-- Logs begin at Sat 2022-10-29 00:09:03 UTC, end at Sat 2022-10-29 02:09:26 UTC. -- Oct 29 00:53:06.539152 n-d-862964-3 systemd[1]: Starting Devstack devstack@n-api.service... Oct 29 00:53:06.547923 n-d-862964-3 devstack@n-api.service[105077]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 29 00:53:06.550468 n-d-862964-3 devstack@n-api.service[105077]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 29 00:53:06 2022] *** Oct 29 00:53:06.550468 n-d-862964-3 devstack@n-api.service[105077]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 29 00:53:06.550468 n-d-862964-3 devstack@n-api.service[105077]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 29 00:53:06.550468 n-d-862964-3 devstack@n-api.service[105077]: nodename: n-d-862964-3 Oct 29 00:53:06.550468 n-d-862964-3 devstack@n-api.service[105077]: machine: x86_64 Oct 29 00:53:06.550468 n-d-862964-3 devstack@n-api.service[105077]: clock source: unix Oct 29 00:53:06.550468 n-d-862964-3 devstack@n-api.service[105077]: pcre jit disabled Oct 29 00:53:06.550468 n-d-862964-3 devstack@n-api.service[105077]: detected number of CPU cores: 4 Oct 29 00:53:06.550468 n-d-862964-3 devstack@n-api.service[105077]: current working directory: / Oct 29 00:53:06.550468 n-d-862964-3 devstack@n-api.service[105077]: detected binary path: /usr/bin/uwsgi-core Oct 29 00:53:06.550468 n-d-862964-3 devstack@n-api.service[105077]: your processes number limit is 47680 Oct 29 00:53:06.550468 n-d-862964-3 devstack@n-api.service[105077]: your memory page size is 4096 bytes Oct 29 00:53:06.550468 n-d-862964-3 devstack@n-api.service[105077]: detected max file descriptor number: 2048 Oct 29 00:53:06.550468 n-d-862964-3 devstack@n-api.service[105077]: lock engine: pthread robust mutexes Oct 29 00:53:06.550468 n-d-862964-3 devstack@n-api.service[105077]: thunder lock: enabled Oct 29 00:53:06.550468 n-d-862964-3 devstack@n-api.service[105077]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 29 00:53:06.550468 n-d-862964-3 devstack@n-api.service[105077]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 29 00:53:06.589240 n-d-862964-3 devstack@n-api.service[105077]: Python main interpreter initialized at 0x560cfd0d39c0 Oct 29 00:53:06.589240 n-d-862964-3 devstack@n-api.service[105077]: python threads support enabled Oct 29 00:53:06.589240 n-d-862964-3 devstack@n-api.service[105077]: your server socket listen backlog is limited to 100 connections Oct 29 00:53:06.589240 n-d-862964-3 devstack@n-api.service[105077]: your mercy for graceful operations on workers is 90 seconds Oct 29 00:53:06.589583 n-d-862964-3 devstack@n-api.service[105077]: mapped 403077 bytes (393 KB) for 2 cores Oct 29 00:53:06.589661 n-d-862964-3 devstack@n-api.service[105077]: *** Operational MODE: preforking *** Oct 29 00:53:06.589908 n-d-862964-3 devstack@n-api.service[105077]: *** uWSGI is running in multiple interpreter mode *** Oct 29 00:53:06.589908 n-d-862964-3 devstack@n-api.service[105077]: spawned uWSGI master process (pid: 105077) Oct 29 00:53:06.590110 n-d-862964-3 systemd[1]: Started Devstack devstack@n-api.service. Oct 29 00:53:06.591768 n-d-862964-3 devstack@n-api.service[105077]: spawned uWSGI worker 1 (pid: 105078, cores: 1) Oct 29 00:53:06.591768 n-d-862964-3 devstack@n-api.service[105077]: spawned uWSGI worker 2 (pid: 105079, cores: 1) Oct 29 00:53:06.591768 n-d-862964-3 devstack@n-api.service[105077]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 29 00:53:07.252792 n-d-862964-3 devstack@n-api.service[105078]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 29 00:53:07.254386 n-d-862964-3 devstack@n-api.service[105079]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 29 00:53:08.330567 n-d-862964-3 devstack@n-api.service[105078]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 00:53:08.330567 n-d-862964-3 devstack@n-api.service[105078]: from cryptography.utils import int_from_bytes Oct 29 00:53:08.331203 n-d-862964-3 devstack@n-api.service[105078]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 00:53:08.331203 n-d-862964-3 devstack@n-api.service[105078]: from cryptography.utils import int_from_bytes Oct 29 00:53:08.335385 n-d-862964-3 devstack@n-api.service[105079]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 00:53:08.335385 n-d-862964-3 devstack@n-api.service[105079]: from cryptography.utils import int_from_bytes Oct 29 00:53:08.335811 n-d-862964-3 devstack@n-api.service[105079]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 00:53:08.335811 n-d-862964-3 devstack@n-api.service[105079]: from cryptography.utils import int_from_bytes Oct 29 00:53:10.843913 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 00:53:10.850812 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 00:53:10.850812 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 00:53:10.850812 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 00:53:10.850812 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 00:53:10.851123 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 00:53:10.851123 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 00:53:10.851537 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.851537 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.851673 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 00:53:10.851745 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.851816 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 00:53:10.851898 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.851971 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 00:53:10.852043 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.852117 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.852189 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.852265 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.852337 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.852411 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.852486 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.852557 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.852632 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.852704 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.852779 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.852851 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.852925 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.852997 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.853074 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862964-3 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.853146 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.853488 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.853560 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.853632 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.853713 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.853786 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.853861 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.853933 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.854004 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862964-3 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.854074 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.854151 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.854223 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.854294 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.854373 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.854449 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.854529 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.854628 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.854628 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.854755 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.854826 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.854906 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.854984 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.855055 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.855055 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.855188 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.855270 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.855337 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.855409 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.855486 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.855561 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.855633 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.855704 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.855777 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.855849 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.855915 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.855979 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.856050 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.856125 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862964-3 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.856197 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.856268 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.856339 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.856405 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.856508 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.856705 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.856808 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.857129 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.857275 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862964-3 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.857461 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.857554 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.857751 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.857867 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.858069 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.858168 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.858390 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.858512 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.858697 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.858806 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.859018 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.859113 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.859335 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.859429 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.859653 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.859747 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.859969 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.860063 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.860269 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.860371 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.860584 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.860694 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.860920 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.861041 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.861269 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.861410 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.861573 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.861718 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.861874 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.862032 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.862123 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.862347 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.862452 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.863222 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.863358 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.863565 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.863832 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.863969 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.864078 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.864224 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.864481 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.864732 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.865060 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.865228 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.865406 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.865517 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.865716 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.865812 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.866024 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.866123 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.866308 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.866403 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.866567 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.866666 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.866940 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.867037 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.867247 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.867339 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.867552 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.867717 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.867855 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.867949 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.868171 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.868265 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.868482 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.868580 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.868793 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.868892 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.869095 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.869240 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.869431 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.869536 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.869743 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.869832 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.870059 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.870146 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.870363 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.870456 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.870687 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.870779 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.870998 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.871091 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.871301 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.871394 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.871617 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.871705 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.871934 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.872028 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.872239 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.872326 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.872541 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.872844 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.873187 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.873287 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.873515 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.873602 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.873816 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.873909 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.874063 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.874160 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.874360 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.874477 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.874658 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.874792 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.874973 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.875105 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.875275 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.875417 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.875575 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.875740 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.875877 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.876081 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.876169 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.876391 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.876484 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.876647 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.876734 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.876952 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.877039 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.877282 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.877371 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.877605 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.877702 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.877921 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.878011 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.878257 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.878361 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.878571 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.878673 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.878873 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.878970 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.879175 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.879262 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.879491 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.879596 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.879806 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.879899 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.880107 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.880193 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.880408 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.880508 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.880713 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.880801 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.881016 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.881102 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.881352 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.881450 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.881653 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.881738 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.881956 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.882043 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.882272 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.882372 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.882573 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.882665 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.882872 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.882963 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.883176 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.883270 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.883476 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.883562 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.883777 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.883863 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.884088 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.884186 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.884383 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.884476 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.884683 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.884768 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.884996 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.885104 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.885320 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.885409 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.885621 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.885715 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.885918 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.886006 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.886215 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.886301 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.886513 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.886606 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.886812 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.886908 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.887109 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.887196 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.887404 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.887491 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.887698 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.887785 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.888010 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.888101 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.888312 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.888405 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.888616 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.888710 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.888913 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.889008 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.889233 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.889335 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.889540 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.889632 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.889845 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.889968 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.890149 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.890249 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.890449 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.890536 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.890769 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.890862 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.891089 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.891183 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.891397 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.891483 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.891705 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.891791 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.892009 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.892172 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.892348 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.892455 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 00:53:10.892634 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.892721 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.892942 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.893031 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.893277 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.893377 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.893585 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.893671 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.893963 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.894061 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.894319 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.894412 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.894593 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.894688 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.894906 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.895008 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.895217 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.895305 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.895527 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.895636 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.895833 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.895921 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.896143 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.896228 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.896455 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.896541 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.896770 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.896856 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.897077 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.897194 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.897431 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.897517 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.897756 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.897850 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.898064 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.898150 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.898381 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.898480 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.898694 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.898781 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.898998 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.899083 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.899305 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.899403 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.899612 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.899699 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.899930 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.900056 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.900241 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.900335 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.900551 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.900644 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.900873 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.900966 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.901210 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.901316 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.901523 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.901877 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.902104 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.902192 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.902411 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.902499 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.902718 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.902805 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.903028 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.903114 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.903335 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.903423 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.903657 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.903742 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.903965 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.904051 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.904282 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.904375 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.904590 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.904675 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.904898 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.904984 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.905231 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.905319 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.905540 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.905635 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.905848 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.905943 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.906154 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.906241 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.906455 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.906552 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.906754 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.906850 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.907052 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.907138 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.907358 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.907445 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.907657 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.907754 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.907971 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.908057 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.908294 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.908384 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.908596 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.908692 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.908906 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.908992 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.909228 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.909844 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.910099 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.910197 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.910473 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.910559 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.910789 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.910876 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.911097 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.911185 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.911419 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.911509 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.911748 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.911834 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.912053 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.912148 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.912376 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.912465 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.912682 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.912769 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.912983 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.913069 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.913328 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.913415 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.913631 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.913717 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.913934 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.914021 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.914244 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.914338 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.914549 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.914643 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.914854 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.914940 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.915161 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.915262 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.915466 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.915630 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.915772 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.915858 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.916081 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.916166 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.916390 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.916485 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.916696 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.916782 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.917015 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.917101 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.917353 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.917453 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.917673 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.917759 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.917988 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.918074 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.918298 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.918395 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.918599 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.918685 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.918907 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.918993 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.919206 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.919301 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.919508 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.919602 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.919808 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.919895 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.920113 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.920201 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.920411 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.920509 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.920710 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.920796 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.921009 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.921096 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.921337 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.921426 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.921637 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.921737 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.921956 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.922043 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.922262 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.922349 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.922562 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.922662 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.922865 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.922952 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.923166 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.923259 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.923472 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.923572 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.923778 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.923872 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.924084 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.924171 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.924388 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.924484 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.924714 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.924801 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.925648 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.925753 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.925965 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.926071 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.926277 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.926373 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.926584 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.926672 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.926920 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.927018 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.927228 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.927322 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.927540 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.927626 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.927857 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.927953 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.928166 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.928254 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.928484 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.928576 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.928791 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.928880 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.929111 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.929288 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.929444 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.929572 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.929761 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.929851 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.930063 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.930156 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.930376 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.930471 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.930697 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.930784 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.931013 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.931100 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.931331 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.931428 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.931643 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.931737 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.931949 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.932034 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.932262 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.932357 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.932569 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.932655 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.932873 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.932964 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.933194 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.933295 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.933504 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.933592 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.933821 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.933909 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.934147 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.934238 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.934444 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.934537 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.934751 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.934839 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.935070 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.935157 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.935376 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.935481 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.935686 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.935772 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.935987 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.936082 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.936297 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.936384 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.936617 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.936711 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.936933 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.937022 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.937259 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.937349 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.937578 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.937677 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.937910 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.937998 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.938222 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.938308 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.938542 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.938637 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.938850 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.938936 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.939157 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.939243 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.939464 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.939559 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.939769 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.939855 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.940079 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.940166 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.940385 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.940480 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.940731 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.940842 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.941168 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.941257 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.941487 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.941576 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.941801 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.941888 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.942102 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.942196 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.942404 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.942492 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.942783 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.942929 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.943048 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.943137 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.943334 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.943484 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.943728 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.943819 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.944048 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.944136 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.944351 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.944447 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.944654 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.944740 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.944975 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.945145 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.945305 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.945383 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.945607 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.945692 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.945912 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.946050 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.946213 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.946301 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.946540 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.946626 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.946850 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.946944 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.947151 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.947239 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.947456 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.947542 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.947768 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.947863 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.948074 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.948167 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.948378 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.948465 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.948684 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.948774 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.948999 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.949101 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.949328 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.949417 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.949642 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.949733 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.949948 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.950036 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.950255 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.950343 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.950563 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.950651 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.950868 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.950954 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.951177 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.951265 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.951489 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.951577 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.951796 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.951881 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.952102 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.952203 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.952409 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.952505 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.952709 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.952796 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.953014 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.953113 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.953351 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.953450 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.953668 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.953916 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.954002 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.954247 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.954334 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.954561 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.954647 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.954877 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.954964 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.955187 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.955280 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.955497 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.955603 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.955810 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.955898 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.956131 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.956781 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.957000 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.957278 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.957391 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.957613 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.957700 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.957917 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.958011 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.958271 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.958414 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.958525 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.958624 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.958827 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.958937 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.959130 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.959279 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.959432 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.959520 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.959737 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.959826 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.960037 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.960131 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.960338 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.960432 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.960638 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.960777 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.960937 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.961027 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.961304 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.961400 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.961607 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.961705 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.961912 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.961999 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.962211 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.962297 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.962519 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.962613 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.962824 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.962911 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.963126 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.963214 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.963429 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.963516 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.963725 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.963818 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.964038 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.964133 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.964344 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.964433 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.964657 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.964751 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.964961 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.965057 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.965311 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.965416 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.965627 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.965718 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.965925 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.966021 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.966231 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.966317 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.966529 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.966616 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.966830 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.966925 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.967129 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.967216 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.967433 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.967520 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.967737 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.967826 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.968035 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.968146 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.968341 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.968456 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.968645 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.968763 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.968951 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.969092 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.969282 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.969426 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.969591 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.969734 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.969871 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.970039 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.970169 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.970350 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.970477 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.970657 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.970780 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.970960 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.971079 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.971272 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.971360 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.971582 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.971669 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.971960 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.972075 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.972273 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.972508 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.972595 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.972818 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.972906 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.973117 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.973253 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.973455 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.973543 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.973755 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.973839 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.974056 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.974145 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.974355 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.974442 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.974662 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.974750 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.974969 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.975063 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.975264 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.975350 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.975574 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.975668 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.975878 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.975973 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.976175 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.976273 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.976477 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.976574 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.976778 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.976866 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.977075 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.977187 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.977399 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.977496 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.977704 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.977792 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.978013 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.978104 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.978323 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.978423 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.978621 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.978708 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.978928 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.979027 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.979224 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.979321 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.979524 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.979660 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.979822 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.979911 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.980123 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.980218 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.980418 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.980505 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.980715 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.980803 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.981010 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.981107 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.981331 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.981420 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.981628 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.981725 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.981947 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.982034 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.982250 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.982336 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.982549 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.982637 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.982849 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.982938 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.983147 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.983234 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.983447 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.983533 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.983749 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.983838 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.984054 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.984142 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.984358 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.984454 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.984681 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.984768 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.984997 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.985121 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.985326 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.985458 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.985650 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.985738 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.985933 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.986036 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.986234 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.986350 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.986549 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.986644 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.986856 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.986944 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.987167 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.987264 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.988011 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.988119 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.988328 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.988467 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.988641 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.988739 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.988954 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.989045 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.989295 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.989398 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.989606 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.989709 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.989927 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.990022 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.990233 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.990329 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.990552 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.990652 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.990856 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.990961 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.991159 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.991265 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.991463 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.991558 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.991771 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.991859 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.992078 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.992165 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.992401 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.992494 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.992700 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.992788 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.993009 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.993105 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.993343 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.993430 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.993657 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.993743 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.993962 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.994060 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.994269 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.994357 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.994576 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.994664 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.994876 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.994972 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.995186 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.995271 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.995492 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.995586 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.995792 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.995894 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.996097 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.996184 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.996396 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.996483 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.996703 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.996799 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.996998 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.997086 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.997334 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.997456 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.997643 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.997769 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.997974 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.998061 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.998287 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.998374 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.998593 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.998683 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.998905 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.998993 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.999209 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.999306 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.999519 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.999608 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.999823 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:10.999911 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.000233 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.000326 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.000543 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.000639 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.000852 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.000953 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.001175 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.001278 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.001480 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.001567 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.001779 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.001866 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.002091 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.002187 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.002402 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.002488 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.002700 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.002787 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.002999 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.003190 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.003515 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.003628 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.003828 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.003918 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.004131 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.004219 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.004435 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.004526 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.004739 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.004852 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.005053 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.005181 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.005406 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.005494 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.005714 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.005876 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.006018 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.006187 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.006321 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.006493 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.006644 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.006811 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.006948 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.007131 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.007268 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.007453 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.007691 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.007787 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.008003 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.008100 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.008307 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.008403 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.008647 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.008734 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.008966 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.009133 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.009284 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.009374 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.009596 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.009697 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.009896 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.009993 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.010215 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.010311 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.010537 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.010629 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.010851 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.010959 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.011167 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.011295 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.011493 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.011582 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.011818 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.011919 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.012129 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.012216 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.012442 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.012530 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.012747 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.012836 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.013071 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.013179 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.013401 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.013500 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.013710 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.013799 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.014012 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.014100 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.014316 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.014435 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.014637 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.014761 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.014938 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.015076 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.015245 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.015399 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.015551 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.015728 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.015857 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.016035 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.016158 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.016341 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.016454 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.016653 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.016773 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.016958 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.017073 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.017289 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.017415 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.017622 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.017712 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.017929 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.018021 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.018241 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.018337 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.018554 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.018642 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.019410 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.019518 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.019774 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.019906 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.020070 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.020176 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.020371 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.020497 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.020671 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.020805 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.021008 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.021130 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.021337 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.021468 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.021657 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.021795 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.021984 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.022121 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.022309 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.022429 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.022622 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.022754 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.022951 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.023069 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.023271 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.023372 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.023588 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.023685 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.023892 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.023981 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.024205 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.024294 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.024526 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.024614 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.024827 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.024925 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.025125 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.025304 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.025455 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.025544 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.025755 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.025843 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.026056 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.026181 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.026354 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.026511 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.026914 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.027092 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.027214 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.027406 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.027494 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.027728 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.027815 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.028061 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.028151 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.028367 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.028455 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.028674 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.028761 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.028979 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.029067 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.029301 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.029406 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.029605 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.029705 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.029900 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.029989 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.030208 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.030297 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.030512 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.030600 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.030816 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.030908 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.031119 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.031216 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.031434 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.031529 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.031737 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.031823 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.032045 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.032138 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.032357 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.032462 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.032662 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.032757 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.032969 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.033058 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.033301 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.033405 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.033613 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.033701 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.033915 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.034012 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.034225 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.034321 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.034614 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.034724 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.034940 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.035037 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.035254 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.035547 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.035638 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.035874 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.035961 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.036183 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.036280 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.036494 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.036583 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.036802 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.036892 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.037111 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.037262 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.037447 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.037536 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.037771 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.037892 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.038088 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.038186 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.038407 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.038568 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.038883 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.038971 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.039210 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.039301 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.039528 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.039632 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.039848 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.039947 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.040161 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.040251 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.040473 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.040561 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.040783 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.040871 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.041094 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.041203 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.041432 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.041520 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.041743 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.041857 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.042056 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.042146 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.042372 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.042461 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.042688 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.042790 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.042998 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.043088 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.043307 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.043396 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.043615 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.043704 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.043922 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.044017 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.044231 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.044320 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.044539 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.044628 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.044846 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.044934 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.045178 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.045281 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.045483 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.045573 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.045794 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.045882 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.046114 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.046210 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.046429 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.046516 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.046744 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.046831 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.047052 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.047147 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.047362 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.047459 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.047674 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.047762 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.047985 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.048186 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.048299 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.048500 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.048616 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.048827 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.048923 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.049148 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.049257 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.049491 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.049579 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.049807 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.050465 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.050658 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.050828 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.050963 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.051238 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.051333 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.051557 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.051645 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.051865 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.052079 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.052168 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.052402 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.052492 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.052739 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.052829 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.053049 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.053136 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.053373 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.053464 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.053687 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.053777 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.053990 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.054078 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.054341 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.054516 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.054652 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.054865 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.054966 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.055180 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.055276 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.055506 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.055602 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.055831 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.055919 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.056146 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.056234 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.056451 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.056550 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.056754 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.056842 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.057066 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.057213 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.057395 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.057487 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.057708 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.057946 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.058049 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.058297 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.058393 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.058595 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.058687 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.058901 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.058990 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.059204 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.059309 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.059502 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.059589 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.059807 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.059896 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.060107 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.060212 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.060426 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.060515 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.060726 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.060816 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.061027 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.061123 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.061360 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.061515 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.061655 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.061746 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.061954 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.062046 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.062253 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.062356 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.062552 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.062648 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.062849 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.062938 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.063157 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.063253 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.063454 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.063541 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.063758 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.063853 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.064056 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.064153 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.064363 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.064459 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.064669 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.064757 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.064982 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.065078 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.065309 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.065409 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.065684 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.065781 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.066062 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.066308 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.066469 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.066619 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.066778 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.066926 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.067095 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.067237 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.067405 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.067542 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.067729 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.067861 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.068041 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.068215 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.068350 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.068529 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.068694 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.068836 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.069000 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.069179 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.069490 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.069578 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.069797 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.069885 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.070115 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.070204 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.070427 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.070515 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.070751 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.070846 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.071064 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.071165 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.071377 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.071466 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.071676 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.071777 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.072000 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.072088 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.072310 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.072552 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.072640 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.072894 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.072983 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.073230 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.073321 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.073545 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.073645 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.073851 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.073940 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.074157 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.074246 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.074463 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.074565 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.074768 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.074857 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.075073 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.075169 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.075379 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.075476 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.075682 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.075770 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.075986 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.076074 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.076290 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.076380 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.076599 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.076684 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.076911 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.077009 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.077253 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.077356 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.077567 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.077654 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.077878 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.077965 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.078187 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.078281 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.078493 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.078587 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.078800 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.078888 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.079104 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.079193 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.079408 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.079504 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.079718 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.079816 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.080043 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.080131 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.080350 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.080437 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.080650 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.080794 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.080970 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.081834 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.081949 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.082153 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.082275 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.082464 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.082554 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.082777 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.082864 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.083089 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.083189 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.083406 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.083493 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.083729 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.083817 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.084042 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.084138 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.084349 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.084477 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.084654 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.084979 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.085073 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.085336 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.085437 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.085664 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.085752 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.085987 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.086083 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.086290 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.086379 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.086591 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.086679 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.086892 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.086988 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.087196 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.087283 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.087508 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.087592 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.087814 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.087920 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.088112 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.088200 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.088410 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.088497 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.088714 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.088810 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.089010 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.089098 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.089338 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.089429 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.089637 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.089726 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.089936 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.090024 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.090239 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.090327 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.090536 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.090625 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.090834 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.090921 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.091132 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.091219 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.091430 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.091526 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.091727 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.091822 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.092026 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.092123 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.092334 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.092448 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.092626 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.092719 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.092925 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.093022 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.093243 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.093336 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.093543 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.093631 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.093840 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.093989 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.094142 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.094239 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.094448 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.094575 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.094756 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.094859 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.095060 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.095147 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.095370 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.095459 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.095676 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.095765 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.095980 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.096066 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.096280 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.096366 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.096584 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.096673 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.096978 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.097092 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.097315 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.097486 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.097638 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.097831 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.097943 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.098158 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.098257 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.098485 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.098650 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.098800 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.098888 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.099126 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.099214 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.099430 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.099526 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.099753 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.099839 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.100070 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.100157 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.100372 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.100462 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.100685 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.100779 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.100996 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.101093 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.101336 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.101428 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.101648 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.101736 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.101951 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.102051 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.102263 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.102350 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.102566 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.102652 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.102871 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.102975 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.103175 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.103264 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.103481 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.103569 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.103787 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.103882 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.104103 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.104197 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.104408 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.104503 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.104714 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.104803 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.105025 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.105112 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.105361 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.105448 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.105682 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.105784 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.105995 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.106082 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.106298 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.106384 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.106609 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.106703 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.106923 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.107010 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.107237 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.107333 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.107556 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.107644 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.107871 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.107960 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.108191 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.108288 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.108501 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.108595 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.108811 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.108899 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.109111 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.109229 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.109374 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 00:53:11.109490 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.109803 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.110133 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.110463 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.110812 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.111127 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.111473 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.111807 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.112126 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.112441 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.113398 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 00:53:11.113648 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 00:53:11.264689 n-d-862964-3 devstack@n-api.service[105078]: INFO dbcounter [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] Registered counter for database nova_api Oct 29 00:53:11.266244 n-d-862964-3 devstack@n-api.service[105079]: INFO dbcounter [None req-55226b18-178f-4699-84e4-ef3e8bd9ab86 None None] Registered counter for database nova_api Oct 29 00:53:11.286461 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_db.sqlalchemy.engines [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105078) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 00:53:11.289959 n-d-862964-3 devstack@n-api.service[105079]: DEBUG oslo_db.sqlalchemy.engines [None req-55226b18-178f-4699-84e4-ef3e8bd9ab86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105079) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 00:53:11.293049 n-d-862964-3 devstack@n-api.service[105078]: DEBUG dbcounter [-] [105078] Writer thread running {{(pid=105078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 00:53:11.296627 n-d-862964-3 devstack@n-api.service[105079]: DEBUG dbcounter [-] [105079] Writer thread running {{(pid=105079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 00:53:11.351151 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.context [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),584133c9-70d9-4dbd-88ec-66308eedb7a2(cell1) {{(pid=105078) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 00:53:11.353816 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.context [None req-55226b18-178f-4699-84e4-ef3e8bd9ab86 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),584133c9-70d9-4dbd-88ec-66308eedb7a2(cell1) {{(pid=105079) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 00:53:11.354928 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_concurrency.lockutils [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105078) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 00:53:11.355401 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_concurrency.lockutils [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105078) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 00:53:11.356997 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_concurrency.lockutils [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105078) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 00:53:11.357667 n-d-862964-3 devstack@n-api.service[105079]: DEBUG oslo_concurrency.lockutils [None req-55226b18-178f-4699-84e4-ef3e8bd9ab86 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 00:53:11.357765 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_concurrency.lockutils [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105078) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 00:53:11.358145 n-d-862964-3 devstack@n-api.service[105079]: DEBUG oslo_concurrency.lockutils [None req-55226b18-178f-4699-84e4-ef3e8bd9ab86 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 00:53:11.358237 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_concurrency.lockutils [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105078) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 00:53:11.359758 n-d-862964-3 devstack@n-api.service[105079]: DEBUG oslo_concurrency.lockutils [None req-55226b18-178f-4699-84e4-ef3e8bd9ab86 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 00:53:11.360124 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_concurrency.lockutils [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105078) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 00:53:11.360472 n-d-862964-3 devstack@n-api.service[105079]: DEBUG oslo_concurrency.lockutils [None req-55226b18-178f-4699-84e4-ef3e8bd9ab86 None None] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 00:53:11.360922 n-d-862964-3 devstack@n-api.service[105079]: DEBUG oslo_concurrency.lockutils [None req-55226b18-178f-4699-84e4-ef3e8bd9ab86 None None] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 00:53:11.362121 n-d-862964-3 devstack@n-api.service[105078]: INFO dbcounter [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] Registered counter for database nova_cell0 Oct 29 00:53:11.363553 n-d-862964-3 devstack@n-api.service[105079]: DEBUG oslo_concurrency.lockutils [None req-55226b18-178f-4699-84e4-ef3e8bd9ab86 None None] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 00:53:11.365575 n-d-862964-3 devstack@n-api.service[105079]: INFO dbcounter [None req-55226b18-178f-4699-84e4-ef3e8bd9ab86 None None] Registered counter for database nova_cell0 Oct 29 00:53:11.366981 n-d-862964-3 devstack@n-api.service[105078]: INFO dbcounter [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] Registered counter for database nova_cell1 Oct 29 00:53:11.369642 n-d-862964-3 devstack@n-api.service[105079]: INFO dbcounter [None req-55226b18-178f-4699-84e4-ef3e8bd9ab86 None None] Registered counter for database nova_cell1 Oct 29 00:53:11.374400 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_db.sqlalchemy.engines [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105078) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 00:53:11.376152 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_db.sqlalchemy.engines [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105078) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 00:53:11.377698 n-d-862964-3 devstack@n-api.service[105079]: DEBUG oslo_db.sqlalchemy.engines [None req-55226b18-178f-4699-84e4-ef3e8bd9ab86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105079) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 00:53:11.380186 n-d-862964-3 devstack@n-api.service[105079]: DEBUG oslo_db.sqlalchemy.engines [None req-55226b18-178f-4699-84e4-ef3e8bd9ab86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105079) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 00:53:11.381685 n-d-862964-3 devstack@n-api.service[105078]: DEBUG dbcounter [-] [105078] Writer thread running {{(pid=105078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 00:53:11.387185 n-d-862964-3 devstack@n-api.service[105079]: DEBUG dbcounter [-] [105079] Writer thread running {{(pid=105079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 00:53:11.388670 n-d-862964-3 devstack@n-api.service[105079]: DEBUG dbcounter [-] [105079] Writer thread running {{(pid=105079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 00:53:11.516875 n-d-862964-3 devstack@n-api.service[105078]: DEBUG dbcounter [-] [105078] Writer thread running {{(pid=105078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 00:53:11.527283 n-d-862964-3 devstack@n-api.service[105078]: INFO dbcounter [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] Registered counter for database nova_cell0 Oct 29 00:53:11.533863 n-d-862964-3 devstack@n-api.service[105079]: INFO dbcounter [None req-55226b18-178f-4699-84e4-ef3e8bd9ab86 None None] Registered counter for database nova_cell0 Oct 29 00:53:11.535679 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_db.sqlalchemy.engines [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105078) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 00:53:11.540502 n-d-862964-3 devstack@n-api.service[105078]: DEBUG dbcounter [-] [105078] Writer thread running {{(pid=105078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 00:53:11.543144 n-d-862964-3 devstack@n-api.service[105079]: DEBUG oslo_db.sqlalchemy.engines [None req-55226b18-178f-4699-84e4-ef3e8bd9ab86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105079) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 00:53:11.547827 n-d-862964-3 devstack@n-api.service[105079]: DEBUG dbcounter [-] [105079] Writer thread running {{(pid=105079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 00:53:11.950152 n-d-862964-3 devstack@n-api.service[105078]: WARNING keystonemiddleware.auth_token [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 00:53:11.958010 n-d-862964-3 devstack@n-api.service[105078]: WARNING keystonemiddleware.auth_token [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 00:53:11.995785 n-d-862964-3 devstack@n-api.service[105079]: WARNING keystonemiddleware.auth_token [None req-55226b18-178f-4699-84e4-ef3e8bd9ab86 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 00:53:12.003039 n-d-862964-3 devstack@n-api.service[105079]: WARNING keystonemiddleware.auth_token [None req-55226b18-178f-4699-84e4-ef3e8bd9ab86 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 00:53:12.301664 n-d-862964-3 devstack@n-api.service[105078]: WARNING keystonemiddleware.auth_token [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 00:53:12.307605 n-d-862964-3 devstack@n-api.service[105078]: WARNING keystonemiddleware.auth_token [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 00:53:12.312885 n-d-862964-3 devstack@n-api.service[105078]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560cfd0d39c0 pid: 105078 (default app) Oct 29 00:53:12.314957 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:53:12.317075 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002647 Oct 29 00:53:12.317505 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Sat Oct 29 00:53:12 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:53:12.348253 n-d-862964-3 devstack@n-api.service[105079]: WARNING keystonemiddleware.auth_token [None req-55226b18-178f-4699-84e4-ef3e8bd9ab86 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 00:53:12.354262 n-d-862964-3 devstack@n-api.service[105079]: WARNING keystonemiddleware.auth_token [None req-55226b18-178f-4699-84e4-ef3e8bd9ab86 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 00:53:12.359538 n-d-862964-3 devstack@n-api.service[105079]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560cfd0d39c0 pid: 105079 (default app) Oct 29 00:54:36.822080 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:54:36.823709 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002070 Oct 29 00:54:36.824112 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 29 00:54:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:54:36.836671 n-d-862964-3 devstack@n-api.service[105079]: DEBUG dbcounter [-] [105079] Writing DB stats nova_api:SELECT=3 {{(pid=105079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 00:54:36.837929 n-d-862964-3 devstack@n-api.service[105079]: DEBUG dbcounter [-] [105079] Writing DB stats nova_cell0:SELECT=3 {{(pid=105079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 00:54:36.838744 n-d-862964-3 devstack@n-api.service[105079]: DEBUG dbcounter [-] [105079] Writing DB stats nova_cell1:SELECT=3 {{(pid=105079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 00:54:36.840777 n-d-862964-3 devstack@n-api.service[105079]: DEBUG dbcounter [-] [105079] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 00:54:37.718872 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-5b1f668e-a92d-4507-94c1-d374251ee83e admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:54:37.752154 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-5b1f668e-a92d-4507-94c1-d374251ee83e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.921292 Oct 29 00:54:37.752938 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 29 00:54:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 00:54:40.418199 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:54:40.419084 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-cfa15042-ecba-4d24-bcdb-9a36c0058cae None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Oct 29 00:54:40.420835 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 29 00:54:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:54:40.891158 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-43ad6a02-9dca-4d7b-9f38-494ead857ee6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "os-flavor-access:is_public": true, "ram": 256, "rxtx_factor": 1.0, "name": "cirros256", "disk": 1, "vcpus": 1}} {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:54:40.988069 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-43ad6a02-9dca-4d7b-9f38-494ead857ee6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.562017 Oct 29 00:54:40.988933 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 29 00:54:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 00:54:41.002634 n-d-862964-3 devstack@n-api.service[105078]: DEBUG dbcounter [-] [105078] Writing DB stats nova_api:SELECT=3 {{(pid=105078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 00:54:41.003450 n-d-862964-3 devstack@n-api.service[105078]: DEBUG dbcounter [-] [105078] Writing DB stats nova_cell0:SELECT=3 {{(pid=105078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 00:54:41.005626 n-d-862964-3 devstack@n-api.service[105078]: DEBUG dbcounter [-] [105078] Writing DB stats nova_cell1:SELECT=3 {{(pid=105078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 00:54:41.006392 n-d-862964-3 devstack@n-api.service[105078]: DEBUG dbcounter [-] [105078] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 00:54:41.215003 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-039cc4a1-5503-41a0-b11b-7b4afe69ce66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:54:41.323709 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-039cc4a1-5503-41a0-b11b-7b4afe69ce66 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.326307 Oct 29 00:54:41.324302 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Oct 29 00:54:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 00:54:43.992690 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-43ad6a02-9dca-4d7b-9f38-494ead857ee6 admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:54:43.993938 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-43ad6a02-9dca-4d7b-9f38-494ead857ee6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001701 Oct 29 00:54:43.994441 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 29 00:54:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:54:44.825929 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-ee5e7d28-9ed6-4ae2-9486-0d9fa61889d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M", "disk": 5, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:54:44.961680 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-ee5e7d28-9ed6-4ae2-9486-0d9fa61889d5 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.957154 Oct 29 00:54:44.962896 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 29 00:54:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 00:54:44.976186 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-7c7b40c8-722b-4a80-aca3-3d093ecbac61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:54:45.126033 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-7c7b40c8-722b-4a80-aca3-3d093ecbac61 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.154132 Oct 29 00:54:45.133833 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Oct 29 00:54:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 00:54:48.008513 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-ee5e7d28-9ed6-4ae2-9486-0d9fa61889d5 admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:54:48.009640 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-ee5e7d28-9ed6-4ae2-9486-0d9fa61889d5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 29 00:54:48.010259 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 29 00:54:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:54:48.523512 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-805b9c61-0e0b-479c-a03b-08ecdc8d3fb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "swap": 0, "ram": 1024, "id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G"}} {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:54:48.682752 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-805b9c61-0e0b-479c-a03b-08ecdc8d3fb5 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.664801 Oct 29 00:54:48.683619 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 29 00:54:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 00:54:48.696469 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-c667442a-eacc-4228-a435-26851b9ca336 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:54:48.770910 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-c667442a-eacc-4228-a435-26851b9ca336 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078591 Oct 29 00:54:48.771486 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Oct 29 00:54:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 00:54:51.431452 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-805b9c61-0e0b-479c-a03b-08ecdc8d3fb5 admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:54:51.432474 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-805b9c61-0e0b-479c-a03b-08ecdc8d3fb5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 29 00:54:51.432879 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 29 00:54:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:54:51.917262 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-f5d19e6d-4101-4564-a0cb-1813cda2e5ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "name": "ds2G", "disk": 10}} {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:54:51.991276 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-f5d19e6d-4101-4564-a0cb-1813cda2e5ee admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.551538 Oct 29 00:54:51.991835 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 29 00:54:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 00:54:52.012277 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-c2047b7b-b6c5-4e62-999c-24b885092e75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:54:52.091421 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-c2047b7b-b6c5-4e62-999c-24b885092e75 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090384 Oct 29 00:54:52.092212 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Oct 29 00:54:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 00:54:54.872258 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-f5d19e6d-4101-4564-a0cb-1813cda2e5ee admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:54:54.873880 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-f5d19e6d-4101-4564-a0cb-1813cda2e5ee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002180 Oct 29 00:54:54.874452 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 29 00:54:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:54:55.346063 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-46bc03b6-2d5c-49db-9b22-6a07fc0d282e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:54:55.431988 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-46bc03b6-2d5c-49db-9b22-6a07fc0d282e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.550870 Oct 29 00:54:55.442049 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 29 00:54:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 00:54:55.445793 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-cdeda49e-4cf6-4523-859c-f901ddc4d981 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:54:55.543106 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-cdeda49e-4cf6-4523-859c-f901ddc4d981 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101178 Oct 29 00:54:55.544465 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Oct 29 00:54:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 00:54:58.342042 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-46bc03b6-2d5c-49db-9b22-6a07fc0d282e admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:54:58.343065 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-46bc03b6-2d5c-49db-9b22-6a07fc0d282e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Oct 29 00:54:58.343470 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 29 00:54:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 00:54:58.823346 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-9e0785e8-d5cc-44a4-8397-cf4f46fbd0fb admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:54:58.848425 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-9e0785e8-d5cc-44a4-8397-cf4f46fbd0fb admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.496695 Oct 29 00:54:58.848966 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 29 00:54:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 00:55:01.858234 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-46bc03b6-2d5c-49db-9b22-6a07fc0d282e admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:01.859447 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-46bc03b6-2d5c-49db-9b22-6a07fc0d282e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001759 Oct 29 00:55:01.859937 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 29 00:55:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 00:55:02.326924 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-40ccb78a-51b2-42cb-b671-82f7b248e45d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1", "vcpus": 1}} {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:55:02.390742 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-40ccb78a-51b2-42cb-b671-82f7b248e45d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.524264 Oct 29 00:55:02.391337 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 29 00:55:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 00:55:02.405045 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-0a22a1a4-8cf1-4559-accd-0a429f77bf1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:55:02.515116 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-0a22a1a4-8cf1-4559-accd-0a429f77bf1f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114240 Oct 29 00:55:02.515657 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Oct 29 00:55:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 00:55:05.143928 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-40ccb78a-51b2-42cb-b671-82f7b248e45d admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:05.144961 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-40ccb78a-51b2-42cb-b671-82f7b248e45d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Oct 29 00:55:05.145391 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 29 00:55:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:55:05.544248 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-4b5d60bc-50e2-493b-bcc2-cce79d6f59ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "id": "2", "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:55:05.613589 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-4b5d60bc-50e2-493b-bcc2-cce79d6f59ed admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.461343 Oct 29 00:55:05.614161 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 29 00:55:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 00:55:05.626377 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-04d60d48-b66b-404e-a3f7-2c055f8446e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:55:05.725315 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-04d60d48-b66b-404e-a3f7-2c055f8446e8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102748 Oct 29 00:55:05.728045 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Oct 29 00:55:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 00:55:08.381729 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-4b5d60bc-50e2-493b-bcc2-cce79d6f59ed admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:08.382753 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-4b5d60bc-50e2-493b-bcc2-cce79d6f59ed admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Oct 29 00:55:08.383161 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 29 00:55:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:55:08.777560 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-7918deb4-4802-4940-a520-1d9bcc060900 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 40, "name": "m1.medium", "vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:55:09.522859 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-7918deb4-4802-4940-a520-1d9bcc060900 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.133694 Oct 29 00:55:09.523409 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 29 00:55:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 00:55:09.537841 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-25dbdfff-c29a-415c-9b2b-d3f62c31dba3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:55:09.555608 n-d-862964-3 devstack@n-api.service[105079]: DEBUG dbcounter [-] [105079] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 00:55:09.651095 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-25dbdfff-c29a-415c-9b2b-d3f62c31dba3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118711 Oct 29 00:55:09.652103 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Oct 29 00:55:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 00:55:12.282872 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-7918deb4-4802-4940-a520-1d9bcc060900 admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:12.285282 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-7918deb4-4802-4940-a520-1d9bcc060900 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 29 00:55:12.286174 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 29 00:55:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:55:12.743960 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-c55e58f5-761e-41f7-b231-06f22dc496d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "id": "4", "ram": 8192}} {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:55:12.801962 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-c55e58f5-761e-41f7-b231-06f22dc496d0 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.509475 Oct 29 00:55:12.802863 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 29 00:55:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 00:55:12.814465 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-3e4cb610-0784-4840-a0fd-367f3d537f80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:55:12.821557 n-d-862964-3 devstack@n-api.service[105078]: DEBUG dbcounter [-] [105078] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 00:55:12.918098 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-3e4cb610-0784-4840-a0fd-367f3d537f80 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107149 Oct 29 00:55:12.918775 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Oct 29 00:55:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 00:55:15.570351 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-c55e58f5-761e-41f7-b231-06f22dc496d0 admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:15.571371 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-c55e58f5-761e-41f7-b231-06f22dc496d0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 29 00:55:15.571764 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 29 00:55:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:55:16.028694 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-70ab4e20-2593-4821-8a60-fa86888b52e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "swap": 0, "name": "m1.xlarge", "id": "5", "vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true}} {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:55:16.116350 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-70ab4e20-2593-4821-8a60-fa86888b52e7 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.538459 Oct 29 00:55:16.121201 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 29 00:55:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 00:55:16.130728 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-7dd94d1e-0bb8-422f-b11f-256bbd375479 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:55:16.230722 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-7dd94d1e-0bb8-422f-b11f-256bbd375479 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104617 Oct 29 00:55:16.231781 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Oct 29 00:55:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 00:55:36.304728 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-70ab4e20-2593-4821-8a60-fa86888b52e7 admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:36.305704 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-70ab4e20-2593-4821-8a60-fa86888b52e7 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Oct 29 00:55:36.306098 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 29 00:55:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:55:36.316478 n-d-862964-3 devstack@n-api.service[105079]: DEBUG dbcounter [-] [105079] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 00:55:36.711302 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-598274eb-48f4-40e8-aaee-5ac8522dc736 admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:36.730375 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-598274eb-48f4-40e8-aaee-5ac8522dc736 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.418308 Oct 29 00:55:36.731162 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 29 00:55:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 00:55:38.031467 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-70ab4e20-2593-4821-8a60-fa86888b52e7 admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:38.032489 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-70ab4e20-2593-4821-8a60-fa86888b52e7 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 29 00:55:38.032878 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 29 00:55:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:55:38.583619 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-1579ba1b-b979-4963-bfb1-2ece6e29f9ea admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:38.588858 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.wsgi [None req-1579ba1b-b979-4963-bfb1-2ece6e29f9ea admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-1579ba1b-b979-4963-bfb1-2ece6e29f9ea admin admin] Request method failure captured: Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: Accept: application/json Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: Accept-Encoding: gzip, deflate Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: Connection: keep-alive Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: Content-Length: 0 Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: Host: 10.222.0.26 Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: Openstack-Api-Version: compute 2.92 Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: Openstack-System-Scope: None Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: User-Agent: python-novaclient Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: X-Auth-Token: gAAAAABjXHoJN_ABJZB8AiPD_XTOnKow2ISy1xroTWI_TzI4xiSIeWuLIUZ9SuPz1RK2at2LAfUL4txe9lKaJFkCC8umwyxMeemS6mic5Z6bJ5TbdvTV5N9jUhDtakzCc7-fnAdpeoqC4gGT-RItKuPligKVz4IQYZ_aVSXaILivfRtKzzCJaQc Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: X-Domain-Id: None Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: X-Domain-Name: None Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: X-Identity-Status: Confirmed Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: X-Is-Admin-Project: True Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: X-Project-Domain-Id: default Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: X-Project-Domain-Name: Default Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: X-Project-Id: 012def6fc4104ffda070bc0506cf79c5 Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: X-Project-Name: admin Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: X-Role: member,admin,reader Oct 29 00:55:38.592072 n-d-862964-3 devstack@n-api.service[105079]: X-Roles: member,admin,reader Oct 29 00:55:38.593665 n-d-862964-3 devstack@n-api.service[105079]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/012def6fc4104ffda070bc0506cf79c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/012def6fc4104ffda070bc0506cf79c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/012def6fc4104ffda070bc0506cf79c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_012def6fc4104ffda070bc0506cf79c5", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 00:55:38.593665 n-d-862964-3 devstack@n-api.service[105079]: X-Tenant: admin Oct 29 00:55:38.593665 n-d-862964-3 devstack@n-api.service[105079]: X-Tenant-Id: 012def6fc4104ffda070bc0506cf79c5 Oct 29 00:55:38.593665 n-d-862964-3 devstack@n-api.service[105079]: X-Tenant-Name: admin Oct 29 00:55:38.593665 n-d-862964-3 devstack@n-api.service[105079]: X-User: admin Oct 29 00:55:38.593665 n-d-862964-3 devstack@n-api.service[105079]: X-User-Domain-Id: default Oct 29 00:55:38.593665 n-d-862964-3 devstack@n-api.service[105079]: X-User-Domain-Name: Default Oct 29 00:55:38.593665 n-d-862964-3 devstack@n-api.service[105079]: X-User-Id: 8a6df006c993489995e1473bbe6c1dfa Oct 29 00:55:38.593665 n-d-862964-3 devstack@n-api.service[105079]: X-User-Name: admin Oct 29 00:55:38.593665 n-d-862964-3 devstack@n-api.service[105079]: method: > Oct 29 00:55:38.593665 n-d-862964-3 devstack@n-api.service[105079]: exception: Flavor 42 could not be found. Oct 29 00:55:38.593665 n-d-862964-3 devstack@n-api.service[105079]: action_args: {'id': '42'} Oct 29 00:55:38.593665 n-d-862964-3 devstack@n-api.service[105079]: {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 00:55:38.593665 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 00:55:38.594699 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 00:55:38.594699 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 00:55:38.594699 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 00:55:38.594699 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 00:55:38.594699 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 00:55:38.594699 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 00:55:38.594699 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 00:55:38.594699 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 00:55:38.594699 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 00:55:38.594699 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 00:55:38.594699 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 00:55:38.594699 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 00:55:38.594699 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 29 00:55:38.594699 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Oct 29 00:55:38.594699 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 00:55:38.594699 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Oct 29 00:55:38.594699 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 00:55:38.594699 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 00:55:38.594699 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 00:55:38.596277 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 00:55:38.596277 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 00:55:38.596277 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 00:55:38.596277 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 00:55:38.596277 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 00:55:38.596277 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 00:55:38.596277 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 29 00:55:38.596277 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Oct 29 00:55:38.596277 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 00:55:38.596277 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Oct 29 00:55:38.596277 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 00:55:38.596277 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 00:55:38.596277 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 00:55:38.596277 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 00:55:38.596277 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 00:55:38.596277 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 29 00:55:38.596277 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Oct 29 00:55:38.596277 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-1579ba1b-b979-4963-bfb1-2ece6e29f9ea admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 00:55:38.597584 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-1579ba1b-b979-4963-bfb1-2ece6e29f9ea admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.403021 Oct 29 00:55:38.597584 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Oct 29 00:55:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 00:55:38.603733 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-2abba108-c0a4-43ba-920e-5f8bc35b58cc admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:38.607766 n-d-862964-3 devstack@n-api.service[105078]: DEBUG dbcounter [-] [105078] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 00:55:38.626744 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-2abba108-c0a4-43ba-920e-5f8bc35b58cc admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026582 Oct 29 00:55:38.627286 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Oct 29 00:55:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 00:55:38.638535 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-27dc38ea-57fb-4fa9-9e1f-56a5faf1becf admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:38.660427 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-27dc38ea-57fb-4fa9-9e1f-56a5faf1becf admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026500 Oct 29 00:55:38.661529 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Oct 29 00:55:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 00:55:38.671106 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-5cc3ad83-4466-496f-8010-d567e79a64be admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:38.677505 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.wsgi [None req-5cc3ad83-4466-496f-8010-d567e79a64be admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-5cc3ad83-4466-496f-8010-d567e79a64be admin admin] Request method failure captured: Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: Accept: application/json Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: Accept-Encoding: gzip, deflate Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: Connection: keep-alive Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: Content-Length: 0 Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: Host: 10.222.0.26 Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: Openstack-Api-Version: compute 2.92 Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: Openstack-System-Scope: None Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: User-Agent: python-novaclient Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: X-Auth-Token: gAAAAABjXHoJN_ABJZB8AiPD_XTOnKow2ISy1xroTWI_TzI4xiSIeWuLIUZ9SuPz1RK2at2LAfUL4txe9lKaJFkCC8umwyxMeemS6mic5Z6bJ5TbdvTV5N9jUhDtakzCc7-fnAdpeoqC4gGT-RItKuPligKVz4IQYZ_aVSXaILivfRtKzzCJaQc Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: X-Domain-Id: None Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: X-Domain-Name: None Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: X-Identity-Status: Confirmed Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: X-Is-Admin-Project: True Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: X-Project-Domain-Id: default Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: X-Project-Domain-Name: Default Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: X-Project-Id: 012def6fc4104ffda070bc0506cf79c5 Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: X-Project-Name: admin Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: X-Role: member,admin,reader Oct 29 00:55:38.680751 n-d-862964-3 devstack@n-api.service[105078]: X-Roles: member,admin,reader Oct 29 00:55:38.685356 n-d-862964-3 devstack@n-api.service[105078]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/012def6fc4104ffda070bc0506cf79c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/012def6fc4104ffda070bc0506cf79c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/012def6fc4104ffda070bc0506cf79c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_012def6fc4104ffda070bc0506cf79c5", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 00:55:38.685356 n-d-862964-3 devstack@n-api.service[105078]: X-Tenant: admin Oct 29 00:55:38.685356 n-d-862964-3 devstack@n-api.service[105078]: X-Tenant-Id: 012def6fc4104ffda070bc0506cf79c5 Oct 29 00:55:38.685356 n-d-862964-3 devstack@n-api.service[105078]: X-Tenant-Name: admin Oct 29 00:55:38.685356 n-d-862964-3 devstack@n-api.service[105078]: X-User: admin Oct 29 00:55:38.685356 n-d-862964-3 devstack@n-api.service[105078]: X-User-Domain-Id: default Oct 29 00:55:38.685356 n-d-862964-3 devstack@n-api.service[105078]: X-User-Domain-Name: Default Oct 29 00:55:38.685356 n-d-862964-3 devstack@n-api.service[105078]: X-User-Id: 8a6df006c993489995e1473bbe6c1dfa Oct 29 00:55:38.685356 n-d-862964-3 devstack@n-api.service[105078]: X-User-Name: admin Oct 29 00:55:38.685356 n-d-862964-3 devstack@n-api.service[105078]: method: > Oct 29 00:55:38.685356 n-d-862964-3 devstack@n-api.service[105078]: exception: Flavor 42 could not be found. Oct 29 00:55:38.685356 n-d-862964-3 devstack@n-api.service[105078]: action_args: {'id': '42'} Oct 29 00:55:38.685356 n-d-862964-3 devstack@n-api.service[105078]: {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 00:55:38.685356 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 00:55:38.686357 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 00:55:38.686357 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 00:55:38.686357 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 00:55:38.686357 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 00:55:38.686357 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 00:55:38.686357 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 00:55:38.686357 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 00:55:38.686357 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 00:55:38.686357 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 00:55:38.686357 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 00:55:38.686357 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 00:55:38.686357 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 00:55:38.686357 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 29 00:55:38.686357 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Oct 29 00:55:38.686357 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 00:55:38.686357 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Oct 29 00:55:38.686357 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 00:55:38.686357 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 00:55:38.686357 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 00:55:38.687692 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 00:55:38.687692 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 00:55:38.687692 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 00:55:38.687692 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 00:55:38.687692 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 00:55:38.687692 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 00:55:38.687692 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 29 00:55:38.687692 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Oct 29 00:55:38.687692 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 00:55:38.687692 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Oct 29 00:55:38.687692 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 00:55:38.687692 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 00:55:38.687692 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 00:55:38.687692 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 00:55:38.687692 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 00:55:38.687692 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 29 00:55:38.687692 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Oct 29 00:55:38.687692 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-5cc3ad83-4466-496f-8010-d567e79a64be admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105078) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 00:55:38.688918 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-5cc3ad83-4466-496f-8010-d567e79a64be admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014939 Oct 29 00:55:38.688918 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Oct 29 00:55:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 29 00:55:39.907267 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-27dc38ea-57fb-4fa9-9e1f-56a5faf1becf admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:39.908319 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-27dc38ea-57fb-4fa9-9e1f-56a5faf1becf admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 29 00:55:39.908751 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 29 00:55:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:55:40.426704 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-15a477df-32bd-4a7a-84ac-c1975c8e8655 admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:40.431836 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.wsgi [None req-15a477df-32bd-4a7a-84ac-c1975c8e8655 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-15a477df-32bd-4a7a-84ac-c1975c8e8655 admin admin] Request method failure captured: Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: Accept: application/json Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: Accept-Encoding: gzip, deflate Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: Connection: keep-alive Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: Content-Length: 0 Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: Host: 10.222.0.26 Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: Openstack-Api-Version: compute 2.92 Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: Openstack-System-Scope: None Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: User-Agent: python-novaclient Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: X-Auth-Token: gAAAAABjXHoL7zzNF7YtkPy9SqT1BA1BY8vFHIukq08M3EC85NI2dP7aYH_1346MT4thWFtP5lQo14lkzPgoRiM2U6wXA-Rf4IaV7STXtRzKyoMQhy7_bpL7athBeEDkXkhrRG5jUiEUnAhP7CU9j4IZbL2ii8r-napSKGLq64cPu9NMd4W8yzY Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: X-Domain-Id: None Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: X-Domain-Name: None Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: X-Identity-Status: Confirmed Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: X-Is-Admin-Project: True Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: X-Project-Domain-Id: default Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: X-Project-Domain-Name: Default Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: X-Project-Id: 012def6fc4104ffda070bc0506cf79c5 Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: X-Project-Name: admin Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: X-Role: member,admin,reader Oct 29 00:55:40.433371 n-d-862964-3 devstack@n-api.service[105078]: X-Roles: member,admin,reader Oct 29 00:55:40.434865 n-d-862964-3 devstack@n-api.service[105078]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/012def6fc4104ffda070bc0506cf79c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/012def6fc4104ffda070bc0506cf79c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/012def6fc4104ffda070bc0506cf79c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_012def6fc4104ffda070bc0506cf79c5", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 00:55:40.434865 n-d-862964-3 devstack@n-api.service[105078]: X-Tenant: admin Oct 29 00:55:40.434865 n-d-862964-3 devstack@n-api.service[105078]: X-Tenant-Id: 012def6fc4104ffda070bc0506cf79c5 Oct 29 00:55:40.434865 n-d-862964-3 devstack@n-api.service[105078]: X-Tenant-Name: admin Oct 29 00:55:40.434865 n-d-862964-3 devstack@n-api.service[105078]: X-User: admin Oct 29 00:55:40.434865 n-d-862964-3 devstack@n-api.service[105078]: X-User-Domain-Id: default Oct 29 00:55:40.434865 n-d-862964-3 devstack@n-api.service[105078]: X-User-Domain-Name: Default Oct 29 00:55:40.434865 n-d-862964-3 devstack@n-api.service[105078]: X-User-Id: 8a6df006c993489995e1473bbe6c1dfa Oct 29 00:55:40.434865 n-d-862964-3 devstack@n-api.service[105078]: X-User-Name: admin Oct 29 00:55:40.434865 n-d-862964-3 devstack@n-api.service[105078]: method: > Oct 29 00:55:40.434865 n-d-862964-3 devstack@n-api.service[105078]: exception: Flavor 84 could not be found. Oct 29 00:55:40.434865 n-d-862964-3 devstack@n-api.service[105078]: action_args: {'id': '84'} Oct 29 00:55:40.434865 n-d-862964-3 devstack@n-api.service[105078]: {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 00:55:40.434865 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 00:55:40.435911 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 00:55:40.435911 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 00:55:40.435911 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 00:55:40.435911 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 00:55:40.435911 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 00:55:40.435911 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 00:55:40.435911 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 00:55:40.435911 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 00:55:40.435911 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 00:55:40.435911 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 00:55:40.435911 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 00:55:40.435911 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 00:55:40.435911 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 29 00:55:40.435911 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Oct 29 00:55:40.435911 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 00:55:40.435911 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Oct 29 00:55:40.435911 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 00:55:40.435911 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 00:55:40.435911 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 00:55:40.437288 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 00:55:40.437288 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 00:55:40.437288 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 00:55:40.437288 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 00:55:40.437288 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 00:55:40.437288 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 00:55:40.437288 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 29 00:55:40.437288 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Oct 29 00:55:40.437288 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 00:55:40.437288 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Oct 29 00:55:40.437288 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 00:55:40.437288 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 00:55:40.437288 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 00:55:40.437288 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 00:55:40.437288 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 00:55:40.437288 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 29 00:55:40.437288 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Oct 29 00:55:40.437288 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-15a477df-32bd-4a7a-84ac-c1975c8e8655 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105078) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 00:55:40.438518 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-15a477df-32bd-4a7a-84ac-c1975c8e8655 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.388458 Oct 29 00:55:40.438518 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Oct 29 00:55:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 00:55:40.445110 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-c5d47cc7-e7cc-4241-baa8-bdc198583de0 admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:40.459904 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-c5d47cc7-e7cc-4241-baa8-bdc198583de0 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019116 Oct 29 00:55:40.460440 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Oct 29 00:55:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 00:55:40.469775 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-edb6719b-078c-4b17-ac60-d7bae0e79f97 admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:40.485234 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-edb6719b-078c-4b17-ac60-d7bae0e79f97 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018978 Oct 29 00:55:40.485760 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Oct 29 00:55:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 00:55:40.495393 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-b48fa973-9751-4d17-888f-b7858e9963df admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:40.500917 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.wsgi [None req-b48fa973-9751-4d17-888f-b7858e9963df admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-b48fa973-9751-4d17-888f-b7858e9963df admin admin] Request method failure captured: Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: Accept: application/json Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: Accept-Encoding: gzip, deflate Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: Connection: keep-alive Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: Content-Length: 0 Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: Host: 10.222.0.26 Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: Openstack-Api-Version: compute 2.92 Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: Openstack-System-Scope: None Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: User-Agent: python-novaclient Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: X-Auth-Token: gAAAAABjXHoL7zzNF7YtkPy9SqT1BA1BY8vFHIukq08M3EC85NI2dP7aYH_1346MT4thWFtP5lQo14lkzPgoRiM2U6wXA-Rf4IaV7STXtRzKyoMQhy7_bpL7athBeEDkXkhrRG5jUiEUnAhP7CU9j4IZbL2ii8r-napSKGLq64cPu9NMd4W8yzY Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: X-Domain-Id: None Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: X-Domain-Name: None Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: X-Identity-Status: Confirmed Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: X-Is-Admin-Project: True Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: X-Project-Domain-Id: default Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: X-Project-Domain-Name: Default Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: X-Project-Id: 012def6fc4104ffda070bc0506cf79c5 Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: X-Project-Name: admin Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: X-Role: member,admin,reader Oct 29 00:55:40.502433 n-d-862964-3 devstack@n-api.service[105079]: X-Roles: member,admin,reader Oct 29 00:55:40.503990 n-d-862964-3 devstack@n-api.service[105079]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/012def6fc4104ffda070bc0506cf79c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/012def6fc4104ffda070bc0506cf79c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/012def6fc4104ffda070bc0506cf79c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_012def6fc4104ffda070bc0506cf79c5", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 00:55:40.503990 n-d-862964-3 devstack@n-api.service[105079]: X-Tenant: admin Oct 29 00:55:40.503990 n-d-862964-3 devstack@n-api.service[105079]: X-Tenant-Id: 012def6fc4104ffda070bc0506cf79c5 Oct 29 00:55:40.503990 n-d-862964-3 devstack@n-api.service[105079]: X-Tenant-Name: admin Oct 29 00:55:40.503990 n-d-862964-3 devstack@n-api.service[105079]: X-User: admin Oct 29 00:55:40.503990 n-d-862964-3 devstack@n-api.service[105079]: X-User-Domain-Id: default Oct 29 00:55:40.503990 n-d-862964-3 devstack@n-api.service[105079]: X-User-Domain-Name: Default Oct 29 00:55:40.503990 n-d-862964-3 devstack@n-api.service[105079]: X-User-Id: 8a6df006c993489995e1473bbe6c1dfa Oct 29 00:55:40.503990 n-d-862964-3 devstack@n-api.service[105079]: X-User-Name: admin Oct 29 00:55:40.503990 n-d-862964-3 devstack@n-api.service[105079]: method: > Oct 29 00:55:40.503990 n-d-862964-3 devstack@n-api.service[105079]: exception: Flavor 84 could not be found. Oct 29 00:55:40.503990 n-d-862964-3 devstack@n-api.service[105079]: action_args: {'id': '84'} Oct 29 00:55:40.503990 n-d-862964-3 devstack@n-api.service[105079]: {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 00:55:40.503990 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 00:55:40.505582 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 00:55:40.505582 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 00:55:40.505582 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 00:55:40.505582 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 00:55:40.505582 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 00:55:40.505582 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 00:55:40.505582 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 00:55:40.505582 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 00:55:40.505582 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 00:55:40.505582 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 00:55:40.505582 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 00:55:40.505582 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 00:55:40.505582 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 29 00:55:40.505582 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Oct 29 00:55:40.505582 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 00:55:40.505582 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Oct 29 00:55:40.505582 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 00:55:40.505582 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 00:55:40.505582 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 00:55:40.507074 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 00:55:40.507074 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 00:55:40.507074 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 00:55:40.507074 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 00:55:40.507074 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 00:55:40.507074 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 00:55:40.507074 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 29 00:55:40.507074 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Oct 29 00:55:40.507074 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 00:55:40.507074 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Oct 29 00:55:40.507074 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 00:55:40.507074 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 00:55:40.507074 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 00:55:40.507074 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 00:55:40.507074 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 00:55:40.507074 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 29 00:55:40.507074 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Oct 29 00:55:40.507074 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-b48fa973-9751-4d17-888f-b7858e9963df admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 00:55:40.508303 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-b48fa973-9751-4d17-888f-b7858e9963df admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011930 Oct 29 00:55:40.508303 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Oct 29 00:55:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 00:55:41.714676 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-edb6719b-078c-4b17-ac60-d7bae0e79f97 admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:41.715687 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-edb6719b-078c-4b17-ac60-d7bae0e79f97 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Oct 29 00:55:41.716080 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 29 00:55:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 00:55:42.233974 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-3b1254bf-39a1-451c-a4e6-1f3a468910ea admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:42.241145 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.wsgi [None req-3b1254bf-39a1-451c-a4e6-1f3a468910ea admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-3b1254bf-39a1-451c-a4e6-1f3a468910ea admin admin] Request method failure captured: Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: Accept: application/json Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: Accept-Encoding: gzip, deflate Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: Connection: keep-alive Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: Content-Length: 0 Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: Host: 10.222.0.26 Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: Openstack-Api-Version: compute 2.92 Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: Openstack-System-Scope: None Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: User-Agent: python-novaclient Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: X-Auth-Token: gAAAAABjXHoNjJY-mGzpHQDTikk84j3zvz72CHc-v6I2MUnb8aat8feBUJaDk7vFjVTwaUGgP--Y2ATDh1K6NI4KycxYqH3MfWIV9FWE7gvStoIYNXIc5wVSlbsZdZeilPFqzwb683YjeQlP-9AJrsoeMY0me1yPUXeTQ2tXqpES1nsDyAquqr0 Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: X-Domain-Id: None Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: X-Domain-Name: None Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: X-Identity-Status: Confirmed Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: X-Is-Admin-Project: True Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: X-Project-Domain-Id: default Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: X-Project-Domain-Name: Default Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: X-Project-Id: 012def6fc4104ffda070bc0506cf79c5 Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: X-Project-Name: admin Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: X-Role: member,admin,reader Oct 29 00:55:42.252428 n-d-862964-3 devstack@n-api.service[105079]: X-Roles: member,admin,reader Oct 29 00:55:42.254101 n-d-862964-3 devstack@n-api.service[105079]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/012def6fc4104ffda070bc0506cf79c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/012def6fc4104ffda070bc0506cf79c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/012def6fc4104ffda070bc0506cf79c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_012def6fc4104ffda070bc0506cf79c5", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 00:55:42.254101 n-d-862964-3 devstack@n-api.service[105079]: X-Tenant: admin Oct 29 00:55:42.254101 n-d-862964-3 devstack@n-api.service[105079]: X-Tenant-Id: 012def6fc4104ffda070bc0506cf79c5 Oct 29 00:55:42.254101 n-d-862964-3 devstack@n-api.service[105079]: X-Tenant-Name: admin Oct 29 00:55:42.254101 n-d-862964-3 devstack@n-api.service[105079]: X-User: admin Oct 29 00:55:42.254101 n-d-862964-3 devstack@n-api.service[105079]: X-User-Domain-Id: default Oct 29 00:55:42.254101 n-d-862964-3 devstack@n-api.service[105079]: X-User-Domain-Name: Default Oct 29 00:55:42.254101 n-d-862964-3 devstack@n-api.service[105079]: X-User-Id: 8a6df006c993489995e1473bbe6c1dfa Oct 29 00:55:42.254101 n-d-862964-3 devstack@n-api.service[105079]: X-User-Name: admin Oct 29 00:55:42.254101 n-d-862964-3 devstack@n-api.service[105079]: method: > Oct 29 00:55:42.254101 n-d-862964-3 devstack@n-api.service[105079]: exception: Flavor 451 could not be found. Oct 29 00:55:42.254101 n-d-862964-3 devstack@n-api.service[105079]: action_args: {'id': '451'} Oct 29 00:55:42.254101 n-d-862964-3 devstack@n-api.service[105079]: {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 00:55:42.254101 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 00:55:42.255035 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 00:55:42.255035 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 00:55:42.255035 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 00:55:42.255035 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 00:55:42.255035 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 00:55:42.255035 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 00:55:42.255035 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 00:55:42.255035 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 00:55:42.255035 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 00:55:42.255035 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 00:55:42.255035 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 00:55:42.255035 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 00:55:42.255035 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 29 00:55:42.255035 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Oct 29 00:55:42.255035 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 00:55:42.255035 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Oct 29 00:55:42.255035 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 00:55:42.255035 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 00:55:42.255035 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 00:55:42.256333 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 00:55:42.256333 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 00:55:42.256333 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 00:55:42.256333 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 00:55:42.256333 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 00:55:42.256333 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 00:55:42.256333 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 29 00:55:42.256333 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Oct 29 00:55:42.256333 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 00:55:42.256333 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Oct 29 00:55:42.256333 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 00:55:42.256333 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 00:55:42.256333 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 00:55:42.256333 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 00:55:42.256333 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 00:55:42.256333 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 29 00:55:42.256333 n-d-862964-3 devstack@n-api.service[105079]: ERROR nova.api.openstack.wsgi Oct 29 00:55:42.256333 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-3b1254bf-39a1-451c-a4e6-1f3a468910ea admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 00:55:42.257695 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-3b1254bf-39a1-451c-a4e6-1f3a468910ea admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.391026 Oct 29 00:55:42.257695 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 29 00:55:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 00:55:42.257924 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-d44d0143-51f3-468c-b812-52d3dd8200c8 admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:42.268988 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-d44d0143-51f3-468c-b812-52d3dd8200c8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018629 Oct 29 00:55:42.269554 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Oct 29 00:55:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 00:55:42.279997 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-a502829b-b4c7-4ef9-8493-d5421d71ffee admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:42.295978 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-a502829b-b4c7-4ef9-8493-d5421d71ffee admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019866 Oct 29 00:55:42.296773 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Oct 29 00:55:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 00:55:42.307270 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-494a09c5-2bc8-4e63-8b4d-49ab90397af6 admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:42.312254 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.wsgi [None req-494a09c5-2bc8-4e63-8b4d-49ab90397af6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-494a09c5-2bc8-4e63-8b4d-49ab90397af6 admin admin] Request method failure captured: Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: Accept: application/json Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: Accept-Encoding: gzip, deflate Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: Connection: keep-alive Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: Content-Length: 0 Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: Host: 10.222.0.26 Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: Openstack-Api-Version: compute 2.92 Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: Openstack-System-Scope: None Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: User-Agent: python-novaclient Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: X-Auth-Token: gAAAAABjXHoNjJY-mGzpHQDTikk84j3zvz72CHc-v6I2MUnb8aat8feBUJaDk7vFjVTwaUGgP--Y2ATDh1K6NI4KycxYqH3MfWIV9FWE7gvStoIYNXIc5wVSlbsZdZeilPFqzwb683YjeQlP-9AJrsoeMY0me1yPUXeTQ2tXqpES1nsDyAquqr0 Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: X-Domain-Id: None Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: X-Domain-Name: None Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: X-Identity-Status: Confirmed Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: X-Is-Admin-Project: True Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: X-Project-Domain-Id: default Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: X-Project-Domain-Name: Default Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: X-Project-Id: 012def6fc4104ffda070bc0506cf79c5 Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: X-Project-Name: admin Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: X-Role: member,admin,reader Oct 29 00:55:42.313791 n-d-862964-3 devstack@n-api.service[105078]: X-Roles: member,admin,reader Oct 29 00:55:42.315524 n-d-862964-3 devstack@n-api.service[105078]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/012def6fc4104ffda070bc0506cf79c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/012def6fc4104ffda070bc0506cf79c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/012def6fc4104ffda070bc0506cf79c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_012def6fc4104ffda070bc0506cf79c5", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 00:55:42.315524 n-d-862964-3 devstack@n-api.service[105078]: X-Tenant: admin Oct 29 00:55:42.315524 n-d-862964-3 devstack@n-api.service[105078]: X-Tenant-Id: 012def6fc4104ffda070bc0506cf79c5 Oct 29 00:55:42.315524 n-d-862964-3 devstack@n-api.service[105078]: X-Tenant-Name: admin Oct 29 00:55:42.315524 n-d-862964-3 devstack@n-api.service[105078]: X-User: admin Oct 29 00:55:42.315524 n-d-862964-3 devstack@n-api.service[105078]: X-User-Domain-Id: default Oct 29 00:55:42.315524 n-d-862964-3 devstack@n-api.service[105078]: X-User-Domain-Name: Default Oct 29 00:55:42.315524 n-d-862964-3 devstack@n-api.service[105078]: X-User-Id: 8a6df006c993489995e1473bbe6c1dfa Oct 29 00:55:42.315524 n-d-862964-3 devstack@n-api.service[105078]: X-User-Name: admin Oct 29 00:55:42.315524 n-d-862964-3 devstack@n-api.service[105078]: method: > Oct 29 00:55:42.315524 n-d-862964-3 devstack@n-api.service[105078]: exception: Flavor 451 could not be found. Oct 29 00:55:42.315524 n-d-862964-3 devstack@n-api.service[105078]: action_args: {'id': '451'} Oct 29 00:55:42.315524 n-d-862964-3 devstack@n-api.service[105078]: {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 00:55:42.315524 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 00:55:42.316370 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 00:55:42.316370 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 00:55:42.316370 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 00:55:42.316370 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 00:55:42.316370 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 00:55:42.316370 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 00:55:42.316370 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 00:55:42.316370 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 00:55:42.316370 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 00:55:42.316370 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 00:55:42.316370 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 00:55:42.316370 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 00:55:42.316370 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 29 00:55:42.316370 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Oct 29 00:55:42.316370 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 00:55:42.316370 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Oct 29 00:55:42.316370 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 00:55:42.316370 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 00:55:42.316370 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 00:55:42.317776 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 00:55:42.317776 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 00:55:42.317776 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 00:55:42.317776 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 00:55:42.317776 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 00:55:42.317776 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 00:55:42.317776 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 29 00:55:42.317776 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Oct 29 00:55:42.317776 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 00:55:42.317776 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Oct 29 00:55:42.317776 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 00:55:42.317776 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 00:55:42.317776 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 00:55:42.317776 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 00:55:42.317776 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 00:55:42.317776 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 29 00:55:42.317776 n-d-862964-3 devstack@n-api.service[105078]: ERROR nova.api.openstack.wsgi Oct 29 00:55:42.317776 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-494a09c5-2bc8-4e63-8b4d-49ab90397af6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105078) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 00:55:42.318818 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-494a09c5-2bc8-4e63-8b4d-49ab90397af6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011480 Oct 29 00:55:42.318818 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 29 00:55:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 29 00:55:43.522209 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-a502829b-b4c7-4ef9-8493-d5421d71ffee admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:43.523223 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-a502829b-b4c7-4ef9-8493-d5421d71ffee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 29 00:55:43.523619 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 29 00:55:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:55:44.038928 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-13aa0fad-b662-410d-bed2-2b1022e36dc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:55:44.096850 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-13aa0fad-b662-410d-bed2-2b1022e36dc6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.436291 Oct 29 00:55:44.097430 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Oct 29 00:55:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 00:55:45.325313 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-a502829b-b4c7-4ef9-8493-d5421d71ffee admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:45.326314 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-a502829b-b4c7-4ef9-8493-d5421d71ffee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Oct 29 00:55:45.326706 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 29 00:55:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:55:45.849409 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-6255fedb-2a5e-4af3-860d-76851ced73c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:55:45.914653 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-6255fedb-2a5e-4af3-860d-76851ced73c2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.448444 Oct 29 00:55:45.915198 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Oct 29 00:55:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 00:55:47.120796 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-a502829b-b4c7-4ef9-8493-d5421d71ffee admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:47.121899 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-a502829b-b4c7-4ef9-8493-d5421d71ffee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Oct 29 00:55:47.122301 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 29 00:55:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:55:47.647048 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-ab18808d-22f9-47ef-8da5-56e9496a2eb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:55:47.718593 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-ab18808d-22f9-47ef-8da5-56e9496a2eb1 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.458315 Oct 29 00:55:47.719135 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Oct 29 00:55:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 00:55:48.933933 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-a502829b-b4c7-4ef9-8493-d5421d71ffee admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:48.934940 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-a502829b-b4c7-4ef9-8493-d5421d71ffee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 29 00:55:48.935335 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 29 00:55:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:55:49.455021 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-6ee92dd3-b382-494e-b82e-8de444532ca7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 00:55:49.600907 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-6ee92dd3-b382-494e-b82e-8de444532ca7 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.526927 Oct 29 00:55:49.601528 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Oct 29 00:55:49 2022] POST /compute/v2.1/flavors => generated 409 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 00:55:50.809686 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-a502829b-b4c7-4ef9-8493-d5421d71ffee admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:50.810680 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-a502829b-b4c7-4ef9-8493-d5421d71ffee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 29 00:55:50.811070 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 29 00:55:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:55:51.335839 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-1ca32746-1d26-418b-8a7a-f9849f4aca6e admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:55:51.356495 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-1ca32746-1d26-418b-8a7a-f9849f4aca6e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.409220 Oct 29 00:55:51.357029 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Sat Oct 29 00:55:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 00:56:48.325577 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-a502829b-b4c7-4ef9-8493-d5421d71ffee admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:56:48.326653 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-a502829b-b4c7-4ef9-8493-d5421d71ffee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Oct 29 00:56:48.327053 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 29 00:56:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 00:56:48.338874 n-d-862964-3 devstack@n-api.service[105078]: DEBUG dbcounter [-] [105078] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 00:56:48.723942 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-8102462f-d326-4823-98cd-8f4797894e37 admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:56:48.743983 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-8102462f-d326-4823-98cd-8f4797894e37 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.410726 Oct 29 00:56:48.744454 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 29 00:56:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 00:56:48.766003 n-d-862964-3 devstack@n-api.service[105079]: DEBUG dbcounter [-] [105079] Writing DB stats nova_api:SELECT=14 {{(pid=105079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 00:56:48.769708 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-eda8e349-b360-46de-8b8c-ad0e924fbefb admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:56:48.777717 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-eda8e349-b360-46de-8b8c-ad0e924fbefb admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013074 Oct 29 00:56:48.778240 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1283 bytes} [Sat Oct 29 00:56:48 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 00:56:48.790467 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-b4d1fa9c-27c2-4320-b3c3-bd8168b9022d admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:56:48.797618 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-b4d1fa9c-27c2-4320-b3c3-bd8168b9022d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011159 Oct 29 00:56:48.798131 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1286 bytes} [Sat Oct 29 00:56:48 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 00:56:48.810229 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-1a7e07af-6c70-4953-a396-6d5f1938935b admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:56:48.818293 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-1a7e07af-6c70-4953-a396-6d5f1938935b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011058 Oct 29 00:56:48.818808 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1286 bytes} [Sat Oct 29 00:56:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 00:56:48.830287 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-d1c6c194-37e2-4bc9-93f5-aef56ae7b396 admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 00:56:48.837735 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-d1c6c194-37e2-4bc9-93f5-aef56ae7b396 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010926 Oct 29 00:56:48.838252 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1283 bytes} [Sat Oct 29 00:56:48 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:02:18.641738 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-1a7e07af-6c70-4953-a396-6d5f1938935b admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:02:18.642759 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-1a7e07af-6c70-4953-a396-6d5f1938935b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Oct 29 01:02:18.643156 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 29 01:02:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:02:18.785908 n-d-862964-3 devstack@n-api.service[105078]: DEBUG dbcounter [-] [105078] Writing DB stats nova_api:SELECT=6 {{(pid=105078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:02:18.930453 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-2efe06ad-e126-4315-a36a-c280ac4fbd7a admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:02:18.935254 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_concurrency.lockutils [None req-2efe06ad-e126-4315-a36a-c280ac4fbd7a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105078) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:02:18.935728 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_concurrency.lockutils [None req-2efe06ad-e126-4315-a36a-c280ac4fbd7a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105078) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:02:18.936154 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_concurrency.lockutils [None req-2efe06ad-e126-4315-a36a-c280ac4fbd7a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105078) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:02:18.936875 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_concurrency.lockutils [None req-2efe06ad-e126-4315-a36a-c280ac4fbd7a admin admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105078) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:02:18.937354 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_concurrency.lockutils [None req-2efe06ad-e126-4315-a36a-c280ac4fbd7a admin admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105078) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:02:18.937774 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_concurrency.lockutils [None req-2efe06ad-e126-4315-a36a-c280ac4fbd7a admin admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105078) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:02:18.976865 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-2efe06ad-e126-4315-a36a-c280ac4fbd7a admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.192144 Oct 29 01:02:18.977443 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 29 01:02:18 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:02:20.049234 n-d-862964-3 devstack@n-api.service[105079]: DEBUG nova.api.openstack.wsgi [None req-1a7e07af-6c70-4953-a396-6d5f1938935b admin admin] Calling method '>' {{(pid=105079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:02:20.050233 n-d-862964-3 devstack@n-api.service[105079]: INFO nova.api.openstack.requestlog [None req-1a7e07af-6c70-4953-a396-6d5f1938935b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Oct 29 01:02:20.050625 n-d-862964-3 devstack@n-api.service[105079]: [pid: 105079|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 29 01:02:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:02:20.244101 n-d-862964-3 devstack@n-api.service[105078]: DEBUG nova.api.openstack.wsgi [None req-af7f67d6-696e-4853-9530-0b1e5fafd95b admin admin] Calling method '>' {{(pid=105078) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:02:20.247588 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_concurrency.lockutils [None req-af7f67d6-696e-4853-9530-0b1e5fafd95b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105078) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:02:20.248068 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_concurrency.lockutils [None req-af7f67d6-696e-4853-9530-0b1e5fafd95b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105078) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:02:20.248528 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_concurrency.lockutils [None req-af7f67d6-696e-4853-9530-0b1e5fafd95b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105078) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:02:20.249278 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_concurrency.lockutils [None req-af7f67d6-696e-4853-9530-0b1e5fafd95b admin admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105078) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:02:20.249731 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_concurrency.lockutils [None req-af7f67d6-696e-4853-9530-0b1e5fafd95b admin admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105078) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:02:20.250150 n-d-862964-3 devstack@n-api.service[105078]: DEBUG oslo_concurrency.lockutils [None req-af7f67d6-696e-4853-9530-0b1e5fafd95b admin admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105078) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:02:20.273538 n-d-862964-3 devstack@n-api.service[105078]: INFO nova.api.openstack.requestlog [None req-af7f67d6-696e-4853-9530-0b1e5fafd95b admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.080775 Oct 29 01:02:20.274021 n-d-862964-3 devstack@n-api.service[105078]: [pid: 105078|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 29 01:02:20 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:03:04.872613 n-d-862964-3 devstack@n-api.service[105077]: Sat Oct 29 01:03:04 2022 - graceful shutdown triggered... Oct 29 01:03:04.873139 n-d-862964-3 devstack@n-api.service[105079]: Gracefully killing worker 2 (pid: 105079)... Oct 29 01:03:04.872856 n-d-862964-3 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 29 01:03:04.873973 n-d-862964-3 devstack@n-api.service[105078]: Gracefully killing worker 1 (pid: 105078)... Oct 29 01:03:05.004097 n-d-862964-3 devstack@n-api.service[105079]: DEBUG dbcounter [-] [105079] Writing DB stats nova_api:SELECT=4 {{(pid=105079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:03:05.873444 n-d-862964-3 devstack@n-api.service[105077]: worker 1 buried after 1 seconds Oct 29 01:03:05.873444 n-d-862964-3 devstack@n-api.service[105077]: worker 2 buried after 1 seconds Oct 29 01:03:05.874013 n-d-862964-3 devstack@n-api.service[105077]: goodbye to uWSGI. Oct 29 01:03:05.875027 n-d-862964-3 systemd[1]: devstack@n-api.service: Succeeded. Oct 29 01:03:05.875634 n-d-862964-3 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 29 01:03:05.878421 n-d-862964-3 systemd[1]: Starting Devstack devstack@n-api.service... Oct 29 01:03:05.898972 n-d-862964-3 devstack@n-api.service[121089]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 29 01:03:05.925509 n-d-862964-3 devstack@n-api.service[121089]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 29 01:03:05 2022] *** Oct 29 01:03:05.925509 n-d-862964-3 devstack@n-api.service[121089]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 29 01:03:05.925509 n-d-862964-3 devstack@n-api.service[121089]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 29 01:03:05.925509 n-d-862964-3 devstack@n-api.service[121089]: nodename: n-d-862964-3 Oct 29 01:03:05.925509 n-d-862964-3 devstack@n-api.service[121089]: machine: x86_64 Oct 29 01:03:05.925509 n-d-862964-3 devstack@n-api.service[121089]: clock source: unix Oct 29 01:03:05.925509 n-d-862964-3 devstack@n-api.service[121089]: pcre jit disabled Oct 29 01:03:05.925509 n-d-862964-3 devstack@n-api.service[121089]: detected number of CPU cores: 4 Oct 29 01:03:05.925509 n-d-862964-3 devstack@n-api.service[121089]: current working directory: / Oct 29 01:03:05.925509 n-d-862964-3 devstack@n-api.service[121089]: detected binary path: /usr/bin/uwsgi-core Oct 29 01:03:05.925509 n-d-862964-3 devstack@n-api.service[121089]: your processes number limit is 47680 Oct 29 01:03:05.925509 n-d-862964-3 devstack@n-api.service[121089]: your memory page size is 4096 bytes Oct 29 01:03:05.925509 n-d-862964-3 devstack@n-api.service[121089]: detected max file descriptor number: 2048 Oct 29 01:03:05.925509 n-d-862964-3 devstack@n-api.service[121089]: lock engine: pthread robust mutexes Oct 29 01:03:05.926663 n-d-862964-3 devstack@n-api.service[121089]: thunder lock: enabled Oct 29 01:03:05.926663 n-d-862964-3 devstack@n-api.service[121089]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 29 01:03:05.926663 n-d-862964-3 devstack@n-api.service[121089]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 29 01:03:05.965804 n-d-862964-3 devstack@n-api.service[121089]: Python main interpreter initialized at 0x5625d884e9c0 Oct 29 01:03:05.965804 n-d-862964-3 devstack@n-api.service[121089]: python threads support enabled Oct 29 01:03:05.965804 n-d-862964-3 devstack@n-api.service[121089]: your server socket listen backlog is limited to 100 connections Oct 29 01:03:05.965804 n-d-862964-3 devstack@n-api.service[121089]: your mercy for graceful operations on workers is 90 seconds Oct 29 01:03:05.966211 n-d-862964-3 devstack@n-api.service[121089]: mapped 403077 bytes (393 KB) for 2 cores Oct 29 01:03:05.966211 n-d-862964-3 devstack@n-api.service[121089]: *** Operational MODE: preforking *** Oct 29 01:03:05.966475 n-d-862964-3 devstack@n-api.service[121089]: *** uWSGI is running in multiple interpreter mode *** Oct 29 01:03:05.966475 n-d-862964-3 devstack@n-api.service[121089]: spawned uWSGI master process (pid: 121089) Oct 29 01:03:05.966681 n-d-862964-3 systemd[1]: Started Devstack devstack@n-api.service. Oct 29 01:03:05.968122 n-d-862964-3 devstack@n-api.service[121089]: spawned uWSGI worker 1 (pid: 121099, cores: 1) Oct 29 01:03:05.968408 n-d-862964-3 devstack@n-api.service[121089]: spawned uWSGI worker 2 (pid: 121100, cores: 1) Oct 29 01:03:05.968578 n-d-862964-3 devstack@n-api.service[121089]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 29 01:03:06.651763 n-d-862964-3 devstack@n-api.service[121100]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 29 01:03:06.652370 n-d-862964-3 devstack@n-api.service[121099]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 29 01:03:07.930373 n-d-862964-3 devstack@n-api.service[121100]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:03:07.930373 n-d-862964-3 devstack@n-api.service[121100]: from cryptography.utils import int_from_bytes Oct 29 01:03:07.930853 n-d-862964-3 devstack@n-api.service[121099]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:03:07.930853 n-d-862964-3 devstack@n-api.service[121099]: from cryptography.utils import int_from_bytes Oct 29 01:03:07.931273 n-d-862964-3 devstack@n-api.service[121100]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:03:07.931273 n-d-862964-3 devstack@n-api.service[121100]: from cryptography.utils import int_from_bytes Oct 29 01:03:07.931435 n-d-862964-3 devstack@n-api.service[121099]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:03:07.931435 n-d-862964-3 devstack@n-api.service[121099]: from cryptography.utils import int_from_bytes Oct 29 01:03:10.389006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 01:03:10.389703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 01:03:10.389809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 01:03:10.390180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 01:03:10.390443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 01:03:10.390836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.391169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.391499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.391825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.392163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.392483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.392816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.393144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.393506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.393771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.394097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.394432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862964-3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.394805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.395082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.395401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.395978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.396301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.396718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.397034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.397147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 01:03:10.397634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 01:03:10.397712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.398942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 01:03:10.399064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.399149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 01:03:10.399537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.399638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 01:03:10.399714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.399805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.399886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.399964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.400036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.400106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.400182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.400267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.400351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.400429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.400506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.400591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.400675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.400758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.400857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.401063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.402697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862964-3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.402804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.402883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.402969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.403043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.403123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.403203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.403284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862964-3 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.403363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.403445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.403540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.403627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.403708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.403793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.403865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.403936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.403936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.404081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.404168 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.404247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.404448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.404575 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.404744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.404895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.405056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.405550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.405702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.405792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.405878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.406027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.406304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.406528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.406754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.406974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.407180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.407632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.407725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.407821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.407912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.408002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.408092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.408184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.408269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.408358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.408572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.408724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.408959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862964-3 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.409052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.409282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.409399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.409573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.409751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.409848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.409934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.410178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.410327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.410493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.410643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.410807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.410956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.411121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.411282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.411435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.411609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.411758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.411924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.412074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.412625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.412748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.412748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.412924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.413059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.413173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.413373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.413483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.413681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.413781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.413996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.414088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.414311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.414417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.414635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.414758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.414944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.415041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.415252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.415396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.415532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.415660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.415788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.415964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.416118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.416279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.416444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.416609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.416769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.416938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.417047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.417285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.417398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.417588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.417691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.417904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.418005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.418214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.418312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.418524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.418615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.418834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.418935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.419111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.419208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.419420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.419522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.419732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.419832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.420044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.420143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.420352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.420455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.420664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.420762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.420976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.421068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.421310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.421403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.421621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.421763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.421930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.422068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.422243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.422352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.422557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.422687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.422870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.423008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.423182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.423354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.423493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.423683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.423791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.423990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.424085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.424315 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.424408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.424637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.424737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.424948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.425046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.425282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.425377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.425596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.425688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.425920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.426026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.426246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.426337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.426556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.426650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.426810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.426903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.427115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.427261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.427425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.427567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.428298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.428903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.429041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.429212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.429327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.429414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.429511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.429595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.429685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.429780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.429878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.429971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.430105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.430200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.430374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.430514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.430683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.430841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.430993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.431157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.431302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.431471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.431610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.431784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.431920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.432095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.432229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.432407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.432524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.432719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.432846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.433029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.433305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.433428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.433523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.433657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.433793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.433983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.434090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.434310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.434402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.434625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.434779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.434941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.435045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.435284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.435464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.435588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.435712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.435901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.436019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.436242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.436372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.436537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.436666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.436849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.436982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.437170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.437290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.437568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.437809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.437961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.438112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.438269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.438413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.438569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.438735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.438883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.439033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.439175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.439350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.439500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.439643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.439793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.439945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.440088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.440250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.440401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.440550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.440692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.440835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.441006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.441188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.441339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.441483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.441667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.441816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.441988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.442154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.442298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.442474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.442673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.442809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.442953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.443087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.443880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.444049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:03:10.444455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.444714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.444873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.445029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.445216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.445323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.445411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.445495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.445685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.445895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.445988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.446079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.446226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.446368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.446546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.446689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.446908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.447008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.447235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.447335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.447560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.447661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.447891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.448121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.448223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.448352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.448521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.448682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.448849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.448944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.449211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.449309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.449536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.449634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.449837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.450004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.450157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.450302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.450472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.450573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.450796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.450896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.451127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.451225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.451452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.451551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.451770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.451862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.452096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.452340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.452789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.452885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.452980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.453076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.453183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.453289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.453460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.453931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.454105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.454351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.454448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.454645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.454775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.455502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.455659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.455754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.455874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.456056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.456159 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.456245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.456328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.456411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.456500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.456593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.456678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.456769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.456854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.456943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.457040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.457133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.457301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.457395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.457483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.457618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.457764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.457854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.457946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.458038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.458263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.458366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.458602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.458709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.459029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.459481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.459569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.459662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.459662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.459839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.459932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.460017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.460245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.460348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.460563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.460662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.460873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.460964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.461205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.461319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.461518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.461610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.461834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.461932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.462147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.462297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.462474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.462632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.462802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.462947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.463112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.463219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.463453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.463545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.463765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.463865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.464082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.464182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.464400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.464512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.464713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.464848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.465022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.465123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.465363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.465456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.465678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.465778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.465988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.466079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.466297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.466395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.466615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.466706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.466922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.467019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.467231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.467322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.467542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.467657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.467853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.467952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.468163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.468288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.468476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.468584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.468790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.468890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.469099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.469215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.469435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.469537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.469749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.469841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.470064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.470162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.470385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.470491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.470722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.470815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.471059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.471157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.471368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.471468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.471697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.471800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.472014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.472105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.472336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.472458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.472648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.472753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.472961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.473105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.473294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.473388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.473605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.473704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.473914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.474014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.474226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.474351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.475047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.475198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.475313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.475502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.475616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.475726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.475846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.475958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.476077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.476201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.476320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.476432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.476542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.476658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.476770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.476888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.477008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.477118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.477292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.477445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.477599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.477776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.477896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.478097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.478224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.478427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.478561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.478748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.478878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.479127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.479265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.480326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.480457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.480802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.480954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.481069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.481206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.481344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.481542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.481661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.481879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.481961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.482209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.482323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.482562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.482698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.482859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.482978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.483175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.483324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.483495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.483626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.483813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.483912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.484139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.484232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.484451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.484570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.484772 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.484866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.485101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.485236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.485460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.485565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.485779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.485876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.486099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.486198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.486413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.486511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.486727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.486862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.487043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.487166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.487361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.487482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.487685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.487785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.487999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.488096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.488320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.488420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.488632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.488731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.488952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.489043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.489288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.490684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.490684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.491424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.491520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.491604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.491696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.491788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.491872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.491966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.492059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.492059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.492223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.492314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.492451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.492553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.492662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.492749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.492839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.492923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.493014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.493274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.493434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.493590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.493727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.493906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.494012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.494218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.494317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.494605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.494704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.494918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.495021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.495231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.495331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.495550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.495641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.495869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.495971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.496187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.496285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.496499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.496591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.496817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.496909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.497132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.497303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.497468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.497569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.497779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.497879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.498095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.498187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.498414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.498506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.498727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.498817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.499043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.499138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.499363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.499462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.499672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.499765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.499985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.500079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.500311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.500411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.500611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.500780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.500924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.501044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.501266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.501403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.501592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.501724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.501944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.502185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.502358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.502530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.502650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.502854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.502972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.503182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.503390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.503517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.503628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.503807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.503946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.504123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.504244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.504439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.504558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.504768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.504974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.505088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.505233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.505475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.505602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.506305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.506885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.507044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.507172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.507298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.507411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.507529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.507642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.507759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.507871 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.507966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.508087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.508272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.508405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.508589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.508721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.508908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.509033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.509254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.509647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.509904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.510218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.510539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.510856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.511191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.511509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.511823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.512135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.512447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.512799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.513115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.513637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.513826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.514184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.514503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.514820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.515158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.515520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.515787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.516098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.516417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.516733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.517045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.517461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.517699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.518019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.518336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.518647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.518971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.519282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.519602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.519922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.520235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.520547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.520866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.521207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.522055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.522346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.522469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.522767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.522926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.523097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.523412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.523590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.523764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.523924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.524072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.524247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.524353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.524592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.524691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.524958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.525060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.525319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.525441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.525641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.525812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.525976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.526604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.526721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.526721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.526858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.527171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.527491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.527900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.528258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.528491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.528769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.529086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.529425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.529739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.529958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.530134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.530283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.530435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.530587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.530749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.530896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.531041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.531187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.531347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.531494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.531666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.531821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.531967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.532112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.532264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.532672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.532819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.534768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.534768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.535701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.535877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.536030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.536190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.536358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.536508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.536709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.536868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.537951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.538116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.538306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.538459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.538635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.538812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.540142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.540325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.540484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.540643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.540798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.540956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.541110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.541287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.541435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.541591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.541747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.541893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.542038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.542182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.542339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.542493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.542687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.542834 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.542834 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.543137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.543359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.543510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.543675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.543822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.543974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.544128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.544275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.544431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.544586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.544741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.544887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.545031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.545237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.545408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.545555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.545708 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.545864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.546018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.546177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.546335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.546491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.546683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.546833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.546988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.547141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.547297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.547450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.547596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.547741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.547901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.548046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.548200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.548356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.548503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.548648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.548800 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.548955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.549128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.549128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.550008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.550008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.550295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.550519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.550675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.550830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.550990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.551135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.551290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.551450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.551611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.551757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.551910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.551910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.551910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.552331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.552479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.552701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.552904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.553076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.553279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.553522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.553684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.553836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.553986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.554145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.554313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.554473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.554712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.554946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.555100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.555266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.555437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.555597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.555752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.555911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.556063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.556223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.556383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.556535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.556736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.556896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.557128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.557775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.558144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.558331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.558528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.558697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.558865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.559018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.559171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.559920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.560104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.560266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.560432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.560592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.560745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.560909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.561069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.561258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.561435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.561435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.561742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.561895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.562054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.562213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.562378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.562536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.562688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.562839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.563002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.563234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.563388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.563624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.563780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.563940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.564109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.564272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.564431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.564591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.564744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.564908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.565062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.565298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.565466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.565628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.565780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.565938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.566091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.566258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.566418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.566578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.566731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.566924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.567094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.567249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.567418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.567573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.567734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.567895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.568061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.568245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.568412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.568613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.568770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.568931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.569097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.569274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.569448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.570207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.570380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.570535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.570535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.570845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.570999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.571150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.571150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.571534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.573274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.573396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.573482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.573571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.573650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.573737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.573814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.573888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.573960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.574041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.574115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.574196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.574271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.574352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.574433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.574524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.574611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.574713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.574809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.574896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.574989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.575076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.575175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.575259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.575341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.575341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.575517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.575517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.575722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.575831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.575928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.576023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.576111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.576206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.576281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.576374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.576461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.576556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.576663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.576752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.576839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.576924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.577004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.577097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.577218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.577304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.577399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.577399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.577566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.577667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.577764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.577851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.577947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.578036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.578129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.578129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.578129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.578129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.578129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.578129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.578129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.578129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.578754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.578754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.578754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.578754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.578754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.578754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.578754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.578754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.579370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.579370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.579370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.579605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.581196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.581394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.581571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.581730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.581730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.582052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.582052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.582354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.582515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.582677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.582677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.582986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.583138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.583290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.583290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.583595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.583757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.584514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.584688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.584849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.585003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.585196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.585368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.585522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.585673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.585824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.585824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.586115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.586295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.586530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.586689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.586851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.587004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.587223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.587378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.587531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.587691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.587844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.587996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.588163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.588324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.588491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.588645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.588816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.588969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.589130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.589318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.589482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.589642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.589819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.590527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.590790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.591553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.591723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.591879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.592040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.592216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.592400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.592688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.592862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.593017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.593233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.593488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.593645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.593797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.593956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.594117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.594284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.594456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.594727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.594893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.595046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.595198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.595351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.595512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.595665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.595826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.595979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.596130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.596130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.596434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.596681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.596865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.597028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.597267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.597438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.597602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.597755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.597914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.598069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.598228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.598390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.598542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.598695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.598858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.599018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.599179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.599332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.599510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.600978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.601209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.601376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.601552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.601707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.601872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.602028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.602028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.602330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.602498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.602659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.602814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.602974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.603138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.603305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.603466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.603620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.603772 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.603924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.604076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.604251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.604420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.604580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.604580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.604976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.605141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.605141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.605489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.605642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.605794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.605794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.606093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.606257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.606409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.606575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.606817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.606991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.607162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.607361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.607526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.607681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.607841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.608000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.608167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.608328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.608500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.608654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.608806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.608959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.609126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.609314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.609469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.609621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.609772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.609937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.610098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.610253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.610872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.611202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.611202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.611520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.611683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.611836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.611997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.612150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.612303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.612465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.612626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.612787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.612948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.613113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.613329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.613484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.613635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.613786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.613937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.614088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.614255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.614412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.614572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.614730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.614883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.615187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.615423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.616294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.616462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.616625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.616891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.617065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.617065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.617457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.617618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.617771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.617922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.618083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.618083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.618396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.618550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.618710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.618873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.619035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.619188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.619339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.619491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.619491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.619789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.619966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.620119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.620283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.620437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.621080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.621481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.621661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.621819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.621971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.622123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.622283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.622450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.622450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.622743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.622914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.623084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.623245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.623412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.623573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.623726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.623878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.624030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.624194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.624358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.624511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.624663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.624842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.625005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.625293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.625454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.625621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.625775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.625936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.626089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.626445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.626615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.626778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.626960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.627266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.627507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.627751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.627908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.628062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.628214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.628367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.628532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.628685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.628837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.628989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.629149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.629329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.629511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.629673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.629827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.629978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.630139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.630299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.630465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.630625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.631659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.631827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.631827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.632140 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.632296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.632460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.632614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.632766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.632925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.633092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.633271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.633426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.633589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.633742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.633893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.634059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.634220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.634389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.634564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.634726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.634878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.635039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.635039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.635420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.635595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.635756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.635919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.636071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.636223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.636223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.636574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.636848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.637119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.637682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.637949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.638134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.638290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.638290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.638598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.638760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.638915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.639074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.639270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.639461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.639635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.639790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.639957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.640119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.640272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.640436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.640592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.640743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.640923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.641415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.641896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.642062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.642234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.642395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.642550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.642702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.642862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.643024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.643185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.643337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.643488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.643640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.643808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.643968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.644132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.644299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.644464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.644625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.644788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.644948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.645102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.645289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.645463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.645694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.645868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.646022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.646182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.646182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.647083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.647083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.647422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.647703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.647859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.648018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.648178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.648413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.648575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.648736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.648891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.649056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.649283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.649452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.649605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.649605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.649903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.650065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.650225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.650386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.650538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.650538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.650845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.651006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.651191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.651191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.652707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.652870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.653030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.653205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.653379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.653540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.653702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.653854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.654015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.654167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.654344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.654511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.654671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.654824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.654976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.655137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.655301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.655461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.655614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.655860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.656028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.656028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.656332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.656505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.656670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.656824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.656985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.657233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.657664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.657938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.658113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.658390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.658610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.658779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.658941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.659095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.659271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.659431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.659595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.659762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.659762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.660063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.660224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.660385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.660550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.660550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.660841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.661001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.661175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.661366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.661678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.661840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.662017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.663094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.663258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.663412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.663642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.663800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.663962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.664115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.664838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.665036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.665225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.665386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.665539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.665700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.665873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.666110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.666270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.666430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.666593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.666746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.666908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.667071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.667236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.667388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.667539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.667698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.667961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.668130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.668284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.668444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.668596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.668755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.668923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.669077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.669312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.669469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.669622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.669774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.669939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.670092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.670251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.670406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.670558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.670710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.670875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.671029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.671029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.671330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.671490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.671820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.671982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.672136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.672289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.672449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.672603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.672787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.673485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.673643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.673796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.673962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.674133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.674301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.674462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.674625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.674777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.674938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.675105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.675261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.675430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.675667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.675833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.675996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.676247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.676415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.676577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.676731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.676882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.677035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.677229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.677399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.677553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.677842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.678110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.678445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.678623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.678777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.678930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.679081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.679081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.679391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.679545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.679696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.679854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.680016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.680176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.680338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.680491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.680661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.680814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.680965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.681118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.681309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.681473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.681626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.681946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.682114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.682279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.682432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.682593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.682756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.682916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.683383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.683664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.683907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 01:03:10.684066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.684066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.684066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.684066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.684066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.684066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.684066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.684066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.685283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.685283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.685283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.685283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.685283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.685283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.685283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.685283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.686521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.686521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.686521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.686521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.686521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.686521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.686521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.686521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.687697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.687697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.687697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.687697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.687697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.687697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.687697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.687697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.688982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.688982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.688982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.688982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.688982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.688982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.688982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.688982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.690187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.690187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.690187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.690187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.690187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.690187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.690187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.690187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.691337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.691337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.691337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.691337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.691337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.691337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.691337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:03:10.691337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 01:03:10.732751 n-d-862964-3 devstack@n-api.service[121099]: INFO dbcounter [None req-ba916bb3-8fc0-468f-bf1b-673c1716ded8 None None] Registered counter for database nova_api Oct 29 01:03:10.750247 n-d-862964-3 devstack@n-api.service[121100]: INFO dbcounter [None req-a0332e92-9392-41dc-a6ad-8a971141423a None None] Registered counter for database nova_api Oct 29 01:03:10.753047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_db.sqlalchemy.engines [None req-ba916bb3-8fc0-468f-bf1b-673c1716ded8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 01:03:10.760385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writer thread running {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 01:03:10.770326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_db.sqlalchemy.engines [None req-a0332e92-9392-41dc-a6ad-8a971141423a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121100) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 01:03:10.778298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writer thread running {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 01:03:10.817877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.context [None req-ba916bb3-8fc0-468f-bf1b-673c1716ded8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),584133c9-70d9-4dbd-88ec-66308eedb7a2(cell1) {{(pid=121099) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 01:03:10.822635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba916bb3-8fc0-468f-bf1b-673c1716ded8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:10.823118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba916bb3-8fc0-468f-bf1b-673c1716ded8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:10.824815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba916bb3-8fc0-468f-bf1b-673c1716ded8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:10.825510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba916bb3-8fc0-468f-bf1b-673c1716ded8 None None] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:10.826011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba916bb3-8fc0-468f-bf1b-673c1716ded8 None None] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:10.827972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba916bb3-8fc0-468f-bf1b-673c1716ded8 None None] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:10.830042 n-d-862964-3 devstack@n-api.service[121099]: INFO dbcounter [None req-ba916bb3-8fc0-468f-bf1b-673c1716ded8 None None] Registered counter for database nova_cell0 Oct 29 01:03:10.834993 n-d-862964-3 devstack@n-api.service[121099]: INFO dbcounter [None req-ba916bb3-8fc0-468f-bf1b-673c1716ded8 None None] Registered counter for database nova_cell1 Oct 29 01:03:10.837244 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.context [None req-a0332e92-9392-41dc-a6ad-8a971141423a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),584133c9-70d9-4dbd-88ec-66308eedb7a2(cell1) {{(pid=121100) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 01:03:10.841344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0332e92-9392-41dc-a6ad-8a971141423a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:10.841830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0332e92-9392-41dc-a6ad-8a971141423a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:10.842783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_db.sqlalchemy.engines [None req-ba916bb3-8fc0-468f-bf1b-673c1716ded8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 01:03:10.843640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0332e92-9392-41dc-a6ad-8a971141423a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:10.844294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_db.sqlalchemy.engines [None req-ba916bb3-8fc0-468f-bf1b-673c1716ded8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 01:03:10.844410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0332e92-9392-41dc-a6ad-8a971141423a None None] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:10.844853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0332e92-9392-41dc-a6ad-8a971141423a None None] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:10.846965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0332e92-9392-41dc-a6ad-8a971141423a None None] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:10.849031 n-d-862964-3 devstack@n-api.service[121100]: INFO dbcounter [None req-a0332e92-9392-41dc-a6ad-8a971141423a None None] Registered counter for database nova_cell0 Oct 29 01:03:10.852207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writer thread running {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 01:03:10.853610 n-d-862964-3 devstack@n-api.service[121100]: INFO dbcounter [None req-a0332e92-9392-41dc-a6ad-8a971141423a None None] Registered counter for database nova_cell1 Oct 29 01:03:10.854780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writer thread running {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 01:03:10.861046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_db.sqlalchemy.engines [None req-a0332e92-9392-41dc-a6ad-8a971141423a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121100) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 01:03:10.863457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_db.sqlalchemy.engines [None req-a0332e92-9392-41dc-a6ad-8a971141423a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121100) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 01:03:10.869289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writer thread running {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 01:03:11.004722 n-d-862964-3 devstack@n-api.service[121099]: INFO dbcounter [None req-ba916bb3-8fc0-468f-bf1b-673c1716ded8 None None] Registered counter for database nova_cell0 Oct 29 01:03:11.013363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_db.sqlalchemy.engines [None req-ba916bb3-8fc0-468f-bf1b-673c1716ded8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 01:03:11.018292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writer thread running {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 01:03:11.026045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writer thread running {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 01:03:11.036705 n-d-862964-3 devstack@n-api.service[121100]: INFO dbcounter [None req-a0332e92-9392-41dc-a6ad-8a971141423a None None] Registered counter for database nova_cell0 Oct 29 01:03:11.044985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_db.sqlalchemy.engines [None req-a0332e92-9392-41dc-a6ad-8a971141423a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121100) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 01:03:11.049638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writer thread running {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 01:03:11.347425 n-d-862964-3 devstack@n-api.service[121099]: WARNING keystonemiddleware.auth_token [None req-ba916bb3-8fc0-468f-bf1b-673c1716ded8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:03:11.354988 n-d-862964-3 devstack@n-api.service[121099]: WARNING keystonemiddleware.auth_token [None req-ba916bb3-8fc0-468f-bf1b-673c1716ded8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:03:11.378568 n-d-862964-3 devstack@n-api.service[121100]: WARNING keystonemiddleware.auth_token [None req-a0332e92-9392-41dc-a6ad-8a971141423a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:03:11.387042 n-d-862964-3 devstack@n-api.service[121100]: WARNING keystonemiddleware.auth_token [None req-a0332e92-9392-41dc-a6ad-8a971141423a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:03:11.705868 n-d-862964-3 devstack@n-api.service[121099]: WARNING keystonemiddleware.auth_token [None req-ba916bb3-8fc0-468f-bf1b-673c1716ded8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:03:11.711955 n-d-862964-3 devstack@n-api.service[121099]: WARNING keystonemiddleware.auth_token [None req-ba916bb3-8fc0-468f-bf1b-673c1716ded8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:03:11.717618 n-d-862964-3 devstack@n-api.service[121099]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5625d884e9c0 pid: 121099 (default app) Oct 29 01:03:11.734946 n-d-862964-3 devstack@n-api.service[121100]: WARNING keystonemiddleware.auth_token [None req-a0332e92-9392-41dc-a6ad-8a971141423a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:03:11.741810 n-d-862964-3 devstack@n-api.service[121100]: WARNING keystonemiddleware.auth_token [None req-a0332e92-9392-41dc-a6ad-8a971141423a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:03:11.747140 n-d-862964-3 devstack@n-api.service[121100]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5625d884e9c0 pid: 121100 (default app) Oct 29 01:03:53.523440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:03:53.525506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:03:53.526466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:03:53.527239 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:03:54.657202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:03:54.660040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:03:54.662156 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:03:54.663282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:03:55.273657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7533f99d-9468-4f30-acc1-d982f724fae4 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Calling method '.version_select at 0x7f9d9d635ee0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:55.287186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7533f99d-9468-4f30-acc1-d982f724fae4 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),584133c9-70d9-4dbd-88ec-66308eedb7a2(cell1) {{(pid=121099) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 29 01:03:55.288170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7533f99d-9468-4f30-acc1-d982f724fae4 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:55.288936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7533f99d-9468-4f30-acc1-d982f724fae4 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:55.289583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7533f99d-9468-4f30-acc1-d982f724fae4 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:55.317776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7533f99d-9468-4f30-acc1-d982f724fae4 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:55.318593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7533f99d-9468-4f30-acc1-d982f724fae4 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:55.319162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7533f99d-9468-4f30-acc1-d982f724fae4 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:55.359500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7533f99d-9468-4f30-acc1-d982f724fae4 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:55.359971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7533f99d-9468-4f30-acc1-d982f724fae4 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:55.360473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7533f99d-9468-4f30-acc1-d982f724fae4 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:55.375307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7533f99d-9468-4f30-acc1-d982f724fae4 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:55.375880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7533f99d-9468-4f30-acc1-d982f724fae4 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:55.376379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7533f99d-9468-4f30-acc1-d982f724fae4 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:55.390543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7533f99d-9468-4f30-acc1-d982f724fae4 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:55.391351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7533f99d-9468-4f30-acc1-d982f724fae4 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:55.391860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7533f99d-9468-4f30-acc1-d982f724fae4 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:55.405814 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7533f99d-9468-4f30-acc1-d982f724fae4 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1571 microversion: 2.53 time: 1.892905 Oct 29 01:03:55.408673 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1243 bytes} [Sat Oct 29 01:03:53 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1571 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:03:55.622563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4ad15597-ccb5-4f61-b983-d2b6f517ca93 tempest-FlavorsAccessTestJSON-1591635930 tempest-FlavorsAccessTestJSON-1591635930-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-384695956", "id": 584164829, "os-flavor-access:is_public": "False"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:03:55.698768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cadb6b51-ed5f-4439-98b4-92f542a28dbe tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Calling method '.version_select at 0x7f9d9d65cb80>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:55.699390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cadb6b51-ed5f-4439-98b4-92f542a28dbe tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:55.700046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cadb6b51-ed5f-4439-98b4-92f542a28dbe tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:55.700624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cadb6b51-ed5f-4439-98b4-92f542a28dbe tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:55.718053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cadb6b51-ed5f-4439-98b4-92f542a28dbe tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:55.718725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cadb6b51-ed5f-4439-98b4-92f542a28dbe tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:55.719290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cadb6b51-ed5f-4439-98b4-92f542a28dbe tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:55.734599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cadb6b51-ed5f-4439-98b4-92f542a28dbe tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:55.735498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cadb6b51-ed5f-4439-98b4-92f542a28dbe tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:55.735498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cadb6b51-ed5f-4439-98b4-92f542a28dbe tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:55.743250 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cadb6b51-ed5f-4439-98b4-92f542a28dbe tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.333208 Oct 29 01:03:55.744306 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2/2] 10.222.0.26 () {60 vars in 1208 bytes} [Sat Oct 29 01:03:55 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:03:55.782196 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4ad15597-ccb5-4f61-b983-d2b6f517ca93 tempest-FlavorsAccessTestJSON-1591635930 tempest-FlavorsAccessTestJSON-1591635930-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 1.138133 Oct 29 01:03:55.790443 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:03:54 2022] POST /compute/v2.1/flavors => generated 427 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:03:55.961057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8f3def12-e1df-4399-a5cc-d608c41e1cd2 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1662255371", "ram": 512, "vcpus": 1, "disk": 10, "id": 874088884, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:03:56.017504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-412fc741-5289-439c-b971-3f09c1671b58 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '.version_select at 0x7f9d9d634e50>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:56.025385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-412fc741-5289-439c-b971-3f09c1671b58 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),584133c9-70d9-4dbd-88ec-66308eedb7a2(cell1) {{(pid=121100) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 29 01:03:56.026106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-412fc741-5289-439c-b971-3f09c1671b58 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:56.026700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-412fc741-5289-439c-b971-3f09c1671b58 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:56.027123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-412fc741-5289-439c-b971-3f09c1671b58 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:56.054122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-412fc741-5289-439c-b971-3f09c1671b58 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:56.054597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-412fc741-5289-439c-b971-3f09c1671b58 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:56.055025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-412fc741-5289-439c-b971-3f09c1671b58 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:56.068322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-412fc741-5289-439c-b971-3f09c1671b58 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:56.068797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-412fc741-5289-439c-b971-3f09c1671b58 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:56.069246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-412fc741-5289-439c-b971-3f09c1671b58 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:56.075552 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-412fc741-5289-439c-b971-3f09c1671b58 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.283820 Oct 29 01:03:56.076110 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Oct 29 01:03:55 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:03:56.128578 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8f3def12-e1df-4399-a5cc-d608c41e1cd2 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.382870 Oct 29 01:03:56.129619 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3/5] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:03:55 2022] POST /compute/v2.1/flavors => generated 413 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:03:56.136562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-50af8298-6a3c-44b5-93c9-7feb7c6088e3 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Calling method '.version_select at 0x7f9d9d4c2dc0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:56.142934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50af8298-6a3c-44b5-93c9-7feb7c6088e3 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:56.143495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50af8298-6a3c-44b5-93c9-7feb7c6088e3 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:56.143945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50af8298-6a3c-44b5-93c9-7feb7c6088e3 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:56.170130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50af8298-6a3c-44b5-93c9-7feb7c6088e3 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:56.170612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50af8298-6a3c-44b5-93c9-7feb7c6088e3 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:56.171040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50af8298-6a3c-44b5-93c9-7feb7c6088e3 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:56.199017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50af8298-6a3c-44b5-93c9-7feb7c6088e3 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:56.199499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50af8298-6a3c-44b5-93c9-7feb7c6088e3 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:56.200155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50af8298-6a3c-44b5-93c9-7feb7c6088e3 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:56.212030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50af8298-6a3c-44b5-93c9-7feb7c6088e3 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:56.212854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50af8298-6a3c-44b5-93c9-7feb7c6088e3 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:56.213828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50af8298-6a3c-44b5-93c9-7feb7c6088e3 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:56.230026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50af8298-6a3c-44b5-93c9-7feb7c6088e3 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:56.230855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50af8298-6a3c-44b5-93c9-7feb7c6088e3 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:56.231481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50af8298-6a3c-44b5-93c9-7feb7c6088e3 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:56.241431 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-50af8298-6a3c-44b5-93c9-7feb7c6088e3 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 265 microversion: 2.53 time: 0.110598 Oct 29 01:03:56.242418 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 4/6] 10.222.0.26 () {60 vars in 1222 bytes} [Sat Oct 29 01:03:56 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:03:56.249542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-51d2e07d-aabb-467a-b42d-75b04f292b17 tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1809315991"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:03:56.252860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.aggregate [None req-51d2e07d-aabb-467a-b42d-75b04f292b17 tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Generated uuid 23c56b3c-ac1d-441a-a939-41509f098406 for aggregate {{(pid=121099) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:03:56.348053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d588056-de75-4e5e-8716-21d8bbf0732b tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:56.354675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d588056-de75-4e5e-8716-21d8bbf0732b tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:56.355443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d588056-de75-4e5e-8716-21d8bbf0732b tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:56.355915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d588056-de75-4e5e-8716-21d8bbf0732b tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:56.357067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d588056-de75-4e5e-8716-21d8bbf0732b tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:56.357552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d588056-de75-4e5e-8716-21d8bbf0732b tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:56.358182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d588056-de75-4e5e-8716-21d8bbf0732b tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:56.402603 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-51d2e07d-aabb-467a-b42d-75b04f292b17 tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.158565 Oct 29 01:03:56.404190 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 5/7] 10.222.0.26 () {62 vars in 1205 bytes} [Sat Oct 29 01:03:56 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:03:56.416979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fe6cd220-8f7a-40cb-a2df-797032ba8ca5 tempest-FlavorsAccessTestJSON-1591635930 tempest-FlavorsAccessTestJSON-1591635930-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "785627ddfe8b47ac942e876d1175265e"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:03:56.436905 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7d588056-de75-4e5e-8716-21d8bbf0732b tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.358929 Oct 29 01:03:56.440151 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3/8] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Oct 29 01:03:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:03:56.757974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fa2f0c7a-d892-4a42-95d6-9390dd6f05b5 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:56.778009 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fe6cd220-8f7a-40cb-a2df-797032ba8ca5 tempest-FlavorsAccessTestJSON-1591635930 tempest-FlavorsAccessTestJSON-1591635930-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/584164829/action" status: 200 len: 96 microversion: 2.1 time: 0.372162 Oct 29 01:03:56.778904 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 6/9] 10.222.0.26 () {60 vars in 1197 bytes} [Sat Oct 29 01:03:56 2022] POST /compute/v2.1/flavors/584164829/action => generated 96 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:03:56.785492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2c93a812-be1d-4112-ade8-b34e2d623f05 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Calling method '.version_select at 0x7f9d9d3f13a0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:56.786715 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-fa2f0c7a-d892-4a42-95d6-9390dd6f05b5 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] HTTP exception thrown: Flavor 874088884 has no extra specs with key hw:cpu_thread_policy. Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fa2f0c7a-d892-4a42-95d6-9390dd6f05b5 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] Request method failure captured: Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/flavors/874088884/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHv334GK8X4ceTVdLxDRN3ICdO58UNAzxabskKKtEBRiAplS7dYQLkC0aai2x6VGWAmmuSAM-Hcc6Qa0c5f-ApucC92oz7GFeeD70jvDWHwLJ07dwg_5pe92kKhyKpfqrbsd-IonCBavfAvtUVP7UkU3pQbdRawa_hRC5croMjFzUmA Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: a0434fada20e4da4b2ad32770682c5ce Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:03:56.789901 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:03:56.791174 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0434fada20e4da4b2ad32770682c5ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a0434fada20e4da4b2ad32770682c5ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0434fada20e4da4b2ad32770682c5ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a0434fada20e4da4b2ad32770682c5ce", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:03:56.791174 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 Oct 29 01:03:56.791174 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: a0434fada20e4da4b2ad32770682c5ce Oct 29 01:03:56.791174 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 Oct 29 01:03:56.791174 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project Oct 29 01:03:56.791174 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:03:56.791174 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:03:56.791174 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 6c4392cc4d474298afb91612d7ce3552 Oct 29 01:03:56.791174 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project Oct 29 01:03:56.791174 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:03:56.791174 n-d-862964-3 devstack@n-api.service[121100]: exception: Flavor 874088884 has no extra specs with key hw:cpu_thread_policy. Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'flavor_id': '874088884', 'id': 'hw:cpu_thread_policy'} Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 874088884 has no extra specs with key hw:cpu_thread_policy. Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:03:56.791889 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:56.793402 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:03:56.793402 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:03:56.793402 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:03:56.793402 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:03:56.793402 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:03:56.793402 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 874088884 has no extra specs with key hw:cpu_thread_policy. Oct 29 01:03:56.793402 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:56.794105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c93a812-be1d-4112-ade8-b34e2d623f05 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:56.794105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c93a812-be1d-4112-ade8-b34e2d623f05 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:56.794105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c93a812-be1d-4112-ade8-b34e2d623f05 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:56.795789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fa2f0c7a-d892-4a42-95d6-9390dd6f05b5 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] Returning 404 to user: Flavor 874088884 has no extra specs with key hw:cpu_thread_policy. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:03:56.797410 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fa2f0c7a-d892-4a42-95d6-9390dd6f05b5 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] 10.222.0.26 "GET /compute/v2.1/flavors/874088884/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.356054 Oct 29 01:03:56.798633 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 4/10] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:03:56 2022] GET /compute/v2.1/flavors/874088884/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 358 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:03:56.803604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dec69971-e2cf-4283-8da6-91368e9ffdf8 tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1313131046"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:03:56.842949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c93a812-be1d-4112-ade8-b34e2d623f05 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:56.843507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c93a812-be1d-4112-ade8-b34e2d623f05 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:56.844499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c93a812-be1d-4112-ade8-b34e2d623f05 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:56.851769 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2c93a812-be1d-4112-ade8-b34e2d623f05 tempest-HypervisorAdminV253TestBase-156639778 tempest-HypervisorAdminV253TestBase-156639778-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/43cbf89a-f7d1-466a-b639-e9022cfbb565" status: 200 len: 791 microversion: 2.53 time: 0.071641 Oct 29 01:03:56.852535 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 7/11] 10.222.0.26 () {60 vars in 1298 bytes} [Sat Oct 29 01:03:56 2022] GET /compute/v2.1/os-hypervisors/43cbf89a-f7d1-466a-b639-e9022cfbb565 => generated 791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:03:57.027283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3c1b2eb2-b47a-4bc7-9fb3-3b85e4479b40 tempest-FlavorsAccessTestJSON-1825566678 tempest-FlavorsAccessTestJSON-1825566678-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:57.061993 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3c1b2eb2-b47a-4bc7-9fb3-3b85e4479b40 tempest-FlavorsAccessTestJSON-1825566678 tempest-FlavorsAccessTestJSON-1825566678-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5811 microversion: 2.1 time: 0.208168 Oct 29 01:03:57.063119 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 8/12] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:03:56 2022] GET /compute/v2.1/flavors/detail => generated 5811 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:03:57.079917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9f66b713-2988-4929-8174-8828cadfc2c9 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:03:57.089779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9f66b713-2988-4929-8174-8828cadfc2c9 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '6c4392cc4d474298afb91612d7ce3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0434fada20e4da4b2ad32770682c5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:03:57.092112 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dec69971-e2cf-4283-8da6-91368e9ffdf8 tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.292060 Oct 29 01:03:57.093256 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 5/13] 10.222.0.26 () {62 vars in 1210 bytes} [Sat Oct 29 01:03:56 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:03:57.103258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1dbe0b5a-275f-40c1-9d1a-ae111c8e88dc tempest-FlavorsAccessTestJSON-1591635930 tempest-FlavorsAccessTestJSON-1591635930-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "785627ddfe8b47ac942e876d1175265e"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9f66b713-2988-4929-8174-8828cadfc2c9 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] Request method failure captured: Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/flavors/874088884/os-extra_specs HTTP/1.1 Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 66 Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHv334GK8X4ceTVdLxDRN3ICdO58UNAzxabskKKtEBRiAplS7dYQLkC0aai2x6VGWAmmuSAM-Hcc6Qa0c5f-ApucC92oz7GFeeD70jvDWHwLJ07dwg_5pe92kKhyKpfqrbsd-IonCBavfAvtUVP7UkU3pQbdRawa_hRC5croMjFzUmA Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: a0434fada20e4da4b2ad32770682c5ce Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:03:57.112875 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:03:57.113977 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0434fada20e4da4b2ad32770682c5ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a0434fada20e4da4b2ad32770682c5ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0434fada20e4da4b2ad32770682c5ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a0434fada20e4da4b2ad32770682c5ce", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:03:57.113977 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 Oct 29 01:03:57.113977 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: a0434fada20e4da4b2ad32770682c5ce Oct 29 01:03:57.113977 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 Oct 29 01:03:57.113977 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project Oct 29 01:03:57.113977 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:03:57.113977 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:03:57.113977 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6c4392cc4d474298afb91612d7ce3552 Oct 29 01:03:57.113977 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project Oct 29 01:03:57.113977 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:03:57.113977 n-d-862964-3 devstack@n-api.service[121099]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 29 01:03:57.113977 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:03:57.115184 n-d-862964-3 devstack@n-api.service[121099]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 29 01:03:57.115184 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'flavor_id': '874088884', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 29 01:03:57.115184 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:03:57.115184 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:03:57.115184 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:03:57.115184 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:03:57.115184 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:03:57.115184 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:03:57.115184 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:03:57.115184 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:03:57.115184 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:03:57.115184 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:03:57.115184 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 29 01:03:57.115184 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 29 01:03:57.115184 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:03:57.115184 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:03:57.115184 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:03:57.115184 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:03:57.115184 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 29 01:03:57.116101 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:03:57.118962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9f66b713-2988-4929-8174-8828cadfc2c9 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:03:57.128685 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9f66b713-2988-4929-8174-8828cadfc2c9 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] 10.222.0.26 "POST /compute/v2.1/flavors/874088884/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.055622 Oct 29 01:03:57.128685 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 9/14] 10.222.0.26 () {60 vars in 1221 bytes} [Sat Oct 29 01:03:57 2022] POST /compute/v2.1/flavors/874088884/os-extra_specs => generated 124 bytes in 57 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:03:57.128685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bdbc8957-9cee-42cd-81c7-4efd30b711cc tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:57.151445 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bdbc8957-9cee-42cd-81c7-4efd30b711cc tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.029181 Oct 29 01:03:57.163169 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 10/15] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Oct 29 01:03:57 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:03:57.163169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-13c75adb-fcea-490e-8040-f1d3c9753168 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:03:57.301518 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-13c75adb-fcea-490e-8040-f1d3c9753168 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/874088884/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.148150 Oct 29 01:03:57.302356 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 11/16] 10.222.0.26 () {60 vars in 1221 bytes} [Sat Oct 29 01:03:57 2022] POST /compute/v2.1/flavors/874088884/os-extra_specs => generated 66 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:03:57.315026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-77d7626b-2247-4e73-b66b-cd141b088a93 tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862964-3"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:03:57.334895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77d7626b-2247-4e73-b66b-cd141b088a93 tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:57.334895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77d7626b-2247-4e73-b66b-cd141b088a93 tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:57.334895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77d7626b-2247-4e73-b66b-cd141b088a93 tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:57.985225 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1dbe0b5a-275f-40c1-9d1a-ae111c8e88dc tempest-FlavorsAccessTestJSON-1591635930 tempest-FlavorsAccessTestJSON-1591635930-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/584164829/action" status: 200 len: 21 microversion: 2.1 time: 0.890505 Oct 29 01:03:57.992334 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 6/17] 10.222.0.26 () {60 vars in 1197 bytes} [Sat Oct 29 01:03:57 2022] POST /compute/v2.1/flavors/584164829/action => generated 21 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:03:57.997561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4d36fb04-3c76-4cd5-9889-333d3189faff tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:58.003965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4d36fb04-3c76-4cd5-9889-333d3189faff tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '6c4392cc4d474298afb91612d7ce3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0434fada20e4da4b2ad32770682c5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4d36fb04-3c76-4cd5-9889-333d3189faff tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] Request method failure captured: Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/flavors/874088884/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHv334GK8X4ceTVdLxDRN3ICdO58UNAzxabskKKtEBRiAplS7dYQLkC0aai2x6VGWAmmuSAM-Hcc6Qa0c5f-ApucC92oz7GFeeD70jvDWHwLJ07dwg_5pe92kKhyKpfqrbsd-IonCBavfAvtUVP7UkU3pQbdRawa_hRC5croMjFzUmA Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: a0434fada20e4da4b2ad32770682c5ce Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:03:58.015557 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:03:58.016763 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0434fada20e4da4b2ad32770682c5ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a0434fada20e4da4b2ad32770682c5ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0434fada20e4da4b2ad32770682c5ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a0434fada20e4da4b2ad32770682c5ce", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:03:58.016763 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 Oct 29 01:03:58.016763 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: a0434fada20e4da4b2ad32770682c5ce Oct 29 01:03:58.016763 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 Oct 29 01:03:58.016763 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project Oct 29 01:03:58.016763 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:03:58.016763 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:03:58.016763 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 6c4392cc4d474298afb91612d7ce3552 Oct 29 01:03:58.016763 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project Oct 29 01:03:58.016763 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:03:58.016763 n-d-862964-3 devstack@n-api.service[121100]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'flavor_id': '874088884', 'id': 'hw:numa_nodes'} Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:03:58.017328 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:03:58.018300 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:03:58.018300 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:03:58.018300 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:03:58.018300 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:03:58.018300 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:03:58.018300 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 29 01:03:58.018300 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.018300 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:03:58.018300 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.018300 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:03:58.018300 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:03:58.018300 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:03:58.018300 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:03:58.018300 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:03:58.018300 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 29 01:03:58.018300 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.020225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4d36fb04-3c76-4cd5-9889-333d3189faff tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:03:58.022593 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4d36fb04-3c76-4cd5-9889-333d3189faff tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] 10.222.0.26 "DELETE /compute/v2.1/flavors/874088884/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.028245 Oct 29 01:03:58.024683 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 7/18] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:03:57 2022] DELETE /compute/v2.1/flavors/874088884/os-extra_specs/hw:numa_nodes => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:03:58.029823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d005bdd9-aa0b-4c63-8b41-552bb200c863 tempest-FlavorsAccessTestJSON-1825566678 tempest-FlavorsAccessTestJSON-1825566678-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:58.069401 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d005bdd9-aa0b-4c63-8b41-552bb200c863 tempest-FlavorsAccessTestJSON-1825566678 tempest-FlavorsAccessTestJSON-1825566678-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.043269 Oct 29 01:03:58.085365 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 8/19] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:03:58 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:03:58.258758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-72477c01-68b2-4a60-b074-65e086b6a318 tempest-AZAdminV2TestJSON-1517724974 tempest-AZAdminV2TestJSON-1517724974-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:58.261262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-72477c01-68b2-4a60-b074-65e086b6a318 tempest-AZAdminV2TestJSON-1517724974 tempest-AZAdminV2TestJSON-1517724974-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:58.262516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-72477c01-68b2-4a60-b074-65e086b6a318 tempest-AZAdminV2TestJSON-1517724974 tempest-AZAdminV2TestJSON-1517724974-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:58.263157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-72477c01-68b2-4a60-b074-65e086b6a318 tempest-AZAdminV2TestJSON-1517724974 tempest-AZAdminV2TestJSON-1517724974-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:58.264096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-72477c01-68b2-4a60-b074-65e086b6a318 tempest-AZAdminV2TestJSON-1517724974 tempest-AZAdminV2TestJSON-1517724974-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:58.264768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-72477c01-68b2-4a60-b074-65e086b6a318 tempest-AZAdminV2TestJSON-1517724974 tempest-AZAdminV2TestJSON-1517724974-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:58.265410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-72477c01-68b2-4a60-b074-65e086b6a318 tempest-AZAdminV2TestJSON-1517724974 tempest-AZAdminV2TestJSON-1517724974-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:58.310244 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-72477c01-68b2-4a60-b074-65e086b6a318 tempest-AZAdminV2TestJSON-1517724974 tempest-AZAdminV2TestJSON-1517724974-project-admin] 10.222.0.26 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.223283 Oct 29 01:03:58.318747 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 9/20] 10.222.0.26 () {58 vars in 1164 bytes} [Sat Oct 29 01:03:58 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:03:58.318747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b07a1483-e2fd-4007-8a38-0ab115f17afd tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:03:58.347798 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b07a1483-e2fd-4007-8a38-0ab115f17afd tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/874088884/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035514 Oct 29 01:03:58.348391 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 10/21] 10.222.0.26 () {60 vars in 1221 bytes} [Sat Oct 29 01:03:58 2022] POST /compute/v2.1/flavors/874088884/os-extra_specs => generated 66 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:03:58.357619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5bccac14-266b-4641-a09e-d37d1ecc77ad tempest-FlavorsAccessTestJSON-1591635930 tempest-FlavorsAccessTestJSON-1591635930-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:58.416063 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-77d7626b-2247-4e73-b66b-cd141b088a93 tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 1.112287 Oct 29 01:03:58.417952 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 12/22] 10.222.0.26 () {62 vars in 1232 bytes} [Sat Oct 29 01:03:57 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:03:58.431651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c8ce8f1a-76a2-487b-8c88-80bd01651664 tempest-AZAdminV2TestJSON-1517724974 tempest-AZAdminV2TestJSON-1517724974-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:58.433547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8ce8f1a-76a2-487b-8c88-80bd01651664 tempest-AZAdminV2TestJSON-1517724974 tempest-AZAdminV2TestJSON-1517724974-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:58.434109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8ce8f1a-76a2-487b-8c88-80bd01651664 tempest-AZAdminV2TestJSON-1517724974 tempest-AZAdminV2TestJSON-1517724974-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:58.434705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8ce8f1a-76a2-487b-8c88-80bd01651664 tempest-AZAdminV2TestJSON-1517724974 tempest-AZAdminV2TestJSON-1517724974-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:58.435545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8ce8f1a-76a2-487b-8c88-80bd01651664 tempest-AZAdminV2TestJSON-1517724974 tempest-AZAdminV2TestJSON-1517724974-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:58.436188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8ce8f1a-76a2-487b-8c88-80bd01651664 tempest-AZAdminV2TestJSON-1517724974 tempest-AZAdminV2TestJSON-1517724974-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:58.436824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8ce8f1a-76a2-487b-8c88-80bd01651664 tempest-AZAdminV2TestJSON-1517724974 tempest-AZAdminV2TestJSON-1517724974-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:58.474500 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c8ce8f1a-76a2-487b-8c88-80bd01651664 tempest-AZAdminV2TestJSON-1517724974 tempest-AZAdminV2TestJSON-1517724974-project-admin] 10.222.0.26 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.047414 Oct 29 01:03:58.475248 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5bccac14-266b-4641-a09e-d37d1ecc77ad tempest-FlavorsAccessTestJSON-1591635930 tempest-FlavorsAccessTestJSON-1591635930-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/584164829" status: 202 len: 0 microversion: 2.1 time: 0.122998 Oct 29 01:03:58.483292 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 29 01:03:58 2022] DELETE /compute/v2.1/flavors/584164829 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:03:58.484413 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 13/24] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Oct 29 01:03:58 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:03:58.499231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0d9e21c2-591c-48f5-a6ff-143375ee7bb3 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:03:58.504461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8959e2da-80d8-4a4a-a04f-3b2fe24d8f20 tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862964-3"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:03:58.506572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0d9e21c2-591c-48f5-a6ff-143375ee7bb3 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '6c4392cc4d474298afb91612d7ce3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0434fada20e4da4b2ad32770682c5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0d9e21c2-591c-48f5-a6ff-143375ee7bb3 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] Request method failure captured: Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: request: PUT /compute/v2.1/flavors/874088884/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 22 Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHv334GK8X4ceTVdLxDRN3ICdO58UNAzxabskKKtEBRiAplS7dYQLkC0aai2x6VGWAmmuSAM-Hcc6Qa0c5f-ApucC92oz7GFeeD70jvDWHwLJ07dwg_5pe92kKhyKpfqrbsd-IonCBavfAvtUVP7UkU3pQbdRawa_hRC5croMjFzUmA Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: a0434fada20e4da4b2ad32770682c5ce Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:03:58.508443 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:03:58.510042 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0434fada20e4da4b2ad32770682c5ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a0434fada20e4da4b2ad32770682c5ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0434fada20e4da4b2ad32770682c5ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a0434fada20e4da4b2ad32770682c5ce", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:03:58.510042 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 Oct 29 01:03:58.510042 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: a0434fada20e4da4b2ad32770682c5ce Oct 29 01:03:58.510042 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 Oct 29 01:03:58.510042 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project Oct 29 01:03:58.510042 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:03:58.510042 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:03:58.510042 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 6c4392cc4d474298afb91612d7ce3552 Oct 29 01:03:58.510042 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project Oct 29 01:03:58.510042 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:03:58.510042 n-d-862964-3 devstack@n-api.service[121100]: {"hw:numa_nodes": "1"} Oct 29 01:03:58.510042 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:03:58.510042 n-d-862964-3 devstack@n-api.service[121100]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 29 01:03:58.510856 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'flavor_id': '874088884', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 29 01:03:58.510856 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:03:58.510856 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:03:58.510856 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:03:58.510856 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:03:58.510856 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:03:58.510856 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:03:58.510856 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:03:58.510856 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:03:58.510856 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:03:58.510856 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:03:58.510856 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 29 01:03:58.510856 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 29 01:03:58.510856 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:03:58.510856 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:03:58.510856 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:03:58.510856 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:03:58.510856 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:03:58.510856 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:03:58.511966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:03:58.511966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:03:58.511966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:03:58.511966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:03:58.511966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:03:58.511966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:03:58.511966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:03:58.511966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:03:58.511966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 29 01:03:58.511966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.511966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:03:58.511966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.511966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:03:58.511966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:03:58.511966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:03:58.511966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:03:58.511966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:03:58.511966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 29 01:03:58.511966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.520978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0d9e21c2-591c-48f5-a6ff-143375ee7bb3 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:03:58.520978 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0d9e21c2-591c-48f5-a6ff-143375ee7bb3 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288 tempest-FlavorsExtraSpecsNegativeTestJSON-528437288-project] 10.222.0.26 "PUT /compute/v2.1/flavors/874088884/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.031927 Oct 29 01:03:58.528067 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 12/25] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 29 01:03:58 2022] PUT /compute/v2.1/flavors/874088884/os-extra_specs/hw:numa_nodes => generated 124 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:03:58.537088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8959e2da-80d8-4a4a-a04f-3b2fe24d8f20 tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:58.538243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8959e2da-80d8-4a4a-a04f-3b2fe24d8f20 tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:58.538782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8959e2da-80d8-4a4a-a04f-3b2fe24d8f20 tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:03:58.541066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-65322c8c-392d-4b3f-8fc9-e6349a3701d9 tempest-FlavorsAccessTestJSON-1591635930 tempest-FlavorsAccessTestJSON-1591635930-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:58.609889 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-65322c8c-392d-4b3f-8fc9-e6349a3701d9 tempest-FlavorsAccessTestJSON-1591635930 tempest-FlavorsAccessTestJSON-1591635930-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.080449 Oct 29 01:03:58.611011 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 13/26] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:03:58 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:03:58.619341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-92151af0-9ce0-4b08-a295-733a7b49bfa9 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:58.630830 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-92151af0-9ce0-4b08-a295-733a7b49bfa9 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] HTTP exception thrown: Flavor 874088884 has no extra specs with key hw:cpu_thread_policy. Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-92151af0-9ce0-4b08-a295-733a7b49bfa9 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] Request method failure captured: Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/flavors/874088884/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHv6q9XloizdzuBxJcquM9fjs351dd-jJpMeZa5uRTH6TOd3Tizj9v5XygQIVNGG3eZNDJmE598fv3f3tZtlgzUcfi2d8EUDEGbsmI0kkKIkF-7P_DSVjbjTdlg0dWbQMqSxj9iSKNdNJsNDbtjGCOGOmkWaZk9zS9mtbfEzaLDu8sE Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 7d1781e094a446f0abee5c712bce7c3e Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:03:58.632239 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:03:58.633523 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d1781e094a446f0abee5c712bce7c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7d1781e094a446f0abee5c712bce7c3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d1781e094a446f0abee5c712bce7c3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7d1781e094a446f0abee5c712bce7c3e", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:03:58.633523 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 Oct 29 01:03:58.633523 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 7d1781e094a446f0abee5c712bce7c3e Oct 29 01:03:58.633523 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 Oct 29 01:03:58.633523 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin Oct 29 01:03:58.633523 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:03:58.633523 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:03:58.633523 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 18be56fa3ee74a26a8f0d96e7f6b756c Oct 29 01:03:58.633523 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin Oct 29 01:03:58.633523 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:03:58.633523 n-d-862964-3 devstack@n-api.service[121100]: exception: Flavor 874088884 has no extra specs with key hw:cpu_thread_policy. Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'flavor_id': '874088884', 'id': 'hw:cpu_thread_policy'} Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 874088884 has no extra specs with key hw:cpu_thread_policy. Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:03:58.634440 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.635699 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:03:58.635699 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:03:58.635699 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:03:58.635699 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:03:58.635699 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:03:58.635699 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 874088884 has no extra specs with key hw:cpu_thread_policy. Oct 29 01:03:58.635699 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.636934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-92151af0-9ce0-4b08-a295-733a7b49bfa9 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] Returning 404 to user: Flavor 874088884 has no extra specs with key hw:cpu_thread_policy. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:03:58.639556 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-92151af0-9ce0-4b08-a295-733a7b49bfa9 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/874088884/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.024017 Oct 29 01:03:58.639556 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 14/27] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 29 01:03:58 2022] DELETE /compute/v2.1/flavors/874088884/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:03:58.643892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-863f94f2-9a9b-4d1d-a5aa-590ead4b6fa1 tempest-FlavorsAccessTestJSON-1591635930 tempest-FlavorsAccessTestJSON-1591635930-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-590257130", "id": 1321411717, "os-flavor-access:is_public": "False"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:03:58.750887 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-863f94f2-9a9b-4d1d-a5aa-590ead4b6fa1 tempest-FlavorsAccessTestJSON-1591635930 tempest-FlavorsAccessTestJSON-1591635930-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.110500 Oct 29 01:03:58.751947 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 15/28] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:03:58 2022] POST /compute/v2.1/flavors => generated 430 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:03:58.758406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e13054be-7a19-42c7-b639-cdb1cce27d76 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:03:58.763900 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-e13054be-7a19-42c7-b639-cdb1cce27d76 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e13054be-7a19-42c7-b639-cdb1cce27d76 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] Request method failure captured: Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: request: PUT /compute/v2.1/flavors/874088884/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 27 Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHv6q9XloizdzuBxJcquM9fjs351dd-jJpMeZa5uRTH6TOd3Tizj9v5XygQIVNGG3eZNDJmE598fv3f3tZtlgzUcfi2d8EUDEGbsmI0kkKIkF-7P_DSVjbjTdlg0dWbQMqSxj9iSKNdNJsNDbtjGCOGOmkWaZk9zS9mtbfEzaLDu8sE Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 7d1781e094a446f0abee5c712bce7c3e Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:03:58.765316 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:03:58.772524 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d1781e094a446f0abee5c712bce7c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7d1781e094a446f0abee5c712bce7c3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d1781e094a446f0abee5c712bce7c3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7d1781e094a446f0abee5c712bce7c3e", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:03:58.772524 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 Oct 29 01:03:58.772524 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 7d1781e094a446f0abee5c712bce7c3e Oct 29 01:03:58.772524 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 Oct 29 01:03:58.772524 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin Oct 29 01:03:58.772524 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:03:58.772524 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:03:58.772524 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 18be56fa3ee74a26a8f0d96e7f6b756c Oct 29 01:03:58.772524 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin Oct 29 01:03:58.772524 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:03:58.772524 n-d-862964-3 devstack@n-api.service[121100]: {"hw:cpu_policy": "shared"} Oct 29 01:03:58.772524 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:03:58.772524 n-d-862964-3 devstack@n-api.service[121100]: exception: Request body and URI mismatch Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'flavor_id': '874088884', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:03:58.773185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:03:58.774204 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:03:58.774204 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:03:58.774204 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 29 01:03:58.774204 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.774204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e13054be-7a19-42c7-b639-cdb1cce27d76 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:03:58.774204 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e13054be-7a19-42c7-b639-cdb1cce27d76 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/874088884/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.013546 Oct 29 01:03:58.774204 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 16/29] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 29 01:03:58 2022] PUT /compute/v2.1/flavors/874088884/os-extra_specs/hw:numa_nodes => generated 73 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 01:03:58.774204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a62d4a8c-ea8b-446e-b9d6-41c7791d61f0 tempest-FlavorsAccessTestJSON-1591635930 tempest-FlavorsAccessTestJSON-1591635930-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:58.809755 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a62d4a8c-ea8b-446e-b9d6-41c7791d61f0 tempest-FlavorsAccessTestJSON-1591635930 tempest-FlavorsAccessTestJSON-1591635930-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/1321411717/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.020560 Oct 29 01:03:58.809755 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 17/30] 10.222.0.26 () {58 vars in 1209 bytes} [Sat Oct 29 01:03:58 2022] GET /compute/v2.1/flavors/1321411717/os-flavor-access => generated 21 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:03:58.812595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e715fdea-5538-47c2-a380-256a272d8cab tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e715fdea-5538-47c2-a380-256a272d8cab tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] Request method failure captured: Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: request: PUT /compute/v2.1/flavors/874088884/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 49 Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHv6q9XloizdzuBxJcquM9fjs351dd-jJpMeZa5uRTH6TOd3Tizj9v5XygQIVNGG3eZNDJmE598fv3f3tZtlgzUcfi2d8EUDEGbsmI0kkKIkF-7P_DSVjbjTdlg0dWbQMqSxj9iSKNdNJsNDbtjGCOGOmkWaZk9zS9mtbfEzaLDu8sE Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 7d1781e094a446f0abee5c712bce7c3e Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:03:58.818654 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:03:58.819938 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d1781e094a446f0abee5c712bce7c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7d1781e094a446f0abee5c712bce7c3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d1781e094a446f0abee5c712bce7c3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7d1781e094a446f0abee5c712bce7c3e", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:03:58.819938 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 Oct 29 01:03:58.819938 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 7d1781e094a446f0abee5c712bce7c3e Oct 29 01:03:58.819938 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 Oct 29 01:03:58.819938 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin Oct 29 01:03:58.819938 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:03:58.819938 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:03:58.819938 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 18be56fa3ee74a26a8f0d96e7f6b756c Oct 29 01:03:58.819938 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin Oct 29 01:03:58.819938 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:03:58.819938 n-d-862964-3 devstack@n-api.service[121100]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 29 01:03:58.819938 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'flavor_id': '874088884', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance: Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 29 01:03:58.820700 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.821994 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:03:58.823351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:03:58.823351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:03:58.823351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:03:58.823351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:03:58.823351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 29 01:03:58.823351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:03:58.824904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e715fdea-5538-47c2-a380-256a272d8cab tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:03:58.825933 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e715fdea-5538-47c2-a380-256a272d8cab tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/874088884/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.022212 Oct 29 01:03:58.827286 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 18/31] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 29 01:03:58 2022] PUT /compute/v2.1/flavors/874088884/os-extra_specs/hw:numa_nodes => generated 117 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:03:58.833598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4bd0d075-4120-4fc9-ba4a-d01a5df83c21 tempest-FlavorsAccessTestJSON-1591635930 tempest-FlavorsAccessTestJSON-1591635930-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:58.899347 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8959e2da-80d8-4a4a-a04f-3b2fe24d8f20 tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.413802 Oct 29 01:03:58.907617 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 14/32] 10.222.0.26 () {62 vars in 1232 bytes} [Sat Oct 29 01:03:58 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:03:58.913602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-da5d8c06-0d35-4c64-a6db-026d12d29e14 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:58.963458 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4bd0d075-4120-4fc9-ba4a-d01a5df83c21 tempest-FlavorsAccessTestJSON-1591635930 tempest-FlavorsAccessTestJSON-1591635930-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1321411717" status: 202 len: 0 microversion: 2.1 time: 0.134870 Oct 29 01:03:58.964152 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 19/33] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 29 01:03:58 2022] DELETE /compute/v2.1/flavors/1321411717 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:03:58.971488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5f525357-bd0d-4418-9c79-7a1c612f33fd tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:59.031623 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-da5d8c06-0d35-4c64-a6db-026d12d29e14 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/874088884" status: 202 len: 0 microversion: 2.1 time: 0.122076 Oct 29 01:03:59.037629 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 15/34] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 29 01:03:58 2022] DELETE /compute/v2.1/flavors/874088884 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:03:59.039337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c6f3e429-1eee-4f65-ac54-8ae9f5364203 tempest-FlavorsAccessTestJSON-1591635930 tempest-FlavorsAccessTestJSON-1591635930-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:59.081086 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c6f3e429-1eee-4f65-ac54-8ae9f5364203 tempest-FlavorsAccessTestJSON-1591635930 tempest-FlavorsAccessTestJSON-1591635930-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046814 Oct 29 01:03:59.098036 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 16/35] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:03:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:03:59.103685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b0731ce7-b285-4231-b03b-662cb692b36b tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:03:59.127678 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b0731ce7-b285-4231-b03b-662cb692b36b tempest-FlavorsExtraSpecsNegativeTestJSON-31360714 tempest-FlavorsExtraSpecsNegativeTestJSON-31360714-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027563 Oct 29 01:03:59.128643 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 17/36] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:03:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:03:59.147209 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5f525357-bd0d-4418-9c79-7a1c612f33fd tempest-AggregatesAdminTestV241-1914081599 tempest-AggregatesAdminTestV241-1914081599-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.181351 Oct 29 01:03:59.148191 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 20/37] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 29 01:03:58 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:03:59.211797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-94b4ef08-0cbf-414a-9369-f3c0855da246 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1255855997"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:03:59.218750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.aggregate [None req-94b4ef08-0cbf-414a-9369-f3c0855da246 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Generated uuid 4d03b0bd-f2ce-42d4-b95e-6afc2899c4da for aggregate {{(pid=121099) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:03:59.339411 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-94b4ef08-0cbf-414a-9369-f3c0855da246 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.133434 Oct 29 01:03:59.340516 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 18/38] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 29 01:03:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:03:59.353676 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cf19c3f4-2ab1-424e-84a2-cdd7f0921d41 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862964-3"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:03:59.366751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf19c3f4-2ab1-424e-84a2-cdd7f0921d41 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:03:59.367674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf19c3f4-2ab1-424e-84a2-cdd7f0921d41 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:03:59.368274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf19c3f4-2ab1-424e-84a2-cdd7f0921d41 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:01.994459 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cf19c3f4-2ab1-424e-84a2-cdd7f0921d41 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 2.645377 Oct 29 01:04:01.995748 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 21/39] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Oct 29 01:03:59 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 2648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:02.008116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d223db9b-3a5e-4205-83b1-0111ed494ece tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862964-3"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:02.022271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d223db9b-3a5e-4205-83b1-0111ed494ece tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:02.022768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d223db9b-3a5e-4205-83b1-0111ed494ece tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:02.023252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d223db9b-3a5e-4205-83b1-0111ed494ece tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:02.087269 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-d223db9b-3a5e-4205-83b1-0111ed494ece tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h1-862964-3. Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d223db9b-3a5e-4205-83b1-0111ed494ece tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Request method failure captured: Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 39 Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHv7y8fShnsI63katGEm0WgeH2Kbxb39HiH2QfZWEo35_i0CM4MysUy3T68MF-S5HdOozTWeGWIMRqxpzlKGzDHSCr88YvTwNGZc6Vc9h6bMGWUs__LxLXaKSakCIT0In3KWZiVycXo6zG2reiAiUr-bhYYkiK6Zw7Ip62YHXMFXVgQ Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 86f9981226e344ae85143aae56266c16 Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:04:02.106115 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:04:02.107420 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86f9981226e344ae85143aae56266c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/86f9981226e344ae85143aae56266c16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86f9981226e344ae85143aae56266c16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_86f9981226e344ae85143aae56266c16", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:02.107420 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:02.107420 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 86f9981226e344ae85143aae56266c16 Oct 29 01:04:02.107420 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:02.107420 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin Oct 29 01:04:02.107420 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:02.107420 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:02.107420 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 2c3f8d72ff964f3abf72457e6db8e408 Oct 29 01:04:02.107420 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin Oct 29 01:04:02.107420 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:04:02.107420 n-d-862964-3 devstack@n-api.service[121099]: {"add_host": {"host": "n-h1-862964-3"}} Oct 29 01:04:02.107420 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:04:02.107420 n-d-862964-3 devstack@n-api.service[121099]: exception: Aggregate 2 already has host n-h1-862964-3. Oct 29 01:04:02.108288 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-862964-3'}}} Oct 29 01:04:02.108288 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:02.108288 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:02.108288 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 01:04:02.108288 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 01:04:02.108288 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 01:04:02.108288 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 01:04:02.108288 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 01:04:02.108288 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 01:04:02.108288 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 01:04:02.108288 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 01:04:02.108288 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 01:04:02.108288 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 01:04:02.108288 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 01:04:02.108288 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result.read() Oct 29 01:04:02.108288 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 01:04:02.108288 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 01:04:02.108288 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 01:04:02.108288 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 01:04:02.109436 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 01:04:02.109436 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 01:04:02.109436 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 01:04:02.109436 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 01:04:02.109436 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-862964-3-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 29 01:04:02.109436 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:02.109436 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 01:04:02.109436 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:02.109436 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:02.109436 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 29 01:04:02.109436 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 29 01:04:02.109436 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 29 01:04:02.109436 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi session.flush() Oct 29 01:04:02.109436 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 01:04:02.109436 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 29 01:04:02.109436 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 01:04:02.109436 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 29 01:04:02.109436 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 01:04:02.109436 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 29 01:04:02.110532 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 01:04:02.110532 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception Oct 29 01:04:02.110532 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 01:04:02.110532 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 29 01:04:02.110532 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 01:04:02.110532 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 29 01:04:02.110532 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 01:04:02.110532 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 29 01:04:02.110532 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 01:04:02.110532 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 29 01:04:02.110532 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 29 01:04:02.110532 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 29 01:04:02.110532 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 01:04:02.110532 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 01:04:02.110532 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 01:04:02.110532 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 29 01:04:02.110532 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 01:04:02.110532 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 29 01:04:02.111865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 01:04:02.111865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 29 01:04:02.111865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 01:04:02.111865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 01:04:02.111865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 01:04:02.111865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception Oct 29 01:04:02.111865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 01:04:02.111865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 01:04:02.111865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 01:04:02.111865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 01:04:02.111865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 01:04:02.111865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 01:04:02.111865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 01:04:02.111865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 01:04:02.111865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 01:04:02.111865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 01:04:02.111865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 01:04:02.111865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result.read() Oct 29 01:04:02.113552 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 01:04:02.113552 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 01:04:02.113552 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 01:04:02.113552 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 01:04:02.113552 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 01:04:02.113552 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 01:04:02.113552 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 01:04:02.113552 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 01:04:02.113552 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-862964-3-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 29 01:04:02.113552 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 29 01:04:02.113552 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 29, 1, 4, 2, 40188), 'updated_at': None, 'host': 'n-h1-862964-3', 'aggregate_id': 2}] Oct 29 01:04:02.113552 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 01:04:02.113552 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:02.113552 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:02.113552 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:02.113552 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:02.113552 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h1-862964-3. Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:02.117258 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h1-862964-3. Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:02.121524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:02.124844 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h1-862964-3. Oct 29 01:04:02.124844 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:02.124844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d223db9b-3a5e-4205-83b1-0111ed494ece tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Returning 409 to user: Aggregate 2 already has host n-h1-862964-3. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:02.124844 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d223db9b-3a5e-4205-83b1-0111ed494ece tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.113084 Oct 29 01:04:02.129644 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 19/40] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Oct 29 01:04:02 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 29 01:04:02.138581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-668317c1-7c1a-47dd-baec-a6d4b1247af9 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862964-3"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:02.152942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-668317c1-7c1a-47dd-baec-a6d4b1247af9 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:02.153285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-668317c1-7c1a-47dd-baec-a6d4b1247af9 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:02.155426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-668317c1-7c1a-47dd-baec-a6d4b1247af9 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:02.426335 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-668317c1-7c1a-47dd-baec-a6d4b1247af9 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.292881 Oct 29 01:04:02.428599 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 22/41] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Oct 29 01:04:02 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:02.444112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-91c31337-b47e-448a-8edc-6fc48f026b1b tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:02.465262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=5 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:02.538265 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-91c31337-b47e-448a-8edc-6fc48f026b1b tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.101849 Oct 29 01:04:02.538851 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 20/42] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:04:02 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 01:04:02.549463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-99752485-2844-4250-a0be-3c2f1ebfb96e tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-759863162"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:02.553717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.aggregate [None req-99752485-2844-4250-a0be-3c2f1ebfb96e tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Generated uuid cd12a49a-cd8f-4888-898a-1ccc65bafbbd for aggregate {{(pid=121100) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:04:02.562077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-875c8792-4cf8-4055-8d3d-a2949ff7dc66 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-65866272", "name": "tempest-test_aggregate-497009834"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:02.585095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.aggregate [None req-875c8792-4cf8-4055-8d3d-a2949ff7dc66 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Generated uuid 3871fa26-0c44-4e6a-924d-7a890b5c9017 for aggregate {{(pid=121099) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:04:02.658137 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-99752485-2844-4250-a0be-3c2f1ebfb96e tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.112218 Oct 29 01:04:02.658879 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 23/43] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 29 01:04:02 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:02.690021 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-875c8792-4cf8-4055-8d3d-a2949ff7dc66 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 219 microversion: 2.1 time: 0.132561 Oct 29 01:04:02.697651 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 21/44] 10.222.0.26 () {60 vars in 1165 bytes} [Sat Oct 29 01:04:02 2022] POST /compute/v2.1/os-aggregates => generated 219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:02.702723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c1df6d0d-168d-4c26-a1e3-ae21b2450159 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:02.716159 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c1df6d0d-168d-4c26-a1e3-ae21b2450159 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 511 microversion: 2.1 time: 0.017057 Oct 29 01:04:02.716768 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 22/45] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 29 01:04:02 2022] GET /compute/v2.1/os-aggregates => generated 511 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:02.732433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c789c1f8-47b9-4733-9496-457e7738c86b tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862964-3"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:02.744618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c789c1f8-47b9-4733-9496-457e7738c86b tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:02.745120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c789c1f8-47b9-4733-9496-457e7738c86b tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:02.745596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c789c1f8-47b9-4733-9496-457e7738c86b tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:03.116778 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c789c1f8-47b9-4733-9496-457e7738c86b tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 310 microversion: 2.1 time: 0.388450 Oct 29 01:04:03.118030 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Oct 29 01:04:02 2022] POST /compute/v2.1/os-aggregates/4/action => generated 310 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:03.759262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-20feebbd-9263-4409-9f49-70bde18979a0 tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862964-3"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:03.766886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-20feebbd-9263-4409-9f49-70bde18979a0 tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '5b471a581f8d46dd8cd017e3dfc75bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a749a5d109a440938aac285ef9951b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-20feebbd-9263-4409-9f49-70bde18979a0 tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Request method failure captured: Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 39 Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHv4tLh0QEaA21VVydkXYCA00aZxNS-Mjkoocl_LUaIgDA7mt2fS8TPHd5Olve0yT9v0LK5lpooi5a1wHhY6e-gbAM3F3enCBtSpJOByjqJ1ZP2iUZ3wMiTcmX7zrye4PW_-hVvoGG0wsikjxwIGUPXhJk3vXDw8OjrN09ECKArxROc Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: a749a5d109a440938aac285ef9951b9f Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1806462143 Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:04:03.770487 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:04:03.771635 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a749a5d109a440938aac285ef9951b9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a749a5d109a440938aac285ef9951b9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a749a5d109a440938aac285ef9951b9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a749a5d109a440938aac285ef9951b9f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:03.771635 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1806462143 Oct 29 01:04:03.771635 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: a749a5d109a440938aac285ef9951b9f Oct 29 01:04:03.771635 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1806462143 Oct 29 01:04:03.771635 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AggregatesAdminNegativeTestJSON-1806462143-project Oct 29 01:04:03.771635 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:03.771635 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:03.771635 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 5b471a581f8d46dd8cd017e3dfc75bc7 Oct 29 01:04:03.771635 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1806462143-project Oct 29 01:04:03.771635 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:04:03.771635 n-d-862964-3 devstack@n-api.service[121100]: {"add_host": {"host": "n-h1-862964-3"}} Oct 29 01:04:03.771635 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:04:03.771635 n-d-862964-3 devstack@n-api.service[121100]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 29 01:04:03.772296 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-862964-3'}}} Oct 29 01:04:03.772296 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:03.772296 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:03.772296 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:03.772296 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:03.772296 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:03.772296 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:03.772296 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:03.772296 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:03.772296 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:03.772296 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:03.772296 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 29 01:04:03.772296 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 29 01:04:03.772296 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:04:03.772296 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:04:03.772296 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:04:03.772296 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:04:03.772296 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:03.772296 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:03.773222 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:03.773222 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:03.773222 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:04:03.773222 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:04:03.773222 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:04:03.773222 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:04:03.773222 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:04:03.773222 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:04:03.773222 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 29 01:04:03.773222 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:03.773222 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:03.773222 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:03.773222 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:03.773222 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:03.773222 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:03.773222 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:04:03.773222 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:04:03.773222 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 29 01:04:03.773222 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:03.774120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-20feebbd-9263-4409-9f49-70bde18979a0 tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:03.774502 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-20feebbd-9263-4409-9f49-70bde18979a0 tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] 10.222.0.26 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 1.107314 Oct 29 01:04:03.778844 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 24/47] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Oct 29 01:04:02 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 1112 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:04:03.788681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7dae9bd1-48d4-422b-a962-ae9d5d5d8509 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:03.925369 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7dae9bd1-48d4-422b-a962-ae9d5d5d8509 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.141247 Oct 29 01:04:03.927509 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 24/48] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:04:03 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 01:04:03.939035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a6322cb9-5af9-4acd-b642-84ff8b2faaa3 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1358792056"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:03.943004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.aggregate [None req-a6322cb9-5af9-4acd-b642-84ff8b2faaa3 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Generated uuid 13d728c1-2ecf-4e32-8f58-ee920f982185 for aggregate {{(pid=121100) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:04:04.066977 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a6322cb9-5af9-4acd-b642-84ff8b2faaa3 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.132350 Oct 29 01:04:04.068310 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 25/49] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 29 01:04:03 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:04.085918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-446e8de7-e513-43c4-bb5b-add08627fb81 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1723390383"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:04.102694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=10,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:04.114403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-446e8de7-e513-43c4-bb5b-add08627fb81 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:04.115239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-446e8de7-e513-43c4-bb5b-add08627fb81 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:04.117669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-446e8de7-e513-43c4-bb5b-add08627fb81 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:04.128151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-446e8de7-e513-43c4-bb5b-add08627fb81 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:04.128955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-446e8de7-e513-43c4-bb5b-add08627fb81 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:04.130219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-446e8de7-e513-43c4-bb5b-add08627fb81 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:04.141086 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-446e8de7-e513-43c4-bb5b-add08627fb81 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1723390383 could not be found. Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-446e8de7-e513-43c4-bb5b-add08627fb81 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Request method failure captured: Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 58 Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHv7y8fShnsI63katGEm0WgeH2Kbxb39HiH2QfZWEo35_i0CM4MysUy3T68MF-S5HdOozTWeGWIMRqxpzlKGzDHSCr88YvTwNGZc6Vc9h6bMGWUs__LxLXaKSakCIT0In3KWZiVycXo6zG2reiAiUr-bhYYkiK6Zw7Ip62YHXMFXVgQ Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 86f9981226e344ae85143aae56266c16 Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:04:04.147462 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:04:04.148589 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86f9981226e344ae85143aae56266c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/86f9981226e344ae85143aae56266c16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86f9981226e344ae85143aae56266c16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_86f9981226e344ae85143aae56266c16", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:04.148589 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:04.148589 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 86f9981226e344ae85143aae56266c16 Oct 29 01:04:04.148589 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:04.148589 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin Oct 29 01:04:04.148589 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:04.148589 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:04.148589 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 2c3f8d72ff964f3abf72457e6db8e408 Oct 29 01:04:04.148589 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin Oct 29 01:04:04.148589 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:04:04.148589 n-d-862964-3 devstack@n-api.service[121100]: {"add_host": {"host": "tempest-nonexist_host-1723390383"}} Oct 29 01:04:04.148589 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: exception: Compute host tempest-nonexist_host-1723390383 could not be found. Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-1723390383'}}} Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1723390383' is not mapped to any cell Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:04.149368 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 29 01:04:04.150345 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1723390383 could not be found. Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1723390383 could not be found. Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:04.151353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.152369 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:04.152369 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:04.152369 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:04.152369 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:04.152369 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:04.152369 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1723390383 could not be found. Oct 29 01:04:04.152369 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.154539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-446e8de7-e513-43c4-bb5b-add08627fb81 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1723390383 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:04.155618 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-446e8de7-e513-43c4-bb5b-add08627fb81 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 111 microversion: 2.1 time: 0.073649 Oct 29 01:04:04.156777 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Oct 29 01:04:04 2022] POST /compute/v2.1/os-aggregates/5/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:04:04.165014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7a46e3cd-8d89-4a91-953b-27c8597a6c47 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:04.307208 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7a46e3cd-8d89-4a91-953b-27c8597a6c47 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.145677 Oct 29 01:04:04.309115 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 27/51] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:04:04 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 01:04:04.320478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-146d72a1-8e9b-418e-aeba-15c7dbf376b0 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-146d72a1-8e9b-418e-aeba-15c7dbf376b0 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Request method failure captured: Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 283 Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHv7y8fShnsI63katGEm0WgeH2Kbxb39HiH2QfZWEo35_i0CM4MysUy3T68MF-S5HdOozTWeGWIMRqxpzlKGzDHSCr88YvTwNGZc6Vc9h6bMGWUs__LxLXaKSakCIT0In3KWZiVycXo6zG2reiAiUr-bhYYkiK6Zw7Ip62YHXMFXVgQ Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 86f9981226e344ae85143aae56266c16 Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:04:04.324218 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:04:04.330293 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86f9981226e344ae85143aae56266c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/86f9981226e344ae85143aae56266c16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86f9981226e344ae85143aae56266c16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_86f9981226e344ae85143aae56266c16", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:04.330293 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:04.330293 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 86f9981226e344ae85143aae56266c16 Oct 29 01:04:04.330293 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:04.330293 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin Oct 29 01:04:04.330293 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:04.330293 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:04.330293 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 2c3f8d72ff964f3abf72457e6db8e408 Oct 29 01:04:04.330293 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin Oct 29 01:04:04.330293 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:04:04.331068 n-d-862964-3 devstack@n-api.service[121100]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 29 01:04:04.331068 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:04:04.331068 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 01:04:04.331068 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 29 01:04:04.331068 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:04.331068 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:04.331068 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:04:04.331068 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:04:04.331068 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:04:04.331068 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:04:04.331593 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 01:04:04.331593 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.331593 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 29 01:04:04.331593 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 01:04:04.331593 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.331593 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 29 01:04:04.331593 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 01:04:04.331593 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.331593 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:04.331593 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.331593 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:04.331593 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:04.331593 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:04.331593 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:04.331593 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:04.331593 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:04.331593 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:04.335262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:04.335262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:04.335262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:04:04.335262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:04:04.335262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:04:04.335262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:04:04.335262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:04:04.335262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:04:04.335262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 01:04:04.335262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.335262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:04.335262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.335262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:04.335262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:04.335262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:04.338149 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:04:04.338149 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:04:04.338149 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 01:04:04.338149 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.338149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-146d72a1-8e9b-418e-aeba-15c7dbf376b0 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:04.340729 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-146d72a1-8e9b-418e-aeba-15c7dbf376b0 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.021839 Oct 29 01:04:04.340729 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 28/52] 10.222.0.26 () {60 vars in 1165 bytes} [Sat Oct 29 01:04:04 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 01:04:04.354064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2004d26f-0026-4e66-ac59-785de979740a tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2004d26f-0026-4e66-ac59-785de979740a tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Request method failure captured: Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 27 Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHv7y8fShnsI63katGEm0WgeH2Kbxb39HiH2QfZWEo35_i0CM4MysUy3T68MF-S5HdOozTWeGWIMRqxpzlKGzDHSCr88YvTwNGZc6Vc9h6bMGWUs__LxLXaKSakCIT0In3KWZiVycXo6zG2reiAiUr-bhYYkiK6Zw7Ip62YHXMFXVgQ Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 86f9981226e344ae85143aae56266c16 Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:04:04.364777 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:04:04.366095 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86f9981226e344ae85143aae56266c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/86f9981226e344ae85143aae56266c16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86f9981226e344ae85143aae56266c16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_86f9981226e344ae85143aae56266c16", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:04.366095 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:04.366095 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 86f9981226e344ae85143aae56266c16 Oct 29 01:04:04.366095 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:04.366095 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin Oct 29 01:04:04.366095 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:04.366095 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:04.366095 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 2c3f8d72ff964f3abf72457e6db8e408 Oct 29 01:04:04.366095 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin Oct 29 01:04:04.366095 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:04:04.366095 n-d-862964-3 devstack@n-api.service[121100]: {"aggregate": {"name": ""}} Oct 29 01:04:04.366095 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:04:04.366095 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi '' Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:04.366763 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 29 01:04:04.372197 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.373535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2004d26f-0026-4e66-ac59-785de979740a tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:04.373535 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2004d26f-0026-4e66-ac59-785de979740a tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.016004 Oct 29 01:04:04.373535 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 29/53] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 29 01:04:04 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:04:04.376441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-202e1100-712f-438b-af79-f44e274dd99c tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1051380521"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:04.380279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-202e1100-712f-438b-af79-f44e274dd99c tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '5b471a581f8d46dd8cd017e3dfc75bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a749a5d109a440938aac285ef9951b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-202e1100-712f-438b-af79-f44e274dd99c tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Request method failure captured: Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 60 Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHv4tLh0QEaA21VVydkXYCA00aZxNS-Mjkoocl_LUaIgDA7mt2fS8TPHd5Olve0yT9v0LK5lpooi5a1wHhY6e-gbAM3F3enCBtSpJOByjqJ1ZP2iUZ3wMiTcmX7zrye4PW_-hVvoGG0wsikjxwIGUPXhJk3vXDw8OjrN09ECKArxROc Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: a749a5d109a440938aac285ef9951b9f Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1806462143 Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:04:04.383159 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:04:04.384329 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a749a5d109a440938aac285ef9951b9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a749a5d109a440938aac285ef9951b9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a749a5d109a440938aac285ef9951b9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a749a5d109a440938aac285ef9951b9f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:04.384329 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1806462143 Oct 29 01:04:04.384329 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: a749a5d109a440938aac285ef9951b9f Oct 29 01:04:04.384329 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1806462143 Oct 29 01:04:04.384329 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AggregatesAdminNegativeTestJSON-1806462143-project Oct 29 01:04:04.384329 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:04.384329 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:04.384329 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 5b471a581f8d46dd8cd017e3dfc75bc7 Oct 29 01:04:04.384329 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1806462143-project Oct 29 01:04:04.384329 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:04:04.384329 n-d-862964-3 devstack@n-api.service[121100]: {"aggregate": {"name": "tempest-test_aggregate-1051380521"}} Oct 29 01:04:04.384329 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:04:04.384329 n-d-862964-3 devstack@n-api.service[121100]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 29 01:04:04.384968 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1051380521'}}} Oct 29 01:04:04.384968 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:04.384968 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:04.384968 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:04.384968 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:04.384968 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:04.384968 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:04.384968 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:04.384968 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:04.384968 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:04.384968 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:04.384968 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:04.384968 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:04.384968 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 29 01:04:04.384968 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 29 01:04:04.384968 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:04:04.384968 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:04:04.384968 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:04:04.384968 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:04:04.386417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 29 01:04:04.387685 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.387685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-202e1100-712f-438b-af79-f44e274dd99c tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:04.387685 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-202e1100-712f-438b-af79-f44e274dd99c tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.012596 Oct 29 01:04:04.387685 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 30/54] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 29 01:04:04 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:04:04.395002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4ea68872-d7b4-4c60-a3f2-47d41878bb93 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1770406771"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:04.404666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.aggregate [None req-4ea68872-d7b4-4c60-a3f2-47d41878bb93 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Generated uuid 633e6e14-6c3c-4733-a67b-846f0cb52fbf for aggregate {{(pid=121100) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:04:04.554911 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4ea68872-d7b4-4c60-a3f2-47d41878bb93 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.163391 Oct 29 01:04:04.557197 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 31/55] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 29 01:04:04 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:04.571867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-42a1eef0-548a-4b4d-8fbc-a02576202ee3 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1770406771"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:04.575736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.aggregate [None req-42a1eef0-548a-4b4d-8fbc-a02576202ee3 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Generated uuid ab7d51eb-3d31-4627-9ba5-fe7a4c43c344 for aggregate {{(pid=121100) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:04:04.589608 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-42a1eef0-548a-4b4d-8fbc-a02576202ee3 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1770406771 already exists. Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-42a1eef0-548a-4b4d-8fbc-a02576202ee3 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Request method failure captured: Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 60 Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHv7y8fShnsI63katGEm0WgeH2Kbxb39HiH2QfZWEo35_i0CM4MysUy3T68MF-S5HdOozTWeGWIMRqxpzlKGzDHSCr88YvTwNGZc6Vc9h6bMGWUs__LxLXaKSakCIT0In3KWZiVycXo6zG2reiAiUr-bhYYkiK6Zw7Ip62YHXMFXVgQ Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 86f9981226e344ae85143aae56266c16 Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:04:04.591930 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:04:04.593403 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86f9981226e344ae85143aae56266c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/86f9981226e344ae85143aae56266c16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86f9981226e344ae85143aae56266c16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_86f9981226e344ae85143aae56266c16", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:04.593403 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:04.593403 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 86f9981226e344ae85143aae56266c16 Oct 29 01:04:04.593403 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:04.593403 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin Oct 29 01:04:04.593403 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:04.593403 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:04.593403 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 2c3f8d72ff964f3abf72457e6db8e408 Oct 29 01:04:04.593403 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin Oct 29 01:04:04.593403 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:04:04.593403 n-d-862964-3 devstack@n-api.service[121100]: {"aggregate": {"name": "tempest-test_aggregate-1770406771"}} Oct 29 01:04:04.593403 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:04:04.593403 n-d-862964-3 devstack@n-api.service[121100]: exception: Aggregate tempest-test_aggregate-1770406771 already exists. Oct 29 01:04:04.594087 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1770406771'}}} Oct 29 01:04:04.594087 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:04.594087 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:04.594087 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 29 01:04:04.594087 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 29 01:04:04.594087 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 01:04:04.594087 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 01:04:04.594087 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:04.594087 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:04.594087 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:04.594087 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:04.594087 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 01:04:04.594087 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 01:04:04.594087 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 29 01:04:04.594087 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 29 01:04:04.594087 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 01:04:04.594087 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 01:04:04.594087 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 29 01:04:04.594087 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1770406771 already exists. Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:04.595020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 29 01:04:04.596469 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 29 01:04:04.596469 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1770406771 already exists. Oct 29 01:04:04.596469 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.596469 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:04.596469 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.596469 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:04.596469 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:04.596469 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:04.596469 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:04.596469 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:04.596469 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1770406771 already exists. Oct 29 01:04:04.596469 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.596469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-42a1eef0-548a-4b4d-8fbc-a02576202ee3 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1770406771 already exists. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:04.596469 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-42a1eef0-548a-4b4d-8fbc-a02576202ee3 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.031189 Oct 29 01:04:04.597426 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 32/56] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 29 01:04:04 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 32 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 29 01:04:04.606556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-913eccf9-9439-4236-bfb0-a1f4dac8b647 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:04.636380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-2124556363", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "availability_zone": "tempest-test_az-65866272"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:04.670844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:04.671486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:04.672250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:04.673077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:04.675813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:04.675813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:04.735924 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-913eccf9-9439-4236-bfb0-a1f4dac8b647 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.134034 Oct 29 01:04:04.736894 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 33/57] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:04:04 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 01:04:04.745814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-89245984-d4c1-4396-8db6-cfd3a42c2d6b tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-730647484"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:04.751557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.aggregate [None req-89245984-d4c1-4396-8db6-cfd3a42c2d6b tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Generated uuid c602c926-36c5-49ae-8283-b6f5127f7a2e for aggregate {{(pid=121100) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:04:04.900501 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-89245984-d4c1-4396-8db6-cfd3a42c2d6b tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.158656 Oct 29 01:04:04.902132 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 34/58] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 29 01:04:04 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:04:04.916651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-20647857-46b6-4a7d-b100-299ccb1b79ed tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:04.918530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-20647857-46b6-4a7d-b100-299ccb1b79ed tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '5b471a581f8d46dd8cd017e3dfc75bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a749a5d109a440938aac285ef9951b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-20647857-46b6-4a7d-b100-299ccb1b79ed tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Request method failure captured: Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHv4tLh0QEaA21VVydkXYCA00aZxNS-Mjkoocl_LUaIgDA7mt2fS8TPHd5Olve0yT9v0LK5lpooi5a1wHhY6e-gbAM3F3enCBtSpJOByjqJ1ZP2iUZ3wMiTcmX7zrye4PW_-hVvoGG0wsikjxwIGUPXhJk3vXDw8OjrN09ECKArxROc Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: a749a5d109a440938aac285ef9951b9f Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1806462143 Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:04:04.920879 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:04:04.922129 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a749a5d109a440938aac285ef9951b9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a749a5d109a440938aac285ef9951b9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a749a5d109a440938aac285ef9951b9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a749a5d109a440938aac285ef9951b9f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:04.922129 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1806462143 Oct 29 01:04:04.922129 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: a749a5d109a440938aac285ef9951b9f Oct 29 01:04:04.922129 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1806462143 Oct 29 01:04:04.922129 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AggregatesAdminNegativeTestJSON-1806462143-project Oct 29 01:04:04.922129 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:04.922129 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:04.922129 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 5b471a581f8d46dd8cd017e3dfc75bc7 Oct 29 01:04:04.922129 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1806462143-project Oct 29 01:04:04.922129 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:04:04.922129 n-d-862964-3 devstack@n-api.service[121100]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 29 01:04:04.922129 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '7'} Oct 29 01:04:04.922905 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:04.922905 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:04.922905 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:04.922905 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:04.922905 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:04.922905 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:04.922905 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:04.922905 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:04.922905 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 29 01:04:04.922905 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 29 01:04:04.922905 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:04:04.922905 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:04:04.922905 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:04:04.922905 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:04:04.922905 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:04.922905 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:04.922905 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:04.922905 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:04.922905 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:04:04.923842 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:04:04.923842 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:04:04.923842 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:04:04.923842 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:04:04.923842 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:04:04.923842 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 29 01:04:04.923842 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.923842 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:04.923842 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.923842 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:04.923842 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:04.923842 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:04.923842 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:04:04.923842 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:04:04.923842 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 29 01:04:04.923842 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:04.926279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-20647857-46b6-4a7d-b100-299ccb1b79ed tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:04.927779 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-20647857-46b6-4a7d-b100-299ccb1b79ed tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.017310 Oct 29 01:04:04.928323 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 35/59] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:04:04 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:04:04.937358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b5c2d94e-d0c2-4ba9-ae90-bcbc277fa768 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:05.024835 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b5c2d94e-d0c2-4ba9-ae90-bcbc277fa768 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.091738 Oct 29 01:04:05.026683 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 36/60] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:04:04 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 01:04:05.037212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-76561256-68c4-4b84-ab91-c202f76257d4 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:05.049938 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-76561256-68c4-4b84-ab91-c202f76257d4 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-76561256-68c4-4b84-ab91-c202f76257d4 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Request method failure captured: Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHv7y8fShnsI63katGEm0WgeH2Kbxb39HiH2QfZWEo35_i0CM4MysUy3T68MF-S5HdOozTWeGWIMRqxpzlKGzDHSCr88YvTwNGZc6Vc9h6bMGWUs__LxLXaKSakCIT0In3KWZiVycXo6zG2reiAiUr-bhYYkiK6Zw7Ip62YHXMFXVgQ Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 86f9981226e344ae85143aae56266c16 Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:04:05.053080 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:04:05.054702 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86f9981226e344ae85143aae56266c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/86f9981226e344ae85143aae56266c16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86f9981226e344ae85143aae56266c16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_86f9981226e344ae85143aae56266c16", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:05.054702 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:05.054702 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 86f9981226e344ae85143aae56266c16 Oct 29 01:04:05.054702 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:05.054702 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin Oct 29 01:04:05.054702 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:05.054702 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:05.054702 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 2c3f8d72ff964f3abf72457e6db8e408 Oct 29 01:04:05.054702 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin Oct 29 01:04:05.054702 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:04:05.054702 n-d-862964-3 devstack@n-api.service[121100]: exception: Aggregate -1 could not be found. Oct 29 01:04:05.054702 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '-1'} Oct 29 01:04:05.055507 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:05.055507 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:05.055507 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 29 01:04:05.055507 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 29 01:04:05.055507 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 01:04:05.055507 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 01:04:05.055507 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:05.055507 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:05.055507 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:05.055507 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:05.055507 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 01:04:05.055507 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 01:04:05.055507 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 29 01:04:05.055507 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 01:04:05.055507 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:04:05.055507 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:04:05.055507 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 01:04:05.055507 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 01:04:05.055507 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:05.056676 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:05.058276 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:05.058276 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:05.058276 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:05.058276 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:05.058276 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 29 01:04:05.058276 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:05.060258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-76561256-68c4-4b84-ab91-c202f76257d4 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:05.062173 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-76561256-68c4-4b84-ab91-c202f76257d4 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.029100 Oct 29 01:04:05.068623 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 37/61] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 29 01:04:05 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:04:05.089184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-68f197a3-6159-40bb-8cc2-d8fd6c578c7b tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1373808460"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:05.089184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.aggregate [None req-68f197a3-6159-40bb-8cc2-d8fd6c578c7b tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Generated uuid 22acdaf4-f5fc-4cf6-95bf-bb7eba4f36eb for aggregate {{(pid=121100) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:04:05.181697 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-68f197a3-6159-40bb-8cc2-d8fd6c578c7b tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.111459 Oct 29 01:04:05.182295 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 38/62] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 29 01:04:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:05.194601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0bab027d-0a58-4ffa-8d3e-955d15d3539c tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:05.196812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0bab027d-0a58-4ffa-8d3e-955d15d3539c tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '5b471a581f8d46dd8cd017e3dfc75bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a749a5d109a440938aac285ef9951b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0bab027d-0a58-4ffa-8d3e-955d15d3539c tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Request method failure captured: Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHv4tLh0QEaA21VVydkXYCA00aZxNS-Mjkoocl_LUaIgDA7mt2fS8TPHd5Olve0yT9v0LK5lpooi5a1wHhY6e-gbAM3F3enCBtSpJOByjqJ1ZP2iUZ3wMiTcmX7zrye4PW_-hVvoGG0wsikjxwIGUPXhJk3vXDw8OjrN09ECKArxROc Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: a749a5d109a440938aac285ef9951b9f Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1806462143 Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:04:05.197731 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:04:05.198879 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a749a5d109a440938aac285ef9951b9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a749a5d109a440938aac285ef9951b9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a749a5d109a440938aac285ef9951b9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a749a5d109a440938aac285ef9951b9f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:05.198879 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1806462143 Oct 29 01:04:05.198879 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: a749a5d109a440938aac285ef9951b9f Oct 29 01:04:05.198879 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1806462143 Oct 29 01:04:05.198879 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AggregatesAdminNegativeTestJSON-1806462143-project Oct 29 01:04:05.198879 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:05.198879 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:05.198879 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 5b471a581f8d46dd8cd017e3dfc75bc7 Oct 29 01:04:05.198879 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1806462143-project Oct 29 01:04:05.198879 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:04:05.198879 n-d-862964-3 devstack@n-api.service[121100]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 29 01:04:05.198879 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '8'} Oct 29 01:04:05.199590 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:05.199590 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:05.199590 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:05.199590 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:05.199590 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:05.199590 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:05.199590 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:05.199590 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:05.199590 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 29 01:04:05.199590 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 29 01:04:05.199590 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:04:05.199590 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:04:05.199590 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:04:05.199590 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:04:05.199590 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:05.199590 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:05.199590 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:05.199590 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:05.199590 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:04:05.200522 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:04:05.200522 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:04:05.200522 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:04:05.200522 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:04:05.200522 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:04:05.200522 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 29 01:04:05.200522 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:05.200522 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:05.200522 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:05.200522 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:05.200522 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:05.200522 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:05.200522 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:04:05.200522 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:04:05.200522 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 29 01:04:05.200522 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:05.200522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0bab027d-0a58-4ffa-8d3e-955d15d3539c tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:05.202195 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0bab027d-0a58-4ffa-8d3e-955d15d3539c tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] 10.222.0.26 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.009717 Oct 29 01:04:05.203827 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 39/63] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 29 01:04:05 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:04:05.209552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-18ed49cd-1a60-4968-a3ae-4d3f4c8ae79c tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:05.326288 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-18ed49cd-1a60-4968-a3ae-4d3f4c8ae79c tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.121008 Oct 29 01:04:05.327276 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 40/64] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:04:05 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 29 01:04:05.337923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-de0f19a0-a10f-4503-817e-8633707e3087 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:05.346880 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-de0f19a0-a10f-4503-817e-8633707e3087 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-de0f19a0-a10f-4503-817e-8633707e3087 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Request method failure captured: Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHv7y8fShnsI63katGEm0WgeH2Kbxb39HiH2QfZWEo35_i0CM4MysUy3T68MF-S5HdOozTWeGWIMRqxpzlKGzDHSCr88YvTwNGZc6Vc9h6bMGWUs__LxLXaKSakCIT0In3KWZiVycXo6zG2reiAiUr-bhYYkiK6Zw7Ip62YHXMFXVgQ Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 86f9981226e344ae85143aae56266c16 Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:04:05.349198 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:04:05.360686 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86f9981226e344ae85143aae56266c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/86f9981226e344ae85143aae56266c16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86f9981226e344ae85143aae56266c16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_86f9981226e344ae85143aae56266c16", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:05.360686 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:05.360686 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 86f9981226e344ae85143aae56266c16 Oct 29 01:04:05.360686 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:05.360686 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin Oct 29 01:04:05.360686 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:05.360686 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:05.360686 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 2c3f8d72ff964f3abf72457e6db8e408 Oct 29 01:04:05.360686 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin Oct 29 01:04:05.360686 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:04:05.360686 n-d-862964-3 devstack@n-api.service[121100]: exception: Aggregate -1 could not be found. Oct 29 01:04:05.360686 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '-1'} Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:05.361353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:05.362353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:05.362353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:05.362353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:05.362353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:05.362353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:05.362353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 29 01:04:05.362353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:04:05.362353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 29 01:04:05.362353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:05.362353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:05.362353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:05.362353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:05.362353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:05.362353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:05.362353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:05.362353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:05.362353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 29 01:04:05.362353 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:05.363282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-de0f19a0-a10f-4503-817e-8633707e3087 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:05.363282 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-de0f19a0-a10f-4503-817e-8633707e3087 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.018548 Oct 29 01:04:05.363282 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 41/65] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:04:05 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:04:05.371894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a4a2c9d0-8b3b-45cf-9bec-7616065f0cec tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:05.374577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a4a2c9d0-8b3b-45cf-9bec-7616065f0cec tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '5b471a581f8d46dd8cd017e3dfc75bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a749a5d109a440938aac285ef9951b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a4a2c9d0-8b3b-45cf-9bec-7616065f0cec tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Request method failure captured: Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHv4tLh0QEaA21VVydkXYCA00aZxNS-Mjkoocl_LUaIgDA7mt2fS8TPHd5Olve0yT9v0LK5lpooi5a1wHhY6e-gbAM3F3enCBtSpJOByjqJ1ZP2iUZ3wMiTcmX7zrye4PW_-hVvoGG0wsikjxwIGUPXhJk3vXDw8OjrN09ECKArxROc Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: a749a5d109a440938aac285ef9951b9f Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1806462143 Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:04:05.377014 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:04:05.378204 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a749a5d109a440938aac285ef9951b9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a749a5d109a440938aac285ef9951b9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a749a5d109a440938aac285ef9951b9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a749a5d109a440938aac285ef9951b9f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:05.378204 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1806462143 Oct 29 01:04:05.378204 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: a749a5d109a440938aac285ef9951b9f Oct 29 01:04:05.378204 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1806462143 Oct 29 01:04:05.378204 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AggregatesAdminNegativeTestJSON-1806462143-project Oct 29 01:04:05.378204 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:05.378204 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:05.378204 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 5b471a581f8d46dd8cd017e3dfc75bc7 Oct 29 01:04:05.378204 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1806462143-project Oct 29 01:04:05.378204 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:04:05.378204 n-d-862964-3 devstack@n-api.service[121100]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 29 01:04:05.378204 n-d-862964-3 devstack@n-api.service[121100]: action_args: {} Oct 29 01:04:05.378818 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:05.378818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:05.378818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:05.378818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:05.378818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:05.378818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:05.378818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:05.378818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:05.378818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 29 01:04:05.378818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 29 01:04:05.378818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:04:05.378818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:04:05.378818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:04:05.378818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:04:05.378818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:05.378818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:05.378818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:05.378818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:05.378818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:04:05.379832 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:04:05.379832 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:04:05.379832 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:04:05.379832 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:04:05.379832 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:04:05.379832 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 29 01:04:05.379832 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:05.379832 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:05.379832 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:05.379832 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:05.379832 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:05.379832 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:05.379832 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:04:05.379832 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:04:05.379832 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 29 01:04:05.379832 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:05.379832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a4a2c9d0-8b3b-45cf-9bec-7616065f0cec tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:05.380904 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a4a2c9d0-8b3b-45cf-9bec-7616065f0cec tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.017623 Oct 29 01:04:05.380904 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 42/66] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 29 01:04:05 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:04:05.769783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] validate_networks() for None {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:04:06.202940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:04:06.203380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:04:06.204091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:04:06.204519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:04:06.204949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:04:06.236833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:06.238820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:06.242100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:06.244086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:06.244591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:06.245038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:06.307329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Getting quotas for project 73949a2336ba4121922600fa26b4af43. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:04:06.313943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Getting quotas for user c5f2373aa70c4119843b4f019bd4ea62 and project 73949a2336ba4121922600fa26b4af43. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:04:06.326333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:04:06.329137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:04:06.527832 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fb46650a-0011-43f0-9f9f-174a7070e38e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.525339 Oct 29 01:04:06.528850 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 25/67] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:04:06.545145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ca89771c-a3ff-4ee2-8207-9a7e7ca6e9ca tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:06.545907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ca89771c-a3ff-4ee2-8207-9a7e7ca6e9ca tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:08.088043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ca89771c-a3ff-4ee2-8207-9a7e7ca6e9ca tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:08.126257 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ca89771c-a3ff-4ee2-8207-9a7e7ca6e9ca tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1241 microversion: 2.1 time: 1.587044 Oct 29 01:04:08.126870 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 43/68] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:06 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1241 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:09.151864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5a6842c7-a1a0-4e69-9597-acaa08019f37 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:09.153294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5a6842c7-a1a0-4e69-9597-acaa08019f37 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:09.256822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5a6842c7-a1a0-4e69-9597-acaa08019f37 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:09.273766 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5a6842c7-a1a0-4e69-9597-acaa08019f37 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1241 microversion: 2.1 time: 0.125940 Oct 29 01:04:09.285691 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 26/69] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:09 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1241 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:09.865096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-353b23bf-727a-4ff5-bca8-9353d2fbcc23 tempest-InstanceUsageAuditLogNegativeTestJSON-2002258596 tempest-InstanceUsageAuditLogNegativeTestJSON-2002258596-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:09.872940 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-353b23bf-727a-4ff5-bca8-9353d2fbcc23 tempest-InstanceUsageAuditLogNegativeTestJSON-2002258596 tempest-InstanceUsageAuditLogNegativeTestJSON-2002258596-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-353b23bf-727a-4ff5-bca8-9353d2fbcc23 tempest-InstanceUsageAuditLogNegativeTestJSON-2002258596 tempest-InstanceUsageAuditLogNegativeTestJSON-2002258596-project-admin] Request method failure captured: Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHwJ_KRotTxKtBTDp9G-6hqVFxifKrHmCwfdUyqWygaSsku6GreF36YID4E9eVJGNmNZkYHPNbeAfPwqnrc1Qafw9BF4t3fnI5Uxz8qjlX96s27S2oilYSPllVHqnFkR9ruJQYvac6eLuS7_YDz2r7TMELs9AhqCO44KcJXJlE40Zmk Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: e6943424ea2847c79c734f2cf9b3dd19 Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2002258596 Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:04:09.888337 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:04:09.889736 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e6943424ea2847c79c734f2cf9b3dd19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e6943424ea2847c79c734f2cf9b3dd19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e6943424ea2847c79c734f2cf9b3dd19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e6943424ea2847c79c734f2cf9b3dd19", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:09.889736 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2002258596 Oct 29 01:04:09.889736 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: e6943424ea2847c79c734f2cf9b3dd19 Oct 29 01:04:09.889736 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2002258596 Oct 29 01:04:09.889736 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2002258596-project-admin Oct 29 01:04:09.889736 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:09.889736 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:09.889736 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 900ea2e3ac4549b48eefaa3dd5d30ea8 Oct 29 01:04:09.889736 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2002258596-project-admin Oct 29 01:04:09.889736 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:04:09.889736 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid timestamp for date invalid_time Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'invalid_time'} Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:09.890528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:09.891730 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 29 01:04:09.891730 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 29 01:04:09.891730 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 29 01:04:09.891730 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:09.891730 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:09.891730 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:09.891730 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:09.891730 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:09.891730 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:09.891730 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:09.891730 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:09.891730 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 29 01:04:09.891730 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:09.891730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-353b23bf-727a-4ff5-bca8-9353d2fbcc23 tempest-InstanceUsageAuditLogNegativeTestJSON-2002258596 tempest-InstanceUsageAuditLogNegativeTestJSON-2002258596-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:09.891730 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-353b23bf-727a-4ff5-bca8-9353d2fbcc23 tempest-InstanceUsageAuditLogNegativeTestJSON-2002258596 tempest-InstanceUsageAuditLogNegativeTestJSON-2002258596-project-admin] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.679550 Oct 29 01:04:09.902018 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 44/70] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 29 01:04:09 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 692 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 01:04:10.299433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-225953f8-60ac-43f2-bca0-50124482df50 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:10.300168 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-225953f8-60ac-43f2-bca0-50124482df50 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:10.310596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-225953f8-60ac-43f2-bca0-50124482df50 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:10.311091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-225953f8-60ac-43f2-bca0-50124482df50 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:10.311526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-225953f8-60ac-43f2-bca0-50124482df50 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:10.318464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-225953f8-60ac-43f2-bca0-50124482df50 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:10.318965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-225953f8-60ac-43f2-bca0-50124482df50 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:10.319413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-225953f8-60ac-43f2-bca0-50124482df50 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:10.507031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-225953f8-60ac-43f2-bca0-50124482df50 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:10.557627 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-225953f8-60ac-43f2-bca0-50124482df50 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1289 microversion: 2.1 time: 0.260163 Oct 29 01:04:10.559956 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 45/71] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:10 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1289 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:10.618086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-42e93dc5-1857-4415-8357-3066b8ca1725 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:10.621817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-42e93dc5-1857-4415-8357-3066b8ca1725 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'f258dfb9a07e47899a65a080a1c11621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3984ee00f8ef4b0f84beb3cee2487387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-42e93dc5-1857-4415-8357-3066b8ca1725 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649-project] Request method failure captured: Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwFu_1051du067QZ1QhP5dnkOrcUa9gGxX_Yhi1ONtsJU6D6h-8w2EFdaSPseIBwytNrjlNA_6BXDLLcPNh9emq1QH1DheAlKKdpV5pDZvBk4Q0UJ9r1TEKi6Gb_F_fsM4qBQi_VN-_3CCqx_-XtqFi41tXzjJULZYfontNI3wcJRc Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 3984ee00f8ef4b0f84beb3cee2487387 Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-526517649 Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:04:10.624178 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:04:10.626372 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3984ee00f8ef4b0f84beb3cee2487387"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3984ee00f8ef4b0f84beb3cee2487387"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3984ee00f8ef4b0f84beb3cee2487387"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3984ee00f8ef4b0f84beb3cee2487387", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:10.626372 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-526517649 Oct 29 01:04:10.626372 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 3984ee00f8ef4b0f84beb3cee2487387 Oct 29 01:04:10.626372 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-526517649 Oct 29 01:04:10.626372 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-526517649-project Oct 29 01:04:10.626372 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:10.626372 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:10.626372 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f258dfb9a07e47899a65a080a1c11621 Oct 29 01:04:10.626372 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-526517649-project Oct 29 01:04:10.626372 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: action_args: {} Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:10.627065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:10.628068 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:04:10.628068 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:04:10.628068 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:04:10.628068 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:04:10.628068 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:04:10.628068 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:04:10.628068 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 29 01:04:10.628068 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:10.628068 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:10.628068 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:10.628068 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:10.628068 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:10.628068 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:10.628068 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:04:10.628068 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:04:10.628068 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 29 01:04:10.628068 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:10.632237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-42e93dc5-1857-4415-8357-3066b8ca1725 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:10.633511 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-42e93dc5-1857-4415-8357-3066b8ca1725 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649-project] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.734454 Oct 29 01:04:10.644999 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 27/72] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Oct 29 01:04:09 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 745 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:04:10.661324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81ad9b38-d5a8-4b15-a218-45103b8c3321 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:10.668386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-81ad9b38-d5a8-4b15-a218-45103b8c3321 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'f258dfb9a07e47899a65a080a1c11621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3984ee00f8ef4b0f84beb3cee2487387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81ad9b38-d5a8-4b15-a218-45103b8c3321 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649-project] Request method failure captured: Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29%2001:04:10 HTTP/1.1 Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwFu_1051du067QZ1QhP5dnkOrcUa9gGxX_Yhi1ONtsJU6D6h-8w2EFdaSPseIBwytNrjlNA_6BXDLLcPNh9emq1QH1DheAlKKdpV5pDZvBk4Q0UJ9r1TEKi6Gb_F_fsM4qBQi_VN-_3CCqx_-XtqFi41tXzjJULZYfontNI3wcJRc Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 3984ee00f8ef4b0f84beb3cee2487387 Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-526517649 Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:04:10.674774 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:04:10.676107 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3984ee00f8ef4b0f84beb3cee2487387"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3984ee00f8ef4b0f84beb3cee2487387"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3984ee00f8ef4b0f84beb3cee2487387"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3984ee00f8ef4b0f84beb3cee2487387", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:10.676107 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-526517649 Oct 29 01:04:10.676107 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 3984ee00f8ef4b0f84beb3cee2487387 Oct 29 01:04:10.676107 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-526517649 Oct 29 01:04:10.676107 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-526517649-project Oct 29 01:04:10.676107 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:10.676107 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:10.676107 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f258dfb9a07e47899a65a080a1c11621 Oct 29 01:04:10.676107 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-526517649-project Oct 29 01:04:10.676107 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '2022-10-29 01:04:10'} Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:10.677388 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:10.678638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:04:10.678638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:04:10.678638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:04:10.678638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:04:10.678638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:04:10.678638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:04:10.678638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 29 01:04:10.678638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:10.678638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:10.678638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:10.678638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:10.678638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:10.678638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:10.678638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:04:10.678638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:04:10.678638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 29 01:04:10.678638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:10.680502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81ad9b38-d5a8-4b15-a218-45103b8c3321 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:10.680502 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-81ad9b38-d5a8-4b15-a218-45103b8c3321 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649 tempest-InstanceUsageAuditLogNegativeTestJSON-526517649-project] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29 01:04:10" status: 403 len: 128 microversion: 2.1 time: 0.028075 Oct 29 01:04:10.693675 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 28/73] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 29 01:04:10 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29%2001%3A04%3A10 => generated 128 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:04:10.960886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d79044b-835e-4c55-8d47-92f2461cffe4 tempest-AZAdminNegativeTestJSON-1594748300 tempest-AZAdminNegativeTestJSON-1594748300-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:10.962666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7d79044b-835e-4c55-8d47-92f2461cffe4 tempest-AZAdminNegativeTestJSON-1594748300 tempest-AZAdminNegativeTestJSON-1594748300-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '09f51da735f142bd816d9e812bf42f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1532d055c184550bed69f4b7a4b91b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d79044b-835e-4c55-8d47-92f2461cffe4 tempest-AZAdminNegativeTestJSON-1594748300 tempest-AZAdminNegativeTestJSON-1594748300-project] Request method failure captured: Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHwHkAH55TtVFC05e6V_5LyNQzvlyfmEJdl8Yj31WkxjAuFy1k0-ngp7bF5icz6x-gLuIOY9nsvD-LIOTc5hayleXMHnfFr8bDfhc1O_MdpIyQ1SXd0YqsOSXVwVVpe9BqjjiFUhQVwK5S6j4VqaoySvOUz4d69pdKJvemGPDwwOz34 Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: e1532d055c184550bed69f4b7a4b91b4 Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1594748300 Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:04:10.965728 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:04:10.966982 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1532d055c184550bed69f4b7a4b91b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e1532d055c184550bed69f4b7a4b91b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1532d055c184550bed69f4b7a4b91b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e1532d055c184550bed69f4b7a4b91b4", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:10.966982 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AZAdminNegativeTestJSON-1594748300 Oct 29 01:04:10.966982 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: e1532d055c184550bed69f4b7a4b91b4 Oct 29 01:04:10.966982 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1594748300 Oct 29 01:04:10.966982 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AZAdminNegativeTestJSON-1594748300-project Oct 29 01:04:10.966982 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:10.966982 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:10.966982 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 09f51da735f142bd816d9e812bf42f1e Oct 29 01:04:10.966982 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AZAdminNegativeTestJSON-1594748300-project Oct 29 01:04:10.966982 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:04:10.966982 n-d-862964-3 devstack@n-api.service[121100]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 29 01:04:10.966982 n-d-862964-3 devstack@n-api.service[121100]: action_args: {} Oct 29 01:04:10.967613 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:10.967613 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:10.967613 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:10.967613 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:10.967613 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:10.967613 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:10.967613 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:10.967613 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:10.967613 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 29 01:04:10.967613 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 29 01:04:10.967613 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:04:10.967613 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:04:10.967613 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:04:10.967613 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:04:10.967613 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:10.967613 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:10.967613 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:10.967613 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:10.967613 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:04:10.969360 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:04:10.969360 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:04:10.969360 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:04:10.969360 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:04:10.969360 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:04:10.969360 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 29 01:04:10.969360 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:10.969360 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:10.969360 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:10.969360 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:10.969360 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:10.969360 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:10.969360 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:04:10.969360 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:04:10.969360 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 29 01:04:10.969360 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:10.969360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d79044b-835e-4c55-8d47-92f2461cffe4 tempest-AZAdminNegativeTestJSON-1594748300 tempest-AZAdminNegativeTestJSON-1594748300-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:10.970314 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7d79044b-835e-4c55-8d47-92f2461cffe4 tempest-AZAdminNegativeTestJSON-1594748300 tempest-AZAdminNegativeTestJSON-1594748300-project] 10.222.0.26 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.403970 Oct 29 01:04:10.977655 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 46/74] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Oct 29 01:04:10 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 412 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:04:12.078858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-58288668-15cb-4467-959a-98cb116ff11c tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:12.089249 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-58288668-15cb-4467-959a-98cb116ff11c tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.531431 Oct 29 01:04:12.090030 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 47/75] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:04:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:04:12.105637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b5527543-8d5a-4a19-a751-6298fd528b08 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:12.106609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b5527543-8d5a-4a19-a751-6298fd528b08 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:12.107545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-545663e7-9afa-4612-834a-f434cee03496 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1893806019", "id": 907928887, "os-flavor-access:is_public": "True"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:12.118701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5527543-8d5a-4a19-a751-6298fd528b08 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:12.120935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5527543-8d5a-4a19-a751-6298fd528b08 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:12.121619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5527543-8d5a-4a19-a751-6298fd528b08 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:12.123231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5527543-8d5a-4a19-a751-6298fd528b08 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:12.125393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5527543-8d5a-4a19-a751-6298fd528b08 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:12.126127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5527543-8d5a-4a19-a751-6298fd528b08 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:12.203672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b5527543-8d5a-4a19-a751-6298fd528b08 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:12.212704 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b5527543-8d5a-4a19-a751-6298fd528b08 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1295 microversion: 2.1 time: 0.111351 Oct 29 01:04:12.239910 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-545663e7-9afa-4612-834a-f434cee03496 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.825048 Oct 29 01:04:12.240822 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 29/76] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:11 2022] POST /compute/v2.1/flavors => generated 427 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:12.242372 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 48/77] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:12 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1295 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:12.243449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b5527543-8d5a-4a19-a751-6298fd528b08 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:12.244433 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b5527543-8d5a-4a19-a751-6298fd528b08 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001242 Oct 29 01:04:12.254219 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 49/78] 10.222.0.26 () {56 vars in 886 bytes} [Sat Oct 29 01:04:12 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 29 01:04:12.496450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9d807171-8681-4dc3-b946-0f17df9fbfd0 tempest-ServersWithSpecificFlavorTestJSON-1281486603 tempest-ServersWithSpecificFlavorTestJSON-1281486603-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-865691048", "id": 909793781, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:12.599525 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9d807171-8681-4dc3-b946-0f17df9fbfd0 tempest-ServersWithSpecificFlavorTestJSON-1281486603 tempest-ServersWithSpecificFlavorTestJSON-1281486603-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.350230 Oct 29 01:04:12.600775 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 50/79] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:12 2022] POST /compute/v2.1/flavors => generated 421 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:12.605652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-92218d38-ac4d-402e-9b41-bcedb0759ce4 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:12.647609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ab375c87-3248-44af-becb-6dba7ee6fefa tempest-FlavorsV261TestJSON-708680395 tempest-FlavorsV261TestJSON-708680395-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-586125052", "id": 946473599, "os-flavor-access:is_public": "True"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:12.714449 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-92218d38-ac4d-402e-9b41-bcedb0759ce4 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/907928887" status: 202 len: 0 microversion: 2.1 time: 0.102334 Oct 29 01:04:12.716651 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 51/80] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 29 01:04:12 2022] DELETE /compute/v2.1/flavors/907928887 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:04:12.724700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-51288e65-18c1-4a39-83c2-2607f1988093 tempest-ServersWithSpecificFlavorTestJSON-1281486603 tempest-ServersWithSpecificFlavorTestJSON-1281486603-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:12.750628 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ab375c87-3248-44af-becb-6dba7ee6fefa tempest-FlavorsV261TestJSON-708680395 tempest-FlavorsV261TestJSON-708680395-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.507552 Oct 29 01:04:12.752111 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 30/81] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 29 01:04:12 2022] POST /compute/v2.1/flavors => generated 464 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:04:12.755848 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-51288e65-18c1-4a39-83c2-2607f1988093 tempest-ServersWithSpecificFlavorTestJSON-1281486603 tempest-ServersWithSpecificFlavorTestJSON-1281486603-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.036070 Oct 29 01:04:12.759142 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 52/82] 10.222.0.26 () {58 vars in 1182 bytes} [Sat Oct 29 01:04:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:04:12.768795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-949749d8-7de6-4883-980a-d172d416724d tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:12.826052 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-949749d8-7de6-4883-980a-d172d416724d tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.071727 Oct 29 01:04:12.828687 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 31/83] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:12 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:12.840617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fb00a83c-a10e-4126-93fa-61f6ed8c90ae tempest-ServersWithSpecificFlavorTestJSON-1281486603 tempest-ServersWithSpecificFlavorTestJSON-1281486603-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-2066802916", "id": 593901281, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:12.953754 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fb00a83c-a10e-4126-93fa-61f6ed8c90ae tempest-ServersWithSpecificFlavorTestJSON-1281486603 tempest-ServersWithSpecificFlavorTestJSON-1281486603-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.123729 Oct 29 01:04:12.954353 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 32/84] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:12 2022] POST /compute/v2.1/flavors => generated 422 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:12.965735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-625b954d-a45d-405c-b7a1-61b75ae2bc17 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1729396661", "id": 704951931, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:13.077734 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-625b954d-a45d-405c-b7a1-61b75ae2bc17 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.121988 Oct 29 01:04:13.078441 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 33/85] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:12 2022] POST /compute/v2.1/flavors => generated 414 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:13.090187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-90e7bef7-74aa-4219-9d71-1917a7089d31 tempest-ServersWithSpecificFlavorTestJSON-1281486603 tempest-ServersWithSpecificFlavorTestJSON-1281486603-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:13.115759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-10d13da5-0451-4f30-ae50-1440fed1ec2c tempest-FlavorsV261TestJSON-1963860104 tempest-FlavorsV261TestJSON-1963860104-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:13.121611 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-90e7bef7-74aa-4219-9d71-1917a7089d31 tempest-ServersWithSpecificFlavorTestJSON-1281486603 tempest-ServersWithSpecificFlavorTestJSON-1281486603-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.041975 Oct 29 01:04:13.126216 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 34/86] 10.222.0.26 () {58 vars in 1182 bytes} [Sat Oct 29 01:04:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:04:13.136413 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-10d13da5-0451-4f30-ae50-1440fed1ec2c tempest-FlavorsV261TestJSON-1963860104 tempest-FlavorsV261TestJSON-1963860104-project] 10.222.0.26 "GET /compute/v2.1/flavors/946473599" status: 200 len: 464 microversion: 2.61 time: 0.374225 Oct 29 01:04:13.142186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c0013bbc-b1d4-4439-91c6-d1d684d93029 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:13.158428 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 53/87] 10.222.0.26 () {60 vars in 1196 bytes} [Sat Oct 29 01:04:12 2022] GET /compute/v2.1/flavors/946473599 => generated 464 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:04:13.169276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-57d5f90c-6105-4403-9473-0a182b881483 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Action: 'create', calling method: .version_select at 0x7f9d9c963ca0>, body: {"keypair": {"name": "tempest-keypair-1497961946", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMqo7XNc4b0UpDCxnvbQWfyFGg8XJW4BpsRqfjTfl9AKeK+ZLW1w9ohNFbQ9OgiqJBpxQ66rONIkboIATgpBKosDJ5bqrlkT2nazKonA2v6g4diSujk6D0UA5oIoezf3g=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:13.195283 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c0013bbc-b1d4-4439-91c6-d1d684d93029 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6632 microversion: 2.1 time: 0.068711 Oct 29 01:04:13.196174 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 35/88] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:13 2022] GET /compute/v2.1/flavors/detail => generated 6632 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:13.201283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c1506919-8719-4571-aa5b-fcd3a0419b28 tempest-FlavorsV261TestJSON-708680395 tempest-FlavorsV261TestJSON-708680395-project-admin] Action: 'update', calling method: .version_select at 0x7f9d9da07b80>, body: {"flavor": {"description": "new"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:13.250711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-57d5f90c-6105-4403-9473-0a182b881483 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Getting quotas for project a4ff5b9558944b61804150ad564c0d8f. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:04:13.264613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-57d5f90c-6105-4403-9473-0a182b881483 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Getting quotas for user d2be9b9e6ac945f48fe7118bc10d4064 and project a4ff5b9558944b61804150ad564c0d8f. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:04:13.394086 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c1506919-8719-4571-aa5b-fcd3a0419b28 tempest-FlavorsV261TestJSON-708680395 tempest-FlavorsV261TestJSON-708680395-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/946473599" status: 200 len: 465 microversion: 2.61 time: 0.196523 Oct 29 01:04:13.396935 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 36/89] 10.222.0.26 () {62 vars in 1216 bytes} [Sat Oct 29 01:04:13 2022] PUT /compute/v2.1/flavors/946473599 => generated 465 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:04:13.408520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d389f86c-3bbe-4f5d-b618-894b91e87ce1 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:13.459766 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-57d5f90c-6105-4403-9473-0a182b881483 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.300921 Oct 29 01:04:13.460592 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 54/90] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:04:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:13.467726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-91935625-80ba-4a9f-838c-def7feafb28b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:13.467726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-91935625-80ba-4a9f-838c-def7feafb28b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:13.491207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91935625-80ba-4a9f-838c-def7feafb28b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:13.491207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91935625-80ba-4a9f-838c-def7feafb28b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:13.491641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91935625-80ba-4a9f-838c-def7feafb28b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:13.494677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91935625-80ba-4a9f-838c-def7feafb28b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:13.495638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91935625-80ba-4a9f-838c-def7feafb28b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:13.497364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91935625-80ba-4a9f-838c-def7feafb28b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:13.546682 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d389f86c-3bbe-4f5d-b618-894b91e87ce1 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/704951931" status: 202 len: 0 microversion: 2.1 time: 0.147064 Oct 29 01:04:13.548195 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 37/91] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 29 01:04:13 2022] DELETE /compute/v2.1/flavors/704951931 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:04:13.553547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a9698857-27c4-4b71-89f7-533aa6284613 tempest-FlavorsV261TestJSON-1963860104 tempest-FlavorsV261TestJSON-1963860104-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:13.644896 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a9698857-27c4-4b71-89f7-533aa6284613 tempest-FlavorsV261TestJSON-1963860104 tempest-FlavorsV261TestJSON-1963860104-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 7149 microversion: 2.61 time: 0.096332 Oct 29 01:04:13.646827 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 38/92] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Oct 29 01:04:13 2022] GET /compute/v2.1/flavors/detail => generated 7149 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:04:13.655271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-02353057-c7c0-42b5-a7fb-67e6d682dc36 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:13.688702 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-02353057-c7c0-42b5-a7fb-67e6d682dc36 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6228 microversion: 2.1 time: 0.040453 Oct 29 01:04:13.693815 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 39/93] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:13 2022] GET /compute/v2.1/flavors/detail => generated 6228 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:13.700624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0303da8c-7a36-4010-8acd-257f5af695fe tempest-FlavorsV261TestJSON-1963860104 tempest-FlavorsV261TestJSON-1963860104-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:13.785673 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0303da8c-7a36-4010-8acd-257f5af695fe tempest-FlavorsV261TestJSON-1963860104 tempest-FlavorsV261TestJSON-1963860104-project] 10.222.0.26 "GET /compute/v2.1/flavors" status: 200 len: 3676 microversion: 2.61 time: 0.087550 Oct 29 01:04:13.785673 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 40/94] 10.222.0.26 () {60 vars in 1166 bytes} [Sat Oct 29 01:04:13 2022] GET /compute/v2.1/flavors => generated 3676 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:04:13.812035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d8cdb1e1-6559-4991-a97e-9113e01a5aa6 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-137344586", "id": 1157142874, "os-flavor-access:is_public": "True"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:13.903635 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d8cdb1e1-6559-4991-a97e-9113e01a5aa6 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.118756 Oct 29 01:04:13.904803 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 41/95] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:13 2022] POST /compute/v2.1/flavors => generated 428 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:13.919242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7a70991c-81f6-4132-9da6-cc706762e5d4 tempest-FlavorsV261TestJSON-708680395 tempest-FlavorsV261TestJSON-708680395-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:13.943502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=81,nova_api:INSERT=11,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:14.050576 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7a70991c-81f6-4132-9da6-cc706762e5d4 tempest-FlavorsV261TestJSON-708680395 tempest-FlavorsV261TestJSON-708680395-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/946473599" status: 202 len: 0 microversion: 2.61 time: 0.143424 Oct 29 01:04:14.058055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-91935625-80ba-4a9f-838c-def7feafb28b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:14.063669 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 42/96] 10.222.0.26 () {60 vars in 1199 bytes} [Sat Oct 29 01:04:13 2022] DELETE /compute/v2.1/flavors/946473599 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:04:14.071441 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-91935625-80ba-4a9f-838c-def7feafb28b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1337 microversion: 2.1 time: 0.609525 Oct 29 01:04:14.073005 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 55/97] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:13 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1337 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:14.074384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1bbf9ed5-6469-4095-8bcf-3235af581a9f tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:14.081944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c4048089-4237-488a-9645-2b9a36dd5a24 tempest-FlavorsV261TestJSON-708680395 tempest-FlavorsV261TestJSON-708680395-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:14.132767 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c4048089-4237-488a-9645-2b9a36dd5a24 tempest-FlavorsV261TestJSON-708680395 tempest-FlavorsV261TestJSON-708680395-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 7152 microversion: 2.61 time: 0.057827 Oct 29 01:04:14.134109 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 56/98] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Oct 29 01:04:14 2022] GET /compute/v2.1/flavors/detail => generated 7152 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:04:14.269615 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1bbf9ed5-6469-4095-8bcf-3235af581a9f tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1157142874" status: 202 len: 0 microversion: 2.1 time: 0.203429 Oct 29 01:04:14.270943 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 43/99] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 29 01:04:14 2022] DELETE /compute/v2.1/flavors/1157142874 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:04:14.281691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e7c0baa4-cb2f-48a8-83eb-3d9cc50eea16 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:14.291922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:14.335700 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e7c0baa4-cb2f-48a8-83eb-3d9cc50eea16 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.059560 Oct 29 01:04:14.336489 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 57/100] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:14 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:14.383822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c0c6ab15-0b5c-4c8c-84c1-ec0a5e32b382 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1804886741", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:15.087955 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c0c6ab15-0b5c-4c8c-84c1-ec0a5e32b382 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.730504 Oct 29 01:04:15.098159 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-de365be8-e78d-4d53-b587-62bd19d19cf5 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:15.098660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-de365be8-e78d-4d53-b587-62bd19d19cf5 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:15.109446 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 44/101] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:14 2022] POST /compute/v2.1/flavors => generated 507 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:15.109736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de365be8-e78d-4d53-b587-62bd19d19cf5 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:15.109736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de365be8-e78d-4d53-b587-62bd19d19cf5 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:15.109736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de365be8-e78d-4d53-b587-62bd19d19cf5 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:15.109736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de365be8-e78d-4d53-b587-62bd19d19cf5 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:15.110014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de365be8-e78d-4d53-b587-62bd19d19cf5 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:15.110014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de365be8-e78d-4d53-b587-62bd19d19cf5 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:15.116720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d848fa93-bc18-40a5-8366-4c7aada135a0 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:15.254729 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d848fa93-bc18-40a5-8366-4c7aada135a0 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/c57db212-e3ff-45e3-8da1-3595f753fb54" status: 202 len: 0 microversion: 2.1 time: 0.142527 Oct 29 01:04:15.256459 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 45/102] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:04:15 2022] DELETE /compute/v2.1/flavors/c57db212-e3ff-45e3-8da1-3595f753fb54 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:04:15.265094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-26a3a393-5b03-4936-a5e7-5de402729546 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:15.307180 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-26a3a393-5b03-4936-a5e7-5de402729546 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.047107 Oct 29 01:04:15.309190 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 46/103] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:15 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:04:15.331506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-854ed7f8-324e-45fc-ad4b-172017d0e8fb tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2037911324", "id": "f3ac100e-19c0-435e-b0ac-bd0530abb6ac", "os-flavor-access:is_public": "True"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:15.472872 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-854ed7f8-324e-45fc-ad4b-172017d0e8fb tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.146437 Oct 29 01:04:15.481776 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 47/104] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:15 2022] POST /compute/v2.1/flavors => generated 507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:15.488443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-de365be8-e78d-4d53-b587-62bd19d19cf5 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:15.493774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-23828001-0f5b-4088-8262-8323558f6d34 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:15.505234 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-de365be8-e78d-4d53-b587-62bd19d19cf5 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1337 microversion: 2.1 time: 0.410473 Oct 29 01:04:15.525277 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 58/105] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:15 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1337 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:15.618424 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-23828001-0f5b-4088-8262-8323558f6d34 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/f3ac100e-19c0-435e-b0ac-bd0530abb6ac" status: 202 len: 0 microversion: 2.1 time: 0.134941 Oct 29 01:04:15.619129 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 48/106] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:04:15 2022] DELETE /compute/v2.1/flavors/f3ac100e-19c0-435e-b0ac-bd0530abb6ac => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:04:15.636212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3ef5cf79-090a-46f6-9ff8-ad3b55cc5323 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:15.689254 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3ef5cf79-090a-46f6-9ff8-ad3b55cc5323 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.057884 Oct 29 01:04:15.694300 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 59/107] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:15 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:15.714768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ace8d42e-44f5-48eb-af8f-a79ac8c0b9cc tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2110185162", "id": 1391505382, "os-flavor-access:is_public": "True"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:15.851595 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ace8d42e-44f5-48eb-af8f-a79ac8c0b9cc tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.141204 Oct 29 01:04:15.854939 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 49/108] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:15 2022] POST /compute/v2.1/flavors => generated 414 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:15.867760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6e7788f9-34f0-451b-b90a-4a1daef4a6a2 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:15.892573 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6e7788f9-34f0-451b-b90a-4a1daef4a6a2 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/1391505382" status: 200 len: 414 microversion: 2.1 time: 0.031546 Oct 29 01:04:15.894968 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 60/109] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 29 01:04:15 2022] GET /compute/v2.1/flavors/1391505382 => generated 414 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:16.268214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:16.289764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=50 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:16.539971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f0c80420-08e1-4a63-830d-86d1126dc78f tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:16.541631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f0c80420-08e1-4a63-830d-86d1126dc78f tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:16.548649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0c80420-08e1-4a63-830d-86d1126dc78f tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:16.556234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0c80420-08e1-4a63-830d-86d1126dc78f tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:16.557585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0c80420-08e1-4a63-830d-86d1126dc78f tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:16.569431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0c80420-08e1-4a63-830d-86d1126dc78f tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:16.569431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0c80420-08e1-4a63-830d-86d1126dc78f tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:16.569431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0c80420-08e1-4a63-830d-86d1126dc78f tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:16.751228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a8b89794-ee96-4603-a8aa-8dcdc69725a8 tempest-FlavorsAdminTestJSON-505317675 tempest-FlavorsAdminTestJSON-505317675-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:16.794587 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a8b89794-ee96-4603-a8aa-8dcdc69725a8 tempest-FlavorsAdminTestJSON-505317675 tempest-FlavorsAdminTestJSON-505317675-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.891698 Oct 29 01:04:16.799651 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 50/110] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:15 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:16.822356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6ebdee4a-be1e-4c49-89f1-8c004ff8eed9 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:16.981740 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6ebdee4a-be1e-4c49-89f1-8c004ff8eed9 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1391505382" status: 202 len: 0 microversion: 2.1 time: 0.166083 Oct 29 01:04:16.987816 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 51/111] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 29 01:04:16 2022] DELETE /compute/v2.1/flavors/1391505382 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:04:17.000299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6f5fb738-f771-4364-989f-21f8a4ce25d7 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:17.099762 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6f5fb738-f771-4364-989f-21f8a4ce25d7 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.108770 Oct 29 01:04:17.109213 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 52/112] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:16 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:04:17.128186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c7ded9cf-0152-4a8d-b21d-ae63c02248ae tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-770549609", "id": 1673925605, "os-flavor-access:is_public": "False"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:17.251121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f0c80420-08e1-4a63-830d-86d1126dc78f tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:17.259583 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c7ded9cf-0152-4a8d-b21d-ae63c02248ae tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.140833 Oct 29 01:04:17.265782 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 53/113] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:17 2022] POST /compute/v2.1/flavors => generated 429 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:17.266031 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f0c80420-08e1-4a63-830d-86d1126dc78f tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1337 microversion: 2.1 time: 0.728718 Oct 29 01:04:17.266031 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 61/114] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:16 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1337 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:17.273358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-34c6fcf8-c980-4b58-9889-96ca639a15f2 tempest-FlavorsAdminTestJSON-505317675 tempest-FlavorsAdminTestJSON-505317675-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "1673925605"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:17.301881 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-34c6fcf8-c980-4b58-9889-96ca639a15f2 tempest-FlavorsAdminTestJSON-505317675 tempest-FlavorsAdminTestJSON-505317675-project] HTTP exception thrown: Flavor 1673925605 could not be found. Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-34c6fcf8-c980-4b58-9889-96ca639a15f2 tempest-FlavorsAdminTestJSON-505317675 tempest-FlavorsAdminTestJSON-505317675-project] Request method failure captured: Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 107 Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHwIC5qH_MaBF2bq9mmLawNGvHBIj6OcFKcikS2h4k1mrJlZE83Bsg242f7OKcRdec7pWfE56Maf-4aM8AAcf5lCgZZxSB3q8_xkwHu1_ghCz-YFv8v7pE3IfSRYZbm77eaKLXhzmaH1_Cg_pJCRBAJ_9jkvgreWDg7xkV4MU1hGXB8 Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 60156280f8074e80a7480bf7089d1f36 Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FlavorsAdminTestJSON-505317675 Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:04:17.305284 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:04:17.306555 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60156280f8074e80a7480bf7089d1f36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/60156280f8074e80a7480bf7089d1f36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60156280f8074e80a7480bf7089d1f36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_60156280f8074e80a7480bf7089d1f36", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:17.306555 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FlavorsAdminTestJSON-505317675 Oct 29 01:04:17.306555 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 60156280f8074e80a7480bf7089d1f36 Oct 29 01:04:17.306555 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-505317675 Oct 29 01:04:17.306555 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FlavorsAdminTestJSON-505317675-project Oct 29 01:04:17.306555 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:17.306555 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:17.306555 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 75430f3b60904dbbbdcfec6a86320995 Oct 29 01:04:17.306555 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FlavorsAdminTestJSON-505317675-project Oct 29 01:04:17.306555 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:04:17.306555 n-d-862964-3 devstack@n-api.service[121100]: {"server": {"name": "test", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "1673925605"}} Oct 29 01:04:17.306555 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:04:17.306555 n-d-862964-3 devstack@n-api.service[121100]: exception: Flavor 1673925605 could not be found. Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '1673925605'}}} Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1673925605 could not be found. Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:17.307306 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1673925605 could not be found. Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:17.308437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:17.309563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:17.309563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:17.309563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:17.309563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1673925605 could not be found. Oct 29 01:04:17.309563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:17.311566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-34c6fcf8-c980-4b58-9889-96ca639a15f2 tempest-FlavorsAdminTestJSON-505317675 tempest-FlavorsAdminTestJSON-505317675-project] Returning 400 to user: Flavor 1673925605 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:17.312674 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-34c6fcf8-c980-4b58-9889-96ca639a15f2 tempest-FlavorsAdminTestJSON-505317675 tempest-FlavorsAdminTestJSON-505317675-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.043460 Oct 29 01:04:17.313791 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 62/115] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:17 2022] POST /compute/v2.1/servers => generated 81 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 01:04:17.323149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-39d5873b-6efc-426a-a449-8b7764199be3 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:17.333604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=13,nova_api:INSERT=5 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:17.449345 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-39d5873b-6efc-426a-a449-8b7764199be3 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1673925605" status: 202 len: 0 microversion: 2.1 time: 0.130635 Oct 29 01:04:17.460750 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 63/116] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 29 01:04:17 2022] DELETE /compute/v2.1/flavors/1673925605 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:04:17.466438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7830408d-bf1e-492c-9ace-a1796dfdddf3 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:17.510815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-1c6db485-3db2-4575-8d1e-472835b3219f req-7d901f56-8b85-4db2-b456-95a97a6a9719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea9fe51-2e94-4205-959b-c9687e60b4ab", "tag": "a3e3f41d-0080-4c51-b487-85a6a1282969"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:17.514470 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7830408d-bf1e-492c-9ace-a1796dfdddf3 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.052465 Oct 29 01:04:17.532158 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 64/117] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:17 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:17.547773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-391d1de0-30f4-41c9-a9b0-357547114efb tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-25968126", "id": 257301714, "os-flavor-access:is_public": "False"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:17.554149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1c6db485-3db2-4575-8d1e-472835b3219f req-7d901f56-8b85-4db2-b456-95a97a6a9719 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:17.555195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1c6db485-3db2-4575-8d1e-472835b3219f req-7d901f56-8b85-4db2-b456-95a97a6a9719 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:17.556048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1c6db485-3db2-4575-8d1e-472835b3219f req-7d901f56-8b85-4db2-b456-95a97a6a9719 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:17.595558 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-1c6db485-3db2-4575-8d1e-472835b3219f req-7d901f56-8b85-4db2-b456-95a97a6a9719 service nova] Creating event network-changed:a3e3f41d-0080-4c51-b487-85a6a1282969 for instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab on n-h1-862964-3 Oct 29 01:04:17.596450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1c6db485-3db2-4575-8d1e-472835b3219f req-7d901f56-8b85-4db2-b456-95a97a6a9719 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 01:04:17.597275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1c6db485-3db2-4575-8d1e-472835b3219f req-7d901f56-8b85-4db2-b456-95a97a6a9719 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 01:04:17.598870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40b87222-b3d5-40a5-9cd2-fc87c40e4fce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:17.599599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40b87222-b3d5-40a5-9cd2-fc87c40e4fce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:17.600109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40b87222-b3d5-40a5-9cd2-fc87c40e4fce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:17.601405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40b87222-b3d5-40a5-9cd2-fc87c40e4fce None None] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:17.602313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40b87222-b3d5-40a5-9cd2-fc87c40e4fce None None] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:17.603062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40b87222-b3d5-40a5-9cd2-fc87c40e4fce None None] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:17.616243 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.compute.rpcapi [None req-40b87222-b3d5-40a5-9cd2-fc87c40e4fce None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 29 01:04:17.617421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40b87222-b3d5-40a5-9cd2-fc87c40e4fce None None] Releasing lock "compute-rpcapi-router" {{(pid=121099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 01:04:17.639190 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-40b87222-b3d5-40a5-9cd2-fc87c40e4fce None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.376568 Oct 29 01:04:17.645727 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 54/118] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:17.684564 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-391d1de0-30f4-41c9-a9b0-357547114efb tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.146459 Oct 29 01:04:17.685932 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 65/119] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:17 2022] POST /compute/v2.1/flavors => generated 410 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:17.698999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4efc6be6-b87d-44ee-95cd-800e93698613 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1275608292", "id": 1881966084, "os-flavor-access:is_public": "True"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:17.854466 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4efc6be6-b87d-44ee-95cd-800e93698613 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.159488 Oct 29 01:04:17.863677 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 55/120] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:17 2022] POST /compute/v2.1/flavors => generated 414 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:17.870504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-97fabf5c-53a0-45e1-be16-a4c4121ad61e tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:17.890426 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-97fabf5c-53a0-45e1-be16-a4c4121ad61e tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 413 microversion: 2.1 time: 0.025928 Oct 29 01:04:17.891531 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 66/121] 10.222.0.26 () {58 vars in 1169 bytes} [Sat Oct 29 01:04:17 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 413 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:17.904514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ddb60ff3-7441-4c05-8403-d826b0ca8650 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:17.941506 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ddb60ff3-7441-4c05-8403-d826b0ca8650 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 413 microversion: 2.1 time: 0.037445 Oct 29 01:04:17.946783 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 56/122] 10.222.0.26 () {58 vars in 1177 bytes} [Sat Oct 29 01:04:17 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 413 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:17.959768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-47b96219-4bca-4559-b5f4-9b79c6d3255a tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:17.979583 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-47b96219-4bca-4559-b5f4-9b79c6d3255a tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 413 microversion: 2.1 time: 0.020117 Oct 29 01:04:17.981496 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 67/123] 10.222.0.26 () {58 vars in 1171 bytes} [Sat Oct 29 01:04:17 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 413 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:18.012835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c6196d38-a7d6-4cc0-ba0c-e91dfa6d5f5b tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:18.061566 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c6196d38-a7d6-4cc0-ba0c-e91dfa6d5f5b tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 413 microversion: 2.1 time: 0.063341 Oct 29 01:04:18.062535 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 57/124] 10.222.0.26 () {58 vars in 1169 bytes} [Sat Oct 29 01:04:17 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 413 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:18.084714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e5fc3699-17cd-46b2-aec3-68c112a94b9c tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:18.125136 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e5fc3699-17cd-46b2-aec3-68c112a94b9c tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6218 microversion: 2.1 time: 0.047363 Oct 29 01:04:18.126093 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 68/125] 10.222.0.26 () {58 vars in 1169 bytes} [Sat Oct 29 01:04:18 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6218 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:18.153593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-14d19737-beb7-418f-a321-d045224b69e4 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:18.207503 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-14d19737-beb7-418f-a321-d045224b69e4 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6218 microversion: 2.1 time: 0.065198 Oct 29 01:04:18.213533 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 58/126] 10.222.0.26 () {58 vars in 1175 bytes} [Sat Oct 29 01:04:18 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:18.228369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f992a052-62e0-481a-9b82-fe7bf72fe360 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:18.272753 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f992a052-62e0-481a-9b82-fe7bf72fe360 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6218 microversion: 2.1 time: 0.046653 Oct 29 01:04:18.272753 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 69/127] 10.222.0.26 () {58 vars in 1173 bytes} [Sat Oct 29 01:04:18 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6218 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:18.295578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2336c842-f4d6-4cc7-ba27-d82c13aa1eac tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:18.296956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-731acdb4-8119-4249-9128-70cb9c48d7a3 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:18.304239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2336c842-f4d6-4cc7-ba27-d82c13aa1eac tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:18.316313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2336c842-f4d6-4cc7-ba27-d82c13aa1eac tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:18.322549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2336c842-f4d6-4cc7-ba27-d82c13aa1eac tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:18.323167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2336c842-f4d6-4cc7-ba27-d82c13aa1eac tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:18.324074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2336c842-f4d6-4cc7-ba27-d82c13aa1eac tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:18.324684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2336c842-f4d6-4cc7-ba27-d82c13aa1eac tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:18.325310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2336c842-f4d6-4cc7-ba27-d82c13aa1eac tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:18.378173 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-731acdb4-8119-4249-9128-70cb9c48d7a3 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6218 microversion: 2.1 time: 0.090069 Oct 29 01:04:18.378785 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 59/128] 10.222.0.26 () {58 vars in 1169 bytes} [Sat Oct 29 01:04:18 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:04:18.409383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-17a60cd0-0fe3-44f6-945e-7bdb8176d583 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:18.542656 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-17a60cd0-0fe3-44f6-945e-7bdb8176d583 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1881966084" status: 202 len: 0 microversion: 2.1 time: 0.136692 Oct 29 01:04:18.543831 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 60/129] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 29 01:04:18 2022] DELETE /compute/v2.1/flavors/1881966084 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:04:18.575585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6b4d8a2d-21f9-4eef-a5eb-0dda435e305a tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:18.644223 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6b4d8a2d-21f9-4eef-a5eb-0dda435e305a tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.087950 Oct 29 01:04:18.649285 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 61/130] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:18 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:18.672089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bea88f9c-4098-4122-aea2-3e69df0eaeae tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:18.756586 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bea88f9c-4098-4122-aea2-3e69df0eaeae tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/257301714" status: 202 len: 0 microversion: 2.1 time: 0.090671 Oct 29 01:04:18.759157 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 62/131] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 29 01:04:18 2022] DELETE /compute/v2.1/flavors/257301714 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:04:18.771662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9527eb23-436e-4e3f-bad1-7f7ec005bfee tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:18.811604 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9527eb23-436e-4e3f-bad1-7f7ec005bfee tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.049285 Oct 29 01:04:18.812471 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 63/132] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:18 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:18.840798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-da06300d-3ff2-4d67-98cc-a80a5b7496d3 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-781598992", "id": 902554628, "os-flavor-access:is_public": "False"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:18.951651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2336c842-f4d6-4cc7-ba27-d82c13aa1eac tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:18.968138 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-da06300d-3ff2-4d67-98cc-a80a5b7496d3 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.131573 Oct 29 01:04:18.973287 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 64/133] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:18 2022] POST /compute/v2.1/flavors => generated 411 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:18.973702 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2336c842-f4d6-4cc7-ba27-d82c13aa1eac tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1337 microversion: 2.1 time: 0.683032 Oct 29 01:04:18.974676 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 70/134] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:18 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1337 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:18.994446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3c51ba60-4494-4ca5-8531-9161ad55fa3a tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:19.041053 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3c51ba60-4494-4ca5-8531-9161ad55fa3a tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.058355 Oct 29 01:04:19.042032 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 65/135] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:18 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:19.066865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f2b56983-a21f-4741-9dfd-faeaf610a5b7 tempest-FlavorsAdminTestJSON-505317675 tempest-FlavorsAdminTestJSON-505317675-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:19.115253 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f2b56983-a21f-4741-9dfd-faeaf610a5b7 tempest-FlavorsAdminTestJSON-505317675 tempest-FlavorsAdminTestJSON-505317675-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.052370 Oct 29 01:04:19.118047 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 71/136] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:19 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:19.144876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-af44505f-b500-46f7-b6dc-2ffe2ac1fae8 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:19.227105 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-af44505f-b500-46f7-b6dc-2ffe2ac1fae8 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/902554628" status: 202 len: 0 microversion: 2.1 time: 0.090724 Oct 29 01:04:19.227957 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 66/137] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 29 01:04:19 2022] DELETE /compute/v2.1/flavors/902554628 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:04:19.237502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c93a864b-5950-4804-9caf-1bef6a6d0738 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:19.292415 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c93a864b-5950-4804-9caf-1bef6a6d0738 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.059671 Oct 29 01:04:19.297228 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 72/138] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:19 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:19.315743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4afa1e94-2052-432f-a28a-bcf253d48421 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-985302677", "id": 223483445, "os-flavor-access:is_public": "True"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:19.322696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=8 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:19.323687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:DELETE=23,nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:19.418705 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4afa1e94-2052-432f-a28a-bcf253d48421 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.107252 Oct 29 01:04:19.435301 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 67/139] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:19 2022] POST /compute/v2.1/flavors => generated 410 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:19.435417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f235895e-3fac-419b-b4ba-7e312c29e020 tempest-FlavorsAdminTestJSON-505317675 tempest-FlavorsAdminTestJSON-505317675-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:19.464816 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f235895e-3fac-419b-b4ba-7e312c29e020 tempest-FlavorsAdminTestJSON-505317675 tempest-FlavorsAdminTestJSON-505317675-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6214 microversion: 2.1 time: 0.034461 Oct 29 01:04:19.465530 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 73/140] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:19 2022] GET /compute/v2.1/flavors/detail => generated 6214 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:04:19.488140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-06826292-3dd3-4fa6-83ba-3466885f1897 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:19.600666 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-06826292-3dd3-4fa6-83ba-3466885f1897 tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/223483445" status: 202 len: 0 microversion: 2.1 time: 0.118116 Oct 29 01:04:19.601815 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 68/141] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 29 01:04:19 2022] DELETE /compute/v2.1/flavors/223483445 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:04:19.610663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2291879e-a0c4-4e96-9d5d-8f251ee865be tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:19.650645 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2291879e-a0c4-4e96-9d5d-8f251ee865be tempest-FlavorsAdminTestJSON-1843433997 tempest-FlavorsAdminTestJSON-1843433997-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.044432 Oct 29 01:04:19.651559 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 74/142] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:19 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:19.979522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5d2c5d9d-d2d5-43ef-b423-e82849870c4b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-649438045", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "593901281", "adminPass": "***", "networks": [{"uuid": "7b39c1f5-a758-44cb-b968-9e05ca904af9"}], "security_groups": [{"name": "tempest-securitygroup--2076096584"}], "key_name": "tempest-keypair-1497961946", "user_data": "}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:20.001967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-69cc342a-2a25-471e-aacd-0069c93cca19 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:20.003181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-69cc342a-2a25-471e-aacd-0069c93cca19 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:20.011951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69cc342a-2a25-471e-aacd-0069c93cca19 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:20.013717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69cc342a-2a25-471e-aacd-0069c93cca19 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:20.014324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69cc342a-2a25-471e-aacd-0069c93cca19 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:20.015279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69cc342a-2a25-471e-aacd-0069c93cca19 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:20.015875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69cc342a-2a25-471e-aacd-0069c93cca19 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:20.016450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69cc342a-2a25-471e-aacd-0069c93cca19 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:20.260233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-5d2c5d9d-d2d5-43ef-b423-e82849870c4b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] validate_networks() for [('7b39c1f5-a758-44cb-b968-9e05ca904af9', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:04:20.350931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-69cc342a-2a25-471e-aacd-0069c93cca19 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:20.359528 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-69cc342a-2a25-471e-aacd-0069c93cca19 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1337 microversion: 2.1 time: 0.363446 Oct 29 01:04:20.362481 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 75/143] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:19 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1337 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:21.387923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5caadc14-f8fd-4666-b711-03ce93dbb9a1 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:21.389546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5caadc14-f8fd-4666-b711-03ce93dbb9a1 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:21.397837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5caadc14-f8fd-4666-b711-03ce93dbb9a1 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:21.398548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5caadc14-f8fd-4666-b711-03ce93dbb9a1 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:21.399135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5caadc14-f8fd-4666-b711-03ce93dbb9a1 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:21.400297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5caadc14-f8fd-4666-b711-03ce93dbb9a1 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:21.400909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5caadc14-f8fd-4666-b711-03ce93dbb9a1 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:21.402198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5caadc14-f8fd-4666-b711-03ce93dbb9a1 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:21.616051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5caadc14-f8fd-4666-b711-03ce93dbb9a1 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:21.631091 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5caadc14-f8fd-4666-b711-03ce93dbb9a1 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1337 microversion: 2.1 time: 0.249134 Oct 29 01:04:21.632681 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 76/144] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:21 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1337 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:04:22.097367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5d2c5d9d-d2d5-43ef-b423-e82849870c4b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:04:22.097931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5d2c5d9d-d2d5-43ef-b423-e82849870c4b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:04:22.098826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5d2c5d9d-d2d5-43ef-b423-e82849870c4b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:04:22.099237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5d2c5d9d-d2d5-43ef-b423-e82849870c4b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:04:22.099708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5d2c5d9d-d2d5-43ef-b423-e82849870c4b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:04:22.109953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d2c5d9d-d2d5-43ef-b423-e82849870c4b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:22.114855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d2c5d9d-d2d5-43ef-b423-e82849870c4b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:22.115552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d2c5d9d-d2d5-43ef-b423-e82849870c4b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:22.116555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d2c5d9d-d2d5-43ef-b423-e82849870c4b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:22.117027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d2c5d9d-d2d5-43ef-b423-e82849870c4b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:22.117643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d2c5d9d-d2d5-43ef-b423-e82849870c4b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:22.139094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-5d2c5d9d-d2d5-43ef-b423-e82849870c4b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Getting quotas for project a4ff5b9558944b61804150ad564c0d8f. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:04:22.148162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-5d2c5d9d-d2d5-43ef-b423-e82849870c4b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Getting quotas for user d2be9b9e6ac945f48fe7118bc10d4064 and project a4ff5b9558944b61804150ad564c0d8f. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:04:22.163665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5d2c5d9d-d2d5-43ef-b423-e82849870c4b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:04:22.166267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5d2c5d9d-d2d5-43ef-b423-e82849870c4b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:04:22.354850 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5d2c5d9d-d2d5-43ef-b423-e82849870c4b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.379771 Oct 29 01:04:22.365130 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 69/145] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 2391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:04:22.369673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-12bd0b0b-d4d9-4aff-8a46-00a707a4027a tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:22.370673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-12bd0b0b-d4d9-4aff-8a46-00a707a4027a tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:22.506097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-12bd0b0b-d4d9-4aff-8a46-00a707a4027a tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:22.515383 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-12bd0b0b-d4d9-4aff-8a46-00a707a4027a tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1262 microversion: 2.1 time: 0.151499 Oct 29 01:04:22.516249 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 77/146] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:22 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1262 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:22.657500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c09e87bc-d97a-4f12-be77-ce1038270b3d tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:22.658120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c09e87bc-d97a-4f12-be77-ce1038270b3d tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:22.670212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c09e87bc-d97a-4f12-be77-ce1038270b3d tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:22.675724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c09e87bc-d97a-4f12-be77-ce1038270b3d tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:22.675724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c09e87bc-d97a-4f12-be77-ce1038270b3d tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:22.676115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c09e87bc-d97a-4f12-be77-ce1038270b3d tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:22.678126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c09e87bc-d97a-4f12-be77-ce1038270b3d tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:22.679437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c09e87bc-d97a-4f12-be77-ce1038270b3d tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:23.011336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c09e87bc-d97a-4f12-be77-ce1038270b3d tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:23.041533 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c09e87bc-d97a-4f12-be77-ce1038270b3d tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1337 microversion: 2.1 time: 0.389796 Oct 29 01:04:23.048613 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 70/147] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:22 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1337 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:23.546401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ca36db9d-95a1-4e5c-a8b1-ea70bb473a80 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:23.547875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ca36db9d-95a1-4e5c-a8b1-ea70bb473a80 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:23.620942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ca36db9d-95a1-4e5c-a8b1-ea70bb473a80 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:23.647184 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ca36db9d-95a1-4e5c-a8b1-ea70bb473a80 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1262 microversion: 2.1 time: 0.109092 Oct 29 01:04:23.647788 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 78/148] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:23 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1262 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:04:24.073018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9b69abd7-3527-4f90-9a1f-162f315d6a78 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:24.073663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9b69abd7-3527-4f90-9a1f-162f315d6a78 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:24.080517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b69abd7-3527-4f90-9a1f-162f315d6a78 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:24.087246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b69abd7-3527-4f90-9a1f-162f315d6a78 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:24.087246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b69abd7-3527-4f90-9a1f-162f315d6a78 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:24.087246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b69abd7-3527-4f90-9a1f-162f315d6a78 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:24.087246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b69abd7-3527-4f90-9a1f-162f315d6a78 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:24.087804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b69abd7-3527-4f90-9a1f-162f315d6a78 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:24.105929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1cfdf7f2-8af8-4293-bbae-a5e3dd14c841 tempest-FlavorsV255TestJSON-1551504229 tempest-FlavorsV255TestJSON-1551504229-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-521645206", "id": 1018201757, "os-flavor-access:is_public": "True"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:24.227973 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1cfdf7f2-8af8-4293-bbae-a5e3dd14c841 tempest-FlavorsV255TestJSON-1551504229 tempest-FlavorsV255TestJSON-1551504229-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.418522 Oct 29 01:04:24.229781 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 71/149] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 29 01:04:23 2022] POST /compute/v2.1/flavors => generated 448 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:04:24.259284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9b69abd7-3527-4f90-9a1f-162f315d6a78 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:24.267007 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9b69abd7-3527-4f90-9a1f-162f315d6a78 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1337 microversion: 2.1 time: 0.198311 Oct 29 01:04:24.268094 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 79/150] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:24 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1337 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:04:24.735031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8c85215d-8947-4a41-bf88-e1f16b3cf31c tempest-FlavorsV255TestJSON-1500268868 tempest-FlavorsV255TestJSON-1500268868-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:24.746025 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8c85215d-8947-4a41-bf88-e1f16b3cf31c tempest-FlavorsV255TestJSON-1500268868 tempest-FlavorsV255TestJSON-1500268868-project] 10.222.0.26 "GET /compute/v2.1/flavors/1018201757" status: 200 len: 448 microversion: 2.55 time: 0.507105 Oct 29 01:04:24.756987 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 72/151] 10.222.0.26 () {60 vars in 1199 bytes} [Sat Oct 29 01:04:24 2022] GET /compute/v2.1/flavors/1018201757 => generated 448 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:04:24.762647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7ce59b9e-6ab4-437a-b491-8c0d5ec54b63 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:24.763638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7ce59b9e-6ab4-437a-b491-8c0d5ec54b63 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:24.766602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e5e10b2-1657-4de3-8a25-0ba3870aed15 tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] Action: 'create', calling method: .version_select at 0x7f9d9c8a3820>, body: {"keypair": {"name": "tempest-keypair-1130558713", "type": "ssh", "user_id": "77fe640d28ed4a1598d7426c0b7bbac7", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSbGg/4RycVVVfhWtRjQnBIdLMwWCX2HIzsv/W+NH/ShT54PHW4I1dfRma6S+Mt3dp/tCxfa7QvZplRuFbUMTNjMzKZilKSIlownhvcn2j0lPaLsR4iCS+yJ778vM/Qaw=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:24.771356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ce59b9e-6ab4-437a-b491-8c0d5ec54b63 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:24.772260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ce59b9e-6ab4-437a-b491-8c0d5ec54b63 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:24.772709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ce59b9e-6ab4-437a-b491-8c0d5ec54b63 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:24.773445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ce59b9e-6ab4-437a-b491-8c0d5ec54b63 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:24.774001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ce59b9e-6ab4-437a-b491-8c0d5ec54b63 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:24.776835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ce59b9e-6ab4-437a-b491-8c0d5ec54b63 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:24.788930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-7e5e10b2-1657-4de3-8a25-0ba3870aed15 tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] Getting quotas for project b8408ab9ea7c4f27964cc956a0ddc31d. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:04:24.794450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-7e5e10b2-1657-4de3-8a25-0ba3870aed15 tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] Getting quotas for user 1e4be50410f44994a73579b97bc35181 and project b8408ab9ea7c4f27964cc956a0ddc31d. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:04:24.843871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7ce59b9e-6ab4-437a-b491-8c0d5ec54b63 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:24.852892 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7ce59b9e-6ab4-437a-b491-8c0d5ec54b63 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1266 microversion: 2.1 time: 0.094082 Oct 29 01:04:24.866347 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 73/152] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:24 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:24.871189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4b3da88d-f191-4f42-99eb-4eb99d205326 tempest-FlavorsV255TestJSON-1551504229 tempest-FlavorsV255TestJSON-1551504229-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:24.903579 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e5e10b2-1657-4de3-8a25-0ba3870aed15 tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.621140 Oct 29 01:04:24.904185 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 80/153] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 29 01:04:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 622 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 01:04:24.923036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1c4e4884-2d16-4033-9231-2415c00b4849 tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] Action: 'create', calling method: .version_select at 0x7f9d9c844dc0>, body: {"keypair": {"name": "tempest-keypair-1736853007", "type": "ssh", "user_id": "77fe640d28ed4a1598d7426c0b7bbac7", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGfw+SSMrC7cFE997cH07EJ+WsVkuCL93zRFwvy9udmpu7HqZTYxWuLoPEX8MJ3inf6SNOqkQVE0tDMa4oG/l8R9SakkFCA+YiqMUQdnsJo3QZ5Ju4dW90pnwo9ObkYHw=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:24.941178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-1c4e4884-2d16-4033-9231-2415c00b4849 tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] Getting quotas for project b8408ab9ea7c4f27964cc956a0ddc31d. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:04:24.946231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-1c4e4884-2d16-4033-9231-2415c00b4849 tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] Getting quotas for user 1e4be50410f44994a73579b97bc35181 and project b8408ab9ea7c4f27964cc956a0ddc31d. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:04:25.008695 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4b3da88d-f191-4f42-99eb-4eb99d205326 tempest-FlavorsV255TestJSON-1551504229 tempest-FlavorsV255TestJSON-1551504229-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/1018201757" status: 200 len: 449 microversion: 2.55 time: 0.141123 Oct 29 01:04:25.009454 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 74/154] 10.222.0.26 () {62 vars in 1219 bytes} [Sat Oct 29 01:04:24 2022] PUT /compute/v2.1/flavors/1018201757 => generated 449 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:04:25.022774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b76eaed5-6512-4240-8466-f6f2dc2f44eb tempest-FlavorsV255TestJSON-1500268868 tempest-FlavorsV255TestJSON-1500268868-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:25.032863 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1c4e4884-2d16-4033-9231-2415c00b4849 tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.113457 Oct 29 01:04:25.040543 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 81/155] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 29 01:04:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 122 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 29 01:04:25.047482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b85383f3-5e5b-43ce-ac7d-50a3f5ace011 tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] Calling method '.version_select at 0x7f9d9c835f70>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:25.058699 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b76eaed5-6512-4240-8466-f6f2dc2f44eb tempest-FlavorsV255TestJSON-1500268868 tempest-FlavorsV255TestJSON-1500268868-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6589 microversion: 2.55 time: 0.040123 Oct 29 01:04:25.059785 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 75/156] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Oct 29 01:04:25 2022] GET /compute/v2.1/flavors/detail => generated 6589 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:04:25.069515 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b85383f3-5e5b-43ce-ac7d-50a3f5ace011 tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-1130558713?user_id=77fe640d28ed4a1598d7426c0b7bbac7" status: 200 len: 512 microversion: 2.10 time: 0.026612 Oct 29 01:04:25.079340 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 82/157] 10.222.0.26 () {60 vars in 1340 bytes} [Sat Oct 29 01:04:25 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1130558713?user_id=77fe640d28ed4a1598d7426c0b7bbac7 => generated 512 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:04:25.085230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-50089ebd-0d2a-4eb5-a611-658871307d78 tempest-FlavorsV255TestJSON-1500268868 tempest-FlavorsV255TestJSON-1500268868-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:25.089067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8c0e6857-2f2d-4a14-b39d-6995796ca909 tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] Action: 'create', calling method: .version_select at 0x7f9d9c835d30>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1928595614", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBl7m8EVkhkjXYkxJor1lfS3eaB+dvkgjSQMjPqlMhSgzCzWdg2f0x4sf7jQV7698SpDVTjtnYmSbl74hYeOjth2EIncmjTG4S8O3Zc4/j1YrfAD/+AlAu9DJGushziiQ=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:25.106627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-8c0e6857-2f2d-4a14-b39d-6995796ca909 tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] Getting quotas for project b8408ab9ea7c4f27964cc956a0ddc31d. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:04:25.111794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-8c0e6857-2f2d-4a14-b39d-6995796ca909 tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] Getting quotas for user 1e4be50410f44994a73579b97bc35181 and project b8408ab9ea7c4f27964cc956a0ddc31d. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:04:25.112748 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-50089ebd-0d2a-4eb5-a611-658871307d78 tempest-FlavorsV255TestJSON-1500268868 tempest-FlavorsV255TestJSON-1500268868-project] 10.222.0.26 "GET /compute/v2.1/flavors" status: 200 len: 3679 microversion: 2.55 time: 0.035742 Oct 29 01:04:25.113457 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 76/158] 10.222.0.26 () {60 vars in 1166 bytes} [Sat Oct 29 01:04:25 2022] GET /compute/v2.1/flavors => generated 3679 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:04:25.132625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d9159af1-6495-4903-ac7f-092352a7e086 tempest-FlavorsV255TestJSON-1551504229 tempest-FlavorsV255TestJSON-1551504229-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:25.212505 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8c0e6857-2f2d-4a14-b39d-6995796ca909 tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.131856 Oct 29 01:04:25.213250 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 83/159] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 29 01:04:25 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 01:04:25.243538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fcbd0fe8-c392-4a3a-86d1-4c546ac373ca tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] Calling method '.version_select at 0x7f9d9c844700>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:25.245967 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d9159af1-6495-4903-ac7f-092352a7e086 tempest-FlavorsV255TestJSON-1551504229 tempest-FlavorsV255TestJSON-1551504229-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1018201757" status: 202 len: 0 microversion: 2.55 time: 0.118423 Oct 29 01:04:25.246554 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 77/160] 10.222.0.26 () {60 vars in 1202 bytes} [Sat Oct 29 01:04:25 2022] DELETE /compute/v2.1/flavors/1018201757 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:04:25.253898 n-d-862964-3 devstack@n-api.service[121100]: WARNING oslo_db.sqlalchemy.utils [None req-fcbd0fe8-c392-4a3a-86d1-4c546ac373ca tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 01:04:25.257175 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fcbd0fe8-c392-4a3a-86d1-4c546ac373ca tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] 10.222.0.26 "GET /compute/v2.1/os-keypairs?user_id=77fe640d28ed4a1598d7426c0b7bbac7" status: 200 len: 726 microversion: 2.10 time: 0.017986 Oct 29 01:04:25.257912 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 84/161] 10.222.0.26 () {60 vars in 1259 bytes} [Sat Oct 29 01:04:25 2022] GET /compute/v2.1/os-keypairs?user_id=77fe640d28ed4a1598d7426c0b7bbac7 => generated 726 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:04:25.264191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f4b44cff-9a69-40fc-9c7f-cdfd6c7fb98c tempest-FlavorsV255TestJSON-1551504229 tempest-FlavorsV255TestJSON-1551504229-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:25.269324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f51cf206-ada7-4f7f-a617-81bd81be44cb tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] Calling method '.version_select at 0x7f9d9c7aeee0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:25.281437 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f4b44cff-9a69-40fc-9c7f-cdfd6c7fb98c tempest-FlavorsV255TestJSON-1551504229 tempest-FlavorsV255TestJSON-1551504229-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6150 microversion: 2.55 time: 0.030176 Oct 29 01:04:25.282037 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 78/162] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Oct 29 01:04:25 2022] GET /compute/v2.1/flavors/detail => generated 6150 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:04:25.294271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ff2538ac-2abe-4405-a5d8-43c825a79d5e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:25.294271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ff2538ac-2abe-4405-a5d8-43c825a79d5e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:25.311159 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff2538ac-2abe-4405-a5d8-43c825a79d5e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:25.317186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff2538ac-2abe-4405-a5d8-43c825a79d5e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:25.317186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff2538ac-2abe-4405-a5d8-43c825a79d5e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:25.317186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff2538ac-2abe-4405-a5d8-43c825a79d5e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:25.317186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff2538ac-2abe-4405-a5d8-43c825a79d5e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:25.317648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff2538ac-2abe-4405-a5d8-43c825a79d5e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:25.386844 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f51cf206-ada7-4f7f-a617-81bd81be44cb tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1928595614" status: 204 len: 0 microversion: 2.10 time: 0.121087 Oct 29 01:04:25.387829 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 85/163] 10.222.0.26 () {60 vars in 1325 bytes} [Sat Oct 29 01:04:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1928595614 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:04:25.399720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b806a794-ce88-441d-be88-0aa943dabcf4 tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] Calling method '.version_select at 0x7f9d9c969790>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:25.503499 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b806a794-ce88-441d-be88-0aa943dabcf4 tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1736853007?user_id=77fe640d28ed4a1598d7426c0b7bbac7" status: 204 len: 0 microversion: 2.10 time: 0.108890 Oct 29 01:04:25.504137 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 86/164] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:04:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1736853007?user_id=77fe640d28ed4a1598d7426c0b7bbac7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:04:25.514658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1d2c52d3-e596-47cf-851b-971e4fb1d1cb tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] Calling method '.version_select at 0x7f9d9c858160>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:25.567514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ff2538ac-2abe-4405-a5d8-43c825a79d5e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:25.576395 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ff2538ac-2abe-4405-a5d8-43c825a79d5e tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1337 microversion: 2.1 time: 0.288442 Oct 29 01:04:25.577312 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 79/165] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:25 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1337 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:04:25.611883 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1d2c52d3-e596-47cf-851b-971e4fb1d1cb tempest-KeyPairsV210TestJSON-1318817942 tempest-KeyPairsV210TestJSON-1318817942-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1130558713?user_id=77fe640d28ed4a1598d7426c0b7bbac7" status: 204 len: 0 microversion: 2.10 time: 0.103036 Oct 29 01:04:25.612492 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 87/166] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:04:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1130558713?user_id=77fe640d28ed4a1598d7426c0b7bbac7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 29 01:04:25.886054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c906f7c4-2527-4c09-9106-4c659a942e26 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:25.886979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c906f7c4-2527-4c09-9106-4c659a942e26 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:25.893477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c906f7c4-2527-4c09-9106-4c659a942e26 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:25.897732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c906f7c4-2527-4c09-9106-4c659a942e26 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:25.897732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c906f7c4-2527-4c09-9106-4c659a942e26 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:25.897732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c906f7c4-2527-4c09-9106-4c659a942e26 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:25.898089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c906f7c4-2527-4c09-9106-4c659a942e26 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:25.898089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c906f7c4-2527-4c09-9106-4c659a942e26 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:25.970186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c906f7c4-2527-4c09-9106-4c659a942e26 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:25.978364 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c906f7c4-2527-4c09-9106-4c659a942e26 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1314 microversion: 2.1 time: 0.096625 Oct 29 01:04:25.983970 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 80/167] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:25 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1314 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:26.600729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d7521f1-9e21-4b53-953d-716a371c2e41 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:26.601445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7d7521f1-9e21-4b53-953d-716a371c2e41 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:26.607739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d7521f1-9e21-4b53-953d-716a371c2e41 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:26.608327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d7521f1-9e21-4b53-953d-716a371c2e41 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:26.611860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d7521f1-9e21-4b53-953d-716a371c2e41 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:26.611860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d7521f1-9e21-4b53-953d-716a371c2e41 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:26.611860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d7521f1-9e21-4b53-953d-716a371c2e41 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:26.611860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d7521f1-9e21-4b53-953d-716a371c2e41 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:26.615538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=75 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:26.865784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7d7521f1-9e21-4b53-953d-716a371c2e41 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:26.875728 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7d7521f1-9e21-4b53-953d-716a371c2e41 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1337 microversion: 2.1 time: 0.279435 Oct 29 01:04:26.876424 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 88/168] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:26 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1337 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:27.010277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-56c983df-406d-491d-99c7-0ae6df62e3b7 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:27.010895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-56c983df-406d-491d-99c7-0ae6df62e3b7 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:27.018998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56c983df-406d-491d-99c7-0ae6df62e3b7 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:27.019499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56c983df-406d-491d-99c7-0ae6df62e3b7 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:27.020808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56c983df-406d-491d-99c7-0ae6df62e3b7 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:27.022878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56c983df-406d-491d-99c7-0ae6df62e3b7 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:27.023450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56c983df-406d-491d-99c7-0ae6df62e3b7 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:27.024205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56c983df-406d-491d-99c7-0ae6df62e3b7 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:27.182945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d4ac1774-72c7-43ff-acee-4074a9ed5b82 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Calling method '.version_select at 0x7f9d9c5f04c0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:27.186930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4ac1774-72c7-43ff-acee-4074a9ed5b82 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:27.187795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4ac1774-72c7-43ff-acee-4074a9ed5b82 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:27.188400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4ac1774-72c7-43ff-acee-4074a9ed5b82 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:27.209147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-56c983df-406d-491d-99c7-0ae6df62e3b7 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:27.226523 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-56c983df-406d-491d-99c7-0ae6df62e3b7 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1320 microversion: 2.1 time: 0.220522 Oct 29 01:04:27.227923 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 89/169] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:27 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1320 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:27.250002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4ac1774-72c7-43ff-acee-4074a9ed5b82 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:27.250618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4ac1774-72c7-43ff-acee-4074a9ed5b82 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:27.251060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4ac1774-72c7-43ff-acee-4074a9ed5b82 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:27.269382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4ac1774-72c7-43ff-acee-4074a9ed5b82 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:27.269872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4ac1774-72c7-43ff-acee-4074a9ed5b82 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:27.271013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4ac1774-72c7-43ff-acee-4074a9ed5b82 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:27.278673 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d4ac1774-72c7-43ff-acee-4074a9ed5b82 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.365601 Oct 29 01:04:27.289907 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 81/170] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:27.298817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7441215f-e3f6-4586-a26a-9eb0144a54fc tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Calling method '.version_select at 0x7f9d9c835d30>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:27.308705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7441215f-e3f6-4586-a26a-9eb0144a54fc tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:27.310017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7441215f-e3f6-4586-a26a-9eb0144a54fc tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:27.310575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7441215f-e3f6-4586-a26a-9eb0144a54fc tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:27.333962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7441215f-e3f6-4586-a26a-9eb0144a54fc tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:27.334485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7441215f-e3f6-4586-a26a-9eb0144a54fc tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:27.340032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7441215f-e3f6-4586-a26a-9eb0144a54fc tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:27.366927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:27.370059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7441215f-e3f6-4586-a26a-9eb0144a54fc tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:27.370832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7441215f-e3f6-4586-a26a-9eb0144a54fc tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:27.373212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7441215f-e3f6-4586-a26a-9eb0144a54fc tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:27.377624 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7441215f-e3f6-4586-a26a-9eb0144a54fc tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/n-h1-862964-3/servers" status: 200 len: 196 microversion: 2.1 time: 0.088098 Oct 29 01:04:27.378372 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 90/171] 10.222.0.26 () {58 vars in 1212 bytes} [Sat Oct 29 01:04:27 2022] GET /compute/v2.1/os-hypervisors/n-h1-862964-3/servers => generated 196 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:04:27.390641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3695a32f-3a61-4c64-847b-38816f100bd3 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Calling method '.version_select at 0x7f9d9c65d430>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:27.397480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3695a32f-3a61-4c64-847b-38816f100bd3 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:27.397480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3695a32f-3a61-4c64-847b-38816f100bd3 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:27.397480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3695a32f-3a61-4c64-847b-38816f100bd3 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:27.616688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3695a32f-3a61-4c64-847b-38816f100bd3 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:27.617422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3695a32f-3a61-4c64-847b-38816f100bd3 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:27.618640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3695a32f-3a61-4c64-847b-38816f100bd3 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:27.641116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3695a32f-3a61-4c64-847b-38816f100bd3 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:27.641707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3695a32f-3a61-4c64-847b-38816f100bd3 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:27.642192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3695a32f-3a61-4c64-847b-38816f100bd3 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:27.652648 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3695a32f-3a61-4c64-847b-38816f100bd3 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.263650 Oct 29 01:04:27.653309 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 82/172] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:04:27.664845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fe4d7484-c82f-44b4-9b2e-2f681ca8d3b0 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Calling method '.version_select at 0x7f9d9c835f70>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:27.667143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe4d7484-c82f-44b4-9b2e-2f681ca8d3b0 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:27.667629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe4d7484-c82f-44b4-9b2e-2f681ca8d3b0 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:27.668094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe4d7484-c82f-44b4-9b2e-2f681ca8d3b0 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:27.695309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe4d7484-c82f-44b4-9b2e-2f681ca8d3b0 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:27.695906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe4d7484-c82f-44b4-9b2e-2f681ca8d3b0 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:27.696415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe4d7484-c82f-44b4-9b2e-2f681ca8d3b0 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:27.703762 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fe4d7484-c82f-44b4-9b2e-2f681ca8d3b0 tempest-HypervisorAdminUnderV252Test-1849341109 tempest-HypervisorAdminUnderV252Test-1849341109-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/n-h1-862964-3/search" status: 200 len: 104 microversion: 2.1 time: 0.043386 Oct 29 01:04:27.704561 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 91/173] 10.222.0.26 () {58 vars in 1209 bytes} [Sat Oct 29 01:04:27 2022] GET /compute/v2.1/os-hypervisors/n-h1-862964-3/search => generated 104 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:27.899662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e91d7abb-c13a-4a5e-b291-88b6635ba4ae tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:27.900281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e91d7abb-c13a-4a5e-b291-88b6635ba4ae tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:27.910148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e91d7abb-c13a-4a5e-b291-88b6635ba4ae tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:27.911880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e91d7abb-c13a-4a5e-b291-88b6635ba4ae tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:27.912337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e91d7abb-c13a-4a5e-b291-88b6635ba4ae tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:27.913061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e91d7abb-c13a-4a5e-b291-88b6635ba4ae tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:27.915723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e91d7abb-c13a-4a5e-b291-88b6635ba4ae tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:27.915723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e91d7abb-c13a-4a5e-b291-88b6635ba4ae tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:28.123627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e91d7abb-c13a-4a5e-b291-88b6635ba4ae tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:28.134663 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e91d7abb-c13a-4a5e-b291-88b6635ba4ae tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1337 microversion: 2.1 time: 0.239411 Oct 29 01:04:28.135271 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 83/174] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:27 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1337 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:28.252283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dc824054-faa1-41eb-aeab-fbb2aab6ccf9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:28.252885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dc824054-faa1-41eb-aeab-fbb2aab6ccf9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:28.259789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dc824054-faa1-41eb-aeab-fbb2aab6ccf9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:28.260269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dc824054-faa1-41eb-aeab-fbb2aab6ccf9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:28.260698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dc824054-faa1-41eb-aeab-fbb2aab6ccf9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:28.261438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dc824054-faa1-41eb-aeab-fbb2aab6ccf9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:28.261892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dc824054-faa1-41eb-aeab-fbb2aab6ccf9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:28.262314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dc824054-faa1-41eb-aeab-fbb2aab6ccf9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:28.403973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-dc824054-faa1-41eb-aeab-fbb2aab6ccf9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:28.415830 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dc824054-faa1-41eb-aeab-fbb2aab6ccf9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1388 microversion: 2.1 time: 0.164974 Oct 29 01:04:28.416461 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 92/175] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:28 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1388 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:29.159623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-06f6a2d1-e070-4a3c-8bb8-92f6b575a5d4 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:29.160350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-06f6a2d1-e070-4a3c-8bb8-92f6b575a5d4 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:29.167430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06f6a2d1-e070-4a3c-8bb8-92f6b575a5d4 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:29.167918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06f6a2d1-e070-4a3c-8bb8-92f6b575a5d4 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:29.168354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06f6a2d1-e070-4a3c-8bb8-92f6b575a5d4 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:29.169054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06f6a2d1-e070-4a3c-8bb8-92f6b575a5d4 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:29.169533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06f6a2d1-e070-4a3c-8bb8-92f6b575a5d4 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:29.169955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06f6a2d1-e070-4a3c-8bb8-92f6b575a5d4 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:29.312262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-06f6a2d1-e070-4a3c-8bb8-92f6b575a5d4 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:29.321406 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-06f6a2d1-e070-4a3c-8bb8-92f6b575a5d4 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1337 microversion: 2.1 time: 0.166574 Oct 29 01:04:29.321993 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 84/176] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:29 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1337 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:29.439386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f0325a9f-cddf-4439-a4b4-009ef1ebc323 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:29.439993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f0325a9f-cddf-4439-a4b4-009ef1ebc323 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:29.447855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0325a9f-cddf-4439-a4b4-009ef1ebc323 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:29.448953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0325a9f-cddf-4439-a4b4-009ef1ebc323 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:29.448953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0325a9f-cddf-4439-a4b4-009ef1ebc323 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:29.449512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0325a9f-cddf-4439-a4b4-009ef1ebc323 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:29.449966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0325a9f-cddf-4439-a4b4-009ef1ebc323 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:29.450390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0325a9f-cddf-4439-a4b4-009ef1ebc323 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:29.629028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f0325a9f-cddf-4439-a4b4-009ef1ebc323 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:29.637215 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f0325a9f-cddf-4439-a4b4-009ef1ebc323 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1388 microversion: 2.1 time: 0.202064 Oct 29 01:04:29.637875 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 93/177] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:29 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1388 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:30.347634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e4b6fa2-3e51-4aac-bf23-297e41ce1137 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:30.349780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e4b6fa2-3e51-4aac-bf23-297e41ce1137 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:30.359168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e4b6fa2-3e51-4aac-bf23-297e41ce1137 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:30.360370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e4b6fa2-3e51-4aac-bf23-297e41ce1137 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:30.360965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e4b6fa2-3e51-4aac-bf23-297e41ce1137 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:30.362269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e4b6fa2-3e51-4aac-bf23-297e41ce1137 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:30.363697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e4b6fa2-3e51-4aac-bf23-297e41ce1137 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:30.364857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e4b6fa2-3e51-4aac-bf23-297e41ce1137 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:30.599825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8e4b6fa2-3e51-4aac-bf23-297e41ce1137 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:30.619554 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8e4b6fa2-3e51-4aac-bf23-297e41ce1137 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1337 microversion: 2.1 time: 0.279142 Oct 29 01:04:30.620410 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 85/178] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:30 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1337 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:30.663861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-01edd34c-521b-407c-9637-3f6f743fd611 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:30.664361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-01edd34c-521b-407c-9637-3f6f743fd611 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:30.677231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01edd34c-521b-407c-9637-3f6f743fd611 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:30.686861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01edd34c-521b-407c-9637-3f6f743fd611 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:30.686861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01edd34c-521b-407c-9637-3f6f743fd611 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:30.686861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01edd34c-521b-407c-9637-3f6f743fd611 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:30.687184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01edd34c-521b-407c-9637-3f6f743fd611 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:30.687184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01edd34c-521b-407c-9637-3f6f743fd611 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:30.989536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-01edd34c-521b-407c-9637-3f6f743fd611 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:31.009610 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-01edd34c-521b-407c-9637-3f6f743fd611 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1388 microversion: 2.1 time: 0.350845 Oct 29 01:04:31.026246 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 94/179] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:30 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1388 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:31.644694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-22e5a2a2-225a-4848-a8ce-14e439090cbd tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:31.646676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-22e5a2a2-225a-4848-a8ce-14e439090cbd tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:31.651929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22e5a2a2-225a-4848-a8ce-14e439090cbd tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:31.652415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22e5a2a2-225a-4848-a8ce-14e439090cbd tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:31.652851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22e5a2a2-225a-4848-a8ce-14e439090cbd tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:31.653913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22e5a2a2-225a-4848-a8ce-14e439090cbd tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:31.654375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22e5a2a2-225a-4848-a8ce-14e439090cbd tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:31.654804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22e5a2a2-225a-4848-a8ce-14e439090cbd tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:31.818871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-22e5a2a2-225a-4848-a8ce-14e439090cbd tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:31.827983 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-22e5a2a2-225a-4848-a8ce-14e439090cbd tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1337 microversion: 2.1 time: 0.187084 Oct 29 01:04:31.832558 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 86/180] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:31 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1337 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:32.035976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-304f68bb-3443-4a21-b7e1-7cc58aafea7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:32.036760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-304f68bb-3443-4a21-b7e1-7cc58aafea7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:32.042710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-304f68bb-3443-4a21-b7e1-7cc58aafea7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:32.043203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-304f68bb-3443-4a21-b7e1-7cc58aafea7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:32.043624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-304f68bb-3443-4a21-b7e1-7cc58aafea7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:32.044321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-304f68bb-3443-4a21-b7e1-7cc58aafea7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:32.044773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-304f68bb-3443-4a21-b7e1-7cc58aafea7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:32.045222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-304f68bb-3443-4a21-b7e1-7cc58aafea7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:32.203555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-304f68bb-3443-4a21-b7e1-7cc58aafea7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:32.213300 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-304f68bb-3443-4a21-b7e1-7cc58aafea7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1388 microversion: 2.1 time: 0.180442 Oct 29 01:04:32.225758 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 95/181] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:32 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1388 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:32.660622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:32.662199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:32.852273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0bbeea15-8a49-40f2-b2af-61dbf256f47a tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:32.853182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0bbeea15-8a49-40f2-b2af-61dbf256f47a tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:32.859164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0bbeea15-8a49-40f2-b2af-61dbf256f47a tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:32.859836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0bbeea15-8a49-40f2-b2af-61dbf256f47a tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:32.863008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0bbeea15-8a49-40f2-b2af-61dbf256f47a tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:32.863008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0bbeea15-8a49-40f2-b2af-61dbf256f47a tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:32.863008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0bbeea15-8a49-40f2-b2af-61dbf256f47a tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:32.863008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0bbeea15-8a49-40f2-b2af-61dbf256f47a tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:33.008339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0bbeea15-8a49-40f2-b2af-61dbf256f47a tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:33.016749 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0bbeea15-8a49-40f2-b2af-61dbf256f47a tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1337 microversion: 2.1 time: 0.168988 Oct 29 01:04:33.017377 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 96/182] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:32 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1337 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:33.236948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2b4f0ecc-4bad-420d-bc7b-d277099147e0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:33.237668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2b4f0ecc-4bad-420d-bc7b-d277099147e0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:33.244537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b4f0ecc-4bad-420d-bc7b-d277099147e0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:33.245101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b4f0ecc-4bad-420d-bc7b-d277099147e0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:33.245634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b4f0ecc-4bad-420d-bc7b-d277099147e0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:33.246560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b4f0ecc-4bad-420d-bc7b-d277099147e0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:33.247333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b4f0ecc-4bad-420d-bc7b-d277099147e0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:33.247822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b4f0ecc-4bad-420d-bc7b-d277099147e0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:33.334972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fa591490-94d7-446c-80d3-1706b5f5a1b3 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-207989299", "id": 1470901579, "os-flavor-access:is_public": "False"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:33.440842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2b4f0ecc-4bad-420d-bc7b-d277099147e0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:33.448103 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fa591490-94d7-446c-80d3-1706b5f5a1b3 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.792658 Oct 29 01:04:33.449017 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 87/183] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:32 2022] POST /compute/v2.1/flavors => generated 438 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:33.451836 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2b4f0ecc-4bad-420d-bc7b-d277099147e0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1388 microversion: 2.1 time: 0.218722 Oct 29 01:04:33.452588 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 97/184] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:33 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1388 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:33.462421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9c9a2a1b-b7c6-4217-b5a0-f2ed1f1b05c3 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "998862b2874247179be55d2f10b15dc4"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:33.936952 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9c9a2a1b-b7c6-4217-b5a0-f2ed1f1b05c3 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1470901579/action" status: 200 len: 97 microversion: 2.1 time: 0.478768 Oct 29 01:04:33.938748 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 88/185] 10.222.0.26 () {60 vars in 1200 bytes} [Sat Oct 29 01:04:33 2022] POST /compute/v2.1/flavors/1470901579/action => generated 97 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:04:33.950704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-75ecd21d-ffe0-40a9-a109-4300760341a2 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "998862b2874247179be55d2f10b15dc4"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:34.082177 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-8e3e7fd4-9ac9-4eb6-a465-7da4b1591edd req-9d83eab7-c7dd-4eb6-9f2a-f6137ecd6ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea9fe51-2e94-4205-959b-c9687e60b4ab", "name": "network-vif-plugged", "status": "completed", "tag": "a3e3f41d-0080-4c51-b487-85a6a1282969"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:34.106652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8e3e7fd4-9ac9-4eb6-a465-7da4b1591edd req-9d83eab7-c7dd-4eb6-9f2a-f6137ecd6ed7 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:34.106652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8e3e7fd4-9ac9-4eb6-a465-7da4b1591edd req-9d83eab7-c7dd-4eb6-9f2a-f6137ecd6ed7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:34.106652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8e3e7fd4-9ac9-4eb6-a465-7da4b1591edd req-9d83eab7-c7dd-4eb6-9f2a-f6137ecd6ed7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:34.116787 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-8e3e7fd4-9ac9-4eb6-a465-7da4b1591edd req-9d83eab7-c7dd-4eb6-9f2a-f6137ecd6ed7 service nova] Creating event network-vif-plugged:a3e3f41d-0080-4c51-b487-85a6a1282969 for instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab on n-h1-862964-3 Oct 29 01:04:34.117350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8e3e7fd4-9ac9-4eb6-a465-7da4b1591edd req-9d83eab7-c7dd-4eb6-9f2a-f6137ecd6ed7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 01:04:34.117770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8e3e7fd4-9ac9-4eb6-a465-7da4b1591edd req-9d83eab7-c7dd-4eb6-9f2a-f6137ecd6ed7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 01:04:34.118827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-267c3ca0-1a08-43b0-adf0-8f924e47a7c6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:34.119282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-267c3ca0-1a08-43b0-adf0-8f924e47a7c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:34.119705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-267c3ca0-1a08-43b0-adf0-8f924e47a7c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:34.120604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-267c3ca0-1a08-43b0-adf0-8f924e47a7c6 None None] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:34.121058 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-267c3ca0-1a08-43b0-adf0-8f924e47a7c6 None None] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:34.121499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-267c3ca0-1a08-43b0-adf0-8f924e47a7c6 None None] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:34.132122 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.compute.rpcapi [None req-267c3ca0-1a08-43b0-adf0-8f924e47a7c6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 29 01:04:34.132122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-267c3ca0-1a08-43b0-adf0-8f924e47a7c6 None None] Releasing lock "compute-rpcapi-router" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 01:04:34.148812 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-267c3ca0-1a08-43b0-adf0-8f924e47a7c6 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.415104 Oct 29 01:04:34.150567 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 98/186] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:04:34.159543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-18195dea-2d1b-4b9d-a493-bc1632c7d076 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:34.160770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-18195dea-2d1b-4b9d-a493-bc1632c7d076 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:34.171563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18195dea-2d1b-4b9d-a493-bc1632c7d076 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:34.172378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18195dea-2d1b-4b9d-a493-bc1632c7d076 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:34.173104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18195dea-2d1b-4b9d-a493-bc1632c7d076 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:34.174255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18195dea-2d1b-4b9d-a493-bc1632c7d076 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:34.175014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18195dea-2d1b-4b9d-a493-bc1632c7d076 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:34.175699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18195dea-2d1b-4b9d-a493-bc1632c7d076 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:34.386558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-18195dea-2d1b-4b9d-a493-bc1632c7d076 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:34.394418 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-18195dea-2d1b-4b9d-a493-bc1632c7d076 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1337 microversion: 2.1 time: 0.242185 Oct 29 01:04:34.396192 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 99/187] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:34 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1337 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:34.480229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1c1e113e-42b4-474b-bac2-7e857124a3e9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:34.481182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1c1e113e-42b4-474b-bac2-7e857124a3e9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:34.487106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c1e113e-42b4-474b-bac2-7e857124a3e9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:34.487936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c1e113e-42b4-474b-bac2-7e857124a3e9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:34.488545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c1e113e-42b4-474b-bac2-7e857124a3e9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:34.490349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c1e113e-42b4-474b-bac2-7e857124a3e9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:34.491012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c1e113e-42b4-474b-bac2-7e857124a3e9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:34.495390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c1e113e-42b4-474b-bac2-7e857124a3e9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:34.659210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1c1e113e-42b4-474b-bac2-7e857124a3e9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:34.675777 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1c1e113e-42b4-474b-bac2-7e857124a3e9 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1388 microversion: 2.1 time: 0.202296 Oct 29 01:04:34.677826 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 100/188] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:34 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1388 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:34.838664 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-75ecd21d-ffe0-40a9-a109-4300760341a2 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] HTTP exception thrown: Flavor access already exists for flavor 33 and project 998862b2874247179be55d2f10b15dc4 combination. Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-75ecd21d-ffe0-40a9-a109-4300760341a2 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Request method failure captured: Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/flavors/1470901579/action HTTP/1.1 Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 67 Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwekFNc_yiV2DQrkN2maW6WmiR0f7WOCzYtIRHidQIlJ7m_pLof2zbQk5jbr0qYTmc6iyATL6WPzCrJu5t7ACI1L_gkJXaV_sj8fjpDR4pbBtnE7EV4bZKnhqzz5OzGxTn4auUAQXE2E7Lq4n2SwBEqhQpmqjsf55FVmCXyuDifFUs Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 0c9d7c32a82047418c94c08280059e9a Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1836212034 Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:04:34.844674 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:04:34.846210 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c9d7c32a82047418c94c08280059e9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0c9d7c32a82047418c94c08280059e9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c9d7c32a82047418c94c08280059e9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0c9d7c32a82047418c94c08280059e9a", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:34.846210 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1836212034 Oct 29 01:04:34.846210 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 0c9d7c32a82047418c94c08280059e9a Oct 29 01:04:34.846210 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1836212034 Oct 29 01:04:34.846210 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin Oct 29 01:04:34.846210 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:34.846210 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:34.846210 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 7b3756e7f8f64a0dae22398e6ad63bdc Oct 29 01:04:34.846210 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin Oct 29 01:04:34.846210 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:04:34.846210 n-d-862964-3 devstack@n-api.service[121099]: {"addTenantAccess": {"tenant": "998862b2874247179be55d2f10b15dc4"}} Oct 29 01:04:34.846210 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:04:34.846942 n-d-862964-3 devstack@n-api.service[121099]: exception: Flavor access already exists for flavor 33 and project 998862b2874247179be55d2f10b15dc4 combination. Oct 29 01:04:34.846942 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '1470901579', 'body': {'addTenantAccess': {'tenant': '998862b2874247179be55d2f10b15dc4'}}} Oct 29 01:04:34.846942 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:34.846942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:34.846942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 01:04:34.846942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 01:04:34.846942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 01:04:34.846942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 01:04:34.846942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 01:04:34.846942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 01:04:34.846942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 01:04:34.846942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 01:04:34.846942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 01:04:34.846942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 01:04:34.846942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 01:04:34.846942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result.read() Oct 29 01:04:34.846942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 01:04:34.846942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 01:04:34.848250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 01:04:34.848250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 01:04:34.848250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 01:04:34.848250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 01:04:34.848250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 01:04:34.848250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 01:04:34.848250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '33-998862b2874247179be55d2f10b15dc4' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 29 01:04:34.848250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:34.848250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 01:04:34.848250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:34.848250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:34.848250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 29 01:04:34.848250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 29 01:04:34.848250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 29 01:04:34.848250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi session.flush() Oct 29 01:04:34.848250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 01:04:34.848250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 29 01:04:34.848250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 01:04:34.848250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 29 01:04:34.849596 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 01:04:34.849596 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 29 01:04:34.849596 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 01:04:34.849596 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception Oct 29 01:04:34.849596 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 01:04:34.849596 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 29 01:04:34.849596 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 01:04:34.849596 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 29 01:04:34.849596 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 01:04:34.849596 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 29 01:04:34.849596 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 01:04:34.849596 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 29 01:04:34.849596 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 29 01:04:34.849596 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 29 01:04:34.849596 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 01:04:34.849596 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 01:04:34.849596 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 01:04:34.849596 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 29 01:04:34.850770 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 01:04:34.850770 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 29 01:04:34.850770 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 01:04:34.850770 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 29 01:04:34.850770 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 01:04:34.850770 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 01:04:34.850770 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 01:04:34.850770 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception Oct 29 01:04:34.850770 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 01:04:34.850770 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 01:04:34.850770 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 01:04:34.850770 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 01:04:34.850770 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 01:04:34.850770 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 01:04:34.850770 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 01:04:34.850770 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 01:04:34.850770 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 01:04:34.850770 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 01:04:34.851900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 01:04:34.851900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result.read() Oct 29 01:04:34.851900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 01:04:34.851900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 01:04:34.851900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 01:04:34.851900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 01:04:34.851900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 01:04:34.851900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 01:04:34.851900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 01:04:34.851900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 01:04:34.851900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '33-998862b2874247179be55d2f10b15dc4' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 29 01:04:34.851900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 29 01:04:34.851900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 29, 1, 4, 34, 811208), 'updated_at': None, 'flavor_id': 33, 'project_id': '998862b2874247179be55d2f10b15dc4'}] Oct 29 01:04:34.851900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 01:04:34.851900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:34.851900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:34.851900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:34.852895 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:34.852895 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 29 01:04:34.852895 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 29 01:04:34.852895 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 01:04:34.852895 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 01:04:34.852895 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 29 01:04:34.852895 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 29 01:04:34.852895 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 29 01:04:34.852895 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 29 01:04:34.852895 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 29 01:04:34.852895 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 29 01:04:34.852895 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:04:34.852895 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:04:34.852895 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 29 01:04:34.852895 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 29 01:04:34.852895 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 33 and project 998862b2874247179be55d2f10b15dc4 combination. Oct 29 01:04:34.852895 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:34.852895 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:34.852895 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 33 and project 998862b2874247179be55d2f10b15dc4 combination. Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:34.855794 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:34.857201 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 33 and project 998862b2874247179be55d2f10b15dc4 combination. Oct 29 01:04:34.857201 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:34.859222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-75ecd21d-ffe0-40a9-a109-4300760341a2 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Returning 409 to user: Flavor access already exists for flavor 33 and project 998862b2874247179be55d2f10b15dc4 combination. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:34.859222 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-75ecd21d-ffe0-40a9-a109-4300760341a2 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1470901579/action" status: 409 len: 152 microversion: 2.1 time: 0.912964 Oct 29 01:04:34.859222 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 89/189] 10.222.0.26 () {60 vars in 1200 bytes} [Sat Oct 29 01:04:33 2022] POST /compute/v2.1/flavors/1470901579/action => generated 152 bytes in 915 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 29 01:04:34.869508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-03002131-e6f7-4f3e-ac32-4ed658baa9cb tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "998862b2874247179be55d2f10b15dc4"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:35.128486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=22 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:35.428002 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-03002131-e6f7-4f3e-ac32-4ed658baa9cb tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1470901579/action" status: 200 len: 21 microversion: 2.1 time: 0.563836 Oct 29 01:04:35.428769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d7ebb141-4e2d-415d-a498-1901eac9633a tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Calling method '.version_select at 0x7f9d9c751280>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:35.429146 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 101/190] 10.222.0.26 () {60 vars in 1200 bytes} [Sat Oct 29 01:04:34 2022] POST /compute/v2.1/flavors/1470901579/action => generated 21 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:04:35.436137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7ebb141-4e2d-415d-a498-1901eac9633a tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:35.436283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b399eb43-d098-40a0-a78a-6adeb15976c6 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:35.437660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b399eb43-d098-40a0-a78a-6adeb15976c6 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:35.438278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7ebb141-4e2d-415d-a498-1901eac9633a tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:35.439339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7ebb141-4e2d-415d-a498-1901eac9633a tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:35.440884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7ebb141-4e2d-415d-a498-1901eac9633a tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:35.444380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7ebb141-4e2d-415d-a498-1901eac9633a tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:35.445022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7ebb141-4e2d-415d-a498-1901eac9633a tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:35.453344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b399eb43-d098-40a0-a78a-6adeb15976c6 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:35.458446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b399eb43-d098-40a0-a78a-6adeb15976c6 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:35.458446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b399eb43-d098-40a0-a78a-6adeb15976c6 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:35.458446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b399eb43-d098-40a0-a78a-6adeb15976c6 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:35.458446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b399eb43-d098-40a0-a78a-6adeb15976c6 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:35.458794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b399eb43-d098-40a0-a78a-6adeb15976c6 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:35.476387 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d7ebb141-4e2d-415d-a498-1901eac9633a tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 396 microversion: 2.1 time: 0.410745 Oct 29 01:04:35.483357 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 90/191] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Oct 29 01:04:35 2022] GET /compute/v2.1/os-hosts => generated 396 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:04:35.483357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c25784e0-d5ba-41e9-b4a1-bc22e94228eb tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:35.490181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=83,nova_api:DELETE=8,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:35.603708 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c25784e0-d5ba-41e9-b4a1-bc22e94228eb tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1470901579" status: 202 len: 0 microversion: 2.1 time: 0.123283 Oct 29 01:04:35.607349 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 91/192] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 29 01:04:35 2022] DELETE /compute/v2.1/flavors/1470901579 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:04:35.757198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b399eb43-d098-40a0-a78a-6adeb15976c6 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:35.768284 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b399eb43-d098-40a0-a78a-6adeb15976c6 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1337 microversion: 2.1 time: 0.334504 Oct 29 01:04:35.772407 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 102/193] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:35 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1337 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:35.783111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-303fe0f6-2db3-4235-bc50-427ed6e010be req-0ded855e-9ddd-43c2-b937-762c3c3427dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f061780f-e530-42cd-8c3d-021d7e63a22f", "tag": "0ef4060b-e698-4221-b1fb-3c5bdfd3cba2"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:35.803702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-303fe0f6-2db3-4235-bc50-427ed6e010be req-0ded855e-9ddd-43c2-b937-762c3c3427dd service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:35.804187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-303fe0f6-2db3-4235-bc50-427ed6e010be req-0ded855e-9ddd-43c2-b937-762c3c3427dd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:35.804612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-303fe0f6-2db3-4235-bc50-427ed6e010be req-0ded855e-9ddd-43c2-b937-762c3c3427dd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:35.829597 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-303fe0f6-2db3-4235-bc50-427ed6e010be req-0ded855e-9ddd-43c2-b937-762c3c3427dd service nova] Creating event network-changed:0ef4060b-e698-4221-b1fb-3c5bdfd3cba2 for instance f061780f-e530-42cd-8c3d-021d7e63a22f on n-h2-862964-3 Oct 29 01:04:35.838509 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-303fe0f6-2db3-4235-bc50-427ed6e010be req-0ded855e-9ddd-43c2-b937-762c3c3427dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063941 Oct 29 01:04:35.839767 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 103/194] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:35.845138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c593357e-5956-4ad0-8e8d-cce055c5d228 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:35.878365 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c593357e-5956-4ad0-8e8d-cce055c5d228 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.036185 Oct 29 01:04:35.879492 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 104/195] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:35 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:35.896459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2bdf6ba5-6fef-4e6f-943a-a7ad1b14b337 tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Calling method '.version_select at 0x7f9d9c85aca0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:35.899544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2bdf6ba5-6fef-4e6f-943a-a7ad1b14b337 tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'c6717061cfd54346b457aafab306fbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14576b15796b49459fbbcbd2c24646e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2bdf6ba5-6fef-4e6f-943a-a7ad1b14b337 tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Request method failure captured: Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwgI4PnoVDB79Hk1PZaH8o6ATEwQGpuDC58wJmMDXMwdhsoM7a4GVctez7dXgJMCO4ZhukaSjr95zGQ4kqDyjd6Em6ldfAfgjwraPwhUtyv-7tImdYrF9O183uDHwQGotI0n3DqYCI5eMzX2lqzvAfYOwGZa98B23lgEyOatYHZHKs Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 14576b15796b49459fbbcbd2c24646e8 Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1566482778 Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:04:35.901524 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:04:35.902959 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14576b15796b49459fbbcbd2c24646e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/14576b15796b49459fbbcbd2c24646e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14576b15796b49459fbbcbd2c24646e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_14576b15796b49459fbbcbd2c24646e8", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:35.902959 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1566482778 Oct 29 01:04:35.902959 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 14576b15796b49459fbbcbd2c24646e8 Oct 29 01:04:35.902959 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1566482778 Oct 29 01:04:35.902959 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-HostsAdminNegativeTestJSON-1566482778-project Oct 29 01:04:35.902959 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:35.902959 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:35.902959 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: c6717061cfd54346b457aafab306fbd9 Oct 29 01:04:35.902959 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1566482778-project Oct 29 01:04:35.902959 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:04:35.902959 n-d-862964-3 devstack@n-api.service[121099]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 29 01:04:35.902959 n-d-862964-3 devstack@n-api.service[121099]: action_args: {} Oct 29 01:04:35.902959 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:35.903823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:35.903823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:35.903823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:35.903823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:35.903823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:35.903823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:04:35.903823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:04:35.903823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:04:35.903823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:35.903823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:35.903823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:35.903823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 29 01:04:35.903823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 29 01:04:35.903823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:04:35.903823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:04:35.903823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:04:35.903823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:04:35.903823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:35.903823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:35.906088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:35.906088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:35.906088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:04:35.906088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:04:35.906088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:04:35.906088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:04:35.906088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:04:35.906088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:04:35.906088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 29 01:04:35.906088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:35.906088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:35.906088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:35.906088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:35.906088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:35.906088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:35.906088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:04:35.906088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:04:35.906088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 29 01:04:35.906088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:35.911459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2bdf6ba5-6fef-4e6f-943a-a7ad1b14b337 tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:35.911459 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2bdf6ba5-6fef-4e6f-943a-a7ad1b14b337 tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.292820 Oct 29 01:04:35.911459 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 92/196] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Oct 29 01:04:35 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 296 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:04:35.919205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-df3f4614-d3b4-4637-b10a-3fba29e76d2e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:35.919836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-df3f4614-d3b4-4637-b10a-3fba29e76d2e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:35.936506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df3f4614-d3b4-4637-b10a-3fba29e76d2e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:35.937009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df3f4614-d3b4-4637-b10a-3fba29e76d2e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:35.938970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df3f4614-d3b4-4637-b10a-3fba29e76d2e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:35.939716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df3f4614-d3b4-4637-b10a-3fba29e76d2e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:35.940547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df3f4614-d3b4-4637-b10a-3fba29e76d2e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:35.944487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df3f4614-d3b4-4637-b10a-3fba29e76d2e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:36.042052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f4801e4c-6ab4-4dfd-8928-b046aff07a7b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1730838922", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:36.181028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-df3f4614-d3b4-4637-b10a-3fba29e76d2e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:36.197030 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-df3f4614-d3b4-4637-b10a-3fba29e76d2e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1388 microversion: 2.1 time: 0.290855 Oct 29 01:04:36.198421 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 93/197] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:35 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1388 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:36.214518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-82089ffe-810c-4b81-8fce-6213efa42ab8 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1942248373", "id": 923075089, "os-flavor-access:is_public": "True"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:36.280402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-f4801e4c-6ab4-4dfd-8928-b046aff07a7b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] validate_networks() for None {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:04:36.352236 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-82089ffe-810c-4b81-8fce-6213efa42ab8 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.148777 Oct 29 01:04:36.352236 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 94/198] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:36 2022] POST /compute/v2.1/flavors => generated 435 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:36.362371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a00e5742-e59f-46c8-a500-8d43c587cf0b tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Calling method '.version_select at 0x7f9d9db13670>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:36.364631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a00e5742-e59f-46c8-a500-8d43c587cf0b tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'c6717061cfd54346b457aafab306fbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14576b15796b49459fbbcbd2c24646e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a00e5742-e59f-46c8-a500-8d43c587cf0b tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Request method failure captured: Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-hosts/n-d-862964-3/reboot HTTP/1.1 Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwgI4PnoVDB79Hk1PZaH8o6ATEwQGpuDC58wJmMDXMwdhsoM7a4GVctez7dXgJMCO4ZhukaSjr95zGQ4kqDyjd6Em6ldfAfgjwraPwhUtyv-7tImdYrF9O183uDHwQGotI0n3DqYCI5eMzX2lqzvAfYOwGZa98B23lgEyOatYHZHKs Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 14576b15796b49459fbbcbd2c24646e8 Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1566482778 Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:04:36.366518 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:04:36.376820 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14576b15796b49459fbbcbd2c24646e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/14576b15796b49459fbbcbd2c24646e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14576b15796b49459fbbcbd2c24646e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_14576b15796b49459fbbcbd2c24646e8", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:36.376820 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1566482778 Oct 29 01:04:36.376820 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 14576b15796b49459fbbcbd2c24646e8 Oct 29 01:04:36.376820 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1566482778 Oct 29 01:04:36.376820 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-HostsAdminNegativeTestJSON-1566482778-project Oct 29 01:04:36.376820 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:36.376820 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:36.376820 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: c6717061cfd54346b457aafab306fbd9 Oct 29 01:04:36.376820 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1566482778-project Oct 29 01:04:36.376820 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:04:36.376820 n-d-862964-3 devstack@n-api.service[121099]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 29 01:04:36.376820 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'n-d-862964-3'} Oct 29 01:04:36.376820 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:36.377572 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:36.377572 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:36.377572 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:36.377572 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:36.377572 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:36.377572 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:04:36.377572 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:04:36.377572 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:36.377572 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:36.377572 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 29 01:04:36.377572 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 29 01:04:36.377572 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:04:36.377572 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:04:36.377572 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:04:36.377572 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:04:36.377572 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:36.377572 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:36.377572 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:36.377572 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:36.378574 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:04:36.378574 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:04:36.378574 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:04:36.378574 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:04:36.378574 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:04:36.378574 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:04:36.378574 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 29 01:04:36.378574 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.378574 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:36.378574 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.378574 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:36.378574 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:36.378574 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:36.378574 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:04:36.378574 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:04:36.378574 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 29 01:04:36.378574 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.380141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a00e5742-e59f-46c8-a500-8d43c587cf0b tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:36.380141 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a00e5742-e59f-46c8-a500-8d43c587cf0b tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-d-862964-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.015684 Oct 29 01:04:36.380141 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 95/199] 10.222.0.26 () {58 vars in 1188 bytes} [Sat Oct 29 01:04:36 2022] GET /compute/v2.1/os-hosts/n-d-862964-3/reboot => generated 111 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:04:36.383442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b49f63d6-5356-424d-bbb4-18aae2239c47 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:36.392816 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-b49f63d6-5356-424d-bbb4-18aae2239c47 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b49f63d6-5356-424d-bbb4-18aae2239c47 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Request method failure captured: Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/flavors/923075089/os-flavor-access HTTP/1.1 Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwekFNc_yiV2DQrkN2maW6WmiR0f7WOCzYtIRHidQIlJ7m_pLof2zbQk5jbr0qYTmc6iyATL6WPzCrJu5t7ACI1L_gkJXaV_sj8fjpDR4pbBtnE7EV4bZKnhqzz5OzGxTn4auUAQXE2E7Lq4n2SwBEqhQpmqjsf55FVmCXyuDifFUs Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 0c9d7c32a82047418c94c08280059e9a Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1836212034 Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:04:36.394236 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:04:36.403533 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c9d7c32a82047418c94c08280059e9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0c9d7c32a82047418c94c08280059e9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c9d7c32a82047418c94c08280059e9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0c9d7c32a82047418c94c08280059e9a", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:36.403533 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1836212034 Oct 29 01:04:36.403533 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 0c9d7c32a82047418c94c08280059e9a Oct 29 01:04:36.403533 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1836212034 Oct 29 01:04:36.403533 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin Oct 29 01:04:36.403533 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:36.403533 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:36.403533 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 7b3756e7f8f64a0dae22398e6ad63bdc Oct 29 01:04:36.403533 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin Oct 29 01:04:36.403533 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:04:36.403533 n-d-862964-3 devstack@n-api.service[121099]: exception: Access list not available for public flavors. Oct 29 01:04:36.403533 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'flavor_id': '923075089'} Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 29 01:04:36.404410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.405783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b49f63d6-5356-424d-bbb4-18aae2239c47 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:36.405783 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b49f63d6-5356-424d-bbb4-18aae2239c47 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/923075089/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.026644 Oct 29 01:04:36.405783 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 96/200] 10.222.0.26 () {58 vars in 1206 bytes} [Sat Oct 29 01:04:36 2022] GET /compute/v2.1/flavors/923075089/os-flavor-access => generated 91 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:04:36.405783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-37e35bcf-b0e4-4438-81d2-f9f6adcfe0c3 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Calling method '.version_select at 0x7f9d9c65d3a0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:36.411007 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-37e35bcf-b0e4-4438-81d2-f9f6adcfe0c3 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-37e35bcf-b0e4-4438-81d2-f9f6adcfe0c3 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Request method failure captured: Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwilvRwYV_DGUAWU1FEEaVQ9DuJgcSByIxrhr-laDn3alhTgLAOpKsmVmnU42jgJ9zT4MTRaJI93Lh6S6G2TDhNHiisaTA5vVCc7uSJkNIl1DRfpExf4Epv3zTbWiS7_6XIphZv_t79YIARrK49OstUmY_vQS2R7v8kRQUjzgLhU_o Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f19a46371fa24b97a607ceec2d96fb70 Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:04:36.413203 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:04:36.415809 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f19a46371fa24b97a607ceec2d96fb70", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:36.415809 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:36.415809 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f19a46371fa24b97a607ceec2d96fb70 Oct 29 01:04:36.415809 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:36.415809 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-HostsAdminNegativeTestJSON-1269563830-project-admin Oct 29 01:04:36.415809 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:36.415809 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:36.415809 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 998ba7162adf41d8bba07636f7a62764 Oct 29 01:04:36.415809 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1269563830-project-admin Oct 29 01:04:36.415809 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:04:36.415809 n-d-862964-3 devstack@n-api.service[121099]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:36.415809 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'nonexistent_hostname'} Oct 29 01:04:36.415809 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:36.416892 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:36.416892 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 29 01:04:36.416892 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 29 01:04:36.416892 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 01:04:36.416892 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 01:04:36.416892 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:36.416892 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:36.416892 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:36.416892 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:36.416892 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 01:04:36.416892 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 01:04:36.416892 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 29 01:04:36.416892 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 29 01:04:36.416892 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:04:36.416892 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:04:36.416892 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 01:04:36.416892 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 01:04:36.416892 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:04:36.416892 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:04:36.418177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 01:04:36.418177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 01:04:36.418177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:36.418177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.418177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:36.418177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.418177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:36.418177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:36.418177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:36.418177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:36.418177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:36.418177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:04:36.418177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:04:36.418177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:36.418177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:36.418177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 29 01:04:36.418177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 29 01:04:36.418177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 29 01:04:36.418177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:04:36.420146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:36.420146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.420146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:36.420146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.420146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:36.420146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:36.420146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:36.420146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:36.420146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:36.420146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:36.420146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.420146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-37e35bcf-b0e4-4438-81d2-f9f6adcfe0c3 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:36.420146 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-37e35bcf-b0e4-4438-81d2-f9f6adcfe0c3 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.016832 Oct 29 01:04:36.420146 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 97/201] 10.222.0.26 () {58 vars in 1212 bytes} [Sat Oct 29 01:04:36 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:04:36.423030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8fe441a7-ae20-4bbb-81d1-6c8c26e863aa tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:36.516710 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8fe441a7-ae20-4bbb-81d1-6c8c26e863aa tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/923075089" status: 202 len: 0 microversion: 2.1 time: 0.097070 Oct 29 01:04:36.517786 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 98/202] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 29 01:04:36 2022] DELETE /compute/v2.1/flavors/923075089 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:04:36.524016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-41a2bb42-e5c7-49e3-a2ba-cae3313fdc09 tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Calling method '.version_select at 0x7f9d9c6f68b0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:36.525957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-41a2bb42-e5c7-49e3-a2ba-cae3313fdc09 tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'c6717061cfd54346b457aafab306fbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14576b15796b49459fbbcbd2c24646e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-41a2bb42-e5c7-49e3-a2ba-cae3313fdc09 tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Request method failure captured: Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-hosts/n-d-862964-3 HTTP/1.1 Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwgI4PnoVDB79Hk1PZaH8o6ATEwQGpuDC58wJmMDXMwdhsoM7a4GVctez7dXgJMCO4ZhukaSjr95zGQ4kqDyjd6Em6ldfAfgjwraPwhUtyv-7tImdYrF9O183uDHwQGotI0n3DqYCI5eMzX2lqzvAfYOwGZa98B23lgEyOatYHZHKs Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 14576b15796b49459fbbcbd2c24646e8 Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1566482778 Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:04:36.527745 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:04:36.529192 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14576b15796b49459fbbcbd2c24646e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/14576b15796b49459fbbcbd2c24646e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14576b15796b49459fbbcbd2c24646e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_14576b15796b49459fbbcbd2c24646e8", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:36.529192 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1566482778 Oct 29 01:04:36.529192 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 14576b15796b49459fbbcbd2c24646e8 Oct 29 01:04:36.529192 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1566482778 Oct 29 01:04:36.529192 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-HostsAdminNegativeTestJSON-1566482778-project Oct 29 01:04:36.529192 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:36.529192 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:36.529192 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: c6717061cfd54346b457aafab306fbd9 Oct 29 01:04:36.529192 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1566482778-project Oct 29 01:04:36.529192 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:04:36.529192 n-d-862964-3 devstack@n-api.service[121099]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 29 01:04:36.529192 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'n-d-862964-3'} Oct 29 01:04:36.529192 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:36.530066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:36.530066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:36.530066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:36.530066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:36.530066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:36.530066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:04:36.530066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:04:36.530066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:36.530066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:36.530066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 29 01:04:36.530066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 29 01:04:36.530066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:04:36.530066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:04:36.530066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:04:36.530066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:04:36.530066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:36.530066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:36.530066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:36.530066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:36.531262 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:04:36.531262 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:04:36.531262 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:04:36.531262 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:04:36.531262 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:04:36.531262 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:04:36.531262 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 29 01:04:36.531262 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.531262 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:36.531262 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.531262 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:36.531262 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:36.531262 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:36.531262 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:04:36.531262 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:04:36.531262 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 29 01:04:36.531262 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.532346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-41a2bb42-e5c7-49e3-a2ba-cae3313fdc09 tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:36.533875 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-41a2bb42-e5c7-49e3-a2ba-cae3313fdc09 tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-d-862964-3" status: 403 len: 109 microversion: 2.1 time: 0.014104 Oct 29 01:04:36.533988 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 99/203] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Oct 29 01:04:36 2022] GET /compute/v2.1/os-hosts/n-d-862964-3 => generated 109 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:04:36.541653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-041b3170-4a80-41da-99b0-bf59cf91c2b3 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:36.566414 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-041b3170-4a80-41da-99b0-bf59cf91c2b3 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.031048 Oct 29 01:04:36.567520 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 100/204] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:36 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:36.570362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f4801e4c-6ab4-4dfd-8928-b046aff07a7b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:04:36.570846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f4801e4c-6ab4-4dfd-8928-b046aff07a7b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:04:36.571436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f4801e4c-6ab4-4dfd-8928-b046aff07a7b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:04:36.571917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f4801e4c-6ab4-4dfd-8928-b046aff07a7b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:04:36.572421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f4801e4c-6ab4-4dfd-8928-b046aff07a7b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:04:36.572588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4bb8198b-fb4f-44d8-a43e-8402582c49ee tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Calling method '.version_select at 0x7f9d9c604550>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:36.579263 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-4bb8198b-fb4f-44d8-a43e-8402582c49ee tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4bb8198b-fb4f-44d8-a43e-8402582c49ee tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Request method failure captured: Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwilvRwYV_DGUAWU1FEEaVQ9DuJgcSByIxrhr-laDn3alhTgLAOpKsmVmnU42jgJ9zT4MTRaJI93Lh6S6G2TDhNHiisaTA5vVCc7uSJkNIl1DRfpExf4Epv3zTbWiS7_6XIphZv_t79YIARrK49OstUmY_vQS2R7v8kRQUjzgLhU_o Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f19a46371fa24b97a607ceec2d96fb70 Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:04:36.580957 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:04:36.582169 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f19a46371fa24b97a607ceec2d96fb70", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:36.582169 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:36.582169 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f19a46371fa24b97a607ceec2d96fb70 Oct 29 01:04:36.582169 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:36.582169 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-HostsAdminNegativeTestJSON-1269563830-project-admin Oct 29 01:04:36.582169 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:36.582169 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:36.582169 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 998ba7162adf41d8bba07636f7a62764 Oct 29 01:04:36.582169 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1269563830-project-admin Oct 29 01:04:36.582169 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:04:36.582169 n-d-862964-3 devstack@n-api.service[121099]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:36.582169 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'nonexistent_hostname'} Oct 29 01:04:36.582169 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:36.583064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:36.583064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 29 01:04:36.583064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 29 01:04:36.583064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:04:36.583064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:04:36.583064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 01:04:36.583064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 01:04:36.583064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:04:36.583064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:04:36.583064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 01:04:36.583064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 01:04:36.583064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:36.583064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.583064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:36.583064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.583064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:36.583064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:36.583064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:36.583064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:36.584209 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:36.584209 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:04:36.584209 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:04:36.584209 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:36.584209 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:36.584209 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 29 01:04:36.584209 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:04:36.584209 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:36.584209 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.584209 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:36.584209 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.584209 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:36.584209 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:36.584209 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:36.584209 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:36.584209 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:36.584209 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:36.584209 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.585223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4bb8198b-fb4f-44d8-a43e-8402582c49ee tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:36.585223 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4bb8198b-fb4f-44d8-a43e-8402582c49ee tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.013358 Oct 29 01:04:36.585223 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 101/205] 10.222.0.26 () {58 vars in 1191 bytes} [Sat Oct 29 01:04:36 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:04:36.588206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-43522e76-259b-41b8-8e09-4e34858db32e tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-980179775", "id": 1101916627, "os-flavor-access:is_public": "False"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:36.591919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4801e4c-6ab4-4dfd-8928-b046aff07a7b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:36.592414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4801e4c-6ab4-4dfd-8928-b046aff07a7b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:36.592855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4801e4c-6ab4-4dfd-8928-b046aff07a7b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:36.593617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4801e4c-6ab4-4dfd-8928-b046aff07a7b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:36.600677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4801e4c-6ab4-4dfd-8928-b046aff07a7b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:36.600677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4801e4c-6ab4-4dfd-8928-b046aff07a7b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:36.618184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-f4801e4c-6ab4-4dfd-8928-b046aff07a7b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for project fba91819dd56439daea17217c5d7b9b7. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:04:36.622427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-f4801e4c-6ab4-4dfd-8928-b046aff07a7b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for user 175bb8f8b330495394cd401223847733 and project fba91819dd56439daea17217c5d7b9b7. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:04:36.634285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f4801e4c-6ab4-4dfd-8928-b046aff07a7b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:04:36.637260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f4801e4c-6ab4-4dfd-8928-b046aff07a7b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:04:36.737692 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-43522e76-259b-41b8-8e09-4e34858db32e tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.153165 Oct 29 01:04:36.738274 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 102/206] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:36 2022] POST /compute/v2.1/flavors => generated 438 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:36.744325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-78a901d8-cbe6-4dd0-b38b-64d812765c2f tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Calling method '.version_select at 0x7f9d9c643700>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:36.746131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-78a901d8-cbe6-4dd0-b38b-64d812765c2f tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'c6717061cfd54346b457aafab306fbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14576b15796b49459fbbcbd2c24646e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-78a901d8-cbe6-4dd0-b38b-64d812765c2f tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Request method failure captured: Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-hosts/n-d-862964-3/shutdown HTTP/1.1 Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwgI4PnoVDB79Hk1PZaH8o6ATEwQGpuDC58wJmMDXMwdhsoM7a4GVctez7dXgJMCO4ZhukaSjr95zGQ4kqDyjd6Em6ldfAfgjwraPwhUtyv-7tImdYrF9O183uDHwQGotI0n3DqYCI5eMzX2lqzvAfYOwGZa98B23lgEyOatYHZHKs Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 14576b15796b49459fbbcbd2c24646e8 Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1566482778 Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:04:36.747703 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:04:36.748940 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14576b15796b49459fbbcbd2c24646e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/14576b15796b49459fbbcbd2c24646e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14576b15796b49459fbbcbd2c24646e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_14576b15796b49459fbbcbd2c24646e8", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:36.748940 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1566482778 Oct 29 01:04:36.748940 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 14576b15796b49459fbbcbd2c24646e8 Oct 29 01:04:36.748940 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1566482778 Oct 29 01:04:36.748940 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-HostsAdminNegativeTestJSON-1566482778-project Oct 29 01:04:36.748940 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:36.748940 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:36.748940 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: c6717061cfd54346b457aafab306fbd9 Oct 29 01:04:36.748940 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1566482778-project Oct 29 01:04:36.748940 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:04:36.748940 n-d-862964-3 devstack@n-api.service[121099]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 29 01:04:36.748940 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'n-d-862964-3'} Oct 29 01:04:36.748940 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:36.749933 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:36.749933 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:36.749933 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:36.749933 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:36.749933 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:36.749933 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:04:36.749933 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:04:36.749933 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:36.749933 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:36.749933 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 29 01:04:36.749933 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 29 01:04:36.749933 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:04:36.749933 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:04:36.749933 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:04:36.749933 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:04:36.749933 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:36.749933 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:36.749933 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:36.749933 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:36.750965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:04:36.750965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:04:36.750965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:04:36.750965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:04:36.750965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:04:36.750965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:04:36.750965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 29 01:04:36.750965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.750965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:36.750965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.750965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:36.750965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:36.750965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:36.750965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:04:36.750965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:04:36.750965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 29 01:04:36.750965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.751929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-78a901d8-cbe6-4dd0-b38b-64d812765c2f tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:36.751929 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-78a901d8-cbe6-4dd0-b38b-64d812765c2f tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-d-862964-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.008709 Oct 29 01:04:36.751929 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 103/207] 10.222.0.26 () {58 vars in 1194 bytes} [Sat Oct 29 01:04:36 2022] GET /compute/v2.1/os-hosts/n-d-862964-3/shutdown => generated 113 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:04:36.792547 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f4801e4c-6ab4-4dfd-8928-b046aff07a7b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908194 Oct 29 01:04:36.804101 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 105/208] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:04:36.811403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0f921071-f4d0-4561-98e5-ae204f69a014 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Calling method '.version_select at 0x7f9d9c858280>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:36.823402 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-0f921071-f4d0-4561-98e5-ae204f69a014 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0f921071-f4d0-4561-98e5-ae204f69a014 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Request method failure captured: Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHwilvRwYV_DGUAWU1FEEaVQ9DuJgcSByIxrhr-laDn3alhTgLAOpKsmVmnU42jgJ9zT4MTRaJI93Lh6S6G2TDhNHiisaTA5vVCc7uSJkNIl1DRfpExf4Epv3zTbWiS7_6XIphZv_t79YIARrK49OstUmY_vQS2R7v8kRQUjzgLhU_o Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: f19a46371fa24b97a607ceec2d96fb70 Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:04:36.825507 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:04:36.826797 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f19a46371fa24b97a607ceec2d96fb70", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:36.826797 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:36.826797 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: f19a46371fa24b97a607ceec2d96fb70 Oct 29 01:04:36.826797 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:36.826797 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-HostsAdminNegativeTestJSON-1269563830-project-admin Oct 29 01:04:36.826797 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:36.826797 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:36.826797 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 998ba7162adf41d8bba07636f7a62764 Oct 29 01:04:36.826797 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1269563830-project-admin Oct 29 01:04:36.826797 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:04:36.826797 n-d-862964-3 devstack@n-api.service[121100]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:36.826797 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'nonexistent_hostname'} Oct 29 01:04:36.826797 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:36.827505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:36.827505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 29 01:04:36.827505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 29 01:04:36.827505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 01:04:36.827505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 01:04:36.827505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:36.827505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:36.827505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:36.827505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:36.827505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 01:04:36.827505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 01:04:36.827505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 29 01:04:36.827505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 29 01:04:36.827505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:04:36.827505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:04:36.827505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 01:04:36.827505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 01:04:36.827505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:04:36.827505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:04:36.828529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 01:04:36.828529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 01:04:36.828529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:36.828529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.828529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:36.828529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.828529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:36.828529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:36.828529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:36.828529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:36.828529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:36.828529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:04:36.828529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:04:36.828529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:36.828529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:36.828529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 29 01:04:36.828529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 29 01:04:36.828529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 29 01:04:36.828529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:04:36.829909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:36.829909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.829909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:36.829909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.829909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:36.829909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:36.829909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:36.829909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:36.829909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:36.829909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:36.829909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:36.829909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0f921071-f4d0-4561-98e5-ae204f69a014 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:36.829909 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0f921071-f4d0-4561-98e5-ae204f69a014 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.022249 Oct 29 01:04:36.832117 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 106/209] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 29 01:04:36 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:04:36.838550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1a1b63bd-91f9-469f-859b-aa1f4b752dd2 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:36.857684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1a1b63bd-91f9-469f-859b-aa1f4b752dd2 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:36.864938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a1b63bd-91f9-469f-859b-aa1f4b752dd2 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:36.865694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a1b63bd-91f9-469f-859b-aa1f4b752dd2 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:36.868177 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a1b63bd-91f9-469f-859b-aa1f4b752dd2 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:36.869063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a1b63bd-91f9-469f-859b-aa1f4b752dd2 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:36.871404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a1b63bd-91f9-469f-859b-aa1f4b752dd2 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:36.874145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a1b63bd-91f9-469f-859b-aa1f4b752dd2 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:37.073676 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1a1b63bd-91f9-469f-859b-aa1f4b752dd2 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:37.091472 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1a1b63bd-91f9-469f-859b-aa1f4b752dd2 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1337 microversion: 2.1 time: 0.256584 Oct 29 01:04:37.092549 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 107/210] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:36 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1337 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:37.099825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-27a95b8a-ea2b-4c6f-ae78-2aa7f9a0d935 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:37.100469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-27a95b8a-ea2b-4c6f-ae78-2aa7f9a0d935 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:37.117562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-26b8d86b-67cf-4d2b-accd-d73167109435 tempest-FlavorsAccessNegativeTestJSON-2147063843 tempest-FlavorsAccessNegativeTestJSON-2147063843-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "998862b2874247179be55d2f10b15dc4"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:37.120940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-26b8d86b-67cf-4d2b-accd-d73167109435 tempest-FlavorsAccessNegativeTestJSON-2147063843 tempest-FlavorsAccessNegativeTestJSON-2147063843-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'ff63c67cc1d547e09a513d86d017d9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998862b2874247179be55d2f10b15dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-26b8d86b-67cf-4d2b-accd-d73167109435 tempest-FlavorsAccessNegativeTestJSON-2147063843 tempest-FlavorsAccessNegativeTestJSON-2147063843-project] Request method failure captured: Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/flavors/1101916627/action HTTP/1.1 Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 67 Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwaE2TRmi8LubuNT8QrO-8iAXXPy69JL2BXyAdiZTkU4rUnW66j0tlOt9KB-JFjECEu-B5T0J4irgyFI66jxf0EH8cYvB7Oe0SPd8tInkrZQ5k5e-HFD0eRe9knaP9S_lrXY2iU0K54Kht5KP54-zbT8_rjA-udyKxordHh9SdhX_k Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 998862b2874247179be55d2f10b15dc4 Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2147063843 Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:04:37.123683 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:04:37.125059 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/998862b2874247179be55d2f10b15dc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/998862b2874247179be55d2f10b15dc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/998862b2874247179be55d2f10b15dc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_998862b2874247179be55d2f10b15dc4", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:37.125059 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2147063843 Oct 29 01:04:37.125059 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 998862b2874247179be55d2f10b15dc4 Oct 29 01:04:37.125059 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2147063843 Oct 29 01:04:37.125059 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-FlavorsAccessNegativeTestJSON-2147063843-project Oct 29 01:04:37.125059 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:37.125059 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:37.125059 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: ff63c67cc1d547e09a513d86d017d9fd Oct 29 01:04:37.125059 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2147063843-project Oct 29 01:04:37.125059 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:04:37.125059 n-d-862964-3 devstack@n-api.service[121099]: {"addTenantAccess": {"tenant": "998862b2874247179be55d2f10b15dc4"}} Oct 29 01:04:37.125059 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:04:37.125836 n-d-862964-3 devstack@n-api.service[121099]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 29 01:04:37.125836 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '1101916627', 'body': {'addTenantAccess': {'tenant': '998862b2874247179be55d2f10b15dc4'}}} Oct 29 01:04:37.125836 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:37.125836 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.125836 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:37.125836 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:37.125836 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:37.125836 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:37.125836 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:37.125836 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:37.125836 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:37.125836 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:37.125836 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 29 01:04:37.125836 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 29 01:04:37.125836 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:04:37.125836 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:04:37.125836 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:04:37.125836 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:04:37.125836 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 29 01:04:37.126890 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.128008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-26b8d86b-67cf-4d2b-accd-d73167109435 tempest-FlavorsAccessNegativeTestJSON-2147063843 tempest-FlavorsAccessNegativeTestJSON-2147063843-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:37.131941 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-26b8d86b-67cf-4d2b-accd-d73167109435 tempest-FlavorsAccessNegativeTestJSON-2147063843 tempest-FlavorsAccessNegativeTestJSON-2147063843-project] 10.222.0.26 "POST /compute/v2.1/flavors/1101916627/action" status: 403 len: 130 microversion: 2.1 time: 0.376734 Oct 29 01:04:37.135699 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 104/211] 10.222.0.26 () {60 vars in 1200 bytes} [Sat Oct 29 01:04:36 2022] POST /compute/v2.1/flavors/1101916627/action => generated 130 bytes in 381 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:04:37.140037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f8d6877d-73d1-43b0-b717-f2e1617dc410 tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Calling method '.version_select at 0x7f9d9dea04c0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:37.147624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f8d6877d-73d1-43b0-b717-f2e1617dc410 tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'c6717061cfd54346b457aafab306fbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14576b15796b49459fbbcbd2c24646e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f8d6877d-73d1-43b0-b717-f2e1617dc410 tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Request method failure captured: Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-hosts/n-d-862964-3/startup HTTP/1.1 Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwgI4PnoVDB79Hk1PZaH8o6ATEwQGpuDC58wJmMDXMwdhsoM7a4GVctez7dXgJMCO4ZhukaSjr95zGQ4kqDyjd6Em6ldfAfgjwraPwhUtyv-7tImdYrF9O183uDHwQGotI0n3DqYCI5eMzX2lqzvAfYOwGZa98B23lgEyOatYHZHKs Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 14576b15796b49459fbbcbd2c24646e8 Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1566482778 Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:04:37.149205 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:04:37.150430 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14576b15796b49459fbbcbd2c24646e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/14576b15796b49459fbbcbd2c24646e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14576b15796b49459fbbcbd2c24646e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_14576b15796b49459fbbcbd2c24646e8", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:37.150430 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1566482778 Oct 29 01:04:37.150430 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 14576b15796b49459fbbcbd2c24646e8 Oct 29 01:04:37.150430 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1566482778 Oct 29 01:04:37.150430 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-HostsAdminNegativeTestJSON-1566482778-project Oct 29 01:04:37.150430 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:37.150430 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:37.150430 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: c6717061cfd54346b457aafab306fbd9 Oct 29 01:04:37.150430 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1566482778-project Oct 29 01:04:37.150430 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:04:37.150430 n-d-862964-3 devstack@n-api.service[121099]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 29 01:04:37.150430 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'n-d-862964-3'} Oct 29 01:04:37.150430 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:37.151133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.151133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:37.151133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:37.151133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:37.151133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:37.151133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:04:37.151133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:04:37.151133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:37.151133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:37.151133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 29 01:04:37.151133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 29 01:04:37.151133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:04:37.151133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:04:37.151133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:04:37.151133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:04:37.151133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:37.151133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:37.151133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:37.151133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:37.153692 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:04:37.153692 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:04:37.153692 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:04:37.153692 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:04:37.153692 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:04:37.153692 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:04:37.153692 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 29 01:04:37.153692 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.153692 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:37.153692 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.153692 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.153692 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:37.153692 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:37.153692 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:04:37.153692 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:04:37.153692 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 29 01:04:37.153692 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.154636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f8d6877d-73d1-43b0-b717-f2e1617dc410 tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:37.154636 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f8d6877d-73d1-43b0-b717-f2e1617dc410 tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-d-862964-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.016715 Oct 29 01:04:37.154636 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 105/212] 10.222.0.26 () {58 vars in 1191 bytes} [Sat Oct 29 01:04:37 2022] GET /compute/v2.1/os-hosts/n-d-862964-3/startup => generated 110 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:04:37.222841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-65fcf23f-ec81-45bf-8c2b-a231d0bb2b54 tempest-HypervisorAdminV228Test-60332550 tempest-HypervisorAdminV228Test-60332550-project-admin] Calling method '.version_select at 0x7f9d9c604dc0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:37.224167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-27a95b8a-ea2b-4c6f-ae78-2aa7f9a0d935 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:37.224928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65fcf23f-ec81-45bf-8c2b-a231d0bb2b54 tempest-HypervisorAdminV228Test-60332550 tempest-HypervisorAdminV228Test-60332550-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:37.225659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65fcf23f-ec81-45bf-8c2b-a231d0bb2b54 tempest-HypervisorAdminV228Test-60332550 tempest-HypervisorAdminV228Test-60332550-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:37.226237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65fcf23f-ec81-45bf-8c2b-a231d0bb2b54 tempest-HypervisorAdminV228Test-60332550 tempest-HypervisorAdminV228Test-60332550-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:37.233491 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-27a95b8a-ea2b-4c6f-ae78-2aa7f9a0d935 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1217 microversion: 2.1 time: 0.139499 Oct 29 01:04:37.245523 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 108/213] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:37 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1217 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:37.245712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65fcf23f-ec81-45bf-8c2b-a231d0bb2b54 tempest-HypervisorAdminV228Test-60332550 tempest-HypervisorAdminV228Test-60332550-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:37.245712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65fcf23f-ec81-45bf-8c2b-a231d0bb2b54 tempest-HypervisorAdminV228Test-60332550 tempest-HypervisorAdminV228Test-60332550-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:37.245712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65fcf23f-ec81-45bf-8c2b-a231d0bb2b54 tempest-HypervisorAdminV228Test-60332550 tempest-HypervisorAdminV228Test-60332550-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:37.251670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f2850629-f82b-45f4-b80e-a79aeed28a08 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:37.254169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65fcf23f-ec81-45bf-8c2b-a231d0bb2b54 tempest-HypervisorAdminV228Test-60332550 tempest-HypervisorAdminV228Test-60332550-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:37.255475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65fcf23f-ec81-45bf-8c2b-a231d0bb2b54 tempest-HypervisorAdminV228Test-60332550 tempest-HypervisorAdminV228Test-60332550-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:37.256033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65fcf23f-ec81-45bf-8c2b-a231d0bb2b54 tempest-HypervisorAdminV228Test-60332550 tempest-HypervisorAdminV228Test-60332550-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:37.262717 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-65fcf23f-ec81-45bf-8c2b-a231d0bb2b54 tempest-HypervisorAdminV228Test-60332550 tempest-HypervisorAdminV228Test-60332550-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.110686 Oct 29 01:04:37.263736 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 106/214] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Oct 29 01:04:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:04:37.268664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-71138beb-f395-4bc4-a19e-9265b4a84ae6 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Calling method '.version_select at 0x7f9d9c604160>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:37.279359 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-71138beb-f395-4bc4-a19e-9265b4a84ae6 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-71138beb-f395-4bc4-a19e-9265b4a84ae6 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Request method failure captured: Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwilvRwYV_DGUAWU1FEEaVQ9DuJgcSByIxrhr-laDn3alhTgLAOpKsmVmnU42jgJ9zT4MTRaJI93Lh6S6G2TDhNHiisaTA5vVCc7uSJkNIl1DRfpExf4Epv3zTbWiS7_6XIphZv_t79YIARrK49OstUmY_vQS2R7v8kRQUjzgLhU_o Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f19a46371fa24b97a607ceec2d96fb70 Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:04:37.281128 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:04:37.282622 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f19a46371fa24b97a607ceec2d96fb70", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:37.282622 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:37.282622 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f19a46371fa24b97a607ceec2d96fb70 Oct 29 01:04:37.282622 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:37.282622 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-HostsAdminNegativeTestJSON-1269563830-project-admin Oct 29 01:04:37.282622 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:37.282622 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:37.282622 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 998ba7162adf41d8bba07636f7a62764 Oct 29 01:04:37.282622 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1269563830-project-admin Oct 29 01:04:37.282622 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:04:37.282622 n-d-862964-3 devstack@n-api.service[121099]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:37.282622 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'nonexistent_hostname'} Oct 29 01:04:37.282622 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:37.283475 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.283475 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 29 01:04:37.283475 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 29 01:04:37.283475 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 01:04:37.283475 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 01:04:37.283475 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:37.283475 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:37.283475 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:37.283475 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:37.283475 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 01:04:37.283475 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 01:04:37.283475 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 29 01:04:37.283475 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 29 01:04:37.283475 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:04:37.283475 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:04:37.283475 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 01:04:37.283475 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 01:04:37.283475 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:04:37.283475 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:04:37.284936 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 01:04:37.284936 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 01:04:37.284936 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:37.284936 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.284936 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:37.284936 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.284936 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.284936 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:37.284936 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:37.284936 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:37.284936 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:37.284936 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:04:37.284936 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:04:37.284936 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:37.284936 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:37.284936 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 29 01:04:37.284936 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 29 01:04:37.284936 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 29 01:04:37.284936 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:04:37.291249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:37.291249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.291249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:37.291249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.291249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.291249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:37.291249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:37.291249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:37.291249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:37.291249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:37.291249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.291249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-71138beb-f395-4bc4-a19e-9265b4a84ae6 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:37.291249 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-71138beb-f395-4bc4-a19e-9265b4a84ae6 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.020433 Oct 29 01:04:37.291249 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 107/215] 10.222.0.26 () {58 vars in 1215 bytes} [Sat Oct 29 01:04:37 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:04:37.299325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-31f22d75-7f15-4046-a224-8d8596a8dd93 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:37.300034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-31f22d75-7f15-4046-a224-8d8596a8dd93 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:37.308148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31f22d75-7f15-4046-a224-8d8596a8dd93 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:37.308632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31f22d75-7f15-4046-a224-8d8596a8dd93 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:37.309063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31f22d75-7f15-4046-a224-8d8596a8dd93 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:37.309795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31f22d75-7f15-4046-a224-8d8596a8dd93 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:37.310278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31f22d75-7f15-4046-a224-8d8596a8dd93 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:37.310700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31f22d75-7f15-4046-a224-8d8596a8dd93 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:37.380233 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f2850629-f82b-45f4-b80e-a79aeed28a08 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1101916627" status: 202 len: 0 microversion: 2.1 time: 0.144824 Oct 29 01:04:37.381010 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 109/216] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 29 01:04:37 2022] DELETE /compute/v2.1/flavors/1101916627 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:04:37.387698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-84e9cfc8-09ba-45f0-ac42-30c8544f3a98 tempest-HypervisorAdminV228Test-60332550 tempest-HypervisorAdminV228Test-60332550-project-admin] Calling method '.version_select at 0x7f9d9c963ca0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:37.389740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84e9cfc8-09ba-45f0-ac42-30c8544f3a98 tempest-HypervisorAdminV228Test-60332550 tempest-HypervisorAdminV228Test-60332550-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:37.390334 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84e9cfc8-09ba-45f0-ac42-30c8544f3a98 tempest-HypervisorAdminV228Test-60332550 tempest-HypervisorAdminV228Test-60332550-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:37.390939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84e9cfc8-09ba-45f0-ac42-30c8544f3a98 tempest-HypervisorAdminV228Test-60332550 tempest-HypervisorAdminV228Test-60332550-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:37.414668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84e9cfc8-09ba-45f0-ac42-30c8544f3a98 tempest-HypervisorAdminV228Test-60332550 tempest-HypervisorAdminV228Test-60332550-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:37.415303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84e9cfc8-09ba-45f0-ac42-30c8544f3a98 tempest-HypervisorAdminV228Test-60332550 tempest-HypervisorAdminV228Test-60332550-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:37.415933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84e9cfc8-09ba-45f0-ac42-30c8544f3a98 tempest-HypervisorAdminV228Test-60332550 tempest-HypervisorAdminV228Test-60332550-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:37.425779 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-84e9cfc8-09ba-45f0-ac42-30c8544f3a98 tempest-HypervisorAdminV228Test-60332550 tempest-HypervisorAdminV228Test-60332550-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.043444 Oct 29 01:04:37.427042 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 110/217] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 29 01:04:37 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:04:37.431793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c56d4def-19a8-43ff-ae7b-9b6dbb0ddd62 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Action: 'update', calling method: .version_select at 0x7f9d9d47d940>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c56d4def-19a8-43ff-ae7b-9b6dbb0ddd62 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Request method failure captured: Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: request: PUT /compute/v2.1/os-hosts/n-d-862964-3 HTTP/1.1 Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 51 Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHwilvRwYV_DGUAWU1FEEaVQ9DuJgcSByIxrhr-laDn3alhTgLAOpKsmVmnU42jgJ9zT4MTRaJI93Lh6S6G2TDhNHiisaTA5vVCc7uSJkNIl1DRfpExf4Epv3zTbWiS7_6XIphZv_t79YIARrK49OstUmY_vQS2R7v8kRQUjzgLhU_o Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: f19a46371fa24b97a607ceec2d96fb70 Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:04:37.439176 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:04:37.440348 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f19a46371fa24b97a607ceec2d96fb70", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:37.440348 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:37.440348 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: f19a46371fa24b97a607ceec2d96fb70 Oct 29 01:04:37.440348 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:37.440348 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-HostsAdminNegativeTestJSON-1269563830-project-admin Oct 29 01:04:37.440348 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:37.440348 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:37.440348 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 998ba7162adf41d8bba07636f7a62764 Oct 29 01:04:37.440348 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1269563830-project-admin Oct 29 01:04:37.440348 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:04:37.440348 n-d-862964-3 devstack@n-api.service[121100]: {"status": "enable", "maintenance_mode": "invalid"} Oct 29 01:04:37.440348 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:04:37.440348 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'n-d-862964-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'disable', Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'Enable', Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'Disable', Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance: Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'invalid' Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.441625 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:37.444161 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:37.444161 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:37.444161 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:37.444161 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:04:37.444161 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:04:37.444161 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:37.444161 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:37.444161 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:04:37.444161 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:04:37.444161 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:04:37.444161 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:04:37.444161 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:04:37.444161 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:04:37.444161 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 01:04:37.444161 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.444161 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:37.444161 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.444161 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.444161 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:37.445428 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:37.445428 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:04:37.445428 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:04:37.445428 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 01:04:37.445428 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.451808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c56d4def-19a8-43ff-ae7b-9b6dbb0ddd62 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:37.451808 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c56d4def-19a8-43ff-ae7b-9b6dbb0ddd62 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/n-d-862964-3" status: 400 len: 199 microversion: 2.1 time: 0.020202 Oct 29 01:04:37.451808 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 111/218] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Oct 29 01:04:37 2022] PUT /compute/v2.1/os-hosts/n-d-862964-3 => generated 199 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:04:37.457336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-26fe9b9f-7b0c-44e2-9d41-87873cc3f04b tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:37.482820 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-26fe9b9f-7b0c-44e2-9d41-87873cc3f04b tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.032359 Oct 29 01:04:37.483687 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 112/219] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:37 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:37.504620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a29be2ec-ef03-4d52-bc15-8ecc3e42ce66 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Action: 'update', calling method: .version_select at 0x7f9d9db7c9d0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a29be2ec-ef03-4d52-bc15-8ecc3e42ce66 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Request method failure captured: Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: request: PUT /compute/v2.1/os-hosts/n-d-862964-3 HTTP/1.1 Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 51 Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHwilvRwYV_DGUAWU1FEEaVQ9DuJgcSByIxrhr-laDn3alhTgLAOpKsmVmnU42jgJ9zT4MTRaJI93Lh6S6G2TDhNHiisaTA5vVCc7uSJkNIl1DRfpExf4Epv3zTbWiS7_6XIphZv_t79YIARrK49OstUmY_vQS2R7v8kRQUjzgLhU_o Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: f19a46371fa24b97a607ceec2d96fb70 Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:04:37.508400 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:04:37.510443 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f19a46371fa24b97a607ceec2d96fb70", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:37.510443 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:37.510443 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: f19a46371fa24b97a607ceec2d96fb70 Oct 29 01:04:37.510443 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:37.510443 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-HostsAdminNegativeTestJSON-1269563830-project-admin Oct 29 01:04:37.510443 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:37.510443 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:37.510443 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 998ba7162adf41d8bba07636f7a62764 Oct 29 01:04:37.510443 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1269563830-project-admin Oct 29 01:04:37.510443 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:04:37.510443 n-d-862964-3 devstack@n-api.service[121100]: {"status": "invalid", "maintenance_mode": "enable"} Oct 29 01:04:37.510443 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:04:37.510443 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'n-d-862964-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'disable', Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'Enable', Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'Disable', Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance: Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'invalid' Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.511265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:37.512556 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:37.512556 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:37.512556 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:37.512556 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:04:37.512556 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:04:37.512556 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:37.512556 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:37.512556 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:04:37.512556 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:04:37.512556 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:04:37.512556 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:04:37.512556 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:04:37.512556 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:04:37.512556 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 01:04:37.512556 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.512556 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:37.512556 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.512556 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.512556 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:37.514753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:37.514753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:04:37.514753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:04:37.514753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 01:04:37.514753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.514753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a29be2ec-ef03-4d52-bc15-8ecc3e42ce66 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:37.514753 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a29be2ec-ef03-4d52-bc15-8ecc3e42ce66 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/n-d-862964-3" status: 400 len: 189 microversion: 2.1 time: 0.023632 Oct 29 01:04:37.514753 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 113/220] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Oct 29 01:04:37 2022] PUT /compute/v2.1/os-hosts/n-d-862964-3 => generated 189 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:04:37.518832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2ab5c0b8-7fd9-4f17-903a-8d7065604f00 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-146780396", "id": 474934963, "os-flavor-access:is_public": "False"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:37.566393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-31f22d75-7f15-4046-a224-8d8596a8dd93 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:37.579276 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-31f22d75-7f15-4046-a224-8d8596a8dd93 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1388 microversion: 2.1 time: 0.286164 Oct 29 01:04:37.580368 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 108/221] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:37 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1388 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:37.588296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d1d78db6-77b9-4302-ad48-c2b60c2809ea tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Action: 'update', calling method: .version_select at 0x7f9d9c6f61f0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:37.593084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d1d78db6-77b9-4302-ad48-c2b60c2809ea tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'c6717061cfd54346b457aafab306fbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14576b15796b49459fbbcbd2c24646e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d1d78db6-77b9-4302-ad48-c2b60c2809ea tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Request method failure captured: Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: request: PUT /compute/v2.1/os-hosts/n-d-862964-3 HTTP/1.1 Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 50 Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwgI4PnoVDB79Hk1PZaH8o6ATEwQGpuDC58wJmMDXMwdhsoM7a4GVctez7dXgJMCO4ZhukaSjr95zGQ4kqDyjd6Em6ldfAfgjwraPwhUtyv-7tImdYrF9O183uDHwQGotI0n3DqYCI5eMzX2lqzvAfYOwGZa98B23lgEyOatYHZHKs Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 14576b15796b49459fbbcbd2c24646e8 Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1566482778 Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:04:37.594979 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:04:37.596195 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14576b15796b49459fbbcbd2c24646e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/14576b15796b49459fbbcbd2c24646e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14576b15796b49459fbbcbd2c24646e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_14576b15796b49459fbbcbd2c24646e8", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:37.596195 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1566482778 Oct 29 01:04:37.596195 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 14576b15796b49459fbbcbd2c24646e8 Oct 29 01:04:37.596195 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1566482778 Oct 29 01:04:37.596195 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-HostsAdminNegativeTestJSON-1566482778-project Oct 29 01:04:37.596195 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:37.596195 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:37.596195 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: c6717061cfd54346b457aafab306fbd9 Oct 29 01:04:37.596195 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1566482778-project Oct 29 01:04:37.596195 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:04:37.596195 n-d-862964-3 devstack@n-api.service[121099]: {"status": "enable", "maintenance_mode": "enable"} Oct 29 01:04:37.596195 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:04:37.596195 n-d-862964-3 devstack@n-api.service[121099]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 29 01:04:37.596195 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'n-d-862964-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:37.596983 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:37.598394 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:37.598394 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:37.598394 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:04:37.598394 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:04:37.598394 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:04:37.598394 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:04:37.598394 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:04:37.598394 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:04:37.598394 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 29 01:04:37.598394 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.598394 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:37.598394 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.598394 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.598394 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:37.598394 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:37.598394 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:04:37.598394 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:04:37.598394 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 29 01:04:37.598394 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.600841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d1d78db6-77b9-4302-ad48-c2b60c2809ea tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:37.601941 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d1d78db6-77b9-4302-ad48-c2b60c2809ea tempest-HostsAdminNegativeTestJSON-1566482778 tempest-HostsAdminNegativeTestJSON-1566482778-project] 10.222.0.26 "PUT /compute/v2.1/os-hosts/n-d-862964-3" status: 403 len: 111 microversion: 2.1 time: 0.020574 Oct 29 01:04:37.602453 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2ab5c0b8-7fd9-4f17-903a-8d7065604f00 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.090460 Oct 29 01:04:37.603446 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 114/222] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:37 2022] POST /compute/v2.1/flavors => generated 435 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:37.608205 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 109/223] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Oct 29 01:04:37 2022] PUT /compute/v2.1/os-hosts/n-d-862964-3 => generated 111 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:04:37.616000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1c7e55cd-a368-437e-8568-99a66d9dc8b3 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "998862b2874247179be55d2f10b15dc4"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:37.618197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a97add50-30ee-4ca4-a62a-af3284c9ba04 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Action: 'update', calling method: .version_select at 0x7f9d9db7c9d0>, body: {"status": null, "maintenance_mode": null} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a97add50-30ee-4ca4-a62a-af3284c9ba04 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Request method failure captured: Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: request: PUT /compute/v2.1/os-hosts/n-d-862964-3 HTTP/1.1 Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 42 Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHwilvRwYV_DGUAWU1FEEaVQ9DuJgcSByIxrhr-laDn3alhTgLAOpKsmVmnU42jgJ9zT4MTRaJI93Lh6S6G2TDhNHiisaTA5vVCc7uSJkNIl1DRfpExf4Epv3zTbWiS7_6XIphZv_t79YIARrK49OstUmY_vQS2R7v8kRQUjzgLhU_o Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: f19a46371fa24b97a607ceec2d96fb70 Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:04:37.622048 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:04:37.623338 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f19a46371fa24b97a607ceec2d96fb70", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:37.623338 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:37.623338 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: f19a46371fa24b97a607ceec2d96fb70 Oct 29 01:04:37.623338 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:37.623338 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-HostsAdminNegativeTestJSON-1269563830-project-admin Oct 29 01:04:37.623338 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:37.623338 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:37.623338 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 998ba7162adf41d8bba07636f7a62764 Oct 29 01:04:37.623338 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1269563830-project-admin Oct 29 01:04:37.623338 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:04:37.623338 n-d-862964-3 devstack@n-api.service[121100]: {"status": null, "maintenance_mode": null} Oct 29 01:04:37.623338 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:04:37.623338 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 29 01:04:37.623338 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'n-d-862964-3', 'body': {'status': None, 'maintenance_mode': None}} Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'disable', Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'Enable', Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'Disable', Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance: Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi None Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:37.624393 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:37.626020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:37.626020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:37.626020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:04:37.626020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:04:37.626020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:37.626020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:37.626020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:04:37.626020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:04:37.626020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:04:37.626020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:04:37.626020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:04:37.626020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:04:37.626020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 29 01:04:37.626020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.626020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:37.626020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.626020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.626020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:37.626020 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:37.627375 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:04:37.627375 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:04:37.627375 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 29 01:04:37.627375 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.629117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a97add50-30ee-4ca4-a62a-af3284c9ba04 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:37.639450 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a97add50-30ee-4ca4-a62a-af3284c9ba04 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/n-d-862964-3" status: 400 len: 127 microversion: 2.1 time: 0.021184 Oct 29 01:04:37.639450 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 115/224] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Oct 29 01:04:37 2022] PUT /compute/v2.1/os-hosts/n-d-862964-3 => generated 127 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:04:37.648158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4b471614-7c5e-49f4-a809-101b9e0f5df5 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Action: 'update', calling method: .version_select at 0x7f9d9c858280>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:37.651914 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.hosts [None req-4b471614-7c5e-49f4-a809-101b9e0f5df5 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Enabling host nonexistent_hostname. Oct 29 01:04:37.662732 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-4b471614-7c5e-49f4-a809-101b9e0f5df5 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4b471614-7c5e-49f4-a809-101b9e0f5df5 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Request method failure captured: Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 50 Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHwilvRwYV_DGUAWU1FEEaVQ9DuJgcSByIxrhr-laDn3alhTgLAOpKsmVmnU42jgJ9zT4MTRaJI93Lh6S6G2TDhNHiisaTA5vVCc7uSJkNIl1DRfpExf4Epv3zTbWiS7_6XIphZv_t79YIARrK49OstUmY_vQS2R7v8kRQUjzgLhU_o Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: f19a46371fa24b97a607ceec2d96fb70 Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:04:37.664809 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:04:37.666077 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f19a46371fa24b97a607ceec2d96fb70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f19a46371fa24b97a607ceec2d96fb70", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:37.666077 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:37.666077 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: f19a46371fa24b97a607ceec2d96fb70 Oct 29 01:04:37.666077 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1269563830 Oct 29 01:04:37.666077 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-HostsAdminNegativeTestJSON-1269563830-project-admin Oct 29 01:04:37.666077 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:37.666077 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:37.666077 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 998ba7162adf41d8bba07636f7a62764 Oct 29 01:04:37.666077 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1269563830-project-admin Oct 29 01:04:37.666077 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:04:37.666077 n-d-862964-3 devstack@n-api.service[121100]: {"status": "enable", "maintenance_mode": "enable"} Oct 29 01:04:37.666077 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:04:37.666077 n-d-862964-3 devstack@n-api.service[121100]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:37.666077 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 29 01:04:37.666835 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:37.666835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.666835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 29 01:04:37.666835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 29 01:04:37.666835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 01:04:37.666835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 01:04:37.666835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:37.666835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:37.666835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:37.666835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:37.666835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 01:04:37.666835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 01:04:37.666835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 29 01:04:37.666835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 29 01:04:37.666835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:04:37.666835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:04:37.666835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 01:04:37.666835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:37.667774 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 29 01:04:37.669413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 29 01:04:37.669413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 29 01:04:37.669413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:04:37.669413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:37.669413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.669413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:37.669413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.669413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.669413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:37.669413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:37.669413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:37.669413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:37.669413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 01:04:37.669413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.670973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4b471614-7c5e-49f4-a809-101b9e0f5df5 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:37.671934 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4b471614-7c5e-49f4-a809-101b9e0f5df5 tempest-HostsAdminNegativeTestJSON-1269563830 tempest-HostsAdminNegativeTestJSON-1269563830-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.028594 Oct 29 01:04:37.677626 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 116/225] 10.222.0.26 () {60 vars in 1211 bytes} [Sat Oct 29 01:04:37 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:04:37.933674 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1c7e55cd-a368-437e-8568-99a66d9dc8b3 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/474934963/action" status: 200 len: 96 microversion: 2.1 time: 0.322150 Oct 29 01:04:37.934485 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 110/226] 10.222.0.26 () {60 vars in 1197 bytes} [Sat Oct 29 01:04:37 2022] POST /compute/v2.1/flavors/474934963/action => generated 96 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:04:37.948120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2e54d9be-fc95-4acd-b576-5008e3fe35af tempest-FlavorsAccessNegativeTestJSON-2147063843 tempest-FlavorsAccessNegativeTestJSON-2147063843-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "998862b2874247179be55d2f10b15dc4"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:37.952669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2e54d9be-fc95-4acd-b576-5008e3fe35af tempest-FlavorsAccessNegativeTestJSON-2147063843 tempest-FlavorsAccessNegativeTestJSON-2147063843-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'ff63c67cc1d547e09a513d86d017d9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998862b2874247179be55d2f10b15dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2e54d9be-fc95-4acd-b576-5008e3fe35af tempest-FlavorsAccessNegativeTestJSON-2147063843 tempest-FlavorsAccessNegativeTestJSON-2147063843-project] Request method failure captured: Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/flavors/474934963/action HTTP/1.1 Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 70 Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHwaE2TRmi8LubuNT8QrO-8iAXXPy69JL2BXyAdiZTkU4rUnW66j0tlOt9KB-JFjECEu-B5T0J4irgyFI66jxf0EH8cYvB7Oe0SPd8tInkrZQ5k5e-HFD0eRe9knaP9S_lrXY2iU0K54Kht5KP54-zbT8_rjA-udyKxordHh9SdhX_k Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 998862b2874247179be55d2f10b15dc4 Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2147063843 Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:04:37.955051 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:04:37.956548 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/998862b2874247179be55d2f10b15dc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/998862b2874247179be55d2f10b15dc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/998862b2874247179be55d2f10b15dc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_998862b2874247179be55d2f10b15dc4", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:37.956548 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2147063843 Oct 29 01:04:37.956548 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 998862b2874247179be55d2f10b15dc4 Oct 29 01:04:37.956548 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2147063843 Oct 29 01:04:37.956548 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FlavorsAccessNegativeTestJSON-2147063843-project Oct 29 01:04:37.956548 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:37.956548 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:37.956548 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: ff63c67cc1d547e09a513d86d017d9fd Oct 29 01:04:37.956548 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2147063843-project Oct 29 01:04:37.956548 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:04:37.956548 n-d-862964-3 devstack@n-api.service[121100]: {"removeTenantAccess": {"tenant": "998862b2874247179be55d2f10b15dc4"}} Oct 29 01:04:37.956548 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '474934963', 'body': {'removeTenantAccess': {'tenant': '998862b2874247179be55d2f10b15dc4'}}} Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi context.can( Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:37.958255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:37.962348 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:37.962348 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:37.962348 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:04:37.962348 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:04:37.962348 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:04:37.962348 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:04:37.962348 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:04:37.962348 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:04:37.962348 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 29 01:04:37.962348 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.962348 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:37.962348 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.962348 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:37.962348 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:37.962348 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:37.962348 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:04:37.962348 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:04:37.962348 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 29 01:04:37.962348 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:37.970941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2e54d9be-fc95-4acd-b576-5008e3fe35af tempest-FlavorsAccessNegativeTestJSON-2147063843 tempest-FlavorsAccessNegativeTestJSON-2147063843-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:37.970941 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2e54d9be-fc95-4acd-b576-5008e3fe35af tempest-FlavorsAccessNegativeTestJSON-2147063843 tempest-FlavorsAccessNegativeTestJSON-2147063843-project] 10.222.0.26 "POST /compute/v2.1/flavors/474934963/action" status: 403 len: 133 microversion: 2.1 time: 0.016735 Oct 29 01:04:37.970941 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 117/227] 10.222.0.26 () {60 vars in 1197 bytes} [Sat Oct 29 01:04:37 2022] POST /compute/v2.1/flavors/474934963/action => generated 133 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:04:37.974246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-08cd7b90-3a98-4e7f-8a5d-a4f032fcdb03 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "998862b2874247179be55d2f10b15dc4"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:38.118412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ac0c1f26-d3a6-4ce4-ab5f-f2e7ad6616c0 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:38.119225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ac0c1f26-d3a6-4ce4-ab5f-f2e7ad6616c0 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:38.131299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac0c1f26-d3a6-4ce4-ab5f-f2e7ad6616c0 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:38.132576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac0c1f26-d3a6-4ce4-ab5f-f2e7ad6616c0 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:38.133147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac0c1f26-d3a6-4ce4-ab5f-f2e7ad6616c0 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:38.134587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac0c1f26-d3a6-4ce4-ab5f-f2e7ad6616c0 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:38.135875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac0c1f26-d3a6-4ce4-ab5f-f2e7ad6616c0 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:38.136743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac0c1f26-d3a6-4ce4-ab5f-f2e7ad6616c0 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:38.511285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ac0c1f26-d3a6-4ce4-ab5f-f2e7ad6616c0 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:38.518019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:38.544078 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ac0c1f26-d3a6-4ce4-ab5f-f2e7ad6616c0 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1487 microversion: 2.1 time: 0.429440 Oct 29 01:04:38.548476 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 118/228] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:38 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1487 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:38.554192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-626f3fca-c150-444a-9443-6df3ce07257e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:38.555090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-626f3fca-c150-444a-9443-6df3ce07257e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:38.561974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-626f3fca-c150-444a-9443-6df3ce07257e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:38.563005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-626f3fca-c150-444a-9443-6df3ce07257e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:38.563602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-626f3fca-c150-444a-9443-6df3ce07257e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:38.564608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-626f3fca-c150-444a-9443-6df3ce07257e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:38.565984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-626f3fca-c150-444a-9443-6df3ce07257e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:38.567672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-626f3fca-c150-444a-9443-6df3ce07257e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:38.664857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-626f3fca-c150-444a-9443-6df3ce07257e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:38.672898 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-626f3fca-c150-444a-9443-6df3ce07257e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1221 microversion: 2.1 time: 0.123369 Oct 29 01:04:38.673576 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 119/229] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:38 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1221 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:38.680029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cc1ae6f4-300d-42e6-8322-4d69f2cb36ea tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:38.680900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cc1ae6f4-300d-42e6-8322-4d69f2cb36ea tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:38.687453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc1ae6f4-300d-42e6-8322-4d69f2cb36ea tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:38.688876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc1ae6f4-300d-42e6-8322-4d69f2cb36ea tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:38.689456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc1ae6f4-300d-42e6-8322-4d69f2cb36ea tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:38.690215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc1ae6f4-300d-42e6-8322-4d69f2cb36ea tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:38.690676 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc1ae6f4-300d-42e6-8322-4d69f2cb36ea tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:38.691101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc1ae6f4-300d-42e6-8322-4d69f2cb36ea tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:38.728044 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-08cd7b90-3a98-4e7f-8a5d-a4f032fcdb03 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/474934963/action" status: 200 len: 21 microversion: 2.1 time: 0.758697 Oct 29 01:04:38.728644 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 111/230] 10.222.0.26 () {60 vars in 1197 bytes} [Sat Oct 29 01:04:37 2022] POST /compute/v2.1/flavors/474934963/action => generated 21 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:04:38.735892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3f958755-9a69-4de2-9233-ff743e66b635 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:38.736769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3f958755-9a69-4de2-9233-ff743e66b635 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:38.745990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f958755-9a69-4de2-9233-ff743e66b635 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:38.746471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f958755-9a69-4de2-9233-ff743e66b635 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:38.746899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f958755-9a69-4de2-9233-ff743e66b635 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:38.747971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f958755-9a69-4de2-9233-ff743e66b635 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:38.748486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f958755-9a69-4de2-9233-ff743e66b635 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:38.748982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f958755-9a69-4de2-9233-ff743e66b635 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:39.373516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3f958755-9a69-4de2-9233-ff743e66b635 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:39.387307 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3f958755-9a69-4de2-9233-ff743e66b635 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1388 microversion: 2.1 time: 0.655838 Oct 29 01:04:39.401184 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 112/231] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:38 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1388 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:39.401184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-db474c49-87ff-4ab6-86d0-f77c6ca1dd32 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:39.514639 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-db474c49-87ff-4ab6-86d0-f77c6ca1dd32 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/474934963" status: 202 len: 0 microversion: 2.1 time: 0.117813 Oct 29 01:04:39.514639 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 113/232] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 29 01:04:39 2022] DELETE /compute/v2.1/flavors/474934963 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:04:39.538726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3eb9bde6-5773-4c96-998a-3d50cf90f070 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:39.615997 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3eb9bde6-5773-4c96-998a-3d50cf90f070 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.086468 Oct 29 01:04:39.630007 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 114/233] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:39 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:39.638928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ddc95f1f-9d6e-4f1d-b656-697deb309cb4 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-416366323", "id": 863070045, "os-flavor-access:is_public": "False"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:39.774337 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ddc95f1f-9d6e-4f1d-b656-697deb309cb4 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.139290 Oct 29 01:04:39.785522 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 115/234] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:39 2022] POST /compute/v2.1/flavors => generated 435 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:04:39.799235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-73ffb1ca-51c5-488c-91c3-0d0a62cfbdee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:39.801273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-73ffb1ca-51c5-488c-91c3-0d0a62cfbdee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:39.810971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73ffb1ca-51c5-488c-91c3-0d0a62cfbdee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:39.811526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73ffb1ca-51c5-488c-91c3-0d0a62cfbdee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:39.811966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73ffb1ca-51c5-488c-91c3-0d0a62cfbdee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:39.813544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73ffb1ca-51c5-488c-91c3-0d0a62cfbdee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:39.814314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73ffb1ca-51c5-488c-91c3-0d0a62cfbdee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:39.814855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73ffb1ca-51c5-488c-91c3-0d0a62cfbdee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:39.985927 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cc1ae6f4-300d-42e6-8322-4d69f2cb36ea tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1638 microversion: 2.1 time: 1.310531 Oct 29 01:04:39.989083 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 120/235] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:38 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1638 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:40.000640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ab8ebecb-526c-4924-aa7a-f91d1057448e tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "90ec3a3068d74712978c93afd4999caa"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:40.001939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-73ffb1ca-51c5-488c-91c3-0d0a62cfbdee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:40.014648 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-73ffb1ca-51c5-488c-91c3-0d0a62cfbdee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1269 microversion: 2.1 time: 0.234288 Oct 29 01:04:40.016519 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 116/236] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:39 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1269 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:40.033607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f94d409-0c13-4217-9f5b-38c84c6988a3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:40.044596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1f94d409-0c13-4217-9f5b-38c84c6988a3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:40.059168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f94d409-0c13-4217-9f5b-38c84c6988a3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:40.059902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f94d409-0c13-4217-9f5b-38c84c6988a3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:40.060521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f94d409-0c13-4217-9f5b-38c84c6988a3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:40.061461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f94d409-0c13-4217-9f5b-38c84c6988a3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:40.062116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f94d409-0c13-4217-9f5b-38c84c6988a3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:40.062717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f94d409-0c13-4217-9f5b-38c84c6988a3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:40.074323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:40.097532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1f94d409-0c13-4217-9f5b-38c84c6988a3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:04:40.282252 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-ab8ebecb-526c-4924-aa7a-f91d1057448e tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] HTTP exception thrown: Flavor access not found for 37 / 90ec3a3068d74712978c93afd4999caa combination. Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ab8ebecb-526c-4924-aa7a-f91d1057448e tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Request method failure captured: Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/flavors/863070045/action HTTP/1.1 Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 70 Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHwekFNc_yiV2DQrkN2maW6WmiR0f7WOCzYtIRHidQIlJ7m_pLof2zbQk5jbr0qYTmc6iyATL6WPzCrJu5t7ACI1L_gkJXaV_sj8fjpDR4pbBtnE7EV4bZKnhqzz5OzGxTn4auUAQXE2E7Lq4n2SwBEqhQpmqjsf55FVmCXyuDifFUs Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 0c9d7c32a82047418c94c08280059e9a Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1836212034 Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:04:40.294429 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:04:40.296040 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c9d7c32a82047418c94c08280059e9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0c9d7c32a82047418c94c08280059e9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c9d7c32a82047418c94c08280059e9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0c9d7c32a82047418c94c08280059e9a", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:40.296040 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1836212034 Oct 29 01:04:40.296040 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 0c9d7c32a82047418c94c08280059e9a Oct 29 01:04:40.296040 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1836212034 Oct 29 01:04:40.296040 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin Oct 29 01:04:40.296040 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:40.296040 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:40.296040 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 7b3756e7f8f64a0dae22398e6ad63bdc Oct 29 01:04:40.296040 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin Oct 29 01:04:40.296040 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:04:40.296040 n-d-862964-3 devstack@n-api.service[121100]: {"removeTenantAccess": {"tenant": "90ec3a3068d74712978c93afd4999caa"}} Oct 29 01:04:40.296040 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:04:40.296839 n-d-862964-3 devstack@n-api.service[121100]: exception: Flavor access not found for 37 / 90ec3a3068d74712978c93afd4999caa combination. Oct 29 01:04:40.296839 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '863070045', 'body': {'removeTenantAccess': {'tenant': '90ec3a3068d74712978c93afd4999caa'}}} Oct 29 01:04:40.296839 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:40.296839 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:40.296839 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 29 01:04:40.296839 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 29 01:04:40.296839 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 01:04:40.296839 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 01:04:40.296839 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 29 01:04:40.296839 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 29 01:04:40.296839 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 29 01:04:40.296839 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 29 01:04:40.296839 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 29 01:04:40.296839 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 29 01:04:40.296839 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:04:40.296839 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:04:40.296839 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 29 01:04:40.296839 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 37 / 90ec3a3068d74712978c93afd4999caa combination. Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 37 / 90ec3a3068d74712978c93afd4999caa combination. Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:40.298040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:40.299350 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:40.299350 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:40.299350 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:40.299350 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:40.299350 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 37 / 90ec3a3068d74712978c93afd4999caa combination. Oct 29 01:04:40.299350 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:40.300046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ab8ebecb-526c-4924-aa7a-f91d1057448e tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Returning 404 to user: Flavor access not found for 37 / 90ec3a3068d74712978c93afd4999caa combination. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:40.301612 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ab8ebecb-526c-4924-aa7a-f91d1057448e tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/863070045/action" status: 404 len: 124 microversion: 2.1 time: 0.311051 Oct 29 01:04:40.310914 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 121/237] 10.222.0.26 () {60 vars in 1197 bytes} [Sat Oct 29 01:04:39 2022] POST /compute/v2.1/flavors/863070045/action => generated 124 bytes in 318 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:04:40.316294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-183df3b4-54fb-40e8-8cbb-b876417ef605 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:40.438755 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-183df3b4-54fb-40e8-8cbb-b876417ef605 tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/863070045" status: 202 len: 0 microversion: 2.1 time: 0.126400 Oct 29 01:04:40.440471 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 122/238] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 29 01:04:40 2022] DELETE /compute/v2.1/flavors/863070045 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:04:40.478456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-64f2cd01-8199-4314-baaa-653f61afff81 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:40.479749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-64f2cd01-8199-4314-baaa-653f61afff81 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:40.498591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64f2cd01-8199-4314-baaa-653f61afff81 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:40.501298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64f2cd01-8199-4314-baaa-653f61afff81 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:40.503449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64f2cd01-8199-4314-baaa-653f61afff81 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:40.504451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64f2cd01-8199-4314-baaa-653f61afff81 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:40.506019 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1f94d409-0c13-4217-9f5b-38c84c6988a3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 204 len: 0 microversion: 2.1 time: 0.486722 Oct 29 01:04:40.507216 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 117/239] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:04:40 2022] DELETE /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:04:40.507610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64f2cd01-8199-4314-baaa-653f61afff81 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:40.508272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64f2cd01-8199-4314-baaa-653f61afff81 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:40.521532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7534e388-c0ab-4334-83f1-eb013707d8bd tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:40.559822 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7534e388-c0ab-4334-83f1-eb013707d8bd tempest-FlavorsAccessNegativeTestJSON-1836212034 tempest-FlavorsAccessNegativeTestJSON-1836212034-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.051745 Oct 29 01:04:40.561284 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 118/240] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:04:40 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:40.580538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e1816f10-8675-47e0-8872-4014c91e212b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:40.581349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e1816f10-8675-47e0-8872-4014c91e212b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:40.590329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1816f10-8675-47e0-8872-4014c91e212b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:40.591100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1816f10-8675-47e0-8872-4014c91e212b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:40.591548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1816f10-8675-47e0-8872-4014c91e212b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:40.592755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1816f10-8675-47e0-8872-4014c91e212b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:40.594094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1816f10-8675-47e0-8872-4014c91e212b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:40.595462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1816f10-8675-47e0-8872-4014c91e212b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:40.809445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-64f2cd01-8199-4314-baaa-653f61afff81 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:40.820400 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-64f2cd01-8199-4314-baaa-653f61afff81 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1388 microversion: 2.1 time: 0.378402 Oct 29 01:04:40.835003 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 123/241] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:40 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1388 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:40.861891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e1816f10-8675-47e0-8872-4014c91e212b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:40.870112 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e1816f10-8675-47e0-8872-4014c91e212b tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1493 microversion: 2.1 time: 0.307899 Oct 29 01:04:40.871042 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 119/242] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:40 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1493 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:41.039837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5019f065-3b56-45bf-b173-9b766c1eb09c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:41.040472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5019f065-3b56-45bf-b173-9b766c1eb09c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:41.059007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5019f065-3b56-45bf-b173-9b766c1eb09c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:41.060348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5019f065-3b56-45bf-b173-9b766c1eb09c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:41.061214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5019f065-3b56-45bf-b173-9b766c1eb09c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:41.062343 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5019f065-3b56-45bf-b173-9b766c1eb09c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:41.063461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5019f065-3b56-45bf-b173-9b766c1eb09c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:41.064110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5019f065-3b56-45bf-b173-9b766c1eb09c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:41.145602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5019f065-3b56-45bf-b173-9b766c1eb09c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:41.153660 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5019f065-3b56-45bf-b173-9b766c1eb09c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1287 microversion: 2.1 time: 0.118247 Oct 29 01:04:41.154240 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 124/243] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:41 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1287 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:41.851345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6b4215fe-1849-4276-bae5-ed09d53746c0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:41.852184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6b4215fe-1849-4276-bae5-ed09d53746c0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:41.862520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b4215fe-1849-4276-bae5-ed09d53746c0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:41.863155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b4215fe-1849-4276-bae5-ed09d53746c0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:41.863423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b4215fe-1849-4276-bae5-ed09d53746c0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:41.878037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b4215fe-1849-4276-bae5-ed09d53746c0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:41.878537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b4215fe-1849-4276-bae5-ed09d53746c0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:41.879548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b4215fe-1849-4276-bae5-ed09d53746c0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:41.896473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-04b7fae8-f83f-47c9-9c30-2a020abc5ecf tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:41.897552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-04b7fae8-f83f-47c9-9c30-2a020abc5ecf tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:41.909559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04b7fae8-f83f-47c9-9c30-2a020abc5ecf tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:41.912745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04b7fae8-f83f-47c9-9c30-2a020abc5ecf tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:41.913500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04b7fae8-f83f-47c9-9c30-2a020abc5ecf tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:41.916857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04b7fae8-f83f-47c9-9c30-2a020abc5ecf tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:41.917804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04b7fae8-f83f-47c9-9c30-2a020abc5ecf tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:41.919955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04b7fae8-f83f-47c9-9c30-2a020abc5ecf tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:42.371742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-04b7fae8-f83f-47c9-9c30-2a020abc5ecf tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:42.385797 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-04b7fae8-f83f-47c9-9c30-2a020abc5ecf tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1493 microversion: 2.1 time: 0.495208 Oct 29 01:04:42.386746 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 125/244] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:41 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1493 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:04:42.406535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4c51123c-14cd-4b66-b1d5-de0556b973a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:42.407241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4c51123c-14cd-4b66-b1d5-de0556b973a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:42.419991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c51123c-14cd-4b66-b1d5-de0556b973a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:42.423442 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c51123c-14cd-4b66-b1d5-de0556b973a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:42.427461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c51123c-14cd-4b66-b1d5-de0556b973a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:42.428401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c51123c-14cd-4b66-b1d5-de0556b973a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:42.429023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c51123c-14cd-4b66-b1d5-de0556b973a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:42.433832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6b4215fe-1849-4276-bae5-ed09d53746c0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:42.438977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c51123c-14cd-4b66-b1d5-de0556b973a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:42.451604 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6b4215fe-1849-4276-bae5-ed09d53746c0 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1388 microversion: 2.1 time: 0.607089 Oct 29 01:04:42.453007 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 120/245] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:41 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1388 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:42.631890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4c51123c-14cd-4b66-b1d5-de0556b973a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:42.656872 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4c51123c-14cd-4b66-b1d5-de0556b973a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1275 microversion: 2.1 time: 0.255256 Oct 29 01:04:42.659172 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 126/246] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:42 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1275 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:43.411564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-951a7f4f-ab67-4923-8976-fab932090726 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:43.412722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-951a7f4f-ab67-4923-8976-fab932090726 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:43.419948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-951a7f4f-ab67-4923-8976-fab932090726 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:43.421071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-951a7f4f-ab67-4923-8976-fab932090726 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:43.421775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-951a7f4f-ab67-4923-8976-fab932090726 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:43.422500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-951a7f4f-ab67-4923-8976-fab932090726 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:43.422961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-951a7f4f-ab67-4923-8976-fab932090726 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:43.423581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-951a7f4f-ab67-4923-8976-fab932090726 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:43.479857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-005b63ba-ae38-4b7d-b27c-25fe3df32c64 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:43.484668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-005b63ba-ae38-4b7d-b27c-25fe3df32c64 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:43.494395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=8,nova_api:INSERT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:43.497770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-005b63ba-ae38-4b7d-b27c-25fe3df32c64 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:43.499571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-005b63ba-ae38-4b7d-b27c-25fe3df32c64 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:43.505006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-005b63ba-ae38-4b7d-b27c-25fe3df32c64 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:43.506726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-005b63ba-ae38-4b7d-b27c-25fe3df32c64 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:43.510948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-005b63ba-ae38-4b7d-b27c-25fe3df32c64 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:43.511650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-005b63ba-ae38-4b7d-b27c-25fe3df32c64 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:43.579182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-951a7f4f-ab67-4923-8976-fab932090726 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:43.590442 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-951a7f4f-ab67-4923-8976-fab932090726 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1451 microversion: 2.1 time: 0.183437 Oct 29 01:04:43.590442 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 121/247] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:43 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1451 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:43.683977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c53a7b6f-6f1a-4ce2-bd85-c7e2d951c485 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:43.683977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c53a7b6f-6f1a-4ce2-bd85-c7e2d951c485 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:43.693375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c53a7b6f-6f1a-4ce2-bd85-c7e2d951c485 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:43.697410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c53a7b6f-6f1a-4ce2-bd85-c7e2d951c485 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:43.698687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c53a7b6f-6f1a-4ce2-bd85-c7e2d951c485 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:43.699827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c53a7b6f-6f1a-4ce2-bd85-c7e2d951c485 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:43.703272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c53a7b6f-6f1a-4ce2-bd85-c7e2d951c485 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:43.704180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c53a7b6f-6f1a-4ce2-bd85-c7e2d951c485 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:44.075383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-005b63ba-ae38-4b7d-b27c-25fe3df32c64 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:44.092442 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-005b63ba-ae38-4b7d-b27c-25fe3df32c64 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1388 microversion: 2.1 time: 0.617002 Oct 29 01:04:44.098178 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 127/248] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:43 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1388 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:44.105292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-1eda214b-d338-4d97-9d06-816e39653863 req-48c4865f-a42b-448e-845c-117e6d72ff0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f061780f-e530-42cd-8c3d-021d7e63a22f", "name": "network-vif-plugged", "status": "completed", "tag": "0ef4060b-e698-4221-b1fb-3c5bdfd3cba2"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:44.122158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1eda214b-d338-4d97-9d06-816e39653863 req-48c4865f-a42b-448e-845c-117e6d72ff0e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:44.123742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1eda214b-d338-4d97-9d06-816e39653863 req-48c4865f-a42b-448e-845c-117e6d72ff0e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:44.124711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1eda214b-d338-4d97-9d06-816e39653863 req-48c4865f-a42b-448e-845c-117e6d72ff0e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:44.140052 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-1eda214b-d338-4d97-9d06-816e39653863 req-48c4865f-a42b-448e-845c-117e6d72ff0e service nova] Creating event network-vif-plugged:0ef4060b-e698-4221-b1fb-3c5bdfd3cba2 for instance f061780f-e530-42cd-8c3d-021d7e63a22f on n-h2-862964-3 Oct 29 01:04:44.146543 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-1eda214b-d338-4d97-9d06-816e39653863 req-48c4865f-a42b-448e-845c-117e6d72ff0e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046314 Oct 29 01:04:44.147528 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 128/249] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:44.156983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-744fb7f4-f9ed-45b9-a6da-45cdcd6f8364 req-b3e4f477-cca6-4acf-838a-49b940117860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea9fe51-2e94-4205-959b-c9687e60b4ab", "name": "network-vif-deleted", "tag": "a3e3f41d-0080-4c51-b487-85a6a1282969"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:44.169702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-744fb7f4-f9ed-45b9-a6da-45cdcd6f8364 req-b3e4f477-cca6-4acf-838a-49b940117860 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:44.171064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-744fb7f4-f9ed-45b9-a6da-45cdcd6f8364 req-b3e4f477-cca6-4acf-838a-49b940117860 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:44.171926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-744fb7f4-f9ed-45b9-a6da-45cdcd6f8364 req-b3e4f477-cca6-4acf-838a-49b940117860 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:44.191956 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-744fb7f4-f9ed-45b9-a6da-45cdcd6f8364 req-b3e4f477-cca6-4acf-838a-49b940117860 service nova] Creating event network-vif-deleted:a3e3f41d-0080-4c51-b487-85a6a1282969 for instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab on n-h1-862964-3 Oct 29 01:04:44.192786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c53a7b6f-6f1a-4ce2-bd85-c7e2d951c485 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:44.197963 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-744fb7f4-f9ed-45b9-a6da-45cdcd6f8364 req-b3e4f477-cca6-4acf-838a-49b940117860 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048879 Oct 29 01:04:44.199023 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 129/250] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:44.213822 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c53a7b6f-6f1a-4ce2-bd85-c7e2d951c485 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1317 microversion: 2.1 time: 0.534560 Oct 29 01:04:44.214768 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 122/251] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:43 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:04:44.619175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1257426b-56ab-4faf-9fba-5bf187dd22d3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:44.619874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1257426b-56ab-4faf-9fba-5bf187dd22d3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:44.653449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1257426b-56ab-4faf-9fba-5bf187dd22d3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:44.653449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1257426b-56ab-4faf-9fba-5bf187dd22d3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:44.653449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1257426b-56ab-4faf-9fba-5bf187dd22d3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:44.654171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1257426b-56ab-4faf-9fba-5bf187dd22d3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:44.654478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1257426b-56ab-4faf-9fba-5bf187dd22d3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:44.654807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1257426b-56ab-4faf-9fba-5bf187dd22d3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:44.724154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1257426b-56ab-4faf-9fba-5bf187dd22d3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:44.724647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1257426b-56ab-4faf-9fba-5bf187dd22d3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:44.726057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1257426b-56ab-4faf-9fba-5bf187dd22d3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:44.726728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-1257426b-56ab-4faf-9fba-5bf187dd22d3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lazy-loading 'fault' on Instance uuid 4ea9fe51-2e94-4205-959b-c9687e60b4ab {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:04:44.813052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1257426b-56ab-4faf-9fba-5bf187dd22d3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f2373aa70c4119843b4f019bd4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73949a2336ba4121922600fa26b4af43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:44.831229 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1257426b-56ab-4faf-9fba-5bf187dd22d3 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 200 len: 1327 microversion: 2.1 time: 0.220696 Oct 29 01:04:44.832006 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 130/252] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:44 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 1327 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:04:45.125497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-31bca622-9688-4888-b5f6-1ee827dcd717 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:45.138118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-31bca622-9688-4888-b5f6-1ee827dcd717 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:45.155623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31bca622-9688-4888-b5f6-1ee827dcd717 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:45.156307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31bca622-9688-4888-b5f6-1ee827dcd717 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:45.157219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31bca622-9688-4888-b5f6-1ee827dcd717 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:45.158590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31bca622-9688-4888-b5f6-1ee827dcd717 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:45.159767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31bca622-9688-4888-b5f6-1ee827dcd717 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:45.160908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31bca622-9688-4888-b5f6-1ee827dcd717 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:45.240020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c50ffd12-d8a3-4f52-b9b0-799d2086643e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:45.240608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c50ffd12-d8a3-4f52-b9b0-799d2086643e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:45.252735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c50ffd12-d8a3-4f52-b9b0-799d2086643e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:45.253253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c50ffd12-d8a3-4f52-b9b0-799d2086643e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:45.253694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c50ffd12-d8a3-4f52-b9b0-799d2086643e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:45.261573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c50ffd12-d8a3-4f52-b9b0-799d2086643e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:45.261573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c50ffd12-d8a3-4f52-b9b0-799d2086643e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:45.262393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c50ffd12-d8a3-4f52-b9b0-799d2086643e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:45.440188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-31bca622-9688-4888-b5f6-1ee827dcd717 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:45.450644 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-31bca622-9688-4888-b5f6-1ee827dcd717 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1388 microversion: 2.1 time: 0.334325 Oct 29 01:04:45.457762 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 123/253] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:45 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1388 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:45.638997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c50ffd12-d8a3-4f52-b9b0-799d2086643e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:45.649117 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c50ffd12-d8a3-4f52-b9b0-799d2086643e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1317 microversion: 2.1 time: 0.414203 Oct 29 01:04:45.650114 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 131/254] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:45 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:45.856555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-45f73ff0-91a3-4ef5-aa54-7afb12912341 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:45.857223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-45f73ff0-91a3-4ef5-aa54-7afb12912341 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:45.859205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:45.865657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45f73ff0-91a3-4ef5-aa54-7afb12912341 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:45.866154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45f73ff0-91a3-4ef5-aa54-7afb12912341 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:45.866763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45f73ff0-91a3-4ef5-aa54-7afb12912341 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:45.870315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45f73ff0-91a3-4ef5-aa54-7afb12912341 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:45.870315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45f73ff0-91a3-4ef5-aa54-7afb12912341 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:45.870315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45f73ff0-91a3-4ef5-aa54-7afb12912341 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:45.886523 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-45f73ff0-91a3-4ef5-aa54-7afb12912341 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] HTTP exception thrown: Instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab could not be found. Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-45f73ff0-91a3-4ef5-aa54-7afb12912341 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Request method failure captured: Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab HTTP/1.1 Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHv3QuJBS1vK2EmFFl04y27u7Mj9bPd78wA8w-4sayDpHsFOt1gZjZz6tJ9uytuNyXKeszYqgOzkAg9a3x6P_pXG1-VaEg_SLVMahaD2EPJdexTUcOknBzpEN1-aC_TySd6iU1_pCyJs3hLgM6-w_cAK-x9V4rDD5W79-fTjXwvf9Gc Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 73949a2336ba4121922600fa26b4af43 Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AggregatesAdminTestJSON-155089787 Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:04:45.888646 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:04:45.890077 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/73949a2336ba4121922600fa26b4af43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/73949a2336ba4121922600fa26b4af43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/73949a2336ba4121922600fa26b4af43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_73949a2336ba4121922600fa26b4af43", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:45.890077 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AggregatesAdminTestJSON-155089787 Oct 29 01:04:45.890077 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 73949a2336ba4121922600fa26b4af43 Oct 29 01:04:45.890077 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-155089787 Oct 29 01:04:45.890077 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AggregatesAdminTestJSON-155089787-project Oct 29 01:04:45.890077 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:45.890077 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:45.890077 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: c5f2373aa70c4119843b4f019bd4ea62 Oct 29 01:04:45.890077 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AggregatesAdminTestJSON-155089787-project Oct 29 01:04:45.890077 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:04:45.890077 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab could not be found. Oct 29 01:04:45.890077 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '4ea9fe51-2e94-4205-959b-c9687e60b4ab'} Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab could not be found. Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:45.890898 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:45.892454 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:45.892454 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:04:45.892454 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:04:45.892454 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:04:45.892454 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:04:45.892454 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:04:45.892454 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:04:45.892454 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab could not be found. Oct 29 01:04:45.892454 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:45.892454 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:45.892454 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:45.892454 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:45.892454 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:45.892454 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:45.892454 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:45.892454 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:45.892454 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab could not be found. Oct 29 01:04:45.892454 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:45.894269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-45f73ff0-91a3-4ef5-aa54-7afb12912341 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Returning 404 to user: Instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:45.894269 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-45f73ff0-91a3-4ef5-aa54-7afb12912341 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 404 len: 111 microversion: 2.1 time: 0.040023 Oct 29 01:04:45.901063 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 124/255] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:45 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:04:45.905553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-56bf78da-03b2-43ad-9184-d385b89506f0 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862964-3"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:45.931057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56bf78da-03b2-43ad-9184-d385b89506f0 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:45.934121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56bf78da-03b2-43ad-9184-d385b89506f0 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:45.934802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56bf78da-03b2-43ad-9184-d385b89506f0 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:46.251994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-81129371-8d44-425c-87b2-f067ca08d38c req-fb53d8c3-4c0e-44cd-b6ad-737ce8373b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a5a9b1-7f02-4874-83d4-c48badd76f5f", "tag": "92316f92-4129-4d3d-a8ad-df5607e5d4e5"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:46.264024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-81129371-8d44-425c-87b2-f067ca08d38c req-fb53d8c3-4c0e-44cd-b6ad-737ce8373b2d service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:46.264997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-81129371-8d44-425c-87b2-f067ca08d38c req-fb53d8c3-4c0e-44cd-b6ad-737ce8373b2d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:46.266356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-81129371-8d44-425c-87b2-f067ca08d38c req-fb53d8c3-4c0e-44cd-b6ad-737ce8373b2d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:46.284684 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-81129371-8d44-425c-87b2-f067ca08d38c req-fb53d8c3-4c0e-44cd-b6ad-737ce8373b2d service nova] Creating event network-changed:92316f92-4129-4d3d-a8ad-df5607e5d4e5 for instance a9a5a9b1-7f02-4874-83d4-c48badd76f5f on n-h2-862964-3 Oct 29 01:04:46.287417 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-56bf78da-03b2-43ad-9184-d385b89506f0 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 295 microversion: 2.1 time: 0.387104 Oct 29 01:04:46.288596 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 132/256] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Oct 29 01:04:45 2022] POST /compute/v2.1/os-aggregates/4/action => generated 295 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:04:46.323460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-71eb7ffd-b6e0-4038-8cbd-2deae7cbd55d tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:46.324785 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-81129371-8d44-425c-87b2-f067ca08d38c req-fb53d8c3-4c0e-44cd-b6ad-737ce8373b2d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083237 Oct 29 01:04:46.327495 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 125/257] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:46.480343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cf6e5317-8409-4f9c-b2ba-da299032e843 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:46.481051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cf6e5317-8409-4f9c-b2ba-da299032e843 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:46.494303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf6e5317-8409-4f9c-b2ba-da299032e843 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:46.494809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf6e5317-8409-4f9c-b2ba-da299032e843 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:46.495441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf6e5317-8409-4f9c-b2ba-da299032e843 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:46.496301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf6e5317-8409-4f9c-b2ba-da299032e843 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:46.496820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf6e5317-8409-4f9c-b2ba-da299032e843 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:46.497339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf6e5317-8409-4f9c-b2ba-da299032e843 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:46.534374 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-71eb7ffd-b6e0-4038-8cbd-2deae7cbd55d tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.234897 Oct 29 01:04:46.537791 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 133/258] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:04:46 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 01:04:46.552625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e8ad518-8906-4635-9d24-43900009a316 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-848675868"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:46.560445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.aggregate [None req-7e8ad518-8906-4635-9d24-43900009a316 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Generated uuid bbafd632-e07c-44b4-a1ba-c642cde728c1 for aggregate {{(pid=121100) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:04:46.607638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:46.688947 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e8ad518-8906-4635-9d24-43900009a316 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.139131 Oct 29 01:04:46.689625 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 134/259] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 29 01:04:46 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:04:46.709799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9b1f8c57-2a3a-4210-9edf-7841b9285aa3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:46.713933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9b1f8c57-2a3a-4210-9edf-7841b9285aa3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:46.725979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b1f8c57-2a3a-4210-9edf-7841b9285aa3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:46.726816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b1f8c57-2a3a-4210-9edf-7841b9285aa3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:46.727856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b1f8c57-2a3a-4210-9edf-7841b9285aa3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:46.730140 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b1f8c57-2a3a-4210-9edf-7841b9285aa3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:46.731072 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b1f8c57-2a3a-4210-9edf-7841b9285aa3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:46.732306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b1f8c57-2a3a-4210-9edf-7841b9285aa3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:46.854062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cf6e5317-8409-4f9c-b2ba-da299032e843 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:46.866839 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cf6e5317-8409-4f9c-b2ba-da299032e843 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1388 microversion: 2.1 time: 0.386307 Oct 29 01:04:46.882575 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 126/260] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:46 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1388 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:04:46.882575 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e98609b6-56a1-444e-9a4f-18e00f4b279b tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862964-3"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:46.900265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e98609b6-56a1-444e-9a4f-18e00f4b279b tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:46.900762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e98609b6-56a1-444e-9a4f-18e00f4b279b tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:46.901218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e98609b6-56a1-444e-9a4f-18e00f4b279b tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:47.166063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9b1f8c57-2a3a-4210-9edf-7841b9285aa3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:47.176564 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9b1f8c57-2a3a-4210-9edf-7841b9285aa3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1317 microversion: 2.1 time: 0.480218 Oct 29 01:04:47.193092 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 135/261] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:46 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1317 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:47.231592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:47.273920 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e98609b6-56a1-444e-9a4f-18e00f4b279b tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.405068 Oct 29 01:04:47.274556 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 127/262] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Oct 29 01:04:46 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:47.289018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1e7ebf59-934a-4994-a57e-8c892f709c9a tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:47.296104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=8,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:47.302855 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1e7ebf59-934a-4994-a57e-8c892f709c9a tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.019636 Oct 29 01:04:47.303809 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 128/263] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 29 01:04:47 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:04:47.317905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-af074a2e-20e1-4b75-817f-74de3ca90d85 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862964-3"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:47.340493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af074a2e-20e1-4b75-817f-74de3ca90d85 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:47.344059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af074a2e-20e1-4b75-817f-74de3ca90d85 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:47.347539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af074a2e-20e1-4b75-817f-74de3ca90d85 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:47.595805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-70108e28-7695-451e-aa43-115f19e48f83 tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Action: 'update', calling method: .version_select at 0x7f9d9c72b310>, body: {"quota_set": {"ram": "5120"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:47.744115 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-af074a2e-20e1-4b75-817f-74de3ca90d85 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.432586 Oct 29 01:04:47.745136 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 129/264] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Oct 29 01:04:47 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:47.757310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f6f1894e-a59d-44a4-a74c-3490a6ca48e6 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:47.850938 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f6f1894e-a59d-44a4-a74c-3490a6ca48e6 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.097861 Oct 29 01:04:47.851690 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 130/265] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:04:47 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 29 01:04:47.862231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8983e5b5-842d-41cb-85c9-cc117632ce24 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1199326722"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:47.865735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.aggregate [None req-8983e5b5-842d-41cb-85c9-cc117632ce24 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Generated uuid 1b1baff1-04d7-41ff-aab8-58f8e73e6b98 for aggregate {{(pid=121099) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:04:47.976623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70108e28-7695-451e-aa43-115f19e48f83 tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:47.978787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70108e28-7695-451e-aa43-115f19e48f83 tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:47.979399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70108e28-7695-451e-aa43-115f19e48f83 tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:47.981011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70108e28-7695-451e-aa43-115f19e48f83 tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:47.982612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70108e28-7695-451e-aa43-115f19e48f83 tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:47.983232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70108e28-7695-451e-aa43-115f19e48f83 tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:47.999461 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8983e5b5-842d-41cb-85c9-cc117632ce24 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.141029 Oct 29 01:04:48.000590 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 131/266] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 29 01:04:47 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:48.011715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7c0a6ccf-5b2a-4ba7-a7f4-66416b3f691c tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:48.012834 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7c0a6ccf-5b2a-4ba7-a7f4-66416b3f691c tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:48.027538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c0a6ccf-5b2a-4ba7-a7f4-66416b3f691c tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:48.028280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c0a6ccf-5b2a-4ba7-a7f4-66416b3f691c tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:48.029049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c0a6ccf-5b2a-4ba7-a7f4-66416b3f691c tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:48.030059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c0a6ccf-5b2a-4ba7-a7f4-66416b3f691c tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:48.030695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c0a6ccf-5b2a-4ba7-a7f4-66416b3f691c tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:48.031294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c0a6ccf-5b2a-4ba7-a7f4-66416b3f691c tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:48.179930 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-70108e28-7695-451e-aa43-115f19e48f83 tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/cbfb11bdc69f4e2b81bdac51b5b0d855" status: 200 len: 240 microversion: 2.36 time: 1.001331 Oct 29 01:04:48.180565 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 136/267] 10.222.0.26 () {62 vars in 1303 bytes} [Sat Oct 29 01:04:47 2022] PUT /compute/v2.1/os-quota-sets/cbfb11bdc69f4e2b81bdac51b5b0d855 => generated 240 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:04:48.187338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-29731bd9-8c7a-4723-84ea-1bcedce496d1 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862964-3"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:48.201746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29731bd9-8c7a-4723-84ea-1bcedce496d1 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:48.202549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29731bd9-8c7a-4723-84ea-1bcedce496d1 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:48.203183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29731bd9-8c7a-4723-84ea-1bcedce496d1 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:48.433047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7c0a6ccf-5b2a-4ba7-a7f4-66416b3f691c tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:48.454248 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7c0a6ccf-5b2a-4ba7-a7f4-66416b3f691c tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1584 microversion: 2.1 time: 0.452399 Oct 29 01:04:48.455099 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 132/268] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:48 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1584 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:48.460665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eb4eb619-d416-43c6-bba2-b0394734d67e tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Calling method '.version_select at 0x7f9d9c604430>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:48.574193 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-29731bd9-8c7a-4723-84ea-1bcedce496d1 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.392414 Oct 29 01:04:48.582922 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 137/269] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 29 01:04:48 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:48.588995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5cb72398-789d-4e19-bd99-cd46399bcd66 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:48.594416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5cb72398-789d-4e19-bd99-cd46399bcd66 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:48.616345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cb72398-789d-4e19-bd99-cd46399bcd66 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:48.617366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cb72398-789d-4e19-bd99-cd46399bcd66 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:48.621328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cb72398-789d-4e19-bd99-cd46399bcd66 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:48.621328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cb72398-789d-4e19-bd99-cd46399bcd66 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:48.623137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cb72398-789d-4e19-bd99-cd46399bcd66 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:48.623607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cb72398-789d-4e19-bd99-cd46399bcd66 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:48.843004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb4eb619-d416-43c6-bba2-b0394734d67e tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:48.843004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb4eb619-d416-43c6-bba2-b0394734d67e tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:48.843004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb4eb619-d416-43c6-bba2-b0394734d67e tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:48.843004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb4eb619-d416-43c6-bba2-b0394734d67e tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:48.843363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb4eb619-d416-43c6-bba2-b0394734d67e tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:48.843363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb4eb619-d416-43c6-bba2-b0394734d67e tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:48.892994 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eb4eb619-d416-43c6-bba2-b0394734d67e tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/cbfb11bdc69f4e2b81bdac51b5b0d855/detail" status: 200 len: 672 microversion: 2.36 time: 0.436550 Oct 29 01:04:48.893658 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 133/270] 10.222.0.26 () {60 vars in 1304 bytes} [Sat Oct 29 01:04:48 2022] GET /compute/v2.1/os-quota-sets/cbfb11bdc69f4e2b81bdac51b5b0d855/detail => generated 672 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:04:48.904327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d978ea28-55c7-4af0-b162-dd0469d0a9bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:48.913731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d978ea28-55c7-4af0-b162-dd0469d0a9bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:48.926028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5cb72398-789d-4e19-bd99-cd46399bcd66 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:48.929979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d978ea28-55c7-4af0-b162-dd0469d0a9bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:48.930472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d978ea28-55c7-4af0-b162-dd0469d0a9bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:48.930911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d978ea28-55c7-4af0-b162-dd0469d0a9bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:48.934078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d978ea28-55c7-4af0-b162-dd0469d0a9bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:48.934563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d978ea28-55c7-4af0-b162-dd0469d0a9bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:48.935001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d978ea28-55c7-4af0-b162-dd0469d0a9bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:48.943313 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5cb72398-789d-4e19-bd99-cd46399bcd66 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1317 microversion: 2.1 time: 0.359045 Oct 29 01:04:48.946886 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 138/271] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:48 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:48.951774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e4dd2f0a-6f7b-473e-a18f-097a9a6df95d tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:48.977531 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e4dd2f0a-6f7b-473e-a18f-097a9a6df95d tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.029000 Oct 29 01:04:48.980772 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 139/272] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 29 01:04:48 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:49.026702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5f287a6b-79fe-444d-b505-d67258ec6691 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862964-3"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:49.042205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f287a6b-79fe-444d-b505-d67258ec6691 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:49.042942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f287a6b-79fe-444d-b505-d67258ec6691 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:49.043533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f287a6b-79fe-444d-b505-d67258ec6691 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:49.216613 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d978ea28-55c7-4af0-b162-dd0469d0a9bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.317830 Oct 29 01:04:49.217262 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 134/273] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:04:48 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f/os-interface => generated 284 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:49.309062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-06973d9a-a2fd-42c4-beff-816e09dd5bbd tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Action: 'update', calling method: .version_select at 0x7f9d9c4d79d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:49.374851 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5f287a6b-79fe-444d-b505-d67258ec6691 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.381220 Oct 29 01:04:49.375468 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 140/274] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 29 01:04:48 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:49.389575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3c9b1457-635a-4815-bce3-c5cf43ac07e2 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:49.552023 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3c9b1457-635a-4815-bce3-c5cf43ac07e2 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.166940 Oct 29 01:04:49.554372 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 141/275] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 29 01:04:49 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 01:04:49.571797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1796885b-4a4c-4900-bc83-7a09c594395e tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-330822670"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:49.575509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.aggregate [None req-1796885b-4a4c-4900-bc83-7a09c594395e tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Generated uuid 76988c81-51be-48ed-8f97-e7272173fb57 for aggregate {{(pid=121100) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:04:49.713011 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1796885b-4a4c-4900-bc83-7a09c594395e tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.149758 Oct 29 01:04:49.713613 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 142/276] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 29 01:04:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:04:49.737458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cb47650e-d494-4289-88af-cddbe22a60d2 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862964-3"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:49.768815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb47650e-d494-4289-88af-cddbe22a60d2 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:49.773466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb47650e-d494-4289-88af-cddbe22a60d2 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:49.774205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb47650e-d494-4289-88af-cddbe22a60d2 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:49.816099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06973d9a-a2fd-42c4-beff-816e09dd5bbd tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:49.823605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06973d9a-a2fd-42c4-beff-816e09dd5bbd tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:49.827308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06973d9a-a2fd-42c4-beff-816e09dd5bbd tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:49.828146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06973d9a-a2fd-42c4-beff-816e09dd5bbd tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:49.828623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06973d9a-a2fd-42c4-beff-816e09dd5bbd tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:49.830631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06973d9a-a2fd-42c4-beff-816e09dd5bbd tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:49.993280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06973d9a-a2fd-42c4-beff-816e09dd5bbd tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:50.000242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06973d9a-a2fd-42c4-beff-816e09dd5bbd tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:50.000242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06973d9a-a2fd-42c4-beff-816e09dd5bbd tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:50.000242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06973d9a-a2fd-42c4-beff-816e09dd5bbd tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:50.002305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06973d9a-a2fd-42c4-beff-816e09dd5bbd tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:50.005347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06973d9a-a2fd-42c4-beff-816e09dd5bbd tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:50.191384 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cb47650e-d494-4289-88af-cddbe22a60d2 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.469484 Oct 29 01:04:50.193290 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 143/277] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 29 01:04:49 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:50.200484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ec717e0d-aac0-4689-a22c-c9a659a49c79 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:50.205890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ec717e0d-aac0-4689-a22c-c9a659a49c79 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:50.237459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec717e0d-aac0-4689-a22c-c9a659a49c79 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:50.238150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec717e0d-aac0-4689-a22c-c9a659a49c79 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:50.239214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec717e0d-aac0-4689-a22c-c9a659a49c79 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:50.243494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec717e0d-aac0-4689-a22c-c9a659a49c79 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:50.244453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec717e0d-aac0-4689-a22c-c9a659a49c79 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:50.245765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec717e0d-aac0-4689-a22c-c9a659a49c79 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:50.257005 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-06973d9a-a2fd-42c4-beff-816e09dd5bbd tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/cbfb11bdc69f4e2b81bdac51b5b0d855?user_id=1c5024d7e14349eaa6dc26785df081f2" status: 200 len: 240 microversion: 2.36 time: 0.951976 Oct 29 01:04:50.264546 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 135/278] 10.222.0.26 () {62 vars in 1384 bytes} [Sat Oct 29 01:04:49 2022] PUT /compute/v2.1/os-quota-sets/cbfb11bdc69f4e2b81bdac51b5b0d855?user_id=1c5024d7e14349eaa6dc26785df081f2 => generated 240 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:04:50.269620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fb71dd6a-cba0-4f99-bd14-6f717eabc57b tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862964-3"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:50.309065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb71dd6a-cba0-4f99-bd14-6f717eabc57b tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:50.313652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb71dd6a-cba0-4f99-bd14-6f717eabc57b tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:50.313652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb71dd6a-cba0-4f99-bd14-6f717eabc57b tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:50.704158 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fb71dd6a-cba0-4f99-bd14-6f717eabc57b tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.438187 Oct 29 01:04:50.704897 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 136/279] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 29 01:04:50 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:50.711022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b902b3bf-49db-435e-a293-1ac3c9263586 tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] Calling method '.version_select at 0x7f9d9c604160>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:51.058732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ec717e0d-aac0-4689-a22c-c9a659a49c79 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:51.067898 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ec717e0d-aac0-4689-a22c-c9a659a49c79 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1317 microversion: 2.1 time: 0.873594 Oct 29 01:04:51.071326 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 144/280] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:50 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1317 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:51.100868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-39bbe979-3428-4219-8c5e-bc6bb93a8962 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:51.113967 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b902b3bf-49db-435e-a293-1ac3c9263586 tempest-QuotasAdminTestV236-880039960 tempest-QuotasAdminTestV236-880039960-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/cbfb11bdc69f4e2b81bdac51b5b0d855?user_id=1c5024d7e14349eaa6dc26785df081f2" status: 200 len: 282 microversion: 2.36 time: 0.407796 Oct 29 01:04:51.126126 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 137/281] 10.222.0.26 () {60 vars in 1364 bytes} [Sat Oct 29 01:04:50 2022] GET /compute/v2.1/os-quota-sets/cbfb11bdc69f4e2b81bdac51b5b0d855?user_id=1c5024d7e14349eaa6dc26785df081f2 => generated 282 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:04:51.201447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-321a2f87-5aa6-4244-80aa-4abc66e70a11 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-213059995", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:51.221810 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-39bbe979-3428-4219-8c5e-bc6bb93a8962 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.133922 Oct 29 01:04:51.228167 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 145/282] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 29 01:04:51 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 01:04:51.239916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4cc90720-d7a9-4737-b017-de465b03416d tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1126710814"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:51.253402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.aggregate [None req-4cc90720-d7a9-4737-b017-de465b03416d tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Generated uuid 19795e40-5ec5-4701-83a2-8a4539dae46f for aggregate {{(pid=121100) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:04:51.306407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-321a2f87-5aa6-4244-80aa-4abc66e70a11 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] validate_networks() for None {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:04:51.366983 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4cc90720-d7a9-4737-b017-de465b03416d tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.137504 Oct 29 01:04:51.374428 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 146/283] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 29 01:04:51 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:51.387407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c30cdfb3-d0f2-4b4f-828d-78e209d727c8 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1188730015"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:51.392702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.aggregate [None req-c30cdfb3-d0f2-4b4f-828d-78e209d727c8 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Generated uuid b9e8effb-f856-40ab-8476-e19b78d15aef for aggregate {{(pid=121100) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:04:51.537927 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c30cdfb3-d0f2-4b4f-828d-78e209d727c8 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.161850 Oct 29 01:04:51.538560 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 147/284] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 29 01:04:51 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:51.550763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-031556c3-031f-48c7-92ce-74a15e2f3a2d tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:51.579953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=8,nova_api:INSERT=7 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:51.697488 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-031556c3-031f-48c7-92ce-74a15e2f3a2d tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.157068 Oct 29 01:04:51.702512 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 148/285] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 29 01:04:51 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 01:04:51.715282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0ca07b66-2732-4686-ac1a-4256008d05df tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862964-3"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:51.733664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ca07b66-2732-4686-ac1a-4256008d05df tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:51.734562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ca07b66-2732-4686-ac1a-4256008d05df tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:51.735764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ca07b66-2732-4686-ac1a-4256008d05df tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:51.870007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:52.099816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-321a2f87-5aa6-4244-80aa-4abc66e70a11 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:04:52.100248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-321a2f87-5aa6-4244-80aa-4abc66e70a11 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:04:52.100728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-321a2f87-5aa6-4244-80aa-4abc66e70a11 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:04:52.101140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-321a2f87-5aa6-4244-80aa-4abc66e70a11 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:04:52.101575 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-321a2f87-5aa6-4244-80aa-4abc66e70a11 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:04:52.119141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-321a2f87-5aa6-4244-80aa-4abc66e70a11 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:52.119789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-321a2f87-5aa6-4244-80aa-4abc66e70a11 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:52.120101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-321a2f87-5aa6-4244-80aa-4abc66e70a11 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:52.123546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-321a2f87-5aa6-4244-80aa-4abc66e70a11 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:52.130722 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0ca07b66-2732-4686-ac1a-4256008d05df tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.426789 Oct 29 01:04:52.131540 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 149/286] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 29 01:04:51 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:52.143591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3fc28574-21db-4123-a546-f411f4dd2f49 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:52.143850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-321a2f87-5aa6-4244-80aa-4abc66e70a11 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:52.145557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-321a2f87-5aa6-4244-80aa-4abc66e70a11 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:52.172153 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-3fc28574-21db-4123-a546-f411f4dd2f49 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3fc28574-21db-4123-a546-f411f4dd2f49 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Request method failure captured: Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHv6tkMFgk258Glcxd5gUfDwgle2-J5sTqYTFLrIE2S8zwbXK7zSjApB8T6bwoi0MCeRCx4KT1fQAdobOcnBUGDmkCSCWR2605a7feZxXIg1ApETrH5qryDnDn8HoYuEoOwUv0EuQsZRclWLzHSfZlZU4V_d3Kc5sBxbBDRCrZd7c2g Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: cd2a5af7cb164dc2872a253c8cb1e4ef Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AggregatesAdminTestJSON-1829263483 Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:04:52.174718 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:04:52.176370 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd2a5af7cb164dc2872a253c8cb1e4ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cd2a5af7cb164dc2872a253c8cb1e4ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd2a5af7cb164dc2872a253c8cb1e4ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cd2a5af7cb164dc2872a253c8cb1e4ef", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:52.176370 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AggregatesAdminTestJSON-1829263483 Oct 29 01:04:52.176370 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: cd2a5af7cb164dc2872a253c8cb1e4ef Oct 29 01:04:52.176370 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1829263483 Oct 29 01:04:52.176370 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AggregatesAdminTestJSON-1829263483-project-admin Oct 29 01:04:52.176370 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:52.176370 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:52.176370 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: ff6ebb3a7af147e798fda92d7ea42b5e Oct 29 01:04:52.176370 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AggregatesAdminTestJSON-1829263483-project-admin Oct 29 01:04:52.176370 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:04:52.176370 n-d-862964-3 devstack@n-api.service[121100]: exception: Aggregate 12 could not be found. Oct 29 01:04:52.176370 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '12'} Oct 29 01:04:52.176370 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:52.177437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:52.177437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 29 01:04:52.177437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 29 01:04:52.177437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 29 01:04:52.177437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 01:04:52.177437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:04:52.177437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:04:52.177437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 01:04:52.177437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 01:04:52.177437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:04:52.177437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:04:52.177437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 01:04:52.177437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 01:04:52.177437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 29 01:04:52.177437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:52.177437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:52.177437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:52.177437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:52.177437 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:52.178761 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:52.178761 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:52.178761 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:52.178761 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:52.178761 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:52.178761 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 29 01:04:52.178761 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:04:52.178761 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 29 01:04:52.178761 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:52.178761 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:52.178761 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:52.178761 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:52.178761 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:52.178761 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:52.178761 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:52.178761 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:52.178761 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 29 01:04:52.178761 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:52.184004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3fc28574-21db-4123-a546-f411f4dd2f49 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:52.189975 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3fc28574-21db-4123-a546-f411f4dd2f49 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.045217 Oct 29 01:04:52.194063 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 150/287] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:04:52 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:04:52.198942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-53767671-8dc7-48f1-ab1a-5868e0e5547e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:52.205320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-53767671-8dc7-48f1-ab1a-5868e0e5547e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:52.213494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-321a2f87-5aa6-4244-80aa-4abc66e70a11 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Getting quotas for project edf4bb92337045bdb017d273b7fc55d4. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:04:52.220453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-53767671-8dc7-48f1-ab1a-5868e0e5547e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:52.220955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-53767671-8dc7-48f1-ab1a-5868e0e5547e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:52.223846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-53767671-8dc7-48f1-ab1a-5868e0e5547e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:52.223846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-53767671-8dc7-48f1-ab1a-5868e0e5547e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:52.223846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-53767671-8dc7-48f1-ab1a-5868e0e5547e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:52.223846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-53767671-8dc7-48f1-ab1a-5868e0e5547e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:52.227522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-321a2f87-5aa6-4244-80aa-4abc66e70a11 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Getting quotas for user 1826e3c223c8493081c90eeb180d9b81 and project edf4bb92337045bdb017d273b7fc55d4. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:04:52.256028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-321a2f87-5aa6-4244-80aa-4abc66e70a11 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:04:52.263821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-321a2f87-5aa6-4244-80aa-4abc66e70a11 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:04:52.444078 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-321a2f87-5aa6-4244-80aa-4abc66e70a11 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.302217 Oct 29 01:04:52.446277 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 138/288] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:04:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:04:52.463308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-af9a7d35-ed38-4113-99ed-101702f7a40b tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862964-3"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:52.492590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-af9a7d35-ed38-4113-99ed-101702f7a40b tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '5b471a581f8d46dd8cd017e3dfc75bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a749a5d109a440938aac285ef9951b9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-af9a7d35-ed38-4113-99ed-101702f7a40b tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Request method failure captured: Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 42 Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHv4tLh0QEaA21VVydkXYCA00aZxNS-Mjkoocl_LUaIgDA7mt2fS8TPHd5Olve0yT9v0LK5lpooi5a1wHhY6e-gbAM3F3enCBtSpJOByjqJ1ZP2iUZ3wMiTcmX7zrye4PW_-hVvoGG0wsikjxwIGUPXhJk3vXDw8OjrN09ECKArxROc Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: a749a5d109a440938aac285ef9951b9f Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1806462143 Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:04:52.495865 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:04:52.500749 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a749a5d109a440938aac285ef9951b9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a749a5d109a440938aac285ef9951b9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a749a5d109a440938aac285ef9951b9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a749a5d109a440938aac285ef9951b9f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:52.500749 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1806462143 Oct 29 01:04:52.500749 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: a749a5d109a440938aac285ef9951b9f Oct 29 01:04:52.500749 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1806462143 Oct 29 01:04:52.500749 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AggregatesAdminNegativeTestJSON-1806462143-project Oct 29 01:04:52.500749 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:52.500749 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:52.500749 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 5b471a581f8d46dd8cd017e3dfc75bc7 Oct 29 01:04:52.500749 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1806462143-project Oct 29 01:04:52.500749 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:04:52.500749 n-d-862964-3 devstack@n-api.service[121099]: {"remove_host": {"host": "n-h1-862964-3"}} Oct 29 01:04:52.500749 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:04:52.500749 n-d-862964-3 devstack@n-api.service[121099]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 29 01:04:52.501713 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-862964-3'}}} Oct 29 01:04:52.501713 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:52.501713 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:52.501713 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:52.501713 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:52.501713 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:52.501713 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:52.501713 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:52.501713 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:52.501713 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:52.501713 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:52.501713 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 29 01:04:52.501713 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 29 01:04:52.501713 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:04:52.501713 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:04:52.501713 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:04:52.501713 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:04:52.501713 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:52.501713 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:52.502768 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:52.502768 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:52.502768 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:04:52.502768 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:04:52.502768 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:04:52.502768 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:04:52.502768 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:04:52.502768 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:04:52.502768 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 29 01:04:52.502768 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:52.502768 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:52.502768 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:52.502768 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:52.502768 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:52.502768 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:52.502768 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:04:52.502768 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:04:52.502768 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 29 01:04:52.502768 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:52.509032 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-af9a7d35-ed38-4113-99ed-101702f7a40b tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:52.523689 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-af9a7d35-ed38-4113-99ed-101702f7a40b tempest-AggregatesAdminNegativeTestJSON-1806462143 tempest-AggregatesAdminNegativeTestJSON-1806462143-project] 10.222.0.26 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.049283 Oct 29 01:04:52.529566 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 139/289] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 29 01:04:52 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 75 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:04:52.537082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-86f66aa0-7b7c-4b7a-b109-8ec163e544ec tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:52.554387 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-86f66aa0-7b7c-4b7a-b109-8ec163e544ec tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-86f66aa0-7b7c-4b7a-b109-8ec163e544ec tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Request method failure captured: Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHv6tkMFgk258Glcxd5gUfDwgle2-J5sTqYTFLrIE2S8zwbXK7zSjApB8T6bwoi0MCeRCx4KT1fQAdobOcnBUGDmkCSCWR2605a7feZxXIg1ApETrH5qryDnDn8HoYuEoOwUv0EuQsZRclWLzHSfZlZU4V_d3Kc5sBxbBDRCrZd7c2g Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: cd2a5af7cb164dc2872a253c8cb1e4ef Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AggregatesAdminTestJSON-1829263483 Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:04:52.557064 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:04:52.559417 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd2a5af7cb164dc2872a253c8cb1e4ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cd2a5af7cb164dc2872a253c8cb1e4ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd2a5af7cb164dc2872a253c8cb1e4ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cd2a5af7cb164dc2872a253c8cb1e4ef", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:52.559417 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AggregatesAdminTestJSON-1829263483 Oct 29 01:04:52.559417 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: cd2a5af7cb164dc2872a253c8cb1e4ef Oct 29 01:04:52.559417 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1829263483 Oct 29 01:04:52.559417 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AggregatesAdminTestJSON-1829263483-project-admin Oct 29 01:04:52.559417 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:52.559417 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:52.559417 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: ff6ebb3a7af147e798fda92d7ea42b5e Oct 29 01:04:52.559417 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AggregatesAdminTestJSON-1829263483-project-admin Oct 29 01:04:52.559417 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:04:52.559417 n-d-862964-3 devstack@n-api.service[121099]: exception: Aggregate 12 could not be found. Oct 29 01:04:52.559417 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '12'} Oct 29 01:04:52.559417 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:52.560146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:52.560146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 29 01:04:52.560146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 29 01:04:52.560146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 01:04:52.560146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 01:04:52.560146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:52.560146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:52.560146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:52.560146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:52.560146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 01:04:52.560146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 01:04:52.560146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 29 01:04:52.560146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 01:04:52.560146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:04:52.560146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:04:52.560146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 01:04:52.560146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 01:04:52.560146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:04:52.560146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:52.561249 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:52.563675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:52.563675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:52.563675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:52.563675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 29 01:04:52.563675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:52.563675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-86f66aa0-7b7c-4b7a-b109-8ec163e544ec tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:52.572348 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-86f66aa0-7b7c-4b7a-b109-8ec163e544ec tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.045768 Oct 29 01:04:52.573674 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 140/290] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 29 01:04:52 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:04:52.590662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-76bb0640-204b-493d-8666-58ee40ed0b6d tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:52.594643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-76bb0640-204b-493d-8666-58ee40ed0b6d tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:52.740016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-53767671-8dc7-48f1-ab1a-5868e0e5547e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:52.758478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-76bb0640-204b-493d-8666-58ee40ed0b6d tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:52.768245 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-53767671-8dc7-48f1-ab1a-5868e0e5547e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1317 microversion: 2.1 time: 0.558903 Oct 29 01:04:52.771796 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 151/291] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:52 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:52.795423 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-76bb0640-204b-493d-8666-58ee40ed0b6d tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127" status: 200 len: 1218 microversion: 2.1 time: 0.216812 Oct 29 01:04:52.799372 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 141/292] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:52 2022] GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 => generated 1218 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:52.815267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a1dc97de-7d7b-40da-b11a-a7f7dcb515bd tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862964-3"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:52.821055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-08531b09-39e5-4a77-b85a-70031104f0c8 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2035886766", "name": "tempest-test_aggregate-662109035"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:52.840279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.aggregate [None req-08531b09-39e5-4a77-b85a-70031104f0c8 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Generated uuid 6e2e80d9-e174-4a8d-9b5d-167e6cd0d0c6 for aggregate {{(pid=121099) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:04:52.862843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1dc97de-7d7b-40da-b11a-a7f7dcb515bd tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:52.863605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1dc97de-7d7b-40da-b11a-a7f7dcb515bd tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:52.867981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1dc97de-7d7b-40da-b11a-a7f7dcb515bd tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:53.028274 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-08531b09-39e5-4a77-b85a-70031104f0c8 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.227415 Oct 29 01:04:53.029403 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 142/293] 10.222.0.26 () {60 vars in 1165 bytes} [Sat Oct 29 01:04:52 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:53.041750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b2fef014-8f2a-4d40-a600-23f9a5267adc tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:53.196728 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b2fef014-8f2a-4d40-a600-23f9a5267adc tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.158991 Oct 29 01:04:53.201355 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 143/294] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 29 01:04:53 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 29 01:04:53.210670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-94f7a2fc-3ce6-4d4a-9b69-056e8a918f26 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:53.232759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=6,nova_api:INSERT=7 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:53.243289 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-94f7a2fc-3ce6-4d4a-9b69-056e8a918f26 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-94f7a2fc-3ce6-4d4a-9b69-056e8a918f26 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Request method failure captured: Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHv6tkMFgk258Glcxd5gUfDwgle2-J5sTqYTFLrIE2S8zwbXK7zSjApB8T6bwoi0MCeRCx4KT1fQAdobOcnBUGDmkCSCWR2605a7feZxXIg1ApETrH5qryDnDn8HoYuEoOwUv0EuQsZRclWLzHSfZlZU4V_d3Kc5sBxbBDRCrZd7c2g Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: cd2a5af7cb164dc2872a253c8cb1e4ef Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AggregatesAdminTestJSON-1829263483 Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:04:53.248391 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:04:53.249888 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd2a5af7cb164dc2872a253c8cb1e4ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cd2a5af7cb164dc2872a253c8cb1e4ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd2a5af7cb164dc2872a253c8cb1e4ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cd2a5af7cb164dc2872a253c8cb1e4ef", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:53.249888 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AggregatesAdminTestJSON-1829263483 Oct 29 01:04:53.249888 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: cd2a5af7cb164dc2872a253c8cb1e4ef Oct 29 01:04:53.249888 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1829263483 Oct 29 01:04:53.249888 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AggregatesAdminTestJSON-1829263483-project-admin Oct 29 01:04:53.249888 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:53.249888 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:53.249888 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: ff6ebb3a7af147e798fda92d7ea42b5e Oct 29 01:04:53.249888 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AggregatesAdminTestJSON-1829263483-project-admin Oct 29 01:04:53.249888 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:04:53.249888 n-d-862964-3 devstack@n-api.service[121099]: exception: Aggregate 14 could not be found. Oct 29 01:04:53.249888 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '14'} Oct 29 01:04:53.249888 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:53.250767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:53.250767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 29 01:04:53.250767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 29 01:04:53.250767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 29 01:04:53.250767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 01:04:53.250767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:04:53.250767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:04:53.250767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 01:04:53.250767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 01:04:53.250767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:04:53.250767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:04:53.250767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 01:04:53.250767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 01:04:53.250767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 29 01:04:53.250767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:53.250767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:53.250767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:53.250767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:53.250767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:53.251998 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:53.251998 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:53.251998 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:53.251998 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:53.251998 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:53.251998 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 29 01:04:53.251998 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:04:53.251998 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 29 01:04:53.251998 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:53.251998 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:53.251998 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:53.251998 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:53.251998 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:53.251998 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:53.251998 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:53.251998 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:53.251998 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 29 01:04:53.251998 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:53.253353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-94f7a2fc-3ce6-4d4a-9b69-056e8a918f26 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:53.257316 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-94f7a2fc-3ce6-4d4a-9b69-056e8a918f26 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.050850 Oct 29 01:04:53.264534 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 144/295] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:04:53 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:04:53.281796 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a1dc97de-7d7b-40da-b11a-a7f7dcb515bd tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.487427 Oct 29 01:04:53.286087 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 152/296] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 29 01:04:52 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:53.292689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8737c305-99d7-4823-8d8d-ddbd5d44ef38 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:53.303369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5aaabcc6-b591-42bf-851f-c9797a838852 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:53.336259 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-8737c305-99d7-4823-8d8d-ddbd5d44ef38 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8737c305-99d7-4823-8d8d-ddbd5d44ef38 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Request method failure captured: Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHv6tkMFgk258Glcxd5gUfDwgle2-J5sTqYTFLrIE2S8zwbXK7zSjApB8T6bwoi0MCeRCx4KT1fQAdobOcnBUGDmkCSCWR2605a7feZxXIg1ApETrH5qryDnDn8HoYuEoOwUv0EuQsZRclWLzHSfZlZU4V_d3Kc5sBxbBDRCrZd7c2g Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: cd2a5af7cb164dc2872a253c8cb1e4ef Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AggregatesAdminTestJSON-1829263483 Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:04:53.341105 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:04:53.342722 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd2a5af7cb164dc2872a253c8cb1e4ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cd2a5af7cb164dc2872a253c8cb1e4ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cd2a5af7cb164dc2872a253c8cb1e4ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cd2a5af7cb164dc2872a253c8cb1e4ef", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:53.342722 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AggregatesAdminTestJSON-1829263483 Oct 29 01:04:53.342722 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: cd2a5af7cb164dc2872a253c8cb1e4ef Oct 29 01:04:53.342722 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1829263483 Oct 29 01:04:53.342722 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AggregatesAdminTestJSON-1829263483-project-admin Oct 29 01:04:53.342722 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:53.342722 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:53.342722 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: ff6ebb3a7af147e798fda92d7ea42b5e Oct 29 01:04:53.342722 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AggregatesAdminTestJSON-1829263483-project-admin Oct 29 01:04:53.342722 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:04:53.342722 n-d-862964-3 devstack@n-api.service[121099]: exception: Aggregate 14 could not be found. Oct 29 01:04:53.342722 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '14'} Oct 29 01:04:53.342722 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:53.343599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:53.343599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 29 01:04:53.343599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 29 01:04:53.343599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 01:04:53.343599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 01:04:53.343599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:53.343599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:53.343599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:53.343599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:53.343599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 01:04:53.343599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 01:04:53.343599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 29 01:04:53.343599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 01:04:53.343599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:04:53.343599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:04:53.343599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 01:04:53.343599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 01:04:53.343599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:04:53.343599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:53.344801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:53.347272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:53.347272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:53.347272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:53.347272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 29 01:04:53.347272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:53.347272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8737c305-99d7-4823-8d8d-ddbd5d44ef38 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:53.349680 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8737c305-99d7-4823-8d8d-ddbd5d44ef38 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.083424 Oct 29 01:04:53.352617 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 145/297] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 29 01:04:53 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:04:53.371155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f405645-e553-40f0-88bb-40650c387a28 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2078791222"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:53.385539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.aggregate [None req-1f405645-e553-40f0-88bb-40650c387a28 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Generated uuid 05f271d4-6c5d-4114-946b-7968d9c0610d for aggregate {{(pid=121099) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:04:53.428900 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5aaabcc6-b591-42bf-851f-c9797a838852 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.131646 Oct 29 01:04:53.429521 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 153/298] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 29 01:04:53 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 01:04:53.440430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-db477223-519e-445e-811d-0672d3f5c21b tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-492257218"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:53.456315 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.aggregate [None req-db477223-519e-445e-811d-0672d3f5c21b tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Generated uuid b8a0a86a-56bd-4eae-8af5-7fd8e24777e6 for aggregate {{(pid=121100) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:04:53.508748 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1f405645-e553-40f0-88bb-40650c387a28 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.150648 Oct 29 01:04:53.515978 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 146/299] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 29 01:04:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:53.522775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2074aa06-eb97-471c-974e-be06927cf325 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:53.550584 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2074aa06-eb97-471c-974e-be06927cf325 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 228 microversion: 2.1 time: 0.032427 Oct 29 01:04:53.559774 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 147/300] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:04:53 2022] GET /compute/v2.1/os-aggregates/15 => generated 228 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:04:53.565545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5a53a891-ef80-49ef-a0da-6c5713f32f5f tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:53.605875 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-db477223-519e-445e-811d-0672d3f5c21b tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.168869 Oct 29 01:04:53.607109 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 154/301] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 29 01:04:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:53.624818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a44d8493-15ee-4d05-9cbc-2efcd05e23f8 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:53.637924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a44d8493-15ee-4d05-9cbc-2efcd05e23f8 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:53.638954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a44d8493-15ee-4d05-9cbc-2efcd05e23f8 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:53.639906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a44d8493-15ee-4d05-9cbc-2efcd05e23f8 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:53.648573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a44d8493-15ee-4d05-9cbc-2efcd05e23f8 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:53.649720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a44d8493-15ee-4d05-9cbc-2efcd05e23f8 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:53.650431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a44d8493-15ee-4d05-9cbc-2efcd05e23f8 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:53.662619 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.compute.aggregates [None req-a44d8493-15ee-4d05-9cbc-2efcd05e23f8 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 29 01:04:53.664594 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-a44d8493-15ee-4d05-9cbc-2efcd05e23f8 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a44d8493-15ee-4d05-9cbc-2efcd05e23f8 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Request method failure captured: Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 42 Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHv7y8fShnsI63katGEm0WgeH2Kbxb39HiH2QfZWEo35_i0CM4MysUy3T68MF-S5HdOozTWeGWIMRqxpzlKGzDHSCr88YvTwNGZc6Vc9h6bMGWUs__LxLXaKSakCIT0In3KWZiVycXo6zG2reiAiUr-bhYYkiK6Zw7Ip62YHXMFXVgQ Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 86f9981226e344ae85143aae56266c16 Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:04:53.667826 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:04:53.673834 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86f9981226e344ae85143aae56266c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/86f9981226e344ae85143aae56266c16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86f9981226e344ae85143aae56266c16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_86f9981226e344ae85143aae56266c16", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:53.673834 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:53.673834 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 86f9981226e344ae85143aae56266c16 Oct 29 01:04:53.673834 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483 Oct 29 01:04:53.673834 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin Oct 29 01:04:53.673834 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:04:53.673834 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:04:53.673834 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 2c3f8d72ff964f3abf72457e6db8e408 Oct 29 01:04:53.673834 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin Oct 29 01:04:53.673834 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:04:53.673834 n-d-862964-3 devstack@n-api.service[121100]: {"remove_host": {"host": "nonexist_host"}} Oct 29 01:04:53.673834 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:04:53.673834 n-d-862964-3 devstack@n-api.service[121100]: exception: Cannot remove host nonexist_host in aggregate 16 Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 29 01:04:53.674818 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 29 01:04:53.676116 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:53.677330 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:53.678492 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:53.678492 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:53.678492 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:53.678492 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:53.678492 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Oct 29 01:04:53.678492 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:04:53.683265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a44d8493-15ee-4d05-9cbc-2efcd05e23f8 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:53.684152 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a44d8493-15ee-4d05-9cbc-2efcd05e23f8 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.065759 Oct 29 01:04:53.696210 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 155/302] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 29 01:04:53 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:04:53.698501 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5a53a891-ef80-49ef-a0da-6c5713f32f5f tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 266 microversion: 2.1 time: 0.136213 Oct 29 01:04:53.706529 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 148/303] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 29 01:04:53 2022] POST /compute/v2.1/os-aggregates/15/action => generated 266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:04:53.710450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-08e42cd3-0d8c-40e5-a964-247c49acc8b8 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:53.720849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c7e8b712-ecf6-441b-8d55-9301ae79d3db tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:53.740540 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c7e8b712-ecf6-441b-8d55-9301ae79d3db tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 242 microversion: 2.1 time: 0.031173 Oct 29 01:04:53.741881 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 149/304] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:04:53 2022] GET /compute/v2.1/os-aggregates/15 => generated 242 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:53.752849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-94027aee-b1af-451d-9f18-9671c2ab3cd3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:53.753520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-94027aee-b1af-451d-9f18-9671c2ab3cd3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:53.760876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94027aee-b1af-451d-9f18-9671c2ab3cd3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:53.761871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94027aee-b1af-451d-9f18-9671c2ab3cd3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:53.762316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94027aee-b1af-451d-9f18-9671c2ab3cd3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:53.763089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94027aee-b1af-451d-9f18-9671c2ab3cd3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:53.764127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94027aee-b1af-451d-9f18-9671c2ab3cd3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:53.764742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94027aee-b1af-451d-9f18-9671c2ab3cd3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:53.853933 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-08e42cd3-0d8c-40e5-a964-247c49acc8b8 tempest-AggregatesAdminNegativeTestJSON-1145993483 tempest-AggregatesAdminNegativeTestJSON-1145993483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.143581 Oct 29 01:04:53.854803 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 156/305] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 29 01:04:53 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 01:04:53.871561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-476df185-55a7-48d7-b55d-c0020566598e req-3165d082-741d-4914-bb0a-5b4509a522bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f061780f-e530-42cd-8c3d-021d7e63a22f", "tag": "0ef4060b-e698-4221-b1fb-3c5bdfd3cba2"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:53.904564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-476df185-55a7-48d7-b55d-c0020566598e req-3165d082-741d-4914-bb0a-5b4509a522bd service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:53.907569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-476df185-55a7-48d7-b55d-c0020566598e req-3165d082-741d-4914-bb0a-5b4509a522bd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:53.907908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-476df185-55a7-48d7-b55d-c0020566598e req-3165d082-741d-4914-bb0a-5b4509a522bd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:53.943800 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-476df185-55a7-48d7-b55d-c0020566598e req-3165d082-741d-4914-bb0a-5b4509a522bd service nova] Creating event network-changed:0ef4060b-e698-4221-b1fb-3c5bdfd3cba2 for instance f061780f-e530-42cd-8c3d-021d7e63a22f on n-h2-862964-3 Oct 29 01:04:53.958631 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-476df185-55a7-48d7-b55d-c0020566598e req-3165d082-741d-4914-bb0a-5b4509a522bd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096823 Oct 29 01:04:53.959274 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 157/306] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:53.975172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d5215c55-cfc9-4b8b-b376-886b0456bba4 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:54.066679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-94027aee-b1af-451d-9f18-9671c2ab3cd3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:54.077651 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-94027aee-b1af-451d-9f18-9671c2ab3cd3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 200 len: 1584 microversion: 2.1 time: 0.331290 Oct 29 01:04:54.078397 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 150/307] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:53 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 1584 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:54.092466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5a1f2176-9b63-440f-80c5-89758be19d20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:54.092466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5a1f2176-9b63-440f-80c5-89758be19d20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:54.108432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a1f2176-9b63-440f-80c5-89758be19d20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:54.108877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a1f2176-9b63-440f-80c5-89758be19d20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:54.109764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a1f2176-9b63-440f-80c5-89758be19d20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:54.112061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a1f2176-9b63-440f-80c5-89758be19d20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:54.112399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a1f2176-9b63-440f-80c5-89758be19d20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:54.122331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a1f2176-9b63-440f-80c5-89758be19d20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:54.130227 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d5215c55-cfc9-4b8b-b376-886b0456bba4 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.157500 Oct 29 01:04:54.135394 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 158/308] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 29 01:04:53 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 01:04:54.144030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cd08b0f4-1ee5-42e5-8238-640b9675bafe tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:54.149560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cd08b0f4-1ee5-42e5-8238-640b9675bafe tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:54.391814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cd08b0f4-1ee5-42e5-8238-640b9675bafe tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:54.401017 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cd08b0f4-1ee5-42e5-8238-640b9675bafe tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127" status: 200 len: 1218 microversion: 2.1 time: 0.264221 Oct 29 01:04:54.405296 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 159/309] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:54 2022] GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 => generated 1218 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:54.433605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-73cbeec1-545f-492c-ae97-e0b0127e1d74 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-716220707", "availability_zone": "tempest-test_az-2125079325"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:54.470473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.aggregate [None req-73cbeec1-545f-492c-ae97-e0b0127e1d74 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Generated uuid b2a407a2-4638-4c18-a21d-5b83af9a9f19 for aggregate {{(pid=121100) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:04:54.602056 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-73cbeec1-545f-492c-ae97-e0b0127e1d74 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.193849 Oct 29 01:04:54.602669 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 160/310] 10.222.0.26 () {60 vars in 1165 bytes} [Sat Oct 29 01:04:54 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:54.616395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1aeeba03-b167-4e59-a71d-a550822dd24a tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-716220707_new", "availability_zone": "tempest-test_az-2125079325_new"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:54.641497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5a1f2176-9b63-440f-80c5-89758be19d20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:54.655520 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5a1f2176-9b63-440f-80c5-89758be19d20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1317 microversion: 2.1 time: 0.574625 Oct 29 01:04:54.656200 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 151/311] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:54 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1317 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:54.838631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1aeeba03-b167-4e59-a71d-a550822dd24a tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:54.839464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1aeeba03-b167-4e59-a71d-a550822dd24a tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:54.840724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1aeeba03-b167-4e59-a71d-a550822dd24a tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:55.026537 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1aeeba03-b167-4e59-a71d-a550822dd24a tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 336 microversion: 2.1 time: 0.414523 Oct 29 01:04:55.027162 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 161/312] 10.222.0.26 () {60 vars in 1173 bytes} [Sat Oct 29 01:04:54 2022] PUT /compute/v2.1/os-aggregates/17 => generated 336 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:04:55.039644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-465041d5-79ea-4aa5-8374-7e211e0cd12a tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:55.063467 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-465041d5-79ea-4aa5-8374-7e211e0cd12a tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.028374 Oct 29 01:04:55.064295 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 152/313] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 29 01:04:55 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:55.077059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-837f609d-0e57-4da6-82d8-3cc1810a828e tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:55.432042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c1374ac8-e6c7-4af2-ab33-c0fd5045a7cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:55.432903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c1374ac8-e6c7-4af2-ab33-c0fd5045a7cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:55.444516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1374ac8-e6c7-4af2-ab33-c0fd5045a7cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:55.445342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1374ac8-e6c7-4af2-ab33-c0fd5045a7cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:55.446011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1374ac8-e6c7-4af2-ab33-c0fd5045a7cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:55.446777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1374ac8-e6c7-4af2-ab33-c0fd5045a7cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:55.447398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1374ac8-e6c7-4af2-ab33-c0fd5045a7cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:55.448120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1374ac8-e6c7-4af2-ab33-c0fd5045a7cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:55.477628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:04:55.559624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c1374ac8-e6c7-4af2-ab33-c0fd5045a7cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:55.567096 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c1374ac8-e6c7-4af2-ab33-c0fd5045a7cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127" status: 200 len: 1214 microversion: 2.1 time: 0.138576 Oct 29 01:04:55.580229 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 153/314] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:55 2022] GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:04:55.611934 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-837f609d-0e57-4da6-82d8-3cc1810a828e tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.535715 Oct 29 01:04:55.615723 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 162/315] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 29 01:04:55 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 01:04:55.630913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4d421491-ffae-4a95-9e3a-8b69a18e54bd tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-219567393"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:55.634972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.aggregate [None req-4d421491-ffae-4a95-9e3a-8b69a18e54bd tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Generated uuid 5b63f23b-5a3c-4f1a-85ce-28b2e147df92 for aggregate {{(pid=121099) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:04:55.683248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1a086c50-cafa-4e36-a087-61832bcad1a7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:55.684105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1a086c50-cafa-4e36-a087-61832bcad1a7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:55.690774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a086c50-cafa-4e36-a087-61832bcad1a7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:55.700226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a086c50-cafa-4e36-a087-61832bcad1a7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:55.701333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a086c50-cafa-4e36-a087-61832bcad1a7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:55.704249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a086c50-cafa-4e36-a087-61832bcad1a7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:55.704947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a086c50-cafa-4e36-a087-61832bcad1a7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:55.705439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a086c50-cafa-4e36-a087-61832bcad1a7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:55.808825 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4d421491-ffae-4a95-9e3a-8b69a18e54bd tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.182293 Oct 29 01:04:55.811425 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 154/316] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 29 01:04:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:55.825912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4b3a00a7-c81e-4c51-8eda-a8c3484a9d6d tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:55.840536 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4b3a00a7-c81e-4c51-8eda-a8c3484a9d6d tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.017998 Oct 29 01:04:55.844046 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 155/317] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 29 01:04:55 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:04:55.893360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-516d908e-91a1-4081-8bde-8e896ebccf64 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:56.089164 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-516d908e-91a1-4081-8bde-8e896ebccf64 tempest-AggregatesAdminTestJSON-1829263483 tempest-AggregatesAdminTestJSON-1829263483-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.237703 Oct 29 01:04:56.089786 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 156/318] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 29 01:04:55 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 29 01:04:56.100267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-424725e1-418a-44f5-9b1f-986664186871 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:56.103083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-424725e1-418a-44f5-9b1f-986664186871 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:56.127355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-424725e1-418a-44f5-9b1f-986664186871 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:56.131953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-424725e1-418a-44f5-9b1f-986664186871 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:56.131953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-424725e1-418a-44f5-9b1f-986664186871 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:56.131953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-424725e1-418a-44f5-9b1f-986664186871 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:56.131953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-424725e1-418a-44f5-9b1f-986664186871 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:56.132318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-424725e1-418a-44f5-9b1f-986664186871 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:56.153429 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-424725e1-418a-44f5-9b1f-986664186871 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] HTTP exception thrown: Instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab could not be found. Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-424725e1-418a-44f5-9b1f-986664186871 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Request method failure captured: Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab HTTP/1.1 Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHv3QuJBS1vK2EmFFl04y27u7Mj9bPd78wA8w-4sayDpHsFOt1gZjZz6tJ9uytuNyXKeszYqgOzkAg9a3x6P_pXG1-VaEg_SLVMahaD2EPJdexTUcOknBzpEN1-aC_TySd6iU1_pCyJs3hLgM6-w_cAK-x9V4rDD5W79-fTjXwvf9Gc Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 73949a2336ba4121922600fa26b4af43 Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AggregatesAdminTestJSON-155089787 Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:04:56.155690 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:04:56.156976 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/73949a2336ba4121922600fa26b4af43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/73949a2336ba4121922600fa26b4af43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/73949a2336ba4121922600fa26b4af43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_73949a2336ba4121922600fa26b4af43", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:56.156976 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AggregatesAdminTestJSON-155089787 Oct 29 01:04:56.156976 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 73949a2336ba4121922600fa26b4af43 Oct 29 01:04:56.156976 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-155089787 Oct 29 01:04:56.156976 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AggregatesAdminTestJSON-155089787-project Oct 29 01:04:56.156976 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:56.156976 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:56.156976 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: c5f2373aa70c4119843b4f019bd4ea62 Oct 29 01:04:56.156976 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AggregatesAdminTestJSON-155089787-project Oct 29 01:04:56.156976 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:04:56.156976 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab could not be found. Oct 29 01:04:56.156976 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '4ea9fe51-2e94-4205-959b-c9687e60b4ab'} Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab could not be found. Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:56.161297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab could not be found. Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab could not be found. Oct 29 01:04:56.162496 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:56.163664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-424725e1-418a-44f5-9b1f-986664186871 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Returning 404 to user: Instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:56.163664 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-424725e1-418a-44f5-9b1f-986664186871 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 404 len: 111 microversion: 2.1 time: 0.062750 Oct 29 01:04:56.163664 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 157/319] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:04:56 2022] DELETE /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:04:56.169027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-01ef4510-1b90-4357-a2ea-1cc90e0cb8e8 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:56.169719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-01ef4510-1b90-4357-a2ea-1cc90e0cb8e8 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] [instance: 4ea9fe51-2e94-4205-959b-c9687e60b4ab] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:56.177278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01ef4510-1b90-4357-a2ea-1cc90e0cb8e8 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:56.177798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01ef4510-1b90-4357-a2ea-1cc90e0cb8e8 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:56.178275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01ef4510-1b90-4357-a2ea-1cc90e0cb8e8 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:56.179814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01ef4510-1b90-4357-a2ea-1cc90e0cb8e8 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:56.180477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01ef4510-1b90-4357-a2ea-1cc90e0cb8e8 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:56.181614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01ef4510-1b90-4357-a2ea-1cc90e0cb8e8 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:56.204378 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-01ef4510-1b90-4357-a2ea-1cc90e0cb8e8 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] HTTP exception thrown: Instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab could not be found. Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-01ef4510-1b90-4357-a2ea-1cc90e0cb8e8 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Request method failure captured: Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab HTTP/1.1 Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHv3QuJBS1vK2EmFFl04y27u7Mj9bPd78wA8w-4sayDpHsFOt1gZjZz6tJ9uytuNyXKeszYqgOzkAg9a3x6P_pXG1-VaEg_SLVMahaD2EPJdexTUcOknBzpEN1-aC_TySd6iU1_pCyJs3hLgM6-w_cAK-x9V4rDD5W79-fTjXwvf9Gc Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 73949a2336ba4121922600fa26b4af43 Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AggregatesAdminTestJSON-155089787 Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:04:56.206922 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:04:56.209052 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/73949a2336ba4121922600fa26b4af43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/73949a2336ba4121922600fa26b4af43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/73949a2336ba4121922600fa26b4af43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_73949a2336ba4121922600fa26b4af43", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:04:56.209052 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AggregatesAdminTestJSON-155089787 Oct 29 01:04:56.209052 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 73949a2336ba4121922600fa26b4af43 Oct 29 01:04:56.209052 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-155089787 Oct 29 01:04:56.209052 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AggregatesAdminTestJSON-155089787-project Oct 29 01:04:56.209052 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:04:56.209052 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:04:56.209052 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: c5f2373aa70c4119843b4f019bd4ea62 Oct 29 01:04:56.209052 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AggregatesAdminTestJSON-155089787-project Oct 29 01:04:56.209052 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:04:56.209052 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab could not be found. Oct 29 01:04:56.209052 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '4ea9fe51-2e94-4205-959b-c9687e60b4ab'} Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab could not be found. Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:04:56.209888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:04:56.211191 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:04:56.211191 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:04:56.211191 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:04:56.211191 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:04:56.211191 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:04:56.211191 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:04:56.211191 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:04:56.211191 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab could not be found. Oct 29 01:04:56.211191 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:56.211191 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:04:56.211191 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:56.211191 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:04:56.211191 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:04:56.211191 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:04:56.211191 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:04:56.211191 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:04:56.211191 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab could not be found. Oct 29 01:04:56.211191 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:04:56.224711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-01ef4510-1b90-4357-a2ea-1cc90e0cb8e8 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] Returning 404 to user: Instance 4ea9fe51-2e94-4205-959b-c9687e60b4ab could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:04:56.225734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1a086c50-cafa-4e36-a087-61832bcad1a7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:56.227030 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-01ef4510-1b90-4357-a2ea-1cc90e0cb8e8 tempest-AggregatesAdminTestJSON-155089787 tempest-AggregatesAdminTestJSON-155089787-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab" status: 404 len: 111 microversion: 2.1 time: 0.063317 Oct 29 01:04:56.239276 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 158/320] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:56 2022] GET /compute/v2.1/servers/4ea9fe51-2e94-4205-959b-c9687e60b4ab => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:04:56.239492 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1a086c50-cafa-4e36-a087-61832bcad1a7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1317 microversion: 2.1 time: 0.557932 Oct 29 01:04:56.239492 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 163/321] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:55 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1317 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:04:56.595320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-688a02c2-161a-445c-8eda-1ab0faf0f817 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:56.596634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-688a02c2-161a-445c-8eda-1ab0faf0f817 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:56.647919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-688a02c2-161a-445c-8eda-1ab0faf0f817 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:56.648531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-688a02c2-161a-445c-8eda-1ab0faf0f817 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:56.652862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-688a02c2-161a-445c-8eda-1ab0faf0f817 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:56.662650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-688a02c2-161a-445c-8eda-1ab0faf0f817 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:56.665991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-ef4ed8c8-125f-44b6-8b1f-cecf64f4fc73 req-29cecdc6-16c7-4424-b393-e886e7b19320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a5a9b1-7f02-4874-83d4-c48badd76f5f", "name": "network-vif-plugged", "status": "completed", "tag": "92316f92-4129-4d3d-a8ad-df5607e5d4e5"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:04:56.670669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-688a02c2-161a-445c-8eda-1ab0faf0f817 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:56.675104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-688a02c2-161a-445c-8eda-1ab0faf0f817 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:56.734992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ef4ed8c8-125f-44b6-8b1f-cecf64f4fc73 req-29cecdc6-16c7-4424-b393-e886e7b19320 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:56.736690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ef4ed8c8-125f-44b6-8b1f-cecf64f4fc73 req-29cecdc6-16c7-4424-b393-e886e7b19320 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.049s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:56.741377 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ef4ed8c8-125f-44b6-8b1f-cecf64f4fc73 req-29cecdc6-16c7-4424-b393-e886e7b19320 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:56.768710 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-ef4ed8c8-125f-44b6-8b1f-cecf64f4fc73 req-29cecdc6-16c7-4424-b393-e886e7b19320 service nova] Creating event network-vif-plugged:92316f92-4129-4d3d-a8ad-df5607e5d4e5 for instance a9a5a9b1-7f02-4874-83d4-c48badd76f5f on n-h2-862964-3 Oct 29 01:04:56.794421 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-ef4ed8c8-125f-44b6-8b1f-cecf64f4fc73 req-29cecdc6-16c7-4424-b393-e886e7b19320 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133959 Oct 29 01:04:56.798820 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 164/322] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:04:57.001705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-688a02c2-161a-445c-8eda-1ab0faf0f817 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:57.016657 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-688a02c2-161a-445c-8eda-1ab0faf0f817 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127" status: 200 len: 1278 microversion: 2.1 time: 0.425147 Oct 29 01:04:57.019583 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 159/323] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:56 2022] GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 => generated 1278 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:57.263074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-20ec180c-df8e-4598-b3dd-54a3ff571e37 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:57.264257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-20ec180c-df8e-4598-b3dd-54a3ff571e37 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:57.276141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20ec180c-df8e-4598-b3dd-54a3ff571e37 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:57.277019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20ec180c-df8e-4598-b3dd-54a3ff571e37 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:57.280909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20ec180c-df8e-4598-b3dd-54a3ff571e37 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:57.282019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20ec180c-df8e-4598-b3dd-54a3ff571e37 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:57.282761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20ec180c-df8e-4598-b3dd-54a3ff571e37 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:57.283945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20ec180c-df8e-4598-b3dd-54a3ff571e37 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:57.657416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-20ec180c-df8e-4598-b3dd-54a3ff571e37 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:57.672326 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-20ec180c-df8e-4598-b3dd-54a3ff571e37 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1317 microversion: 2.1 time: 0.412783 Oct 29 01:04:57.674668 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 165/324] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:57 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:58.039178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d85bf5e9-5652-48bf-aaf0-b7aef3defac4 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:58.039917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d85bf5e9-5652-48bf-aaf0-b7aef3defac4 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:58.054803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d85bf5e9-5652-48bf-aaf0-b7aef3defac4 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:58.055425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d85bf5e9-5652-48bf-aaf0-b7aef3defac4 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:58.057654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d85bf5e9-5652-48bf-aaf0-b7aef3defac4 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:58.058518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d85bf5e9-5652-48bf-aaf0-b7aef3defac4 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:58.059100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d85bf5e9-5652-48bf-aaf0-b7aef3defac4 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:58.062679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d85bf5e9-5652-48bf-aaf0-b7aef3defac4 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:58.190466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d85bf5e9-5652-48bf-aaf0-b7aef3defac4 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:58.203891 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d85bf5e9-5652-48bf-aaf0-b7aef3defac4 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127" status: 200 len: 1276 microversion: 2.1 time: 0.169712 Oct 29 01:04:58.221410 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 160/325] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:58 2022] GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:58.700883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a733008f-1eb4-4400-be7c-29346b7d1fea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:58.702246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a733008f-1eb4-4400-be7c-29346b7d1fea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:58.715021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a733008f-1eb4-4400-be7c-29346b7d1fea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:58.720878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a733008f-1eb4-4400-be7c-29346b7d1fea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:58.720878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a733008f-1eb4-4400-be7c-29346b7d1fea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:58.720878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a733008f-1eb4-4400-be7c-29346b7d1fea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:58.720878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a733008f-1eb4-4400-be7c-29346b7d1fea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:58.721633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a733008f-1eb4-4400-be7c-29346b7d1fea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:59.141452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a733008f-1eb4-4400-be7c-29346b7d1fea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:59.163428 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a733008f-1eb4-4400-be7c-29346b7d1fea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1317 microversion: 2.1 time: 0.464121 Oct 29 01:04:59.166397 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 166/326] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:58 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:04:59.229126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-43119381-5dd8-4fcd-b9a5-c98beb5ad855 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:04:59.230417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-43119381-5dd8-4fcd-b9a5-c98beb5ad855 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:04:59.241710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43119381-5dd8-4fcd-b9a5-c98beb5ad855 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:59.242554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43119381-5dd8-4fcd-b9a5-c98beb5ad855 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:59.243039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43119381-5dd8-4fcd-b9a5-c98beb5ad855 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:59.243769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43119381-5dd8-4fcd-b9a5-c98beb5ad855 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:04:59.244229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43119381-5dd8-4fcd-b9a5-c98beb5ad855 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:04:59.244650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43119381-5dd8-4fcd-b9a5-c98beb5ad855 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:04:59.690426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-43119381-5dd8-4fcd-b9a5-c98beb5ad855 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:04:59.722049 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-43119381-5dd8-4fcd-b9a5-c98beb5ad855 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127" status: 200 len: 1318 microversion: 2.1 time: 0.497045 Oct 29 01:04:59.739251 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 161/327] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:04:59 2022] GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 => generated 1318 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:00.197268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4ebde72b-8702-4124-a6da-5f989b78a8a4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:00.198033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4ebde72b-8702-4124-a6da-5f989b78a8a4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:00.213134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ebde72b-8702-4124-a6da-5f989b78a8a4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:00.213799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ebde72b-8702-4124-a6da-5f989b78a8a4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:00.217180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ebde72b-8702-4124-a6da-5f989b78a8a4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:00.221501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ebde72b-8702-4124-a6da-5f989b78a8a4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:00.222364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ebde72b-8702-4124-a6da-5f989b78a8a4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:00.223902 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ebde72b-8702-4124-a6da-5f989b78a8a4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:00.753061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f861e75e-a5f4-400a-89f7-f9394589a49f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:00.756599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f861e75e-a5f4-400a-89f7-f9394589a49f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:00.769187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f861e75e-a5f4-400a-89f7-f9394589a49f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:00.769714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f861e75e-a5f4-400a-89f7-f9394589a49f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:00.776243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f861e75e-a5f4-400a-89f7-f9394589a49f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:00.782082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f861e75e-a5f4-400a-89f7-f9394589a49f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:00.784976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f861e75e-a5f4-400a-89f7-f9394589a49f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:00.786143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f861e75e-a5f4-400a-89f7-f9394589a49f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:01.198668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4ebde72b-8702-4124-a6da-5f989b78a8a4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:01.212690 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4ebde72b-8702-4124-a6da-5f989b78a8a4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1467 microversion: 2.1 time: 1.025004 Oct 29 01:05:01.213708 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 167/328] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:00 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1467 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:01.538261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f861e75e-a5f4-400a-89f7-f9394589a49f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:01.555541 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f861e75e-a5f4-400a-89f7-f9394589a49f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127" status: 200 len: 1318 microversion: 2.1 time: 0.808729 Oct 29 01:05:01.556504 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 162/329] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:00 2022] GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 => generated 1318 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:01.571208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4d1c23f3-763a-4e16-a397-369c60d7a974 req-f9e97150-ab27-414e-afb7-e5f119770c57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f551ae9b-dc1f-4352-98e5-9fe95c860127", "tag": "9eceb19a-6248-4650-b85b-c8eadd87a690"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:01.593795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4d1c23f3-763a-4e16-a397-369c60d7a974 req-f9e97150-ab27-414e-afb7-e5f119770c57 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:01.594513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4d1c23f3-763a-4e16-a397-369c60d7a974 req-f9e97150-ab27-414e-afb7-e5f119770c57 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:01.595118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4d1c23f3-763a-4e16-a397-369c60d7a974 req-f9e97150-ab27-414e-afb7-e5f119770c57 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:01.617765 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4d1c23f3-763a-4e16-a397-369c60d7a974 req-f9e97150-ab27-414e-afb7-e5f119770c57 service nova] Creating event network-changed:9eceb19a-6248-4650-b85b-c8eadd87a690 for instance f551ae9b-dc1f-4352-98e5-9fe95c860127 on n-h1-862964-3 Oct 29 01:05:01.630684 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4d1c23f3-763a-4e16-a397-369c60d7a974 req-f9e97150-ab27-414e-afb7-e5f119770c57 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070746 Oct 29 01:05:01.632070 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 163/330] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:01.768950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-39cfefec-8a48-4d70-9bfa-5fe8ae471418 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:01.770239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-39cfefec-8a48-4d70-9bfa-5fe8ae471418 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:01.780756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39cfefec-8a48-4d70-9bfa-5fe8ae471418 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:01.781648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39cfefec-8a48-4d70-9bfa-5fe8ae471418 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:01.785941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39cfefec-8a48-4d70-9bfa-5fe8ae471418 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:01.787082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39cfefec-8a48-4d70-9bfa-5fe8ae471418 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:01.788648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39cfefec-8a48-4d70-9bfa-5fe8ae471418 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:01.789385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39cfefec-8a48-4d70-9bfa-5fe8ae471418 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:02.163591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=9 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:02.466802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1d5b650c-0bae-467a-bdd4-d2ed89662a68 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1132220415", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:02.578487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-1d5b650c-0bae-467a-bdd4-d2ed89662a68 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] validate_networks() for None {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:05:02.765048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=26 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:02.930009 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-39cfefec-8a48-4d70-9bfa-5fe8ae471418 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1618 microversion: 2.1 time: 1.675987 Oct 29 01:05:02.931531 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 168/331] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:01 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1618 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:02.938179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a587a278-1153-4211-879c-b75d03c6e87b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:02.944542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a587a278-1153-4211-879c-b75d03c6e87b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:02.965039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a587a278-1153-4211-879c-b75d03c6e87b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:02.965795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a587a278-1153-4211-879c-b75d03c6e87b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:02.968864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a587a278-1153-4211-879c-b75d03c6e87b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:02.974626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a587a278-1153-4211-879c-b75d03c6e87b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:02.975458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a587a278-1153-4211-879c-b75d03c6e87b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:02.976081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a587a278-1153-4211-879c-b75d03c6e87b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:03.646559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:04.045421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1d5b650c-0bae-467a-bdd4-d2ed89662a68 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:05:04.045960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1d5b650c-0bae-467a-bdd4-d2ed89662a68 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:05:04.047176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1d5b650c-0bae-467a-bdd4-d2ed89662a68 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:05:04.047604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1d5b650c-0bae-467a-bdd4-d2ed89662a68 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:05:04.048037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1d5b650c-0bae-467a-bdd4-d2ed89662a68 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:05:04.060842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d5b650c-0bae-467a-bdd4-d2ed89662a68 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:04.063757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d5b650c-0bae-467a-bdd4-d2ed89662a68 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:04.064277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d5b650c-0bae-467a-bdd4-d2ed89662a68 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:04.065094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d5b650c-0bae-467a-bdd4-d2ed89662a68 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:04.065615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d5b650c-0bae-467a-bdd4-d2ed89662a68 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:04.066049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d5b650c-0bae-467a-bdd4-d2ed89662a68 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:04.087241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-1d5b650c-0bae-467a-bdd4-d2ed89662a68 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Getting quotas for project 61912f5be1a14ceaadbf630612a0ac6d. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:04.092234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-1d5b650c-0bae-467a-bdd4-d2ed89662a68 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Getting quotas for user 09a2047f41174f5fbf1fc11d515c90c6 and project 61912f5be1a14ceaadbf630612a0ac6d. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:04.106217 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a587a278-1153-4211-879c-b75d03c6e87b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:04.114228 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a587a278-1153-4211-879c-b75d03c6e87b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127" status: 200 len: 1318 microversion: 2.1 time: 1.181381 Oct 29 01:05:04.115188 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 169/332] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:02 2022] GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 => generated 1318 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:04.120063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ab84bf02-d48c-4e6b-b54b-b7bfaabe023c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Action: 'create', calling method: .version_select at 0x7f9d9c79b040>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-112419077", "policies": ["affinity"]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:04.123816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1d5b650c-0bae-467a-bdd4-d2ed89662a68 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:05:04.126993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1d5b650c-0bae-467a-bdd4-d2ed89662a68 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:05:04.161583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-ab84bf02-d48c-4e6b-b54b-b7bfaabe023c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_groups'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:04.166968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-ab84bf02-d48c-4e6b-b54b-b7bfaabe023c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for user 175bb8f8b330495394cd401223847733 and project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_groups'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:04.203022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:DELETE=11,nova_api:SELECT=82,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:04.322622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-ab84bf02-d48c-4e6b-b54b-b7bfaabe023c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_groups'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:04.328646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-ab84bf02-d48c-4e6b-b54b-b7bfaabe023c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for user 175bb8f8b330495394cd401223847733 and project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_groups'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:04.347496 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ab84bf02-d48c-4e6b-b54b-b7bfaabe023c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.231046 Oct 29 01:05:04.349020 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 170/333] 10.222.0.26 () {60 vars in 1174 bytes} [Sat Oct 29 01:05:04 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:04.377528 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1d5b650c-0bae-467a-bdd4-d2ed89662a68 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.469785 Oct 29 01:05:04.408992 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 164/334] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:05:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:05:04.433581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-01366c09-26e2-4050-ab6b-a08bb1076866 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:04.440726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-01366c09-26e2-4050-ab6b-a08bb1076866 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:04.589066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-01366c09-26e2-4050-ab6b-a08bb1076866 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:04.600471 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-01366c09-26e2-4050-ab6b-a08bb1076866 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1214 microversion: 2.1 time: 0.189862 Oct 29 01:05:04.620018 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 165/335] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:04 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1214 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:04.652300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-44248391", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "19f66753-9f29-4847-90a4-a634f869da7a"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:04.747944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] validate_networks() for None {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:05:05.027264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7f763ce2-b437-41b9-b927-aa62de99f4e5 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-406954736", "ram": 512, "vcpus": 1, "disk": 10, "id": 1995057356, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:05.168603 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7f763ce2-b437-41b9-b927-aa62de99f4e5 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.818148 Oct 29 01:05:05.169861 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 171/336] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:05:04 2022] POST /compute/v2.1/flavors => generated 415 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:05.252551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-92aa7a76-b318-4fb1-aafa-e3851b79b3c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-905827325", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:05.317453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-92aa7a76-b318-4fb1-aafa-e3851b79b3c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] validate_networks() for None {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:05:05.321682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:05:05.322225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:05:05.322555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:05:05.322965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:05:05.323372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:05:05.354049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:05.355354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:05.355943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:05.356845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:05.357516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:05.358121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:05.378654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for project fba91819dd56439daea17217c5d7b9b7. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:05.388768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for user 175bb8f8b330495394cd401223847733 and project fba91819dd56439daea17217c5d7b9b7. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:05.411985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Going to run 2 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:05:05.414568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e328b4b4-473e-44af-9260-e3e1df072c09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:05:05.551674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=121099) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 29 01:05:05.575483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:05.579678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for user 175bb8f8b330495394cd401223847733 and project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:05.589112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:DELETE=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:05.596212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-92aa7a76-b318-4fb1-aafa-e3851b79b3c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:05:05.596641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-92aa7a76-b318-4fb1-aafa-e3851b79b3c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:05:05.597120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-92aa7a76-b318-4fb1-aafa-e3851b79b3c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:05:05.597578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-92aa7a76-b318-4fb1-aafa-e3851b79b3c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:05:05.598701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-92aa7a76-b318-4fb1-aafa-e3851b79b3c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:05:05.608598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-92aa7a76-b318-4fb1-aafa-e3851b79b3c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:05.609095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-92aa7a76-b318-4fb1-aafa-e3851b79b3c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:05.609808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-92aa7a76-b318-4fb1-aafa-e3851b79b3c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:05.610454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-92aa7a76-b318-4fb1-aafa-e3851b79b3c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:05.611086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-92aa7a76-b318-4fb1-aafa-e3851b79b3c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:05.611663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-92aa7a76-b318-4fb1-aafa-e3851b79b3c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:05.631728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-92aa7a76-b318-4fb1-aafa-e3851b79b3c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Getting quotas for project f53e974fb417481e99277df8d9bf81d5. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:05.635974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-92aa7a76-b318-4fb1-aafa-e3851b79b3c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Getting quotas for user f5c2ae31500e4a59a468e0362a9c75d2 and project f53e974fb417481e99277df8d9bf81d5. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:05.650818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-92aa7a76-b318-4fb1-aafa-e3851b79b3c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:05:05.653955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-92aa7a76-b318-4fb1-aafa-e3851b79b3c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:05:05.733763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:05.738143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for user 175bb8f8b330495394cd401223847733 and project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:05.757193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=e328b4b4-473e-44af-9260-e3e1df072c09,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:05:05.965850 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-92aa7a76-b318-4fb1-aafa-e3851b79b3c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.794204 Oct 29 01:05:05.967252 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 172/337] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:05:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:05:05.972146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7da49661-aa6d-47b6-b914-511a0a4a9771 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:05.973609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7da49661-aa6d-47b6-b914-511a0a4a9771 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:05.980264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7da49661-aa6d-47b6-b914-511a0a4a9771 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:05.980834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7da49661-aa6d-47b6-b914-511a0a4a9771 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:05.981378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7da49661-aa6d-47b6-b914-511a0a4a9771 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:05.982153 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7da49661-aa6d-47b6-b914-511a0a4a9771 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:05.982820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7da49661-aa6d-47b6-b914-511a0a4a9771 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:05.983482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7da49661-aa6d-47b6-b914-511a0a4a9771 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:06.000765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:06.019882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for user 175bb8f8b330495394cd401223847733 and project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:06.193569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:06.202847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for user 175bb8f8b330495394cd401223847733 and project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:06.296552 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0ca06464-a514-4f28-a6cd-cc6491b7c879 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.646278 Oct 29 01:05:06.297403 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 166/338] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:05:04 2022] POST /compute/v2.1/servers => generated 32 bytes in 1650 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 29 01:05:06.311472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-da06cda3-612d-4ab8-b1af-99f11559854f tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:06.471201 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-da06cda3-612d-4ab8-b1af-99f11559854f tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1995057356/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.170467 Oct 29 01:05:06.471839 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 167/339] 10.222.0.26 () {60 vars in 1224 bytes} [Sat Oct 29 01:05:06 2022] POST /compute/v2.1/flavors/1995057356/os-extra_specs => generated 66 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:05:06.578282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d5c3b42e-19a7-432b-a450-4fdfb5b8f9f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1052047487", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "f4099806-4a58-499a-8649-04716b1c047c"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:06.666927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-d5c3b42e-19a7-432b-a450-4fdfb5b8f9f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] validate_networks() for [('f4099806-4a58-499a-8649-04716b1c047c', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:05:06.891566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7da49661-aa6d-47b6-b914-511a0a4a9771 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:06.908627 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7da49661-aa6d-47b6-b914-511a0a4a9771 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127" status: 200 len: 1318 microversion: 2.1 time: 0.935995 Oct 29 01:05:06.908627 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 173/340] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:05 2022] GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 => generated 1318 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:06.927895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1bf35598-d60f-4749-808d-96e077d16782 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:06.928519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1bf35598-d60f-4749-808d-96e077d16782 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:06.938875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bf35598-d60f-4749-808d-96e077d16782 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:06.938875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bf35598-d60f-4749-808d-96e077d16782 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:06.938875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bf35598-d60f-4749-808d-96e077d16782 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:06.939436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bf35598-d60f-4749-808d-96e077d16782 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:06.940121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bf35598-d60f-4749-808d-96e077d16782 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:06.940892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bf35598-d60f-4749-808d-96e077d16782 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:07.109369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1bf35598-d60f-4749-808d-96e077d16782 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:07.118013 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1bf35598-d60f-4749-808d-96e077d16782 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1210 microversion: 2.1 time: 0.194889 Oct 29 01:05:07.120223 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 174/341] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:06 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1210 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:07.136835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-763a7ec8-466f-4dbd-9dc1-931ee7128540 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:07.143337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-763a7ec8-466f-4dbd-9dc1-931ee7128540 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:07.400621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-763a7ec8-466f-4dbd-9dc1-931ee7128540 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:07.420857 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-763a7ec8-466f-4dbd-9dc1-931ee7128540 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1219 microversion: 2.1 time: 0.297279 Oct 29 01:05:07.429919 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 175/342] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:07 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1219 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:07.455292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2a8a426f-6e52-4cdb-8ba6-1b4e2a1cbbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:07.469650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2a8a426f-6e52-4cdb-8ba6-1b4e2a1cbbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:07.473947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2a8a426f-6e52-4cdb-8ba6-1b4e2a1cbbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Searching by: {'deleted': False, 'project_id': 'fba91819dd56439daea17217c5d7b9b7'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:05:07.508173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a8a426f-6e52-4cdb-8ba6-1b4e2a1cbbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:07.508887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a8a426f-6e52-4cdb-8ba6-1b4e2a1cbbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:07.509539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a8a426f-6e52-4cdb-8ba6-1b4e2a1cbbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:07.510535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a8a426f-6e52-4cdb-8ba6-1b4e2a1cbbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:07.511331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a8a426f-6e52-4cdb-8ba6-1b4e2a1cbbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:07.511974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a8a426f-6e52-4cdb-8ba6-1b4e2a1cbbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:07.668998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.multi_cell_list [None req-2a8a426f-6e52-4cdb-8ba6-1b4e2a1cbbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=121100) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:05:07.784456 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2a8a426f-6e52-4cdb-8ba6-1b4e2a1cbbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1000 microversion: 2.1 time: 0.352584 Oct 29 01:05:07.796758 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 176/343] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 29 01:05:07 2022] GET /compute/v2.1/servers => generated 1000 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:07.803662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-d5c3b42e-19a7-432b-a450-4fdfb5b8f9f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:05:07.804161 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-d5c3b42e-19a7-432b-a450-4fdfb5b8f9f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:05:07.804646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-d5c3b42e-19a7-432b-a450-4fdfb5b8f9f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:05:07.805310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-d5c3b42e-19a7-432b-a450-4fdfb5b8f9f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:05:07.805942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-d5c3b42e-19a7-432b-a450-4fdfb5b8f9f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:05:07.827835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5c3b42e-19a7-432b-a450-4fdfb5b8f9f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:07.838357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5c3b42e-19a7-432b-a450-4fdfb5b8f9f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:07.838357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5c3b42e-19a7-432b-a450-4fdfb5b8f9f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:07.838357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5c3b42e-19a7-432b-a450-4fdfb5b8f9f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:07.838357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5c3b42e-19a7-432b-a450-4fdfb5b8f9f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:07.838998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5c3b42e-19a7-432b-a450-4fdfb5b8f9f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:07.896611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-d5c3b42e-19a7-432b-a450-4fdfb5b8f9f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Getting quotas for project d0adfdd6819a472baf1aa25878c5ee22. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:07.903967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-d5c3b42e-19a7-432b-a450-4fdfb5b8f9f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Getting quotas for user c56d01b83c0649e0b1d47b7563892d3f and project d0adfdd6819a472baf1aa25878c5ee22. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:07.922879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d5c3b42e-19a7-432b-a450-4fdfb5b8f9f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:05:07.925038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d5c3b42e-19a7-432b-a450-4fdfb5b8f9f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:05:07.943968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-758812ad-bad8-4b2c-8108-6e9300621d16 tempest-FlavorsExtraSpecsTestJSON-1745339230 tempest-FlavorsExtraSpecsTestJSON-1745339230-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:07.956075 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-758812ad-bad8-4b2c-8108-6e9300621d16 tempest-FlavorsExtraSpecsTestJSON-1745339230 tempest-FlavorsExtraSpecsTestJSON-1745339230-project] 10.222.0.26 "GET /compute/v2.1/flavors/1995057356/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.157604 Oct 29 01:05:07.956954 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 177/344] 10.222.0.26 () {58 vars in 1203 bytes} [Sat Oct 29 01:05:07 2022] GET /compute/v2.1/flavors/1995057356/os-extra_specs => generated 66 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:05:07.968748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-14404c8e-72bc-4d53-a48a-beddc6b7fb32 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:07.973658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-14404c8e-72bc-4d53-a48a-beddc6b7fb32 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:08.108720 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d5c3b42e-19a7-432b-a450-4fdfb5b8f9f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.631264 Oct 29 01:05:08.113015 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 168/345] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 29 01:05:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1641 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 01:05:08.118514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cf58a100-f6a5-4176-a5ba-8117d707a068 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:08.119132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cf58a100-f6a5-4176-a5ba-8117d707a068 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:08.139259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf58a100-f6a5-4176-a5ba-8117d707a068 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:08.139996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf58a100-f6a5-4176-a5ba-8117d707a068 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:08.145879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf58a100-f6a5-4176-a5ba-8117d707a068 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:08.147429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf58a100-f6a5-4176-a5ba-8117d707a068 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:08.148265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf58a100-f6a5-4176-a5ba-8117d707a068 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:08.149287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf58a100-f6a5-4176-a5ba-8117d707a068 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:08.178445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-14404c8e-72bc-4d53-a48a-beddc6b7fb32 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:08.188347 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-14404c8e-72bc-4d53-a48a-beddc6b7fb32 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 200 len: 1217 microversion: 2.1 time: 0.227387 Oct 29 01:05:08.189270 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 178/346] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:07 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 1217 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:08.204895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-15246649-794d-423f-821a-458809ecf1e6 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:08.284003 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-15246649-794d-423f-821a-458809ecf1e6 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1995057356/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.093646 Oct 29 01:05:08.293808 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 179/347] 10.222.0.26 () {60 vars in 1224 bytes} [Sat Oct 29 01:05:08 2022] POST /compute/v2.1/flavors/1995057356/os-extra_specs => generated 66 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:05:08.305899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-68a93bd1-6e0d-4852-b3a4-4098a56acc53 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:08.320212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-68a93bd1-6e0d-4852-b3a4-4098a56acc53 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:08.663591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-68a93bd1-6e0d-4852-b3a4-4098a56acc53 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:08.672207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-68a93bd1-6e0d-4852-b3a4-4098a56acc53 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:08.705643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-68a93bd1-6e0d-4852-b3a4-4098a56acc53 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:08.707073 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-68a93bd1-6e0d-4852-b3a4-4098a56acc53 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1262 microversion: 2.25 time: 0.407819 Oct 29 01:05:08.708179 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 180/348] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:08 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1262 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:08.726183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-29d63d31-1d13-4ec7-b9b8-7cd4082c2ba7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:08.726183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-29d63d31-1d13-4ec7-b9b8-7cd4082c2ba7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:08.736731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29d63d31-1d13-4ec7-b9b8-7cd4082c2ba7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:08.737258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29d63d31-1d13-4ec7-b9b8-7cd4082c2ba7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:08.737695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29d63d31-1d13-4ec7-b9b8-7cd4082c2ba7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:08.738945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29d63d31-1d13-4ec7-b9b8-7cd4082c2ba7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:08.739836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29d63d31-1d13-4ec7-b9b8-7cd4082c2ba7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:08.740594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29d63d31-1d13-4ec7-b9b8-7cd4082c2ba7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:08.762470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cf58a100-f6a5-4176-a5ba-8117d707a068 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:08.774357 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cf58a100-f6a5-4176-a5ba-8117d707a068 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127" status: 200 len: 1318 microversion: 2.1 time: 0.659508 Oct 29 01:05:08.774943 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 169/349] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:08 2022] GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 => generated 1318 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:08.788371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5bddcadb-54d1-41e3-b8be-c2e89370ae7e tempest-FlavorsExtraSpecsTestJSON-1745339230 tempest-FlavorsExtraSpecsTestJSON-1745339230-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:08.816901 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5bddcadb-54d1-41e3-b8be-c2e89370ae7e tempest-FlavorsExtraSpecsTestJSON-1745339230 tempest-FlavorsExtraSpecsTestJSON-1745339230-project] 10.222.0.26 "GET /compute/v2.1/flavors/1995057356/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.038344 Oct 29 01:05:08.828266 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 170/350] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:05:08 2022] GET /compute/v2.1/flavors/1995057356/os-extra_specs/hw:numa_nodes => generated 22 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:05:08.845605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-629bcfac-6fa3-4604-82c4-bbd6cbcfedda tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:08.846924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-629bcfac-6fa3-4604-82c4-bbd6cbcfedda tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:08.853732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-629bcfac-6fa3-4604-82c4-bbd6cbcfedda tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:08.854490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-629bcfac-6fa3-4604-82c4-bbd6cbcfedda tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:08.855778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-629bcfac-6fa3-4604-82c4-bbd6cbcfedda tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:08.856637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-629bcfac-6fa3-4604-82c4-bbd6cbcfedda tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:08.859967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-629bcfac-6fa3-4604-82c4-bbd6cbcfedda tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:08.860589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-629bcfac-6fa3-4604-82c4-bbd6cbcfedda tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:09.010797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-29d63d31-1d13-4ec7-b9b8-7cd4082c2ba7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:09.022949 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-29d63d31-1d13-4ec7-b9b8-7cd4082c2ba7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1284 microversion: 2.1 time: 0.313430 Oct 29 01:05:09.033648 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 181/351] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:08 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1284 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:09.039588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-912f4dba-8373-4f97-afdb-ab7eaef68f63 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:09.069308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-629bcfac-6fa3-4604-82c4-bbd6cbcfedda tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:09.077981 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-629bcfac-6fa3-4604-82c4-bbd6cbcfedda tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1271 microversion: 2.1 time: 0.249164 Oct 29 01:05:09.078572 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 171/352] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:08 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:09.112908 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-912f4dba-8373-4f97-afdb-ab7eaef68f63 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1995057356/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.077610 Oct 29 01:05:09.122638 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 182/353] 10.222.0.26 () {60 vars in 1224 bytes} [Sat Oct 29 01:05:09 2022] POST /compute/v2.1/flavors/1995057356/os-extra_specs => generated 66 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:05:09.127490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-106cfe99-1ac4-414c-9d60-d0b643ba0000 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:09.138233 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-106cfe99-1ac4-414c-9d60-d0b643ba0000 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/1995057356/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014285 Oct 29 01:05:09.139048 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 172/354] 10.222.0.26 () {58 vars in 1203 bytes} [Sat Oct 29 01:05:09 2022] GET /compute/v2.1/flavors/1995057356/os-extra_specs => generated 66 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:05:09.154303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aa248aae-5740-4e54-b7c2-20a3b7a4c3ca tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:09.218127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-475eb705-21b0-40f9-874e-64dff260dd96 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:09.218767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-475eb705-21b0-40f9-874e-64dff260dd96 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:09.311585 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aa248aae-5740-4e54-b7c2-20a3b7a4c3ca tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/1995057356/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.160872 Oct 29 01:05:09.312273 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 183/355] 10.222.0.26 () {60 vars in 1265 bytes} [Sat Oct 29 01:05:09 2022] PUT /compute/v2.1/flavors/1995057356/os-extra_specs/hw:numa_nodes => generated 22 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:05:09.322193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d8dab42d-e4b4-4da4-bd97-3d600ea58544 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:09.340240 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d8dab42d-e4b4-4da4-bd97-3d600ea58544 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/1995057356/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.018647 Oct 29 01:05:09.340240 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 184/356] 10.222.0.26 () {58 vars in 1203 bytes} [Sat Oct 29 01:05:09 2022] GET /compute/v2.1/flavors/1995057356/os-extra_specs => generated 66 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:05:09.361948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c90e8d96-c808-482b-b3c2-5de6628f12f8 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:09.405271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-475eb705-21b0-40f9-874e-64dff260dd96 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:09.423494 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-475eb705-21b0-40f9-874e-64dff260dd96 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 200 len: 1217 microversion: 2.1 time: 0.209944 Oct 29 01:05:09.424843 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 173/357] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:09 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 1217 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:05:09.540444 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c90e8d96-c808-482b-b3c2-5de6628f12f8 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1995057356/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.187986 Oct 29 01:05:09.546097 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 185/358] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 29 01:05:09 2022] DELETE /compute/v2.1/flavors/1995057356/os-extra_specs/hw:numa_nodes => generated 0 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 01:05:09.554664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-91a0e9a4-96b2-4b8c-b5c7-347ffe488e62 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:09.675411 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-91a0e9a4-96b2-4b8c-b5c7-347ffe488e62 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1995057356/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.125202 Oct 29 01:05:09.680108 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 174/359] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 29 01:05:09 2022] DELETE /compute/v2.1/flavors/1995057356/os-extra_specs/hw:cpu_policy => generated 0 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 01:05:09.689429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-83059048-68e3-4936-8ab9-e38edf081fe4 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:09.713431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=79,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:09.727435 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-83059048-68e3-4936-8ab9-e38edf081fe4 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/1995057356/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.042699 Oct 29 01:05:09.728642 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 186/360] 10.222.0.26 () {58 vars in 1203 bytes} [Sat Oct 29 01:05:09 2022] GET /compute/v2.1/flavors/1995057356/os-extra_specs => generated 19 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:05:09.735311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3cd84f51-cc80-4e05-a706-61e091bdb815 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:09.735926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3cd84f51-cc80-4e05-a706-61e091bdb815 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:09.743649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2ee82e5a-cfc0-4e6b-89a1-b5efb87dc3e9 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:09.864437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3cd84f51-cc80-4e05-a706-61e091bdb815 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:09.876581 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2ee82e5a-cfc0-4e6b-89a1-b5efb87dc3e9 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1995057356" status: 202 len: 0 microversion: 2.1 time: 0.136368 Oct 29 01:05:09.877264 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 187/361] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 29 01:05:09 2022] DELETE /compute/v2.1/flavors/1995057356 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:05:09.882347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-18f07061-ad53-4382-aa91-415cf1d693f0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:09.883202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-18f07061-ad53-4382-aa91-415cf1d693f0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:09.890002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3cd84f51-cc80-4e05-a706-61e091bdb815 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:09.890002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3cd84f51-cc80-4e05-a706-61e091bdb815 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:09.902214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18f07061-ad53-4382-aa91-415cf1d693f0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:09.902781 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3cd84f51-cc80-4e05-a706-61e091bdb815 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1262 microversion: 2.25 time: 0.168069 Oct 29 01:05:09.905900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18f07061-ad53-4382-aa91-415cf1d693f0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:09.906215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18f07061-ad53-4382-aa91-415cf1d693f0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:09.906958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18f07061-ad53-4382-aa91-415cf1d693f0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:09.907424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18f07061-ad53-4382-aa91-415cf1d693f0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:09.907851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18f07061-ad53-4382-aa91-415cf1d693f0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:09.908860 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 175/362] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:09 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1262 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:09.914083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f933cb6d-fb97-442a-86a4-37cc4652ad06 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:09.976726 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f933cb6d-fb97-442a-86a4-37cc4652ad06 tempest-FlavorsExtraSpecsTestJSON-1436959375 tempest-FlavorsExtraSpecsTestJSON-1436959375-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.066531 Oct 29 01:05:09.989941 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 176/363] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:05:09 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:10.062943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-abaeeac6-1a38-4a0d-87ad-ec09563c45c8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:10.063912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-abaeeac6-1a38-4a0d-87ad-ec09563c45c8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:10.078872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abaeeac6-1a38-4a0d-87ad-ec09563c45c8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:10.079363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abaeeac6-1a38-4a0d-87ad-ec09563c45c8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:10.079865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abaeeac6-1a38-4a0d-87ad-ec09563c45c8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:10.080678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abaeeac6-1a38-4a0d-87ad-ec09563c45c8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:10.081135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abaeeac6-1a38-4a0d-87ad-ec09563c45c8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:10.083909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abaeeac6-1a38-4a0d-87ad-ec09563c45c8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:10.608976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-abaeeac6-1a38-4a0d-87ad-ec09563c45c8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:10.641857 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-abaeeac6-1a38-4a0d-87ad-ec09563c45c8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1272 microversion: 2.1 time: 0.583345 Oct 29 01:05:10.644229 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 177/364] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:10 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1272 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:05:10.651675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-268a6c0a-7b5f-419d-8a9a-d0a88ef6051a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:10.652317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-268a6c0a-7b5f-419d-8a9a-d0a88ef6051a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:10.693828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-268a6c0a-7b5f-419d-8a9a-d0a88ef6051a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:10.699216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-268a6c0a-7b5f-419d-8a9a-d0a88ef6051a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:10.701958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-268a6c0a-7b5f-419d-8a9a-d0a88ef6051a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:10.703685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-268a6c0a-7b5f-419d-8a9a-d0a88ef6051a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:10.704589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-268a6c0a-7b5f-419d-8a9a-d0a88ef6051a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:10.707802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-268a6c0a-7b5f-419d-8a9a-d0a88ef6051a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:10.875381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-18f07061-ad53-4382-aa91-415cf1d693f0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:10.893382 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-18f07061-ad53-4382-aa91-415cf1d693f0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127" status: 200 len: 1318 microversion: 2.1 time: 1.014806 Oct 29 01:05:10.894738 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 188/365] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:09 2022] GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 => generated 1318 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:10.902398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-268a6c0a-7b5f-419d-8a9a-d0a88ef6051a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:10.918367 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-268a6c0a-7b5f-419d-8a9a-d0a88ef6051a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1277 microversion: 2.1 time: 0.267572 Oct 29 01:05:10.934520 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 178/366] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:10 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1277 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:10.942197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-25ca2d2d-aad0-428c-ad3d-d45a805948a3 req-bd88bb89-8762-424b-b97e-4e38ca2f9f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f551ae9b-dc1f-4352-98e5-9fe95c860127", "name": "network-vif-plugged", "status": "completed", "tag": "9eceb19a-6248-4650-b85b-c8eadd87a690"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:10.954901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80a2dd78-2c4f-4cef-8f73-aaaf25dd3d78 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:10.956840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-80a2dd78-2c4f-4cef-8f73-aaaf25dd3d78 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:10.959213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=10,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:10.971586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80a2dd78-2c4f-4cef-8f73-aaaf25dd3d78 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:10.974867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-25ca2d2d-aad0-428c-ad3d-d45a805948a3 req-bd88bb89-8762-424b-b97e-4e38ca2f9f2f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:10.975672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80a2dd78-2c4f-4cef-8f73-aaaf25dd3d78 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:10.976338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80a2dd78-2c4f-4cef-8f73-aaaf25dd3d78 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:10.977024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-25ca2d2d-aad0-428c-ad3d-d45a805948a3 req-bd88bb89-8762-424b-b97e-4e38ca2f9f2f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:10.977967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-25ca2d2d-aad0-428c-ad3d-d45a805948a3 req-bd88bb89-8762-424b-b97e-4e38ca2f9f2f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:10.978716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80a2dd78-2c4f-4cef-8f73-aaaf25dd3d78 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:10.981662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80a2dd78-2c4f-4cef-8f73-aaaf25dd3d78 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:10.982266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80a2dd78-2c4f-4cef-8f73-aaaf25dd3d78 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:11.010878 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-25ca2d2d-aad0-428c-ad3d-d45a805948a3 req-bd88bb89-8762-424b-b97e-4e38ca2f9f2f service nova] Creating event network-vif-plugged:9eceb19a-6248-4650-b85b-c8eadd87a690 for instance f551ae9b-dc1f-4352-98e5-9fe95c860127 on n-h1-862964-3 Oct 29 01:05:11.031195 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-25ca2d2d-aad0-428c-ad3d-d45a805948a3 req-bd88bb89-8762-424b-b97e-4e38ca2f9f2f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133541 Oct 29 01:05:11.035319 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 189/367] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:11.049308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2b973f49-20c5-4293-ad51-8b14c3cd90b4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:11.058293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2b973f49-20c5-4293-ad51-8b14c3cd90b4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:11.084696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b973f49-20c5-4293-ad51-8b14c3cd90b4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:11.085316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b973f49-20c5-4293-ad51-8b14c3cd90b4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:11.085831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b973f49-20c5-4293-ad51-8b14c3cd90b4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:11.086619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b973f49-20c5-4293-ad51-8b14c3cd90b4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:11.087177 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b973f49-20c5-4293-ad51-8b14c3cd90b4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:11.089330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b973f49-20c5-4293-ad51-8b14c3cd90b4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:11.356591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-80a2dd78-2c4f-4cef-8f73-aaaf25dd3d78 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:11.374056 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-80a2dd78-2c4f-4cef-8f73-aaaf25dd3d78 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 200 len: 1213 microversion: 2.1 time: 0.438075 Oct 29 01:05:11.392547 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 179/368] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:10 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 1213 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:11.398376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2b973f49-20c5-4293-ad51-8b14c3cd90b4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:11.419644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2b973f49-20c5-4293-ad51-8b14c3cd90b4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:11.421133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2b973f49-20c5-4293-ad51-8b14c3cd90b4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:11.422362 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2b973f49-20c5-4293-ad51-8b14c3cd90b4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1258 microversion: 2.25 time: 0.384290 Oct 29 01:05:11.429202 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 190/369] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:11 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1258 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:11.670465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-56642782-0ebf-4a84-bd18-3b90d023aeb8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:11.671375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-56642782-0ebf-4a84-bd18-3b90d023aeb8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:11.681925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56642782-0ebf-4a84-bd18-3b90d023aeb8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:11.683393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56642782-0ebf-4a84-bd18-3b90d023aeb8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:11.684398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56642782-0ebf-4a84-bd18-3b90d023aeb8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:11.685333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56642782-0ebf-4a84-bd18-3b90d023aeb8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:11.685952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56642782-0ebf-4a84-bd18-3b90d023aeb8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:11.686717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56642782-0ebf-4a84-bd18-3b90d023aeb8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:11.919480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-faea2185-fa90-4db2-9bc4-01c4dac95348 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:11.921003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-faea2185-fa90-4db2-9bc4-01c4dac95348 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:11.929686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faea2185-fa90-4db2-9bc4-01c4dac95348 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:11.930579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faea2185-fa90-4db2-9bc4-01c4dac95348 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:11.931806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faea2185-fa90-4db2-9bc4-01c4dac95348 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:11.932885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faea2185-fa90-4db2-9bc4-01c4dac95348 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:11.934093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faea2185-fa90-4db2-9bc4-01c4dac95348 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:11.935298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faea2185-fa90-4db2-9bc4-01c4dac95348 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:11.977577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:11.995295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-56642782-0ebf-4a84-bd18-3b90d023aeb8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:12.013650 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-56642782-0ebf-4a84-bd18-3b90d023aeb8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1314 microversion: 2.1 time: 0.349595 Oct 29 01:05:12.014249 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 180/370] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:11 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:12.045610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3f1311a7-9825-4a62-a016-a15884659bd8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:12.046136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3f1311a7-9825-4a62-a016-a15884659bd8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:12.054385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f1311a7-9825-4a62-a016-a15884659bd8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:12.055216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f1311a7-9825-4a62-a016-a15884659bd8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:12.055881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f1311a7-9825-4a62-a016-a15884659bd8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:12.056935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f1311a7-9825-4a62-a016-a15884659bd8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:12.057690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f1311a7-9825-4a62-a016-a15884659bd8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:12.058319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f1311a7-9825-4a62-a016-a15884659bd8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:12.291703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3f1311a7-9825-4a62-a016-a15884659bd8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:12.309934 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3f1311a7-9825-4a62-a016-a15884659bd8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1277 microversion: 2.1 time: 0.275264 Oct 29 01:05:12.310756 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 181/371] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:12 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1277 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:12.321694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-17fdf8cb-1d1b-4a98-b5a0-1b98b7b23eaf req-34ed316b-c8f3-4342-b2f6-0467d47fd260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d821e4c3-4aa0-45aa-acb9-24f55080a6ff", "tag": "42ca8294-5152-4196-880d-faf05585a2ea"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:12.340085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-17fdf8cb-1d1b-4a98-b5a0-1b98b7b23eaf req-34ed316b-c8f3-4342-b2f6-0467d47fd260 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:12.342670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-17fdf8cb-1d1b-4a98-b5a0-1b98b7b23eaf req-34ed316b-c8f3-4342-b2f6-0467d47fd260 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:12.342670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-17fdf8cb-1d1b-4a98-b5a0-1b98b7b23eaf req-34ed316b-c8f3-4342-b2f6-0467d47fd260 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:12.365369 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-17fdf8cb-1d1b-4a98-b5a0-1b98b7b23eaf req-34ed316b-c8f3-4342-b2f6-0467d47fd260 service nova] Creating event network-changed:42ca8294-5152-4196-880d-faf05585a2ea for instance d821e4c3-4aa0-45aa-acb9-24f55080a6ff on n-h2-862964-3 Oct 29 01:05:12.374996 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-17fdf8cb-1d1b-4a98-b5a0-1b98b7b23eaf req-34ed316b-c8f3-4342-b2f6-0467d47fd260 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062211 Oct 29 01:05:12.382715 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 182/372] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:12.409558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0ba0cc55-a642-43e1-bc36-db5d92b71ba6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:12.410880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0ba0cc55-a642-43e1-bc36-db5d92b71ba6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:12.426914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ba0cc55-a642-43e1-bc36-db5d92b71ba6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:12.427415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ba0cc55-a642-43e1-bc36-db5d92b71ba6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:12.427850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ba0cc55-a642-43e1-bc36-db5d92b71ba6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:12.428556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ba0cc55-a642-43e1-bc36-db5d92b71ba6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:12.430611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ba0cc55-a642-43e1-bc36-db5d92b71ba6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:12.431281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ba0cc55-a642-43e1-bc36-db5d92b71ba6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:12.607177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0ba0cc55-a642-43e1-bc36-db5d92b71ba6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:12.621362 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0ba0cc55-a642-43e1-bc36-db5d92b71ba6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 200 len: 1277 microversion: 2.1 time: 0.225769 Oct 29 01:05:12.621953 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 183/373] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:12 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 1277 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:05:12.626693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6dc2cc8a-5d73-498e-a165-e30716602eb4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:12.627301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6dc2cc8a-5d73-498e-a165-e30716602eb4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:12.641778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-faea2185-fa90-4db2-9bc4-01c4dac95348 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:12.649884 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-faea2185-fa90-4db2-9bc4-01c4dac95348 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127" status: 200 len: 1318 microversion: 2.1 time: 0.735000 Oct 29 01:05:12.651403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dc2cc8a-5d73-498e-a165-e30716602eb4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:12.651774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dc2cc8a-5d73-498e-a165-e30716602eb4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:12.652216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dc2cc8a-5d73-498e-a165-e30716602eb4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:12.658018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dc2cc8a-5d73-498e-a165-e30716602eb4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:12.658671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dc2cc8a-5d73-498e-a165-e30716602eb4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:12.659115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dc2cc8a-5d73-498e-a165-e30716602eb4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:12.670145 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 191/374] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:11 2022] GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 => generated 1318 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:05:12.848266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6dc2cc8a-5d73-498e-a165-e30716602eb4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:12.865392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6dc2cc8a-5d73-498e-a165-e30716602eb4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:12.866885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6dc2cc8a-5d73-498e-a165-e30716602eb4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:12.868037 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6dc2cc8a-5d73-498e-a165-e30716602eb4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1314 microversion: 2.25 time: 0.245151 Oct 29 01:05:12.870465 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 184/375] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:12 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:13.042116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-55217a2d-cc77-4161-b601-07acc3153243 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:13.043352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-55217a2d-cc77-4161-b601-07acc3153243 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:13.052509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55217a2d-cc77-4161-b601-07acc3153243 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:13.053408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55217a2d-cc77-4161-b601-07acc3153243 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:13.054319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55217a2d-cc77-4161-b601-07acc3153243 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:13.055250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55217a2d-cc77-4161-b601-07acc3153243 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:13.056047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55217a2d-cc77-4161-b601-07acc3153243 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:13.056928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55217a2d-cc77-4161-b601-07acc3153243 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:13.335184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6c84ed89-d272-40d3-b5d8-76fce8d0d53e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:13.336557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6c84ed89-d272-40d3-b5d8-76fce8d0d53e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:13.343264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c84ed89-d272-40d3-b5d8-76fce8d0d53e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:13.344087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c84ed89-d272-40d3-b5d8-76fce8d0d53e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:13.344695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c84ed89-d272-40d3-b5d8-76fce8d0d53e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:13.345651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c84ed89-d272-40d3-b5d8-76fce8d0d53e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:13.346305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c84ed89-d272-40d3-b5d8-76fce8d0d53e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:13.346727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c84ed89-d272-40d3-b5d8-76fce8d0d53e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:13.478088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6c84ed89-d272-40d3-b5d8-76fce8d0d53e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:13.497404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:13.503546 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6c84ed89-d272-40d3-b5d8-76fce8d0d53e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1277 microversion: 2.1 time: 0.173190 Oct 29 01:05:13.504991 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 185/376] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:13 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:05:13.651849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-914e2cfe-3e27-4796-abe1-ada9810d4e98 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:13.652471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-914e2cfe-3e27-4796-abe1-ada9810d4e98 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:13.658549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-914e2cfe-3e27-4796-abe1-ada9810d4e98 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:13.659042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-914e2cfe-3e27-4796-abe1-ada9810d4e98 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:13.659741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-914e2cfe-3e27-4796-abe1-ada9810d4e98 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:13.661014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-914e2cfe-3e27-4796-abe1-ada9810d4e98 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:13.661493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-914e2cfe-3e27-4796-abe1-ada9810d4e98 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:13.662105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-914e2cfe-3e27-4796-abe1-ada9810d4e98 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:13.685771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-55217a2d-cc77-4161-b601-07acc3153243 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:13.698601 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-55217a2d-cc77-4161-b601-07acc3153243 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1314 microversion: 2.1 time: 0.658033 Oct 29 01:05:13.698601 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 192/377] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:13 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:13.701198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-16d7d219-fe2c-4ae6-9335-62c3ae3482c5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:13.701840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-16d7d219-fe2c-4ae6-9335-62c3ae3482c5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:13.707823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16d7d219-fe2c-4ae6-9335-62c3ae3482c5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:13.708302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16d7d219-fe2c-4ae6-9335-62c3ae3482c5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:13.708737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16d7d219-fe2c-4ae6-9335-62c3ae3482c5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:13.709460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16d7d219-fe2c-4ae6-9335-62c3ae3482c5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:13.710197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16d7d219-fe2c-4ae6-9335-62c3ae3482c5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:13.710629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16d7d219-fe2c-4ae6-9335-62c3ae3482c5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:13.795535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-914e2cfe-3e27-4796-abe1-ada9810d4e98 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:13.816682 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-914e2cfe-3e27-4796-abe1-ada9810d4e98 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 200 len: 1275 microversion: 2.1 time: 0.165470 Oct 29 01:05:13.818029 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 186/378] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:13 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 1275 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:05:13.898470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9473499a-094c-434d-a7dd-12e4a36a1cdb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:13.899470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9473499a-094c-434d-a7dd-12e4a36a1cdb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:13.906220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9473499a-094c-434d-a7dd-12e4a36a1cdb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:13.907261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9473499a-094c-434d-a7dd-12e4a36a1cdb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:13.907946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9473499a-094c-434d-a7dd-12e4a36a1cdb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:13.908867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9473499a-094c-434d-a7dd-12e4a36a1cdb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:13.909601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9473499a-094c-434d-a7dd-12e4a36a1cdb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:13.910528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9473499a-094c-434d-a7dd-12e4a36a1cdb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:14.008369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9473499a-094c-434d-a7dd-12e4a36a1cdb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:14.022631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9473499a-094c-434d-a7dd-12e4a36a1cdb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:14.024326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-16d7d219-fe2c-4ae6-9335-62c3ae3482c5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:14.026571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9473499a-094c-434d-a7dd-12e4a36a1cdb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:14.028300 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9473499a-094c-434d-a7dd-12e4a36a1cdb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1320 microversion: 2.25 time: 0.133749 Oct 29 01:05:14.029458 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 187/379] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:13 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1320 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:05:14.034636 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-16d7d219-fe2c-4ae6-9335-62c3ae3482c5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127" status: 200 len: 1468 microversion: 2.1 time: 0.337713 Oct 29 01:05:14.036137 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 193/380] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:13 2022] GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 => generated 1468 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:14.528815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8d4f5b6c-59bf-4e64-a6b8-3edf54321da7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:14.529631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8d4f5b6c-59bf-4e64-a6b8-3edf54321da7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:14.538157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d4f5b6c-59bf-4e64-a6b8-3edf54321da7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:14.540325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d4f5b6c-59bf-4e64-a6b8-3edf54321da7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:14.543499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d4f5b6c-59bf-4e64-a6b8-3edf54321da7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:14.552211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d4f5b6c-59bf-4e64-a6b8-3edf54321da7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:14.552211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d4f5b6c-59bf-4e64-a6b8-3edf54321da7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:14.552211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d4f5b6c-59bf-4e64-a6b8-3edf54321da7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:14.623100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f4a56f86-c2c4-408d-bef1-dd06808830ac tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1211984614", "block_migration": true, "disk_over_commit": false}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:14.625758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f4a56f86-c2c4-408d-bef1-dd06808830ac tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:14.636248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4a56f86-c2c4-408d-bef1-dd06808830ac tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:14.637353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4a56f86-c2c4-408d-bef1-dd06808830ac tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:14.637989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4a56f86-c2c4-408d-bef1-dd06808830ac tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:14.639765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4a56f86-c2c4-408d-bef1-dd06808830ac tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:14.643873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4a56f86-c2c4-408d-bef1-dd06808830ac tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:14.643873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4a56f86-c2c4-408d-bef1-dd06808830ac tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:14.784879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-f4a56f86-c2c4-408d-bef1-dd06808830ac tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lazy-loading 'flavor' on Instance uuid f551ae9b-dc1f-4352-98e5-9fe95c860127 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:05:14.878156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f4a56f86-c2c4-408d-bef1-dd06808830ac tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Going to try to live migrate instance to tempest-host-1211984614 {{(pid=121099) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 01:05:14.895372 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-f4a56f86-c2c4-408d-bef1-dd06808830ac tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] HTTP exception thrown: Compute host tempest-host-1211984614 could not be found. Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f4a56f86-c2c4-408d-bef1-dd06808830ac tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Request method failure captured: Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127/action HTTP/1.1 Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 107 Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwy4Mg8j6bETSIvRy2bm6etUuQmLHfQh0blAMKtuA_D9Fqt-nsQxsqcwLGBrHbC7Pt7cc-giXCb7PxbAHab7lyOa3xu9nQiw2hIuJEOYJ1xn-yVnoPX7mCq7O0KqIz52pOAtNUWJWYXL-ZH5lB4-E4f35e3qgBdZCZAbgZD_V7X49g Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: a0702a0163e74405bb0faea806ff1e2f Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-LiveMigrationNegativeTest-485021780 Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:05:14.903969 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:05:14.905237 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0702a0163e74405bb0faea806ff1e2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a0702a0163e74405bb0faea806ff1e2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0702a0163e74405bb0faea806ff1e2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a0702a0163e74405bb0faea806ff1e2f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:05:14.905237 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-LiveMigrationNegativeTest-485021780 Oct 29 01:05:14.905237 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: a0702a0163e74405bb0faea806ff1e2f Oct 29 01:05:14.905237 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-485021780 Oct 29 01:05:14.905237 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-LiveMigrationNegativeTest-485021780-project-admin Oct 29 01:05:14.905237 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:05:14.905237 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:05:14.905237 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: cf883ea1e04146c4903a9715b25d251b Oct 29 01:05:14.905237 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-LiveMigrationNegativeTest-485021780-project-admin Oct 29 01:05:14.905237 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:05:14.905237 n-d-862964-3 devstack@n-api.service[121099]: {"os-migrateLive": {"host": "tempest-host-1211984614", "block_migration": true, "disk_over_commit": false}} Oct 29 01:05:14.905237 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:05:14.905963 n-d-862964-3 devstack@n-api.service[121099]: exception: Compute host tempest-host-1211984614 could not be found. Oct 29 01:05:14.905963 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'f551ae9b-dc1f-4352-98e5-9fe95c860127', 'body': {'os-migrateLive': {'host': 'tempest-host-1211984614', 'block_migration': True, 'disk_over_commit': False}}} Oct 29 01:05:14.905963 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:05:14.905963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:14.905963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 29 01:05:14.905963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 29 01:05:14.905963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 01:05:14.905963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:05:14.905963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 01:05:14.905963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 01:05:14.905963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 29 01:05:14.905963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 01:05:14.905963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 01:05:14.905963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 01:05:14.905963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 01:05:14.905963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 01:05:14.905963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 29 01:05:14.905963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 01:05:14.905963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 01:05:14.907090 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:05:14.907090 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 01:05:14.907090 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 01:05:14.907090 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 29 01:05:14.907090 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 29 01:05:14.907090 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:05:14.907090 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:05:14.907090 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 29 01:05:14.907090 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 29 01:05:14.907090 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 29 01:05:14.907090 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:05:14.907090 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 29 01:05:14.907090 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 29 01:05:14.907090 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 29 01:05:14.907090 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 29 01:05:14.907090 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 29 01:05:14.907090 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 29 01:05:14.907090 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1211984614 could not be found. Oct 29 01:05:14.907090 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1211984614 could not be found. Oct 29 01:05:14.908190 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:05:14.913966 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:14.913966 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:05:14.913966 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:14.913966 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:14.913966 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:14.913966 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:05:14.913966 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:05:14.913966 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1211984614 could not be found. Oct 29 01:05:14.913966 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:05:14.913966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f4a56f86-c2c4-408d-bef1-dd06808830ac tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Returning 400 to user: Compute host tempest-host-1211984614 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:05:14.913966 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f4a56f86-c2c4-408d-bef1-dd06808830ac tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127/action" status: 400 len: 100 microversion: 2.1 time: 0.842061 Oct 29 01:05:14.913966 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 188/381] 10.222.0.26 () {60 vars in 1279 bytes} [Sat Oct 29 01:05:14 2022] POST /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127/action => generated 100 bytes in 847 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:05:14.930198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d2029a92-0089-4a38-9dd4-4ebc58e7fe31 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:14.931204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d2029a92-0089-4a38-9dd4-4ebc58e7fe31 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:14.939381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2029a92-0089-4a38-9dd4-4ebc58e7fe31 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:14.940235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2029a92-0089-4a38-9dd4-4ebc58e7fe31 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:14.940906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2029a92-0089-4a38-9dd4-4ebc58e7fe31 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:14.941915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2029a92-0089-4a38-9dd4-4ebc58e7fe31 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:14.942662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2029a92-0089-4a38-9dd4-4ebc58e7fe31 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:14.943288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2029a92-0089-4a38-9dd4-4ebc58e7fe31 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:15.011413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8d4f5b6c-59bf-4e64-a6b8-3edf54321da7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:15.042272 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8d4f5b6c-59bf-4e64-a6b8-3edf54321da7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1319 microversion: 2.1 time: 0.517822 Oct 29 01:05:15.048593 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 194/382] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:14 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1319 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:05:15.058579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f6d61573-01ad-44a8-ae4c-9a29457574a3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:15.059598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f6d61573-01ad-44a8-ae4c-9a29457574a3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:15.079998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d61573-01ad-44a8-ae4c-9a29457574a3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:15.080497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d61573-01ad-44a8-ae4c-9a29457574a3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:15.080936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d61573-01ad-44a8-ae4c-9a29457574a3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:15.081698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d61573-01ad-44a8-ae4c-9a29457574a3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:15.083020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d61573-01ad-44a8-ae4c-9a29457574a3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:15.085811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d61573-01ad-44a8-ae4c-9a29457574a3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:15.255621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f6d61573-01ad-44a8-ae4c-9a29457574a3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:15.265878 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f6d61573-01ad-44a8-ae4c-9a29457574a3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 200 len: 1275 microversion: 2.1 time: 0.215759 Oct 29 01:05:15.283074 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 195/383] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:15 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 1275 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:15.291329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0b091f2b-d3a6-4d8b-a68e-3d4ba0889066 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:15.292404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0b091f2b-d3a6-4d8b-a68e-3d4ba0889066 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:15.299296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b091f2b-d3a6-4d8b-a68e-3d4ba0889066 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:15.300329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b091f2b-d3a6-4d8b-a68e-3d4ba0889066 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:15.301720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b091f2b-d3a6-4d8b-a68e-3d4ba0889066 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:15.302888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b091f2b-d3a6-4d8b-a68e-3d4ba0889066 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:15.303574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b091f2b-d3a6-4d8b-a68e-3d4ba0889066 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:15.304200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b091f2b-d3a6-4d8b-a68e-3d4ba0889066 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:15.367090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d2029a92-0089-4a38-9dd4-4ebc58e7fe31 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:15.374803 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d2029a92-0089-4a38-9dd4-4ebc58e7fe31 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1314 microversion: 2.1 time: 0.461172 Oct 29 01:05:15.375376 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 189/384] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:14 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:15.398610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a8e7c74e-055b-4c00-9b67-bd3c52735c83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:15.399205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a8e7c74e-055b-4c00-9b67-bd3c52735c83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:15.429390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8e7c74e-055b-4c00-9b67-bd3c52735c83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:15.430083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8e7c74e-055b-4c00-9b67-bd3c52735c83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:15.430940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8e7c74e-055b-4c00-9b67-bd3c52735c83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:15.431813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8e7c74e-055b-4c00-9b67-bd3c52735c83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:15.432417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8e7c74e-055b-4c00-9b67-bd3c52735c83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:15.432983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8e7c74e-055b-4c00-9b67-bd3c52735c83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:16.052202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0b091f2b-d3a6-4d8b-a68e-3d4ba0889066 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:16.085815 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0b091f2b-d3a6-4d8b-a68e-3d4ba0889066 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127" status: 200 len: 1468 microversion: 2.1 time: 0.798058 Oct 29 01:05:16.087204 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 196/385] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:15 2022] GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 => generated 1468 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:16.101916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-43d3f93b-18df-465a-a23d-a8cea24cb444 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:16.105508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-43d3f93b-18df-465a-a23d-a8cea24cb444 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:16.124167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43d3f93b-18df-465a-a23d-a8cea24cb444 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:16.125536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43d3f93b-18df-465a-a23d-a8cea24cb444 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:16.130226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43d3f93b-18df-465a-a23d-a8cea24cb444 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:16.130226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43d3f93b-18df-465a-a23d-a8cea24cb444 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:16.130226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43d3f93b-18df-465a-a23d-a8cea24cb444 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:16.130226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43d3f93b-18df-465a-a23d-a8cea24cb444 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:16.165486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a8e7c74e-055b-4c00-9b67-bd3c52735c83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:16.174030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a8e7c74e-055b-4c00-9b67-bd3c52735c83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:16.175475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a8e7c74e-055b-4c00-9b67-bd3c52735c83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:16.177091 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a8e7c74e-055b-4c00-9b67-bd3c52735c83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1362 microversion: 2.25 time: 0.782521 Oct 29 01:05:16.177686 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 190/386] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:15 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1362 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:16.293960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-238d372a-d8bf-4b5b-8637-764a5b973b64 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:16.294574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-238d372a-d8bf-4b5b-8637-764a5b973b64 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:16.311251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-238d372a-d8bf-4b5b-8637-764a5b973b64 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:16.311967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-238d372a-d8bf-4b5b-8637-764a5b973b64 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:16.312535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-238d372a-d8bf-4b5b-8637-764a5b973b64 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:16.313509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-238d372a-d8bf-4b5b-8637-764a5b973b64 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:16.313922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-238d372a-d8bf-4b5b-8637-764a5b973b64 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:16.314349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-238d372a-d8bf-4b5b-8637-764a5b973b64 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:16.540388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-43d3f93b-18df-465a-a23d-a8cea24cb444 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:16.549013 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-43d3f93b-18df-465a-a23d-a8cea24cb444 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1319 microversion: 2.1 time: 0.459716 Oct 29 01:05:16.561938 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 197/387] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:16 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1319 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:16.584625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9027fdf1-1308-4ce2-a89f-41e6c1586645 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-55404613", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:16.682121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-9027fdf1-1308-4ce2-a89f-41e6c1586645 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] validate_networks() for None {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:05:17.050171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-238d372a-d8bf-4b5b-8637-764a5b973b64 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:17.061624 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-238d372a-d8bf-4b5b-8637-764a5b973b64 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 200 len: 1317 microversion: 2.1 time: 0.771467 Oct 29 01:05:17.065416 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 191/388] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:16 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 1317 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:05:17.071015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-158660a0-ad19-4a5b-b26d-ec1a5b3e6236 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:17.083238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-158660a0-ad19-4a5b-b26d-ec1a5b3e6236 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:17.104553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-158660a0-ad19-4a5b-b26d-ec1a5b3e6236 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:17.111437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-158660a0-ad19-4a5b-b26d-ec1a5b3e6236 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:17.111886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-158660a0-ad19-4a5b-b26d-ec1a5b3e6236 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:17.112620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-158660a0-ad19-4a5b-b26d-ec1a5b3e6236 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:17.113629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-158660a0-ad19-4a5b-b26d-ec1a5b3e6236 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:17.114325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-158660a0-ad19-4a5b-b26d-ec1a5b3e6236 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:17.555097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:17.652598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-158660a0-ad19-4a5b-b26d-ec1a5b3e6236 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:17.665551 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-158660a0-ad19-4a5b-b26d-ec1a5b3e6236 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1314 microversion: 2.1 time: 0.598823 Oct 29 01:05:17.666132 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 192/389] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:17 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:17.680067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4be22e54-ed58-46cf-9acb-56efb7e299a5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:17.686461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4be22e54-ed58-46cf-9acb-56efb7e299a5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:17.704088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4be22e54-ed58-46cf-9acb-56efb7e299a5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:17.704582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4be22e54-ed58-46cf-9acb-56efb7e299a5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:17.705020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4be22e54-ed58-46cf-9acb-56efb7e299a5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:17.708179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4be22e54-ed58-46cf-9acb-56efb7e299a5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:17.708179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4be22e54-ed58-46cf-9acb-56efb7e299a5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:17.708179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4be22e54-ed58-46cf-9acb-56efb7e299a5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:17.854993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:17.999624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-9027fdf1-1308-4ce2-a89f-41e6c1586645 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:05:17.999917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-9027fdf1-1308-4ce2-a89f-41e6c1586645 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:05:18.000723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-9027fdf1-1308-4ce2-a89f-41e6c1586645 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:05:18.003325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-9027fdf1-1308-4ce2-a89f-41e6c1586645 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:05:18.003777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-9027fdf1-1308-4ce2-a89f-41e6c1586645 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:05:18.013552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9027fdf1-1308-4ce2-a89f-41e6c1586645 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:18.014284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9027fdf1-1308-4ce2-a89f-41e6c1586645 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:18.014876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9027fdf1-1308-4ce2-a89f-41e6c1586645 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:18.015754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9027fdf1-1308-4ce2-a89f-41e6c1586645 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:18.016372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9027fdf1-1308-4ce2-a89f-41e6c1586645 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:18.016788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9027fdf1-1308-4ce2-a89f-41e6c1586645 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:18.038446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-9027fdf1-1308-4ce2-a89f-41e6c1586645 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Getting quotas for project edf4bb92337045bdb017d273b7fc55d4. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:18.043163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-9027fdf1-1308-4ce2-a89f-41e6c1586645 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Getting quotas for user 1826e3c223c8493081c90eeb180d9b81 and project edf4bb92337045bdb017d273b7fc55d4. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:18.056398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9027fdf1-1308-4ce2-a89f-41e6c1586645 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:05:18.058946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9027fdf1-1308-4ce2-a89f-41e6c1586645 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:05:18.063934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4be22e54-ed58-46cf-9acb-56efb7e299a5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:18.072999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4be22e54-ed58-46cf-9acb-56efb7e299a5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:18.075906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4be22e54-ed58-46cf-9acb-56efb7e299a5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:18.077905 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4be22e54-ed58-46cf-9acb-56efb7e299a5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1362 microversion: 2.25 time: 0.405021 Oct 29 01:05:18.080225 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 193/390] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:17 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:18.090833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-449d3e24-aeb1-4f91-9e0b-37fb836c0152 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:18.093102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-449d3e24-aeb1-4f91-9e0b-37fb836c0152 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:18.112848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-449d3e24-aeb1-4f91-9e0b-37fb836c0152 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:18.113940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-449d3e24-aeb1-4f91-9e0b-37fb836c0152 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:18.121809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-449d3e24-aeb1-4f91-9e0b-37fb836c0152 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:18.124118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-449d3e24-aeb1-4f91-9e0b-37fb836c0152 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:18.124753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-449d3e24-aeb1-4f91-9e0b-37fb836c0152 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:18.125533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-449d3e24-aeb1-4f91-9e0b-37fb836c0152 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:18.217728 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9027fdf1-1308-4ce2-a89f-41e6c1586645 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.654099 Oct 29 01:05:18.219237 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 198/391] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:05:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:05:18.225329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4e579e26-aaa1-4fb2-ae5a-f64a7aebc7ac tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:18.229938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4e579e26-aaa1-4fb2-ae5a-f64a7aebc7ac tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:18.244271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e579e26-aaa1-4fb2-ae5a-f64a7aebc7ac tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:18.244271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e579e26-aaa1-4fb2-ae5a-f64a7aebc7ac tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:18.244271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e579e26-aaa1-4fb2-ae5a-f64a7aebc7ac tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:18.246162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e579e26-aaa1-4fb2-ae5a-f64a7aebc7ac tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:18.246651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e579e26-aaa1-4fb2-ae5a-f64a7aebc7ac tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:18.247089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e579e26-aaa1-4fb2-ae5a-f64a7aebc7ac tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:18.818215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-449d3e24-aeb1-4f91-9e0b-37fb836c0152 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:18.827666 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-449d3e24-aeb1-4f91-9e0b-37fb836c0152 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1319 microversion: 2.1 time: 0.744002 Oct 29 01:05:18.829418 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 194/392] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:18 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1319 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:18.835439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-ba7d9a41-b538-4485-b9fe-17221a6f9de4 req-c7b599a3-89b1-4c2d-8473-94142329ee6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba8acd1-344c-42b0-be43-a35cc5ff6f8e", "tag": "cd682e5a-2996-4509-aa56-a7726f2d94bc"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:18.845521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ba7d9a41-b538-4485-b9fe-17221a6f9de4 req-c7b599a3-89b1-4c2d-8473-94142329ee6f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:18.846236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ba7d9a41-b538-4485-b9fe-17221a6f9de4 req-c7b599a3-89b1-4c2d-8473-94142329ee6f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:18.846818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ba7d9a41-b538-4485-b9fe-17221a6f9de4 req-c7b599a3-89b1-4c2d-8473-94142329ee6f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:18.859139 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-ba7d9a41-b538-4485-b9fe-17221a6f9de4 req-c7b599a3-89b1-4c2d-8473-94142329ee6f service nova] Creating event network-changed:cd682e5a-2996-4509-aa56-a7726f2d94bc for instance 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e on n-h1-862964-3 Oct 29 01:05:18.864600 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-ba7d9a41-b538-4485-b9fe-17221a6f9de4 req-c7b599a3-89b1-4c2d-8473-94142329ee6f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033236 Oct 29 01:05:18.865406 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 195/393] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:18.870902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-756e4ae6-b64f-4656-8d50-5934abc4e82d tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:18.872637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-756e4ae6-b64f-4656-8d50-5934abc4e82d tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:18.902406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4e579e26-aaa1-4fb2-ae5a-f64a7aebc7ac tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:18.913989 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4e579e26-aaa1-4fb2-ae5a-f64a7aebc7ac tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 200 len: 1317 microversion: 2.1 time: 0.693052 Oct 29 01:05:18.914743 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 199/394] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:18 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 1317 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:18.982692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-756e4ae6-b64f-4656-8d50-5934abc4e82d tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:18.993947 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-756e4ae6-b64f-4656-8d50-5934abc4e82d tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1217 microversion: 2.1 time: 0.126057 Oct 29 01:05:18.996111 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 196/395] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:18 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1217 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:19.009996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-930290c8-2223-4e93-b238-1be86431531e tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:19.010966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-930290c8-2223-4e93-b238-1be86431531e tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:19.021528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-930290c8-2223-4e93-b238-1be86431531e tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.022031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-930290c8-2223-4e93-b238-1be86431531e tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.022465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-930290c8-2223-4e93-b238-1be86431531e tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.023405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-930290c8-2223-4e93-b238-1be86431531e tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.023871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-930290c8-2223-4e93-b238-1be86431531e tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.024297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-930290c8-2223-4e93-b238-1be86431531e tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.100034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5fa6909c-5f3c-4f4f-b7f0-2a64287b5d51 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Calling method '.version_select at 0x7f9d9c63e8b0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:19.106363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fa6909c-5f3c-4f4f-b7f0-2a64287b5d51 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.107079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fa6909c-5f3c-4f4f-b7f0-2a64287b5d51 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.107592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fa6909c-5f3c-4f4f-b7f0-2a64287b5d51 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.108466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fa6909c-5f3c-4f4f-b7f0-2a64287b5d51 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.109212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fa6909c-5f3c-4f4f-b7f0-2a64287b5d51 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.109933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fa6909c-5f3c-4f4f-b7f0-2a64287b5d51 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.147530 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5fa6909c-5f3c-4f4f-b7f0-2a64287b5d51 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.230496 Oct 29 01:05:19.148805 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 200/396] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Oct 29 01:05:18 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:19.156854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-80bb1054-0217-4343-8bea-5e8af8e1bcc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:19.158424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-80bb1054-0217-4343-8bea-5e8af8e1bcc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:19.166278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80bb1054-0217-4343-8bea-5e8af8e1bcc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.167115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80bb1054-0217-4343-8bea-5e8af8e1bcc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.167763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80bb1054-0217-4343-8bea-5e8af8e1bcc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.168909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80bb1054-0217-4343-8bea-5e8af8e1bcc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.169712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80bb1054-0217-4343-8bea-5e8af8e1bcc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.170236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80bb1054-0217-4343-8bea-5e8af8e1bcc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.338223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-930290c8-2223-4e93-b238-1be86431531e tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:19.349509 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-930290c8-2223-4e93-b238-1be86431531e tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1314 microversion: 2.1 time: 0.351984 Oct 29 01:05:19.350650 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 197/397] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:18 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:19.380891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-469de704-bf42-4c64-93e1-1b460adeb12f tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Calling method '.version_select at 0x7f9d9c6438b0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:19.386616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-469de704-bf42-4c64-93e1-1b460adeb12f tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.387666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-469de704-bf42-4c64-93e1-1b460adeb12f tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.388115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-469de704-bf42-4c64-93e1-1b460adeb12f tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.389088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-469de704-bf42-4c64-93e1-1b460adeb12f tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.389646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-469de704-bf42-4c64-93e1-1b460adeb12f tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.390081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-469de704-bf42-4c64-93e1-1b460adeb12f tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.418516 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-469de704-bf42-4c64-93e1-1b460adeb12f tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.058597 Oct 29 01:05:19.419314 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 198/398] 10.222.0.26 () {58 vars in 1139 bytes} [Sat Oct 29 01:05:19 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:19.430737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-21e54382-b6e9-41dc-bbbd-cb9c4780f5ff tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Calling method '.version_select at 0x7f9d9c43c0d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:19.434524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21e54382-b6e9-41dc-bbbd-cb9c4780f5ff tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.435004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21e54382-b6e9-41dc-bbbd-cb9c4780f5ff tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.435438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21e54382-b6e9-41dc-bbbd-cb9c4780f5ff tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.436156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21e54382-b6e9-41dc-bbbd-cb9c4780f5ff tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.436603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21e54382-b6e9-41dc-bbbd-cb9c4780f5ff tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.437290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21e54382-b6e9-41dc-bbbd-cb9c4780f5ff tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.462098 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-21e54382-b6e9-41dc-bbbd-cb9c4780f5ff tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.035218 Oct 29 01:05:19.463437 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 199/399] 10.222.0.26 () {58 vars in 1145 bytes} [Sat Oct 29 01:05:19 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:05:19.476552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4b4608e7-3f1a-43e3-a679-8a38529a688d tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Calling method '.version_select at 0x7f9d9c7fb430>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:19.484870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b4608e7-3f1a-43e3-a679-8a38529a688d tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.485617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b4608e7-3f1a-43e3-a679-8a38529a688d tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.486303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-80bb1054-0217-4343-8bea-5e8af8e1bcc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:19.486688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b4608e7-3f1a-43e3-a679-8a38529a688d tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.487650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b4608e7-3f1a-43e3-a679-8a38529a688d tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.488844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b4608e7-3f1a-43e3-a679-8a38529a688d tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.489496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b4608e7-3f1a-43e3-a679-8a38529a688d tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.506405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-80bb1054-0217-4343-8bea-5e8af8e1bcc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:19.508790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-80bb1054-0217-4343-8bea-5e8af8e1bcc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:19.510578 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-80bb1054-0217-4343-8bea-5e8af8e1bcc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1362 microversion: 2.25 time: 0.360342 Oct 29 01:05:19.511688 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 201/400] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:19 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:19.537212 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4b4608e7-3f1a-43e3-a679-8a38529a688d tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.065102 Oct 29 01:05:19.537942 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 200/401] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Oct 29 01:05:19 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:19.551973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7a293c1c-f242-4427-b034-87606cc36021 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Calling method '.version_select at 0x7f9d9c56dc10>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:19.556454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a293c1c-f242-4427-b034-87606cc36021 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.556952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a293c1c-f242-4427-b034-87606cc36021 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.557416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a293c1c-f242-4427-b034-87606cc36021 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.558684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a293c1c-f242-4427-b034-87606cc36021 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.559890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a293c1c-f242-4427-b034-87606cc36021 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.560534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a293c1c-f242-4427-b034-87606cc36021 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.594519 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7a293c1c-f242-4427-b034-87606cc36021 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.047263 Oct 29 01:05:19.606068 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 202/402] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 29 01:05:19 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:19.607822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c49a8d4a-0b8a-4c10-9a81-6f9b8240b8cd tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Calling method '.version_select at 0x7f9d9c43c550>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:19.611199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c49a8d4a-0b8a-4c10-9a81-6f9b8240b8cd tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.611689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c49a8d4a-0b8a-4c10-9a81-6f9b8240b8cd tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.612132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c49a8d4a-0b8a-4c10-9a81-6f9b8240b8cd tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.612942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c49a8d4a-0b8a-4c10-9a81-6f9b8240b8cd tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.617907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c49a8d4a-0b8a-4c10-9a81-6f9b8240b8cd tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.618446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c49a8d4a-0b8a-4c10-9a81-6f9b8240b8cd tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.671253 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c49a8d4a-0b8a-4c10-9a81-6f9b8240b8cd tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.066619 Oct 29 01:05:19.681420 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 201/403] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Oct 29 01:05:19 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:19.691014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8ba2bb77-58e6-4af8-9538-aa764c9a0bc8 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Calling method '.version_select at 0x7f9d9c43c040>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:19.704903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ba2bb77-58e6-4af8-9538-aa764c9a0bc8 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.705762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ba2bb77-58e6-4af8-9538-aa764c9a0bc8 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.706359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ba2bb77-58e6-4af8-9538-aa764c9a0bc8 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.742523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ba2bb77-58e6-4af8-9538-aa764c9a0bc8 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.743359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ba2bb77-58e6-4af8-9538-aa764c9a0bc8 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.743989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ba2bb77-58e6-4af8-9538-aa764c9a0bc8 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.753313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-1129d274-0f44-43dc-955f-78f023bf99ff req-f957ee29-cd3f-4883-8e55-f9348d0599a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf8015b1-0e50-4db4-9bda-eaad0ad293b3", "tag": "db0edede-be33-4b87-a766-e1102315288f"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:19.774073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1129d274-0f44-43dc-955f-78f023bf99ff req-f957ee29-cd3f-4883-8e55-f9348d0599a6 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.774557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1129d274-0f44-43dc-955f-78f023bf99ff req-f957ee29-cd3f-4883-8e55-f9348d0599a6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.774995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1129d274-0f44-43dc-955f-78f023bf99ff req-f957ee29-cd3f-4883-8e55-f9348d0599a6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.800258 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-1129d274-0f44-43dc-955f-78f023bf99ff req-f957ee29-cd3f-4883-8e55-f9348d0599a6 service nova] Creating event network-changed:db0edede-be33-4b87-a766-e1102315288f for instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 on n-h2-862964-3 Oct 29 01:05:19.801280 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8ba2bb77-58e6-4af8-9538-aa764c9a0bc8 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-h1-862964-3" status: 200 len: 598 microversion: 2.1 time: 0.113845 Oct 29 01:05:19.810375 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 202/404] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Oct 29 01:05:19 2022] GET /compute/v2.1/os-hosts/n-h1-862964-3 => generated 598 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:19.814899 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-1129d274-0f44-43dc-955f-78f023bf99ff req-f957ee29-cd3f-4883-8e55-f9348d0599a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177175 Oct 29 01:05:19.817729 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 203/405] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:19.819238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2089e669-10de-419f-ac20-c359170fdff9 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Calling method '.version_select at 0x7f9d9c2c39d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:19.831270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2089e669-10de-419f-ac20-c359170fdff9 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.832105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2089e669-10de-419f-ac20-c359170fdff9 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.832580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2089e669-10de-419f-ac20-c359170fdff9 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.863818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e8512bd8-9b26-4615-a585-ac0c63642a19 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:19.865051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e8512bd8-9b26-4615-a585-ac0c63642a19 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:19.871596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2089e669-10de-419f-ac20-c359170fdff9 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.872100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2089e669-10de-419f-ac20-c359170fdff9 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.872854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2089e669-10de-419f-ac20-c359170fdff9 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.877941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8512bd8-9b26-4615-a585-ac0c63642a19 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.878440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8512bd8-9b26-4615-a585-ac0c63642a19 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.880727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8512bd8-9b26-4615-a585-ac0c63642a19 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.881087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8512bd8-9b26-4615-a585-ac0c63642a19 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.881584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8512bd8-9b26-4615-a585-ac0c63642a19 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.882625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8512bd8-9b26-4615-a585-ac0c63642a19 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.912350 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2089e669-10de-419f-ac20-c359170fdff9 tempest-HostsAdminTestJSON-1543207273 tempest-HostsAdminTestJSON-1543207273-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-h2-862964-3" status: 200 len: 860 microversion: 2.1 time: 0.100509 Oct 29 01:05:19.913264 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 203/406] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Oct 29 01:05:19 2022] GET /compute/v2.1/os-hosts/n-h2-862964-3 => generated 860 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:19.944711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e35e5ec-b20c-48ea-b050-99a40896c8a9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:19.945882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e35e5ec-b20c-48ea-b050-99a40896c8a9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:19.955880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e35e5ec-b20c-48ea-b050-99a40896c8a9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.956838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e35e5ec-b20c-48ea-b050-99a40896c8a9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.957686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e35e5ec-b20c-48ea-b050-99a40896c8a9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:19.958560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e35e5ec-b20c-48ea-b050-99a40896c8a9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:19.959813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e35e5ec-b20c-48ea-b050-99a40896c8a9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:19.961813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e35e5ec-b20c-48ea-b050-99a40896c8a9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:20.337367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e8512bd8-9b26-4615-a585-ac0c63642a19 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:20.345875 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e8512bd8-9b26-4615-a585-ac0c63642a19 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1319 microversion: 2.1 time: 0.492991 Oct 29 01:05:20.347604 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 204/407] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:19 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1319 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:05:20.353885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-365b8a23-8636-4e9b-9e04-8ed6c67a5d67 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:20.355208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-365b8a23-8636-4e9b-9e04-8ed6c67a5d67 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:20.361239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-365b8a23-8636-4e9b-9e04-8ed6c67a5d67 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:20.361904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-365b8a23-8636-4e9b-9e04-8ed6c67a5d67 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:20.367263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-365b8a23-8636-4e9b-9e04-8ed6c67a5d67 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:20.367263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-365b8a23-8636-4e9b-9e04-8ed6c67a5d67 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:20.367263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-365b8a23-8636-4e9b-9e04-8ed6c67a5d67 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:20.367263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-365b8a23-8636-4e9b-9e04-8ed6c67a5d67 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:20.483267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8e35e5ec-b20c-48ea-b050-99a40896c8a9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:20.492046 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8e35e5ec-b20c-48ea-b050-99a40896c8a9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 200 len: 1317 microversion: 2.1 time: 0.553778 Oct 29 01:05:20.492633 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 204/408] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:19 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 1317 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:20.515197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2dfa01ec-0c8c-4e99-8c3c-b7ab6307d4f8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:20.518314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2dfa01ec-0c8c-4e99-8c3c-b7ab6307d4f8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:20.526282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2dfa01ec-0c8c-4e99-8c3c-b7ab6307d4f8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:20.527010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2dfa01ec-0c8c-4e99-8c3c-b7ab6307d4f8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:20.527593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2dfa01ec-0c8c-4e99-8c3c-b7ab6307d4f8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:20.528621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2dfa01ec-0c8c-4e99-8c3c-b7ab6307d4f8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:20.529297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2dfa01ec-0c8c-4e99-8c3c-b7ab6307d4f8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:20.529871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2dfa01ec-0c8c-4e99-8c3c-b7ab6307d4f8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:20.796306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-365b8a23-8636-4e9b-9e04-8ed6c67a5d67 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:20.813688 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-365b8a23-8636-4e9b-9e04-8ed6c67a5d67 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1221 microversion: 2.1 time: 0.464314 Oct 29 01:05:20.814952 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 205/409] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:20 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1221 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:20.835790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-80632224-6c6a-4f57-8e4b-20a38264800c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:20.837942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-80632224-6c6a-4f57-8e4b-20a38264800c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:20.858455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80632224-6c6a-4f57-8e4b-20a38264800c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:20.860414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80632224-6c6a-4f57-8e4b-20a38264800c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:20.861649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80632224-6c6a-4f57-8e4b-20a38264800c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:20.863987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80632224-6c6a-4f57-8e4b-20a38264800c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:20.864833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80632224-6c6a-4f57-8e4b-20a38264800c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:20.865525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80632224-6c6a-4f57-8e4b-20a38264800c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:21.060267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2dfa01ec-0c8c-4e99-8c3c-b7ab6307d4f8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:21.070678 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2dfa01ec-0c8c-4e99-8c3c-b7ab6307d4f8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1314 microversion: 2.1 time: 0.572018 Oct 29 01:05:21.071485 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 205/410] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:20 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:21.079886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-7577ba78-fd63-4184-b936-bf54feccb110 req-f02a077b-2fb7-4534-864f-56f7c61a7d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e8aabd6-f029-4d30-b984-ac9905d35c60", "tag": "c1de427c-560f-4f24-8158-8a289cec2e31"}, {"name": "network-changed", "server_uuid": "e328b4b4-473e-44af-9260-e3e1df072c09", "tag": "d15faedf-65dc-4a76-a947-4939de811d0e"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:21.092940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7577ba78-fd63-4184-b936-bf54feccb110 req-f02a077b-2fb7-4534-864f-56f7c61a7d5c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:21.093533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7577ba78-fd63-4184-b936-bf54feccb110 req-f02a077b-2fb7-4534-864f-56f7c61a7d5c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:21.094060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7577ba78-fd63-4184-b936-bf54feccb110 req-f02a077b-2fb7-4534-864f-56f7c61a7d5c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:21.107572 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-7577ba78-fd63-4184-b936-bf54feccb110 req-f02a077b-2fb7-4534-864f-56f7c61a7d5c service nova] Creating event network-changed:c1de427c-560f-4f24-8158-8a289cec2e31 for instance 8e8aabd6-f029-4d30-b984-ac9905d35c60 on n-h2-862964-3 Oct 29 01:05:21.108084 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-7577ba78-fd63-4184-b936-bf54feccb110 req-f02a077b-2fb7-4534-864f-56f7c61a7d5c service nova] Creating event network-changed:d15faedf-65dc-4a76-a947-4939de811d0e for instance e328b4b4-473e-44af-9260-e3e1df072c09 on n-h2-862964-3 Oct 29 01:05:21.115269 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-7577ba78-fd63-4184-b936-bf54feccb110 req-f02a077b-2fb7-4534-864f-56f7c61a7d5c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042167 Oct 29 01:05:21.116062 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 206/411] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:21.180148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-80632224-6c6a-4f57-8e4b-20a38264800c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:21.188501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-80632224-6c6a-4f57-8e4b-20a38264800c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:21.189906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-80632224-6c6a-4f57-8e4b-20a38264800c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:21.191010 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-80632224-6c6a-4f57-8e4b-20a38264800c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1362 microversion: 2.25 time: 0.374615 Oct 29 01:05:21.192925 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 206/412] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:20 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:21.373996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-065e1b4c-7559-4e5f-ac53-24ba52477100 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:21.374967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-065e1b4c-7559-4e5f-ac53-24ba52477100 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:21.383656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-065e1b4c-7559-4e5f-ac53-24ba52477100 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:21.384161 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-065e1b4c-7559-4e5f-ac53-24ba52477100 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:21.384596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-065e1b4c-7559-4e5f-ac53-24ba52477100 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:21.385350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-065e1b4c-7559-4e5f-ac53-24ba52477100 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:21.387949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-065e1b4c-7559-4e5f-ac53-24ba52477100 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:21.388625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-065e1b4c-7559-4e5f-ac53-24ba52477100 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:21.397225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:21.521650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-50251c65-c254-46bd-b7ab-105345a492d0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:21.523126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-50251c65-c254-46bd-b7ab-105345a492d0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:21.536854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50251c65-c254-46bd-b7ab-105345a492d0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:21.538119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50251c65-c254-46bd-b7ab-105345a492d0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:21.538783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50251c65-c254-46bd-b7ab-105345a492d0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:21.539748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50251c65-c254-46bd-b7ab-105345a492d0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:21.540413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50251c65-c254-46bd-b7ab-105345a492d0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:21.541507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50251c65-c254-46bd-b7ab-105345a492d0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:21.727509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-065e1b4c-7559-4e5f-ac53-24ba52477100 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:21.736738 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-065e1b4c-7559-4e5f-ac53-24ba52477100 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1319 microversion: 2.1 time: 0.366845 Oct 29 01:05:21.737995 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 207/413] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:21 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:21.839516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2376066d-07b9-4989-9bc3-5b6f3b6e8f33 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:21.840442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2376066d-07b9-4989-9bc3-5b6f3b6e8f33 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:21.848221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-50251c65-c254-46bd-b7ab-105345a492d0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:21.849023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2376066d-07b9-4989-9bc3-5b6f3b6e8f33 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:21.849533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2376066d-07b9-4989-9bc3-5b6f3b6e8f33 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:21.849981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2376066d-07b9-4989-9bc3-5b6f3b6e8f33 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:21.854607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2376066d-07b9-4989-9bc3-5b6f3b6e8f33 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:21.855298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2376066d-07b9-4989-9bc3-5b6f3b6e8f33 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:21.860607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2376066d-07b9-4989-9bc3-5b6f3b6e8f33 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:21.868819 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-50251c65-c254-46bd-b7ab-105345a492d0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 200 len: 1317 microversion: 2.1 time: 0.352718 Oct 29 01:05:21.872055 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 207/414] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:21 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:05:21.998552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2376066d-07b9-4989-9bc3-5b6f3b6e8f33 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:22.013286 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2376066d-07b9-4989-9bc3-5b6f3b6e8f33 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1213 microversion: 2.1 time: 0.173541 Oct 29 01:05:22.014313 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 208/415] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:21 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1213 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:22.095319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-82bab7eb-17b3-4130-a724-c075ea87493b tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:22.096071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-82bab7eb-17b3-4130-a724-c075ea87493b tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:22.108611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82bab7eb-17b3-4130-a724-c075ea87493b tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:22.109446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82bab7eb-17b3-4130-a724-c075ea87493b tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:22.109892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82bab7eb-17b3-4130-a724-c075ea87493b tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:22.110602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82bab7eb-17b3-4130-a724-c075ea87493b tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:22.111071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82bab7eb-17b3-4130-a724-c075ea87493b tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:22.111498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82bab7eb-17b3-4130-a724-c075ea87493b tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:22.218110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4a3a089f-c4d6-427d-830d-a05d3e86689b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:22.218712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4a3a089f-c4d6-427d-830d-a05d3e86689b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:22.242241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a3a089f-c4d6-427d-830d-a05d3e86689b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:22.242630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a3a089f-c4d6-427d-830d-a05d3e86689b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:22.244175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a3a089f-c4d6-427d-830d-a05d3e86689b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:22.245523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a3a089f-c4d6-427d-830d-a05d3e86689b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:22.247757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a3a089f-c4d6-427d-830d-a05d3e86689b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:22.249086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a3a089f-c4d6-427d-830d-a05d3e86689b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:22.566068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-82bab7eb-17b3-4130-a724-c075ea87493b tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:22.575604 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-82bab7eb-17b3-4130-a724-c075ea87493b tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1314 microversion: 2.1 time: 0.484942 Oct 29 01:05:22.576739 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 208/416] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:22 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:22.583473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-f537ebc0-658c-4533-877e-219f3f24b220 req-f7140082-e343-48bc-b234-82bdac7a7b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d821e4c3-4aa0-45aa-acb9-24f55080a6ff", "name": "network-vif-plugged", "status": "completed", "tag": "42ca8294-5152-4196-880d-faf05585a2ea"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:22.584436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4a3a089f-c4d6-427d-830d-a05d3e86689b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:22.593507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f537ebc0-658c-4533-877e-219f3f24b220 req-f7140082-e343-48bc-b234-82bdac7a7b12 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:22.594278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f537ebc0-658c-4533-877e-219f3f24b220 req-f7140082-e343-48bc-b234-82bdac7a7b12 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:22.594922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f537ebc0-658c-4533-877e-219f3f24b220 req-f7140082-e343-48bc-b234-82bdac7a7b12 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:22.595992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4a3a089f-c4d6-427d-830d-a05d3e86689b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:22.598356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4a3a089f-c4d6-427d-830d-a05d3e86689b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:22.600270 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4a3a089f-c4d6-427d-830d-a05d3e86689b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1362 microversion: 2.25 time: 0.386102 Oct 29 01:05:22.601427 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 209/417] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:22 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1362 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:05:22.621034 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f537ebc0-658c-4533-877e-219f3f24b220 req-f7140082-e343-48bc-b234-82bdac7a7b12 service nova] Creating event network-vif-plugged:42ca8294-5152-4196-880d-faf05585a2ea for instance d821e4c3-4aa0-45aa-acb9-24f55080a6ff on n-h2-862964-3 Oct 29 01:05:22.626549 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-f537ebc0-658c-4533-877e-219f3f24b220 req-f7140082-e343-48bc-b234-82bdac7a7b12 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048279 Oct 29 01:05:22.627790 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 209/418] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:22.760376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d55aa1b1-decc-49d0-b775-3826ba8b7fad tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:22.761441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d55aa1b1-decc-49d0-b775-3826ba8b7fad tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:22.771209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d55aa1b1-decc-49d0-b775-3826ba8b7fad tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:22.771698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d55aa1b1-decc-49d0-b775-3826ba8b7fad tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:22.777611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d55aa1b1-decc-49d0-b775-3826ba8b7fad tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:22.778664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d55aa1b1-decc-49d0-b775-3826ba8b7fad tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:22.780613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d55aa1b1-decc-49d0-b775-3826ba8b7fad tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:22.782028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d55aa1b1-decc-49d0-b775-3826ba8b7fad tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:22.897606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-187151a9-fd88-4182-931c-61076dc71122 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:22.898550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-187151a9-fd88-4182-931c-61076dc71122 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:22.904898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-187151a9-fd88-4182-931c-61076dc71122 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:22.905615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-187151a9-fd88-4182-931c-61076dc71122 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:22.906205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-187151a9-fd88-4182-931c-61076dc71122 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:22.907065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-187151a9-fd88-4182-931c-61076dc71122 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:22.907764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-187151a9-fd88-4182-931c-61076dc71122 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:22.908359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-187151a9-fd88-4182-931c-61076dc71122 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:23.063663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d55aa1b1-decc-49d0-b775-3826ba8b7fad tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:23.074768 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d55aa1b1-decc-49d0-b775-3826ba8b7fad tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1319 microversion: 2.1 time: 0.318096 Oct 29 01:05:23.075986 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 210/419] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:22 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:23.082480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a334afae-4026-40e6-87a8-4000f838a6a0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:23.084275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a334afae-4026-40e6-87a8-4000f838a6a0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:23.091836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a334afae-4026-40e6-87a8-4000f838a6a0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:23.092612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a334afae-4026-40e6-87a8-4000f838a6a0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:23.093369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a334afae-4026-40e6-87a8-4000f838a6a0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:23.094513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a334afae-4026-40e6-87a8-4000f838a6a0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:23.095070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a334afae-4026-40e6-87a8-4000f838a6a0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:23.095594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a334afae-4026-40e6-87a8-4000f838a6a0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:23.189286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a334afae-4026-40e6-87a8-4000f838a6a0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:23.199949 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a334afae-4026-40e6-87a8-4000f838a6a0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1277 microversion: 2.1 time: 0.122598 Oct 29 01:05:23.201096 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 211/420] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:23 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:23.233255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-187151a9-fd88-4182-931c-61076dc71122 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:23.243352 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-187151a9-fd88-4182-931c-61076dc71122 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 200 len: 1317 microversion: 2.1 time: 0.350045 Oct 29 01:05:23.246280 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 210/421] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:22 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:23.600863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6822b481-ec8f-4d06-984b-e8a45a8379a4 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:23.601570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6822b481-ec8f-4d06-984b-e8a45a8379a4 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:23.609185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6822b481-ec8f-4d06-984b-e8a45a8379a4 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:23.610166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6822b481-ec8f-4d06-984b-e8a45a8379a4 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:23.611429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6822b481-ec8f-4d06-984b-e8a45a8379a4 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:23.612270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6822b481-ec8f-4d06-984b-e8a45a8379a4 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:23.613681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6822b481-ec8f-4d06-984b-e8a45a8379a4 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:23.614490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6822b481-ec8f-4d06-984b-e8a45a8379a4 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:23.626059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6ace0b93-84fa-4f89-8990-9ef39547a89b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:23.627295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6ace0b93-84fa-4f89-8990-9ef39547a89b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:23.636642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ace0b93-84fa-4f89-8990-9ef39547a89b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:23.639564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ace0b93-84fa-4f89-8990-9ef39547a89b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:23.640444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ace0b93-84fa-4f89-8990-9ef39547a89b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:23.641421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ace0b93-84fa-4f89-8990-9ef39547a89b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:23.643912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ace0b93-84fa-4f89-8990-9ef39547a89b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:23.644763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ace0b93-84fa-4f89-8990-9ef39547a89b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:23.685835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:24.137615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6822b481-ec8f-4d06-984b-e8a45a8379a4 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:24.143146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6ace0b93-84fa-4f89-8990-9ef39547a89b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:24.146080 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6822b481-ec8f-4d06-984b-e8a45a8379a4 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1314 microversion: 2.1 time: 0.550109 Oct 29 01:05:24.146871 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 212/422] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:23 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:24.151500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bc70a2b8-acc8-464a-91ed-77313c544997 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:24.152294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bc70a2b8-acc8-464a-91ed-77313c544997 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:24.154076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6ace0b93-84fa-4f89-8990-9ef39547a89b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:24.155530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6ace0b93-84fa-4f89-8990-9ef39547a89b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:24.156715 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6ace0b93-84fa-4f89-8990-9ef39547a89b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1362 microversion: 2.25 time: 0.535050 Oct 29 01:05:24.158957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc70a2b8-acc8-464a-91ed-77313c544997 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:24.159983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc70a2b8-acc8-464a-91ed-77313c544997 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:24.161119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc70a2b8-acc8-464a-91ed-77313c544997 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:24.162021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc70a2b8-acc8-464a-91ed-77313c544997 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:24.162635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc70a2b8-acc8-464a-91ed-77313c544997 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:24.163218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc70a2b8-acc8-464a-91ed-77313c544997 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:24.170316 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 211/423] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:23 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1362 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:24.225022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b72906ef-58ce-4c84-9667-bbe409704c91 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:24.225920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b72906ef-58ce-4c84-9667-bbe409704c91 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:24.244953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b72906ef-58ce-4c84-9667-bbe409704c91 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:24.245709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b72906ef-58ce-4c84-9667-bbe409704c91 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:24.246150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b72906ef-58ce-4c84-9667-bbe409704c91 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:24.247002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b72906ef-58ce-4c84-9667-bbe409704c91 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:24.247525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b72906ef-58ce-4c84-9667-bbe409704c91 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:24.248102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b72906ef-58ce-4c84-9667-bbe409704c91 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:24.395375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bc70a2b8-acc8-464a-91ed-77313c544997 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:24.408865 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bc70a2b8-acc8-464a-91ed-77313c544997 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1319 microversion: 2.1 time: 0.260731 Oct 29 01:05:24.409496 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 213/424] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:24 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:24.450308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-88028922-d818-4f3a-978b-33b123901f50 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:24.453379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-88028922-d818-4f3a-978b-33b123901f50 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:24.461544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88028922-d818-4f3a-978b-33b123901f50 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:24.463465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88028922-d818-4f3a-978b-33b123901f50 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:24.463465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88028922-d818-4f3a-978b-33b123901f50 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:24.464503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88028922-d818-4f3a-978b-33b123901f50 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:24.466121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88028922-d818-4f3a-978b-33b123901f50 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:24.467405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88028922-d818-4f3a-978b-33b123901f50 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:24.730525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b72906ef-58ce-4c84-9667-bbe409704c91 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:24.739949 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b72906ef-58ce-4c84-9667-bbe409704c91 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1317 microversion: 2.1 time: 0.518587 Oct 29 01:05:24.741319 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 212/425] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:24 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1317 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:05:24.747182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-92cd3a73-d6b9-4e14-ab51-368d9e41b0f9 req-767082c0-f0eb-496a-b591-936f39b616df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba8acd1-344c-42b0-be43-a35cc5ff6f8e", "name": "network-vif-plugged", "status": "completed", "tag": "cd682e5a-2996-4509-aa56-a7726f2d94bc"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:24.758345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-92cd3a73-d6b9-4e14-ab51-368d9e41b0f9 req-767082c0-f0eb-496a-b591-936f39b616df service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:24.759097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-92cd3a73-d6b9-4e14-ab51-368d9e41b0f9 req-767082c0-f0eb-496a-b591-936f39b616df service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:24.759737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-92cd3a73-d6b9-4e14-ab51-368d9e41b0f9 req-767082c0-f0eb-496a-b591-936f39b616df service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:24.772761 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-92cd3a73-d6b9-4e14-ab51-368d9e41b0f9 req-767082c0-f0eb-496a-b591-936f39b616df service nova] Creating event network-vif-plugged:cd682e5a-2996-4509-aa56-a7726f2d94bc for instance 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e on n-h1-862964-3 Oct 29 01:05:24.778813 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-92cd3a73-d6b9-4e14-ab51-368d9e41b0f9 req-767082c0-f0eb-496a-b591-936f39b616df service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035244 Oct 29 01:05:24.782355 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 213/426] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:25.041864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-88028922-d818-4f3a-978b-33b123901f50 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:25.049615 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-88028922-d818-4f3a-978b-33b123901f50 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 200 len: 1317 microversion: 2.1 time: 0.637469 Oct 29 01:05:25.061931 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 214/427] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:24 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 1317 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:25.178384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f35749b8-91ec-409e-8318-dc4042ba7136 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:25.179689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f35749b8-91ec-409e-8318-dc4042ba7136 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:25.183313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-18a74be3-6822-4200-a387-4a91365eb48c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:25.184019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-18a74be3-6822-4200-a387-4a91365eb48c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:25.186215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f35749b8-91ec-409e-8318-dc4042ba7136 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:25.186859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f35749b8-91ec-409e-8318-dc4042ba7136 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:25.189303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f35749b8-91ec-409e-8318-dc4042ba7136 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:25.189303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f35749b8-91ec-409e-8318-dc4042ba7136 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:25.189303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f35749b8-91ec-409e-8318-dc4042ba7136 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:25.189920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18a74be3-6822-4200-a387-4a91365eb48c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:25.190052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f35749b8-91ec-409e-8318-dc4042ba7136 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:25.190680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18a74be3-6822-4200-a387-4a91365eb48c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:25.191810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18a74be3-6822-4200-a387-4a91365eb48c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:25.193391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18a74be3-6822-4200-a387-4a91365eb48c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:25.193851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18a74be3-6822-4200-a387-4a91365eb48c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:25.194272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18a74be3-6822-4200-a387-4a91365eb48c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:25.495569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-18a74be3-6822-4200-a387-4a91365eb48c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:25.512463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-18a74be3-6822-4200-a387-4a91365eb48c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:25.515109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-18a74be3-6822-4200-a387-4a91365eb48c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:25.516645 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-18a74be3-6822-4200-a387-4a91365eb48c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1362 microversion: 2.25 time: 0.337396 Oct 29 01:05:25.518925 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 215/428] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:25 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1362 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:05:25.527347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9a47f8a2-1ea5-48c6-adc9-02a9ff6820c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:25.528290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9a47f8a2-1ea5-48c6-adc9-02a9ff6820c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:25.548360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a47f8a2-1ea5-48c6-adc9-02a9ff6820c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:25.549180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a47f8a2-1ea5-48c6-adc9-02a9ff6820c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:25.551112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a47f8a2-1ea5-48c6-adc9-02a9ff6820c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:25.553300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a47f8a2-1ea5-48c6-adc9-02a9ff6820c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:25.554177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a47f8a2-1ea5-48c6-adc9-02a9ff6820c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:25.555014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a47f8a2-1ea5-48c6-adc9-02a9ff6820c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:25.582440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f35749b8-91ec-409e-8318-dc4042ba7136 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:25.593834 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f35749b8-91ec-409e-8318-dc4042ba7136 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1314 microversion: 2.1 time: 0.423361 Oct 29 01:05:25.594747 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 214/429] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:25 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:25.766401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cb2150eb-8692-4603-b98b-3f2903f760aa tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:25.767229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cb2150eb-8692-4603-b98b-3f2903f760aa tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:25.781715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb2150eb-8692-4603-b98b-3f2903f760aa tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:25.782725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb2150eb-8692-4603-b98b-3f2903f760aa tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:25.785752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb2150eb-8692-4603-b98b-3f2903f760aa tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:25.786038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9a47f8a2-1ea5-48c6-adc9-02a9ff6820c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:25.789246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb2150eb-8692-4603-b98b-3f2903f760aa tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:25.789901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb2150eb-8692-4603-b98b-3f2903f760aa tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:25.795421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb2150eb-8692-4603-b98b-3f2903f760aa tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:25.797439 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9a47f8a2-1ea5-48c6-adc9-02a9ff6820c3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1319 microversion: 2.1 time: 0.275907 Oct 29 01:05:25.798546 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 216/430] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:25 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:26.241322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cb2150eb-8692-4603-b98b-3f2903f760aa tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:26.241322 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cb2150eb-8692-4603-b98b-3f2903f760aa tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1317 microversion: 2.1 time: 0.233705 Oct 29 01:05:26.241322 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 215/431] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:25 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:26.243373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-429d49e8-3237-4a6b-8d56-ad298bd3a1bd tempest-InstanceUsageAuditLogTestJSON-542528224 tempest-InstanceUsageAuditLogTestJSON-542528224-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:26.244544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-68ec33ad-7507-4dad-b667-e91bd760785c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:26.244544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-68ec33ad-7507-4dad-b667-e91bd760785c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:26.244967 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-429d49e8-3237-4a6b-8d56-ad298bd3a1bd tempest-InstanceUsageAuditLogTestJSON-542528224 tempest-InstanceUsageAuditLogTestJSON-542528224-project-admin] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29 01:05:25" status: 200 len: 318 microversion: 2.1 time: 0.168498 Oct 29 01:05:26.244967 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 217/432] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 29 01:05:25 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29%2001%3A05%3A25 => generated 318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:05:26.245394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68ec33ad-7507-4dad-b667-e91bd760785c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:26.245394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68ec33ad-7507-4dad-b667-e91bd760785c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:26.245394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68ec33ad-7507-4dad-b667-e91bd760785c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:26.245394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68ec33ad-7507-4dad-b667-e91bd760785c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:26.245749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68ec33ad-7507-4dad-b667-e91bd760785c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:26.245749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68ec33ad-7507-4dad-b667-e91bd760785c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:26.245749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-68ec33ad-7507-4dad-b667-e91bd760785c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:26.252004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ffad3a3f-b548-4d23-8f2c-3826afe67dfd tempest-InstanceUsageAuditLogTestJSON-542528224 tempest-InstanceUsageAuditLogTestJSON-542528224-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:26.257450 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-68ec33ad-7507-4dad-b667-e91bd760785c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 200 len: 1317 microversion: 2.1 time: 0.175214 Oct 29 01:05:26.258534 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 216/433] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:26 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:05:26.271511 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ffad3a3f-b548-4d23-8f2c-3826afe67dfd tempest-InstanceUsageAuditLogTestJSON-542528224 tempest-InstanceUsageAuditLogTestJSON-542528224-project-admin] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.026021 Oct 29 01:05:26.271511 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 218/434] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Oct 29 01:05:26 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:26.546216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f46299e3-c2cd-4e92-8b2f-c465df4ba145 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:26.547472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f46299e3-c2cd-4e92-8b2f-c465df4ba145 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:26.549375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-aaaa9db4-828a-4c9b-bd63-4de69b58932d req-7b2519c5-eb2c-4a08-ab05-7cfb356ad46f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c3640f-299c-4975-be9b-612e064d3399", "tag": "c0ea08d6-21f2-4a27-992a-09d1ef81df82"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:26.563680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f46299e3-c2cd-4e92-8b2f-c465df4ba145 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:26.564475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f46299e3-c2cd-4e92-8b2f-c465df4ba145 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:26.565358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f46299e3-c2cd-4e92-8b2f-c465df4ba145 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:26.566568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f46299e3-c2cd-4e92-8b2f-c465df4ba145 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:26.567295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f46299e3-c2cd-4e92-8b2f-c465df4ba145 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:26.568064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f46299e3-c2cd-4e92-8b2f-c465df4ba145 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:26.570709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-aaaa9db4-828a-4c9b-bd63-4de69b58932d req-7b2519c5-eb2c-4a08-ab05-7cfb356ad46f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:26.572226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-aaaa9db4-828a-4c9b-bd63-4de69b58932d req-7b2519c5-eb2c-4a08-ab05-7cfb356ad46f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:26.572226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-aaaa9db4-828a-4c9b-bd63-4de69b58932d req-7b2519c5-eb2c-4a08-ab05-7cfb356ad46f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:26.606466 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-aaaa9db4-828a-4c9b-bd63-4de69b58932d req-7b2519c5-eb2c-4a08-ab05-7cfb356ad46f service nova] Creating event network-changed:c0ea08d6-21f2-4a27-992a-09d1ef81df82 for instance 60c3640f-299c-4975-be9b-612e064d3399 on n-h1-862964-3 Oct 29 01:05:26.618928 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-aaaa9db4-828a-4c9b-bd63-4de69b58932d req-7b2519c5-eb2c-4a08-ab05-7cfb356ad46f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074578 Oct 29 01:05:26.619613 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 217/435] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:26.626341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5aa9a049-0a2b-406b-91cf-9f90b49be43d tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:26.627076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5aa9a049-0a2b-406b-91cf-9f90b49be43d tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:26.633482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5aa9a049-0a2b-406b-91cf-9f90b49be43d tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:26.634234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5aa9a049-0a2b-406b-91cf-9f90b49be43d tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:26.634842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5aa9a049-0a2b-406b-91cf-9f90b49be43d tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:26.635705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5aa9a049-0a2b-406b-91cf-9f90b49be43d tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:26.636407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5aa9a049-0a2b-406b-91cf-9f90b49be43d tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:26.636991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5aa9a049-0a2b-406b-91cf-9f90b49be43d tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:26.821686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f46299e3-c2cd-4e92-8b2f-c465df4ba145 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:26.836643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f46299e3-c2cd-4e92-8b2f-c465df4ba145 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:26.838322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f46299e3-c2cd-4e92-8b2f-c465df4ba145 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:26.840515 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f46299e3-c2cd-4e92-8b2f-c465df4ba145 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1362 microversion: 2.25 time: 0.300356 Oct 29 01:05:26.848179 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 219/436] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:26 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:26.856957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f84072d5-5028-4513-adaf-c1f57c2fe680 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:26.857866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f84072d5-5028-4513-adaf-c1f57c2fe680 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:26.870569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f84072d5-5028-4513-adaf-c1f57c2fe680 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:26.872396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f84072d5-5028-4513-adaf-c1f57c2fe680 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:26.873632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f84072d5-5028-4513-adaf-c1f57c2fe680 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:26.874653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f84072d5-5028-4513-adaf-c1f57c2fe680 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:26.875367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f84072d5-5028-4513-adaf-c1f57c2fe680 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:26.875978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f84072d5-5028-4513-adaf-c1f57c2fe680 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:26.913360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5aa9a049-0a2b-406b-91cf-9f90b49be43d tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:26.922889 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5aa9a049-0a2b-406b-91cf-9f90b49be43d tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1314 microversion: 2.1 time: 0.300635 Oct 29 01:05:26.924335 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 218/437] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:26 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:27.041784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f84072d5-5028-4513-adaf-c1f57c2fe680 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:27.051795 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f84072d5-5028-4513-adaf-c1f57c2fe680 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1319 microversion: 2.1 time: 0.202213 Oct 29 01:05:27.052639 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 220/438] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:26 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:27.259193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d833674e-0708-4834-bd78-ec3aac012aba tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:27.260072 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d833674e-0708-4834-bd78-ec3aac012aba tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:27.266926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d833674e-0708-4834-bd78-ec3aac012aba tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:27.267552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d833674e-0708-4834-bd78-ec3aac012aba tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:27.267993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d833674e-0708-4834-bd78-ec3aac012aba tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:27.268697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d833674e-0708-4834-bd78-ec3aac012aba tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:27.269173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d833674e-0708-4834-bd78-ec3aac012aba tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:27.269729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d833674e-0708-4834-bd78-ec3aac012aba tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:27.282172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d3656e60-137b-47cb-8eb5-d1074da7fbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:27.283020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d3656e60-137b-47cb-8eb5-d1074da7fbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:27.290927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3656e60-137b-47cb-8eb5-d1074da7fbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:27.291812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3656e60-137b-47cb-8eb5-d1074da7fbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:27.292640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3656e60-137b-47cb-8eb5-d1074da7fbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:27.293550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3656e60-137b-47cb-8eb5-d1074da7fbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:27.294266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3656e60-137b-47cb-8eb5-d1074da7fbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:27.294950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3656e60-137b-47cb-8eb5-d1074da7fbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:27.551709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d833674e-0708-4834-bd78-ec3aac012aba tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:27.555690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d3656e60-137b-47cb-8eb5-d1074da7fbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:27.560179 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d833674e-0708-4834-bd78-ec3aac012aba tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1317 microversion: 2.1 time: 0.305617 Oct 29 01:05:27.560837 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 219/439] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:27 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:27.573542 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d3656e60-137b-47cb-8eb5-d1074da7fbce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 200 len: 1317 microversion: 2.1 time: 0.295363 Oct 29 01:05:27.574415 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 221/440] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:27 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:27.874760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e8ae6488-bc37-4347-9c6b-1e6c44b3889d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:27.875376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e8ae6488-bc37-4347-9c6b-1e6c44b3889d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:27.882407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8ae6488-bc37-4347-9c6b-1e6c44b3889d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:27.882900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8ae6488-bc37-4347-9c6b-1e6c44b3889d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:27.883346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8ae6488-bc37-4347-9c6b-1e6c44b3889d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:27.884041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8ae6488-bc37-4347-9c6b-1e6c44b3889d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:27.884497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8ae6488-bc37-4347-9c6b-1e6c44b3889d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:27.884925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8ae6488-bc37-4347-9c6b-1e6c44b3889d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:27.948210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b1f56ae5-a65e-43e6-8ed6-3d1fbd3216d3 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:27.949014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b1f56ae5-a65e-43e6-8ed6-3d1fbd3216d3 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:27.955205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1f56ae5-a65e-43e6-8ed6-3d1fbd3216d3 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:27.955686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1f56ae5-a65e-43e6-8ed6-3d1fbd3216d3 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:27.956313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1f56ae5-a65e-43e6-8ed6-3d1fbd3216d3 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:27.957480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1f56ae5-a65e-43e6-8ed6-3d1fbd3216d3 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:27.958147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1f56ae5-a65e-43e6-8ed6-3d1fbd3216d3 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:27.958924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1f56ae5-a65e-43e6-8ed6-3d1fbd3216d3 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:28.050598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=36 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:28.137401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e8ae6488-bc37-4347-9c6b-1e6c44b3889d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:28.157942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e8ae6488-bc37-4347-9c6b-1e6c44b3889d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:28.159393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e8ae6488-bc37-4347-9c6b-1e6c44b3889d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:28.161008 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e8ae6488-bc37-4347-9c6b-1e6c44b3889d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1557 microversion: 2.25 time: 0.290515 Oct 29 01:05:28.161610 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 220/441] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:27 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1557 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:28.169320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-83bcdbe2-137d-4328-8c19-6e723f717c3c tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:28.169679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-83bcdbe2-137d-4328-8c19-6e723f717c3c tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:28.176748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83bcdbe2-137d-4328-8c19-6e723f717c3c tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:28.177571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83bcdbe2-137d-4328-8c19-6e723f717c3c tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:28.178179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83bcdbe2-137d-4328-8c19-6e723f717c3c tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:28.179054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83bcdbe2-137d-4328-8c19-6e723f717c3c tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:28.179754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83bcdbe2-137d-4328-8c19-6e723f717c3c tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:28.180657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83bcdbe2-137d-4328-8c19-6e723f717c3c tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:28.453064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b1f56ae5-a65e-43e6-8ed6-3d1fbd3216d3 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:28.461459 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b1f56ae5-a65e-43e6-8ed6-3d1fbd3216d3 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1314 microversion: 2.1 time: 0.517198 Oct 29 01:05:28.462460 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 222/442] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:27 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:05:28.585952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-83bcdbe2-137d-4328-8c19-6e723f717c3c tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:28.602429 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-83bcdbe2-137d-4328-8c19-6e723f717c3c tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1319 microversion: 2.1 time: 0.439524 Oct 29 01:05:28.613632 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 221/443] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:28 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1319 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:28.613632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-161e9281-1e9c-4693-99bc-2f06f71ea43d tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:28.613632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-161e9281-1e9c-4693-99bc-2f06f71ea43d tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:28.617975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-161e9281-1e9c-4693-99bc-2f06f71ea43d tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:28.618529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-161e9281-1e9c-4693-99bc-2f06f71ea43d tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:28.618957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-161e9281-1e9c-4693-99bc-2f06f71ea43d tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:28.620138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-161e9281-1e9c-4693-99bc-2f06f71ea43d tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:28.620724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-161e9281-1e9c-4693-99bc-2f06f71ea43d tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:28.621462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-161e9281-1e9c-4693-99bc-2f06f71ea43d tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:28.708288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2297422a-fafb-434b-94dd-3d9d4460e854 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:28.708819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2297422a-fafb-434b-94dd-3d9d4460e854 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:28.715058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2297422a-fafb-434b-94dd-3d9d4460e854 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:28.715545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2297422a-fafb-434b-94dd-3d9d4460e854 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:28.715996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2297422a-fafb-434b-94dd-3d9d4460e854 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:28.716697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2297422a-fafb-434b-94dd-3d9d4460e854 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:28.717188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2297422a-fafb-434b-94dd-3d9d4460e854 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:28.717602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2297422a-fafb-434b-94dd-3d9d4460e854 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:28.793557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-161e9281-1e9c-4693-99bc-2f06f71ea43d tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:28.801248 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-161e9281-1e9c-4693-99bc-2f06f71ea43d tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1317 microversion: 2.1 time: 0.196465 Oct 29 01:05:28.818312 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 222/444] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:28 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:28.824653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5358ada1-a54c-4122-9fb5-b65f425ac72e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:28.825461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5358ada1-a54c-4122-9fb5-b65f425ac72e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:28.833353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5358ada1-a54c-4122-9fb5-b65f425ac72e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:28.834419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5358ada1-a54c-4122-9fb5-b65f425ac72e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:28.835015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5358ada1-a54c-4122-9fb5-b65f425ac72e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:28.836444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5358ada1-a54c-4122-9fb5-b65f425ac72e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:28.837062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5358ada1-a54c-4122-9fb5-b65f425ac72e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:28.837809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5358ada1-a54c-4122-9fb5-b65f425ac72e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:29.049236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-2297422a-fafb-434b-94dd-3d9d4460e854 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'services' on Instance uuid 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:05:29.060930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5358ada1-a54c-4122-9fb5-b65f425ac72e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:29.071206 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5358ada1-a54c-4122-9fb5-b65f425ac72e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 200 len: 1317 microversion: 2.1 time: 0.251637 Oct 29 01:05:29.072195 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 223/445] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:28 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:29.078945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-be48fea1-ad74-4731-9ac0-80df8cdf94ed req-bb305c16-fc51-4f61-9172-7905eb6f66fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e8aabd6-f029-4d30-b984-ac9905d35c60", "name": "network-vif-plugged", "status": "completed", "tag": "c1de427c-560f-4f24-8158-8a289cec2e31"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:29.092601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-be48fea1-ad74-4731-9ac0-80df8cdf94ed req-bb305c16-fc51-4f61-9172-7905eb6f66fa service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:29.093226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-be48fea1-ad74-4731-9ac0-80df8cdf94ed req-bb305c16-fc51-4f61-9172-7905eb6f66fa service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:29.093548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-be48fea1-ad74-4731-9ac0-80df8cdf94ed req-bb305c16-fc51-4f61-9172-7905eb6f66fa service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:29.109420 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-be48fea1-ad74-4731-9ac0-80df8cdf94ed req-bb305c16-fc51-4f61-9172-7905eb6f66fa service nova] Creating event network-vif-plugged:c1de427c-560f-4f24-8158-8a289cec2e31 for instance 8e8aabd6-f029-4d30-b984-ac9905d35c60 on n-h2-862964-3 Oct 29 01:05:29.114689 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2297422a-fafb-434b-94dd-3d9d4460e854 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 2050 microversion: 2.25 time: 0.651085 Oct 29 01:05:29.115034 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-be48fea1-ad74-4731-9ac0-80df8cdf94ed req-bb305c16-fc51-4f61-9172-7905eb6f66fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041671 Oct 29 01:05:29.115525 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 223/446] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:28 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 2050 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:29.121331 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 224/447] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:29.141140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0f8c2916-7a67-49fa-9ebe-dbbdb8788849 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:29.141793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0f8c2916-7a67-49fa-9ebe-dbbdb8788849 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:29.145988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:29.149883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f8c2916-7a67-49fa-9ebe-dbbdb8788849 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:29.150373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f8c2916-7a67-49fa-9ebe-dbbdb8788849 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:29.150809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f8c2916-7a67-49fa-9ebe-dbbdb8788849 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:29.151508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f8c2916-7a67-49fa-9ebe-dbbdb8788849 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:29.152031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f8c2916-7a67-49fa-9ebe-dbbdb8788849 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:29.152431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f8c2916-7a67-49fa-9ebe-dbbdb8788849 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:29.353244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-0f8c2916-7a67-49fa-9ebe-dbbdb8788849 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'services' on Instance uuid 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:05:29.368255 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0f8c2916-7a67-49fa-9ebe-dbbdb8788849 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 2050 microversion: 2.25 time: 0.231125 Oct 29 01:05:29.373195 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 224/448] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:29 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 2050 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:29.393916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d85d432-a573-4fb6-a643-17e775a71f99 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:29.397542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d85d432-a573-4fb6-a643-17e775a71f99 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:29.398034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d85d432-a573-4fb6-a643-17e775a71f99 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:29.398480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d85d432-a573-4fb6-a643-17e775a71f99 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:29.399217 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d85d432-a573-4fb6-a643-17e775a71f99 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:29.399681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d85d432-a573-4fb6-a643-17e775a71f99 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:29.400105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d85d432-a573-4fb6-a643-17e775a71f99 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:29.413382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:29.425093 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7d85d432-a573-4fb6-a643-17e775a71f99 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.035505 Oct 29 01:05:29.426359 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 225/449] 10.222.0.26 () {60 vars in 1217 bytes} [Sat Oct 29 01:05:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:05:29.438953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3090d5c7-ba28-471a-a546-b1a79ab16e46 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862964-3", "block_migration": "auto"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:29.443637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3090d5c7-ba28-471a-a546-b1a79ab16e46 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:29.447597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3090d5c7-ba28-471a-a546-b1a79ab16e46 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:29.448076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3090d5c7-ba28-471a-a546-b1a79ab16e46 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:29.448508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3090d5c7-ba28-471a-a546-b1a79ab16e46 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:29.449218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3090d5c7-ba28-471a-a546-b1a79ab16e46 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:29.449670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3090d5c7-ba28-471a-a546-b1a79ab16e46 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:29.450091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3090d5c7-ba28-471a-a546-b1a79ab16e46 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:29.452393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:29.498315 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0449ef3b-cd5a-491a-8102-c94bd2962427 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:29.500298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-3090d5c7-ba28-471a-a546-b1a79ab16e46 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'flavor' on Instance uuid 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:05:29.501360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0449ef3b-cd5a-491a-8102-c94bd2962427 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:29.512274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0449ef3b-cd5a-491a-8102-c94bd2962427 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:29.513048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0449ef3b-cd5a-491a-8102-c94bd2962427 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:29.513657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0449ef3b-cd5a-491a-8102-c94bd2962427 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:29.514584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0449ef3b-cd5a-491a-8102-c94bd2962427 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:29.515626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0449ef3b-cd5a-491a-8102-c94bd2962427 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:29.516324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0449ef3b-cd5a-491a-8102-c94bd2962427 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:29.521678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3090d5c7-ba28-471a-a546-b1a79ab16e46 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Going to try to live migrate instance to n-h2-862964-3 {{(pid=121099) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 01:05:29.631858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=8 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:29.688728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0449ef3b-cd5a-491a-8102-c94bd2962427 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:29.698739 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0449ef3b-cd5a-491a-8102-c94bd2962427 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1314 microversion: 2.1 time: 0.213732 Oct 29 01:05:29.699495 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 226/450] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:29 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:29.704527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0955dcfc-6582-4e80-a3d7-c7815f4d6fbe tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:29.705137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0955dcfc-6582-4e80-a3d7-c7815f4d6fbe tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:29.711384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0955dcfc-6582-4e80-a3d7-c7815f4d6fbe tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:29.713285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0955dcfc-6582-4e80-a3d7-c7815f4d6fbe tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:29.713285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0955dcfc-6582-4e80-a3d7-c7815f4d6fbe tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:29.713285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0955dcfc-6582-4e80-a3d7-c7815f4d6fbe tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:29.714003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0955dcfc-6582-4e80-a3d7-c7815f4d6fbe tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:29.714590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0955dcfc-6582-4e80-a3d7-c7815f4d6fbe tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:29.873828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0955dcfc-6582-4e80-a3d7-c7815f4d6fbe tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:29.882665 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0955dcfc-6582-4e80-a3d7-c7815f4d6fbe tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1319 microversion: 2.1 time: 0.181838 Oct 29 01:05:29.883240 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 227/451] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:29 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:29.887887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9aa72208-0998-4784-88b4-dc2e7852f1cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:29.888480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9aa72208-0998-4784-88b4-dc2e7852f1cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:29.896499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9aa72208-0998-4784-88b4-dc2e7852f1cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:29.896986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9aa72208-0998-4784-88b4-dc2e7852f1cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:29.897457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9aa72208-0998-4784-88b4-dc2e7852f1cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:29.898151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9aa72208-0998-4784-88b4-dc2e7852f1cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:29.898603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9aa72208-0998-4784-88b4-dc2e7852f1cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:29.899372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9aa72208-0998-4784-88b4-dc2e7852f1cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:30.175129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9aa72208-0998-4784-88b4-dc2e7852f1cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:30.183721 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9aa72208-0998-4784-88b4-dc2e7852f1cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1317 microversion: 2.1 time: 0.299458 Oct 29 01:05:30.184616 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 228/452] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:29 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:30.189962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-95ace127-73ce-4150-a19d-3dd5631e324a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:30.190713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-95ace127-73ce-4150-a19d-3dd5631e324a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:30.200967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95ace127-73ce-4150-a19d-3dd5631e324a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:30.201625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95ace127-73ce-4150-a19d-3dd5631e324a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:30.202368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95ace127-73ce-4150-a19d-3dd5631e324a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:30.207181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95ace127-73ce-4150-a19d-3dd5631e324a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:30.207181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95ace127-73ce-4150-a19d-3dd5631e324a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:30.207181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95ace127-73ce-4150-a19d-3dd5631e324a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:30.512254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-95ace127-73ce-4150-a19d-3dd5631e324a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:30.523814 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-95ace127-73ce-4150-a19d-3dd5631e324a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 200 len: 1317 microversion: 2.1 time: 0.335278 Oct 29 01:05:30.525525 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 229/453] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:30 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:30.722969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7ef58c08-5c9a-49db-b7dd-8ebc08d632a0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:30.723785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7ef58c08-5c9a-49db-b7dd-8ebc08d632a0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:30.729886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ef58c08-5c9a-49db-b7dd-8ebc08d632a0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:30.730371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ef58c08-5c9a-49db-b7dd-8ebc08d632a0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:30.731001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ef58c08-5c9a-49db-b7dd-8ebc08d632a0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:30.731705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ef58c08-5c9a-49db-b7dd-8ebc08d632a0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:30.732170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ef58c08-5c9a-49db-b7dd-8ebc08d632a0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:30.732729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ef58c08-5c9a-49db-b7dd-8ebc08d632a0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:30.946430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7ef58c08-5c9a-49db-b7dd-8ebc08d632a0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:30.948902 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:30.958136 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7ef58c08-5c9a-49db-b7dd-8ebc08d632a0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1464 microversion: 2.1 time: 0.239670 Oct 29 01:05:30.958739 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 230/454] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:30 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1464 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:05:30.986050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fb6dbd43-b2eb-44a7-bda5-745125e8a29b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:30.986817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fb6dbd43-b2eb-44a7-bda5-745125e8a29b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:30.993981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb6dbd43-b2eb-44a7-bda5-745125e8a29b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:30.994536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb6dbd43-b2eb-44a7-bda5-745125e8a29b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:30.994987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb6dbd43-b2eb-44a7-bda5-745125e8a29b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:30.997207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb6dbd43-b2eb-44a7-bda5-745125e8a29b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:30.997207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb6dbd43-b2eb-44a7-bda5-745125e8a29b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:30.997207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb6dbd43-b2eb-44a7-bda5-745125e8a29b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:31.148156 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fb6dbd43-b2eb-44a7-bda5-745125e8a29b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:31.156709 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fb6dbd43-b2eb-44a7-bda5-745125e8a29b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1319 microversion: 2.1 time: 0.196753 Oct 29 01:05:31.157512 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 231/455] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:30 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:31.390491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-495847af-e749-4a98-bd69-ef528490683e tempest-TenantUsagesTestJSON-1903823846 tempest-TenantUsagesTestJSON-1903823846-project-admin] Calling method '.version_select at 0x7f9d9c63e940>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:31.402440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-495847af-e749-4a98-bd69-ef528490683e tempest-TenantUsagesTestJSON-1903823846 tempest-TenantUsagesTestJSON-1903823846-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:31.402918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-495847af-e749-4a98-bd69-ef528490683e tempest-TenantUsagesTestJSON-1903823846 tempest-TenantUsagesTestJSON-1903823846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:31.403344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-495847af-e749-4a98-bd69-ef528490683e tempest-TenantUsagesTestJSON-1903823846 tempest-TenantUsagesTestJSON-1903823846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:31.423223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-495847af-e749-4a98-bd69-ef528490683e tempest-TenantUsagesTestJSON-1903823846 tempest-TenantUsagesTestJSON-1903823846-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:31.432358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-495847af-e749-4a98-bd69-ef528490683e tempest-TenantUsagesTestJSON-1903823846 tempest-TenantUsagesTestJSON-1903823846-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:31.432358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-495847af-e749-4a98-bd69-ef528490683e tempest-TenantUsagesTestJSON-1903823846 tempest-TenantUsagesTestJSON-1903823846-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:31.443491 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-495847af-e749-4a98-bd69-ef528490683e tempest-TenantUsagesTestJSON-1903823846 tempest-TenantUsagesTestJSON-1903823846-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/61912f5be1a14ceaadbf630612a0ac6d?start=2022-10-28T01%3A05%3A30.977761&end=2022-10-30T01%3A05%3A30.977761" status: 200 len: 700 microversion: 2.1 time: 0.284711 Oct 29 01:05:31.455447 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 232/456] 10.222.0.26 () {58 vars in 1412 bytes} [Sat Oct 29 01:05:31 2022] GET /compute/v2.1/os-simple-tenant-usage/61912f5be1a14ceaadbf630612a0ac6d?start=2022-10-28T01%3A05%3A30.977761&end=2022-10-30T01%3A05%3A30.977761 => generated 700 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:31.462819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9196ddaf-4b64-4e30-9db1-c4ac63b5c3cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:31.467214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9196ddaf-4b64-4e30-9db1-c4ac63b5c3cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:31.470034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9196ddaf-4b64-4e30-9db1-c4ac63b5c3cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:31.470785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9196ddaf-4b64-4e30-9db1-c4ac63b5c3cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:31.471282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9196ddaf-4b64-4e30-9db1-c4ac63b5c3cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:31.472301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9196ddaf-4b64-4e30-9db1-c4ac63b5c3cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:31.473787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9196ddaf-4b64-4e30-9db1-c4ac63b5c3cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:31.474440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9196ddaf-4b64-4e30-9db1-c4ac63b5c3cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:31.663978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9196ddaf-4b64-4e30-9db1-c4ac63b5c3cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:31.672006 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9196ddaf-4b64-4e30-9db1-c4ac63b5c3cb tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1317 microversion: 2.1 time: 0.215307 Oct 29 01:05:31.672582 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 233/457] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:31 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:31.688497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e1e46ac6-7b58-44f1-be00-35ba9eeffc9b tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '.version_select at 0x7f9d9c5b88b0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:31.696179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1e46ac6-7b58-44f1-be00-35ba9eeffc9b tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:31.696668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1e46ac6-7b58-44f1-be00-35ba9eeffc9b tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:31.697100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1e46ac6-7b58-44f1-be00-35ba9eeffc9b tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:31.708570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1e46ac6-7b58-44f1-be00-35ba9eeffc9b tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:31.709305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1e46ac6-7b58-44f1-be00-35ba9eeffc9b tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:31.710694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1e46ac6-7b58-44f1-be00-35ba9eeffc9b tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:31.723404 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e1e46ac6-7b58-44f1-be00-35ba9eeffc9b tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/61912f5be1a14ceaadbf630612a0ac6d?start=2022-10-28T01%3A05%3A30.977761&end=2022-10-30T01%3A05%3A30.977761" status: 200 len: 695 microversion: 2.1 time: 0.049623 Oct 29 01:05:31.724324 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 234/458] 10.222.0.26 () {58 vars in 1412 bytes} [Sat Oct 29 01:05:31 2022] GET /compute/v2.1/os-simple-tenant-usage/61912f5be1a14ceaadbf630612a0ac6d?start=2022-10-28T01%3A05%3A30.977761&end=2022-10-30T01%3A05%3A30.977761 => generated 695 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:31.729030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6748d06a-40a9-4742-80a5-4948ebdeef42 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:31.729933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6748d06a-40a9-4742-80a5-4948ebdeef42 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:31.737295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6748d06a-40a9-4742-80a5-4948ebdeef42 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:31.737295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6748d06a-40a9-4742-80a5-4948ebdeef42 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:31.737641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6748d06a-40a9-4742-80a5-4948ebdeef42 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:31.738635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6748d06a-40a9-4742-80a5-4948ebdeef42 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:31.739296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6748d06a-40a9-4742-80a5-4948ebdeef42 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:31.739899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6748d06a-40a9-4742-80a5-4948ebdeef42 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:31.949196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6748d06a-40a9-4742-80a5-4948ebdeef42 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:31.965653 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6748d06a-40a9-4742-80a5-4948ebdeef42 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 200 len: 1317 microversion: 2.1 time: 0.240005 Oct 29 01:05:31.981720 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 235/459] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:31 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:31.987292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d094b8dd-3aa7-4fb3-884a-b003ff945114 tempest-TenantUsagesTestJSON-1903823846 tempest-TenantUsagesTestJSON-1903823846-project-admin] Calling method '.version_select at 0x7f9d9c6743a0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:31.997300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d094b8dd-3aa7-4fb3-884a-b003ff945114 tempest-TenantUsagesTestJSON-1903823846 tempest-TenantUsagesTestJSON-1903823846-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:31.998024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d094b8dd-3aa7-4fb3-884a-b003ff945114 tempest-TenantUsagesTestJSON-1903823846 tempest-TenantUsagesTestJSON-1903823846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:31.998623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d094b8dd-3aa7-4fb3-884a-b003ff945114 tempest-TenantUsagesTestJSON-1903823846 tempest-TenantUsagesTestJSON-1903823846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:32.015142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d094b8dd-3aa7-4fb3-884a-b003ff945114 tempest-TenantUsagesTestJSON-1903823846 tempest-TenantUsagesTestJSON-1903823846-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:32.019415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d094b8dd-3aa7-4fb3-884a-b003ff945114 tempest-TenantUsagesTestJSON-1903823846 tempest-TenantUsagesTestJSON-1903823846-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:32.019415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d094b8dd-3aa7-4fb3-884a-b003ff945114 tempest-TenantUsagesTestJSON-1903823846 tempest-TenantUsagesTestJSON-1903823846-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:32.043752 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d094b8dd-3aa7-4fb3-884a-b003ff945114 tempest-TenantUsagesTestJSON-1903823846 tempest-TenantUsagesTestJSON-1903823846-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T01%3A05%3A30.977761&end=2022-10-30T01%3A05%3A30.977761&detailed=1" status: 200 len: 4176 microversion: 2.1 time: 0.060530 Oct 29 01:05:32.044530 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 236/460] 10.222.0.26 () {58 vars in 1335 bytes} [Sat Oct 29 01:05:31 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T01%3A05%3A30.977761&end=2022-10-30T01%3A05%3A30.977761&detailed=1 => generated 4176 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:32.065561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1de357df-0443-4029-9a3d-8c20e6487d56 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:32.066134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1de357df-0443-4029-9a3d-8c20e6487d56 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:32.073407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1de357df-0443-4029-9a3d-8c20e6487d56 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:32.074239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1de357df-0443-4029-9a3d-8c20e6487d56 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:32.074384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1de357df-0443-4029-9a3d-8c20e6487d56 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:32.075044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1de357df-0443-4029-9a3d-8c20e6487d56 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:32.075684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1de357df-0443-4029-9a3d-8c20e6487d56 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:32.076806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1de357df-0443-4029-9a3d-8c20e6487d56 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:32.107218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1de357df-0443-4029-9a3d-8c20e6487d56 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:05:32.663577 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1de357df-0443-4029-9a3d-8c20e6487d56 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 204 len: 0 microversion: 2.1 time: 0.603399 Oct 29 01:05:32.665174 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 237/461] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:05:32 2022] DELETE /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 0 bytes in 606 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:05:32.672627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9eab187a-bdf7-4d97-b617-bb7a0e1e3573 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:32.673645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9eab187a-bdf7-4d97-b617-bb7a0e1e3573 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:32.686423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9eab187a-bdf7-4d97-b617-bb7a0e1e3573 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:32.697594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9eab187a-bdf7-4d97-b617-bb7a0e1e3573 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:32.697594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9eab187a-bdf7-4d97-b617-bb7a0e1e3573 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:32.697594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9eab187a-bdf7-4d97-b617-bb7a0e1e3573 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:32.697594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9eab187a-bdf7-4d97-b617-bb7a0e1e3573 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:32.698218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9eab187a-bdf7-4d97-b617-bb7a0e1e3573 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:32.892360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9eab187a-bdf7-4d97-b617-bb7a0e1e3573 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:32.902994 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9eab187a-bdf7-4d97-b617-bb7a0e1e3573 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1319 microversion: 2.1 time: 0.235444 Oct 29 01:05:32.904115 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 238/462] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:32 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:33.217218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7db69c58-4c18-4453-9a98-0b726a2f30d3 tempest-NetworksTest-63340229 tempest-NetworksTest-63340229-project-admin] Calling method '.version_select at 0x7f9d9c5b8280>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:33.521104 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7db69c58-4c18-4453-9a98-0b726a2f30d3 tempest-NetworksTest-63340229 tempest-NetworksTest-63340229-project-admin] 10.222.0.26 "GET /compute/v2.1/os-networks" status: 200 len: 4706 microversion: 2.1 time: 0.615912 Oct 29 01:05:33.521814 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 239/463] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:05:32 2022] GET /compute/v2.1/os-networks => generated 4706 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:33.529529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a0a289a3-4521-4781-afe4-516423793de1 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:33.532585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a0a289a3-4521-4781-afe4-516423793de1 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:33.541462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0a289a3-4521-4781-afe4-516423793de1 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:33.544264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0a289a3-4521-4781-afe4-516423793de1 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:33.544264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0a289a3-4521-4781-afe4-516423793de1 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:33.544264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0a289a3-4521-4781-afe4-516423793de1 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:33.544264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0a289a3-4521-4781-afe4-516423793de1 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:33.544639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0a289a3-4521-4781-afe4-516423793de1 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:33.940318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a0a289a3-4521-4781-afe4-516423793de1 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:33.949858 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a0a289a3-4521-4781-afe4-516423793de1 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1470 microversion: 2.1 time: 0.426800 Oct 29 01:05:33.950976 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 240/464] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:33 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1470 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:33.955829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-79d46ac1-435d-4fe4-8357-1eb10617a40e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:33.960945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-79d46ac1-435d-4fe4-8357-1eb10617a40e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:33.966004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79d46ac1-435d-4fe4-8357-1eb10617a40e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:33.966705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79d46ac1-435d-4fe4-8357-1eb10617a40e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:33.967307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79d46ac1-435d-4fe4-8357-1eb10617a40e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:33.968499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79d46ac1-435d-4fe4-8357-1eb10617a40e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:33.968961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79d46ac1-435d-4fe4-8357-1eb10617a40e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:33.969414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79d46ac1-435d-4fe4-8357-1eb10617a40e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:34.115988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-79d46ac1-435d-4fe4-8357-1eb10617a40e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:34.124741 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-79d46ac1-435d-4fe4-8357-1eb10617a40e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1317 microversion: 2.1 time: 0.172590 Oct 29 01:05:34.125468 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 241/465] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:33 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:34.131743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e91d865a-7a6e-4bac-b18a-7c651869fdcc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:34.132441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e91d865a-7a6e-4bac-b18a-7c651869fdcc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:34.145257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e91d865a-7a6e-4bac-b18a-7c651869fdcc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:34.147186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e91d865a-7a6e-4bac-b18a-7c651869fdcc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:34.147710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e91d865a-7a6e-4bac-b18a-7c651869fdcc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:34.149229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e91d865a-7a6e-4bac-b18a-7c651869fdcc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:34.149339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e91d865a-7a6e-4bac-b18a-7c651869fdcc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:34.157385 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3090d5c7-ba28-471a-a546-b1a79ab16e46 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e/action" status: 202 len: 0 microversion: 2.25 time: 4.714466 Oct 29 01:05:34.158501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e91d865a-7a6e-4bac-b18a-7c651869fdcc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:34.158604 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 225/466] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 29 01:05:29 2022] POST /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e/action => generated 0 bytes in 4716 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:05:34.158604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80b49dfd-b497-43d9-998a-8026f64d91c8 tempest-NetworksTest-63340229 tempest-NetworksTest-63340229-project-admin] Calling method '.version_select at 0x7f9d9c1578b0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:34.338782 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-80b49dfd-b497-43d9-998a-8026f64d91c8 tempest-NetworksTest-63340229 tempest-NetworksTest-63340229-project-admin] 10.222.0.26 "GET /compute/v2.1/os-networks/28a3ad30-a90e-4539-9105-75a1ae5b0ef9" status: 200 len: 652 microversion: 2.1 time: 0.187122 Oct 29 01:05:34.340071 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 226/467] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 29 01:05:34 2022] GET /compute/v2.1/os-networks/28a3ad30-a90e-4539-9105-75a1ae5b0ef9 => generated 652 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:34.347047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-38aa6cd0-95b7-4a1d-ad94-1e928f71802e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:34.348588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-38aa6cd0-95b7-4a1d-ad94-1e928f71802e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:34.363927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38aa6cd0-95b7-4a1d-ad94-1e928f71802e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:34.363927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38aa6cd0-95b7-4a1d-ad94-1e928f71802e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:34.363927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38aa6cd0-95b7-4a1d-ad94-1e928f71802e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:34.363927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38aa6cd0-95b7-4a1d-ad94-1e928f71802e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:34.364608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38aa6cd0-95b7-4a1d-ad94-1e928f71802e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:34.366015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38aa6cd0-95b7-4a1d-ad94-1e928f71802e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:34.367274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e91d865a-7a6e-4bac-b18a-7c651869fdcc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:34.381490 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e91d865a-7a6e-4bac-b18a-7c651869fdcc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 200 len: 1467 microversion: 2.1 time: 0.254234 Oct 29 01:05:34.382100 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 242/468] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:34 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 1467 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:34.387206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-19880cf9-5004-4164-85fa-e35d411a76e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:34.389924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-19880cf9-5004-4164-85fa-e35d411a76e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:34.400284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19880cf9-5004-4164-85fa-e35d411a76e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:34.400709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19880cf9-5004-4164-85fa-e35d411a76e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:34.403194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19880cf9-5004-4164-85fa-e35d411a76e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:34.403928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19880cf9-5004-4164-85fa-e35d411a76e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:34.404402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19880cf9-5004-4164-85fa-e35d411a76e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:34.404858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19880cf9-5004-4164-85fa-e35d411a76e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:34.579292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-38aa6cd0-95b7-4a1d-ad94-1e928f71802e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:34.587688 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-38aa6cd0-95b7-4a1d-ad94-1e928f71802e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1319 microversion: 2.1 time: 0.246551 Oct 29 01:05:34.590687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-19880cf9-5004-4164-85fa-e35d411a76e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:34.594611 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 227/469] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:34 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:34.599387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3a384592-4770-4151-9209-cdf239e6a4a3 tempest-NetworksTest-63340229 tempest-NetworksTest-63340229-project-admin] Calling method '.version_select at 0x7f9d9c25ff70>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:34.602470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-19880cf9-5004-4164-85fa-e35d411a76e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:34.604138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-19880cf9-5004-4164-85fa-e35d411a76e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:34.605548 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-19880cf9-5004-4164-85fa-e35d411a76e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1567 microversion: 2.25 time: 0.222173 Oct 29 01:05:34.609618 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 243/470] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:34 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:34.611462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-19a97153-4d95-4783-a86a-5bbf22f24096 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:34.612074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-19a97153-4d95-4783-a86a-5bbf22f24096 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e328b4b4-473e-44af-9260-e3e1df072c09] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:34.620110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19a97153-4d95-4783-a86a-5bbf22f24096 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:34.620887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19a97153-4d95-4783-a86a-5bbf22f24096 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:34.621786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19a97153-4d95-4783-a86a-5bbf22f24096 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:34.623076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19a97153-4d95-4783-a86a-5bbf22f24096 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:34.623680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19a97153-4d95-4783-a86a-5bbf22f24096 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:34.624444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19a97153-4d95-4783-a86a-5bbf22f24096 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:34.780310 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3a384592-4770-4151-9209-cdf239e6a4a3 tempest-NetworksTest-63340229 tempest-NetworksTest-63340229-project-admin] 10.222.0.26 "GET /compute/v2.1/os-networks" status: 200 len: 4706 microversion: 2.1 time: 0.184588 Oct 29 01:05:34.780937 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 228/471] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:05:34 2022] GET /compute/v2.1/os-networks => generated 4706 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:34.814131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-19a97153-4d95-4783-a86a-5bbf22f24096 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:34.827064 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-19a97153-4d95-4783-a86a-5bbf22f24096 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09" status: 200 len: 1317 microversion: 2.1 time: 0.217421 Oct 29 01:05:34.845081 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 244/472] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:34 2022] GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:34.862104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-d5657f29-b032-4142-8b4b-ed6985cbe6e0 req-7625965b-fc6e-455b-a3a2-dc0cb8dd528f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c3640f-299c-4975-be9b-612e064d3399", "name": "network-vif-plugged", "status": "completed", "tag": "c0ea08d6-21f2-4a27-992a-09d1ef81df82"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:34.886538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d5657f29-b032-4142-8b4b-ed6985cbe6e0 req-7625965b-fc6e-455b-a3a2-dc0cb8dd528f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:34.887026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d5657f29-b032-4142-8b4b-ed6985cbe6e0 req-7625965b-fc6e-455b-a3a2-dc0cb8dd528f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:34.889322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d5657f29-b032-4142-8b4b-ed6985cbe6e0 req-7625965b-fc6e-455b-a3a2-dc0cb8dd528f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:34.924568 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-d5657f29-b032-4142-8b4b-ed6985cbe6e0 req-7625965b-fc6e-455b-a3a2-dc0cb8dd528f service nova] Creating event network-vif-plugged:c0ea08d6-21f2-4a27-992a-09d1ef81df82 for instance 60c3640f-299c-4975-be9b-612e064d3399 on n-h1-862964-3 Oct 29 01:05:34.930151 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-d5657f29-b032-4142-8b4b-ed6985cbe6e0 req-7625965b-fc6e-455b-a3a2-dc0cb8dd528f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077611 Oct 29 01:05:34.931107 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 245/473] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:34.974352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81ca2d6b-fba8-4886-be75-5a013dba1350 tempest-QuotaClassesAdminTestJSON-2037322267 tempest-QuotaClassesAdminTestJSON-2037322267-project-admin] Calling method '.version_select at 0x7f9d9c12e310>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:34.976210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d8b9972b-d814-44b2-b0ef-b022a14778e0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:34.976920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d8b9972b-d814-44b2-b0ef-b022a14778e0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:34.987519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8b9972b-d814-44b2-b0ef-b022a14778e0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:34.987519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8b9972b-d814-44b2-b0ef-b022a14778e0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:34.987788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8b9972b-d814-44b2-b0ef-b022a14778e0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:34.988619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8b9972b-d814-44b2-b0ef-b022a14778e0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:34.989484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8b9972b-d814-44b2-b0ef-b022a14778e0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:34.989605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8b9972b-d814-44b2-b0ef-b022a14778e0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:35.009117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=51 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:35.011890 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-81ca2d6b-fba8-4886-be75-5a013dba1350 tempest-QuotaClassesAdminTestJSON-2037322267 tempest-QuotaClassesAdminTestJSON-2037322267-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.229627 Oct 29 01:05:35.012678 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 229/474] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Oct 29 01:05:34 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:35.035982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e8bfeaac-04e1-4c65-b2c4-59c34f92ad4f tempest-QuotaClassesAdminTestJSON-2037322267 tempest-QuotaClassesAdminTestJSON-2037322267-project-admin] Action: 'update', calling method: .version_select at 0x7f9d9c1534c0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:35.232858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d8b9972b-d814-44b2-b0ef-b022a14778e0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:35.241695 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d8b9972b-d814-44b2-b0ef-b022a14778e0 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1470 microversion: 2.1 time: 0.270673 Oct 29 01:05:35.242372 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 246/475] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:34 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1470 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:35.261484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ac92f929-3eeb-4946-a216-71b45b140ff9 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:35.262103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ac92f929-3eeb-4946-a216-71b45b140ff9 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:35.273651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac92f929-3eeb-4946-a216-71b45b140ff9 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:35.274133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac92f929-3eeb-4946-a216-71b45b140ff9 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:35.274570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac92f929-3eeb-4946-a216-71b45b140ff9 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:35.275278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac92f929-3eeb-4946-a216-71b45b140ff9 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:35.275736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac92f929-3eeb-4946-a216-71b45b140ff9 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:35.276417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac92f929-3eeb-4946-a216-71b45b140ff9 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:35.550719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ac92f929-3eeb-4946-a216-71b45b140ff9 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:35.560317 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ac92f929-3eeb-4946-a216-71b45b140ff9 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1317 microversion: 2.1 time: 0.316825 Oct 29 01:05:35.561575 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 247/476] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:35 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:35.568058 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-08bcf179-6960-4801-923f-a7b0f6c5a0ae req-06d5f26f-7f64-4415-a8b8-8dbdc4a37f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d821e4c3-4aa0-45aa-acb9-24f55080a6ff", "name": "network-vif-deleted", "tag": "42ca8294-5152-4196-880d-faf05585a2ea"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:35.578508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-08bcf179-6960-4801-923f-a7b0f6c5a0ae req-06d5f26f-7f64-4415-a8b8-8dbdc4a37f28 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:35.579324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-08bcf179-6960-4801-923f-a7b0f6c5a0ae req-06d5f26f-7f64-4415-a8b8-8dbdc4a37f28 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:35.579961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-08bcf179-6960-4801-923f-a7b0f6c5a0ae req-06d5f26f-7f64-4415-a8b8-8dbdc4a37f28 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:35.605803 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-08bcf179-6960-4801-923f-a7b0f6c5a0ae req-06d5f26f-7f64-4415-a8b8-8dbdc4a37f28 service nova] Creating event network-vif-deleted:42ca8294-5152-4196-880d-faf05585a2ea for instance d821e4c3-4aa0-45aa-acb9-24f55080a6ff on n-h2-862964-3 Oct 29 01:05:35.618220 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-08bcf179-6960-4801-923f-a7b0f6c5a0ae req-06d5f26f-7f64-4415-a8b8-8dbdc4a37f28 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053988 Oct 29 01:05:35.619241 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 248/477] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:35.630583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-725e0904-cbbf-4245-88f0-0223d8ff7af8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:35.630583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-725e0904-cbbf-4245-88f0-0223d8ff7af8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:35.638143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-725e0904-cbbf-4245-88f0-0223d8ff7af8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:35.638884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-725e0904-cbbf-4245-88f0-0223d8ff7af8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:35.640595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-725e0904-cbbf-4245-88f0-0223d8ff7af8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:35.641592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-725e0904-cbbf-4245-88f0-0223d8ff7af8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:35.642277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-725e0904-cbbf-4245-88f0-0223d8ff7af8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:35.642851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-725e0904-cbbf-4245-88f0-0223d8ff7af8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:35.836695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-725e0904-cbbf-4245-88f0-0223d8ff7af8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:35.845277 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-725e0904-cbbf-4245-88f0-0223d8ff7af8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1319 microversion: 2.1 time: 0.223977 Oct 29 01:05:35.861216 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 249/478] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:35 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:35.866248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-99a07d5a-d320-4f35-bb93-0626a68c3005 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:35.867188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-99a07d5a-d320-4f35-bb93-0626a68c3005 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:35.873672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99a07d5a-d320-4f35-bb93-0626a68c3005 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:35.874354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99a07d5a-d320-4f35-bb93-0626a68c3005 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:35.874786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99a07d5a-d320-4f35-bb93-0626a68c3005 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:35.875488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99a07d5a-d320-4f35-bb93-0626a68c3005 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:35.875949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99a07d5a-d320-4f35-bb93-0626a68c3005 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:35.876372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99a07d5a-d320-4f35-bb93-0626a68c3005 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:35.879735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:36.079637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-99a07d5a-d320-4f35-bb93-0626a68c3005 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:36.090409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-99a07d5a-d320-4f35-bb93-0626a68c3005 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:36.092024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-99a07d5a-d320-4f35-bb93-0626a68c3005 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:36.093542 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-99a07d5a-d320-4f35-bb93-0626a68c3005 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1567 microversion: 2.25 time: 0.236309 Oct 29 01:05:36.094216 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 250/479] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:35 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:36.099661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0e03434c-24c9-471e-925d-9917a38ba3ad tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:36.100659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0e03434c-24c9-471e-925d-9917a38ba3ad tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e328b4b4-473e-44af-9260-e3e1df072c09] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:36.107492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e03434c-24c9-471e-925d-9917a38ba3ad tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:36.111534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e03434c-24c9-471e-925d-9917a38ba3ad tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:36.112256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e03434c-24c9-471e-925d-9917a38ba3ad tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:36.114469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e03434c-24c9-471e-925d-9917a38ba3ad tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:36.115238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e03434c-24c9-471e-925d-9917a38ba3ad tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:36.115972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e03434c-24c9-471e-925d-9917a38ba3ad tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:36.365604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0e03434c-24c9-471e-925d-9917a38ba3ad tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:36.373478 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0e03434c-24c9-471e-925d-9917a38ba3ad tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09" status: 200 len: 1317 microversion: 2.1 time: 0.278017 Oct 29 01:05:36.374148 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 251/480] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:36 2022] GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09 => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:36.379209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1257ffac-df97-46fb-be85-93794d700fc8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:36.380396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1257ffac-df97-46fb-be85-93794d700fc8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:36.402354 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e8bfeaac-04e1-4c65-b2c4-59c34f92ad4f tempest-QuotaClassesAdminTestJSON-2037322267 tempest-QuotaClassesAdminTestJSON-2037322267-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.376462 Oct 29 01:05:36.402984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1257ffac-df97-46fb-be85-93794d700fc8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:36.402984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1257ffac-df97-46fb-be85-93794d700fc8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:36.402984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1257ffac-df97-46fb-be85-93794d700fc8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:36.402984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1257ffac-df97-46fb-be85-93794d700fc8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:36.403243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1257ffac-df97-46fb-be85-93794d700fc8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:36.403846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1257ffac-df97-46fb-be85-93794d700fc8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:36.404299 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 230/481] 10.222.0.26 () {60 vars in 1206 bytes} [Sat Oct 29 01:05:35 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:36.413492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5ac1c5d9-f031-4f76-bbea-4c92b5b73a7f tempest-QuotaClassesAdminTestJSON-2037322267 tempest-QuotaClassesAdminTestJSON-2037322267-project-admin] Calling method '.version_select at 0x7f9d9c643790>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:36.426341 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5ac1c5d9-f031-4f76-bbea-4c92b5b73a7f tempest-QuotaClassesAdminTestJSON-2037322267 tempest-QuotaClassesAdminTestJSON-2037322267-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.017255 Oct 29 01:05:36.427137 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 231/482] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Oct 29 01:05:36 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:05:36.442476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b8d4df4d-f5e4-4926-b5ca-45e3dcbc4ec5 tempest-QuotaClassesAdminTestJSON-2037322267 tempest-QuotaClassesAdminTestJSON-2037322267-project-admin] Action: 'update', calling method: .version_select at 0x7f9d9c0ef790>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:36.449522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1257ffac-df97-46fb-be85-93794d700fc8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:36.450063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1257ffac-df97-46fb-be85-93794d700fc8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:36.450503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1257ffac-df97-46fb-be85-93794d700fc8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:36.450962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-1257ffac-df97-46fb-be85-93794d700fc8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lazy-loading 'fault' on Instance uuid d821e4c3-4aa0-45aa-acb9-24f55080a6ff {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:05:36.508101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1257ffac-df97-46fb-be85-93794d700fc8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09a2047f41174f5fbf1fc11d515c90c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61912f5be1a14ceaadbf630612a0ac6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:36.526891 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1257ffac-df97-46fb-be85-93794d700fc8 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 200 len: 1304 microversion: 2.1 time: 0.151674 Oct 29 01:05:36.527508 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 252/483] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:36 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 1304 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:36.571874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-50dd5e9b-0309-4849-bbde-edd55dbcb4b9 req-d18d322f-1123-4491-9650-1c7418a41219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba8acd1-344c-42b0-be43-a35cc5ff6f8e", "name": "network-vif-unplugged", "status": "completed", "tag": "cd682e5a-2996-4509-aa56-a7726f2d94bc"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:36.582559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-50dd5e9b-0309-4849-bbde-edd55dbcb4b9 req-d18d322f-1123-4491-9650-1c7418a41219 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:36.583044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-50dd5e9b-0309-4849-bbde-edd55dbcb4b9 req-d18d322f-1123-4491-9650-1c7418a41219 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:36.583477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-50dd5e9b-0309-4849-bbde-edd55dbcb4b9 req-d18d322f-1123-4491-9650-1c7418a41219 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:36.597007 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-50dd5e9b-0309-4849-bbde-edd55dbcb4b9 req-d18d322f-1123-4491-9650-1c7418a41219 service nova] Creating event network-vif-unplugged:cd682e5a-2996-4509-aa56-a7726f2d94bc for instance 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e on n-h1-862964-3 Oct 29 01:05:36.600091 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-50dd5e9b-0309-4849-bbde-edd55dbcb4b9 req-d18d322f-1123-4491-9650-1c7418a41219 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031943 Oct 29 01:05:36.601092 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 253/484] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:05:36.607175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-31f8af27-ad83-4d9f-adb4-65943d8a4eee tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:36.608482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-31f8af27-ad83-4d9f-adb4-65943d8a4eee tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:36.616953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31f8af27-ad83-4d9f-adb4-65943d8a4eee tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:36.618055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31f8af27-ad83-4d9f-adb4-65943d8a4eee tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:36.618497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31f8af27-ad83-4d9f-adb4-65943d8a4eee tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:36.619214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31f8af27-ad83-4d9f-adb4-65943d8a4eee tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:36.619742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31f8af27-ad83-4d9f-adb4-65943d8a4eee tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:36.620102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31f8af27-ad83-4d9f-adb4-65943d8a4eee tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:36.863882 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-31f8af27-ad83-4d9f-adb4-65943d8a4eee tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:36.872172 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-31f8af27-ad83-4d9f-adb4-65943d8a4eee tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1317 microversion: 2.1 time: 0.269723 Oct 29 01:05:36.872756 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 254/485] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:36 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:36.878124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-71adada1-a4c1-4278-987b-3365f32e9227 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:36.879341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-71adada1-a4c1-4278-987b-3365f32e9227 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:36.886473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71adada1-a4c1-4278-987b-3365f32e9227 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:36.887550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71adada1-a4c1-4278-987b-3365f32e9227 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:36.888073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71adada1-a4c1-4278-987b-3365f32e9227 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:36.889242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71adada1-a4c1-4278-987b-3365f32e9227 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:36.889725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71adada1-a4c1-4278-987b-3365f32e9227 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:36.890390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71adada1-a4c1-4278-987b-3365f32e9227 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:37.064412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-71adada1-a4c1-4278-987b-3365f32e9227 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:37.072280 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-71adada1-a4c1-4278-987b-3365f32e9227 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1319 microversion: 2.1 time: 0.198509 Oct 29 01:05:37.072858 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 255/486] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:36 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:37.077381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-b0e4996a-1bf3-41a8-8631-acc827b56e98 req-2f762823-ae19-4eaa-a489-d08170ce922e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e328b4b4-473e-44af-9260-e3e1df072c09", "name": "network-vif-plugged", "status": "completed", "tag": "d15faedf-65dc-4a76-a947-4939de811d0e"}, {"server_uuid": "bf8015b1-0e50-4db4-9bda-eaad0ad293b3", "name": "network-vif-plugged", "status": "completed", "tag": "db0edede-be33-4b87-a766-e1102315288f"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:37.087943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b0e4996a-1bf3-41a8-8631-acc827b56e98 req-2f762823-ae19-4eaa-a489-d08170ce922e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:37.088560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b0e4996a-1bf3-41a8-8631-acc827b56e98 req-2f762823-ae19-4eaa-a489-d08170ce922e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:37.088838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b0e4996a-1bf3-41a8-8631-acc827b56e98 req-2f762823-ae19-4eaa-a489-d08170ce922e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:37.103284 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-b0e4996a-1bf3-41a8-8631-acc827b56e98 req-2f762823-ae19-4eaa-a489-d08170ce922e service nova] Creating event network-vif-plugged:d15faedf-65dc-4a76-a947-4939de811d0e for instance e328b4b4-473e-44af-9260-e3e1df072c09 on n-h2-862964-3 Oct 29 01:05:37.104133 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-b0e4996a-1bf3-41a8-8631-acc827b56e98 req-2f762823-ae19-4eaa-a489-d08170ce922e service nova] Creating event network-vif-plugged:db0edede-be33-4b87-a766-e1102315288f for instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 on n-h2-862964-3 Oct 29 01:05:37.110200 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-b0e4996a-1bf3-41a8-8631-acc827b56e98 req-2f762823-ae19-4eaa-a489-d08170ce922e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036169 Oct 29 01:05:37.110801 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 256/487] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:37.121605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ed4a9b2b-2a21-4138-b706-153e5f18cec9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:37.122299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ed4a9b2b-2a21-4138-b706-153e5f18cec9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:37.128890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed4a9b2b-2a21-4138-b706-153e5f18cec9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:37.129401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed4a9b2b-2a21-4138-b706-153e5f18cec9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:37.129837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed4a9b2b-2a21-4138-b706-153e5f18cec9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:37.130597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed4a9b2b-2a21-4138-b706-153e5f18cec9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:37.131050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed4a9b2b-2a21-4138-b706-153e5f18cec9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:37.131472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed4a9b2b-2a21-4138-b706-153e5f18cec9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:37.427078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ed4a9b2b-2a21-4138-b706-153e5f18cec9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:37.437938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ed4a9b2b-2a21-4138-b706-153e5f18cec9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:37.439714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ed4a9b2b-2a21-4138-b706-153e5f18cec9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:37.442163 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ed4a9b2b-2a21-4138-b706-153e5f18cec9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1567 microversion: 2.25 time: 0.325099 Oct 29 01:05:37.443156 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 257/488] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:37 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1567 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:05:37.456426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fc02a4e4-f25e-42bd-9fee-449196e39e70 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:37.456426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fc02a4e4-f25e-42bd-9fee-449196e39e70 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e328b4b4-473e-44af-9260-e3e1df072c09] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:37.461490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc02a4e4-f25e-42bd-9fee-449196e39e70 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:37.462162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc02a4e4-f25e-42bd-9fee-449196e39e70 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:37.462600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc02a4e4-f25e-42bd-9fee-449196e39e70 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:37.463337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc02a4e4-f25e-42bd-9fee-449196e39e70 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:37.463796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc02a4e4-f25e-42bd-9fee-449196e39e70 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:37.464222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc02a4e4-f25e-42bd-9fee-449196e39e70 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:37.636378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fc02a4e4-f25e-42bd-9fee-449196e39e70 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:37.644617 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fc02a4e4-f25e-42bd-9fee-449196e39e70 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09" status: 200 len: 1317 microversion: 2.1 time: 0.199623 Oct 29 01:05:37.648804 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 258/489] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:37 2022] GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:37.654190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-32817018-c843-40c8-87e4-aff8dffb57e7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:37.654928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-32817018-c843-40c8-87e4-aff8dffb57e7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] [instance: d821e4c3-4aa0-45aa-acb9-24f55080a6ff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:37.662915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32817018-c843-40c8-87e4-aff8dffb57e7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:37.663412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32817018-c843-40c8-87e4-aff8dffb57e7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:37.663881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32817018-c843-40c8-87e4-aff8dffb57e7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:37.664591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32817018-c843-40c8-87e4-aff8dffb57e7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:37.665075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32817018-c843-40c8-87e4-aff8dffb57e7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:37.665528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32817018-c843-40c8-87e4-aff8dffb57e7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:37.680262 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-32817018-c843-40c8-87e4-aff8dffb57e7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] HTTP exception thrown: Instance d821e4c3-4aa0-45aa-acb9-24f55080a6ff could not be found. Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-32817018-c843-40c8-87e4-aff8dffb57e7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Request method failure captured: Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff HTTP/1.1 Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHw7lH_p0NbUFL8M7JjUaL8ieBrjCCvizxN7niktjErchjgbwOokzgq9qZefofdygCGKeVJomxlrO8REc0dLKPRqluuJaJTdPBOtQOHd8YXxhCrn-SyjhSaPdBI5JGerQzdAo6I-Asrqt9clZyEWinjl3nji_MdgFSsCAe8_441wKsQ Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 61912f5be1a14ceaadbf630612a0ac6d Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TenantUsagesTestJSON-937627260 Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:05:37.682325 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:05:37.683924 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61912f5be1a14ceaadbf630612a0ac6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/61912f5be1a14ceaadbf630612a0ac6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61912f5be1a14ceaadbf630612a0ac6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_61912f5be1a14ceaadbf630612a0ac6d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:05:37.683924 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TenantUsagesTestJSON-937627260 Oct 29 01:05:37.683924 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 61912f5be1a14ceaadbf630612a0ac6d Oct 29 01:05:37.683924 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TenantUsagesTestJSON-937627260 Oct 29 01:05:37.683924 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TenantUsagesTestJSON-937627260-project Oct 29 01:05:37.683924 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:05:37.683924 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:05:37.683924 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 09a2047f41174f5fbf1fc11d515c90c6 Oct 29 01:05:37.683924 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TenantUsagesTestJSON-937627260-project Oct 29 01:05:37.683924 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:05:37.683924 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance d821e4c3-4aa0-45aa-acb9-24f55080a6ff could not be found. Oct 29 01:05:37.683924 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'd821e4c3-4aa0-45aa-acb9-24f55080a6ff'} Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d821e4c3-4aa0-45aa-acb9-24f55080a6ff could not be found. Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:05:37.688048 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:05:37.689529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:05:37.689529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:05:37.689529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:05:37.689529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:05:37.689529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:05:37.689529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:05:37.689529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:05:37.689529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d821e4c3-4aa0-45aa-acb9-24f55080a6ff could not be found. Oct 29 01:05:37.689529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:37.689529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:37.689529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:37.689529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:37.689529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:37.689529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:37.689529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:05:37.689529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:05:37.689529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d821e4c3-4aa0-45aa-acb9-24f55080a6ff could not be found. Oct 29 01:05:37.689529 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:37.692023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-32817018-c843-40c8-87e4-aff8dffb57e7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] Returning 404 to user: Instance d821e4c3-4aa0-45aa-acb9-24f55080a6ff could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:05:37.692023 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-32817018-c843-40c8-87e4-aff8dffb57e7 tempest-TenantUsagesTestJSON-937627260 tempest-TenantUsagesTestJSON-937627260-project] 10.222.0.26 "GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff" status: 404 len: 111 microversion: 2.1 time: 0.033603 Oct 29 01:05:37.692023 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 259/490] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:37 2022] GET /compute/v2.1/servers/d821e4c3-4aa0-45aa-acb9-24f55080a6ff => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:05:37.725614 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b8d4df4d-f5e4-4926-b5ca-45e3dcbc4ec5 tempest-QuotaClassesAdminTestJSON-2037322267 tempest-QuotaClassesAdminTestJSON-2037322267-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.287799 Oct 29 01:05:37.726816 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 232/491] 10.222.0.26 () {60 vars in 1206 bytes} [Sat Oct 29 01:05:36 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:05:37.895783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b4949c6d-262a-41ba-9606-27246a87680b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:37.896376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b4949c6d-262a-41ba-9606-27246a87680b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:37.902350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4949c6d-262a-41ba-9606-27246a87680b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:37.902833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4949c6d-262a-41ba-9606-27246a87680b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:37.903269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4949c6d-262a-41ba-9606-27246a87680b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:37.903960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4949c6d-262a-41ba-9606-27246a87680b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:37.904415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4949c6d-262a-41ba-9606-27246a87680b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:37.904838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4949c6d-262a-41ba-9606-27246a87680b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:38.044917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b4949c6d-262a-41ba-9606-27246a87680b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:38.053902 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b4949c6d-262a-41ba-9606-27246a87680b tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1467 microversion: 2.1 time: 0.161932 Oct 29 01:05:38.054695 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 260/492] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:37 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1467 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:38.078958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-040920be-2e6d-4301-b3d2-680036436b8d tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:38.079527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-040920be-2e6d-4301-b3d2-680036436b8d tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:38.082659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=24,nova_api:INSERT=12 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:38.086133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-040920be-2e6d-4301-b3d2-680036436b8d tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:38.086617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-040920be-2e6d-4301-b3d2-680036436b8d tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:38.087055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-040920be-2e6d-4301-b3d2-680036436b8d tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:38.087956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-040920be-2e6d-4301-b3d2-680036436b8d tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:38.088421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-040920be-2e6d-4301-b3d2-680036436b8d tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:38.088842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-040920be-2e6d-4301-b3d2-680036436b8d tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:38.104418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8aa9668f-5dcc-47c2-bafb-e91d55e7c1b1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:38.105044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8aa9668f-5dcc-47c2-bafb-e91d55e7c1b1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:38.116123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-040920be-2e6d-4301-b3d2-680036436b8d tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lazy-loading 'flavor' on Instance uuid 60c3640f-299c-4975-be9b-612e064d3399 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:05:38.116319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8aa9668f-5dcc-47c2-bafb-e91d55e7c1b1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:38.116763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8aa9668f-5dcc-47c2-bafb-e91d55e7c1b1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:38.117221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8aa9668f-5dcc-47c2-bafb-e91d55e7c1b1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:38.120251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8aa9668f-5dcc-47c2-bafb-e91d55e7c1b1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:38.120880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8aa9668f-5dcc-47c2-bafb-e91d55e7c1b1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:38.128203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8aa9668f-5dcc-47c2-bafb-e91d55e7c1b1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:38.288288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8aa9668f-5dcc-47c2-bafb-e91d55e7c1b1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:38.297465 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8aa9668f-5dcc-47c2-bafb-e91d55e7c1b1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1319 microversion: 2.1 time: 0.205677 Oct 29 01:05:38.298047 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 261/493] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:38 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:38.470288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4bb8501e-1c5c-4a34-bfb0-3d0310f41b7f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:38.470433 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-040920be-2e6d-4301-b3d2-680036436b8d tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399/action" status: 202 len: 0 microversion: 2.1 time: 0.395280 Oct 29 01:05:38.470914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4bb8501e-1c5c-4a34-bfb0-3d0310f41b7f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:38.475133 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 233/494] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:05:38 2022] POST /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:05:38.479858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4bb8501e-1c5c-4a34-bfb0-3d0310f41b7f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:38.480684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4bb8501e-1c5c-4a34-bfb0-3d0310f41b7f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:38.481388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4bb8501e-1c5c-4a34-bfb0-3d0310f41b7f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:38.482329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4bb8501e-1c5c-4a34-bfb0-3d0310f41b7f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:38.483036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4bb8501e-1c5c-4a34-bfb0-3d0310f41b7f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:38.484072 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4bb8501e-1c5c-4a34-bfb0-3d0310f41b7f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:38.502405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-85913e31-63df-4d29-9bb3-24dbe7dfb6d0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:38.502405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-85913e31-63df-4d29-9bb3-24dbe7dfb6d0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:38.505727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85913e31-63df-4d29-9bb3-24dbe7dfb6d0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:38.506225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85913e31-63df-4d29-9bb3-24dbe7dfb6d0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:38.506697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85913e31-63df-4d29-9bb3-24dbe7dfb6d0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:38.508003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85913e31-63df-4d29-9bb3-24dbe7dfb6d0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:38.508910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85913e31-63df-4d29-9bb3-24dbe7dfb6d0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:38.509528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85913e31-63df-4d29-9bb3-24dbe7dfb6d0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:38.768833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4bb8501e-1c5c-4a34-bfb0-3d0310f41b7f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:38.782220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-85913e31-63df-4d29-9bb3-24dbe7dfb6d0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:38.791969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4bb8501e-1c5c-4a34-bfb0-3d0310f41b7f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:38.792126 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-85913e31-63df-4d29-9bb3-24dbe7dfb6d0 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1475 microversion: 2.1 time: 0.315026 Oct 29 01:05:38.794522 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 234/495] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:38 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1475 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:38.805555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4bb8501e-1c5c-4a34-bfb0-3d0310f41b7f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:38.813141 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4bb8501e-1c5c-4a34-bfb0-3d0310f41b7f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1567 microversion: 2.25 time: 0.346831 Oct 29 01:05:38.825362 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 262/496] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:38 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1567 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:38.825602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-ca05b6f3-889f-459b-88a2-70ab5ad4fb25 req-80a9b0e0-c4ef-4c9e-876e-bd955182069f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba8acd1-344c-42b0-be43-a35cc5ff6f8e", "tag": "cd682e5a-2996-4509-aa56-a7726f2d94bc"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:38.831991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ca05b6f3-889f-459b-88a2-70ab5ad4fb25 req-80a9b0e0-c4ef-4c9e-876e-bd955182069f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:38.832716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ca05b6f3-889f-459b-88a2-70ab5ad4fb25 req-80a9b0e0-c4ef-4c9e-876e-bd955182069f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:38.833343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ca05b6f3-889f-459b-88a2-70ab5ad4fb25 req-80a9b0e0-c4ef-4c9e-876e-bd955182069f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:38.845676 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b51fbce1-b073-4fd3-9aab-555b4afcb5d7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:38.849418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b51fbce1-b073-4fd3-9aab-555b4afcb5d7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e328b4b4-473e-44af-9260-e3e1df072c09] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:38.852451 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-ca05b6f3-889f-459b-88a2-70ab5ad4fb25 req-80a9b0e0-c4ef-4c9e-876e-bd955182069f service nova] Creating event network-changed:cd682e5a-2996-4509-aa56-a7726f2d94bc for instance 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e on n-h1-862964-3 Oct 29 01:05:38.861372 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-ca05b6f3-889f-459b-88a2-70ab5ad4fb25 req-80a9b0e0-c4ef-4c9e-876e-bd955182069f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042859 Oct 29 01:05:38.864453 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 235/497] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:38.867128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b51fbce1-b073-4fd3-9aab-555b4afcb5d7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:38.867936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b51fbce1-b073-4fd3-9aab-555b4afcb5d7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:38.870426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b51fbce1-b073-4fd3-9aab-555b4afcb5d7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:38.872445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b51fbce1-b073-4fd3-9aab-555b4afcb5d7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:38.873397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b51fbce1-b073-4fd3-9aab-555b4afcb5d7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:38.874093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b51fbce1-b073-4fd3-9aab-555b4afcb5d7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:39.084159 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b51fbce1-b073-4fd3-9aab-555b4afcb5d7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:39.095703 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b51fbce1-b073-4fd3-9aab-555b4afcb5d7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09" status: 200 len: 1317 microversion: 2.1 time: 0.273188 Oct 29 01:05:39.096390 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 263/498] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:38 2022] GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:39.322482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4cb4f00e-7196-45f9-a869-95ad61ba4411 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:39.323439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4cb4f00e-7196-45f9-a869-95ad61ba4411 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:39.331314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4cb4f00e-7196-45f9-a869-95ad61ba4411 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:39.331314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4cb4f00e-7196-45f9-a869-95ad61ba4411 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:39.331314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4cb4f00e-7196-45f9-a869-95ad61ba4411 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:39.331314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4cb4f00e-7196-45f9-a869-95ad61ba4411 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:39.332165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4cb4f00e-7196-45f9-a869-95ad61ba4411 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:39.332601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4cb4f00e-7196-45f9-a869-95ad61ba4411 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:39.539512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4cb4f00e-7196-45f9-a869-95ad61ba4411 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:39.575804 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4cb4f00e-7196-45f9-a869-95ad61ba4411 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1319 microversion: 2.1 time: 0.257865 Oct 29 01:05:39.576970 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 236/499] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:39 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:39.823978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c4e016da-054a-4eb0-bf9e-6085e802928a tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:39.825259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c4e016da-054a-4eb0-bf9e-6085e802928a tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:39.831923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4e016da-054a-4eb0-bf9e-6085e802928a tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:39.833021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4e016da-054a-4eb0-bf9e-6085e802928a tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:39.833534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4e016da-054a-4eb0-bf9e-6085e802928a tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:39.834241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4e016da-054a-4eb0-bf9e-6085e802928a tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:39.834833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4e016da-054a-4eb0-bf9e-6085e802928a tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:39.835143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4e016da-054a-4eb0-bf9e-6085e802928a tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:39.844063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eea4c6c9-3cbc-4d00-b2f3-817e724f9a1c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:39.844774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eea4c6c9-3cbc-4d00-b2f3-817e724f9a1c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:39.851447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eea4c6c9-3cbc-4d00-b2f3-817e724f9a1c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:39.852172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eea4c6c9-3cbc-4d00-b2f3-817e724f9a1c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:39.852607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eea4c6c9-3cbc-4d00-b2f3-817e724f9a1c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:39.853339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eea4c6c9-3cbc-4d00-b2f3-817e724f9a1c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:39.853973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eea4c6c9-3cbc-4d00-b2f3-817e724f9a1c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:39.854550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eea4c6c9-3cbc-4d00-b2f3-817e724f9a1c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:40.046250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c4e016da-054a-4eb0-bf9e-6085e802928a tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:40.055798 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c4e016da-054a-4eb0-bf9e-6085e802928a tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1458 microversion: 2.1 time: 0.235675 Oct 29 01:05:40.068883 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 264/500] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:39 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1458 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:40.088680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f454c976-7441-429c-82bf-c636410ac7a0 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:40.088680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f454c976-7441-429c-82bf-c636410ac7a0 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:40.110111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f454c976-7441-429c-82bf-c636410ac7a0 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:40.110858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f454c976-7441-429c-82bf-c636410ac7a0 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:40.111463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f454c976-7441-429c-82bf-c636410ac7a0 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:40.112716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f454c976-7441-429c-82bf-c636410ac7a0 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:40.117770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eea4c6c9-3cbc-4d00-b2f3-817e724f9a1c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:40.127764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f454c976-7441-429c-82bf-c636410ac7a0 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:40.128388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f454c976-7441-429c-82bf-c636410ac7a0 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:40.134274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eea4c6c9-3cbc-4d00-b2f3-817e724f9a1c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:40.135783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eea4c6c9-3cbc-4d00-b2f3-817e724f9a1c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:40.136985 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eea4c6c9-3cbc-4d00-b2f3-817e724f9a1c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1567 microversion: 2.25 time: 0.297237 Oct 29 01:05:40.137580 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 237/501] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:39 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1567 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:40.151283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-24704054-f547-4e88-aff8-45d6d4749a9d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:40.151917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-24704054-f547-4e88-aff8-45d6d4749a9d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e328b4b4-473e-44af-9260-e3e1df072c09] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:40.164561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24704054-f547-4e88-aff8-45d6d4749a9d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:40.165054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24704054-f547-4e88-aff8-45d6d4749a9d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:40.165521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24704054-f547-4e88-aff8-45d6d4749a9d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:40.166233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24704054-f547-4e88-aff8-45d6d4749a9d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:40.166690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24704054-f547-4e88-aff8-45d6d4749a9d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:40.172022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24704054-f547-4e88-aff8-45d6d4749a9d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:40.396958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-24704054-f547-4e88-aff8-45d6d4749a9d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:40.406030 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-24704054-f547-4e88-aff8-45d6d4749a9d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09" status: 200 len: 1466 microversion: 2.1 time: 0.267129 Oct 29 01:05:40.406614 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 238/502] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:40 2022] GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09 => generated 1466 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:40.455681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8683b44c-a2be-4dd7-9f6c-37582efed073 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:40.468419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8683b44c-a2be-4dd7-9f6c-37582efed073 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:40.469372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8683b44c-a2be-4dd7-9f6c-37582efed073 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Searching by: {'reservation_id': 'r-hfhubrhv', 'deleted': False, 'project_id': 'fba91819dd56439daea17217c5d7b9b7'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:05:40.476538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8683b44c-a2be-4dd7-9f6c-37582efed073 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:40.477288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8683b44c-a2be-4dd7-9f6c-37582efed073 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:40.482551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8683b44c-a2be-4dd7-9f6c-37582efed073 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:40.482551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8683b44c-a2be-4dd7-9f6c-37582efed073 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:40.482551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8683b44c-a2be-4dd7-9f6c-37582efed073 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:40.482551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8683b44c-a2be-4dd7-9f6c-37582efed073 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:40.602823 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f454c976-7441-429c-82bf-c636410ac7a0 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1609 microversion: 2.1 time: 0.526446 Oct 29 01:05:40.606155 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 265/503] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:40 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1609 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:40.612506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a8cedc8e-9360-4248-9fa2-2981c7e9b4a3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:40.613696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a8cedc8e-9360-4248-9fa2-2981c7e9b4a3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:40.621081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a8cedc8e-9360-4248-9fa2-2981c7e9b4a3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:40.621836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a8cedc8e-9360-4248-9fa2-2981c7e9b4a3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:40.624697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a8cedc8e-9360-4248-9fa2-2981c7e9b4a3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:40.625690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a8cedc8e-9360-4248-9fa2-2981c7e9b4a3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:40.626137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a8cedc8e-9360-4248-9fa2-2981c7e9b4a3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:40.626738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a8cedc8e-9360-4248-9fa2-2981c7e9b4a3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:40.686846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-8683b44c-a2be-4dd7-9f6c-37582efed073 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:05:40.805373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a8cedc8e-9360-4248-9fa2-2981c7e9b4a3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:40.813629 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a8cedc8e-9360-4248-9fa2-2981c7e9b4a3 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1319 microversion: 2.1 time: 0.205490 Oct 29 01:05:40.825739 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 266/504] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:40 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:40.834102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d668e936-f7c2-4e7d-8f98-c3f946b34a11 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:40.839595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8683b44c-a2be-4dd7-9f6c-37582efed073 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:40.840301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d668e936-f7c2-4e7d-8f98-c3f946b34a11 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:40.840799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d668e936-f7c2-4e7d-8f98-c3f946b34a11 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:40.841282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d668e936-f7c2-4e7d-8f98-c3f946b34a11 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:40.842209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d668e936-f7c2-4e7d-8f98-c3f946b34a11 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:40.843776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d668e936-f7c2-4e7d-8f98-c3f946b34a11 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:40.844401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d668e936-f7c2-4e7d-8f98-c3f946b34a11 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:40.858924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8683b44c-a2be-4dd7-9f6c-37582efed073 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:40.862819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8683b44c-a2be-4dd7-9f6c-37582efed073 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:40.863910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8683b44c-a2be-4dd7-9f6c-37582efed073 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:40.871921 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d668e936-f7c2-4e7d-8f98-c3f946b34a11 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044556 Oct 29 01:05:40.872792 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 267/505] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Oct 29 01:05:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:40.895924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b4d9fec9-76ea-4ad8-bd95-829a22754198 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862964-3", "block_migration": true, "disk_over_commit": false}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:40.899945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b4d9fec9-76ea-4ad8-bd95-829a22754198 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:40.909218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4d9fec9-76ea-4ad8-bd95-829a22754198 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:40.910258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4d9fec9-76ea-4ad8-bd95-829a22754198 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:40.910831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4d9fec9-76ea-4ad8-bd95-829a22754198 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:40.911724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4d9fec9-76ea-4ad8-bd95-829a22754198 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:40.912387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4d9fec9-76ea-4ad8-bd95-829a22754198 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:40.913411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4d9fec9-76ea-4ad8-bd95-829a22754198 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:41.036444 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8683b44c-a2be-4dd7-9f6c-37582efed073 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?reservation_id=r-hfhubrhv" status: 200 len: 2926 microversion: 2.1 time: 0.602540 Oct 29 01:05:41.037039 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 239/506] 10.222.0.26 () {58 vars in 1197 bytes} [Sat Oct 29 01:05:40 2022] GET /compute/v2.1/servers/detail?reservation_id=r-hfhubrhv => generated 2926 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:41.222522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e945998a-3491-4136-8eb7-450b014f4427 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:41.226206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e945998a-3491-4136-8eb7-450b014f4427 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:41.226692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e945998a-3491-4136-8eb7-450b014f4427 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:41.227128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e945998a-3491-4136-8eb7-450b014f4427 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:41.227860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e945998a-3491-4136-8eb7-450b014f4427 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:41.228312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e945998a-3491-4136-8eb7-450b014f4427 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:41.228734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e945998a-3491-4136-8eb7-450b014f4427 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:41.253424 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e945998a-3491-4136-8eb7-450b014f4427 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.214713 Oct 29 01:05:41.262513 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 240/507] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:05:41 2022] GET /compute/v2.1/os-services => generated 944 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:41.264216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-b4d9fec9-76ea-4ad8-bd95-829a22754198 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Lazy-loading 'flavor' on Instance uuid 60c3640f-299c-4975-be9b-612e064d3399 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:05:41.267554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4db06f4a-7125-4fbc-90d4-dfd364a311f7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:41.283855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.compute.server_groups [None req-4db06f4a-7125-4fbc-90d4-dfd364a311f7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Querying cell 584133c9-70d9-4dbd-88ec-66308eedb7a2(cell1) for 2 instances {{(pid=121099) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 01:05:41.284568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4db06f4a-7125-4fbc-90d4-dfd364a311f7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:41.285429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4db06f4a-7125-4fbc-90d4-dfd364a311f7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:41.285916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4db06f4a-7125-4fbc-90d4-dfd364a311f7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:41.319296 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-b4d9fec9-76ea-4ad8-bd95-829a22754198 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 60c3640f-299c-4975-be9b-612e064d3399 while it is in vm_state suspended Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b4d9fec9-76ea-4ad8-bd95-829a22754198 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Request method failure captured: Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399/action HTTP/1.1 Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 97 Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHwy4Mg8j6bETSIvRy2bm6etUuQmLHfQh0blAMKtuA_D9Fqt-nsQxsqcwLGBrHbC7Pt7cc-giXCb7PxbAHab7lyOa3xu9nQiw2hIuJEOYJ1xn-yVnoPX7mCq7O0KqIz52pOAtNUWJWYXL-ZH5lB4-E4f35e3qgBdZCZAbgZD_V7X49g Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: a0702a0163e74405bb0faea806ff1e2f Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-LiveMigrationNegativeTest-485021780 Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:05:41.321676 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:05:41.323340 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0702a0163e74405bb0faea806ff1e2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a0702a0163e74405bb0faea806ff1e2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0702a0163e74405bb0faea806ff1e2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a0702a0163e74405bb0faea806ff1e2f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:05:41.323340 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-LiveMigrationNegativeTest-485021780 Oct 29 01:05:41.323340 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: a0702a0163e74405bb0faea806ff1e2f Oct 29 01:05:41.323340 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-485021780 Oct 29 01:05:41.323340 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-LiveMigrationNegativeTest-485021780-project-admin Oct 29 01:05:41.323340 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:05:41.323340 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:05:41.323340 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: cf883ea1e04146c4903a9715b25d251b Oct 29 01:05:41.323340 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-LiveMigrationNegativeTest-485021780-project-admin Oct 29 01:05:41.323340 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:05:41.323340 n-d-862964-3 devstack@n-api.service[121100]: {"os-migrateLive": {"host": "n-h2-862964-3", "block_migration": true, "disk_over_commit": false}} Oct 29 01:05:41.323340 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:05:41.324140 n-d-862964-3 devstack@n-api.service[121100]: exception: Cannot 'os-migrateLive' instance 60c3640f-299c-4975-be9b-612e064d3399 while it is in vm_state suspended Oct 29 01:05:41.324140 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '60c3640f-299c-4975-be9b-612e064d3399', 'body': {'os-migrateLive': {'host': 'n-h2-862964-3', 'block_migration': True, 'disk_over_commit': False}}} Oct 29 01:05:41.324140 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:05:41.324140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:41.324140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 29 01:05:41.324140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 29 01:05:41.324140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 01:05:41.324140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:05:41.324140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 01:05:41.324140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 01:05:41.324140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 29 01:05:41.324140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 01:05:41.324140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 01:05:41.324140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 01:05:41.324140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 01:05:41.324140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 01:05:41.324140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 29 01:05:41.324140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 60c3640f-299c-4975-be9b-612e064d3399 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:05:41.325208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:05:41.326778 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:05:41.326778 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 01:05:41.326778 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 29 01:05:41.326778 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 01:05:41.326778 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 01:05:41.326778 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 01:05:41.326778 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 60c3640f-299c-4975-be9b-612e064d3399 while it is in vm_state suspended Oct 29 01:05:41.326778 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:41.326778 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:41.326778 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:41.326778 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:41.326778 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:41.326778 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:41.326778 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:05:41.326778 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:05:41.326778 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 60c3640f-299c-4975-be9b-612e064d3399 while it is in vm_state suspended Oct 29 01:05:41.326778 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:41.328224 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4db06f4a-7125-4fbc-90d4-dfd364a311f7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/19f66753-9f29-4847-90a4-a634f869da7a" status: 200 len: 265 microversion: 2.1 time: 0.059099 Oct 29 01:05:41.329174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b4d9fec9-76ea-4ad8-bd95-829a22754198 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 60c3640f-299c-4975-be9b-612e064d3399 while it is in vm_state suspended {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:05:41.330268 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b4d9fec9-76ea-4ad8-bd95-829a22754198 tempest-LiveMigrationNegativeTest-485021780 tempest-LiveMigrationNegativeTest-485021780-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399/action" status: 409 len: 155 microversion: 2.1 time: 0.441812 Oct 29 01:05:41.330625 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 241/508] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:05:41 2022] GET /compute/v2.1/os-server-groups/19f66753-9f29-4847-90a4-a634f869da7a => generated 265 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:41.331132 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 268/509] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:05:40 2022] POST /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399/action => generated 155 bytes in 443 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:05:41.341203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cca09212-0504-4763-b09d-6989ecf9a4c8 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:41.342396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2f62ccb1-55fa-40ec-a874-76cb7d950928 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:41.343112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2f62ccb1-55fa-40ec-a874-76cb7d950928 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:41.345432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cca09212-0504-4763-b09d-6989ecf9a4c8 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:41.346039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cca09212-0504-4763-b09d-6989ecf9a4c8 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:41.346495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cca09212-0504-4763-b09d-6989ecf9a4c8 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:41.347260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cca09212-0504-4763-b09d-6989ecf9a4c8 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:41.348908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cca09212-0504-4763-b09d-6989ecf9a4c8 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:41.349376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cca09212-0504-4763-b09d-6989ecf9a4c8 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:41.354732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f62ccb1-55fa-40ec-a874-76cb7d950928 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:41.355248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f62ccb1-55fa-40ec-a874-76cb7d950928 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:41.355390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:41.356648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f62ccb1-55fa-40ec-a874-76cb7d950928 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:41.358152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f62ccb1-55fa-40ec-a874-76cb7d950928 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:41.358973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f62ccb1-55fa-40ec-a874-76cb7d950928 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:41.359654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f62ccb1-55fa-40ec-a874-76cb7d950928 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:41.372411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:41.386168 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cca09212-0504-4763-b09d-6989ecf9a4c8 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.052448 Oct 29 01:05:41.387247 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 269/510] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Oct 29 01:05:41 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:41.392294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-94717236-aae9-4f13-b62a-183796f3bd10 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:41.393539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-94717236-aae9-4f13-b62a-183796f3bd10 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:41.406701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94717236-aae9-4f13-b62a-183796f3bd10 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:41.406701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94717236-aae9-4f13-b62a-183796f3bd10 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:41.406701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94717236-aae9-4f13-b62a-183796f3bd10 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:41.406701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94717236-aae9-4f13-b62a-183796f3bd10 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:41.406992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94717236-aae9-4f13-b62a-183796f3bd10 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:41.406992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94717236-aae9-4f13-b62a-183796f3bd10 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:41.564555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f62ccb1-55fa-40ec-a874-76cb7d950928 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:41.574062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f62ccb1-55fa-40ec-a874-76cb7d950928 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:41.575688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f62ccb1-55fa-40ec-a874-76cb7d950928 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:41.580141 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2f62ccb1-55fa-40ec-a874-76cb7d950928 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1567 microversion: 2.25 time: 0.244475 Oct 29 01:05:41.585449 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-94717236-aae9-4f13-b62a-183796f3bd10 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 200 len: 1618 microversion: 2.1 time: 0.196426 Oct 29 01:05:41.587918 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 270/511] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:41 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 1618 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:41.593843 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 242/512] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:41 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:41.602388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d5117389-6d2b-49d1-b560-f710a567da15 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:41.602899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d5117389-6d2b-49d1-b560-f710a567da15 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:41.605889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aaaee028-befc-434b-a085-afcbeddbdcf1 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:41.610061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaaee028-befc-434b-a085-afcbeddbdcf1 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:41.610729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaaee028-befc-434b-a085-afcbeddbdcf1 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:41.611347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaaee028-befc-434b-a085-afcbeddbdcf1 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:41.612318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaaee028-befc-434b-a085-afcbeddbdcf1 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:41.613029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaaee028-befc-434b-a085-afcbeddbdcf1 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:41.614070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaaee028-befc-434b-a085-afcbeddbdcf1 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:41.617267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5117389-6d2b-49d1-b560-f710a567da15 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:41.617972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5117389-6d2b-49d1-b560-f710a567da15 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:41.619008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5117389-6d2b-49d1-b560-f710a567da15 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:41.619872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5117389-6d2b-49d1-b560-f710a567da15 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:41.620481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5117389-6d2b-49d1-b560-f710a567da15 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:41.621059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5117389-6d2b-49d1-b560-f710a567da15 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:41.641035 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aaaee028-befc-434b-a085-afcbeddbdcf1 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.045938 Oct 29 01:05:41.641681 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 243/513] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:05:41 2022] GET /compute/v2.1/os-services => generated 944 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:41.646535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b27bcd08-e805-4209-ac34-57d04baeebdb tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:41.647437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b27bcd08-e805-4209-ac34-57d04baeebdb tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] [instance: e328b4b4-473e-44af-9260-e3e1df072c09] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:41.653501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d5117389-6d2b-49d1-b560-f710a567da15 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:05:41.654409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b27bcd08-e805-4209-ac34-57d04baeebdb tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:41.655776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b27bcd08-e805-4209-ac34-57d04baeebdb tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:41.656508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b27bcd08-e805-4209-ac34-57d04baeebdb tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:41.657533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b27bcd08-e805-4209-ac34-57d04baeebdb tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:41.657997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b27bcd08-e805-4209-ac34-57d04baeebdb tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:41.658426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b27bcd08-e805-4209-ac34-57d04baeebdb tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:42.007341 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b27bcd08-e805-4209-ac34-57d04baeebdb tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09" status: 200 len: 1617 microversion: 2.1 time: 0.364447 Oct 29 01:05:42.008195 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 244/514] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:41 2022] GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09 => generated 1617 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:42.014662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3d15b751-72fd-45ea-99f6-bfb5bcdaa98e tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:42.021481 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d5117389-6d2b-49d1-b560-f710a567da15 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "DELETE /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 204 len: 0 microversion: 2.1 time: 0.431383 Oct 29 01:05:42.025693 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 271/515] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:05:41 2022] DELETE /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:05:42.033719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-12244ddc-67f2-4882-93a0-98208794d784 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:42.034442 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-12244ddc-67f2-4882-93a0-98208794d784 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:42.038898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d15b751-72fd-45ea-99f6-bfb5bcdaa98e tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:42.039400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d15b751-72fd-45ea-99f6-bfb5bcdaa98e tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:42.039843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d15b751-72fd-45ea-99f6-bfb5bcdaa98e tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:42.040592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d15b751-72fd-45ea-99f6-bfb5bcdaa98e tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:42.041055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d15b751-72fd-45ea-99f6-bfb5bcdaa98e tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:42.041540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d15b751-72fd-45ea-99f6-bfb5bcdaa98e tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:42.047353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12244ddc-67f2-4882-93a0-98208794d784 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:42.047847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12244ddc-67f2-4882-93a0-98208794d784 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:42.048505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12244ddc-67f2-4882-93a0-98208794d784 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:42.049604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12244ddc-67f2-4882-93a0-98208794d784 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:42.050214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12244ddc-67f2-4882-93a0-98208794d784 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:42.053913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12244ddc-67f2-4882-93a0-98208794d784 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:42.067208 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3d15b751-72fd-45ea-99f6-bfb5bcdaa98e tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=n-d-862964-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.057775 Oct 29 01:05:42.067855 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 245/516] 10.222.0.26 () {58 vars in 1194 bytes} [Sat Oct 29 01:05:42 2022] GET /compute/v2.1/os-services?host=n-d-862964-3&binary=xxx => generated 16 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:05:42.072360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e12a51bf-081a-461e-b0c4-348e5a1f5b02 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:42.072897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e12a51bf-081a-461e-b0c4-348e5a1f5b02 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:42.081067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e12a51bf-081a-461e-b0c4-348e5a1f5b02 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:42.082599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e12a51bf-081a-461e-b0c4-348e5a1f5b02 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:42.082599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e12a51bf-081a-461e-b0c4-348e5a1f5b02 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:42.083311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e12a51bf-081a-461e-b0c4-348e5a1f5b02 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:42.083768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e12a51bf-081a-461e-b0c4-348e5a1f5b02 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:42.084242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e12a51bf-081a-461e-b0c4-348e5a1f5b02 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:42.102624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:42.257725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-12244ddc-67f2-4882-93a0-98208794d784 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:42.267596 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-12244ddc-67f2-4882-93a0-98208794d784 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1469 microversion: 2.1 time: 0.244024 Oct 29 01:05:42.268578 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 272/517] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:42 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1469 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:42.275208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e9a94977-b284-4843-a9d7-f226a1b1d1b0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Action: 'create', calling method: .version_select at 0x7f9d9c36f8b0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1343220290", "policies": ["anti-affinity"]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:42.289752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e12a51bf-081a-461e-b0c4-348e5a1f5b02 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:42.298421 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e12a51bf-081a-461e-b0c4-348e5a1f5b02 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1464 microversion: 2.1 time: 0.229574 Oct 29 01:05:42.299221 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 246/518] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:42 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1464 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:42.307031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f7b4eb34-81d7-477c-9e71-2408d45180b1 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:42.310527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7b4eb34-81d7-477c-9e71-2408d45180b1 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:42.311014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7b4eb34-81d7-477c-9e71-2408d45180b1 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:42.311478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7b4eb34-81d7-477c-9e71-2408d45180b1 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:42.317303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-e9a94977-b284-4843-a9d7-f226a1b1d1b0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_groups'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:42.318958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7b4eb34-81d7-477c-9e71-2408d45180b1 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:42.322858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7b4eb34-81d7-477c-9e71-2408d45180b1 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:42.323331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7b4eb34-81d7-477c-9e71-2408d45180b1 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:42.325004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-e9a94977-b284-4843-a9d7-f226a1b1d1b0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for user 175bb8f8b330495394cd401223847733 and project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_groups'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:42.359201 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f7b4eb34-81d7-477c-9e71-2408d45180b1 tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.056797 Oct 29 01:05:42.360088 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 247/519] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:05:42 2022] GET /compute/v2.1/os-services => generated 944 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:42.435812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-e9a94977-b284-4843-a9d7-f226a1b1d1b0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_groups'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:42.442022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-e9a94977-b284-4843-a9d7-f226a1b1d1b0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for user 175bb8f8b330495394cd401223847733 and project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_groups'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:42.454661 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e9a94977-b284-4843-a9d7-f226a1b1d1b0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.184003 Oct 29 01:05:42.455265 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 273/520] 10.222.0.26 () {60 vars in 1174 bytes} [Sat Oct 29 01:05:42 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:42.460019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-10d6287a-fcf0-40fe-98fa-fc12ce53664b tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:42.463793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10d6287a-fcf0-40fe-98fa-fc12ce53664b tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:42.464277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10d6287a-fcf0-40fe-98fa-fc12ce53664b tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:42.464713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10d6287a-fcf0-40fe-98fa-fc12ce53664b tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:42.465481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10d6287a-fcf0-40fe-98fa-fc12ce53664b tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:42.465960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10d6287a-fcf0-40fe-98fa-fc12ce53664b tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:42.466382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10d6287a-fcf0-40fe-98fa-fc12ce53664b tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:42.491682 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-10d6287a-fcf0-40fe-98fa-fc12ce53664b tempest-ServicesAdminNegativeTestJSON-884768184 tempest-ServicesAdminNegativeTestJSON-884768184-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.035059 Oct 29 01:05:42.492633 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 274/521] 10.222.0.26 () {58 vars in 1198 bytes} [Sat Oct 29 01:05:42 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:05:42.573876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7ff03cb0-4233-4e51-aadc-3a10a15a985e tempest-DeleteServersAdminTestJSON-910484707 tempest-DeleteServersAdminTestJSON-910484707-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:42.574613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7ff03cb0-4233-4e51-aadc-3a10a15a985e tempest-DeleteServersAdminTestJSON-910484707 tempest-DeleteServersAdminTestJSON-910484707-project-admin] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:42.582683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ff03cb0-4233-4e51-aadc-3a10a15a985e tempest-DeleteServersAdminTestJSON-910484707 tempest-DeleteServersAdminTestJSON-910484707-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:42.583729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ff03cb0-4233-4e51-aadc-3a10a15a985e tempest-DeleteServersAdminTestJSON-910484707 tempest-DeleteServersAdminTestJSON-910484707-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:42.584261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ff03cb0-4233-4e51-aadc-3a10a15a985e tempest-DeleteServersAdminTestJSON-910484707 tempest-DeleteServersAdminTestJSON-910484707-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:42.585192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ff03cb0-4233-4e51-aadc-3a10a15a985e tempest-DeleteServersAdminTestJSON-910484707 tempest-DeleteServersAdminTestJSON-910484707-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:42.585845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ff03cb0-4233-4e51-aadc-3a10a15a985e tempest-DeleteServersAdminTestJSON-910484707 tempest-DeleteServersAdminTestJSON-910484707-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:42.586466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ff03cb0-4233-4e51-aadc-3a10a15a985e tempest-DeleteServersAdminTestJSON-910484707 tempest-DeleteServersAdminTestJSON-910484707-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:42.617591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7ff03cb0-4233-4e51-aadc-3a10a15a985e tempest-DeleteServersAdminTestJSON-910484707 tempest-DeleteServersAdminTestJSON-910484707-project-admin] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:05:42.748875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e8dbd48-c6a9-43ae-8406-08bd21664cbb tempest-ServicesAdminNegativeTestJSON-2067932608 tempest-ServicesAdminNegativeTestJSON-2067932608-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:42.752370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7e8dbd48-c6a9-43ae-8406-08bd21664cbb tempest-ServicesAdminNegativeTestJSON-2067932608 tempest-ServicesAdminNegativeTestJSON-2067932608-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '86e593c0bcdc4578a39607253c29aa6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f28fd1704ac48519ba77b5e0f7fd5cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e8dbd48-c6a9-43ae-8406-08bd21664cbb tempest-ServicesAdminNegativeTestJSON-2067932608 tempest-ServicesAdminNegativeTestJSON-2067932608-project] Request method failure captured: Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHxjOcccFrOUgK-qgSGJXJqAAxefllAAcVS-lr4-kwPOdrEES4YI-KAeukCrsz278aW12eCkFYhXVvmqNpl0Jk05ExGobqLhkSMeKNGv8a9MxWIZqgLPgEqlwyBwdX2EZUUKum490rCkOTuq91EsThrNfyBgm68gv5MojqCqe83hpfU Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 6f28fd1704ac48519ba77b5e0f7fd5cd Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-2067932608 Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:05:42.754631 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:05:42.756215 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6f28fd1704ac48519ba77b5e0f7fd5cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6f28fd1704ac48519ba77b5e0f7fd5cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6f28fd1704ac48519ba77b5e0f7fd5cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6f28fd1704ac48519ba77b5e0f7fd5cd", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:05:42.756215 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-2067932608 Oct 29 01:05:42.756215 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 6f28fd1704ac48519ba77b5e0f7fd5cd Oct 29 01:05:42.756215 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-2067932608 Oct 29 01:05:42.756215 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServicesAdminNegativeTestJSON-2067932608-project Oct 29 01:05:42.756215 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:05:42.756215 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:05:42.756215 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 86e593c0bcdc4578a39607253c29aa6a Oct 29 01:05:42.756215 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-2067932608-project Oct 29 01:05:42.756215 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:05:42.756215 n-d-862964-3 devstack@n-api.service[121100]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 01:05:42.756215 n-d-862964-3 devstack@n-api.service[121100]: action_args: {} Oct 29 01:05:42.757080 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:05:42.757080 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:42.757080 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:42.757080 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:42.757080 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:05:42.757080 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:05:42.757080 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:05:42.757080 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:05:42.757080 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:05:42.757080 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:05:42.757080 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:05:42.757080 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:05:42.757080 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 29 01:05:42.757080 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 29 01:05:42.757080 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:05:42.757080 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:05:42.757080 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:05:42.757080 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:05:42.757080 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 01:05:42.758573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:42.760907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e8dbd48-c6a9-43ae-8406-08bd21664cbb tempest-ServicesAdminNegativeTestJSON-2067932608 tempest-ServicesAdminNegativeTestJSON-2067932608-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:05:42.761786 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e8dbd48-c6a9-43ae-8406-08bd21664cbb tempest-ServicesAdminNegativeTestJSON-2067932608 tempest-ServicesAdminNegativeTestJSON-2067932608-project] 10.222.0.26 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.261165 Oct 29 01:05:42.766010 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 275/522] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:05:42 2022] GET /compute/v2.1/os-services => generated 112 bytes in 262 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:05:42.767636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-28649337-c54b-4482-9e0a-c33ae1023a07 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:42.768150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-28649337-c54b-4482-9e0a-c33ae1023a07 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:42.775924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28649337-c54b-4482-9e0a-c33ae1023a07 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:42.776661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28649337-c54b-4482-9e0a-c33ae1023a07 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:42.777381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28649337-c54b-4482-9e0a-c33ae1023a07 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:42.778308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28649337-c54b-4482-9e0a-c33ae1023a07 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:42.779006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28649337-c54b-4482-9e0a-c33ae1023a07 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:42.779649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28649337-c54b-4482-9e0a-c33ae1023a07 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:42.944405 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7ff03cb0-4233-4e51-aadc-3a10a15a985e tempest-DeleteServersAdminTestJSON-910484707 tempest-DeleteServersAdminTestJSON-910484707-project-admin] 10.222.0.26 "DELETE /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 204 len: 0 microversion: 2.1 time: 0.582340 Oct 29 01:05:42.944906 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 248/523] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:05:42 2022] DELETE /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:05:42.950487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1630896349", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c09db39f-3e03-49b9-abf5-1fbf9e347ec6"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:42.998535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-28649337-c54b-4482-9e0a-c33ae1023a07 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:43.014718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-28649337-c54b-4482-9e0a-c33ae1023a07 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:43.016625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-28649337-c54b-4482-9e0a-c33ae1023a07 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:43.018233 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-28649337-c54b-4482-9e0a-c33ae1023a07 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1567 microversion: 2.25 time: 0.254951 Oct 29 01:05:43.033677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] validate_networks() for None {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:05:43.035492 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 276/524] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:42 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1567 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:43.045052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-76d3f0bd-eeac-4b89-bca2-b5a8ada9c083 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:43.047381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-76d3f0bd-eeac-4b89-bca2-b5a8ada9c083 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:43.055632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76d3f0bd-eeac-4b89-bca2-b5a8ada9c083 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:43.056194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76d3f0bd-eeac-4b89-bca2-b5a8ada9c083 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:43.056691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76d3f0bd-eeac-4b89-bca2-b5a8ada9c083 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:43.057653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76d3f0bd-eeac-4b89-bca2-b5a8ada9c083 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:43.058345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76d3f0bd-eeac-4b89-bca2-b5a8ada9c083 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:43.058998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76d3f0bd-eeac-4b89-bca2-b5a8ada9c083 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:43.458446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-76d3f0bd-eeac-4b89-bca2-b5a8ada9c083 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:43.474889 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-76d3f0bd-eeac-4b89-bca2-b5a8ada9c083 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1475 microversion: 2.1 time: 0.437639 Oct 29 01:05:43.475367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:05:43.475791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:05:43.476192 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 277/525] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:43 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1475 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:43.476306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:05:43.476662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:05:43.477074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:05:43.481668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c3d894d1-5834-4bd1-a436-7ee7a1493ad5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:43.482663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c3d894d1-5834-4bd1-a436-7ee7a1493ad5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:43.489070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3d894d1-5834-4bd1-a436-7ee7a1493ad5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:43.489655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3d894d1-5834-4bd1-a436-7ee7a1493ad5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:43.490268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3d894d1-5834-4bd1-a436-7ee7a1493ad5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:43.491261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3d894d1-5834-4bd1-a436-7ee7a1493ad5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:43.491873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3d894d1-5834-4bd1-a436-7ee7a1493ad5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:43.492679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3d894d1-5834-4bd1-a436-7ee7a1493ad5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:43.499585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:43.500399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:43.500844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:43.501643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:43.502264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:43.507362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:43.537853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for project fba91819dd56439daea17217c5d7b9b7. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:43.543354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for user 175bb8f8b330495394cd401223847733 and project fba91819dd56439daea17217c5d7b9b7. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:43.557988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Going to run 2 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:05:43.560483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: cc5d115c-8881-4057-8885-cc8358078ca3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:05:43.709476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c3d894d1-5834-4bd1-a436-7ee7a1493ad5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:43.720366 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c3d894d1-5834-4bd1-a436-7ee7a1493ad5 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1464 microversion: 2.1 time: 0.242678 Oct 29 01:05:43.721181 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 278/526] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:43 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1464 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:43.736196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:43.743790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for user 175bb8f8b330495394cd401223847733 and project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:43.864336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:43.871911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for user 175bb8f8b330495394cd401223847733 and project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:43.873209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-81968301-7355-401d-923b-47ce5242d559 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Calling method '.version_select at 0x7f9d9c2309d0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:43.895533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=cc5d115c-8881-4057-8885-cc8358078ca3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:05:43.956203 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-81968301-7355-401d-923b-47ce5242d559 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/9ac21e1eda7740b680213d81d28a3b6b" status: 200 len: 371 microversion: 2.1 time: 0.233501 Oct 29 01:05:43.957435 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 279/527] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 29 01:05:43 2022] GET /compute/v2.1/os-quota-sets/9ac21e1eda7740b680213d81d28a3b6b => generated 371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:43.970407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1dcc896c-c5b9-45d2-863f-2ed08bdb8582 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Action: 'update', calling method: .version_select at 0x7f9d9c63e940>, body: {"quota_set": {"ram": "5120"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:44.063496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:44.066360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:44.072768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1dcc896c-c5b9-45d2-863f-2ed08bdb8582 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:44.073909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1dcc896c-c5b9-45d2-863f-2ed08bdb8582 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:44.074569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1dcc896c-c5b9-45d2-863f-2ed08bdb8582 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:44.075707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1dcc896c-c5b9-45d2-863f-2ed08bdb8582 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:44.076379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1dcc896c-c5b9-45d2-863f-2ed08bdb8582 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:44.077040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1dcc896c-c5b9-45d2-863f-2ed08bdb8582 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:44.078845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for user 175bb8f8b330495394cd401223847733 and project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:44.195606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:44.203080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for user 175bb8f8b330495394cd401223847733 and project fba91819dd56439daea17217c5d7b9b7. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:44.219269 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1dcc896c-c5b9-45d2-863f-2ed08bdb8582 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/9ac21e1eda7740b680213d81d28a3b6b" status: 200 len: 328 microversion: 2.1 time: 0.252470 Oct 29 01:05:44.223177 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 280/528] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 29 01:05:43 2022] PUT /compute/v2.1/os-quota-sets/9ac21e1eda7740b680213d81d28a3b6b => generated 328 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:44.235627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ad9da15b-7849-46f7-afca-5f57ad6c0283 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:44.236481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ad9da15b-7849-46f7-afca-5f57ad6c0283 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:44.249678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad9da15b-7849-46f7-afca-5f57ad6c0283 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:44.251159 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad9da15b-7849-46f7-afca-5f57ad6c0283 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:44.255526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad9da15b-7849-46f7-afca-5f57ad6c0283 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:44.261708 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad9da15b-7849-46f7-afca-5f57ad6c0283 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:44.262508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad9da15b-7849-46f7-afca-5f57ad6c0283 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:44.263099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad9da15b-7849-46f7-afca-5f57ad6c0283 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:44.281843 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cbdb8d48-26c0-47fb-ba71-98753bdabf4b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.335520 Oct 29 01:05:44.286991 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 249/529] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:05:42 2022] POST /compute/v2.1/servers => generated 32 bytes in 1341 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 29 01:05:44.296488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-17d617a8-3eaa-41fb-915f-10690fae7c10 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:44.387274 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-17d617a8-3eaa-41fb-915f-10690fae7c10 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-quota-sets/9ac21e1eda7740b680213d81d28a3b6b" status: 202 len: 0 microversion: 2.1 time: 0.097358 Oct 29 01:05:44.394585 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 250/530] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:05:44 2022] DELETE /compute/v2.1/os-quota-sets/9ac21e1eda7740b680213d81d28a3b6b => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:05:44.402675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-21bb0a37-e122-4adb-9104-2647d58c7c7a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:44.413707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-21bb0a37-e122-4adb-9104-2647d58c7c7a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:44.414700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-21bb0a37-e122-4adb-9104-2647d58c7c7a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Searching by: {'deleted': False, 'project_id': 'fba91819dd56439daea17217c5d7b9b7'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:05:44.435028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21bb0a37-e122-4adb-9104-2647d58c7c7a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:44.435776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21bb0a37-e122-4adb-9104-2647d58c7c7a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:44.436227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21bb0a37-e122-4adb-9104-2647d58c7c7a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:44.437685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21bb0a37-e122-4adb-9104-2647d58c7c7a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:44.438151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21bb0a37-e122-4adb-9104-2647d58c7c7a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:44.439868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21bb0a37-e122-4adb-9104-2647d58c7c7a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:44.595357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-21bb0a37-e122-4adb-9104-2647d58c7c7a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:05:44.612076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ad9da15b-7849-46f7-afca-5f57ad6c0283 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:44.623057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ad9da15b-7849-46f7-afca-5f57ad6c0283 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:44.624507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ad9da15b-7849-46f7-afca-5f57ad6c0283 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:44.625832 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ad9da15b-7849-46f7-afca-5f57ad6c0283 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1567 microversion: 2.25 time: 0.401316 Oct 29 01:05:44.642918 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 281/531] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:44 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1567 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:44.651427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-265342b5-d954-4e14-99d8-d4ce28efc888 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Calling method '.version_select at 0x7f9d9c230af0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:44.746262 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-21bb0a37-e122-4adb-9104-2647d58c7c7a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.350133 Oct 29 01:05:44.747998 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 251/532] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 29 01:05:44 2022] GET /compute/v2.1/servers => generated 1662 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:44.759067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1634c04c-2d6c-4405-aa8d-16de50e707a0 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:44.760017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1634c04c-2d6c-4405-aa8d-16de50e707a0 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:44.777367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1634c04c-2d6c-4405-aa8d-16de50e707a0 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:44.778841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1634c04c-2d6c-4405-aa8d-16de50e707a0 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:44.779609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1634c04c-2d6c-4405-aa8d-16de50e707a0 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:44.780747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1634c04c-2d6c-4405-aa8d-16de50e707a0 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:44.782307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1634c04c-2d6c-4405-aa8d-16de50e707a0 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:44.784893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1634c04c-2d6c-4405-aa8d-16de50e707a0 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:45.220044 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-265342b5-d954-4e14-99d8-d4ce28efc888 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/9ac21e1eda7740b680213d81d28a3b6b" status: 200 len: 371 microversion: 2.1 time: 0.570649 Oct 29 01:05:45.244132 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 282/533] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 29 01:05:44 2022] GET /compute/v2.1/os-quota-sets/9ac21e1eda7740b680213d81d28a3b6b => generated 371 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:45.262943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1bfbf759-4a05-4711-a02b-b657c044b248 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:45.262943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1bfbf759-4a05-4711-a02b-b657c044b248 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:45.278145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bfbf759-4a05-4711-a02b-b657c044b248 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:45.278644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bfbf759-4a05-4711-a02b-b657c044b248 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:45.282744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bfbf759-4a05-4711-a02b-b657c044b248 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:45.289603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bfbf759-4a05-4711-a02b-b657c044b248 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:45.290172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bfbf759-4a05-4711-a02b-b657c044b248 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:45.290610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bfbf759-4a05-4711-a02b-b657c044b248 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:45.506991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1bfbf759-4a05-4711-a02b-b657c044b248 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:45.522258 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1bfbf759-4a05-4711-a02b-b657c044b248 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 200 len: 1293 microversion: 2.1 time: 0.276933 Oct 29 01:05:45.523079 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 283/534] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:45 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 1293 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:45.536524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a9f6abfe-a7a5-4a12-b652-c498f07125dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:45.537379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a9f6abfe-a7a5-4a12-b652-c498f07125dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:45.609096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1634c04c-2d6c-4405-aa8d-16de50e707a0 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:45.619104 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1634c04c-2d6c-4405-aa8d-16de50e707a0 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1475 microversion: 2.1 time: 0.869816 Oct 29 01:05:45.623786 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 252/535] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:44 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1475 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:45.629679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-505c5fc9-7567-493f-85a1-62df2ccb5376 req-76ef2b4c-b0b5-43e9-9d8c-3bb16a5a3da9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c3640f-299c-4975-be9b-612e064d3399", "name": "network-vif-deleted", "tag": "c0ea08d6-21f2-4a27-992a-09d1ef81df82"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:45.667308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-505c5fc9-7567-493f-85a1-62df2ccb5376 req-76ef2b4c-b0b5-43e9-9d8c-3bb16a5a3da9 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:45.668001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-505c5fc9-7567-493f-85a1-62df2ccb5376 req-76ef2b4c-b0b5-43e9-9d8c-3bb16a5a3da9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:45.668526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-505c5fc9-7567-493f-85a1-62df2ccb5376 req-76ef2b4c-b0b5-43e9-9d8c-3bb16a5a3da9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:45.700438 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-505c5fc9-7567-493f-85a1-62df2ccb5376 req-76ef2b4c-b0b5-43e9-9d8c-3bb16a5a3da9 service nova] Creating event network-vif-deleted:c0ea08d6-21f2-4a27-992a-09d1ef81df82 for instance 60c3640f-299c-4975-be9b-612e064d3399 on n-h1-862964-3 Oct 29 01:05:45.714588 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-505c5fc9-7567-493f-85a1-62df2ccb5376 req-76ef2b4c-b0b5-43e9-9d8c-3bb16a5a3da9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087641 Oct 29 01:05:45.719646 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 253/536] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:45.726974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2013e9be-8aaa-4cbd-95ea-12bf22eafc25 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Calling method '.version_select at 0x7f9d9c12ed30>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:45.766431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a9f6abfe-a7a5-4a12-b652-c498f07125dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:45.780042 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a9f6abfe-a7a5-4a12-b652-c498f07125dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554" status: 200 len: 1219 microversion: 2.1 time: 0.253262 Oct 29 01:05:45.781981 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 284/537] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:45 2022] GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 => generated 1219 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:45.792171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f6d89f73-1b80-4042-841b-0743b7f6ca7c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:45.795875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f6d89f73-1b80-4042-841b-0743b7f6ca7c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:45.808991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d89f73-1b80-4042-841b-0743b7f6ca7c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:45.813855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d89f73-1b80-4042-841b-0743b7f6ca7c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:45.814707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d89f73-1b80-4042-841b-0743b7f6ca7c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:45.815607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d89f73-1b80-4042-841b-0743b7f6ca7c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:45.816780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d89f73-1b80-4042-841b-0743b7f6ca7c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:45.818133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d89f73-1b80-4042-841b-0743b7f6ca7c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:46.005465 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2013e9be-8aaa-4cbd-95ea-12bf22eafc25 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/141f380a2a8a498c896980b49f2e472e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.284312 Oct 29 01:05:46.006063 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 254/538] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 29 01:05:45 2022] GET /compute/v2.1/os-quota-sets/141f380a2a8a498c896980b49f2e472e/defaults => generated 371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:46.453061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dc33847f-6c57-4ded-a054-86558d00454e tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Action: 'update', calling method: .version_select at 0x7f9d9c10cf70>, body: {"quota_set": {"ram": "5120"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:46.557771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f6d89f73-1b80-4042-841b-0743b7f6ca7c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:46.570269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f6d89f73-1b80-4042-841b-0743b7f6ca7c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:46.577191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f6d89f73-1b80-4042-841b-0743b7f6ca7c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:46.578945 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f6d89f73-1b80-4042-841b-0743b7f6ca7c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1567 microversion: 2.25 time: 0.795623 Oct 29 01:05:46.585193 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 285/539] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:45 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1567 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:46.602512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-121310b5-800d-47db-8ee8-3d9ec45b0b5e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:46.603145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-121310b5-800d-47db-8ee8-3d9ec45b0b5e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: 60c3640f-299c-4975-be9b-612e064d3399] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:46.620390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-121310b5-800d-47db-8ee8-3d9ec45b0b5e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:46.620390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-121310b5-800d-47db-8ee8-3d9ec45b0b5e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:46.620390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-121310b5-800d-47db-8ee8-3d9ec45b0b5e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:46.620390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-121310b5-800d-47db-8ee8-3d9ec45b0b5e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:46.620992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-121310b5-800d-47db-8ee8-3d9ec45b0b5e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:46.620992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-121310b5-800d-47db-8ee8-3d9ec45b0b5e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:46.655699 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-121310b5-800d-47db-8ee8-3d9ec45b0b5e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] HTTP exception thrown: Instance 60c3640f-299c-4975-be9b-612e064d3399 could not be found. Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-121310b5-800d-47db-8ee8-3d9ec45b0b5e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Request method failure captured: Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 HTTP/1.1 Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHww4Sy_UPEuMi7yBC2MzMDLcTuVn-hv7zofqLveJePOKKQj-mqb7txopG-4Z9R4CgbRA_zbJdRWdXeKyg-K_BDYiJQQXm5QM9kaBuPqyXMpaT4A4ZeDxKn2-c-M5aKuhesakUywtKP52bH81qosldq9OECe0EYfRl-D76-2oK-DWvE Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: edf4bb92337045bdb017d273b7fc55d4 Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-LiveMigrationNegativeTest-162359861 Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:05:46.657750 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:05:46.659302 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/edf4bb92337045bdb017d273b7fc55d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/edf4bb92337045bdb017d273b7fc55d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/edf4bb92337045bdb017d273b7fc55d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_edf4bb92337045bdb017d273b7fc55d4", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:05:46.659302 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-LiveMigrationNegativeTest-162359861 Oct 29 01:05:46.659302 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: edf4bb92337045bdb017d273b7fc55d4 Oct 29 01:05:46.659302 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-162359861 Oct 29 01:05:46.659302 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-LiveMigrationNegativeTest-162359861-project Oct 29 01:05:46.659302 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:05:46.659302 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:05:46.659302 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 1826e3c223c8493081c90eeb180d9b81 Oct 29 01:05:46.659302 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-LiveMigrationNegativeTest-162359861-project Oct 29 01:05:46.659302 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:05:46.659302 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 60c3640f-299c-4975-be9b-612e064d3399 could not be found. Oct 29 01:05:46.659302 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '60c3640f-299c-4975-be9b-612e064d3399'} Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60c3640f-299c-4975-be9b-612e064d3399 could not be found. Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:05:46.660581 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:05:46.661868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:05:46.661868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:05:46.661868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:05:46.661868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:05:46.661868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:05:46.661868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:05:46.661868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:05:46.661868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60c3640f-299c-4975-be9b-612e064d3399 could not be found. Oct 29 01:05:46.661868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:46.661868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:46.661868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:46.661868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:46.661868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:46.661868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:46.661868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:05:46.661868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:05:46.661868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60c3640f-299c-4975-be9b-612e064d3399 could not be found. Oct 29 01:05:46.661868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:46.663154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-121310b5-800d-47db-8ee8-3d9ec45b0b5e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Returning 404 to user: Instance 60c3640f-299c-4975-be9b-612e064d3399 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:05:46.663154 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-121310b5-800d-47db-8ee8-3d9ec45b0b5e tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399" status: 404 len: 111 microversion: 2.1 time: 0.072418 Oct 29 01:05:46.665401 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 286/540] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:46 2022] GET /compute/v2.1/servers/60c3640f-299c-4975-be9b-612e064d3399 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:05:46.678380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-be6a85cf-6517-4733-8b17-c790719356d1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:46.679630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-be6a85cf-6517-4733-8b17-c790719356d1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:46.694973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be6a85cf-6517-4733-8b17-c790719356d1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:46.694973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be6a85cf-6517-4733-8b17-c790719356d1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:46.694973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be6a85cf-6517-4733-8b17-c790719356d1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:46.694973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be6a85cf-6517-4733-8b17-c790719356d1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:46.695439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be6a85cf-6517-4733-8b17-c790719356d1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:46.695439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be6a85cf-6517-4733-8b17-c790719356d1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:46.698821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc33847f-6c57-4ded-a054-86558d00454e tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:46.699331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc33847f-6c57-4ded-a054-86558d00454e tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:46.699730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc33847f-6c57-4ded-a054-86558d00454e tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:46.700649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc33847f-6c57-4ded-a054-86558d00454e tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:46.701293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc33847f-6c57-4ded-a054-86558d00454e tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:46.701929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc33847f-6c57-4ded-a054-86558d00454e tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:46.929703 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dc33847f-6c57-4ded-a054-86558d00454e tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/bf6ec5573adc4052a4d296f1234b06cb" status: 200 len: 328 microversion: 2.1 time: 0.482140 Oct 29 01:05:46.933218 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 255/541] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 29 01:05:46 2022] PUT /compute/v2.1/os-quota-sets/bf6ec5573adc4052a4d296f1234b06cb => generated 328 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:46.944309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-00a474b1-257c-4be8-a266-b9e1c31e3576 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:46.945320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-00a474b1-257c-4be8-a266-b9e1c31e3576 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:46.959461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00a474b1-257c-4be8-a266-b9e1c31e3576 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:46.960313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00a474b1-257c-4be8-a266-b9e1c31e3576 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:46.960817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00a474b1-257c-4be8-a266-b9e1c31e3576 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:46.961769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00a474b1-257c-4be8-a266-b9e1c31e3576 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:46.963373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00a474b1-257c-4be8-a266-b9e1c31e3576 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:46.963373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00a474b1-257c-4be8-a266-b9e1c31e3576 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:47.005069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-00a474b1-257c-4be8-a266-b9e1c31e3576 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:05:47.291758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-be6a85cf-6517-4733-8b17-c790719356d1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:47.300156 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-be6a85cf-6517-4733-8b17-c790719356d1 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1475 microversion: 2.1 time: 0.633624 Oct 29 01:05:47.301450 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 287/542] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:46 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1475 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:47.323420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0b370f5b-51fd-4bec-abbd-66c9bef69cc3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:47.325239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0b370f5b-51fd-4bec-abbd-66c9bef69cc3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:47.343977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b370f5b-51fd-4bec-abbd-66c9bef69cc3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:47.345362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b370f5b-51fd-4bec-abbd-66c9bef69cc3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:47.346045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b370f5b-51fd-4bec-abbd-66c9bef69cc3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:47.346972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b370f5b-51fd-4bec-abbd-66c9bef69cc3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:47.348182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b370f5b-51fd-4bec-abbd-66c9bef69cc3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:47.349008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b370f5b-51fd-4bec-abbd-66c9bef69cc3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:47.460431 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-00a474b1-257c-4be8-a266-b9e1c31e3576 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127" status: 204 len: 0 microversion: 2.1 time: 0.525951 Oct 29 01:05:47.473816 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 256/543] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:05:46 2022] DELETE /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:05:47.473816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-05fbcd28-ce89-42cc-b029-ea35a68f7b03 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Calling method '.version_select at 0x7f9d9c25f700>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:47.539190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0b370f5b-51fd-4bec-abbd-66c9bef69cc3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:47.553239 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0b370f5b-51fd-4bec-abbd-66c9bef69cc3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554" status: 200 len: 1215 microversion: 2.1 time: 0.237198 Oct 29 01:05:47.561205 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 288/544] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:47 2022] GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 => generated 1215 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:47.572554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-42a62b5a-1ff5-42c9-9662-2b19a4baee6c tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:47.573203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-42a62b5a-1ff5-42c9-9662-2b19a4baee6c tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:47.580685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42a62b5a-1ff5-42c9-9662-2b19a4baee6c tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:47.581196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42a62b5a-1ff5-42c9-9662-2b19a4baee6c tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:47.581702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42a62b5a-1ff5-42c9-9662-2b19a4baee6c tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:47.582466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42a62b5a-1ff5-42c9-9662-2b19a4baee6c tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:47.583037 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42a62b5a-1ff5-42c9-9662-2b19a4baee6c tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:47.583514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42a62b5a-1ff5-42c9-9662-2b19a4baee6c tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:47.759241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05fbcd28-ce89-42cc-b029-ea35a68f7b03 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:47.759769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05fbcd28-ce89-42cc-b029-ea35a68f7b03 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:47.760139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05fbcd28-ce89-42cc-b029-ea35a68f7b03 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:47.761044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05fbcd28-ce89-42cc-b029-ea35a68f7b03 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:47.761769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05fbcd28-ce89-42cc-b029-ea35a68f7b03 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:47.764562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05fbcd28-ce89-42cc-b029-ea35a68f7b03 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:47.793396 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-05fbcd28-ce89-42cc-b029-ea35a68f7b03 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/bf6ec5573adc4052a4d296f1234b06cb/detail" status: 200 len: 916 microversion: 2.1 time: 0.330357 Oct 29 01:05:47.818080 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 257/545] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:05:47 2022] GET /compute/v2.1/os-quota-sets/bf6ec5573adc4052a4d296f1234b06cb/detail => generated 916 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:47.831192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-b1872f5a-5bf1-4fbf-ad7c-37dd61c8bbdf req-c127d725-b92a-46f0-8a05-e801f132f6d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf8015b1-0e50-4db4-9bda-eaad0ad293b3", "name": "network-vif-deleted", "tag": "db0edede-be33-4b87-a766-e1102315288f"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:47.846883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b1872f5a-5bf1-4fbf-ad7c-37dd61c8bbdf req-c127d725-b92a-46f0-8a05-e801f132f6d2 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:47.851309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b1872f5a-5bf1-4fbf-ad7c-37dd61c8bbdf req-c127d725-b92a-46f0-8a05-e801f132f6d2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:47.851309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b1872f5a-5bf1-4fbf-ad7c-37dd61c8bbdf req-c127d725-b92a-46f0-8a05-e801f132f6d2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:47.863855 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-b1872f5a-5bf1-4fbf-ad7c-37dd61c8bbdf req-c127d725-b92a-46f0-8a05-e801f132f6d2 service nova] Creating event network-vif-deleted:db0edede-be33-4b87-a766-e1102315288f for instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 on n-h2-862964-3 Oct 29 01:05:47.881639 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-b1872f5a-5bf1-4fbf-ad7c-37dd61c8bbdf req-c127d725-b92a-46f0-8a05-e801f132f6d2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058996 Oct 29 01:05:47.881639 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 258/546] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:47.885391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-99cd81b5-793d-4e9a-9b07-f62d2878e04d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:47.886098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-99cd81b5-793d-4e9a-9b07-f62d2878e04d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:47.895877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99cd81b5-793d-4e9a-9b07-f62d2878e04d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:47.895877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99cd81b5-793d-4e9a-9b07-f62d2878e04d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:47.896060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99cd81b5-793d-4e9a-9b07-f62d2878e04d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:47.896958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99cd81b5-793d-4e9a-9b07-f62d2878e04d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:47.897508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99cd81b5-793d-4e9a-9b07-f62d2878e04d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:47.897940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99cd81b5-793d-4e9a-9b07-f62d2878e04d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:47.936472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-42a62b5a-1ff5-42c9-9662-2b19a4baee6c tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:47.946678 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-42a62b5a-1ff5-42c9-9662-2b19a4baee6c tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127" status: 200 len: 1474 microversion: 2.1 time: 0.391124 Oct 29 01:05:47.949911 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 289/547] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:47 2022] GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 => generated 1474 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:48.114364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-99cd81b5-793d-4e9a-9b07-f62d2878e04d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:48.124148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-99cd81b5-793d-4e9a-9b07-f62d2878e04d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:48.124950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3c8bb82e-8178-46ea-b26c-8cc0d426fdfb tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Action: 'update', calling method: .version_select at 0x7f9d9c354280>, body: {"quota_set": {"ram": "2048"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:48.125713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-99cd81b5-793d-4e9a-9b07-f62d2878e04d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:48.126977 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-99cd81b5-793d-4e9a-9b07-f62d2878e04d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1567 microversion: 2.25 time: 0.246284 Oct 29 01:05:48.140291 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 259/548] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:47 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:48.266499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c8bb82e-8178-46ea-b26c-8cc0d426fdfb tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:48.266984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c8bb82e-8178-46ea-b26c-8cc0d426fdfb tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:48.267426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c8bb82e-8178-46ea-b26c-8cc0d426fdfb tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:48.270809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c8bb82e-8178-46ea-b26c-8cc0d426fdfb tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:48.272312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c8bb82e-8178-46ea-b26c-8cc0d426fdfb tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:48.279919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c8bb82e-8178-46ea-b26c-8cc0d426fdfb tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:48.280645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=23 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:48.303079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:48.319999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c8bb82e-8178-46ea-b26c-8cc0d426fdfb tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:48.319999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c8bb82e-8178-46ea-b26c-8cc0d426fdfb tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:48.319999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c8bb82e-8178-46ea-b26c-8cc0d426fdfb tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:48.319999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c8bb82e-8178-46ea-b26c-8cc0d426fdfb tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:48.321087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c8bb82e-8178-46ea-b26c-8cc0d426fdfb tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:48.321087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c8bb82e-8178-46ea-b26c-8cc0d426fdfb tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:48.327645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d8f09505-f24f-4830-9659-4cd4cf68f044 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:48.328476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d8f09505-f24f-4830-9659-4cd4cf68f044 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:48.336906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8f09505-f24f-4830-9659-4cd4cf68f044 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:48.337431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8f09505-f24f-4830-9659-4cd4cf68f044 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:48.338112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8f09505-f24f-4830-9659-4cd4cf68f044 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:48.339031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8f09505-f24f-4830-9659-4cd4cf68f044 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:48.339726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8f09505-f24f-4830-9659-4cd4cf68f044 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:48.340389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8f09505-f24f-4830-9659-4cd4cf68f044 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:48.378859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8f09505-f24f-4830-9659-4cd4cf68f044 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:48.379963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8f09505-f24f-4830-9659-4cd4cf68f044 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:48.380469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8f09505-f24f-4830-9659-4cd4cf68f044 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:48.381001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-d8f09505-f24f-4830-9659-4cd4cf68f044 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lazy-loading 'fault' on Instance uuid bf8015b1-0e50-4db4-9bda-eaad0ad293b3 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:05:48.438513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d8f09505-f24f-4830-9659-4cd4cf68f044 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:48.448418 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d8f09505-f24f-4830-9659-4cd4cf68f044 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1309 microversion: 2.1 time: 0.124501 Oct 29 01:05:48.450402 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 260/549] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:48 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1309 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:48.514949 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3c8bb82e-8178-46ea-b26c-8cc0d426fdfb tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/bf6ec5573adc4052a4d296f1234b06cb?user_id=91d8c2cdb6cf4cb7899edfb016c5d0f1" status: 200 len: 328 microversion: 2.1 time: 0.395846 Oct 29 01:05:48.520172 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 290/550] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:05:48 2022] PUT /compute/v2.1/os-quota-sets/bf6ec5573adc4052a4d296f1234b06cb?user_id=91d8c2cdb6cf4cb7899edfb016c5d0f1 => generated 328 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:05:48.531413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-717579b2-8b84-475f-8e16-af44e2b367e1 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Calling method '.version_select at 0x7f9d97ec7040>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:48.580225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-45d6563a-7f9e-4e70-8e6f-95853e36347d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:48.581028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-45d6563a-7f9e-4e70-8e6f-95853e36347d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:48.596833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45d6563a-7f9e-4e70-8e6f-95853e36347d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:48.597956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45d6563a-7f9e-4e70-8e6f-95853e36347d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:48.600865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45d6563a-7f9e-4e70-8e6f-95853e36347d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:48.601738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45d6563a-7f9e-4e70-8e6f-95853e36347d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:48.605211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45d6563a-7f9e-4e70-8e6f-95853e36347d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:48.605807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45d6563a-7f9e-4e70-8e6f-95853e36347d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:48.681439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-45d6563a-7f9e-4e70-8e6f-95853e36347d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:48.690039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:48.693908 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-45d6563a-7f9e-4e70-8e6f-95853e36347d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554" status: 200 len: 1271 microversion: 2.1 time: 0.117882 Oct 29 01:05:48.709770 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 291/551] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:48 2022] GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 => generated 1271 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:48.798355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5358ab5d-24e7-460b-bc6e-4619af90611d tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Action: 'update', calling method: .version_select at 0x7f9d9c5ccee0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:48.805027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5358ab5d-24e7-460b-bc6e-4619af90611d tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:48.807415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5358ab5d-24e7-460b-bc6e-4619af90611d tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:48.808685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5358ab5d-24e7-460b-bc6e-4619af90611d tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:48.827943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5358ab5d-24e7-460b-bc6e-4619af90611d tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:48.830088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5358ab5d-24e7-460b-bc6e-4619af90611d tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:48.830612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5358ab5d-24e7-460b-bc6e-4619af90611d tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:48.852786 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-5358ab5d-24e7-460b-bc6e-4619af90611d tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] HTTP exception thrown: Service c8dcf737-fbeb-4999-9276-10bf52600c27 could not be found. Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5358ab5d-24e7-460b-bc6e-4619af90611d tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Request method failure captured: Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: request: PUT /compute/v2.1/os-services/c8dcf737-fbeb-4999-9276-10bf52600c27 HTTP/1.1 Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 56 Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHxsLoDEYrOcxQ2Cj6o3x9xFR0OB6lhFTMmJ0PwicfwwYQDApJxkRvfgCK-sSN5sQI6v5omog2CZzcGSvuvHjOD0B07ymgu-ZosAM4BIG9ibg433j56TqzBl0yEQ1MWgIGQ2w-OnRHDOT5pXdnyk-huqdTRypBfFXTuCeRDm5rC_Aps Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: X-Openstack-Nova-Api-Version: 2.53 Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: b986b266eb5845fba5cc3b8a37a996dd Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-508716308 Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:05:48.859179 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:05:48.860739 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b986b266eb5845fba5cc3b8a37a996dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b986b266eb5845fba5cc3b8a37a996dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b986b266eb5845fba5cc3b8a37a996dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b986b266eb5845fba5cc3b8a37a996dd", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:05:48.860739 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-508716308 Oct 29 01:05:48.860739 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: b986b266eb5845fba5cc3b8a37a996dd Oct 29 01:05:48.860739 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-508716308 Oct 29 01:05:48.860739 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin Oct 29 01:05:48.860739 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:05:48.860739 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:05:48.860739 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 9eaf17e7eb3c4af18ccacc6349bd647c Oct 29 01:05:48.860739 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin Oct 29 01:05:48.860739 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:05:48.860739 n-d-862964-3 devstack@n-api.service[121100]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 29 01:05:48.860739 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:05:48.860739 n-d-862964-3 devstack@n-api.service[121100]: exception: Service c8dcf737-fbeb-4999-9276-10bf52600c27 could not be found. Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'c8dcf737-fbeb-4999-9276-10bf52600c27', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service c8dcf737-fbeb-4999-9276-10bf52600c27 could not be found. Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:48.861729 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service c8dcf737-fbeb-4999-9276-10bf52600c27 could not be found. Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:48.863627 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:05:48.864791 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:05:48.864791 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service c8dcf737-fbeb-4999-9276-10bf52600c27 could not be found. Oct 29 01:05:48.864791 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:48.864791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5358ab5d-24e7-460b-bc6e-4619af90611d tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Returning 404 to user: Service c8dcf737-fbeb-4999-9276-10bf52600c27 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:05:48.864791 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5358ab5d-24e7-460b-bc6e-4619af90611d tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-services/c8dcf737-fbeb-4999-9276-10bf52600c27" status: 404 len: 110 microversion: 2.53 time: 0.134266 Oct 29 01:05:48.864791 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 292/552] 10.222.0.26 () {62 vars in 1309 bytes} [Sat Oct 29 01:05:48 2022] PUT /compute/v2.1/os-services/c8dcf737-fbeb-4999-9276-10bf52600c27 => generated 110 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:05:48.872917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e1b9b227-3166-455a-8860-4c7fa927f2e5 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Action: 'update', calling method: .version_select at 0x7f9d9c5ccd30>, body: {"status": "disabled"} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:48.883004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1b9b227-3166-455a-8860-4c7fa927f2e5 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:48.889051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1b9b227-3166-455a-8860-4c7fa927f2e5 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:48.889980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1b9b227-3166-455a-8860-4c7fa927f2e5 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:48.902433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1b9b227-3166-455a-8860-4c7fa927f2e5 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:48.907551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1b9b227-3166-455a-8860-4c7fa927f2e5 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:48.908459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1b9b227-3166-455a-8860-4c7fa927f2e5 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:48.921266 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-e1b9b227-3166-455a-8860-4c7fa927f2e5 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] HTTP exception thrown: Service c8dcf737-fbeb-4999-9276-10bf52600c27 could not be found. Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e1b9b227-3166-455a-8860-4c7fa927f2e5 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Request method failure captured: Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: request: PUT /compute/v2.1/os-services/c8dcf737-fbeb-4999-9276-10bf52600c27 HTTP/1.1 Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 22 Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHxsLoDEYrOcxQ2Cj6o3x9xFR0OB6lhFTMmJ0PwicfwwYQDApJxkRvfgCK-sSN5sQI6v5omog2CZzcGSvuvHjOD0B07ymgu-ZosAM4BIG9ibg433j56TqzBl0yEQ1MWgIGQ2w-OnRHDOT5pXdnyk-huqdTRypBfFXTuCeRDm5rC_Aps Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: X-Openstack-Nova-Api-Version: 2.53 Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: b986b266eb5845fba5cc3b8a37a996dd Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-508716308 Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:05:48.925722 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:05:48.927684 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b986b266eb5845fba5cc3b8a37a996dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b986b266eb5845fba5cc3b8a37a996dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b986b266eb5845fba5cc3b8a37a996dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b986b266eb5845fba5cc3b8a37a996dd", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:05:48.927684 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-508716308 Oct 29 01:05:48.927684 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: b986b266eb5845fba5cc3b8a37a996dd Oct 29 01:05:48.927684 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-508716308 Oct 29 01:05:48.927684 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin Oct 29 01:05:48.927684 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:05:48.927684 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:05:48.927684 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 9eaf17e7eb3c4af18ccacc6349bd647c Oct 29 01:05:48.927684 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin Oct 29 01:05:48.927684 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:05:48.927684 n-d-862964-3 devstack@n-api.service[121100]: {"status": "disabled"} Oct 29 01:05:48.927684 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:05:48.927684 n-d-862964-3 devstack@n-api.service[121100]: exception: Service c8dcf737-fbeb-4999-9276-10bf52600c27 could not be found. Oct 29 01:05:48.927684 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'c8dcf737-fbeb-4999-9276-10bf52600c27', 'body': {'status': 'disabled'}} Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service c8dcf737-fbeb-4999-9276-10bf52600c27 could not be found. Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:48.928497 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service c8dcf737-fbeb-4999-9276-10bf52600c27 could not be found. Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:05:48.929703 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:05:48.930935 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service c8dcf737-fbeb-4999-9276-10bf52600c27 could not be found. Oct 29 01:05:48.930935 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:48.935715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e1b9b227-3166-455a-8860-4c7fa927f2e5 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Returning 404 to user: Service c8dcf737-fbeb-4999-9276-10bf52600c27 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:05:48.936834 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e1b9b227-3166-455a-8860-4c7fa927f2e5 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-services/c8dcf737-fbeb-4999-9276-10bf52600c27" status: 404 len: 110 microversion: 2.53 time: 0.069175 Oct 29 01:05:48.939683 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 293/553] 10.222.0.26 () {62 vars in 1309 bytes} [Sat Oct 29 01:05:48 2022] PUT /compute/v2.1/os-services/c8dcf737-fbeb-4999-9276-10bf52600c27 => generated 110 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 29 01:05:48.950312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-943c2fa1-2104-4d96-852a-9175cdf8d8a2 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Action: 'update', calling method: .version_select at 0x7f9d9c336280>, body: {"status": "enabled"} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:48.967506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-943c2fa1-2104-4d96-852a-9175cdf8d8a2 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:48.968385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-943c2fa1-2104-4d96-852a-9175cdf8d8a2 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:48.968978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-943c2fa1-2104-4d96-852a-9175cdf8d8a2 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:48.986431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-943c2fa1-2104-4d96-852a-9175cdf8d8a2 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:48.986916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-943c2fa1-2104-4d96-852a-9175cdf8d8a2 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:48.987491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-943c2fa1-2104-4d96-852a-9175cdf8d8a2 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.015322 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-943c2fa1-2104-4d96-852a-9175cdf8d8a2 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] HTTP exception thrown: Service c8dcf737-fbeb-4999-9276-10bf52600c27 could not be found. Oct 29 01:05:49.026999 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-717579b2-8b84-475f-8e16-af44e2b367e1 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/bf6ec5573adc4052a4d296f1234b06cb?user_id=91d8c2cdb6cf4cb7899edfb016c5d0f1" status: 200 len: 370 microversion: 2.1 time: 0.499754 Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-943c2fa1-2104-4d96-852a-9175cdf8d8a2 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Request method failure captured: Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: request: PUT /compute/v2.1/os-services/c8dcf737-fbeb-4999-9276-10bf52600c27 HTTP/1.1 Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 21 Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHxsLoDEYrOcxQ2Cj6o3x9xFR0OB6lhFTMmJ0PwicfwwYQDApJxkRvfgCK-sSN5sQI6v5omog2CZzcGSvuvHjOD0B07ymgu-ZosAM4BIG9ibg433j56TqzBl0yEQ1MWgIGQ2w-OnRHDOT5pXdnyk-huqdTRypBfFXTuCeRDm5rC_Aps Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: X-Openstack-Nova-Api-Version: 2.53 Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: b986b266eb5845fba5cc3b8a37a996dd Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-508716308 Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:05:49.027485 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:05:49.028814 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b986b266eb5845fba5cc3b8a37a996dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b986b266eb5845fba5cc3b8a37a996dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b986b266eb5845fba5cc3b8a37a996dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b986b266eb5845fba5cc3b8a37a996dd", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:05:49.028814 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-508716308 Oct 29 01:05:49.028814 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: b986b266eb5845fba5cc3b8a37a996dd Oct 29 01:05:49.028814 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-508716308 Oct 29 01:05:49.028814 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin Oct 29 01:05:49.028814 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:05:49.028814 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:05:49.028814 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 9eaf17e7eb3c4af18ccacc6349bd647c Oct 29 01:05:49.028814 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin Oct 29 01:05:49.028814 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:05:49.028814 n-d-862964-3 devstack@n-api.service[121100]: {"status": "enabled"} Oct 29 01:05:49.028814 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:05:49.028814 n-d-862964-3 devstack@n-api.service[121100]: exception: Service c8dcf737-fbeb-4999-9276-10bf52600c27 could not be found. Oct 29 01:05:49.028814 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'c8dcf737-fbeb-4999-9276-10bf52600c27', 'body': {'status': 'enabled'}} Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service c8dcf737-fbeb-4999-9276-10bf52600c27 could not be found. Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:49.029866 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service c8dcf737-fbeb-4999-9276-10bf52600c27 could not be found. Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:05:49.031039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:05:49.040452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service c8dcf737-fbeb-4999-9276-10bf52600c27 could not be found. Oct 29 01:05:49.040452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:05:49.040452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-943c2fa1-2104-4d96-852a-9175cdf8d8a2 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Returning 404 to user: Service c8dcf737-fbeb-4999-9276-10bf52600c27 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:05:49.040452 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-943c2fa1-2104-4d96-852a-9175cdf8d8a2 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-services/c8dcf737-fbeb-4999-9276-10bf52600c27" status: 404 len: 110 microversion: 2.53 time: 0.082729 Oct 29 01:05:49.040452 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 294/554] 10.222.0.26 () {62 vars in 1309 bytes} [Sat Oct 29 01:05:48 2022] PUT /compute/v2.1/os-services/c8dcf737-fbeb-4999-9276-10bf52600c27 => generated 110 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 29 01:05:49.040772 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 261/555] 10.222.0.26 () {58 vars in 1323 bytes} [Sat Oct 29 01:05:48 2022] GET /compute/v2.1/os-quota-sets/bf6ec5573adc4052a4d296f1234b06cb?user_id=91d8c2cdb6cf4cb7899edfb016c5d0f1 => generated 370 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:49.046214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0e8b7f43-dea2-4046-a85c-bb0928996100 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:49.050963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e8b7f43-dea2-4046-a85c-bb0928996100 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.052016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e8b7f43-dea2-4046-a85c-bb0928996100 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.052476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0fc1ac18-6f34-471a-9e97-e496b1324f5f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:49.052900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e8b7f43-dea2-4046-a85c-bb0928996100 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.053097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0fc1ac18-6f34-471a-9e97-e496b1324f5f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:49.054089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e8b7f43-dea2-4046-a85c-bb0928996100 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.054749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e8b7f43-dea2-4046-a85c-bb0928996100 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.055534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e8b7f43-dea2-4046-a85c-bb0928996100 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.079378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fc1ac18-6f34-471a-9e97-e496b1324f5f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.079886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fc1ac18-6f34-471a-9e97-e496b1324f5f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.080322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fc1ac18-6f34-471a-9e97-e496b1324f5f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.087961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fc1ac18-6f34-471a-9e97-e496b1324f5f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.091823 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0e8b7f43-dea2-4046-a85c-bb0928996100 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.046558 Oct 29 01:05:49.092618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fc1ac18-6f34-471a-9e97-e496b1324f5f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.093351 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 262/556] 10.222.0.26 () {60 vars in 1178 bytes} [Sat Oct 29 01:05:49 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:49.093594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fc1ac18-6f34-471a-9e97-e496b1324f5f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.107052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd867b22-268a-4cbb-9156-3b83b1db9ce5 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:49.111110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd867b22-268a-4cbb-9156-3b83b1db9ce5 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.111615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd867b22-268a-4cbb-9156-3b83b1db9ce5 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.112560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd867b22-268a-4cbb-9156-3b83b1db9ce5 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.115214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd867b22-268a-4cbb-9156-3b83b1db9ce5 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.115634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd867b22-268a-4cbb-9156-3b83b1db9ce5 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.116073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd867b22-268a-4cbb-9156-3b83b1db9ce5 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.147699 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bd867b22-268a-4cbb-9156-3b83b1db9ce5 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.044194 Oct 29 01:05:49.148579 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 263/557] 10.222.0.26 () {60 vars in 1211 bytes} [Sat Oct 29 01:05:49 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:49.163940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9fd690c0-68c3-416a-92fd-afac4c6d5ac4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:49.164540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9fd690c0-68c3-416a-92fd-afac4c6d5ac4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:49.172118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd690c0-68c3-416a-92fd-afac4c6d5ac4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.172617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd690c0-68c3-416a-92fd-afac4c6d5ac4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.173117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd690c0-68c3-416a-92fd-afac4c6d5ac4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.174152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd690c0-68c3-416a-92fd-afac4c6d5ac4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.174836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd690c0-68c3-416a-92fd-afac4c6d5ac4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.175363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd690c0-68c3-416a-92fd-afac4c6d5ac4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.447054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9fd690c0-68c3-416a-92fd-afac4c6d5ac4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:49.460153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9fd690c0-68c3-416a-92fd-afac4c6d5ac4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:49.461813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9fd690c0-68c3-416a-92fd-afac4c6d5ac4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:49.462986 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9fd690c0-68c3-416a-92fd-afac4c6d5ac4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1567 microversion: 2.25 time: 0.304295 Oct 29 01:05:49.491233 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 264/558] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:49 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1567 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:49.499357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7fa56416-188f-46e7-ac94-341cefc677f6 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:49.503166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fa56416-188f-46e7-ac94-341cefc677f6 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.504265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fa56416-188f-46e7-ac94-341cefc677f6 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.504707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fa56416-188f-46e7-ac94-341cefc677f6 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.505680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fa56416-188f-46e7-ac94-341cefc677f6 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.506139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fa56416-188f-46e7-ac94-341cefc677f6 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.506768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fa56416-188f-46e7-ac94-341cefc677f6 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.545784 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7fa56416-188f-46e7-ac94-341cefc677f6 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.053054 Oct 29 01:05:49.547718 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 265/559] 10.222.0.26 () {60 vars in 1178 bytes} [Sat Oct 29 01:05:49 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:49.561621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6dff141a-d904-47cf-853a-4abe88b4b8fa tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:49.562236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6dff141a-d904-47cf-853a-4abe88b4b8fa tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:49.574217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dff141a-d904-47cf-853a-4abe88b4b8fa tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.576196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dff141a-d904-47cf-853a-4abe88b4b8fa tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.576901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dff141a-d904-47cf-853a-4abe88b4b8fa tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.577994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dff141a-d904-47cf-853a-4abe88b4b8fa tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.578667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dff141a-d904-47cf-853a-4abe88b4b8fa tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.579333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dff141a-d904-47cf-853a-4abe88b4b8fa tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.608890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0fc1ac18-6f34-471a-9e97-e496b1324f5f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:49.617284 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0fc1ac18-6f34-471a-9e97-e496b1324f5f tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127" status: 200 len: 1474 microversion: 2.1 time: 0.586718 Oct 29 01:05:49.629516 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 295/560] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:49 2022] GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 => generated 1474 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:49.634801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-284438c2-f1b8-436f-81d4-02aabf7c9332 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:49.638809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-284438c2-f1b8-436f-81d4-02aabf7c9332 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.639536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-284438c2-f1b8-436f-81d4-02aabf7c9332 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.644793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-284438c2-f1b8-436f-81d4-02aabf7c9332 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.645880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-284438c2-f1b8-436f-81d4-02aabf7c9332 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.646567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-284438c2-f1b8-436f-81d4-02aabf7c9332 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.647201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-284438c2-f1b8-436f-81d4-02aabf7c9332 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.656221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dff141a-d904-47cf-853a-4abe88b4b8fa tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.657503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dff141a-d904-47cf-853a-4abe88b4b8fa tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.670218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dff141a-d904-47cf-853a-4abe88b4b8fa tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.671043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-6dff141a-d904-47cf-853a-4abe88b4b8fa tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lazy-loading 'fault' on Instance uuid bf8015b1-0e50-4db4-9bda-eaad0ad293b3 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:05:49.701497 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-284438c2-f1b8-436f-81d4-02aabf7c9332 tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=n-d-862964-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.070360 Oct 29 01:05:49.705757 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 296/561] 10.222.0.26 () {60 vars in 1235 bytes} [Sat Oct 29 01:05:49 2022] GET /compute/v2.1/os-services?host=n-d-862964-3&binary=xxx => generated 16 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:49.718547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0eb09df6-4504-4105-a99c-496d83496f0a tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:49.729315 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0eb09df6-4504-4105-a99c-496d83496f0a tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.730343 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0eb09df6-4504-4105-a99c-496d83496f0a tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.731017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0eb09df6-4504-4105-a99c-496d83496f0a tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.732093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0eb09df6-4504-4105-a99c-496d83496f0a tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.732782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0eb09df6-4504-4105-a99c-496d83496f0a tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.733478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0eb09df6-4504-4105-a99c-496d83496f0a tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.783799 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0eb09df6-4504-4105-a99c-496d83496f0a tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.068852 Oct 29 01:05:49.796353 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 297/562] 10.222.0.26 () {60 vars in 1178 bytes} [Sat Oct 29 01:05:49 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:49.806120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5fd999a7-4456-4c06-bb34-ec7480d1b463 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:49.806811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5fd999a7-4456-4c06-bb34-ec7480d1b463 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:49.823624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fd999a7-4456-4c06-bb34-ec7480d1b463 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.824113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fd999a7-4456-4c06-bb34-ec7480d1b463 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.828815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fd999a7-4456-4c06-bb34-ec7480d1b463 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.829951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fd999a7-4456-4c06-bb34-ec7480d1b463 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.833807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fd999a7-4456-4c06-bb34-ec7480d1b463 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.834292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fd999a7-4456-4c06-bb34-ec7480d1b463 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.890675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6dff141a-d904-47cf-853a-4abe88b4b8fa tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:49.899105 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6dff141a-d904-47cf-853a-4abe88b4b8fa tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 200 len: 1309 microversion: 2.1 time: 0.350327 Oct 29 01:05:49.905516 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 266/563] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:49 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 1309 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:49.913568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-09f7967f-ff8f-4c83-8a38-fa0b24cd2f8a tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:49.917385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09f7967f-ff8f-4c83-8a38-fa0b24cd2f8a tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.917906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09f7967f-ff8f-4c83-8a38-fa0b24cd2f8a tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.918349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09f7967f-ff8f-4c83-8a38-fa0b24cd2f8a tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.919091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09f7967f-ff8f-4c83-8a38-fa0b24cd2f8a tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:49.919554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09f7967f-ff8f-4c83-8a38-fa0b24cd2f8a tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:49.919985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09f7967f-ff8f-4c83-8a38-fa0b24cd2f8a tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:49.969684 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-09f7967f-ff8f-4c83-8a38-fa0b24cd2f8a tempest-ServicesAdminNegativeV253TestJSON-508716308 tempest-ServicesAdminNegativeV253TestJSON-508716308-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.062836 Oct 29 01:05:49.977231 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 267/564] 10.222.0.26 () {60 vars in 1239 bytes} [Sat Oct 29 01:05:49 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:50.009797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5fd999a7-4456-4c06-bb34-ec7480d1b463 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:50.017685 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5fd999a7-4456-4c06-bb34-ec7480d1b463 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554" status: 200 len: 1289 microversion: 2.1 time: 0.219745 Oct 29 01:05:50.018266 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 298/565] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:49 2022] GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 => generated 1289 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:50.100598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-89016aef-ed17-45e5-afcd-4d9190d7683b tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Calling method '.version_select at 0x7f9d9c1f00d0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:50.441814 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-89016aef-ed17-45e5-afcd-4d9190d7683b tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/141f380a2a8a498c896980b49f2e472e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.344324 Oct 29 01:05:50.443112 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 299/566] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 29 01:05:50 2022] GET /compute/v2.1/os-quota-sets/141f380a2a8a498c896980b49f2e472e/defaults => generated 371 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:05:50.457662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d366d6c6-ce2b-41cb-9388-782ac7ac3179 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Action: 'update', calling method: .version_select at 0x7f9d9c1f0280>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:50.545848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cb8313cc-8283-48a8-9aaf-82c566987577 tempest-ServicesAdminNegativeV253TestJSON-592934990 tempest-ServicesAdminNegativeV253TestJSON-592934990-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:50.551190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cb8313cc-8283-48a8-9aaf-82c566987577 tempest-ServicesAdminNegativeV253TestJSON-592934990 tempest-ServicesAdminNegativeV253TestJSON-592934990-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'ce131546f7e545d79b5b8a0254b5ee23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d89b4d9d10e4d5eb41c77e5e3b5bbdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cb8313cc-8283-48a8-9aaf-82c566987577 tempest-ServicesAdminNegativeV253TestJSON-592934990 tempest-ServicesAdminNegativeV253TestJSON-592934990-project] Request method failure captured: Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHxrLxNCZMOgPcgTDbnr6lZNGpdCDo5M2rQgM_PWTdVaZnviCCjAfisuh69bMHOlU3uFcE_lbhUaohdRbKcTm2frRcLjOQAOBPbR9y9K9Jytn94o_CaegnEnhP9fnXBp_9LxbhuSsZECLh3mwqIBEEXF10FX-AnBP2D0DuMlyp-zwTk Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.53 Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 7d89b4d9d10e4d5eb41c77e5e3b5bbdd Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-592934990 Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:05:50.568908 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:05:50.574822 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d89b4d9d10e4d5eb41c77e5e3b5bbdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7d89b4d9d10e4d5eb41c77e5e3b5bbdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7d89b4d9d10e4d5eb41c77e5e3b5bbdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7d89b4d9d10e4d5eb41c77e5e3b5bbdd", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:05:50.574822 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-592934990 Oct 29 01:05:50.574822 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 7d89b4d9d10e4d5eb41c77e5e3b5bbdd Oct 29 01:05:50.574822 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-592934990 Oct 29 01:05:50.574822 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServicesAdminNegativeV253TestJSON-592934990-project Oct 29 01:05:50.574822 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:05:50.574822 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:05:50.574822 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: ce131546f7e545d79b5b8a0254b5ee23 Oct 29 01:05:50.574822 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-592934990-project Oct 29 01:05:50.574822 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:05:50.574822 n-d-862964-3 devstack@n-api.service[121099]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 01:05:50.574822 n-d-862964-3 devstack@n-api.service[121099]: action_args: {} Oct 29 01:05:50.575588 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:05:50.575588 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:50.575588 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:50.575588 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:50.575588 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:05:50.575588 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:05:50.575588 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:05:50.575588 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:05:50.575588 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:05:50.575588 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:05:50.575588 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:05:50.575588 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:05:50.575588 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 29 01:05:50.575588 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 29 01:05:50.575588 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:05:50.575588 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:05:50.575588 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:05:50.575588 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:05:50.575588 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 01:05:50.576720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:05:50.578001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cb8313cc-8283-48a8-9aaf-82c566987577 tempest-ServicesAdminNegativeV253TestJSON-592934990 tempest-ServicesAdminNegativeV253TestJSON-592934990-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:05:50.578001 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cb8313cc-8283-48a8-9aaf-82c566987577 tempest-ServicesAdminNegativeV253TestJSON-592934990 tempest-ServicesAdminNegativeV253TestJSON-592934990-project] 10.222.0.26 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.590761 Oct 29 01:05:50.578001 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 268/567] 10.222.0.26 () {60 vars in 1178 bytes} [Sat Oct 29 01:05:49 2022] GET /compute/v2.1/os-services => generated 112 bytes in 592 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Oct 29 01:05:50.578445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d366d6c6-ce2b-41cb-9388-782ac7ac3179 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:50.584309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d366d6c6-ce2b-41cb-9388-782ac7ac3179 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:50.585188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d366d6c6-ce2b-41cb-9388-782ac7ac3179 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:50.585583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-864242c8-3cac-43ee-ad3e-20f865007b0d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:50.586310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-864242c8-3cac-43ee-ad3e-20f865007b0d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:50.586522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d366d6c6-ce2b-41cb-9388-782ac7ac3179 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:50.587156 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d366d6c6-ce2b-41cb-9388-782ac7ac3179 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:50.587917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d366d6c6-ce2b-41cb-9388-782ac7ac3179 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:50.614724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-864242c8-3cac-43ee-ad3e-20f865007b0d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:50.615377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-864242c8-3cac-43ee-ad3e-20f865007b0d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:50.616207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-864242c8-3cac-43ee-ad3e-20f865007b0d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:50.617255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-864242c8-3cac-43ee-ad3e-20f865007b0d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:50.617842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-864242c8-3cac-43ee-ad3e-20f865007b0d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:50.618596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-864242c8-3cac-43ee-ad3e-20f865007b0d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:50.654601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:50.932222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-864242c8-3cac-43ee-ad3e-20f865007b0d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:50.940726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-864242c8-3cac-43ee-ad3e-20f865007b0d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:50.943021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-864242c8-3cac-43ee-ad3e-20f865007b0d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:50.944248 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-864242c8-3cac-43ee-ad3e-20f865007b0d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1567 microversion: 2.25 time: 0.371708 Oct 29 01:05:50.944809 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 269/568] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:50 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1567 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:50.954815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5cd6b017-e468-4bbd-8122-ab31dad43d12 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:50.955412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5cd6b017-e468-4bbd-8122-ab31dad43d12 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:50.964840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cd6b017-e468-4bbd-8122-ab31dad43d12 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:50.965656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cd6b017-e468-4bbd-8122-ab31dad43d12 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:50.966252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cd6b017-e468-4bbd-8122-ab31dad43d12 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:50.967138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cd6b017-e468-4bbd-8122-ab31dad43d12 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:50.967796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cd6b017-e468-4bbd-8122-ab31dad43d12 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:50.968719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cd6b017-e468-4bbd-8122-ab31dad43d12 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:51.366443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5cd6b017-e468-4bbd-8122-ab31dad43d12 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1826e3c223c8493081c90eeb180d9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf4bb92337045bdb017d273b7fc55d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:51.386421 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5cd6b017-e468-4bbd-8122-ab31dad43d12 tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127" status: 200 len: 1474 microversion: 2.1 time: 0.435543 Oct 29 01:05:51.389174 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 270/569] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:50 2022] GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 => generated 1474 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:51.400364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80af6da9-cb54-4696-b52d-62985adbedef tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:51.407798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-80af6da9-cb54-4696-b52d-62985adbedef tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:51.430808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80af6da9-cb54-4696-b52d-62985adbedef tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:51.466998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80af6da9-cb54-4696-b52d-62985adbedef tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:51.469964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80af6da9-cb54-4696-b52d-62985adbedef tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:51.472038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80af6da9-cb54-4696-b52d-62985adbedef tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:51.472561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80af6da9-cb54-4696-b52d-62985adbedef tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:51.473039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80af6da9-cb54-4696-b52d-62985adbedef tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:51.502163 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-80af6da9-cb54-4696-b52d-62985adbedef tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] HTTP exception thrown: Instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 could not be found. Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80af6da9-cb54-4696-b52d-62985adbedef tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Request method failure captured: Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 HTTP/1.1 Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHw-agme2hOY9hJItOb-jRkZqRFjxwSwen5Lgo3CiWDEwaG--xFK5DBOsyUwoQV2_Ld1s7QZq0tzoQqlgI-GjP_Cj4VnBcpkJqIUHnlql8eyf9hi3ylpPALP3BIRUNTLyDnxolPYiDh-bBrbDtq1j8ITVfUqynuQOxlCdCpVYV5o3Tw Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f53e974fb417481e99277df8d9bf81d5 Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2121225012 Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:05:51.504828 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:05:51.506392 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53e974fb417481e99277df8d9bf81d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f53e974fb417481e99277df8d9bf81d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53e974fb417481e99277df8d9bf81d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f53e974fb417481e99277df8d9bf81d5", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:05:51.506392 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersAdminTestJSON-2121225012 Oct 29 01:05:51.506392 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f53e974fb417481e99277df8d9bf81d5 Oct 29 01:05:51.506392 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2121225012 Oct 29 01:05:51.506392 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersAdminTestJSON-2121225012-project Oct 29 01:05:51.506392 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:05:51.506392 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:05:51.506392 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f5c2ae31500e4a59a468e0362a9c75d2 Oct 29 01:05:51.506392 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersAdminTestJSON-2121225012-project Oct 29 01:05:51.506392 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:05:51.506392 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 could not be found. Oct 29 01:05:51.506392 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'bf8015b1-0e50-4db4-9bda-eaad0ad293b3'} Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 could not be found. Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:05:51.507216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:05:51.508510 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:05:51.508510 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:05:51.508510 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:05:51.508510 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:05:51.508510 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:05:51.508510 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:05:51.508510 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:05:51.508510 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 could not be found. Oct 29 01:05:51.508510 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:05:51.508510 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:51.508510 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:05:51.508510 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:51.508510 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:51.508510 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:51.508510 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:05:51.508510 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:05:51.508510 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 could not be found. Oct 29 01:05:51.508510 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:05:51.511059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80af6da9-cb54-4696-b52d-62985adbedef tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Returning 404 to user: Instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:05:51.512089 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-80af6da9-cb54-4696-b52d-62985adbedef tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 404 len: 111 microversion: 2.1 time: 0.119775 Oct 29 01:05:51.512793 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 271/570] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:51 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:05:51.521166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8adafdac-f2ad-4f47-a866-bfeb377823f1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:51.522015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8adafdac-f2ad-4f47-a866-bfeb377823f1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:51.524121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:51.539066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8adafdac-f2ad-4f47-a866-bfeb377823f1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:51.539224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8adafdac-f2ad-4f47-a866-bfeb377823f1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:51.539669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8adafdac-f2ad-4f47-a866-bfeb377823f1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:51.540378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8adafdac-f2ad-4f47-a866-bfeb377823f1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:51.540831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8adafdac-f2ad-4f47-a866-bfeb377823f1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:51.545518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8adafdac-f2ad-4f47-a866-bfeb377823f1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:52.014630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8adafdac-f2ad-4f47-a866-bfeb377823f1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:52.036013 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8adafdac-f2ad-4f47-a866-bfeb377823f1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554" status: 200 len: 1319 microversion: 2.1 time: 0.507724 Oct 29 01:05:52.036013 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 272/571] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:51 2022] GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 => generated 1319 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:52.038342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-5332deb9-4e9e-4602-95b1-528af90e0261 req-00facd72-46aa-42ba-8e2e-8403448efa64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f551ae9b-dc1f-4352-98e5-9fe95c860127", "name": "network-vif-deleted", "tag": "9eceb19a-6248-4650-b85b-c8eadd87a690"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:52.061079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5332deb9-4e9e-4602-95b1-528af90e0261 req-00facd72-46aa-42ba-8e2e-8403448efa64 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:52.061615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5332deb9-4e9e-4602-95b1-528af90e0261 req-00facd72-46aa-42ba-8e2e-8403448efa64 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:52.062050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5332deb9-4e9e-4602-95b1-528af90e0261 req-00facd72-46aa-42ba-8e2e-8403448efa64 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:52.098717 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-5332deb9-4e9e-4602-95b1-528af90e0261 req-00facd72-46aa-42ba-8e2e-8403448efa64 service nova] Creating event network-vif-deleted:9eceb19a-6248-4650-b85b-c8eadd87a690 for instance f551ae9b-dc1f-4352-98e5-9fe95c860127 on n-h1-862964-3 Oct 29 01:05:52.106990 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-5332deb9-4e9e-4602-95b1-528af90e0261 req-00facd72-46aa-42ba-8e2e-8403448efa64 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072932 Oct 29 01:05:52.114671 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 273/572] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:52.132579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-36dafb4d-b175-415d-b1a5-73b0b5edf34f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1804684314", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:52.260575 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-36dafb4d-b175-415d-b1a5-73b0b5edf34f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] validate_networks() for None {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:05:52.297719 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d366d6c6-ce2b-41cb-9388-782ac7ac3179 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/141f380a2a8a498c896980b49f2e472e" status: 200 len: 329 microversion: 2.1 time: 1.845522 Oct 29 01:05:52.298286 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 300/573] 10.222.0.26 () {60 vars in 1263 bytes} [Sat Oct 29 01:05:50 2022] PUT /compute/v2.1/os-quota-sets/141f380a2a8a498c896980b49f2e472e => generated 329 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:05:52.316910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-26a591e3-d7ad-40d0-acf0-135e7b0b9bc4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:52.317718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-26a591e3-d7ad-40d0-acf0-135e7b0b9bc4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:52.334818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26a591e3-d7ad-40d0-acf0-135e7b0b9bc4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:52.335595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26a591e3-d7ad-40d0-acf0-135e7b0b9bc4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:52.337299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26a591e3-d7ad-40d0-acf0-135e7b0b9bc4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:52.339960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26a591e3-d7ad-40d0-acf0-135e7b0b9bc4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:52.340457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26a591e3-d7ad-40d0-acf0-135e7b0b9bc4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:52.340904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26a591e3-d7ad-40d0-acf0-135e7b0b9bc4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:52.879482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-26a591e3-d7ad-40d0-acf0-135e7b0b9bc4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:52.893188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-26a591e3-d7ad-40d0-acf0-135e7b0b9bc4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:52.896647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-26a591e3-d7ad-40d0-acf0-135e7b0b9bc4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:52.899230 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-26a591e3-d7ad-40d0-acf0-135e7b0b9bc4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1557 microversion: 2.25 time: 0.596626 Oct 29 01:05:52.899817 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 301/574] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:52 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1557 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:52.910521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3f8e56f8-d076-4267-8fba-aa9ff5c04df2 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Action: 'update', calling method: .version_select at 0x7f9d9c5ccd30>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:52.917647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-36dafb4d-b175-415d-b1a5-73b0b5edf34f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:05:52.918788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-36dafb4d-b175-415d-b1a5-73b0b5edf34f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:05:52.931189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-36dafb4d-b175-415d-b1a5-73b0b5edf34f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:05:52.931189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-36dafb4d-b175-415d-b1a5-73b0b5edf34f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:05:52.931189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-36dafb4d-b175-415d-b1a5-73b0b5edf34f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:05:52.949060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36dafb4d-b175-415d-b1a5-73b0b5edf34f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:52.949843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36dafb4d-b175-415d-b1a5-73b0b5edf34f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:52.950345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36dafb4d-b175-415d-b1a5-73b0b5edf34f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:52.951205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36dafb4d-b175-415d-b1a5-73b0b5edf34f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:52.959212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36dafb4d-b175-415d-b1a5-73b0b5edf34f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:52.967500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36dafb4d-b175-415d-b1a5-73b0b5edf34f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:53.030866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-36dafb4d-b175-415d-b1a5-73b0b5edf34f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Getting quotas for project f53e974fb417481e99277df8d9bf81d5. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:53.039535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-36dafb4d-b175-415d-b1a5-73b0b5edf34f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Getting quotas for user f5c2ae31500e4a59a468e0362a9c75d2 and project f53e974fb417481e99277df8d9bf81d5. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:53.071474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-36dafb4d-b175-415d-b1a5-73b0b5edf34f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:05:53.074237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-36dafb4d-b175-415d-b1a5-73b0b5edf34f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:05:53.230315 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-36dafb4d-b175-415d-b1a5-73b0b5edf34f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.102477 Oct 29 01:05:53.238638 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 274/575] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:05:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:05:53.255989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4f6220dc-a54e-4f0a-b7fe-9e9432c7d8cf tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:53.259314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4f6220dc-a54e-4f0a-b7fe-9e9432c7d8cf tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] [instance: f551ae9b-dc1f-4352-98e5-9fe95c860127] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:53.281201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f6220dc-a54e-4f0a-b7fe-9e9432c7d8cf tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:53.287949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f6220dc-a54e-4f0a-b7fe-9e9432c7d8cf tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:53.288732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f6220dc-a54e-4f0a-b7fe-9e9432c7d8cf tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:53.289706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f6220dc-a54e-4f0a-b7fe-9e9432c7d8cf tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:53.292024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f6220dc-a54e-4f0a-b7fe-9e9432c7d8cf tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:53.296064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f6220dc-a54e-4f0a-b7fe-9e9432c7d8cf tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:53.341587 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-4f6220dc-a54e-4f0a-b7fe-9e9432c7d8cf tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] HTTP exception thrown: Instance f551ae9b-dc1f-4352-98e5-9fe95c860127 could not be found. Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4f6220dc-a54e-4f0a-b7fe-9e9432c7d8cf tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Request method failure captured: Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 HTTP/1.1 Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHww4Sy_UPEuMi7yBC2MzMDLcTuVn-hv7zofqLveJePOKKQj-mqb7txopG-4Z9R4CgbRA_zbJdRWdXeKyg-K_BDYiJQQXm5QM9kaBuPqyXMpaT4A4ZeDxKn2-c-M5aKuhesakUywtKP52bH81qosldq9OECe0EYfRl-D76-2oK-DWvE Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: edf4bb92337045bdb017d273b7fc55d4 Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-LiveMigrationNegativeTest-162359861 Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:05:53.346718 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:05:53.349631 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/edf4bb92337045bdb017d273b7fc55d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/edf4bb92337045bdb017d273b7fc55d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/edf4bb92337045bdb017d273b7fc55d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_edf4bb92337045bdb017d273b7fc55d4", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:05:53.349631 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-LiveMigrationNegativeTest-162359861 Oct 29 01:05:53.349631 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: edf4bb92337045bdb017d273b7fc55d4 Oct 29 01:05:53.349631 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-162359861 Oct 29 01:05:53.349631 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-LiveMigrationNegativeTest-162359861-project Oct 29 01:05:53.349631 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:05:53.349631 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:05:53.349631 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 1826e3c223c8493081c90eeb180d9b81 Oct 29 01:05:53.349631 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-LiveMigrationNegativeTest-162359861-project Oct 29 01:05:53.349631 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:05:53.349631 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance f551ae9b-dc1f-4352-98e5-9fe95c860127 could not be found. Oct 29 01:05:53.349631 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'f551ae9b-dc1f-4352-98e5-9fe95c860127'} Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f551ae9b-dc1f-4352-98e5-9fe95c860127 could not be found. Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:05:53.350482 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:05:53.351719 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:05:53.351719 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:05:53.351719 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:05:53.351719 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:05:53.351719 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:05:53.351719 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:05:53.351719 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:05:53.351719 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f551ae9b-dc1f-4352-98e5-9fe95c860127 could not be found. Oct 29 01:05:53.351719 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:05:53.351719 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:05:53.351719 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:05:53.351719 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:05:53.351719 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:05:53.351719 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:05:53.351719 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:05:53.351719 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:05:53.351719 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f551ae9b-dc1f-4352-98e5-9fe95c860127 could not be found. Oct 29 01:05:53.351719 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:05:53.355314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4f6220dc-a54e-4f0a-b7fe-9e9432c7d8cf tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] Returning 404 to user: Instance f551ae9b-dc1f-4352-98e5-9fe95c860127 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:05:53.359178 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4f6220dc-a54e-4f0a-b7fe-9e9432c7d8cf tempest-LiveMigrationNegativeTest-162359861 tempest-LiveMigrationNegativeTest-162359861-project] 10.222.0.26 "GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127" status: 404 len: 111 microversion: 2.1 time: 0.116658 Oct 29 01:05:53.360047 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 275/576] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:53 2022] GET /compute/v2.1/servers/f551ae9b-dc1f-4352-98e5-9fe95c860127 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:05:53.371109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c0684d87-c574-458f-843c-d81b67ec7f8b tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '.version_select at 0x7f9d97e1f940>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:53.377520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0684d87-c574-458f-843c-d81b67ec7f8b tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:53.379867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0684d87-c574-458f-843c-d81b67ec7f8b tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:53.381303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0684d87-c574-458f-843c-d81b67ec7f8b tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:53.429038 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c0684d87-c574-458f-843c-d81b67ec7f8b tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.052418 Oct 29 01:05:53.429038 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 276/577] 10.222.0.26 () {60 vars in 1184 bytes} [Sat Oct 29 01:05:53 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:05:53.431244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2df76e97-5bf4-442c-b5e7-79e0dea8dc6b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:53.431874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2df76e97-5bf4-442c-b5e7-79e0dea8dc6b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:53.445518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2df76e97-5bf4-442c-b5e7-79e0dea8dc6b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:53.446318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2df76e97-5bf4-442c-b5e7-79e0dea8dc6b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:53.446919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2df76e97-5bf4-442c-b5e7-79e0dea8dc6b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:53.447935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2df76e97-5bf4-442c-b5e7-79e0dea8dc6b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:53.448565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2df76e97-5bf4-442c-b5e7-79e0dea8dc6b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:53.450342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2df76e97-5bf4-442c-b5e7-79e0dea8dc6b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:53.639706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8e56f8-d076-4267-8fba-aa9ff5c04df2 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:53.643327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8e56f8-d076-4267-8fba-aa9ff5c04df2 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:53.643327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8e56f8-d076-4267-8fba-aa9ff5c04df2 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:53.646149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8e56f8-d076-4267-8fba-aa9ff5c04df2 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:53.648421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8e56f8-d076-4267-8fba-aa9ff5c04df2 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:53.651223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8e56f8-d076-4267-8fba-aa9ff5c04df2 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:53.828263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2df76e97-5bf4-442c-b5e7-79e0dea8dc6b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:53.857887 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2df76e97-5bf4-442c-b5e7-79e0dea8dc6b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554" status: 200 len: 1319 microversion: 2.1 time: 0.421972 Oct 29 01:05:53.877605 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 277/578] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:53 2022] GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:53.900103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3940c8d6-7a67-43a8-8805-cda277443aa8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:53.902865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3940c8d6-7a67-43a8-8805-cda277443aa8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:53.980704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3940c8d6-7a67-43a8-8805-cda277443aa8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:53.989279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=88,nova_cell0:UPDATE=12 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:53.995143 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3940c8d6-7a67-43a8-8805-cda277443aa8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 200 len: 1220 microversion: 2.1 time: 0.112742 Oct 29 01:05:53.996432 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 278/579] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:53 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 1220 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:54.002268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-468ffd5d-ac72-4837-ac7d-7210a21b21c0 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:54.003367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-468ffd5d-ac72-4837-ac7d-7210a21b21c0 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:54.013437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-468ffd5d-ac72-4837-ac7d-7210a21b21c0 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:54.014123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-468ffd5d-ac72-4837-ac7d-7210a21b21c0 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:54.015646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-468ffd5d-ac72-4837-ac7d-7210a21b21c0 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:54.016614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-468ffd5d-ac72-4837-ac7d-7210a21b21c0 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:54.017271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-468ffd5d-ac72-4837-ac7d-7210a21b21c0 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:54.018200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-468ffd5d-ac72-4837-ac7d-7210a21b21c0 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:54.290308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-468ffd5d-ac72-4837-ac7d-7210a21b21c0 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'services' on Instance uuid 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:05:54.321386 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-468ffd5d-ac72-4837-ac7d-7210a21b21c0 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 2050 microversion: 2.25 time: 0.322628 Oct 29 01:05:54.322857 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 279/580] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:53 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 2050 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:54.542436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f852a136-f60b-4c7f-9ab1-e525c4a3a44e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1848388750", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "f4099806-4a58-499a-8649-04716b1c047c"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:54.643373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=20,nova_api:UPDATE=5 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:54.643960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-f852a136-f60b-4c7f-9ab1-e525c4a3a44e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] validate_networks() for [('f4099806-4a58-499a-8649-04716b1c047c', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:05:55.602268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-f852a136-f60b-4c7f-9ab1-e525c4a3a44e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:05:55.604331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-f852a136-f60b-4c7f-9ab1-e525c4a3a44e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:05:55.605454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-f852a136-f60b-4c7f-9ab1-e525c4a3a44e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:05:55.606130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-f852a136-f60b-4c7f-9ab1-e525c4a3a44e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:05:55.606747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-f852a136-f60b-4c7f-9ab1-e525c4a3a44e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:05:55.630070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f852a136-f60b-4c7f-9ab1-e525c4a3a44e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:55.630599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f852a136-f60b-4c7f-9ab1-e525c4a3a44e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:55.633243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f852a136-f60b-4c7f-9ab1-e525c4a3a44e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:55.634396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f852a136-f60b-4c7f-9ab1-e525c4a3a44e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:55.634889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f852a136-f60b-4c7f-9ab1-e525c4a3a44e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:55.638760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f852a136-f60b-4c7f-9ab1-e525c4a3a44e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:55.674971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-f852a136-f60b-4c7f-9ab1-e525c4a3a44e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Getting quotas for project d0adfdd6819a472baf1aa25878c5ee22. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:05:55.682749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-f852a136-f60b-4c7f-9ab1-e525c4a3a44e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Getting quotas for user c56d01b83c0649e0b1d47b7563892d3f and project d0adfdd6819a472baf1aa25878c5ee22. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:05:55.701613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f852a136-f60b-4c7f-9ab1-e525c4a3a44e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:05:55.705498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f852a136-f60b-4c7f-9ab1-e525c4a3a44e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:05:55.898029 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f852a136-f60b-4c7f-9ab1-e525c4a3a44e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.359577 Oct 29 01:05:55.901364 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 280/581] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 29 01:05:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 01:05:55.911146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3cc3f1e3-2470-43e4-a172-989271787bf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:55.911768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3cc3f1e3-2470-43e4-a172-989271787bf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:55.948736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3cc3f1e3-2470-43e4-a172-989271787bf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:55.950211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3cc3f1e3-2470-43e4-a172-989271787bf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:55.950917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3cc3f1e3-2470-43e4-a172-989271787bf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:55.952022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3cc3f1e3-2470-43e4-a172-989271787bf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:55.952693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3cc3f1e3-2470-43e4-a172-989271787bf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:55.953333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3cc3f1e3-2470-43e4-a172-989271787bf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:55.959795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:05:56.125388 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3f8e56f8-d076-4267-8fba-aa9ff5c04df2 tempest-QuotasAdminTestJSON-1567121541 tempest-QuotasAdminTestJSON-1567121541-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/141f380a2a8a498c896980b49f2e472e" status: 200 len: 329 microversion: 2.1 time: 3.224247 Oct 29 01:05:56.139539 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 302/582] 10.222.0.26 () {60 vars in 1263 bytes} [Sat Oct 29 01:05:52 2022] PUT /compute/v2.1/os-quota-sets/141f380a2a8a498c896980b49f2e472e => generated 329 bytes in 3238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:56.152763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c0a33f96-e076-415c-9687-effe3100674a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:56.159367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c0a33f96-e076-415c-9687-effe3100674a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:56.180414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0a33f96-e076-415c-9687-effe3100674a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:56.184149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0a33f96-e076-415c-9687-effe3100674a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:56.185742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0a33f96-e076-415c-9687-effe3100674a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:56.186682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0a33f96-e076-415c-9687-effe3100674a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:56.187156 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0a33f96-e076-415c-9687-effe3100674a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:56.196508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3cc3f1e3-2470-43e4-a172-989271787bf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:56.196766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0a33f96-e076-415c-9687-effe3100674a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:56.212467 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3cc3f1e3-2470-43e4-a172-989271787bf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554" status: 200 len: 1319 microversion: 2.1 time: 0.309510 Oct 29 01:05:56.213071 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 281/583] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:55 2022] GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:56.230840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-544ccc2e-78b3-4750-8714-7cda7ecf89e3 req-4d81cee1-1f20-4371-b819-030ea463eca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1320c383-f883-429f-ac91-5d2209cb6554", "tag": "9d68c9f6-205b-40b0-842b-72ea38b567a6"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:56.262334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-544ccc2e-78b3-4750-8714-7cda7ecf89e3 req-4d81cee1-1f20-4371-b819-030ea463eca3 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:56.264727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-544ccc2e-78b3-4750-8714-7cda7ecf89e3 req-4d81cee1-1f20-4371-b819-030ea463eca3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:56.265234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-544ccc2e-78b3-4750-8714-7cda7ecf89e3 req-4d81cee1-1f20-4371-b819-030ea463eca3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:56.287681 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-544ccc2e-78b3-4750-8714-7cda7ecf89e3 req-4d81cee1-1f20-4371-b819-030ea463eca3 service nova] Creating event network-changed:9d68c9f6-205b-40b0-842b-72ea38b567a6 for instance 1320c383-f883-429f-ac91-5d2209cb6554 on n-h2-862964-3 Oct 29 01:05:56.296749 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-544ccc2e-78b3-4750-8714-7cda7ecf89e3 req-4d81cee1-1f20-4371-b819-030ea463eca3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079580 Oct 29 01:05:56.298004 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 282/584] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:05:56.305708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9ed8f92b-7b76-4c25-aa1e-4382b100032a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:56.307089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9ed8f92b-7b76-4c25-aa1e-4382b100032a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:56.465442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9ed8f92b-7b76-4c25-aa1e-4382b100032a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:56.477142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9ed8f92b-7b76-4c25-aa1e-4382b100032a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:56.478581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9ed8f92b-7b76-4c25-aa1e-4382b100032a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:56.479744 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9ed8f92b-7b76-4c25-aa1e-4382b100032a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1262 microversion: 2.25 time: 0.180389 Oct 29 01:05:56.484251 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 283/585] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:56 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1262 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:56.497426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c0a33f96-e076-415c-9687-effe3100674a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:56.518601 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c0a33f96-e076-415c-9687-effe3100674a tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 200 len: 1272 microversion: 2.1 time: 0.377615 Oct 29 01:05:56.542250 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 303/586] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:56 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 1272 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:57.523265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d31b5916-3ab5-4c96-8516-11c0b3efd1f9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:57.523265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d31b5916-3ab5-4c96-8516-11c0b3efd1f9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:57.523265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d31b5916-3ab5-4c96-8516-11c0b3efd1f9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:57.523265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d31b5916-3ab5-4c96-8516-11c0b3efd1f9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:57.527802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d31b5916-3ab5-4c96-8516-11c0b3efd1f9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:57.527802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d31b5916-3ab5-4c96-8516-11c0b3efd1f9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:57.527802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d31b5916-3ab5-4c96-8516-11c0b3efd1f9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:57.527802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d31b5916-3ab5-4c96-8516-11c0b3efd1f9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:57.528849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-67ab6c3c-d26a-4993-b943-b5af0477d018 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:57.528849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-67ab6c3c-d26a-4993-b943-b5af0477d018 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:57.598330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-67ab6c3c-d26a-4993-b943-b5af0477d018 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:57.606171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-67ab6c3c-d26a-4993-b943-b5af0477d018 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:57.607629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-67ab6c3c-d26a-4993-b943-b5af0477d018 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:57.608753 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-67ab6c3c-d26a-4993-b943-b5af0477d018 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1262 microversion: 2.25 time: 0.097054 Oct 29 01:05:57.609338 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 304/587] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:57 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1262 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:57.622126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d31b5916-3ab5-4c96-8516-11c0b3efd1f9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:57.625019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ad4ed380-cc3c-46de-925b-8ec643eae43b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:57.625832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ad4ed380-cc3c-46de-925b-8ec643eae43b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:57.631062 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d31b5916-3ab5-4c96-8516-11c0b3efd1f9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554" status: 200 len: 1319 microversion: 2.1 time: 0.396814 Oct 29 01:05:57.631653 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 284/588] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:57 2022] GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:57.632571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad4ed380-cc3c-46de-925b-8ec643eae43b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:57.633125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad4ed380-cc3c-46de-925b-8ec643eae43b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:57.633686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad4ed380-cc3c-46de-925b-8ec643eae43b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:57.634486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad4ed380-cc3c-46de-925b-8ec643eae43b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:57.635042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad4ed380-cc3c-46de-925b-8ec643eae43b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:57.635565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad4ed380-cc3c-46de-925b-8ec643eae43b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:57.776768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ad4ed380-cc3c-46de-925b-8ec643eae43b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:57.792108 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ad4ed380-cc3c-46de-925b-8ec643eae43b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 200 len: 1278 microversion: 2.1 time: 0.179999 Oct 29 01:05:57.809328 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 305/589] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:57 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:58.634870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1ee4d6b8-5e82-4b1f-93ce-ee71ec380b45 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:58.635492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1ee4d6b8-5e82-4b1f-93ce-ee71ec380b45 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:58.652724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-13ca06bc-9adb-478a-a417-78e24e306e7e req-ecae89fb-ce33-4131-b020-6bf7ad30bff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc5d115c-8881-4057-8885-cc8358078ca3", "tag": "16ac71ce-7be1-49ac-9a85-380b1ed3cfd1"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:05:58.670197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-13ca06bc-9adb-478a-a417-78e24e306e7e req-ecae89fb-ce33-4131-b020-6bf7ad30bff7 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:58.670678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-13ca06bc-9adb-478a-a417-78e24e306e7e req-ecae89fb-ce33-4131-b020-6bf7ad30bff7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:58.671441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-13ca06bc-9adb-478a-a417-78e24e306e7e req-ecae89fb-ce33-4131-b020-6bf7ad30bff7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:58.674318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ee4d6b8-5e82-4b1f-93ce-ee71ec380b45 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:58.675017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ee4d6b8-5e82-4b1f-93ce-ee71ec380b45 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:58.675525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ee4d6b8-5e82-4b1f-93ce-ee71ec380b45 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:58.676267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ee4d6b8-5e82-4b1f-93ce-ee71ec380b45 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:58.676732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ee4d6b8-5e82-4b1f-93ce-ee71ec380b45 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:58.682419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ee4d6b8-5e82-4b1f-93ce-ee71ec380b45 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:58.697962 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-13ca06bc-9adb-478a-a417-78e24e306e7e req-ecae89fb-ce33-4131-b020-6bf7ad30bff7 service nova] Creating event network-changed:16ac71ce-7be1-49ac-9a85-380b1ed3cfd1 for instance cc5d115c-8881-4057-8885-cc8358078ca3 on n-h1-862964-3 Oct 29 01:05:58.703726 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-13ca06bc-9adb-478a-a417-78e24e306e7e req-ecae89fb-ce33-4131-b020-6bf7ad30bff7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055352 Oct 29 01:05:58.704337 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 306/590] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:05:58.709877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2fe8ce87-cd9c-46f7-b75c-8b465ee36a69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:58.710816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2fe8ce87-cd9c-46f7-b75c-8b465ee36a69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:58.720723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fe8ce87-cd9c-46f7-b75c-8b465ee36a69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:58.721445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fe8ce87-cd9c-46f7-b75c-8b465ee36a69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:58.722938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fe8ce87-cd9c-46f7-b75c-8b465ee36a69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:58.723815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fe8ce87-cd9c-46f7-b75c-8b465ee36a69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:58.731064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fe8ce87-cd9c-46f7-b75c-8b465ee36a69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:58.732378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fe8ce87-cd9c-46f7-b75c-8b465ee36a69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:58.791234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ee4d6b8-5e82-4b1f-93ce-ee71ec380b45 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:58.803094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ee4d6b8-5e82-4b1f-93ce-ee71ec380b45 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:58.805058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ee4d6b8-5e82-4b1f-93ce-ee71ec380b45 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:58.821502 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1ee4d6b8-5e82-4b1f-93ce-ee71ec380b45 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1266 microversion: 2.25 time: 0.175755 Oct 29 01:05:58.821502 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 285/591] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:58 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:05:58.823977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4d989ad3-c78a-4bc9-958a-0069b24f0911 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:58.825012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4d989ad3-c78a-4bc9-958a-0069b24f0911 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:58.857067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d989ad3-c78a-4bc9-958a-0069b24f0911 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:58.864999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d989ad3-c78a-4bc9-958a-0069b24f0911 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:58.871213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d989ad3-c78a-4bc9-958a-0069b24f0911 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:58.872740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d989ad3-c78a-4bc9-958a-0069b24f0911 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:58.875758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d989ad3-c78a-4bc9-958a-0069b24f0911 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:58.875758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d989ad3-c78a-4bc9-958a-0069b24f0911 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:59.249983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2fe8ce87-cd9c-46f7-b75c-8b465ee36a69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:59.264442 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2fe8ce87-cd9c-46f7-b75c-8b465ee36a69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554" status: 200 len: 1319 microversion: 2.1 time: 0.555709 Oct 29 01:05:59.265006 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 307/592] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:58 2022] GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 => generated 1319 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:59.340680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4d989ad3-c78a-4bc9-958a-0069b24f0911 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:05:59.368153 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4d989ad3-c78a-4bc9-958a-0069b24f0911 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 200 len: 1320 microversion: 2.1 time: 0.533300 Oct 29 01:05:59.368153 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 286/593] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:05:58 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 1320 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:05:59.836549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1bbc9f64-448d-48b7-8d9a-2b24ded5b175 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:05:59.836549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1bbc9f64-448d-48b7-8d9a-2b24ded5b175 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:05:59.855258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bbc9f64-448d-48b7-8d9a-2b24ded5b175 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:59.855764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bbc9f64-448d-48b7-8d9a-2b24ded5b175 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:59.857739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bbc9f64-448d-48b7-8d9a-2b24ded5b175 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:05:59.858855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bbc9f64-448d-48b7-8d9a-2b24ded5b175 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:05:59.860589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bbc9f64-448d-48b7-8d9a-2b24ded5b175 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:05:59.861867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bbc9f64-448d-48b7-8d9a-2b24ded5b175 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:00.020545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1bbc9f64-448d-48b7-8d9a-2b24ded5b175 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:00.034312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1bbc9f64-448d-48b7-8d9a-2b24ded5b175 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:00.036553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1bbc9f64-448d-48b7-8d9a-2b24ded5b175 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:00.038719 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1bbc9f64-448d-48b7-8d9a-2b24ded5b175 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1266 microversion: 2.25 time: 0.207047 Oct 29 01:06:00.052061 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 308/594] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:05:59 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:00.301253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e94caae2-25b7-44ef-9593-a08a7193e86e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:00.301253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e94caae2-25b7-44ef-9593-a08a7193e86e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:00.306484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e94caae2-25b7-44ef-9593-a08a7193e86e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:00.307176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e94caae2-25b7-44ef-9593-a08a7193e86e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:00.308682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e94caae2-25b7-44ef-9593-a08a7193e86e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:00.311153 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e94caae2-25b7-44ef-9593-a08a7193e86e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:00.311747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e94caae2-25b7-44ef-9593-a08a7193e86e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:00.322314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e94caae2-25b7-44ef-9593-a08a7193e86e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:00.729033 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-da8822f3-0f6f-41cf-8ea4-664993351501 tempest-TenantUsagesNegativeTestJSON-1586119391 tempest-TenantUsagesNegativeTestJSON-1586119391-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-28T01%3A06%3A00.145353&end=2022-10-30T01%3A06%3A00.145353" status: 404 len: 112 microversion: - time: 0.580041 Oct 29 01:06:00.729772 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 287/595] 10.222.0.26 () {58 vars in 1316 bytes} [Sat Oct 29 01:06:00 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-28T01%3A06%3A00.145353&end=2022-10-30T01%3A06%3A00.145353 => generated 112 bytes in 581 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 01:06:00.745051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4b6b7261-755c-4078-aadb-905e75c3bcab tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:00.754108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4b6b7261-755c-4078-aadb-905e75c3bcab tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:00.774073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b6b7261-755c-4078-aadb-905e75c3bcab tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:00.774607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b6b7261-755c-4078-aadb-905e75c3bcab tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:00.775054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b6b7261-755c-4078-aadb-905e75c3bcab tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:00.779624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b6b7261-755c-4078-aadb-905e75c3bcab tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:00.780211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b6b7261-755c-4078-aadb-905e75c3bcab tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:00.780696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b6b7261-755c-4078-aadb-905e75c3bcab tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:00.811213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e94caae2-25b7-44ef-9593-a08a7193e86e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:00.819299 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e94caae2-25b7-44ef-9593-a08a7193e86e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554" status: 200 len: 1319 microversion: 2.1 time: 0.532218 Oct 29 01:06:00.819894 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 309/596] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:00 2022] GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 => generated 1319 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:06:00.840744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fd6266c7-fe7e-41e0-94c7-d6f83f00c16d tempest-TenantUsagesNegativeTestJSON-1586119391 tempest-TenantUsagesNegativeTestJSON-1586119391-project-admin] Calling method '.version_select at 0x7f9d9c56dc10>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:00.869542 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-fd6266c7-fe7e-41e0-94c7-d6f83f00c16d tempest-TenantUsagesNegativeTestJSON-1586119391 tempest-TenantUsagesNegativeTestJSON-1586119391-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fd6266c7-fe7e-41e0-94c7-d6f83f00c16d tempest-TenantUsagesNegativeTestJSON-1586119391 tempest-TenantUsagesNegativeTestJSON-1586119391-project-admin] Request method failure captured: Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-simple-tenant-usage/418409318af64685ba0266c2f8ab0fae?start=2022-10-30T01%3A06%3A00.145353&end=2022-10-28T01%3A06%3A00.145353 HTTP/1.1 Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHx3wEQ983DsgJPeK4NA0ea57rvxt6xhXrxoXvCLN5zqrBUuB9rslj-KkdhohSCEwy4Op9zCctzPBJrh1MnYYJ_R68EJEa-ZRLHeAnm1Ue2QHwS9_BgfOKJvA3kx2ilIpPLWjDqc1ldRKTLYllMw96Wol7Twz4HgKH6C8uQBo3KS0gU Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 11d5dff2e1584a268a5b1385db70cdbe Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1586119391 Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:06:00.879488 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:06:00.880905 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11d5dff2e1584a268a5b1385db70cdbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/11d5dff2e1584a268a5b1385db70cdbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11d5dff2e1584a268a5b1385db70cdbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_11d5dff2e1584a268a5b1385db70cdbe", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:06:00.880905 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1586119391 Oct 29 01:06:00.880905 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 11d5dff2e1584a268a5b1385db70cdbe Oct 29 01:06:00.880905 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1586119391 Oct 29 01:06:00.880905 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TenantUsagesNegativeTestJSON-1586119391-project-admin Oct 29 01:06:00.880905 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:06:00.880905 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:06:00.880905 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 6a11f26652874b53bd64cbfabbf9c26d Oct 29 01:06:00.880905 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1586119391-project-admin Oct 29 01:06:00.880905 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:06:00.880905 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid start time. The start time cannot occur after the end time. Oct 29 01:06:00.880905 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '418409318af64685ba0266c2f8ab0fae'} Oct 29 01:06:00.881745 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:06:00.881745 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:06:00.881745 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:06:00.881745 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:06:00.881745 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:06:00.881745 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:06:00.881745 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:06:00.881745 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:06:00.881745 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:06:00.881745 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:06:00.881745 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:06:00.881745 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:06:00.881745 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 29 01:06:00.881745 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 29 01:06:00.881745 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 29 01:06:00.881745 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 29 01:06:00.881745 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 29 01:06:00.881745 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 29 01:06:00.881745 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 29 01:06:00.883458 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:06:00.883458 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:06:00.883458 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:06:00.883458 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:06:00.883458 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:06:00.883458 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:06:00.883458 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:06:00.883458 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:06:00.883458 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 29 01:06:00.883458 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:06:00.885697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fd6266c7-fe7e-41e0-94c7-d6f83f00c16d tempest-TenantUsagesNegativeTestJSON-1586119391 tempest-TenantUsagesNegativeTestJSON-1586119391-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:06:00.885697 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fd6266c7-fe7e-41e0-94c7-d6f83f00c16d tempest-TenantUsagesNegativeTestJSON-1586119391 tempest-TenantUsagesNegativeTestJSON-1586119391-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/418409318af64685ba0266c2f8ab0fae?start=2022-10-30T01%3A06%3A00.145353&end=2022-10-28T01%3A06%3A00.145353" status: 400 len: 111 microversion: 2.1 time: 0.064572 Oct 29 01:06:00.886153 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 310/597] 10.222.0.26 () {58 vars in 1412 bytes} [Sat Oct 29 01:06:00 2022] GET /compute/v2.1/os-simple-tenant-usage/418409318af64685ba0266c2f8ab0fae?start=2022-10-30T01%3A06%3A00.145353&end=2022-10-28T01%3A06%3A00.145353 => generated 111 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:06:01.201839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4b6b7261-755c-4078-aadb-905e75c3bcab tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:01.212106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-02b15b2e-635a-4375-a782-76b87b59b0f0 tempest-TenantUsagesNegativeTestJSON-1981707035 tempest-TenantUsagesNegativeTestJSON-1981707035-project] Calling method '.version_select at 0x7f9d9c1f0670>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:01.218314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-02b15b2e-635a-4375-a782-76b87b59b0f0 tempest-TenantUsagesNegativeTestJSON-1981707035 tempest-TenantUsagesNegativeTestJSON-1981707035-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'ea0789abb7da40e0881a02c929bc8811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418409318af64685ba0266c2f8ab0fae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:01.223001 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4b6b7261-755c-4078-aadb-905e75c3bcab tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 200 len: 1320 microversion: 2.1 time: 0.486465 Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-02b15b2e-635a-4375-a782-76b87b59b0f0 tempest-TenantUsagesNegativeTestJSON-1981707035 tempest-TenantUsagesNegativeTestJSON-1981707035-project] Request method failure captured: Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T01%3A06%3A00.145353&end=2022-10-30T01%3A06%3A00.145353&detailed=1 HTTP/1.1 Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHx2VspeV0gZreLJ9G_nfjGQyQKGZm3ngeNZiV_7BgWkoIJZ82JSqPSkqmosxCb5IN_pBXxrm_Og3-67BZ9jZJ8n7d2-68sBZqLsvbYH74vTj8uQ-xoQ-y6TjhnpXAEkYUJrLOE6rhPTRaeviiwwVpgTBHU3HiCBouADvNZbk-rLqwo Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 418409318af64685ba0266c2f8ab0fae Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1981707035 Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:06:01.226495 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:06:01.228005 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/418409318af64685ba0266c2f8ab0fae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/418409318af64685ba0266c2f8ab0fae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/418409318af64685ba0266c2f8ab0fae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_418409318af64685ba0266c2f8ab0fae", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:06:01.228005 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1981707035 Oct 29 01:06:01.228005 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 418409318af64685ba0266c2f8ab0fae Oct 29 01:06:01.228005 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1981707035 Oct 29 01:06:01.228005 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TenantUsagesNegativeTestJSON-1981707035-project Oct 29 01:06:01.228005 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:06:01.228005 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:06:01.228005 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: ea0789abb7da40e0881a02c929bc8811 Oct 29 01:06:01.228005 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1981707035-project Oct 29 01:06:01.228005 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:06:01.228005 n-d-862964-3 devstack@n-api.service[121100]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 29 01:06:01.228005 n-d-862964-3 devstack@n-api.service[121100]: action_args: {} Oct 29 01:06:01.228005 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:06:01.228986 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:06:01.228986 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:06:01.228986 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:06:01.228986 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:06:01.228986 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:06:01.228986 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:06:01.228986 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:06:01.228986 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:06:01.228986 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:06:01.228986 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:06:01.228986 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:06:01.228986 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 29 01:06:01.228986 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 29 01:06:01.228986 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 29 01:06:01.228986 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 29 01:06:01.228986 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:06:01.228986 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:06:01.228986 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:06:01.228986 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:06:01.230436 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:06:01.230436 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:06:01.230436 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:06:01.230436 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:06:01.230436 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:06:01.230436 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:06:01.230436 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:06:01.230436 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:06:01.230436 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:06:01.230436 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:06:01.230436 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 29 01:06:01.230436 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:06:01.230436 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:06:01.230436 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:06:01.230436 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:06:01.230436 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:06:01.230436 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:06:01.230436 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:06:01.230436 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:06:01.231690 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 29 01:06:01.231690 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:06:01.233827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-02b15b2e-635a-4375-a782-76b87b59b0f0 tempest-TenantUsagesNegativeTestJSON-1981707035 tempest-TenantUsagesNegativeTestJSON-1981707035-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:06:01.252331 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-02b15b2e-635a-4375-a782-76b87b59b0f0 tempest-TenantUsagesNegativeTestJSON-1981707035 tempest-TenantUsagesNegativeTestJSON-1981707035-project] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T01%3A06%3A00.145353&end=2022-10-30T01%3A06%3A00.145353&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.341030 Oct 29 01:06:01.252648 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 288/598] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:00 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 1320 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:01.252757 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 311/599] 10.222.0.26 () {58 vars in 1335 bytes} [Sat Oct 29 01:06:00 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T01%3A06%3A00.145353&end=2022-10-30T01%3A06%3A00.145353&detailed=1 => generated 123 bytes in 349 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:06:01.253643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7c1f948d-d8fe-4cf5-8bc1-09b21d984e72 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:01.261144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7c1f948d-d8fe-4cf5-8bc1-09b21d984e72 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:01.282054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c1f948d-d8fe-4cf5-8bc1-09b21d984e72 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:01.282054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c1f948d-d8fe-4cf5-8bc1-09b21d984e72 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:01.282353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c1f948d-d8fe-4cf5-8bc1-09b21d984e72 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:01.283063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c1f948d-d8fe-4cf5-8bc1-09b21d984e72 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:01.283522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c1f948d-d8fe-4cf5-8bc1-09b21d984e72 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:01.283950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c1f948d-d8fe-4cf5-8bc1-09b21d984e72 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:01.549341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7c1f948d-d8fe-4cf5-8bc1-09b21d984e72 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:01.558324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7c1f948d-d8fe-4cf5-8bc1-09b21d984e72 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:01.566976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7c1f948d-d8fe-4cf5-8bc1-09b21d984e72 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:01.568550 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7c1f948d-d8fe-4cf5-8bc1-09b21d984e72 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1322 microversion: 2.25 time: 0.328669 Oct 29 01:06:01.569725 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 289/600] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:01 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:01.844718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fb97eb6c-76fa-4f8a-a0c5-cdd774284fce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:01.845581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fb97eb6c-76fa-4f8a-a0c5-cdd774284fce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:01.858581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb97eb6c-76fa-4f8a-a0c5-cdd774284fce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:01.859081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb97eb6c-76fa-4f8a-a0c5-cdd774284fce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:01.859587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb97eb6c-76fa-4f8a-a0c5-cdd774284fce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:01.860298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb97eb6c-76fa-4f8a-a0c5-cdd774284fce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:01.861483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb97eb6c-76fa-4f8a-a0c5-cdd774284fce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:01.861918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb97eb6c-76fa-4f8a-a0c5-cdd774284fce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:02.004512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-e0825c36-9fbf-4555-94bb-dc7efe7f97ae req-e3bddb3d-79f4-4fb3-9d7b-db1e6a005998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "057a3c07-ea05-4f36-9178-5bd7ab180e92", "tag": "6daf4ba8-989a-4e18-adfd-8659f76c37d1"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:02.031162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e0825c36-9fbf-4555-94bb-dc7efe7f97ae req-e3bddb3d-79f4-4fb3-9d7b-db1e6a005998 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:02.031656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e0825c36-9fbf-4555-94bb-dc7efe7f97ae req-e3bddb3d-79f4-4fb3-9d7b-db1e6a005998 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:02.032102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e0825c36-9fbf-4555-94bb-dc7efe7f97ae req-e3bddb3d-79f4-4fb3-9d7b-db1e6a005998 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:02.091664 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-e0825c36-9fbf-4555-94bb-dc7efe7f97ae req-e3bddb3d-79f4-4fb3-9d7b-db1e6a005998 service nova] Creating event network-changed:6daf4ba8-989a-4e18-adfd-8659f76c37d1 for instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 on n-h1-862964-3 Oct 29 01:06:02.103065 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-e0825c36-9fbf-4555-94bb-dc7efe7f97ae req-e3bddb3d-79f4-4fb3-9d7b-db1e6a005998 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103185 Oct 29 01:06:02.107262 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 290/601] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:02.263601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e1fefa11-d63f-4a9b-a38e-e96f689f16a9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:02.267243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e1fefa11-d63f-4a9b-a38e-e96f689f16a9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:02.276453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1fefa11-d63f-4a9b-a38e-e96f689f16a9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:02.276952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1fefa11-d63f-4a9b-a38e-e96f689f16a9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:02.277426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1fefa11-d63f-4a9b-a38e-e96f689f16a9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:02.278147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1fefa11-d63f-4a9b-a38e-e96f689f16a9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:02.278640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1fefa11-d63f-4a9b-a38e-e96f689f16a9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:02.279078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1fefa11-d63f-4a9b-a38e-e96f689f16a9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:02.829341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fb97eb6c-76fa-4f8a-a0c5-cdd774284fce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:02.838626 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fb97eb6c-76fa-4f8a-a0c5-cdd774284fce tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554" status: 200 len: 1319 microversion: 2.1 time: 0.997851 Oct 29 01:06:02.839206 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 312/602] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:01 2022] GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 => generated 1319 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:02.857820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c5cda16b-039b-420b-b8cd-e170e527687b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:02.857820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c5cda16b-039b-420b-b8cd-e170e527687b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:02.878075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c5cda16b-039b-420b-b8cd-e170e527687b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:02.880690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c5cda16b-039b-420b-b8cd-e170e527687b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:02.881216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c5cda16b-039b-420b-b8cd-e170e527687b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:02.891667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c5cda16b-039b-420b-b8cd-e170e527687b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:02.893340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c5cda16b-039b-420b-b8cd-e170e527687b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:02.894734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c5cda16b-039b-420b-b8cd-e170e527687b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:03.182852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c5cda16b-039b-420b-b8cd-e170e527687b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:03.197710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c5cda16b-039b-420b-b8cd-e170e527687b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:03.199249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c5cda16b-039b-420b-b8cd-e170e527687b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:03.205826 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c5cda16b-039b-420b-b8cd-e170e527687b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1320 microversion: 2.25 time: 0.355275 Oct 29 01:06:03.216368 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 313/603] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:02 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1320 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:03.234053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e1fefa11-d63f-4a9b-a38e-e96f689f16a9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:03.242638 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e1fefa11-d63f-4a9b-a38e-e96f689f16a9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 200 len: 1320 microversion: 2.1 time: 0.984755 Oct 29 01:06:03.243216 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 291/604] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:02 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 1320 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:03.473529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e5d3ab16-d840-4e91-ac31-7f82c2fc8e9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-144524438", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:03.576150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-e5d3ab16-d840-4e91-ac31-7f82c2fc8e9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] validate_networks() for None {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:06:03.608326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4cd645cd-a953-4894-a7f0-d4f48b7c83c9 req-95506701-87c4-4f06-9c4a-5d7637b6fe9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5d115c-8881-4057-8885-cc8358078ca3", "name": "network-vif-plugged", "status": "completed", "tag": "16ac71ce-7be1-49ac-9a85-380b1ed3cfd1"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:03.625604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4cd645cd-a953-4894-a7f0-d4f48b7c83c9 req-95506701-87c4-4f06-9c4a-5d7637b6fe9e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:03.626776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4cd645cd-a953-4894-a7f0-d4f48b7c83c9 req-95506701-87c4-4f06-9c4a-5d7637b6fe9e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:03.627535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4cd645cd-a953-4894-a7f0-d4f48b7c83c9 req-95506701-87c4-4f06-9c4a-5d7637b6fe9e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:03.646839 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4cd645cd-a953-4894-a7f0-d4f48b7c83c9 req-95506701-87c4-4f06-9c4a-5d7637b6fe9e service nova] Creating event network-vif-plugged:16ac71ce-7be1-49ac-9a85-380b1ed3cfd1 for instance cc5d115c-8881-4057-8885-cc8358078ca3 on n-h1-862964-3 Oct 29 01:06:03.652456 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4cd645cd-a953-4894-a7f0-d4f48b7c83c9 req-95506701-87c4-4f06-9c4a-5d7637b6fe9e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049177 Oct 29 01:06:03.654814 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 292/605] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:06:03.697517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=18 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:03.866476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f74e33a6-d6a9-44d4-9cb2-d7e212a92b0c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:03.867994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f74e33a6-d6a9-44d4-9cb2-d7e212a92b0c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:03.875588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f74e33a6-d6a9-44d4-9cb2-d7e212a92b0c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:03.876489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f74e33a6-d6a9-44d4-9cb2-d7e212a92b0c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:03.877422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f74e33a6-d6a9-44d4-9cb2-d7e212a92b0c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:03.881909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f74e33a6-d6a9-44d4-9cb2-d7e212a92b0c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:03.882745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f74e33a6-d6a9-44d4-9cb2-d7e212a92b0c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:03.883578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f74e33a6-d6a9-44d4-9cb2-d7e212a92b0c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:04.432316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f74e33a6-d6a9-44d4-9cb2-d7e212a92b0c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:04.445210 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f74e33a6-d6a9-44d4-9cb2-d7e212a92b0c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554" status: 200 len: 1319 microversion: 2.1 time: 0.584471 Oct 29 01:06:04.458768 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 293/606] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:03 2022] GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 => generated 1319 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:04.545401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e5d3ab16-d840-4e91-ac31-7f82c2fc8e9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:06:04.545906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e5d3ab16-d840-4e91-ac31-7f82c2fc8e9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:06:04.546293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e5d3ab16-d840-4e91-ac31-7f82c2fc8e9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:06:04.546697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e5d3ab16-d840-4e91-ac31-7f82c2fc8e9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:06:04.547310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e5d3ab16-d840-4e91-ac31-7f82c2fc8e9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:06:04.558539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e5d3ab16-d840-4e91-ac31-7f82c2fc8e9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:04.559312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e5d3ab16-d840-4e91-ac31-7f82c2fc8e9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:04.560195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e5d3ab16-d840-4e91-ac31-7f82c2fc8e9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:04.561243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e5d3ab16-d840-4e91-ac31-7f82c2fc8e9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:04.561889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e5d3ab16-d840-4e91-ac31-7f82c2fc8e9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:04.562488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e5d3ab16-d840-4e91-ac31-7f82c2fc8e9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:04.586842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-e5d3ab16-d840-4e91-ac31-7f82c2fc8e9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Getting quotas for project 646dbadc4e9140348132e6950c885e81. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:06:04.592788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-e5d3ab16-d840-4e91-ac31-7f82c2fc8e9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Getting quotas for user 8219d81b19964408b9bc275a4457f389 and project 646dbadc4e9140348132e6950c885e81. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:06:04.609139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e5d3ab16-d840-4e91-ac31-7f82c2fc8e9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:06:04.613595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e5d3ab16-d840-4e91-ac31-7f82c2fc8e9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:06:04.738882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0875864d-144e-48cb-a7c6-e3f3518b6d0b tempest-SecurityGroupsTestAdminJSON-1091469773 tempest-SecurityGroupsTestAdminJSON-1091469773-project] Action: 'create', calling method: .version_select at 0x7f9d97e715e0>, body: {"security_group": {"name": "tempest-securitygroup-1963896263", "description": "tempest-description-1966124490"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:04.946016 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e5d3ab16-d840-4e91-ac31-7f82c2fc8e9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.728125 Oct 29 01:06:04.948236 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 314/607] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:06:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:06:04.958130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-48644c5a-8f38-4996-947d-85390fe31eb1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:04.960867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-48644c5a-8f38-4996-947d-85390fe31eb1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:04.980591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48644c5a-8f38-4996-947d-85390fe31eb1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:04.980591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48644c5a-8f38-4996-947d-85390fe31eb1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:04.980591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48644c5a-8f38-4996-947d-85390fe31eb1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:04.980591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48644c5a-8f38-4996-947d-85390fe31eb1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:04.980945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48644c5a-8f38-4996-947d-85390fe31eb1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:04.983259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48644c5a-8f38-4996-947d-85390fe31eb1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:05.563740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-48644c5a-8f38-4996-947d-85390fe31eb1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:05.579169 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-48644c5a-8f38-4996-947d-85390fe31eb1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:05.593966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-48644c5a-8f38-4996-947d-85390fe31eb1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:05.606405 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-48644c5a-8f38-4996-947d-85390fe31eb1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1362 microversion: 2.25 time: 0.651530 Oct 29 01:06:05.607685 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 315/608] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:04 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1362 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:05.617335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4b444176-2b06-428c-a779-3f6768081483 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:05.621972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4b444176-2b06-428c-a779-3f6768081483 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:05.633550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b444176-2b06-428c-a779-3f6768081483 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:05.634052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b444176-2b06-428c-a779-3f6768081483 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:05.634485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b444176-2b06-428c-a779-3f6768081483 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:05.635209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b444176-2b06-428c-a779-3f6768081483 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:05.637214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b444176-2b06-428c-a779-3f6768081483 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:05.637670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b444176-2b06-428c-a779-3f6768081483 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:05.665014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=30 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:05.955733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4b444176-2b06-428c-a779-3f6768081483 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:05.965383 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4b444176-2b06-428c-a779-3f6768081483 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 200 len: 1320 microversion: 2.1 time: 0.356435 Oct 29 01:06:05.965968 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 316/609] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:05 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 1320 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:05.971342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b323eeb8-aa5d-4373-9c0c-0d140372439a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:05.972035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b323eeb8-aa5d-4373-9c0c-0d140372439a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:06.030117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b323eeb8-aa5d-4373-9c0c-0d140372439a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:06.034154 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b323eeb8-aa5d-4373-9c0c-0d140372439a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1212 microversion: 2.1 time: 0.067078 Oct 29 01:06:06.035655 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 317/610] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:05 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1212 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:06.040105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b3ef2079-a4eb-4145-af05-ca8cf1eceaeb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:06.040702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b3ef2079-a4eb-4145-af05-ca8cf1eceaeb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:06.046409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b3ef2079-a4eb-4145-af05-ca8cf1eceaeb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:06.046882 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b3ef2079-a4eb-4145-af05-ca8cf1eceaeb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:06.047313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b3ef2079-a4eb-4145-af05-ca8cf1eceaeb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:06.047991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b3ef2079-a4eb-4145-af05-ca8cf1eceaeb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:06.048741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b3ef2079-a4eb-4145-af05-ca8cf1eceaeb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:06.049406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b3ef2079-a4eb-4145-af05-ca8cf1eceaeb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:06.246361 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0875864d-144e-48cb-a7c6-e3f3518b6d0b tempest-SecurityGroupsTestAdminJSON-1091469773 tempest-SecurityGroupsTestAdminJSON-1091469773-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.780746 Oct 29 01:06:06.247020 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 294/611] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:06:04 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:06.265290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-d1ea5d7c-3747-49e5-bd66-fa592e645713 req-8c4e16c5-01d5-4ae6-891d-74e74824f7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1320c383-f883-429f-ac91-5d2209cb6554", "name": "network-vif-plugged", "status": "completed", "tag": "9d68c9f6-205b-40b0-842b-72ea38b567a6"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:06.291918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b3ef2079-a4eb-4145-af05-ca8cf1eceaeb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:06.301693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d1ea5d7c-3747-49e5-bd66-fa592e645713 req-8c4e16c5-01d5-4ae6-891d-74e74824f7a2 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:06.303421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d1ea5d7c-3747-49e5-bd66-fa592e645713 req-8c4e16c5-01d5-4ae6-891d-74e74824f7a2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:06.304445 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b3ef2079-a4eb-4145-af05-ca8cf1eceaeb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554" status: 200 len: 1319 microversion: 2.1 time: 0.265222 Oct 29 01:06:06.306584 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 318/612] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:06 2022] GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:06.306914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d1ea5d7c-3747-49e5-bd66-fa592e645713 req-8c4e16c5-01d5-4ae6-891d-74e74824f7a2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:06.322428 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e202a7bb-58ec-4dc2-875a-3114fa7b430e tempest-SecurityGroupsTestAdminJSON-1091469773 tempest-SecurityGroupsTestAdminJSON-1091469773-project] Action: 'create', calling method: .version_select at 0x7f9d9c230b80>, body: {"security_group": {"name": "tempest-securitygroup-260782306", "description": "tempest-description-50247111"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:06.339922 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-d1ea5d7c-3747-49e5-bd66-fa592e645713 req-8c4e16c5-01d5-4ae6-891d-74e74824f7a2 service nova] Creating event network-vif-plugged:9d68c9f6-205b-40b0-842b-72ea38b567a6 for instance 1320c383-f883-429f-ac91-5d2209cb6554 on n-h2-862964-3 Oct 29 01:06:06.358400 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-d1ea5d7c-3747-49e5-bd66-fa592e645713 req-8c4e16c5-01d5-4ae6-891d-74e74824f7a2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107411 Oct 29 01:06:06.360724 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 295/613] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:06.635681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c195a5b6-8164-4345-86c4-0f881f9e73ab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:06.636613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c195a5b6-8164-4345-86c4-0f881f9e73ab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:06.642221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=9 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:06.647538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c195a5b6-8164-4345-86c4-0f881f9e73ab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:06.647538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c195a5b6-8164-4345-86c4-0f881f9e73ab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:06.647538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c195a5b6-8164-4345-86c4-0f881f9e73ab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:06.647538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c195a5b6-8164-4345-86c4-0f881f9e73ab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:06.647919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c195a5b6-8164-4345-86c4-0f881f9e73ab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:06.647919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c195a5b6-8164-4345-86c4-0f881f9e73ab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:06.676758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:06.865173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c195a5b6-8164-4345-86c4-0f881f9e73ab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:06.875063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c195a5b6-8164-4345-86c4-0f881f9e73ab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:06.876891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c195a5b6-8164-4345-86c4-0f881f9e73ab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:06.878477 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c195a5b6-8164-4345-86c4-0f881f9e73ab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1362 microversion: 2.25 time: 0.247904 Oct 29 01:06:06.879186 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 296/614] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:06 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:06:06.937081 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e202a7bb-58ec-4dc2-875a-3114fa7b430e tempest-SecurityGroupsTestAdminJSON-1091469773 tempest-SecurityGroupsTestAdminJSON-1091469773-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.628919 Oct 29 01:06:06.938044 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 319/615] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:06:06 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:06.996466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2d8a7b44-92d4-4be1-a676-6b9734fc3e6b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:06.997094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2d8a7b44-92d4-4be1-a676-6b9734fc3e6b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:07.014572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d8a7b44-92d4-4be1-a676-6b9734fc3e6b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:07.015098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d8a7b44-92d4-4be1-a676-6b9734fc3e6b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:07.016110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d8a7b44-92d4-4be1-a676-6b9734fc3e6b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:07.018566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d8a7b44-92d4-4be1-a676-6b9734fc3e6b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:07.021386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d8a7b44-92d4-4be1-a676-6b9734fc3e6b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:07.022075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d8a7b44-92d4-4be1-a676-6b9734fc3e6b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:07.074979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:07.309822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2d8a7b44-92d4-4be1-a676-6b9734fc3e6b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:07.322280 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2d8a7b44-92d4-4be1-a676-6b9734fc3e6b tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 200 len: 1320 microversion: 2.1 time: 0.332367 Oct 29 01:06:07.323338 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 320/616] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:06 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 1320 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:06:07.336091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bf9315bf-592b-49e1-b756-efa0ef915e37 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:07.340706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bf9315bf-592b-49e1-b756-efa0ef915e37 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:07.354442 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf9315bf-592b-49e1-b756-efa0ef915e37 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:07.355302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf9315bf-592b-49e1-b756-efa0ef915e37 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:07.355946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf9315bf-592b-49e1-b756-efa0ef915e37 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:07.356875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf9315bf-592b-49e1-b756-efa0ef915e37 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:07.357508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf9315bf-592b-49e1-b756-efa0ef915e37 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:07.358020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf9315bf-592b-49e1-b756-efa0ef915e37 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:07.457949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3c607390-fed2-4dba-991a-6224e50bab6d tempest-SecurityGroupsTestAdminJSON-1855060058 tempest-SecurityGroupsTestAdminJSON-1855060058-project-admin] Action: 'create', calling method: .version_select at 0x7f9d97ec7040>, body: {"security_group": {"name": "tempest-securitygroup-1532380535", "description": "tempest-description-634735688"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:07.469551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bf9315bf-592b-49e1-b756-efa0ef915e37 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:07.489899 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bf9315bf-592b-49e1-b756-efa0ef915e37 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1216 microversion: 2.1 time: 0.161943 Oct 29 01:06:07.489899 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 321/617] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:07 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:07.494469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-82097108-eaaf-4d29-b574-36f4a03e524f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:07.495455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-82097108-eaaf-4d29-b574-36f4a03e524f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:07.507252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82097108-eaaf-4d29-b574-36f4a03e524f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:07.508008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82097108-eaaf-4d29-b574-36f4a03e524f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:07.512771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82097108-eaaf-4d29-b574-36f4a03e524f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:07.512771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82097108-eaaf-4d29-b574-36f4a03e524f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:07.512771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82097108-eaaf-4d29-b574-36f4a03e524f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:07.512771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82097108-eaaf-4d29-b574-36f4a03e524f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:07.932045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-82097108-eaaf-4d29-b574-36f4a03e524f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:07.943801 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-82097108-eaaf-4d29-b574-36f4a03e524f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554" status: 200 len: 1319 microversion: 2.1 time: 0.455067 Oct 29 01:06:07.960315 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 322/618] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:07 2022] GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:07.966720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a92390f0-990a-494e-8dc8-cbc9c47301ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:07.968120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a92390f0-990a-494e-8dc8-cbc9c47301ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:07.978732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a92390f0-990a-494e-8dc8-cbc9c47301ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:07.979425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a92390f0-990a-494e-8dc8-cbc9c47301ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:07.980100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a92390f0-990a-494e-8dc8-cbc9c47301ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:07.980994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a92390f0-990a-494e-8dc8-cbc9c47301ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:07.981668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a92390f0-990a-494e-8dc8-cbc9c47301ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:07.982233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a92390f0-990a-494e-8dc8-cbc9c47301ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:08.452803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a92390f0-990a-494e-8dc8-cbc9c47301ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:08.462094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a92390f0-990a-494e-8dc8-cbc9c47301ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:08.463565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a92390f0-990a-494e-8dc8-cbc9c47301ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:08.464685 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a92390f0-990a-494e-8dc8-cbc9c47301ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1362 microversion: 2.25 time: 0.503007 Oct 29 01:06:08.465265 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 323/619] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:07 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1362 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:08.481657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0063deb7-85a4-4e61-96f3-457b69fea7d8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:08.482306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0063deb7-85a4-4e61-96f3-457b69fea7d8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:08.492425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0063deb7-85a4-4e61-96f3-457b69fea7d8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:08.493138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0063deb7-85a4-4e61-96f3-457b69fea7d8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:08.493751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0063deb7-85a4-4e61-96f3-457b69fea7d8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:08.494479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0063deb7-85a4-4e61-96f3-457b69fea7d8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:08.494931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0063deb7-85a4-4e61-96f3-457b69fea7d8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:08.495347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0063deb7-85a4-4e61-96f3-457b69fea7d8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:08.887271 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3c607390-fed2-4dba-991a-6224e50bab6d tempest-SecurityGroupsTestAdminJSON-1855060058 tempest-SecurityGroupsTestAdminJSON-1855060058-project-admin] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.927078 Oct 29 01:06:08.890148 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 297/620] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:06:06 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:08.903876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e24463da-8582-4219-921f-0b1dc7752b5c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:08.907720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e24463da-8582-4219-921f-0b1dc7752b5c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:08.953218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e24463da-8582-4219-921f-0b1dc7752b5c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:08.954042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e24463da-8582-4219-921f-0b1dc7752b5c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:08.955774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e24463da-8582-4219-921f-0b1dc7752b5c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:08.957820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e24463da-8582-4219-921f-0b1dc7752b5c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:08.958591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e24463da-8582-4219-921f-0b1dc7752b5c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:08.959236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e24463da-8582-4219-921f-0b1dc7752b5c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:09.011485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0063deb7-85a4-4e61-96f3-457b69fea7d8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:09.027334 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0063deb7-85a4-4e61-96f3-457b69fea7d8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 200 len: 1320 microversion: 2.1 time: 0.558955 Oct 29 01:06:09.035222 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 324/621] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:08 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 1320 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:09.047450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3145f32e-9323-44f2-b93c-e7602f4d7874 tempest-SecurityGroupsTestAdminJSON-1855060058 tempest-SecurityGroupsTestAdminJSON-1855060058-project-admin] Action: 'create', calling method: .version_select at 0x7f9d9c5ccd30>, body: {"security_group": {"name": "tempest-securitygroup-1088256989", "description": "tempest-description-1787626847"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:09.186021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e24463da-8582-4219-921f-0b1dc7752b5c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:09.195533 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e24463da-8582-4219-921f-0b1dc7752b5c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1264 microversion: 2.1 time: 0.304114 Oct 29 01:06:09.223473 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 298/622] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:08 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1264 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:09.236929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd6efca8-831f-48a1-8e1c-36e601ca9042 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:09.247980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bd6efca8-831f-48a1-8e1c-36e601ca9042 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:09.256080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd6efca8-831f-48a1-8e1c-36e601ca9042 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:09.256584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd6efca8-831f-48a1-8e1c-36e601ca9042 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:09.257023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd6efca8-831f-48a1-8e1c-36e601ca9042 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:09.257769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd6efca8-831f-48a1-8e1c-36e601ca9042 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:09.258663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd6efca8-831f-48a1-8e1c-36e601ca9042 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:09.259094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd6efca8-831f-48a1-8e1c-36e601ca9042 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:09.562268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bd6efca8-831f-48a1-8e1c-36e601ca9042 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:09.578631 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bd6efca8-831f-48a1-8e1c-36e601ca9042 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554" status: 200 len: 1467 microversion: 2.1 time: 0.353757 Oct 29 01:06:09.579933 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 299/623] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:09 2022] GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 => generated 1467 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:09.586300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1c010531-1239-4af1-8d74-c5296af7b4a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:09.587804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1c010531-1239-4af1-8d74-c5296af7b4a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:09.601957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c010531-1239-4af1-8d74-c5296af7b4a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:09.604545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c010531-1239-4af1-8d74-c5296af7b4a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:09.606345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c010531-1239-4af1-8d74-c5296af7b4a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:09.607568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c010531-1239-4af1-8d74-c5296af7b4a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:09.614859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c010531-1239-4af1-8d74-c5296af7b4a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:09.617430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c010531-1239-4af1-8d74-c5296af7b4a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:10.007528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1c010531-1239-4af1-8d74-c5296af7b4a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:10.025103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1c010531-1239-4af1-8d74-c5296af7b4a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:10.027360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1c010531-1239-4af1-8d74-c5296af7b4a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:10.032280 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1c010531-1239-4af1-8d74-c5296af7b4a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1362 microversion: 2.25 time: 0.451134 Oct 29 01:06:10.033605 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 300/624] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:09 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1362 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:10.043234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9660c868-b5c6-4450-9023-9ea7a86e2608 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:10.047736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9660c868-b5c6-4450-9023-9ea7a86e2608 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: cc5d115c-8881-4057-8885-cc8358078ca3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:10.061568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9660c868-b5c6-4450-9023-9ea7a86e2608 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:10.062298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9660c868-b5c6-4450-9023-9ea7a86e2608 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:10.062948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9660c868-b5c6-4450-9023-9ea7a86e2608 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:10.063896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9660c868-b5c6-4450-9023-9ea7a86e2608 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:10.064833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9660c868-b5c6-4450-9023-9ea7a86e2608 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:10.065412 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3145f32e-9323-44f2-b93c-e7602f4d7874 tempest-SecurityGroupsTestAdminJSON-1855060058 tempest-SecurityGroupsTestAdminJSON-1855060058-project-admin] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.008365 Oct 29 01:06:10.074342 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 325/625] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:06:09 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:10.076911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9660c868-b5c6-4450-9023-9ea7a86e2608 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:10.077283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fc44fecd-c271-4771-8ca6-546d9b5de1ac tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:10.077793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fc44fecd-c271-4771-8ca6-546d9b5de1ac tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:10.106772 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc44fecd-c271-4771-8ca6-546d9b5de1ac tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:10.107280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc44fecd-c271-4771-8ca6-546d9b5de1ac tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:10.114874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc44fecd-c271-4771-8ca6-546d9b5de1ac tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:10.115755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc44fecd-c271-4771-8ca6-546d9b5de1ac tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:10.116247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc44fecd-c271-4771-8ca6-546d9b5de1ac tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:10.116691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc44fecd-c271-4771-8ca6-546d9b5de1ac tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:10.217359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fc44fecd-c271-4771-8ca6-546d9b5de1ac tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:06:10.429547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9660c868-b5c6-4450-9023-9ea7a86e2608 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:10.444388 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9660c868-b5c6-4450-9023-9ea7a86e2608 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/cc5d115c-8881-4057-8885-cc8358078ca3" status: 200 len: 1468 microversion: 2.1 time: 0.403820 Oct 29 01:06:10.446296 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 301/626] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:10 2022] GET /compute/v2.1/servers/cc5d115c-8881-4057-8885-cc8358078ca3 => generated 1468 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:10.461721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-029060c1-ca66-43e6-856a-2ae3435a6b51 req-b53a4814-4e46-4d16-bb13-a0b04abece75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a6eeec1-f116-41ea-b5ed-c20d0d37114a", "tag": "11ae0cb6-be2c-4a65-9b62-b6a49a05a7e3"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:10.485985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-029060c1-ca66-43e6-856a-2ae3435a6b51 req-b53a4814-4e46-4d16-bb13-a0b04abece75 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:10.492773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-029060c1-ca66-43e6-856a-2ae3435a6b51 req-b53a4814-4e46-4d16-bb13-a0b04abece75 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:10.492773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-029060c1-ca66-43e6-856a-2ae3435a6b51 req-b53a4814-4e46-4d16-bb13-a0b04abece75 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:10.526247 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-029060c1-ca66-43e6-856a-2ae3435a6b51 req-b53a4814-4e46-4d16-bb13-a0b04abece75 service nova] Creating event network-changed:11ae0cb6-be2c-4a65-9b62-b6a49a05a7e3 for instance 9a6eeec1-f116-41ea-b5ed-c20d0d37114a on n-h1-862964-3 Oct 29 01:06:10.544485 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-029060c1-ca66-43e6-856a-2ae3435a6b51 req-b53a4814-4e46-4d16-bb13-a0b04abece75 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089229 Oct 29 01:06:10.548453 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 302/627] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:10.554725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8692d3f3-707d-4911-b179-9c8c445c54d9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:10.556752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:INSERT=12,nova_api:SELECT=79,nova_api:UPDATE=9 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:10.563134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8692d3f3-707d-4911-b179-9c8c445c54d9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:10.579343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8692d3f3-707d-4911-b179-9c8c445c54d9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:10.580109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8692d3f3-707d-4911-b179-9c8c445c54d9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:10.580713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8692d3f3-707d-4911-b179-9c8c445c54d9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:10.582870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8692d3f3-707d-4911-b179-9c8c445c54d9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:10.584682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8692d3f3-707d-4911-b179-9c8c445c54d9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:10.587043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8692d3f3-707d-4911-b179-9c8c445c54d9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:10.647838 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fc44fecd-c271-4771-8ca6-546d9b5de1ac tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 204 len: 0 microversion: 2.1 time: 0.578939 Oct 29 01:06:10.648734 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 326/628] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:06:10 2022] DELETE /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:06:10.659902 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a99a66c1-c18b-4258-adb2-4cb984b3a787 tempest-SecurityGroupsTestAdminJSON-1855060058 tempest-SecurityGroupsTestAdminJSON-1855060058-project-admin] Calling method '.version_select at 0x7f9d9c6743a0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:11.284597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8692d3f3-707d-4911-b179-9c8c445c54d9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:11.296518 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8692d3f3-707d-4911-b179-9c8c445c54d9 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 200 len: 1320 microversion: 2.1 time: 0.746464 Oct 29 01:06:11.309617 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 303/629] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:10 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 1320 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:11.326209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-491e56b4-7731-4853-9ab7-a84066855669 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:11.331069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-491e56b4-7731-4853-9ab7-a84066855669 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:11.358388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-491e56b4-7731-4853-9ab7-a84066855669 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:11.359242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-491e56b4-7731-4853-9ab7-a84066855669 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:11.359861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-491e56b4-7731-4853-9ab7-a84066855669 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:11.364064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-491e56b4-7731-4853-9ab7-a84066855669 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:11.371388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-491e56b4-7731-4853-9ab7-a84066855669 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:11.373558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-491e56b4-7731-4853-9ab7-a84066855669 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:11.631186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-491e56b4-7731-4853-9ab7-a84066855669 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:11.652316 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-491e56b4-7731-4853-9ab7-a84066855669 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1270 microversion: 2.1 time: 0.332085 Oct 29 01:06:11.652316 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 304/630] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:11 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1270 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:11.657189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d39b6de9-df52-4b20-8675-4d89a2143c8e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:11.673439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d39b6de9-df52-4b20-8675-4d89a2143c8e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:11.674888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d39b6de9-df52-4b20-8675-4d89a2143c8e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Searching by: {'reservation_id': 'r-pen64uxq', 'deleted': False, 'project_id': 'fba91819dd56439daea17217c5d7b9b7'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:06:11.702860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d39b6de9-df52-4b20-8675-4d89a2143c8e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:11.703684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d39b6de9-df52-4b20-8675-4d89a2143c8e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:11.704303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d39b6de9-df52-4b20-8675-4d89a2143c8e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:11.705105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d39b6de9-df52-4b20-8675-4d89a2143c8e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:11.705595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d39b6de9-df52-4b20-8675-4d89a2143c8e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:11.706022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d39b6de9-df52-4b20-8675-4d89a2143c8e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:11.918898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-d39b6de9-df52-4b20-8675-4d89a2143c8e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:06:12.000027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d39b6de9-df52-4b20-8675-4d89a2143c8e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:12.011557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d39b6de9-df52-4b20-8675-4d89a2143c8e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:12.012046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d39b6de9-df52-4b20-8675-4d89a2143c8e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:12.012426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d39b6de9-df52-4b20-8675-4d89a2143c8e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:12.374670 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d39b6de9-df52-4b20-8675-4d89a2143c8e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?reservation_id=r-pen64uxq" status: 200 len: 2928 microversion: 2.1 time: 0.721224 Oct 29 01:06:12.389778 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 305/631] 10.222.0.26 () {58 vars in 1197 bytes} [Sat Oct 29 01:06:11 2022] GET /compute/v2.1/servers/detail?reservation_id=r-pen64uxq => generated 2928 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:12.400696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5d5f5b5e-25e3-448f-9884-acaa81742221 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2003638463", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "909793781", "adminPass": "***", "networks": [{"uuid": "7b39c1f5-a758-44cb-b968-9e05ca904af9"}], "security_groups": [{"name": "tempest-securitygroup--2076096584"}], "key_name": "tempest-keypair-1497961946", "user_data": "}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:12.724102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-5d5f5b5e-25e3-448f-9884-acaa81742221 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] validate_networks() for [('7b39c1f5-a758-44cb-b968-9e05ca904af9', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:06:14.564811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5d5f5b5e-25e3-448f-9884-acaa81742221 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:06:14.566716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5d5f5b5e-25e3-448f-9884-acaa81742221 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:06:14.567498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5d5f5b5e-25e3-448f-9884-acaa81742221 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:06:14.568151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5d5f5b5e-25e3-448f-9884-acaa81742221 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:06:14.568774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5d5f5b5e-25e3-448f-9884-acaa81742221 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:06:14.573144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:14.602421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d5f5b5e-25e3-448f-9884-acaa81742221 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:14.603478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d5f5b5e-25e3-448f-9884-acaa81742221 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:14.604026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d5f5b5e-25e3-448f-9884-acaa81742221 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:14.606606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d5f5b5e-25e3-448f-9884-acaa81742221 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:14.607224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d5f5b5e-25e3-448f-9884-acaa81742221 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:14.608202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d5f5b5e-25e3-448f-9884-acaa81742221 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:14.635030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:14.647683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-5d5f5b5e-25e3-448f-9884-acaa81742221 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Getting quotas for project a4ff5b9558944b61804150ad564c0d8f. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:06:14.660286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-5d5f5b5e-25e3-448f-9884-acaa81742221 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Getting quotas for user d2be9b9e6ac945f48fe7118bc10d4064 and project a4ff5b9558944b61804150ad564c0d8f. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:06:14.687751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5d5f5b5e-25e3-448f-9884-acaa81742221 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:06:14.695365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5d5f5b5e-25e3-448f-9884-acaa81742221 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:06:14.951988 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5d5f5b5e-25e3-448f-9884-acaa81742221 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.560740 Oct 29 01:06:14.962660 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 306/632] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:06:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 2565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:06:14.996495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b4c8a703-8919-4ec5-8dac-82da52b54440 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:15.000209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b4c8a703-8919-4ec5-8dac-82da52b54440 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:15.057022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b4c8a703-8919-4ec5-8dac-82da52b54440 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:15.074073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b4c8a703-8919-4ec5-8dac-82da52b54440 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:15.076657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b4c8a703-8919-4ec5-8dac-82da52b54440 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:15.078884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b4c8a703-8919-4ec5-8dac-82da52b54440 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:15.082539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b4c8a703-8919-4ec5-8dac-82da52b54440 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:15.085438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b4c8a703-8919-4ec5-8dac-82da52b54440 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:16.031744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=12 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:16.293808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b4c8a703-8919-4ec5-8dac-82da52b54440 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:16.308424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b4c8a703-8919-4ec5-8dac-82da52b54440 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:16.309934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b4c8a703-8919-4ec5-8dac-82da52b54440 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:16.314295 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b4c8a703-8919-4ec5-8dac-82da52b54440 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1362 microversion: 2.25 time: 1.350705 Oct 29 01:06:16.318605 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 307/633] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:14 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1362 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:16.326894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cba30e5b-a0ac-42f4-a860-0f1f255af475 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:16.330708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cba30e5b-a0ac-42f4-a860-0f1f255af475 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:16.344774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cba30e5b-a0ac-42f4-a860-0f1f255af475 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:16.349260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cba30e5b-a0ac-42f4-a860-0f1f255af475 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:16.350716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cba30e5b-a0ac-42f4-a860-0f1f255af475 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:16.351639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cba30e5b-a0ac-42f4-a860-0f1f255af475 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:16.352966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cba30e5b-a0ac-42f4-a860-0f1f255af475 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:16.355025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cba30e5b-a0ac-42f4-a860-0f1f255af475 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:16.870311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cba30e5b-a0ac-42f4-a860-0f1f255af475 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:16.881018 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cba30e5b-a0ac-42f4-a860-0f1f255af475 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 200 len: 1320 microversion: 2.1 time: 0.560979 Oct 29 01:06:16.886990 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 308/634] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:16 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 1320 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:16.900979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aa3a68ca-6fbd-485c-888c-c088ae40ffff tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:16.948657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.compute.server_groups [None req-aa3a68ca-6fbd-485c-888c-c088ae40ffff tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Querying cell 584133c9-70d9-4dbd-88ec-66308eedb7a2(cell1) for 2 instances {{(pid=121099) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 01:06:16.952278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa3a68ca-6fbd-485c-888c-c088ae40ffff tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:16.952772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa3a68ca-6fbd-485c-888c-c088ae40ffff tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:16.953243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa3a68ca-6fbd-485c-888c-c088ae40ffff tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:16.995947 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aa3a68ca-6fbd-485c-888c-c088ae40ffff tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/c09db39f-3e03-49b9-abf5-1fbf9e347ec6" status: 200 len: 271 microversion: 2.1 time: 0.101020 Oct 29 01:06:17.015925 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 309/635] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:06:16 2022] GET /compute/v2.1/os-server-groups/c09db39f-3e03-49b9-abf5-1fbf9e347ec6 => generated 271 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:17.031028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-49a6d6a4-ce87-4067-b4cb-578d4feafd09 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:17.040335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-49a6d6a4-ce87-4067-b4cb-578d4feafd09 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:17.059680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49a6d6a4-ce87-4067-b4cb-578d4feafd09 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:17.065719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49a6d6a4-ce87-4067-b4cb-578d4feafd09 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:17.066733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49a6d6a4-ce87-4067-b4cb-578d4feafd09 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:17.067876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49a6d6a4-ce87-4067-b4cb-578d4feafd09 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:17.075352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49a6d6a4-ce87-4067-b4cb-578d4feafd09 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:17.078133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49a6d6a4-ce87-4067-b4cb-578d4feafd09 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:17.629749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-49a6d6a4-ce87-4067-b4cb-578d4feafd09 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:17.638648 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-49a6d6a4-ce87-4067-b4cb-578d4feafd09 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1312 microversion: 2.1 time: 0.618169 Oct 29 01:06:17.642052 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 310/636] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:17 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1312 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:17.647496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-19439207-7bff-4c84-aa28-c2d3ff9be700 req-764ac9c6-de90-4b1c-8904-4ccea6d75a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057a3c07-ea05-4f36-9178-5bd7ab180e92", "name": "network-vif-plugged", "status": "completed", "tag": "6daf4ba8-989a-4e18-adfd-8659f76c37d1"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:17.664906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-19439207-7bff-4c84-aa28-c2d3ff9be700 req-764ac9c6-de90-4b1c-8904-4ccea6d75a3c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:17.665744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-19439207-7bff-4c84-aa28-c2d3ff9be700 req-764ac9c6-de90-4b1c-8904-4ccea6d75a3c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:17.666334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-19439207-7bff-4c84-aa28-c2d3ff9be700 req-764ac9c6-de90-4b1c-8904-4ccea6d75a3c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:17.680652 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-19439207-7bff-4c84-aa28-c2d3ff9be700 req-764ac9c6-de90-4b1c-8904-4ccea6d75a3c service nova] Creating event network-vif-plugged:6daf4ba8-989a-4e18-adfd-8659f76c37d1 for instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 on n-h1-862964-3 Oct 29 01:06:17.689325 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-19439207-7bff-4c84-aa28-c2d3ff9be700 req-764ac9c6-de90-4b1c-8904-4ccea6d75a3c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045730 Oct 29 01:06:17.691161 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 311/637] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:17.698764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-eba7e32e-d7db-4fc4-a60c-2af3d01b0f86 req-d3e3f75b-b20e-447c-bddb-8f990a551cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65c62cb3-ec7c-43fa-9840-1c0fef87ae15", "tag": "edbb0f10-da6d-409d-8978-de8280afa7df"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:17.711753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-eba7e32e-d7db-4fc4-a60c-2af3d01b0f86 req-d3e3f75b-b20e-447c-bddb-8f990a551cb9 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:17.712573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-eba7e32e-d7db-4fc4-a60c-2af3d01b0f86 req-d3e3f75b-b20e-447c-bddb-8f990a551cb9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:17.714446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-eba7e32e-d7db-4fc4-a60c-2af3d01b0f86 req-d3e3f75b-b20e-447c-bddb-8f990a551cb9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:17.748520 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-eba7e32e-d7db-4fc4-a60c-2af3d01b0f86 req-d3e3f75b-b20e-447c-bddb-8f990a551cb9 service nova] Creating event network-changed:edbb0f10-da6d-409d-8978-de8280afa7df for instance 65c62cb3-ec7c-43fa-9840-1c0fef87ae15 on n-h2-862964-3 Oct 29 01:06:17.760033 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-eba7e32e-d7db-4fc4-a60c-2af3d01b0f86 req-d3e3f75b-b20e-447c-bddb-8f990a551cb9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066864 Oct 29 01:06:17.761261 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 312/638] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:17.771087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fbff7b45-5009-467c-9b7c-50c08385ebc4 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:17.772204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fbff7b45-5009-467c-9b7c-50c08385ebc4 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:17.782193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbff7b45-5009-467c-9b7c-50c08385ebc4 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:17.783121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbff7b45-5009-467c-9b7c-50c08385ebc4 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:17.783796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbff7b45-5009-467c-9b7c-50c08385ebc4 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:17.784812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbff7b45-5009-467c-9b7c-50c08385ebc4 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:17.786069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbff7b45-5009-467c-9b7c-50c08385ebc4 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:17.786729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbff7b45-5009-467c-9b7c-50c08385ebc4 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:18.065036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fbff7b45-5009-467c-9b7c-50c08385ebc4 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:18.081727 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fbff7b45-5009-467c-9b7c-50c08385ebc4 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1315 microversion: 2.1 time: 0.318334 Oct 29 01:06:18.092513 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 313/639] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:17 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:18.119355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-03dd57be-cc90-4db0-9425-f7c56f20d046 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:18.123338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-03dd57be-cc90-4db0-9425-f7c56f20d046 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:18.156932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03dd57be-cc90-4db0-9425-f7c56f20d046 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:18.278617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03dd57be-cc90-4db0-9425-f7c56f20d046 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:18.278617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03dd57be-cc90-4db0-9425-f7c56f20d046 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:18.278617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03dd57be-cc90-4db0-9425-f7c56f20d046 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:18.278617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03dd57be-cc90-4db0-9425-f7c56f20d046 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:18.279533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03dd57be-cc90-4db0-9425-f7c56f20d046 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:18.666313 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-03dd57be-cc90-4db0-9425-f7c56f20d046 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554" status: 200 len: 1618 microversion: 2.1 time: 0.571605 Oct 29 01:06:18.667712 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 314/640] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:18 2022] GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 => generated 1618 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:18.680891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-8d779f63-93be-458f-95d3-f9e853acc35b req-cba9fcfd-9f52-4d14-a4d5-d473219f2f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f061780f-e530-42cd-8c3d-021d7e63a22f", "name": "network-vif-deleted", "tag": "0ef4060b-e698-4221-b1fb-3c5bdfd3cba2"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:18.724002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8d779f63-93be-458f-95d3-f9e853acc35b req-cba9fcfd-9f52-4d14-a4d5-d473219f2f24 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:18.728047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8d779f63-93be-458f-95d3-f9e853acc35b req-cba9fcfd-9f52-4d14-a4d5-d473219f2f24 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:18.728953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8d779f63-93be-458f-95d3-f9e853acc35b req-cba9fcfd-9f52-4d14-a4d5-d473219f2f24 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:18.754528 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-8d779f63-93be-458f-95d3-f9e853acc35b req-cba9fcfd-9f52-4d14-a4d5-d473219f2f24 service nova] Creating event network-vif-deleted:0ef4060b-e698-4221-b1fb-3c5bdfd3cba2 for instance f061780f-e530-42cd-8c3d-021d7e63a22f on n-h2-862964-3 Oct 29 01:06:18.766057 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-8d779f63-93be-458f-95d3-f9e853acc35b req-cba9fcfd-9f52-4d14-a4d5-d473219f2f24 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096887 Oct 29 01:06:18.769349 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 315/641] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:18.774142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-94f95b54-2a44-4514-91ae-da47ba3d32e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:18.775159 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-94f95b54-2a44-4514-91ae-da47ba3d32e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:18.784722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94f95b54-2a44-4514-91ae-da47ba3d32e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:18.786013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94f95b54-2a44-4514-91ae-da47ba3d32e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:18.787283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94f95b54-2a44-4514-91ae-da47ba3d32e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:18.788391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94f95b54-2a44-4514-91ae-da47ba3d32e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:18.789074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94f95b54-2a44-4514-91ae-da47ba3d32e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:18.789778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94f95b54-2a44-4514-91ae-da47ba3d32e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:19.289523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-94f95b54-2a44-4514-91ae-da47ba3d32e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:19.299005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-94f95b54-2a44-4514-91ae-da47ba3d32e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:19.302974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-94f95b54-2a44-4514-91ae-da47ba3d32e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:19.309813 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-94f95b54-2a44-4514-91ae-da47ba3d32e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1362 microversion: 2.25 time: 0.541216 Oct 29 01:06:19.325303 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 316/642] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:18 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1362 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:19.330482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fdb8d12c-5cfb-4f7e-a4d4-217e4073daed tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:19.333779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fdb8d12c-5cfb-4f7e-a4d4-217e4073daed tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:19.358249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fdb8d12c-5cfb-4f7e-a4d4-217e4073daed tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:19.358738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fdb8d12c-5cfb-4f7e-a4d4-217e4073daed tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:19.359434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fdb8d12c-5cfb-4f7e-a4d4-217e4073daed tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:19.360220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fdb8d12c-5cfb-4f7e-a4d4-217e4073daed tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:19.360633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fdb8d12c-5cfb-4f7e-a4d4-217e4073daed tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:19.361052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fdb8d12c-5cfb-4f7e-a4d4-217e4073daed tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:19.366257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:19.457772 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a99a66c1-c18b-4258-adb2-4cb984b3a787 tempest-SecurityGroupsTestAdminJSON-1855060058 tempest-SecurityGroupsTestAdminJSON-1855060058-project-admin] 10.222.0.26 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11740 microversion: 2.1 time: 8.805826 Oct 29 01:06:19.459442 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 327/643] 10.222.0.26 () {58 vars in 1191 bytes} [Sat Oct 29 01:06:10 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11740 bytes in 8810 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:06:19.465928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-42158252-dbe1-4323-beb2-e3850582ed5f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:19.467750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-42158252-dbe1-4323-beb2-e3850582ed5f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:19.486916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42158252-dbe1-4323-beb2-e3850582ed5f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:19.493952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42158252-dbe1-4323-beb2-e3850582ed5f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:19.496828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42158252-dbe1-4323-beb2-e3850582ed5f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:19.499821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42158252-dbe1-4323-beb2-e3850582ed5f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:19.507370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42158252-dbe1-4323-beb2-e3850582ed5f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:19.508695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42158252-dbe1-4323-beb2-e3850582ed5f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:20.469758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-42158252-dbe1-4323-beb2-e3850582ed5f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:20.479352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fdb8d12c-5cfb-4f7e-a4d4-217e4073daed tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:20.505147 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fdb8d12c-5cfb-4f7e-a4d4-217e4073daed tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 200 len: 1320 microversion: 2.1 time: 1.178367 Oct 29 01:06:20.509819 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 317/644] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:19 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 1320 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:20.510919 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-42158252-dbe1-4323-beb2-e3850582ed5f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1312 microversion: 2.1 time: 1.050089 Oct 29 01:06:20.515236 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 328/645] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:19 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1312 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:20.532404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2d075af5-b2e7-4a9d-9dcc-34a424d48e22 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:20.536126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2d075af5-b2e7-4a9d-9dcc-34a424d48e22 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] [instance: cc5d115c-8881-4057-8885-cc8358078ca3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:20.537471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c412c20-99a1-4731-a2c8-f079af74bd17 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:20.542384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9c412c20-99a1-4731-a2c8-f079af74bd17 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:20.551631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c412c20-99a1-4731-a2c8-f079af74bd17 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:20.552471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c412c20-99a1-4731-a2c8-f079af74bd17 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:20.553790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c412c20-99a1-4731-a2c8-f079af74bd17 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:20.555040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d075af5-b2e7-4a9d-9dcc-34a424d48e22 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:20.555420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c412c20-99a1-4731-a2c8-f079af74bd17 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:20.555534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d075af5-b2e7-4a9d-9dcc-34a424d48e22 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:20.555978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d075af5-b2e7-4a9d-9dcc-34a424d48e22 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:20.556429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c412c20-99a1-4731-a2c8-f079af74bd17 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:20.557121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c412c20-99a1-4731-a2c8-f079af74bd17 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:20.559893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d075af5-b2e7-4a9d-9dcc-34a424d48e22 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:20.560405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d075af5-b2e7-4a9d-9dcc-34a424d48e22 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:20.560854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d075af5-b2e7-4a9d-9dcc-34a424d48e22 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:20.777389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9c412c20-99a1-4731-a2c8-f079af74bd17 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:20.822092 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9c412c20-99a1-4731-a2c8-f079af74bd17 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1321 microversion: 2.1 time: 0.291651 Oct 29 01:06:20.822092 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 329/646] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:20 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:20.840868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9b0cea8e-6ff3-4c5a-9c71-912420caedb9 tempest-SecurityGroupsTestAdminJSON-1091469773 tempest-SecurityGroupsTestAdminJSON-1091469773-project] Calling method '.version_select at 0x7f9d9c1f04c0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:20.980910 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2d075af5-b2e7-4a9d-9dcc-34a424d48e22 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/cc5d115c-8881-4057-8885-cc8358078ca3" status: 200 len: 1619 microversion: 2.1 time: 0.467336 Oct 29 01:06:20.983087 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 318/647] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:20 2022] GET /compute/v2.1/servers/cc5d115c-8881-4057-8885-cc8358078ca3 => generated 1619 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:20.997665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-48e638e5-1e77-4c91-88ff-8d61e28edf85 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:21.003618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-48e638e5-1e77-4c91-88ff-8d61e28edf85 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:21.032698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48e638e5-1e77-4c91-88ff-8d61e28edf85 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:21.034133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48e638e5-1e77-4c91-88ff-8d61e28edf85 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:21.036372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48e638e5-1e77-4c91-88ff-8d61e28edf85 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:21.041335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48e638e5-1e77-4c91-88ff-8d61e28edf85 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:21.042682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48e638e5-1e77-4c91-88ff-8d61e28edf85 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:21.042830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48e638e5-1e77-4c91-88ff-8d61e28edf85 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:21.573131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-48e638e5-1e77-4c91-88ff-8d61e28edf85 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:21.608845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-48e638e5-1e77-4c91-88ff-8d61e28edf85 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:21.610806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-48e638e5-1e77-4c91-88ff-8d61e28edf85 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:21.612890 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-48e638e5-1e77-4c91-88ff-8d61e28edf85 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1362 microversion: 2.25 time: 0.625850 Oct 29 01:06:21.623840 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 319/648] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:20 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1362 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:21.643191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-d269a6da-c917-4300-af2c-4b568bf8384e req-1b3226d6-885d-469a-ae5c-de7eb279b14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6eeec1-f116-41ea-b5ed-c20d0d37114a", "name": "network-vif-plugged", "status": "completed", "tag": "11ae0cb6-be2c-4a65-9b62-b6a49a05a7e3"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:21.662615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d269a6da-c917-4300-af2c-4b568bf8384e req-1b3226d6-885d-469a-ae5c-de7eb279b14f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:21.663373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d269a6da-c917-4300-af2c-4b568bf8384e req-1b3226d6-885d-469a-ae5c-de7eb279b14f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:21.663989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d269a6da-c917-4300-af2c-4b568bf8384e req-1b3226d6-885d-469a-ae5c-de7eb279b14f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:21.678298 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-d269a6da-c917-4300-af2c-4b568bf8384e req-1b3226d6-885d-469a-ae5c-de7eb279b14f service nova] Creating event network-vif-plugged:11ae0cb6-be2c-4a65-9b62-b6a49a05a7e3 for instance 9a6eeec1-f116-41ea-b5ed-c20d0d37114a on n-h1-862964-3 Oct 29 01:06:21.684634 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-d269a6da-c917-4300-af2c-4b568bf8384e req-1b3226d6-885d-469a-ae5c-de7eb279b14f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058316 Oct 29 01:06:21.686172 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 320/649] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:21.692775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ee0fb43d-5c61-4036-8843-e7c0ca831a33 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-226795030", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "a9a5a9b1-7f02-4874-83d4-c48badd76f5f"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:21.777171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-ee0fb43d-5c61-4036-8843-e7c0ca831a33 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] validate_networks() for None {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:06:21.879914 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9b0cea8e-6ff3-4c5a-9c71-912420caedb9 tempest-SecurityGroupsTestAdminJSON-1091469773 tempest-SecurityGroupsTestAdminJSON-1091469773-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 1.053897 Oct 29 01:06:21.890956 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 330/650] 10.222.0.26 () {58 vars in 1191 bytes} [Sat Oct 29 01:06:20 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:21.897833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e3702ae-9e1d-41d9-8d20-f0dcd06414a2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:21.898629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7e3702ae-9e1d-41d9-8d20-f0dcd06414a2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:21.906334 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e3702ae-9e1d-41d9-8d20-f0dcd06414a2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:21.907413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e3702ae-9e1d-41d9-8d20-f0dcd06414a2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:21.907866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e3702ae-9e1d-41d9-8d20-f0dcd06414a2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:21.908573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e3702ae-9e1d-41d9-8d20-f0dcd06414a2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:21.909134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e3702ae-9e1d-41d9-8d20-f0dcd06414a2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:21.909558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e3702ae-9e1d-41d9-8d20-f0dcd06414a2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:22.684260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7e3702ae-9e1d-41d9-8d20-f0dcd06414a2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:22.696223 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e3702ae-9e1d-41d9-8d20-f0dcd06414a2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 200 len: 1469 microversion: 2.1 time: 0.804032 Oct 29 01:06:22.697043 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 331/651] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:21 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 1469 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:22.703170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-91a7b4d5-3772-496e-a836-a4f9d9c58f97 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:22.703798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-91a7b4d5-3772-496e-a836-a4f9d9c58f97 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:22.710791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91a7b4d5-3772-496e-a836-a4f9d9c58f97 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:22.718046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91a7b4d5-3772-496e-a836-a4f9d9c58f97 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:22.718805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91a7b4d5-3772-496e-a836-a4f9d9c58f97 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:22.719903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91a7b4d5-3772-496e-a836-a4f9d9c58f97 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:22.720272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91a7b4d5-3772-496e-a836-a4f9d9c58f97 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:22.720707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91a7b4d5-3772-496e-a836-a4f9d9c58f97 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:22.813788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ee0fb43d-5c61-4036-8843-e7c0ca831a33 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:06:22.814301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ee0fb43d-5c61-4036-8843-e7c0ca831a33 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:06:22.814661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ee0fb43d-5c61-4036-8843-e7c0ca831a33 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:06:22.815064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ee0fb43d-5c61-4036-8843-e7c0ca831a33 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:06:22.816218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ee0fb43d-5c61-4036-8843-e7c0ca831a33 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:06:22.833054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee0fb43d-5c61-4036-8843-e7c0ca831a33 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:22.833805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee0fb43d-5c61-4036-8843-e7c0ca831a33 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:22.834536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee0fb43d-5c61-4036-8843-e7c0ca831a33 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:22.835638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee0fb43d-5c61-4036-8843-e7c0ca831a33 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:22.836094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee0fb43d-5c61-4036-8843-e7c0ca831a33 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:22.836520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee0fb43d-5c61-4036-8843-e7c0ca831a33 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:22.857454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-ee0fb43d-5c61-4036-8843-e7c0ca831a33 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for project fba91819dd56439daea17217c5d7b9b7. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:06:22.864462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-ee0fb43d-5c61-4036-8843-e7c0ca831a33 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for user 175bb8f8b330495394cd401223847733 and project fba91819dd56439daea17217c5d7b9b7. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:06:22.880795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ee0fb43d-5c61-4036-8843-e7c0ca831a33 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:06:22.883049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ee0fb43d-5c61-4036-8843-e7c0ca831a33 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:06:22.953055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-91a7b4d5-3772-496e-a836-a4f9d9c58f97 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:22.962624 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-91a7b4d5-3772-496e-a836-a4f9d9c58f97 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1312 microversion: 2.1 time: 0.263394 Oct 29 01:06:22.977489 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 332/652] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:22 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1312 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:23.060884 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ee0fb43d-5c61-4036-8843-e7c0ca831a33 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.373255 Oct 29 01:06:23.061904 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 321/653] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:06:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:06:23.075847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d8e9f211-ef60-4e15-a528-4daf77746f57 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:23.076473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d8e9f211-ef60-4e15-a528-4daf77746f57 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:23.094241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8e9f211-ef60-4e15-a528-4daf77746f57 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:23.094241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8e9f211-ef60-4e15-a528-4daf77746f57 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:23.094241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8e9f211-ef60-4e15-a528-4daf77746f57 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:23.094241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8e9f211-ef60-4e15-a528-4daf77746f57 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:23.094590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8e9f211-ef60-4e15-a528-4daf77746f57 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:23.094590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8e9f211-ef60-4e15-a528-4daf77746f57 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:23.277198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-455de64a-692d-439c-b062-52cd4db5d79d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1269383568", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "126fc8bc-76ae-4d47-87ee-a1185490f9e0"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:23.387886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-455de64a-692d-439c-b062-52cd4db5d79d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] validate_networks() for [('126fc8bc-76ae-4d47-87ee-a1185490f9e0', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:06:23.665950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d8e9f211-ef60-4e15-a528-4daf77746f57 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:23.679292 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d8e9f211-ef60-4e15-a528-4daf77746f57 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1389 microversion: 2.1 time: 0.610102 Oct 29 01:06:23.680689 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 322/654] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:23 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1389 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:23.708595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-de129a41-bafc-46e8-ac00-f2369b5c4440 tempest-SecurityGroupsTestAdminJSON-1855060058 tempest-SecurityGroupsTestAdminJSON-1855060058-project-admin] Calling method '.version_select at 0x7f9d9c10a4c0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:24.594091 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-de129a41-bafc-46e8-ac00-f2369b5c4440 tempest-SecurityGroupsTestAdminJSON-1855060058 tempest-SecurityGroupsTestAdminJSON-1855060058-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/dabde05f-4f96-4f56-92cf-a027c537b0b0" status: 202 len: 0 microversion: 2.1 time: 0.911986 Oct 29 01:06:24.595399 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 323/655] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:06:23 2022] DELETE /compute/v2.1/os-security-groups/dabde05f-4f96-4f56-92cf-a027c537b0b0 => generated 0 bytes in 914 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:06:24.601300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-95917e14-32b5-4edb-9c9e-d2818bf8e344 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:24.602214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-95917e14-32b5-4edb-9c9e-d2818bf8e344 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:24.609096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95917e14-32b5-4edb-9c9e-d2818bf8e344 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:24.613954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95917e14-32b5-4edb-9c9e-d2818bf8e344 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:24.615105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95917e14-32b5-4edb-9c9e-d2818bf8e344 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:24.616089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95917e14-32b5-4edb-9c9e-d2818bf8e344 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:24.616738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95917e14-32b5-4edb-9c9e-d2818bf8e344 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:24.617438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95917e14-32b5-4edb-9c9e-d2818bf8e344 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:24.716919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-455de64a-692d-439c-b062-52cd4db5d79d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:06:24.717628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-455de64a-692d-439c-b062-52cd4db5d79d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:06:24.718516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-455de64a-692d-439c-b062-52cd4db5d79d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:06:24.719151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-455de64a-692d-439c-b062-52cd4db5d79d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:06:24.719755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-455de64a-692d-439c-b062-52cd4db5d79d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:06:24.738010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-455de64a-692d-439c-b062-52cd4db5d79d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:24.738829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-455de64a-692d-439c-b062-52cd4db5d79d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:24.739520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-455de64a-692d-439c-b062-52cd4db5d79d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:24.740669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-455de64a-692d-439c-b062-52cd4db5d79d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:24.741410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-455de64a-692d-439c-b062-52cd4db5d79d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:24.748310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-455de64a-692d-439c-b062-52cd4db5d79d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:24.764680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-455de64a-692d-439c-b062-52cd4db5d79d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Getting quotas for project aed69fb18603408db6f91a05423e3ffb. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:06:24.772116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-455de64a-692d-439c-b062-52cd4db5d79d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Getting quotas for user 9d53762f33554711a9114f273918f2eb and project aed69fb18603408db6f91a05423e3ffb. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:06:24.790967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-455de64a-692d-439c-b062-52cd4db5d79d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:06:24.793375 n-d-862964-3 devstack@n-api.service[121100]: WARNING nova.utils [None req-455de64a-692d-439c-b062-52cd4db5d79d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1269383568 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-126938356 Oct 29 01:06:24.794218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-455de64a-692d-439c-b062-52cd4db5d79d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:06:24.951019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-95917e14-32b5-4edb-9c9e-d2818bf8e344 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:24.963599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-95917e14-32b5-4edb-9c9e-d2818bf8e344 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:24.965460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-95917e14-32b5-4edb-9c9e-d2818bf8e344 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:24.965995 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-455de64a-692d-439c-b062-52cd4db5d79d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.987060 Oct 29 01:06:24.967142 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-95917e14-32b5-4edb-9c9e-d2818bf8e344 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1558 microversion: 2.25 time: 0.370503 Oct 29 01:06:24.981922 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 333/656] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:06:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:06:24.982437 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 324/657] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:24 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1558 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:24.989016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-effb1b42-bca4-4e0f-94d6-99c7876e7b80 tempest-DeleteServersAdminTestJSON-910484707 tempest-DeleteServersAdminTestJSON-910484707-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:24.998093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-effb1b42-bca4-4e0f-94d6-99c7876e7b80 tempest-DeleteServersAdminTestJSON-910484707 tempest-DeleteServersAdminTestJSON-910484707-project-admin] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:25.013029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ed8d16c8-1df7-4342-a349-1f9b3536c673 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:25.015712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ed8d16c8-1df7-4342-a349-1f9b3536c673 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:25.016815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-effb1b42-bca4-4e0f-94d6-99c7876e7b80 tempest-DeleteServersAdminTestJSON-910484707 tempest-DeleteServersAdminTestJSON-910484707-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:25.019208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-effb1b42-bca4-4e0f-94d6-99c7876e7b80 tempest-DeleteServersAdminTestJSON-910484707 tempest-DeleteServersAdminTestJSON-910484707-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:25.019884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-effb1b42-bca4-4e0f-94d6-99c7876e7b80 tempest-DeleteServersAdminTestJSON-910484707 tempest-DeleteServersAdminTestJSON-910484707-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:25.023084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-effb1b42-bca4-4e0f-94d6-99c7876e7b80 tempest-DeleteServersAdminTestJSON-910484707 tempest-DeleteServersAdminTestJSON-910484707-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:25.023734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-effb1b42-bca4-4e0f-94d6-99c7876e7b80 tempest-DeleteServersAdminTestJSON-910484707 tempest-DeleteServersAdminTestJSON-910484707-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:25.026655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-effb1b42-bca4-4e0f-94d6-99c7876e7b80 tempest-DeleteServersAdminTestJSON-910484707 tempest-DeleteServersAdminTestJSON-910484707-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:25.056241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed8d16c8-1df7-4342-a349-1f9b3536c673 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:25.061423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed8d16c8-1df7-4342-a349-1f9b3536c673 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:25.062596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed8d16c8-1df7-4342-a349-1f9b3536c673 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:25.064356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed8d16c8-1df7-4342-a349-1f9b3536c673 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:25.066996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed8d16c8-1df7-4342-a349-1f9b3536c673 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:25.069303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed8d16c8-1df7-4342-a349-1f9b3536c673 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:25.283347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ed8d16c8-1df7-4342-a349-1f9b3536c673 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:25.296067 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ed8d16c8-1df7-4342-a349-1f9b3536c673 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1212 microversion: 2.1 time: 0.312223 Oct 29 01:06:25.298647 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 325/658] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:24 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1212 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:25.311396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9e5a07c4-b20f-4539-995f-a96cec8168a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:25.311396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9e5a07c4-b20f-4539-995f-a96cec8168a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:25.336888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e5a07c4-b20f-4539-995f-a96cec8168a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:25.341031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e5a07c4-b20f-4539-995f-a96cec8168a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:25.341031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e5a07c4-b20f-4539-995f-a96cec8168a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:25.341031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e5a07c4-b20f-4539-995f-a96cec8168a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:25.341031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e5a07c4-b20f-4539-995f-a96cec8168a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:25.341452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e5a07c4-b20f-4539-995f-a96cec8168a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:25.515142 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-effb1b42-bca4-4e0f-94d6-99c7876e7b80 tempest-DeleteServersAdminTestJSON-910484707 tempest-DeleteServersAdminTestJSON-910484707-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92/action" status: 202 len: 0 microversion: 2.1 time: 0.533705 Oct 29 01:06:25.515970 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 334/659] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:06:24 2022] POST /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:06:25.523325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-3787fb45-67bc-4806-9c0e-d7a062af4d8d req-a8446b8a-f10c-4b11-9eda-770db34b0fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65c62cb3-ec7c-43fa-9840-1c0fef87ae15", "name": "network-vif-plugged", "status": "completed", "tag": "edbb0f10-da6d-409d-8978-de8280afa7df"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:25.549333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3787fb45-67bc-4806-9c0e-d7a062af4d8d req-a8446b8a-f10c-4b11-9eda-770db34b0fcc service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:25.552350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3787fb45-67bc-4806-9c0e-d7a062af4d8d req-a8446b8a-f10c-4b11-9eda-770db34b0fcc service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:25.553132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3787fb45-67bc-4806-9c0e-d7a062af4d8d req-a8446b8a-f10c-4b11-9eda-770db34b0fcc service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:25.579383 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-3787fb45-67bc-4806-9c0e-d7a062af4d8d req-a8446b8a-f10c-4b11-9eda-770db34b0fcc service nova] Creating event network-vif-plugged:edbb0f10-da6d-409d-8978-de8280afa7df for instance 65c62cb3-ec7c-43fa-9840-1c0fef87ae15 on n-h2-862964-3 Oct 29 01:06:25.583721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9e5a07c4-b20f-4539-995f-a96cec8168a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:25.592394 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-3787fb45-67bc-4806-9c0e-d7a062af4d8d req-a8446b8a-f10c-4b11-9eda-770db34b0fcc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071841 Oct 29 01:06:25.592718 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9e5a07c4-b20f-4539-995f-a96cec8168a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1312 microversion: 2.1 time: 0.291380 Oct 29 01:06:25.593477 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 335/660] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:25.602024 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 326/661] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:25 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1312 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:25.608511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4ef49d1f-ec90-46a5-af32-5b27c0c3c074 tempest-SecurityGroupsTestAdminJSON-1855060058 tempest-SecurityGroupsTestAdminJSON-1855060058-project-admin] Calling method '.version_select at 0x7f9d9c2301f0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:25.613645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fac9fd5c-e8c3-4323-ad07-ef425ce439a2 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:25.614479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fac9fd5c-e8c3-4323-ad07-ef425ce439a2 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:25.621463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fac9fd5c-e8c3-4323-ad07-ef425ce439a2 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:25.622152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fac9fd5c-e8c3-4323-ad07-ef425ce439a2 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:25.622780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fac9fd5c-e8c3-4323-ad07-ef425ce439a2 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:25.623656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fac9fd5c-e8c3-4323-ad07-ef425ce439a2 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:25.624267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fac9fd5c-e8c3-4323-ad07-ef425ce439a2 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:25.624849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fac9fd5c-e8c3-4323-ad07-ef425ce439a2 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:25.975111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fac9fd5c-e8c3-4323-ad07-ef425ce439a2 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:25.995548 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fac9fd5c-e8c3-4323-ad07-ef425ce439a2 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1389 microversion: 2.1 time: 0.389063 Oct 29 01:06:26.013420 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 327/662] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:25 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1389 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:26.016868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ce9f8b46-11f4-48c7-9e39-ac6e68fdcdcf tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:26.017971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ce9f8b46-11f4-48c7-9e39-ac6e68fdcdcf tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:26.144974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ce9f8b46-11f4-48c7-9e39-ac6e68fdcdcf tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d53762f33554711a9114f273918f2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed69fb18603408db6f91a05423e3ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:26.156530 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ce9f8b46-11f4-48c7-9e39-ac6e68fdcdcf tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85" status: 200 len: 1232 microversion: 2.1 time: 0.154854 Oct 29 01:06:26.157135 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 328/663] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:25 2022] GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85 => generated 1232 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:26.177400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb722f01-7dd7-4bc0-a7ed-425c1c80a4e8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:26.178441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bb722f01-7dd7-4bc0-a7ed-425c1c80a4e8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:26.188344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb722f01-7dd7-4bc0-a7ed-425c1c80a4e8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:26.188848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb722f01-7dd7-4bc0-a7ed-425c1c80a4e8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:26.189497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb722f01-7dd7-4bc0-a7ed-425c1c80a4e8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:26.197685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb722f01-7dd7-4bc0-a7ed-425c1c80a4e8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:26.198165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb722f01-7dd7-4bc0-a7ed-425c1c80a4e8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:26.198607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb722f01-7dd7-4bc0-a7ed-425c1c80a4e8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:26.469886 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4ef49d1f-ec90-46a5-af32-5b27c0c3c074 tempest-SecurityGroupsTestAdminJSON-1855060058 tempest-SecurityGroupsTestAdminJSON-1855060058-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/88aa2a67-db04-4b9b-ae2d-624dbcd01464" status: 202 len: 0 microversion: 2.1 time: 0.873975 Oct 29 01:06:26.471184 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 336/664] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:06:25 2022] DELETE /compute/v2.1/os-security-groups/88aa2a67-db04-4b9b-ae2d-624dbcd01464 => generated 0 bytes in 877 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:06:26.479353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-edc6714c-b25c-44c4-abd9-dfb7a4c1cc2f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:26.480366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-edc6714c-b25c-44c4-abd9-dfb7a4c1cc2f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:26.487819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edc6714c-b25c-44c4-abd9-dfb7a4c1cc2f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:26.489113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edc6714c-b25c-44c4-abd9-dfb7a4c1cc2f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:26.489775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edc6714c-b25c-44c4-abd9-dfb7a4c1cc2f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:26.490692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edc6714c-b25c-44c4-abd9-dfb7a4c1cc2f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:26.491799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edc6714c-b25c-44c4-abd9-dfb7a4c1cc2f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:26.492416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edc6714c-b25c-44c4-abd9-dfb7a4c1cc2f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:26.534765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edc6714c-b25c-44c4-abd9-dfb7a4c1cc2f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:26.535605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edc6714c-b25c-44c4-abd9-dfb7a4c1cc2f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:26.536486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edc6714c-b25c-44c4-abd9-dfb7a4c1cc2f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:26.537319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-edc6714c-b25c-44c4-abd9-dfb7a4c1cc2f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lazy-loading 'fault' on Instance uuid 057a3c07-ea05-4f36-9178-5bd7ab180e92 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:06:26.769066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-bb722f01-7dd7-4bc0-a7ed-425c1c80a4e8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'services' on Instance uuid 9a6eeec1-f116-41ea-b5ed-c20d0d37114a {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:06:26.788618 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bb722f01-7dd7-4bc0-a7ed-425c1c80a4e8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 2051 microversion: 2.25 time: 0.630008 Oct 29 01:06:26.789481 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 329/665] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:26 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 2051 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:26.794628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-0bc74962-fad6-4037-bc0a-bedbe1d031c9 req-e857ad49-1143-49aa-8f3b-0444d2dca5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80c528e3-4bf5-4d61-aaa8-581168f42c7b", "tag": "a52a9942-a3d5-4dcb-a096-9f922211cccc"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:26.807363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-0bc74962-fad6-4037-bc0a-bedbe1d031c9 req-e857ad49-1143-49aa-8f3b-0444d2dca5b0 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:26.816695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-0bc74962-fad6-4037-bc0a-bedbe1d031c9 req-e857ad49-1143-49aa-8f3b-0444d2dca5b0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:26.816695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-0bc74962-fad6-4037-bc0a-bedbe1d031c9 req-e857ad49-1143-49aa-8f3b-0444d2dca5b0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:26.824455 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-0bc74962-fad6-4037-bc0a-bedbe1d031c9 req-e857ad49-1143-49aa-8f3b-0444d2dca5b0 service nova] Creating event network-changed:a52a9942-a3d5-4dcb-a096-9f922211cccc for instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b on n-h1-862964-3 Oct 29 01:06:26.834640 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-0bc74962-fad6-4037-bc0a-bedbe1d031c9 req-e857ad49-1143-49aa-8f3b-0444d2dca5b0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043197 Oct 29 01:06:26.835889 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 330/666] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:26.842021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-26094ba3-23eb-4d41-9b06-8095a1c83c3a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:26.843631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-26094ba3-23eb-4d41-9b06-8095a1c83c3a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:26.850929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26094ba3-23eb-4d41-9b06-8095a1c83c3a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:26.851700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26094ba3-23eb-4d41-9b06-8095a1c83c3a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:26.852291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26094ba3-23eb-4d41-9b06-8095a1c83c3a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:26.856868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26094ba3-23eb-4d41-9b06-8095a1c83c3a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:26.856868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26094ba3-23eb-4d41-9b06-8095a1c83c3a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:26.856868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26094ba3-23eb-4d41-9b06-8095a1c83c3a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:27.018077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-26094ba3-23eb-4d41-9b06-8095a1c83c3a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:27.036452 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-26094ba3-23eb-4d41-9b06-8095a1c83c3a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1286 microversion: 2.1 time: 0.196843 Oct 29 01:06:27.037095 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 331/667] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:26 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1286 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:27.073274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80d08eb4-0efe-42fc-ae7f-45d2dd1b6e79 tempest-SecurityGroupsTestAdminJSON-1091469773 tempest-SecurityGroupsTestAdminJSON-1091469773-project] Calling method '.version_select at 0x7f9d9c109d30>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:27.084769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-edc6714c-b25c-44c4-abd9-dfb7a4c1cc2f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:27.093764 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-edc6714c-b25c-44c4-abd9-dfb7a4c1cc2f tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 200 len: 1452 microversion: 2.1 time: 0.620655 Oct 29 01:06:27.105802 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 337/668] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:26 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 1452 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:27.112702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-594c2cd1-28a8-4583-8acd-bdc0748003c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:27.113730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-594c2cd1-28a8-4583-8acd-bdc0748003c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:27.132143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-594c2cd1-28a8-4583-8acd-bdc0748003c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:27.132647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-594c2cd1-28a8-4583-8acd-bdc0748003c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:27.133056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-594c2cd1-28a8-4583-8acd-bdc0748003c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:27.133791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-594c2cd1-28a8-4583-8acd-bdc0748003c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:27.134242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-594c2cd1-28a8-4583-8acd-bdc0748003c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:27.134661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-594c2cd1-28a8-4583-8acd-bdc0748003c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:27.475804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-594c2cd1-28a8-4583-8acd-bdc0748003c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:27.484141 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-594c2cd1-28a8-4583-8acd-bdc0748003c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1312 microversion: 2.1 time: 0.377135 Oct 29 01:06:27.484921 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 338/669] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:27 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1312 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:27.505324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e4e9ea6f-c56a-4c64-a5b3-06d2437f798c tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:27.505324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e4e9ea6f-c56a-4c64-a5b3-06d2437f798c tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:27.513200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4e9ea6f-c56a-4c64-a5b3-06d2437f798c tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:27.513725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4e9ea6f-c56a-4c64-a5b3-06d2437f798c tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:27.514203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4e9ea6f-c56a-4c64-a5b3-06d2437f798c tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:27.518020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4e9ea6f-c56a-4c64-a5b3-06d2437f798c tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:27.518020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4e9ea6f-c56a-4c64-a5b3-06d2437f798c tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:27.518020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4e9ea6f-c56a-4c64-a5b3-06d2437f798c tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:27.519381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:28.100551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-e4e9ea6f-c56a-4c64-a5b3-06d2437f798c tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'services' on Instance uuid 9a6eeec1-f116-41ea-b5ed-c20d0d37114a {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:06:28.163222 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-80d08eb4-0efe-42fc-ae7f-45d2dd1b6e79 tempest-SecurityGroupsTestAdminJSON-1091469773 tempest-SecurityGroupsTestAdminJSON-1091469773-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/42359da3-a13d-4ad2-9a9d-f610b39de7be" status: 202 len: 0 microversion: 2.1 time: 1.122611 Oct 29 01:06:28.164406 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 332/670] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:06:27 2022] DELETE /compute/v2.1/os-security-groups/42359da3-a13d-4ad2-9a9d-f610b39de7be => generated 0 bytes in 1127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:06:28.172095 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e4e9ea6f-c56a-4c64-a5b3-06d2437f798c tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 2051 microversion: 2.25 time: 0.679823 Oct 29 01:06:28.176882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1a21eeca-16e7-45f5-b981-ca50fc1979ba tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:28.180248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1a21eeca-16e7-45f5-b981-ca50fc1979ba tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:28.186031 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 339/671] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:27 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 2051 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:28.189356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a21eeca-16e7-45f5-b981-ca50fc1979ba tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:28.191422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a21eeca-16e7-45f5-b981-ca50fc1979ba tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:28.192883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a21eeca-16e7-45f5-b981-ca50fc1979ba tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:28.194935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a21eeca-16e7-45f5-b981-ca50fc1979ba tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:28.195580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a21eeca-16e7-45f5-b981-ca50fc1979ba tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:28.196555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a21eeca-16e7-45f5-b981-ca50fc1979ba tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:28.196664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-44cc604f-ebce-46a7-ac30-e27057c5c52d tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:28.197037 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-44cc604f-ebce-46a7-ac30-e27057c5c52d tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:28.214571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44cc604f-ebce-46a7-ac30-e27057c5c52d tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:28.215150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44cc604f-ebce-46a7-ac30-e27057c5c52d tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:28.215709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44cc604f-ebce-46a7-ac30-e27057c5c52d tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:28.216588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44cc604f-ebce-46a7-ac30-e27057c5c52d tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:28.217352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44cc604f-ebce-46a7-ac30-e27057c5c52d tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:28.217880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44cc604f-ebce-46a7-ac30-e27057c5c52d tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:28.301446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-44cc604f-ebce-46a7-ac30-e27057c5c52d tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:06:28.540307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1a21eeca-16e7-45f5-b981-ca50fc1979ba tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:28.567103 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1a21eeca-16e7-45f5-b981-ca50fc1979ba tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1389 microversion: 2.1 time: 0.394095 Oct 29 01:06:28.570527 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 333/672] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:28 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1389 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:28.589766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0db793ee-67f6-4054-a3a5-47243afe896a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:28.591862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0db793ee-67f6-4054-a3a5-47243afe896a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:28.604723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0db793ee-67f6-4054-a3a5-47243afe896a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:28.606239 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0db793ee-67f6-4054-a3a5-47243afe896a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:28.606948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0db793ee-67f6-4054-a3a5-47243afe896a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:28.615302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0db793ee-67f6-4054-a3a5-47243afe896a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:28.615302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0db793ee-67f6-4054-a3a5-47243afe896a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:28.616188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0db793ee-67f6-4054-a3a5-47243afe896a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:28.678454 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-44cc604f-ebce-46a7-ac30-e27057c5c52d tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "DELETE /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 204 len: 0 microversion: 2.1 time: 0.487561 Oct 29 01:06:28.678454 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 340/673] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:06:28 2022] DELETE /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:06:28.683049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-88c70a69-c7f9-499e-97fa-c48fbd5e2660 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:28.685787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-88c70a69-c7f9-499e-97fa-c48fbd5e2660 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:28.721802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88c70a69-c7f9-499e-97fa-c48fbd5e2660 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:28.722576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88c70a69-c7f9-499e-97fa-c48fbd5e2660 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:28.722738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88c70a69-c7f9-499e-97fa-c48fbd5e2660 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:28.729765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88c70a69-c7f9-499e-97fa-c48fbd5e2660 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:28.735930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88c70a69-c7f9-499e-97fa-c48fbd5e2660 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:28.739982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88c70a69-c7f9-499e-97fa-c48fbd5e2660 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:28.901049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0db793ee-67f6-4054-a3a5-47243afe896a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d53762f33554711a9114f273918f2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed69fb18603408db6f91a05423e3ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:28.926374 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0db793ee-67f6-4054-a3a5-47243afe896a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85" status: 200 len: 1284 microversion: 2.1 time: 0.357196 Oct 29 01:06:28.930356 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 334/674] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:28 2022] GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85 => generated 1284 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:28.945896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-122cb55d-ae48-4279-9f8e-24762bafc89d tempest-SecurityGroupsTestAdminJSON-1091469773 tempest-SecurityGroupsTestAdminJSON-1091469773-project] Calling method '.version_select at 0x7f9d97ec71f0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:29.135541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-88c70a69-c7f9-499e-97fa-c48fbd5e2660 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:29.143175 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-88c70a69-c7f9-499e-97fa-c48fbd5e2660 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1316 microversion: 2.1 time: 0.465439 Oct 29 01:06:29.144287 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 341/675] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:28 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:29.153109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5a2278ce-ef33-4f44-8cd5-ec9e386b9fec tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:29.165317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a2278ce-ef33-4f44-8cd5-ec9e386b9fec tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:29.165827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a2278ce-ef33-4f44-8cd5-ec9e386b9fec tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:29.166273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a2278ce-ef33-4f44-8cd5-ec9e386b9fec tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:29.167026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a2278ce-ef33-4f44-8cd5-ec9e386b9fec tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:29.167485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a2278ce-ef33-4f44-8cd5-ec9e386b9fec tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:29.167930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a2278ce-ef33-4f44-8cd5-ec9e386b9fec tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:29.230194 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5a2278ce-ef33-4f44-8cd5-ec9e386b9fec tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.084824 Oct 29 01:06:29.240892 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 342/676] 10.222.0.26 () {60 vars in 1217 bytes} [Sat Oct 29 01:06:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:06:29.248741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c9f7ffe-d696-496b-b2d3-d87bbbf05528 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:29.254325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9c9f7ffe-d696-496b-b2d3-d87bbbf05528 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:29.262852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9f7ffe-d696-496b-b2d3-d87bbbf05528 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:29.263347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9f7ffe-d696-496b-b2d3-d87bbbf05528 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:29.263781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9f7ffe-d696-496b-b2d3-d87bbbf05528 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:29.264677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9f7ffe-d696-496b-b2d3-d87bbbf05528 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:29.265513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9f7ffe-d696-496b-b2d3-d87bbbf05528 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:29.265958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9f7ffe-d696-496b-b2d3-d87bbbf05528 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:29.407264 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-122cb55d-ae48-4279-9f8e-24762bafc89d tempest-SecurityGroupsTestAdminJSON-1091469773 tempest-SecurityGroupsTestAdminJSON-1091469773-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/eb3365bd-9fcd-4fcb-9595-04a33adbf659" status: 202 len: 0 microversion: 2.1 time: 0.475402 Oct 29 01:06:29.408198 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 335/677] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:06:28 2022] DELETE /compute/v2.1/os-security-groups/eb3365bd-9fcd-4fcb-9595-04a33adbf659 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:06:29.434741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb0436d0-3bab-4896-93f3-ccf5bb38c6fc tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:29.438418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bb0436d0-3bab-4896-93f3-ccf5bb38c6fc tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:29.458144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb0436d0-3bab-4896-93f3-ccf5bb38c6fc tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:29.463088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb0436d0-3bab-4896-93f3-ccf5bb38c6fc tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:29.464083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb0436d0-3bab-4896-93f3-ccf5bb38c6fc tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:29.465436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb0436d0-3bab-4896-93f3-ccf5bb38c6fc tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:29.466824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb0436d0-3bab-4896-93f3-ccf5bb38c6fc tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:29.467911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb0436d0-3bab-4896-93f3-ccf5bb38c6fc tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:29.522386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb0436d0-3bab-4896-93f3-ccf5bb38c6fc tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:29.523301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb0436d0-3bab-4896-93f3-ccf5bb38c6fc tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:29.524071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb0436d0-3bab-4896-93f3-ccf5bb38c6fc tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:29.524882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-bb0436d0-3bab-4896-93f3-ccf5bb38c6fc tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lazy-loading 'fault' on Instance uuid 057a3c07-ea05-4f36-9178-5bd7ab180e92 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:06:29.717203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9c9f7ffe-d696-496b-b2d3-d87bbbf05528 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:29.750958 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9c9f7ffe-d696-496b-b2d3-d87bbbf05528 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1462 microversion: 2.1 time: 0.504278 Oct 29 01:06:29.754988 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 343/678] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:29 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1462 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:29.765266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ec77b984-5705-487f-a222-3dfe6066b310 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:29.776077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ec77b984-5705-487f-a222-3dfe6066b310 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:29.789214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec77b984-5705-487f-a222-3dfe6066b310 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:29.789964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec77b984-5705-487f-a222-3dfe6066b310 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:29.791557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec77b984-5705-487f-a222-3dfe6066b310 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:29.793686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec77b984-5705-487f-a222-3dfe6066b310 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:29.794392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec77b984-5705-487f-a222-3dfe6066b310 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:29.795034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec77b984-5705-487f-a222-3dfe6066b310 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:29.831383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bb0436d0-3bab-4896-93f3-ccf5bb38c6fc tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:29.841852 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bb0436d0-3bab-4896-93f3-ccf5bb38c6fc tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 200 len: 1458 microversion: 2.1 time: 0.431620 Oct 29 01:06:29.845935 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 336/679] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:29 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 1458 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:29.865220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-26cb2682-d207-42a9-93b6-6d116c5f304b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:29.866664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-26cb2682-d207-42a9-93b6-6d116c5f304b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:29.883687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26cb2682-d207-42a9-93b6-6d116c5f304b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:29.892180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26cb2682-d207-42a9-93b6-6d116c5f304b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:29.896014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26cb2682-d207-42a9-93b6-6d116c5f304b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:29.897809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26cb2682-d207-42a9-93b6-6d116c5f304b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:29.899730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26cb2682-d207-42a9-93b6-6d116c5f304b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:29.900237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26cb2682-d207-42a9-93b6-6d116c5f304b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:30.138729 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ec77b984-5705-487f-a222-3dfe6066b310 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a/action" status: 202 len: 0 microversion: 2.25 time: 0.381760 Oct 29 01:06:30.140399 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 344/680] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 29 01:06:29 2022] POST /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:06:30.162446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-26cb2682-d207-42a9-93b6-6d116c5f304b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:30.171290 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-26cb2682-d207-42a9-93b6-6d116c5f304b tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1389 microversion: 2.1 time: 0.323023 Oct 29 01:06:30.172136 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 337/681] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:29 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1389 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:30.177493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d44c7688-f9b5-46f9-b7e0-26bd94aa3214 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:30.178266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d44c7688-f9b5-46f9-b7e0-26bd94aa3214 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:30.184727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d44c7688-f9b5-46f9-b7e0-26bd94aa3214 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:30.185518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d44c7688-f9b5-46f9-b7e0-26bd94aa3214 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:30.186185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d44c7688-f9b5-46f9-b7e0-26bd94aa3214 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:30.187158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d44c7688-f9b5-46f9-b7e0-26bd94aa3214 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:30.187803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d44c7688-f9b5-46f9-b7e0-26bd94aa3214 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:30.188432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d44c7688-f9b5-46f9-b7e0-26bd94aa3214 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:30.291278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d44c7688-f9b5-46f9-b7e0-26bd94aa3214 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d53762f33554711a9114f273918f2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed69fb18603408db6f91a05423e3ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:30.303281 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d44c7688-f9b5-46f9-b7e0-26bd94aa3214 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85" status: 200 len: 1290 microversion: 2.1 time: 0.129771 Oct 29 01:06:30.314806 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 338/682] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:30 2022] GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85 => generated 1290 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:30.331691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d808302c-667e-4b7b-a312-c41dc698a374 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:30.333038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d808302c-667e-4b7b-a312-c41dc698a374 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:30.355892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d808302c-667e-4b7b-a312-c41dc698a374 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:30.357832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d808302c-667e-4b7b-a312-c41dc698a374 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:30.358940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d808302c-667e-4b7b-a312-c41dc698a374 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:30.367070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d808302c-667e-4b7b-a312-c41dc698a374 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:30.368154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d808302c-667e-4b7b-a312-c41dc698a374 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:30.369803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d808302c-667e-4b7b-a312-c41dc698a374 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:30.383226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:30.519795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c796ad58-c9e1-49d5-8f02-362e1b9cdcd3 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:30.520701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c796ad58-c9e1-49d5-8f02-362e1b9cdcd3 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:30.536677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c796ad58-c9e1-49d5-8f02-362e1b9cdcd3 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:30.537214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c796ad58-c9e1-49d5-8f02-362e1b9cdcd3 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:30.537659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c796ad58-c9e1-49d5-8f02-362e1b9cdcd3 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:30.538947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c796ad58-c9e1-49d5-8f02-362e1b9cdcd3 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:30.539413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c796ad58-c9e1-49d5-8f02-362e1b9cdcd3 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:30.539834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c796ad58-c9e1-49d5-8f02-362e1b9cdcd3 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:30.744618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-d808302c-667e-4b7b-a312-c41dc698a374 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'services' on Instance uuid 9a6eeec1-f116-41ea-b5ed-c20d0d37114a {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:06:30.782663 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d808302c-667e-4b7b-a312-c41dc698a374 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 2056 microversion: 2.25 time: 0.465611 Oct 29 01:06:30.783700 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 339/683] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:30 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 2056 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:30.804608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c10dde70-a654-4ff8-abfa-b4ff8ef0dda6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:30.805574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c10dde70-a654-4ff8-abfa-b4ff8ef0dda6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:30.813188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c10dde70-a654-4ff8-abfa-b4ff8ef0dda6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:30.813852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c10dde70-a654-4ff8-abfa-b4ff8ef0dda6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:30.822543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c10dde70-a654-4ff8-abfa-b4ff8ef0dda6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:30.822543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c10dde70-a654-4ff8-abfa-b4ff8ef0dda6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:30.822543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c10dde70-a654-4ff8-abfa-b4ff8ef0dda6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:30.822543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c10dde70-a654-4ff8-abfa-b4ff8ef0dda6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:31.179107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c10dde70-a654-4ff8-abfa-b4ff8ef0dda6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:31.187472 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c10dde70-a654-4ff8-abfa-b4ff8ef0dda6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1316 microversion: 2.1 time: 0.402633 Oct 29 01:06:31.188349 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 340/684] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:30 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1316 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:31.201252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a83bc653-61f4-4914-86e7-205652195fe2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:31.202115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a83bc653-61f4-4914-86e7-205652195fe2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:31.208834 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83bc653-61f4-4914-86e7-205652195fe2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:31.211969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83bc653-61f4-4914-86e7-205652195fe2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:31.212640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83bc653-61f4-4914-86e7-205652195fe2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:31.213438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83bc653-61f4-4914-86e7-205652195fe2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:31.213895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83bc653-61f4-4914-86e7-205652195fe2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:31.214331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83bc653-61f4-4914-86e7-205652195fe2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:31.249544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83bc653-61f4-4914-86e7-205652195fe2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:31.249951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83bc653-61f4-4914-86e7-205652195fe2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:31.250438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a83bc653-61f4-4914-86e7-205652195fe2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:31.250895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-a83bc653-61f4-4914-86e7-205652195fe2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lazy-loading 'fault' on Instance uuid 057a3c07-ea05-4f36-9178-5bd7ab180e92 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:06:31.663812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a83bc653-61f4-4914-86e7-205652195fe2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:31.683662 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a83bc653-61f4-4914-86e7-205652195fe2 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 200 len: 1458 microversion: 2.1 time: 0.493342 Oct 29 01:06:31.697245 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 341/685] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:31 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 1458 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:31.703693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8ecf1f92-e986-4d86-9798-6b53dff3edfe tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:31.703693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8ecf1f92-e986-4d86-9798-6b53dff3edfe tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:31.720885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ecf1f92-e986-4d86-9798-6b53dff3edfe tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:31.724022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ecf1f92-e986-4d86-9798-6b53dff3edfe tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:31.724493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ecf1f92-e986-4d86-9798-6b53dff3edfe tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:31.725261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ecf1f92-e986-4d86-9798-6b53dff3edfe tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:31.727308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ecf1f92-e986-4d86-9798-6b53dff3edfe tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:31.728889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ecf1f92-e986-4d86-9798-6b53dff3edfe tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:31.823095 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c796ad58-c9e1-49d5-8f02-362e1b9cdcd3 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1613 microversion: 2.1 time: 1.674297 Oct 29 01:06:31.823095 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 345/686] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:30 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1613 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:31.826530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-edd243fa-12d2-4747-b594-26521d99296d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:31.827140 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-edd243fa-12d2-4747-b594-26521d99296d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:31.842025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edd243fa-12d2-4747-b594-26521d99296d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:31.842816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edd243fa-12d2-4747-b594-26521d99296d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:31.843430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edd243fa-12d2-4747-b594-26521d99296d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:31.844297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edd243fa-12d2-4747-b594-26521d99296d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:31.844911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edd243fa-12d2-4747-b594-26521d99296d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:31.850031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edd243fa-12d2-4747-b594-26521d99296d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:32.289171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8ecf1f92-e986-4d86-9798-6b53dff3edfe tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:32.310042 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8ecf1f92-e986-4d86-9798-6b53dff3edfe tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1389 microversion: 2.1 time: 0.620103 Oct 29 01:06:32.313386 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 342/687] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:31 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1389 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:32.319996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fc76856d-d89d-4cda-960e-830accdfd893 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:32.321381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fc76856d-d89d-4cda-960e-830accdfd893 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:32.323902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:32.330088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc76856d-d89d-4cda-960e-830accdfd893 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:32.331407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc76856d-d89d-4cda-960e-830accdfd893 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:32.333004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc76856d-d89d-4cda-960e-830accdfd893 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:32.333983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc76856d-d89d-4cda-960e-830accdfd893 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:32.334650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc76856d-d89d-4cda-960e-830accdfd893 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:32.336155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc76856d-d89d-4cda-960e-830accdfd893 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:32.381692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-edd243fa-12d2-4747-b594-26521d99296d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d53762f33554711a9114f273918f2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed69fb18603408db6f91a05423e3ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:32.392949 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-edd243fa-12d2-4747-b594-26521d99296d tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85" status: 200 len: 1332 microversion: 2.1 time: 0.570043 Oct 29 01:06:32.394697 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 346/688] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:31 2022] GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85 => generated 1332 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:32.426215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5640f678-ba63-4c31-8650-72416063629c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:32.430959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5640f678-ba63-4c31-8650-72416063629c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:32.449199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5640f678-ba63-4c31-8650-72416063629c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:32.449697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5640f678-ba63-4c31-8650-72416063629c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:32.454038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5640f678-ba63-4c31-8650-72416063629c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:32.454789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5640f678-ba63-4c31-8650-72416063629c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:32.455257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5640f678-ba63-4c31-8650-72416063629c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:32.455685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5640f678-ba63-4c31-8650-72416063629c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:32.657098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5640f678-ba63-4c31-8650-72416063629c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '697b41dede9e4b13bee4388eeea17e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e269112846c4a24a4b95af97ad0a362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:32.662592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5640f678-ba63-4c31-8650-72416063629c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] flavor_id is None. Assuming migration. {{(pid=121100) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 29 01:06:32.662592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5640f678-ba63-4c31-8650-72416063629c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121100) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 01:06:32.849494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:33.060202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-fc76856d-d89d-4cda-960e-830accdfd893 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'services' on Instance uuid 9a6eeec1-f116-41ea-b5ed-c20d0d37114a {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:06:33.102518 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fc76856d-d89d-4cda-960e-830accdfd893 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 2056 microversion: 2.25 time: 0.785683 Oct 29 01:06:33.103895 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 343/689] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:32 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 2056 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:33.109956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ac137b90-2dff-4d8b-8042-b131d71723d2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:33.116396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ac137b90-2dff-4d8b-8042-b131d71723d2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:33.131188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac137b90-2dff-4d8b-8042-b131d71723d2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:33.131188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac137b90-2dff-4d8b-8042-b131d71723d2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:33.131188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac137b90-2dff-4d8b-8042-b131d71723d2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:33.131948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac137b90-2dff-4d8b-8042-b131d71723d2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:33.132587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac137b90-2dff-4d8b-8042-b131d71723d2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:33.133290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac137b90-2dff-4d8b-8042-b131d71723d2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:33.192900 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5640f678-ba63-4c31-8650-72416063629c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15/action" status: 202 len: 0 microversion: 2.1 time: 0.793136 Oct 29 01:06:33.194804 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 347/690] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:06:32 2022] POST /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15/action => generated 0 bytes in 799 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:06:33.211866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5cea754f-c66c-4969-a52a-da1c12a5bf1e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:33.212860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5cea754f-c66c-4969-a52a-da1c12a5bf1e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:33.246181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cea754f-c66c-4969-a52a-da1c12a5bf1e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:33.247032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cea754f-c66c-4969-a52a-da1c12a5bf1e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:33.248654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cea754f-c66c-4969-a52a-da1c12a5bf1e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:33.252299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cea754f-c66c-4969-a52a-da1c12a5bf1e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:33.254255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cea754f-c66c-4969-a52a-da1c12a5bf1e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:33.258071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cea754f-c66c-4969-a52a-da1c12a5bf1e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:33.642775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cea754f-c66c-4969-a52a-da1c12a5bf1e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:33.644378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cea754f-c66c-4969-a52a-da1c12a5bf1e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:33.644996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cea754f-c66c-4969-a52a-da1c12a5bf1e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:33.645660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-5cea754f-c66c-4969-a52a-da1c12a5bf1e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lazy-loading 'fault' on Instance uuid 057a3c07-ea05-4f36-9178-5bd7ab180e92 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:06:33.693557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ac137b90-2dff-4d8b-8042-b131d71723d2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:33.705053 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ac137b90-2dff-4d8b-8042-b131d71723d2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1316 microversion: 2.1 time: 0.599370 Oct 29 01:06:33.711836 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 344/691] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:33 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1316 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:33.728504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1618fe04-ffd0-4406-a666-aa17b08e674e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:33.729617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1618fe04-ffd0-4406-a666-aa17b08e674e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:33.751139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1618fe04-ffd0-4406-a666-aa17b08e674e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:33.752094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1618fe04-ffd0-4406-a666-aa17b08e674e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:33.756146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1618fe04-ffd0-4406-a666-aa17b08e674e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:33.757868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1618fe04-ffd0-4406-a666-aa17b08e674e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:33.758567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1618fe04-ffd0-4406-a666-aa17b08e674e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:33.759494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1618fe04-ffd0-4406-a666-aa17b08e674e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:34.273806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5cea754f-c66c-4969-a52a-da1c12a5bf1e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:34.294305 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5cea754f-c66c-4969-a52a-da1c12a5bf1e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 200 len: 1416 microversion: 2.1 time: 1.097907 Oct 29 01:06:34.317479 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 348/692] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:33 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 1416 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:34.324936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-be6bb65a-cd65-49cf-934a-5f660b54e7b8 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:34.325785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-be6bb65a-cd65-49cf-934a-5f660b54e7b8 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:34.335812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be6bb65a-cd65-49cf-934a-5f660b54e7b8 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:34.336601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be6bb65a-cd65-49cf-934a-5f660b54e7b8 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:34.337885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be6bb65a-cd65-49cf-934a-5f660b54e7b8 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:34.338855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be6bb65a-cd65-49cf-934a-5f660b54e7b8 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:34.339823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be6bb65a-cd65-49cf-934a-5f660b54e7b8 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:34.341199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be6bb65a-cd65-49cf-934a-5f660b54e7b8 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:34.430585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1618fe04-ffd0-4406-a666-aa17b08e674e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:34.440267 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1618fe04-ffd0-4406-a666-aa17b08e674e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1471 microversion: 2.1 time: 0.724987 Oct 29 01:06:34.441703 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 345/693] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:33 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1471 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:34.446774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-74d592ba-a81b-40d4-aecc-ec55dca91db8 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:34.447612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-74d592ba-a81b-40d4-aecc-ec55dca91db8 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:34.453746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74d592ba-a81b-40d4-aecc-ec55dca91db8 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:34.454906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74d592ba-a81b-40d4-aecc-ec55dca91db8 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:34.455539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74d592ba-a81b-40d4-aecc-ec55dca91db8 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:34.456972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74d592ba-a81b-40d4-aecc-ec55dca91db8 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:34.460574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74d592ba-a81b-40d4-aecc-ec55dca91db8 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:34.461019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74d592ba-a81b-40d4-aecc-ec55dca91db8 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:34.658555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-be6bb65a-cd65-49cf-934a-5f660b54e7b8 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:34.691950 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-be6bb65a-cd65-49cf-934a-5f660b54e7b8 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1389 microversion: 2.1 time: 0.359254 Oct 29 01:06:34.691950 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 349/694] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:34 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1389 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:34.709626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-c74952ca-4191-4ce0-8e29-1c857f232bd7 req-70b49328-e32e-40e8-b892-f3549e064b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057a3c07-ea05-4f36-9178-5bd7ab180e92", "name": "network-vif-deleted", "tag": "6daf4ba8-989a-4e18-adfd-8659f76c37d1"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:34.742393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c74952ca-4191-4ce0-8e29-1c857f232bd7 req-70b49328-e32e-40e8-b892-f3549e064b5e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:34.743478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c74952ca-4191-4ce0-8e29-1c857f232bd7 req-70b49328-e32e-40e8-b892-f3549e064b5e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:34.743917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c74952ca-4191-4ce0-8e29-1c857f232bd7 req-70b49328-e32e-40e8-b892-f3549e064b5e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:34.769585 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-c74952ca-4191-4ce0-8e29-1c857f232bd7 req-70b49328-e32e-40e8-b892-f3549e064b5e service nova] Creating event network-vif-deleted:6daf4ba8-989a-4e18-adfd-8659f76c37d1 for instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 on n-h1-862964-3 Oct 29 01:06:34.774869 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-c74952ca-4191-4ce0-8e29-1c857f232bd7 req-70b49328-e32e-40e8-b892-f3549e064b5e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093675 Oct 29 01:06:34.775766 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 350/695] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:34.781935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2d6b37ca-5002-4e53-9469-a20ec27b0e40 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:34.782786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2d6b37ca-5002-4e53-9469-a20ec27b0e40 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:34.802026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:34.804585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d6b37ca-5002-4e53-9469-a20ec27b0e40 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:34.805195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d6b37ca-5002-4e53-9469-a20ec27b0e40 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:34.805860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d6b37ca-5002-4e53-9469-a20ec27b0e40 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:34.807703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d6b37ca-5002-4e53-9469-a20ec27b0e40 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:34.808449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d6b37ca-5002-4e53-9469-a20ec27b0e40 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:34.808983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d6b37ca-5002-4e53-9469-a20ec27b0e40 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:35.155842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-2d6b37ca-5002-4e53-9469-a20ec27b0e40 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'services' on Instance uuid 9a6eeec1-f116-41ea-b5ed-c20d0d37114a {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:06:35.159969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:35.193190 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2d6b37ca-5002-4e53-9469-a20ec27b0e40 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 2036 microversion: 2.25 time: 0.415619 Oct 29 01:06:35.193834 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 351/696] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:34 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 2036 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:35.219918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-96ce2d62-da47-4025-acf2-73769324a473 req-65600f2b-8f5e-4115-b191-d8c9b9f4dab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c770e759-7e36-4f04-b6f9-12435bce6ff6", "tag": "7d5d77a6-2cec-4f2d-b47a-4fb74c833658"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:35.241097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-96ce2d62-da47-4025-acf2-73769324a473 req-65600f2b-8f5e-4115-b191-d8c9b9f4dab0 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:35.243332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-96ce2d62-da47-4025-acf2-73769324a473 req-65600f2b-8f5e-4115-b191-d8c9b9f4dab0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:35.244457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-96ce2d62-da47-4025-acf2-73769324a473 req-65600f2b-8f5e-4115-b191-d8c9b9f4dab0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:35.263748 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-96ce2d62-da47-4025-acf2-73769324a473 req-65600f2b-8f5e-4115-b191-d8c9b9f4dab0 service nova] Creating event network-changed:7d5d77a6-2cec-4f2d-b47a-4fb74c833658 for instance c770e759-7e36-4f04-b6f9-12435bce6ff6 on n-h1-862964-3 Oct 29 01:06:35.270261 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-96ce2d62-da47-4025-acf2-73769324a473 req-65600f2b-8f5e-4115-b191-d8c9b9f4dab0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059378 Oct 29 01:06:35.271911 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 352/697] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:35.277876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-000386df-be00-4500-9f41-8e523f8deee9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:35.279355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-000386df-be00-4500-9f41-8e523f8deee9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:35.286922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-000386df-be00-4500-9f41-8e523f8deee9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:35.287899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-000386df-be00-4500-9f41-8e523f8deee9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:35.289255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-000386df-be00-4500-9f41-8e523f8deee9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:35.290367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-000386df-be00-4500-9f41-8e523f8deee9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:35.291031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-000386df-be00-4500-9f41-8e523f8deee9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:35.291675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-000386df-be00-4500-9f41-8e523f8deee9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:35.594770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-74d592ba-a81b-40d4-aecc-ec55dca91db8 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d53762f33554711a9114f273918f2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed69fb18603408db6f91a05423e3ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:35.604479 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-74d592ba-a81b-40d4-aecc-ec55dca91db8 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85" status: 200 len: 1332 microversion: 2.1 time: 1.160522 Oct 29 01:06:35.622200 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 346/698] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:34 2022] GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85 => generated 1332 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:35.633289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-000386df-be00-4500-9f41-8e523f8deee9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:35.633795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4f22c70a-c8bd-45df-a67e-44ff286e8334 req-754f38d0-0e7b-4b47-af0a-cfc3fb7a992a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c528e3-4bf5-4d61-aaa8-581168f42c7b", "name": "network-vif-plugged", "status": "completed", "tag": "a52a9942-a3d5-4dcb-a096-9f922211cccc"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:35.641848 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-000386df-be00-4500-9f41-8e523f8deee9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1316 microversion: 2.1 time: 0.367905 Oct 29 01:06:35.649450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4f22c70a-c8bd-45df-a67e-44ff286e8334 req-754f38d0-0e7b-4b47-af0a-cfc3fb7a992a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:35.650243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4f22c70a-c8bd-45df-a67e-44ff286e8334 req-754f38d0-0e7b-4b47-af0a-cfc3fb7a992a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:35.650937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4f22c70a-c8bd-45df-a67e-44ff286e8334 req-754f38d0-0e7b-4b47-af0a-cfc3fb7a992a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:35.657752 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 353/699] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:35 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:35.665387 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4f22c70a-c8bd-45df-a67e-44ff286e8334 req-754f38d0-0e7b-4b47-af0a-cfc3fb7a992a service nova] Creating event network-vif-plugged:a52a9942-a3d5-4dcb-a096-9f922211cccc for instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b on n-h1-862964-3 Oct 29 01:06:35.671837 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4f22c70a-c8bd-45df-a67e-44ff286e8334 req-754f38d0-0e7b-4b47-af0a-cfc3fb7a992a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047930 Oct 29 01:06:35.673288 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 347/700] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:35.681801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-44e7cf12-cba4-432d-91db-af4ad7552550 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:35.682906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-44e7cf12-cba4-432d-91db-af4ad7552550 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:35.683324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ae0aa544-3aa4-4a2b-8a3f-12838d909514 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862964-3", "block_migration": "auto"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:35.685786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ae0aa544-3aa4-4a2b-8a3f-12838d909514 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:35.691004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44e7cf12-cba4-432d-91db-af4ad7552550 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:35.692423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44e7cf12-cba4-432d-91db-af4ad7552550 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:35.696304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44e7cf12-cba4-432d-91db-af4ad7552550 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:35.696304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44e7cf12-cba4-432d-91db-af4ad7552550 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:35.696304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44e7cf12-cba4-432d-91db-af4ad7552550 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:35.696304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44e7cf12-cba4-432d-91db-af4ad7552550 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:35.727356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae0aa544-3aa4-4a2b-8a3f-12838d909514 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:35.731051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae0aa544-3aa4-4a2b-8a3f-12838d909514 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:35.734230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae0aa544-3aa4-4a2b-8a3f-12838d909514 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:35.738908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae0aa544-3aa4-4a2b-8a3f-12838d909514 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:35.739612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae0aa544-3aa4-4a2b-8a3f-12838d909514 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:35.740056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae0aa544-3aa4-4a2b-8a3f-12838d909514 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:35.798759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44e7cf12-cba4-432d-91db-af4ad7552550 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:35.801516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44e7cf12-cba4-432d-91db-af4ad7552550 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:35.806614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44e7cf12-cba4-432d-91db-af4ad7552550 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:35.807306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-44e7cf12-cba4-432d-91db-af4ad7552550 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lazy-loading 'fault' on Instance uuid 057a3c07-ea05-4f36-9178-5bd7ab180e92 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:06:35.808297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-ae0aa544-3aa4-4a2b-8a3f-12838d909514 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'flavor' on Instance uuid 9a6eeec1-f116-41ea-b5ed-c20d0d37114a {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:06:35.858386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ae0aa544-3aa4-4a2b-8a3f-12838d909514 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Going to try to live migrate instance to n-h2-862964-3 {{(pid=121100) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 01:06:35.929749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-44e7cf12-cba4-432d-91db-af4ad7552550 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c2ae31500e4a59a468e0362a9c75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53e974fb417481e99277df8d9bf81d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:35.940379 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-44e7cf12-cba4-432d-91db-af4ad7552550 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 200 len: 1310 microversion: 2.1 time: 0.263307 Oct 29 01:06:35.943230 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 348/701] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:35 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 1310 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:35.965853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ba984047-1e3e-4194-99c9-174c1f001cb9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:35.967771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ba984047-1e3e-4194-99c9-174c1f001cb9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:35.980629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba984047-1e3e-4194-99c9-174c1f001cb9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:35.981298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba984047-1e3e-4194-99c9-174c1f001cb9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:35.981913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba984047-1e3e-4194-99c9-174c1f001cb9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:35.982778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba984047-1e3e-4194-99c9-174c1f001cb9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:35.983384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba984047-1e3e-4194-99c9-174c1f001cb9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:35.983958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba984047-1e3e-4194-99c9-174c1f001cb9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:36.149148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=16 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:36.239576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ba984047-1e3e-4194-99c9-174c1f001cb9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:36.266529 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ba984047-1e3e-4194-99c9-174c1f001cb9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1471 microversion: 2.1 time: 0.321626 Oct 29 01:06:36.269065 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 349/702] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:35 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1471 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:36.276936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f5e06d7a-2d23-4527-995f-52a0e3e4d7a1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:36.277880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f5e06d7a-2d23-4527-995f-52a0e3e4d7a1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:36.297093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5e06d7a-2d23-4527-995f-52a0e3e4d7a1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:36.297276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5e06d7a-2d23-4527-995f-52a0e3e4d7a1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:36.297636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5e06d7a-2d23-4527-995f-52a0e3e4d7a1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:36.298377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5e06d7a-2d23-4527-995f-52a0e3e4d7a1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:36.298806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5e06d7a-2d23-4527-995f-52a0e3e4d7a1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:36.299235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5e06d7a-2d23-4527-995f-52a0e3e4d7a1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:36.580782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f5e06d7a-2d23-4527-995f-52a0e3e4d7a1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:36.598198 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f5e06d7a-2d23-4527-995f-52a0e3e4d7a1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1389 microversion: 2.1 time: 0.325006 Oct 29 01:06:36.601117 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 350/703] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:36 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1389 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:36.812907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-41061d0f-69d2-47a6-ba9b-7d911cd35e76 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-519799806", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:36.896215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-41061d0f-69d2-47a6-ba9b-7d911cd35e76 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] validate_networks() for None {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:06:37.200585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-41061d0f-69d2-47a6-ba9b-7d911cd35e76 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:06:37.201079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-41061d0f-69d2-47a6-ba9b-7d911cd35e76 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:06:37.201942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-41061d0f-69d2-47a6-ba9b-7d911cd35e76 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:06:37.202422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-41061d0f-69d2-47a6-ba9b-7d911cd35e76 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:06:37.202920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-41061d0f-69d2-47a6-ba9b-7d911cd35e76 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:06:37.226692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41061d0f-69d2-47a6-ba9b-7d911cd35e76 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:37.227188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41061d0f-69d2-47a6-ba9b-7d911cd35e76 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:37.227632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41061d0f-69d2-47a6-ba9b-7d911cd35e76 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:37.228407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41061d0f-69d2-47a6-ba9b-7d911cd35e76 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:37.228879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41061d0f-69d2-47a6-ba9b-7d911cd35e76 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:37.229336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41061d0f-69d2-47a6-ba9b-7d911cd35e76 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:37.255244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-41061d0f-69d2-47a6-ba9b-7d911cd35e76 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Getting quotas for project 361ee1c7ea6a43258240e801fb45f440. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:06:37.260700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-41061d0f-69d2-47a6-ba9b-7d911cd35e76 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Getting quotas for user f1d4ceb600214ce2a80d48a0cd53a548 and project 361ee1c7ea6a43258240e801fb45f440. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:06:37.278358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-41061d0f-69d2-47a6-ba9b-7d911cd35e76 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:06:37.281032 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-41061d0f-69d2-47a6-ba9b-7d911cd35e76 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:06:37.442386 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-41061d0f-69d2-47a6-ba9b-7d911cd35e76 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838525 Oct 29 01:06:37.450412 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 351/704] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:06:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:06:37.455638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-96b63f84-6466-47de-84c3-ff2f9b8aeaf6 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:37.457332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-96b63f84-6466-47de-84c3-ff2f9b8aeaf6 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:37.478206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96b63f84-6466-47de-84c3-ff2f9b8aeaf6 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:37.478919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96b63f84-6466-47de-84c3-ff2f9b8aeaf6 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:37.479906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96b63f84-6466-47de-84c3-ff2f9b8aeaf6 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:37.481682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96b63f84-6466-47de-84c3-ff2f9b8aeaf6 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:37.482354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96b63f84-6466-47de-84c3-ff2f9b8aeaf6 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:37.482985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96b63f84-6466-47de-84c3-ff2f9b8aeaf6 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:37.705179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-96b63f84-6466-47de-84c3-ff2f9b8aeaf6 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d53762f33554711a9114f273918f2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed69fb18603408db6f91a05423e3ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:37.721326 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-96b63f84-6466-47de-84c3-ff2f9b8aeaf6 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85" status: 200 len: 1332 microversion: 2.1 time: 0.269424 Oct 29 01:06:37.722590 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 352/705] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:37 2022] GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85 => generated 1332 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:37.728075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f26c25a-6ef7-419c-b45b-792cdab1ae04 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:37.728851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1f26c25a-6ef7-419c-b45b-792cdab1ae04 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:37.735474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f26c25a-6ef7-419c-b45b-792cdab1ae04 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:37.736202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f26c25a-6ef7-419c-b45b-792cdab1ae04 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:37.736637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f26c25a-6ef7-419c-b45b-792cdab1ae04 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:37.737602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f26c25a-6ef7-419c-b45b-792cdab1ae04 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:37.738173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f26c25a-6ef7-419c-b45b-792cdab1ae04 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:37.738710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f26c25a-6ef7-419c-b45b-792cdab1ae04 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:37.901908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1f26c25a-6ef7-419c-b45b-792cdab1ae04 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:37.914291 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1f26c25a-6ef7-419c-b45b-792cdab1ae04 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1316 microversion: 2.1 time: 0.190550 Oct 29 01:06:37.915836 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 353/706] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:37 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1316 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:37.921121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-62642164-97c0-4a0d-8dd3-ae7b7a7612e8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:37.922072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-62642164-97c0-4a0d-8dd3-ae7b7a7612e8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:37.931059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62642164-97c0-4a0d-8dd3-ae7b7a7612e8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:37.931926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62642164-97c0-4a0d-8dd3-ae7b7a7612e8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:37.932764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62642164-97c0-4a0d-8dd3-ae7b7a7612e8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:37.933743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62642164-97c0-4a0d-8dd3-ae7b7a7612e8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:37.934368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62642164-97c0-4a0d-8dd3-ae7b7a7612e8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:37.935204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62642164-97c0-4a0d-8dd3-ae7b7a7612e8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:37.954860 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-62642164-97c0-4a0d-8dd3-ae7b7a7612e8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] HTTP exception thrown: Instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 could not be found. Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-62642164-97c0-4a0d-8dd3-ae7b7a7612e8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Request method failure captured: Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 HTTP/1.1 Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHw-agme2hOY9hJItOb-jRkZqRFjxwSwen5Lgo3CiWDEwaG--xFK5DBOsyUwoQV2_Ld1s7QZq0tzoQqlgI-GjP_Cj4VnBcpkJqIUHnlql8eyf9hi3ylpPALP3BIRUNTLyDnxolPYiDh-bBrbDtq1j8ITVfUqynuQOxlCdCpVYV5o3Tw Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f53e974fb417481e99277df8d9bf81d5 Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2121225012 Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:06:37.957238 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:06:37.958975 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53e974fb417481e99277df8d9bf81d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f53e974fb417481e99277df8d9bf81d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53e974fb417481e99277df8d9bf81d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f53e974fb417481e99277df8d9bf81d5", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:06:37.958975 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersAdminTestJSON-2121225012 Oct 29 01:06:37.958975 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f53e974fb417481e99277df8d9bf81d5 Oct 29 01:06:37.958975 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2121225012 Oct 29 01:06:37.958975 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersAdminTestJSON-2121225012-project Oct 29 01:06:37.958975 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:06:37.958975 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:06:37.958975 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f5c2ae31500e4a59a468e0362a9c75d2 Oct 29 01:06:37.958975 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersAdminTestJSON-2121225012-project Oct 29 01:06:37.958975 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:06:37.958975 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 could not be found. Oct 29 01:06:37.958975 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '057a3c07-ea05-4f36-9178-5bd7ab180e92'} Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 could not be found. Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:06:37.960003 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:06:37.961566 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:06:37.961566 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:06:37.961566 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:06:37.961566 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:06:37.961566 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:06:37.961566 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:06:37.961566 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:06:37.961566 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 could not be found. Oct 29 01:06:37.961566 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:37.961566 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:06:37.961566 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:37.961566 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:06:37.961566 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:06:37.961566 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:06:37.961566 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:06:37.961566 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:06:37.961566 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 could not be found. Oct 29 01:06:37.961566 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:37.962985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-62642164-97c0-4a0d-8dd3-ae7b7a7612e8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Returning 404 to user: Instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:06:37.962985 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-62642164-97c0-4a0d-8dd3-ae7b7a7612e8 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 404 len: 111 microversion: 2.1 time: 0.041594 Oct 29 01:06:37.962985 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 354/707] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:37 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:06:37.972444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d53bf00d-8058-4b63-85e0-4dd3b94900ba tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:37.973063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d53bf00d-8058-4b63-85e0-4dd3b94900ba tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:37.979527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d53bf00d-8058-4b63-85e0-4dd3b94900ba tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:37.980082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d53bf00d-8058-4b63-85e0-4dd3b94900ba tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:37.980689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d53bf00d-8058-4b63-85e0-4dd3b94900ba tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:37.982134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d53bf00d-8058-4b63-85e0-4dd3b94900ba tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:37.982134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d53bf00d-8058-4b63-85e0-4dd3b94900ba tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:37.982427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d53bf00d-8058-4b63-85e0-4dd3b94900ba tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:38.156924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d53bf00d-8058-4b63-85e0-4dd3b94900ba tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:38.168101 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d53bf00d-8058-4b63-85e0-4dd3b94900ba tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1471 microversion: 2.1 time: 0.201769 Oct 29 01:06:38.168768 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 355/708] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:37 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1471 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:38.173413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-9c3a622b-76a1-488d-aaf2-31d67f14c367 req-c3c5baee-1454-4a97-bc64-5626a24db39f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ee6daec-1cf6-45be-943c-20749b8d7d85", "tag": "8dcc0733-0f1e-41cd-9fc2-f9f371fc1086"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:38.187622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9c3a622b-76a1-488d-aaf2-31d67f14c367 req-c3c5baee-1454-4a97-bc64-5626a24db39f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:38.188357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9c3a622b-76a1-488d-aaf2-31d67f14c367 req-c3c5baee-1454-4a97-bc64-5626a24db39f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:38.188948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9c3a622b-76a1-488d-aaf2-31d67f14c367 req-c3c5baee-1454-4a97-bc64-5626a24db39f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:38.201658 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-9c3a622b-76a1-488d-aaf2-31d67f14c367 req-c3c5baee-1454-4a97-bc64-5626a24db39f service nova] Creating event network-changed:8dcc0733-0f1e-41cd-9fc2-f9f371fc1086 for instance 5ee6daec-1cf6-45be-943c-20749b8d7d85 on n-h2-862964-3 Oct 29 01:06:38.211032 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-9c3a622b-76a1-488d-aaf2-31d67f14c367 req-c3c5baee-1454-4a97-bc64-5626a24db39f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040849 Oct 29 01:06:38.211955 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 356/709] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:38.218459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3f7a45a9-19d8-49d2-b356-b4015322bd47 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:38.219356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3f7a45a9-19d8-49d2-b356-b4015322bd47 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:38.288047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3f7a45a9-19d8-49d2-b356-b4015322bd47 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:38.304052 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3f7a45a9-19d8-49d2-b356-b4015322bd47 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 200 len: 1222 microversion: 2.1 time: 0.089981 Oct 29 01:06:38.305814 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 357/710] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:38 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:38.316266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-db6b0726-9e4f-4935-899b-6e43d972dd74 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:38.317825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-db6b0726-9e4f-4935-899b-6e43d972dd74 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:38.330032 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db6b0726-9e4f-4935-899b-6e43d972dd74 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:38.332116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db6b0726-9e4f-4935-899b-6e43d972dd74 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:38.333641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db6b0726-9e4f-4935-899b-6e43d972dd74 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:38.335288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db6b0726-9e4f-4935-899b-6e43d972dd74 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:38.336449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db6b0726-9e4f-4935-899b-6e43d972dd74 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:38.338399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db6b0726-9e4f-4935-899b-6e43d972dd74 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:38.350157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:38.526809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-db6b0726-9e4f-4935-899b-6e43d972dd74 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:38.546233 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-db6b0726-9e4f-4935-899b-6e43d972dd74 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1389 microversion: 2.1 time: 0.238589 Oct 29 01:06:38.546835 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 358/711] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:38 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1389 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:38.551622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb9c101b-adbe-4234-91f3-a587362971f7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:38.552142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bb9c101b-adbe-4234-91f3-a587362971f7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:38.558494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb9c101b-adbe-4234-91f3-a587362971f7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:38.558992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb9c101b-adbe-4234-91f3-a587362971f7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:38.559435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb9c101b-adbe-4234-91f3-a587362971f7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:38.560153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb9c101b-adbe-4234-91f3-a587362971f7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:38.560616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb9c101b-adbe-4234-91f3-a587362971f7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:38.561038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb9c101b-adbe-4234-91f3-a587362971f7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:38.578001 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-bb9c101b-adbe-4234-91f3-a587362971f7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] HTTP exception thrown: Instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 could not be found. Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb9c101b-adbe-4234-91f3-a587362971f7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Request method failure captured: Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 HTTP/1.1 Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHw-agme2hOY9hJItOb-jRkZqRFjxwSwen5Lgo3CiWDEwaG--xFK5DBOsyUwoQV2_Ld1s7QZq0tzoQqlgI-GjP_Cj4VnBcpkJqIUHnlql8eyf9hi3ylpPALP3BIRUNTLyDnxolPYiDh-bBrbDtq1j8ITVfUqynuQOxlCdCpVYV5o3Tw Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f53e974fb417481e99277df8d9bf81d5 Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2121225012 Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:06:38.579801 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:06:38.582059 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53e974fb417481e99277df8d9bf81d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f53e974fb417481e99277df8d9bf81d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53e974fb417481e99277df8d9bf81d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f53e974fb417481e99277df8d9bf81d5", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:06:38.582059 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersAdminTestJSON-2121225012 Oct 29 01:06:38.582059 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f53e974fb417481e99277df8d9bf81d5 Oct 29 01:06:38.582059 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2121225012 Oct 29 01:06:38.582059 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersAdminTestJSON-2121225012-project Oct 29 01:06:38.582059 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:06:38.582059 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:06:38.582059 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f5c2ae31500e4a59a468e0362a9c75d2 Oct 29 01:06:38.582059 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersAdminTestJSON-2121225012-project Oct 29 01:06:38.582059 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:06:38.582059 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 could not be found. Oct 29 01:06:38.582059 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '057a3c07-ea05-4f36-9178-5bd7ab180e92'} Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 could not be found. Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:06:38.582960 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 could not be found. Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 could not be found. Oct 29 01:06:38.584280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.587779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb9c101b-adbe-4234-91f3-a587362971f7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Returning 404 to user: Instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:06:38.587779 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bb9c101b-adbe-4234-91f3-a587362971f7 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "DELETE /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 404 len: 111 microversion: 2.1 time: 0.034148 Oct 29 01:06:38.587779 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 359/712] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:06:38 2022] DELETE /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:06:38.591150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-07e9e124-491f-4d1d-9f1a-b39ba7609cf5 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:38.591779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-07e9e124-491f-4d1d-9f1a-b39ba7609cf5 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: 057a3c07-ea05-4f36-9178-5bd7ab180e92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:38.598479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07e9e124-491f-4d1d-9f1a-b39ba7609cf5 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:38.599005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07e9e124-491f-4d1d-9f1a-b39ba7609cf5 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:38.599450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07e9e124-491f-4d1d-9f1a-b39ba7609cf5 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:38.600910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07e9e124-491f-4d1d-9f1a-b39ba7609cf5 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:38.601797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07e9e124-491f-4d1d-9f1a-b39ba7609cf5 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:38.602547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07e9e124-491f-4d1d-9f1a-b39ba7609cf5 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:38.619598 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-07e9e124-491f-4d1d-9f1a-b39ba7609cf5 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] HTTP exception thrown: Instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 could not be found. Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-07e9e124-491f-4d1d-9f1a-b39ba7609cf5 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Request method failure captured: Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 HTTP/1.1 Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHw-agme2hOY9hJItOb-jRkZqRFjxwSwen5Lgo3CiWDEwaG--xFK5DBOsyUwoQV2_Ld1s7QZq0tzoQqlgI-GjP_Cj4VnBcpkJqIUHnlql8eyf9hi3ylpPALP3BIRUNTLyDnxolPYiDh-bBrbDtq1j8ITVfUqynuQOxlCdCpVYV5o3Tw Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f53e974fb417481e99277df8d9bf81d5 Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2121225012 Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:06:38.621145 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:06:38.622520 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53e974fb417481e99277df8d9bf81d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f53e974fb417481e99277df8d9bf81d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53e974fb417481e99277df8d9bf81d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f53e974fb417481e99277df8d9bf81d5", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:06:38.622520 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersAdminTestJSON-2121225012 Oct 29 01:06:38.622520 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f53e974fb417481e99277df8d9bf81d5 Oct 29 01:06:38.622520 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2121225012 Oct 29 01:06:38.622520 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersAdminTestJSON-2121225012-project Oct 29 01:06:38.622520 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:06:38.622520 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:06:38.622520 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f5c2ae31500e4a59a468e0362a9c75d2 Oct 29 01:06:38.622520 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersAdminTestJSON-2121225012-project Oct 29 01:06:38.622520 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:06:38.622520 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 could not be found. Oct 29 01:06:38.622520 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '057a3c07-ea05-4f36-9178-5bd7ab180e92'} Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 could not be found. Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:06:38.623246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:06:38.624408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:06:38.624408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:06:38.624408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:06:38.624408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:06:38.624408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:06:38.624408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:06:38.624408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:06:38.624408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 could not be found. Oct 29 01:06:38.624408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.624408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:06:38.624408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.624408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:06:38.624408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:06:38.624408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:06:38.624408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:06:38.624408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:06:38.624408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 could not be found. Oct 29 01:06:38.624408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.626813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-07e9e124-491f-4d1d-9f1a-b39ba7609cf5 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Returning 404 to user: Instance 057a3c07-ea05-4f36-9178-5bd7ab180e92 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:06:38.626813 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-07e9e124-491f-4d1d-9f1a-b39ba7609cf5 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92" status: 404 len: 111 microversion: 2.1 time: 0.035615 Oct 29 01:06:38.626813 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 360/713] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:38 2022] GET /compute/v2.1/servers/057a3c07-ea05-4f36-9178-5bd7ab180e92 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:06:38.635136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1ef9c2bf-66e1-4e22-804d-4e08b51fb922 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:38.635637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1ef9c2bf-66e1-4e22-804d-4e08b51fb922 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:38.641688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ef9c2bf-66e1-4e22-804d-4e08b51fb922 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:38.649365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ef9c2bf-66e1-4e22-804d-4e08b51fb922 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:38.649365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ef9c2bf-66e1-4e22-804d-4e08b51fb922 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:38.649365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ef9c2bf-66e1-4e22-804d-4e08b51fb922 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:38.649365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ef9c2bf-66e1-4e22-804d-4e08b51fb922 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:38.649840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ef9c2bf-66e1-4e22-804d-4e08b51fb922 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:38.662013 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-1ef9c2bf-66e1-4e22-804d-4e08b51fb922 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] HTTP exception thrown: Instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 could not be found. Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1ef9c2bf-66e1-4e22-804d-4e08b51fb922 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Request method failure captured: Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 HTTP/1.1 Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHw-agme2hOY9hJItOb-jRkZqRFjxwSwen5Lgo3CiWDEwaG--xFK5DBOsyUwoQV2_Ld1s7QZq0tzoQqlgI-GjP_Cj4VnBcpkJqIUHnlql8eyf9hi3ylpPALP3BIRUNTLyDnxolPYiDh-bBrbDtq1j8ITVfUqynuQOxlCdCpVYV5o3Tw Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f53e974fb417481e99277df8d9bf81d5 Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2121225012 Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:06:38.663601 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:06:38.665005 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53e974fb417481e99277df8d9bf81d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f53e974fb417481e99277df8d9bf81d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53e974fb417481e99277df8d9bf81d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f53e974fb417481e99277df8d9bf81d5", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:06:38.665005 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersAdminTestJSON-2121225012 Oct 29 01:06:38.665005 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f53e974fb417481e99277df8d9bf81d5 Oct 29 01:06:38.665005 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2121225012 Oct 29 01:06:38.665005 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersAdminTestJSON-2121225012-project Oct 29 01:06:38.665005 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:06:38.665005 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:06:38.665005 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f5c2ae31500e4a59a468e0362a9c75d2 Oct 29 01:06:38.665005 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersAdminTestJSON-2121225012-project Oct 29 01:06:38.665005 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:06:38.665005 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 could not be found. Oct 29 01:06:38.665005 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'bf8015b1-0e50-4db4-9bda-eaad0ad293b3'} Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 could not be found. Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:06:38.665760 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 could not be found. Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 could not be found. Oct 29 01:06:38.667129 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.668314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1ef9c2bf-66e1-4e22-804d-4e08b51fb922 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Returning 404 to user: Instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:06:38.668314 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1ef9c2bf-66e1-4e22-804d-4e08b51fb922 tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 404 len: 111 microversion: 2.1 time: 0.033823 Oct 29 01:06:38.668314 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 361/714] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:06:38 2022] DELETE /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:06:38.673744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-21dad1df-7eb9-4966-b591-e7bf17db714e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:38.674358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-21dad1df-7eb9-4966-b591-e7bf17db714e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] [instance: bf8015b1-0e50-4db4-9bda-eaad0ad293b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:38.680898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21dad1df-7eb9-4966-b591-e7bf17db714e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:38.681431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21dad1df-7eb9-4966-b591-e7bf17db714e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:38.684828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21dad1df-7eb9-4966-b591-e7bf17db714e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:38.684828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21dad1df-7eb9-4966-b591-e7bf17db714e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:38.684828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21dad1df-7eb9-4966-b591-e7bf17db714e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:38.684828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21dad1df-7eb9-4966-b591-e7bf17db714e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:38.705455 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-21dad1df-7eb9-4966-b591-e7bf17db714e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] HTTP exception thrown: Instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 could not be found. Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-21dad1df-7eb9-4966-b591-e7bf17db714e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Request method failure captured: Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 HTTP/1.1 Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHw-agme2hOY9hJItOb-jRkZqRFjxwSwen5Lgo3CiWDEwaG--xFK5DBOsyUwoQV2_Ld1s7QZq0tzoQqlgI-GjP_Cj4VnBcpkJqIUHnlql8eyf9hi3ylpPALP3BIRUNTLyDnxolPYiDh-bBrbDtq1j8ITVfUqynuQOxlCdCpVYV5o3Tw Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f53e974fb417481e99277df8d9bf81d5 Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2121225012 Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:06:38.708065 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:06:38.709416 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53e974fb417481e99277df8d9bf81d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f53e974fb417481e99277df8d9bf81d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53e974fb417481e99277df8d9bf81d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f53e974fb417481e99277df8d9bf81d5", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:06:38.709416 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersAdminTestJSON-2121225012 Oct 29 01:06:38.709416 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f53e974fb417481e99277df8d9bf81d5 Oct 29 01:06:38.709416 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2121225012 Oct 29 01:06:38.709416 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersAdminTestJSON-2121225012-project Oct 29 01:06:38.709416 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:06:38.709416 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:06:38.709416 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f5c2ae31500e4a59a468e0362a9c75d2 Oct 29 01:06:38.709416 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersAdminTestJSON-2121225012-project Oct 29 01:06:38.709416 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:06:38.709416 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 could not be found. Oct 29 01:06:38.709416 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'bf8015b1-0e50-4db4-9bda-eaad0ad293b3'} Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 could not be found. Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:06:38.732335 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:06:38.733984 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:06:38.733984 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:06:38.733984 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:06:38.733984 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:06:38.733984 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:06:38.733984 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:06:38.733984 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:06:38.733984 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 could not be found. Oct 29 01:06:38.733984 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.733984 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:06:38.733984 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.733984 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:06:38.733984 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:06:38.733984 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:06:38.733984 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:06:38.733984 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:06:38.733984 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 could not be found. Oct 29 01:06:38.733984 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:06:38.735227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-21dad1df-7eb9-4966-b591-e7bf17db714e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] Returning 404 to user: Instance bf8015b1-0e50-4db4-9bda-eaad0ad293b3 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:06:38.735227 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-21dad1df-7eb9-4966-b591-e7bf17db714e tempest-DeleteServersAdminTestJSON-2121225012 tempest-DeleteServersAdminTestJSON-2121225012-project] 10.222.0.26 "GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3" status: 404 len: 111 microversion: 2.1 time: 0.039644 Oct 29 01:06:38.735227 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 362/715] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:38 2022] GET /compute/v2.1/servers/bf8015b1-0e50-4db4-9bda-eaad0ad293b3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:06:38.766800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-17ca746a-05b5-476f-8048-e8820d11c845 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:38.786502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-17ca746a-05b5-476f-8048-e8820d11c845 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:38.786502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17ca746a-05b5-476f-8048-e8820d11c845 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:38.786502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17ca746a-05b5-476f-8048-e8820d11c845 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:38.786502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17ca746a-05b5-476f-8048-e8820d11c845 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:38.787162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17ca746a-05b5-476f-8048-e8820d11c845 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:38.787162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17ca746a-05b5-476f-8048-e8820d11c845 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:38.787162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17ca746a-05b5-476f-8048-e8820d11c845 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:38.945545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-17ca746a-05b5-476f-8048-e8820d11c845 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d53762f33554711a9114f273918f2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed69fb18603408db6f91a05423e3ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:38.953435 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-17ca746a-05b5-476f-8048-e8820d11c845 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85" status: 200 len: 1332 microversion: 2.1 time: 0.194645 Oct 29 01:06:38.954185 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 363/716] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:38 2022] GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85 => generated 1332 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:38.961516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5d03392e-a92a-4b3e-a8ec-12081500a115 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:38.961516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5d03392e-a92a-4b3e-a8ec-12081500a115 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:38.965292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d03392e-a92a-4b3e-a8ec-12081500a115 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:38.965786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d03392e-a92a-4b3e-a8ec-12081500a115 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:38.966221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d03392e-a92a-4b3e-a8ec-12081500a115 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:38.966931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d03392e-a92a-4b3e-a8ec-12081500a115 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:38.967914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d03392e-a92a-4b3e-a8ec-12081500a115 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:38.968069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d03392e-a92a-4b3e-a8ec-12081500a115 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:39.153389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5d03392e-a92a-4b3e-a8ec-12081500a115 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:39.162509 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5d03392e-a92a-4b3e-a8ec-12081500a115 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1316 microversion: 2.1 time: 0.207347 Oct 29 01:06:39.163086 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 364/717] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:38 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:39.188307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:39.192714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fffdd62f-bb67-470c-86ee-b3e346a9a955 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:39.193363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fffdd62f-bb67-470c-86ee-b3e346a9a955 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:39.199585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fffdd62f-bb67-470c-86ee-b3e346a9a955 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:39.200070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fffdd62f-bb67-470c-86ee-b3e346a9a955 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:39.200549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fffdd62f-bb67-470c-86ee-b3e346a9a955 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:39.201279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fffdd62f-bb67-470c-86ee-b3e346a9a955 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:39.201723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fffdd62f-bb67-470c-86ee-b3e346a9a955 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:39.202247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fffdd62f-bb67-470c-86ee-b3e346a9a955 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:39.368225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fffdd62f-bb67-470c-86ee-b3e346a9a955 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:39.377030 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fffdd62f-bb67-470c-86ee-b3e346a9a955 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1471 microversion: 2.1 time: 0.189020 Oct 29 01:06:39.385324 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 365/718] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:39 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:06:39.385324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c4fda45e-5957-4d53-b22e-c7326ecce7a6 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:39.385324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c4fda45e-5957-4d53-b22e-c7326ecce7a6 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:39.391055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4fda45e-5957-4d53-b22e-c7326ecce7a6 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:39.391867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4fda45e-5957-4d53-b22e-c7326ecce7a6 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:39.392612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4fda45e-5957-4d53-b22e-c7326ecce7a6 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:39.393812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4fda45e-5957-4d53-b22e-c7326ecce7a6 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:39.394594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4fda45e-5957-4d53-b22e-c7326ecce7a6 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:39.395298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4fda45e-5957-4d53-b22e-c7326ecce7a6 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:39.470050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c4fda45e-5957-4d53-b22e-c7326ecce7a6 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:39.478889 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c4fda45e-5957-4d53-b22e-c7326ecce7a6 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 200 len: 1226 microversion: 2.1 time: 0.100024 Oct 29 01:06:39.482140 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 366/719] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:39 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:39.571211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ff3e08e0-d50b-4228-97c6-884ac383d72e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:39.572205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ff3e08e0-d50b-4228-97c6-884ac383d72e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:39.579841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff3e08e0-d50b-4228-97c6-884ac383d72e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:39.581437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff3e08e0-d50b-4228-97c6-884ac383d72e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:39.585563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff3e08e0-d50b-4228-97c6-884ac383d72e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:39.590870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff3e08e0-d50b-4228-97c6-884ac383d72e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:39.590870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff3e08e0-d50b-4228-97c6-884ac383d72e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:39.590870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff3e08e0-d50b-4228-97c6-884ac383d72e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:39.898035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ff3e08e0-d50b-4228-97c6-884ac383d72e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:39.906698 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ff3e08e0-d50b-4228-97c6-884ac383d72e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1389 microversion: 2.1 time: 0.340158 Oct 29 01:06:39.921437 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 367/720] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:39 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1389 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:06:39.980583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-718d4b12-1445-40bf-8c59-6d4ca72db589 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:39.981178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-718d4b12-1445-40bf-8c59-6d4ca72db589 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:39.994589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-718d4b12-1445-40bf-8c59-6d4ca72db589 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:39.994589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-718d4b12-1445-40bf-8c59-6d4ca72db589 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:39.994589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-718d4b12-1445-40bf-8c59-6d4ca72db589 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:39.995050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-718d4b12-1445-40bf-8c59-6d4ca72db589 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:40.005055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-718d4b12-1445-40bf-8c59-6d4ca72db589 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:40.005897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-718d4b12-1445-40bf-8c59-6d4ca72db589 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:40.326818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-718d4b12-1445-40bf-8c59-6d4ca72db589 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d53762f33554711a9114f273918f2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed69fb18603408db6f91a05423e3ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:40.334926 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-718d4b12-1445-40bf-8c59-6d4ca72db589 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85" status: 200 len: 1332 microversion: 2.1 time: 0.358197 Oct 29 01:06:40.335509 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 368/721] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:39 2022] GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85 => generated 1332 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:40.347996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d1d11998-866f-403c-9aa2-68b59af08bf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:40.348340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d1d11998-866f-403c-9aa2-68b59af08bf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:40.355725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1d11998-866f-403c-9aa2-68b59af08bf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:40.356199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1d11998-866f-403c-9aa2-68b59af08bf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:40.356617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1d11998-866f-403c-9aa2-68b59af08bf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:40.357345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1d11998-866f-403c-9aa2-68b59af08bf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:40.357799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1d11998-866f-403c-9aa2-68b59af08bf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:40.367631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1d11998-866f-403c-9aa2-68b59af08bf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:40.616950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d1d11998-866f-403c-9aa2-68b59af08bf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:40.640856 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d1d11998-866f-403c-9aa2-68b59af08bf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1316 microversion: 2.1 time: 0.303980 Oct 29 01:06:40.658558 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 369/722] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:40 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:40.667187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0ce43c5b-51ae-4863-af81-ef10c63ebde7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:40.667187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0ce43c5b-51ae-4863-af81-ef10c63ebde7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:40.672413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ce43c5b-51ae-4863-af81-ef10c63ebde7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:40.672956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ce43c5b-51ae-4863-af81-ef10c63ebde7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:40.673415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ce43c5b-51ae-4863-af81-ef10c63ebde7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:40.674264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ce43c5b-51ae-4863-af81-ef10c63ebde7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:40.675380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ce43c5b-51ae-4863-af81-ef10c63ebde7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:40.675815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ce43c5b-51ae-4863-af81-ef10c63ebde7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:40.906242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0ce43c5b-51ae-4863-af81-ef10c63ebde7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:40.915183 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0ce43c5b-51ae-4863-af81-ef10c63ebde7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1471 microversion: 2.1 time: 0.254829 Oct 29 01:06:40.915763 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 370/723] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:40 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:40.920290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d6b4fcfe-1014-41ba-844e-dfb0e31d982f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:40.920894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d6b4fcfe-1014-41ba-844e-dfb0e31d982f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:40.927183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b4fcfe-1014-41ba-844e-dfb0e31d982f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:40.927719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b4fcfe-1014-41ba-844e-dfb0e31d982f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:40.928564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b4fcfe-1014-41ba-844e-dfb0e31d982f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:40.929393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b4fcfe-1014-41ba-844e-dfb0e31d982f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:40.929850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b4fcfe-1014-41ba-844e-dfb0e31d982f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:40.930273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b4fcfe-1014-41ba-844e-dfb0e31d982f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:41.042297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d6b4fcfe-1014-41ba-844e-dfb0e31d982f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:41.054626 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d6b4fcfe-1014-41ba-844e-dfb0e31d982f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 200 len: 1218 microversion: 2.1 time: 0.137653 Oct 29 01:06:41.055927 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 371/724] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:40 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:41.257462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d14c335e-9321-4751-8234-176fd588c349 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Action: 'create', calling method: .version_select at 0x7f9d9c157d30>, body: {"keypair": {"name": "tempest-keypair-611727957", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsBz5SpfyGt/4qBy0t99VA7EdCEKtM44GPLGAYYEWdkJbZPx2xGpKZsc6AHMca4MTB9bhp6bWo00Z07lx3YDOUauZbkytTuLUWPwzR7pEeZm1m7hQe2lTG8juF9IkXFVA=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:41.281018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-d14c335e-9321-4751-8234-176fd588c349 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Getting quotas for project 471e99f2826f4133a5cd65c2962c0406. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:06:41.287442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-d14c335e-9321-4751-8234-176fd588c349 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Getting quotas for user cf36c8bc01ea4fb7b1bd4e93b91e9e1e and project 471e99f2826f4133a5cd65c2962c0406. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:06:41.397374 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d14c335e-9321-4751-8234-176fd588c349 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.340168 Oct 29 01:06:41.403919 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 372/725] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:06:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:41.413569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-22d86636-a081-4362-802c-929d270bdd7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:41.414185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-22d86636-a081-4362-802c-929d270bdd7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:41.427226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22d86636-a081-4362-802c-929d270bdd7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:41.439992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22d86636-a081-4362-802c-929d270bdd7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:41.439992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22d86636-a081-4362-802c-929d270bdd7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:41.439992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22d86636-a081-4362-802c-929d270bdd7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:41.441123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22d86636-a081-4362-802c-929d270bdd7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:41.441123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22d86636-a081-4362-802c-929d270bdd7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:41.683802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-22d86636-a081-4362-802c-929d270bdd7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:41.698533 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-22d86636-a081-4362-802c-929d270bdd7d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1585 microversion: 2.1 time: 0.299178 Oct 29 01:06:41.699460 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 373/726] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:41 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1585 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:41.711564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-61577686-9643-4673-9ebb-e76e0960e892 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:41.714455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-61577686-9643-4673-9ebb-e76e0960e892 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:41.733784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61577686-9643-4673-9ebb-e76e0960e892 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:41.734279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61577686-9643-4673-9ebb-e76e0960e892 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:41.734720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61577686-9643-4673-9ebb-e76e0960e892 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:41.735596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61577686-9643-4673-9ebb-e76e0960e892 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:41.736056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61577686-9643-4673-9ebb-e76e0960e892 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:41.736486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61577686-9643-4673-9ebb-e76e0960e892 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:41.960500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-61577686-9643-4673-9ebb-e76e0960e892 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d53762f33554711a9114f273918f2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed69fb18603408db6f91a05423e3ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:41.978538 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-61577686-9643-4673-9ebb-e76e0960e892 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85" status: 200 len: 1332 microversion: 2.1 time: 0.277338 Oct 29 01:06:41.981228 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 374/727] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:41 2022] GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85 => generated 1332 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:42.009835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8895c6a3-7de9-43c9-a88b-6c702b007298 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:42.013076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8895c6a3-7de9-43c9-a88b-6c702b007298 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:42.037623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8895c6a3-7de9-43c9-a88b-6c702b007298 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:42.038130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8895c6a3-7de9-43c9-a88b-6c702b007298 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:42.038581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8895c6a3-7de9-43c9-a88b-6c702b007298 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:42.039399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8895c6a3-7de9-43c9-a88b-6c702b007298 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:42.040742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8895c6a3-7de9-43c9-a88b-6c702b007298 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:42.041206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8895c6a3-7de9-43c9-a88b-6c702b007298 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:42.493395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8895c6a3-7de9-43c9-a88b-6c702b007298 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:42.508279 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8895c6a3-7de9-43c9-a88b-6c702b007298 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1316 microversion: 2.1 time: 0.525707 Oct 29 01:06:42.510234 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 375/728] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:41 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1316 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:42.518990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3b94d8e9-ac8b-4a9c-a0b7-637e45719b01 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:42.524173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3b94d8e9-ac8b-4a9c-a0b7-637e45719b01 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:42.536371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b94d8e9-ac8b-4a9c-a0b7-637e45719b01 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:42.537127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b94d8e9-ac8b-4a9c-a0b7-637e45719b01 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:42.537662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b94d8e9-ac8b-4a9c-a0b7-637e45719b01 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:42.538624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b94d8e9-ac8b-4a9c-a0b7-637e45719b01 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:42.539253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b94d8e9-ac8b-4a9c-a0b7-637e45719b01 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:42.539845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b94d8e9-ac8b-4a9c-a0b7-637e45719b01 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:42.763932 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3b94d8e9-ac8b-4a9c-a0b7-637e45719b01 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.252350 Oct 29 01:06:42.764990 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 376/729] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:06:42 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b/os-interface => generated 284 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:42.771755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5bf9da58-aa76-4184-bae5-d3686bf530c2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:42.772789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5bf9da58-aa76-4184-bae5-d3686bf530c2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:42.779846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bf9da58-aa76-4184-bae5-d3686bf530c2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:42.780667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bf9da58-aa76-4184-bae5-d3686bf530c2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:42.781434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bf9da58-aa76-4184-bae5-d3686bf530c2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:42.782310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bf9da58-aa76-4184-bae5-d3686bf530c2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:42.782957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bf9da58-aa76-4184-bae5-d3686bf530c2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:42.783592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bf9da58-aa76-4184-bae5-d3686bf530c2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:43.209783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5bf9da58-aa76-4184-bae5-d3686bf530c2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:43.240647 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5bf9da58-aa76-4184-bae5-d3686bf530c2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1476 microversion: 2.1 time: 0.474297 Oct 29 01:06:43.255370 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 377/730] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:42 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1476 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:43.270083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-efc3670f-d045-44a1-8357-c0ec5e73c512 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:43.270878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-efc3670f-d045-44a1-8357-c0ec5e73c512 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:43.280661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efc3670f-d045-44a1-8357-c0ec5e73c512 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:43.283115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efc3670f-d045-44a1-8357-c0ec5e73c512 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:43.284533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efc3670f-d045-44a1-8357-c0ec5e73c512 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:43.285553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efc3670f-d045-44a1-8357-c0ec5e73c512 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:43.288383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efc3670f-d045-44a1-8357-c0ec5e73c512 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:43.289248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efc3670f-d045-44a1-8357-c0ec5e73c512 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:43.441536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-efc3670f-d045-44a1-8357-c0ec5e73c512 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:43.444251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:43.451435 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-efc3670f-d045-44a1-8357-c0ec5e73c512 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 200 len: 1280 microversion: 2.1 time: 0.194022 Oct 29 01:06:43.452024 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 378/731] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:43 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 1280 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:43.457602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9863a668-af61-4474-a7db-bcc78da47e4e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:43.458210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9863a668-af61-4474-a7db-bcc78da47e4e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:43.459997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:43.465192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9863a668-af61-4474-a7db-bcc78da47e4e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:43.465869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9863a668-af61-4474-a7db-bcc78da47e4e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:43.477599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9863a668-af61-4474-a7db-bcc78da47e4e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:43.477599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9863a668-af61-4474-a7db-bcc78da47e4e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:43.477599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9863a668-af61-4474-a7db-bcc78da47e4e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:43.477917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9863a668-af61-4474-a7db-bcc78da47e4e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:43.640219 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ae0aa544-3aa4-4a2b-8a3f-12838d909514 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a/action" status: 202 len: 0 microversion: 2.25 time: 7.979388 Oct 29 01:06:43.644806 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 354/732] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 29 01:06:35 2022] POST /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a/action => generated 0 bytes in 7983 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:06:43.663881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ef9fc0cd-ed5b-424a-80da-16aa6cb2242f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:43.665866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ef9fc0cd-ed5b-424a-80da-16aa6cb2242f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:43.687386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:43.690424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef9fc0cd-ed5b-424a-80da-16aa6cb2242f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:43.691361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef9fc0cd-ed5b-424a-80da-16aa6cb2242f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:43.701023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef9fc0cd-ed5b-424a-80da-16aa6cb2242f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:43.701023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef9fc0cd-ed5b-424a-80da-16aa6cb2242f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:43.701023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef9fc0cd-ed5b-424a-80da-16aa6cb2242f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:43.701023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef9fc0cd-ed5b-424a-80da-16aa6cb2242f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:44.227268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9863a668-af61-4474-a7db-bcc78da47e4e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d53762f33554711a9114f273918f2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed69fb18603408db6f91a05423e3ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:44.235759 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9863a668-af61-4474-a7db-bcc78da47e4e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85" status: 200 len: 1332 microversion: 2.1 time: 0.782223 Oct 29 01:06:44.246163 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 379/733] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:43 2022] GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85 => generated 1332 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:44.251415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5e9473d9-38b1-49f4-8b7f-c2cb9581979e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:44.255750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5e9473d9-38b1-49f4-8b7f-c2cb9581979e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:44.258978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e9473d9-38b1-49f4-8b7f-c2cb9581979e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:44.259729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e9473d9-38b1-49f4-8b7f-c2cb9581979e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:44.260225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e9473d9-38b1-49f4-8b7f-c2cb9581979e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:44.265646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e9473d9-38b1-49f4-8b7f-c2cb9581979e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:44.267190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e9473d9-38b1-49f4-8b7f-c2cb9581979e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:44.267702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e9473d9-38b1-49f4-8b7f-c2cb9581979e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:44.289696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ef9fc0cd-ed5b-424a-80da-16aa6cb2242f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:44.301122 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ef9fc0cd-ed5b-424a-80da-16aa6cb2242f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1316 microversion: 2.1 time: 0.653566 Oct 29 01:06:44.305380 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 355/734] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:43 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1316 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:44.322894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-0d754a7a-7c77-49a5-8564-5786d4c0e6b4 req-3e144a2f-23d3-423b-9d86-cc70700afe93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ee6daec-1cf6-45be-943c-20749b8d7d85", "name": "network-vif-plugged", "status": "completed", "tag": "8dcc0733-0f1e-41cd-9fc2-f9f371fc1086"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:44.332828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-0d754a7a-7c77-49a5-8564-5786d4c0e6b4 req-3e144a2f-23d3-423b-9d86-cc70700afe93 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:44.333406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-0d754a7a-7c77-49a5-8564-5786d4c0e6b4 req-3e144a2f-23d3-423b-9d86-cc70700afe93 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:44.333844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-0d754a7a-7c77-49a5-8564-5786d4c0e6b4 req-3e144a2f-23d3-423b-9d86-cc70700afe93 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:44.347061 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-0d754a7a-7c77-49a5-8564-5786d4c0e6b4 req-3e144a2f-23d3-423b-9d86-cc70700afe93 service nova] Creating event network-vif-plugged:8dcc0733-0f1e-41cd-9fc2-f9f371fc1086 for instance 5ee6daec-1cf6-45be-943c-20749b8d7d85 on n-h2-862964-3 Oct 29 01:06:44.352675 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-0d754a7a-7c77-49a5-8564-5786d4c0e6b4 req-3e144a2f-23d3-423b-9d86-cc70700afe93 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049837 Oct 29 01:06:44.353619 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 356/735] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:44.359799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2e305770-79bb-49d1-aaae-d6b9a9d4478b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:44.360770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2e305770-79bb-49d1-aaae-d6b9a9d4478b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:44.368513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e305770-79bb-49d1-aaae-d6b9a9d4478b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:44.369373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e305770-79bb-49d1-aaae-d6b9a9d4478b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:44.371920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e305770-79bb-49d1-aaae-d6b9a9d4478b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:44.372959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e305770-79bb-49d1-aaae-d6b9a9d4478b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:44.373701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e305770-79bb-49d1-aaae-d6b9a9d4478b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:44.374580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e305770-79bb-49d1-aaae-d6b9a9d4478b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:44.882215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5e9473d9-38b1-49f4-8b7f-c2cb9581979e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:44.896004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5e9473d9-38b1-49f4-8b7f-c2cb9581979e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:44.897594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5e9473d9-38b1-49f4-8b7f-c2cb9581979e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:44.898789 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5e9473d9-38b1-49f4-8b7f-c2cb9581979e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1568 microversion: 2.25 time: 0.651307 Oct 29 01:06:44.899358 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 380/736] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:44 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1568 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:44.903777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fb5bd5d2-3e28-407e-a33e-9f8385a77d3e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:44.904370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fb5bd5d2-3e28-407e-a33e-9f8385a77d3e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:44.910905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb5bd5d2-3e28-407e-a33e-9f8385a77d3e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:44.911678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb5bd5d2-3e28-407e-a33e-9f8385a77d3e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:44.915097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb5bd5d2-3e28-407e-a33e-9f8385a77d3e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:44.915097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb5bd5d2-3e28-407e-a33e-9f8385a77d3e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:44.915097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb5bd5d2-3e28-407e-a33e-9f8385a77d3e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:44.915097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb5bd5d2-3e28-407e-a33e-9f8385a77d3e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:44.944107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2e305770-79bb-49d1-aaae-d6b9a9d4478b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:44.951856 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2e305770-79bb-49d1-aaae-d6b9a9d4478b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1476 microversion: 2.1 time: 0.596879 Oct 29 01:06:44.952464 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 357/737] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:44 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1476 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:45.037616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fb5bd5d2-3e28-407e-a33e-9f8385a77d3e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:45.047400 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fb5bd5d2-3e28-407e-a33e-9f8385a77d3e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 200 len: 1280 microversion: 2.1 time: 0.146507 Oct 29 01:06:45.048720 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 381/738] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:44 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 1280 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:45.268196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1b5119d3-23b6-4419-8279-9773af2257e3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:45.269056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1b5119d3-23b6-4419-8279-9773af2257e3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:45.281178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b5119d3-23b6-4419-8279-9773af2257e3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:45.281363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4b12a7b1-6e68-4c1e-8547-bb1734212d7f tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-303155578", "imageRef": "151178e6-cf0c-43dd-b4e7-c4c11589b009", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "d366e20a-10b3-40b5-beb3-cd2068740e54"}], "security_groups": [{"name": "tempest-securitygroup--901733846"}], "key_name": "tempest-keypair-611727957", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:45.281801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b5119d3-23b6-4419-8279-9773af2257e3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:45.282105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b5119d3-23b6-4419-8279-9773af2257e3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:45.282820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b5119d3-23b6-4419-8279-9773af2257e3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:45.283278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b5119d3-23b6-4419-8279-9773af2257e3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:45.284455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b5119d3-23b6-4419-8279-9773af2257e3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:45.650233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-4b12a7b1-6e68-4c1e-8547-bb1734212d7f tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] validate_networks() for [('d366e20a-10b3-40b5-beb3-cd2068740e54', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:06:45.842387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1b5119d3-23b6-4419-8279-9773af2257e3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d53762f33554711a9114f273918f2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed69fb18603408db6f91a05423e3ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:45.848609 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1b5119d3-23b6-4419-8279-9773af2257e3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85" status: 200 len: 1332 microversion: 2.1 time: 0.584105 Oct 29 01:06:45.850063 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 358/739] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:45 2022] GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85 => generated 1332 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:45.870609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7c58758a-79a2-4f69-80cf-16f8a631a11c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:45.871432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7c58758a-79a2-4f69-80cf-16f8a631a11c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:45.878993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c58758a-79a2-4f69-80cf-16f8a631a11c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:45.880055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c58758a-79a2-4f69-80cf-16f8a631a11c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:45.880666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c58758a-79a2-4f69-80cf-16f8a631a11c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:45.881560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c58758a-79a2-4f69-80cf-16f8a631a11c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:45.882169 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c58758a-79a2-4f69-80cf-16f8a631a11c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:45.882788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c58758a-79a2-4f69-80cf-16f8a631a11c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:46.699532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7c58758a-79a2-4f69-80cf-16f8a631a11c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:46.708852 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7c58758a-79a2-4f69-80cf-16f8a631a11c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1316 microversion: 2.1 time: 0.857576 Oct 29 01:06:46.710027 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 359/740] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:45 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1316 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:46.714675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-00853cd7-8a14-4f12-bfd9-ec6c2b72b4b1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:46.715759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-00853cd7-8a14-4f12-bfd9-ec6c2b72b4b1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:46.722508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00853cd7-8a14-4f12-bfd9-ec6c2b72b4b1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:46.723050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00853cd7-8a14-4f12-bfd9-ec6c2b72b4b1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:46.723711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00853cd7-8a14-4f12-bfd9-ec6c2b72b4b1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:46.724767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00853cd7-8a14-4f12-bfd9-ec6c2b72b4b1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:46.725467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00853cd7-8a14-4f12-bfd9-ec6c2b72b4b1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:46.726107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00853cd7-8a14-4f12-bfd9-ec6c2b72b4b1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:47.063610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-4b12a7b1-6e68-4c1e-8547-bb1734212d7f tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:06:47.064567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-4b12a7b1-6e68-4c1e-8547-bb1734212d7f tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:06:47.065257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-4b12a7b1-6e68-4c1e-8547-bb1734212d7f tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:06:47.065840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-4b12a7b1-6e68-4c1e-8547-bb1734212d7f tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:06:47.066409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-4b12a7b1-6e68-4c1e-8547-bb1734212d7f tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:06:47.075649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b12a7b1-6e68-4c1e-8547-bb1734212d7f tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:47.076372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b12a7b1-6e68-4c1e-8547-bb1734212d7f tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:47.076948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b12a7b1-6e68-4c1e-8547-bb1734212d7f tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:47.077890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b12a7b1-6e68-4c1e-8547-bb1734212d7f tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:47.078498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b12a7b1-6e68-4c1e-8547-bb1734212d7f tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:47.079074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b12a7b1-6e68-4c1e-8547-bb1734212d7f tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:47.098737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-4b12a7b1-6e68-4c1e-8547-bb1734212d7f tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Getting quotas for project 471e99f2826f4133a5cd65c2962c0406. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:06:47.105821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-4b12a7b1-6e68-4c1e-8547-bb1734212d7f tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Getting quotas for user cf36c8bc01ea4fb7b1bd4e93b91e9e1e and project 471e99f2826f4133a5cd65c2962c0406. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:06:47.119354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4b12a7b1-6e68-4c1e-8547-bb1734212d7f tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:06:47.122014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4b12a7b1-6e68-4c1e-8547-bb1734212d7f tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='151178e6-cf0c-43dd-b4e7-c4c11589b009',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:06:47.162632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-00853cd7-8a14-4f12-bfd9-ec6c2b72b4b1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:47.171421 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-00853cd7-8a14-4f12-bfd9-ec6c2b72b4b1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1585 microversion: 2.1 time: 0.460299 Oct 29 01:06:47.175111 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 360/741] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:46 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1585 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:47.177355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-3c4f2b69-5e87-4398-9028-18fa98adac60 req-0db1e2a4-d87a-4757-ab1e-4d8c0df889c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80c528e3-4bf5-4d61-aaa8-581168f42c7b", "tag": "a52a9942-a3d5-4dcb-a096-9f922211cccc"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:47.187621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3c4f2b69-5e87-4398-9028-18fa98adac60 req-0db1e2a4-d87a-4757-ab1e-4d8c0df889c2 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:47.188526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3c4f2b69-5e87-4398-9028-18fa98adac60 req-0db1e2a4-d87a-4757-ab1e-4d8c0df889c2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:47.189191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3c4f2b69-5e87-4398-9028-18fa98adac60 req-0db1e2a4-d87a-4757-ab1e-4d8c0df889c2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:47.203988 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-3c4f2b69-5e87-4398-9028-18fa98adac60 req-0db1e2a4-d87a-4757-ab1e-4d8c0df889c2 service nova] Creating event network-changed:a52a9942-a3d5-4dcb-a096-9f922211cccc for instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b on n-h1-862964-3 Oct 29 01:06:47.210981 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-3c4f2b69-5e87-4398-9028-18fa98adac60 req-0db1e2a4-d87a-4757-ab1e-4d8c0df889c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037233 Oct 29 01:06:47.211616 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 361/742] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:47.217358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e7811f8b-c689-49ba-9c24-9909869cfc54 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:47.218082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e7811f8b-c689-49ba-9c24-9909869cfc54 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:47.225280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7811f8b-c689-49ba-9c24-9909869cfc54 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:47.225977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7811f8b-c689-49ba-9c24-9909869cfc54 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:47.226582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7811f8b-c689-49ba-9c24-9909869cfc54 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:47.227511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7811f8b-c689-49ba-9c24-9909869cfc54 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:47.227971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7811f8b-c689-49ba-9c24-9909869cfc54 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:47.228397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7811f8b-c689-49ba-9c24-9909869cfc54 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:47.330496 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4b12a7b1-6e68-4c1e-8547-bb1734212d7f tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.055337 Oct 29 01:06:47.332836 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 382/743] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:06:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 2058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:06:47.337961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-97f8d843-19ec-470b-a8ff-ee63fdcbfdb2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:47.338888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-97f8d843-19ec-470b-a8ff-ee63fdcbfdb2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:47.347039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97f8d843-19ec-470b-a8ff-ee63fdcbfdb2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:47.347863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97f8d843-19ec-470b-a8ff-ee63fdcbfdb2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:47.348482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97f8d843-19ec-470b-a8ff-ee63fdcbfdb2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:47.349574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97f8d843-19ec-470b-a8ff-ee63fdcbfdb2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:47.350632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97f8d843-19ec-470b-a8ff-ee63fdcbfdb2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:47.351338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97f8d843-19ec-470b-a8ff-ee63fdcbfdb2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:47.739690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e7811f8b-c689-49ba-9c24-9909869cfc54 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:47.748352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e7811f8b-c689-49ba-9c24-9909869cfc54 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:47.750222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e7811f8b-c689-49ba-9c24-9909869cfc54 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:47.751917 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e7811f8b-c689-49ba-9c24-9909869cfc54 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1568 microversion: 2.25 time: 0.539054 Oct 29 01:06:47.767072 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 362/744] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:47 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1568 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:47.785370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d90983c-81fa-4a94-b3de-905f9156d766 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:47.785370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7d90983c-81fa-4a94-b3de-905f9156d766 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:47.789065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d90983c-81fa-4a94-b3de-905f9156d766 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:47.789808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d90983c-81fa-4a94-b3de-905f9156d766 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:47.790443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d90983c-81fa-4a94-b3de-905f9156d766 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:47.791404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d90983c-81fa-4a94-b3de-905f9156d766 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:47.792067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d90983c-81fa-4a94-b3de-905f9156d766 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:47.792832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d90983c-81fa-4a94-b3de-905f9156d766 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:47.988982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-97f8d843-19ec-470b-a8ff-ee63fdcbfdb2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:48.015781 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-97f8d843-19ec-470b-a8ff-ee63fdcbfdb2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1476 microversion: 2.1 time: 0.681503 Oct 29 01:06:48.021245 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 383/745] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:47 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1476 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:48.028006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-94188517-030d-4380-94fa-2fc81d645420 req-c91e9a1a-8128-4386-8405-6b0204bf269a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c770e759-7e36-4f04-b6f9-12435bce6ff6", "name": "network-vif-plugged", "status": "completed", "tag": "7d5d77a6-2cec-4f2d-b47a-4fb74c833658"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:48.053622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-94188517-030d-4380-94fa-2fc81d645420 req-c91e9a1a-8128-4386-8405-6b0204bf269a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:48.054437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-94188517-030d-4380-94fa-2fc81d645420 req-c91e9a1a-8128-4386-8405-6b0204bf269a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:48.055096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-94188517-030d-4380-94fa-2fc81d645420 req-c91e9a1a-8128-4386-8405-6b0204bf269a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:48.074133 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-94188517-030d-4380-94fa-2fc81d645420 req-c91e9a1a-8128-4386-8405-6b0204bf269a service nova] Creating event network-vif-plugged:7d5d77a6-2cec-4f2d-b47a-4fb74c833658 for instance c770e759-7e36-4f04-b6f9-12435bce6ff6 on n-h1-862964-3 Oct 29 01:06:48.080125 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-94188517-030d-4380-94fa-2fc81d645420 req-c91e9a1a-8128-4386-8405-6b0204bf269a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057140 Oct 29 01:06:48.081047 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 384/746] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:48.090004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-39a2b2a4-acf7-44ec-b9cb-bc3cb7513b2a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:48.091134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-39a2b2a4-acf7-44ec-b9cb-bc3cb7513b2a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:48.100347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39a2b2a4-acf7-44ec-b9cb-bc3cb7513b2a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:48.101061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39a2b2a4-acf7-44ec-b9cb-bc3cb7513b2a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:48.105327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39a2b2a4-acf7-44ec-b9cb-bc3cb7513b2a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:48.105327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39a2b2a4-acf7-44ec-b9cb-bc3cb7513b2a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:48.105327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39a2b2a4-acf7-44ec-b9cb-bc3cb7513b2a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:48.105677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39a2b2a4-acf7-44ec-b9cb-bc3cb7513b2a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:48.319771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7d90983c-81fa-4a94-b3de-905f9156d766 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:48.333478 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7d90983c-81fa-4a94-b3de-905f9156d766 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 200 len: 1322 microversion: 2.1 time: 0.564853 Oct 29 01:06:48.334966 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 363/747] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:47 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 1322 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:48.341488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ed48ffec-1277-413f-a31e-5d0a4db3df89 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:48.343287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ed48ffec-1277-413f-a31e-5d0a4db3df89 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:48.464578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ed48ffec-1277-413f-a31e-5d0a4db3df89 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:48.473756 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ed48ffec-1277-413f-a31e-5d0a4db3df89 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1244 microversion: 2.1 time: 0.137034 Oct 29 01:06:48.474666 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 364/748] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:48 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1244 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:48.480877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cf258531-aaa5-4c66-a752-cdac04e58c20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:48.485541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cf258531-aaa5-4c66-a752-cdac04e58c20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:48.490851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf258531-aaa5-4c66-a752-cdac04e58c20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:48.491348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf258531-aaa5-4c66-a752-cdac04e58c20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:48.491788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf258531-aaa5-4c66-a752-cdac04e58c20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:48.492819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf258531-aaa5-4c66-a752-cdac04e58c20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:48.493343 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf258531-aaa5-4c66-a752-cdac04e58c20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:48.493797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf258531-aaa5-4c66-a752-cdac04e58c20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:48.618475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-39a2b2a4-acf7-44ec-b9cb-bc3cb7513b2a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d53762f33554711a9114f273918f2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed69fb18603408db6f91a05423e3ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:48.626823 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-39a2b2a4-acf7-44ec-b9cb-bc3cb7513b2a tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85" status: 200 len: 1537 microversion: 2.1 time: 0.543839 Oct 29 01:06:48.628487 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 385/749] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:48 2022] GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85 => generated 1537 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:48.664503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1dd291c0-2cff-412c-b71d-71b0da38bf15 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Action: 'create', calling method: .version_select at 0x7f9d9c157d30>, body: {"pool": "28a3ad30-a90e-4539-9105-75a1ae5b0ef9"} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:48.833765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cf258531-aaa5-4c66-a752-cdac04e58c20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:48.844189 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cf258531-aaa5-4c66-a752-cdac04e58c20 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1316 microversion: 2.1 time: 0.368114 Oct 29 01:06:48.845531 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 365/750] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:48 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:48.850935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f05f6537-e608-44a7-bb97-30ea737c23a1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:48.851830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f05f6537-e608-44a7-bb97-30ea737c23a1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:48.860843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f05f6537-e608-44a7-bb97-30ea737c23a1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:48.867976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f05f6537-e608-44a7-bb97-30ea737c23a1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:48.868493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f05f6537-e608-44a7-bb97-30ea737c23a1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:48.869451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f05f6537-e608-44a7-bb97-30ea737c23a1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:48.869921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f05f6537-e608-44a7-bb97-30ea737c23a1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:48.870349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f05f6537-e608-44a7-bb97-30ea737c23a1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:49.755033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f05f6537-e608-44a7-bb97-30ea737c23a1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:49.763551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f05f6537-e608-44a7-bb97-30ea737c23a1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:49.765009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f05f6537-e608-44a7-bb97-30ea737c23a1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:49.774790 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f05f6537-e608-44a7-bb97-30ea737c23a1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1568 microversion: 2.25 time: 0.927812 Oct 29 01:06:49.781086 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 366/751] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:48 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1568 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:49.806358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0b043bfe-46c9-4014-8b3e-bf6938b6563c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:49.807271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0b043bfe-46c9-4014-8b3e-bf6938b6563c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:49.829436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b043bfe-46c9-4014-8b3e-bf6938b6563c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:49.829923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b043bfe-46c9-4014-8b3e-bf6938b6563c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:49.830354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b043bfe-46c9-4014-8b3e-bf6938b6563c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:49.839804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b043bfe-46c9-4014-8b3e-bf6938b6563c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:49.840428 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b043bfe-46c9-4014-8b3e-bf6938b6563c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:49.843803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b043bfe-46c9-4014-8b3e-bf6938b6563c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:50.246056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0b043bfe-46c9-4014-8b3e-bf6938b6563c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:50.255053 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0b043bfe-46c9-4014-8b3e-bf6938b6563c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1476 microversion: 2.1 time: 0.459895 Oct 29 01:06:50.269704 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 367/752] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:49 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1476 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:50.280584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-834cf4b3-8622-406e-a8c8-31465a5687f3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:50.282628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-834cf4b3-8622-406e-a8c8-31465a5687f3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:50.289838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-834cf4b3-8622-406e-a8c8-31465a5687f3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:50.301361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-834cf4b3-8622-406e-a8c8-31465a5687f3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:50.301361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-834cf4b3-8622-406e-a8c8-31465a5687f3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:50.301361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-834cf4b3-8622-406e-a8c8-31465a5687f3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:50.301361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-834cf4b3-8622-406e-a8c8-31465a5687f3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:50.301780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-834cf4b3-8622-406e-a8c8-31465a5687f3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:50.561360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-834cf4b3-8622-406e-a8c8-31465a5687f3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:50.573725 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-834cf4b3-8622-406e-a8c8-31465a5687f3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 200 len: 1322 microversion: 2.1 time: 0.300804 Oct 29 01:06:50.576249 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 368/753] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:50 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:50.600945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-d32bd268-cfc9-4353-a435-fbb119db90e5 req-46f44faf-55a4-4e50-bb23-40a5948d8055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6eeec1-f116-41ea-b5ed-c20d0d37114a", "name": "network-vif-unplugged", "status": "completed", "tag": "11ae0cb6-be2c-4a65-9b62-b6a49a05a7e3"}, {"name": "network-changed", "server_uuid": "29fc33a2-ac2f-4c14-bf42-861c727f7dd6", "tag": "a55a9dd9-fbc3-4aac-bb41-9e1e7ca1b060"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:50.624988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d32bd268-cfc9-4353-a435-fbb119db90e5 req-46f44faf-55a4-4e50-bb23-40a5948d8055 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:50.626485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d32bd268-cfc9-4353-a435-fbb119db90e5 req-46f44faf-55a4-4e50-bb23-40a5948d8055 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:50.627273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d32bd268-cfc9-4353-a435-fbb119db90e5 req-46f44faf-55a4-4e50-bb23-40a5948d8055 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:50.655358 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-d32bd268-cfc9-4353-a435-fbb119db90e5 req-46f44faf-55a4-4e50-bb23-40a5948d8055 service nova] Creating event network-vif-unplugged:11ae0cb6-be2c-4a65-9b62-b6a49a05a7e3 for instance 9a6eeec1-f116-41ea-b5ed-c20d0d37114a on n-h1-862964-3 Oct 29 01:06:50.655358 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-d32bd268-cfc9-4353-a435-fbb119db90e5 req-46f44faf-55a4-4e50-bb23-40a5948d8055 service nova] Creating event network-changed:a55a9dd9-fbc3-4aac-bb41-9e1e7ca1b060 for instance 29fc33a2-ac2f-4c14-bf42-861c727f7dd6 on n-h1-862964-3 Oct 29 01:06:50.667719 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-d32bd268-cfc9-4353-a435-fbb119db90e5 req-46f44faf-55a4-4e50-bb23-40a5948d8055 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.088529 Oct 29 01:06:50.668865 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 369/754] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:50.684837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0e1a9b34-ce9e-4c54-96d3-c27a7b003e42 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:50.686335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0e1a9b34-ce9e-4c54-96d3-c27a7b003e42 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:50.697843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e1a9b34-ce9e-4c54-96d3-c27a7b003e42 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:50.698564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e1a9b34-ce9e-4c54-96d3-c27a7b003e42 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:50.699543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e1a9b34-ce9e-4c54-96d3-c27a7b003e42 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:50.700685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e1a9b34-ce9e-4c54-96d3-c27a7b003e42 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:50.701657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e1a9b34-ce9e-4c54-96d3-c27a7b003e42 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:50.702954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e1a9b34-ce9e-4c54-96d3-c27a7b003e42 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:50.711650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:50.968959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0e1a9b34-ce9e-4c54-96d3-c27a7b003e42 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:50.983215 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0e1a9b34-ce9e-4c54-96d3-c27a7b003e42 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1304 microversion: 2.1 time: 0.312311 Oct 29 01:06:50.993206 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 370/755] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:50 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1304 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:50.996686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8c222b4a-9bdd-4e8c-9ada-b64e9b962065 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:51.000944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8c222b4a-9bdd-4e8c-9ada-b64e9b962065 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:51.021651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c222b4a-9bdd-4e8c-9ada-b64e9b962065 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:51.022269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c222b4a-9bdd-4e8c-9ada-b64e9b962065 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:51.023399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c222b4a-9bdd-4e8c-9ada-b64e9b962065 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:51.024579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c222b4a-9bdd-4e8c-9ada-b64e9b962065 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:51.029458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c222b4a-9bdd-4e8c-9ada-b64e9b962065 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:51.037955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c222b4a-9bdd-4e8c-9ada-b64e9b962065 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:51.376386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8c222b4a-9bdd-4e8c-9ada-b64e9b962065 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:51.386809 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8c222b4a-9bdd-4e8c-9ada-b64e9b962065 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1465 microversion: 2.1 time: 0.397849 Oct 29 01:06:51.401187 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 371/756] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:50 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1465 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:51.411650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-adb13941-1f49-4444-8ca7-0e92657a5617 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:51.412298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-adb13941-1f49-4444-8ca7-0e92657a5617 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:51.418520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-adb13941-1f49-4444-8ca7-0e92657a5617 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:51.419239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-adb13941-1f49-4444-8ca7-0e92657a5617 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:51.419965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-adb13941-1f49-4444-8ca7-0e92657a5617 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:51.420957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-adb13941-1f49-4444-8ca7-0e92657a5617 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:51.421462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-adb13941-1f49-4444-8ca7-0e92657a5617 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:51.422046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-adb13941-1f49-4444-8ca7-0e92657a5617 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:51.716019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-adb13941-1f49-4444-8ca7-0e92657a5617 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:51.747888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-adb13941-1f49-4444-8ca7-0e92657a5617 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:51.751828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-adb13941-1f49-4444-8ca7-0e92657a5617 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:51.756506 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-adb13941-1f49-4444-8ca7-0e92657a5617 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1568 microversion: 2.25 time: 0.353791 Oct 29 01:06:51.758694 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 372/757] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:51 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1568 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:51.767091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-37a86505-e8e8-4703-b690-47c7ddfb57fb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:51.769083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-37a86505-e8e8-4703-b690-47c7ddfb57fb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:51.787389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37a86505-e8e8-4703-b690-47c7ddfb57fb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:51.788159 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37a86505-e8e8-4703-b690-47c7ddfb57fb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:51.788316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37a86505-e8e8-4703-b690-47c7ddfb57fb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:51.794808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37a86505-e8e8-4703-b690-47c7ddfb57fb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:51.796292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37a86505-e8e8-4703-b690-47c7ddfb57fb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:51.797703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37a86505-e8e8-4703-b690-47c7ddfb57fb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:52.461039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-37a86505-e8e8-4703-b690-47c7ddfb57fb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:52.478678 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-37a86505-e8e8-4703-b690-47c7ddfb57fb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1476 microversion: 2.1 time: 0.715566 Oct 29 01:06:52.482595 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 373/758] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:51 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1476 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:52.511278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b9bf246e-7631-40f0-8db0-62974e3e14ab tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:52.519518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b9bf246e-7631-40f0-8db0-62974e3e14ab tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:52.530656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9bf246e-7631-40f0-8db0-62974e3e14ab tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:52.535461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9bf246e-7631-40f0-8db0-62974e3e14ab tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:52.546635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9bf246e-7631-40f0-8db0-62974e3e14ab tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:52.546635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9bf246e-7631-40f0-8db0-62974e3e14ab tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:52.546635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9bf246e-7631-40f0-8db0-62974e3e14ab tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:52.546635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9bf246e-7631-40f0-8db0-62974e3e14ab tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:53.062661 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b9bf246e-7631-40f0-8db0-62974e3e14ab tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1616 microversion: 2.1 time: 0.549042 Oct 29 01:06:53.062661 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 374/759] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:52 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1616 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:53.067831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b15256d5-7ab9-42cd-937e-eef6ec709433 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:53.068797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b15256d5-7ab9-42cd-937e-eef6ec709433 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:53.075481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b15256d5-7ab9-42cd-937e-eef6ec709433 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:53.076486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b15256d5-7ab9-42cd-937e-eef6ec709433 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:53.077244 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b15256d5-7ab9-42cd-937e-eef6ec709433 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:53.078383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b15256d5-7ab9-42cd-937e-eef6ec709433 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:53.083256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b15256d5-7ab9-42cd-937e-eef6ec709433 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:53.083256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b15256d5-7ab9-42cd-937e-eef6ec709433 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:54.147719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b15256d5-7ab9-42cd-937e-eef6ec709433 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:54.161666 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b15256d5-7ab9-42cd-937e-eef6ec709433 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 200 len: 1322 microversion: 2.1 time: 1.097835 Oct 29 01:06:54.162776 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 375/760] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:53 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 1322 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:54.169720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e83e8957-2e08-4f6d-b51e-ba44c0765413 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:54.171275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e83e8957-2e08-4f6d-b51e-ba44c0765413 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:54.178748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e83e8957-2e08-4f6d-b51e-ba44c0765413 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:54.180248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e83e8957-2e08-4f6d-b51e-ba44c0765413 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:54.180936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e83e8957-2e08-4f6d-b51e-ba44c0765413 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:54.182542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e83e8957-2e08-4f6d-b51e-ba44c0765413 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:54.183199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e83e8957-2e08-4f6d-b51e-ba44c0765413 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:54.183813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e83e8957-2e08-4f6d-b51e-ba44c0765413 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:54.184093 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1dd291c0-2cff-412c-b71d-71b0da38bf15 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.527430 Oct 29 01:06:54.187869 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 386/761] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 29 01:06:48 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:54.194218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-a75ec53d-25c2-4785-8918-0e82df4b4f80 req-dc223b93-8217-4e43-a6b6-9339418a641f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a6eeec1-f116-41ea-b5ed-c20d0d37114a", "tag": "11ae0cb6-be2c-4a65-9b62-b6a49a05a7e3"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:54.207523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a75ec53d-25c2-4785-8918-0e82df4b4f80 req-dc223b93-8217-4e43-a6b6-9339418a641f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:54.208420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a75ec53d-25c2-4785-8918-0e82df4b4f80 req-dc223b93-8217-4e43-a6b6-9339418a641f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:54.209410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a75ec53d-25c2-4785-8918-0e82df4b4f80 req-dc223b93-8217-4e43-a6b6-9339418a641f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:54.223748 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-a75ec53d-25c2-4785-8918-0e82df4b4f80 req-dc223b93-8217-4e43-a6b6-9339418a641f service nova] Creating event network-changed:11ae0cb6-be2c-4a65-9b62-b6a49a05a7e3 for instance 9a6eeec1-f116-41ea-b5ed-c20d0d37114a on n-h1-862964-3 Oct 29 01:06:54.231263 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-a75ec53d-25c2-4785-8918-0e82df4b4f80 req-dc223b93-8217-4e43-a6b6-9339418a641f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044037 Oct 29 01:06:54.233265 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 387/762] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:06:54.244689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bef603f7-2c91-4e02-9597-bff113a18cb9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:54.259618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bef603f7-2c91-4e02-9597-bff113a18cb9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:54.274917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bef603f7-2c91-4e02-9597-bff113a18cb9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:54.275684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bef603f7-2c91-4e02-9597-bff113a18cb9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:54.276313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bef603f7-2c91-4e02-9597-bff113a18cb9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:54.277325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bef603f7-2c91-4e02-9597-bff113a18cb9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:54.278011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bef603f7-2c91-4e02-9597-bff113a18cb9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:54.282903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bef603f7-2c91-4e02-9597-bff113a18cb9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:54.828945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e83e8957-2e08-4f6d-b51e-ba44c0765413 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:54.854110 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e83e8957-2e08-4f6d-b51e-ba44c0765413 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1369 microversion: 2.1 time: 0.679069 Oct 29 01:06:54.854796 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 376/763] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:54 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1369 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:54.871872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-08c9e459-1d27-418e-9eb5-0be38c86d66c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-279902943", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["a9a5a9b1-7f02-4874-83d4-c48badd76f5f"]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:54.911876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bef603f7-2c91-4e02-9597-bff113a18cb9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:54.926795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bef603f7-2c91-4e02-9597-bff113a18cb9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:54.928261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bef603f7-2c91-4e02-9597-bff113a18cb9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:54.929493 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bef603f7-2c91-4e02-9597-bff113a18cb9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1568 microversion: 2.25 time: 0.694468 Oct 29 01:06:54.930069 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 388/764] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:54 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1568 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:54.937346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1b76619d-af51-4b55-8694-10579a27e63d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:54.949916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1b76619d-af51-4b55-8694-10579a27e63d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:54.957931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b76619d-af51-4b55-8694-10579a27e63d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:54.969663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b76619d-af51-4b55-8694-10579a27e63d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:54.969663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b76619d-af51-4b55-8694-10579a27e63d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:54.969663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b76619d-af51-4b55-8694-10579a27e63d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:54.969663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b76619d-af51-4b55-8694-10579a27e63d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:54.970275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b76619d-af51-4b55-8694-10579a27e63d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:55.022901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-08c9e459-1d27-418e-9eb5-0be38c86d66c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] validate_networks() for None {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:06:55.617550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1b76619d-af51-4b55-8694-10579a27e63d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:55.629456 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1b76619d-af51-4b55-8694-10579a27e63d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1476 microversion: 2.1 time: 0.698155 Oct 29 01:06:55.642406 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 389/765] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:54 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1476 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:55.652517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-27a1fd17-d74a-4bc7-9934-e0e9de45804e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Action: 'action', calling method: .version_select at 0x7f9d9d8c1af0>, body: {"addFloatingIp": {"address": "172.25.8.86"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:06:55.655610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-27a1fd17-d74a-4bc7-9934-e0e9de45804e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:55.663227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27a1fd17-d74a-4bc7-9934-e0e9de45804e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:55.664031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27a1fd17-d74a-4bc7-9934-e0e9de45804e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:55.664632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27a1fd17-d74a-4bc7-9934-e0e9de45804e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:55.665554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27a1fd17-d74a-4bc7-9934-e0e9de45804e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:55.666653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27a1fd17-d74a-4bc7-9934-e0e9de45804e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:55.667253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27a1fd17-d74a-4bc7-9934-e0e9de45804e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:55.755765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27a1fd17-d74a-4bc7-9934-e0e9de45804e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "refresh_cache-5ee6daec-1cf6-45be-943c-20749b8d7d85" {{(pid=121099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 01:06:55.756497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27a1fd17-d74a-4bc7-9934-e0e9de45804e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquired lock "refresh_cache-5ee6daec-1cf6-45be-943c-20749b8d7d85" {{(pid=121099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 01:06:56.307497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-08c9e459-1d27-418e-9eb5-0be38c86d66c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:06:56.308015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-08c9e459-1d27-418e-9eb5-0be38c86d66c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:06:56.308390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-08c9e459-1d27-418e-9eb5-0be38c86d66c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:06:56.308998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-08c9e459-1d27-418e-9eb5-0be38c86d66c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:06:56.309584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-08c9e459-1d27-418e-9eb5-0be38c86d66c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:06:56.332262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08c9e459-1d27-418e-9eb5-0be38c86d66c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:56.347404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08c9e459-1d27-418e-9eb5-0be38c86d66c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:56.348202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08c9e459-1d27-418e-9eb5-0be38c86d66c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:56.349042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08c9e459-1d27-418e-9eb5-0be38c86d66c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:56.349536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08c9e459-1d27-418e-9eb5-0be38c86d66c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:56.349966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08c9e459-1d27-418e-9eb5-0be38c86d66c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:56.388383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-08c9e459-1d27-418e-9eb5-0be38c86d66c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for project fba91819dd56439daea17217c5d7b9b7. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:06:56.397276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-08c9e459-1d27-418e-9eb5-0be38c86d66c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for user 175bb8f8b330495394cd401223847733 and project fba91819dd56439daea17217c5d7b9b7. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:06:56.421628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-08c9e459-1d27-418e-9eb5-0be38c86d66c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:06:56.426114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-08c9e459-1d27-418e-9eb5-0be38c86d66c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:06:56.592719 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-08c9e459-1d27-418e-9eb5-0be38c86d66c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.724661 Oct 29 01:06:56.594105 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 377/766] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:06:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:06:56.600045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-59b4d8cd-9b01-4016-af9f-d1acf6eb315f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:56.604848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-59b4d8cd-9b01-4016-af9f-d1acf6eb315f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:56.626122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59b4d8cd-9b01-4016-af9f-d1acf6eb315f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:56.626888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59b4d8cd-9b01-4016-af9f-d1acf6eb315f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:56.628163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59b4d8cd-9b01-4016-af9f-d1acf6eb315f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:56.630558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59b4d8cd-9b01-4016-af9f-d1acf6eb315f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:56.631297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59b4d8cd-9b01-4016-af9f-d1acf6eb315f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:56.631929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59b4d8cd-9b01-4016-af9f-d1acf6eb315f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:57.090186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:57.114758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=18 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:06:57.660782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-59b4d8cd-9b01-4016-af9f-d1acf6eb315f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:57.681783 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-59b4d8cd-9b01-4016-af9f-d1acf6eb315f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 200 len: 1322 microversion: 2.1 time: 1.086356 Oct 29 01:06:57.682668 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 378/767] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:56 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 1322 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:57.699950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dab1e92d-4ba4-4985-89ec-e28a8731bbe0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:57.704523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dab1e92d-4ba4-4985-89ec-e28a8731bbe0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:57.739085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dab1e92d-4ba4-4985-89ec-e28a8731bbe0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:57.739609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dab1e92d-4ba4-4985-89ec-e28a8731bbe0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:57.740061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dab1e92d-4ba4-4985-89ec-e28a8731bbe0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:57.740812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dab1e92d-4ba4-4985-89ec-e28a8731bbe0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:57.741285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dab1e92d-4ba4-4985-89ec-e28a8731bbe0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:57.751821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dab1e92d-4ba4-4985-89ec-e28a8731bbe0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:58.373888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-dab1e92d-4ba4-4985-89ec-e28a8731bbe0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:58.386949 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dab1e92d-4ba4-4985-89ec-e28a8731bbe0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1369 microversion: 2.1 time: 0.702842 Oct 29 01:06:58.387838 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 379/768] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:57 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1369 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:58.416312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-191112c7-b611-446c-b7d0-3625bd93bdfc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:58.417625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-191112c7-b611-446c-b7d0-3625bd93bdfc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:58.439851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-191112c7-b611-446c-b7d0-3625bd93bdfc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:58.441643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-191112c7-b611-446c-b7d0-3625bd93bdfc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:58.443003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-191112c7-b611-446c-b7d0-3625bd93bdfc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:58.443934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-191112c7-b611-446c-b7d0-3625bd93bdfc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:58.444556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-191112c7-b611-446c-b7d0-3625bd93bdfc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:58.445195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-191112c7-b611-446c-b7d0-3625bd93bdfc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:59.275144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-191112c7-b611-446c-b7d0-3625bd93bdfc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:59.312399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-191112c7-b611-446c-b7d0-3625bd93bdfc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:59.314488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-191112c7-b611-446c-b7d0-3625bd93bdfc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:59.317938 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-191112c7-b611-446c-b7d0-3625bd93bdfc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1568 microversion: 2.25 time: 0.909890 Oct 29 01:06:59.322830 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 380/769] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:06:58 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1568 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:06:59.340859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e7fc45a-c53f-44cf-ac43-1405868abb18 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:59.341529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7e7fc45a-c53f-44cf-ac43-1405868abb18 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:59.372026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e7fc45a-c53f-44cf-ac43-1405868abb18 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:59.372811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e7fc45a-c53f-44cf-ac43-1405868abb18 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:59.375474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e7fc45a-c53f-44cf-ac43-1405868abb18 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:59.378906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e7fc45a-c53f-44cf-ac43-1405868abb18 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:59.385623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e7fc45a-c53f-44cf-ac43-1405868abb18 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:59.386324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e7fc45a-c53f-44cf-ac43-1405868abb18 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:59.587048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7e7fc45a-c53f-44cf-ac43-1405868abb18 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:06:59.595666 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e7fc45a-c53f-44cf-ac43-1405868abb18 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9" status: 200 len: 1268 microversion: 2.1 time: 0.271332 Oct 29 01:06:59.601963 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 381/770] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:59 2022] GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 => generated 1268 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:06:59.617544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4b759cb6-8018-4902-889d-11fcc30c8ba6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:06:59.618563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4b759cb6-8018-4902-889d-11fcc30c8ba6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:06:59.635629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b759cb6-8018-4902-889d-11fcc30c8ba6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:59.646078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b759cb6-8018-4902-889d-11fcc30c8ba6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:59.647891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b759cb6-8018-4902-889d-11fcc30c8ba6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:06:59.647891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b759cb6-8018-4902-889d-11fcc30c8ba6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:06:59.647891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b759cb6-8018-4902-889d-11fcc30c8ba6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:06:59.648652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b759cb6-8018-4902-889d-11fcc30c8ba6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:00.904100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4b759cb6-8018-4902-889d-11fcc30c8ba6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:00.921408 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4b759cb6-8018-4902-889d-11fcc30c8ba6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1476 microversion: 2.1 time: 1.316075 Oct 29 01:07:00.945910 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 382/771] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:06:59 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1476 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:00.963145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-98e1a814-094b-4327-9d8f-54b6ecffee21 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:00.966739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-98e1a814-094b-4327-9d8f-54b6ecffee21 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:00.981405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98e1a814-094b-4327-9d8f-54b6ecffee21 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:00.982412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98e1a814-094b-4327-9d8f-54b6ecffee21 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:00.983117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98e1a814-094b-4327-9d8f-54b6ecffee21 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:00.984164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98e1a814-094b-4327-9d8f-54b6ecffee21 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:00.984874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98e1a814-094b-4327-9d8f-54b6ecffee21 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:00.986348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98e1a814-094b-4327-9d8f-54b6ecffee21 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:02.273842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-98e1a814-094b-4327-9d8f-54b6ecffee21 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:02.288031 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-98e1a814-094b-4327-9d8f-54b6ecffee21 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 200 len: 1322 microversion: 2.1 time: 1.340570 Oct 29 01:07:02.293807 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 383/772] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:00 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 1322 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:02.315410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6a95d0b1-b663-4138-8612-39f75dbc29ae tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:02.316057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6a95d0b1-b663-4138-8612-39f75dbc29ae tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:02.333451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a95d0b1-b663-4138-8612-39f75dbc29ae tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:02.334133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a95d0b1-b663-4138-8612-39f75dbc29ae tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:02.334745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a95d0b1-b663-4138-8612-39f75dbc29ae tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:02.335626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a95d0b1-b663-4138-8612-39f75dbc29ae tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:02.336236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a95d0b1-b663-4138-8612-39f75dbc29ae tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:02.336819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a95d0b1-b663-4138-8612-39f75dbc29ae tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:02.875749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-27a1fd17-d74a-4bc7-9934-e0e9de45804e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Building network info cache for instance {{(pid=121099) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 01:07:02.913280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6a95d0b1-b663-4138-8612-39f75dbc29ae tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:02.921831 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6a95d0b1-b663-4138-8612-39f75dbc29ae tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1369 microversion: 2.1 time: 0.626168 Oct 29 01:07:02.942254 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 384/773] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:02 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1369 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:02.947970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-558924fa-6516-4a58-96e2-34e2e150370d req-e2d9468d-0169-4d17-a5bf-b69e2795eb99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f38f9413-877d-43ab-b4ed-294552b3c231", "tag": "dba01d43-1d1a-480f-89cd-3555f1ef20a4"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:02.959087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-558924fa-6516-4a58-96e2-34e2e150370d req-e2d9468d-0169-4d17-a5bf-b69e2795eb99 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:02.959842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-558924fa-6516-4a58-96e2-34e2e150370d req-e2d9468d-0169-4d17-a5bf-b69e2795eb99 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:02.960427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-558924fa-6516-4a58-96e2-34e2e150370d req-e2d9468d-0169-4d17-a5bf-b69e2795eb99 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:02.974908 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-558924fa-6516-4a58-96e2-34e2e150370d req-e2d9468d-0169-4d17-a5bf-b69e2795eb99 service nova] Creating event network-changed:dba01d43-1d1a-480f-89cd-3555f1ef20a4 for instance f38f9413-877d-43ab-b4ed-294552b3c231 on n-h2-862964-3 Oct 29 01:07:02.981763 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-558924fa-6516-4a58-96e2-34e2e150370d req-e2d9468d-0169-4d17-a5bf-b69e2795eb99 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037869 Oct 29 01:07:02.983223 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 385/774] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:02.991285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a988813e-cdbb-455d-83b7-52ea1bc3e2fb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:02.997974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a988813e-cdbb-455d-83b7-52ea1bc3e2fb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:03.011009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a988813e-cdbb-455d-83b7-52ea1bc3e2fb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:03.011009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a988813e-cdbb-455d-83b7-52ea1bc3e2fb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:03.011009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a988813e-cdbb-455d-83b7-52ea1bc3e2fb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:03.011009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a988813e-cdbb-455d-83b7-52ea1bc3e2fb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:03.011371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a988813e-cdbb-455d-83b7-52ea1bc3e2fb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:03.011371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a988813e-cdbb-455d-83b7-52ea1bc3e2fb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:03.641988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a988813e-cdbb-455d-83b7-52ea1bc3e2fb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:03.654304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a988813e-cdbb-455d-83b7-52ea1bc3e2fb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:03.656199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a988813e-cdbb-455d-83b7-52ea1bc3e2fb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:03.657606 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a988813e-cdbb-455d-83b7-52ea1bc3e2fb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1568 microversion: 2.25 time: 0.672893 Oct 29 01:07:03.658358 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 386/775] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:02 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1568 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:03.701582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1c47aa9b-bccf-4732-8387-4ef6994c48c1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:03.701582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1c47aa9b-bccf-4732-8387-4ef6994c48c1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:03.701582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c47aa9b-bccf-4732-8387-4ef6994c48c1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:03.701582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c47aa9b-bccf-4732-8387-4ef6994c48c1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:03.702903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c47aa9b-bccf-4732-8387-4ef6994c48c1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:03.702903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c47aa9b-bccf-4732-8387-4ef6994c48c1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:03.702903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c47aa9b-bccf-4732-8387-4ef6994c48c1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:03.702903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c47aa9b-bccf-4732-8387-4ef6994c48c1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:03.849182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1c47aa9b-bccf-4732-8387-4ef6994c48c1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:03.859811 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1c47aa9b-bccf-4732-8387-4ef6994c48c1 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9" status: 200 len: 1274 microversion: 2.1 time: 0.199317 Oct 29 01:07:03.864395 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 387/776] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:03 2022] GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 => generated 1274 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:03.871839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-4501e797-6c71-4df5-9ac0-24ae19f05657 req-f4477a39-dae9-4198-bd50-73c6482f080d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29fc33a2-ac2f-4c14-bf42-861c727f7dd6", "name": "network-vif-plugged", "status": "completed", "tag": "a55a9dd9-fbc3-4aac-bb41-9e1e7ca1b060"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:03.895224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4501e797-6c71-4df5-9ac0-24ae19f05657 req-f4477a39-dae9-4198-bd50-73c6482f080d service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:03.896105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4501e797-6c71-4df5-9ac0-24ae19f05657 req-f4477a39-dae9-4198-bd50-73c6482f080d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:03.896724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4501e797-6c71-4df5-9ac0-24ae19f05657 req-f4477a39-dae9-4198-bd50-73c6482f080d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:03.900017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:03.963408 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-4501e797-6c71-4df5-9ac0-24ae19f05657 req-f4477a39-dae9-4198-bd50-73c6482f080d service nova] Creating event network-vif-plugged:a55a9dd9-fbc3-4aac-bb41-9e1e7ca1b060 for instance 29fc33a2-ac2f-4c14-bf42-861c727f7dd6 on n-h1-862964-3 Oct 29 01:07:03.963408 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-4501e797-6c71-4df5-9ac0-24ae19f05657 req-f4477a39-dae9-4198-bd50-73c6482f080d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057008 Oct 29 01:07:03.963408 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 388/777] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:03.963408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dc56ab8a-186f-4a8e-9c58-46c764037278 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:03.963408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dc56ab8a-186f-4a8e-9c58-46c764037278 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:03.964506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dc56ab8a-186f-4a8e-9c58-46c764037278 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:03.964506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dc56ab8a-186f-4a8e-9c58-46c764037278 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:03.964506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dc56ab8a-186f-4a8e-9c58-46c764037278 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:03.964506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dc56ab8a-186f-4a8e-9c58-46c764037278 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:03.964829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dc56ab8a-186f-4a8e-9c58-46c764037278 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:03.964829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dc56ab8a-186f-4a8e-9c58-46c764037278 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:04.591255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-dc56ab8a-186f-4a8e-9c58-46c764037278 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:04.603366 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dc56ab8a-186f-4a8e-9c58-46c764037278 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1476 microversion: 2.1 time: 0.678349 Oct 29 01:07:04.603966 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 389/778] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:03 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1476 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:04.618084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b09275ea-4588-4ab9-aa3c-d738a63cc16e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:04.619021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b09275ea-4588-4ab9-aa3c-d738a63cc16e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:04.634543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b09275ea-4588-4ab9-aa3c-d738a63cc16e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:04.635310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b09275ea-4588-4ab9-aa3c-d738a63cc16e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:04.635952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b09275ea-4588-4ab9-aa3c-d738a63cc16e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:04.637585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b09275ea-4588-4ab9-aa3c-d738a63cc16e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:04.642406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b09275ea-4588-4ab9-aa3c-d738a63cc16e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:04.644547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b09275ea-4588-4ab9-aa3c-d738a63cc16e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:05.021590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b09275ea-4588-4ab9-aa3c-d738a63cc16e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:05.045904 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b09275ea-4588-4ab9-aa3c-d738a63cc16e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 200 len: 1322 microversion: 2.1 time: 0.429706 Oct 29 01:07:05.047779 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 390/779] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:04 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 1322 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:05.054062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-12d3a7b0-d2d8-4e03-b8b4-f36b52d3f703 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:05.055267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-12d3a7b0-d2d8-4e03-b8b4-f36b52d3f703 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:05.062578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12d3a7b0-d2d8-4e03-b8b4-f36b52d3f703 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:05.064111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12d3a7b0-d2d8-4e03-b8b4-f36b52d3f703 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:05.065125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12d3a7b0-d2d8-4e03-b8b4-f36b52d3f703 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:05.066575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12d3a7b0-d2d8-4e03-b8b4-f36b52d3f703 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:05.067278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12d3a7b0-d2d8-4e03-b8b4-f36b52d3f703 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:05.067919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12d3a7b0-d2d8-4e03-b8b4-f36b52d3f703 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:05.239815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-27a1fd17-d74a-4bc7-9934-e0e9de45804e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Updating instance_info_cache with network_info: [{"id": "8dcc0733-0f1e-41cd-9fc2-f9f371fc1086", "address": "fa:16:3e:3c:92:f9", "network": {"id": "126fc8bc-76ae-4d47-87ee-a1185490f9e0", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1391062101-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aed69fb18603408db6f91a05423e3ffb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8dcc0733-0f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121099) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 01:07:05.319523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27a1fd17-d74a-4bc7-9934-e0e9de45804e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Releasing lock "refresh_cache-5ee6daec-1cf6-45be-943c-20749b8d7d85" {{(pid=121099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 01:07:05.320408 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-27a1fd17-d74a-4bc7-9934-e0e9de45804e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "POST /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85/action" status: 202 len: 0 microversion: 2.1 time: 9.676672 Oct 29 01:07:05.321024 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 390/780] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:06:55 2022] POST /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85/action => generated 0 bytes in 9678 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 01:07:05.325669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d4a3266b-0b03-4dd4-897a-6eec9cc3b30b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:05.326278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d4a3266b-0b03-4dd4-897a-6eec9cc3b30b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:05.343929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4a3266b-0b03-4dd4-897a-6eec9cc3b30b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:05.345394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4a3266b-0b03-4dd4-897a-6eec9cc3b30b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:05.358087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4a3266b-0b03-4dd4-897a-6eec9cc3b30b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:05.362480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4a3266b-0b03-4dd4-897a-6eec9cc3b30b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:05.362480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4a3266b-0b03-4dd4-897a-6eec9cc3b30b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:05.362480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4a3266b-0b03-4dd4-897a-6eec9cc3b30b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:05.384021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-12d3a7b0-d2d8-4e03-b8b4-f36b52d3f703 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:05.400645 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-12d3a7b0-d2d8-4e03-b8b4-f36b52d3f703 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1369 microversion: 2.1 time: 0.351225 Oct 29 01:07:05.401725 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 391/781] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:05 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1369 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:05.425016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-087cfcae-74cb-4e30-8205-5bb97df3d06f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:05.425715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-087cfcae-74cb-4e30-8205-5bb97df3d06f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:05.443991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-087cfcae-74cb-4e30-8205-5bb97df3d06f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:05.444497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-087cfcae-74cb-4e30-8205-5bb97df3d06f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:05.444938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-087cfcae-74cb-4e30-8205-5bb97df3d06f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:05.445691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-087cfcae-74cb-4e30-8205-5bb97df3d06f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:05.446157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-087cfcae-74cb-4e30-8205-5bb97df3d06f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:05.446588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-087cfcae-74cb-4e30-8205-5bb97df3d06f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:05.841757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d4a3266b-0b03-4dd4-897a-6eec9cc3b30b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:05.846002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-087cfcae-74cb-4e30-8205-5bb97df3d06f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:05.865278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d4a3266b-0b03-4dd4-897a-6eec9cc3b30b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:05.873772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d4a3266b-0b03-4dd4-897a-6eec9cc3b30b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:05.883723 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-087cfcae-74cb-4e30-8205-5bb97df3d06f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9" status: 200 len: 1316 microversion: 2.1 time: 0.471433 Oct 29 01:07:05.883723 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 392/782] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:05 2022] GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 => generated 1316 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:05.883946 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d4a3266b-0b03-4dd4-897a-6eec9cc3b30b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1568 microversion: 2.25 time: 0.555562 Oct 29 01:07:05.883946 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 391/783] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:05 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1568 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:05.916990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-377cf554-7b52-464c-803e-14d3ecdfaf35 req-fb9cf4c8-5032-47e8-9ebf-e85e167a2165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ee6daec-1cf6-45be-943c-20749b8d7d85", "tag": "8dcc0733-0f1e-41cd-9fc2-f9f371fc1086"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:05.930062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-377cf554-7b52-464c-803e-14d3ecdfaf35 req-fb9cf4c8-5032-47e8-9ebf-e85e167a2165 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:05.930835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-377cf554-7b52-464c-803e-14d3ecdfaf35 req-fb9cf4c8-5032-47e8-9ebf-e85e167a2165 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:05.931474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-377cf554-7b52-464c-803e-14d3ecdfaf35 req-fb9cf4c8-5032-47e8-9ebf-e85e167a2165 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:05.959233 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-377cf554-7b52-464c-803e-14d3ecdfaf35 req-fb9cf4c8-5032-47e8-9ebf-e85e167a2165 service nova] Creating event network-changed:8dcc0733-0f1e-41cd-9fc2-f9f371fc1086 for instance 5ee6daec-1cf6-45be-943c-20749b8d7d85 on n-h2-862964-3 Oct 29 01:07:05.967176 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-377cf554-7b52-464c-803e-14d3ecdfaf35 req-fb9cf4c8-5032-47e8-9ebf-e85e167a2165 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085765 Oct 29 01:07:05.968445 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 393/784] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:05.977806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-23c987bf-9659-4d9b-ac53-7678678a638e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Action: 'create', calling method: .version_select at 0x7f9d9c042e50>, body: {"pool": "28a3ad30-a90e-4539-9105-75a1ae5b0ef9"} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:06.186966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ff6a84cb-4deb-4278-9266-0a4703819077 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1308059741", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "aa7f8f73-d2d1-4330-a914-f73cc0db67b6"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:06.354600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-ff6a84cb-4deb-4278-9266-0a4703819077 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] validate_networks() for [('aa7f8f73-d2d1-4330-a914-f73cc0db67b6', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:07:06.367265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:06.410648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:07.904538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ff6a84cb-4deb-4278-9266-0a4703819077 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:07:07.905009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ff6a84cb-4deb-4278-9266-0a4703819077 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:07:07.905531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ff6a84cb-4deb-4278-9266-0a4703819077 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:07:07.906367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ff6a84cb-4deb-4278-9266-0a4703819077 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:07:07.906876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ff6a84cb-4deb-4278-9266-0a4703819077 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:07:07.918187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff6a84cb-4deb-4278-9266-0a4703819077 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:07.918900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff6a84cb-4deb-4278-9266-0a4703819077 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:07.919409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff6a84cb-4deb-4278-9266-0a4703819077 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:07.920285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff6a84cb-4deb-4278-9266-0a4703819077 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:07.920836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff6a84cb-4deb-4278-9266-0a4703819077 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:07.921370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff6a84cb-4deb-4278-9266-0a4703819077 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:07.941953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-ff6a84cb-4deb-4278-9266-0a4703819077 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Getting quotas for project 6719b662fc734d2797d515778a57296d. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:07:07.947420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-ff6a84cb-4deb-4278-9266-0a4703819077 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Getting quotas for user da623c3132aa466aa25685aa45fceaf9 and project 6719b662fc734d2797d515778a57296d. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:07:07.962251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ff6a84cb-4deb-4278-9266-0a4703819077 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:07:07.965007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ff6a84cb-4deb-4278-9266-0a4703819077 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:07:08.078405 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ff6a84cb-4deb-4278-9266-0a4703819077 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.195084 Oct 29 01:07:08.079907 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 392/785] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:07:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:07:08.091783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ae0aad30-5d6e-4a5c-ace2-21b0dbfe89db tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:08.092704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ae0aad30-5d6e-4a5c-ace2-21b0dbfe89db tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:08.103062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae0aad30-5d6e-4a5c-ace2-21b0dbfe89db tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:08.104417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae0aad30-5d6e-4a5c-ace2-21b0dbfe89db tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:08.106002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae0aad30-5d6e-4a5c-ace2-21b0dbfe89db tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:08.106949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae0aad30-5d6e-4a5c-ace2-21b0dbfe89db tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:08.108216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae0aad30-5d6e-4a5c-ace2-21b0dbfe89db tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:08.108914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae0aad30-5d6e-4a5c-ace2-21b0dbfe89db tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:08.496944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ae0aad30-5d6e-4a5c-ace2-21b0dbfe89db tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:08.520765 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ae0aad30-5d6e-4a5c-ace2-21b0dbfe89db tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1476 microversion: 2.1 time: 0.439497 Oct 29 01:07:08.522676 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 393/786] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:08 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1476 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:08.535831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c1f91944-32d7-499c-bf3e-befab2216126 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:08.536970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c1f91944-32d7-499c-bf3e-befab2216126 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:08.550214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1f91944-32d7-499c-bf3e-befab2216126 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:08.551630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1f91944-32d7-499c-bf3e-befab2216126 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:08.552308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1f91944-32d7-499c-bf3e-befab2216126 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:08.554968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1f91944-32d7-499c-bf3e-befab2216126 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:08.555997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1f91944-32d7-499c-bf3e-befab2216126 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:08.556663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1f91944-32d7-499c-bf3e-befab2216126 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:08.864524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c1f91944-32d7-499c-bf3e-befab2216126 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:08.873077 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c1f91944-32d7-499c-bf3e-befab2216126 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 200 len: 1471 microversion: 2.1 time: 0.349236 Oct 29 01:07:08.873835 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 394/787] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:08 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 1471 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:08.878915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4069e95d-e20d-4898-9a53-80a608fc06df tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:08.879856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4069e95d-e20d-4898-9a53-80a608fc06df tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:08.886446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4069e95d-e20d-4898-9a53-80a608fc06df tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:08.887363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4069e95d-e20d-4898-9a53-80a608fc06df tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:08.888069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4069e95d-e20d-4898-9a53-80a608fc06df tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:08.889237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4069e95d-e20d-4898-9a53-80a608fc06df tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:08.889894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4069e95d-e20d-4898-9a53-80a608fc06df tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:08.890477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4069e95d-e20d-4898-9a53-80a608fc06df tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:09.091560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4069e95d-e20d-4898-9a53-80a608fc06df tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:09.101893 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4069e95d-e20d-4898-9a53-80a608fc06df tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1369 microversion: 2.1 time: 0.226943 Oct 29 01:07:09.106912 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 395/788] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:08 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1369 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:09.113190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-152be83a-40dd-48a6-b7cd-3e7aeae72a68 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:09.115344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-152be83a-40dd-48a6-b7cd-3e7aeae72a68 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:09.124226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-152be83a-40dd-48a6-b7cd-3e7aeae72a68 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:09.124743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-152be83a-40dd-48a6-b7cd-3e7aeae72a68 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:09.125368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-152be83a-40dd-48a6-b7cd-3e7aeae72a68 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:09.126073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-152be83a-40dd-48a6-b7cd-3e7aeae72a68 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:09.127326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-152be83a-40dd-48a6-b7cd-3e7aeae72a68 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:09.131061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-152be83a-40dd-48a6-b7cd-3e7aeae72a68 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:09.346331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-152be83a-40dd-48a6-b7cd-3e7aeae72a68 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:09.354882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-152be83a-40dd-48a6-b7cd-3e7aeae72a68 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:09.373311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-152be83a-40dd-48a6-b7cd-3e7aeae72a68 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:09.373311 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-152be83a-40dd-48a6-b7cd-3e7aeae72a68 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1568 microversion: 2.25 time: 0.249516 Oct 29 01:07:09.373311 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 396/789] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:09 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:09.373311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f73dbc48-7d13-472e-b9eb-e3f5ebc53de9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:09.373764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f73dbc48-7d13-472e-b9eb-e3f5ebc53de9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:09.373764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f73dbc48-7d13-472e-b9eb-e3f5ebc53de9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:09.373764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f73dbc48-7d13-472e-b9eb-e3f5ebc53de9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:09.373764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f73dbc48-7d13-472e-b9eb-e3f5ebc53de9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:09.374115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f73dbc48-7d13-472e-b9eb-e3f5ebc53de9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:09.374115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f73dbc48-7d13-472e-b9eb-e3f5ebc53de9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:09.374115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f73dbc48-7d13-472e-b9eb-e3f5ebc53de9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:09.590120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f73dbc48-7d13-472e-b9eb-e3f5ebc53de9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:09.598474 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f73dbc48-7d13-472e-b9eb-e3f5ebc53de9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9" status: 200 len: 1316 microversion: 2.1 time: 0.239402 Oct 29 01:07:09.599712 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 397/790] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:09 2022] GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:09.605824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-a008f83a-05ed-4184-908e-b7390e8b9e05 req-ae9a3581-4c33-4c4c-a5d1-8a315c9d5ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18b6f45-f426-4003-9d72-fa419f9190d9", "tag": "f526b6da-75af-4897-80a9-ff820e170edc"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:09.618475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a008f83a-05ed-4184-908e-b7390e8b9e05 req-ae9a3581-4c33-4c4c-a5d1-8a315c9d5ef8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:09.618957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a008f83a-05ed-4184-908e-b7390e8b9e05 req-ae9a3581-4c33-4c4c-a5d1-8a315c9d5ef8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:09.619391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a008f83a-05ed-4184-908e-b7390e8b9e05 req-ae9a3581-4c33-4c4c-a5d1-8a315c9d5ef8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:09.625078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:09.636775 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-a008f83a-05ed-4184-908e-b7390e8b9e05 req-ae9a3581-4c33-4c4c-a5d1-8a315c9d5ef8 service nova] Creating event network-changed:f526b6da-75af-4897-80a9-ff820e170edc for instance e18b6f45-f426-4003-9d72-fa419f9190d9 on n-h1-862964-3 Oct 29 01:07:09.648677 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-a008f83a-05ed-4184-908e-b7390e8b9e05 req-ae9a3581-4c33-4c4c-a5d1-8a315c9d5ef8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047071 Oct 29 01:07:09.649210 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 398/791] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:09.655692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0b84006c-3e9c-44d5-8bf6-5317b085b9ff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:09.656392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0b84006c-3e9c-44d5-8bf6-5317b085b9ff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:09.665530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b84006c-3e9c-44d5-8bf6-5317b085b9ff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:09.666293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b84006c-3e9c-44d5-8bf6-5317b085b9ff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:09.666891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b84006c-3e9c-44d5-8bf6-5317b085b9ff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:09.667821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b84006c-3e9c-44d5-8bf6-5317b085b9ff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:09.668452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b84006c-3e9c-44d5-8bf6-5317b085b9ff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:09.669103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b84006c-3e9c-44d5-8bf6-5317b085b9ff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:09.812387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0b84006c-3e9c-44d5-8bf6-5317b085b9ff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:09.824848 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0b84006c-3e9c-44d5-8bf6-5317b085b9ff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1215 microversion: 2.1 time: 0.174313 Oct 29 01:07:09.836849 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 399/792] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:09 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:09.848647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb4b57f6-0574-40aa-bf7c-db2d581288c2 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:09.849428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bb4b57f6-0574-40aa-bf7c-db2d581288c2 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:09.857450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb4b57f6-0574-40aa-bf7c-db2d581288c2 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:09.857450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb4b57f6-0574-40aa-bf7c-db2d581288c2 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:09.857450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb4b57f6-0574-40aa-bf7c-db2d581288c2 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:09.858203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb4b57f6-0574-40aa-bf7c-db2d581288c2 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:09.858820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb4b57f6-0574-40aa-bf7c-db2d581288c2 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:09.859411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb4b57f6-0574-40aa-bf7c-db2d581288c2 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:09.891691 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-23c987bf-9659-4d9b-ac53-7678678a638e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.921481 Oct 29 01:07:09.901017 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 394/793] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 29 01:07:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:09.903760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bb4b57f6-0574-40aa-bf7c-db2d581288c2 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:09.909278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-f1ad1126-de87-45ae-8bd7-8896ed957f55 req-cc6f3f93-3c49-473a-a4ce-d6a64696fe1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65c62cb3-ec7c-43fa-9840-1c0fef87ae15", "name": "network-vif-unplugged", "status": "completed", "tag": "edbb0f10-da6d-409d-8978-de8280afa7df"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb4b57f6-0574-40aa-bf7c-db2d581288c2 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Request method failure captured: Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6/diagnostics HTTP/1.1 Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHyaAVkNeg4A3bwjDtHGUWCq-Xi43MJ2jobg2M5s5bnjIZXmkEqAdtO04zP8KcGCZ15BLGtCjKBM6PouNjahKVL6LKPSmOLFvMSPvawPfQiCojnPaxaZ_EypmtmRYpa1iV7Whsfle4BnKo6w2ucF7HUFz8bfuX2rLyAWOJC0VHvRpXg Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 361ee1c7ea6a43258240e801fb45f440 Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1226875869 Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:07:09.915454 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:07:09.916878 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/361ee1c7ea6a43258240e801fb45f440"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/361ee1c7ea6a43258240e801fb45f440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/361ee1c7ea6a43258240e801fb45f440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_361ee1c7ea6a43258240e801fb45f440", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:07:09.916878 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1226875869 Oct 29 01:07:09.916878 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 361ee1c7ea6a43258240e801fb45f440 Oct 29 01:07:09.916878 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1226875869 Oct 29 01:07:09.916878 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerDiagnosticsNegativeTest-1226875869-project Oct 29 01:07:09.916878 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:07:09.916878 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:07:09.916878 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f1d4ceb600214ce2a80d48a0cd53a548 Oct 29 01:07:09.916878 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1226875869-project Oct 29 01:07:09.916878 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:07:09.916878 n-d-862964-3 devstack@n-api.service[121099]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'server_id': '29fc33a2-ac2f-4c14-bf42-861c727f7dd6'} Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:07:09.917715 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:07:09.919272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:07:09.919272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:07:09.919272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:07:09.919272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:07:09.919272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:07:09.919272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 29 01:07:09.919272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:09.919272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:09.919272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:09.919272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:09.919272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:09.919272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:09.919272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:07:09.919272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:07:09.919272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 29 01:07:09.919272 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:09.922395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb4b57f6-0574-40aa-bf7c-db2d581288c2 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:07:09.924176 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bb4b57f6-0574-40aa-bf7c-db2d581288c2 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.079465 Oct 29 01:07:09.929880 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 400/794] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:07:09 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6/diagnostics => generated 117 bytes in 93 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:07:09.934658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f1ad1126-de87-45ae-8bd7-8896ed957f55 req-cc6f3f93-3c49-473a-a4ce-d6a64696fe1f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:09.934658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f1ad1126-de87-45ae-8bd7-8896ed957f55 req-cc6f3f93-3c49-473a-a4ce-d6a64696fe1f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:09.934658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f1ad1126-de87-45ae-8bd7-8896ed957f55 req-cc6f3f93-3c49-473a-a4ce-d6a64696fe1f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:09.938685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-982dda06-95dd-40c7-a7a0-10abb3cf07f7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:09.939405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-982dda06-95dd-40c7-a7a0-10abb3cf07f7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:09.948299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-982dda06-95dd-40c7-a7a0-10abb3cf07f7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:09.952393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-982dda06-95dd-40c7-a7a0-10abb3cf07f7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:09.953114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-982dda06-95dd-40c7-a7a0-10abb3cf07f7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:09.954057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-982dda06-95dd-40c7-a7a0-10abb3cf07f7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:09.954691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-982dda06-95dd-40c7-a7a0-10abb3cf07f7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:09.957619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-982dda06-95dd-40c7-a7a0-10abb3cf07f7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:09.976914 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f1ad1126-de87-45ae-8bd7-8896ed957f55 req-cc6f3f93-3c49-473a-a4ce-d6a64696fe1f service nova] Creating event network-vif-unplugged:edbb0f10-da6d-409d-8978-de8280afa7df for instance 65c62cb3-ec7c-43fa-9840-1c0fef87ae15 on n-h1-862964-3 Oct 29 01:07:09.994403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [req-f1ad1126-de87-45ae-8bd7-8896ed957f55 req-cc6f3f93-3c49-473a-a4ce-d6a64696fe1f service nova] Instance 65c62cb3-ec7c-43fa-9840-1c0fef87ae15 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121100) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:07:10.010119 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-f1ad1126-de87-45ae-8bd7-8896ed957f55 req-cc6f3f93-3c49-473a-a4ce-d6a64696fe1f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107557 Oct 29 01:07:10.010762 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 395/795] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:10.017133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d6a43b16-eb75-431e-806c-0b5864974554 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Action: 'action', calling method: .version_select at 0x7f9d9d8c2af0>, body: {"addFloatingIp": {"address": "172.25.8.195"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:10.020441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d6a43b16-eb75-431e-806c-0b5864974554 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:10.029272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6a43b16-eb75-431e-806c-0b5864974554 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:10.030053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6a43b16-eb75-431e-806c-0b5864974554 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:10.030694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6a43b16-eb75-431e-806c-0b5864974554 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:10.031595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6a43b16-eb75-431e-806c-0b5864974554 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:10.032408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6a43b16-eb75-431e-806c-0b5864974554 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:10.034943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6a43b16-eb75-431e-806c-0b5864974554 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:10.107650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6a43b16-eb75-431e-806c-0b5864974554 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "refresh_cache-5ee6daec-1cf6-45be-943c-20749b8d7d85" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 01:07:10.108079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6a43b16-eb75-431e-806c-0b5864974554 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquired lock "refresh_cache-5ee6daec-1cf6-45be-943c-20749b8d7d85" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 01:07:10.172922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-982dda06-95dd-40c7-a7a0-10abb3cf07f7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:10.194415 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-982dda06-95dd-40c7-a7a0-10abb3cf07f7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1475 microversion: 2.1 time: 0.262991 Oct 29 01:07:10.195195 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 401/796] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:09 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1475 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:10.223411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6306a561-8e70-4b01-a7b3-ced3e5999aff tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:10.223411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6306a561-8e70-4b01-a7b3-ced3e5999aff tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:10.230172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6306a561-8e70-4b01-a7b3-ced3e5999aff tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:10.235160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6306a561-8e70-4b01-a7b3-ced3e5999aff tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:10.235913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6306a561-8e70-4b01-a7b3-ced3e5999aff tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:10.237431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6306a561-8e70-4b01-a7b3-ced3e5999aff tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:10.239352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6306a561-8e70-4b01-a7b3-ced3e5999aff tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:10.240079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6306a561-8e70-4b01-a7b3-ced3e5999aff tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:10.304360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6306a561-8e70-4b01-a7b3-ced3e5999aff tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:07:10.634618 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6306a561-8e70-4b01-a7b3-ced3e5999aff tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "DELETE /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 204 len: 0 microversion: 2.1 time: 0.429037 Oct 29 01:07:10.635955 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 402/797] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:07:10 2022] DELETE /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:07:10.643061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-458e384e-4861-4dc2-ac1b-a9a6d721402e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:10.644362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-458e384e-4861-4dc2-ac1b-a9a6d721402e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:10.651339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-458e384e-4861-4dc2-ac1b-a9a6d721402e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:10.651985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-458e384e-4861-4dc2-ac1b-a9a6d721402e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:10.652496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-458e384e-4861-4dc2-ac1b-a9a6d721402e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:10.653386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-458e384e-4861-4dc2-ac1b-a9a6d721402e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:10.654079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-458e384e-4861-4dc2-ac1b-a9a6d721402e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:10.654585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-458e384e-4861-4dc2-ac1b-a9a6d721402e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:10.654917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG neutronclient.v2_0.client [None req-d6a43b16-eb75-431e-806c-0b5864974554 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.8.195 (2ca3bc4a-f619-4811-87fd-3f66b9b54456) with port 8dcc0733-0f1e-41cd-9fc2-f9f371fc1086 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 28a3ad30-a90e-4539-9105-75a1ae5b0ef9.", "detail": ""}} {{(pid=121100) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:07:10.655551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6a43b16-eb75-431e-806c-0b5864974554 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Releasing lock "refresh_cache-5ee6daec-1cf6-45be-943c-20749b8d7d85" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 01:07:10.656456 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-d6a43b16-eb75-431e-806c-0b5864974554 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] HTTP exception thrown: Cannot associate floating IP 172.25.8.195 (2ca3bc4a-f619-4811-87fd-3f66b9b54456) with port 8dcc0733-0f1e-41cd-9fc2-f9f371fc1086 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 28a3ad30-a90e-4539-9105-75a1ae5b0ef9. Oct 29 01:07:10.656456 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-829ddf36-cb66-4fba-9c54-3313192c5445'] Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d6a43b16-eb75-431e-806c-0b5864974554 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Request method failure captured: Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85/action HTTP/1.1 Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 46 Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHyNM-oQJLOZR5D75mMgEVZWYe-L8kVeqFzbyjW9DOD4FI3jzoBXRVbBpc_E3VyN3o--xqQ6iimWGND3I50I4FgFmrsyNJuHwJDQtteMLBjg_tlensmRhl1TA7xEFVnYU4-dfFkDd4XyzlmvFJVm-4ImLXtOpvc2H8R9d2XkTF5Xu0I Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: aed69fb18603408db6f91a05423e3ffb Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:07:10.696124 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:07:10.697876 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aed69fb18603408db6f91a05423e3ffb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aed69fb18603408db6f91a05423e3ffb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aed69fb18603408db6f91a05423e3ffb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aed69fb18603408db6f91a05423e3ffb", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:07:10.697876 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 Oct 29 01:07:10.697876 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: aed69fb18603408db6f91a05423e3ffb Oct 29 01:07:10.697876 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 Oct 29 01:07:10.697876 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project Oct 29 01:07:10.697876 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:07:10.697876 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:07:10.697876 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 9d53762f33554711a9114f273918f2eb Oct 29 01:07:10.697876 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project Oct 29 01:07:10.697876 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:07:10.697876 n-d-862964-3 devstack@n-api.service[121100]: {"addFloatingIp": {"address": "172.25.8.195"}} Oct 29 01:07:10.697876 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:07:10.698802 n-d-862964-3 devstack@n-api.service[121100]: exception: Cannot associate floating IP 172.25.8.195 (2ca3bc4a-f619-4811-87fd-3f66b9b54456) with port 8dcc0733-0f1e-41cd-9fc2-f9f371fc1086 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 28a3ad30-a90e-4539-9105-75a1ae5b0ef9. Oct 29 01:07:10.698802 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-829ddf36-cb66-4fba-9c54-3313192c5445'] Oct 29 01:07:10.698802 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '5ee6daec-1cf6-45be-943c-20749b8d7d85', 'body': {'addFloatingIp': {'address': '172.25.8.195'}}} Oct 29 01:07:10.698802 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:07:10.698802 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:10.698802 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 29 01:07:10.698802 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 29 01:07:10.698802 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:07:10.698802 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:07:10.698802 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 29 01:07:10.698802 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 29 01:07:10.698802 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:07:10.698802 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:07:10.698802 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 29 01:07:10.698802 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 29 01:07:10.698802 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:07:10.698802 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:07:10.700638 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 29 01:07:10.700638 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 29 01:07:10.700638 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:07:10.700638 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:07:10.700638 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:07:10.700638 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:07:10.700638 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:07:10.700638 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:07:10.700638 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:07:10.700638 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:07:10.700638 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:07:10.700638 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:07:10.700638 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:07:10.700638 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:07:10.700638 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:07:10.700638 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:07:10.707421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.8.195 (2ca3bc4a-f619-4811-87fd-3f66b9b54456) with port 8dcc0733-0f1e-41cd-9fc2-f9f371fc1086 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 28a3ad30-a90e-4539-9105-75a1ae5b0ef9. Oct 29 01:07:10.707421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-829ddf36-cb66-4fba-9c54-3313192c5445'] Oct 29 01:07:10.707421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:10.707421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:10.707421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:10.707421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:10.707421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 29 01:07:10.707421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 29 01:07:10.707421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 29 01:07:10.707421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 29 01:07:10.707421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 29 01:07:10.707421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 29 01:07:10.707421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.8.195 (2ca3bc4a-f619-4811-87fd-3f66b9b54456) with port 8dcc0733-0f1e-41cd-9fc2-f9f371fc1086 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 28a3ad30-a90e-4539-9105-75a1ae5b0ef9. Oct 29 01:07:10.707421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-829ddf36-cb66-4fba-9c54-3313192c5445'] Oct 29 01:07:10.707421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:10.707421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:10.708697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:10.708697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:10.708697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:10.708697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:10.708697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:07:10.708697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:07:10.708697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:07:10.708697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:07:10.708697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:07:10.708697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:07:10.708697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:07:10.708697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:07:10.708697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 29 01:07:10.708697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 01:07:10.708697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.8.195 (2ca3bc4a-f619-4811-87fd-3f66b9b54456) with port 8dcc0733-0f1e-41cd-9fc2-f9f371fc1086 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 28a3ad30-a90e-4539-9105-75a1ae5b0ef9. Oct 29 01:07:10.708697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-829ddf36-cb66-4fba-9c54-3313192c5445'] Oct 29 01:07:10.708697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:10.708697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:10.710098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:10.710098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:10.710098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:10.710098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:10.710098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:07:10.710098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:07:10.710098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.8.195 (2ca3bc4a-f619-4811-87fd-3f66b9b54456) with port 8dcc0733-0f1e-41cd-9fc2-f9f371fc1086 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 28a3ad30-a90e-4539-9105-75a1ae5b0ef9. Oct 29 01:07:10.710098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-829ddf36-cb66-4fba-9c54-3313192c5445'] Oct 29 01:07:10.710098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:10.710098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d6a43b16-eb75-431e-806c-0b5864974554 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Returning 400 to user: Cannot associate floating IP 172.25.8.195 (2ca3bc4a-f619-4811-87fd-3f66b9b54456) with port 8dcc0733-0f1e-41cd-9fc2-f9f371fc1086 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 28a3ad30-a90e-4539-9105-75a1ae5b0ef9. Oct 29 01:07:10.710098 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-829ddf36-cb66-4fba-9c54-3313192c5445'] {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:07:10.710963 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d6a43b16-eb75-431e-806c-0b5864974554 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "POST /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85/action" status: 400 len: 382 microversion: 2.1 time: 0.685960 Oct 29 01:07:10.710963 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 396/798] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:07:10 2022] POST /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85/action => generated 382 bytes in 691 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:07:10.710963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-432cb682-99fb-4836-8beb-d293cf539d5e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:10.710963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-432cb682-99fb-4836-8beb-d293cf539d5e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:10.717651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-432cb682-99fb-4836-8beb-d293cf539d5e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:10.718199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-432cb682-99fb-4836-8beb-d293cf539d5e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:10.718638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-432cb682-99fb-4836-8beb-d293cf539d5e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:10.719374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-432cb682-99fb-4836-8beb-d293cf539d5e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:10.719824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-432cb682-99fb-4836-8beb-d293cf539d5e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:10.720633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-432cb682-99fb-4836-8beb-d293cf539d5e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:10.862296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-458e384e-4861-4dc2-ac1b-a9a6d721402e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:10.870954 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-458e384e-4861-4dc2-ac1b-a9a6d721402e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1369 microversion: 2.1 time: 0.233517 Oct 29 01:07:10.871640 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 403/799] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:10 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1369 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:10.877736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-95ecc45d-6b16-40ef-9784-231f912538e7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:10.878604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-95ecc45d-6b16-40ef-9784-231f912538e7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:10.884568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95ecc45d-6b16-40ef-9784-231f912538e7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:10.885130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95ecc45d-6b16-40ef-9784-231f912538e7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:10.885669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95ecc45d-6b16-40ef-9784-231f912538e7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:10.886460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95ecc45d-6b16-40ef-9784-231f912538e7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:10.887122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95ecc45d-6b16-40ef-9784-231f912538e7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:10.887763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95ecc45d-6b16-40ef-9784-231f912538e7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:10.903470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-432cb682-99fb-4836-8beb-d293cf539d5e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:10.912504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-432cb682-99fb-4836-8beb-d293cf539d5e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:10.914033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-432cb682-99fb-4836-8beb-d293cf539d5e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:10.915209 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-432cb682-99fb-4836-8beb-d293cf539d5e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1568 microversion: 2.25 time: 0.211159 Oct 29 01:07:10.915777 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 397/800] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:10 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:10.920356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3c064f1a-a7c2-4664-8fc7-6438de7ede0e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:10.921187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3c064f1a-a7c2-4664-8fc7-6438de7ede0e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:10.923087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:10.928294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c064f1a-a7c2-4664-8fc7-6438de7ede0e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:10.928791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c064f1a-a7c2-4664-8fc7-6438de7ede0e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:10.929293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c064f1a-a7c2-4664-8fc7-6438de7ede0e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:10.930001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c064f1a-a7c2-4664-8fc7-6438de7ede0e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:10.930459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c064f1a-a7c2-4664-8fc7-6438de7ede0e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:10.931064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c064f1a-a7c2-4664-8fc7-6438de7ede0e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:11.074553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-95ecc45d-6b16-40ef-9784-231f912538e7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:11.083031 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-95ecc45d-6b16-40ef-9784-231f912538e7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9" status: 200 len: 1316 microversion: 2.1 time: 0.209541 Oct 29 01:07:11.083631 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 404/801] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:10 2022] GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:11.088138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-912e2d19-30fe-4491-bdd5-ae7c186fdb65 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '.version_select at 0x7f9d97d7f790>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:11.109273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3c064f1a-a7c2-4664-8fc7-6438de7ede0e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:11.117186 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3c064f1a-a7c2-4664-8fc7-6438de7ede0e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 200 len: 1477 microversion: 2.1 time: 0.200248 Oct 29 01:07:11.118057 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 398/802] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:10 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 1477 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:11.122669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eabcef6c-3622-41cb-926d-8fe2bc91ee3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:11.123281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-eabcef6c-3622-41cb-926d-8fe2bc91ee3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:11.129145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eabcef6c-3622-41cb-926d-8fe2bc91ee3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:11.130617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eabcef6c-3622-41cb-926d-8fe2bc91ee3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:11.130617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eabcef6c-3622-41cb-926d-8fe2bc91ee3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:11.130818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eabcef6c-3622-41cb-926d-8fe2bc91ee3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:11.131248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eabcef6c-3622-41cb-926d-8fe2bc91ee3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:11.131706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eabcef6c-3622-41cb-926d-8fe2bc91ee3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:11.215129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-eabcef6c-3622-41cb-926d-8fe2bc91ee3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:11.223681 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-eabcef6c-3622-41cb-926d-8fe2bc91ee3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1215 microversion: 2.1 time: 0.104540 Oct 29 01:07:11.224432 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 399/803] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:11 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:11.228763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-28eecd37-74d8-4ead-9248-31a7ced88c53 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:11.229398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-28eecd37-74d8-4ead-9248-31a7ced88c53 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:11.235296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28eecd37-74d8-4ead-9248-31a7ced88c53 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:11.235810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28eecd37-74d8-4ead-9248-31a7ced88c53 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:11.236248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28eecd37-74d8-4ead-9248-31a7ced88c53 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:11.237479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28eecd37-74d8-4ead-9248-31a7ced88c53 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:11.238576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28eecd37-74d8-4ead-9248-31a7ced88c53 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:11.239327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28eecd37-74d8-4ead-9248-31a7ced88c53 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:11.470961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-28eecd37-74d8-4ead-9248-31a7ced88c53 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:11.479947 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-28eecd37-74d8-4ead-9248-31a7ced88c53 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1475 microversion: 2.1 time: 0.254686 Oct 29 01:07:11.480532 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 400/804] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:11 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1475 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:11.895735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-454c4740-b591-4825-9219-c3aace9f599e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:11.896281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-454c4740-b591-4825-9219-c3aace9f599e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:11.902719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-454c4740-b591-4825-9219-c3aace9f599e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:11.903199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-454c4740-b591-4825-9219-c3aace9f599e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:11.903634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-454c4740-b591-4825-9219-c3aace9f599e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:11.904321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-454c4740-b591-4825-9219-c3aace9f599e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:11.904770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-454c4740-b591-4825-9219-c3aace9f599e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:11.905212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-454c4740-b591-4825-9219-c3aace9f599e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:12.064334 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-912e2d19-30fe-4491-bdd5-ae7c186fdb65 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/2ca3bc4a-f619-4811-87fd-3f66b9b54456" status: 202 len: 0 microversion: 2.1 time: 0.979626 Oct 29 01:07:12.065817 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 405/805] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:07:11 2022] DELETE /compute/v2.1/os-floating-ips/2ca3bc4a-f619-4811-87fd-3f66b9b54456 => generated 0 bytes in 982 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:07:12.071547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-35f12b38-8012-4533-8bad-0c36adc87aec tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:12.072356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-35f12b38-8012-4533-8bad-0c36adc87aec tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:12.079357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35f12b38-8012-4533-8bad-0c36adc87aec tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:12.079874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35f12b38-8012-4533-8bad-0c36adc87aec tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:12.080986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35f12b38-8012-4533-8bad-0c36adc87aec tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:12.082286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35f12b38-8012-4533-8bad-0c36adc87aec tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:12.082753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35f12b38-8012-4533-8bad-0c36adc87aec tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:12.083185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35f12b38-8012-4533-8bad-0c36adc87aec tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:12.095362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-454c4740-b591-4825-9219-c3aace9f599e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:12.104364 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-454c4740-b591-4825-9219-c3aace9f599e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1369 microversion: 2.1 time: 0.213236 Oct 29 01:07:12.104947 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 401/806] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:11 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1369 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:12.109523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b53fd995-1f38-454c-8e67-970b631b039b tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Action: 'action', calling method: .version_select at 0x7f9d9d8c2c10>, body: {"removeFloatingIp": {"address": "172.25.8.86"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:12.579346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-35f12b38-8012-4533-8bad-0c36adc87aec tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:12.588019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-35f12b38-8012-4533-8bad-0c36adc87aec tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:12.589574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-35f12b38-8012-4533-8bad-0c36adc87aec tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:12.590648 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-35f12b38-8012-4533-8bad-0c36adc87aec tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1568 microversion: 2.25 time: 0.523718 Oct 29 01:07:12.591104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b53fd995-1f38-454c-8e67-970b631b039b tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:12.591259 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 406/807] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:12 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1568 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:12.595711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b5f8bc2a-1b55-4b1c-978b-a3fda5bafae2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:12.597711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b5f8bc2a-1b55-4b1c-978b-a3fda5bafae2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:12.598677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b53fd995-1f38-454c-8e67-970b631b039b tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:12.599238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b53fd995-1f38-454c-8e67-970b631b039b tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:12.599745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b53fd995-1f38-454c-8e67-970b631b039b tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:12.600520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b53fd995-1f38-454c-8e67-970b631b039b tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:12.601210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b53fd995-1f38-454c-8e67-970b631b039b tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:12.601888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b53fd995-1f38-454c-8e67-970b631b039b tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:12.603653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5f8bc2a-1b55-4b1c-978b-a3fda5bafae2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:12.604142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5f8bc2a-1b55-4b1c-978b-a3fda5bafae2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:12.604580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5f8bc2a-1b55-4b1c-978b-a3fda5bafae2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:12.605362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5f8bc2a-1b55-4b1c-978b-a3fda5bafae2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:12.606035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5f8bc2a-1b55-4b1c-978b-a3fda5bafae2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:12.606269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5f8bc2a-1b55-4b1c-978b-a3fda5bafae2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:12.840185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b5f8bc2a-1b55-4b1c-978b-a3fda5bafae2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:12.848437 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b5f8bc2a-1b55-4b1c-978b-a3fda5bafae2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9" status: 200 len: 1316 microversion: 2.1 time: 0.256259 Oct 29 01:07:12.849018 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 407/808] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:12 2022] GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 => generated 1316 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:12.853438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4b0d6755-63db-4f41-abec-07d9c511e04f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:12.854044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4b0d6755-63db-4f41-abec-07d9c511e04f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:12.859726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b0d6755-63db-4f41-abec-07d9c511e04f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:12.860206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b0d6755-63db-4f41-abec-07d9c511e04f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:12.860639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b0d6755-63db-4f41-abec-07d9c511e04f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:12.861352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b0d6755-63db-4f41-abec-07d9c511e04f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:12.861869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b0d6755-63db-4f41-abec-07d9c511e04f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:12.862285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b0d6755-63db-4f41-abec-07d9c511e04f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:12.888936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b53fd995-1f38-454c-8e67-970b631b039b tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "refresh_cache-5ee6daec-1cf6-45be-943c-20749b8d7d85" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 01:07:12.889392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b53fd995-1f38-454c-8e67-970b631b039b tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquired lock "refresh_cache-5ee6daec-1cf6-45be-943c-20749b8d7d85" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 01:07:13.191034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4b0d6755-63db-4f41-abec-07d9c511e04f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:13.200908 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4b0d6755-63db-4f41-abec-07d9c511e04f tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 200 len: 1477 microversion: 2.1 time: 0.350825 Oct 29 01:07:13.203798 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 408/809] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:12 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 1477 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:13.222366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3f14746d-a93c-412a-8f80-3b71385efbec tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:13.223095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3f14746d-a93c-412a-8f80-3b71385efbec tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:13.232545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f14746d-a93c-412a-8f80-3b71385efbec tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:13.232545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f14746d-a93c-412a-8f80-3b71385efbec tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:13.232545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f14746d-a93c-412a-8f80-3b71385efbec tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:13.233298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f14746d-a93c-412a-8f80-3b71385efbec tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:13.233761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f14746d-a93c-412a-8f80-3b71385efbec tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:13.234369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f14746d-a93c-412a-8f80-3b71385efbec tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:13.364577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3f14746d-a93c-412a-8f80-3b71385efbec tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:13.373331 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3f14746d-a93c-412a-8f80-3b71385efbec tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1207 microversion: 2.1 time: 0.170274 Oct 29 01:07:13.389508 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 409/810] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:13 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1207 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:13.396941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a18e72ca-0af1-4126-bb44-e0d206a6eb72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:13.397616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a18e72ca-0af1-4126-bb44-e0d206a6eb72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:13.404062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a18e72ca-0af1-4126-bb44-e0d206a6eb72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:13.404677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a18e72ca-0af1-4126-bb44-e0d206a6eb72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:13.405362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a18e72ca-0af1-4126-bb44-e0d206a6eb72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:13.406104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a18e72ca-0af1-4126-bb44-e0d206a6eb72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:13.406619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a18e72ca-0af1-4126-bb44-e0d206a6eb72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:13.407105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a18e72ca-0af1-4126-bb44-e0d206a6eb72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:13.773615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a18e72ca-0af1-4126-bb44-e0d206a6eb72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:13.784390 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a18e72ca-0af1-4126-bb44-e0d206a6eb72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1475 microversion: 2.1 time: 0.392472 Oct 29 01:07:13.802098 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 410/811] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:13 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1475 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:13.808959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d8950ecc-73fa-40e2-a7af-0f3d769d73b0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:13.809609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d8950ecc-73fa-40e2-a7af-0f3d769d73b0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:13.818704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8950ecc-73fa-40e2-a7af-0f3d769d73b0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:13.819199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8950ecc-73fa-40e2-a7af-0f3d769d73b0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:13.819618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8950ecc-73fa-40e2-a7af-0f3d769d73b0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:13.820407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8950ecc-73fa-40e2-a7af-0f3d769d73b0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:13.820936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8950ecc-73fa-40e2-a7af-0f3d769d73b0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:13.821603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8950ecc-73fa-40e2-a7af-0f3d769d73b0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:14.246070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d8950ecc-73fa-40e2-a7af-0f3d769d73b0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:14.260739 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d8950ecc-73fa-40e2-a7af-0f3d769d73b0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1369 microversion: 2.1 time: 0.457422 Oct 29 01:07:14.262857 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 411/812] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:13 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1369 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:14.273533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-35300e9f-b44a-4672-97bc-5024d5f37a15 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:14.276125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-35300e9f-b44a-4672-97bc-5024d5f37a15 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:14.289726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35300e9f-b44a-4672-97bc-5024d5f37a15 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:14.290629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35300e9f-b44a-4672-97bc-5024d5f37a15 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:14.291233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35300e9f-b44a-4672-97bc-5024d5f37a15 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:14.292695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35300e9f-b44a-4672-97bc-5024d5f37a15 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:14.293371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35300e9f-b44a-4672-97bc-5024d5f37a15 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:14.293954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35300e9f-b44a-4672-97bc-5024d5f37a15 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:14.619687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-35300e9f-b44a-4672-97bc-5024d5f37a15 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:14.621377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-35300e9f-b44a-4672-97bc-5024d5f37a15 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:14.623369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-35300e9f-b44a-4672-97bc-5024d5f37a15 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:14.625564 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-35300e9f-b44a-4672-97bc-5024d5f37a15 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1568 microversion: 2.25 time: 0.359351 Oct 29 01:07:14.630298 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 412/813] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:14 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1568 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:14.637783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-25fd3ae6-fb08-47d9-b117-daa24b92d645 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:14.641807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-25fd3ae6-fb08-47d9-b117-daa24b92d645 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:14.646562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:14.648260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25fd3ae6-fb08-47d9-b117-daa24b92d645 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:14.648835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25fd3ae6-fb08-47d9-b117-daa24b92d645 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:14.649608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25fd3ae6-fb08-47d9-b117-daa24b92d645 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:14.650575 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25fd3ae6-fb08-47d9-b117-daa24b92d645 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:14.651118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25fd3ae6-fb08-47d9-b117-daa24b92d645 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:14.651614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25fd3ae6-fb08-47d9-b117-daa24b92d645 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:14.676998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-b53fd995-1f38-454c-8e67-970b631b039b tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Building network info cache for instance {{(pid=121100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 01:07:15.054207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-25fd3ae6-fb08-47d9-b117-daa24b92d645 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:15.067639 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-25fd3ae6-fb08-47d9-b117-daa24b92d645 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9" status: 200 len: 1316 microversion: 2.1 time: 0.435932 Oct 29 01:07:15.068805 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 413/814] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:14 2022] GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:15.073707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4759634f-2949-49fe-93c3-94fb741b4955 req-79cf3fa7-9da7-48d1-81b6-5767f72f64f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65c62cb3-ec7c-43fa-9840-1c0fef87ae15", "tag": "edbb0f10-da6d-409d-8978-de8280afa7df"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:15.107634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4759634f-2949-49fe-93c3-94fb741b4955 req-79cf3fa7-9da7-48d1-81b6-5767f72f64f4 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:15.110869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4759634f-2949-49fe-93c3-94fb741b4955 req-79cf3fa7-9da7-48d1-81b6-5767f72f64f4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:15.112936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4759634f-2949-49fe-93c3-94fb741b4955 req-79cf3fa7-9da7-48d1-81b6-5767f72f64f4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:15.159461 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4759634f-2949-49fe-93c3-94fb741b4955 req-79cf3fa7-9da7-48d1-81b6-5767f72f64f4 service nova] Creating event network-changed:edbb0f10-da6d-409d-8978-de8280afa7df for instance 65c62cb3-ec7c-43fa-9840-1c0fef87ae15 on n-h1-862964-3 Oct 29 01:07:15.181309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [req-4759634f-2949-49fe-93c3-94fb741b4955 req-79cf3fa7-9da7-48d1-81b6-5767f72f64f4 service nova] Instance 65c62cb3-ec7c-43fa-9840-1c0fef87ae15 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121099) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:07:15.211847 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4759634f-2949-49fe-93c3-94fb741b4955 req-79cf3fa7-9da7-48d1-81b6-5767f72f64f4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141409 Oct 29 01:07:15.221789 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 414/815] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:15.228695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-037f1882-2922-4a3f-ad71-aea3bfa006d3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:15.230495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-037f1882-2922-4a3f-ad71-aea3bfa006d3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:15.257687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-037f1882-2922-4a3f-ad71-aea3bfa006d3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:15.257687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-037f1882-2922-4a3f-ad71-aea3bfa006d3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:15.257687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-037f1882-2922-4a3f-ad71-aea3bfa006d3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:15.257687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-037f1882-2922-4a3f-ad71-aea3bfa006d3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:15.258522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-037f1882-2922-4a3f-ad71-aea3bfa006d3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:15.258522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-037f1882-2922-4a3f-ad71-aea3bfa006d3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:15.297385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:15.733873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-037f1882-2922-4a3f-ad71-aea3bfa006d3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:15.748040 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-037f1882-2922-4a3f-ad71-aea3bfa006d3 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 200 len: 1307 microversion: 2.1 time: 0.524593 Oct 29 01:07:15.753883 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 415/816] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:15 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 1307 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:15.762917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-78e76c4f-bda6-42a5-b804-b01aa55d16c6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:15.764819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-78e76c4f-bda6-42a5-b804-b01aa55d16c6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:15.775167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78e76c4f-bda6-42a5-b804-b01aa55d16c6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:15.775992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78e76c4f-bda6-42a5-b804-b01aa55d16c6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:15.777225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78e76c4f-bda6-42a5-b804-b01aa55d16c6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:15.778729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78e76c4f-bda6-42a5-b804-b01aa55d16c6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:15.779381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78e76c4f-bda6-42a5-b804-b01aa55d16c6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:15.780319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78e76c4f-bda6-42a5-b804-b01aa55d16c6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:15.915229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-78e76c4f-bda6-42a5-b804-b01aa55d16c6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:15.926128 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-78e76c4f-bda6-42a5-b804-b01aa55d16c6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1269 microversion: 2.1 time: 0.170550 Oct 29 01:07:15.936029 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 416/817] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:15 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1269 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:15.936029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-f9ff3c8b-defc-4966-bb87-c8945c8f2f0b req-fca594bd-035d-451a-a222-ce942516a17a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ee6daec-1cf6-45be-943c-20749b8d7d85", "tag": "8dcc0733-0f1e-41cd-9fc2-f9f371fc1086"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:15.958340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f9ff3c8b-defc-4966-bb87-c8945c8f2f0b req-fca594bd-035d-451a-a222-ce942516a17a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:15.959118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f9ff3c8b-defc-4966-bb87-c8945c8f2f0b req-fca594bd-035d-451a-a222-ce942516a17a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:15.959717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f9ff3c8b-defc-4966-bb87-c8945c8f2f0b req-fca594bd-035d-451a-a222-ce942516a17a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:15.975797 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-f9ff3c8b-defc-4966-bb87-c8945c8f2f0b req-fca594bd-035d-451a-a222-ce942516a17a service nova] Creating event network-changed:8dcc0733-0f1e-41cd-9fc2-f9f371fc1086 for instance 5ee6daec-1cf6-45be-943c-20749b8d7d85 on n-h2-862964-3 Oct 29 01:07:15.982488 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-f9ff3c8b-defc-4966-bb87-c8945c8f2f0b req-fca594bd-035d-451a-a222-ce942516a17a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054547 Oct 29 01:07:15.985412 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 417/818] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:15.992725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80e75519-9b17-42f5-99a6-29c7ade2e7a4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:16.008410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-80e75519-9b17-42f5-99a6-29c7ade2e7a4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:16.045528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80e75519-9b17-42f5-99a6-29c7ade2e7a4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:16.053513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80e75519-9b17-42f5-99a6-29c7ade2e7a4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:16.054067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80e75519-9b17-42f5-99a6-29c7ade2e7a4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:16.059620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80e75519-9b17-42f5-99a6-29c7ade2e7a4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:16.063980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80e75519-9b17-42f5-99a6-29c7ade2e7a4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:16.065044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80e75519-9b17-42f5-99a6-29c7ade2e7a4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:16.495211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-80e75519-9b17-42f5-99a6-29c7ade2e7a4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:16.512298 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-80e75519-9b17-42f5-99a6-29c7ade2e7a4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1475 microversion: 2.1 time: 0.524346 Oct 29 01:07:16.514168 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 418/819] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:15 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1475 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:16.521537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8fccf828-f82f-45b8-b0d0-134a9672f0b1 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:16.524326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8fccf828-f82f-45b8-b0d0-134a9672f0b1 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:16.538861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8fccf828-f82f-45b8-b0d0-134a9672f0b1 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:16.539400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8fccf828-f82f-45b8-b0d0-134a9672f0b1 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:16.539850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8fccf828-f82f-45b8-b0d0-134a9672f0b1 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:16.540602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8fccf828-f82f-45b8-b0d0-134a9672f0b1 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:16.541078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8fccf828-f82f-45b8-b0d0-134a9672f0b1 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:16.541531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8fccf828-f82f-45b8-b0d0-134a9672f0b1 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:16.557418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-b53fd995-1f38-454c-8e67-970b631b039b tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Updating instance_info_cache with network_info: [{"id": "8dcc0733-0f1e-41cd-9fc2-f9f371fc1086", "address": "fa:16:3e:3c:92:f9", "network": {"id": "126fc8bc-76ae-4d47-87ee-a1185490f9e0", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1391062101-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "aed69fb18603408db6f91a05423e3ffb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8dcc0733-0f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 01:07:16.656786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b53fd995-1f38-454c-8e67-970b631b039b tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Releasing lock "refresh_cache-5ee6daec-1cf6-45be-943c-20749b8d7d85" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 01:07:16.657960 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b53fd995-1f38-454c-8e67-970b631b039b tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "POST /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85/action" status: 202 len: 0 microversion: 2.1 time: 4.552034 Oct 29 01:07:16.660335 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 402/820] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:07:12 2022] POST /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85/action => generated 0 bytes in 4555 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 01:07:16.666169 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-336fc22b-16a2-4917-889b-f0ab15a3bfe7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:16.667278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-336fc22b-16a2-4917-889b-f0ab15a3bfe7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:16.675538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-336fc22b-16a2-4917-889b-f0ab15a3bfe7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:16.676252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-336fc22b-16a2-4917-889b-f0ab15a3bfe7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:16.676998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-336fc22b-16a2-4917-889b-f0ab15a3bfe7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:16.677957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-336fc22b-16a2-4917-889b-f0ab15a3bfe7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:16.680011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-336fc22b-16a2-4917-889b-f0ab15a3bfe7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:16.681049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-336fc22b-16a2-4917-889b-f0ab15a3bfe7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:16.848724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8fccf828-f82f-45b8-b0d0-134a9672f0b1 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:16.860144 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8fccf828-f82f-45b8-b0d0-134a9672f0b1 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1369 microversion: 2.1 time: 0.343006 Oct 29 01:07:16.860877 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 419/821] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:16 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1369 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:16.870386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8dd5113b-913d-4cf3-b4a6-c00ade45d44d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:16.871427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8dd5113b-913d-4cf3-b4a6-c00ade45d44d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:16.881757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8dd5113b-913d-4cf3-b4a6-c00ade45d44d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:16.882806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8dd5113b-913d-4cf3-b4a6-c00ade45d44d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:16.884548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8dd5113b-913d-4cf3-b4a6-c00ade45d44d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:16.885341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8dd5113b-913d-4cf3-b4a6-c00ade45d44d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:16.886368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8dd5113b-913d-4cf3-b4a6-c00ade45d44d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:16.886791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8dd5113b-913d-4cf3-b4a6-c00ade45d44d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:17.025479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-336fc22b-16a2-4917-889b-f0ab15a3bfe7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:17.034458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-336fc22b-16a2-4917-889b-f0ab15a3bfe7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:17.036805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-336fc22b-16a2-4917-889b-f0ab15a3bfe7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:17.038553 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-336fc22b-16a2-4917-889b-f0ab15a3bfe7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1543 microversion: 2.25 time: 0.376749 Oct 29 01:07:17.039562 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 403/822] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:16 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1543 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:17.060688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ded7cea7-1548-4e92-a09a-a33dd1385559 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '.version_select at 0x7f9d97f56c10>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:17.112170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8dd5113b-913d-4cf3-b4a6-c00ade45d44d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:17.120417 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8dd5113b-913d-4cf3-b4a6-c00ade45d44d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9" status: 200 len: 1316 microversion: 2.1 time: 0.257486 Oct 29 01:07:17.121461 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 420/823] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:16 2022] GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:17.126629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d774dd29-f9a2-4802-a776-efb535fa329b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:17.128293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d774dd29-f9a2-4802-a776-efb535fa329b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:17.136655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d774dd29-f9a2-4802-a776-efb535fa329b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:17.136655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d774dd29-f9a2-4802-a776-efb535fa329b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:17.136655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d774dd29-f9a2-4802-a776-efb535fa329b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:17.136655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d774dd29-f9a2-4802-a776-efb535fa329b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:17.137297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d774dd29-f9a2-4802-a776-efb535fa329b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:17.138000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d774dd29-f9a2-4802-a776-efb535fa329b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:17.170939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d774dd29-f9a2-4802-a776-efb535fa329b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:17.171433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d774dd29-f9a2-4802-a776-efb535fa329b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:17.171872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d774dd29-f9a2-4802-a776-efb535fa329b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:17.172327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-d774dd29-f9a2-4802-a776-efb535fa329b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lazy-loading 'fault' on Instance uuid 29fc33a2-ac2f-4c14-bf42-861c727f7dd6 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:07:17.271908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d774dd29-f9a2-4802-a776-efb535fa329b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:17.280402 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d774dd29-f9a2-4802-a776-efb535fa329b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 200 len: 1312 microversion: 2.1 time: 0.156920 Oct 29 01:07:17.280509 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 421/824] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:17 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:17.285528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-800b1d0f-ab4f-4fe9-83b3-c15bce478f4a req-1a17d9f8-8283-426a-83e0-3b2cebbdb86b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18b6f45-f426-4003-9d72-fa419f9190d9", "name": "network-vif-plugged", "status": "completed", "tag": "f526b6da-75af-4897-80a9-ff820e170edc"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:17.295921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-800b1d0f-ab4f-4fe9-83b3-c15bce478f4a req-1a17d9f8-8283-426a-83e0-3b2cebbdb86b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:17.296265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-800b1d0f-ab4f-4fe9-83b3-c15bce478f4a req-1a17d9f8-8283-426a-83e0-3b2cebbdb86b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:17.296693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-800b1d0f-ab4f-4fe9-83b3-c15bce478f4a req-1a17d9f8-8283-426a-83e0-3b2cebbdb86b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:17.309424 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-800b1d0f-ab4f-4fe9-83b3-c15bce478f4a req-1a17d9f8-8283-426a-83e0-3b2cebbdb86b service nova] Creating event network-vif-plugged:f526b6da-75af-4897-80a9-ff820e170edc for instance e18b6f45-f426-4003-9d72-fa419f9190d9 on n-h1-862964-3 Oct 29 01:07:17.314296 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-800b1d0f-ab4f-4fe9-83b3-c15bce478f4a req-1a17d9f8-8283-426a-83e0-3b2cebbdb86b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032701 Oct 29 01:07:17.314938 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 422/825] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:17.320967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eb8e629d-ede1-47a5-b686-b649d3b4110f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:17.321764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eb8e629d-ede1-47a5-b686-b649d3b4110f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:17.328265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb8e629d-ede1-47a5-b686-b649d3b4110f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:17.328766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb8e629d-ede1-47a5-b686-b649d3b4110f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:17.329254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb8e629d-ede1-47a5-b686-b649d3b4110f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:17.329957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb8e629d-ede1-47a5-b686-b649d3b4110f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:17.331300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb8e629d-ede1-47a5-b686-b649d3b4110f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:17.331899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb8e629d-ede1-47a5-b686-b649d3b4110f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:17.594639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eb8e629d-ede1-47a5-b686-b649d3b4110f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:17.603115 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eb8e629d-ede1-47a5-b686-b649d3b4110f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1311 microversion: 2.1 time: 0.286828 Oct 29 01:07:17.603697 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 423/826] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:17 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1311 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:17.608120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-992d107f-53c2-4e02-b5b9-a062d56d2a47 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '.version_select at 0x7f9d97caef70>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:17.617259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-992d107f-53c2-4e02-b5b9-a062d56d2a47 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:17.617259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-992d107f-53c2-4e02-b5b9-a062d56d2a47 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:17.617259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-992d107f-53c2-4e02-b5b9-a062d56d2a47 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:17.621644 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-992d107f-53c2-4e02-b5b9-a062d56d2a47 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1529 microversion: 2.25 time: 0.016765 Oct 29 01:07:17.622242 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 424/827] 10.222.0.26 () {60 vars in 1184 bytes} [Sat Oct 29 01:07:17 2022] GET /compute/v2.1/os-migrations => generated 1529 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:17.626949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-11b40a9b-0332-4f5d-b020-8d90a713754b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:17.627566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-11b40a9b-0332-4f5d-b020-8d90a713754b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:17.634233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11b40a9b-0332-4f5d-b020-8d90a713754b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:17.634728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11b40a9b-0332-4f5d-b020-8d90a713754b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:17.635170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11b40a9b-0332-4f5d-b020-8d90a713754b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:17.635874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11b40a9b-0332-4f5d-b020-8d90a713754b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:17.636368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11b40a9b-0332-4f5d-b020-8d90a713754b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:17.636795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11b40a9b-0332-4f5d-b020-8d90a713754b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:17.860077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-11b40a9b-0332-4f5d-b020-8d90a713754b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:17.870731 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-11b40a9b-0332-4f5d-b020-8d90a713754b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1473 microversion: 2.1 time: 0.247458 Oct 29 01:07:17.871393 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 425/828] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:17 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1473 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:17.888208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a6e07595-128e-40bc-951d-5609b9b22187 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:17.888828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a6e07595-128e-40bc-951d-5609b9b22187 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:17.895201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6e07595-128e-40bc-951d-5609b9b22187 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:17.895533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6e07595-128e-40bc-951d-5609b9b22187 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:17.895978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6e07595-128e-40bc-951d-5609b9b22187 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:17.896827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6e07595-128e-40bc-951d-5609b9b22187 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:17.897363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6e07595-128e-40bc-951d-5609b9b22187 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:17.897798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6e07595-128e-40bc-951d-5609b9b22187 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:17.931903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:17.954576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:18.086051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-a6e07595-128e-40bc-951d-5609b9b22187 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'services' on Instance uuid 9a6eeec1-f116-41ea-b5ed-c20d0d37114a {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:07:18.100542 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a6e07595-128e-40bc-951d-5609b9b22187 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 2036 microversion: 2.25 time: 0.218082 Oct 29 01:07:18.103014 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 426/829] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:17 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 2036 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:18.105657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b581dd7d-58b5-4f4f-93fa-dacfaf2a6142 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:18.106274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b581dd7d-58b5-4f4f-93fa-dacfaf2a6142 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:18.112358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b581dd7d-58b5-4f4f-93fa-dacfaf2a6142 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:18.112837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b581dd7d-58b5-4f4f-93fa-dacfaf2a6142 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:18.113300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b581dd7d-58b5-4f4f-93fa-dacfaf2a6142 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:18.113995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b581dd7d-58b5-4f4f-93fa-dacfaf2a6142 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:18.114456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b581dd7d-58b5-4f4f-93fa-dacfaf2a6142 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:18.114883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b581dd7d-58b5-4f4f-93fa-dacfaf2a6142 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:18.304227 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ded7cea7-1548-4e92-a09a-a33dd1385559 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/c66a7fe6-74bb-4760-a01a-58ec4cb88c89" status: 202 len: 0 microversion: 2.1 time: 1.250726 Oct 29 01:07:18.304927 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 404/830] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:07:17 2022] DELETE /compute/v2.1/os-floating-ips/c66a7fe6-74bb-4760-a01a-58ec4cb88c89 => generated 0 bytes in 1252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:07:18.311490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-e09b60b4-2eab-414d-8b6f-cd7029368572 req-f8c98f8c-0f19-4cdf-a5bc-81b0f1af301e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29fc33a2-ac2f-4c14-bf42-861c727f7dd6", "name": "network-vif-deleted", "tag": "a55a9dd9-fbc3-4aac-bb41-9e1e7ca1b060"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:18.322349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e09b60b4-2eab-414d-8b6f-cd7029368572 req-f8c98f8c-0f19-4cdf-a5bc-81b0f1af301e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:18.322905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e09b60b4-2eab-414d-8b6f-cd7029368572 req-f8c98f8c-0f19-4cdf-a5bc-81b0f1af301e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:18.325844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e09b60b4-2eab-414d-8b6f-cd7029368572 req-f8c98f8c-0f19-4cdf-a5bc-81b0f1af301e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:18.327048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b581dd7d-58b5-4f4f-93fa-dacfaf2a6142 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:18.334106 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-e09b60b4-2eab-414d-8b6f-cd7029368572 req-f8c98f8c-0f19-4cdf-a5bc-81b0f1af301e service nova] Creating event network-vif-deleted:a55a9dd9-fbc3-4aac-bb41-9e1e7ca1b060 for instance 29fc33a2-ac2f-4c14-bf42-861c727f7dd6 on n-h1-862964-3 Oct 29 01:07:18.335049 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b581dd7d-58b5-4f4f-93fa-dacfaf2a6142 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1369 microversion: 2.1 time: 0.232909 Oct 29 01:07:18.335627 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 427/831] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:18 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1369 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:18.339460 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-e09b60b4-2eab-414d-8b6f-cd7029368572 req-f8c98f8c-0f19-4cdf-a5bc-81b0f1af301e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033164 Oct 29 01:07:18.340266 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 405/832] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:18.341620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a8d9aca6-9c4b-42e2-9c51-c12ec84187d9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Action: 'create', calling method: .version_select at 0x7f9d97cae160>, body: {"keypair": {"name": "tempest-keypair-1561001635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv22PHI3OoFGdkUZ2jDm5rnvSThYnFpLtCQ0Ib5RhlI+Y9gXrEvg+IRom10zXcXY7Uk1hXQXFMDfe0A8kCvC81muPZHA0ShKgx8piTU7X0Rxctk8l9rv01H51epDWNPrQ=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:18.346667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b6609061-be5f-4366-b94e-dbb4ee5d3b5e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:18.347550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b6609061-be5f-4366-b94e-dbb4ee5d3b5e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:18.354575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6609061-be5f-4366-b94e-dbb4ee5d3b5e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:18.355045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6609061-be5f-4366-b94e-dbb4ee5d3b5e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:18.355489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6609061-be5f-4366-b94e-dbb4ee5d3b5e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:18.356192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6609061-be5f-4366-b94e-dbb4ee5d3b5e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:18.356652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6609061-be5f-4366-b94e-dbb4ee5d3b5e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:18.357077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6609061-be5f-4366-b94e-dbb4ee5d3b5e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:18.360873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-a8d9aca6-9c4b-42e2-9c51-c12ec84187d9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Getting quotas for project d0adfdd6819a472baf1aa25878c5ee22. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:07:18.366956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-a8d9aca6-9c4b-42e2-9c51-c12ec84187d9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Getting quotas for user c56d01b83c0649e0b1d47b7563892d3f and project d0adfdd6819a472baf1aa25878c5ee22. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:07:18.453429 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a8d9aca6-9c4b-42e2-9c51-c12ec84187d9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.116722 Oct 29 01:07:18.459098 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 428/833] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 29 01:07:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 01:07:18.466333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-99ddfcce-a498-4adf-b613-cc8ee3fa3c5e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:18.466333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-99ddfcce-a498-4adf-b613-cc8ee3fa3c5e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:18.466633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99ddfcce-a498-4adf-b613-cc8ee3fa3c5e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:18.467579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99ddfcce-a498-4adf-b613-cc8ee3fa3c5e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:18.467809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99ddfcce-a498-4adf-b613-cc8ee3fa3c5e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:18.468984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99ddfcce-a498-4adf-b613-cc8ee3fa3c5e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:18.469541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99ddfcce-a498-4adf-b613-cc8ee3fa3c5e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:18.470052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99ddfcce-a498-4adf-b613-cc8ee3fa3c5e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:18.496448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b6609061-be5f-4366-b94e-dbb4ee5d3b5e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:18.505096 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b6609061-be5f-4366-b94e-dbb4ee5d3b5e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9" status: 200 len: 1316 microversion: 2.1 time: 0.163496 Oct 29 01:07:18.505700 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 406/834] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:18 2022] GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:18.506415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99ddfcce-a498-4adf-b613-cc8ee3fa3c5e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:18.506891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99ddfcce-a498-4adf-b613-cc8ee3fa3c5e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:18.507331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99ddfcce-a498-4adf-b613-cc8ee3fa3c5e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:18.507785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-99ddfcce-a498-4adf-b613-cc8ee3fa3c5e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lazy-loading 'fault' on Instance uuid 29fc33a2-ac2f-4c14-bf42-861c727f7dd6 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:07:18.523833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b2d2fa61-6e63-4308-a610-9b09e1979647 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b2d2fa61-6e63-4308-a610-9b09e1979647 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Request method failure captured: Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85/action HTTP/1.1 Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 34 Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHyNM-oQJLOZR5D75mMgEVZWYe-L8kVeqFzbyjW9DOD4FI3jzoBXRVbBpc_E3VyN3o--xqQ6iimWGND3I50I4FgFmrsyNJuHwJDQtteMLBjg_tlensmRhl1TA7xEFVnYU4-dfFkDd4XyzlmvFJVm-4ImLXtOpvc2H8R9d2XkTF5Xu0I Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: aed69fb18603408db6f91a05423e3ffb Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:07:18.527860 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:07:18.531216 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aed69fb18603408db6f91a05423e3ffb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aed69fb18603408db6f91a05423e3ffb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aed69fb18603408db6f91a05423e3ffb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aed69fb18603408db6f91a05423e3ffb", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:07:18.531216 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 Oct 29 01:07:18.531216 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: aed69fb18603408db6f91a05423e3ffb Oct 29 01:07:18.531216 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 Oct 29 01:07:18.531216 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project Oct 29 01:07:18.531216 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:07:18.531216 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:07:18.531216 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 9d53762f33554711a9114f273918f2eb Oct 29 01:07:18.531216 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project Oct 29 01:07:18.531216 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:07:18.531216 n-d-862964-3 devstack@n-api.service[121100]: {"addFloatingIp": {"address": ""}} Oct 29 01:07:18.531216 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:07:18.531216 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '5ee6daec-1cf6-45be-943c-20749b8d7d85', 'body': {'addFloatingIp': {'address': ''}}} Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi '' Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:07:18.532194 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:07:18.533903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:07:18.533903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:07:18.533903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:07:18.533903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:07:18.533903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:07:18.533903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:07:18.533903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:07:18.533903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:07:18.533903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:07:18.533903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:07:18.533903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 29 01:07:18.533903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:18.533903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:18.533903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:18.533903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:18.533903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:18.533903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:18.533903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:07:18.533903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:07:18.536270 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 29 01:07:18.536270 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:18.536270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b2d2fa61-6e63-4308-a610-9b09e1979647 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:07:18.536270 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b2d2fa61-6e63-4308-a610-9b09e1979647 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "POST /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85/action" status: 400 len: 142 microversion: 2.1 time: 0.010662 Oct 29 01:07:18.536270 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 407/835] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:07:18 2022] POST /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85/action => generated 142 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:07:18.540013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-67dd9b04-f5cc-4e2c-a55f-e1a08b1256d3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:18.542412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-67dd9b04-f5cc-4e2c-a55f-e1a08b1256d3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:18.552484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67dd9b04-f5cc-4e2c-a55f-e1a08b1256d3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:18.553006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67dd9b04-f5cc-4e2c-a55f-e1a08b1256d3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:18.553506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67dd9b04-f5cc-4e2c-a55f-e1a08b1256d3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:18.554222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67dd9b04-f5cc-4e2c-a55f-e1a08b1256d3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:18.554682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67dd9b04-f5cc-4e2c-a55f-e1a08b1256d3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:18.555116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67dd9b04-f5cc-4e2c-a55f-e1a08b1256d3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:18.555234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-99ddfcce-a498-4adf-b613-cc8ee3fa3c5e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:18.563455 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-99ddfcce-a498-4adf-b613-cc8ee3fa3c5e tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 200 len: 1312 microversion: 2.1 time: 0.108371 Oct 29 01:07:18.564031 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 429/836] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:18 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:18.580864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67dd9b04-f5cc-4e2c-a55f-e1a08b1256d3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "refresh_cache-5ee6daec-1cf6-45be-943c-20749b8d7d85" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 01:07:18.581132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67dd9b04-f5cc-4e2c-a55f-e1a08b1256d3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquired lock "refresh_cache-5ee6daec-1cf6-45be-943c-20749b8d7d85" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 01:07:18.628706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7429900f-fb0e-4760-8532-1a79405e85bd tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:18.629363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7429900f-fb0e-4760-8532-1a79405e85bd tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:18.635744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7429900f-fb0e-4760-8532-1a79405e85bd tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:18.636231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7429900f-fb0e-4760-8532-1a79405e85bd tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:18.637194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7429900f-fb0e-4760-8532-1a79405e85bd tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:18.637620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7429900f-fb0e-4760-8532-1a79405e85bd tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:18.637969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7429900f-fb0e-4760-8532-1a79405e85bd tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:18.638401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7429900f-fb0e-4760-8532-1a79405e85bd tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:18.687331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67dd9b04-f5cc-4e2c-a55f-e1a08b1256d3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Releasing lock "refresh_cache-5ee6daec-1cf6-45be-943c-20749b8d7d85" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 01:07:18.687917 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-67dd9b04-f5cc-4e2c-a55f-e1a08b1256d3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] HTTP exception thrown: floating IP not found Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-67dd9b04-f5cc-4e2c-a55f-e1a08b1256d3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Request method failure captured: Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85/action HTTP/1.1 Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 41 Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHyNM-oQJLOZR5D75mMgEVZWYe-L8kVeqFzbyjW9DOD4FI3jzoBXRVbBpc_E3VyN3o--xqQ6iimWGND3I50I4FgFmrsyNJuHwJDQtteMLBjg_tlensmRhl1TA7xEFVnYU4-dfFkDd4XyzlmvFJVm-4ImLXtOpvc2H8R9d2XkTF5Xu0I Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: aed69fb18603408db6f91a05423e3ffb Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:07:18.689515 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:07:18.694986 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aed69fb18603408db6f91a05423e3ffb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aed69fb18603408db6f91a05423e3ffb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aed69fb18603408db6f91a05423e3ffb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aed69fb18603408db6f91a05423e3ffb", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:07:18.694986 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 Oct 29 01:07:18.694986 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: aed69fb18603408db6f91a05423e3ffb Oct 29 01:07:18.694986 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 Oct 29 01:07:18.694986 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project Oct 29 01:07:18.694986 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:07:18.694986 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:07:18.694986 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 9d53762f33554711a9114f273918f2eb Oct 29 01:07:18.694986 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project Oct 29 01:07:18.694986 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:07:18.694986 n-d-862964-3 devstack@n-api.service[121100]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 29 01:07:18.694986 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:07:18.694986 n-d-862964-3 devstack@n-api.service[121100]: exception: floating IP not found Oct 29 01:07:18.695787 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '5ee6daec-1cf6-45be-943c-20749b8d7d85', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 29 01:07:18.695787 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:07:18.695787 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:18.695787 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 29 01:07:18.695787 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 29 01:07:18.695787 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 29 01:07:18.695787 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 29 01:07:18.695787 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 29 01:07:18.695787 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 29 01:07:18.695787 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 29 01:07:18.695787 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 29 01:07:18.695787 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 29 01:07:18.695787 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:18.695787 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:18.695787 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:18.695787 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:18.695787 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:18.695787 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:18.695787 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 29 01:07:18.696943 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:18.698237 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-67dd9b04-f5cc-4e2c-a55f-e1a08b1256d3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Returning 404 to user: floating IP not found {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:07:18.698237 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-67dd9b04-f5cc-4e2c-a55f-e1a08b1256d3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "POST /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85/action" status: 404 len: 67 microversion: 2.1 time: 0.156166 Oct 29 01:07:18.698237 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 408/837] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:07:18 2022] POST /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85/action => generated 67 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:07:18.702383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e93bcffc-242e-4669-8c5b-9f0251c68b06 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:18.755631 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-e93bcffc-242e-4669-8c5b-9f0251c68b06 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e93bcffc-242e-4669-8c5b-9f0251c68b06 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Request method failure captured: Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85/action HTTP/1.1 Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 44 Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHyNM-oQJLOZR5D75mMgEVZWYe-L8kVeqFzbyjW9DOD4FI3jzoBXRVbBpc_E3VyN3o--xqQ6iimWGND3I50I4FgFmrsyNJuHwJDQtteMLBjg_tlensmRhl1TA7xEFVnYU4-dfFkDd4XyzlmvFJVm-4ImLXtOpvc2H8R9d2XkTF5Xu0I Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: aed69fb18603408db6f91a05423e3ffb Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:07:18.757445 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:07:18.758915 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aed69fb18603408db6f91a05423e3ffb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aed69fb18603408db6f91a05423e3ffb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aed69fb18603408db6f91a05423e3ffb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aed69fb18603408db6f91a05423e3ffb", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:07:18.758915 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 Oct 29 01:07:18.758915 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: aed69fb18603408db6f91a05423e3ffb Oct 29 01:07:18.758915 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 Oct 29 01:07:18.758915 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project Oct 29 01:07:18.758915 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:07:18.758915 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:07:18.758915 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 9d53762f33554711a9114f273918f2eb Oct 29 01:07:18.758915 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project Oct 29 01:07:18.758915 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:07:18.758915 n-d-862964-3 devstack@n-api.service[121100]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 29 01:07:18.758915 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:07:18.758915 n-d-862964-3 devstack@n-api.service[121100]: exception: Floating IP not found for address 0.0.0.0. Oct 29 01:07:18.759724 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '5ee6daec-1cf6-45be-943c-20749b8d7d85', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 29 01:07:18.759724 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:07:18.759724 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:18.759724 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 29 01:07:18.759724 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 29 01:07:18.759724 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 29 01:07:18.759724 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 29 01:07:18.759724 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 29 01:07:18.759724 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 29 01:07:18.759724 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 29 01:07:18.759724 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:18.759724 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:18.759724 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:18.759724 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:18.759724 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:18.759724 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:18.759724 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:07:18.759724 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:07:18.759724 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 29 01:07:18.760850 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:18.763676 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e93bcffc-242e-4669-8c5b-9f0251c68b06 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:07:18.763676 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e93bcffc-242e-4669-8c5b-9f0251c68b06 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "POST /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85/action" status: 404 len: 88 microversion: 2.1 time: 0.060823 Oct 29 01:07:18.764638 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 409/838] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:07:18 2022] POST /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85/action => generated 88 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:07:18.769263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-15902e44-dc01-49fd-8bd4-da08c2e9d70e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:18.769696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-15902e44-dc01-49fd-8bd4-da08c2e9d70e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:18.776804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15902e44-dc01-49fd-8bd4-da08c2e9d70e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:18.777335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15902e44-dc01-49fd-8bd4-da08c2e9d70e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:18.777776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15902e44-dc01-49fd-8bd4-da08c2e9d70e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:18.778486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15902e44-dc01-49fd-8bd4-da08c2e9d70e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:18.778963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15902e44-dc01-49fd-8bd4-da08c2e9d70e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:18.779501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15902e44-dc01-49fd-8bd4-da08c2e9d70e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:18.806288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-15902e44-dc01-49fd-8bd4-da08c2e9d70e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:07:18.809275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:18.821587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7429900f-fb0e-4760-8532-1a79405e85bd tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:18.829526 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7429900f-fb0e-4760-8532-1a79405e85bd tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1311 microversion: 2.1 time: 0.206229 Oct 29 01:07:18.830303 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 430/839] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:18 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1311 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:18.895086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-71bd1c00-85f5-42ce-9018-979c893d79a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:18.895685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-71bd1c00-85f5-42ce-9018-979c893d79a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:18.901709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71bd1c00-85f5-42ce-9018-979c893d79a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:18.902183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71bd1c00-85f5-42ce-9018-979c893d79a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:18.902613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71bd1c00-85f5-42ce-9018-979c893d79a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:18.903289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71bd1c00-85f5-42ce-9018-979c893d79a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:18.903740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71bd1c00-85f5-42ce-9018-979c893d79a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:18.904157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71bd1c00-85f5-42ce-9018-979c893d79a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:19.044217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-71bd1c00-85f5-42ce-9018-979c893d79a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:19.056306 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-71bd1c00-85f5-42ce-9018-979c893d79a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1473 microversion: 2.1 time: 0.165237 Oct 29 01:07:19.057240 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 431/840] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:18 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1473 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:19.133853 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-15902e44-dc01-49fd-8bd4-da08c2e9d70e tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85" status: 204 len: 0 microversion: 2.1 time: 0.368389 Oct 29 01:07:19.134564 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 410/841] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:07:18 2022] DELETE /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:07:19.143089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-50d59ef1-dd93-4f4a-a178-5e7b39085fa3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:19.143707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-50d59ef1-dd93-4f4a-a178-5e7b39085fa3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:19.149816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50d59ef1-dd93-4f4a-a178-5e7b39085fa3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:19.150289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50d59ef1-dd93-4f4a-a178-5e7b39085fa3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:19.150719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50d59ef1-dd93-4f4a-a178-5e7b39085fa3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:19.151433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50d59ef1-dd93-4f4a-a178-5e7b39085fa3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:19.151975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50d59ef1-dd93-4f4a-a178-5e7b39085fa3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:19.152393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50d59ef1-dd93-4f4a-a178-5e7b39085fa3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:19.286340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-50d59ef1-dd93-4f4a-a178-5e7b39085fa3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d53762f33554711a9114f273918f2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed69fb18603408db6f91a05423e3ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:19.294322 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-50d59ef1-dd93-4f4a-a178-5e7b39085fa3 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85" status: 200 len: 1543 microversion: 2.1 time: 0.155460 Oct 29 01:07:19.294955 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 432/842] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:19 2022] GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85 => generated 1543 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:19.330619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-ab07f3e4-95b8-498d-8798-b7d005d32318 req-5b2f2a9e-e2b9-439e-ae7f-562d7dc05b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38f9413-877d-43ab-b4ed-294552b3c231", "name": "network-vif-plugged", "status": "completed", "tag": "dba01d43-1d1a-480f-89cd-3555f1ef20a4"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:19.340936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ab07f3e4-95b8-498d-8798-b7d005d32318 req-5b2f2a9e-e2b9-439e-ae7f-562d7dc05b38 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:19.341427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ab07f3e4-95b8-498d-8798-b7d005d32318 req-5b2f2a9e-e2b9-439e-ae7f-562d7dc05b38 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:19.341863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ab07f3e4-95b8-498d-8798-b7d005d32318 req-5b2f2a9e-e2b9-439e-ae7f-562d7dc05b38 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:19.353924 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-ab07f3e4-95b8-498d-8798-b7d005d32318 req-5b2f2a9e-e2b9-439e-ae7f-562d7dc05b38 service nova] Creating event network-vif-plugged:dba01d43-1d1a-480f-89cd-3555f1ef20a4 for instance f38f9413-877d-43ab-b4ed-294552b3c231 on n-h2-862964-3 Oct 29 01:07:19.358971 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-ab07f3e4-95b8-498d-8798-b7d005d32318 req-5b2f2a9e-e2b9-439e-ae7f-562d7dc05b38 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033365 Oct 29 01:07:19.359572 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 411/843] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:19.360413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4a24d38c-7bd5-40b2-a268-a49900c326a0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:19.361028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4a24d38c-7bd5-40b2-a268-a49900c326a0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:19.368008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a24d38c-7bd5-40b2-a268-a49900c326a0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:19.368436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a24d38c-7bd5-40b2-a268-a49900c326a0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:19.368866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a24d38c-7bd5-40b2-a268-a49900c326a0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:19.369634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a24d38c-7bd5-40b2-a268-a49900c326a0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:19.370229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a24d38c-7bd5-40b2-a268-a49900c326a0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:19.370657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a24d38c-7bd5-40b2-a268-a49900c326a0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:19.532691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-db737c68-e9a7-4cc6-951b-7ce11200d114 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:19.534560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-db737c68-e9a7-4cc6-951b-7ce11200d114 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:19.543968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db737c68-e9a7-4cc6-951b-7ce11200d114 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:19.544977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db737c68-e9a7-4cc6-951b-7ce11200d114 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:19.547541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db737c68-e9a7-4cc6-951b-7ce11200d114 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:19.548453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db737c68-e9a7-4cc6-951b-7ce11200d114 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:19.549114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db737c68-e9a7-4cc6-951b-7ce11200d114 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:19.550290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db737c68-e9a7-4cc6-951b-7ce11200d114 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:19.587438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4a24d38c-7bd5-40b2-a268-a49900c326a0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:19.597308 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4a24d38c-7bd5-40b2-a268-a49900c326a0 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1369 microversion: 2.1 time: 0.240891 Oct 29 01:07:19.615137 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 433/844] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:19 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1369 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:19.623195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6ae7fcd5-9bf0-4d42-bec5-48a9991e3b26 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:19.624295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6ae7fcd5-9bf0-4d42-bec5-48a9991e3b26 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:19.633353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ae7fcd5-9bf0-4d42-bec5-48a9991e3b26 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:19.634594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ae7fcd5-9bf0-4d42-bec5-48a9991e3b26 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:19.635102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ae7fcd5-9bf0-4d42-bec5-48a9991e3b26 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:19.635874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ae7fcd5-9bf0-4d42-bec5-48a9991e3b26 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:19.636576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ae7fcd5-9bf0-4d42-bec5-48a9991e3b26 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:19.637065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ae7fcd5-9bf0-4d42-bec5-48a9991e3b26 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:19.642095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:19.674122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ae7fcd5-9bf0-4d42-bec5-48a9991e3b26 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:19.674709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ae7fcd5-9bf0-4d42-bec5-48a9991e3b26 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:19.675321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ae7fcd5-9bf0-4d42-bec5-48a9991e3b26 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:19.681840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-6ae7fcd5-9bf0-4d42-bec5-48a9991e3b26 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lazy-loading 'fault' on Instance uuid 29fc33a2-ac2f-4c14-bf42-861c727f7dd6 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:07:19.795785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6ae7fcd5-9bf0-4d42-bec5-48a9991e3b26 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:19.809341 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6ae7fcd5-9bf0-4d42-bec5-48a9991e3b26 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 200 len: 1312 microversion: 2.1 time: 0.191751 Oct 29 01:07:19.820584 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 434/845] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:19 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:19.853507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-00fd2b0f-f17f-47dc-8d0c-99ce74c23ddb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:19.854198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-00fd2b0f-f17f-47dc-8d0c-99ce74c23ddb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:19.860888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00fd2b0f-f17f-47dc-8d0c-99ce74c23ddb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:19.861657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00fd2b0f-f17f-47dc-8d0c-99ce74c23ddb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:19.862039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00fd2b0f-f17f-47dc-8d0c-99ce74c23ddb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:19.862813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00fd2b0f-f17f-47dc-8d0c-99ce74c23ddb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:19.863355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00fd2b0f-f17f-47dc-8d0c-99ce74c23ddb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:19.863842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00fd2b0f-f17f-47dc-8d0c-99ce74c23ddb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:19.872836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-db737c68-e9a7-4cc6-951b-7ce11200d114 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:19.882510 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-db737c68-e9a7-4cc6-951b-7ce11200d114 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9" status: 200 len: 1316 microversion: 2.1 time: 0.353989 Oct 29 01:07:19.898423 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 412/846] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:19 2022] GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:20.082817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f16db9ab-f404-449c-9374-0099ceecb24b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:20.083736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f16db9ab-f404-449c-9374-0099ceecb24b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:20.090680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f16db9ab-f404-449c-9374-0099ceecb24b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:20.091349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f16db9ab-f404-449c-9374-0099ceecb24b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:20.091870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f16db9ab-f404-449c-9374-0099ceecb24b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:20.092804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f16db9ab-f404-449c-9374-0099ceecb24b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:20.093396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f16db9ab-f404-449c-9374-0099ceecb24b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:20.093921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f16db9ab-f404-449c-9374-0099ceecb24b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:20.120178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-00fd2b0f-f17f-47dc-8d0c-99ce74c23ddb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:20.134333 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-00fd2b0f-f17f-47dc-8d0c-99ce74c23ddb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1311 microversion: 2.1 time: 0.285174 Oct 29 01:07:20.152222 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 435/847] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:19 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1311 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:20.300385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f16db9ab-f404-449c-9374-0099ceecb24b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:20.312514 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f16db9ab-f404-449c-9374-0099ceecb24b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1473 microversion: 2.1 time: 0.236030 Oct 29 01:07:20.314539 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 413/848] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:20 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1473 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:20.336247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1aee8255-ab87-4ca6-aaf8-1972e37db57c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:20.337537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1aee8255-ab87-4ca6-aaf8-1972e37db57c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:20.350380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1aee8255-ab87-4ca6-aaf8-1972e37db57c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:20.350895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1aee8255-ab87-4ca6-aaf8-1972e37db57c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:20.351320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1aee8255-ab87-4ca6-aaf8-1972e37db57c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:20.354207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1aee8255-ab87-4ca6-aaf8-1972e37db57c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:20.356088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1aee8255-ab87-4ca6-aaf8-1972e37db57c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:20.356719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1aee8255-ab87-4ca6-aaf8-1972e37db57c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:20.623126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-329889c3-6b11-4ac1-b768-1d532db36eef tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:20.623906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-329889c3-6b11-4ac1-b768-1d532db36eef tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:20.629650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1aee8255-ab87-4ca6-aaf8-1972e37db57c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d53762f33554711a9114f273918f2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed69fb18603408db6f91a05423e3ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:20.634762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-329889c3-6b11-4ac1-b768-1d532db36eef tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:20.635534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-329889c3-6b11-4ac1-b768-1d532db36eef tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:20.636522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-329889c3-6b11-4ac1-b768-1d532db36eef tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:20.639521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-329889c3-6b11-4ac1-b768-1d532db36eef tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:20.640325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-329889c3-6b11-4ac1-b768-1d532db36eef tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:20.641042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-329889c3-6b11-4ac1-b768-1d532db36eef tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:20.647947 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1aee8255-ab87-4ca6-aaf8-1972e37db57c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85" status: 200 len: 1543 microversion: 2.1 time: 0.333466 Oct 29 01:07:20.661864 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 436/849] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:20 2022] GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85 => generated 1543 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:20.833933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-329889c3-6b11-4ac1-b768-1d532db36eef tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:20.835775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-76154046-ba98-4c7c-b5a7-bcd7d4423ce9 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:20.838280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-76154046-ba98-4c7c-b5a7-bcd7d4423ce9 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:20.842567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76154046-ba98-4c7c-b5a7-bcd7d4423ce9 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:20.842980 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-329889c3-6b11-4ac1-b768-1d532db36eef tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1369 microversion: 2.1 time: 0.224232 Oct 29 01:07:20.843440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76154046-ba98-4c7c-b5a7-bcd7d4423ce9 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:20.843904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76154046-ba98-4c7c-b5a7-bcd7d4423ce9 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:20.844690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76154046-ba98-4c7c-b5a7-bcd7d4423ce9 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:20.845342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76154046-ba98-4c7c-b5a7-bcd7d4423ce9 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:20.846085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76154046-ba98-4c7c-b5a7-bcd7d4423ce9 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:20.859936 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 414/850] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:20 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1369 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:20.882374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76154046-ba98-4c7c-b5a7-bcd7d4423ce9 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:20.882641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76154046-ba98-4c7c-b5a7-bcd7d4423ce9 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:20.883409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76154046-ba98-4c7c-b5a7-bcd7d4423ce9 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:20.883942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-76154046-ba98-4c7c-b5a7-bcd7d4423ce9 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lazy-loading 'fault' on Instance uuid 29fc33a2-ac2f-4c14-bf42-861c727f7dd6 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:07:20.909132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-851501ad-919c-4cf5-b16f-d329baa9e986 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:20.909766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-851501ad-919c-4cf5-b16f-d329baa9e986 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:20.916183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-851501ad-919c-4cf5-b16f-d329baa9e986 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:20.916675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-851501ad-919c-4cf5-b16f-d329baa9e986 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:20.917110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-851501ad-919c-4cf5-b16f-d329baa9e986 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:20.918070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-851501ad-919c-4cf5-b16f-d329baa9e986 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:20.918530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-851501ad-919c-4cf5-b16f-d329baa9e986 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:20.918956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-851501ad-919c-4cf5-b16f-d329baa9e986 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:20.931414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-76154046-ba98-4c7c-b5a7-bcd7d4423ce9 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d4ceb600214ce2a80d48a0cd53a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361ee1c7ea6a43258240e801fb45f440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:20.940740 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-76154046-ba98-4c7c-b5a7-bcd7d4423ce9 tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 200 len: 1312 microversion: 2.1 time: 0.109137 Oct 29 01:07:20.941842 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 437/851] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:20 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:20.948171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-fac57492-f81a-4f1a-9819-0e07e17b5201 req-f2c56dc5-19d0-47f9-b933-864071c9734d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5", "tag": "3696a714-c84c-4ccf-a78d-0b8a642038f9"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:20.959776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-fac57492-f81a-4f1a-9819-0e07e17b5201 req-f2c56dc5-19d0-47f9-b933-864071c9734d service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:20.960293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-fac57492-f81a-4f1a-9819-0e07e17b5201 req-f2c56dc5-19d0-47f9-b933-864071c9734d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:20.960731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-fac57492-f81a-4f1a-9819-0e07e17b5201 req-f2c56dc5-19d0-47f9-b933-864071c9734d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:20.976468 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-fac57492-f81a-4f1a-9819-0e07e17b5201 req-f2c56dc5-19d0-47f9-b933-864071c9734d service nova] Creating event network-changed:3696a714-c84c-4ccf-a78d-0b8a642038f9 for instance cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 on n-h1-862964-3 Oct 29 01:07:20.981365 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-fac57492-f81a-4f1a-9819-0e07e17b5201 req-f2c56dc5-19d0-47f9-b933-864071c9734d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037087 Oct 29 01:07:20.993211 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 438/852] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:07:21.097315 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-851501ad-919c-4cf5-b16f-d329baa9e986 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:21.105034 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-851501ad-919c-4cf5-b16f-d329baa9e986 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9" status: 200 len: 1316 microversion: 2.1 time: 0.200710 Oct 29 01:07:21.105638 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 415/853] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:20 2022] GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 => generated 1316 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:21.160311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6e46abcc-8c29-48f9-be12-7990e38fa450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:21.161110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6e46abcc-8c29-48f9-be12-7990e38fa450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:21.168237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e46abcc-8c29-48f9-be12-7990e38fa450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:21.168740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e46abcc-8c29-48f9-be12-7990e38fa450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:21.181880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e46abcc-8c29-48f9-be12-7990e38fa450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:21.182737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e46abcc-8c29-48f9-be12-7990e38fa450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:21.183178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e46abcc-8c29-48f9-be12-7990e38fa450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:21.183643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e46abcc-8c29-48f9-be12-7990e38fa450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:21.343993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e04dd58c-edc9-4c39-9bcf-9d38f52fd761 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:21.344606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e04dd58c-edc9-4c39-9bcf-9d38f52fd761 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:21.351515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e04dd58c-edc9-4c39-9bcf-9d38f52fd761 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:21.352460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e04dd58c-edc9-4c39-9bcf-9d38f52fd761 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:21.352899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e04dd58c-edc9-4c39-9bcf-9d38f52fd761 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:21.353634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e04dd58c-edc9-4c39-9bcf-9d38f52fd761 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:21.354296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e04dd58c-edc9-4c39-9bcf-9d38f52fd761 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:21.354714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e04dd58c-edc9-4c39-9bcf-9d38f52fd761 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:21.679291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6e46abcc-8c29-48f9-be12-7990e38fa450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:21.691509 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6e46abcc-8c29-48f9-be12-7990e38fa450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1311 microversion: 2.1 time: 0.537042 Oct 29 01:07:21.709389 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 439/854] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:21 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1311 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:21.714828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-58bd3436-3b30-4c10-b15f-c6aeb4289413 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:21.715700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-58bd3436-3b30-4c10-b15f-c6aeb4289413 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:21.722964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58bd3436-3b30-4c10-b15f-c6aeb4289413 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:21.723808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58bd3436-3b30-4c10-b15f-c6aeb4289413 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:21.724313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58bd3436-3b30-4c10-b15f-c6aeb4289413 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:21.725085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58bd3436-3b30-4c10-b15f-c6aeb4289413 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:21.725774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58bd3436-3b30-4c10-b15f-c6aeb4289413 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:21.726193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58bd3436-3b30-4c10-b15f-c6aeb4289413 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:21.749760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e04dd58c-edc9-4c39-9bcf-9d38f52fd761 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:21.758431 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e04dd58c-edc9-4c39-9bcf-9d38f52fd761 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1470 microversion: 2.1 time: 0.418303 Oct 29 01:07:21.759006 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 416/855] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:21 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1470 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:21.773339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-11d0a1dd-bde7-486c-9cef-ad9f707c3d9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1302871002", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "f4099806-4a58-499a-8649-04716b1c047c"}], "security_groups": [{"name": "tempest-securitygroup--1671293507"}], "key_name": "tempest-keypair-1561001635", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:21.915943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-58bd3436-3b30-4c10-b15f-c6aeb4289413 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d53762f33554711a9114f273918f2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed69fb18603408db6f91a05423e3ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:21.921308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-11d0a1dd-bde7-486c-9cef-ad9f707c3d9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] validate_networks() for [('f4099806-4a58-499a-8649-04716b1c047c', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:07:21.926054 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-58bd3436-3b30-4c10-b15f-c6aeb4289413 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85" status: 200 len: 1543 microversion: 2.1 time: 0.215156 Oct 29 01:07:21.937195 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 440/856] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:21 2022] GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85 => generated 1543 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:21.937195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4be3492b-109d-4c11-ad55-7141957d92bc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:21.937195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4be3492b-109d-4c11-ad55-7141957d92bc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:21.945634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4be3492b-109d-4c11-ad55-7141957d92bc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:21.945975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4be3492b-109d-4c11-ad55-7141957d92bc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:21.946482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4be3492b-109d-4c11-ad55-7141957d92bc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:21.947265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4be3492b-109d-4c11-ad55-7141957d92bc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:21.947789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4be3492b-109d-4c11-ad55-7141957d92bc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:21.948288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4be3492b-109d-4c11-ad55-7141957d92bc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:22.171175 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4be3492b-109d-4c11-ad55-7141957d92bc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "POST /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15/action" status: 204 len: 0 microversion: 2.1 time: 0.242903 Oct 29 01:07:22.172133 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 441/857] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:07:21 2022] POST /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15/action => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:07:22.192702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dd4c648a-3b30-4602-8482-d214577e310d tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:22.193630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dd4c648a-3b30-4602-8482-d214577e310d tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:22.204826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd4c648a-3b30-4602-8482-d214577e310d tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:22.206737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd4c648a-3b30-4602-8482-d214577e310d tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:22.207185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd4c648a-3b30-4602-8482-d214577e310d tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:22.207969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd4c648a-3b30-4602-8482-d214577e310d tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:22.208429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd4c648a-3b30-4602-8482-d214577e310d tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:22.208852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd4c648a-3b30-4602-8482-d214577e310d tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:22.435332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dd4c648a-3b30-4602-8482-d214577e310d tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:22.444806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-11d0a1dd-bde7-486c-9cef-ad9f707c3d9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:07:22.445251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-11d0a1dd-bde7-486c-9cef-ad9f707c3d9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:07:22.445620 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dd4c648a-3b30-4602-8482-d214577e310d tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1369 microversion: 2.1 time: 0.271581 Oct 29 01:07:22.446253 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 442/858] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:22 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1369 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:22.446701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-11d0a1dd-bde7-486c-9cef-ad9f707c3d9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:07:22.447973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-11d0a1dd-bde7-486c-9cef-ad9f707c3d9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:07:22.448409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-11d0a1dd-bde7-486c-9cef-ad9f707c3d9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:07:22.451643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1ae7e5f3-435e-4db3-bc84-c507a6bc317b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:22.452454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1ae7e5f3-435e-4db3-bc84-c507a6bc317b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] [instance: 29fc33a2-ac2f-4c14-bf42-861c727f7dd6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:22.459823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ae7e5f3-435e-4db3-bc84-c507a6bc317b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:22.460558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ae7e5f3-435e-4db3-bc84-c507a6bc317b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:22.461242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ae7e5f3-435e-4db3-bc84-c507a6bc317b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:22.462128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ae7e5f3-435e-4db3-bc84-c507a6bc317b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:22.462760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ae7e5f3-435e-4db3-bc84-c507a6bc317b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:22.463187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ae7e5f3-435e-4db3-bc84-c507a6bc317b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:22.479219 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-1ae7e5f3-435e-4db3-bc84-c507a6bc317b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] HTTP exception thrown: Instance 29fc33a2-ac2f-4c14-bf42-861c727f7dd6 could not be found. Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1ae7e5f3-435e-4db3-bc84-c507a6bc317b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Request method failure captured: Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 HTTP/1.1 Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHyaAVkNeg4A3bwjDtHGUWCq-Xi43MJ2jobg2M5s5bnjIZXmkEqAdtO04zP8KcGCZ15BLGtCjKBM6PouNjahKVL6LKPSmOLFvMSPvawPfQiCojnPaxaZ_EypmtmRYpa1iV7Whsfle4BnKo6w2ucF7HUFz8bfuX2rLyAWOJC0VHvRpXg Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 361ee1c7ea6a43258240e801fb45f440 Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1226875869 Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:07:22.481134 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:07:22.482899 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/361ee1c7ea6a43258240e801fb45f440"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/361ee1c7ea6a43258240e801fb45f440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/361ee1c7ea6a43258240e801fb45f440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_361ee1c7ea6a43258240e801fb45f440", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:07:22.482899 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1226875869 Oct 29 01:07:22.482899 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 361ee1c7ea6a43258240e801fb45f440 Oct 29 01:07:22.482899 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1226875869 Oct 29 01:07:22.482899 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerDiagnosticsNegativeTest-1226875869-project Oct 29 01:07:22.482899 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:07:22.482899 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:07:22.482899 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f1d4ceb600214ce2a80d48a0cd53a548 Oct 29 01:07:22.482899 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1226875869-project Oct 29 01:07:22.482899 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:07:22.482899 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 29fc33a2-ac2f-4c14-bf42-861c727f7dd6 could not be found. Oct 29 01:07:22.482899 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '29fc33a2-ac2f-4c14-bf42-861c727f7dd6'} Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29fc33a2-ac2f-4c14-bf42-861c727f7dd6 could not be found. Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:07:22.483733 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:07:22.484965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:07:22.484965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:07:22.484965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:07:22.484965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:07:22.484965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:07:22.484965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:07:22.484965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:07:22.484965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29fc33a2-ac2f-4c14-bf42-861c727f7dd6 could not be found. Oct 29 01:07:22.484965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:22.484965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:22.484965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:22.484965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:22.484965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:22.484965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:22.484965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:07:22.484965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:07:22.484965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29fc33a2-ac2f-4c14-bf42-861c727f7dd6 could not be found. Oct 29 01:07:22.484965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:22.486117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-11d0a1dd-bde7-486c-9cef-ad9f707c3d9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:22.486117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-11d0a1dd-bde7-486c-9cef-ad9f707c3d9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:22.486117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-11d0a1dd-bde7-486c-9cef-ad9f707c3d9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:22.486117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-11d0a1dd-bde7-486c-9cef-ad9f707c3d9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:22.486478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-11d0a1dd-bde7-486c-9cef-ad9f707c3d9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:22.486478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-11d0a1dd-bde7-486c-9cef-ad9f707c3d9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:22.487880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1ae7e5f3-435e-4db3-bc84-c507a6bc317b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] Returning 404 to user: Instance 29fc33a2-ac2f-4c14-bf42-861c727f7dd6 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:07:22.488754 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1ae7e5f3-435e-4db3-bc84-c507a6bc317b tempest-ServerDiagnosticsNegativeTest-1226875869 tempest-ServerDiagnosticsNegativeTest-1226875869-project] 10.222.0.26 "GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6" status: 404 len: 111 microversion: 2.1 time: 0.041177 Oct 29 01:07:22.489548 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 443/859] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:22 2022] GET /compute/v2.1/servers/29fc33a2-ac2f-4c14-bf42-861c727f7dd6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:07:22.497390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-891d6925-044c-4fd0-9c8d-7518acbd3e0a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:22.498006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-891d6925-044c-4fd0-9c8d-7518acbd3e0a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:22.504348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-891d6925-044c-4fd0-9c8d-7518acbd3e0a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:22.504851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-891d6925-044c-4fd0-9c8d-7518acbd3e0a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:22.510210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-891d6925-044c-4fd0-9c8d-7518acbd3e0a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:22.510210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-891d6925-044c-4fd0-9c8d-7518acbd3e0a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:22.510210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-891d6925-044c-4fd0-9c8d-7518acbd3e0a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:22.510210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-891d6925-044c-4fd0-9c8d-7518acbd3e0a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:22.521301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-11d0a1dd-bde7-486c-9cef-ad9f707c3d9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Getting quotas for project d0adfdd6819a472baf1aa25878c5ee22. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:07:22.552831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-11d0a1dd-bde7-486c-9cef-ad9f707c3d9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Getting quotas for user c56d01b83c0649e0b1d47b7563892d3f and project d0adfdd6819a472baf1aa25878c5ee22. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:07:22.586383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-11d0a1dd-bde7-486c-9cef-ad9f707c3d9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:07:22.589848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-11d0a1dd-bde7-486c-9cef-ad9f707c3d9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:07:22.668498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-891d6925-044c-4fd0-9c8d-7518acbd3e0a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:22.677323 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-891d6925-044c-4fd0-9c8d-7518acbd3e0a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9" status: 200 len: 1466 microversion: 2.1 time: 0.183656 Oct 29 01:07:22.694354 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 444/860] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:22 2022] GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 => generated 1466 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:22.702751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f5a0c6ce-e98b-48c4-8674-53d3d964c446 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:22.703368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f5a0c6ce-e98b-48c4-8674-53d3d964c446 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:22.710303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5a0c6ce-e98b-48c4-8674-53d3d964c446 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:22.711261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5a0c6ce-e98b-48c4-8674-53d3d964c446 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:22.711914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5a0c6ce-e98b-48c4-8674-53d3d964c446 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:22.713003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5a0c6ce-e98b-48c4-8674-53d3d964c446 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:22.713576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5a0c6ce-e98b-48c4-8674-53d3d964c446 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:22.714082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5a0c6ce-e98b-48c4-8674-53d3d964c446 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:22.830805 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-11d0a1dd-bde7-486c-9cef-ad9f707c3d9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.070675 Oct 29 01:07:22.837401 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 417/861] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 29 01:07:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 01:07:22.847428 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-956a9347-b409-48da-bf10-6ffafec1af52 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:22.849097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-956a9347-b409-48da-bf10-6ffafec1af52 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:22.859644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-956a9347-b409-48da-bf10-6ffafec1af52 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:22.860818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-956a9347-b409-48da-bf10-6ffafec1af52 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:22.862210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-956a9347-b409-48da-bf10-6ffafec1af52 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:22.863930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-956a9347-b409-48da-bf10-6ffafec1af52 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:22.864617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-956a9347-b409-48da-bf10-6ffafec1af52 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:22.865405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-956a9347-b409-48da-bf10-6ffafec1af52 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:22.882039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f5a0c6ce-e98b-48c4-8674-53d3d964c446 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:22.895632 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f5a0c6ce-e98b-48c4-8674-53d3d964c446 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1470 microversion: 2.1 time: 0.198665 Oct 29 01:07:22.905599 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 445/862] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:22 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1470 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:22.917550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-63241ff2-1622-44f0-ba14-3841a44d011f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:22.919819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-63241ff2-1622-44f0-ba14-3841a44d011f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:22.933498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63241ff2-1622-44f0-ba14-3841a44d011f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:22.935740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63241ff2-1622-44f0-ba14-3841a44d011f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:22.937012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63241ff2-1622-44f0-ba14-3841a44d011f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:22.938042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63241ff2-1622-44f0-ba14-3841a44d011f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:22.941054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63241ff2-1622-44f0-ba14-3841a44d011f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:22.945813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63241ff2-1622-44f0-ba14-3841a44d011f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:23.159151 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-956a9347-b409-48da-bf10-6ffafec1af52 tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9" status: 200 len: 1617 microversion: 2.1 time: 0.320317 Oct 29 01:07:23.177402 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 418/863] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:22 2022] GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 => generated 1617 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:23.185796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6dea4b18-5ede-4e42-8e5f-7e36eeb751b6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:23.188771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6dea4b18-5ede-4e42-8e5f-7e36eeb751b6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:23.230856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-63241ff2-1622-44f0-ba14-3841a44d011f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:23.241727 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-63241ff2-1622-44f0-ba14-3841a44d011f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1311 microversion: 2.1 time: 0.333845 Oct 29 01:07:23.242789 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 446/864] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:22 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1311 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:23.263958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-331b84f5-7326-48ec-855f-53855c7e6d90 req-fdad9712-3dbd-42a4-a4af-6ad92cdca0ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ee6daec-1cf6-45be-943c-20749b8d7d85", "name": "network-vif-deleted", "tag": "8dcc0733-0f1e-41cd-9fc2-f9f371fc1086"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:23.277175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-331b84f5-7326-48ec-855f-53855c7e6d90 req-fdad9712-3dbd-42a4-a4af-6ad92cdca0ce service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:23.278017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-331b84f5-7326-48ec-855f-53855c7e6d90 req-fdad9712-3dbd-42a4-a4af-6ad92cdca0ce service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:23.278678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-331b84f5-7326-48ec-855f-53855c7e6d90 req-fdad9712-3dbd-42a4-a4af-6ad92cdca0ce service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:23.309915 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-331b84f5-7326-48ec-855f-53855c7e6d90 req-fdad9712-3dbd-42a4-a4af-6ad92cdca0ce service nova] Creating event network-vif-deleted:8dcc0733-0f1e-41cd-9fc2-f9f371fc1086 for instance 5ee6daec-1cf6-45be-943c-20749b8d7d85 on n-h2-862964-3 Oct 29 01:07:23.320285 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-331b84f5-7326-48ec-855f-53855c7e6d90 req-fdad9712-3dbd-42a4-a4af-6ad92cdca0ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076115 Oct 29 01:07:23.321409 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 447/865] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:23.323290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6dea4b18-5ede-4e42-8e5f-7e36eeb751b6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:23.326928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5b32bcef-4d69-4512-933b-382eea059359 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:23.327632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5b32bcef-4d69-4512-933b-382eea059359 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:23.332030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6dea4b18-5ede-4e42-8e5f-7e36eeb751b6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:23.333506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6dea4b18-5ede-4e42-8e5f-7e36eeb751b6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:23.334635 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6dea4b18-5ede-4e42-8e5f-7e36eeb751b6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1286 microversion: 2.25 time: 0.162183 Oct 29 01:07:23.336876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b32bcef-4d69-4512-933b-382eea059359 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:23.337498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b32bcef-4d69-4512-933b-382eea059359 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:23.338249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b32bcef-4d69-4512-933b-382eea059359 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:23.339181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b32bcef-4d69-4512-933b-382eea059359 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:23.339879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b32bcef-4d69-4512-933b-382eea059359 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:23.341328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b32bcef-4d69-4512-933b-382eea059359 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:23.360664 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 419/866] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:23 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1286 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:23.374516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-7f738197-cbdd-434c-9dbf-1f06f14c9113 req-28154b81-30b1-4885-a86f-40779d4fbd4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65c62cb3-ec7c-43fa-9840-1c0fef87ae15", "name": "network-vif-plugged", "status": "completed", "tag": "edbb0f10-da6d-409d-8978-de8280afa7df"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:23.392069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7f738197-cbdd-434c-9dbf-1f06f14c9113 req-28154b81-30b1-4885-a86f-40779d4fbd4a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:23.393070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7f738197-cbdd-434c-9dbf-1f06f14c9113 req-28154b81-30b1-4885-a86f-40779d4fbd4a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:23.396445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7f738197-cbdd-434c-9dbf-1f06f14c9113 req-28154b81-30b1-4885-a86f-40779d4fbd4a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:23.408862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b32bcef-4d69-4512-933b-382eea059359 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:23.409845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b32bcef-4d69-4512-933b-382eea059359 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:23.410295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b32bcef-4d69-4512-933b-382eea059359 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:23.410752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-5b32bcef-4d69-4512-933b-382eea059359 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lazy-loading 'fault' on Instance uuid 5ee6daec-1cf6-45be-943c-20749b8d7d85 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:07:23.410868 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-7f738197-cbdd-434c-9dbf-1f06f14c9113 req-28154b81-30b1-4885-a86f-40779d4fbd4a service nova] Creating event network-vif-plugged:edbb0f10-da6d-409d-8978-de8280afa7df for instance 65c62cb3-ec7c-43fa-9840-1c0fef87ae15 on n-h1-862964-3 Oct 29 01:07:23.419659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [req-7f738197-cbdd-434c-9dbf-1f06f14c9113 req-28154b81-30b1-4885-a86f-40779d4fbd4a service nova] Instance 65c62cb3-ec7c-43fa-9840-1c0fef87ae15 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121100) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:07:23.433909 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-7f738197-cbdd-434c-9dbf-1f06f14c9113 req-28154b81-30b1-4885-a86f-40779d4fbd4a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063050 Oct 29 01:07:23.439141 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 420/867] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:23.451835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d650b64-4af7-4931-8835-754871e79cc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1690117810", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "a9a5a9b1-7f02-4874-83d4-c48badd76f5f"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:23.469904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5b32bcef-4d69-4512-933b-382eea059359 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d53762f33554711a9114f273918f2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed69fb18603408db6f91a05423e3ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:23.479175 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5b32bcef-4d69-4512-933b-382eea059359 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85" status: 200 len: 1322 microversion: 2.1 time: 0.156572 Oct 29 01:07:23.480031 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 448/868] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:23 2022] GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:23.501797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-15bc0cb7-e470-4bab-b1eb-48566264a922 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:23.503251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-15bc0cb7-e470-4bab-b1eb-48566264a922 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:23.509980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15bc0cb7-e470-4bab-b1eb-48566264a922 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:23.510565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15bc0cb7-e470-4bab-b1eb-48566264a922 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:23.511081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15bc0cb7-e470-4bab-b1eb-48566264a922 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:23.511939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15bc0cb7-e470-4bab-b1eb-48566264a922 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:23.512614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15bc0cb7-e470-4bab-b1eb-48566264a922 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:23.512977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15bc0cb7-e470-4bab-b1eb-48566264a922 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:23.558908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-7d650b64-4af7-4931-8835-754871e79cc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] validate_networks() for None {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:07:23.876621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-15bc0cb7-e470-4bab-b1eb-48566264a922 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:23.885471 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-15bc0cb7-e470-4bab-b1eb-48566264a922 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1555 microversion: 2.1 time: 0.387842 Oct 29 01:07:23.886056 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 449/869] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:23 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1555 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:23.909304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f952f0f9-4ec9-4490-987c-76470ddf1e84 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:23.909885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f952f0f9-4ec9-4490-987c-76470ddf1e84 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:23.916230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f952f0f9-4ec9-4490-987c-76470ddf1e84 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:23.918489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f952f0f9-4ec9-4490-987c-76470ddf1e84 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:23.918489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f952f0f9-4ec9-4490-987c-76470ddf1e84 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:23.918489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f952f0f9-4ec9-4490-987c-76470ddf1e84 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:23.918828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f952f0f9-4ec9-4490-987c-76470ddf1e84 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:23.919258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f952f0f9-4ec9-4490-987c-76470ddf1e84 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:24.016296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-7d650b64-4af7-4931-8835-754871e79cc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:07:24.016832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-7d650b64-4af7-4931-8835-754871e79cc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:07:24.017376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-7d650b64-4af7-4931-8835-754871e79cc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:07:24.017872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-7d650b64-4af7-4931-8835-754871e79cc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:07:24.018283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-7d650b64-4af7-4931-8835-754871e79cc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:07:24.027265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d650b64-4af7-4931-8835-754871e79cc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:24.027747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d650b64-4af7-4931-8835-754871e79cc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:24.028177 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d650b64-4af7-4931-8835-754871e79cc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:24.028899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d650b64-4af7-4931-8835-754871e79cc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:24.029670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d650b64-4af7-4931-8835-754871e79cc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:24.030084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d650b64-4af7-4931-8835-754871e79cc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:24.041003 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f952f0f9-4ec9-4490-987c-76470ddf1e84 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136137 Oct 29 01:07:24.046198 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 450/870] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:07:23 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:07:24.051060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-7d650b64-4af7-4931-8835-754871e79cc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for project fba91819dd56439daea17217c5d7b9b7. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:07:24.054209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c4ac63a6-9b43-4037-b80e-4e21776b06c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:24.055154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c4ac63a6-9b43-4037-b80e-4e21776b06c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:24.060654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-7d650b64-4af7-4931-8835-754871e79cc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Getting quotas for user 175bb8f8b330495394cd401223847733 and project fba91819dd56439daea17217c5d7b9b7. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:07:24.063576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4ac63a6-9b43-4037-b80e-4e21776b06c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:24.064331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4ac63a6-9b43-4037-b80e-4e21776b06c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:24.066214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4ac63a6-9b43-4037-b80e-4e21776b06c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:24.067447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4ac63a6-9b43-4037-b80e-4e21776b06c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:24.068098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4ac63a6-9b43-4037-b80e-4e21776b06c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:24.068679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4ac63a6-9b43-4037-b80e-4e21776b06c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:24.078674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7d650b64-4af7-4931-8835-754871e79cc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:07:24.082942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7d650b64-4af7-4931-8835-754871e79cc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:07:24.104125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:24.254433 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7d650b64-4af7-4931-8835-754871e79cc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813158 Oct 29 01:07:24.255272 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 421/871] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:07:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:07:24.268485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eded4131-911a-41e1-a037-0482aa26e3fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:24.269430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-eded4131-911a-41e1-a037-0482aa26e3fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:24.279473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eded4131-911a-41e1-a037-0482aa26e3fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:24.280227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eded4131-911a-41e1-a037-0482aa26e3fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:24.280830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eded4131-911a-41e1-a037-0482aa26e3fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:24.282051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eded4131-911a-41e1-a037-0482aa26e3fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:24.282663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eded4131-911a-41e1-a037-0482aa26e3fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:24.283372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eded4131-911a-41e1-a037-0482aa26e3fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:24.424354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c4ac63a6-9b43-4037-b80e-4e21776b06c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:24.428965 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c4ac63a6-9b43-4037-b80e-4e21776b06c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1470 microversion: 2.1 time: 0.381408 Oct 29 01:07:24.431191 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 451/872] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:24 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1470 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:24.435814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8f559edb-5199-473d-8893-ac64252da66a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:24.436635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8f559edb-5199-473d-8893-ac64252da66a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:24.577370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8f559edb-5199-473d-8893-ac64252da66a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:24.590349 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8f559edb-5199-473d-8893-ac64252da66a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1217 microversion: 2.1 time: 0.157723 Oct 29 01:07:24.592060 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 452/873] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:24 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:24.605149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-eded4131-911a-41e1-a037-0482aa26e3fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:24.611748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1d093d36-f2af-4120-8d1d-98411183682a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:24.611748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1d093d36-f2af-4120-8d1d-98411183682a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:24.611748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:24.618205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d093d36-f2af-4120-8d1d-98411183682a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:24.618949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d093d36-f2af-4120-8d1d-98411183682a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:24.619689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d093d36-f2af-4120-8d1d-98411183682a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:24.621612 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-eded4131-911a-41e1-a037-0482aa26e3fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1311 microversion: 2.1 time: 0.358171 Oct 29 01:07:24.621761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d093d36-f2af-4120-8d1d-98411183682a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:24.623028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d093d36-f2af-4120-8d1d-98411183682a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:24.623504 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 422/874] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:24 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1311 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:24.624248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d093d36-f2af-4120-8d1d-98411183682a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:24.629112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4b0bd247-30f4-4005-9bc5-00a73a15999c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:24.629867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4b0bd247-30f4-4005-9bc5-00a73a15999c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] [instance: 5ee6daec-1cf6-45be-943c-20749b8d7d85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:24.643613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b0bd247-30f4-4005-9bc5-00a73a15999c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:24.644457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b0bd247-30f4-4005-9bc5-00a73a15999c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:24.644955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b0bd247-30f4-4005-9bc5-00a73a15999c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:24.645881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b0bd247-30f4-4005-9bc5-00a73a15999c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:24.647147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b0bd247-30f4-4005-9bc5-00a73a15999c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:24.647822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b0bd247-30f4-4005-9bc5-00a73a15999c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:24.664489 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-4b0bd247-30f4-4005-9bc5-00a73a15999c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] HTTP exception thrown: Instance 5ee6daec-1cf6-45be-943c-20749b8d7d85 could not be found. Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4b0bd247-30f4-4005-9bc5-00a73a15999c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Request method failure captured: Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85 HTTP/1.1 Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHyNM-oQJLOZR5D75mMgEVZWYe-L8kVeqFzbyjW9DOD4FI3jzoBXRVbBpc_E3VyN3o--xqQ6iimWGND3I50I4FgFmrsyNJuHwJDQtteMLBjg_tlensmRhl1TA7xEFVnYU4-dfFkDd4XyzlmvFJVm-4ImLXtOpvc2H8R9d2XkTF5Xu0I Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: aed69fb18603408db6f91a05423e3ffb Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:07:24.666267 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:07:24.667598 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aed69fb18603408db6f91a05423e3ffb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aed69fb18603408db6f91a05423e3ffb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aed69fb18603408db6f91a05423e3ffb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aed69fb18603408db6f91a05423e3ffb", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:07:24.667598 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 Oct 29 01:07:24.667598 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: aed69fb18603408db6f91a05423e3ffb Oct 29 01:07:24.667598 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 Oct 29 01:07:24.667598 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project Oct 29 01:07:24.667598 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:07:24.667598 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:07:24.667598 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 9d53762f33554711a9114f273918f2eb Oct 29 01:07:24.667598 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project Oct 29 01:07:24.667598 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:07:24.667598 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 5ee6daec-1cf6-45be-943c-20749b8d7d85 could not be found. Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '5ee6daec-1cf6-45be-943c-20749b8d7d85'} Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ee6daec-1cf6-45be-943c-20749b8d7d85 could not be found. Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:07:24.668301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:07:24.674809 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:07:24.674809 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:07:24.674809 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:07:24.674809 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:07:24.674809 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:07:24.674809 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:07:24.674809 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:07:24.674809 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:07:24.674809 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ee6daec-1cf6-45be-943c-20749b8d7d85 could not be found. Oct 29 01:07:24.674809 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:24.674809 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:24.674809 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:24.674809 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:24.674809 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:24.674809 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:24.674809 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:07:24.674809 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:07:24.674809 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ee6daec-1cf6-45be-943c-20749b8d7d85 could not be found. Oct 29 01:07:24.674809 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:24.676408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4b0bd247-30f4-4005-9bc5-00a73a15999c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] Returning 404 to user: Instance 5ee6daec-1cf6-45be-943c-20749b8d7d85 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:07:24.676408 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4b0bd247-30f4-4005-9bc5-00a73a15999c tempest-FloatingIPsAssociationNegativeTestJSON-1014721471 tempest-FloatingIPsAssociationNegativeTestJSON-1014721471-project] 10.222.0.26 "GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85" status: 404 len: 111 microversion: 2.1 time: 0.042666 Oct 29 01:07:24.676408 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 423/875] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:24 2022] GET /compute/v2.1/servers/5ee6daec-1cf6-45be-943c-20749b8d7d85 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:07:24.742839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1d093d36-f2af-4120-8d1d-98411183682a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:24.757794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1d093d36-f2af-4120-8d1d-98411183682a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:24.759391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1d093d36-f2af-4120-8d1d-98411183682a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:24.760707 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1d093d36-f2af-4120-8d1d-98411183682a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1290 microversion: 2.25 time: 0.167330 Oct 29 01:07:24.778445 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 453/876] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:24 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1290 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:25.458503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-90b8a713-7370-4553-9576-4cc7a7c768c5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:25.459171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-90b8a713-7370-4553-9576-4cc7a7c768c5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:25.467404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90b8a713-7370-4553-9576-4cc7a7c768c5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:25.472280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90b8a713-7370-4553-9576-4cc7a7c768c5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:25.472728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90b8a713-7370-4553-9576-4cc7a7c768c5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:25.473483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90b8a713-7370-4553-9576-4cc7a7c768c5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:25.474111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90b8a713-7370-4553-9576-4cc7a7c768c5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:25.474722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90b8a713-7370-4553-9576-4cc7a7c768c5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:25.619737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e27b5636-4d76-4ebc-9a54-fbf95f3a11f8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:25.621412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e27b5636-4d76-4ebc-9a54-fbf95f3a11f8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:25.633656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e27b5636-4d76-4ebc-9a54-fbf95f3a11f8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:25.634942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e27b5636-4d76-4ebc-9a54-fbf95f3a11f8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:25.635789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e27b5636-4d76-4ebc-9a54-fbf95f3a11f8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:25.637171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e27b5636-4d76-4ebc-9a54-fbf95f3a11f8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:25.641323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e27b5636-4d76-4ebc-9a54-fbf95f3a11f8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:25.642833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e27b5636-4d76-4ebc-9a54-fbf95f3a11f8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:25.938948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e27b5636-4d76-4ebc-9a54-fbf95f3a11f8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:25.948419 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e27b5636-4d76-4ebc-9a54-fbf95f3a11f8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1221 microversion: 2.1 time: 0.333025 Oct 29 01:07:25.949003 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 454/877] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:25 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1221 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:25.954187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aba1eeac-2306-4e2e-83b5-6d4c675871fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:25.955027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-aba1eeac-2306-4e2e-83b5-6d4c675871fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:25.988070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aba1eeac-2306-4e2e-83b5-6d4c675871fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:25.992372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aba1eeac-2306-4e2e-83b5-6d4c675871fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:25.992372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aba1eeac-2306-4e2e-83b5-6d4c675871fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:25.992372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aba1eeac-2306-4e2e-83b5-6d4c675871fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:25.992372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aba1eeac-2306-4e2e-83b5-6d4c675871fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:25.993342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aba1eeac-2306-4e2e-83b5-6d4c675871fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:26.122308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-90b8a713-7370-4553-9576-4cc7a7c768c5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:26.132689 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-90b8a713-7370-4553-9576-4cc7a7c768c5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1462 microversion: 2.1 time: 0.679025 Oct 29 01:07:26.149573 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 424/878] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:25 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1462 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:26.159879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-40962e2c-7330-4e39-beeb-be7aa9f26144 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:26.160774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-40962e2c-7330-4e39-beeb-be7aa9f26144 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:26.176111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40962e2c-7330-4e39-beeb-be7aa9f26144 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:26.178063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40962e2c-7330-4e39-beeb-be7aa9f26144 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:26.179943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40962e2c-7330-4e39-beeb-be7aa9f26144 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:26.181253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40962e2c-7330-4e39-beeb-be7aa9f26144 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:26.187534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40962e2c-7330-4e39-beeb-be7aa9f26144 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:26.187534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40962e2c-7330-4e39-beeb-be7aa9f26144 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:26.287441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-aba1eeac-2306-4e2e-83b5-6d4c675871fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:26.304191 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aba1eeac-2306-4e2e-83b5-6d4c675871fe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1311 microversion: 2.1 time: 0.353849 Oct 29 01:07:26.317313 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 455/879] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:25 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1311 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:26.317638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-acb51ca5-a4cb-4d10-93b2-42982ad1e44a req-eeaf678c-ddfd-4642-acfe-cda58efec8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f38f9413-877d-43ab-b4ed-294552b3c231", "tag": "dba01d43-1d1a-480f-89cd-3555f1ef20a4"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:26.342418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-40962e2c-7330-4e39-beeb-be7aa9f26144 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:26.345524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-acb51ca5-a4cb-4d10-93b2-42982ad1e44a req-eeaf678c-ddfd-4642-acfe-cda58efec8b9 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:26.346848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-acb51ca5-a4cb-4d10-93b2-42982ad1e44a req-eeaf678c-ddfd-4642-acfe-cda58efec8b9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:26.347072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-acb51ca5-a4cb-4d10-93b2-42982ad1e44a req-eeaf678c-ddfd-4642-acfe-cda58efec8b9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:26.375739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-40962e2c-7330-4e39-beeb-be7aa9f26144 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:26.378939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-40962e2c-7330-4e39-beeb-be7aa9f26144 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:26.380775 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-40962e2c-7330-4e39-beeb-be7aa9f26144 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1338 microversion: 2.25 time: 0.229669 Oct 29 01:07:26.386684 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 425/880] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:26 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1338 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:26.392192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-90498821-fa8d-47d3-bfd6-c0845682fc85 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:26.394158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-90498821-fa8d-47d3-bfd6-c0845682fc85 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:26.401009 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-acb51ca5-a4cb-4d10-93b2-42982ad1e44a req-eeaf678c-ddfd-4642-acfe-cda58efec8b9 service nova] Creating event network-changed:dba01d43-1d1a-480f-89cd-3555f1ef20a4 for instance f38f9413-877d-43ab-b4ed-294552b3c231 on n-h2-862964-3 Oct 29 01:07:26.402724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90498821-fa8d-47d3-bfd6-c0845682fc85 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:26.403487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90498821-fa8d-47d3-bfd6-c0845682fc85 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:26.404340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90498821-fa8d-47d3-bfd6-c0845682fc85 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:26.405357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90498821-fa8d-47d3-bfd6-c0845682fc85 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:26.406376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90498821-fa8d-47d3-bfd6-c0845682fc85 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:26.407037 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90498821-fa8d-47d3-bfd6-c0845682fc85 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:26.415102 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-acb51ca5-a4cb-4d10-93b2-42982ad1e44a req-eeaf678c-ddfd-4642-acfe-cda58efec8b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105347 Oct 29 01:07:26.416239 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 456/881] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:26.694039 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-90498821-fa8d-47d3-bfd6-c0845682fc85 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1613 microversion: 2.1 time: 0.305981 Oct 29 01:07:26.701270 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 426/882] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:26 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1613 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:26.732352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-834b18cb-a8d7-42ba-a69b-3dc871a551dc tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Calling method '.version_select at 0x7f9d9c157280>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:26.736184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-834b18cb-a8d7-42ba-a69b-3dc871a551dc tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:26.739494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-834b18cb-a8d7-42ba-a69b-3dc871a551dc tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:26.739494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-834b18cb-a8d7-42ba-a69b-3dc871a551dc tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:26.756993 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-834b18cb-a8d7-42ba-a69b-3dc871a551dc tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1177 microversion: 2.1 time: 0.029835 Oct 29 01:07:26.773928 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 457/883] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 29 01:07:26 2022] GET /compute/v2.1/os-migrations => generated 1177 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:26.919110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-32dd2658-f2a0-42d8-a663-aac295652ead tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-141889920", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:26.980909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f65fb519-af73-472c-a1e4-cfc75a629fa6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:26.981792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f65fb519-af73-472c-a1e4-cfc75a629fa6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:27.003275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f65fb519-af73-472c-a1e4-cfc75a629fa6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:27.009187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f65fb519-af73-472c-a1e4-cfc75a629fa6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:27.011968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f65fb519-af73-472c-a1e4-cfc75a629fa6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:27.014083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f65fb519-af73-472c-a1e4-cfc75a629fa6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:27.029014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f65fb519-af73-472c-a1e4-cfc75a629fa6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:27.029698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f65fb519-af73-472c-a1e4-cfc75a629fa6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:27.047199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-32dd2658-f2a0-42d8-a663-aac295652ead tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] validate_networks() for None {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:07:27.232631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f65fb519-af73-472c-a1e4-cfc75a629fa6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:27.242322 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f65fb519-af73-472c-a1e4-cfc75a629fa6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1269 microversion: 2.1 time: 0.270559 Oct 29 01:07:27.254561 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 458/884] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:26 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1269 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:27.332232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6963c5e2-9af5-4fac-918d-60cdd4f37bb5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:27.332997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6963c5e2-9af5-4fac-918d-60cdd4f37bb5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:27.344993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6963c5e2-9af5-4fac-918d-60cdd4f37bb5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:27.345548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6963c5e2-9af5-4fac-918d-60cdd4f37bb5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:27.348254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6963c5e2-9af5-4fac-918d-60cdd4f37bb5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:27.349005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6963c5e2-9af5-4fac-918d-60cdd4f37bb5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:27.349511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6963c5e2-9af5-4fac-918d-60cdd4f37bb5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:27.349946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6963c5e2-9af5-4fac-918d-60cdd4f37bb5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:27.585447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-32dd2658-f2a0-42d8-a663-aac295652ead tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:07:27.585774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-32dd2658-f2a0-42d8-a663-aac295652ead tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:07:27.586240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-32dd2658-f2a0-42d8-a663-aac295652ead tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:07:27.586817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-32dd2658-f2a0-42d8-a663-aac295652ead tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:07:27.587410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-32dd2658-f2a0-42d8-a663-aac295652ead tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:07:27.602669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32dd2658-f2a0-42d8-a663-aac295652ead tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:27.603533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32dd2658-f2a0-42d8-a663-aac295652ead tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:27.604383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32dd2658-f2a0-42d8-a663-aac295652ead tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:27.605422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32dd2658-f2a0-42d8-a663-aac295652ead tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:27.606099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32dd2658-f2a0-42d8-a663-aac295652ead tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:27.606709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32dd2658-f2a0-42d8-a663-aac295652ead tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:27.636241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-32dd2658-f2a0-42d8-a663-aac295652ead tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Getting quotas for project 646dbadc4e9140348132e6950c885e81. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:07:27.643603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-32dd2658-f2a0-42d8-a663-aac295652ead tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Getting quotas for user 8219d81b19964408b9bc275a4457f389 and project 646dbadc4e9140348132e6950c885e81. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:07:27.683705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:27.686116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-32dd2658-f2a0-42d8-a663-aac295652ead tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:07:27.690311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-32dd2658-f2a0-42d8-a663-aac295652ead tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:07:27.724999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6963c5e2-9af5-4fac-918d-60cdd4f37bb5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:27.736844 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6963c5e2-9af5-4fac-918d-60cdd4f37bb5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1311 microversion: 2.1 time: 0.407603 Oct 29 01:07:27.739980 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 459/885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:27 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1311 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:27.749947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bc35554b-8d74-47f6-9703-955e2177721d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:27.751837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bc35554b-8d74-47f6-9703-955e2177721d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:27.770450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc35554b-8d74-47f6-9703-955e2177721d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:27.780505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc35554b-8d74-47f6-9703-955e2177721d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:27.780505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc35554b-8d74-47f6-9703-955e2177721d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:27.780505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc35554b-8d74-47f6-9703-955e2177721d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:27.780505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc35554b-8d74-47f6-9703-955e2177721d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:27.781199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc35554b-8d74-47f6-9703-955e2177721d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:27.869749 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-32dd2658-f2a0-42d8-a663-aac295652ead tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.954762 Oct 29 01:07:27.872530 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 427/886] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:07:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:07:27.885305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-46a43bac-fea5-4a79-82cb-98c703e8f8c5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:27.886366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-46a43bac-fea5-4a79-82cb-98c703e8f8c5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:27.962465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bc35554b-8d74-47f6-9703-955e2177721d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:27.987877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bc35554b-8d74-47f6-9703-955e2177721d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:27.992814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bc35554b-8d74-47f6-9703-955e2177721d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:27.995900 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bc35554b-8d74-47f6-9703-955e2177721d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1344 microversion: 2.25 time: 0.253209 Oct 29 01:07:27.997926 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 460/887] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:27 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1344 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:28.020802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-46a43bac-fea5-4a79-82cb-98c703e8f8c5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:28.031895 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-46a43bac-fea5-4a79-82cb-98c703e8f8c5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1212 microversion: 2.1 time: 0.151893 Oct 29 01:07:28.034384 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 428/888] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:27 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1212 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:28.268852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fbc0c591-47e3-4752-94e7-f3c618094da3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:28.272374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fbc0c591-47e3-4752-94e7-f3c618094da3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:28.292710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbc0c591-47e3-4752-94e7-f3c618094da3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:28.303181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbc0c591-47e3-4752-94e7-f3c618094da3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:28.306135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbc0c591-47e3-4752-94e7-f3c618094da3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:28.310311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbc0c591-47e3-4752-94e7-f3c618094da3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:28.314091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbc0c591-47e3-4752-94e7-f3c618094da3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:28.316590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbc0c591-47e3-4752-94e7-f3c618094da3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:28.462270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fbc0c591-47e3-4752-94e7-f3c618094da3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:28.476851 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fbc0c591-47e3-4752-94e7-f3c618094da3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1275 microversion: 2.1 time: 0.212513 Oct 29 01:07:28.478870 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 461/889] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:28 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1275 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:28.760590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6f8331e2-9133-46c6-8298-c07ca0937ad7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:28.761248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6f8331e2-9133-46c6-8298-c07ca0937ad7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:28.769325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f8331e2-9133-46c6-8298-c07ca0937ad7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:28.769872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f8331e2-9133-46c6-8298-c07ca0937ad7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:28.770499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f8331e2-9133-46c6-8298-c07ca0937ad7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:28.771206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f8331e2-9133-46c6-8298-c07ca0937ad7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:28.771665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f8331e2-9133-46c6-8298-c07ca0937ad7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:28.772088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f8331e2-9133-46c6-8298-c07ca0937ad7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:29.031025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0d948854-9ca2-464f-9408-b66d7e1e1475 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:29.033238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0d948854-9ca2-464f-9408-b66d7e1e1475 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:29.044077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d948854-9ca2-464f-9408-b66d7e1e1475 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:29.045091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d948854-9ca2-464f-9408-b66d7e1e1475 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:29.045804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d948854-9ca2-464f-9408-b66d7e1e1475 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:29.046752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d948854-9ca2-464f-9408-b66d7e1e1475 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:29.047365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d948854-9ca2-464f-9408-b66d7e1e1475 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:29.048085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d948854-9ca2-464f-9408-b66d7e1e1475 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:29.079993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6f8331e2-9133-46c6-8298-c07ca0937ad7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:29.090083 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6f8331e2-9133-46c6-8298-c07ca0937ad7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1311 microversion: 2.1 time: 0.333932 Oct 29 01:07:29.090661 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 429/890] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:28 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1311 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:29.105043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dd6cb44b-ed05-4779-8fcd-8a98e242e59a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:29.105983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dd6cb44b-ed05-4779-8fcd-8a98e242e59a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:29.164841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0d948854-9ca2-464f-9408-b66d7e1e1475 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:29.187458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0d948854-9ca2-464f-9408-b66d7e1e1475 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:29.188966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0d948854-9ca2-464f-9408-b66d7e1e1475 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:29.190309 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0d948854-9ca2-464f-9408-b66d7e1e1475 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1344 microversion: 2.25 time: 0.166253 Oct 29 01:07:29.202885 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 462/891] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:29 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1344 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:07:29.218128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-dd6cb44b-ed05-4779-8fcd-8a98e242e59a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:29.231060 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dd6cb44b-ed05-4779-8fcd-8a98e242e59a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1212 microversion: 2.1 time: 0.135426 Oct 29 01:07:29.232324 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 430/892] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:29 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1212 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:29.510400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e449bc54-a905-49d7-81ad-62685d3aed90 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:29.511122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e449bc54-a905-49d7-81ad-62685d3aed90 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:29.520638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e449bc54-a905-49d7-81ad-62685d3aed90 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:29.521480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e449bc54-a905-49d7-81ad-62685d3aed90 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:29.522073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e449bc54-a905-49d7-81ad-62685d3aed90 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:29.525322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e449bc54-a905-49d7-81ad-62685d3aed90 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:29.525322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e449bc54-a905-49d7-81ad-62685d3aed90 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:29.525322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e449bc54-a905-49d7-81ad-62685d3aed90 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:29.626009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e449bc54-a905-49d7-81ad-62685d3aed90 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:29.635295 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e449bc54-a905-49d7-81ad-62685d3aed90 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1275 microversion: 2.1 time: 0.131482 Oct 29 01:07:29.639652 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 463/893] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:29 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1275 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:29.658664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-78937717-05db-4c64-8f76-8191b566eeef req-801c92ed-7585-47ab-9967-bf7bdad68bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5", "name": "network-vif-plugged", "status": "completed", "tag": "3696a714-c84c-4ccf-a78d-0b8a642038f9"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:29.675446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-78937717-05db-4c64-8f76-8191b566eeef req-801c92ed-7585-47ab-9967-bf7bdad68bd6 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:29.680162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-78937717-05db-4c64-8f76-8191b566eeef req-801c92ed-7585-47ab-9967-bf7bdad68bd6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:29.680162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-78937717-05db-4c64-8f76-8191b566eeef req-801c92ed-7585-47ab-9967-bf7bdad68bd6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:29.709375 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-78937717-05db-4c64-8f76-8191b566eeef req-801c92ed-7585-47ab-9967-bf7bdad68bd6 service nova] Creating event network-vif-plugged:3696a714-c84c-4ccf-a78d-0b8a642038f9 for instance cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 on n-h1-862964-3 Oct 29 01:07:29.738415 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-78937717-05db-4c64-8f76-8191b566eeef req-801c92ed-7585-47ab-9967-bf7bdad68bd6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084496 Oct 29 01:07:29.740257 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 431/894] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:29.934055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9e5ab842-4326-4977-abc1-ff13029193bf tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1470406761", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": "none"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:30.012656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9e5ab842-4326-4977-abc1-ff13029193bf tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:07:30.013141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9e5ab842-4326-4977-abc1-ff13029193bf tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:07:30.013646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9e5ab842-4326-4977-abc1-ff13029193bf tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:07:30.018504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9e5ab842-4326-4977-abc1-ff13029193bf tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:07:30.018504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9e5ab842-4326-4977-abc1-ff13029193bf tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:07:30.026839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e5ab842-4326-4977-abc1-ff13029193bf tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:30.027404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e5ab842-4326-4977-abc1-ff13029193bf tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:30.027908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e5ab842-4326-4977-abc1-ff13029193bf tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:30.028879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e5ab842-4326-4977-abc1-ff13029193bf tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:30.029755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e5ab842-4326-4977-abc1-ff13029193bf tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:30.030638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e5ab842-4326-4977-abc1-ff13029193bf tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:30.050847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-9e5ab842-4326-4977-abc1-ff13029193bf tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Getting quotas for project 4588a9c84a1442c1ac953fccdcef476b. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:07:30.056235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-9e5ab842-4326-4977-abc1-ff13029193bf tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Getting quotas for user b9806b022cbf4505939c94b658f797e5 and project 4588a9c84a1442c1ac953fccdcef476b. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:07:30.069950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9e5ab842-4326-4977-abc1-ff13029193bf tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:07:30.072254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9e5ab842-4326-4977-abc1-ff13029193bf tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:07:30.116034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-edfb4153-8377-4c78-8bf3-8bde38e02818 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:30.116731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-edfb4153-8377-4c78-8bf3-8bde38e02818 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:30.123359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edfb4153-8377-4c78-8bf3-8bde38e02818 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:30.127886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edfb4153-8377-4c78-8bf3-8bde38e02818 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:30.127886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edfb4153-8377-4c78-8bf3-8bde38e02818 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:30.127886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edfb4153-8377-4c78-8bf3-8bde38e02818 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:30.127886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edfb4153-8377-4c78-8bf3-8bde38e02818 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:30.128255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edfb4153-8377-4c78-8bf3-8bde38e02818 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:30.224244 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9e5ab842-4326-4977-abc1-ff13029193bf tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.513454 Oct 29 01:07:30.228866 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 464/895] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 29 01:07:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 01:07:30.236434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7fbf1e61-6b85-467c-8266-987f5d0f933f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:30.240470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7fbf1e61-6b85-467c-8266-987f5d0f933f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:30.255803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fbf1e61-6b85-467c-8266-987f5d0f933f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:30.256630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fbf1e61-6b85-467c-8266-987f5d0f933f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:30.257347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fbf1e61-6b85-467c-8266-987f5d0f933f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:30.259204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fbf1e61-6b85-467c-8266-987f5d0f933f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:30.260100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fbf1e61-6b85-467c-8266-987f5d0f933f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:30.260751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fbf1e61-6b85-467c-8266-987f5d0f933f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:30.327919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-edfb4153-8377-4c78-8bf3-8bde38e02818 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:30.343509 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-edfb4153-8377-4c78-8bf3-8bde38e02818 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1311 microversion: 2.1 time: 0.233191 Oct 29 01:07:30.373332 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 432/896] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:30 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1311 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:30.387760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5f214afb-8c00-4096-b418-d93a5f948a12 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:30.394191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5f214afb-8c00-4096-b418-d93a5f948a12 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:30.551617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7fbf1e61-6b85-467c-8266-987f5d0f933f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:30.569623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7fbf1e61-6b85-467c-8266-987f5d0f933f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:30.571873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7fbf1e61-6b85-467c-8266-987f5d0f933f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:30.573287 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7fbf1e61-6b85-467c-8266-987f5d0f933f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1412 microversion: 2.25 time: 0.343256 Oct 29 01:07:30.574607 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 465/897] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:30 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1412 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:30.579452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f9e68058-2db3-4b88-93dc-a539e333253c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:30.581860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f9e68058-2db3-4b88-93dc-a539e333253c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:30.588942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9e68058-2db3-4b88-93dc-a539e333253c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:30.589562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9e68058-2db3-4b88-93dc-a539e333253c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:30.590205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9e68058-2db3-4b88-93dc-a539e333253c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:30.592179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9e68058-2db3-4b88-93dc-a539e333253c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:30.593282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9e68058-2db3-4b88-93dc-a539e333253c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:30.593924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9e68058-2db3-4b88-93dc-a539e333253c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:30.707528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5f214afb-8c00-4096-b418-d93a5f948a12 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:30.720730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5f214afb-8c00-4096-b418-d93a5f948a12 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:30.724434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5f214afb-8c00-4096-b418-d93a5f948a12 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:30.747097 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5f214afb-8c00-4096-b418-d93a5f948a12 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "PUT /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1359 microversion: 2.75 time: 0.368193 Oct 29 01:07:30.747405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f9e68058-2db3-4b88-93dc-a539e333253c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:30.773358 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f9e68058-2db3-4b88-93dc-a539e333253c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1264 microversion: 2.1 time: 0.193618 Oct 29 01:07:30.774013 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 466/898] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:30 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1264 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:30.779689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-47ba7e68-be89-430f-bf54-77f0218796bd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:30.780588 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 433/899] 10.222.0.26 () {62 vars in 1297 bytes} [Sat Oct 29 01:07:30 2022] PUT /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1359 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:30.787454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-47ba7e68-be89-430f-bf54-77f0218796bd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:30.794746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-004efb56-cd9d-43a1-bba5-05de45c6a080 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:30.794746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-004efb56-cd9d-43a1-bba5-05de45c6a080 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:30.803951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47ba7e68-be89-430f-bf54-77f0218796bd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:30.804520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47ba7e68-be89-430f-bf54-77f0218796bd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:30.808136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47ba7e68-be89-430f-bf54-77f0218796bd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:30.808947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47ba7e68-be89-430f-bf54-77f0218796bd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:30.811423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47ba7e68-be89-430f-bf54-77f0218796bd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:30.811846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47ba7e68-be89-430f-bf54-77f0218796bd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:30.907175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-004efb56-cd9d-43a1-bba5-05de45c6a080 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:30.916248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-004efb56-cd9d-43a1-bba5-05de45c6a080 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:30.917826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-004efb56-cd9d-43a1-bba5-05de45c6a080 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:30.941450 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-004efb56-cd9d-43a1-bba5-05de45c6a080 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1359 microversion: 2.75 time: 0.143749 Oct 29 01:07:30.941450 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 434/900] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:30 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:31.014250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-47ba7e68-be89-430f-bf54-77f0218796bd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:31.021285 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-47ba7e68-be89-430f-bf54-77f0218796bd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1317 microversion: 2.1 time: 0.245522 Oct 29 01:07:31.022449 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 467/901] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:30 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:31.371781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9594e508-1d25-441d-8ed5-21885158ed79 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:31.372440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9594e508-1d25-441d-8ed5-21885158ed79 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:31.386039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9594e508-1d25-441d-8ed5-21885158ed79 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:31.387757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9594e508-1d25-441d-8ed5-21885158ed79 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:31.390830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9594e508-1d25-441d-8ed5-21885158ed79 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:31.393501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9594e508-1d25-441d-8ed5-21885158ed79 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:31.394300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9594e508-1d25-441d-8ed5-21885158ed79 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:31.394946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9594e508-1d25-441d-8ed5-21885158ed79 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:31.400983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:31.603244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dee11cad-2b6f-44ee-8301-ffc9bf869d2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:31.603870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dee11cad-2b6f-44ee-8301-ffc9bf869d2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:31.612312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9594e508-1d25-441d-8ed5-21885158ed79 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:31.623015 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9594e508-1d25-441d-8ed5-21885158ed79 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1311 microversion: 2.1 time: 0.255163 Oct 29 01:07:31.627579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dee11cad-2b6f-44ee-8301-ffc9bf869d2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:31.632260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dee11cad-2b6f-44ee-8301-ffc9bf869d2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:31.633010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dee11cad-2b6f-44ee-8301-ffc9bf869d2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:31.634332 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 435/902] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:31 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1311 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:31.638014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dee11cad-2b6f-44ee-8301-ffc9bf869d2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:31.639003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dee11cad-2b6f-44ee-8301-ffc9bf869d2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:31.639524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dee11cad-2b6f-44ee-8301-ffc9bf869d2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:31.803309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-78ba771d-089d-4d26-9331-0d15e1799f5d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:31.804482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-78ba771d-089d-4d26-9331-0d15e1799f5d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:31.813922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-78ba771d-089d-4d26-9331-0d15e1799f5d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:31.815399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-78ba771d-089d-4d26-9331-0d15e1799f5d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:31.816040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-78ba771d-089d-4d26-9331-0d15e1799f5d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:31.816973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-78ba771d-089d-4d26-9331-0d15e1799f5d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:31.817878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-78ba771d-089d-4d26-9331-0d15e1799f5d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:31.818500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-78ba771d-089d-4d26-9331-0d15e1799f5d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:32.007168 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-78ba771d-089d-4d26-9331-0d15e1799f5d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:32.016732 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-78ba771d-089d-4d26-9331-0d15e1799f5d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1264 microversion: 2.1 time: 0.218498 Oct 29 01:07:32.026186 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 436/903] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:31 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1264 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:32.035244 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7b314b73-95d8-4b4e-bc4b-a31ea2704f72 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:32.035887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7b314b73-95d8-4b4e-bc4b-a31ea2704f72 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:32.055650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b314b73-95d8-4b4e-bc4b-a31ea2704f72 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:32.056979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b314b73-95d8-4b4e-bc4b-a31ea2704f72 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:32.058123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b314b73-95d8-4b4e-bc4b-a31ea2704f72 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:32.058667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dee11cad-2b6f-44ee-8301-ffc9bf869d2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:32.058864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b314b73-95d8-4b4e-bc4b-a31ea2704f72 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:32.060477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b314b73-95d8-4b4e-bc4b-a31ea2704f72 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:32.061078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b314b73-95d8-4b4e-bc4b-a31ea2704f72 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:32.074400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dee11cad-2b6f-44ee-8301-ffc9bf869d2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:32.077177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dee11cad-2b6f-44ee-8301-ffc9bf869d2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:32.078670 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dee11cad-2b6f-44ee-8301-ffc9bf869d2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1412 microversion: 2.25 time: 0.479606 Oct 29 01:07:32.079529 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 468/904] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:31 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1412 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:32.116040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-951b99c4-c235-41d9-b97d-9c493e2debf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:32.117607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-951b99c4-c235-41d9-b97d-9c493e2debf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:32.127134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-951b99c4-c235-41d9-b97d-9c493e2debf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:32.128055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-951b99c4-c235-41d9-b97d-9c493e2debf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:32.128820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-951b99c4-c235-41d9-b97d-9c493e2debf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:32.129898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-951b99c4-c235-41d9-b97d-9c493e2debf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:32.131864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-951b99c4-c235-41d9-b97d-9c493e2debf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:32.133330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-951b99c4-c235-41d9-b97d-9c493e2debf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:32.386835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7b314b73-95d8-4b4e-bc4b-a31ea2704f72 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:32.413860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7b314b73-95d8-4b4e-bc4b-a31ea2704f72 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:32.415816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7b314b73-95d8-4b4e-bc4b-a31ea2704f72 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:32.425640 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7b314b73-95d8-4b4e-bc4b-a31ea2704f72 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1363 microversion: 2.75 time: 0.398359 Oct 29 01:07:32.426478 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 437/905] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:32 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1363 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:32.457731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-323f37ee-3b1a-4af5-bc89-a77127da0591 req-8332b4dd-06c9-4d28-a407-4f0393bf5f88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72ffa89-8708-45d4-872f-65509e631d27", "tag": "454e8b33-3067-4ecd-9cee-b3d21ccf81cd"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:32.469658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-323f37ee-3b1a-4af5-bc89-a77127da0591 req-8332b4dd-06c9-4d28-a407-4f0393bf5f88 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:32.470383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-323f37ee-3b1a-4af5-bc89-a77127da0591 req-8332b4dd-06c9-4d28-a407-4f0393bf5f88 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:32.471507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-323f37ee-3b1a-4af5-bc89-a77127da0591 req-8332b4dd-06c9-4d28-a407-4f0393bf5f88 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:32.484533 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-323f37ee-3b1a-4af5-bc89-a77127da0591 req-8332b4dd-06c9-4d28-a407-4f0393bf5f88 service nova] Creating event network-changed:454e8b33-3067-4ecd-9cee-b3d21ccf81cd for instance c72ffa89-8708-45d4-872f-65509e631d27 on n-h2-862964-3 Oct 29 01:07:32.491725 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-323f37ee-3b1a-4af5-bc89-a77127da0591 req-8332b4dd-06c9-4d28-a407-4f0393bf5f88 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040296 Oct 29 01:07:32.492648 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 438/906] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:32.524978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-951b99c4-c235-41d9-b97d-9c493e2debf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:32.536411 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-951b99c4-c235-41d9-b97d-9c493e2debf6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1317 microversion: 2.1 time: 0.434011 Oct 29 01:07:32.537308 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 469/907] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:32 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:32.650226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-352a39e5-db2c-49c5-881e-569654a4d232 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:32.655204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-352a39e5-db2c-49c5-881e-569654a4d232 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:32.663404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-352a39e5-db2c-49c5-881e-569654a4d232 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:32.663897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-352a39e5-db2c-49c5-881e-569654a4d232 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:32.664333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-352a39e5-db2c-49c5-881e-569654a4d232 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:32.665043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-352a39e5-db2c-49c5-881e-569654a4d232 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:32.665608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-352a39e5-db2c-49c5-881e-569654a4d232 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:32.667609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-352a39e5-db2c-49c5-881e-569654a4d232 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:32.921373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-352a39e5-db2c-49c5-881e-569654a4d232 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:32.934703 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-352a39e5-db2c-49c5-881e-569654a4d232 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1493 microversion: 2.1 time: 0.289396 Oct 29 01:07:32.935509 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 439/908] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:32 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1493 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:33.041909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e4e9adf1-6195-4285-8b6a-7313021ab5df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:33.042822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e4e9adf1-6195-4285-8b6a-7313021ab5df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:33.055648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4e9adf1-6195-4285-8b6a-7313021ab5df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:33.056154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4e9adf1-6195-4285-8b6a-7313021ab5df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:33.056598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4e9adf1-6195-4285-8b6a-7313021ab5df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:33.057363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4e9adf1-6195-4285-8b6a-7313021ab5df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:33.060933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4e9adf1-6195-4285-8b6a-7313021ab5df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:33.060933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4e9adf1-6195-4285-8b6a-7313021ab5df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:33.219968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-811ff310-ee4f-461e-b0b4-2bc79c4692b1 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:33.222194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-811ff310-ee4f-461e-b0b4-2bc79c4692b1 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:33.230296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-811ff310-ee4f-461e-b0b4-2bc79c4692b1 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:33.231318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-811ff310-ee4f-461e-b0b4-2bc79c4692b1 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:33.232313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-811ff310-ee4f-461e-b0b4-2bc79c4692b1 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:33.233397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-811ff310-ee4f-461e-b0b4-2bc79c4692b1 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:33.238783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-811ff310-ee4f-461e-b0b4-2bc79c4692b1 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:33.238783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-811ff310-ee4f-461e-b0b4-2bc79c4692b1 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:33.472299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e4e9adf1-6195-4285-8b6a-7313021ab5df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:33.489800 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e4e9adf1-6195-4285-8b6a-7313021ab5df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1270 microversion: 2.1 time: 0.451337 Oct 29 01:07:33.509609 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 440/909] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:33 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1270 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:33.518122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4a427d27-c414-45cf-aa0c-90a9315f0b77 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:33.520857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4a427d27-c414-45cf-aa0c-90a9315f0b77 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:33.530309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a427d27-c414-45cf-aa0c-90a9315f0b77 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:33.531056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a427d27-c414-45cf-aa0c-90a9315f0b77 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:33.531668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a427d27-c414-45cf-aa0c-90a9315f0b77 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:33.532952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a427d27-c414-45cf-aa0c-90a9315f0b77 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:33.533801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a427d27-c414-45cf-aa0c-90a9315f0b77 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:33.534458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a427d27-c414-45cf-aa0c-90a9315f0b77 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:33.655539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:33.662135 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-811ff310-ee4f-461e-b0b4-2bc79c4692b1 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1644 microversion: 2.1 time: 0.706811 Oct 29 01:07:33.662734 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 470/910] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:32 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1644 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:33.685853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-85978f82-3659-4b52-abf7-a06d6ca3a30d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:33.686524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-85978f82-3659-4b52-abf7-a06d6ca3a30d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:33.710124 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85978f82-3659-4b52-abf7-a06d6ca3a30d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:33.710608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85978f82-3659-4b52-abf7-a06d6ca3a30d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:33.711320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85978f82-3659-4b52-abf7-a06d6ca3a30d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:33.712338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85978f82-3659-4b52-abf7-a06d6ca3a30d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:33.712800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85978f82-3659-4b52-abf7-a06d6ca3a30d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:33.718759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85978f82-3659-4b52-abf7-a06d6ca3a30d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:33.805542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4a427d27-c414-45cf-aa0c-90a9315f0b77 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:33.817742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4a427d27-c414-45cf-aa0c-90a9315f0b77 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:33.825583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4a427d27-c414-45cf-aa0c-90a9315f0b77 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:33.827081 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4a427d27-c414-45cf-aa0c-90a9315f0b77 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1412 microversion: 2.25 time: 0.316021 Oct 29 01:07:33.828081 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 441/911] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:33 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1412 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:33.845026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6f9b7434-bb9a-4273-88fc-cd39e66b541b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:33.847348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6f9b7434-bb9a-4273-88fc-cd39e66b541b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:33.859976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f9b7434-bb9a-4273-88fc-cd39e66b541b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:33.860872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f9b7434-bb9a-4273-88fc-cd39e66b541b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:33.862914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f9b7434-bb9a-4273-88fc-cd39e66b541b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:33.866049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f9b7434-bb9a-4273-88fc-cd39e66b541b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:33.866749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f9b7434-bb9a-4273-88fc-cd39e66b541b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:33.878029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f9b7434-bb9a-4273-88fc-cd39e66b541b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:34.062129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-85978f82-3659-4b52-abf7-a06d6ca3a30d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:34.077003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-85978f82-3659-4b52-abf7-a06d6ca3a30d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:34.086058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-85978f82-3659-4b52-abf7-a06d6ca3a30d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:34.107487 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-85978f82-3659-4b52-abf7-a06d6ca3a30d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1411 microversion: 2.75 time: 0.425953 Oct 29 01:07:34.110816 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 471/912] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:33 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1411 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:34.128128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c0a34f05-ad90-4f4f-84b2-9fbe737cae20 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:34.129368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c0a34f05-ad90-4f4f-84b2-9fbe737cae20 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:34.142435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0a34f05-ad90-4f4f-84b2-9fbe737cae20 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:34.144923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0a34f05-ad90-4f4f-84b2-9fbe737cae20 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:34.147605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0a34f05-ad90-4f4f-84b2-9fbe737cae20 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:34.148573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0a34f05-ad90-4f4f-84b2-9fbe737cae20 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:34.149319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0a34f05-ad90-4f4f-84b2-9fbe737cae20 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:34.150694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0a34f05-ad90-4f4f-84b2-9fbe737cae20 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:34.322394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6f9b7434-bb9a-4273-88fc-cd39e66b541b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:34.336611 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6f9b7434-bb9a-4273-88fc-cd39e66b541b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1317 microversion: 2.1 time: 0.506319 Oct 29 01:07:34.338174 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 442/913] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:33 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:34.425868 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c0a34f05-ad90-4f4f-84b2-9fbe737cae20 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1644 microversion: 2.1 time: 0.312801 Oct 29 01:07:34.427554 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 472/914] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:34 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1644 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:34.448487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6da1a136-7a88-4248-b0c9-5ee21c1e1075 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:34.452555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6da1a136-7a88-4248-b0c9-5ee21c1e1075 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:34.453132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6da1a136-7a88-4248-b0c9-5ee21c1e1075 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:34.453683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6da1a136-7a88-4248-b0c9-5ee21c1e1075 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:34.454479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6da1a136-7a88-4248-b0c9-5ee21c1e1075 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:34.455579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6da1a136-7a88-4248-b0c9-5ee21c1e1075 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:34.456513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6da1a136-7a88-4248-b0c9-5ee21c1e1075 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:34.482103 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6da1a136-7a88-4248-b0c9-5ee21c1e1075 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.037377 Oct 29 01:07:34.489351 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 443/915] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Oct 29 01:07:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:34.495576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-549bf49d-fb04-48e3-9eee-3de31450cd71 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862964-3", "block_migration": true, "disk_over_commit": false}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:34.498289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-549bf49d-fb04-48e3-9eee-3de31450cd71 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:34.505119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-549bf49d-fb04-48e3-9eee-3de31450cd71 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:34.506048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-549bf49d-fb04-48e3-9eee-3de31450cd71 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:34.506571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-549bf49d-fb04-48e3-9eee-3de31450cd71 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:34.507435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-549bf49d-fb04-48e3-9eee-3de31450cd71 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:34.507906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-549bf49d-fb04-48e3-9eee-3de31450cd71 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:34.508336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-549bf49d-fb04-48e3-9eee-3de31450cd71 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:34.513451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-ead7b591-54c9-47b1-907f-47b1368e8e11 req-b86ae3eb-b7b1-4c52-a752-f1455e63ac9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a19183-c526-47be-95c4-d4c3a9936390", "tag": "1435293b-3554-4c79-9898-f9de315c7829"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:34.528269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ead7b591-54c9-47b1-907f-47b1368e8e11 req-b86ae3eb-b7b1-4c52-a752-f1455e63ac9b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:34.529016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ead7b591-54c9-47b1-907f-47b1368e8e11 req-b86ae3eb-b7b1-4c52-a752-f1455e63ac9b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:34.529705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ead7b591-54c9-47b1-907f-47b1368e8e11 req-b86ae3eb-b7b1-4c52-a752-f1455e63ac9b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:34.555116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-549bf49d-fb04-48e3-9eee-3de31450cd71 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lazy-loading 'flavor' on Instance uuid cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:07:34.569535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-549bf49d-fb04-48e3-9eee-3de31450cd71 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Going to try to live migrate instance to n-h2-862964-3 {{(pid=121099) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 01:07:34.586008 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-ead7b591-54c9-47b1-907f-47b1368e8e11 req-b86ae3eb-b7b1-4c52-a752-f1455e63ac9b service nova] Creating event network-changed:1435293b-3554-4c79-9898-f9de315c7829 for instance 00a19183-c526-47be-95c4-d4c3a9936390 on n-h1-862964-3 Oct 29 01:07:34.603662 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-ead7b591-54c9-47b1-907f-47b1368e8e11 req-b86ae3eb-b7b1-4c52-a752-f1455e63ac9b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095971 Oct 29 01:07:34.604285 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 444/916] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:34.615956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f2febdaf-14e8-4595-9b6f-3c7daec05423 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:34.616581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f2febdaf-14e8-4595-9b6f-3c7daec05423 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:34.622852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2febdaf-14e8-4595-9b6f-3c7daec05423 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:34.623537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2febdaf-14e8-4595-9b6f-3c7daec05423 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:34.624124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2febdaf-14e8-4595-9b6f-3c7daec05423 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:34.625010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2febdaf-14e8-4595-9b6f-3c7daec05423 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:34.625632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2febdaf-14e8-4595-9b6f-3c7daec05423 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:34.626053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2febdaf-14e8-4595-9b6f-3c7daec05423 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:34.805711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f2febdaf-14e8-4595-9b6f-3c7daec05423 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:34.806688 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f2febdaf-14e8-4595-9b6f-3c7daec05423 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1312 microversion: 2.1 time: 0.199862 Oct 29 01:07:34.807289 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 445/917] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:34 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1312 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:34.858467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-380f18a9-70fc-45a5-848c-5109c218b1dc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:34.859182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-380f18a9-70fc-45a5-848c-5109c218b1dc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:34.866426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-380f18a9-70fc-45a5-848c-5109c218b1dc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:34.866850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-380f18a9-70fc-45a5-848c-5109c218b1dc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:34.867482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-380f18a9-70fc-45a5-848c-5109c218b1dc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:34.868424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-380f18a9-70fc-45a5-848c-5109c218b1dc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:34.868921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-380f18a9-70fc-45a5-848c-5109c218b1dc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:34.869380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-380f18a9-70fc-45a5-848c-5109c218b1dc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:35.100642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-380f18a9-70fc-45a5-848c-5109c218b1dc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:35.109442 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-380f18a9-70fc-45a5-848c-5109c218b1dc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:35.110889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-380f18a9-70fc-45a5-848c-5109c218b1dc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:35.112795 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-380f18a9-70fc-45a5-848c-5109c218b1dc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1412 microversion: 2.25 time: 0.259348 Oct 29 01:07:35.113587 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 446/918] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:34 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1412 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:07:35.140721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a071e04e-e287-4d2b-a40e-5b535241d000 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:35.142000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a071e04e-e287-4d2b-a40e-5b535241d000 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:35.157013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a071e04e-e287-4d2b-a40e-5b535241d000 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:35.157859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a071e04e-e287-4d2b-a40e-5b535241d000 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:35.159241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a071e04e-e287-4d2b-a40e-5b535241d000 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:35.162479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a071e04e-e287-4d2b-a40e-5b535241d000 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:35.163137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a071e04e-e287-4d2b-a40e-5b535241d000 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:35.163752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a071e04e-e287-4d2b-a40e-5b535241d000 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:35.258450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a071e04e-e287-4d2b-a40e-5b535241d000 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:35.267029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a071e04e-e287-4d2b-a40e-5b535241d000 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:35.269977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a071e04e-e287-4d2b-a40e-5b535241d000 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:35.274892 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a071e04e-e287-4d2b-a40e-5b535241d000 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1419 microversion: 2.75 time: 0.138139 Oct 29 01:07:35.275457 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 447/919] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:35 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1419 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:07:35.359931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-40038207-a349-43ff-8c15-6c952e107a46 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:35.360542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-40038207-a349-43ff-8c15-6c952e107a46 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:35.366814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40038207-a349-43ff-8c15-6c952e107a46 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:35.367311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40038207-a349-43ff-8c15-6c952e107a46 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:35.367747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40038207-a349-43ff-8c15-6c952e107a46 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:35.368485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40038207-a349-43ff-8c15-6c952e107a46 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:35.369212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40038207-a349-43ff-8c15-6c952e107a46 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:35.369573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40038207-a349-43ff-8c15-6c952e107a46 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:35.823115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-40038207-a349-43ff-8c15-6c952e107a46 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:35.831851 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-40038207-a349-43ff-8c15-6c952e107a46 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1317 microversion: 2.1 time: 0.475788 Oct 29 01:07:35.845401 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 448/920] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:35 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1317 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:35.845401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-aad0c194-2288-4e11-9ca8-35dc31a8a8bb req-6b1de070-343e-461e-ab8f-52c237c7cc1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f415677-47ed-437a-a567-2831f34712dc", "tag": "7d6159a8-d4d4-4879-bf83-176011337775"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:35.847306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-aad0c194-2288-4e11-9ca8-35dc31a8a8bb req-6b1de070-343e-461e-ab8f-52c237c7cc1b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:35.850170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-aad0c194-2288-4e11-9ca8-35dc31a8a8bb req-6b1de070-343e-461e-ab8f-52c237c7cc1b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:35.850170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-aad0c194-2288-4e11-9ca8-35dc31a8a8bb req-6b1de070-343e-461e-ab8f-52c237c7cc1b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:35.859783 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-aad0c194-2288-4e11-9ca8-35dc31a8a8bb req-6b1de070-343e-461e-ab8f-52c237c7cc1b service nova] Creating event network-changed:7d6159a8-d4d4-4879-bf83-176011337775 for instance 4f415677-47ed-437a-a567-2831f34712dc on n-h1-862964-3 Oct 29 01:07:35.864709 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-aad0c194-2288-4e11-9ca8-35dc31a8a8bb req-6b1de070-343e-461e-ab8f-52c237c7cc1b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031182 Oct 29 01:07:35.865344 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 449/921] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:35.870702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-840dc13f-a6f7-41d9-890a-8e7432211bfa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:35.871401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-840dc13f-a6f7-41d9-890a-8e7432211bfa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:35.878811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-840dc13f-a6f7-41d9-890a-8e7432211bfa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:35.878811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-840dc13f-a6f7-41d9-890a-8e7432211bfa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:35.878811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-840dc13f-a6f7-41d9-890a-8e7432211bfa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:35.879293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-840dc13f-a6f7-41d9-890a-8e7432211bfa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:35.879747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-840dc13f-a6f7-41d9-890a-8e7432211bfa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:35.880856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-840dc13f-a6f7-41d9-890a-8e7432211bfa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:36.012540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-840dc13f-a6f7-41d9-890a-8e7432211bfa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:36.021246 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-840dc13f-a6f7-41d9-890a-8e7432211bfa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1312 microversion: 2.1 time: 0.154653 Oct 29 01:07:36.021812 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 450/922] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:35 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:36.140633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0a54f334-2e0a-4d3d-9e5b-6d56529ebe7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:36.141263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0a54f334-2e0a-4d3d-9e5b-6d56529ebe7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:36.148093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a54f334-2e0a-4d3d-9e5b-6d56529ebe7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:36.148573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a54f334-2e0a-4d3d-9e5b-6d56529ebe7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:36.152091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a54f334-2e0a-4d3d-9e5b-6d56529ebe7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:36.152091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a54f334-2e0a-4d3d-9e5b-6d56529ebe7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:36.152091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a54f334-2e0a-4d3d-9e5b-6d56529ebe7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:36.152091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a54f334-2e0a-4d3d-9e5b-6d56529ebe7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:36.287703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0a54f334-2e0a-4d3d-9e5b-6d56529ebe7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:36.297243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0a54f334-2e0a-4d3d-9e5b-6d56529ebe7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:36.298697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0a54f334-2e0a-4d3d-9e5b-6d56529ebe7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:36.299842 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0a54f334-2e0a-4d3d-9e5b-6d56529ebe7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1412 microversion: 2.25 time: 0.163769 Oct 29 01:07:36.300376 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 451/923] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:36 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1412 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:36.306460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8fb2b15f-2d1b-475e-99f3-b320aa2d1cac tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:36.307186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8fb2b15f-2d1b-475e-99f3-b320aa2d1cac tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:36.313404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8fb2b15f-2d1b-475e-99f3-b320aa2d1cac tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:36.313998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8fb2b15f-2d1b-475e-99f3-b320aa2d1cac tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:36.315079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8fb2b15f-2d1b-475e-99f3-b320aa2d1cac tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:36.315867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8fb2b15f-2d1b-475e-99f3-b320aa2d1cac tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:36.316415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8fb2b15f-2d1b-475e-99f3-b320aa2d1cac tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:36.317067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8fb2b15f-2d1b-475e-99f3-b320aa2d1cac tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:36.382937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8fb2b15f-2d1b-475e-99f3-b320aa2d1cac tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:36.397842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8fb2b15f-2d1b-475e-99f3-b320aa2d1cac tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:36.397842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8fb2b15f-2d1b-475e-99f3-b320aa2d1cac tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:36.414527 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8fb2b15f-2d1b-475e-99f3-b320aa2d1cac tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1419 microversion: 2.75 time: 0.111598 Oct 29 01:07:36.415210 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 452/924] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:36 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1419 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:36.856263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1abf3fe6-cd93-4eb5-8ce2-a5c456e33cf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:36.856956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1abf3fe6-cd93-4eb5-8ce2-a5c456e33cf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:36.864353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1abf3fe6-cd93-4eb5-8ce2-a5c456e33cf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:36.864835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1abf3fe6-cd93-4eb5-8ce2-a5c456e33cf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:36.865469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1abf3fe6-cd93-4eb5-8ce2-a5c456e33cf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:36.866349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1abf3fe6-cd93-4eb5-8ce2-a5c456e33cf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:36.867004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1abf3fe6-cd93-4eb5-8ce2-a5c456e33cf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:36.867565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1abf3fe6-cd93-4eb5-8ce2-a5c456e33cf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:37.388889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1abf3fe6-cd93-4eb5-8ce2-a5c456e33cf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:37.399684 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1abf3fe6-cd93-4eb5-8ce2-a5c456e33cf4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1317 microversion: 2.1 time: 0.547386 Oct 29 01:07:37.400288 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 453/925] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:36 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1317 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:37.405464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1532866e-5ded-42f2-9539-98f2e9c5ec63 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:37.406259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1532866e-5ded-42f2-9539-98f2e9c5ec63 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:37.415140 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1532866e-5ded-42f2-9539-98f2e9c5ec63 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:37.415936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1532866e-5ded-42f2-9539-98f2e9c5ec63 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:37.416540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1532866e-5ded-42f2-9539-98f2e9c5ec63 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:37.417507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1532866e-5ded-42f2-9539-98f2e9c5ec63 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:37.418244 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1532866e-5ded-42f2-9539-98f2e9c5ec63 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:37.418831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1532866e-5ded-42f2-9539-98f2e9c5ec63 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:37.442997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:37.835027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1532866e-5ded-42f2-9539-98f2e9c5ec63 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:37.847089 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1532866e-5ded-42f2-9539-98f2e9c5ec63 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1312 microversion: 2.1 time: 0.445434 Oct 29 01:07:37.847778 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 454/926] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:37 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1312 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:37.852921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6724a0fd-d520-49f5-b6f8-d8da70bb1a98 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:37.855856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6724a0fd-d520-49f5-b6f8-d8da70bb1a98 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:37.860867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6724a0fd-d520-49f5-b6f8-d8da70bb1a98 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:37.863340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6724a0fd-d520-49f5-b6f8-d8da70bb1a98 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:37.864034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6724a0fd-d520-49f5-b6f8-d8da70bb1a98 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:37.865019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6724a0fd-d520-49f5-b6f8-d8da70bb1a98 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:37.865707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6724a0fd-d520-49f5-b6f8-d8da70bb1a98 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:37.866245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6724a0fd-d520-49f5-b6f8-d8da70bb1a98 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:38.109508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6724a0fd-d520-49f5-b6f8-d8da70bb1a98 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:38.120056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6724a0fd-d520-49f5-b6f8-d8da70bb1a98 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:38.122650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6724a0fd-d520-49f5-b6f8-d8da70bb1a98 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:38.122767 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6724a0fd-d520-49f5-b6f8-d8da70bb1a98 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1412 microversion: 2.25 time: 0.273603 Oct 29 01:07:38.123891 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 455/927] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:37 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1412 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:38.129125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3aaf7b3d-e5e2-47a6-80b1-513ed7d66a94 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:38.129759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3aaf7b3d-e5e2-47a6-80b1-513ed7d66a94 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:38.146002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3aaf7b3d-e5e2-47a6-80b1-513ed7d66a94 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:38.147501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3aaf7b3d-e5e2-47a6-80b1-513ed7d66a94 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:38.148138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3aaf7b3d-e5e2-47a6-80b1-513ed7d66a94 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:38.149273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3aaf7b3d-e5e2-47a6-80b1-513ed7d66a94 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:38.150120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3aaf7b3d-e5e2-47a6-80b1-513ed7d66a94 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:38.150881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3aaf7b3d-e5e2-47a6-80b1-513ed7d66a94 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:38.299345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3aaf7b3d-e5e2-47a6-80b1-513ed7d66a94 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:38.324945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3aaf7b3d-e5e2-47a6-80b1-513ed7d66a94 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:38.326436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3aaf7b3d-e5e2-47a6-80b1-513ed7d66a94 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:38.341500 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3aaf7b3d-e5e2-47a6-80b1-513ed7d66a94 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1417 microversion: 2.75 time: 0.216447 Oct 29 01:07:38.358659 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 456/928] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:38 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1417 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:38.427062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9dc986fe-b681-423e-baa8-b8622613fc36 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:38.427746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9dc986fe-b681-423e-baa8-b8622613fc36 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:38.434640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dc986fe-b681-423e-baa8-b8622613fc36 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:38.435155 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dc986fe-b681-423e-baa8-b8622613fc36 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:38.435599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dc986fe-b681-423e-baa8-b8622613fc36 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:38.436566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dc986fe-b681-423e-baa8-b8622613fc36 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:38.437054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dc986fe-b681-423e-baa8-b8622613fc36 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:38.437535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dc986fe-b681-423e-baa8-b8622613fc36 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:38.613682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9dc986fe-b681-423e-baa8-b8622613fc36 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:38.621575 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9dc986fe-b681-423e-baa8-b8622613fc36 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1317 microversion: 2.1 time: 0.199684 Oct 29 01:07:38.622154 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 457/929] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:38 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:38.859805 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-549bf49d-fb04-48e3-9eee-3de31450cd71 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5/action" status: 202 len: 0 microversion: 2.1 time: 4.368049 Oct 29 01:07:38.864117 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 473/930] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:07:34 2022] POST /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5/action => generated 0 bytes in 4370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:07:38.873574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-91ff0eeb-8284-41a4-a0fa-83aa0ed5c95b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:38.874395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-49576243-33db-419a-b128-54b5fc3c06a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:38.875013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-49576243-33db-419a-b128-54b5fc3c06a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:38.875604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-91ff0eeb-8284-41a4-a0fa-83aa0ed5c95b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:38.884350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91ff0eeb-8284-41a4-a0fa-83aa0ed5c95b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:38.884849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91ff0eeb-8284-41a4-a0fa-83aa0ed5c95b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:38.885520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91ff0eeb-8284-41a4-a0fa-83aa0ed5c95b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:38.886410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91ff0eeb-8284-41a4-a0fa-83aa0ed5c95b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:38.887026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91ff0eeb-8284-41a4-a0fa-83aa0ed5c95b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:38.887638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91ff0eeb-8284-41a4-a0fa-83aa0ed5c95b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:38.893828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49576243-33db-419a-b128-54b5fc3c06a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:38.898794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49576243-33db-419a-b128-54b5fc3c06a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:38.898794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49576243-33db-419a-b128-54b5fc3c06a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:38.898794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49576243-33db-419a-b128-54b5fc3c06a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:38.898794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49576243-33db-419a-b128-54b5fc3c06a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:38.899143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49576243-33db-419a-b128-54b5fc3c06a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:39.219490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-91ff0eeb-8284-41a4-a0fa-83aa0ed5c95b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:39.225081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-49576243-33db-419a-b128-54b5fc3c06a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:39.228067 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-91ff0eeb-8284-41a4-a0fa-83aa0ed5c95b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1503 microversion: 2.1 time: 0.362416 Oct 29 01:07:39.228655 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 458/931] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:38 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1503 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:39.233533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a73b9815-b473-4c4d-9150-ce49ab1a8b04 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:39.234142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a73b9815-b473-4c4d-9150-ce49ab1a8b04 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:39.240852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a73b9815-b473-4c4d-9150-ce49ab1a8b04 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:39.241369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a73b9815-b473-4c4d-9150-ce49ab1a8b04 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:39.242012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a73b9815-b473-4c4d-9150-ce49ab1a8b04 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:39.242905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a73b9815-b473-4c4d-9150-ce49ab1a8b04 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:39.243362 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-49576243-33db-419a-b128-54b5fc3c06a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1312 microversion: 2.1 time: 0.372600 Oct 29 01:07:39.243722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a73b9815-b473-4c4d-9150-ce49ab1a8b04 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:39.244318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a73b9815-b473-4c4d-9150-ce49ab1a8b04 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:39.244604 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 474/932] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:38 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1312 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:39.373904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-02e88d4e-5e6b-4535-9d03-171566ad793d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:39.374630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-02e88d4e-5e6b-4535-9d03-171566ad793d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:39.381772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02e88d4e-5e6b-4535-9d03-171566ad793d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:39.382259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02e88d4e-5e6b-4535-9d03-171566ad793d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:39.382694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02e88d4e-5e6b-4535-9d03-171566ad793d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:39.383396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02e88d4e-5e6b-4535-9d03-171566ad793d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:39.383848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02e88d4e-5e6b-4535-9d03-171566ad793d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:39.384270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02e88d4e-5e6b-4535-9d03-171566ad793d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:39.390450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a73b9815-b473-4c4d-9150-ce49ab1a8b04 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:39.399130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a73b9815-b473-4c4d-9150-ce49ab1a8b04 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:39.401734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a73b9815-b473-4c4d-9150-ce49ab1a8b04 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:39.403148 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a73b9815-b473-4c4d-9150-ce49ab1a8b04 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1412 microversion: 2.25 time: 0.173295 Oct 29 01:07:39.417187 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 459/933] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:39 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1412 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:39.469988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-02e88d4e-5e6b-4535-9d03-171566ad793d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:39.479427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-02e88d4e-5e6b-4535-9d03-171566ad793d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:39.481062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-02e88d4e-5e6b-4535-9d03-171566ad793d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:39.486827 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-02e88d4e-5e6b-4535-9d03-171566ad793d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1417 microversion: 2.75 time: 0.116374 Oct 29 01:07:39.487774 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 475/934] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:39 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1417 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:07:39.647066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9b0ca33d-75ef-48fd-bed5-c47235173496 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:39.647968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9b0ca33d-75ef-48fd-bed5-c47235173496 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:39.655543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b0ca33d-75ef-48fd-bed5-c47235173496 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:39.656211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b0ca33d-75ef-48fd-bed5-c47235173496 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:39.656831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b0ca33d-75ef-48fd-bed5-c47235173496 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:39.657741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b0ca33d-75ef-48fd-bed5-c47235173496 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:39.658740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b0ca33d-75ef-48fd-bed5-c47235173496 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:39.658740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b0ca33d-75ef-48fd-bed5-c47235173496 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:40.161549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9b0ca33d-75ef-48fd-bed5-c47235173496 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:40.173256 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9b0ca33d-75ef-48fd-bed5-c47235173496 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1317 microversion: 2.1 time: 0.529014 Oct 29 01:07:40.173786 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 460/935] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:39 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1317 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:40.254974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a0305ac1-c6a4-4f58-8a10-7020643cdafe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:40.257076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a0305ac1-c6a4-4f58-8a10-7020643cdafe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:40.259997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:40.261485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=12 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:40.266777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3405dd66-df88-41f1-900c-c92df7a12df2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:40.269285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3405dd66-df88-41f1-900c-c92df7a12df2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:40.276280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3405dd66-df88-41f1-900c-c92df7a12df2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:40.277097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3405dd66-df88-41f1-900c-c92df7a12df2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:40.277763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3405dd66-df88-41f1-900c-c92df7a12df2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:40.278724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3405dd66-df88-41f1-900c-c92df7a12df2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:40.279247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3405dd66-df88-41f1-900c-c92df7a12df2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:40.279747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3405dd66-df88-41f1-900c-c92df7a12df2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:40.289059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0305ac1-c6a4-4f58-8a10-7020643cdafe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:40.290460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0305ac1-c6a4-4f58-8a10-7020643cdafe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:40.291359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0305ac1-c6a4-4f58-8a10-7020643cdafe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:40.292315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0305ac1-c6a4-4f58-8a10-7020643cdafe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:40.293252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0305ac1-c6a4-4f58-8a10-7020643cdafe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:40.294020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0305ac1-c6a4-4f58-8a10-7020643cdafe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:40.708945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3405dd66-df88-41f1-900c-c92df7a12df2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:40.716922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a0305ac1-c6a4-4f58-8a10-7020643cdafe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:40.719083 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3405dd66-df88-41f1-900c-c92df7a12df2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1312 microversion: 2.1 time: 0.456196 Oct 29 01:07:40.720142 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 461/936] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:40 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1312 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:40.727013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2538077f-3d95-4196-970c-dad28bd2348a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:40.727789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2538077f-3d95-4196-970c-dad28bd2348a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:40.729625 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a0305ac1-c6a4-4f58-8a10-7020643cdafe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1503 microversion: 2.1 time: 0.481170 Oct 29 01:07:40.741511 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 476/937] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:40 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1503 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:40.741667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:40.741667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2538077f-3d95-4196-970c-dad28bd2348a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:40.741667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2538077f-3d95-4196-970c-dad28bd2348a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:40.741667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2538077f-3d95-4196-970c-dad28bd2348a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:40.742077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2538077f-3d95-4196-970c-dad28bd2348a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:40.742077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2538077f-3d95-4196-970c-dad28bd2348a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:40.742077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2538077f-3d95-4196-970c-dad28bd2348a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:40.759909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3c140736-d072-48d5-9cc0-464b8058e8f6 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:40.760538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3c140736-d072-48d5-9cc0-464b8058e8f6 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:40.771579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c140736-d072-48d5-9cc0-464b8058e8f6 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:40.772277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c140736-d072-48d5-9cc0-464b8058e8f6 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:40.772963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c140736-d072-48d5-9cc0-464b8058e8f6 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:40.773891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c140736-d072-48d5-9cc0-464b8058e8f6 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:40.775467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c140736-d072-48d5-9cc0-464b8058e8f6 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:40.776122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c140736-d072-48d5-9cc0-464b8058e8f6 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:40.901101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3c140736-d072-48d5-9cc0-464b8058e8f6 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:40.912515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3c140736-d072-48d5-9cc0-464b8058e8f6 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:40.914324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3c140736-d072-48d5-9cc0-464b8058e8f6 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:40.917077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=28 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:40.919942 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3c140736-d072-48d5-9cc0-464b8058e8f6 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1417 microversion: 2.75 time: 0.164822 Oct 29 01:07:40.938746 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 477/938] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:40 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1417 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:40.944244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-03ab33f5-d09c-4788-b949-03ea253f6229 req-3e6d6b77-3a1d-4df1-9e80-62c52f7f1299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a19183-c526-47be-95c4-d4c3a9936390", "name": "network-vif-plugged", "status": "completed", "tag": "1435293b-3554-4c79-9898-f9de315c7829"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:40.957407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-03ab33f5-d09c-4788-b949-03ea253f6229 req-3e6d6b77-3a1d-4df1-9e80-62c52f7f1299 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:40.957901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-03ab33f5-d09c-4788-b949-03ea253f6229 req-3e6d6b77-3a1d-4df1-9e80-62c52f7f1299 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:40.958568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-03ab33f5-d09c-4788-b949-03ea253f6229 req-3e6d6b77-3a1d-4df1-9e80-62c52f7f1299 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:40.969890 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-03ab33f5-d09c-4788-b949-03ea253f6229 req-3e6d6b77-3a1d-4df1-9e80-62c52f7f1299 service nova] Creating event network-vif-plugged:1435293b-3554-4c79-9898-f9de315c7829 for instance 00a19183-c526-47be-95c4-d4c3a9936390 on n-h1-862964-3 Oct 29 01:07:40.976077 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-03ab33f5-d09c-4788-b949-03ea253f6229 req-3e6d6b77-3a1d-4df1-9e80-62c52f7f1299 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035636 Oct 29 01:07:40.977398 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 478/939] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:40.997760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2538077f-3d95-4196-970c-dad28bd2348a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:41.009657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2538077f-3d95-4196-970c-dad28bd2348a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:41.011563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2538077f-3d95-4196-970c-dad28bd2348a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:41.012782 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2538077f-3d95-4196-970c-dad28bd2348a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1412 microversion: 2.25 time: 0.290765 Oct 29 01:07:41.013689 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 462/940] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:40 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1412 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:41.198511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-89648904-38eb-4916-a11c-6f728ef5f634 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:41.199218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-89648904-38eb-4916-a11c-6f728ef5f634 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:41.205612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89648904-38eb-4916-a11c-6f728ef5f634 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:41.206107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89648904-38eb-4916-a11c-6f728ef5f634 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:41.206542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89648904-38eb-4916-a11c-6f728ef5f634 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:41.207233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89648904-38eb-4916-a11c-6f728ef5f634 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:41.207686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89648904-38eb-4916-a11c-6f728ef5f634 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:41.208107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89648904-38eb-4916-a11c-6f728ef5f634 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:41.478808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-89648904-38eb-4916-a11c-6f728ef5f634 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:41.491348 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-89648904-38eb-4916-a11c-6f728ef5f634 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1317 microversion: 2.1 time: 0.297071 Oct 29 01:07:41.492988 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 479/941] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:41 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:41.759417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9f9100d7-bed4-4151-895b-b475ab03f805 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:41.760921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9f9100d7-bed4-4151-895b-b475ab03f805 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:41.773298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f9100d7-bed4-4151-895b-b475ab03f805 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:41.773784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f9100d7-bed4-4151-895b-b475ab03f805 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:41.774608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f9100d7-bed4-4151-895b-b475ab03f805 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:41.775527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f9100d7-bed4-4151-895b-b475ab03f805 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:41.776310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f9100d7-bed4-4151-895b-b475ab03f805 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:41.776809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f9100d7-bed4-4151-895b-b475ab03f805 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:41.777418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-537c3c60-5bea-4894-b703-75860b059d75 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:41.779602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-537c3c60-5bea-4894-b703-75860b059d75 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:41.795297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-537c3c60-5bea-4894-b703-75860b059d75 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:41.795789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-537c3c60-5bea-4894-b703-75860b059d75 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:41.796263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-537c3c60-5bea-4894-b703-75860b059d75 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:41.796979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-537c3c60-5bea-4894-b703-75860b059d75 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:41.797475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-537c3c60-5bea-4894-b703-75860b059d75 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:41.802939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-537c3c60-5bea-4894-b703-75860b059d75 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:42.066908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9f9100d7-bed4-4151-895b-b475ab03f805 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:42.075467 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9f9100d7-bed4-4151-895b-b475ab03f805 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1312 microversion: 2.1 time: 0.331148 Oct 29 01:07:42.076391 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 463/942] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:41 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1312 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:42.081663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-459b269f-0e60-4cbd-8010-547061857d76 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:42.082764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-459b269f-0e60-4cbd-8010-547061857d76 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:42.092089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-459b269f-0e60-4cbd-8010-547061857d76 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:42.094736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-459b269f-0e60-4cbd-8010-547061857d76 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:42.094736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-459b269f-0e60-4cbd-8010-547061857d76 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:42.094736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-459b269f-0e60-4cbd-8010-547061857d76 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:42.095147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-459b269f-0e60-4cbd-8010-547061857d76 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:42.095591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-459b269f-0e60-4cbd-8010-547061857d76 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:42.105639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-537c3c60-5bea-4894-b703-75860b059d75 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:42.115232 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-537c3c60-5bea-4894-b703-75860b059d75 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1503 microversion: 2.1 time: 0.354656 Oct 29 01:07:42.115823 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 480/943] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:41 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1503 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:42.120535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e4fadfe8-1bca-433b-8ed7-ea4cf21f3edc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:42.128727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e4fadfe8-1bca-433b-8ed7-ea4cf21f3edc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:42.136838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4fadfe8-1bca-433b-8ed7-ea4cf21f3edc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:42.137630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4fadfe8-1bca-433b-8ed7-ea4cf21f3edc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:42.138230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4fadfe8-1bca-433b-8ed7-ea4cf21f3edc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:42.139147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4fadfe8-1bca-433b-8ed7-ea4cf21f3edc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:42.139608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4fadfe8-1bca-433b-8ed7-ea4cf21f3edc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:42.140044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4fadfe8-1bca-433b-8ed7-ea4cf21f3edc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:42.218636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-459b269f-0e60-4cbd-8010-547061857d76 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:42.228399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-459b269f-0e60-4cbd-8010-547061857d76 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:42.231716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-459b269f-0e60-4cbd-8010-547061857d76 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:42.247004 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-459b269f-0e60-4cbd-8010-547061857d76 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1417 microversion: 2.75 time: 0.169184 Oct 29 01:07:42.251139 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 464/944] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:42 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1417 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:42.381377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e4fadfe8-1bca-433b-8ed7-ea4cf21f3edc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:42.395762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e4fadfe8-1bca-433b-8ed7-ea4cf21f3edc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:42.400432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e4fadfe8-1bca-433b-8ed7-ea4cf21f3edc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:42.402968 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e4fadfe8-1bca-433b-8ed7-ea4cf21f3edc tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1412 microversion: 2.25 time: 0.285769 Oct 29 01:07:42.418187 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 481/945] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:42 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1412 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:42.516695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6e89ffa9-dc0e-4dab-b8b8-7f057a4c1ca6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:42.518997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6e89ffa9-dc0e-4dab-b8b8-7f057a4c1ca6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:42.527934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e89ffa9-dc0e-4dab-b8b8-7f057a4c1ca6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:42.535829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e89ffa9-dc0e-4dab-b8b8-7f057a4c1ca6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:42.535829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e89ffa9-dc0e-4dab-b8b8-7f057a4c1ca6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:42.535829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e89ffa9-dc0e-4dab-b8b8-7f057a4c1ca6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:42.535829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e89ffa9-dc0e-4dab-b8b8-7f057a4c1ca6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:42.536759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e89ffa9-dc0e-4dab-b8b8-7f057a4c1ca6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:42.713970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6e89ffa9-dc0e-4dab-b8b8-7f057a4c1ca6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:42.731514 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6e89ffa9-dc0e-4dab-b8b8-7f057a4c1ca6 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1317 microversion: 2.1 time: 0.211197 Oct 29 01:07:42.731514 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 465/946] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:42 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:42.886950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e2dcb308-4bca-4bec-b046-7e089e8cab0d tempest-FloatingIPDetailsNegativeTestJSON-1069283603 tempest-FloatingIPDetailsNegativeTestJSON-1069283603-project] Calling method '.version_select at 0x7f9d97b91e50>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:42.933653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG neutronclient.v2_0.client [None req-e2dcb308-4bca-4bec-b046-7e089e8cab0d tempest-FloatingIPDetailsNegativeTestJSON-1069283603 tempest-FloatingIPDetailsNegativeTestJSON-1069283603-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP cfd93f84-0572-47df-abf5-9415b0233a2f could not be found", "detail": ""}} {{(pid=121099) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:07:42.934418 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-e2dcb308-4bca-4bec-b046-7e089e8cab0d tempest-FloatingIPDetailsNegativeTestJSON-1069283603 tempest-FloatingIPDetailsNegativeTestJSON-1069283603-project] HTTP exception thrown: Floating IP not found for ID cfd93f84-0572-47df-abf5-9415b0233a2f Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e2dcb308-4bca-4bec-b046-7e089e8cab0d tempest-FloatingIPDetailsNegativeTestJSON-1069283603 tempest-FloatingIPDetailsNegativeTestJSON-1069283603-project] Request method failure captured: Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-floating-ips/cfd93f84-0572-47df-abf5-9415b0233a2f HTTP/1.1 Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHzebh1JkJCUGuMEFL7bKL2V1Le24ppUpxdClIyY8ly4pmp9qBGyISmhlJOeh3CQdIu2zemYss8WsC1ya4fgzTnDpK1ykUe9Blb609IAUupr1Klxdi_buFoLcbL7J4gEfgkbDVmonx8sMEchhU6ABCRSZP-nG7_Bws7wb6MEFRz8quY Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 1d1f8be3751a47d48bc8a45f31b3b888 Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1069283603 Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:07:42.938951 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:07:42.941349 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d1f8be3751a47d48bc8a45f31b3b888"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1d1f8be3751a47d48bc8a45f31b3b888"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d1f8be3751a47d48bc8a45f31b3b888"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1d1f8be3751a47d48bc8a45f31b3b888", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:07:42.941349 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1069283603 Oct 29 01:07:42.941349 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 1d1f8be3751a47d48bc8a45f31b3b888 Oct 29 01:07:42.941349 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1069283603 Oct 29 01:07:42.941349 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1069283603-project Oct 29 01:07:42.941349 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:07:42.941349 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:07:42.941349 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 4e81e444cb8c434f981e70ce6541ed99 Oct 29 01:07:42.941349 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1069283603-project Oct 29 01:07:42.941349 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:07:42.941349 n-d-862964-3 devstack@n-api.service[121099]: exception: Floating IP not found for ID cfd93f84-0572-47df-abf5-9415b0233a2f Oct 29 01:07:42.941349 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'cfd93f84-0572-47df-abf5-9415b0233a2f'} Oct 29 01:07:42.942435 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:07:42.942435 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:42.942435 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 29 01:07:42.942435 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 29 01:07:42.942435 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:07:42.942435 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:07:42.942435 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 29 01:07:42.942435 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 29 01:07:42.942435 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:07:42.942435 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:07:42.942435 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:07:42.942435 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:07:42.942435 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:07:42.942435 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:07:42.942435 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:07:42.942435 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:07:42.942435 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:07:42.942435 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:07:42.942435 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:07:42.943914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:07:42.943914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:07:42.943914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:07:42.943914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:07:42.943914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:07:42.943914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:07:42.943914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:07:42.943914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP cfd93f84-0572-47df-abf5-9415b0233a2f could not be found Oct 29 01:07:42.943914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fb64b2a-6cb5-4dff-97c9-a878906c6201'] Oct 29 01:07:42.943914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:42.943914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:42.943914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:42.943914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:42.943914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 29 01:07:42.943914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 29 01:07:42.943914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 29 01:07:42.943914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 29 01:07:42.943914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID cfd93f84-0572-47df-abf5-9415b0233a2f. Oct 29 01:07:42.943914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID cfd93f84-0572-47df-abf5-9415b0233a2f Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:42.945487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:07:42.947223 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:07:42.947223 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID cfd93f84-0572-47df-abf5-9415b0233a2f Oct 29 01:07:42.947223 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:42.947223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e2dcb308-4bca-4bec-b046-7e089e8cab0d tempest-FloatingIPDetailsNegativeTestJSON-1069283603 tempest-FloatingIPDetailsNegativeTestJSON-1069283603-project] Returning 404 to user: Floating IP not found for ID cfd93f84-0572-47df-abf5-9415b0233a2f {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:07:42.947223 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e2dcb308-4bca-4bec-b046-7e089e8cab0d tempest-FloatingIPDetailsNegativeTestJSON-1069283603 tempest-FloatingIPDetailsNegativeTestJSON-1069283603-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/cfd93f84-0572-47df-abf5-9415b0233a2f" status: 404 len: 111 microversion: 2.1 time: 0.166042 Oct 29 01:07:42.947662 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 482/947] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 29 01:07:42 2022] GET /compute/v2.1/os-floating-ips/cfd93f84-0572-47df-abf5-9415b0233a2f => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:07:42.990349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-5ee56bd6-5aa5-472e-a6f6-62b33d2711a2 req-29cc7e11-1af1-4700-8b94-2d255c7c1335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72ffa89-8708-45d4-872f-65509e631d27", "name": "network-vif-plugged", "status": "completed", "tag": "454e8b33-3067-4ecd-9cee-b3d21ccf81cd"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:43.000805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5ee56bd6-5aa5-472e-a6f6-62b33d2711a2 req-29cc7e11-1af1-4700-8b94-2d255c7c1335 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:43.001501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5ee56bd6-5aa5-472e-a6f6-62b33d2711a2 req-29cc7e11-1af1-4700-8b94-2d255c7c1335 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:43.002797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5ee56bd6-5aa5-472e-a6f6-62b33d2711a2 req-29cc7e11-1af1-4700-8b94-2d255c7c1335 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:43.015544 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-5ee56bd6-5aa5-472e-a6f6-62b33d2711a2 req-29cc7e11-1af1-4700-8b94-2d255c7c1335 service nova] Creating event network-vif-plugged:454e8b33-3067-4ecd-9cee-b3d21ccf81cd for instance c72ffa89-8708-45d4-872f-65509e631d27 on n-h2-862964-3 Oct 29 01:07:43.021560 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-5ee56bd6-5aa5-472e-a6f6-62b33d2711a2 req-29cc7e11-1af1-4700-8b94-2d255c7c1335 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034870 Oct 29 01:07:43.022252 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 466/948] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:43.099545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-546558dd-199e-40ec-ae50-a0b060ef0e74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:43.100328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-546558dd-199e-40ec-ae50-a0b060ef0e74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:43.110648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-546558dd-199e-40ec-ae50-a0b060ef0e74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:43.111685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-546558dd-199e-40ec-ae50-a0b060ef0e74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:43.112328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-546558dd-199e-40ec-ae50-a0b060ef0e74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:43.113124 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-546558dd-199e-40ec-ae50-a0b060ef0e74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:43.113687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-546558dd-199e-40ec-ae50-a0b060ef0e74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:43.114360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-546558dd-199e-40ec-ae50-a0b060ef0e74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:43.139425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0e86b025-07b4-4597-a3db-befbcddc7dc5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:43.140348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0e86b025-07b4-4597-a3db-befbcddc7dc5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:43.148472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e86b025-07b4-4597-a3db-befbcddc7dc5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:43.148981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e86b025-07b4-4597-a3db-befbcddc7dc5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:43.149464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e86b025-07b4-4597-a3db-befbcddc7dc5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:43.150184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e86b025-07b4-4597-a3db-befbcddc7dc5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:43.150643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e86b025-07b4-4597-a3db-befbcddc7dc5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:43.151193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e86b025-07b4-4597-a3db-befbcddc7dc5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:43.495757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-546558dd-199e-40ec-ae50-a0b060ef0e74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:43.510536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0e86b025-07b4-4597-a3db-befbcddc7dc5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:43.511946 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-546558dd-199e-40ec-ae50-a0b060ef0e74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1312 microversion: 2.1 time: 0.413902 Oct 29 01:07:43.522627 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0e86b025-07b4-4597-a3db-befbcddc7dc5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1503 microversion: 2.1 time: 0.387438 Oct 29 01:07:43.523218 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 467/949] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:43 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1503 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:43.528763 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 483/950] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:43 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1312 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:43.535116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5fbbec6d-aee2-4a8a-af0f-53eea56424b7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:43.535942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5fbbec6d-aee2-4a8a-af0f-53eea56424b7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:43.540619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3528503b-68c1-4888-933a-4c3aa17faec8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:43.545955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3528503b-68c1-4888-933a-4c3aa17faec8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:43.550496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fbbec6d-aee2-4a8a-af0f-53eea56424b7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:43.553551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fbbec6d-aee2-4a8a-af0f-53eea56424b7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:43.554007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fbbec6d-aee2-4a8a-af0f-53eea56424b7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:43.554999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3528503b-68c1-4888-933a-4c3aa17faec8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:43.555669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3528503b-68c1-4888-933a-4c3aa17faec8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:43.556674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3528503b-68c1-4888-933a-4c3aa17faec8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:43.557614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3528503b-68c1-4888-933a-4c3aa17faec8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:43.558597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3528503b-68c1-4888-933a-4c3aa17faec8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:43.559187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3528503b-68c1-4888-933a-4c3aa17faec8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:43.560255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fbbec6d-aee2-4a8a-af0f-53eea56424b7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:43.562922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fbbec6d-aee2-4a8a-af0f-53eea56424b7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:43.563411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fbbec6d-aee2-4a8a-af0f-53eea56424b7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:43.721448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5fbbec6d-aee2-4a8a-af0f-53eea56424b7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:43.731959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5fbbec6d-aee2-4a8a-af0f-53eea56424b7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:43.733431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5fbbec6d-aee2-4a8a-af0f-53eea56424b7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:43.751370 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5fbbec6d-aee2-4a8a-af0f-53eea56424b7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1417 microversion: 2.75 time: 0.222967 Oct 29 01:07:43.752683 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 468/951] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:43 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1417 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:43.775510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-88e36474-5e5f-4185-94d3-a5064528b2a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:43.776179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-88e36474-5e5f-4185-94d3-a5064528b2a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:43.782488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88e36474-5e5f-4185-94d3-a5064528b2a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:43.783615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88e36474-5e5f-4185-94d3-a5064528b2a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:43.784065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88e36474-5e5f-4185-94d3-a5064528b2a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:43.784777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88e36474-5e5f-4185-94d3-a5064528b2a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:43.785278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88e36474-5e5f-4185-94d3-a5064528b2a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:43.785756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88e36474-5e5f-4185-94d3-a5064528b2a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:43.806667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3528503b-68c1-4888-933a-4c3aa17faec8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:43.813499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3528503b-68c1-4888-933a-4c3aa17faec8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:43.815878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3528503b-68c1-4888-933a-4c3aa17faec8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:43.818149 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3528503b-68c1-4888-933a-4c3aa17faec8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1412 microversion: 2.25 time: 0.283626 Oct 29 01:07:43.818932 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 484/952] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:43 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1412 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:43.953368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-88e36474-5e5f-4185-94d3-a5064528b2a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:43.962049 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-88e36474-5e5f-4185-94d3-a5064528b2a5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1317 microversion: 2.1 time: 0.206266 Oct 29 01:07:43.968333 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 469/953] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:43 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:44.539524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c0e9eb44-cebe-45c9-b56c-7b942c42f0b3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:44.540305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c0e9eb44-cebe-45c9-b56c-7b942c42f0b3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:44.548158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0e9eb44-cebe-45c9-b56c-7b942c42f0b3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:44.549606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0e9eb44-cebe-45c9-b56c-7b942c42f0b3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:44.550167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0e9eb44-cebe-45c9-b56c-7b942c42f0b3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:44.551466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-922d74b5-4514-40e9-bbe0-1a186d761145 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:44.552093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-922d74b5-4514-40e9-bbe0-1a186d761145 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:44.552756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0e9eb44-cebe-45c9-b56c-7b942c42f0b3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:44.554875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:44.555512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0e9eb44-cebe-45c9-b56c-7b942c42f0b3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:44.556047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0e9eb44-cebe-45c9-b56c-7b942c42f0b3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:44.562623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-922d74b5-4514-40e9-bbe0-1a186d761145 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:44.562814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-922d74b5-4514-40e9-bbe0-1a186d761145 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:44.563368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-922d74b5-4514-40e9-bbe0-1a186d761145 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:44.564220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-922d74b5-4514-40e9-bbe0-1a186d761145 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:44.565079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-922d74b5-4514-40e9-bbe0-1a186d761145 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:44.565688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-922d74b5-4514-40e9-bbe0-1a186d761145 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:44.771066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c0e9eb44-cebe-45c9-b56c-7b942c42f0b3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:44.779270 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c0e9eb44-cebe-45c9-b56c-7b942c42f0b3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1312 microversion: 2.1 time: 0.244557 Oct 29 01:07:44.796921 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 485/954] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:44 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1312 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:44.796921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ba663f1b-2d40-4b0d-8852-21fdefe8706b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:44.796921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ba663f1b-2d40-4b0d-8852-21fdefe8706b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:44.797446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-922d74b5-4514-40e9-bbe0-1a186d761145 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:44.799030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba663f1b-2d40-4b0d-8852-21fdefe8706b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:44.799587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba663f1b-2d40-4b0d-8852-21fdefe8706b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:44.800107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba663f1b-2d40-4b0d-8852-21fdefe8706b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:44.800914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba663f1b-2d40-4b0d-8852-21fdefe8706b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:44.801495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba663f1b-2d40-4b0d-8852-21fdefe8706b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:44.809326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba663f1b-2d40-4b0d-8852-21fdefe8706b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:44.812133 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-922d74b5-4514-40e9-bbe0-1a186d761145 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1503 microversion: 2.1 time: 0.266406 Oct 29 01:07:44.813178 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 470/955] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:44 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1503 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:44.845059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fbe7e128-fe95-4fd7-a4d2-affa7f84606b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:44.845818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fbe7e128-fe95-4fd7-a4d2-affa7f84606b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:44.852386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbe7e128-fe95-4fd7-a4d2-affa7f84606b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:44.852870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbe7e128-fe95-4fd7-a4d2-affa7f84606b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:44.853349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbe7e128-fe95-4fd7-a4d2-affa7f84606b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:44.854223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbe7e128-fe95-4fd7-a4d2-affa7f84606b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:44.854684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbe7e128-fe95-4fd7-a4d2-affa7f84606b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:44.861732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbe7e128-fe95-4fd7-a4d2-affa7f84606b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:44.896369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ba663f1b-2d40-4b0d-8852-21fdefe8706b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:44.905269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ba663f1b-2d40-4b0d-8852-21fdefe8706b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:44.907176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ba663f1b-2d40-4b0d-8852-21fdefe8706b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:44.913735 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ba663f1b-2d40-4b0d-8852-21fdefe8706b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1417 microversion: 2.75 time: 0.129975 Oct 29 01:07:44.914494 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 486/956] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:44 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1417 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:44.987130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-05f8dbe3-e50d-4121-bfbd-038004c63a8b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:44.988142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-05f8dbe3-e50d-4121-bfbd-038004c63a8b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:45.008839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fbe7e128-fe95-4fd7-a4d2-affa7f84606b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:45.013946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05f8dbe3-e50d-4121-bfbd-038004c63a8b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:45.015171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:45.016860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05f8dbe3-e50d-4121-bfbd-038004c63a8b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:45.019415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05f8dbe3-e50d-4121-bfbd-038004c63a8b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:45.023370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fbe7e128-fe95-4fd7-a4d2-affa7f84606b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:45.031411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fbe7e128-fe95-4fd7-a4d2-affa7f84606b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:45.031860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05f8dbe3-e50d-4121-bfbd-038004c63a8b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:45.031860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05f8dbe3-e50d-4121-bfbd-038004c63a8b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:45.032036 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fbe7e128-fe95-4fd7-a4d2-affa7f84606b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1412 microversion: 2.25 time: 0.185440 Oct 29 01:07:45.032036 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 471/957] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:44 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1412 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:07:45.032200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05f8dbe3-e50d-4121-bfbd-038004c63a8b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:45.074642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:45.213107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-05f8dbe3-e50d-4121-bfbd-038004c63a8b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:45.222396 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-05f8dbe3-e50d-4121-bfbd-038004c63a8b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1317 microversion: 2.1 time: 0.239828 Oct 29 01:07:45.224481 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 487/958] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:44 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:45.804068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d2f6c038-d519-4e41-842a-9bf31008ad29 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:45.804690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d2f6c038-d519-4e41-842a-9bf31008ad29 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:45.821494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2f6c038-d519-4e41-842a-9bf31008ad29 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:45.823144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2f6c038-d519-4e41-842a-9bf31008ad29 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:45.823912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2f6c038-d519-4e41-842a-9bf31008ad29 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:45.824867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2f6c038-d519-4e41-842a-9bf31008ad29 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:45.825702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2f6c038-d519-4e41-842a-9bf31008ad29 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:45.826450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2f6c038-d519-4e41-842a-9bf31008ad29 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:45.836834 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ed02aa42-6b98-4381-99d3-a47404106ac6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:45.839028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ed02aa42-6b98-4381-99d3-a47404106ac6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:45.851284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed02aa42-6b98-4381-99d3-a47404106ac6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:45.851952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed02aa42-6b98-4381-99d3-a47404106ac6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:45.852406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed02aa42-6b98-4381-99d3-a47404106ac6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:45.857248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed02aa42-6b98-4381-99d3-a47404106ac6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:45.858022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed02aa42-6b98-4381-99d3-a47404106ac6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:45.858804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed02aa42-6b98-4381-99d3-a47404106ac6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:46.067938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d2f6c038-d519-4e41-842a-9bf31008ad29 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:46.078199 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d2f6c038-d519-4e41-842a-9bf31008ad29 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1312 microversion: 2.1 time: 0.277893 Oct 29 01:07:46.079969 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 472/959] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:45 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1312 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:46.082387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ed02aa42-6b98-4381-99d3-a47404106ac6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:46.089457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2a21ad7f-c4a5-402f-8dcb-ca4af6372187 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:46.090046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2a21ad7f-c4a5-402f-8dcb-ca4af6372187 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:46.093022 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ed02aa42-6b98-4381-99d3-a47404106ac6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1503 microversion: 2.1 time: 0.260028 Oct 29 01:07:46.097276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a21ad7f-c4a5-402f-8dcb-ca4af6372187 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:46.097781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a21ad7f-c4a5-402f-8dcb-ca4af6372187 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:46.098219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a21ad7f-c4a5-402f-8dcb-ca4af6372187 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:46.098928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a21ad7f-c4a5-402f-8dcb-ca4af6372187 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:46.099484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a21ad7f-c4a5-402f-8dcb-ca4af6372187 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:46.099822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a21ad7f-c4a5-402f-8dcb-ca4af6372187 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:46.109239 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 488/960] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:45 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1503 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:46.117651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2f6653b1-40c6-41e0-a39d-0de12cdc0900 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:46.118525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2f6653b1-40c6-41e0-a39d-0de12cdc0900 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:46.125297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f6653b1-40c6-41e0-a39d-0de12cdc0900 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:46.125990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f6653b1-40c6-41e0-a39d-0de12cdc0900 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:46.126433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f6653b1-40c6-41e0-a39d-0de12cdc0900 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:46.128158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f6653b1-40c6-41e0-a39d-0de12cdc0900 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:46.128492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f6653b1-40c6-41e0-a39d-0de12cdc0900 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:46.128932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f6653b1-40c6-41e0-a39d-0de12cdc0900 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:46.177091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2a21ad7f-c4a5-402f-8dcb-ca4af6372187 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:46.193200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2a21ad7f-c4a5-402f-8dcb-ca4af6372187 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:46.193200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2a21ad7f-c4a5-402f-8dcb-ca4af6372187 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:46.198940 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2a21ad7f-c4a5-402f-8dcb-ca4af6372187 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1417 microversion: 2.75 time: 0.117666 Oct 29 01:07:46.199951 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 473/961] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:46 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1417 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:46.248362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-54656c64-0da2-40e4-a1e8-45bac27c4927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:46.249697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-54656c64-0da2-40e4-a1e8-45bac27c4927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:46.264669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54656c64-0da2-40e4-a1e8-45bac27c4927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:46.264669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54656c64-0da2-40e4-a1e8-45bac27c4927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:46.264669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54656c64-0da2-40e4-a1e8-45bac27c4927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:46.264669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54656c64-0da2-40e4-a1e8-45bac27c4927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:46.265031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54656c64-0da2-40e4-a1e8-45bac27c4927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:46.265622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54656c64-0da2-40e4-a1e8-45bac27c4927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:46.687577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f6653b1-40c6-41e0-a39d-0de12cdc0900 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:46.698729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f6653b1-40c6-41e0-a39d-0de12cdc0900 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:46.701087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f6653b1-40c6-41e0-a39d-0de12cdc0900 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:46.701821 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2f6653b1-40c6-41e0-a39d-0de12cdc0900 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1412 microversion: 2.25 time: 0.590842 Oct 29 01:07:46.709489 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 489/962] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:46 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1412 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:46.715868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-b06c6df6-1ce3-4fd9-947b-266ae5547d7b req-1c93c5df-7b0f-4663-9a3f-eb742d4c8bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5", "name": "network-vif-unplugged", "status": "completed", "tag": "3696a714-c84c-4ccf-a78d-0b8a642038f9"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:46.726146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-54656c64-0da2-40e4-a1e8-45bac27c4927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:46.735428 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-54656c64-0da2-40e4-a1e8-45bac27c4927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1466 microversion: 2.1 time: 0.490590 Oct 29 01:07:46.737086 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 474/963] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:46 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1466 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:46.755816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b06c6df6-1ce3-4fd9-947b-266ae5547d7b req-1c93c5df-7b0f-4663-9a3f-eb742d4c8bb0 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:46.756442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b06c6df6-1ce3-4fd9-947b-266ae5547d7b req-1c93c5df-7b0f-4663-9a3f-eb742d4c8bb0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:46.757042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b06c6df6-1ce3-4fd9-947b-266ae5547d7b req-1c93c5df-7b0f-4663-9a3f-eb742d4c8bb0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:46.764484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7bed61c9-b953-4833-b6b1-365a983d0e5d tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:46.765307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7bed61c9-b953-4833-b6b1-365a983d0e5d tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:46.781414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7bed61c9-b953-4833-b6b1-365a983d0e5d tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:46.781983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7bed61c9-b953-4833-b6b1-365a983d0e5d tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:46.782500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7bed61c9-b953-4833-b6b1-365a983d0e5d tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:46.783407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7bed61c9-b953-4833-b6b1-365a983d0e5d tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:46.783979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7bed61c9-b953-4833-b6b1-365a983d0e5d tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:46.784479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7bed61c9-b953-4833-b6b1-365a983d0e5d tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:46.790277 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-b06c6df6-1ce3-4fd9-947b-266ae5547d7b req-1c93c5df-7b0f-4663-9a3f-eb742d4c8bb0 service nova] Creating event network-vif-unplugged:3696a714-c84c-4ccf-a78d-0b8a642038f9 for instance cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 on n-h1-862964-3 Oct 29 01:07:46.796921 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-b06c6df6-1ce3-4fd9-947b-266ae5547d7b req-1c93c5df-7b0f-4663-9a3f-eb742d4c8bb0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085582 Oct 29 01:07:46.798039 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 490/964] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:46.961914 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7bed61c9-b953-4833-b6b1-365a983d0e5d tempest-ServersOnMultiNodesTest-1220381819 tempest-ServersOnMultiNodesTest-1220381819-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1617 microversion: 2.1 time: 0.202076 Oct 29 01:07:46.968912 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 475/965] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:46 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1617 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:46.989857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5ac69232-4341-4ff2-abcc-75a6872da7b4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:46.991270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5ac69232-4341-4ff2-abcc-75a6872da7b4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:46.998160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ac69232-4341-4ff2-abcc-75a6872da7b4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:46.998752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ac69232-4341-4ff2-abcc-75a6872da7b4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:46.999257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ac69232-4341-4ff2-abcc-75a6872da7b4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:47.000158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ac69232-4341-4ff2-abcc-75a6872da7b4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:47.000782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ac69232-4341-4ff2-abcc-75a6872da7b4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:47.001400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ac69232-4341-4ff2-abcc-75a6872da7b4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:47.029653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5ac69232-4341-4ff2-abcc-75a6872da7b4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:07:47.105008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fa2140a0-272d-40ba-8b96-0a249878ac74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:47.105950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fa2140a0-272d-40ba-8b96-0a249878ac74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:47.115520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa2140a0-272d-40ba-8b96-0a249878ac74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:47.116644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa2140a0-272d-40ba-8b96-0a249878ac74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:47.116977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa2140a0-272d-40ba-8b96-0a249878ac74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:47.117713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa2140a0-272d-40ba-8b96-0a249878ac74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:47.118504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa2140a0-272d-40ba-8b96-0a249878ac74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:47.118948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa2140a0-272d-40ba-8b96-0a249878ac74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:47.293897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fa2140a0-272d-40ba-8b96-0a249878ac74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:47.309718 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fa2140a0-272d-40ba-8b96-0a249878ac74 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1312 microversion: 2.1 time: 0.209589 Oct 29 01:07:47.310949 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 476/966] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:47 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1312 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:47.317096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0ff3fdcd-c40e-463d-bd16-6b06ed10834f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:47.318021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0ff3fdcd-c40e-463d-bd16-6b06ed10834f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:47.328051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ff3fdcd-c40e-463d-bd16-6b06ed10834f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:47.328051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ff3fdcd-c40e-463d-bd16-6b06ed10834f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:47.328051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ff3fdcd-c40e-463d-bd16-6b06ed10834f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:47.329015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ff3fdcd-c40e-463d-bd16-6b06ed10834f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:47.330434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ff3fdcd-c40e-463d-bd16-6b06ed10834f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:47.331056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ff3fdcd-c40e-463d-bd16-6b06ed10834f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:47.335495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:47.432736 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5ac69232-4341-4ff2-abcc-75a6872da7b4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 204 len: 0 microversion: 2.1 time: 0.447463 Oct 29 01:07:47.436991 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 491/967] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:07:46 2022] DELETE /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:07:47.445277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4e0be5fe-d2f2-4e89-848a-5c074802730a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:47.447376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4e0be5fe-d2f2-4e89-848a-5c074802730a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:47.457587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e0be5fe-d2f2-4e89-848a-5c074802730a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:47.458898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e0be5fe-d2f2-4e89-848a-5c074802730a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:47.460256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e0be5fe-d2f2-4e89-848a-5c074802730a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:47.461912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e0be5fe-d2f2-4e89-848a-5c074802730a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:47.463312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e0be5fe-d2f2-4e89-848a-5c074802730a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:47.464380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e0be5fe-d2f2-4e89-848a-5c074802730a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:47.627103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4e0be5fe-d2f2-4e89-848a-5c074802730a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:47.635845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4e0be5fe-d2f2-4e89-848a-5c074802730a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:47.640259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4e0be5fe-d2f2-4e89-848a-5c074802730a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:47.646429 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4e0be5fe-d2f2-4e89-848a-5c074802730a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1438 microversion: 2.75 time: 0.209848 Oct 29 01:07:47.647067 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 492/968] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:47 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1438 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:47.651436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-c797188f-f0ac-4c74-ba47-93a7396e45a9 req-f5d8fefa-40b2-486d-b667-5a047ac77212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f415677-47ed-437a-a567-2831f34712dc", "name": "network-vif-plugged", "status": "completed", "tag": "7d6159a8-d4d4-4879-bf83-176011337775"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:47.663031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0ff3fdcd-c40e-463d-bd16-6b06ed10834f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:47.671471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c797188f-f0ac-4c74-ba47-93a7396e45a9 req-f5d8fefa-40b2-486d-b667-5a047ac77212 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:47.672194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c797188f-f0ac-4c74-ba47-93a7396e45a9 req-f5d8fefa-40b2-486d-b667-5a047ac77212 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:47.672823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c797188f-f0ac-4c74-ba47-93a7396e45a9 req-f5d8fefa-40b2-486d-b667-5a047ac77212 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:47.678834 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0ff3fdcd-c40e-463d-bd16-6b06ed10834f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1503 microversion: 2.1 time: 0.366254 Oct 29 01:07:47.679362 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 477/969] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:47 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1503 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:47.693939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3239794b-9f8f-4586-9500-e9646880a9f2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:47.699319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3239794b-9f8f-4586-9500-e9646880a9f2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:47.704134 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-c797188f-f0ac-4c74-ba47-93a7396e45a9 req-f5d8fefa-40b2-486d-b667-5a047ac77212 service nova] Creating event network-vif-plugged:7d6159a8-d4d4-4879-bf83-176011337775 for instance 4f415677-47ed-437a-a567-2831f34712dc on n-h1-862964-3 Oct 29 01:07:47.707125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3239794b-9f8f-4586-9500-e9646880a9f2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:47.707673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3239794b-9f8f-4586-9500-e9646880a9f2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:47.708239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3239794b-9f8f-4586-9500-e9646880a9f2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:47.708948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3239794b-9f8f-4586-9500-e9646880a9f2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:47.709428 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3239794b-9f8f-4586-9500-e9646880a9f2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:47.709842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3239794b-9f8f-4586-9500-e9646880a9f2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:47.710060 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-c797188f-f0ac-4c74-ba47-93a7396e45a9 req-f5d8fefa-40b2-486d-b667-5a047ac77212 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061856 Oct 29 01:07:47.710645 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 493/970] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:47.716590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:47.718797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:47.725882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:47.726583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:47.727451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:47.728230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:47.728695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:47.729121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:47.838842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:07:47.839613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:07:47.840355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:07:47.841788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:07:47.841883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:07:48.038166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3239794b-9f8f-4586-9500-e9646880a9f2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:48.046563 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3239794b-9f8f-4586-9500-e9646880a9f2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1472 microversion: 2.1 time: 0.360031 Oct 29 01:07:48.059725 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 478/971] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:47 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1472 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:48.070650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2f283275-f5fa-417a-a944-6f973e3d6e60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:48.071318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2f283275-f5fa-417a-a944-6f973e3d6e60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:48.075524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:48.080914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f283275-f5fa-417a-a944-6f973e3d6e60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:48.081518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f283275-f5fa-417a-a944-6f973e3d6e60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:48.081959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f283275-f5fa-417a-a944-6f973e3d6e60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:48.082676 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f283275-f5fa-417a-a944-6f973e3d6e60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:48.083155 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f283275-f5fa-417a-a944-6f973e3d6e60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:48.083763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f283275-f5fa-417a-a944-6f973e3d6e60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:48.085310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:48.086126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:48.086828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:48.087743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:48.088404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:48.089084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:48.196662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:48.205646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:48.207232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:48.223751 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a3070bdf-7b5a-40ab-9080-8331c8dc0e2b tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "POST /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b/action" status: 202 len: 1495 microversion: 2.75 time: 0.511740 Oct 29 01:07:48.224647 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 494/972] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 29 01:07:47 2022] POST /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b/action => generated 1495 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 29 01:07:48.256023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a3548ae6-1e18-44dc-a5fc-78635a29d34c tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:48.256652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a3548ae6-1e18-44dc-a5fc-78635a29d34c tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:48.264485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3548ae6-1e18-44dc-a5fc-78635a29d34c tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:48.266458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3548ae6-1e18-44dc-a5fc-78635a29d34c tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:48.266907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3548ae6-1e18-44dc-a5fc-78635a29d34c tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:48.268285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3548ae6-1e18-44dc-a5fc-78635a29d34c tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:48.268747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3548ae6-1e18-44dc-a5fc-78635a29d34c tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:48.269188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3548ae6-1e18-44dc-a5fc-78635a29d34c tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:48.349701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2f283275-f5fa-417a-a944-6f973e3d6e60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:48.365744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2f283275-f5fa-417a-a944-6f973e3d6e60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:48.365744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2f283275-f5fa-417a-a944-6f973e3d6e60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:48.365744 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2f283275-f5fa-417a-a944-6f973e3d6e60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1608 microversion: 2.25 time: 0.305531 Oct 29 01:07:48.366123 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 479/973] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:48 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1608 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:48.366925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a3548ae6-1e18-44dc-a5fc-78635a29d34c tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:48.371788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d769b847-88f0-4daa-8793-78b4cebb354b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:48.373853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d769b847-88f0-4daa-8793-78b4cebb354b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:48.375707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a3548ae6-1e18-44dc-a5fc-78635a29d34c tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:48.378437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a3548ae6-1e18-44dc-a5fc-78635a29d34c tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:48.384206 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a3548ae6-1e18-44dc-a5fc-78635a29d34c tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.132590 Oct 29 01:07:48.389262 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 495/974] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:48 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:07:48.395410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e6fed26a-2973-4994-a00e-c5bd40c0b54d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:48.396117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e6fed26a-2973-4994-a00e-c5bd40c0b54d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:48.399932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d769b847-88f0-4daa-8793-78b4cebb354b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:48.400607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d769b847-88f0-4daa-8793-78b4cebb354b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:48.402395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d769b847-88f0-4daa-8793-78b4cebb354b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:48.403370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6fed26a-2973-4994-a00e-c5bd40c0b54d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:48.403760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d769b847-88f0-4daa-8793-78b4cebb354b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:48.404170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6fed26a-2973-4994-a00e-c5bd40c0b54d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:48.404790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6fed26a-2973-4994-a00e-c5bd40c0b54d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:48.405724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6fed26a-2973-4994-a00e-c5bd40c0b54d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:48.406045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d769b847-88f0-4daa-8793-78b4cebb354b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:48.406536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6fed26a-2973-4994-a00e-c5bd40c0b54d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:48.406962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6fed26a-2973-4994-a00e-c5bd40c0b54d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:48.407069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d769b847-88f0-4daa-8793-78b4cebb354b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:48.547985 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e6fed26a-2973-4994-a00e-c5bd40c0b54d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.156947 Oct 29 01:07:48.549669 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 496/975] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Oct 29 01:07:48 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-interface => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:07:48.597005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d769b847-88f0-4daa-8793-78b4cebb354b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:48.606805 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d769b847-88f0-4daa-8793-78b4cebb354b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1312 microversion: 2.1 time: 0.240541 Oct 29 01:07:48.607606 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 480/976] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:48 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1312 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:48.706916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-038183cd-5290-49d0-8c64-2cc562d23cb2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:48.707530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-038183cd-5290-49d0-8c64-2cc562d23cb2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:48.713749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-038183cd-5290-49d0-8c64-2cc562d23cb2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:48.714184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-038183cd-5290-49d0-8c64-2cc562d23cb2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:48.714620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-038183cd-5290-49d0-8c64-2cc562d23cb2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:48.715323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-038183cd-5290-49d0-8c64-2cc562d23cb2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:48.715810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-038183cd-5290-49d0-8c64-2cc562d23cb2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:48.716241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-038183cd-5290-49d0-8c64-2cc562d23cb2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:48.849894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-038183cd-5290-49d0-8c64-2cc562d23cb2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:48.857690 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-038183cd-5290-49d0-8c64-2cc562d23cb2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1503 microversion: 2.1 time: 0.155174 Oct 29 01:07:48.858265 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 497/977] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:48 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:49.071598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-84d901f1-fbbb-408c-883f-be820d7a4d7f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:49.072306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-84d901f1-fbbb-408c-883f-be820d7a4d7f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:49.080471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84d901f1-fbbb-408c-883f-be820d7a4d7f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:49.081066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84d901f1-fbbb-408c-883f-be820d7a4d7f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:49.081606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84d901f1-fbbb-408c-883f-be820d7a4d7f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:49.082478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84d901f1-fbbb-408c-883f-be820d7a4d7f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:49.083011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84d901f1-fbbb-408c-883f-be820d7a4d7f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:49.083638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84d901f1-fbbb-408c-883f-be820d7a4d7f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:49.133190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-b58cdeec-4fa7-48ed-9874-cccade69321b req-2169d319-2b58-40b7-9ae8-3e7c752811b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5", "tag": "3696a714-c84c-4ccf-a78d-0b8a642038f9"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:49.144762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b58cdeec-4fa7-48ed-9874-cccade69321b req-2169d319-2b58-40b7-9ae8-3e7c752811b5 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:49.145370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b58cdeec-4fa7-48ed-9874-cccade69321b req-2169d319-2b58-40b7-9ae8-3e7c752811b5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:49.146026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b58cdeec-4fa7-48ed-9874-cccade69321b req-2169d319-2b58-40b7-9ae8-3e7c752811b5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:49.158415 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-b58cdeec-4fa7-48ed-9874-cccade69321b req-2169d319-2b58-40b7-9ae8-3e7c752811b5 service nova] Creating event network-changed:3696a714-c84c-4ccf-a78d-0b8a642038f9 for instance cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 on n-h1-862964-3 Oct 29 01:07:49.163807 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-b58cdeec-4fa7-48ed-9874-cccade69321b req-2169d319-2b58-40b7-9ae8-3e7c752811b5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035279 Oct 29 01:07:49.168009 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 498/978] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:07:49.240726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-84d901f1-fbbb-408c-883f-be820d7a4d7f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:49.249868 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-84d901f1-fbbb-408c-883f-be820d7a4d7f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1472 microversion: 2.1 time: 0.182455 Oct 29 01:07:49.250452 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 481/979] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:49 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1472 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:49.415520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-413c82b9-260f-4464-ba60-e3ae9e4ae201 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:49.416446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-413c82b9-260f-4464-ba60-e3ae9e4ae201 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:49.424110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-413c82b9-260f-4464-ba60-e3ae9e4ae201 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:49.425024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-413c82b9-260f-4464-ba60-e3ae9e4ae201 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:49.426367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-413c82b9-260f-4464-ba60-e3ae9e4ae201 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:49.427528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-413c82b9-260f-4464-ba60-e3ae9e4ae201 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:49.428237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-413c82b9-260f-4464-ba60-e3ae9e4ae201 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:49.428857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-413c82b9-260f-4464-ba60-e3ae9e4ae201 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:49.499023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-413c82b9-260f-4464-ba60-e3ae9e4ae201 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:49.508263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-413c82b9-260f-4464-ba60-e3ae9e4ae201 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:49.510060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-413c82b9-260f-4464-ba60-e3ae9e4ae201 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:49.520345 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-413c82b9-260f-4464-ba60-e3ae9e4ae201 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.109704 Oct 29 01:07:49.533845 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 499/980] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:49 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:49.630739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-702b8870-9270-439c-9890-9528ce395c72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:49.631436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-702b8870-9270-439c-9890-9528ce395c72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:49.637591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-702b8870-9270-439c-9890-9528ce395c72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:49.638387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-702b8870-9270-439c-9890-9528ce395c72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:49.639033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-702b8870-9270-439c-9890-9528ce395c72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:49.639808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-702b8870-9270-439c-9890-9528ce395c72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:49.640464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-702b8870-9270-439c-9890-9528ce395c72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:49.641085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-702b8870-9270-439c-9890-9528ce395c72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:49.779340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-702b8870-9270-439c-9890-9528ce395c72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:49.788705 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-702b8870-9270-439c-9890-9528ce395c72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1312 microversion: 2.1 time: 0.161913 Oct 29 01:07:49.789301 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 482/981] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:49 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1312 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:49.883251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-44c8482b-d60e-4c74-8a02-7b48e2cfa988 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:49.884123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-44c8482b-d60e-4c74-8a02-7b48e2cfa988 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:49.891817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44c8482b-d60e-4c74-8a02-7b48e2cfa988 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:49.893680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44c8482b-d60e-4c74-8a02-7b48e2cfa988 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:49.894438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44c8482b-d60e-4c74-8a02-7b48e2cfa988 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:49.895279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44c8482b-d60e-4c74-8a02-7b48e2cfa988 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:49.896089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44c8482b-d60e-4c74-8a02-7b48e2cfa988 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:49.896746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44c8482b-d60e-4c74-8a02-7b48e2cfa988 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:50.224782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-44c8482b-d60e-4c74-8a02-7b48e2cfa988 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:50.253892 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-44c8482b-d60e-4c74-8a02-7b48e2cfa988 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1503 microversion: 2.1 time: 0.360649 Oct 29 01:07:50.253892 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 500/982] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:49 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1503 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:50.276184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c6c50d3-007d-424e-a2bd-5d28f89289cb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:50.276890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9c6c50d3-007d-424e-a2bd-5d28f89289cb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:50.289708 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c6c50d3-007d-424e-a2bd-5d28f89289cb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:50.291046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c6c50d3-007d-424e-a2bd-5d28f89289cb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:50.291586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c6c50d3-007d-424e-a2bd-5d28f89289cb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:50.293203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c6c50d3-007d-424e-a2bd-5d28f89289cb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:50.293906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c6c50d3-007d-424e-a2bd-5d28f89289cb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:50.294565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c6c50d3-007d-424e-a2bd-5d28f89289cb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:50.382468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9c6c50d3-007d-424e-a2bd-5d28f89289cb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:50.409743 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9c6c50d3-007d-424e-a2bd-5d28f89289cb tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1302 microversion: 2.1 time: 0.134815 Oct 29 01:07:50.414128 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 483/983] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:50 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1302 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:50.558279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-46980269-4aa0-4ab2-802b-bdc9bcbeb731 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:50.568064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-46980269-4aa0-4ab2-802b-bdc9bcbeb731 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:50.582415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46980269-4aa0-4ab2-802b-bdc9bcbeb731 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:50.585505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46980269-4aa0-4ab2-802b-bdc9bcbeb731 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:50.588087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46980269-4aa0-4ab2-802b-bdc9bcbeb731 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:50.589064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46980269-4aa0-4ab2-802b-bdc9bcbeb731 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:50.593315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46980269-4aa0-4ab2-802b-bdc9bcbeb731 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:50.595949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46980269-4aa0-4ab2-802b-bdc9bcbeb731 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:50.750654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-46980269-4aa0-4ab2-802b-bdc9bcbeb731 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:50.763404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-46980269-4aa0-4ab2-802b-bdc9bcbeb731 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:50.772082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-46980269-4aa0-4ab2-802b-bdc9bcbeb731 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:50.777980 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-46980269-4aa0-4ab2-802b-bdc9bcbeb731 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.231082 Oct 29 01:07:50.779476 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 501/984] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:50 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:50.812339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-39ea9c59-2a12-4cdc-a623-63d1ac49d68e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:50.812959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-39ea9c59-2a12-4cdc-a623-63d1ac49d68e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:50.836597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39ea9c59-2a12-4cdc-a623-63d1ac49d68e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:50.837304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39ea9c59-2a12-4cdc-a623-63d1ac49d68e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:50.837595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39ea9c59-2a12-4cdc-a623-63d1ac49d68e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:50.839376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39ea9c59-2a12-4cdc-a623-63d1ac49d68e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:50.841352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39ea9c59-2a12-4cdc-a623-63d1ac49d68e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:50.842238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39ea9c59-2a12-4cdc-a623-63d1ac49d68e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:51.017988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-39ea9c59-2a12-4cdc-a623-63d1ac49d68e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:51.027641 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-39ea9c59-2a12-4cdc-a623-63d1ac49d68e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1462 microversion: 2.1 time: 0.219404 Oct 29 01:07:51.028389 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 484/985] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:50 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1462 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:51.052220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1fb8d96c-f57c-43bd-bf06-5f61d0885859 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:51.055171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1fb8d96c-f57c-43bd-bf06-5f61d0885859 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:51.062439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fb8d96c-f57c-43bd-bf06-5f61d0885859 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:51.063291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fb8d96c-f57c-43bd-bf06-5f61d0885859 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:51.063957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fb8d96c-f57c-43bd-bf06-5f61d0885859 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:51.065823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fb8d96c-f57c-43bd-bf06-5f61d0885859 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:51.066634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fb8d96c-f57c-43bd-bf06-5f61d0885859 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:51.067276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fb8d96c-f57c-43bd-bf06-5f61d0885859 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:51.124488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:51.195315 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-f4ff54ff-53f8-4404-8137-eae0e6004168 req-caeb27f8-f579-4754-bcf9-e1c8639d6844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72ffa89-8708-45d4-872f-65509e631d27", "name": "network-vif-deleted", "tag": "454e8b33-3067-4ecd-9cee-b3d21ccf81cd"}, {"name": "network-changed", "server_uuid": "00a19183-c526-47be-95c4-d4c3a9936390", "tag": "1435293b-3554-4c79-9898-f9de315c7829"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:51.200419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1fb8d96c-f57c-43bd-bf06-5f61d0885859 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:51.208148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1fb8d96c-f57c-43bd-bf06-5f61d0885859 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Old instance type m1.heat2, new instance type m1.heat {{(pid=121099) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 01:07:51.212439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f4ff54ff-53f8-4404-8137-eae0e6004168 req-caeb27f8-f579-4754-bcf9-e1c8639d6844 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:51.213431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f4ff54ff-53f8-4404-8137-eae0e6004168 req-caeb27f8-f579-4754-bcf9-e1c8639d6844 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:51.214180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f4ff54ff-53f8-4404-8137-eae0e6004168 req-caeb27f8-f579-4754-bcf9-e1c8639d6844 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:51.222912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1fb8d96c-f57c-43bd-bf06-5f61d0885859 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:07:51.223316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1fb8d96c-f57c-43bd-bf06-5f61d0885859 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:07:51.223785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1fb8d96c-f57c-43bd-bf06-5f61d0885859 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:07:51.224184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1fb8d96c-f57c-43bd-bf06-5f61d0885859 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:07:51.224584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1fb8d96c-f57c-43bd-bf06-5f61d0885859 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:07:51.231910 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f4ff54ff-53f8-4404-8137-eae0e6004168 req-caeb27f8-f579-4754-bcf9-e1c8639d6844 service nova] Creating event network-vif-deleted:454e8b33-3067-4ecd-9cee-b3d21ccf81cd for instance c72ffa89-8708-45d4-872f-65509e631d27 on n-h2-862964-3 Oct 29 01:07:51.232706 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f4ff54ff-53f8-4404-8137-eae0e6004168 req-caeb27f8-f579-4754-bcf9-e1c8639d6844 service nova] Creating event network-changed:1435293b-3554-4c79-9898-f9de315c7829 for instance 00a19183-c526-47be-95c4-d4c3a9936390 on n-h1-862964-3 Oct 29 01:07:51.243461 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-f4ff54ff-53f8-4404-8137-eae0e6004168 req-caeb27f8-f579-4754-bcf9-e1c8639d6844 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.052228 Oct 29 01:07:51.245460 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 485/986] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:07:51.265997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bffc506f-10d4-4c42-93a4-41dcc3ee7a24 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:51.267256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bffc506f-10d4-4c42-93a4-41dcc3ee7a24 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:51.275038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bffc506f-10d4-4c42-93a4-41dcc3ee7a24 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:51.275699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bffc506f-10d4-4c42-93a4-41dcc3ee7a24 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:51.276213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bffc506f-10d4-4c42-93a4-41dcc3ee7a24 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:51.277192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bffc506f-10d4-4c42-93a4-41dcc3ee7a24 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:51.277728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bffc506f-10d4-4c42-93a4-41dcc3ee7a24 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:51.278224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bffc506f-10d4-4c42-93a4-41dcc3ee7a24 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:51.520441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bffc506f-10d4-4c42-93a4-41dcc3ee7a24 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:51.540882 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1fb8d96c-f57c-43bd-bf06-5f61d0885859 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "POST /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc/action" status: 202 len: 0 microversion: 2.1 time: 0.493398 Oct 29 01:07:51.544633 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 502/987] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:07:51 2022] POST /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:07:51.547471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1e1a0780-89df-4870-91b5-211d69575142 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:51.548660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1e1a0780-89df-4870-91b5-211d69575142 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:51.558990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e1a0780-89df-4870-91b5-211d69575142 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:51.559470 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bffc506f-10d4-4c42-93a4-41dcc3ee7a24 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1503 microversion: 2.1 time: 0.297814 Oct 29 01:07:51.559863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e1a0780-89df-4870-91b5-211d69575142 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:51.560073 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 486/988] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:51 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1503 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:51.581952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-215308f4-b1fb-43a4-9584-081022f65755 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:51.581952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-215308f4-b1fb-43a4-9584-081022f65755 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:51.583723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e1a0780-89df-4870-91b5-211d69575142 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:51.583851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e1a0780-89df-4870-91b5-211d69575142 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:51.584399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e1a0780-89df-4870-91b5-211d69575142 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:51.584842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e1a0780-89df-4870-91b5-211d69575142 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:51.590990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-215308f4-b1fb-43a4-9584-081022f65755 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:51.591571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-215308f4-b1fb-43a4-9584-081022f65755 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:51.592019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-215308f4-b1fb-43a4-9584-081022f65755 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:51.592954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-215308f4-b1fb-43a4-9584-081022f65755 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:51.593665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-215308f4-b1fb-43a4-9584-081022f65755 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:51.594295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-215308f4-b1fb-43a4-9584-081022f65755 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:51.629636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e1a0780-89df-4870-91b5-211d69575142 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:51.630121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e1a0780-89df-4870-91b5-211d69575142 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:51.630552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e1a0780-89df-4870-91b5-211d69575142 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:51.631092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-1e1a0780-89df-4870-91b5-211d69575142 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lazy-loading 'fault' on Instance uuid c72ffa89-8708-45d4-872f-65509e631d27 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:07:51.691991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1e1a0780-89df-4870-91b5-211d69575142 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:51.702605 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1e1a0780-89df-4870-91b5-211d69575142 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 200 len: 1307 microversion: 2.1 time: 0.159427 Oct 29 01:07:51.707075 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 503/989] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:51 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 1307 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:51.809141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b6259279-f7b4-4978-9b5e-b02fe91e32b1 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:51.809818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b6259279-f7b4-4978-9b5e-b02fe91e32b1 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:51.816448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6259279-f7b4-4978-9b5e-b02fe91e32b1 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:51.819839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6259279-f7b4-4978-9b5e-b02fe91e32b1 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:51.819839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6259279-f7b4-4978-9b5e-b02fe91e32b1 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:51.819839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6259279-f7b4-4978-9b5e-b02fe91e32b1 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:51.819839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6259279-f7b4-4978-9b5e-b02fe91e32b1 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:51.820403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6259279-f7b4-4978-9b5e-b02fe91e32b1 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:51.947002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b6259279-f7b4-4978-9b5e-b02fe91e32b1 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:51.956689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b6259279-f7b4-4978-9b5e-b02fe91e32b1 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:51.958206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b6259279-f7b4-4978-9b5e-b02fe91e32b1 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:51.963470 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b6259279-f7b4-4978-9b5e-b02fe91e32b1 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.158658 Oct 29 01:07:51.963965 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 504/990] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:51 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:07:51.969832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-215308f4-b1fb-43a4-9584-081022f65755 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:51.978029 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-215308f4-b1fb-43a4-9584-081022f65755 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1471 microversion: 2.1 time: 0.407871 Oct 29 01:07:51.978693 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 487/991] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:51 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1471 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:52.582929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-112deaa8-acb2-4cb2-aaec-f1968032c033 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:52.584974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-112deaa8-acb2-4cb2-aaec-f1968032c033 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:52.592583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-112deaa8-acb2-4cb2-aaec-f1968032c033 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:52.593174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-112deaa8-acb2-4cb2-aaec-f1968032c033 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:52.594919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-112deaa8-acb2-4cb2-aaec-f1968032c033 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:52.595843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-112deaa8-acb2-4cb2-aaec-f1968032c033 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:52.596405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-112deaa8-acb2-4cb2-aaec-f1968032c033 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:52.596996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-112deaa8-acb2-4cb2-aaec-f1968032c033 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:52.729648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-61dfcbd7-a727-4f5b-b26d-c6a03b44131d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:52.730165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-61dfcbd7-a727-4f5b-b26d-c6a03b44131d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c72ffa89-8708-45d4-872f-65509e631d27] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:52.739113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61dfcbd7-a727-4f5b-b26d-c6a03b44131d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:52.739620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61dfcbd7-a727-4f5b-b26d-c6a03b44131d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:52.740127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61dfcbd7-a727-4f5b-b26d-c6a03b44131d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:52.740848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61dfcbd7-a727-4f5b-b26d-c6a03b44131d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:52.741371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61dfcbd7-a727-4f5b-b26d-c6a03b44131d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:52.741823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61dfcbd7-a727-4f5b-b26d-c6a03b44131d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:52.760724 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-61dfcbd7-a727-4f5b-b26d-c6a03b44131d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] HTTP exception thrown: Instance c72ffa89-8708-45d4-872f-65509e631d27 could not be found. Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-61dfcbd7-a727-4f5b-b26d-c6a03b44131d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Request method failure captured: Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 HTTP/1.1 Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHwhYjb8T-pefU3e0LRdpcRsaJPFyVw-4dAPNLJHoKRnbD15rG4FUGsSdMiljCoab17YXaJvro1O3NyzEhUDOnHEbevicmLzbOFjk6aedYSm2jKWp75WAaVb6ch8kcgB3XOgcaZPAYGlfDI7vgo-pubvBe6iYlNiBQTmtVirNDMcgXg Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: fba91819dd56439daea17217c5d7b9b7 Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:07:52.764563 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:07:52.766180 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fba91819dd56439daea17217c5d7b9b7", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:07:52.766180 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:07:52.766180 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: fba91819dd56439daea17217c5d7b9b7 Oct 29 01:07:52.766180 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:07:52.766180 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersOnMultiNodesTest-1355240400-project Oct 29 01:07:52.766180 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:07:52.766180 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:07:52.766180 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 175bb8f8b330495394cd401223847733 Oct 29 01:07:52.766180 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersOnMultiNodesTest-1355240400-project Oct 29 01:07:52.766180 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:07:52.766180 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance c72ffa89-8708-45d4-872f-65509e631d27 could not be found. Oct 29 01:07:52.766180 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'c72ffa89-8708-45d4-872f-65509e631d27'} Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c72ffa89-8708-45d4-872f-65509e631d27 could not be found. Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:07:52.767129 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:07:52.770455 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:07:52.770455 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:07:52.770455 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:07:52.770455 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:07:52.770455 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:07:52.770455 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:07:52.770455 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:07:52.770455 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c72ffa89-8708-45d4-872f-65509e631d27 could not be found. Oct 29 01:07:52.770455 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:52.770455 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:52.770455 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:52.770455 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:52.770455 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:52.770455 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:52.770455 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:07:52.770455 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:07:52.770455 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c72ffa89-8708-45d4-872f-65509e631d27 could not be found. Oct 29 01:07:52.770455 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:07:52.773273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-61dfcbd7-a727-4f5b-b26d-c6a03b44131d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Returning 404 to user: Instance c72ffa89-8708-45d4-872f-65509e631d27 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:07:52.773273 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-61dfcbd7-a727-4f5b-b26d-c6a03b44131d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27" status: 404 len: 111 microversion: 2.1 time: 0.040741 Oct 29 01:07:52.773273 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 488/992] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:52 2022] GET /compute/v2.1/servers/c72ffa89-8708-45d4-872f-65509e631d27 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:07:52.776060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e5418fa-80e7-461f-81b1-49705e7816fa tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:52.776764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7e5418fa-80e7-461f-81b1-49705e7816fa tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:52.784786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e5418fa-80e7-461f-81b1-49705e7816fa tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:52.785476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e5418fa-80e7-461f-81b1-49705e7816fa tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:52.786480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e5418fa-80e7-461f-81b1-49705e7816fa tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:52.788416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e5418fa-80e7-461f-81b1-49705e7816fa tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:52.789114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e5418fa-80e7-461f-81b1-49705e7816fa tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:52.789947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e5418fa-80e7-461f-81b1-49705e7816fa tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:52.823091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7e5418fa-80e7-461f-81b1-49705e7816fa tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:07:52.824849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-112deaa8-acb2-4cb2-aaec-f1968032c033 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:52.827221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:52.836970 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-112deaa8-acb2-4cb2-aaec-f1968032c033 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1503 microversion: 2.1 time: 0.257994 Oct 29 01:07:52.837992 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 505/993] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:52 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1503 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:52.991984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b8b242d0-719d-4b9b-8ad2-1c85a2ffa7bd tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:52.992508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b8b242d0-719d-4b9b-8ad2-1c85a2ffa7bd tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:52.999202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8b242d0-719d-4b9b-8ad2-1c85a2ffa7bd tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:52.999957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8b242d0-719d-4b9b-8ad2-1c85a2ffa7bd tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:53.004787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8b242d0-719d-4b9b-8ad2-1c85a2ffa7bd tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:53.004787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8b242d0-719d-4b9b-8ad2-1c85a2ffa7bd tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:53.004787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8b242d0-719d-4b9b-8ad2-1c85a2ffa7bd tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:53.004787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8b242d0-719d-4b9b-8ad2-1c85a2ffa7bd tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:53.117752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b8b242d0-719d-4b9b-8ad2-1c85a2ffa7bd tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:53.125960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b8b242d0-719d-4b9b-8ad2-1c85a2ffa7bd tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:53.128113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b8b242d0-719d-4b9b-8ad2-1c85a2ffa7bd tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:53.132957 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b8b242d0-719d-4b9b-8ad2-1c85a2ffa7bd tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.145307 Oct 29 01:07:53.133565 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 506/994] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:52 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:07:53.138126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-57359798-6aaf-4b46-b1a7-fa257d35215b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:53.142481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-57359798-6aaf-4b46-b1a7-fa257d35215b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:53.144366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57359798-6aaf-4b46-b1a7-fa257d35215b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:53.144852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57359798-6aaf-4b46-b1a7-fa257d35215b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:53.145316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57359798-6aaf-4b46-b1a7-fa257d35215b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:53.146002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57359798-6aaf-4b46-b1a7-fa257d35215b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:53.146453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57359798-6aaf-4b46-b1a7-fa257d35215b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:53.146875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57359798-6aaf-4b46-b1a7-fa257d35215b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:53.204469 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e5418fa-80e7-461f-81b1-49705e7816fa tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9" status: 204 len: 0 microversion: 2.1 time: 0.431602 Oct 29 01:07:53.209299 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 489/995] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:07:52 2022] DELETE /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:07:53.216191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c35a7529-8048-42e0-984c-811154a9aaea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:53.216899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c35a7529-8048-42e0-984c-811154a9aaea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:53.223566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c35a7529-8048-42e0-984c-811154a9aaea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:53.224193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c35a7529-8048-42e0-984c-811154a9aaea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:53.224626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c35a7529-8048-42e0-984c-811154a9aaea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:53.225556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c35a7529-8048-42e0-984c-811154a9aaea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:53.226171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c35a7529-8048-42e0-984c-811154a9aaea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:53.226753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c35a7529-8048-42e0-984c-811154a9aaea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:53.400386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-57359798-6aaf-4b46-b1a7-fa257d35215b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:53.412721 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-57359798-6aaf-4b46-b1a7-fa257d35215b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1471 microversion: 2.1 time: 0.277471 Oct 29 01:07:53.414035 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 507/996] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:53 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1471 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:53.567019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c35a7529-8048-42e0-984c-811154a9aaea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:53.578648 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c35a7529-8048-42e0-984c-811154a9aaea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9" status: 200 len: 1472 microversion: 2.1 time: 0.367952 Oct 29 01:07:53.580753 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 490/997] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:53 2022] GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 => generated 1472 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:53.863658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-625c3f19-d411-4f0b-9d81-c21bb89fc1e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:53.864280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-625c3f19-d411-4f0b-9d81-c21bb89fc1e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:53.871435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-625c3f19-d411-4f0b-9d81-c21bb89fc1e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:53.872079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-625c3f19-d411-4f0b-9d81-c21bb89fc1e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:53.872566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-625c3f19-d411-4f0b-9d81-c21bb89fc1e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:53.873391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-625c3f19-d411-4f0b-9d81-c21bb89fc1e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:53.873921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-625c3f19-d411-4f0b-9d81-c21bb89fc1e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:53.874412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-625c3f19-d411-4f0b-9d81-c21bb89fc1e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:54.105810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-625c3f19-d411-4f0b-9d81-c21bb89fc1e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:54.114867 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-625c3f19-d411-4f0b-9d81-c21bb89fc1e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1503 microversion: 2.1 time: 0.256920 Oct 29 01:07:54.115446 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 508/998] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:53 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1503 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:54.160624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3307dc8e-704d-41d5-bb9f-e9c099684680 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:54.161864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3307dc8e-704d-41d5-bb9f-e9c099684680 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:54.171331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3307dc8e-704d-41d5-bb9f-e9c099684680 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:54.171836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3307dc8e-704d-41d5-bb9f-e9c099684680 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:54.172279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3307dc8e-704d-41d5-bb9f-e9c099684680 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:54.173023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3307dc8e-704d-41d5-bb9f-e9c099684680 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:54.173556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3307dc8e-704d-41d5-bb9f-e9c099684680 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:54.174481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3307dc8e-704d-41d5-bb9f-e9c099684680 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:54.263705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3307dc8e-704d-41d5-bb9f-e9c099684680 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:54.278996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3307dc8e-704d-41d5-bb9f-e9c099684680 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:54.280460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3307dc8e-704d-41d5-bb9f-e9c099684680 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:54.287597 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3307dc8e-704d-41d5-bb9f-e9c099684680 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.131071 Oct 29 01:07:54.288765 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 491/999] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:54 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:54.438344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3880119f-57fc-4a8c-8de2-c0e1b8980bc2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:54.439348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3880119f-57fc-4a8c-8de2-c0e1b8980bc2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:54.448831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3880119f-57fc-4a8c-8de2-c0e1b8980bc2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:54.449799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3880119f-57fc-4a8c-8de2-c0e1b8980bc2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:54.453245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3880119f-57fc-4a8c-8de2-c0e1b8980bc2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:54.453245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3880119f-57fc-4a8c-8de2-c0e1b8980bc2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:54.453245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3880119f-57fc-4a8c-8de2-c0e1b8980bc2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:54.453245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3880119f-57fc-4a8c-8de2-c0e1b8980bc2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:54.603645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ef0ca87c-ced3-4c1d-a157-ae85a1b51fb8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:54.604576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ef0ca87c-ced3-4c1d-a157-ae85a1b51fb8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:54.611547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef0ca87c-ced3-4c1d-a157-ae85a1b51fb8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:54.611781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef0ca87c-ced3-4c1d-a157-ae85a1b51fb8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:54.612310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef0ca87c-ced3-4c1d-a157-ae85a1b51fb8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:54.613475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef0ca87c-ced3-4c1d-a157-ae85a1b51fb8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:54.614319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef0ca87c-ced3-4c1d-a157-ae85a1b51fb8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:54.614854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef0ca87c-ced3-4c1d-a157-ae85a1b51fb8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:54.741659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3880119f-57fc-4a8c-8de2-c0e1b8980bc2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:54.751817 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3880119f-57fc-4a8c-8de2-c0e1b8980bc2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1471 microversion: 2.1 time: 0.318117 Oct 29 01:07:54.753271 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 509/1000] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:54 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1471 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:55.139526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f073bbad-e3f8-43f1-8444-611d511b5949 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:55.139526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f073bbad-e3f8-43f1-8444-611d511b5949 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:55.146983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f073bbad-e3f8-43f1-8444-611d511b5949 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:55.147470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f073bbad-e3f8-43f1-8444-611d511b5949 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:55.147905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f073bbad-e3f8-43f1-8444-611d511b5949 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:55.148608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f073bbad-e3f8-43f1-8444-611d511b5949 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:55.149062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f073bbad-e3f8-43f1-8444-611d511b5949 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:55.149528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f073bbad-e3f8-43f1-8444-611d511b5949 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:55.224172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ef0ca87c-ced3-4c1d-a157-ae85a1b51fb8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:55.232244 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ef0ca87c-ced3-4c1d-a157-ae85a1b51fb8 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9" status: 200 len: 1472 microversion: 2.1 time: 0.632704 Oct 29 01:07:55.233203 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 492/1001] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:54 2022] GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 => generated 1472 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:55.316828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-444937c9-f4c5-46f0-b0e9-08ebdd283e06 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:55.317461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-444937c9-f4c5-46f0-b0e9-08ebdd283e06 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:55.323525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-444937c9-f4c5-46f0-b0e9-08ebdd283e06 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:55.324126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-444937c9-f4c5-46f0-b0e9-08ebdd283e06 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:55.324650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-444937c9-f4c5-46f0-b0e9-08ebdd283e06 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:55.325449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-444937c9-f4c5-46f0-b0e9-08ebdd283e06 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:55.325978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-444937c9-f4c5-46f0-b0e9-08ebdd283e06 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:55.326474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-444937c9-f4c5-46f0-b0e9-08ebdd283e06 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:55.363422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f073bbad-e3f8-43f1-8444-611d511b5949 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:55.371132 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f073bbad-e3f8-43f1-8444-611d511b5949 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1503 microversion: 2.1 time: 0.236231 Oct 29 01:07:55.371713 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 510/1002] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:55 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1503 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:55.398983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-444937c9-f4c5-46f0-b0e9-08ebdd283e06 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:55.407333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-444937c9-f4c5-46f0-b0e9-08ebdd283e06 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:55.408785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-444937c9-f4c5-46f0-b0e9-08ebdd283e06 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:55.413830 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-444937c9-f4c5-46f0-b0e9-08ebdd283e06 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.101840 Oct 29 01:07:55.414573 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 493/1003] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:55 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:07:55.780590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eed15d3b-4597-4885-8892-bb98c0b4d4a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:55.783314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eed15d3b-4597-4885-8892-bb98c0b4d4a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:55.794718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eed15d3b-4597-4885-8892-bb98c0b4d4a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:55.795759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eed15d3b-4597-4885-8892-bb98c0b4d4a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:55.796348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eed15d3b-4597-4885-8892-bb98c0b4d4a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:55.797970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eed15d3b-4597-4885-8892-bb98c0b4d4a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:55.799482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eed15d3b-4597-4885-8892-bb98c0b4d4a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:55.800228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eed15d3b-4597-4885-8892-bb98c0b4d4a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:56.160636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eed15d3b-4597-4885-8892-bb98c0b4d4a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:56.201895 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eed15d3b-4597-4885-8892-bb98c0b4d4a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1471 microversion: 2.1 time: 0.427547 Oct 29 01:07:56.210455 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 511/1004] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:55 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1471 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:56.256396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-beb3a324-2730-46e3-88d6-a6cdf3a3f9dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:56.257185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-beb3a324-2730-46e3-88d6-a6cdf3a3f9dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:56.274025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-beb3a324-2730-46e3-88d6-a6cdf3a3f9dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:56.276666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-beb3a324-2730-46e3-88d6-a6cdf3a3f9dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:56.277246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-beb3a324-2730-46e3-88d6-a6cdf3a3f9dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:56.279732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-beb3a324-2730-46e3-88d6-a6cdf3a3f9dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:56.280485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-beb3a324-2730-46e3-88d6-a6cdf3a3f9dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:56.283203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-beb3a324-2730-46e3-88d6-a6cdf3a3f9dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:56.364252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-ec735369-351f-4ab4-969d-407820f05f05 req-9a0921b5-2fc0-45d0-8fe5-e05234ddc270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18b6f45-f426-4003-9d72-fa419f9190d9", "name": "network-vif-deleted", "tag": "f526b6da-75af-4897-80a9-ff820e170edc"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:56.381189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ec735369-351f-4ab4-969d-407820f05f05 req-9a0921b5-2fc0-45d0-8fe5-e05234ddc270 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:56.388760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ec735369-351f-4ab4-969d-407820f05f05 req-9a0921b5-2fc0-45d0-8fe5-e05234ddc270 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:56.389371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ec735369-351f-4ab4-969d-407820f05f05 req-9a0921b5-2fc0-45d0-8fe5-e05234ddc270 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:56.404597 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-ec735369-351f-4ab4-969d-407820f05f05 req-9a0921b5-2fc0-45d0-8fe5-e05234ddc270 service nova] Creating event network-vif-deleted:f526b6da-75af-4897-80a9-ff820e170edc for instance e18b6f45-f426-4003-9d72-fa419f9190d9 on n-h1-862964-3 Oct 29 01:07:56.411489 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-ec735369-351f-4ab4-969d-407820f05f05 req-9a0921b5-2fc0-45d0-8fe5-e05234ddc270 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051315 Oct 29 01:07:56.412677 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 512/1005] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:07:56.420381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f08f74e5-a813-453f-9653-1915b4566417 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:56.421687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f08f74e5-a813-453f-9653-1915b4566417 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:56.429392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f08f74e5-a813-453f-9653-1915b4566417 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:56.430199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f08f74e5-a813-453f-9653-1915b4566417 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:56.430813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f08f74e5-a813-453f-9653-1915b4566417 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:56.431704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f08f74e5-a813-453f-9653-1915b4566417 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:56.432789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f08f74e5-a813-453f-9653-1915b4566417 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:56.433072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f08f74e5-a813-453f-9653-1915b4566417 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:56.486249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-beb3a324-2730-46e3-88d6-a6cdf3a3f9dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:56.497346 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-beb3a324-2730-46e3-88d6-a6cdf3a3f9dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9" status: 200 len: 1430 microversion: 2.1 time: 0.244753 Oct 29 01:07:56.498003 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 494/1006] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:56 2022] GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 => generated 1430 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:56.513645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3a1920bd-7241-4af7-be18-7f0f013a4007 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:56.514271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3a1920bd-7241-4af7-be18-7f0f013a4007 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:56.521545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a1920bd-7241-4af7-be18-7f0f013a4007 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:56.522318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a1920bd-7241-4af7-be18-7f0f013a4007 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:56.522989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a1920bd-7241-4af7-be18-7f0f013a4007 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:56.523963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a1920bd-7241-4af7-be18-7f0f013a4007 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:56.524587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a1920bd-7241-4af7-be18-7f0f013a4007 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:56.530598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a1920bd-7241-4af7-be18-7f0f013a4007 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:56.636861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3a1920bd-7241-4af7-be18-7f0f013a4007 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:56.647057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3a1920bd-7241-4af7-be18-7f0f013a4007 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:56.650164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3a1920bd-7241-4af7-be18-7f0f013a4007 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:56.656644 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3a1920bd-7241-4af7-be18-7f0f013a4007 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.156705 Oct 29 01:07:56.658506 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 495/1007] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:56 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:56.758120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f08f74e5-a813-453f-9653-1915b4566417 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:56.773655 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f08f74e5-a813-453f-9653-1915b4566417 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1503 microversion: 2.1 time: 0.359319 Oct 29 01:07:56.779164 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 513/1008] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:56 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1503 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:57.232984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5554e441-fffc-4812-b9f1-018a593a4b00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:57.233796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5554e441-fffc-4812-b9f1-018a593a4b00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:57.240382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5554e441-fffc-4812-b9f1-018a593a4b00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:57.241096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5554e441-fffc-4812-b9f1-018a593a4b00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:57.241885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5554e441-fffc-4812-b9f1-018a593a4b00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:57.242766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5554e441-fffc-4812-b9f1-018a593a4b00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:57.243404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5554e441-fffc-4812-b9f1-018a593a4b00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:57.243991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5554e441-fffc-4812-b9f1-018a593a4b00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:57.538691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d6b2b388-668b-437a-9112-06a8155141b9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:57.540807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d6b2b388-668b-437a-9112-06a8155141b9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:57.543432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5554e441-fffc-4812-b9f1-018a593a4b00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:57.557588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b2b388-668b-437a-9112-06a8155141b9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:57.558006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b2b388-668b-437a-9112-06a8155141b9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:57.558444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b2b388-668b-437a-9112-06a8155141b9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:57.559296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b2b388-668b-437a-9112-06a8155141b9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:57.559597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b2b388-668b-437a-9112-06a8155141b9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:57.560026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b2b388-668b-437a-9112-06a8155141b9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:57.569904 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5554e441-fffc-4812-b9f1-018a593a4b00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.340927 Oct 29 01:07:57.572398 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 496/1009] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:57 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:57.605333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b2b388-668b-437a-9112-06a8155141b9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:57.606189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b2b388-668b-437a-9112-06a8155141b9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:57.606963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b2b388-668b-437a-9112-06a8155141b9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:57.607639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-d6b2b388-668b-437a-9112-06a8155141b9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lazy-loading 'fault' on Instance uuid e18b6f45-f426-4003-9d72-fa419f9190d9 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:07:57.664234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d6b2b388-668b-437a-9112-06a8155141b9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:57.672624 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d6b2b388-668b-437a-9112-06a8155141b9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9" status: 200 len: 1306 microversion: 2.1 time: 0.145230 Oct 29 01:07:57.674022 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 514/1010] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:57 2022] GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 => generated 1306 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:57.687687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e44832ef-06ec-4a33-8896-5a0139bcc5ff tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:57.687687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e44832ef-06ec-4a33-8896-5a0139bcc5ff tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:57.695358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e44832ef-06ec-4a33-8896-5a0139bcc5ff tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:57.695936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e44832ef-06ec-4a33-8896-5a0139bcc5ff tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:57.696445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e44832ef-06ec-4a33-8896-5a0139bcc5ff tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:57.697259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e44832ef-06ec-4a33-8896-5a0139bcc5ff tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:57.697804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e44832ef-06ec-4a33-8896-5a0139bcc5ff tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:57.699093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e44832ef-06ec-4a33-8896-5a0139bcc5ff tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:57.778962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e44832ef-06ec-4a33-8896-5a0139bcc5ff tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:57.789323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e44832ef-06ec-4a33-8896-5a0139bcc5ff tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:57.796029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e44832ef-06ec-4a33-8896-5a0139bcc5ff tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:57.805588 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e44832ef-06ec-4a33-8896-5a0139bcc5ff tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.122416 Oct 29 01:07:57.807363 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 497/1011] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:57 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:07:57.809742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5df6dd03-131e-46fa-89dd-dc10f333a320 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:57.809742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5df6dd03-131e-46fa-89dd-dc10f333a320 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:57.818635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df6dd03-131e-46fa-89dd-dc10f333a320 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:57.819477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df6dd03-131e-46fa-89dd-dc10f333a320 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:57.821589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df6dd03-131e-46fa-89dd-dc10f333a320 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:57.822323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df6dd03-131e-46fa-89dd-dc10f333a320 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:57.822962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df6dd03-131e-46fa-89dd-dc10f333a320 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:57.823402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df6dd03-131e-46fa-89dd-dc10f333a320 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:58.057668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5df6dd03-131e-46fa-89dd-dc10f333a320 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:58.081681 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5df6dd03-131e-46fa-89dd-dc10f333a320 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1503 microversion: 2.1 time: 0.275925 Oct 29 01:07:58.082593 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 515/1012] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:57 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1503 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:07:58.597038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-177473e9-42cc-40ca-b33a-5ad02cc73c79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:58.597705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-177473e9-42cc-40ca-b33a-5ad02cc73c79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:58.608872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-177473e9-42cc-40ca-b33a-5ad02cc73c79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:58.609435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-177473e9-42cc-40ca-b33a-5ad02cc73c79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:58.610018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-177473e9-42cc-40ca-b33a-5ad02cc73c79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:58.610643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-177473e9-42cc-40ca-b33a-5ad02cc73c79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:58.611787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-177473e9-42cc-40ca-b33a-5ad02cc73c79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:58.612060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-177473e9-42cc-40ca-b33a-5ad02cc73c79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:58.700162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1b30b152-54fe-4e2f-aff7-c086910f4063 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:58.700940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1b30b152-54fe-4e2f-aff7-c086910f4063 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e18b6f45-f426-4003-9d72-fa419f9190d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:58.708655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b30b152-54fe-4e2f-aff7-c086910f4063 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:58.709146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b30b152-54fe-4e2f-aff7-c086910f4063 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:58.711075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b30b152-54fe-4e2f-aff7-c086910f4063 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:58.711075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b30b152-54fe-4e2f-aff7-c086910f4063 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:58.711075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b30b152-54fe-4e2f-aff7-c086910f4063 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:58.711325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b30b152-54fe-4e2f-aff7-c086910f4063 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:58.726837 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-1b30b152-54fe-4e2f-aff7-c086910f4063 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] HTTP exception thrown: Instance e18b6f45-f426-4003-9d72-fa419f9190d9 could not be found. Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1b30b152-54fe-4e2f-aff7-c086910f4063 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Request method failure captured: Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 HTTP/1.1 Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwhYjb8T-pefU3e0LRdpcRsaJPFyVw-4dAPNLJHoKRnbD15rG4FUGsSdMiljCoab17YXaJvro1O3NyzEhUDOnHEbevicmLzbOFjk6aedYSm2jKWp75WAaVb6ch8kcgB3XOgcaZPAYGlfDI7vgo-pubvBe6iYlNiBQTmtVirNDMcgXg Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: fba91819dd56439daea17217c5d7b9b7 Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:07:58.728737 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:07:58.730271 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fba91819dd56439daea17217c5d7b9b7", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:07:58.730271 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:07:58.730271 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: fba91819dd56439daea17217c5d7b9b7 Oct 29 01:07:58.730271 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:07:58.730271 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersOnMultiNodesTest-1355240400-project Oct 29 01:07:58.730271 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:07:58.730271 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:07:58.730271 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 175bb8f8b330495394cd401223847733 Oct 29 01:07:58.730271 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersOnMultiNodesTest-1355240400-project Oct 29 01:07:58.730271 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:07:58.730271 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance e18b6f45-f426-4003-9d72-fa419f9190d9 could not be found. Oct 29 01:07:58.730271 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'e18b6f45-f426-4003-9d72-fa419f9190d9'} Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18b6f45-f426-4003-9d72-fa419f9190d9 could not be found. Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:07:58.731104 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:07:58.732958 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:07:58.732958 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:07:58.732958 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:07:58.732958 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:07:58.732958 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:07:58.732958 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:07:58.732958 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:07:58.732958 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18b6f45-f426-4003-9d72-fa419f9190d9 could not be found. Oct 29 01:07:58.732958 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:58.732958 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:07:58.732958 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:58.732958 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:07:58.732958 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:07:58.732958 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:07:58.732958 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:07:58.732958 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:07:58.732958 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18b6f45-f426-4003-9d72-fa419f9190d9 could not be found. Oct 29 01:07:58.732958 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:07:58.740908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1b30b152-54fe-4e2f-aff7-c086910f4063 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Returning 404 to user: Instance e18b6f45-f426-4003-9d72-fa419f9190d9 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:07:58.740908 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1b30b152-54fe-4e2f-aff7-c086910f4063 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9" status: 404 len: 111 microversion: 2.1 time: 0.034025 Oct 29 01:07:58.740908 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 516/1013] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:58 2022] GET /compute/v2.1/servers/e18b6f45-f426-4003-9d72-fa419f9190d9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:07:58.742086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-56677b3d-23e5-4abf-bf3a-16865622c6c2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:58.742086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-56677b3d-23e5-4abf-bf3a-16865622c6c2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:58.754491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56677b3d-23e5-4abf-bf3a-16865622c6c2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:58.755497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56677b3d-23e5-4abf-bf3a-16865622c6c2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:58.755497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56677b3d-23e5-4abf-bf3a-16865622c6c2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:58.756095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56677b3d-23e5-4abf-bf3a-16865622c6c2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:58.756736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56677b3d-23e5-4abf-bf3a-16865622c6c2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:58.757037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56677b3d-23e5-4abf-bf3a-16865622c6c2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:58.793577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-56677b3d-23e5-4abf-bf3a-16865622c6c2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:07:58.809740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:59.016508 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-56677b3d-23e5-4abf-bf3a-16865622c6c2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 204 len: 0 microversion: 2.1 time: 0.280342 Oct 29 01:07:59.017190 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 517/1014] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:07:58 2022] DELETE /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:07:59.023431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9598390f-3681-494a-af43-7866c202aa43 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:59.024130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9598390f-3681-494a-af43-7866c202aa43 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:59.030250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9598390f-3681-494a-af43-7866c202aa43 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:59.030775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9598390f-3681-494a-af43-7866c202aa43 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:59.031257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9598390f-3681-494a-af43-7866c202aa43 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:59.031950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9598390f-3681-494a-af43-7866c202aa43 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:59.032399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9598390f-3681-494a-af43-7866c202aa43 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:59.032922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9598390f-3681-494a-af43-7866c202aa43 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:59.072278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-177473e9-42cc-40ca-b33a-5ad02cc73c79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:59.080470 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-177473e9-42cc-40ca-b33a-5ad02cc73c79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.489748 Oct 29 01:07:59.081066 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 498/1015] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:58 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:59.085673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4fda30ae-3858-4938-bf73-220047b19aab tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:59.086278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4fda30ae-3858-4938-bf73-220047b19aab tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:59.093347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fda30ae-3858-4938-bf73-220047b19aab tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:59.093949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fda30ae-3858-4938-bf73-220047b19aab tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:59.094465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fda30ae-3858-4938-bf73-220047b19aab tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:59.095322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fda30ae-3858-4938-bf73-220047b19aab tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:59.095856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fda30ae-3858-4938-bf73-220047b19aab tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:59.096357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fda30ae-3858-4938-bf73-220047b19aab tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:59.136574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9598390f-3681-494a-af43-7866c202aa43 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:59.145449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9598390f-3681-494a-af43-7866c202aa43 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:59.146889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9598390f-3681-494a-af43-7866c202aa43 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:59.151714 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9598390f-3681-494a-af43-7866c202aa43 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.132510 Oct 29 01:07:59.152291 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 518/1016] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:07:59 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:07:59.156830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dd645cd6-c10f-4512-a27f-bc540b2dfb83 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:59.157442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dd645cd6-c10f-4512-a27f-bc540b2dfb83 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:59.164346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd645cd6-c10f-4512-a27f-bc540b2dfb83 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:59.164840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd645cd6-c10f-4512-a27f-bc540b2dfb83 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:59.165390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd645cd6-c10f-4512-a27f-bc540b2dfb83 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:59.166004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd645cd6-c10f-4512-a27f-bc540b2dfb83 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:59.166458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd645cd6-c10f-4512-a27f-bc540b2dfb83 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:59.167018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd645cd6-c10f-4512-a27f-bc540b2dfb83 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:59.194601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dd645cd6-c10f-4512-a27f-bc540b2dfb83 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:07:59.327688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4fda30ae-3858-4938-bf73-220047b19aab tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:59.337365 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4fda30ae-3858-4938-bf73-220047b19aab tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1471 microversion: 2.1 time: 0.255158 Oct 29 01:07:59.338597 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 499/1017] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:59 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:59.357247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-28af614d-5747-425a-8a40-4fa34b26aa6e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:59.360515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-28af614d-5747-425a-8a40-4fa34b26aa6e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:59.367612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28af614d-5747-425a-8a40-4fa34b26aa6e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:59.368705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28af614d-5747-425a-8a40-4fa34b26aa6e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:59.369446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28af614d-5747-425a-8a40-4fa34b26aa6e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:59.370380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28af614d-5747-425a-8a40-4fa34b26aa6e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:59.370993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28af614d-5747-425a-8a40-4fa34b26aa6e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:59.371628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28af614d-5747-425a-8a40-4fa34b26aa6e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:59.503616 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dd645cd6-c10f-4512-a27f-bc540b2dfb83 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "DELETE /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 204 len: 0 microversion: 2.1 time: 0.349936 Oct 29 01:07:59.507639 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 519/1018] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:07:59 2022] DELETE /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:07:59.589496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b7d512f0-9804-411b-be97-579e5ce0039f tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1640495385", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "cf9f4c21-3fd8-48c1-b918-3e30f09ac2e8"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:07:59.598913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:07:59.623814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-28af614d-5747-425a-8a40-4fa34b26aa6e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:59.633043 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-28af614d-5747-425a-8a40-4fa34b26aa6e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1503 microversion: 2.1 time: 0.293155 Oct 29 01:07:59.645229 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 500/1019] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:59 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1503 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:07:59.645229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-81c7ae69-9bc0-49fb-8dc0-a29206a1ef67 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:07:59.645229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-81c7ae69-9bc0-49fb-8dc0-a29206a1ef67 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:07:59.656195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81c7ae69-9bc0-49fb-8dc0-a29206a1ef67 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:59.656195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81c7ae69-9bc0-49fb-8dc0-a29206a1ef67 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:59.656195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81c7ae69-9bc0-49fb-8dc0-a29206a1ef67 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:59.656195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81c7ae69-9bc0-49fb-8dc0-a29206a1ef67 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:07:59.656499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81c7ae69-9bc0-49fb-8dc0-a29206a1ef67 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:07:59.656499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81c7ae69-9bc0-49fb-8dc0-a29206a1ef67 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:07:59.656655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-b7d512f0-9804-411b-be97-579e5ce0039f tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] validate_networks() for [('cf9f4c21-3fd8-48c1-b918-3e30f09ac2e8', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:07:59.872202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-81c7ae69-9bc0-49fb-8dc0-a29206a1ef67 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:07:59.882856 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-81c7ae69-9bc0-49fb-8dc0-a29206a1ef67 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1709 microversion: 2.1 time: 0.247131 Oct 29 01:07:59.883727 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 501/1020] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:07:59 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1709 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:00.104496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-84ab8e9c-b021-42ef-95b3-97c9475c9ec1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:00.105250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-84ab8e9c-b021-42ef-95b3-97c9475c9ec1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:00.108575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:00.115563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b7d512f0-9804-411b-be97-579e5ce0039f tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:08:00.116051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b7d512f0-9804-411b-be97-579e5ce0039f tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:08:00.116443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b7d512f0-9804-411b-be97-579e5ce0039f tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:08:00.116856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b7d512f0-9804-411b-be97-579e5ce0039f tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:08:00.117322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b7d512f0-9804-411b-be97-579e5ce0039f tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:08:00.120993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84ab8e9c-b021-42ef-95b3-97c9475c9ec1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:00.121530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84ab8e9c-b021-42ef-95b3-97c9475c9ec1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:00.122006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84ab8e9c-b021-42ef-95b3-97c9475c9ec1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:00.122729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84ab8e9c-b021-42ef-95b3-97c9475c9ec1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:00.123189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84ab8e9c-b021-42ef-95b3-97c9475c9ec1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:00.123614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84ab8e9c-b021-42ef-95b3-97c9475c9ec1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:00.137693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7d512f0-9804-411b-be97-579e5ce0039f tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:00.138489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7d512f0-9804-411b-be97-579e5ce0039f tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:00.139144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7d512f0-9804-411b-be97-579e5ce0039f tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:00.141278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7d512f0-9804-411b-be97-579e5ce0039f tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:00.142125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7d512f0-9804-411b-be97-579e5ce0039f tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:00.143231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7d512f0-9804-411b-be97-579e5ce0039f tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:00.165634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b7d512f0-9804-411b-be97-579e5ce0039f tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Getting quotas for project d31f1db58267478bbc9a66679ad49f61. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:08:00.171394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b7d512f0-9804-411b-be97-579e5ce0039f tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Getting quotas for user cf7b8ad142bc41aa90ab0132fbed85fc and project d31f1db58267478bbc9a66679ad49f61. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:08:00.186988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b7d512f0-9804-411b-be97-579e5ce0039f tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:08:00.190448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b7d512f0-9804-411b-be97-579e5ce0039f tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:08:00.274457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-84ab8e9c-b021-42ef-95b3-97c9475c9ec1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:00.282774 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-84ab8e9c-b021-42ef-95b3-97c9475c9ec1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.182628 Oct 29 01:08:00.294599 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 502/1021] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:00 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:00.300429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c8234807-76d7-41f0-afc2-14bf77118412 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:00.301062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c8234807-76d7-41f0-afc2-14bf77118412 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:00.307632 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b7d512f0-9804-411b-be97-579e5ce0039f tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802252 Oct 29 01:08:00.308251 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 520/1022] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:07:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:08:00.320564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8234807-76d7-41f0-afc2-14bf77118412 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:00.321116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8234807-76d7-41f0-afc2-14bf77118412 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:00.321850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8234807-76d7-41f0-afc2-14bf77118412 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:00.322490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c67c9dcf-079c-47f7-b401-98e855a2541a tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:00.322722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8234807-76d7-41f0-afc2-14bf77118412 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:00.323114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c67c9dcf-079c-47f7-b401-98e855a2541a tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:00.323227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8234807-76d7-41f0-afc2-14bf77118412 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:00.323797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8234807-76d7-41f0-afc2-14bf77118412 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:00.397304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c67c9dcf-079c-47f7-b401-98e855a2541a tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:00.409653 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c67c9dcf-079c-47f7-b401-98e855a2541a tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1216 microversion: 2.1 time: 0.090942 Oct 29 01:08:00.421185 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 521/1023] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:00 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1216 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:00.427975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c8234807-76d7-41f0-afc2-14bf77118412 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:00.433065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-79c54e80-97fb-49b7-baa8-9d32d8c9ff0b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:00.433725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-79c54e80-97fb-49b7-baa8-9d32d8c9ff0b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:00.438390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c8234807-76d7-41f0-afc2-14bf77118412 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:00.441279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79c54e80-97fb-49b7-baa8-9d32d8c9ff0b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:00.441772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79c54e80-97fb-49b7-baa8-9d32d8c9ff0b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:00.442196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79c54e80-97fb-49b7-baa8-9d32d8c9ff0b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:00.442374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c8234807-76d7-41f0-afc2-14bf77118412 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:00.443509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79c54e80-97fb-49b7-baa8-9d32d8c9ff0b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:00.443980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79c54e80-97fb-49b7-baa8-9d32d8c9ff0b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:00.444560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79c54e80-97fb-49b7-baa8-9d32d8c9ff0b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:00.448396 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c8234807-76d7-41f0-afc2-14bf77118412 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.152586 Oct 29 01:08:00.450628 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 503/1024] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:00 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:00.633465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-79c54e80-97fb-49b7-baa8-9d32d8c9ff0b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:00.643662 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-79c54e80-97fb-49b7-baa8-9d32d8c9ff0b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1471 microversion: 2.1 time: 0.231923 Oct 29 01:08:00.660543 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 522/1025] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:00 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1471 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:00.663970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-61b309e8-17cf-4fdc-8997-4ea2c8eabe83 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:00.664595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-61b309e8-17cf-4fdc-8997-4ea2c8eabe83 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:00.671283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61b309e8-17cf-4fdc-8997-4ea2c8eabe83 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:00.672681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61b309e8-17cf-4fdc-8997-4ea2c8eabe83 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:00.673876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61b309e8-17cf-4fdc-8997-4ea2c8eabe83 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:00.674878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61b309e8-17cf-4fdc-8997-4ea2c8eabe83 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:00.675350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61b309e8-17cf-4fdc-8997-4ea2c8eabe83 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:00.675784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61b309e8-17cf-4fdc-8997-4ea2c8eabe83 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:00.827932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-61b309e8-17cf-4fdc-8997-4ea2c8eabe83 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:00.832313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:00.836986 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-61b309e8-17cf-4fdc-8997-4ea2c8eabe83 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1503 microversion: 2.1 time: 0.183289 Oct 29 01:08:00.837581 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 504/1026] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:00 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:00.920195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-69620434-4926-4e0b-99d2-41eedc9c2dca tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:00.925287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-69620434-4926-4e0b-99d2-41eedc9c2dca tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:00.932774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69620434-4926-4e0b-99d2-41eedc9c2dca tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:00.933790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69620434-4926-4e0b-99d2-41eedc9c2dca tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:00.934758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69620434-4926-4e0b-99d2-41eedc9c2dca tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:00.935473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69620434-4926-4e0b-99d2-41eedc9c2dca tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:00.936090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69620434-4926-4e0b-99d2-41eedc9c2dca tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:00.936680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69620434-4926-4e0b-99d2-41eedc9c2dca tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:01.100632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-69620434-4926-4e0b-99d2-41eedc9c2dca tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:01.109280 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-69620434-4926-4e0b-99d2-41eedc9c2dca tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1709 microversion: 2.1 time: 0.203245 Oct 29 01:08:01.110341 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 523/1027] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:00 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1709 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:01.310895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e28e8772-b2cc-44d4-877a-fd92bc56858a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:01.311754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e28e8772-b2cc-44d4-877a-fd92bc56858a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:01.324878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e28e8772-b2cc-44d4-877a-fd92bc56858a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:01.324878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e28e8772-b2cc-44d4-877a-fd92bc56858a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:01.324878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e28e8772-b2cc-44d4-877a-fd92bc56858a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:01.324878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e28e8772-b2cc-44d4-877a-fd92bc56858a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:01.325411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e28e8772-b2cc-44d4-877a-fd92bc56858a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:01.325411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e28e8772-b2cc-44d4-877a-fd92bc56858a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:01.436341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f4e27ba-3636-41b9-948d-d46bb0a470a8 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:01.436957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1f4e27ba-3636-41b9-948d-d46bb0a470a8 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:01.512165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e28e8772-b2cc-44d4-877a-fd92bc56858a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:01.522058 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e28e8772-b2cc-44d4-877a-fd92bc56858a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.218847 Oct 29 01:08:01.537186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1f4e27ba-3636-41b9-948d-d46bb0a470a8 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:01.538926 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 505/1028] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:01 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:01.539174 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1f4e27ba-3636-41b9-948d-d46bb0a470a8 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1216 microversion: 2.1 time: 0.107250 Oct 29 01:08:01.549189 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 524/1029] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:01 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1216 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:01.562074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-825b01ea-7e56-4604-aa3a-906772217368 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:01.563433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-825b01ea-7e56-4604-aa3a-906772217368 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:01.570594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-825b01ea-7e56-4604-aa3a-906772217368 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:01.571078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-825b01ea-7e56-4604-aa3a-906772217368 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:01.571681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-825b01ea-7e56-4604-aa3a-906772217368 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:01.572575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-825b01ea-7e56-4604-aa3a-906772217368 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:01.573216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-825b01ea-7e56-4604-aa3a-906772217368 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:01.573853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-825b01ea-7e56-4604-aa3a-906772217368 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:01.648706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-825b01ea-7e56-4604-aa3a-906772217368 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:01.659404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-825b01ea-7e56-4604-aa3a-906772217368 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:01.660968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-825b01ea-7e56-4604-aa3a-906772217368 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:01.666555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f734439c-ba7d-431d-89d2-2fc674680ab5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:01.667127 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-825b01ea-7e56-4604-aa3a-906772217368 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.126778 Oct 29 01:08:01.667570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f734439c-ba7d-431d-89d2-2fc674680ab5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:01.667693 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 506/1030] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:01 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:01.673521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f734439c-ba7d-431d-89d2-2fc674680ab5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:01.674019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f734439c-ba7d-431d-89d2-2fc674680ab5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:01.674459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f734439c-ba7d-431d-89d2-2fc674680ab5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:01.675166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f734439c-ba7d-431d-89d2-2fc674680ab5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:01.675717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f734439c-ba7d-431d-89d2-2fc674680ab5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:01.676149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f734439c-ba7d-431d-89d2-2fc674680ab5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:01.828492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f734439c-ba7d-431d-89d2-2fc674680ab5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:01.840971 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f734439c-ba7d-431d-89d2-2fc674680ab5 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1471 microversion: 2.1 time: 0.178427 Oct 29 01:08:01.841726 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 525/1031] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:01 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:01.862919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-db005fc3-1d1b-4cb8-9487-4d2e615d1d9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:01.863568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-db005fc3-1d1b-4cb8-9487-4d2e615d1d9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:01.874245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db005fc3-1d1b-4cb8-9487-4d2e615d1d9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:01.875113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db005fc3-1d1b-4cb8-9487-4d2e615d1d9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:01.875770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db005fc3-1d1b-4cb8-9487-4d2e615d1d9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:01.877314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db005fc3-1d1b-4cb8-9487-4d2e615d1d9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:01.877854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db005fc3-1d1b-4cb8-9487-4d2e615d1d9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:01.878460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db005fc3-1d1b-4cb8-9487-4d2e615d1d9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:02.027828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-db005fc3-1d1b-4cb8-9487-4d2e615d1d9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:02.038320 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-db005fc3-1d1b-4cb8-9487-4d2e615d1d9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1503 microversion: 2.1 time: 0.178147 Oct 29 01:08:02.038320 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 507/1032] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:01 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:02.136735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5c87cde1-82cc-49de-957e-86e5062c2a22 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:02.137551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5c87cde1-82cc-49de-957e-86e5062c2a22 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:02.145473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c87cde1-82cc-49de-957e-86e5062c2a22 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:02.146025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c87cde1-82cc-49de-957e-86e5062c2a22 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:02.146634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c87cde1-82cc-49de-957e-86e5062c2a22 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:02.147636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c87cde1-82cc-49de-957e-86e5062c2a22 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:02.148092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c87cde1-82cc-49de-957e-86e5062c2a22 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:02.148517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c87cde1-82cc-49de-957e-86e5062c2a22 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:02.310215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5c87cde1-82cc-49de-957e-86e5062c2a22 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:02.322408 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5c87cde1-82cc-49de-957e-86e5062c2a22 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1709 microversion: 2.1 time: 0.189900 Oct 29 01:08:02.330027 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 526/1033] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:02 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1709 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:02.569812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a2f2e11b-bc5e-4de4-a9f6-931478aee72e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:02.570701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a2f2e11b-bc5e-4de4-a9f6-931478aee72e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:02.571587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-73010f41-359b-49cc-9c37-75c3e67e48ef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:02.572787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-73010f41-359b-49cc-9c37-75c3e67e48ef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:02.578475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a2f2e11b-bc5e-4de4-a9f6-931478aee72e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:02.579863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a2f2e11b-bc5e-4de4-a9f6-931478aee72e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:02.579863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a2f2e11b-bc5e-4de4-a9f6-931478aee72e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:02.580428 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a2f2e11b-bc5e-4de4-a9f6-931478aee72e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:02.580995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a2f2e11b-bc5e-4de4-a9f6-931478aee72e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:02.581517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a2f2e11b-bc5e-4de4-a9f6-931478aee72e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:02.585961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73010f41-359b-49cc-9c37-75c3e67e48ef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:02.586458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73010f41-359b-49cc-9c37-75c3e67e48ef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:02.586895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73010f41-359b-49cc-9c37-75c3e67e48ef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:02.590105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73010f41-359b-49cc-9c37-75c3e67e48ef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:02.590832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73010f41-359b-49cc-9c37-75c3e67e48ef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:02.591476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73010f41-359b-49cc-9c37-75c3e67e48ef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:02.661458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a2f2e11b-bc5e-4de4-a9f6-931478aee72e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:02.670024 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a2f2e11b-bc5e-4de4-a9f6-931478aee72e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1268 microversion: 2.1 time: 0.105975 Oct 29 01:08:02.670601 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 508/1034] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:02 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1268 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:02.696523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-03d32fc0-9c34-4626-aad2-39165c93ce05 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:02.697251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-03d32fc0-9c34-4626-aad2-39165c93ce05 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:02.703438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03d32fc0-9c34-4626-aad2-39165c93ce05 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:02.703985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03d32fc0-9c34-4626-aad2-39165c93ce05 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:02.704492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03d32fc0-9c34-4626-aad2-39165c93ce05 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:02.706490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03d32fc0-9c34-4626-aad2-39165c93ce05 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:02.707015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03d32fc0-9c34-4626-aad2-39165c93ce05 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:02.707505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03d32fc0-9c34-4626-aad2-39165c93ce05 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:02.770262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-73010f41-359b-49cc-9c37-75c3e67e48ef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:02.778858 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-73010f41-359b-49cc-9c37-75c3e67e48ef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.211653 Oct 29 01:08:02.779448 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 527/1035] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:02 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:02.786903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-03d32fc0-9c34-4626-aad2-39165c93ce05 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:02.795593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-03d32fc0-9c34-4626-aad2-39165c93ce05 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:02.797124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-03d32fc0-9c34-4626-aad2-39165c93ce05 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:02.802911 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-03d32fc0-9c34-4626-aad2-39165c93ce05 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.110368 Oct 29 01:08:02.803466 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 509/1036] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:02 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:02.866257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-55c62b0e-acea-429f-94c8-0ef36923d611 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:02.866865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-55c62b0e-acea-429f-94c8-0ef36923d611 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:02.872825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55c62b0e-acea-429f-94c8-0ef36923d611 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:02.873347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55c62b0e-acea-429f-94c8-0ef36923d611 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:02.873779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55c62b0e-acea-429f-94c8-0ef36923d611 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:02.874454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55c62b0e-acea-429f-94c8-0ef36923d611 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:02.874900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55c62b0e-acea-429f-94c8-0ef36923d611 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:02.875314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55c62b0e-acea-429f-94c8-0ef36923d611 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:03.004495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-55c62b0e-acea-429f-94c8-0ef36923d611 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:03.012302 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-55c62b0e-acea-429f-94c8-0ef36923d611 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1471 microversion: 2.1 time: 0.149987 Oct 29 01:08:03.012867 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 528/1037] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:02 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:03.061681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0582c127-f9ce-4bf5-b12c-559cd382aa92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:03.061681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0582c127-f9ce-4bf5-b12c-559cd382aa92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:03.068671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0582c127-f9ce-4bf5-b12c-559cd382aa92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:03.069193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0582c127-f9ce-4bf5-b12c-559cd382aa92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:03.069628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0582c127-f9ce-4bf5-b12c-559cd382aa92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:03.070325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0582c127-f9ce-4bf5-b12c-559cd382aa92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:03.070775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0582c127-f9ce-4bf5-b12c-559cd382aa92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:03.071196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0582c127-f9ce-4bf5-b12c-559cd382aa92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:03.211870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0582c127-f9ce-4bf5-b12c-559cd382aa92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:03.223251 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0582c127-f9ce-4bf5-b12c-559cd382aa92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1493 microversion: 2.1 time: 0.166157 Oct 29 01:08:03.224679 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 510/1038] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:03 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1493 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:03.246011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c836af2b-248b-4de8-8781-280fa3d2f507 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '.version_select at 0x7f9d97a9d700>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:03.249622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c836af2b-248b-4de8-8781-280fa3d2f507 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:03.250106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c836af2b-248b-4de8-8781-280fa3d2f507 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:03.250546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c836af2b-248b-4de8-8781-280fa3d2f507 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:03.260679 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c836af2b-248b-4de8-8781-280fa3d2f507 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1952 microversion: 2.1 time: 0.018288 Oct 29 01:08:03.261272 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 529/1039] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 29 01:08:03 2022] GET /compute/v2.1/os-migrations => generated 1952 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:03.275662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f0ec0b10-0565-42b9-bf3d-c5e36d0b3e29 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:03.276424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f0ec0b10-0565-42b9-bf3d-c5e36d0b3e29 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:03.283199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0ec0b10-0565-42b9-bf3d-c5e36d0b3e29 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:03.284289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0ec0b10-0565-42b9-bf3d-c5e36d0b3e29 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:03.284729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0ec0b10-0565-42b9-bf3d-c5e36d0b3e29 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:03.285447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0ec0b10-0565-42b9-bf3d-c5e36d0b3e29 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:03.285898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0ec0b10-0565-42b9-bf3d-c5e36d0b3e29 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:03.286341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0ec0b10-0565-42b9-bf3d-c5e36d0b3e29 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:03.347614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3b8c0faf-8dd3-4d09-80b5-8ff8393c20d3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:03.348545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3b8c0faf-8dd3-4d09-80b5-8ff8393c20d3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:03.363215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b8c0faf-8dd3-4d09-80b5-8ff8393c20d3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:03.363717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b8c0faf-8dd3-4d09-80b5-8ff8393c20d3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:03.364182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b8c0faf-8dd3-4d09-80b5-8ff8393c20d3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:03.364895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b8c0faf-8dd3-4d09-80b5-8ff8393c20d3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:03.365377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b8c0faf-8dd3-4d09-80b5-8ff8393c20d3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:03.366565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b8c0faf-8dd3-4d09-80b5-8ff8393c20d3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:03.624966 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f0ec0b10-0565-42b9-bf3d-c5e36d0b3e29 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1644 microversion: 2.1 time: 0.352760 Oct 29 01:08:03.625967 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 511/1040] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:03 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1644 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:03.670370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3b8c0faf-8dd3-4d09-80b5-8ff8393c20d3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:03.679410 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3b8c0faf-8dd3-4d09-80b5-8ff8393c20d3 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1709 microversion: 2.1 time: 0.336350 Oct 29 01:08:03.686085 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 530/1041] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:03 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1709 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:03.709562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-70221d41-805b-4b15-ad74-81377b69f863 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:03.710337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-70221d41-805b-4b15-ad74-81377b69f863 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:03.722332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70221d41-805b-4b15-ad74-81377b69f863 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:03.724092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70221d41-805b-4b15-ad74-81377b69f863 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:03.724605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70221d41-805b-4b15-ad74-81377b69f863 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:03.725370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70221d41-805b-4b15-ad74-81377b69f863 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:03.725887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70221d41-805b-4b15-ad74-81377b69f863 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:03.726326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70221d41-805b-4b15-ad74-81377b69f863 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:03.807061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-12d96ba6-8bcf-4b7a-bd4f-59ec8dfc6698 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:03.808064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-12d96ba6-8bcf-4b7a-bd4f-59ec8dfc6698 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:03.823892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12d96ba6-8bcf-4b7a-bd4f-59ec8dfc6698 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:03.826580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12d96ba6-8bcf-4b7a-bd4f-59ec8dfc6698 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:03.828687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12d96ba6-8bcf-4b7a-bd4f-59ec8dfc6698 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:03.830315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12d96ba6-8bcf-4b7a-bd4f-59ec8dfc6698 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:03.835344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12d96ba6-8bcf-4b7a-bd4f-59ec8dfc6698 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:03.836538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12d96ba6-8bcf-4b7a-bd4f-59ec8dfc6698 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:03.853197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-70221d41-805b-4b15-ad74-81377b69f863 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:03.858246 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-70221d41-805b-4b15-ad74-81377b69f863 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1286 microversion: 2.1 time: 0.161629 Oct 29 01:08:03.859283 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 512/1042] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:03 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1286 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:03.866116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0121bc45-2b9a-4205-aed1-0582cfba8b6d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:03.867080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0121bc45-2b9a-4205-aed1-0582cfba8b6d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:03.875916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0121bc45-2b9a-4205-aed1-0582cfba8b6d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:03.878050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0121bc45-2b9a-4205-aed1-0582cfba8b6d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:03.879077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0121bc45-2b9a-4205-aed1-0582cfba8b6d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:03.881869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0121bc45-2b9a-4205-aed1-0582cfba8b6d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:03.881869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0121bc45-2b9a-4205-aed1-0582cfba8b6d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:03.881869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0121bc45-2b9a-4205-aed1-0582cfba8b6d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:03.988227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0121bc45-2b9a-4205-aed1-0582cfba8b6d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:03.999854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0121bc45-2b9a-4205-aed1-0582cfba8b6d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:04.002641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0121bc45-2b9a-4205-aed1-0582cfba8b6d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:04.024327 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0121bc45-2b9a-4205-aed1-0582cfba8b6d tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.155577 Oct 29 01:08:04.026476 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 513/1043] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:03 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:04.038710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7ac57976-c69f-41d1-b05a-dfb2035d67e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1950695640", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "aa7f8f73-d2d1-4330-a914-f73cc0db67b6"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:04.076897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-12d96ba6-8bcf-4b7a-bd4f-59ec8dfc6698 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:04.091756 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-12d96ba6-8bcf-4b7a-bd4f-59ec8dfc6698 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.285726 Oct 29 01:08:04.091756 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 531/1044] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:03 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:04.092022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5aaa9949-68ae-4b55-b1ab-032fb2b8b71b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:04.092812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5aaa9949-68ae-4b55-b1ab-032fb2b8b71b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:04.104850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-7ac57976-c69f-41d1-b05a-dfb2035d67e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] validate_networks() for [('aa7f8f73-d2d1-4330-a914-f73cc0db67b6', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:08:04.120160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5aaa9949-68ae-4b55-b1ab-032fb2b8b71b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:04.123803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5aaa9949-68ae-4b55-b1ab-032fb2b8b71b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:04.123803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5aaa9949-68ae-4b55-b1ab-032fb2b8b71b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:04.123803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5aaa9949-68ae-4b55-b1ab-032fb2b8b71b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:04.123803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5aaa9949-68ae-4b55-b1ab-032fb2b8b71b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:04.124207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5aaa9949-68ae-4b55-b1ab-032fb2b8b71b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:04.297369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5aaa9949-68ae-4b55-b1ab-032fb2b8b71b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:04.349567 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5aaa9949-68ae-4b55-b1ab-032fb2b8b71b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1429 microversion: 2.1 time: 0.261475 Oct 29 01:08:04.352953 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 532/1045] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:04 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1429 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:04.367477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-77a57365-5931-4a17-99ea-e7493265af8d req-b690fca1-3636-4591-9d55-42d46a22e400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c770e759-7e36-4f04-b6f9-12435bce6ff6", "name": "network-vif-deleted", "tag": "7d5d77a6-2cec-4f2d-b47a-4fb74c833658"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:04.387657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-77a57365-5931-4a17-99ea-e7493265af8d req-b690fca1-3636-4591-9d55-42d46a22e400 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:04.389503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-77a57365-5931-4a17-99ea-e7493265af8d req-b690fca1-3636-4591-9d55-42d46a22e400 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:04.389988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-77a57365-5931-4a17-99ea-e7493265af8d req-b690fca1-3636-4591-9d55-42d46a22e400 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:04.407449 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-77a57365-5931-4a17-99ea-e7493265af8d req-b690fca1-3636-4591-9d55-42d46a22e400 service nova] Creating event network-vif-deleted:7d5d77a6-2cec-4f2d-b47a-4fb74c833658 for instance c770e759-7e36-4f04-b6f9-12435bce6ff6 on n-h1-862964-3 Oct 29 01:08:04.414630 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-77a57365-5931-4a17-99ea-e7493265af8d req-b690fca1-3636-4591-9d55-42d46a22e400 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060136 Oct 29 01:08:04.421562 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 533/1046] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:04.715337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0126855a-e129-4afe-b19a-14c5aa33f7b5 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:04.716053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0126855a-e129-4afe-b19a-14c5aa33f7b5 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:04.739310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0126855a-e129-4afe-b19a-14c5aa33f7b5 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:04.740233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0126855a-e129-4afe-b19a-14c5aa33f7b5 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:04.741963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0126855a-e129-4afe-b19a-14c5aa33f7b5 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:04.743090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0126855a-e129-4afe-b19a-14c5aa33f7b5 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:04.794036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0126855a-e129-4afe-b19a-14c5aa33f7b5 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:04.797621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0126855a-e129-4afe-b19a-14c5aa33f7b5 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.049s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:04.803868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-7ac57976-c69f-41d1-b05a-dfb2035d67e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:08:04.808496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-7ac57976-c69f-41d1-b05a-dfb2035d67e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:08:04.808496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-7ac57976-c69f-41d1-b05a-dfb2035d67e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:08:04.808496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-7ac57976-c69f-41d1-b05a-dfb2035d67e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:08:04.808496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-7ac57976-c69f-41d1-b05a-dfb2035d67e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:08:04.822205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ac57976-c69f-41d1-b05a-dfb2035d67e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:04.822985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ac57976-c69f-41d1-b05a-dfb2035d67e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:04.823635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ac57976-c69f-41d1-b05a-dfb2035d67e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:04.824581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ac57976-c69f-41d1-b05a-dfb2035d67e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:04.826129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ac57976-c69f-41d1-b05a-dfb2035d67e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:04.826780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ac57976-c69f-41d1-b05a-dfb2035d67e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:04.864003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-7ac57976-c69f-41d1-b05a-dfb2035d67e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Getting quotas for project 6719b662fc734d2797d515778a57296d. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:08:04.875241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-7ac57976-c69f-41d1-b05a-dfb2035d67e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Getting quotas for user da623c3132aa466aa25685aa45fceaf9 and project 6719b662fc734d2797d515778a57296d. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:08:04.894696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7ac57976-c69f-41d1-b05a-dfb2035d67e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:08:04.898784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7ac57976-c69f-41d1-b05a-dfb2035d67e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:08:04.956279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0126855a-e129-4afe-b19a-14c5aa33f7b5 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:04.967728 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0126855a-e129-4afe-b19a-14c5aa33f7b5 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1641 microversion: 2.1 time: 0.256882 Oct 29 01:08:04.975948 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 534/1047] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:04 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1641 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:04.980954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-11be14e8-8ea0-41d3-bae1-b1cb6a280b49 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:04.981835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-11be14e8-8ea0-41d3-bae1-b1cb6a280b49 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:04.989355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11be14e8-8ea0-41d3-bae1-b1cb6a280b49 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:04.990112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11be14e8-8ea0-41d3-bae1-b1cb6a280b49 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:04.990987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11be14e8-8ea0-41d3-bae1-b1cb6a280b49 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:04.991939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11be14e8-8ea0-41d3-bae1-b1cb6a280b49 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:04.992681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11be14e8-8ea0-41d3-bae1-b1cb6a280b49 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:04.993374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11be14e8-8ea0-41d3-bae1-b1cb6a280b49 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:05.012589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:05.102895 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7ac57976-c69f-41d1-b05a-dfb2035d67e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.075053 Oct 29 01:08:05.103552 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 514/1048] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:08:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:08:05.127996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a6986772-3e80-4b86-a144-3ca1cda1b476 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:05.132104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a6986772-3e80-4b86-a144-3ca1cda1b476 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:05.172959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6986772-3e80-4b86-a144-3ca1cda1b476 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:05.178774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6986772-3e80-4b86-a144-3ca1cda1b476 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:05.179768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6986772-3e80-4b86-a144-3ca1cda1b476 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:05.193451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6986772-3e80-4b86-a144-3ca1cda1b476 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:05.194119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6986772-3e80-4b86-a144-3ca1cda1b476 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:05.194577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6986772-3e80-4b86-a144-3ca1cda1b476 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:05.352467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-11be14e8-8ea0-41d3-bae1-b1cb6a280b49 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:05.370975 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-11be14e8-8ea0-41d3-bae1-b1cb6a280b49 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1316 microversion: 2.1 time: 0.388346 Oct 29 01:08:05.385403 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 535/1049] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:04 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1316 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:05.389999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-652bb916-fa30-4cd5-837d-509262110d78 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:05.390649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-652bb916-fa30-4cd5-837d-509262110d78 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:05.411130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-652bb916-fa30-4cd5-837d-509262110d78 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:05.411623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-652bb916-fa30-4cd5-837d-509262110d78 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:05.412059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-652bb916-fa30-4cd5-837d-509262110d78 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:05.413014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-652bb916-fa30-4cd5-837d-509262110d78 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:05.413496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-652bb916-fa30-4cd5-837d-509262110d78 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:05.431967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-652bb916-fa30-4cd5-837d-509262110d78 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:05.460280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a6986772-3e80-4b86-a144-3ca1cda1b476 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:05.500352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a6986772-3e80-4b86-a144-3ca1cda1b476 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:05.507167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a6986772-3e80-4b86-a144-3ca1cda1b476 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:05.545808 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a6986772-3e80-4b86-a144-3ca1cda1b476 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.428623 Oct 29 01:08:05.553610 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 515/1050] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:05 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:05.571827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e5d5b85-702d-43ce-ba8e-b954ae38d1ac tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:05.572645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7e5d5b85-702d-43ce-ba8e-b954ae38d1ac tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:05.680173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7e5d5b85-702d-43ce-ba8e-b954ae38d1ac tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:05.688246 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e5d5b85-702d-43ce-ba8e-b954ae38d1ac tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1211 microversion: 2.1 time: 0.133183 Oct 29 01:08:05.692459 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 516/1051] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:05 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1211 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:05.700457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0ebce602-701e-49e4-a23f-a46aa4a8cd02 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:05.701069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0ebce602-701e-49e4-a23f-a46aa4a8cd02 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:05.712911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ebce602-701e-49e4-a23f-a46aa4a8cd02 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:05.713434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ebce602-701e-49e4-a23f-a46aa4a8cd02 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:05.718420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ebce602-701e-49e4-a23f-a46aa4a8cd02 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:05.719383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ebce602-701e-49e4-a23f-a46aa4a8cd02 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:05.721658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ebce602-701e-49e4-a23f-a46aa4a8cd02 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:05.721658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ebce602-701e-49e4-a23f-a46aa4a8cd02 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:05.739686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-652bb916-fa30-4cd5-837d-509262110d78 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:05.754527 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-652bb916-fa30-4cd5-837d-509262110d78 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.379008 Oct 29 01:08:05.755132 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 536/1052] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:05 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:05.775747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-db5058aa-6056-427b-89dc-da91c6644072 req-479f363a-4440-4f40-afea-3ef9396e7307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c528e3-4bf5-4d61-aaa8-581168f42c7b", "name": "network-vif-deleted", "tag": "a52a9942-a3d5-4dcb-a096-9f922211cccc"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:05.796610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-db5058aa-6056-427b-89dc-da91c6644072 req-479f363a-4440-4f40-afea-3ef9396e7307 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:05.797600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-db5058aa-6056-427b-89dc-da91c6644072 req-479f363a-4440-4f40-afea-3ef9396e7307 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:05.806184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-db5058aa-6056-427b-89dc-da91c6644072 req-479f363a-4440-4f40-afea-3ef9396e7307 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:05.820369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ebce602-701e-49e4-a23f-a46aa4a8cd02 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:05.820870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ebce602-701e-49e4-a23f-a46aa4a8cd02 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:05.821276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ebce602-701e-49e4-a23f-a46aa4a8cd02 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:05.823552 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-db5058aa-6056-427b-89dc-da91c6644072 req-479f363a-4440-4f40-afea-3ef9396e7307 service nova] Creating event network-vif-deleted:a52a9942-a3d5-4dcb-a096-9f922211cccc for instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b on n-h1-862964-3 Oct 29 01:08:05.824209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-0ebce602-701e-49e4-a23f-a46aa4a8cd02 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lazy-loading 'fault' on Instance uuid c770e759-7e36-4f04-b6f9-12435bce6ff6 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:05.836371 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-db5058aa-6056-427b-89dc-da91c6644072 req-479f363a-4440-4f40-afea-3ef9396e7307 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064130 Oct 29 01:08:05.854361 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 537/1053] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:05.887900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0ebce602-701e-49e4-a23f-a46aa4a8cd02 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:05.904627 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0ebce602-701e-49e4-a23f-a46aa4a8cd02 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1306 microversion: 2.1 time: 0.211024 Oct 29 01:08:05.905544 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 517/1054] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:05 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1306 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:06.000952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fe4fc16d-8e0d-479d-be04-a1309a3ee862 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:06.002582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fe4fc16d-8e0d-479d-be04-a1309a3ee862 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:06.009101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe4fc16d-8e0d-479d-be04-a1309a3ee862 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:06.009499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe4fc16d-8e0d-479d-be04-a1309a3ee862 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:06.010243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe4fc16d-8e0d-479d-be04-a1309a3ee862 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:06.011112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe4fc16d-8e0d-479d-be04-a1309a3ee862 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:06.014299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe4fc16d-8e0d-479d-be04-a1309a3ee862 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:06.014299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe4fc16d-8e0d-479d-be04-a1309a3ee862 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:06.055493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe4fc16d-8e0d-479d-be04-a1309a3ee862 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:06.056239 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe4fc16d-8e0d-479d-be04-a1309a3ee862 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:06.057000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe4fc16d-8e0d-479d-be04-a1309a3ee862 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:06.057490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-fe4fc16d-8e0d-479d-be04-a1309a3ee862 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lazy-loading 'fault' on Instance uuid 80c528e3-4bf5-4d61-aaa8-581168f42c7b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:06.104887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fe4fc16d-8e0d-479d-be04-a1309a3ee862 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:06.117091 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fe4fc16d-8e0d-479d-be04-a1309a3ee862 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1353 microversion: 2.1 time: 0.120468 Oct 29 01:08:06.118329 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 538/1055] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:05 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:06.399923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a07d846c-e856-4562-ad8f-aa39ee7f0738 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:06.400540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a07d846c-e856-4562-ad8f-aa39ee7f0738 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:06.406644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a07d846c-e856-4562-ad8f-aa39ee7f0738 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:06.409405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a07d846c-e856-4562-ad8f-aa39ee7f0738 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:06.410062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a07d846c-e856-4562-ad8f-aa39ee7f0738 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:06.411046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a07d846c-e856-4562-ad8f-aa39ee7f0738 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:06.411684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a07d846c-e856-4562-ad8f-aa39ee7f0738 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:06.412118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a07d846c-e856-4562-ad8f-aa39ee7f0738 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:06.576877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a2979e9c-c4f9-4618-8306-ea2466f871d0 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:06.577810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a2979e9c-c4f9-4618-8306-ea2466f871d0 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:06.586714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2979e9c-c4f9-4618-8306-ea2466f871d0 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:06.587203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2979e9c-c4f9-4618-8306-ea2466f871d0 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:06.591996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2979e9c-c4f9-4618-8306-ea2466f871d0 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:06.593476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2979e9c-c4f9-4618-8306-ea2466f871d0 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:06.594126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2979e9c-c4f9-4618-8306-ea2466f871d0 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:06.594722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2979e9c-c4f9-4618-8306-ea2466f871d0 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:06.614174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a07d846c-e856-4562-ad8f-aa39ee7f0738 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:06.634073 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a07d846c-e856-4562-ad8f-aa39ee7f0738 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1316 microversion: 2.1 time: 0.236642 Oct 29 01:08:06.638326 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 518/1056] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:06 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:06.717660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a2979e9c-c4f9-4618-8306-ea2466f871d0 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:06.717826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ea5984c3-abe7-4eb4-831f-9a2ce0785257 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:06.717826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ea5984c3-abe7-4eb4-831f-9a2ce0785257 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:06.718735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a2979e9c-c4f9-4618-8306-ea2466f871d0 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:06.721388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a2979e9c-c4f9-4618-8306-ea2466f871d0 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:06.723417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea5984c3-abe7-4eb4-831f-9a2ce0785257 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:06.723963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea5984c3-abe7-4eb4-831f-9a2ce0785257 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:06.724577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea5984c3-abe7-4eb4-831f-9a2ce0785257 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:06.725524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea5984c3-abe7-4eb4-831f-9a2ce0785257 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:06.726281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea5984c3-abe7-4eb4-831f-9a2ce0785257 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:06.726873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea5984c3-abe7-4eb4-831f-9a2ce0785257 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:06.733173 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a2979e9c-c4f9-4618-8306-ea2466f871d0 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.161040 Oct 29 01:08:06.749185 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 539/1057] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:06 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:06.779509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e5b3580a-a781-4c1a-af66-9368bb57a0c0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:06.781364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e5b3580a-a781-4c1a-af66-9368bb57a0c0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:06.788244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5b3580a-a781-4c1a-af66-9368bb57a0c0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:06.788956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5b3580a-a781-4c1a-af66-9368bb57a0c0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:06.789609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5b3580a-a781-4c1a-af66-9368bb57a0c0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:06.790583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5b3580a-a781-4c1a-af66-9368bb57a0c0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:06.791298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5b3580a-a781-4c1a-af66-9368bb57a0c0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:06.791920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5b3580a-a781-4c1a-af66-9368bb57a0c0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:06.873202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ea5984c3-abe7-4eb4-831f-9a2ce0785257 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:06.895475 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ea5984c3-abe7-4eb4-831f-9a2ce0785257 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1215 microversion: 2.1 time: 0.179818 Oct 29 01:08:06.897362 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 519/1058] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:06 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1215 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:06.937015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cb4b2aa4-4b9a-429b-8e72-774e0257c7ea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:06.937692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cb4b2aa4-4b9a-429b-8e72-774e0257c7ea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:06.948212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb4b2aa4-4b9a-429b-8e72-774e0257c7ea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:06.948783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb4b2aa4-4b9a-429b-8e72-774e0257c7ea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:06.949323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb4b2aa4-4b9a-429b-8e72-774e0257c7ea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:06.950500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb4b2aa4-4b9a-429b-8e72-774e0257c7ea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:06.951036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb4b2aa4-4b9a-429b-8e72-774e0257c7ea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:06.951670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb4b2aa4-4b9a-429b-8e72-774e0257c7ea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:06.983966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e5b3580a-a781-4c1a-af66-9368bb57a0c0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:06.995113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb4b2aa4-4b9a-429b-8e72-774e0257c7ea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:06.995770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb4b2aa4-4b9a-429b-8e72-774e0257c7ea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:06.996260 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e5b3580a-a781-4c1a-af66-9368bb57a0c0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.220850 Oct 29 01:08:06.996403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb4b2aa4-4b9a-429b-8e72-774e0257c7ea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:06.997049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-cb4b2aa4-4b9a-429b-8e72-774e0257c7ea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lazy-loading 'fault' on Instance uuid c770e759-7e36-4f04-b6f9-12435bce6ff6 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:06.997822 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 540/1059] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:06 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:07.041692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cb4b2aa4-4b9a-429b-8e72-774e0257c7ea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:07.050500 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cb4b2aa4-4b9a-429b-8e72-774e0257c7ea tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 200 len: 1306 microversion: 2.1 time: 0.123321 Oct 29 01:08:07.051097 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 520/1060] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:06 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 1306 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:07.146445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c3cca960-2aab-47c6-9847-ce35e8378156 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:07.147813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c3cca960-2aab-47c6-9847-ce35e8378156 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:07.155001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3cca960-2aab-47c6-9847-ce35e8378156 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:07.159729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3cca960-2aab-47c6-9847-ce35e8378156 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:07.159729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3cca960-2aab-47c6-9847-ce35e8378156 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:07.159729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3cca960-2aab-47c6-9847-ce35e8378156 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:07.160110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3cca960-2aab-47c6-9847-ce35e8378156 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:07.160110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3cca960-2aab-47c6-9847-ce35e8378156 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:07.191906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3cca960-2aab-47c6-9847-ce35e8378156 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:07.192434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3cca960-2aab-47c6-9847-ce35e8378156 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:07.192875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3cca960-2aab-47c6-9847-ce35e8378156 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:07.193359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-c3cca960-2aab-47c6-9847-ce35e8378156 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lazy-loading 'fault' on Instance uuid 80c528e3-4bf5-4d61-aaa8-581168f42c7b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:07.249072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c3cca960-2aab-47c6-9847-ce35e8378156 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:07.259112 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c3cca960-2aab-47c6-9847-ce35e8378156 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1353 microversion: 2.1 time: 0.118610 Oct 29 01:08:07.264018 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 541/1061] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:07 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:07.661035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cf2bb071-6860-4812-abef-b862715c8bff tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:07.661714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cf2bb071-6860-4812-abef-b862715c8bff tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:07.668431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf2bb071-6860-4812-abef-b862715c8bff tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:07.668911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf2bb071-6860-4812-abef-b862715c8bff tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:07.669451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf2bb071-6860-4812-abef-b862715c8bff tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:07.670136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf2bb071-6860-4812-abef-b862715c8bff tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:07.670585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf2bb071-6860-4812-abef-b862715c8bff tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:07.671041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf2bb071-6860-4812-abef-b862715c8bff tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:07.768736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a30a98bd-d516-4684-bdbf-cbcab993f945 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:07.769370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a30a98bd-d516-4684-bdbf-cbcab993f945 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:07.775797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a30a98bd-d516-4684-bdbf-cbcab993f945 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:07.776289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a30a98bd-d516-4684-bdbf-cbcab993f945 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:07.776711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a30a98bd-d516-4684-bdbf-cbcab993f945 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:07.777423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a30a98bd-d516-4684-bdbf-cbcab993f945 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:07.777883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a30a98bd-d516-4684-bdbf-cbcab993f945 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:07.778297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a30a98bd-d516-4684-bdbf-cbcab993f945 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:07.802686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cf2bb071-6860-4812-abef-b862715c8bff tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:07.811191 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cf2bb071-6860-4812-abef-b862715c8bff tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1316 microversion: 2.1 time: 0.154681 Oct 29 01:08:07.811774 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 521/1062] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:07 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:07.842214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a30a98bd-d516-4684-bdbf-cbcab993f945 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:07.851254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a30a98bd-d516-4684-bdbf-cbcab993f945 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:07.852649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a30a98bd-d516-4684-bdbf-cbcab993f945 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:07.857487 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a30a98bd-d516-4684-bdbf-cbcab993f945 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.093408 Oct 29 01:08:07.858045 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 542/1063] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:07 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:07.885442 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-39ad6bb7-b6e4-4615-9187-4b748275d4f9 req-f55d32c3-5f8f-45bd-ae14-69f1140be49b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90b31213-0f88-43e1-9c55-fcc8606e77b1", "tag": "7d12781f-f45c-4630-9b25-1fe735d2efef"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:07.897465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-39ad6bb7-b6e4-4615-9187-4b748275d4f9 req-f55d32c3-5f8f-45bd-ae14-69f1140be49b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:07.897955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-39ad6bb7-b6e4-4615-9187-4b748275d4f9 req-f55d32c3-5f8f-45bd-ae14-69f1140be49b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:07.898390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-39ad6bb7-b6e4-4615-9187-4b748275d4f9 req-f55d32c3-5f8f-45bd-ae14-69f1140be49b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:07.911176 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-39ad6bb7-b6e4-4615-9187-4b748275d4f9 req-f55d32c3-5f8f-45bd-ae14-69f1140be49b service nova] Creating event network-changed:7d12781f-f45c-4630-9b25-1fe735d2efef for instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 on n-h2-862964-3 Oct 29 01:08:07.916608 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-39ad6bb7-b6e4-4615-9187-4b748275d4f9 req-f55d32c3-5f8f-45bd-ae14-69f1140be49b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034902 Oct 29 01:08:07.917227 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 522/1064] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:07.922882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d1a1e7f8-01d1-4feb-8628-038e0d83a0a4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:07.924242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d1a1e7f8-01d1-4feb-8628-038e0d83a0a4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:07.930161 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1a1e7f8-01d1-4feb-8628-038e0d83a0a4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:07.930714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1a1e7f8-01d1-4feb-8628-038e0d83a0a4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:07.931148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1a1e7f8-01d1-4feb-8628-038e0d83a0a4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:07.931834 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1a1e7f8-01d1-4feb-8628-038e0d83a0a4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:07.932285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1a1e7f8-01d1-4feb-8628-038e0d83a0a4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:07.932707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1a1e7f8-01d1-4feb-8628-038e0d83a0a4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:07.996847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d1a1e7f8-01d1-4feb-8628-038e0d83a0a4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:08.005320 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d1a1e7f8-01d1-4feb-8628-038e0d83a0a4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1207 microversion: 2.1 time: 0.086483 Oct 29 01:08:08.005895 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 543/1065] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:07 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1207 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:08.020761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-42bbf2b1-4b67-4f39-8970-48a204fd5f79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:08.021531 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-42bbf2b1-4b67-4f39-8970-48a204fd5f79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:08.027797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42bbf2b1-4b67-4f39-8970-48a204fd5f79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:08.028282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42bbf2b1-4b67-4f39-8970-48a204fd5f79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:08.028721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42bbf2b1-4b67-4f39-8970-48a204fd5f79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:08.029444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42bbf2b1-4b67-4f39-8970-48a204fd5f79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:08.029905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42bbf2b1-4b67-4f39-8970-48a204fd5f79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:08.030332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42bbf2b1-4b67-4f39-8970-48a204fd5f79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:08.035231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:08.073134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b79a0b81-de3d-47be-a316-7f042f072d2c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:08.073760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b79a0b81-de3d-47be-a316-7f042f072d2c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: c770e759-7e36-4f04-b6f9-12435bce6ff6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:08.083414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b79a0b81-de3d-47be-a316-7f042f072d2c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:08.083997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b79a0b81-de3d-47be-a316-7f042f072d2c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:08.084439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b79a0b81-de3d-47be-a316-7f042f072d2c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:08.085146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b79a0b81-de3d-47be-a316-7f042f072d2c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:08.085630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b79a0b81-de3d-47be-a316-7f042f072d2c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:08.086057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b79a0b81-de3d-47be-a316-7f042f072d2c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:08.101055 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-b79a0b81-de3d-47be-a316-7f042f072d2c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] HTTP exception thrown: Instance c770e759-7e36-4f04-b6f9-12435bce6ff6 could not be found. Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b79a0b81-de3d-47be-a316-7f042f072d2c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Request method failure captured: Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 HTTP/1.1 Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwhYjb8T-pefU3e0LRdpcRsaJPFyVw-4dAPNLJHoKRnbD15rG4FUGsSdMiljCoab17YXaJvro1O3NyzEhUDOnHEbevicmLzbOFjk6aedYSm2jKWp75WAaVb6ch8kcgB3XOgcaZPAYGlfDI7vgo-pubvBe6iYlNiBQTmtVirNDMcgXg Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: fba91819dd56439daea17217c5d7b9b7 Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:08:08.108023 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:08:08.109760 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fba91819dd56439daea17217c5d7b9b7", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:08.109760 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:08:08.109760 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: fba91819dd56439daea17217c5d7b9b7 Oct 29 01:08:08.109760 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:08:08.109760 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersOnMultiNodesTest-1355240400-project Oct 29 01:08:08.109760 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:08:08.109760 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:08:08.109760 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 175bb8f8b330495394cd401223847733 Oct 29 01:08:08.109760 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersOnMultiNodesTest-1355240400-project Oct 29 01:08:08.109760 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:08:08.109760 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance c770e759-7e36-4f04-b6f9-12435bce6ff6 could not be found. Oct 29 01:08:08.109760 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'c770e759-7e36-4f04-b6f9-12435bce6ff6'} Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c770e759-7e36-4f04-b6f9-12435bce6ff6 could not be found. Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:08.110742 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:08.112996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:08.112996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:08:08.112996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:08:08.112996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:08.112996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:08.112996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:08.112996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:08.112996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c770e759-7e36-4f04-b6f9-12435bce6ff6 could not be found. Oct 29 01:08:08.112996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:08.112996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:08.112996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:08.112996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:08.112996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:08.112996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:08.112996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:08.112996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:08.112996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c770e759-7e36-4f04-b6f9-12435bce6ff6 could not be found. Oct 29 01:08:08.112996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:08.114634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b79a0b81-de3d-47be-a316-7f042f072d2c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Returning 404 to user: Instance c770e759-7e36-4f04-b6f9-12435bce6ff6 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:08.114634 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b79a0b81-de3d-47be-a316-7f042f072d2c tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6" status: 404 len: 111 microversion: 2.1 time: 0.035068 Oct 29 01:08:08.114634 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 544/1066] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:08 2022] GET /compute/v2.1/servers/c770e759-7e36-4f04-b6f9-12435bce6ff6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:08:08.114634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d6736b20-b910-449c-954c-162d88af1df2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:08.114634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d6736b20-b910-449c-954c-162d88af1df2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: cc5d115c-8881-4057-8885-cc8358078ca3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:08.119335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6736b20-b910-449c-954c-162d88af1df2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:08.119823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6736b20-b910-449c-954c-162d88af1df2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:08.120264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6736b20-b910-449c-954c-162d88af1df2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:08.121047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6736b20-b910-449c-954c-162d88af1df2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:08.121554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6736b20-b910-449c-954c-162d88af1df2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:08.122219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6736b20-b910-449c-954c-162d88af1df2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:08.150913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d6736b20-b910-449c-954c-162d88af1df2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: cc5d115c-8881-4057-8885-cc8358078ca3] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:08:08.175052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-42bbf2b1-4b67-4f39-8970-48a204fd5f79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:08.183616 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-42bbf2b1-4b67-4f39-8970-48a204fd5f79 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.167460 Oct 29 01:08:08.184570 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 523/1067] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:08 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:08.282410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1ae1ec20-1117-484b-9b97-fa5748ba0e53 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:08.283259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1ae1ec20-1117-484b-9b97-fa5748ba0e53 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:08.289630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ae1ec20-1117-484b-9b97-fa5748ba0e53 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:08.290116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ae1ec20-1117-484b-9b97-fa5748ba0e53 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:08.290555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ae1ec20-1117-484b-9b97-fa5748ba0e53 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:08.291287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ae1ec20-1117-484b-9b97-fa5748ba0e53 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:08.291745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ae1ec20-1117-484b-9b97-fa5748ba0e53 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:08.292167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ae1ec20-1117-484b-9b97-fa5748ba0e53 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:08.324984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ae1ec20-1117-484b-9b97-fa5748ba0e53 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:08.325515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ae1ec20-1117-484b-9b97-fa5748ba0e53 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:08.325950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ae1ec20-1117-484b-9b97-fa5748ba0e53 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:08.326407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-1ae1ec20-1117-484b-9b97-fa5748ba0e53 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lazy-loading 'fault' on Instance uuid 80c528e3-4bf5-4d61-aaa8-581168f42c7b {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:08.377483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1ae1ec20-1117-484b-9b97-fa5748ba0e53 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be9b9e6ac945f48fe7118bc10d4064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ff5b9558944b61804150ad564c0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:08.384753 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1ae1ec20-1117-484b-9b97-fa5748ba0e53 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 200 len: 1353 microversion: 2.1 time: 0.106150 Oct 29 01:08:08.385667 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 524/1068] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:08 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 1353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:08.416183 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d6736b20-b910-449c-954c-162d88af1df2 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cc5d115c-8881-4057-8885-cc8358078ca3" status: 204 len: 0 microversion: 2.1 time: 0.306946 Oct 29 01:08:08.416833 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 545/1069] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:08:08 2022] DELETE /compute/v2.1/servers/cc5d115c-8881-4057-8885-cc8358078ca3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:08:08.426514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-41cda007-b474-4aa3-857d-84e58a872058 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:08.427014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-41cda007-b474-4aa3-857d-84e58a872058 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:08.433221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41cda007-b474-4aa3-857d-84e58a872058 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:08.433715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41cda007-b474-4aa3-857d-84e58a872058 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:08.434158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41cda007-b474-4aa3-857d-84e58a872058 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:08.434860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41cda007-b474-4aa3-857d-84e58a872058 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:08.435320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41cda007-b474-4aa3-857d-84e58a872058 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:08.435740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41cda007-b474-4aa3-857d-84e58a872058 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:08.461070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-41cda007-b474-4aa3-857d-84e58a872058 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:08:08.702411 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-41cda007-b474-4aa3-857d-84e58a872058 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554" status: 204 len: 0 microversion: 2.1 time: 0.280960 Oct 29 01:08:08.702933 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 525/1070] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:08:08 2022] DELETE /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:08:08.711584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c7a6e260-1d49-4b80-8bb5-6aaa788a0283 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:08.712278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c7a6e260-1d49-4b80-8bb5-6aaa788a0283 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: cc5d115c-8881-4057-8885-cc8358078ca3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:08.718382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7a6e260-1d49-4b80-8bb5-6aaa788a0283 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:08.720943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7a6e260-1d49-4b80-8bb5-6aaa788a0283 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:08.720943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7a6e260-1d49-4b80-8bb5-6aaa788a0283 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:08.720943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7a6e260-1d49-4b80-8bb5-6aaa788a0283 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:08.721228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7a6e260-1d49-4b80-8bb5-6aaa788a0283 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:08.721653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7a6e260-1d49-4b80-8bb5-6aaa788a0283 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:08.836662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-661de561-2eaa-4c79-b125-761fe25012f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:08.837660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-661de561-2eaa-4c79-b125-761fe25012f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:08.843959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-661de561-2eaa-4c79-b125-761fe25012f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:08.844563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-661de561-2eaa-4c79-b125-761fe25012f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:08.845116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-661de561-2eaa-4c79-b125-761fe25012f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:08.846433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-661de561-2eaa-4c79-b125-761fe25012f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:08.847064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-661de561-2eaa-4c79-b125-761fe25012f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:08.847704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-661de561-2eaa-4c79-b125-761fe25012f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:08.861949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c7a6e260-1d49-4b80-8bb5-6aaa788a0283 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:08.869927 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c7a6e260-1d49-4b80-8bb5-6aaa788a0283 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/cc5d115c-8881-4057-8885-cc8358078ca3" status: 200 len: 1474 microversion: 2.1 time: 0.162548 Oct 29 01:08:08.870519 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 546/1071] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:08 2022] GET /compute/v2.1/servers/cc5d115c-8881-4057-8885-cc8358078ca3 => generated 1474 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:08.885142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a781bfa3-cc6b-4652-a864-6c6c484f3d80 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:08.885762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a781bfa3-cc6b-4652-a864-6c6c484f3d80 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:08.891951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a781bfa3-cc6b-4652-a864-6c6c484f3d80 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:08.892927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a781bfa3-cc6b-4652-a864-6c6c484f3d80 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:08.893390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a781bfa3-cc6b-4652-a864-6c6c484f3d80 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:08.894089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a781bfa3-cc6b-4652-a864-6c6c484f3d80 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:08.894549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a781bfa3-cc6b-4652-a864-6c6c484f3d80 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:08.894967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a781bfa3-cc6b-4652-a864-6c6c484f3d80 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:08.968569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a781bfa3-cc6b-4652-a864-6c6c484f3d80 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:08.977608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a781bfa3-cc6b-4652-a864-6c6c484f3d80 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:08.979060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a781bfa3-cc6b-4652-a864-6c6c484f3d80 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:08.983928 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a781bfa3-cc6b-4652-a864-6c6c484f3d80 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.102510 Oct 29 01:08:08.984508 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 547/1072] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:08 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:08:09.004101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-661de561-2eaa-4c79-b125-761fe25012f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:09.011762 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-661de561-2eaa-4c79-b125-761fe25012f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1316 microversion: 2.1 time: 0.180035 Oct 29 01:08:09.012321 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 526/1073] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:08 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:09.027617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-64ef1295-0245-43e6-a16b-5008f048cc8d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:09.028224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-64ef1295-0245-43e6-a16b-5008f048cc8d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:09.034802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-64ef1295-0245-43e6-a16b-5008f048cc8d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:09.035284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-64ef1295-0245-43e6-a16b-5008f048cc8d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:09.035718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-64ef1295-0245-43e6-a16b-5008f048cc8d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:09.036406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-64ef1295-0245-43e6-a16b-5008f048cc8d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:09.036859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-64ef1295-0245-43e6-a16b-5008f048cc8d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:09.037319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-64ef1295-0245-43e6-a16b-5008f048cc8d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:09.098298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-64ef1295-0245-43e6-a16b-5008f048cc8d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:09.105918 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-64ef1295-0245-43e6-a16b-5008f048cc8d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1263 microversion: 2.1 time: 0.082067 Oct 29 01:08:09.106719 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 548/1074] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:09 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:09.208713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1e01474a-572c-48cc-88d5-7250067fa0af tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:09.209365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1e01474a-572c-48cc-88d5-7250067fa0af tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:09.215354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1e01474a-572c-48cc-88d5-7250067fa0af tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:09.215833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1e01474a-572c-48cc-88d5-7250067fa0af tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:09.226402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1e01474a-572c-48cc-88d5-7250067fa0af tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:09.226402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1e01474a-572c-48cc-88d5-7250067fa0af tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:09.226402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1e01474a-572c-48cc-88d5-7250067fa0af tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:09.226402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1e01474a-572c-48cc-88d5-7250067fa0af tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:09.362747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1e01474a-572c-48cc-88d5-7250067fa0af tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:09.370527 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1e01474a-572c-48cc-88d5-7250067fa0af tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.166548 Oct 29 01:08:09.371122 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 527/1075] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:09 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:09.407855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f7905a40-807a-42dc-bac4-85d5bb091f66 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:09.408352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f7905a40-807a-42dc-bac4-85d5bb091f66 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:09.414610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7905a40-807a-42dc-bac4-85d5bb091f66 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:09.415091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7905a40-807a-42dc-bac4-85d5bb091f66 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:09.415518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7905a40-807a-42dc-bac4-85d5bb091f66 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:09.416198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7905a40-807a-42dc-bac4-85d5bb091f66 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:09.416651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7905a40-807a-42dc-bac4-85d5bb091f66 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:09.417072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7905a40-807a-42dc-bac4-85d5bb091f66 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:09.430560 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-f7905a40-807a-42dc-bac4-85d5bb091f66 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] HTTP exception thrown: Instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b could not be found. Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f7905a40-807a-42dc-bac4-85d5bb091f66 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Request method failure captured: Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b HTTP/1.1 Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwA6Z_xd_Ekv0UHEWcn5Qf0gulzAli6znbHzNZqjD5gE_uOB45HaBHtLU2vlMTAHe2qRR4OxI7mMvOPDEsyNPCq4llPq436-J2U-TTf8u_AySycgZzQxaOqEHznMtQA-vL7qpdRwyzWSC7I1TBRbg5vlcqoyjTpqmwrdt5rM9LYuk0 Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: a4ff5b9558944b61804150ad564c0d8f Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:08:09.432175 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:08:09.433833 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a4ff5b9558944b61804150ad564c0d8f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:09.433833 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:09.433833 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: a4ff5b9558944b61804150ad564c0d8f Oct 29 01:08:09.433833 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:09.433833 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1064574602-project Oct 29 01:08:09.433833 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:08:09.433833 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:08:09.433833 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: d2be9b9e6ac945f48fe7118bc10d4064 Oct 29 01:08:09.433833 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602-project Oct 29 01:08:09.433833 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:08:09.433833 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b could not be found. Oct 29 01:08:09.433833 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '80c528e3-4bf5-4d61-aaa8-581168f42c7b'} Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b could not be found. Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:09.434819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:09.436349 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:09.436349 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:08:09.436349 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:08:09.436349 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:09.436349 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:09.436349 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:09.436349 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:09.436349 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b could not be found. Oct 29 01:08:09.436349 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:09.436349 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:09.436349 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:09.436349 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:09.436349 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:09.436349 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:09.436349 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:09.436349 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:09.436349 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b could not be found. Oct 29 01:08:09.436349 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:09.437925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f7905a40-807a-42dc-bac4-85d5bb091f66 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Returning 404 to user: Instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:09.437925 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f7905a40-807a-42dc-bac4-85d5bb091f66 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 404 len: 111 microversion: 2.1 time: 0.029670 Oct 29 01:08:09.437925 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 549/1076] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:09 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:09.443057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-80c8b279-642b-4787-be4b-4165b27914ff tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:09.443550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-80c8b279-642b-4787-be4b-4165b27914ff tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:09.449546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80c8b279-642b-4787-be4b-4165b27914ff tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:09.450027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80c8b279-642b-4787-be4b-4165b27914ff tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:09.450461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80c8b279-642b-4787-be4b-4165b27914ff tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:09.451151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80c8b279-642b-4787-be4b-4165b27914ff tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:09.451607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80c8b279-642b-4787-be4b-4165b27914ff tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:09.452029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80c8b279-642b-4787-be4b-4165b27914ff tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:09.465928 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-80c8b279-642b-4787-be4b-4165b27914ff tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] HTTP exception thrown: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-80c8b279-642b-4787-be4b-4165b27914ff tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Request method failure captured: Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f HTTP/1.1 Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHwA6Z_xd_Ekv0UHEWcn5Qf0gulzAli6znbHzNZqjD5gE_uOB45HaBHtLU2vlMTAHe2qRR4OxI7mMvOPDEsyNPCq4llPq436-J2U-TTf8u_AySycgZzQxaOqEHznMtQA-vL7qpdRwyzWSC7I1TBRbg5vlcqoyjTpqmwrdt5rM9LYuk0 Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: a4ff5b9558944b61804150ad564c0d8f Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:08:09.467590 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:08:09.469149 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a4ff5b9558944b61804150ad564c0d8f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:09.469149 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:09.469149 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: a4ff5b9558944b61804150ad564c0d8f Oct 29 01:08:09.469149 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:09.469149 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1064574602-project Oct 29 01:08:09.469149 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:08:09.469149 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:08:09.469149 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: d2be9b9e6ac945f48fe7118bc10d4064 Oct 29 01:08:09.469149 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602-project Oct 29 01:08:09.469149 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:08:09.469149 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:09.469149 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'f061780f-e530-42cd-8c3d-021d7e63a22f'} Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:09.470311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:09.471816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:09.473370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-80c8b279-642b-4787-be4b-4165b27914ff tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Returning 404 to user: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:09.473370 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-80c8b279-642b-4787-be4b-4165b27914ff tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 404 len: 111 microversion: 2.1 time: 0.030282 Oct 29 01:08:09.473370 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 528/1077] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:08:09 2022] DELETE /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:09.477512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c8a6707e-f497-4f88-9488-15b14f2daf72 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:09.478088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c8a6707e-f497-4f88-9488-15b14f2daf72 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:09.484148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8a6707e-f497-4f88-9488-15b14f2daf72 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:09.484637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8a6707e-f497-4f88-9488-15b14f2daf72 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:09.485067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8a6707e-f497-4f88-9488-15b14f2daf72 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:09.485782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8a6707e-f497-4f88-9488-15b14f2daf72 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:09.486243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8a6707e-f497-4f88-9488-15b14f2daf72 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:09.486992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8a6707e-f497-4f88-9488-15b14f2daf72 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:09.504196 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-c8a6707e-f497-4f88-9488-15b14f2daf72 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] HTTP exception thrown: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c8a6707e-f497-4f88-9488-15b14f2daf72 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Request method failure captured: Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f HTTP/1.1 Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwA6Z_xd_Ekv0UHEWcn5Qf0gulzAli6znbHzNZqjD5gE_uOB45HaBHtLU2vlMTAHe2qRR4OxI7mMvOPDEsyNPCq4llPq436-J2U-TTf8u_AySycgZzQxaOqEHznMtQA-vL7qpdRwyzWSC7I1TBRbg5vlcqoyjTpqmwrdt5rM9LYuk0 Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: a4ff5b9558944b61804150ad564c0d8f Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:08:09.505735 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:08:09.507341 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a4ff5b9558944b61804150ad564c0d8f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:09.507341 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:09.507341 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: a4ff5b9558944b61804150ad564c0d8f Oct 29 01:08:09.507341 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:09.507341 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1064574602-project Oct 29 01:08:09.507341 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:08:09.507341 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:08:09.507341 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: d2be9b9e6ac945f48fe7118bc10d4064 Oct 29 01:08:09.507341 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602-project Oct 29 01:08:09.507341 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:08:09.507341 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:09.507341 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'f061780f-e530-42cd-8c3d-021d7e63a22f'} Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:09.508153 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:09.509457 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:09.509457 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:08:09.509457 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:08:09.509457 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:09.509457 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:09.509457 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:09.509457 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:09.509457 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:09.509457 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:09.509457 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:09.509457 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:09.509457 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:09.509457 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:09.509457 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:09.509457 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:09.509457 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:09.509457 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:09.509457 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:09.510582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c8a6707e-f497-4f88-9488-15b14f2daf72 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Returning 404 to user: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:09.510582 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c8a6707e-f497-4f88-9488-15b14f2daf72 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 404 len: 111 microversion: 2.1 time: 0.033462 Oct 29 01:08:09.510582 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 550/1078] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:09 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:09.516323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-181277f7-472f-41d0-b82d-fb049b8c77f1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '.version_select at 0x7f9d97f6c5e0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:09.521492 n-d-862964-3 devstack@n-api.service[121100]: ERROR oslo.messaging._drivers.impl_rabbit [None req-181277f7-472f-41d0-b82d-fb049b8c77f1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [a03a0a8c-79f0-452f-aa5d-ef1a6aac4b6a] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 01:08:09.894885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d48bd6ef-4499-4580-bca4-56a9576ff1ee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:09.895526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d48bd6ef-4499-4580-bca4-56a9576ff1ee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: cc5d115c-8881-4057-8885-cc8358078ca3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:09.902218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d48bd6ef-4499-4580-bca4-56a9576ff1ee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:09.902704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d48bd6ef-4499-4580-bca4-56a9576ff1ee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:09.903136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d48bd6ef-4499-4580-bca4-56a9576ff1ee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:09.903944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d48bd6ef-4499-4580-bca4-56a9576ff1ee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:09.904397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d48bd6ef-4499-4580-bca4-56a9576ff1ee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:09.904818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d48bd6ef-4499-4580-bca4-56a9576ff1ee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:10.035227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d48bd6ef-4499-4580-bca4-56a9576ff1ee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:10.044179 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d48bd6ef-4499-4580-bca4-56a9576ff1ee tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/cc5d115c-8881-4057-8885-cc8358078ca3" status: 200 len: 1474 microversion: 2.1 time: 0.153938 Oct 29 01:08:10.044752 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 551/1079] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:09 2022] GET /compute/v2.1/servers/cc5d115c-8881-4057-8885-cc8358078ca3 => generated 1474 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:10.049352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b54ea3b8-3da1-49eb-9eb4-b0776bbe7e96 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:10.050074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b54ea3b8-3da1-49eb-9eb4-b0776bbe7e96 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:10.056553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b54ea3b8-3da1-49eb-9eb4-b0776bbe7e96 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:10.057045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b54ea3b8-3da1-49eb-9eb4-b0776bbe7e96 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:10.057514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b54ea3b8-3da1-49eb-9eb4-b0776bbe7e96 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:10.058215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b54ea3b8-3da1-49eb-9eb4-b0776bbe7e96 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:10.058676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b54ea3b8-3da1-49eb-9eb4-b0776bbe7e96 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:10.059109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b54ea3b8-3da1-49eb-9eb4-b0776bbe7e96 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:10.075379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:10.125629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b54ea3b8-3da1-49eb-9eb4-b0776bbe7e96 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:10.134882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b54ea3b8-3da1-49eb-9eb4-b0776bbe7e96 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:10.136339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b54ea3b8-3da1-49eb-9eb4-b0776bbe7e96 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:10.141512 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b54ea3b8-3da1-49eb-9eb4-b0776bbe7e96 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.095728 Oct 29 01:08:10.142086 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 552/1080] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:10 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:10.151623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2d9987e4-b4fe-45f0-8641-b0890b06e6f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:10.151623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2d9987e4-b4fe-45f0-8641-b0890b06e6f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:10.151623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:10.154971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d9987e4-b4fe-45f0-8641-b0890b06e6f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:10.155671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d9987e4-b4fe-45f0-8641-b0890b06e6f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:10.156278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d9987e4-b4fe-45f0-8641-b0890b06e6f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:10.157138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d9987e4-b4fe-45f0-8641-b0890b06e6f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:10.157767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d9987e4-b4fe-45f0-8641-b0890b06e6f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:10.158352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d9987e4-b4fe-45f0-8641-b0890b06e6f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:10.164418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:10.324992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2d9987e4-b4fe-45f0-8641-b0890b06e6f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:10.335719 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2d9987e4-b4fe-45f0-8641-b0890b06e6f0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1316 microversion: 2.1 time: 0.192583 Oct 29 01:08:10.336988 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 553/1081] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:10 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:10.342238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e44450c7-b28d-4c58-9159-aeea38d5ecd4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:10.342977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e44450c7-b28d-4c58-9159-aeea38d5ecd4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:10.353953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e44450c7-b28d-4c58-9159-aeea38d5ecd4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:10.355081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e44450c7-b28d-4c58-9159-aeea38d5ecd4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:10.355081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e44450c7-b28d-4c58-9159-aeea38d5ecd4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:10.356151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e44450c7-b28d-4c58-9159-aeea38d5ecd4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:10.356850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e44450c7-b28d-4c58-9159-aeea38d5ecd4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:10.357414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e44450c7-b28d-4c58-9159-aeea38d5ecd4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:10.440948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e44450c7-b28d-4c58-9159-aeea38d5ecd4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:10.450343 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e44450c7-b28d-4c58-9159-aeea38d5ecd4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1271 microversion: 2.1 time: 0.111801 Oct 29 01:08:10.462155 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 554/1082] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:10 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:10.463918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d83803ce-d0fc-4a94-ae45-0886b2ff1dae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:10.464692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d83803ce-d0fc-4a94-ae45-0886b2ff1dae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:10.471486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d83803ce-d0fc-4a94-ae45-0886b2ff1dae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:10.472390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d83803ce-d0fc-4a94-ae45-0886b2ff1dae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:10.472528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d83803ce-d0fc-4a94-ae45-0886b2ff1dae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:10.473131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d83803ce-d0fc-4a94-ae45-0886b2ff1dae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:10.473605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d83803ce-d0fc-4a94-ae45-0886b2ff1dae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:10.474041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d83803ce-d0fc-4a94-ae45-0886b2ff1dae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:10.532375 n-d-862964-3 devstack@n-api.service[121100]: INFO oslo.messaging._drivers.impl_rabbit [None req-181277f7-472f-41d0-b82d-fb049b8c77f1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [a03a0a8c-79f0-452f-aa5d-ef1a6aac4b6a] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 42680. Oct 29 01:08:10.613008 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-181277f7-472f-41d0-b82d-fb049b8c77f1 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1497961946" status: 202 len: 0 microversion: 2.1 time: 1.100019 Oct 29 01:08:10.617250 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 529/1083] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 29 01:08:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1497961946 => generated 0 bytes in 1102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:08:10.688252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d83803ce-d0fc-4a94-ae45-0886b2ff1dae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:10.711833 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d83803ce-d0fc-4a94-ae45-0886b2ff1dae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.251844 Oct 29 01:08:10.722163 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 555/1084] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:10 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:10.790035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-35bb76c4-4cdc-492e-81f9-b68b3d2c77a2 req-347a9920-24d6-4e89-9394-6b2761dfb189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5d115c-8881-4057-8885-cc8358078ca3", "name": "network-vif-deleted", "tag": "16ac71ce-7be1-49ac-9a85-380b1ed3cfd1"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:10.806732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-35bb76c4-4cdc-492e-81f9-b68b3d2c77a2 req-347a9920-24d6-4e89-9394-6b2761dfb189 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:10.807478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-35bb76c4-4cdc-492e-81f9-b68b3d2c77a2 req-347a9920-24d6-4e89-9394-6b2761dfb189 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:10.809219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-35bb76c4-4cdc-492e-81f9-b68b3d2c77a2 req-347a9920-24d6-4e89-9394-6b2761dfb189 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:10.824912 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-35bb76c4-4cdc-492e-81f9-b68b3d2c77a2 req-347a9920-24d6-4e89-9394-6b2761dfb189 service nova] Creating event network-vif-deleted:16ac71ce-7be1-49ac-9a85-380b1ed3cfd1 for instance cc5d115c-8881-4057-8885-cc8358078ca3 on n-h1-862964-3 Oct 29 01:08:10.837144 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-35bb76c4-4cdc-492e-81f9-b68b3d2c77a2 req-347a9920-24d6-4e89-9394-6b2761dfb189 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051394 Oct 29 01:08:10.837941 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 530/1085] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:11.068630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5e2da14b-17e1-4cc2-a40c-3aedbe690882 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:11.069355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5e2da14b-17e1-4cc2-a40c-3aedbe690882 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: cc5d115c-8881-4057-8885-cc8358078ca3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:11.076089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e2da14b-17e1-4cc2-a40c-3aedbe690882 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:11.082007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e2da14b-17e1-4cc2-a40c-3aedbe690882 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:11.082753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e2da14b-17e1-4cc2-a40c-3aedbe690882 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:11.085559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e2da14b-17e1-4cc2-a40c-3aedbe690882 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:11.086123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e2da14b-17e1-4cc2-a40c-3aedbe690882 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:11.087905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e2da14b-17e1-4cc2-a40c-3aedbe690882 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:11.182329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0c585051-870a-4f8c-9cab-de99751387d2 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:11.183179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0c585051-870a-4f8c-9cab-de99751387d2 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:11.194516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c585051-870a-4f8c-9cab-de99751387d2 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:11.195377 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c585051-870a-4f8c-9cab-de99751387d2 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:11.196047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c585051-870a-4f8c-9cab-de99751387d2 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:11.198083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c585051-870a-4f8c-9cab-de99751387d2 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:11.201332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c585051-870a-4f8c-9cab-de99751387d2 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:11.202085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c585051-870a-4f8c-9cab-de99751387d2 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:11.218756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5e2da14b-17e1-4cc2-a40c-3aedbe690882 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:11.235507 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5e2da14b-17e1-4cc2-a40c-3aedbe690882 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/cc5d115c-8881-4057-8885-cc8358078ca3" status: 200 len: 1304 microversion: 2.1 time: 0.170326 Oct 29 01:08:11.235507 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 556/1086] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:11 2022] GET /compute/v2.1/servers/cc5d115c-8881-4057-8885-cc8358078ca3 => generated 1304 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:11.323474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0c585051-870a-4f8c-9cab-de99751387d2 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:11.333392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0c585051-870a-4f8c-9cab-de99751387d2 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:11.334849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0c585051-870a-4f8c-9cab-de99751387d2 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:11.337970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:11.341725 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0c585051-870a-4f8c-9cab-de99751387d2 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.164391 Oct 29 01:08:11.349946 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 531/1087] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:11 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:08:11.360325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-827cc5c4-e2ca-4287-ac27-4d3d61a09972 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:11.361368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-827cc5c4-e2ca-4287-ac27-4d3d61a09972 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:11.380092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-827cc5c4-e2ca-4287-ac27-4d3d61a09972 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:11.380867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-827cc5c4-e2ca-4287-ac27-4d3d61a09972 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:11.381703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-827cc5c4-e2ca-4287-ac27-4d3d61a09972 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:11.382623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-827cc5c4-e2ca-4287-ac27-4d3d61a09972 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:11.383473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-827cc5c4-e2ca-4287-ac27-4d3d61a09972 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:11.384084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-827cc5c4-e2ca-4287-ac27-4d3d61a09972 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:11.478245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7ff07fac-336b-4884-a37a-bb2d01097e3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:11.478920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7ff07fac-336b-4884-a37a-bb2d01097e3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:11.492229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ff07fac-336b-4884-a37a-bb2d01097e3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:11.492828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ff07fac-336b-4884-a37a-bb2d01097e3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:11.494319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ff07fac-336b-4884-a37a-bb2d01097e3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:11.498693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ff07fac-336b-4884-a37a-bb2d01097e3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:11.499616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ff07fac-336b-4884-a37a-bb2d01097e3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:11.500259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ff07fac-336b-4884-a37a-bb2d01097e3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:11.528579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=10 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:11.766734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-827cc5c4-e2ca-4287-ac27-4d3d61a09972 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:11.797395 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-827cc5c4-e2ca-4287-ac27-4d3d61a09972 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1316 microversion: 2.1 time: 0.426782 Oct 29 01:08:11.797395 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 557/1088] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:11 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1316 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:11.797395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-692dae7a-2dfc-48f8-9a2c-6bb16deca5b9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:11.797395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-692dae7a-2dfc-48f8-9a2c-6bb16deca5b9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:11.803111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-692dae7a-2dfc-48f8-9a2c-6bb16deca5b9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:11.803111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-692dae7a-2dfc-48f8-9a2c-6bb16deca5b9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:11.803531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-692dae7a-2dfc-48f8-9a2c-6bb16deca5b9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:11.804440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-692dae7a-2dfc-48f8-9a2c-6bb16deca5b9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:11.806391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-692dae7a-2dfc-48f8-9a2c-6bb16deca5b9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:11.807096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-692dae7a-2dfc-48f8-9a2c-6bb16deca5b9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:11.942927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7ff07fac-336b-4884-a37a-bb2d01097e3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:11.951999 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7ff07fac-336b-4884-a37a-bb2d01097e3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1311 microversion: 2.1 time: 0.481508 Oct 29 01:08:11.952671 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 532/1089] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:11 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1311 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:12.125428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-692dae7a-2dfc-48f8-9a2c-6bb16deca5b9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:12.136667 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-692dae7a-2dfc-48f8-9a2c-6bb16deca5b9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.351061 Oct 29 01:08:12.149364 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 558/1090] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:11 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:12.268224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b8e92927-23b4-4afe-8ef4-afe283389535 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:12.271196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b8e92927-23b4-4afe-8ef4-afe283389535 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: cc5d115c-8881-4057-8885-cc8358078ca3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:12.276703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8e92927-23b4-4afe-8ef4-afe283389535 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:12.277268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8e92927-23b4-4afe-8ef4-afe283389535 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:12.277701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8e92927-23b4-4afe-8ef4-afe283389535 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:12.278402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8e92927-23b4-4afe-8ef4-afe283389535 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:12.278850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8e92927-23b4-4afe-8ef4-afe283389535 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:12.279269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8e92927-23b4-4afe-8ef4-afe283389535 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:12.332607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8e92927-23b4-4afe-8ef4-afe283389535 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:12.333171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8e92927-23b4-4afe-8ef4-afe283389535 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:12.333768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8e92927-23b4-4afe-8ef4-afe283389535 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:12.334240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-b8e92927-23b4-4afe-8ef4-afe283389535 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lazy-loading 'fault' on Instance uuid cc5d115c-8881-4057-8885-cc8358078ca3 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:12.379138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-272408ec-dd41-454e-870c-6641ab847da8 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:12.379887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-272408ec-dd41-454e-870c-6641ab847da8 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:12.386472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-272408ec-dd41-454e-870c-6641ab847da8 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:12.387083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-272408ec-dd41-454e-870c-6641ab847da8 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:12.387963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-272408ec-dd41-454e-870c-6641ab847da8 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:12.388782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-272408ec-dd41-454e-870c-6641ab847da8 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:12.389813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-272408ec-dd41-454e-870c-6641ab847da8 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:12.390591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-272408ec-dd41-454e-870c-6641ab847da8 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:12.394640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b8e92927-23b4-4afe-8ef4-afe283389535 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:12.405257 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b8e92927-23b4-4afe-8ef4-afe283389535 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/cc5d115c-8881-4057-8885-cc8358078ca3" status: 200 len: 1309 microversion: 2.1 time: 0.145270 Oct 29 01:08:12.406858 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 533/1091] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:12 2022] GET /compute/v2.1/servers/cc5d115c-8881-4057-8885-cc8358078ca3 => generated 1309 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:12.525694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-272408ec-dd41-454e-870c-6641ab847da8 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:12.538605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-272408ec-dd41-454e-870c-6641ab847da8 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:12.542728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-272408ec-dd41-454e-870c-6641ab847da8 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:12.549346 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-272408ec-dd41-454e-870c-6641ab847da8 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.174665 Oct 29 01:08:12.553115 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 559/1092] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:12 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:08:12.810484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e0308daa-1ac8-4732-b8fb-708bf2ad0432 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:12.811092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e0308daa-1ac8-4732-b8fb-708bf2ad0432 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:12.819823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0308daa-1ac8-4732-b8fb-708bf2ad0432 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:12.819823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0308daa-1ac8-4732-b8fb-708bf2ad0432 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:12.820084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0308daa-1ac8-4732-b8fb-708bf2ad0432 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:12.820594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0308daa-1ac8-4732-b8fb-708bf2ad0432 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:12.821047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0308daa-1ac8-4732-b8fb-708bf2ad0432 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:12.821485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0308daa-1ac8-4732-b8fb-708bf2ad0432 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:12.847881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-5e7eab38-e80d-4f6e-b7e7-9890135d7652 req-8d83c44a-9e84-455b-b042-ffe7790ae56f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f346c718-28f2-4983-84f1-70909b4505a7", "tag": "dce0d611-7bbc-4151-915f-2f5d25b6d83b"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:12.867307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5e7eab38-e80d-4f6e-b7e7-9890135d7652 req-8d83c44a-9e84-455b-b042-ffe7790ae56f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:12.868191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5e7eab38-e80d-4f6e-b7e7-9890135d7652 req-8d83c44a-9e84-455b-b042-ffe7790ae56f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:12.869934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5e7eab38-e80d-4f6e-b7e7-9890135d7652 req-8d83c44a-9e84-455b-b042-ffe7790ae56f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:12.892046 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-5e7eab38-e80d-4f6e-b7e7-9890135d7652 req-8d83c44a-9e84-455b-b042-ffe7790ae56f service nova] Creating event network-changed:dce0d611-7bbc-4151-915f-2f5d25b6d83b for instance f346c718-28f2-4983-84f1-70909b4505a7 on n-h1-862964-3 Oct 29 01:08:12.899219 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-5e7eab38-e80d-4f6e-b7e7-9890135d7652 req-8d83c44a-9e84-455b-b042-ffe7790ae56f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063619 Oct 29 01:08:12.902589 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 560/1093] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:08:12.911547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-55abba22-6494-43de-ab39-e3f62de3328e tempest-ServersWithSpecificFlavorTestJSON-1281486603 tempest-ServersWithSpecificFlavorTestJSON-1281486603-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:12.996487 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-55abba22-6494-43de-ab39-e3f62de3328e tempest-ServersWithSpecificFlavorTestJSON-1281486603 tempest-ServersWithSpecificFlavorTestJSON-1281486603-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/593901281" status: 202 len: 0 microversion: 2.1 time: 0.092226 Oct 29 01:08:13.000646 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 561/1094] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 29 01:08:12 2022] DELETE /compute/v2.1/flavors/593901281 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:08:13.007145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81224a13-c4c3-4dc1-9452-e919279dec92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:13.007912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-81224a13-c4c3-4dc1-9452-e919279dec92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:13.014943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81224a13-c4c3-4dc1-9452-e919279dec92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:13.015386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81224a13-c4c3-4dc1-9452-e919279dec92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:13.016017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81224a13-c4c3-4dc1-9452-e919279dec92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:13.016887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81224a13-c4c3-4dc1-9452-e919279dec92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:13.017526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81224a13-c4c3-4dc1-9452-e919279dec92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:13.018119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81224a13-c4c3-4dc1-9452-e919279dec92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:13.035599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e0308daa-1ac8-4732-b8fb-708bf2ad0432 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:13.053845 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e0308daa-1ac8-4732-b8fb-708bf2ad0432 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1316 microversion: 2.1 time: 0.247253 Oct 29 01:08:13.054438 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 534/1095] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:12 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:13.069575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-24c3d5ec-ad1c-42a0-a25b-accc7a61f124 tempest-ServersWithSpecificFlavorTestJSON-1281486603 tempest-ServersWithSpecificFlavorTestJSON-1281486603-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:13.092120 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-24c3d5ec-ad1c-42a0-a25b-accc7a61f124 tempest-ServersWithSpecificFlavorTestJSON-1281486603 tempest-ServersWithSpecificFlavorTestJSON-1281486603-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.036337 Oct 29 01:08:13.093085 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 535/1096] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:08:13 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:13.113115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a06fe547-3be4-4129-afc1-ee05bc03f026 tempest-ServersWithSpecificFlavorTestJSON-1281486603 tempest-ServersWithSpecificFlavorTestJSON-1281486603-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:13.199920 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a06fe547-3be4-4129-afc1-ee05bc03f026 tempest-ServersWithSpecificFlavorTestJSON-1281486603 tempest-ServersWithSpecificFlavorTestJSON-1281486603-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/909793781" status: 202 len: 0 microversion: 2.1 time: 0.090959 Oct 29 01:08:13.200878 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 536/1097] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 29 01:08:13 2022] DELETE /compute/v2.1/flavors/909793781 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:08:13.209376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7263938c-20c4-4676-ae9a-ef11de044066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:13.210934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7263938c-20c4-4676-ae9a-ef11de044066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:13.218728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7263938c-20c4-4676-ae9a-ef11de044066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:13.219458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7263938c-20c4-4676-ae9a-ef11de044066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:13.224023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7263938c-20c4-4676-ae9a-ef11de044066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:13.225022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7263938c-20c4-4676-ae9a-ef11de044066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:13.225703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7263938c-20c4-4676-ae9a-ef11de044066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:13.226292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7263938c-20c4-4676-ae9a-ef11de044066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:13.674552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-81224a13-c4c3-4dc1-9452-e919279dec92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:13.684686 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-81224a13-c4c3-4dc1-9452-e919279dec92 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1311 microversion: 2.1 time: 0.682287 Oct 29 01:08:13.703047 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 562/1098] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:13 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1311 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:13.709441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb0a0b08-b1f8-47c2-94f0-d9fddaa355a6 tempest-ServersWithSpecificFlavorTestJSON-1281486603 tempest-ServersWithSpecificFlavorTestJSON-1281486603-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:13.715433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7263938c-20c4-4676-ae9a-ef11de044066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:13.725660 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7263938c-20c4-4676-ae9a-ef11de044066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.520702 Oct 29 01:08:13.726245 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 537/1099] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:13 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:13.732955 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bb0a0b08-b1f8-47c2-94f0-d9fddaa355a6 tempest-ServersWithSpecificFlavorTestJSON-1281486603 tempest-ServersWithSpecificFlavorTestJSON-1281486603-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028313 Oct 29 01:08:13.733300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-90979923-7181-4f16-b910-ef3461f4d217 req-bd40dcc0-1715-48cb-8f8b-3a37b65fede7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1320c383-f883-429f-ac91-5d2209cb6554", "name": "network-vif-deleted", "tag": "9d68c9f6-205b-40b0-842b-72ea38b567a6"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:13.736606 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 563/1100] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:08:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:13.748634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-216c562b-6443-4dd7-b4e5-e19ca84bed2d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:13.755132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-216c562b-6443-4dd7-b4e5-e19ca84bed2d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: cc5d115c-8881-4057-8885-cc8358078ca3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:13.765834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-90979923-7181-4f16-b910-ef3461f4d217 req-bd40dcc0-1715-48cb-8f8b-3a37b65fede7 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:13.766234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-90979923-7181-4f16-b910-ef3461f4d217 req-bd40dcc0-1715-48cb-8f8b-3a37b65fede7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:13.766665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-90979923-7181-4f16-b910-ef3461f4d217 req-bd40dcc0-1715-48cb-8f8b-3a37b65fede7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:13.773813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-216c562b-6443-4dd7-b4e5-e19ca84bed2d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:13.774314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-216c562b-6443-4dd7-b4e5-e19ca84bed2d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:13.774755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-216c562b-6443-4dd7-b4e5-e19ca84bed2d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:13.775466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-216c562b-6443-4dd7-b4e5-e19ca84bed2d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:13.775931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-216c562b-6443-4dd7-b4e5-e19ca84bed2d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:13.776358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-216c562b-6443-4dd7-b4e5-e19ca84bed2d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:13.779466 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-90979923-7181-4f16-b910-ef3461f4d217 req-bd40dcc0-1715-48cb-8f8b-3a37b65fede7 service nova] Creating event network-vif-deleted:9d68c9f6-205b-40b0-842b-72ea38b567a6 for instance 1320c383-f883-429f-ac91-5d2209cb6554 on n-h2-862964-3 Oct 29 01:08:13.786816 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-90979923-7181-4f16-b910-ef3461f4d217 req-bd40dcc0-1715-48cb-8f8b-3a37b65fede7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059085 Oct 29 01:08:13.790012 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 538/1101] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:13.795390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6d99bcd7-080d-47fc-b9a1-730df5393f68 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:13.796510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6d99bcd7-080d-47fc-b9a1-730df5393f68 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:13.796658 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-216c562b-6443-4dd7-b4e5-e19ca84bed2d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] HTTP exception thrown: Instance cc5d115c-8881-4057-8885-cc8358078ca3 could not be found. Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-216c562b-6443-4dd7-b4e5-e19ca84bed2d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Request method failure captured: Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/cc5d115c-8881-4057-8885-cc8358078ca3 HTTP/1.1 Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwhYjb8T-pefU3e0LRdpcRsaJPFyVw-4dAPNLJHoKRnbD15rG4FUGsSdMiljCoab17YXaJvro1O3NyzEhUDOnHEbevicmLzbOFjk6aedYSm2jKWp75WAaVb6ch8kcgB3XOgcaZPAYGlfDI7vgo-pubvBe6iYlNiBQTmtVirNDMcgXg Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: fba91819dd56439daea17217c5d7b9b7 Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:08:13.798939 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:08:13.800385 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fba91819dd56439daea17217c5d7b9b7", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:13.800385 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:08:13.800385 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: fba91819dd56439daea17217c5d7b9b7 Oct 29 01:08:13.800385 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:08:13.800385 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersOnMultiNodesTest-1355240400-project Oct 29 01:08:13.800385 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:08:13.800385 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:08:13.800385 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 175bb8f8b330495394cd401223847733 Oct 29 01:08:13.800385 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersOnMultiNodesTest-1355240400-project Oct 29 01:08:13.800385 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:08:13.800385 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance cc5d115c-8881-4057-8885-cc8358078ca3 could not be found. Oct 29 01:08:13.800385 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'cc5d115c-8881-4057-8885-cc8358078ca3'} Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc5d115c-8881-4057-8885-cc8358078ca3 could not be found. Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:13.801358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:13.803450 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:13.803450 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:08:13.803450 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:08:13.803450 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:13.803450 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:13.803450 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:13.803450 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:13.803450 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc5d115c-8881-4057-8885-cc8358078ca3 could not be found. Oct 29 01:08:13.803450 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:13.803450 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:13.803450 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:13.803450 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:13.803450 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:13.803450 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:13.803450 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:13.803450 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:13.803450 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc5d115c-8881-4057-8885-cc8358078ca3 could not be found. Oct 29 01:08:13.803450 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:13.804801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-216c562b-6443-4dd7-b4e5-e19ca84bed2d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Returning 404 to user: Instance cc5d115c-8881-4057-8885-cc8358078ca3 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:13.804801 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-216c562b-6443-4dd7-b4e5-e19ca84bed2d tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/cc5d115c-8881-4057-8885-cc8358078ca3" status: 404 len: 111 microversion: 2.1 time: 0.062545 Oct 29 01:08:13.804801 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 564/1102] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:13 2022] GET /compute/v2.1/servers/cc5d115c-8881-4057-8885-cc8358078ca3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:13.808259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d99bcd7-080d-47fc-b9a1-730df5393f68 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:13.812985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d99bcd7-080d-47fc-b9a1-730df5393f68 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:13.812985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d99bcd7-080d-47fc-b9a1-730df5393f68 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:13.812985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d99bcd7-080d-47fc-b9a1-730df5393f68 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:13.812985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d99bcd7-080d-47fc-b9a1-730df5393f68 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:13.813419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d99bcd7-080d-47fc-b9a1-730df5393f68 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:13.821020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-673e460a-9018-4e6d-892a-f624235239bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:13.821561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-673e460a-9018-4e6d-892a-f624235239bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:13.827694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-673e460a-9018-4e6d-892a-f624235239bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:13.828121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-673e460a-9018-4e6d-892a-f624235239bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:13.828625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-673e460a-9018-4e6d-892a-f624235239bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:13.829415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-673e460a-9018-4e6d-892a-f624235239bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:13.829923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-673e460a-9018-4e6d-892a-f624235239bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:13.830350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-673e460a-9018-4e6d-892a-f624235239bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:13.848970 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-673e460a-9018-4e6d-892a-f624235239bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] HTTP exception thrown: Instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b could not be found. Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-673e460a-9018-4e6d-892a-f624235239bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Request method failure captured: Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b HTTP/1.1 Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwA6Z_xd_Ekv0UHEWcn5Qf0gulzAli6znbHzNZqjD5gE_uOB45HaBHtLU2vlMTAHe2qRR4OxI7mMvOPDEsyNPCq4llPq436-J2U-TTf8u_AySycgZzQxaOqEHznMtQA-vL7qpdRwyzWSC7I1TBRbg5vlcqoyjTpqmwrdt5rM9LYuk0 Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: a4ff5b9558944b61804150ad564c0d8f Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:08:13.850576 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:08:13.852279 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a4ff5b9558944b61804150ad564c0d8f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:13.852279 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:13.852279 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: a4ff5b9558944b61804150ad564c0d8f Oct 29 01:08:13.852279 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:13.852279 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1064574602-project Oct 29 01:08:13.852279 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:08:13.852279 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:08:13.852279 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: d2be9b9e6ac945f48fe7118bc10d4064 Oct 29 01:08:13.852279 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602-project Oct 29 01:08:13.852279 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:08:13.852279 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b could not be found. Oct 29 01:08:13.852279 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '80c528e3-4bf5-4d61-aaa8-581168f42c7b'} Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b could not be found. Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:13.853049 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b could not be found. Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b could not be found. Oct 29 01:08:13.854461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:13.855756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-673e460a-9018-4e6d-892a-f624235239bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Returning 404 to user: Instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:13.855756 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-673e460a-9018-4e6d-892a-f624235239bc tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "DELETE /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 404 len: 111 microversion: 2.1 time: 0.049800 Oct 29 01:08:13.855756 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 565/1103] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:08:13 2022] DELETE /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:13.857603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-29f470df-ce02-4704-a714-aeddddb3b8dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:13.858232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-29f470df-ce02-4704-a714-aeddddb3b8dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:13.864822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f470df-ce02-4704-a714-aeddddb3b8dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:13.865346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f470df-ce02-4704-a714-aeddddb3b8dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:13.865785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f470df-ce02-4704-a714-aeddddb3b8dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:13.866485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f470df-ce02-4704-a714-aeddddb3b8dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:13.866942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f470df-ce02-4704-a714-aeddddb3b8dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:13.867428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f470df-ce02-4704-a714-aeddddb3b8dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:13.892382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6d99bcd7-080d-47fc-b9a1-730df5393f68 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:13.904044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6d99bcd7-080d-47fc-b9a1-730df5393f68 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:13.906021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6d99bcd7-080d-47fc-b9a1-730df5393f68 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:13.906329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f470df-ce02-4704-a714-aeddddb3b8dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:13.906830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f470df-ce02-4704-a714-aeddddb3b8dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:13.907275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f470df-ce02-4704-a714-aeddddb3b8dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:13.907737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-29f470df-ce02-4704-a714-aeddddb3b8dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lazy-loading 'fault' on Instance uuid 1320c383-f883-429f-ac91-5d2209cb6554 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:13.916929 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6d99bcd7-080d-47fc-b9a1-730df5393f68 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.126683 Oct 29 01:08:13.917536 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 539/1104] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:13 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:13.922548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-44e77c63-1fb7-4aa1-b23c-34e5e75a9d6d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:13.923407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-44e77c63-1fb7-4aa1-b23c-34e5e75a9d6d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: 80c528e3-4bf5-4d61-aaa8-581168f42c7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:13.932866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44e77c63-1fb7-4aa1-b23c-34e5e75a9d6d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:13.934262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44e77c63-1fb7-4aa1-b23c-34e5e75a9d6d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:13.935077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44e77c63-1fb7-4aa1-b23c-34e5e75a9d6d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:13.936400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44e77c63-1fb7-4aa1-b23c-34e5e75a9d6d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:13.937333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44e77c63-1fb7-4aa1-b23c-34e5e75a9d6d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:13.938148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44e77c63-1fb7-4aa1-b23c-34e5e75a9d6d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:13.953789 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-44e77c63-1fb7-4aa1-b23c-34e5e75a9d6d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] HTTP exception thrown: Instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b could not be found. Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-44e77c63-1fb7-4aa1-b23c-34e5e75a9d6d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Request method failure captured: Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b HTTP/1.1 Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHwA6Z_xd_Ekv0UHEWcn5Qf0gulzAli6znbHzNZqjD5gE_uOB45HaBHtLU2vlMTAHe2qRR4OxI7mMvOPDEsyNPCq4llPq436-J2U-TTf8u_AySycgZzQxaOqEHznMtQA-vL7qpdRwyzWSC7I1TBRbg5vlcqoyjTpqmwrdt5rM9LYuk0 Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: a4ff5b9558944b61804150ad564c0d8f Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:08:13.955441 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:08:13.958072 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a4ff5b9558944b61804150ad564c0d8f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:13.958072 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:13.958072 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: a4ff5b9558944b61804150ad564c0d8f Oct 29 01:08:13.958072 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:13.958072 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1064574602-project Oct 29 01:08:13.958072 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:08:13.958072 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:08:13.958072 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: d2be9b9e6ac945f48fe7118bc10d4064 Oct 29 01:08:13.958072 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602-project Oct 29 01:08:13.958072 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:08:13.958072 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b could not be found. Oct 29 01:08:13.958072 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '80c528e3-4bf5-4d61-aaa8-581168f42c7b'} Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b could not be found. Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:13.962111 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:13.963623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:13.963623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:08:13.963623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:08:13.963623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:13.963623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:13.963623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:13.963623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:13.963623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b could not be found. Oct 29 01:08:13.963623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:13.963623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:13.963623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:13.963623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:13.963623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:13.963623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:13.963623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:13.963623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:13.963623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b could not be found. Oct 29 01:08:13.963623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:13.964953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-44e77c63-1fb7-4aa1-b23c-34e5e75a9d6d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Returning 404 to user: Instance 80c528e3-4bf5-4d61-aaa8-581168f42c7b could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:13.964953 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-44e77c63-1fb7-4aa1-b23c-34e5e75a9d6d tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b" status: 404 len: 111 microversion: 2.1 time: 0.038610 Oct 29 01:08:13.964953 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 540/1105] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:13 2022] GET /compute/v2.1/servers/80c528e3-4bf5-4d61-aaa8-581168f42c7b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:13.966014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d45d29c5-7bee-451b-b9b0-74603dd60f05 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:13.966517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d45d29c5-7bee-451b-b9b0-74603dd60f05 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:13.974544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d45d29c5-7bee-451b-b9b0-74603dd60f05 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:13.975021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d45d29c5-7bee-451b-b9b0-74603dd60f05 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:13.975531 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d45d29c5-7bee-451b-b9b0-74603dd60f05 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:13.976136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d45d29c5-7bee-451b-b9b0-74603dd60f05 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:13.976584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d45d29c5-7bee-451b-b9b0-74603dd60f05 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:13.977635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d45d29c5-7bee-451b-b9b0-74603dd60f05 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:13.986409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-29f470df-ce02-4704-a714-aeddddb3b8dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:13.992891 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-d45d29c5-7bee-451b-b9b0-74603dd60f05 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] HTTP exception thrown: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d45d29c5-7bee-451b-b9b0-74603dd60f05 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Request method failure captured: Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f HTTP/1.1 Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHwA6Z_xd_Ekv0UHEWcn5Qf0gulzAli6znbHzNZqjD5gE_uOB45HaBHtLU2vlMTAHe2qRR4OxI7mMvOPDEsyNPCq4llPq436-J2U-TTf8u_AySycgZzQxaOqEHznMtQA-vL7qpdRwyzWSC7I1TBRbg5vlcqoyjTpqmwrdt5rM9LYuk0 Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: a4ff5b9558944b61804150ad564c0d8f Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:08:13.994467 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:08:13.996070 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a4ff5b9558944b61804150ad564c0d8f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:13.996070 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:13.996070 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: a4ff5b9558944b61804150ad564c0d8f Oct 29 01:08:13.996070 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:13.996070 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1064574602-project Oct 29 01:08:13.996070 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:08:13.996070 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:08:13.996070 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: d2be9b9e6ac945f48fe7118bc10d4064 Oct 29 01:08:13.996070 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602-project Oct 29 01:08:13.996070 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:08:13.996070 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:13.996070 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'f061780f-e530-42cd-8c3d-021d7e63a22f'} Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:13.996955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:13.998424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:14.000296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d45d29c5-7bee-451b-b9b0-74603dd60f05 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Returning 404 to user: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:14.000296 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d45d29c5-7bee-451b-b9b0-74603dd60f05 tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 404 len: 111 microversion: 2.1 time: 0.033514 Oct 29 01:08:14.000296 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 541/1106] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:08:13 2022] DELETE /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:14.002249 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-29f470df-ce02-4704-a714-aeddddb3b8dc tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554" status: 200 len: 1309 microversion: 2.1 time: 0.148658 Oct 29 01:08:14.003563 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 566/1107] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:13 2022] GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 => generated 1309 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:14.005338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c715184-4ea8-4855-a60c-b648aa6d8c5e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:14.005950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9c715184-4ea8-4855-a60c-b648aa6d8c5e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] [instance: f061780f-e530-42cd-8c3d-021d7e63a22f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:14.012091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c715184-4ea8-4855-a60c-b648aa6d8c5e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:14.012573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c715184-4ea8-4855-a60c-b648aa6d8c5e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:14.013009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c715184-4ea8-4855-a60c-b648aa6d8c5e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:14.013795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c715184-4ea8-4855-a60c-b648aa6d8c5e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:14.014245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c715184-4ea8-4855-a60c-b648aa6d8c5e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:14.014662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c715184-4ea8-4855-a60c-b648aa6d8c5e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:14.030837 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-9c715184-4ea8-4855-a60c-b648aa6d8c5e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] HTTP exception thrown: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c715184-4ea8-4855-a60c-b648aa6d8c5e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Request method failure captured: Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f HTTP/1.1 Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHwA6Z_xd_Ekv0UHEWcn5Qf0gulzAli6znbHzNZqjD5gE_uOB45HaBHtLU2vlMTAHe2qRR4OxI7mMvOPDEsyNPCq4llPq436-J2U-TTf8u_AySycgZzQxaOqEHznMtQA-vL7qpdRwyzWSC7I1TBRbg5vlcqoyjTpqmwrdt5rM9LYuk0 Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: a4ff5b9558944b61804150ad564c0d8f Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:08:14.032268 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:08:14.034055 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4ff5b9558944b61804150ad564c0d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a4ff5b9558944b61804150ad564c0d8f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:14.034055 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:14.034055 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: a4ff5b9558944b61804150ad564c0d8f Oct 29 01:08:14.034055 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602 Oct 29 01:08:14.034055 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1064574602-project Oct 29 01:08:14.034055 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:08:14.034055 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:08:14.034055 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: d2be9b9e6ac945f48fe7118bc10d4064 Oct 29 01:08:14.034055 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1064574602-project Oct 29 01:08:14.034055 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:08:14.034055 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:14.034055 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'f061780f-e530-42cd-8c3d-021d7e63a22f'} Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:14.035710 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:14.038046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:14.038046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:08:14.038046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:08:14.038046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:14.038046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:14.038046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:14.038046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:14.038046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:14.038046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:14.038046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:14.038046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:14.038046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:14.038046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:14.038046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:14.038046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:14.038046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:14.038046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. Oct 29 01:08:14.038046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:14.039350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c715184-4ea8-4855-a60c-b648aa6d8c5e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] Returning 404 to user: Instance f061780f-e530-42cd-8c3d-021d7e63a22f could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:14.039350 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9c715184-4ea8-4855-a60c-b648aa6d8c5e tempest-ServersWithSpecificFlavorTestJSON-1064574602 tempest-ServersWithSpecificFlavorTestJSON-1064574602-project] 10.222.0.26 "GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f" status: 404 len: 111 microversion: 2.1 time: 0.033364 Oct 29 01:08:14.039350 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 542/1108] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:13 2022] GET /compute/v2.1/servers/f061780f-e530-42cd-8c3d-021d7e63a22f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:08:14.077056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f8ed2625-4845-4b93-b52f-10af29b5bd8a tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:14.077955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f8ed2625-4845-4b93-b52f-10af29b5bd8a tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:14.087224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8ed2625-4845-4b93-b52f-10af29b5bd8a tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:14.094174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8ed2625-4845-4b93-b52f-10af29b5bd8a tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:14.094174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8ed2625-4845-4b93-b52f-10af29b5bd8a tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:14.094174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8ed2625-4845-4b93-b52f-10af29b5bd8a tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:14.094174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8ed2625-4845-4b93-b52f-10af29b5bd8a tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:14.094683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8ed2625-4845-4b93-b52f-10af29b5bd8a tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:14.314039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f8ed2625-4845-4b93-b52f-10af29b5bd8a tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:14.322933 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f8ed2625-4845-4b93-b52f-10af29b5bd8a tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1316 microversion: 2.1 time: 0.249866 Oct 29 01:08:14.324125 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 567/1109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:14 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:14.711502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-32d3b303-8573-4ab3-8848-978a07145ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:14.712142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-32d3b303-8573-4ab3-8848-978a07145ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:14.718932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32d3b303-8573-4ab3-8848-978a07145ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:14.724692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32d3b303-8573-4ab3-8848-978a07145ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:14.724692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32d3b303-8573-4ab3-8848-978a07145ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:14.724692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32d3b303-8573-4ab3-8848-978a07145ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:14.724692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32d3b303-8573-4ab3-8848-978a07145ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:14.725087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32d3b303-8573-4ab3-8848-978a07145ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:14.755205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2a21482e-60e1-453e-b369-af3c6e270c1d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:14.756184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2a21482e-60e1-453e-b369-af3c6e270c1d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:14.764893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2a21482e-60e1-453e-b369-af3c6e270c1d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:14.765448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2a21482e-60e1-453e-b369-af3c6e270c1d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:14.766215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2a21482e-60e1-453e-b369-af3c6e270c1d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:14.767326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2a21482e-60e1-453e-b369-af3c6e270c1d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:14.767862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2a21482e-60e1-453e-b369-af3c6e270c1d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:14.769311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2a21482e-60e1-453e-b369-af3c6e270c1d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:14.840617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:14.921919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-32d3b303-8573-4ab3-8848-978a07145ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:14.929971 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-32d3b303-8573-4ab3-8848-978a07145ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1311 microversion: 2.1 time: 0.223755 Oct 29 01:08:14.931759 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 543/1110] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:14 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1311 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:14.950287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b4b161c4-b33e-49ec-92bf-bd98913956e5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:14.950791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b4b161c4-b33e-49ec-92bf-bd98913956e5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:14.954843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2a21482e-60e1-453e-b369-af3c6e270c1d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:14.957929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4b161c4-b33e-49ec-92bf-bd98913956e5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:14.958413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4b161c4-b33e-49ec-92bf-bd98913956e5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:14.958846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4b161c4-b33e-49ec-92bf-bd98913956e5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:14.959541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4b161c4-b33e-49ec-92bf-bd98913956e5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:14.959990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4b161c4-b33e-49ec-92bf-bd98913956e5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:14.960445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4b161c4-b33e-49ec-92bf-bd98913956e5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:14.961392 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2a21482e-60e1-453e-b369-af3c6e270c1d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.212877 Oct 29 01:08:14.961976 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 568/1111] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:14 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:14.985533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:15.029579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6870db4c-5e9f-48e1-a7f8-e01e2f400b69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:15.030368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6870db4c-5e9f-48e1-a7f8-e01e2f400b69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 1320c383-f883-429f-ac91-5d2209cb6554] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:15.040361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6870db4c-5e9f-48e1-a7f8-e01e2f400b69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:15.041495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6870db4c-5e9f-48e1-a7f8-e01e2f400b69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:15.042609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6870db4c-5e9f-48e1-a7f8-e01e2f400b69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:15.044673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6870db4c-5e9f-48e1-a7f8-e01e2f400b69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:15.045438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6870db4c-5e9f-48e1-a7f8-e01e2f400b69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:15.046178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6870db4c-5e9f-48e1-a7f8-e01e2f400b69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:15.046341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b4b161c4-b33e-49ec-92bf-bd98913956e5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:15.057391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b4b161c4-b33e-49ec-92bf-bd98913956e5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:15.059276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b4b161c4-b33e-49ec-92bf-bd98913956e5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:15.062458 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-6870db4c-5e9f-48e1-a7f8-e01e2f400b69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] HTTP exception thrown: Instance 1320c383-f883-429f-ac91-5d2209cb6554 could not be found. Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6870db4c-5e9f-48e1-a7f8-e01e2f400b69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Request method failure captured: Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 HTTP/1.1 Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwhYjb8T-pefU3e0LRdpcRsaJPFyVw-4dAPNLJHoKRnbD15rG4FUGsSdMiljCoab17YXaJvro1O3NyzEhUDOnHEbevicmLzbOFjk6aedYSm2jKWp75WAaVb6ch8kcgB3XOgcaZPAYGlfDI7vgo-pubvBe6iYlNiBQTmtVirNDMcgXg Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: fba91819dd56439daea17217c5d7b9b7 Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:08:15.064451 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:08:15.066263 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fba91819dd56439daea17217c5d7b9b7", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:15.066263 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:08:15.066263 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: fba91819dd56439daea17217c5d7b9b7 Oct 29 01:08:15.066263 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:08:15.066263 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersOnMultiNodesTest-1355240400-project Oct 29 01:08:15.066263 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:08:15.066263 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:08:15.066263 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 175bb8f8b330495394cd401223847733 Oct 29 01:08:15.066263 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersOnMultiNodesTest-1355240400-project Oct 29 01:08:15.066263 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:08:15.066263 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 1320c383-f883-429f-ac91-5d2209cb6554 could not be found. Oct 29 01:08:15.066263 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '1320c383-f883-429f-ac91-5d2209cb6554'} Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1320c383-f883-429f-ac91-5d2209cb6554 could not be found. Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:15.067292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:15.069434 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:15.069434 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:08:15.069434 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:08:15.069434 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:15.069434 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:15.069434 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:15.069434 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:15.069434 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1320c383-f883-429f-ac91-5d2209cb6554 could not be found. Oct 29 01:08:15.069434 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:15.069434 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:15.069434 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:15.069434 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:15.069434 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:15.069434 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:15.069434 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:15.069434 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:15.069434 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1320c383-f883-429f-ac91-5d2209cb6554 could not be found. Oct 29 01:08:15.069434 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:15.071901 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b4b161c4-b33e-49ec-92bf-bd98913956e5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.118832 Oct 29 01:08:15.073034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6870db4c-5e9f-48e1-a7f8-e01e2f400b69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Returning 404 to user: Instance 1320c383-f883-429f-ac91-5d2209cb6554 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:15.074049 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6870db4c-5e9f-48e1-a7f8-e01e2f400b69 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554" status: 404 len: 111 microversion: 2.1 time: 0.050021 Oct 29 01:08:15.074686 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 569/1112] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:15 2022] GET /compute/v2.1/servers/1320c383-f883-429f-ac91-5d2209cb6554 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:15.081978 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 544/1113] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:14 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:15.088830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-970ac684-3271-4b4e-8b94-b5b78f76b553 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:15.200725 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-970ac684-3271-4b4e-8b94-b5b78f76b553 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/c09db39f-3e03-49b9-abf5-1fbf9e347ec6" status: 204 len: 0 microversion: 2.1 time: 0.121649 Oct 29 01:08:15.203565 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 570/1114] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 29 01:08:15 2022] DELETE /compute/v2.1/os-server-groups/c09db39f-3e03-49b9-abf5-1fbf9e347ec6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:08:15.210592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2da7a462-516b-4cb8-812b-94b3f46befc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:15.211098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2da7a462-516b-4cb8-812b-94b3f46befc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e328b4b4-473e-44af-9260-e3e1df072c09] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:15.217764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2da7a462-516b-4cb8-812b-94b3f46befc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:15.218427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2da7a462-516b-4cb8-812b-94b3f46befc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:15.218934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2da7a462-516b-4cb8-812b-94b3f46befc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:15.219773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2da7a462-516b-4cb8-812b-94b3f46befc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:15.220235 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2da7a462-516b-4cb8-812b-94b3f46befc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:15.220660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2da7a462-516b-4cb8-812b-94b3f46befc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:15.247190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2da7a462-516b-4cb8-812b-94b3f46befc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e328b4b4-473e-44af-9260-e3e1df072c09] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:08:15.346505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-66cc1420-c88a-40ee-9d78-c99b100d41f1 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:15.347307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-66cc1420-c88a-40ee-9d78-c99b100d41f1 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:15.353849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66cc1420-c88a-40ee-9d78-c99b100d41f1 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:15.354339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66cc1420-c88a-40ee-9d78-c99b100d41f1 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:15.354782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66cc1420-c88a-40ee-9d78-c99b100d41f1 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:15.355486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66cc1420-c88a-40ee-9d78-c99b100d41f1 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:15.355948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66cc1420-c88a-40ee-9d78-c99b100d41f1 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:15.356534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66cc1420-c88a-40ee-9d78-c99b100d41f1 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:15.523596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-66cc1420-c88a-40ee-9d78-c99b100d41f1 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:15.536779 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-66cc1420-c88a-40ee-9d78-c99b100d41f1 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1316 microversion: 2.1 time: 0.193829 Oct 29 01:08:15.538684 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 571/1115] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:15 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:15.553771 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2da7a462-516b-4cb8-812b-94b3f46befc0 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09" status: 204 len: 0 microversion: 2.1 time: 0.347606 Oct 29 01:08:15.563739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-481463b2-5051-41ac-8e1a-518a7e25f385 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:15.563739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-481463b2-5051-41ac-8e1a-518a7e25f385 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:15.564071 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 545/1116] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:08:15 2022] DELETE /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:08:15.570180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-481463b2-5051-41ac-8e1a-518a7e25f385 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:15.570774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-481463b2-5051-41ac-8e1a-518a7e25f385 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:15.571150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-481463b2-5051-41ac-8e1a-518a7e25f385 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:15.571865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-481463b2-5051-41ac-8e1a-518a7e25f385 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:15.572373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-481463b2-5051-41ac-8e1a-518a7e25f385 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:15.572799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-481463b2-5051-41ac-8e1a-518a7e25f385 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:15.601259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-481463b2-5051-41ac-8e1a-518a7e25f385 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:08:15.744743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:15.954122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-878031fc-4c0b-42fc-9bc4-13345e3a5fd6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:15.955342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-878031fc-4c0b-42fc-9bc4-13345e3a5fd6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:15.957928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:15.963950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-878031fc-4c0b-42fc-9bc4-13345e3a5fd6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:15.964544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-878031fc-4c0b-42fc-9bc4-13345e3a5fd6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:15.965223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-878031fc-4c0b-42fc-9bc4-13345e3a5fd6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:15.966215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-878031fc-4c0b-42fc-9bc4-13345e3a5fd6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:15.966953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-878031fc-4c0b-42fc-9bc4-13345e3a5fd6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:15.967470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-878031fc-4c0b-42fc-9bc4-13345e3a5fd6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:16.032544 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-481463b2-5051-41ac-8e1a-518a7e25f385 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 204 len: 0 microversion: 2.1 time: 0.472478 Oct 29 01:08:16.041017 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 572/1117] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:08:15 2022] DELETE /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:08:16.064558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-846afabe-ad0e-4612-afb3-82cb045fca05 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:16.070014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-846afabe-ad0e-4612-afb3-82cb045fca05 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:16.084860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-846afabe-ad0e-4612-afb3-82cb045fca05 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:16.085965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-846afabe-ad0e-4612-afb3-82cb045fca05 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:16.086634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-846afabe-ad0e-4612-afb3-82cb045fca05 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:16.087577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-846afabe-ad0e-4612-afb3-82cb045fca05 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:16.088249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-846afabe-ad0e-4612-afb3-82cb045fca05 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:16.089363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-846afabe-ad0e-4612-afb3-82cb045fca05 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:16.138807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-878031fc-4c0b-42fc-9bc4-13345e3a5fd6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:16.149206 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-878031fc-4c0b-42fc-9bc4-13345e3a5fd6 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1311 microversion: 2.1 time: 0.199942 Oct 29 01:08:16.154223 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 546/1118] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:15 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1311 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:16.160716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0ef5dc14-2d94-4312-a98e-d8dfd284c9e9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:16.167940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0ef5dc14-2d94-4312-a98e-d8dfd284c9e9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e328b4b4-473e-44af-9260-e3e1df072c09] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:16.177074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ef5dc14-2d94-4312-a98e-d8dfd284c9e9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:16.177867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ef5dc14-2d94-4312-a98e-d8dfd284c9e9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:16.186758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ef5dc14-2d94-4312-a98e-d8dfd284c9e9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:16.186758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ef5dc14-2d94-4312-a98e-d8dfd284c9e9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:16.186758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ef5dc14-2d94-4312-a98e-d8dfd284c9e9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:16.186758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ef5dc14-2d94-4312-a98e-d8dfd284c9e9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:16.412345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-846afabe-ad0e-4612-afb3-82cb045fca05 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:16.422961 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-846afabe-ad0e-4612-afb3-82cb045fca05 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.380144 Oct 29 01:08:16.427284 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 573/1119] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:16 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:16.432175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dbf4a0a6-dc86-4cfb-b4e9-2c9c71702d40 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:16.432783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dbf4a0a6-dc86-4cfb-b4e9-2c9c71702d40 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:16.451273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbf4a0a6-dc86-4cfb-b4e9-2c9c71702d40 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:16.452001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbf4a0a6-dc86-4cfb-b4e9-2c9c71702d40 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:16.452616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbf4a0a6-dc86-4cfb-b4e9-2c9c71702d40 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:16.453566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbf4a0a6-dc86-4cfb-b4e9-2c9c71702d40 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:16.454025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbf4a0a6-dc86-4cfb-b4e9-2c9c71702d40 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:16.454444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbf4a0a6-dc86-4cfb-b4e9-2c9c71702d40 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:16.538096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0ef5dc14-2d94-4312-a98e-d8dfd284c9e9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:16.549430 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0ef5dc14-2d94-4312-a98e-d8dfd284c9e9 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09" status: 200 len: 1472 microversion: 2.1 time: 0.393931 Oct 29 01:08:16.567357 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 547/1120] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:16 2022] GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09 => generated 1472 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:16.567357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-9e3bb979-2133-4942-b8ad-f06df5549d6a req-4313c6dc-e459-4a05-b923-31f3e56c4d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b31213-0f88-43e1-9c55-fcc8606e77b1", "name": "network-vif-plugged", "status": "completed", "tag": "7d12781f-f45c-4630-9b25-1fe735d2efef"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:16.571076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9e3bb979-2133-4942-b8ad-f06df5549d6a req-4313c6dc-e459-4a05-b923-31f3e56c4d89 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:16.571559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9e3bb979-2133-4942-b8ad-f06df5549d6a req-4313c6dc-e459-4a05-b923-31f3e56c4d89 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:16.572343 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9e3bb979-2133-4942-b8ad-f06df5549d6a req-4313c6dc-e459-4a05-b923-31f3e56c4d89 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:16.579119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dbf4a0a6-dc86-4cfb-b4e9-2c9c71702d40 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:16.585079 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-9e3bb979-2133-4942-b8ad-f06df5549d6a req-4313c6dc-e459-4a05-b923-31f3e56c4d89 service nova] Creating event network-vif-plugged:7d12781f-f45c-4630-9b25-1fe735d2efef for instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 on n-h2-862964-3 Oct 29 01:08:16.589967 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-9e3bb979-2133-4942-b8ad-f06df5549d6a req-4313c6dc-e459-4a05-b923-31f3e56c4d89 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036908 Oct 29 01:08:16.590566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dbf4a0a6-dc86-4cfb-b4e9-2c9c71702d40 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:16.591018 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 548/1121] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:16.592891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dbf4a0a6-dc86-4cfb-b4e9-2c9c71702d40 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:16.596470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-79cb9e43-1d85-417a-924a-bd85cf018ebc tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:16.597901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-79cb9e43-1d85-417a-924a-bd85cf018ebc tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:16.599324 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dbf4a0a6-dc86-4cfb-b4e9-2c9c71702d40 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.170790 Oct 29 01:08:16.600718 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 574/1122] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:16 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:16.604659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79cb9e43-1d85-417a-924a-bd85cf018ebc tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:16.605188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79cb9e43-1d85-417a-924a-bd85cf018ebc tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:16.605609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79cb9e43-1d85-417a-924a-bd85cf018ebc tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:16.606293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79cb9e43-1d85-417a-924a-bd85cf018ebc tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:16.606786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79cb9e43-1d85-417a-924a-bd85cf018ebc tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:16.607194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79cb9e43-1d85-417a-924a-bd85cf018ebc tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:16.752528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-79cb9e43-1d85-417a-924a-bd85cf018ebc tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:16.761233 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-79cb9e43-1d85-417a-924a-bd85cf018ebc tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1316 microversion: 2.1 time: 0.168943 Oct 29 01:08:16.766623 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 549/1123] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:16 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:17.178228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0324e744-43f7-407b-8b44-a116851d8342 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:17.178835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0324e744-43f7-407b-8b44-a116851d8342 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:17.185509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0324e744-43f7-407b-8b44-a116851d8342 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:17.186013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0324e744-43f7-407b-8b44-a116851d8342 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:17.186434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0324e744-43f7-407b-8b44-a116851d8342 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:17.187239 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0324e744-43f7-407b-8b44-a116851d8342 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:17.187700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0324e744-43f7-407b-8b44-a116851d8342 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:17.188123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0324e744-43f7-407b-8b44-a116851d8342 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:17.328135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0324e744-43f7-407b-8b44-a116851d8342 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:17.336439 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0324e744-43f7-407b-8b44-a116851d8342 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1311 microversion: 2.1 time: 0.162635 Oct 29 01:08:17.337017 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 575/1124] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:17 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1311 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:17.450928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b33eb979-0ae8-41fc-906e-f4675c39c959 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:17.451794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b33eb979-0ae8-41fc-906e-f4675c39c959 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:17.459768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b33eb979-0ae8-41fc-906e-f4675c39c959 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:17.460591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b33eb979-0ae8-41fc-906e-f4675c39c959 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:17.461859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b33eb979-0ae8-41fc-906e-f4675c39c959 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:17.462989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b33eb979-0ae8-41fc-906e-f4675c39c959 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:17.463538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b33eb979-0ae8-41fc-906e-f4675c39c959 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:17.464441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b33eb979-0ae8-41fc-906e-f4675c39c959 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:17.575699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b66ed78b-e183-491d-b064-4d6f38f3b681 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:17.576962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b66ed78b-e183-491d-b064-4d6f38f3b681 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e328b4b4-473e-44af-9260-e3e1df072c09] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:17.586728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b66ed78b-e183-491d-b064-4d6f38f3b681 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:17.587457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b66ed78b-e183-491d-b064-4d6f38f3b681 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:17.588370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b66ed78b-e183-491d-b064-4d6f38f3b681 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:17.589664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b66ed78b-e183-491d-b064-4d6f38f3b681 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:17.590128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b66ed78b-e183-491d-b064-4d6f38f3b681 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:17.590557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b66ed78b-e183-491d-b064-4d6f38f3b681 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:17.615654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b33eb979-0ae8-41fc-906e-f4675c39c959 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:17.626545 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b33eb979-0ae8-41fc-906e-f4675c39c959 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.179957 Oct 29 01:08:17.627540 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 550/1125] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:17 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:17.633083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3dceb77e-c85d-4613-a3ec-45cf038cd2f5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:17.633763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3dceb77e-c85d-4613-a3ec-45cf038cd2f5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:17.641886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dceb77e-c85d-4613-a3ec-45cf038cd2f5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:17.641886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dceb77e-c85d-4613-a3ec-45cf038cd2f5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:17.642171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dceb77e-c85d-4613-a3ec-45cf038cd2f5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:17.642678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dceb77e-c85d-4613-a3ec-45cf038cd2f5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:17.643143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dceb77e-c85d-4613-a3ec-45cf038cd2f5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:17.643637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dceb77e-c85d-4613-a3ec-45cf038cd2f5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:17.740847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3dceb77e-c85d-4613-a3ec-45cf038cd2f5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:17.749276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3dceb77e-c85d-4613-a3ec-45cf038cd2f5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:17.750737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3dceb77e-c85d-4613-a3ec-45cf038cd2f5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:17.756023 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3dceb77e-c85d-4613-a3ec-45cf038cd2f5 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.126511 Oct 29 01:08:17.756607 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 551/1126] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:17 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:17.772985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b66ed78b-e183-491d-b064-4d6f38f3b681 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:17.787959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-473e9d40-709d-4b06-b499-2a0b5cb90f03 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:17.788811 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b66ed78b-e183-491d-b064-4d6f38f3b681 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09" status: 200 len: 1472 microversion: 2.1 time: 0.217055 Oct 29 01:08:17.789291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-473e9d40-709d-4b06-b499-2a0b5cb90f03 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:17.790298 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 576/1127] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:17 2022] GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09 => generated 1472 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:17.807739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-473e9d40-709d-4b06-b499-2a0b5cb90f03 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:17.808521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-473e9d40-709d-4b06-b499-2a0b5cb90f03 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:17.810232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-473e9d40-709d-4b06-b499-2a0b5cb90f03 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:17.811973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-473e9d40-709d-4b06-b499-2a0b5cb90f03 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:17.813250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-473e9d40-709d-4b06-b499-2a0b5cb90f03 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:17.814636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-473e9d40-709d-4b06-b499-2a0b5cb90f03 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:17.959676 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-473e9d40-709d-4b06-b499-2a0b5cb90f03 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:17.966001 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-473e9d40-709d-4b06-b499-2a0b5cb90f03 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1316 microversion: 2.1 time: 0.184062 Oct 29 01:08:17.966583 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 552/1128] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:17 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:18.359815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e05e03cd-a8b5-41b9-ab26-51b39cf09f6a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:18.360482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e05e03cd-a8b5-41b9-ab26-51b39cf09f6a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:18.367414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e05e03cd-a8b5-41b9-ab26-51b39cf09f6a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:18.367896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e05e03cd-a8b5-41b9-ab26-51b39cf09f6a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:18.369541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e05e03cd-a8b5-41b9-ab26-51b39cf09f6a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:18.370403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e05e03cd-a8b5-41b9-ab26-51b39cf09f6a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:18.371037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e05e03cd-a8b5-41b9-ab26-51b39cf09f6a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:18.371742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e05e03cd-a8b5-41b9-ab26-51b39cf09f6a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:18.598044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e05e03cd-a8b5-41b9-ab26-51b39cf09f6a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:18.605693 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e05e03cd-a8b5-41b9-ab26-51b39cf09f6a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1311 microversion: 2.1 time: 0.249655 Oct 29 01:08:18.606295 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 577/1129] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:18 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1311 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:18.651962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2cedda29-4d6a-48fe-9b56-d6de6d9bab11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:18.657206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2cedda29-4d6a-48fe-9b56-d6de6d9bab11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:18.659778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cedda29-4d6a-48fe-9b56-d6de6d9bab11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:18.660296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cedda29-4d6a-48fe-9b56-d6de6d9bab11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:18.660810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cedda29-4d6a-48fe-9b56-d6de6d9bab11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:18.661551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cedda29-4d6a-48fe-9b56-d6de6d9bab11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:18.662009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cedda29-4d6a-48fe-9b56-d6de6d9bab11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:18.662435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cedda29-4d6a-48fe-9b56-d6de6d9bab11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:18.785573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-537c1162-a427-4439-ac6c-e296a4d60597 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:18.785573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-537c1162-a427-4439-ac6c-e296a4d60597 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:18.791492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-537c1162-a427-4439-ac6c-e296a4d60597 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:18.791977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-537c1162-a427-4439-ac6c-e296a4d60597 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:18.792414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-537c1162-a427-4439-ac6c-e296a4d60597 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:18.793112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-537c1162-a427-4439-ac6c-e296a4d60597 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:18.793596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-537c1162-a427-4439-ac6c-e296a4d60597 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:18.794021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-537c1162-a427-4439-ac6c-e296a4d60597 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:18.879837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-537c1162-a427-4439-ac6c-e296a4d60597 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:18.888008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-537c1162-a427-4439-ac6c-e296a4d60597 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:18.889514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-537c1162-a427-4439-ac6c-e296a4d60597 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:18.891922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2cedda29-4d6a-48fe-9b56-d6de6d9bab11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:18.895422 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-537c1162-a427-4439-ac6c-e296a4d60597 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.115454 Oct 29 01:08:18.896003 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 578/1130] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:18 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:08:18.900644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-33d76059-d9a9-4c59-b045-410eaa25dffd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:18.901273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-33d76059-d9a9-4c59-b045-410eaa25dffd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e328b4b4-473e-44af-9260-e3e1df072c09] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:18.907117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33d76059-d9a9-4c59-b045-410eaa25dffd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:18.907607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33d76059-d9a9-4c59-b045-410eaa25dffd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:18.908303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33d76059-d9a9-4c59-b045-410eaa25dffd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:18.909174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33d76059-d9a9-4c59-b045-410eaa25dffd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:18.909793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33d76059-d9a9-4c59-b045-410eaa25dffd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:18.910373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33d76059-d9a9-4c59-b045-410eaa25dffd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:18.913692 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2cedda29-4d6a-48fe-9b56-d6de6d9bab11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.265634 Oct 29 01:08:18.914932 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 553/1131] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:18 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:18.991910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4e650205-d012-4c44-853d-82f88433b412 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:18.993452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4e650205-d012-4c44-853d-82f88433b412 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:18.999804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e650205-d012-4c44-853d-82f88433b412 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:19.000278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e650205-d012-4c44-853d-82f88433b412 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:19.001045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e650205-d012-4c44-853d-82f88433b412 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:19.001779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e650205-d012-4c44-853d-82f88433b412 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:19.002395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e650205-d012-4c44-853d-82f88433b412 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:19.003565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e650205-d012-4c44-853d-82f88433b412 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:19.172112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-33d76059-d9a9-4c59-b045-410eaa25dffd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:19.180666 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-33d76059-d9a9-4c59-b045-410eaa25dffd tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09" status: 200 len: 1472 microversion: 2.1 time: 0.283481 Oct 29 01:08:19.181279 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 579/1132] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:18 2022] GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09 => generated 1472 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:19.257137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4e650205-d012-4c44-853d-82f88433b412 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:19.264970 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4e650205-d012-4c44-853d-82f88433b412 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1316 microversion: 2.1 time: 0.277900 Oct 29 01:08:19.265581 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 554/1133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:18 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:19.630598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d1f335a6-4144-4910-92b5-4c010fc1516d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:19.631209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d1f335a6-4144-4910-92b5-4c010fc1516d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:19.642512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1f335a6-4144-4910-92b5-4c010fc1516d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:19.645109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1f335a6-4144-4910-92b5-4c010fc1516d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:19.646597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1f335a6-4144-4910-92b5-4c010fc1516d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:19.649012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1f335a6-4144-4910-92b5-4c010fc1516d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:19.649746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1f335a6-4144-4910-92b5-4c010fc1516d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:19.650831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1f335a6-4144-4910-92b5-4c010fc1516d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:19.917958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d1f335a6-4144-4910-92b5-4c010fc1516d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:19.930590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5bddf843-7bb7-4670-9aa6-4fd65f086255 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:19.940534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5bddf843-7bb7-4670-9aa6-4fd65f086255 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:19.955291 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d1f335a6-4144-4910-92b5-4c010fc1516d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1311 microversion: 2.1 time: 0.325288 Oct 29 01:08:19.972677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bddf843-7bb7-4670-9aa6-4fd65f086255 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:19.976575 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 580/1134] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:19 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1311 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:19.979893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bddf843-7bb7-4670-9aa6-4fd65f086255 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:19.980572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bddf843-7bb7-4670-9aa6-4fd65f086255 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:19.989576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-df4ab34c-2ec1-4cda-ae45-74fb97f301a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:19.990403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bddf843-7bb7-4670-9aa6-4fd65f086255 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:19.991167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bddf843-7bb7-4670-9aa6-4fd65f086255 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:19.991587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-df4ab34c-2ec1-4cda-ae45-74fb97f301a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:19.992230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bddf843-7bb7-4670-9aa6-4fd65f086255 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:20.006062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df4ab34c-2ec1-4cda-ae45-74fb97f301a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:20.006786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df4ab34c-2ec1-4cda-ae45-74fb97f301a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:20.009311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df4ab34c-2ec1-4cda-ae45-74fb97f301a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:20.011717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df4ab34c-2ec1-4cda-ae45-74fb97f301a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:20.012333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df4ab34c-2ec1-4cda-ae45-74fb97f301a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:20.015236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df4ab34c-2ec1-4cda-ae45-74fb97f301a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:20.140790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5bddf843-7bb7-4670-9aa6-4fd65f086255 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:20.151498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5bddf843-7bb7-4670-9aa6-4fd65f086255 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:20.152962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5bddf843-7bb7-4670-9aa6-4fd65f086255 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:20.172406 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5bddf843-7bb7-4670-9aa6-4fd65f086255 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.249323 Oct 29 01:08:20.172406 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 555/1135] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:19 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:20.207628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9f3137ec-04d4-4483-a08b-8369aa77e927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:20.208637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9f3137ec-04d4-4483-a08b-8369aa77e927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e328b4b4-473e-44af-9260-e3e1df072c09] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:20.216942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f3137ec-04d4-4483-a08b-8369aa77e927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:20.217803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f3137ec-04d4-4483-a08b-8369aa77e927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:20.219091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f3137ec-04d4-4483-a08b-8369aa77e927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:20.220076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f3137ec-04d4-4483-a08b-8369aa77e927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:20.220739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f3137ec-04d4-4483-a08b-8369aa77e927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:20.221296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f3137ec-04d4-4483-a08b-8369aa77e927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:20.255732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-df4ab34c-2ec1-4cda-ae45-74fb97f301a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:20.266271 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-df4ab34c-2ec1-4cda-ae45-74fb97f301a2 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.289286 Oct 29 01:08:20.288300 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 581/1136] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:19 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:20.294830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2650856d-c044-4655-b33f-04b3ae88b150 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:20.295773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2650856d-c044-4655-b33f-04b3ae88b150 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:20.310338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2650856d-c044-4655-b33f-04b3ae88b150 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:20.310938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2650856d-c044-4655-b33f-04b3ae88b150 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:20.311973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2650856d-c044-4655-b33f-04b3ae88b150 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:20.312763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2650856d-c044-4655-b33f-04b3ae88b150 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:20.313257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2650856d-c044-4655-b33f-04b3ae88b150 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:20.313692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2650856d-c044-4655-b33f-04b3ae88b150 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:20.383816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9f3137ec-04d4-4483-a08b-8369aa77e927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:20.398380 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9f3137ec-04d4-4483-a08b-8369aa77e927 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09" status: 200 len: 1430 microversion: 2.1 time: 0.197756 Oct 29 01:08:20.419341 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 556/1137] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:20 2022] GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09 => generated 1430 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:20.523232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2650856d-c044-4655-b33f-04b3ae88b150 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:20.542207 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2650856d-c044-4655-b33f-04b3ae88b150 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1504 microversion: 2.1 time: 0.251809 Oct 29 01:08:20.543313 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 582/1138] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:20 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:20.547510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-3befd338-df53-4f67-8abd-73db23b23379 req-63ffe710-3fe8-4aac-9e02-eb514fd494d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e328b4b4-473e-44af-9260-e3e1df072c09", "name": "network-vif-deleted", "tag": "d15faedf-65dc-4a76-a947-4939de811d0e"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:20.564629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3befd338-df53-4f67-8abd-73db23b23379 req-63ffe710-3fe8-4aac-9e02-eb514fd494d0 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:20.569245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3befd338-df53-4f67-8abd-73db23b23379 req-63ffe710-3fe8-4aac-9e02-eb514fd494d0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:20.569816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3befd338-df53-4f67-8abd-73db23b23379 req-63ffe710-3fe8-4aac-9e02-eb514fd494d0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:20.580663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-03c8b69a-755e-4766-87fe-b2789289d510 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:20.582365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-03c8b69a-755e-4766-87fe-b2789289d510 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:20.589935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03c8b69a-755e-4766-87fe-b2789289d510 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:20.590430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03c8b69a-755e-4766-87fe-b2789289d510 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:20.593983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03c8b69a-755e-4766-87fe-b2789289d510 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:20.593983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03c8b69a-755e-4766-87fe-b2789289d510 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:20.593983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03c8b69a-755e-4766-87fe-b2789289d510 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:20.593983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03c8b69a-755e-4766-87fe-b2789289d510 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:20.594588 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-3befd338-df53-4f67-8abd-73db23b23379 req-63ffe710-3fe8-4aac-9e02-eb514fd494d0 service nova] Creating event network-vif-deleted:d15faedf-65dc-4a76-a947-4939de811d0e for instance e328b4b4-473e-44af-9260-e3e1df072c09 on n-h2-862964-3 Oct 29 01:08:20.615351 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-3befd338-df53-4f67-8abd-73db23b23379 req-63ffe710-3fe8-4aac-9e02-eb514fd494d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072059 Oct 29 01:08:20.617233 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 557/1139] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:08:20.632093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-03c8b69a-755e-4766-87fe-b2789289d510 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:08:20.984435 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-03c8b69a-755e-4766-87fe-b2789289d510 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "DELETE /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 204 len: 0 microversion: 2.1 time: 0.416294 Oct 29 01:08:20.985970 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 583/1140] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:08:20 2022] DELETE /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:08:20.992643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a2058b36-39e4-4c62-b0aa-45587d91b861 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:20.994318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a2058b36-39e4-4c62-b0aa-45587d91b861 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:20.997576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d86a2ae4-8b78-4378-b17c-91dadea976b0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:20.998927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d86a2ae4-8b78-4378-b17c-91dadea976b0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:21.007632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d86a2ae4-8b78-4378-b17c-91dadea976b0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:21.008553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d86a2ae4-8b78-4378-b17c-91dadea976b0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:21.009268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d86a2ae4-8b78-4378-b17c-91dadea976b0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:21.010143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d86a2ae4-8b78-4378-b17c-91dadea976b0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:21.010755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d86a2ae4-8b78-4378-b17c-91dadea976b0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:21.011376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d86a2ae4-8b78-4378-b17c-91dadea976b0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:21.012109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a2058b36-39e4-4c62-b0aa-45587d91b861 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:21.013797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a2058b36-39e4-4c62-b0aa-45587d91b861 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:21.014609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a2058b36-39e4-4c62-b0aa-45587d91b861 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:21.017564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a2058b36-39e4-4c62-b0aa-45587d91b861 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:21.018317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a2058b36-39e4-4c62-b0aa-45587d91b861 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:21.019667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a2058b36-39e4-4c62-b0aa-45587d91b861 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:21.257602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a2058b36-39e4-4c62-b0aa-45587d91b861 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:21.259421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d86a2ae4-8b78-4378-b17c-91dadea976b0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:21.267668 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d86a2ae4-8b78-4378-b17c-91dadea976b0 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1510 microversion: 2.1 time: 0.275442 Oct 29 01:08:21.269787 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a2058b36-39e4-4c62-b0aa-45587d91b861 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1311 microversion: 2.1 time: 0.289150 Oct 29 01:08:21.280249 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 584/1141] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:20 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:21.281976 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 558/1142] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:20 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1311 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:21.286055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-f2f5040d-14e6-4fce-8d12-1e98093e4220 req-ff198d51-e137-4653-837e-ba7fdd41f92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f346c718-28f2-4983-84f1-70909b4505a7", "name": "network-vif-plugged", "status": "completed", "tag": "dce0d611-7bbc-4151-915f-2f5d25b6d83b"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:21.289598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d443aaeb-0cc1-4a61-b41a-f80b7ba52779 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:21.290483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d443aaeb-0cc1-4a61-b41a-f80b7ba52779 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:21.307021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d443aaeb-0cc1-4a61-b41a-f80b7ba52779 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:21.307759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d443aaeb-0cc1-4a61-b41a-f80b7ba52779 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:21.308497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d443aaeb-0cc1-4a61-b41a-f80b7ba52779 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:21.309494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d443aaeb-0cc1-4a61-b41a-f80b7ba52779 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:21.310106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d443aaeb-0cc1-4a61-b41a-f80b7ba52779 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:21.310770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d443aaeb-0cc1-4a61-b41a-f80b7ba52779 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:21.318987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f2f5040d-14e6-4fce-8d12-1e98093e4220 req-ff198d51-e137-4653-837e-ba7fdd41f92c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:21.318987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f2f5040d-14e6-4fce-8d12-1e98093e4220 req-ff198d51-e137-4653-837e-ba7fdd41f92c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:21.318987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f2f5040d-14e6-4fce-8d12-1e98093e4220 req-ff198d51-e137-4653-837e-ba7fdd41f92c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:21.383602 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-f2f5040d-14e6-4fce-8d12-1e98093e4220 req-ff198d51-e137-4653-837e-ba7fdd41f92c service nova] Creating event network-vif-plugged:dce0d611-7bbc-4151-915f-2f5d25b6d83b for instance f346c718-28f2-4983-84f1-70909b4505a7 on n-h1-862964-3 Oct 29 01:08:21.398197 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-f2f5040d-14e6-4fce-8d12-1e98093e4220 req-ff198d51-e137-4653-837e-ba7fdd41f92c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116600 Oct 29 01:08:21.399127 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 585/1143] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:21.416566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-91297f59-525d-4a5d-b251-1749a2c0f38d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:21.419062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-91297f59-525d-4a5d-b251-1749a2c0f38d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:21.425948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d443aaeb-0cc1-4a61-b41a-f80b7ba52779 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:21.427079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91297f59-525d-4a5d-b251-1749a2c0f38d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:21.427617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91297f59-525d-4a5d-b251-1749a2c0f38d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:21.428117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91297f59-525d-4a5d-b251-1749a2c0f38d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:21.428939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91297f59-525d-4a5d-b251-1749a2c0f38d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:21.429423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91297f59-525d-4a5d-b251-1749a2c0f38d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:21.433584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91297f59-525d-4a5d-b251-1749a2c0f38d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:21.436055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d443aaeb-0cc1-4a61-b41a-f80b7ba52779 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:21.438352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d443aaeb-0cc1-4a61-b41a-f80b7ba52779 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:21.446273 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d443aaeb-0cc1-4a61-b41a-f80b7ba52779 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.162882 Oct 29 01:08:21.465616 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 559/1144] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:21 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:21.475297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3f4bc4ca-e124-426d-94d8-7ef2fe99fb07 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:21.475917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3f4bc4ca-e124-426d-94d8-7ef2fe99fb07 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e328b4b4-473e-44af-9260-e3e1df072c09] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:21.482109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f4bc4ca-e124-426d-94d8-7ef2fe99fb07 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:21.494937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f4bc4ca-e124-426d-94d8-7ef2fe99fb07 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:21.494937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f4bc4ca-e124-426d-94d8-7ef2fe99fb07 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:21.494937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f4bc4ca-e124-426d-94d8-7ef2fe99fb07 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:21.494937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f4bc4ca-e124-426d-94d8-7ef2fe99fb07 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:21.495362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f4bc4ca-e124-426d-94d8-7ef2fe99fb07 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:21.525813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f4bc4ca-e124-426d-94d8-7ef2fe99fb07 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:21.526565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f4bc4ca-e124-426d-94d8-7ef2fe99fb07 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:21.527158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f4bc4ca-e124-426d-94d8-7ef2fe99fb07 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:21.527819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-3f4bc4ca-e124-426d-94d8-7ef2fe99fb07 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lazy-loading 'fault' on Instance uuid e328b4b4-473e-44af-9260-e3e1df072c09 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:21.531202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:21.884891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3f4bc4ca-e124-426d-94d8-7ef2fe99fb07 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:21.895027 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3f4bc4ca-e124-426d-94d8-7ef2fe99fb07 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09" status: 200 len: 1307 microversion: 2.1 time: 0.427014 Oct 29 01:08:21.897022 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 560/1145] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:21 2022] GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09 => generated 1307 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:21.980757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-91297f59-525d-4a5d-b251-1749a2c0f38d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:21.997059 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-91297f59-525d-4a5d-b251-1749a2c0f38d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.596700 Oct 29 01:08:21.998558 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 586/1146] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:21 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:22.308162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6bcc9460-dc81-4115-af0d-be915011b89d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:22.308977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6bcc9460-dc81-4115-af0d-be915011b89d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:22.309346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-867527e2-058a-49d1-a7df-42863e0814e9 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:22.310038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-867527e2-058a-49d1-a7df-42863e0814e9 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:22.313532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=6,nova_api:UPDATE=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:22.316419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bcc9460-dc81-4115-af0d-be915011b89d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:22.317309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bcc9460-dc81-4115-af0d-be915011b89d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:22.317746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bcc9460-dc81-4115-af0d-be915011b89d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:22.317859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-867527e2-058a-49d1-a7df-42863e0814e9 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:22.318262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-867527e2-058a-49d1-a7df-42863e0814e9 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:22.318454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bcc9460-dc81-4115-af0d-be915011b89d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:22.318857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-867527e2-058a-49d1-a7df-42863e0814e9 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:22.318975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bcc9460-dc81-4115-af0d-be915011b89d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:22.319335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bcc9460-dc81-4115-af0d-be915011b89d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:22.319453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-867527e2-058a-49d1-a7df-42863e0814e9 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:22.319872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-867527e2-058a-49d1-a7df-42863e0814e9 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:22.320281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-867527e2-058a-49d1-a7df-42863e0814e9 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:22.697962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-867527e2-058a-49d1-a7df-42863e0814e9 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:22.711599 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-867527e2-058a-49d1-a7df-42863e0814e9 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1510 microversion: 2.1 time: 0.406301 Oct 29 01:08:22.716638 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 587/1147] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:22 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1510 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:22.726330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-abdca29e-3135-4fd0-bdd3-672f42020efc tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:22.726957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-abdca29e-3135-4fd0-bdd3-672f42020efc tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:22.738018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abdca29e-3135-4fd0-bdd3-672f42020efc tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:22.738298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abdca29e-3135-4fd0-bdd3-672f42020efc tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:22.738874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abdca29e-3135-4fd0-bdd3-672f42020efc tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:22.739587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abdca29e-3135-4fd0-bdd3-672f42020efc tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:22.740049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abdca29e-3135-4fd0-bdd3-672f42020efc tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:22.740479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abdca29e-3135-4fd0-bdd3-672f42020efc tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:22.740604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6bcc9460-dc81-4115-af0d-be915011b89d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:22.752125 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6bcc9460-dc81-4115-af0d-be915011b89d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1311 microversion: 2.1 time: 0.447978 Oct 29 01:08:22.753869 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 561/1148] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:22 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1311 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:22.759438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-6f7300aa-00e5-4220-96d6-274e718ce38e req-da2b7d30-a275-4fab-a6cf-91bc4bb2b534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e8aabd6-f029-4d30-b984-ac9905d35c60", "name": "network-vif-deleted", "tag": "c1de427c-560f-4f24-8158-8a289cec2e31"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:22.775090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6f7300aa-00e5-4220-96d6-274e718ce38e req-da2b7d30-a275-4fab-a6cf-91bc4bb2b534 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:22.775834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6f7300aa-00e5-4220-96d6-274e718ce38e req-da2b7d30-a275-4fab-a6cf-91bc4bb2b534 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:22.776504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6f7300aa-00e5-4220-96d6-274e718ce38e req-da2b7d30-a275-4fab-a6cf-91bc4bb2b534 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:22.784646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:22.800550 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-6f7300aa-00e5-4220-96d6-274e718ce38e req-da2b7d30-a275-4fab-a6cf-91bc4bb2b534 service nova] Creating event network-vif-deleted:c1de427c-560f-4f24-8158-8a289cec2e31 for instance 8e8aabd6-f029-4d30-b984-ac9905d35c60 on n-h2-862964-3 Oct 29 01:08:22.810979 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-6f7300aa-00e5-4220-96d6-274e718ce38e req-da2b7d30-a275-4fab-a6cf-91bc4bb2b534 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055674 Oct 29 01:08:22.811596 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 562/1149] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:22.922162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-abdca29e-3135-4fd0-bdd3-672f42020efc tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:22.922710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ee9270ee-fdeb-43cc-b3af-df36cae53d15 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:22.923553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ee9270ee-fdeb-43cc-b3af-df36cae53d15 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e328b4b4-473e-44af-9260-e3e1df072c09] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:22.930304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9270ee-fdeb-43cc-b3af-df36cae53d15 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:22.930858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9270ee-fdeb-43cc-b3af-df36cae53d15 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:22.931352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9270ee-fdeb-43cc-b3af-df36cae53d15 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:22.932790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9270ee-fdeb-43cc-b3af-df36cae53d15 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:22.932790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9270ee-fdeb-43cc-b3af-df36cae53d15 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:22.933075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9270ee-fdeb-43cc-b3af-df36cae53d15 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:22.934274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-abdca29e-3135-4fd0-bdd3-672f42020efc tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:22.935753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-abdca29e-3135-4fd0-bdd3-672f42020efc tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:22.941888 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-abdca29e-3135-4fd0-bdd3-672f42020efc tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.223535 Oct 29 01:08:22.942489 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 588/1150] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:22 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:22.970949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9270ee-fdeb-43cc-b3af-df36cae53d15 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:22.971393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9270ee-fdeb-43cc-b3af-df36cae53d15 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:22.971887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9270ee-fdeb-43cc-b3af-df36cae53d15 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:22.972337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-ee9270ee-fdeb-43cc-b3af-df36cae53d15 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lazy-loading 'fault' on Instance uuid e328b4b4-473e-44af-9260-e3e1df072c09 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:23.024704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a2f1b6c5-c272-423f-b6ec-13e4e75b6481 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:23.025758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a2f1b6c5-c272-423f-b6ec-13e4e75b6481 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:23.032488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ee9270ee-fdeb-43cc-b3af-df36cae53d15 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:23.033643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2f1b6c5-c272-423f-b6ec-13e4e75b6481 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:23.034961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2f1b6c5-c272-423f-b6ec-13e4e75b6481 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:23.035650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2f1b6c5-c272-423f-b6ec-13e4e75b6481 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:23.036793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2f1b6c5-c272-423f-b6ec-13e4e75b6481 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:23.038322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2f1b6c5-c272-423f-b6ec-13e4e75b6481 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:23.039593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2f1b6c5-c272-423f-b6ec-13e4e75b6481 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:23.044014 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ee9270ee-fdeb-43cc-b3af-df36cae53d15 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09" status: 200 len: 1307 microversion: 2.1 time: 0.129540 Oct 29 01:08:23.053964 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 563/1151] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:22 2022] GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09 => generated 1307 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:23.196487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a2f1b6c5-c272-423f-b6ec-13e4e75b6481 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:23.205456 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a2f1b6c5-c272-423f-b6ec-13e4e75b6481 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.187996 Oct 29 01:08:23.206692 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 589/1152] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:23 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:23.737883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c7abcfb9-fc71-4b64-8bb6-e3339a2ea99e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:23.738617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c7abcfb9-fc71-4b64-8bb6-e3339a2ea99e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:23.746507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7abcfb9-fc71-4b64-8bb6-e3339a2ea99e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:23.747100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7abcfb9-fc71-4b64-8bb6-e3339a2ea99e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:23.747606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7abcfb9-fc71-4b64-8bb6-e3339a2ea99e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:23.749101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7abcfb9-fc71-4b64-8bb6-e3339a2ea99e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:23.749813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7abcfb9-fc71-4b64-8bb6-e3339a2ea99e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:23.750436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7abcfb9-fc71-4b64-8bb6-e3339a2ea99e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:23.780711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1efad8a4-9bed-4ee9-bb0c-619fd638ab00 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:23.781858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1efad8a4-9bed-4ee9-bb0c-619fd638ab00 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:23.788126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7abcfb9-fc71-4b64-8bb6-e3339a2ea99e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:23.788937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7abcfb9-fc71-4b64-8bb6-e3339a2ea99e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:23.789283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7abcfb9-fc71-4b64-8bb6-e3339a2ea99e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:23.789739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-c7abcfb9-fc71-4b64-8bb6-e3339a2ea99e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lazy-loading 'fault' on Instance uuid 90b31213-0f88-43e1-9c55-fcc8606e77b1 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:23.807697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1efad8a4-9bed-4ee9-bb0c-619fd638ab00 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:23.808191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1efad8a4-9bed-4ee9-bb0c-619fd638ab00 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:23.808635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1efad8a4-9bed-4ee9-bb0c-619fd638ab00 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:23.809382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1efad8a4-9bed-4ee9-bb0c-619fd638ab00 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:23.809841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1efad8a4-9bed-4ee9-bb0c-619fd638ab00 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:23.810297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1efad8a4-9bed-4ee9-bb0c-619fd638ab00 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:23.843336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c7abcfb9-fc71-4b64-8bb6-e3339a2ea99e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7b8ad142bc41aa90ab0132fbed85fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31f1db58267478bbc9a66679ad49f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:23.852324 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c7abcfb9-fc71-4b64-8bb6-e3339a2ea99e tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 200 len: 1306 microversion: 2.1 time: 0.119335 Oct 29 01:08:23.853144 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 564/1153] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:23 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 1306 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:23.957452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1efad8a4-9bed-4ee9-bb0c-619fd638ab00 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:23.966593 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1efad8a4-9bed-4ee9-bb0c-619fd638ab00 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1311 microversion: 2.1 time: 0.190008 Oct 29 01:08:23.967169 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 590/1154] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:23 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1311 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:23.970270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0cc060ec-1348-4584-bdef-99b367dbcbb9 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:23.970880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0cc060ec-1348-4584-bdef-99b367dbcbb9 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:23.977242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cc060ec-1348-4584-bdef-99b367dbcbb9 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:23.977730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cc060ec-1348-4584-bdef-99b367dbcbb9 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:23.978164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cc060ec-1348-4584-bdef-99b367dbcbb9 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:23.978892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cc060ec-1348-4584-bdef-99b367dbcbb9 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:23.979311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cc060ec-1348-4584-bdef-99b367dbcbb9 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:23.979736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cc060ec-1348-4584-bdef-99b367dbcbb9 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:24.056218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0cc060ec-1348-4584-bdef-99b367dbcbb9 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:24.067697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0cc060ec-1348-4584-bdef-99b367dbcbb9 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:24.070003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0cc060ec-1348-4584-bdef-99b367dbcbb9 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:24.070205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b9d1ffc6-5217-40da-80b2-53802952ead7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:24.070959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b9d1ffc6-5217-40da-80b2-53802952ead7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e328b4b4-473e-44af-9260-e3e1df072c09] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:24.072994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:24.076973 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0cc060ec-1348-4584-bdef-99b367dbcbb9 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1447 microversion: 2.75 time: 0.110572 Oct 29 01:08:24.077850 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 565/1155] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:23 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1447 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:08:24.080538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9d1ffc6-5217-40da-80b2-53802952ead7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:24.081711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9d1ffc6-5217-40da-80b2-53802952ead7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:24.082316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9d1ffc6-5217-40da-80b2-53802952ead7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:24.087940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9d1ffc6-5217-40da-80b2-53802952ead7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:24.087940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9d1ffc6-5217-40da-80b2-53802952ead7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:24.087940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9d1ffc6-5217-40da-80b2-53802952ead7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:24.119804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9d1ffc6-5217-40da-80b2-53802952ead7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:24.120285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9d1ffc6-5217-40da-80b2-53802952ead7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:24.120907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9d1ffc6-5217-40da-80b2-53802952ead7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:24.121395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-b9d1ffc6-5217-40da-80b2-53802952ead7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lazy-loading 'fault' on Instance uuid e328b4b4-473e-44af-9260-e3e1df072c09 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:24.166148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b9d1ffc6-5217-40da-80b2-53802952ead7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:24.175049 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b9d1ffc6-5217-40da-80b2-53802952ead7 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09" status: 200 len: 1307 microversion: 2.1 time: 0.110858 Oct 29 01:08:24.175632 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 591/1156] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:24 2022] GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09 => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:24.229599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-088211eb-a467-42e5-b5a4-c61323fb872b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:24.230220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-088211eb-a467-42e5-b5a4-c61323fb872b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:24.236755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-088211eb-a467-42e5-b5a4-c61323fb872b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:24.237916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-088211eb-a467-42e5-b5a4-c61323fb872b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:24.238363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-088211eb-a467-42e5-b5a4-c61323fb872b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:24.239121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-088211eb-a467-42e5-b5a4-c61323fb872b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:24.240106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-088211eb-a467-42e5-b5a4-c61323fb872b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:24.240546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-088211eb-a467-42e5-b5a4-c61323fb872b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:24.374393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-088211eb-a467-42e5-b5a4-c61323fb872b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:24.382743 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-088211eb-a467-42e5-b5a4-c61323fb872b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.157653 Oct 29 01:08:24.383312 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 566/1157] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:24 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:24.830689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-e1d1dc6c-31e0-4f1f-baab-ab619c550fbf req-722c965e-88bd-41c4-9652-f20ec01511b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b31213-0f88-43e1-9c55-fcc8606e77b1", "name": "network-vif-deleted", "tag": "7d12781f-f45c-4630-9b25-1fe735d2efef"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:24.841889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e1d1dc6c-31e0-4f1f-baab-ab619c550fbf req-722c965e-88bd-41c4-9652-f20ec01511b8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:24.843020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e1d1dc6c-31e0-4f1f-baab-ab619c550fbf req-722c965e-88bd-41c4-9652-f20ec01511b8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:24.843636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e1d1dc6c-31e0-4f1f-baab-ab619c550fbf req-722c965e-88bd-41c4-9652-f20ec01511b8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:24.856083 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-e1d1dc6c-31e0-4f1f-baab-ab619c550fbf req-722c965e-88bd-41c4-9652-f20ec01511b8 service nova] Creating event network-vif-deleted:7d12781f-f45c-4630-9b25-1fe735d2efef for instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 on n-h2-862964-3 Oct 29 01:08:24.861726 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-e1d1dc6c-31e0-4f1f-baab-ab619c550fbf req-722c965e-88bd-41c4-9652-f20ec01511b8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036776 Oct 29 01:08:24.862408 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 592/1158] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:08:24.876085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-069680a9-2c41-4316-a51c-0b0f3c0ec6ef tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:24.876704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-069680a9-2c41-4316-a51c-0b0f3c0ec6ef tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:24.884512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-069680a9-2c41-4316-a51c-0b0f3c0ec6ef tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:24.885002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-069680a9-2c41-4316-a51c-0b0f3c0ec6ef tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:24.885543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-069680a9-2c41-4316-a51c-0b0f3c0ec6ef tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:24.886240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-069680a9-2c41-4316-a51c-0b0f3c0ec6ef tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:24.886691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-069680a9-2c41-4316-a51c-0b0f3c0ec6ef tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:24.887110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-069680a9-2c41-4316-a51c-0b0f3c0ec6ef tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:24.901524 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-069680a9-2c41-4316-a51c-0b0f3c0ec6ef tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] HTTP exception thrown: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-069680a9-2c41-4316-a51c-0b0f3c0ec6ef tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Request method failure captured: Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 HTTP/1.1 Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHzv7x65-zLLK0G_sZuONepMCJQD8qJBuwAeqssEb2JzU7AP8jhn7qawQIMhwRqa8_K82cCB1I6DnxmTVq3Mgei5KuMDQMo7U4SQ0uPU3zVlCrrNSFTPmAckRKkPGA6iAguGdHCpvYwFtxGXJRwznGu9HEW_36EJWqFGYfTCuowvCSE Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: d31f1db58267478bbc9a66679ad49f61 Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:08:24.903414 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:08:24.905134 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d31f1db58267478bbc9a66679ad49f61", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:24.905134 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:24.905134 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: d31f1db58267478bbc9a66679ad49f61 Oct 29 01:08:24.905134 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:24.905134 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesNegativeTestJSON-1003962219-project Oct 29 01:08:24.905134 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:08:24.905134 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:08:24.905134 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: cf7b8ad142bc41aa90ab0132fbed85fc Oct 29 01:08:24.905134 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesNegativeTestJSON-1003962219-project Oct 29 01:08:24.905134 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:08:24.905134 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:24.905134 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '90b31213-0f88-43e1-9c55-fcc8606e77b1'} Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:24.906098 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:24.907563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:24.907563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:08:24.907563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:08:24.907563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:24.907563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:24.907563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:24.907563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:24.907563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:24.907563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.907563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:24.907563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.907563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:24.907563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:24.907563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:24.907563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:24.907563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:24.907563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:24.907563 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.909794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-069680a9-2c41-4316-a51c-0b0f3c0ec6ef tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Returning 404 to user: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:24.909794 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-069680a9-2c41-4316-a51c-0b0f3c0ec6ef tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 404 len: 111 microversion: 2.1 time: 0.032252 Oct 29 01:08:24.909794 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 567/1159] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:24 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:24.914323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e46d2b00-abf7-469e-add4-a6c9dde0c882 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1577225433", "metadata": {"image_type": "test"}}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:24.916801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e46d2b00-abf7-469e-add4-a6c9dde0c882 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:24.922831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e46d2b00-abf7-469e-add4-a6c9dde0c882 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:24.923313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e46d2b00-abf7-469e-add4-a6c9dde0c882 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:24.923743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e46d2b00-abf7-469e-add4-a6c9dde0c882 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:24.924428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e46d2b00-abf7-469e-add4-a6c9dde0c882 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:24.925249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e46d2b00-abf7-469e-add4-a6c9dde0c882 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:24.925371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e46d2b00-abf7-469e-add4-a6c9dde0c882 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:24.938439 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-e46d2b00-abf7-469e-add4-a6c9dde0c882 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] HTTP exception thrown: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e46d2b00-abf7-469e-add4-a6c9dde0c882 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Request method failure captured: Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1/action HTTP/1.1 Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 112 Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHzv7x65-zLLK0G_sZuONepMCJQD8qJBuwAeqssEb2JzU7AP8jhn7qawQIMhwRqa8_K82cCB1I6DnxmTVq3Mgei5KuMDQMo7U4SQ0uPU3zVlCrrNSFTPmAckRKkPGA6iAguGdHCpvYwFtxGXJRwznGu9HEW_36EJWqFGYfTCuowvCSE Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: d31f1db58267478bbc9a66679ad49f61 Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:08:24.940031 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:08:24.942336 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d31f1db58267478bbc9a66679ad49f61", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:24.942336 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:24.942336 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: d31f1db58267478bbc9a66679ad49f61 Oct 29 01:08:24.942336 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:24.942336 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesNegativeTestJSON-1003962219-project Oct 29 01:08:24.942336 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:08:24.942336 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:08:24.942336 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: cf7b8ad142bc41aa90ab0132fbed85fc Oct 29 01:08:24.942336 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesNegativeTestJSON-1003962219-project Oct 29 01:08:24.942336 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:08:24.942336 n-d-862964-3 devstack@n-api.service[121099]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1577225433", "metadata": {"image_type": "test"}}} Oct 29 01:08:24.942336 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:08:24.943559 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:24.943559 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '90b31213-0f88-43e1-9c55-fcc8606e77b1', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1577225433', 'metadata': {'image_type': 'test'}}}} Oct 29 01:08:24.943559 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:24.943559 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:24.943559 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:24.943559 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:24.943559 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:08:24.943559 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:08:24.943559 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:08:24.943559 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:08:24.943559 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:08:24.943559 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:08:24.943559 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:24.943559 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.943559 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:24.943559 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.943559 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:24.943559 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:24.943559 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:24.945040 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:24.946363 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:24.946363 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:24.946363 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:24.946363 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:24.946363 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.946363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e46d2b00-abf7-469e-add4-a6c9dde0c882 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Returning 404 to user: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:24.946363 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e46d2b00-abf7-469e-add4-a6c9dde0c882 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "POST /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1/action" status: 404 len: 111 microversion: 2.1 time: 0.032304 Oct 29 01:08:24.946363 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 593/1160] 10.222.0.26 () {60 vars in 1279 bytes} [Sat Oct 29 01:08:24 2022] POST /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:24.953591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0594efad-c0f6-4905-bc84-1f414f2bcec5 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-284458345", "metadata": {"image_type": "test"}}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:24.956748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0594efad-c0f6-4905-bc84-1f414f2bcec5 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Failed to fetch instance by id tempest-invalid-1443125421 {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 01:08:24.957302 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-0594efad-c0f6-4905-bc84-1f414f2bcec5 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] HTTP exception thrown: Instance tempest-invalid-1443125421 could not be found. Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0594efad-c0f6-4905-bc84-1f414f2bcec5 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Request method failure captured: Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/tempest-invalid-1443125421/action HTTP/1.1 Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 111 Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHzv7x65-zLLK0G_sZuONepMCJQD8qJBuwAeqssEb2JzU7AP8jhn7qawQIMhwRqa8_K82cCB1I6DnxmTVq3Mgei5KuMDQMo7U4SQ0uPU3zVlCrrNSFTPmAckRKkPGA6iAguGdHCpvYwFtxGXJRwznGu9HEW_36EJWqFGYfTCuowvCSE Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: d31f1db58267478bbc9a66679ad49f61 Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:08:24.958795 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:08:24.960457 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d31f1db58267478bbc9a66679ad49f61", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:24.960457 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:24.960457 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: d31f1db58267478bbc9a66679ad49f61 Oct 29 01:08:24.960457 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:24.960457 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesNegativeTestJSON-1003962219-project Oct 29 01:08:24.960457 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:08:24.960457 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:08:24.960457 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: cf7b8ad142bc41aa90ab0132fbed85fc Oct 29 01:08:24.960457 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesNegativeTestJSON-1003962219-project Oct 29 01:08:24.960457 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:08:24.960457 n-d-862964-3 devstack@n-api.service[121100]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-284458345", "metadata": {"image_type": "test"}}} Oct 29 01:08:24.960457 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance tempest-invalid-1443125421 could not be found. Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'tempest-invalid-1443125421', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-284458345', 'metadata': {'image_type': 'test'}}}} Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1443125421 could not be found. Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:24.961388 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1443125421 could not be found. Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1443125421 could not be found. Oct 29 01:08:24.962883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.964484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0594efad-c0f6-4905-bc84-1f414f2bcec5 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Returning 404 to user: Instance tempest-invalid-1443125421 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:24.964484 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0594efad-c0f6-4905-bc84-1f414f2bcec5 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "POST /compute/v2.1/servers/tempest-invalid-1443125421/action" status: 404 len: 101 microversion: 2.1 time: 0.010471 Oct 29 01:08:24.964484 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 568/1161] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 29 01:08:24 2022] POST /compute/v2.1/servers/tempest-invalid-1443125421/action => generated 101 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:24.969660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7a461e18-8949-4a5b-8fba-9fa101ed1ede tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1538571377"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:24.972605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7a461e18-8949-4a5b-8fba-9fa101ed1ede tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 01:08:24.973140 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-7a461e18-8949-4a5b-8fba-9fa101ed1ede tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7a461e18-8949-4a5b-8fba-9fa101ed1ede tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Request method failure captured: Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 57 Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHzv7x65-zLLK0G_sZuONepMCJQD8qJBuwAeqssEb2JzU7AP8jhn7qawQIMhwRqa8_K82cCB1I6DnxmTVq3Mgei5KuMDQMo7U4SQ0uPU3zVlCrrNSFTPmAckRKkPGA6iAguGdHCpvYwFtxGXJRwznGu9HEW_36EJWqFGYfTCuowvCSE Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: d31f1db58267478bbc9a66679ad49f61 Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:08:24.974658 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:08:24.979518 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d31f1db58267478bbc9a66679ad49f61", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:24.979518 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:24.979518 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: d31f1db58267478bbc9a66679ad49f61 Oct 29 01:08:24.979518 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:24.979518 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesNegativeTestJSON-1003962219-project Oct 29 01:08:24.979518 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:08:24.979518 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:08:24.979518 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: cf7b8ad142bc41aa90ab0132fbed85fc Oct 29 01:08:24.979518 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesNegativeTestJSON-1003962219-project Oct 29 01:08:24.979518 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:08:24.979518 n-d-862964-3 devstack@n-api.service[121099]: {"createImage": {"name": "tempest-test-snap-1538571377"}} Oct 29 01:08:24.979518 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:08:24.979518 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1538571377'}}} Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:08:24.980538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:08:24.981979 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:08:24.981979 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:08:24.981979 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 29 01:08:24.981979 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 01:08:24.981979 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:24.981979 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:24.981979 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:24.981979 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:24.981979 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 01:08:24.981979 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.981979 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:24.981979 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.981979 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:24.981979 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:24.981979 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:24.981979 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:24.981979 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:24.981979 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 01:08:24.981979 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.983337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7a461e18-8949-4a5b-8fba-9fa101ed1ede tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:24.983337 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7a461e18-8949-4a5b-8fba-9fa101ed1ede tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.010295 Oct 29 01:08:24.983337 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 594/1162] 10.222.0.26 () {60 vars in 1275 bytes} [Sat Oct 29 01:08:24 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:08:24.985805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9ee2ec16-2c2a-43e6-b363-ed309c0b8467 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1359267790"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:24.988950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9ee2ec16-2c2a-43e6-b363-ed309c0b8467 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 01:08:24.989485 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-9ee2ec16-2c2a-43e6-b363-ed309c0b8467 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 01:08:24.990124 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a73ca216-c186-4197-a63c-3d046346bf98 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:24.990735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a73ca216-c186-4197-a63c-3d046346bf98 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9ee2ec16-2c2a-43e6-b363-ed309c0b8467 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Request method failure captured: Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 57 Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHzv7x65-zLLK0G_sZuONepMCJQD8qJBuwAeqssEb2JzU7AP8jhn7qawQIMhwRqa8_K82cCB1I6DnxmTVq3Mgei5KuMDQMo7U4SQ0uPU3zVlCrrNSFTPmAckRKkPGA6iAguGdHCpvYwFtxGXJRwznGu9HEW_36EJWqFGYfTCuowvCSE Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: d31f1db58267478bbc9a66679ad49f61 Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:08:24.990977 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:08:24.992622 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d31f1db58267478bbc9a66679ad49f61", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:24.992622 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:24.992622 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: d31f1db58267478bbc9a66679ad49f61 Oct 29 01:08:24.992622 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:24.992622 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesNegativeTestJSON-1003962219-project Oct 29 01:08:24.992622 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:08:24.992622 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:08:24.992622 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: cf7b8ad142bc41aa90ab0132fbed85fc Oct 29 01:08:24.992622 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesNegativeTestJSON-1003962219-project Oct 29 01:08:24.992622 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:08:24.992622 n-d-862964-3 devstack@n-api.service[121100]: {"createImage": {"name": "tempest-test-snap-1359267790"}} Oct 29 01:08:24.992622 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:08:24.992622 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1359267790'}}} Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:08:24.993554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:08:24.994784 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:08:24.994784 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:08:24.994784 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 29 01:08:24.994784 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 01:08:24.994784 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:24.994784 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:24.994784 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:24.994784 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:24.994784 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 01:08:24.994784 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.994784 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:24.994784 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.994784 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:24.994784 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:24.994784 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:24.994784 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:24.994784 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:24.994784 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 01:08:24.994784 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:24.996033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9ee2ec16-2c2a-43e6-b363-ed309c0b8467 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:24.996033 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9ee2ec16-2c2a-43e6-b363-ed309c0b8467 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010571 Oct 29 01:08:24.996033 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 569/1163] 10.222.0.26 () {60 vars in 1281 bytes} [Sat Oct 29 01:08:24 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:25.000919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a73ca216-c186-4197-a63c-3d046346bf98 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.001660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a73ca216-c186-4197-a63c-3d046346bf98 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.002104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a73ca216-c186-4197-a63c-3d046346bf98 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.002414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3237fc21-44ec-4cd4-a65f-f93bf487da66 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:25.003460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a73ca216-c186-4197-a63c-3d046346bf98 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.003582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3237fc21-44ec-4cd4-a65f-f93bf487da66 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:25.003936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a73ca216-c186-4197-a63c-3d046346bf98 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.004362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a73ca216-c186-4197-a63c-3d046346bf98 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.009782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3237fc21-44ec-4cd4-a65f-f93bf487da66 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.010270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3237fc21-44ec-4cd4-a65f-f93bf487da66 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.010792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3237fc21-44ec-4cd4-a65f-f93bf487da66 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.011503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3237fc21-44ec-4cd4-a65f-f93bf487da66 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.012076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3237fc21-44ec-4cd4-a65f-f93bf487da66 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.016489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3237fc21-44ec-4cd4-a65f-f93bf487da66 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.027190 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-3237fc21-44ec-4cd4-a65f-f93bf487da66 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] HTTP exception thrown: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3237fc21-44ec-4cd4-a65f-f93bf487da66 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Request method failure captured: Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 HTTP/1.1 Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHzv7x65-zLLK0G_sZuONepMCJQD8qJBuwAeqssEb2JzU7AP8jhn7qawQIMhwRqa8_K82cCB1I6DnxmTVq3Mgei5KuMDQMo7U4SQ0uPU3zVlCrrNSFTPmAckRKkPGA6iAguGdHCpvYwFtxGXJRwznGu9HEW_36EJWqFGYfTCuowvCSE Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: d31f1db58267478bbc9a66679ad49f61 Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:08:25.028745 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:08:25.030480 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d31f1db58267478bbc9a66679ad49f61", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:25.030480 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:25.030480 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: d31f1db58267478bbc9a66679ad49f61 Oct 29 01:08:25.030480 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:25.030480 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesNegativeTestJSON-1003962219-project Oct 29 01:08:25.030480 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:08:25.030480 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:08:25.030480 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: cf7b8ad142bc41aa90ab0132fbed85fc Oct 29 01:08:25.030480 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesNegativeTestJSON-1003962219-project Oct 29 01:08:25.030480 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:08:25.030480 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:25.030480 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '90b31213-0f88-43e1-9c55-fcc8606e77b1'} Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:25.034044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:25.035736 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.041478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3237fc21-44ec-4cd4-a65f-f93bf487da66 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Returning 404 to user: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:25.041478 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3237fc21-44ec-4cd4-a65f-f93bf487da66 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "DELETE /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 404 len: 111 microversion: 2.1 time: 0.031629 Oct 29 01:08:25.041478 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 570/1164] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:08:24 2022] DELETE /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:25.042938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-661693ad-1d67-4fa8-9f44-88683c0f6fa4 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:25.043545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-661693ad-1d67-4fa8-9f44-88683c0f6fa4 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] [instance: 90b31213-0f88-43e1-9c55-fcc8606e77b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:25.050226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-661693ad-1d67-4fa8-9f44-88683c0f6fa4 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.050387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-661693ad-1d67-4fa8-9f44-88683c0f6fa4 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.050713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-661693ad-1d67-4fa8-9f44-88683c0f6fa4 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.051408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-661693ad-1d67-4fa8-9f44-88683c0f6fa4 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.051860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-661693ad-1d67-4fa8-9f44-88683c0f6fa4 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.052281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-661693ad-1d67-4fa8-9f44-88683c0f6fa4 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.066591 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-661693ad-1d67-4fa8-9f44-88683c0f6fa4 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] HTTP exception thrown: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-661693ad-1d67-4fa8-9f44-88683c0f6fa4 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Request method failure captured: Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 HTTP/1.1 Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHzv7x65-zLLK0G_sZuONepMCJQD8qJBuwAeqssEb2JzU7AP8jhn7qawQIMhwRqa8_K82cCB1I6DnxmTVq3Mgei5KuMDQMo7U4SQ0uPU3zVlCrrNSFTPmAckRKkPGA6iAguGdHCpvYwFtxGXJRwznGu9HEW_36EJWqFGYfTCuowvCSE Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: d31f1db58267478bbc9a66679ad49f61 Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:08:25.069969 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:08:25.071522 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d31f1db58267478bbc9a66679ad49f61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d31f1db58267478bbc9a66679ad49f61", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:25.071522 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:25.071522 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: d31f1db58267478bbc9a66679ad49f61 Oct 29 01:08:25.071522 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1003962219 Oct 29 01:08:25.071522 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesNegativeTestJSON-1003962219-project Oct 29 01:08:25.071522 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:08:25.071522 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:08:25.071522 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: cf7b8ad142bc41aa90ab0132fbed85fc Oct 29 01:08:25.071522 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesNegativeTestJSON-1003962219-project Oct 29 01:08:25.071522 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:08:25.071522 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:25.071522 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '90b31213-0f88-43e1-9c55-fcc8606e77b1'} Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:25.072339 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:25.073819 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:25.073819 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:08:25.073819 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:08:25.073819 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:25.073819 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:25.073819 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:25.073819 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:25.073819 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:25.073819 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.073819 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:25.073819 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.073819 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:25.073819 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:25.073819 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:25.073819 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:25.073819 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:25.073819 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. Oct 29 01:08:25.073819 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.075031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-661693ad-1d67-4fa8-9f44-88683c0f6fa4 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] Returning 404 to user: Instance 90b31213-0f88-43e1-9c55-fcc8606e77b1 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:25.075031 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-661693ad-1d67-4fa8-9f44-88683c0f6fa4 tempest-ImagesNegativeTestJSON-1003962219 tempest-ImagesNegativeTestJSON-1003962219-project] 10.222.0.26 "GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1" status: 404 len: 111 microversion: 2.1 time: 0.031055 Oct 29 01:08:25.075031 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 571/1165] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:25 2022] GET /compute/v2.1/servers/90b31213-0f88-43e1-9c55-fcc8606e77b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:25.110511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8ef6887c-c41b-4ea3-8c4c-1c26cd6ac8f7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:25.111657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8ef6887c-c41b-4ea3-8c4c-1c26cd6ac8f7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:25.119075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8ef6887c-c41b-4ea3-8c4c-1c26cd6ac8f7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.119649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8ef6887c-c41b-4ea3-8c4c-1c26cd6ac8f7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.120156 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8ef6887c-c41b-4ea3-8c4c-1c26cd6ac8f7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.120932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8ef6887c-c41b-4ea3-8c4c-1c26cd6ac8f7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.121502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8ef6887c-c41b-4ea3-8c4c-1c26cd6ac8f7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.122316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8ef6887c-c41b-4ea3-8c4c-1c26cd6ac8f7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.148955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a73ca216-c186-4197-a63c-3d046346bf98 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:25.157760 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a73ca216-c186-4197-a63c-3d046346bf98 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1493 microversion: 2.1 time: 0.171757 Oct 29 01:08:25.162407 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 595/1166] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:24 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1493 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:25.184852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f0d1bcce-2bf7-486b-bb13-1cee5b5a2b75 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:25.185965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f0d1bcce-2bf7-486b-bb13-1cee5b5a2b75 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:25.195501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0d1bcce-2bf7-486b-bb13-1cee5b5a2b75 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.196271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0d1bcce-2bf7-486b-bb13-1cee5b5a2b75 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.196863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0d1bcce-2bf7-486b-bb13-1cee5b5a2b75 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.197757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0d1bcce-2bf7-486b-bb13-1cee5b5a2b75 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.198366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0d1bcce-2bf7-486b-bb13-1cee5b5a2b75 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.198974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0d1bcce-2bf7-486b-bb13-1cee5b5a2b75 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.211354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8ef6887c-c41b-4ea3-8c4c-1c26cd6ac8f7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:25.222740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8ef6887c-c41b-4ea3-8c4c-1c26cd6ac8f7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:25.224125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8ef6887c-c41b-4ea3-8c4c-1c26cd6ac8f7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:25.230168 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8ef6887c-c41b-4ea3-8c4c-1c26cd6ac8f7 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1465 microversion: 2.75 time: 0.124670 Oct 29 01:08:25.231062 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 572/1167] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:25 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1465 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:08:25.236189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1c8956c6-19e3-47c8-a322-6295b85ff38b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:25.237116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1c8956c6-19e3-47c8-a322-6295b85ff38b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: e328b4b4-473e-44af-9260-e3e1df072c09] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:25.243463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c8956c6-19e3-47c8-a322-6295b85ff38b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.244203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c8956c6-19e3-47c8-a322-6295b85ff38b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.245654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c8956c6-19e3-47c8-a322-6295b85ff38b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.250893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c8956c6-19e3-47c8-a322-6295b85ff38b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.250893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c8956c6-19e3-47c8-a322-6295b85ff38b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.250893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c8956c6-19e3-47c8-a322-6295b85ff38b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.266864 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-1c8956c6-19e3-47c8-a322-6295b85ff38b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] HTTP exception thrown: Instance e328b4b4-473e-44af-9260-e3e1df072c09 could not be found. Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1c8956c6-19e3-47c8-a322-6295b85ff38b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Request method failure captured: Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09 HTTP/1.1 Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHwhYjb8T-pefU3e0LRdpcRsaJPFyVw-4dAPNLJHoKRnbD15rG4FUGsSdMiljCoab17YXaJvro1O3NyzEhUDOnHEbevicmLzbOFjk6aedYSm2jKWp75WAaVb6ch8kcgB3XOgcaZPAYGlfDI7vgo-pubvBe6iYlNiBQTmtVirNDMcgXg Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: fba91819dd56439daea17217c5d7b9b7 Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:08:25.269753 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:08:25.271591 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fba91819dd56439daea17217c5d7b9b7", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:25.271591 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:08:25.271591 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: fba91819dd56439daea17217c5d7b9b7 Oct 29 01:08:25.271591 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:08:25.271591 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersOnMultiNodesTest-1355240400-project Oct 29 01:08:25.271591 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:08:25.271591 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:08:25.271591 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 175bb8f8b330495394cd401223847733 Oct 29 01:08:25.271591 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersOnMultiNodesTest-1355240400-project Oct 29 01:08:25.271591 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:08:25.271591 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance e328b4b4-473e-44af-9260-e3e1df072c09 could not be found. Oct 29 01:08:25.271591 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'e328b4b4-473e-44af-9260-e3e1df072c09'} Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e328b4b4-473e-44af-9260-e3e1df072c09 could not be found. Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:25.272689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:25.274253 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:25.274253 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:08:25.274253 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:08:25.274253 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:25.274253 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:25.274253 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:25.274253 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:25.274253 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e328b4b4-473e-44af-9260-e3e1df072c09 could not be found. Oct 29 01:08:25.274253 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.274253 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:25.274253 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.274253 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:25.274253 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:25.274253 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:25.274253 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:25.274253 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:25.274253 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e328b4b4-473e-44af-9260-e3e1df072c09 could not be found. Oct 29 01:08:25.274253 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.275984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1c8956c6-19e3-47c8-a322-6295b85ff38b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Returning 404 to user: Instance e328b4b4-473e-44af-9260-e3e1df072c09 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:25.275984 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1c8956c6-19e3-47c8-a322-6295b85ff38b tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09" status: 404 len: 111 microversion: 2.1 time: 0.038882 Oct 29 01:08:25.275984 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 573/1168] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:25 2022] GET /compute/v2.1/servers/e328b4b4-473e-44af-9260-e3e1df072c09 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:25.279651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-64d9a664-75b0-4341-9245-33dd4b5b90b3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:25.280262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-64d9a664-75b0-4341-9245-33dd4b5b90b3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: 8e8aabd6-f029-4d30-b984-ac9905d35c60] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:25.287232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64d9a664-75b0-4341-9245-33dd4b5b90b3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.288094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64d9a664-75b0-4341-9245-33dd4b5b90b3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.288535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64d9a664-75b0-4341-9245-33dd4b5b90b3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.289272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64d9a664-75b0-4341-9245-33dd4b5b90b3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.289731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64d9a664-75b0-4341-9245-33dd4b5b90b3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.290154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64d9a664-75b0-4341-9245-33dd4b5b90b3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.320878 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-64d9a664-75b0-4341-9245-33dd4b5b90b3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] HTTP exception thrown: Instance 8e8aabd6-f029-4d30-b984-ac9905d35c60 could not be found. Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-64d9a664-75b0-4341-9245-33dd4b5b90b3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Request method failure captured: Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 HTTP/1.1 Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHwhYjb8T-pefU3e0LRdpcRsaJPFyVw-4dAPNLJHoKRnbD15rG4FUGsSdMiljCoab17YXaJvro1O3NyzEhUDOnHEbevicmLzbOFjk6aedYSm2jKWp75WAaVb6ch8kcgB3XOgcaZPAYGlfDI7vgo-pubvBe6iYlNiBQTmtVirNDMcgXg Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: fba91819dd56439daea17217c5d7b9b7 Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:08:25.322705 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:08:25.324357 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fba91819dd56439daea17217c5d7b9b7", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:25.324357 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:08:25.324357 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: fba91819dd56439daea17217c5d7b9b7 Oct 29 01:08:25.324357 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:08:25.324357 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersOnMultiNodesTest-1355240400-project Oct 29 01:08:25.324357 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:08:25.324357 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:08:25.324357 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 175bb8f8b330495394cd401223847733 Oct 29 01:08:25.324357 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersOnMultiNodesTest-1355240400-project Oct 29 01:08:25.324357 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:08:25.324357 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 8e8aabd6-f029-4d30-b984-ac9905d35c60 could not be found. Oct 29 01:08:25.324357 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '8e8aabd6-f029-4d30-b984-ac9905d35c60'} Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e8aabd6-f029-4d30-b984-ac9905d35c60 could not be found. Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:25.325319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:25.326903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:25.326903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:08:25.326903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:08:25.326903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:25.326903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:25.326903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:25.326903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:25.326903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e8aabd6-f029-4d30-b984-ac9905d35c60 could not be found. Oct 29 01:08:25.326903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.326903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:25.326903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.326903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:25.326903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:25.326903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:25.326903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:25.326903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:25.326903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e8aabd6-f029-4d30-b984-ac9905d35c60 could not be found. Oct 29 01:08:25.326903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:25.328221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-64d9a664-75b0-4341-9245-33dd4b5b90b3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Returning 404 to user: Instance 8e8aabd6-f029-4d30-b984-ac9905d35c60 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:25.328963 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-64d9a664-75b0-4341-9245-33dd4b5b90b3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60" status: 404 len: 111 microversion: 2.1 time: 0.053025 Oct 29 01:08:25.329975 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 574/1169] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:25 2022] GET /compute/v2.1/servers/8e8aabd6-f029-4d30-b984-ac9905d35c60 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:25.338649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-87c5becc-ff2e-4c3f-ae4f-7a7d0243ff8a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:25.396566 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f0d1bcce-2bf7-486b-bb13-1cee5b5a2b75 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1644 microversion: 2.1 time: 0.215787 Oct 29 01:08:25.397277 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 596/1170] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:25 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1644 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:25.405933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-708b223c-8614-44c3-b058-1938e96986c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:25.406650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-708b223c-8614-44c3-b058-1938e96986c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:25.414646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-708b223c-8614-44c3-b058-1938e96986c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.415715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-708b223c-8614-44c3-b058-1938e96986c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.416407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-708b223c-8614-44c3-b058-1938e96986c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.417216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-708b223c-8614-44c3-b058-1938e96986c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.417685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-708b223c-8614-44c3-b058-1938e96986c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.418118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-708b223c-8614-44c3-b058-1938e96986c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.453634 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-87c5becc-ff2e-4c3f-ae4f-7a7d0243ff8a tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/19f66753-9f29-4847-90a4-a634f869da7a" status: 204 len: 0 microversion: 2.1 time: 0.117913 Oct 29 01:08:25.458656 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 575/1171] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 29 01:08:25 2022] DELETE /compute/v2.1/os-server-groups/19f66753-9f29-4847-90a4-a634f869da7a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:08:25.459908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0b68804c-f430-472b-a3f8-21031cf18e3b tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:25.460588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0b68804c-f430-472b-a3f8-21031cf18e3b tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:25.467525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b68804c-f430-472b-a3f8-21031cf18e3b tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.468068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b68804c-f430-472b-a3f8-21031cf18e3b tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.468517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b68804c-f430-472b-a3f8-21031cf18e3b tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.469245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b68804c-f430-472b-a3f8-21031cf18e3b tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.469707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b68804c-f430-472b-a3f8-21031cf18e3b tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.470134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b68804c-f430-472b-a3f8-21031cf18e3b tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.630249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-708b223c-8614-44c3-b058-1938e96986c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:25.639223 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-708b223c-8614-44c3-b058-1938e96986c8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1476 microversion: 2.1 time: 0.237144 Oct 29 01:08:25.653755 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 597/1172] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:25 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1476 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:25.661715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-35773a0c-4f35-437d-81d3-89ed524d0235 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:25.662359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-35773a0c-4f35-437d-81d3-89ed524d0235 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:25.665990 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0b68804c-f430-472b-a3f8-21031cf18e3b tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1644 microversion: 2.1 time: 0.210633 Oct 29 01:08:25.670898 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 576/1173] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:25 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1644 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:25.671022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35773a0c-4f35-437d-81d3-89ed524d0235 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.671022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35773a0c-4f35-437d-81d3-89ed524d0235 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.671022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35773a0c-4f35-437d-81d3-89ed524d0235 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.671022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35773a0c-4f35-437d-81d3-89ed524d0235 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.671482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35773a0c-4f35-437d-81d3-89ed524d0235 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.671923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35773a0c-4f35-437d-81d3-89ed524d0235 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.692882 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2f3f0654-e0ad-4ee1-bc21-673cae928ee8 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:25.696930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f3f0654-e0ad-4ee1-bc21-673cae928ee8 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.697487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f3f0654-e0ad-4ee1-bc21-673cae928ee8 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.698175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f3f0654-e0ad-4ee1-bc21-673cae928ee8 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.702306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f3f0654-e0ad-4ee1-bc21-673cae928ee8 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.702306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f3f0654-e0ad-4ee1-bc21-673cae928ee8 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.702306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f3f0654-e0ad-4ee1-bc21-673cae928ee8 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.702600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-35773a0c-4f35-437d-81d3-89ed524d0235 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:08:25.736228 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2f3f0654-e0ad-4ee1-bc21-673cae928ee8 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.045530 Oct 29 01:08:25.737685 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 577/1174] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Oct 29 01:08:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:25.750875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-89666cc1-d180-4b21-ab80-b7b32ee6933a tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:25.751487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-89666cc1-d180-4b21-ab80-b7b32ee6933a tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:25.760448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89666cc1-d180-4b21-ab80-b7b32ee6933a tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.761147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89666cc1-d180-4b21-ab80-b7b32ee6933a tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.761749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89666cc1-d180-4b21-ab80-b7b32ee6933a tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:25.764341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89666cc1-d180-4b21-ab80-b7b32ee6933a tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:25.764936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89666cc1-d180-4b21-ab80-b7b32ee6933a tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:25.765545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89666cc1-d180-4b21-ab80-b7b32ee6933a tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:26.073901 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-89666cc1-d180-4b21-ab80-b7b32ee6933a tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7/action" status: 202 len: 0 microversion: 2.1 time: 0.327217 Oct 29 01:08:26.075914 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 578/1175] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:08:25 2022] POST /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:08:26.091163 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-35773a0c-4f35-437d-81d3-89ed524d0235 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 204 len: 0 microversion: 2.1 time: 0.435901 Oct 29 01:08:26.092053 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 598/1176] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:08:25 2022] DELETE /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:08:26.097758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2bd5ff4b-ccc2-4145-885f-82af98bb2b70 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:26.100266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2bd5ff4b-ccc2-4145-885f-82af98bb2b70 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:26.103926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a8a06830-5310-4f58-99a2-5f0dcf793e3f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:26.104850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a8a06830-5310-4f58-99a2-5f0dcf793e3f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:26.110077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2bd5ff4b-ccc2-4145-885f-82af98bb2b70 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:26.110831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2bd5ff4b-ccc2-4145-885f-82af98bb2b70 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:26.111368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2bd5ff4b-ccc2-4145-885f-82af98bb2b70 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:26.112814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8a06830-5310-4f58-99a2-5f0dcf793e3f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:26.113324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2bd5ff4b-ccc2-4145-885f-82af98bb2b70 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:26.114003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2bd5ff4b-ccc2-4145-885f-82af98bb2b70 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:26.114134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8a06830-5310-4f58-99a2-5f0dcf793e3f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:26.114529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8a06830-5310-4f58-99a2-5f0dcf793e3f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:26.114729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2bd5ff4b-ccc2-4145-885f-82af98bb2b70 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:26.115240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8a06830-5310-4f58-99a2-5f0dcf793e3f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:26.115703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8a06830-5310-4f58-99a2-5f0dcf793e3f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:26.116136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8a06830-5310-4f58-99a2-5f0dcf793e3f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:26.336463 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2bd5ff4b-ccc2-4145-885f-82af98bb2b70 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1649 microversion: 2.1 time: 0.245953 Oct 29 01:08:26.337692 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 579/1177] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:26 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1649 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:26.340276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a8a06830-5310-4f58-99a2-5f0dcf793e3f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:26.346607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f6b4dd22-aa5b-4f2c-a568-fca2e2fdb326 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:26.346607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f6b4dd22-aa5b-4f2c-a568-fca2e2fdb326 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:26.350132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6b4dd22-aa5b-4f2c-a568-fca2e2fdb326 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:26.350815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6b4dd22-aa5b-4f2c-a568-fca2e2fdb326 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:26.350965 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a8a06830-5310-4f58-99a2-5f0dcf793e3f tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1473 microversion: 2.1 time: 0.254223 Oct 29 01:08:26.351802 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 599/1178] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:26 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1473 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:26.352152 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6b4dd22-aa5b-4f2c-a568-fca2e2fdb326 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:26.353022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6b4dd22-aa5b-4f2c-a568-fca2e2fdb326 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:26.353718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6b4dd22-aa5b-4f2c-a568-fca2e2fdb326 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:26.354204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6b4dd22-aa5b-4f2c-a568-fca2e2fdb326 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:26.423399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f6b4dd22-aa5b-4f2c-a568-fca2e2fdb326 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:26.432466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f6b4dd22-aa5b-4f2c-a568-fca2e2fdb326 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:26.434075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f6b4dd22-aa5b-4f2c-a568-fca2e2fdb326 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:26.439380 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f6b4dd22-aa5b-4f2c-a568-fca2e2fdb326 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1453 microversion: 2.75 time: 0.100518 Oct 29 01:08:26.453650 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 580/1179] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:26 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:26.668083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e098a56-193f-469b-affd-6e61eca45f92 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:26.669008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e098a56-193f-469b-affd-6e61eca45f92 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:26.676164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e098a56-193f-469b-affd-6e61eca45f92 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:26.677064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e098a56-193f-469b-affd-6e61eca45f92 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:26.677789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e098a56-193f-469b-affd-6e61eca45f92 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:26.679286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e098a56-193f-469b-affd-6e61eca45f92 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:26.680668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e098a56-193f-469b-affd-6e61eca45f92 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:26.681416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e098a56-193f-469b-affd-6e61eca45f92 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:26.855649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8e098a56-193f-469b-affd-6e61eca45f92 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:26.868754 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8e098a56-193f-469b-affd-6e61eca45f92 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1475 microversion: 2.1 time: 0.204406 Oct 29 01:08:26.870199 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 600/1180] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:26 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1475 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:27.328875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7615c362-7ae0-4a37-b258-4c15938bef3b tempest-FlavorMetadataValidation-1848041546 tempest-FlavorMetadataValidation-1848041546-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1807430405", "id": 100759943, "os-flavor-access:is_public": "True"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:27.363431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5c314ff3-35fd-494c-9bc0-4917821fd9bf tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:27.364164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5c314ff3-35fd-494c-9bc0-4917821fd9bf tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:27.371154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c314ff3-35fd-494c-9bc0-4917821fd9bf tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:27.376568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c314ff3-35fd-494c-9bc0-4917821fd9bf tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:27.376568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c314ff3-35fd-494c-9bc0-4917821fd9bf tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:27.376568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c314ff3-35fd-494c-9bc0-4917821fd9bf tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:27.376568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c314ff3-35fd-494c-9bc0-4917821fd9bf tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:27.377244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c314ff3-35fd-494c-9bc0-4917821fd9bf tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:27.424951 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7615c362-7ae0-4a37-b258-4c15938bef3b tempest-FlavorMetadataValidation-1848041546 tempest-FlavorMetadataValidation-1848041546-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.259666 Oct 29 01:08:27.436073 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 581/1181] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 29 01:08:27 2022] POST /compute/v2.1/flavors => generated 468 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:08:27.442927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d89823c-4e55-421f-a356-adf73cede6d3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:27.443522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7d89823c-4e55-421f-a356-adf73cede6d3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:27.450400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d89823c-4e55-421f-a356-adf73cede6d3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:27.451294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d89823c-4e55-421f-a356-adf73cede6d3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:27.451730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d89823c-4e55-421f-a356-adf73cede6d3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:27.452446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d89823c-4e55-421f-a356-adf73cede6d3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:27.452899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d89823c-4e55-421f-a356-adf73cede6d3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:27.453492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d89823c-4e55-421f-a356-adf73cede6d3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:27.687280 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5c314ff3-35fd-494c-9bc0-4917821fd9bf tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1629 microversion: 2.1 time: 0.328131 Oct 29 01:08:27.692747 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 601/1182] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:27 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1629 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:27.705040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dd2d15d5-9ff6-4a5b-b531-c864cac92c59 tempest-FlavorMetadataValidation-1848041546 tempest-FlavorMetadataValidation-1848041546-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:27.726669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7d89823c-4e55-421f-a356-adf73cede6d3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:27.735343 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7d89823c-4e55-421f-a356-adf73cede6d3 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1473 microversion: 2.1 time: 0.297179 Oct 29 01:08:27.735922 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 582/1183] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:27 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1473 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:27.751457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cf505246-c8e9-4e1e-ba8e-4507afcc8750 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:27.753083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cf505246-c8e9-4e1e-ba8e-4507afcc8750 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:27.767479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf505246-c8e9-4e1e-ba8e-4507afcc8750 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:27.768073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf505246-c8e9-4e1e-ba8e-4507afcc8750 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:27.773733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf505246-c8e9-4e1e-ba8e-4507afcc8750 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:27.774849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf505246-c8e9-4e1e-ba8e-4507afcc8750 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:27.775555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf505246-c8e9-4e1e-ba8e-4507afcc8750 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:27.776145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf505246-c8e9-4e1e-ba8e-4507afcc8750 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:27.850346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cf505246-c8e9-4e1e-ba8e-4507afcc8750 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:27.858926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cf505246-c8e9-4e1e-ba8e-4507afcc8750 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:27.861839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cf505246-c8e9-4e1e-ba8e-4507afcc8750 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:27.867956 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cf505246-c8e9-4e1e-ba8e-4507afcc8750 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1453 microversion: 2.75 time: 0.130872 Oct 29 01:08:27.868749 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 583/1184] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:27 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1453 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:27.881610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-129edc0a-8372-406d-958b-21ec75fca66e tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862964-3", "block_migration": true, "disk_over_commit": false}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:27.885086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-129edc0a-8372-406d-958b-21ec75fca66e tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:27.892725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-129edc0a-8372-406d-958b-21ec75fca66e tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:27.893539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-129edc0a-8372-406d-958b-21ec75fca66e tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:27.894517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-129edc0a-8372-406d-958b-21ec75fca66e tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:27.895718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-129edc0a-8372-406d-958b-21ec75fca66e tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:27.896480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-129edc0a-8372-406d-958b-21ec75fca66e tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:27.898072 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-129edc0a-8372-406d-958b-21ec75fca66e tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:27.905834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:27.929929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-129edc0a-8372-406d-958b-21ec75fca66e tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lazy-loading 'flavor' on Instance uuid f346c718-28f2-4983-84f1-70909b4505a7 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:27.945577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-129edc0a-8372-406d-958b-21ec75fca66e tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Going to try to live migrate instance to n-h2-862964-3 {{(pid=121100) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 01:08:28.007230 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dd2d15d5-9ff6-4a5b-b531-c864cac92c59 tempest-FlavorMetadataValidation-1848041546 tempest-FlavorMetadataValidation-1848041546-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/100759943/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.312656 Oct 29 01:08:28.007932 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 602/1185] 10.222.0.26 () {62 vars in 1262 bytes} [Sat Oct 29 01:08:27 2022] POST /compute/v2.1/flavors/100759943/os-extra_specs => generated 62 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:28.020031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d201d4f8-c236-4fce-9a37-252e0c37623e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:28.020651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d201d4f8-c236-4fce-9a37-252e0c37623e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:28.027105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d201d4f8-c236-4fce-9a37-252e0c37623e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:28.027596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d201d4f8-c236-4fce-9a37-252e0c37623e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:28.028113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d201d4f8-c236-4fce-9a37-252e0c37623e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:28.028847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d201d4f8-c236-4fce-9a37-252e0c37623e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:28.029345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d201d4f8-c236-4fce-9a37-252e0c37623e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:28.029821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d201d4f8-c236-4fce-9a37-252e0c37623e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:28.178235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d201d4f8-c236-4fce-9a37-252e0c37623e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:28.187294 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d201d4f8-c236-4fce-9a37-252e0c37623e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1475 microversion: 2.1 time: 0.172049 Oct 29 01:08:28.187881 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 603/1186] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:28 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1475 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:28.207856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-e597218d-bbc9-40f3-a936-7f652bd2efb4 req-297e9f4e-05c9-4f8b-b148-672273faece2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f415677-47ed-437a-a567-2831f34712dc", "name": "network-vif-unplugged", "status": "completed", "tag": "7d6159a8-d4d4-4879-bf83-176011337775"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:28.218642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e597218d-bbc9-40f3-a936-7f652bd2efb4 req-297e9f4e-05c9-4f8b-b148-672273faece2 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:28.219375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e597218d-bbc9-40f3-a936-7f652bd2efb4 req-297e9f4e-05c9-4f8b-b148-672273faece2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:28.227481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e597218d-bbc9-40f3-a936-7f652bd2efb4 req-297e9f4e-05c9-4f8b-b148-672273faece2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:28.232793 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-e597218d-bbc9-40f3-a936-7f652bd2efb4 req-297e9f4e-05c9-4f8b-b148-672273faece2 service nova] Creating event network-vif-unplugged:7d6159a8-d4d4-4879-bf83-176011337775 for instance 4f415677-47ed-437a-a567-2831f34712dc on n-h2-862964-3 Oct 29 01:08:28.239247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [req-e597218d-bbc9-40f3-a936-7f652bd2efb4 req-297e9f4e-05c9-4f8b-b148-672273faece2 service nova] Instance 4f415677-47ed-437a-a567-2831f34712dc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121099) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:08:28.255207 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-e597218d-bbc9-40f3-a936-7f652bd2efb4 req-297e9f4e-05c9-4f8b-b148-672273faece2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065931 Oct 29 01:08:28.256206 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 604/1187] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:28.271493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-92a169d8-e402-4907-952f-670638d0fc10 tempest-FlavorMetadataValidation-1848041546 tempest-FlavorMetadataValidation-1848041546-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:28.382027 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-92a169d8-e402-4907-952f-670638d0fc10 tempest-FlavorMetadataValidation-1848041546 tempest-FlavorMetadataValidation-1848041546-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/100759943" status: 202 len: 0 microversion: 2.86 time: 0.115637 Oct 29 01:08:28.382691 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 605/1188] 10.222.0.26 () {60 vars in 1199 bytes} [Sat Oct 29 01:08:28 2022] DELETE /compute/v2.1/flavors/100759943 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:08:28.390712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a8f094c8-01a7-4683-9114-7a16df22c0e6 tempest-FlavorMetadataValidation-1848041546 tempest-FlavorMetadataValidation-1848041546-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:28.414619 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a8f094c8-01a7-4683-9114-7a16df22c0e6 tempest-FlavorMetadataValidation-1848041546 tempest-FlavorMetadataValidation-1848041546-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.027306 Oct 29 01:08:28.415340 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 606/1189] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Oct 29 01:08:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:28.758581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6f73c78d-30d0-4c86-9ae5-d73191482bb4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:28.759555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6f73c78d-30d0-4c86-9ae5-d73191482bb4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:28.773588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f73c78d-30d0-4c86-9ae5-d73191482bb4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:28.774077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f73c78d-30d0-4c86-9ae5-d73191482bb4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:28.774684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f73c78d-30d0-4c86-9ae5-d73191482bb4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:28.775549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f73c78d-30d0-4c86-9ae5-d73191482bb4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:28.776159 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f73c78d-30d0-4c86-9ae5-d73191482bb4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:28.776760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f73c78d-30d0-4c86-9ae5-d73191482bb4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:29.003392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6f73c78d-30d0-4c86-9ae5-d73191482bb4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:29.015181 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6f73c78d-30d0-4c86-9ae5-d73191482bb4 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1473 microversion: 2.1 time: 0.260301 Oct 29 01:08:29.016741 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 607/1190] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:28 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1473 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:29.022876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6994b98c-25e6-4846-a11c-3d7a600402aa tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:29.023789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6994b98c-25e6-4846-a11c-3d7a600402aa tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:29.038799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6994b98c-25e6-4846-a11c-3d7a600402aa tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:29.039288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6994b98c-25e6-4846-a11c-3d7a600402aa tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:29.039719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6994b98c-25e6-4846-a11c-3d7a600402aa tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:29.040429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6994b98c-25e6-4846-a11c-3d7a600402aa tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:29.040884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6994b98c-25e6-4846-a11c-3d7a600402aa tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:29.041347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6994b98c-25e6-4846-a11c-3d7a600402aa tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:29.135477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6994b98c-25e6-4846-a11c-3d7a600402aa tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:29.145789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:29.149028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6994b98c-25e6-4846-a11c-3d7a600402aa tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:29.151900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6994b98c-25e6-4846-a11c-3d7a600402aa tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:29.163182 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6994b98c-25e6-4846-a11c-3d7a600402aa tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1453 microversion: 2.75 time: 0.144875 Oct 29 01:08:29.164798 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 608/1191] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:29 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:29.213595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-109bd701-d94f-4c06-8cb2-446b33595d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:29.214415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-109bd701-d94f-4c06-8cb2-446b33595d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:29.229554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-109bd701-d94f-4c06-8cb2-446b33595d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:29.230111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-109bd701-d94f-4c06-8cb2-446b33595d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:29.230677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-109bd701-d94f-4c06-8cb2-446b33595d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:29.231933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-109bd701-d94f-4c06-8cb2-446b33595d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:29.232404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-109bd701-d94f-4c06-8cb2-446b33595d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:29.232832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-109bd701-d94f-4c06-8cb2-446b33595d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:29.404347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-109bd701-d94f-4c06-8cb2-446b33595d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:29.413393 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-109bd701-d94f-4c06-8cb2-446b33595d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1475 microversion: 2.1 time: 0.203261 Oct 29 01:08:29.415016 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 609/1192] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:29 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1475 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:30.043893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-75e4281b-07db-45bc-983e-f35975a2c598 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:30.044943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-75e4281b-07db-45bc-983e-f35975a2c598 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:30.054841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e4281b-07db-45bc-983e-f35975a2c598 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:30.055923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e4281b-07db-45bc-983e-f35975a2c598 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:30.056607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e4281b-07db-45bc-983e-f35975a2c598 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:30.057718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e4281b-07db-45bc-983e-f35975a2c598 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:30.058658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e4281b-07db-45bc-983e-f35975a2c598 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:30.059262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e4281b-07db-45bc-983e-f35975a2c598 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:30.101858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e4281b-07db-45bc-983e-f35975a2c598 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:30.102668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e4281b-07db-45bc-983e-f35975a2c598 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:30.103106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e4281b-07db-45bc-983e-f35975a2c598 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:30.103553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-75e4281b-07db-45bc-983e-f35975a2c598 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lazy-loading 'fault' on Instance uuid a9a5a9b1-7f02-4874-83d4-c48badd76f5f {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:30.150649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-75e4281b-07db-45bc-983e-f35975a2c598 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175bb8f8b330495394cd401223847733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba91819dd56439daea17217c5d7b9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:30.164945 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-75e4281b-07db-45bc-983e-f35975a2c598 tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 200 len: 1307 microversion: 2.1 time: 0.124813 Oct 29 01:08:30.166976 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 610/1193] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:30 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 1307 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:30.197146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9fe41e26-3fd1-4d67-afe8-c98ca5cc5d35 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:30.197783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9fe41e26-3fd1-4d67-afe8-c98ca5cc5d35 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:30.204912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fe41e26-3fd1-4d67-afe8-c98ca5cc5d35 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:30.204912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fe41e26-3fd1-4d67-afe8-c98ca5cc5d35 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:30.205375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fe41e26-3fd1-4d67-afe8-c98ca5cc5d35 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:30.207233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fe41e26-3fd1-4d67-afe8-c98ca5cc5d35 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:30.207702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fe41e26-3fd1-4d67-afe8-c98ca5cc5d35 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:30.208128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fe41e26-3fd1-4d67-afe8-c98ca5cc5d35 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:30.276821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9fe41e26-3fd1-4d67-afe8-c98ca5cc5d35 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:30.286903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9fe41e26-3fd1-4d67-afe8-c98ca5cc5d35 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:30.288599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9fe41e26-3fd1-4d67-afe8-c98ca5cc5d35 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:30.295035 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9fe41e26-3fd1-4d67-afe8-c98ca5cc5d35 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1453 microversion: 2.75 time: 0.101919 Oct 29 01:08:30.295619 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 611/1194] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:30 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:08:30.312424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-e6e0815e-ef67-41df-aed6-93562aba039a req-4ab523f2-3c41-42aa-a4c9-b6c00479ddd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f415677-47ed-437a-a567-2831f34712dc", "tag": "7d6159a8-d4d4-4879-bf83-176011337775"}, {"server_uuid": "a9a5a9b1-7f02-4874-83d4-c48badd76f5f", "name": "network-vif-deleted", "tag": "92316f92-4129-4d3d-a8ad-df5607e5d4e5"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:30.331796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e6e0815e-ef67-41df-aed6-93562aba039a req-4ab523f2-3c41-42aa-a4c9-b6c00479ddd8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:30.332367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e6e0815e-ef67-41df-aed6-93562aba039a req-4ab523f2-3c41-42aa-a4c9-b6c00479ddd8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:30.332918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e6e0815e-ef67-41df-aed6-93562aba039a req-4ab523f2-3c41-42aa-a4c9-b6c00479ddd8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:30.348304 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-e6e0815e-ef67-41df-aed6-93562aba039a req-4ab523f2-3c41-42aa-a4c9-b6c00479ddd8 service nova] Creating event network-changed:7d6159a8-d4d4-4879-bf83-176011337775 for instance 4f415677-47ed-437a-a567-2831f34712dc on n-h2-862964-3 Oct 29 01:08:30.348919 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-e6e0815e-ef67-41df-aed6-93562aba039a req-4ab523f2-3c41-42aa-a4c9-b6c00479ddd8 service nova] Creating event network-vif-deleted:92316f92-4129-4d3d-a8ad-df5607e5d4e5 for instance a9a5a9b1-7f02-4874-83d4-c48badd76f5f on n-h2-862964-3 Oct 29 01:08:30.355448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [req-e6e0815e-ef67-41df-aed6-93562aba039a req-4ab523f2-3c41-42aa-a4c9-b6c00479ddd8 service nova] Instance 4f415677-47ed-437a-a567-2831f34712dc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121099) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:08:30.369551 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-e6e0815e-ef67-41df-aed6-93562aba039a req-4ab523f2-3c41-42aa-a4c9-b6c00479ddd8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.072430 Oct 29 01:08:30.370218 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 612/1195] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:30.440692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2808bcbc-ee75-4d86-9f97-de9cb687dc80 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:30.441536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2808bcbc-ee75-4d86-9f97-de9cb687dc80 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:30.461790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2808bcbc-ee75-4d86-9f97-de9cb687dc80 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:30.462299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2808bcbc-ee75-4d86-9f97-de9cb687dc80 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:30.462743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2808bcbc-ee75-4d86-9f97-de9cb687dc80 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:30.463584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2808bcbc-ee75-4d86-9f97-de9cb687dc80 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:30.464782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2808bcbc-ee75-4d86-9f97-de9cb687dc80 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:30.465491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2808bcbc-ee75-4d86-9f97-de9cb687dc80 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:31.010489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2808bcbc-ee75-4d86-9f97-de9cb687dc80 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:31.034923 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2808bcbc-ee75-4d86-9f97-de9cb687dc80 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1475 microversion: 2.1 time: 0.598475 Oct 29 01:08:31.038510 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 613/1196] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:30 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1475 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:31.192144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1ab60801-501f-40a0-8c2b-682755d0025e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:31.193092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1ab60801-501f-40a0-8c2b-682755d0025e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] [instance: a9a5a9b1-7f02-4874-83d4-c48badd76f5f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:31.199096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ab60801-501f-40a0-8c2b-682755d0025e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:31.199582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ab60801-501f-40a0-8c2b-682755d0025e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:31.200025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ab60801-501f-40a0-8c2b-682755d0025e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:31.200766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ab60801-501f-40a0-8c2b-682755d0025e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:31.201256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ab60801-501f-40a0-8c2b-682755d0025e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:31.201722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ab60801-501f-40a0-8c2b-682755d0025e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:31.216818 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-1ab60801-501f-40a0-8c2b-682755d0025e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] HTTP exception thrown: Instance a9a5a9b1-7f02-4874-83d4-c48badd76f5f could not be found. Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1ab60801-501f-40a0-8c2b-682755d0025e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Request method failure captured: Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f HTTP/1.1 Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwhYjb8T-pefU3e0LRdpcRsaJPFyVw-4dAPNLJHoKRnbD15rG4FUGsSdMiljCoab17YXaJvro1O3NyzEhUDOnHEbevicmLzbOFjk6aedYSm2jKWp75WAaVb6ch8kcgB3XOgcaZPAYGlfDI7vgo-pubvBe6iYlNiBQTmtVirNDMcgXg Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: fba91819dd56439daea17217c5d7b9b7 Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:08:31.218806 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:08:31.223915 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fba91819dd56439daea17217c5d7b9b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fba91819dd56439daea17217c5d7b9b7", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:31.223915 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:08:31.223915 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: fba91819dd56439daea17217c5d7b9b7 Oct 29 01:08:31.223915 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1355240400 Oct 29 01:08:31.223915 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersOnMultiNodesTest-1355240400-project Oct 29 01:08:31.223915 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:08:31.223915 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:08:31.223915 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 175bb8f8b330495394cd401223847733 Oct 29 01:08:31.223915 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersOnMultiNodesTest-1355240400-project Oct 29 01:08:31.223915 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:08:31.223915 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance a9a5a9b1-7f02-4874-83d4-c48badd76f5f could not be found. Oct 29 01:08:31.223915 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'a9a5a9b1-7f02-4874-83d4-c48badd76f5f'} Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9a5a9b1-7f02-4874-83d4-c48badd76f5f could not be found. Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:31.225702 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:31.227442 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:31.227442 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:08:31.227442 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:08:31.227442 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:08:31.227442 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:08:31.227442 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:08:31.227442 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:08:31.227442 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9a5a9b1-7f02-4874-83d4-c48badd76f5f could not be found. Oct 29 01:08:31.227442 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:31.227442 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:31.227442 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:31.227442 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:31.227442 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:31.227442 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:31.227442 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:31.227442 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:31.227442 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9a5a9b1-7f02-4874-83d4-c48badd76f5f could not be found. Oct 29 01:08:31.227442 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:31.228572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1ab60801-501f-40a0-8c2b-682755d0025e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] Returning 404 to user: Instance a9a5a9b1-7f02-4874-83d4-c48badd76f5f could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:31.228572 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1ab60801-501f-40a0-8c2b-682755d0025e tempest-ServersOnMultiNodesTest-1355240400 tempest-ServersOnMultiNodesTest-1355240400-project] 10.222.0.26 "GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f" status: 404 len: 111 microversion: 2.1 time: 0.032863 Oct 29 01:08:31.228572 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 614/1197] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:31 2022] GET /compute/v2.1/servers/a9a5a9b1-7f02-4874-83d4-c48badd76f5f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:08:31.326616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3365c73d-f1a3-48ef-9081-78714199963a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:31.327464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3365c73d-f1a3-48ef-9081-78714199963a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:31.337985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3365c73d-f1a3-48ef-9081-78714199963a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:31.339395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3365c73d-f1a3-48ef-9081-78714199963a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:31.340552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3365c73d-f1a3-48ef-9081-78714199963a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:31.341299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3365c73d-f1a3-48ef-9081-78714199963a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:31.341917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3365c73d-f1a3-48ef-9081-78714199963a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:31.344512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3365c73d-f1a3-48ef-9081-78714199963a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:31.483681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3365c73d-f1a3-48ef-9081-78714199963a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:31.492623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3365c73d-f1a3-48ef-9081-78714199963a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:31.494132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3365c73d-f1a3-48ef-9081-78714199963a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:31.499309 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3365c73d-f1a3-48ef-9081-78714199963a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1438 microversion: 2.75 time: 0.177438 Oct 29 01:08:31.516061 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 615/1198] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:31 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1438 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:31.812019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:31.826396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:31.846730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:31.853831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:31.853831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:31.853831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:31.857542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:31.858021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:31.941707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:08:31.942224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:08:31.942759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:08:31.943167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:08:31.943574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:08:32.053281 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-129edc0a-8372-406d-958b-21ec75fca66e tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7/action" status: 202 len: 0 microversion: 2.1 time: 4.178680 Oct 29 01:08:32.054467 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 584/1199] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:08:27 2022] POST /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7/action => generated 0 bytes in 4185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:08:32.061929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-949ffcbb-6cb9-49f1-90e6-c931f5a47206 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:32.062649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-949ffcbb-6cb9-49f1-90e6-c931f5a47206 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:32.070742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-949ffcbb-6cb9-49f1-90e6-c931f5a47206 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:32.071237 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-949ffcbb-6cb9-49f1-90e6-c931f5a47206 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:32.071683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-949ffcbb-6cb9-49f1-90e6-c931f5a47206 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:32.072399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-949ffcbb-6cb9-49f1-90e6-c931f5a47206 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:32.073071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-949ffcbb-6cb9-49f1-90e6-c931f5a47206 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:32.073548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-949ffcbb-6cb9-49f1-90e6-c931f5a47206 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:32.140353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:32.147532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:32.148651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:32.149613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:32.150513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:32.154105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:32.154105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:32.344756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-949ffcbb-6cb9-49f1-90e6-c931f5a47206 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:32.354073 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-949ffcbb-6cb9-49f1-90e6-c931f5a47206 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1473 microversion: 2.1 time: 0.298453 Oct 29 01:08:32.354229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:32.357133 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 585/1200] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:32 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1473 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:32.368633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e60c011a-12db-4de0-a99e-71a039771895 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:32.369507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e60c011a-12db-4de0-a99e-71a039771895 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:32.376303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e60c011a-12db-4de0-a99e-71a039771895 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:32.376785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e60c011a-12db-4de0-a99e-71a039771895 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:32.385306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e60c011a-12db-4de0-a99e-71a039771895 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:32.386726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e60c011a-12db-4de0-a99e-71a039771895 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:32.387358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e60c011a-12db-4de0-a99e-71a039771895 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:32.387946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e60c011a-12db-4de0-a99e-71a039771895 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:32.413834 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b9ff0602-f87c-485c-a26f-6f1c5320ae1b tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b/action" status: 202 len: 1942 microversion: 2.75 time: 0.881138 Oct 29 01:08:32.414651 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 616/1201] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 29 01:08:31 2022] POST /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b/action => generated 1942 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 29 01:08:32.446819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eed62e21-4163-4ba3-83d0-79d65dfed41e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:32.459100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eed62e21-4163-4ba3-83d0-79d65dfed41e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:32.480040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eed62e21-4163-4ba3-83d0-79d65dfed41e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:32.480541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eed62e21-4163-4ba3-83d0-79d65dfed41e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:32.481057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eed62e21-4163-4ba3-83d0-79d65dfed41e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:32.482028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eed62e21-4163-4ba3-83d0-79d65dfed41e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:32.482564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eed62e21-4163-4ba3-83d0-79d65dfed41e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:32.482986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eed62e21-4163-4ba3-83d0-79d65dfed41e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:32.608115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-eed62e21-4163-4ba3-83d0-79d65dfed41e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:32.629041 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eed62e21-4163-4ba3-83d0-79d65dfed41e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.188548 Oct 29 01:08:32.629761 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 617/1202] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:32 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:32.659859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e60c011a-12db-4de0-a99e-71a039771895 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:32.668396 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e60c011a-12db-4de0-a99e-71a039771895 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1503 microversion: 2.1 time: 0.310072 Oct 29 01:08:32.669208 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 586/1203] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:32 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1503 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:33.385144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3f02a9e7-094f-4ee9-9eb0-16f5e8399084 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:33.385938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3f02a9e7-094f-4ee9-9eb0-16f5e8399084 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:33.389222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:33.397942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f02a9e7-094f-4ee9-9eb0-16f5e8399084 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:33.399923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f02a9e7-094f-4ee9-9eb0-16f5e8399084 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:33.401657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f02a9e7-094f-4ee9-9eb0-16f5e8399084 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:33.404988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f02a9e7-094f-4ee9-9eb0-16f5e8399084 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:33.405815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f02a9e7-094f-4ee9-9eb0-16f5e8399084 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:33.407039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f02a9e7-094f-4ee9-9eb0-16f5e8399084 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:33.614222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3f02a9e7-094f-4ee9-9eb0-16f5e8399084 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:33.614222 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3f02a9e7-094f-4ee9-9eb0-16f5e8399084 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1473 microversion: 2.1 time: 0.215590 Oct 29 01:08:33.614222 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 618/1204] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:33 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1473 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:33.657665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fa34dd5e-2e6c-4cd8-a960-da5890d4308e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:33.658556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fa34dd5e-2e6c-4cd8-a960-da5890d4308e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:33.666795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa34dd5e-2e6c-4cd8-a960-da5890d4308e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:33.668374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa34dd5e-2e6c-4cd8-a960-da5890d4308e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:33.669348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa34dd5e-2e6c-4cd8-a960-da5890d4308e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:33.670349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa34dd5e-2e6c-4cd8-a960-da5890d4308e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:33.671061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa34dd5e-2e6c-4cd8-a960-da5890d4308e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:33.671683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa34dd5e-2e6c-4cd8-a960-da5890d4308e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:33.692603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-89072a36-a7ff-4835-9db9-6a8da4b1f8bb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:33.693448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-89072a36-a7ff-4835-9db9-6a8da4b1f8bb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:33.707452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89072a36-a7ff-4835-9db9-6a8da4b1f8bb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:33.708080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89072a36-a7ff-4835-9db9-6a8da4b1f8bb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:33.708530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89072a36-a7ff-4835-9db9-6a8da4b1f8bb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:33.710366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89072a36-a7ff-4835-9db9-6a8da4b1f8bb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:33.710851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89072a36-a7ff-4835-9db9-6a8da4b1f8bb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:33.711286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89072a36-a7ff-4835-9db9-6a8da4b1f8bb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:33.831525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-fa34dd5e-2e6c-4cd8-a960-da5890d4308e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:33.850201 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fa34dd5e-2e6c-4cd8-a960-da5890d4308e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.196174 Oct 29 01:08:33.850753 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 587/1205] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:33 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:33.896175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-89072a36-a7ff-4835-9db9-6a8da4b1f8bb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:33.904611 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-89072a36-a7ff-4835-9db9-6a8da4b1f8bb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1503 microversion: 2.1 time: 0.216654 Oct 29 01:08:33.905245 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 619/1206] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:33 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:34.621369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-49611d9d-2178-4ee7-a3db-61cea6bed4d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:34.621985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-49611d9d-2178-4ee7-a3db-61cea6bed4d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:34.629831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49611d9d-2178-4ee7-a3db-61cea6bed4d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:34.630335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49611d9d-2178-4ee7-a3db-61cea6bed4d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:34.630929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49611d9d-2178-4ee7-a3db-61cea6bed4d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:34.631818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49611d9d-2178-4ee7-a3db-61cea6bed4d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:34.632420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49611d9d-2178-4ee7-a3db-61cea6bed4d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:34.633001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49611d9d-2178-4ee7-a3db-61cea6bed4d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:34.798157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-49611d9d-2178-4ee7-a3db-61cea6bed4d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:34.812861 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-49611d9d-2178-4ee7-a3db-61cea6bed4d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1473 microversion: 2.1 time: 0.195576 Oct 29 01:08:34.814372 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 588/1207] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:34 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1473 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:34.840186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7750c894-724d-40a4-82e5-8553702133d3 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Calling method '.version_select at 0x7f9d9797b790>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:34.842036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7750c894-724d-40a4-82e5-8553702133d3 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:34.842520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7750c894-724d-40a4-82e5-8553702133d3 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:34.842956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7750c894-724d-40a4-82e5-8553702133d3 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:34.857918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7750c894-724d-40a4-82e5-8553702133d3 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:34.858411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7750c894-724d-40a4-82e5-8553702133d3 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:34.858876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7750c894-724d-40a4-82e5-8553702133d3 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:34.873042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7750c894-724d-40a4-82e5-8553702133d3 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:34.873557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7750c894-724d-40a4-82e5-8553702133d3 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:34.873993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7750c894-724d-40a4-82e5-8553702133d3 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:34.881571 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7750c894-724d-40a4-82e5-8553702133d3 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.218492 Oct 29 01:08:34.882458 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 620/1208] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:08:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:34.882656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3e4dba33-5164-4eec-a111-c4a055eea3c2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:34.883266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3e4dba33-5164-4eec-a111-c4a055eea3c2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:34.890527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e4dba33-5164-4eec-a111-c4a055eea3c2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:34.891230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e4dba33-5164-4eec-a111-c4a055eea3c2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:34.891854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e4dba33-5164-4eec-a111-c4a055eea3c2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:34.893090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e4dba33-5164-4eec-a111-c4a055eea3c2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:34.894091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e4dba33-5164-4eec-a111-c4a055eea3c2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:34.894686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eac139a6-15bb-4107-9664-d5ceb12ddd78 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Calling method '.version_select at 0x7f9d9797bb80>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:34.895005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e4dba33-5164-4eec-a111-c4a055eea3c2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:34.896664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eac139a6-15bb-4107-9664-d5ceb12ddd78 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:34.897412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eac139a6-15bb-4107-9664-d5ceb12ddd78 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:34.898105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eac139a6-15bb-4107-9664-d5ceb12ddd78 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:34.915416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eac139a6-15bb-4107-9664-d5ceb12ddd78 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:34.916279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eac139a6-15bb-4107-9664-d5ceb12ddd78 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:34.916954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eac139a6-15bb-4107-9664-d5ceb12ddd78 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:34.931617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eac139a6-15bb-4107-9664-d5ceb12ddd78 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:34.932333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eac139a6-15bb-4107-9664-d5ceb12ddd78 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:34.933040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eac139a6-15bb-4107-9664-d5ceb12ddd78 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:34.941285 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eac139a6-15bb-4107-9664-d5ceb12ddd78 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.051028 Oct 29 01:08:34.942218 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 621/1209] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Oct 29 01:08:34 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:34.947175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dbe331b6-13a8-48d3-aff9-2da6677faaf8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:34.948070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dbe331b6-13a8-48d3-aff9-2da6677faaf8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:34.957077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbe331b6-13a8-48d3-aff9-2da6677faaf8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:34.962322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbe331b6-13a8-48d3-aff9-2da6677faaf8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:34.962322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbe331b6-13a8-48d3-aff9-2da6677faaf8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:34.962322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbe331b6-13a8-48d3-aff9-2da6677faaf8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:34.962322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbe331b6-13a8-48d3-aff9-2da6677faaf8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:34.962637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbe331b6-13a8-48d3-aff9-2da6677faaf8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:34.997542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-3e4dba33-5164-4eec-a111-c4a055eea3c2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:35.031350 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3e4dba33-5164-4eec-a111-c4a055eea3c2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.154527 Oct 29 01:08:35.045960 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 589/1210] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:34 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:08:35.059764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a0889ebb-d72d-4dfc-90fd-bad4051af1f8 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Calling method '.version_select at 0x7f9d97f6c790>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:35.061664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0889ebb-d72d-4dfc-90fd-bad4051af1f8 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:35.062352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0889ebb-d72d-4dfc-90fd-bad4051af1f8 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:35.062951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0889ebb-d72d-4dfc-90fd-bad4051af1f8 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:35.085313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0889ebb-d72d-4dfc-90fd-bad4051af1f8 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:35.085313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0889ebb-d72d-4dfc-90fd-bad4051af1f8 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:35.085313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0889ebb-d72d-4dfc-90fd-bad4051af1f8 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:35.094672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0889ebb-d72d-4dfc-90fd-bad4051af1f8 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:35.095374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0889ebb-d72d-4dfc-90fd-bad4051af1f8 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:35.095972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0889ebb-d72d-4dfc-90fd-bad4051af1f8 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:35.104702 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a0889ebb-d72d-4dfc-90fd-bad4051af1f8 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.057503 Oct 29 01:08:35.106473 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 590/1211] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:08:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:35.118136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f5459989-e413-4032-800e-cb50bd4ba77e tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Calling method '.version_select at 0x7f9d97db08b0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:35.120513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5459989-e413-4032-800e-cb50bd4ba77e tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:35.120997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5459989-e413-4032-800e-cb50bd4ba77e tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:35.121827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5459989-e413-4032-800e-cb50bd4ba77e tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:35.135666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dbe331b6-13a8-48d3-aff9-2da6677faaf8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:35.136352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5459989-e413-4032-800e-cb50bd4ba77e tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:35.137550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5459989-e413-4032-800e-cb50bd4ba77e tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:35.138565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5459989-e413-4032-800e-cb50bd4ba77e tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:35.146506 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dbe331b6-13a8-48d3-aff9-2da6677faaf8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1503 microversion: 2.1 time: 0.203004 Oct 29 01:08:35.147412 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f5459989-e413-4032-800e-cb50bd4ba77e tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.033186 Oct 29 01:08:35.147558 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 622/1212] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:34 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1503 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:35.149934 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 591/1213] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:08:35 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:35.165648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-50082e1a-625e-413f-ac79-3639216018c9 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Calling method '.version_select at 0x7f9d97e0b280>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:35.167365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50082e1a-625e-413f-ac79-3639216018c9 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:35.167845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50082e1a-625e-413f-ac79-3639216018c9 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:35.168283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50082e1a-625e-413f-ac79-3639216018c9 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:35.363734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3458b813-9f36-4c9c-914f-4d5f04695930 tempest-ListImagesTestJSON-1833087440 tempest-ListImagesTestJSON-1833087440-project] Calling method '.version_select at 0x7f9d97d43a60>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:35.368590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:35.380404 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-50082e1a-625e-413f-ac79-3639216018c9 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 266 microversion: 2.1 time: 0.218524 Oct 29 01:08:35.381213 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 623/1214] 10.222.0.26 () {58 vars in 1179 bytes} [Sat Oct 29 01:08:35 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:35.394404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9b349e14-d84b-4dd4-b30a-6af5cc4e8e54 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Calling method '.version_select at 0x7f9d979ad8b0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:35.396598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b349e14-d84b-4dd4-b30a-6af5cc4e8e54 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:35.397091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b349e14-d84b-4dd4-b30a-6af5cc4e8e54 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:35.397558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b349e14-d84b-4dd4-b30a-6af5cc4e8e54 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:35.413491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b349e14-d84b-4dd4-b30a-6af5cc4e8e54 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:35.414058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b349e14-d84b-4dd4-b30a-6af5cc4e8e54 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:35.414580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b349e14-d84b-4dd4-b30a-6af5cc4e8e54 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:35.416333 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3458b813-9f36-4c9c-914f-4d5f04695930 tempest-ListImagesTestJSON-1833087440 tempest-ListImagesTestJSON-1833087440-project] 10.222.0.26 "GET /compute/v2.1/images/99205ec5-992b-4d3c-9bcd-04eb4b06191a" status: 200 len: 784 microversion: 2.1 time: 0.205376 Oct 29 01:08:35.416904 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 592/1215] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:08:35 2022] GET /compute/v2.1/images/99205ec5-992b-4d3c-9bcd-04eb4b06191a => generated 784 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:35.424905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b349e14-d84b-4dd4-b30a-6af5cc4e8e54 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:35.425972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b349e14-d84b-4dd4-b30a-6af5cc4e8e54 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:35.426567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b349e14-d84b-4dd4-b30a-6af5cc4e8e54 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:35.432295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f32481a3-59d5-4dd8-a3e6-4fef62c4dcb1 tempest-ListImagesTestJSON-1833087440 tempest-ListImagesTestJSON-1833087440-project] Calling method '.version_select at 0x7f9d97db0550>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:35.433457 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9b349e14-d84b-4dd4-b30a-6af5cc4e8e54 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.042744 Oct 29 01:08:35.434122 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 624/1216] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:08:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:35.445601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bab3b8f7-6349-4cf8-9b58-cd9516288540 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Calling method '.version_select at 0x7f9d979adca0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:35.447805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bab3b8f7-6349-4cf8-9b58-cd9516288540 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:35.448288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bab3b8f7-6349-4cf8-9b58-cd9516288540 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:35.448862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bab3b8f7-6349-4cf8-9b58-cd9516288540 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:35.465279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bab3b8f7-6349-4cf8-9b58-cd9516288540 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:35.465866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bab3b8f7-6349-4cf8-9b58-cd9516288540 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:35.466514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bab3b8f7-6349-4cf8-9b58-cd9516288540 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:35.474148 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bab3b8f7-6349-4cf8-9b58-cd9516288540 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.032574 Oct 29 01:08:35.474752 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 625/1217] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:08:35 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:35.488827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-669a334c-1af0-4487-91b6-fa92bdd374d1 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Calling method '.version_select at 0x7f9d979adb80>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:35.490631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-669a334c-1af0-4487-91b6-fa92bdd374d1 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:35.491117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-669a334c-1af0-4487-91b6-fa92bdd374d1 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:35.491739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-669a334c-1af0-4487-91b6-fa92bdd374d1 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:35.508338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-669a334c-1af0-4487-91b6-fa92bdd374d1 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:35.508338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-669a334c-1af0-4487-91b6-fa92bdd374d1 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:35.508338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-669a334c-1af0-4487-91b6-fa92bdd374d1 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:35.515744 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-669a334c-1af0-4487-91b6-fa92bdd374d1 tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.030478 Oct 29 01:08:35.522226 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f32481a3-59d5-4dd8-a3e6-4fef62c4dcb1 tempest-ListImagesTestJSON-1833087440 tempest-ListImagesTestJSON-1833087440-project] 10.222.0.26 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.094063 Oct 29 01:08:35.522801 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 593/1218] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 29 01:08:35 2022] GET /compute/v2.1/images => generated 871 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:08:35.525323 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 626/1219] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:08:35 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:35.534568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7c4bf3be-81d8-4320-ac95-515784edf04b tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Calling method '.version_select at 0x7f9d97f1cf70>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:35.536776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c4bf3be-81d8-4320-ac95-515784edf04b tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:35.537292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c4bf3be-81d8-4320-ac95-515784edf04b tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:35.538257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c4bf3be-81d8-4320-ac95-515784edf04b tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:35.548115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c560a67e-fd52-45a2-9fbd-3ba784736bfe tempest-ListImagesTestJSON-1833087440 tempest-ListImagesTestJSON-1833087440-project] Calling method '.version_select at 0x7f9d979eea60>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:35.553479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c4bf3be-81d8-4320-ac95-515784edf04b tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:35.554298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c4bf3be-81d8-4320-ac95-515784edf04b tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:35.555091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c4bf3be-81d8-4320-ac95-515784edf04b tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:35.570476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c4bf3be-81d8-4320-ac95-515784edf04b tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:35.570969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c4bf3be-81d8-4320-ac95-515784edf04b tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:35.571486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c4bf3be-81d8-4320-ac95-515784edf04b tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:35.612400 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7c4bf3be-81d8-4320-ac95-515784edf04b tempest-HypervisorAdminTestJSON-1911929150 tempest-HypervisorAdminTestJSON-1911929150-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.082532 Oct 29 01:08:35.612801 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 594/1220] 10.222.0.26 () {58 vars in 1173 bytes} [Sat Oct 29 01:08:35 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:08:35.623755 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c560a67e-fd52-45a2-9fbd-3ba784736bfe tempest-ListImagesTestJSON-1833087440 tempest-ListImagesTestJSON-1833087440-project] 10.222.0.26 "GET /compute/v2.1/images/detail" status: 200 len: 1475 microversion: 2.1 time: 0.085502 Oct 29 01:08:35.624674 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 627/1221] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 29 01:08:35 2022] GET /compute/v2.1/images/detail => generated 1475 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:35.842047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f330ea50-4a14-4ff8-ab1d-fbe9549f54e4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:35.843711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f330ea50-4a14-4ff8-ab1d-fbe9549f54e4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:35.848030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:35.853116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f330ea50-4a14-4ff8-ab1d-fbe9549f54e4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:35.854436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f330ea50-4a14-4ff8-ab1d-fbe9549f54e4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:35.854436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f330ea50-4a14-4ff8-ab1d-fbe9549f54e4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:35.854744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f330ea50-4a14-4ff8-ab1d-fbe9549f54e4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:35.855798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f330ea50-4a14-4ff8-ab1d-fbe9549f54e4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:35.856238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f330ea50-4a14-4ff8-ab1d-fbe9549f54e4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:36.011075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-556637e9-a3e0-4e90-8fd9-7210bf3e1e5a req-b489e14d-64ab-4a85-b48c-3732f98abe7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f346c718-28f2-4983-84f1-70909b4505a7", "name": "network-vif-unplugged", "status": "completed", "tag": "dce0d611-7bbc-4151-915f-2f5d25b6d83b"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:36.029415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-556637e9-a3e0-4e90-8fd9-7210bf3e1e5a req-b489e14d-64ab-4a85-b48c-3732f98abe7a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:36.029800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-556637e9-a3e0-4e90-8fd9-7210bf3e1e5a req-b489e14d-64ab-4a85-b48c-3732f98abe7a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:36.030234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-556637e9-a3e0-4e90-8fd9-7210bf3e1e5a req-b489e14d-64ab-4a85-b48c-3732f98abe7a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:36.045712 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-556637e9-a3e0-4e90-8fd9-7210bf3e1e5a req-b489e14d-64ab-4a85-b48c-3732f98abe7a service nova] Creating event network-vif-unplugged:dce0d611-7bbc-4151-915f-2f5d25b6d83b for instance f346c718-28f2-4983-84f1-70909b4505a7 on n-h1-862964-3 Oct 29 01:08:36.052376 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-556637e9-a3e0-4e90-8fd9-7210bf3e1e5a req-b489e14d-64ab-4a85-b48c-3732f98abe7a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046049 Oct 29 01:08:36.056001 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 628/1222] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:08:36.068238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b32be293-f6ef-4ce1-a27d-41ffefd5c728 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:36.069988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b32be293-f6ef-4ce1-a27d-41ffefd5c728 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:36.078581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b32be293-f6ef-4ce1-a27d-41ffefd5c728 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:36.079180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b32be293-f6ef-4ce1-a27d-41ffefd5c728 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:36.079759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b32be293-f6ef-4ce1-a27d-41ffefd5c728 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:36.082166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b32be293-f6ef-4ce1-a27d-41ffefd5c728 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:36.083037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b32be293-f6ef-4ce1-a27d-41ffefd5c728 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:36.083617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b32be293-f6ef-4ce1-a27d-41ffefd5c728 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:36.354848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-b32be293-f6ef-4ce1-a27d-41ffefd5c728 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:36.385410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f330ea50-4a14-4ff8-ab1d-fbe9549f54e4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:36.396114 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f330ea50-4a14-4ff8-ab1d-fbe9549f54e4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1470 microversion: 2.1 time: 0.558277 Oct 29 01:08:36.397255 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 595/1223] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:35 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1470 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:36.400946 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b32be293-f6ef-4ce1-a27d-41ffefd5c728 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.339806 Oct 29 01:08:36.403823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a31d8f1a-289d-4c23-bf3f-7ebd7a705eb8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:36.407233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a31d8f1a-289d-4c23-bf3f-7ebd7a705eb8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:36.426181 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 629/1224] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:36 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:08:36.430680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a31d8f1a-289d-4c23-bf3f-7ebd7a705eb8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:36.432718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a31d8f1a-289d-4c23-bf3f-7ebd7a705eb8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:36.434655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a31d8f1a-289d-4c23-bf3f-7ebd7a705eb8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:36.436561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a31d8f1a-289d-4c23-bf3f-7ebd7a705eb8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:36.438696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c96d65fe-9a5d-4a13-addf-6002b01b56d3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:36.438953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a31d8f1a-289d-4c23-bf3f-7ebd7a705eb8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:36.439470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a31d8f1a-289d-4c23-bf3f-7ebd7a705eb8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:36.441003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c96d65fe-9a5d-4a13-addf-6002b01b56d3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:36.452736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c96d65fe-9a5d-4a13-addf-6002b01b56d3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:36.453254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c96d65fe-9a5d-4a13-addf-6002b01b56d3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:36.453696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c96d65fe-9a5d-4a13-addf-6002b01b56d3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:36.461564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c96d65fe-9a5d-4a13-addf-6002b01b56d3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:36.462115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c96d65fe-9a5d-4a13-addf-6002b01b56d3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:36.462563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c96d65fe-9a5d-4a13-addf-6002b01b56d3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:36.630773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a31d8f1a-289d-4c23-bf3f-7ebd7a705eb8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:36.639610 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a31d8f1a-289d-4c23-bf3f-7ebd7a705eb8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1503 microversion: 2.1 time: 0.241031 Oct 29 01:08:36.640258 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 596/1225] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:36 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1503 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:36.764879 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c96d65fe-9a5d-4a13-addf-6002b01b56d3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "POST /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc/action" status: 204 len: 0 microversion: 2.1 time: 0.336373 Oct 29 01:08:36.766052 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 630/1226] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:08:36 2022] POST /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc/action => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:08:36.778252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-419d9ec9-955c-409a-b204-3bc058cf4946 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:36.779429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-419d9ec9-955c-409a-b204-3bc058cf4946 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:36.790263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-419d9ec9-955c-409a-b204-3bc058cf4946 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:36.791073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-419d9ec9-955c-409a-b204-3bc058cf4946 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:36.791518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-419d9ec9-955c-409a-b204-3bc058cf4946 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:36.796897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-419d9ec9-955c-409a-b204-3bc058cf4946 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:36.796897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-419d9ec9-955c-409a-b204-3bc058cf4946 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:36.796897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-419d9ec9-955c-409a-b204-3bc058cf4946 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:37.195635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-419d9ec9-955c-409a-b204-3bc058cf4946 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:37.203817 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-419d9ec9-955c-409a-b204-3bc058cf4946 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1470 microversion: 2.1 time: 0.432739 Oct 29 01:08:37.217572 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 597/1227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:36 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1470 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:37.436528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-521bc51a-00a2-40c4-9b58-1fbafe306c0f tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:37.437940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-521bc51a-00a2-40c4-9b58-1fbafe306c0f tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:37.446380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-521bc51a-00a2-40c4-9b58-1fbafe306c0f tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:37.447868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-521bc51a-00a2-40c4-9b58-1fbafe306c0f tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:37.448726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-521bc51a-00a2-40c4-9b58-1fbafe306c0f tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:37.450111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-521bc51a-00a2-40c4-9b58-1fbafe306c0f tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:37.450942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-521bc51a-00a2-40c4-9b58-1fbafe306c0f tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:37.452094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-521bc51a-00a2-40c4-9b58-1fbafe306c0f tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:37.596940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-521bc51a-00a2-40c4-9b58-1fbafe306c0f tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:37.622055 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-521bc51a-00a2-40c4-9b58-1fbafe306c0f tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.194061 Oct 29 01:08:37.623660 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 631/1228] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:37 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:37.667482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c76ebcb6-7983-4faf-a9d8-eb7a3053a26c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:37.669556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c76ebcb6-7983-4faf-a9d8-eb7a3053a26c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:37.680444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c76ebcb6-7983-4faf-a9d8-eb7a3053a26c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:37.681611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c76ebcb6-7983-4faf-a9d8-eb7a3053a26c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:37.682376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c76ebcb6-7983-4faf-a9d8-eb7a3053a26c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:37.683875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c76ebcb6-7983-4faf-a9d8-eb7a3053a26c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:37.684522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c76ebcb6-7983-4faf-a9d8-eb7a3053a26c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:37.685130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c76ebcb6-7983-4faf-a9d8-eb7a3053a26c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:38.052178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c76ebcb6-7983-4faf-a9d8-eb7a3053a26c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:38.074730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-2fb0ca90-34f0-4d03-84ca-b3e25911f530 req-01449a27-175f-417a-823d-37157b378159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f346c718-28f2-4983-84f1-70909b4505a7", "tag": "dce0d611-7bbc-4151-915f-2f5d25b6d83b"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:38.101621 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c76ebcb6-7983-4faf-a9d8-eb7a3053a26c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1503 microversion: 2.1 time: 0.437621 Oct 29 01:08:38.102317 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 598/1229] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:37 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1503 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:38.118473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2fb0ca90-34f0-4d03-84ca-b3e25911f530 req-01449a27-175f-417a-823d-37157b378159 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:38.118473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2fb0ca90-34f0-4d03-84ca-b3e25911f530 req-01449a27-175f-417a-823d-37157b378159 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:38.118473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2fb0ca90-34f0-4d03-84ca-b3e25911f530 req-01449a27-175f-417a-823d-37157b378159 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:38.124780 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-2fb0ca90-34f0-4d03-84ca-b3e25911f530 req-01449a27-175f-417a-823d-37157b378159 service nova] Creating event network-changed:dce0d611-7bbc-4151-915f-2f5d25b6d83b for instance f346c718-28f2-4983-84f1-70909b4505a7 on n-h1-862964-3 Oct 29 01:08:38.137803 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-2fb0ca90-34f0-4d03-84ca-b3e25911f530 req-01449a27-175f-417a-823d-37157b378159 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067811 Oct 29 01:08:38.138937 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 632/1230] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:08:38.228566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e8357cbe-8d29-4216-9ba3-da394d603433 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:38.229837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e8357cbe-8d29-4216-9ba3-da394d603433 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:38.241080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8357cbe-8d29-4216-9ba3-da394d603433 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:38.242498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8357cbe-8d29-4216-9ba3-da394d603433 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:38.242826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8357cbe-8d29-4216-9ba3-da394d603433 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:38.244069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8357cbe-8d29-4216-9ba3-da394d603433 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:38.244932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8357cbe-8d29-4216-9ba3-da394d603433 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:38.245616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8357cbe-8d29-4216-9ba3-da394d603433 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:38.654091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-91b815df-7911-4bfd-aeb9-b890c263855e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:38.655196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-91b815df-7911-4bfd-aeb9-b890c263855e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:38.665859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91b815df-7911-4bfd-aeb9-b890c263855e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:38.666569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91b815df-7911-4bfd-aeb9-b890c263855e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:38.672761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91b815df-7911-4bfd-aeb9-b890c263855e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:38.672761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91b815df-7911-4bfd-aeb9-b890c263855e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:38.672761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91b815df-7911-4bfd-aeb9-b890c263855e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:38.672761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91b815df-7911-4bfd-aeb9-b890c263855e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:38.788318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e8357cbe-8d29-4216-9ba3-da394d603433 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:38.799058 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e8357cbe-8d29-4216-9ba3-da394d603433 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1470 microversion: 2.1 time: 0.574472 Oct 29 01:08:38.806988 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 599/1231] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:38 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1470 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:38.858821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-91b815df-7911-4bfd-aeb9-b890c263855e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:38.891571 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-91b815df-7911-4bfd-aeb9-b890c263855e tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.243244 Oct 29 01:08:38.903120 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 633/1232] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:38 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:39.103464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ccf4fe7a-572b-4228-b3d2-4f440027dd38 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Action: 'create', calling method: .version_select at 0x7f9d97d99040>, body: {"keypair": {"name": "tempest-keypair-913488315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsWC8NZCf6Jwq9fHuY2xaTgO8x7q23j11COFhlvmbwcD6a5CdmoIwUDUd1/AA3Y9WFkuZFuiyz+PAKR+7aR5zHpIpRhPF5g+YkBbtfzAQt6ayUwuCx+nSy0UbJLsNqzgw=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:39.127244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7dc7a506-ec39-462f-831b-66c7c17be5e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:39.128454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7dc7a506-ec39-462f-831b-66c7c17be5e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:39.139741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc7a506-ec39-462f-831b-66c7c17be5e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:39.142801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc7a506-ec39-462f-831b-66c7c17be5e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:39.143432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc7a506-ec39-462f-831b-66c7c17be5e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:39.148735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc7a506-ec39-462f-831b-66c7c17be5e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:39.149251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc7a506-ec39-462f-831b-66c7c17be5e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:39.149682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc7a506-ec39-462f-831b-66c7c17be5e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:39.154568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-ccf4fe7a-572b-4228-b3d2-4f440027dd38 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Getting quotas for project 0f92739e0a8b40cda9532d32c50f5cd0. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:08:39.178293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-ccf4fe7a-572b-4228-b3d2-4f440027dd38 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Getting quotas for user 199b6dcddf3b4ecdbbf859d815116d99 and project 0f92739e0a8b40cda9532d32c50f5cd0. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:08:39.300863 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ccf4fe7a-572b-4228-b3d2-4f440027dd38 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.414570 Oct 29 01:08:39.300863 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 600/1233] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:08:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:39.306364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-a710dbe2-92db-4a97-b06a-a8462e74fba5 req-ee9a096c-15f5-41fe-97d2-0b4a424a27a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f415677-47ed-437a-a567-2831f34712dc", "name": "network-vif-plugged", "status": "completed", "tag": "7d6159a8-d4d4-4879-bf83-176011337775"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:39.339958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:39.344829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a710dbe2-92db-4a97-b06a-a8462e74fba5 req-ee9a096c-15f5-41fe-97d2-0b4a424a27a6 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:39.348558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a710dbe2-92db-4a97-b06a-a8462e74fba5 req-ee9a096c-15f5-41fe-97d2-0b4a424a27a6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:39.349310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a710dbe2-92db-4a97-b06a-a8462e74fba5 req-ee9a096c-15f5-41fe-97d2-0b4a424a27a6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:39.382662 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-a710dbe2-92db-4a97-b06a-a8462e74fba5 req-ee9a096c-15f5-41fe-97d2-0b4a424a27a6 service nova] Creating event network-vif-plugged:7d6159a8-d4d4-4879-bf83-176011337775 for instance 4f415677-47ed-437a-a567-2831f34712dc on n-h2-862964-3 Oct 29 01:08:39.388417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:39.390489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [req-a710dbe2-92db-4a97-b06a-a8462e74fba5 req-ee9a096c-15f5-41fe-97d2-0b4a424a27a6 service nova] Instance 4f415677-47ed-437a-a567-2831f34712dc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121100) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:08:39.408211 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-a710dbe2-92db-4a97-b06a-a8462e74fba5 req-ee9a096c-15f5-41fe-97d2-0b4a424a27a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116276 Oct 29 01:08:39.412416 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 601/1234] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:39.419292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-726556ca-bee2-45c5-a36c-41f78c7e1e84 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Calling method '.version_select at 0x7f9d97d22b80>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:39.432135 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-726556ca-bee2-45c5-a36c-41f78c7e1e84 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-913488315" status: 200 len: 496 microversion: 2.1 time: 0.015641 Oct 29 01:08:39.437326 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 602/1235] 10.222.0.26 () {58 vars in 1215 bytes} [Sat Oct 29 01:08:39 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-913488315 => generated 496 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:39.453120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-273c5de7-710a-41f6-a0dd-c3d20bc3665f tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Calling method '.version_select at 0x7f9d97db0430>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:39.481846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7dc7a506-ec39-462f-831b-66c7c17be5e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:39.490981 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7dc7a506-ec39-462f-831b-66c7c17be5e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1503 microversion: 2.1 time: 0.368151 Oct 29 01:08:39.491626 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 634/1236] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:39 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1503 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:39.540975 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-273c5de7-710a-41f6-a0dd-c3d20bc3665f tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-913488315" status: 202 len: 0 microversion: 2.1 time: 0.094114 Oct 29 01:08:39.542175 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 603/1237] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 29 01:08:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-913488315 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:08:39.556893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5f61eb6a-98d9-4653-bff0-f0b79ee713d1 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Action: 'create', calling method: .version_select at 0x7f9d979cf9d0>, body: {"keypair": {"name": "tempest-keypair-1603407329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9XfYflwj1zjMQ0D9g4z6K7KkEuvTqh2eOsostq2PSSBq6mi7qIzqByz+j5Iq3xXX8GYNFZ+wPClRhl88yiFv+kqEQvKTedzv19Q/vW08su/FRRWJPb13WxC1/ZmUPzQw=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:39.598529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-5f61eb6a-98d9-4653-bff0-f0b79ee713d1 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Getting quotas for project 0f92739e0a8b40cda9532d32c50f5cd0. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:08:39.604585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-5f61eb6a-98d9-4653-bff0-f0b79ee713d1 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Getting quotas for user 199b6dcddf3b4ecdbbf859d815116d99 and project 0f92739e0a8b40cda9532d32c50f5cd0. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:08:39.710110 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5f61eb6a-98d9-4653-bff0-f0b79ee713d1 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.158428 Oct 29 01:08:39.714149 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 635/1238] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:08:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:39.722383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a542d26a-b9d8-4a2b-8a1a-ff38da3c27bd tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Calling method '.version_select at 0x7f9d97de4dc0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:39.826884 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a542d26a-b9d8-4a2b-8a1a-ff38da3c27bd tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1603407329" status: 202 len: 0 microversion: 2.1 time: 0.108727 Oct 29 01:08:39.829176 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 604/1239] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 29 01:08:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1603407329 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:08:39.831655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0130353b-db0f-404f-9f8d-a1f6acfb6929 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:39.832403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0130353b-db0f-404f-9f8d-a1f6acfb6929 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:39.839581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-db27cb86-2cb3-4748-8a35-71fbd3a33824 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Action: 'create', calling method: .version_select at 0x7f9d97d6ac10>, body: {"keypair": {"name": "tempest-keypair-255505616", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:39.842440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0130353b-db0f-404f-9f8d-a1f6acfb6929 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:39.843536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0130353b-db0f-404f-9f8d-a1f6acfb6929 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:39.844481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0130353b-db0f-404f-9f8d-a1f6acfb6929 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:39.846162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0130353b-db0f-404f-9f8d-a1f6acfb6929 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:39.848381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0130353b-db0f-404f-9f8d-a1f6acfb6929 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:39.849423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0130353b-db0f-404f-9f8d-a1f6acfb6929 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:39.881893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-db27cb86-2cb3-4748-8a35-71fbd3a33824 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Getting quotas for project 0f92739e0a8b40cda9532d32c50f5cd0. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:08:39.894972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-db27cb86-2cb3-4748-8a35-71fbd3a33824 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Getting quotas for user 199b6dcddf3b4ecdbbf859d815116d99 and project 0f92739e0a8b40cda9532d32c50f5cd0. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:08:40.017859 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-db27cb86-2cb3-4748-8a35-71fbd3a33824 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.182364 Oct 29 01:08:40.019047 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 605/1240] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:08:39 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:08:40.024385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-51436038-30d9-4cd8-859f-6d9567ecc209 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:40.026305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-51436038-30d9-4cd8-859f-6d9567ecc209 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:40.038394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51436038-30d9-4cd8-859f-6d9567ecc209 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:40.038394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51436038-30d9-4cd8-859f-6d9567ecc209 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:40.040312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51436038-30d9-4cd8-859f-6d9567ecc209 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:40.040312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51436038-30d9-4cd8-859f-6d9567ecc209 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:40.040653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51436038-30d9-4cd8-859f-6d9567ecc209 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:40.041078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51436038-30d9-4cd8-859f-6d9567ecc209 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:40.149759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-51436038-30d9-4cd8-859f-6d9567ecc209 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:40.150046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0130353b-db0f-404f-9f8d-a1f6acfb6929 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:40.162066 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0130353b-db0f-404f-9f8d-a1f6acfb6929 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1470 microversion: 2.1 time: 0.341842 Oct 29 01:08:40.162781 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 636/1241] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:39 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1470 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:40.168662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d8bdbda1-1de9-4c01-bedd-b82ae1db62a8 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Calling method '.version_select at 0x7f9d9c418ca0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:40.173996 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-51436038-30d9-4cd8-859f-6d9567ecc209 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.153762 Oct 29 01:08:40.174898 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 606/1242] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:40 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:40.497415 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d8bdbda1-1de9-4c01-bedd-b82ae1db62a8 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-255505616" status: 202 len: 0 microversion: 2.1 time: 0.332485 Oct 29 01:08:40.498441 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 637/1243] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 29 01:08:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-255505616 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:08:40.516750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b3ab49a9-5177-407c-a5d4-b4a376fb2594 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Action: 'create', calling method: .version_select at 0x7f9d97d6a8b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1122716717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/zKrYyRFnQCuEtppbwjpIrx3iDiTy5Q12azY4J1G2lxnczumUpSoAHLVotLyg1rdTr+rlh84rEAL/7V3OPQFAsjQi3hZpALO2gQXZD7KCpn0d/hqrOQNyGN3MIYO42+g=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:40.520992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6e6dcf3b-4acc-4ace-b6c9-e298769089f1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:40.521642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6e6dcf3b-4acc-4ace-b6c9-e298769089f1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:40.538894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e6dcf3b-4acc-4ace-b6c9-e298769089f1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:40.538894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e6dcf3b-4acc-4ace-b6c9-e298769089f1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:40.540894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e6dcf3b-4acc-4ace-b6c9-e298769089f1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:40.545789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e6dcf3b-4acc-4ace-b6c9-e298769089f1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:40.546795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e6dcf3b-4acc-4ace-b6c9-e298769089f1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:40.547463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e6dcf3b-4acc-4ace-b6c9-e298769089f1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:40.554001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-b3ab49a9-5177-407c-a5d4-b4a376fb2594 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Getting quotas for project 0f92739e0a8b40cda9532d32c50f5cd0. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:08:40.560901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-b3ab49a9-5177-407c-a5d4-b4a376fb2594 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Getting quotas for user 199b6dcddf3b4ecdbbf859d815116d99 and project 0f92739e0a8b40cda9532d32c50f5cd0. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:08:40.651890 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b3ab49a9-5177-407c-a5d4-b4a376fb2594 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.142160 Oct 29 01:08:40.652587 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 607/1244] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:08:40 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:40.666498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4b7524b0-c9c2-4e56-bb24-244e1195ee2d tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Action: 'create', calling method: .version_select at 0x7f9d97d22c10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-645671586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdG+C+npglsFVk4cSQuGOamZu/fVJsCD4kRq7nbw3oDYvv8/9wIW9qJqwOLD0TV/5yf0FtzMHimEPaSGVUt4v2zafa7JTmLnPNVBCfMQUyYWggqx6ca08qbe3QVfZV5vQ=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:40.684279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-4b7524b0-c9c2-4e56-bb24-244e1195ee2d tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Getting quotas for project 0f92739e0a8b40cda9532d32c50f5cd0. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:08:40.694576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-4b7524b0-c9c2-4e56-bb24-244e1195ee2d tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Getting quotas for user 199b6dcddf3b4ecdbbf859d815116d99 and project 0f92739e0a8b40cda9532d32c50f5cd0. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:08:40.820013 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4b7524b0-c9c2-4e56-bb24-244e1195ee2d tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.157509 Oct 29 01:08:40.825682 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 608/1245] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:08:40 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:08:40.838743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c818eb4d-ac9f-4aa7-bf7b-5286ef212eb9 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Action: 'create', calling method: .version_select at 0x7f9d97d99550>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1211263123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWEGqRVYMKpSfqsrmT+oLyPnk/3a/7pDproY4bCGhQThXbYH0u73E7AHdRniNEYCE2pQ0kEGiwe0QsCj7+Zs7vQunPzGDZZMzf32pRW7pAjbuuBeX/iz9E+CcNUESssMw=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:40.863623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-c818eb4d-ac9f-4aa7-bf7b-5286ef212eb9 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Getting quotas for project 0f92739e0a8b40cda9532d32c50f5cd0. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:08:40.873790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-c818eb4d-ac9f-4aa7-bf7b-5286ef212eb9 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Getting quotas for user 199b6dcddf3b4ecdbbf859d815116d99 and project 0f92739e0a8b40cda9532d32c50f5cd0. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:08:40.963859 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c818eb4d-ac9f-4aa7-bf7b-5286ef212eb9 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.129339 Oct 29 01:08:40.966336 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 609/1246] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:08:40 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:40.990779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-25306a8a-82bf-4c08-95d0-6f6e96a0fe28 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Calling method '.version_select at 0x7f9d97d6a5e0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:40.995659 n-d-862964-3 devstack@n-api.service[121100]: WARNING oslo_db.sqlalchemy.utils [None req-25306a8a-82bf-4c08-95d0-6f6e96a0fe28 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 01:08:41.002313 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-25306a8a-82bf-4c08-95d0-6f6e96a0fe28 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.018847 Oct 29 01:08:41.003849 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 610/1247] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:08:40 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:41.017462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d98f0eb5-9878-48c3-a288-97398f8f56c8 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Calling method '.version_select at 0x7f9d97e2caf0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:41.108174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6e6dcf3b-4acc-4ace-b6c9-e298769089f1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:41.119190 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6e6dcf3b-4acc-4ace-b6c9-e298769089f1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1503 microversion: 2.1 time: 0.603642 Oct 29 01:08:41.120282 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 638/1248] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:40 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1503 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:41.156624 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d98f0eb5-9878-48c3-a288-97398f8f56c8 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1211263123" status: 202 len: 0 microversion: 2.1 time: 0.144840 Oct 29 01:08:41.161708 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 611/1249] 10.222.0.26 () {58 vars in 1278 bytes} [Sat Oct 29 01:08:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1211263123 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:08:41.168214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d47c4a10-69f7-4174-98b3-91c3650a7cb5 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Calling method '.version_select at 0x7f9d97ae1f70>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:41.185504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-22ad4cac-aaf5-485a-adcc-974feb086001 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:41.186122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-22ad4cac-aaf5-485a-adcc-974feb086001 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:41.193650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22ad4cac-aaf5-485a-adcc-974feb086001 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:41.194797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22ad4cac-aaf5-485a-adcc-974feb086001 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:41.195411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22ad4cac-aaf5-485a-adcc-974feb086001 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:41.196302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22ad4cac-aaf5-485a-adcc-974feb086001 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:41.196933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22ad4cac-aaf5-485a-adcc-974feb086001 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:41.197573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22ad4cac-aaf5-485a-adcc-974feb086001 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:41.256624 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d47c4a10-69f7-4174-98b3-91c3650a7cb5 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-645671586" status: 202 len: 0 microversion: 2.1 time: 0.091144 Oct 29 01:08:41.257696 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 639/1250] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:08:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-645671586 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:08:41.264706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-676fdd76-d2bd-40f2-a907-a0ef488c2939 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:41.265425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-676fdd76-d2bd-40f2-a907-a0ef488c2939 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:41.272882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-676fdd76-d2bd-40f2-a907-a0ef488c2939 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:41.273403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-676fdd76-d2bd-40f2-a907-a0ef488c2939 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:41.273847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-676fdd76-d2bd-40f2-a907-a0ef488c2939 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:41.274556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-676fdd76-d2bd-40f2-a907-a0ef488c2939 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:41.275346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-676fdd76-d2bd-40f2-a907-a0ef488c2939 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:41.276502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-676fdd76-d2bd-40f2-a907-a0ef488c2939 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:41.408029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-676fdd76-d2bd-40f2-a907-a0ef488c2939 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:41.429348 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-676fdd76-d2bd-40f2-a907-a0ef488c2939 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.169781 Oct 29 01:08:41.430230 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 640/1251] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:41 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:41.457732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9497381a-2160-4975-a036-51d2c3f08065 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] Calling method '.version_select at 0x7f9d97a164c0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:41.541192 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9497381a-2160-4975-a036-51d2c3f08065 tempest-KeyPairsV2TestJSON-728681664 tempest-KeyPairsV2TestJSON-728681664-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1122716717" status: 202 len: 0 microversion: 2.1 time: 0.097745 Oct 29 01:08:41.543314 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 641/1252] 10.222.0.26 () {58 vars in 1278 bytes} [Sat Oct 29 01:08:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1122716717 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:08:41.598822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-22ad4cac-aaf5-485a-adcc-974feb086001 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:41.623783 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-22ad4cac-aaf5-485a-adcc-974feb086001 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1462 microversion: 2.1 time: 0.431190 Oct 29 01:08:41.623783 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 612/1253] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:41 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1462 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:41.648741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f556942e-4764-4fb8-ba34-aa45bd1142f3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:41.649388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f556942e-4764-4fb8-ba34-aa45bd1142f3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:41.655568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f556942e-4764-4fb8-ba34-aa45bd1142f3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:41.656184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f556942e-4764-4fb8-ba34-aa45bd1142f3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:41.656625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f556942e-4764-4fb8-ba34-aa45bd1142f3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:41.657354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f556942e-4764-4fb8-ba34-aa45bd1142f3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:41.657809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f556942e-4764-4fb8-ba34-aa45bd1142f3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:41.658231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f556942e-4764-4fb8-ba34-aa45bd1142f3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:41.869870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f556942e-4764-4fb8-ba34-aa45bd1142f3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:41.890307 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f556942e-4764-4fb8-ba34-aa45bd1142f3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1462 microversion: 2.1 time: 0.234787 Oct 29 01:08:41.890307 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 642/1254] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:41 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1462 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:41.911429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-017fe62a-efd7-49c2-bb27-879b65f17600 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Action: 'create', calling method: .version_select at 0x7f9d97de4430>, body: {"keypair": {"name": "tempest-keypair-628280039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsopVY0WmpVOdJco2G8by/dsmH52pfHrpLaIjeUoxdax4cq2YIwnYDhgKAeKO32wwj2kpJWgoJlDxRmvm7vCrxcu+fEwybEnAnw5ysz/xndw34E0Iu0HlgHtJS2DcGJLQ=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:41.948777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-017fe62a-efd7-49c2-bb27-879b65f17600 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Getting quotas for project 646dbadc4e9140348132e6950c885e81. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:08:41.962224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-017fe62a-efd7-49c2-bb27-879b65f17600 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Getting quotas for user 8219d81b19964408b9bc275a4457f389 and project 646dbadc4e9140348132e6950c885e81. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:08:42.052451 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-017fe62a-efd7-49c2-bb27-879b65f17600 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.145421 Oct 29 01:08:42.053080 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 613/1255] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:08:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:42.145583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8dcbeb5d-f535-4895-90f4-17a520065d4b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:42.146204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8dcbeb5d-f535-4895-90f4-17a520065d4b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:42.153784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8dcbeb5d-f535-4895-90f4-17a520065d4b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:42.154280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8dcbeb5d-f535-4895-90f4-17a520065d4b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:42.157001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8dcbeb5d-f535-4895-90f4-17a520065d4b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:42.158531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8dcbeb5d-f535-4895-90f4-17a520065d4b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:42.158656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8dcbeb5d-f535-4895-90f4-17a520065d4b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:42.159186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8dcbeb5d-f535-4895-90f4-17a520065d4b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:42.448112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8dcbeb5d-f535-4895-90f4-17a520065d4b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:42.460082 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8dcbeb5d-f535-4895-90f4-17a520065d4b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1503 microversion: 2.1 time: 0.319010 Oct 29 01:08:42.461566 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 643/1256] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:42 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1503 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:42.476667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d222189a-1323-42c7-941a-74e9abcfae31 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:42.479199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d222189a-1323-42c7-941a-74e9abcfae31 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:42.488426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d222189a-1323-42c7-941a-74e9abcfae31 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:42.488958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d222189a-1323-42c7-941a-74e9abcfae31 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:42.490540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d222189a-1323-42c7-941a-74e9abcfae31 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:42.494392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d222189a-1323-42c7-941a-74e9abcfae31 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:42.494962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d222189a-1323-42c7-941a-74e9abcfae31 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:42.496607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d222189a-1323-42c7-941a-74e9abcfae31 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:42.693275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c93ea6c9-b3d3-48d6-a6dd-3eca2dfda370 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Calling method '.version_select at 0x7f9d97de4e50>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:42.696075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c93ea6c9-b3d3-48d6-a6dd-3eca2dfda370 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'fe303df4a3294032861eeb93156a9669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20ddb856134236977744b8ce87ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c93ea6c9-b3d3-48d6-a6dd-3eca2dfda370 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Request method failure captured: Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH0Z795xfgv_cmn12YzBlN4eNMZeih2D-4vwy6_FtDluTVmViDP2mn0zWse1dRFQldSZeW_uBrJdujMq1sEUjuOADQV-IbUymHBZRk07V8_MWwWuWowdVrYyzSw1M4s3P27OVGJYk5JyM5YJo_lKribMh40kIWZNBKSGTtftBxYXqO8 Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 8f20ddb856134236977744b8ce87ca29 Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-581898503 Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:08:42.713814 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:08:42.715447 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f20ddb856134236977744b8ce87ca29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8f20ddb856134236977744b8ce87ca29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f20ddb856134236977744b8ce87ca29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8f20ddb856134236977744b8ce87ca29", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:42.715447 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-581898503 Oct 29 01:08:42.715447 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 8f20ddb856134236977744b8ce87ca29 Oct 29 01:08:42.715447 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-581898503 Oct 29 01:08:42.715447 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-HypervisorAdminNegativeTestJSON-581898503-project Oct 29 01:08:42.715447 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:08:42.715447 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:08:42.715447 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: fe303df4a3294032861eeb93156a9669 Oct 29 01:08:42.715447 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-581898503-project Oct 29 01:08:42.715447 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:08:42.715447 n-d-862964-3 devstack@n-api.service[121100]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 29 01:08:42.715447 n-d-862964-3 devstack@n-api.service[121100]: action_args: {} Oct 29 01:08:42.715447 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:42.716419 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:42.716419 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:42.716419 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:42.716419 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:42.716419 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:42.716419 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:08:42.716419 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:08:42.716419 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:42.716419 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:42.716419 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 29 01:08:42.716419 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 29 01:08:42.716419 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 29 01:08:42.716419 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 29 01:08:42.716419 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:08:42.716419 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:08:42.716419 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:08:42.716419 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:08:42.716419 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:08:42.716419 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:08:42.718573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:08:42.718573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:08:42.718573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:08:42.718573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:08:42.718573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:08:42.718573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:08:42.718573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:08:42.718573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:08:42.718573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 29 01:08:42.718573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:42.718573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:42.718573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:42.718573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:42.718573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:42.718573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:42.718573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:08:42.718573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:08:42.718573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 29 01:08:42.718573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:42.720838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c93ea6c9-b3d3-48d6-a6dd-3eca2dfda370 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:42.720838 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c93ea6c9-b3d3-48d6-a6dd-3eca2dfda370 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.365142 Oct 29 01:08:42.720838 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 614/1257] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Oct 29 01:08:42 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 367 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:42.725200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9fec074f-8d90-4b17-a202-a3fdae830ca6 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Calling method '.version_select at 0x7f9d97dbddc0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:42.734112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9fec074f-8d90-4b17-a202-a3fdae830ca6 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'fe303df4a3294032861eeb93156a9669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20ddb856134236977744b8ce87ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:42.742473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:42.750289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-d222189a-1323-42c7-941a-74e9abcfae31 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9fec074f-8d90-4b17-a202-a3fdae830ca6 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Request method failure captured: Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH0Z795xfgv_cmn12YzBlN4eNMZeih2D-4vwy6_FtDluTVmViDP2mn0zWse1dRFQldSZeW_uBrJdujMq1sEUjuOADQV-IbUymHBZRk07V8_MWwWuWowdVrYyzSw1M4s3P27OVGJYk5JyM5YJo_lKribMh40kIWZNBKSGTtftBxYXqO8 Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 8f20ddb856134236977744b8ce87ca29 Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-581898503 Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:08:42.753506 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:08:42.755103 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f20ddb856134236977744b8ce87ca29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8f20ddb856134236977744b8ce87ca29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f20ddb856134236977744b8ce87ca29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8f20ddb856134236977744b8ce87ca29", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:42.755103 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-581898503 Oct 29 01:08:42.755103 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 8f20ddb856134236977744b8ce87ca29 Oct 29 01:08:42.755103 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-581898503 Oct 29 01:08:42.755103 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-HypervisorAdminNegativeTestJSON-581898503-project Oct 29 01:08:42.755103 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:08:42.755103 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:08:42.755103 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: fe303df4a3294032861eeb93156a9669 Oct 29 01:08:42.755103 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-581898503-project Oct 29 01:08:42.755103 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:08:42.755103 n-d-862964-3 devstack@n-api.service[121100]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 29 01:08:42.755103 n-d-862964-3 devstack@n-api.service[121100]: action_args: {} Oct 29 01:08:42.755103 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:42.755926 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:42.755926 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:42.755926 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:42.755926 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:42.755926 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:42.755926 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:08:42.755926 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:08:42.755926 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:42.755926 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:42.755926 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 29 01:08:42.755926 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 29 01:08:42.755926 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 29 01:08:42.755926 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 29 01:08:42.755926 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:08:42.755926 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:08:42.755926 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:08:42.755926 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:08:42.755926 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:08:42.755926 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:08:42.764533 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:08:42.764533 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:08:42.764533 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:08:42.764533 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:08:42.764533 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:08:42.764533 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:08:42.764533 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:08:42.764533 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:08:42.764533 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 29 01:08:42.764533 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:42.764533 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:42.764533 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:42.764533 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:42.764533 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:42.764533 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:42.764533 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:08:42.764533 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:08:42.764533 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 29 01:08:42.764533 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:42.766119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9fec074f-8d90-4b17-a202-a3fdae830ca6 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:42.766119 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9fec074f-8d90-4b17-a202-a3fdae830ca6 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.039490 Oct 29 01:08:42.766119 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 615/1258] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:08:42 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:42.772152 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-02653a7c-59ad-4db2-9401-f5560f2a9817 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Calling method '.version_select at 0x7f9d97dbd1f0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:42.774495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-02653a7c-59ad-4db2-9401-f5560f2a9817 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'fe303df4a3294032861eeb93156a9669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20ddb856134236977744b8ce87ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-02653a7c-59ad-4db2-9401-f5560f2a9817 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Request method failure captured: Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH0Z795xfgv_cmn12YzBlN4eNMZeih2D-4vwy6_FtDluTVmViDP2mn0zWse1dRFQldSZeW_uBrJdujMq1sEUjuOADQV-IbUymHBZRk07V8_MWwWuWowdVrYyzSw1M4s3P27OVGJYk5JyM5YJo_lKribMh40kIWZNBKSGTtftBxYXqO8 Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 8f20ddb856134236977744b8ce87ca29 Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-581898503 Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:08:42.776922 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:08:42.778340 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f20ddb856134236977744b8ce87ca29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8f20ddb856134236977744b8ce87ca29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f20ddb856134236977744b8ce87ca29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8f20ddb856134236977744b8ce87ca29", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:42.778340 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-581898503 Oct 29 01:08:42.778340 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 8f20ddb856134236977744b8ce87ca29 Oct 29 01:08:42.778340 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-581898503 Oct 29 01:08:42.778340 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-HypervisorAdminNegativeTestJSON-581898503-project Oct 29 01:08:42.778340 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:08:42.778340 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:08:42.778340 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: fe303df4a3294032861eeb93156a9669 Oct 29 01:08:42.778340 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-581898503-project Oct 29 01:08:42.778340 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:08:42.778340 n-d-862964-3 devstack@n-api.service[121100]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 29 01:08:42.778340 n-d-862964-3 devstack@n-api.service[121100]: action_args: {} Oct 29 01:08:42.778340 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:42.779205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:42.779205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:42.779205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:42.779205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:42.779205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:42.779205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:08:42.779205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:08:42.779205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:42.779205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:42.779205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 29 01:08:42.779205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 29 01:08:42.779205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:08:42.779205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:08:42.779205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:08:42.779205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:08:42.779205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:08:42.779205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:08:42.779205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:08:42.779205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:08:42.780421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:08:42.780421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:08:42.780421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:08:42.780421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:08:42.780421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:08:42.780421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:08:42.780421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 29 01:08:42.780421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:42.780421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:42.780421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:42.780421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:42.780421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:42.780421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:42.780421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:08:42.780421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:08:42.780421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 29 01:08:42.780421 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:42.781526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-02653a7c-59ad-4db2-9401-f5560f2a9817 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:42.781526 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-02653a7c-59ad-4db2-9401-f5560f2a9817 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.011753 Oct 29 01:08:42.781526 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 616/1259] 10.222.0.26 () {58 vars in 1179 bytes} [Sat Oct 29 01:08:42 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:42.798139 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d222189a-1323-42c7-941a-74e9abcfae31 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.335095 Oct 29 01:08:42.799010 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 644/1260] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:42 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:42.888599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b28dd821-8355-46a9-a3c8-ddeb54370828 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Calling method '.version_select at 0x7f9d97e2c040>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:42.890762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b28dd821-8355-46a9-a3c8-ddeb54370828 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:42.891677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b28dd821-8355-46a9-a3c8-ddeb54370828 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:42.892823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b28dd821-8355-46a9-a3c8-ddeb54370828 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:42.909948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b28dd821-8355-46a9-a3c8-ddeb54370828 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:42.910723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b28dd821-8355-46a9-a3c8-ddeb54370828 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:42.912032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b28dd821-8355-46a9-a3c8-ddeb54370828 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:42.934321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b28dd821-8355-46a9-a3c8-ddeb54370828 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:42.935036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b28dd821-8355-46a9-a3c8-ddeb54370828 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:42.935743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b28dd821-8355-46a9-a3c8-ddeb54370828 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:42.944805 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b28dd821-8355-46a9-a3c8-ddeb54370828 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.152052 Oct 29 01:08:42.949327 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 617/1261] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:08:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:42.957727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-443d5436-10e0-482d-8f05-91b3e703a96a tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Calling method '.version_select at 0x7f9d979ee5e0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:42.959433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-443d5436-10e0-482d-8f05-91b3e703a96a tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'fe303df4a3294032861eeb93156a9669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20ddb856134236977744b8ce87ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-443d5436-10e0-482d-8f05-91b3e703a96a tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Request method failure captured: Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH0Z795xfgv_cmn12YzBlN4eNMZeih2D-4vwy6_FtDluTVmViDP2mn0zWse1dRFQldSZeW_uBrJdujMq1sEUjuOADQV-IbUymHBZRk07V8_MWwWuWowdVrYyzSw1M4s3P27OVGJYk5JyM5YJo_lKribMh40kIWZNBKSGTtftBxYXqO8 Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 8f20ddb856134236977744b8ce87ca29 Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-581898503 Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:08:42.961539 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:08:42.963316 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f20ddb856134236977744b8ce87ca29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8f20ddb856134236977744b8ce87ca29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f20ddb856134236977744b8ce87ca29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8f20ddb856134236977744b8ce87ca29", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:42.963316 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-581898503 Oct 29 01:08:42.963316 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 8f20ddb856134236977744b8ce87ca29 Oct 29 01:08:42.963316 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-581898503 Oct 29 01:08:42.963316 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-HypervisorAdminNegativeTestJSON-581898503-project Oct 29 01:08:42.963316 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:08:42.963316 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:08:42.963316 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: fe303df4a3294032861eeb93156a9669 Oct 29 01:08:42.963316 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-581898503-project Oct 29 01:08:42.963316 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:08:42.963316 n-d-862964-3 devstack@n-api.service[121099]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 29 01:08:42.963316 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '1'} Oct 29 01:08:42.963316 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:42.964474 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:42.964474 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:42.964474 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:42.964474 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:42.964474 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:42.964474 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:08:42.964474 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:08:42.964474 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:42.964474 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:42.964474 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 29 01:08:42.964474 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 29 01:08:42.964474 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:08:42.964474 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:08:42.964474 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:08:42.964474 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:08:42.964474 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:08:42.964474 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:08:42.964474 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:08:42.964474 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:08:42.965959 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:08:42.965959 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:08:42.965959 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:08:42.965959 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:08:42.965959 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:08:42.965959 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:08:42.965959 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 29 01:08:42.965959 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:42.965959 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:42.965959 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:42.965959 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:42.965959 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:42.965959 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:42.965959 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:08:42.965959 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:08:42.965959 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 29 01:08:42.965959 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:42.967317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-443d5436-10e0-482d-8f05-91b3e703a96a tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:42.967317 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-443d5436-10e0-482d-8f05-91b3e703a96a tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.014436 Oct 29 01:08:42.967803 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 645/1262] 10.222.0.26 () {58 vars in 1173 bytes} [Sat Oct 29 01:08:42 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:42.979837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7ab47e0b-ef84-4652-af6e-41d28185f2ef tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Calling method '.version_select at 0x7f9d97e2c8b0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:42.981647 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-7ab47e0b-ef84-4652-af6e-41d28185f2ef tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] HTTP exception thrown: Hypervisor with ID '2a451e95-3744-47cc-bfe6-e96ca847b04f' could not be found. Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7ab47e0b-ef84-4652-af6e-41d28185f2ef tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Request method failure captured: Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-hypervisors/2a451e95-3744-47cc-bfe6-e96ca847b04f/uptime HTTP/1.1 Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH0atPJI5nuYEHf84Uoo6gFhuHcyMJ710JBmAIOEKaxYmvPgfkVWW8uzOKMuA38JoU1Osxbt5p1Jpu-3DcyMC5paLkfXsIs7NHoDQ1l3agkydNDds4fJp5rJ04ixDMZvN0v8HD5mr0n7A5V5V1zw7lTBj7Gnm0pZRZvyUEDWz3Az2q4 Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 872939ea74ad44b3aa619562e4935c18 Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1835075936 Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:08:42.997614 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:08:42.999131 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/872939ea74ad44b3aa619562e4935c18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/872939ea74ad44b3aa619562e4935c18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/872939ea74ad44b3aa619562e4935c18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_872939ea74ad44b3aa619562e4935c18", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:42.999131 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1835075936 Oct 29 01:08:42.999131 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 872939ea74ad44b3aa619562e4935c18 Oct 29 01:08:42.999131 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1835075936 Oct 29 01:08:42.999131 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin Oct 29 01:08:42.999131 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:08:42.999131 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:08:42.999131 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 6689d501e2aa4f879ecd2f6730d580d3 Oct 29 01:08:42.999131 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin Oct 29 01:08:42.999131 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:08:42.999131 n-d-862964-3 devstack@n-api.service[121100]: exception: Hypervisor with ID '2a451e95-3744-47cc-bfe6-e96ca847b04f' could not be found. Oct 29 01:08:42.999131 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '2a451e95-3744-47cc-bfe6-e96ca847b04f'} Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '2a451e95-3744-47cc-bfe6-e96ca847b04f' Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 29 01:08:42.999977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '2a451e95-3744-47cc-bfe6-e96ca847b04f' could not be found. Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:43.001603 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:43.003801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:43.003801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:43.003801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:43.003801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:43.003801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:43.003801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '2a451e95-3744-47cc-bfe6-e96ca847b04f' could not be found. Oct 29 01:08:43.003801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:43.004549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7ab47e0b-ef84-4652-af6e-41d28185f2ef tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Returning 404 to user: Hypervisor with ID '2a451e95-3744-47cc-bfe6-e96ca847b04f' could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:43.006567 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7ab47e0b-ef84-4652-af6e-41d28185f2ef tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/2a451e95-3744-47cc-bfe6-e96ca847b04f/uptime" status: 404 len: 123 microversion: 2.1 time: 0.031229 Oct 29 01:08:43.011443 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 618/1263] 10.222.0.26 () {58 vars in 1278 bytes} [Sat Oct 29 01:08:42 2022] GET /compute/v2.1/os-hypervisors/2a451e95-3744-47cc-bfe6-e96ca847b04f/uptime => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:43.016716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4eaa9a2b-bc84-4cf5-8837-99748f531a60 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Calling method '.version_select at 0x7f9d97acaf70>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:43.018615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4eaa9a2b-bc84-4cf5-8837-99748f531a60 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:43.019113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4eaa9a2b-bc84-4cf5-8837-99748f531a60 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:43.019978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4eaa9a2b-bc84-4cf5-8837-99748f531a60 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:43.036717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4eaa9a2b-bc84-4cf5-8837-99748f531a60 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:43.037430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4eaa9a2b-bc84-4cf5-8837-99748f531a60 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:43.037942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4eaa9a2b-bc84-4cf5-8837-99748f531a60 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:43.055398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4eaa9a2b-bc84-4cf5-8837-99748f531a60 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:43.056016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4eaa9a2b-bc84-4cf5-8837-99748f531a60 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:43.056600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4eaa9a2b-bc84-4cf5-8837-99748f531a60 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:43.063688 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4eaa9a2b-bc84-4cf5-8837-99748f531a60 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.050498 Oct 29 01:08:43.064348 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 646/1264] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:08:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:43.079512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4045794e-edcb-4735-95dd-b8f882a37bd6 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Calling method '.version_select at 0x7f9d97d6af70>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:43.082538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4045794e-edcb-4735-95dd-b8f882a37bd6 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'fe303df4a3294032861eeb93156a9669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20ddb856134236977744b8ce87ca29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4045794e-edcb-4735-95dd-b8f882a37bd6 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Request method failure captured: Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH0Z795xfgv_cmn12YzBlN4eNMZeih2D-4vwy6_FtDluTVmViDP2mn0zWse1dRFQldSZeW_uBrJdujMq1sEUjuOADQV-IbUymHBZRk07V8_MWwWuWowdVrYyzSw1M4s3P27OVGJYk5JyM5YJo_lKribMh40kIWZNBKSGTtftBxYXqO8 Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 8f20ddb856134236977744b8ce87ca29 Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-581898503 Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:08:43.085977 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:08:43.087391 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f20ddb856134236977744b8ce87ca29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8f20ddb856134236977744b8ce87ca29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f20ddb856134236977744b8ce87ca29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8f20ddb856134236977744b8ce87ca29", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:43.087391 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-581898503 Oct 29 01:08:43.087391 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 8f20ddb856134236977744b8ce87ca29 Oct 29 01:08:43.087391 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-581898503 Oct 29 01:08:43.087391 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-HypervisorAdminNegativeTestJSON-581898503-project Oct 29 01:08:43.087391 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:08:43.087391 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:08:43.087391 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: fe303df4a3294032861eeb93156a9669 Oct 29 01:08:43.087391 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-581898503-project Oct 29 01:08:43.087391 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:08:43.087391 n-d-862964-3 devstack@n-api.service[121100]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 29 01:08:43.087391 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '1'} Oct 29 01:08:43.087391 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:43.088633 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:43.088633 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:43.088633 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:43.088633 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:43.088633 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:43.088633 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:08:43.088633 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:08:43.088633 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:43.088633 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:43.088633 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 29 01:08:43.088633 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 29 01:08:43.088633 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 29 01:08:43.088633 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 29 01:08:43.088633 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:08:43.088633 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:08:43.088633 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:08:43.088633 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:08:43.088633 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:08:43.088633 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:08:43.089859 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:08:43.089859 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:08:43.089859 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:08:43.089859 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:08:43.089859 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:08:43.089859 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:08:43.089859 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:08:43.089859 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:08:43.089859 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 29 01:08:43.089859 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:43.089859 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:43.089859 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:43.089859 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:43.089859 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:43.089859 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:43.089859 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:08:43.089859 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:08:43.089859 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 29 01:08:43.089859 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:43.095889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4045794e-edcb-4735-95dd-b8f882a37bd6 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:43.097007 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4045794e-edcb-4735-95dd-b8f882a37bd6 tempest-HypervisorAdminNegativeTestJSON-581898503 tempest-HypervisorAdminNegativeTestJSON-581898503-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.023129 Oct 29 01:08:43.106011 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 619/1265] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:08:43 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:43.114096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7bd5028c-9794-4837-8355-a35a77ad51e9 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Calling method '.version_select at 0x7f9d97ac8ca0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:43.115894 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-7bd5028c-9794-4837-8355-a35a77ad51e9 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] HTTP exception thrown: Hypervisor with ID '0b113312-46eb-4912-a517-5d60a7bca8a7' could not be found. Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7bd5028c-9794-4837-8355-a35a77ad51e9 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Request method failure captured: Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-hypervisors/0b113312-46eb-4912-a517-5d60a7bca8a7 HTTP/1.1 Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH0atPJI5nuYEHf84Uoo6gFhuHcyMJ710JBmAIOEKaxYmvPgfkVWW8uzOKMuA38JoU1Osxbt5p1Jpu-3DcyMC5paLkfXsIs7NHoDQ1l3agkydNDds4fJp5rJ04ixDMZvN0v8HD5mr0n7A5V5V1zw7lTBj7Gnm0pZRZvyUEDWz3Az2q4 Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 872939ea74ad44b3aa619562e4935c18 Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1835075936 Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:08:43.118656 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:08:43.119976 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/872939ea74ad44b3aa619562e4935c18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/872939ea74ad44b3aa619562e4935c18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/872939ea74ad44b3aa619562e4935c18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_872939ea74ad44b3aa619562e4935c18", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:43.119976 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1835075936 Oct 29 01:08:43.119976 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 872939ea74ad44b3aa619562e4935c18 Oct 29 01:08:43.119976 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1835075936 Oct 29 01:08:43.119976 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin Oct 29 01:08:43.119976 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:08:43.119976 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:08:43.119976 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6689d501e2aa4f879ecd2f6730d580d3 Oct 29 01:08:43.119976 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin Oct 29 01:08:43.119976 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:08:43.119976 n-d-862964-3 devstack@n-api.service[121099]: exception: Hypervisor with ID '0b113312-46eb-4912-a517-5d60a7bca8a7' could not be found. Oct 29 01:08:43.119976 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '0b113312-46eb-4912-a517-5d60a7bca8a7'} Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '0b113312-46eb-4912-a517-5d60a7bca8a7' Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 29 01:08:43.121842 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 01:08:43.124988 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '0b113312-46eb-4912-a517-5d60a7bca8a7' could not be found. Oct 29 01:08:43.128331 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:43.128331 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:43.128331 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:43.128331 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:43.128331 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:43.128331 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:43.128331 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:43.128331 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:43.128331 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '0b113312-46eb-4912-a517-5d60a7bca8a7' could not be found. Oct 29 01:08:43.128331 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:43.128331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7bd5028c-9794-4837-8355-a35a77ad51e9 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] Returning 404 to user: Hypervisor with ID '0b113312-46eb-4912-a517-5d60a7bca8a7' could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:43.128331 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7bd5028c-9794-4837-8355-a35a77ad51e9 tempest-HypervisorAdminNegativeTestJSON-1835075936 tempest-HypervisorAdminNegativeTestJSON-1835075936-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/0b113312-46eb-4912-a517-5d60a7bca8a7" status: 404 len: 123 microversion: 2.1 time: 0.016832 Oct 29 01:08:43.133479 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 647/1266] 10.222.0.26 () {58 vars in 1257 bytes} [Sat Oct 29 01:08:43 2022] GET /compute/v2.1/os-hypervisors/0b113312-46eb-4912-a517-5d60a7bca8a7 => generated 123 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:08:43.485254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-13326019-79a0-4477-aa64-a090935ef669 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:43.486016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-13326019-79a0-4477-aa64-a090935ef669 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:43.495909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13326019-79a0-4477-aa64-a090935ef669 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:43.499048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13326019-79a0-4477-aa64-a090935ef669 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:43.499048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13326019-79a0-4477-aa64-a090935ef669 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:43.501028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13326019-79a0-4477-aa64-a090935ef669 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:43.502669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13326019-79a0-4477-aa64-a090935ef669 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:43.504179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13326019-79a0-4477-aa64-a090935ef669 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:43.835967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3bcfdd21-1e86-4b2c-90d6-a4953fadd642 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:43.837091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3bcfdd21-1e86-4b2c-90d6-a4953fadd642 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:43.848188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3bcfdd21-1e86-4b2c-90d6-a4953fadd642 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:43.848691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3bcfdd21-1e86-4b2c-90d6-a4953fadd642 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:43.849785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3bcfdd21-1e86-4b2c-90d6-a4953fadd642 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:43.858277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3bcfdd21-1e86-4b2c-90d6-a4953fadd642 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:43.858277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3bcfdd21-1e86-4b2c-90d6-a4953fadd642 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:43.858277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3bcfdd21-1e86-4b2c-90d6-a4953fadd642 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:43.904461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-13326019-79a0-4477-aa64-a090935ef669 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:43.924135 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-13326019-79a0-4477-aa64-a090935ef669 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1503 microversion: 2.1 time: 0.443462 Oct 29 01:08:43.925663 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 620/1267] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:43 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1503 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:43.976390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-3bcfdd21-1e86-4b2c-90d6-a4953fadd642 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:44.011095 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3bcfdd21-1e86-4b2c-90d6-a4953fadd642 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.179215 Oct 29 01:08:44.012675 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 648/1268] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:43 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:44.918992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f10eb4b4-9164-4972-b107-54537583be49 tempest-AbsoluteLimitsNegativeTestJSON-1022288079 tempest-AbsoluteLimitsNegativeTestJSON-1022288079-project] Calling method '.version_select at 0x7f9d97de4b80>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:44.947606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f10eb4b4-9164-4972-b107-54537583be49 tempest-AbsoluteLimitsNegativeTestJSON-1022288079 tempest-AbsoluteLimitsNegativeTestJSON-1022288079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:44.947606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f10eb4b4-9164-4972-b107-54537583be49 tempest-AbsoluteLimitsNegativeTestJSON-1022288079 tempest-AbsoluteLimitsNegativeTestJSON-1022288079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:44.947606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f10eb4b4-9164-4972-b107-54537583be49 tempest-AbsoluteLimitsNegativeTestJSON-1022288079 tempest-AbsoluteLimitsNegativeTestJSON-1022288079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:44.947606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f10eb4b4-9164-4972-b107-54537583be49 tempest-AbsoluteLimitsNegativeTestJSON-1022288079 tempest-AbsoluteLimitsNegativeTestJSON-1022288079-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:44.947990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f10eb4b4-9164-4972-b107-54537583be49 tempest-AbsoluteLimitsNegativeTestJSON-1022288079 tempest-AbsoluteLimitsNegativeTestJSON-1022288079-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:44.947990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f10eb4b4-9164-4972-b107-54537583be49 tempest-AbsoluteLimitsNegativeTestJSON-1022288079 tempest-AbsoluteLimitsNegativeTestJSON-1022288079-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:44.975944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-55093f58-6845-4055-8c61-4b18c4f551d3 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Action: 'create', calling method: .version_select at 0x7f9d979cf9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-802727266", "description": "tempest-description-38181983"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:44.976472 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f10eb4b4-9164-4972-b107-54537583be49 tempest-AbsoluteLimitsNegativeTestJSON-1022288079 tempest-AbsoluteLimitsNegativeTestJSON-1022288079-project] 10.222.0.26 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.253914 Oct 29 01:08:44.976903 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 621/1269] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 29 01:08:44 2022] GET /compute/v2.1/limits => generated 511 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:44.996756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5c89ab16-2aa0-48e6-a489-b08976b44089 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:44.997986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5c89ab16-2aa0-48e6-a489-b08976b44089 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:45.008097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c89ab16-2aa0-48e6-a489-b08976b44089 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:45.008960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c89ab16-2aa0-48e6-a489-b08976b44089 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:45.009815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c89ab16-2aa0-48e6-a489-b08976b44089 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:45.011407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c89ab16-2aa0-48e6-a489-b08976b44089 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:45.012097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c89ab16-2aa0-48e6-a489-b08976b44089 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:45.012904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c89ab16-2aa0-48e6-a489-b08976b44089 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:45.232603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5c89ab16-2aa0-48e6-a489-b08976b44089 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:45.242155 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5c89ab16-2aa0-48e6-a489-b08976b44089 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1503 microversion: 2.1 time: 0.263538 Oct 29 01:08:45.257844 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 622/1270] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:44 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1503 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:45.257844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0158c52f-7357-4d46-ac40-80bfc4ad5dfb tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:45.257844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0158c52f-7357-4d46-ac40-80bfc4ad5dfb tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:45.267897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0158c52f-7357-4d46-ac40-80bfc4ad5dfb tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:45.268431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0158c52f-7357-4d46-ac40-80bfc4ad5dfb tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:45.272009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0158c52f-7357-4d46-ac40-80bfc4ad5dfb tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:45.272009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0158c52f-7357-4d46-ac40-80bfc4ad5dfb tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:45.272009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0158c52f-7357-4d46-ac40-80bfc4ad5dfb tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:45.272009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0158c52f-7357-4d46-ac40-80bfc4ad5dfb tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:45.372697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-0158c52f-7357-4d46-ac40-80bfc4ad5dfb tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:45.393007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=5 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:45.399353 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0158c52f-7357-4d46-ac40-80bfc4ad5dfb tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.149446 Oct 29 01:08:45.400044 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 623/1271] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:45 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:45.406469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e6998268-a36e-4b77-9540-eca96c291bd1 tempest-AbsoluteLimitsNegativeTestJSON-1022288079 tempest-AbsoluteLimitsNegativeTestJSON-1022288079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-303221793", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:45.486057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-e6998268-a36e-4b77-9540-eca96c291bd1 tempest-AbsoluteLimitsNegativeTestJSON-1022288079 tempest-AbsoluteLimitsNegativeTestJSON-1022288079-project] validate_networks() for None {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:08:45.531120 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-55093f58-6845-4055-8c61-4b18c4f551d3 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.733928 Oct 29 01:08:45.541241 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 649/1272] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:08:44 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:45.547949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-400fe223-2b18-4d85-96c6-266020a6e232 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Action: 'create', calling method: .version_select at 0x7f9d97acab80>, body: {"security_group_rule": {"parent_group_id": "bd7a9b6f-8405-4b9a-afcf-5e23f1226f6c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:45.817832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-e6998268-a36e-4b77-9540-eca96c291bd1 tempest-AbsoluteLimitsNegativeTestJSON-1022288079 tempest-AbsoluteLimitsNegativeTestJSON-1022288079-project] Getting quotas for project e9e66e39ea1a414382efb598ede5ed18. Resources: dict_keys(['metadata_items']) {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:08:45.823368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-e6998268-a36e-4b77-9540-eca96c291bd1 tempest-AbsoluteLimitsNegativeTestJSON-1022288079 tempest-AbsoluteLimitsNegativeTestJSON-1022288079-project] Getting quotas for user c75499517627454291bd548e6bf3784a and project e9e66e39ea1a414382efb598ede5ed18. Resources: dict_keys(['metadata_items']) {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:08:45.837089 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-e6998268-a36e-4b77-9540-eca96c291bd1 tempest-AbsoluteLimitsNegativeTestJSON-1022288079 tempest-AbsoluteLimitsNegativeTestJSON-1022288079-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e6998268-a36e-4b77-9540-eca96c291bd1 tempest-AbsoluteLimitsNegativeTestJSON-1022288079 tempest-AbsoluteLimitsNegativeTestJSON-1022288079-project] Request method failure captured: Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 1751 Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH0ctZsy4_a9QKixMi0muzFqedf67eb5nXaiUL-i9PWrFNDry7eDT_1lzlTwmVsi-xaW8GGqDH4bzceRxhpaCTaYsAH5wPAqoAcuLFcXsHM9VhR0M3QL_Y-EjpCZy-vCjl82pKZiZ7BVk0N-jQ3ofNEIVIpCmjZEzaNbiH_kBKxteyk Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: e9e66e39ea1a414382efb598ede5ed18 Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1022288079 Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e9e66e39ea1a414382efb598ede5ed18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e9e66e39ea1a414382efb598ede5ed18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e9e66e39ea1a414382efb598ede5ed18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e9e66e39ea1a414382efb598ede5ed18", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1022288079 Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: e9e66e39ea1a414382efb598ede5ed18 Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1022288079 Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1022288079-project Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: c75499517627454291bd548e6bf3784a Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1022288079-project Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-303221793", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:08:45.858352 n-d-862964-3 devstack@n-api.service[121100]: exception: Maximum number of metadata items exceeds 128 Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-303221793', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:08:45.860830 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:08:45.872395 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:08:45.872395 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 01:08:45.872395 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 29 01:08:45.872395 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 01:08:45.872395 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 29 01:08:45.872395 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:45.872395 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:45.872395 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:45.872395 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:45.872395 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:45.872395 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:45.872395 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:45.872395 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:45.872395 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 29 01:08:45.872395 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:08:45.872395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e6998268-a36e-4b77-9540-eca96c291bd1 tempest-AbsoluteLimitsNegativeTestJSON-1022288079 tempest-AbsoluteLimitsNegativeTestJSON-1022288079-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:45.872395 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e6998268-a36e-4b77-9540-eca96c291bd1 tempest-AbsoluteLimitsNegativeTestJSON-1022288079 tempest-AbsoluteLimitsNegativeTestJSON-1022288079-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.462557 Oct 29 01:08:45.872395 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 624/1273] 10.222.0.26 () {60 vars in 1148 bytes} [Sat Oct 29 01:08:45 2022] POST /compute/v2.1/servers => generated 87 bytes in 464 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:08:46.206205 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-400fe223-2b18-4d85-96c6-266020a6e232 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.655047 Oct 29 01:08:46.206205 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 650/1274] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 29 01:08:45 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:08:46.216151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5f11fee5-f243-477b-908f-860bbd106684 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Action: 'create', calling method: .version_select at 0x7f9d97d1c700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-563771964", "description": "tempest-description-1598115727"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:46.275137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a7bafab5-341d-4b43-9ec3-d1c994bd71c9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:46.275137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a7bafab5-341d-4b43-9ec3-d1c994bd71c9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:46.290517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7bafab5-341d-4b43-9ec3-d1c994bd71c9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:46.291307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7bafab5-341d-4b43-9ec3-d1c994bd71c9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:46.297423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7bafab5-341d-4b43-9ec3-d1c994bd71c9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:46.298182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7bafab5-341d-4b43-9ec3-d1c994bd71c9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:46.298997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7bafab5-341d-4b43-9ec3-d1c994bd71c9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:46.300549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7bafab5-341d-4b43-9ec3-d1c994bd71c9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:46.618189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a7bafab5-341d-4b43-9ec3-d1c994bd71c9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:46.630850 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a7bafab5-341d-4b43-9ec3-d1c994bd71c9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1503 microversion: 2.1 time: 0.361624 Oct 29 01:08:46.631453 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 651/1275] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:46 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1503 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:46.658159 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-69b7dd2c-3404-493d-8083-ebbc0c61cea0 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Calling method '.version_select at 0x7f9d979cf8b0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:46.680119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69b7dd2c-3404-493d-8083-ebbc0c61cea0 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:46.681275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69b7dd2c-3404-493d-8083-ebbc0c61cea0 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:46.681998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69b7dd2c-3404-493d-8083-ebbc0c61cea0 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:46.694974 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-69b7dd2c-3404-493d-8083-ebbc0c61cea0 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 2336 microversion: 2.1 time: 0.057615 Oct 29 01:08:46.695594 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 652/1276] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 29 01:08:46 2022] GET /compute/v2.1/os-migrations => generated 2336 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:46.701266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7f26903c-e89f-4c83-992c-867769832016 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:46.704391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7f26903c-e89f-4c83-992c-867769832016 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:46.713202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f26903c-e89f-4c83-992c-867769832016 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:46.714130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f26903c-e89f-4c83-992c-867769832016 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:46.714582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f26903c-e89f-4c83-992c-867769832016 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:46.715514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f26903c-e89f-4c83-992c-867769832016 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:46.716143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f26903c-e89f-4c83-992c-867769832016 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:46.716707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f26903c-e89f-4c83-992c-867769832016 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:47.142488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-7f26903c-e89f-4c83-992c-867769832016 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:47.167616 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7f26903c-e89f-4c83-992c-867769832016 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.470732 Oct 29 01:08:47.168354 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 653/1277] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:46 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:47.181595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b4647873-e545-40c2-90cc-9ad1c9a77cc6 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:47.198069 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b4647873-e545-40c2-90cc-9ad1c9a77cc6 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026236 Oct 29 01:08:47.199113 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 654/1278] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:08:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:47.211838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7e1cc358-fdb0-4c15-915a-ba68ac5be4dc tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-879470154", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:47.266048 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5f11fee5-f243-477b-908f-860bbd106684 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.050029 Oct 29 01:08:47.266048 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 625/1279] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:08:46 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:47.287064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:47.288978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-453548ea-ba45-42b5-b058-22645baa65aa tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Action: 'create', calling method: .version_select at 0x7f9d97d1cc10>, body: {"security_group_rule": {"parent_group_id": "0ad97f8b-f89d-4688-a228-cfb6bdbd90cd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:47.294610 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7e1cc358-fdb0-4c15-915a-ba68ac5be4dc tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.086674 Oct 29 01:08:47.295123 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 655/1280] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Oct 29 01:08:47 2022] POST /compute/v2.1/flavors => generated 498 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:08:47.308685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f8a2c82a-0ab9-4503-993a-e0cbfa5d7c2c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:47.319090 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f8a2c82a-0ab9-4503-993a-e0cbfa5d7c2c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012826 Oct 29 01:08:47.323646 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 656/1281] 10.222.0.26 () {58 vars in 1182 bytes} [Sat Oct 29 01:08:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:08:47.463351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-60536676-35e7-4c4c-9a8f-6df6fee5378c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-276331708", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "96ff1bc9-8f29-4ce5-a655-891fcb9e939a"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:47.593628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-60536676-35e7-4c4c-9a8f-6df6fee5378c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] validate_networks() for None {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:08:47.880317 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-453548ea-ba45-42b5-b058-22645baa65aa tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.605736 Oct 29 01:08:47.880925 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 626/1282] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 29 01:08:47 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:47.887054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b96d0e5a-94b2-41eb-9c5d-0d5460a80484 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:47.887855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b96d0e5a-94b2-41eb-9c5d-0d5460a80484 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:47.898564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b96d0e5a-94b2-41eb-9c5d-0d5460a80484 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:47.899131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b96d0e5a-94b2-41eb-9c5d-0d5460a80484 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:47.909698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b96d0e5a-94b2-41eb-9c5d-0d5460a80484 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:47.912106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b96d0e5a-94b2-41eb-9c5d-0d5460a80484 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:47.912746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b96d0e5a-94b2-41eb-9c5d-0d5460a80484 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:47.915388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b96d0e5a-94b2-41eb-9c5d-0d5460a80484 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:47.920819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-60536676-35e7-4c4c-9a8f-6df6fee5378c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:08:47.930378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-60536676-35e7-4c4c-9a8f-6df6fee5378c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:08:47.930378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-60536676-35e7-4c4c-9a8f-6df6fee5378c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:08:47.930378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-60536676-35e7-4c4c-9a8f-6df6fee5378c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:08:47.930378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-60536676-35e7-4c4c-9a8f-6df6fee5378c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:08:47.936929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60536676-35e7-4c4c-9a8f-6df6fee5378c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:47.937587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60536676-35e7-4c4c-9a8f-6df6fee5378c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:47.938295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60536676-35e7-4c4c-9a8f-6df6fee5378c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:47.943263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60536676-35e7-4c4c-9a8f-6df6fee5378c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:47.944495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60536676-35e7-4c4c-9a8f-6df6fee5378c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:47.945378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60536676-35e7-4c4c-9a8f-6df6fee5378c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:47.973887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-60536676-35e7-4c4c-9a8f-6df6fee5378c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Getting quotas for project 646dbadc4e9140348132e6950c885e81. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:08:47.982104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-60536676-35e7-4c4c-9a8f-6df6fee5378c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Getting quotas for user 8219d81b19964408b9bc275a4457f389 and project 646dbadc4e9140348132e6950c885e81. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:08:48.005704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-60536676-35e7-4c4c-9a8f-6df6fee5378c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:08:48.011475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-60536676-35e7-4c4c-9a8f-6df6fee5378c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:08:48.161258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b96d0e5a-94b2-41eb-9c5d-0d5460a80484 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:48.169396 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-60536676-35e7-4c4c-9a8f-6df6fee5378c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709599 Oct 29 01:08:48.170065 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 657/1283] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:08:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:08:48.175807 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b96d0e5a-94b2-41eb-9c5d-0d5460a80484 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1478 microversion: 2.1 time: 0.290712 Oct 29 01:08:48.175807 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 627/1284] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:47 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1478 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:48.186548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b742f9c-16e6-432a-8d5a-3379dbe3c12c tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Action: 'create', calling method: .version_select at 0x7f9d979cfca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-811502755", "description": "tempest-description-1470103314"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:48.195487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fd598793-e725-446e-bd0f-c1b25bb728fe tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:48.196604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fd598793-e725-446e-bd0f-c1b25bb728fe tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:48.325544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fd598793-e725-446e-bd0f-c1b25bb728fe tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:48.343786 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fd598793-e725-446e-bd0f-c1b25bb728fe tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1278 microversion: 2.1 time: 0.156269 Oct 29 01:08:48.345094 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 628/1285] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:48 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:48.357580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-861384dd-8fed-4bd0-95aa-83def9b43c01 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '.version_select at 0x7f9d97e6ef70>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:48.362753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-861384dd-8fed-4bd0-95aa-83def9b43c01 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:48.366046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-861384dd-8fed-4bd0-95aa-83def9b43c01 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:48.371449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-861384dd-8fed-4bd0-95aa-83def9b43c01 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:48.415896 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-861384dd-8fed-4bd0-95aa-83def9b43c01 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.067657 Oct 29 01:08:48.420236 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 629/1286] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 29 01:08:48 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:48.425524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a32c36ab-57b2-4d43-82c2-7a30a57da402 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:48.426134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a32c36ab-57b2-4d43-82c2-7a30a57da402 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:48.441306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a32c36ab-57b2-4d43-82c2-7a30a57da402 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:48.441787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a32c36ab-57b2-4d43-82c2-7a30a57da402 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:48.445269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a32c36ab-57b2-4d43-82c2-7a30a57da402 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:48.449170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a32c36ab-57b2-4d43-82c2-7a30a57da402 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:48.451576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a32c36ab-57b2-4d43-82c2-7a30a57da402 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:48.466292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a32c36ab-57b2-4d43-82c2-7a30a57da402 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:48.609761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-a32c36ab-57b2-4d43-82c2-7a30a57da402 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:48.636387 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a32c36ab-57b2-4d43-82c2-7a30a57da402 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.214778 Oct 29 01:08:48.637086 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 630/1287] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:48 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:48.648652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-91d7ff97-e277-4846-b607-1e5eddebc976 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:48.651131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-91d7ff97-e277-4846-b607-1e5eddebc976 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:48.661230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91d7ff97-e277-4846-b607-1e5eddebc976 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:48.661890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91d7ff97-e277-4846-b607-1e5eddebc976 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:48.662339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91d7ff97-e277-4846-b607-1e5eddebc976 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:48.663389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91d7ff97-e277-4846-b607-1e5eddebc976 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:48.664096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91d7ff97-e277-4846-b607-1e5eddebc976 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:48.664579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91d7ff97-e277-4846-b607-1e5eddebc976 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:48.889685 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-91d7ff97-e277-4846-b607-1e5eddebc976 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1629 microversion: 2.1 time: 0.250866 Oct 29 01:08:48.890581 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 631/1288] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:48 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1629 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:48.915701 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7b742f9c-16e6-432a-8d5a-3379dbe3c12c tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.741886 Oct 29 01:08:48.921753 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 658/1289] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:08:48 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:48.933390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-88fd8906-b2d9-4498-aa92-3e890b064c57 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Action: 'create', calling method: .version_select at 0x7f9d97caedc0>, body: {"keypair": {"name": "tempest-keypair-1547659648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhT9lwz4PcRG1N+NbXzE6WEncTGgQjfoFcmNXaIg6USRHFM2wrCZ7PYR7eke5QYkVB6fZy0vSs/VUxUImB6D40tudnBod2oz5HSDarlVZNbz/kSPqGA2KqwBPWGiKxX1A=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:48.934837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a0ab68ae-04ae-4ad3-ab9d-e68b45efcb8e tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Action: 'create', calling method: .version_select at 0x7f9d97ac89d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1923299208", "description": "tempest-description-1123266546"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:48.952737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-88fd8906-b2d9-4498-aa92-3e890b064c57 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Getting quotas for project 6719b662fc734d2797d515778a57296d. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:08:48.958034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-88fd8906-b2d9-4498-aa92-3e890b064c57 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Getting quotas for user da623c3132aa466aa25685aa45fceaf9 and project 6719b662fc734d2797d515778a57296d. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:08:49.048156 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-88fd8906-b2d9-4498-aa92-3e890b064c57 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.129411 Oct 29 01:08:49.049470 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 632/1290] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:08:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:08:49.327536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-97c3cec8-77cd-4b76-a65f-57b9d5b9c28a tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Calling method '.version_select at 0x7f9d97c9c550>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:49.329353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97c3cec8-77cd-4b76-a65f-57b9d5b9c28a tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:49.329840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97c3cec8-77cd-4b76-a65f-57b9d5b9c28a tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:49.330278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97c3cec8-77cd-4b76-a65f-57b9d5b9c28a tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:49.344769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97c3cec8-77cd-4b76-a65f-57b9d5b9c28a tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:49.345207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97c3cec8-77cd-4b76-a65f-57b9d5b9c28a tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:49.345649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97c3cec8-77cd-4b76-a65f-57b9d5b9c28a tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:49.355976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97c3cec8-77cd-4b76-a65f-57b9d5b9c28a tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:49.356456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97c3cec8-77cd-4b76-a65f-57b9d5b9c28a tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:49.356890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97c3cec8-77cd-4b76-a65f-57b9d5b9c28a tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:49.362707 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-97c3cec8-77cd-4b76-a65f-57b9d5b9c28a tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.165601 Oct 29 01:08:49.363461 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 633/1291] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:08:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:08:49.370074 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a0ab68ae-04ae-4ad3-ab9d-e68b45efcb8e tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.443192 Oct 29 01:08:49.370726 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 659/1292] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:08:48 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:49.372234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e62a3600-109e-4bae-85d4-451b5702d6e8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:49.373191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e62a3600-109e-4bae-85d4-451b5702d6e8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:49.443983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e62a3600-109e-4bae-85d4-451b5702d6e8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:49.452578 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e62a3600-109e-4bae-85d4-451b5702d6e8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1278 microversion: 2.1 time: 0.085065 Oct 29 01:08:49.454068 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 634/1293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:49 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:49.465652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-35cabc8e-1db0-4622-a54a-050bba9e7364 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Action: 'create', calling method: .version_select at 0x7f9d97e34ee0>, body: {"security_group_rule": {"parent_group_id": "615eb9c8-5014-49e2-8d57-adf35f7f9b74", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "beb23417-9d99-4308-a24e-550c95e7fb7d"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:49.497816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-18d360fb-40a7-4a26-8ce7-fcce4e7ae7b5 tempest-HypervisorAdminNegativeUnderV252Test-1311181345 tempest-HypervisorAdminNegativeUnderV252Test-1311181345-project] Calling method '.version_select at 0x7f9d979cfa60>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:49.500030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-18d360fb-40a7-4a26-8ce7-fcce4e7ae7b5 tempest-HypervisorAdminNegativeUnderV252Test-1311181345 tempest-HypervisorAdminNegativeUnderV252Test-1311181345-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '57e7945e274f4d238683f4ed4572085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025026c08d9485aaeeaf58dcecea16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-18d360fb-40a7-4a26-8ce7-fcce4e7ae7b5 tempest-HypervisorAdminNegativeUnderV252Test-1311181345 tempest-HypervisorAdminNegativeUnderV252Test-1311181345-project] Request method failure captured: Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-hypervisors/n-h1-862964-3/search HTTP/1.1 Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH0fz-y21Qn0vjUntr4Q9QlAMK42Ex3sxA7jrG6ayYgJBG8w5xdn_P4E8WHxy7HTF-EXHyQr9gs_mX7K1LLpZxIbA-N6CU0RGgKCBJNfHYkIDua_QCdwfh9Ehe-h8bgfzzzcEnDJaQ3TeDVoTbH0i-75UGGiVdBc2o5LoxX5CZJpucc Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: e025026c08d9485aaeeaf58dcecea16b Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1311181345 Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e025026c08d9485aaeeaf58dcecea16b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e025026c08d9485aaeeaf58dcecea16b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e025026c08d9485aaeeaf58dcecea16b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e025026c08d9485aaeeaf58dcecea16b", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1311181345 Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: e025026c08d9485aaeeaf58dcecea16b Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1311181345 Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1311181345-project Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 57e7945e274f4d238683f4ed4572085e Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1311181345-project Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'n-h1-862964-3'} Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:49.501752 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:49.507158 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:49.507158 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:49.507158 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:49.507158 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:08:49.507158 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:08:49.507158 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 29 01:08:49.507158 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:49.507158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-18d360fb-40a7-4a26-8ce7-fcce4e7ae7b5 tempest-HypervisorAdminNegativeUnderV252Test-1311181345 tempest-HypervisorAdminNegativeUnderV252Test-1311181345-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:49.507158 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-18d360fb-40a7-4a26-8ce7-fcce4e7ae7b5 tempest-HypervisorAdminNegativeUnderV252Test-1311181345 tempest-HypervisorAdminNegativeUnderV252Test-1311181345-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/n-h1-862964-3/search" status: 403 len: 117 microversion: 2.1 time: 0.132208 Oct 29 01:08:49.507158 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 660/1294] 10.222.0.26 () {58 vars in 1209 bytes} [Sat Oct 29 01:08:49 2022] GET /compute/v2.1/os-hypervisors/n-h1-862964-3/search => generated 117 bytes in 134 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:49.515960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a764d867-0a53-4d8b-932b-aed6fc2d110e tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Calling method '.version_select at 0x7f9d97aca670>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:49.517849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a764d867-0a53-4d8b-932b-aed6fc2d110e tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:49.518874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a764d867-0a53-4d8b-932b-aed6fc2d110e tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:49.519330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a764d867-0a53-4d8b-932b-aed6fc2d110e tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:49.530445 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-a764d867-0a53-4d8b-932b-aed6fc2d110e tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a764d867-0a53-4d8b-932b-aed6fc2d110e tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Request method failure captured: Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH0hNfKBMxgp-kcUBbUHOiRxovRSrdeADF452kSpxsvA5vax_Htt97otrS4iI2x9pfz9YRzN-_8MOcTETrGbGr3SHuErrdNL_5b6SBCz7jiJZky_bYgD2Z_60fYlu_egM5_z2VN6yagNWt10JafWiDwqmhaxQ4eHHeWH67wSwGUu3Js Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 9cc7019206c74de786d4a30a96e4e685 Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2108519542 Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cc7019206c74de786d4a30a96e4e685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9cc7019206c74de786d4a30a96e4e685"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cc7019206c74de786d4a30a96e4e685"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9cc7019206c74de786d4a30a96e4e685", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2108519542 Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 9cc7019206c74de786d4a30a96e4e685 Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2108519542 Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: b545f50c162248a28d7eba0b6982fadb Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 29 01:08:49.531930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:49.536883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a764d867-0a53-4d8b-932b-aed6fc2d110e tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:49.536883 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a764d867-0a53-4d8b-932b-aed6fc2d110e tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.023665 Oct 29 01:08:49.537848 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 661/1295] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 29 01:08:49 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:49.547942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-06c539db-892c-4d56-9c44-48a360dd58bb tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Calling method '.version_select at 0x7f9d97a9d790>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:49.550519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06c539db-892c-4d56-9c44-48a360dd58bb tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:49.551024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06c539db-892c-4d56-9c44-48a360dd58bb tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:49.551458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06c539db-892c-4d56-9c44-48a360dd58bb tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:49.566627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06c539db-892c-4d56-9c44-48a360dd58bb tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:49.567123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06c539db-892c-4d56-9c44-48a360dd58bb tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:49.567625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06c539db-892c-4d56-9c44-48a360dd58bb tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:49.579160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06c539db-892c-4d56-9c44-48a360dd58bb tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:49.579872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06c539db-892c-4d56-9c44-48a360dd58bb tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:49.580513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06c539db-892c-4d56-9c44-48a360dd58bb tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:49.589803 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-06c539db-892c-4d56-9c44-48a360dd58bb tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.045873 Oct 29 01:08:49.597110 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 662/1296] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:08:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:49.602255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-34b173c3-6667-4b1c-8f7e-2981313cbb6c tempest-HypervisorAdminNegativeUnderV252Test-1311181345 tempest-HypervisorAdminNegativeUnderV252Test-1311181345-project] Calling method '.version_select at 0x7f9d97a9d1f0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:49.604031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-34b173c3-6667-4b1c-8f7e-2981313cbb6c tempest-HypervisorAdminNegativeUnderV252Test-1311181345 tempest-HypervisorAdminNegativeUnderV252Test-1311181345-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '57e7945e274f4d238683f4ed4572085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025026c08d9485aaeeaf58dcecea16b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-34b173c3-6667-4b1c-8f7e-2981313cbb6c tempest-HypervisorAdminNegativeUnderV252Test-1311181345 tempest-HypervisorAdminNegativeUnderV252Test-1311181345-project] Request method failure captured: Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH0fz-y21Qn0vjUntr4Q9QlAMK42Ex3sxA7jrG6ayYgJBG8w5xdn_P4E8WHxy7HTF-EXHyQr9gs_mX7K1LLpZxIbA-N6CU0RGgKCBJNfHYkIDua_QCdwfh9Ehe-h8bgfzzzcEnDJaQ3TeDVoTbH0i-75UGGiVdBc2o5LoxX5CZJpucc Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: e025026c08d9485aaeeaf58dcecea16b Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1311181345 Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e025026c08d9485aaeeaf58dcecea16b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e025026c08d9485aaeeaf58dcecea16b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e025026c08d9485aaeeaf58dcecea16b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e025026c08d9485aaeeaf58dcecea16b", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1311181345 Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: e025026c08d9485aaeeaf58dcecea16b Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1311181345 Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1311181345-project Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 57e7945e274f4d238683f4ed4572085e Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1311181345-project Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '1'} Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:49.605638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:49.614462 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:49.614462 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:49.614462 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:49.614462 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:08:49.614462 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:08:49.614462 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 29 01:08:49.614462 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:49.614462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-34b173c3-6667-4b1c-8f7e-2981313cbb6c tempest-HypervisorAdminNegativeUnderV252Test-1311181345 tempest-HypervisorAdminNegativeUnderV252Test-1311181345-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:49.614462 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-34b173c3-6667-4b1c-8f7e-2981313cbb6c tempest-HypervisorAdminNegativeUnderV252Test-1311181345 tempest-HypervisorAdminNegativeUnderV252Test-1311181345-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.008679 Oct 29 01:08:49.614462 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 663/1297] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Oct 29 01:08:49 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:49.616350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d2995b27-a8cc-4c4e-8dc9-4838e3a72ea1 tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Calling method '.version_select at 0x7f9d979ee700>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:49.618102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2995b27-a8cc-4c4e-8dc9-4838e3a72ea1 tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:49.618592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2995b27-a8cc-4c4e-8dc9-4838e3a72ea1 tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:49.619079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2995b27-a8cc-4c4e-8dc9-4838e3a72ea1 tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:49.625260 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-d2995b27-a8cc-4c4e-8dc9-4838e3a72ea1 tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] HTTP exception thrown: No hypervisor matching '03689e3a-5a21-4985-8471-11bedf0d11b3' could be found. Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d2995b27-a8cc-4c4e-8dc9-4838e3a72ea1 tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Request method failure captured: Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-hypervisors/03689e3a-5a21-4985-8471-11bedf0d11b3/servers HTTP/1.1 Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH0hNfKBMxgp-kcUBbUHOiRxovRSrdeADF452kSpxsvA5vax_Htt97otrS4iI2x9pfz9YRzN-_8MOcTETrGbGr3SHuErrdNL_5b6SBCz7jiJZky_bYgD2Z_60fYlu_egM5_z2VN6yagNWt10JafWiDwqmhaxQ4eHHeWH67wSwGUu3Js Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 9cc7019206c74de786d4a30a96e4e685 Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2108519542 Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cc7019206c74de786d4a30a96e4e685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9cc7019206c74de786d4a30a96e4e685"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cc7019206c74de786d4a30a96e4e685"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9cc7019206c74de786d4a30a96e4e685", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2108519542 Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 9cc7019206c74de786d4a30a96e4e685 Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2108519542 Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: b545f50c162248a28d7eba0b6982fadb Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: exception: No hypervisor matching '03689e3a-5a21-4985-8471-11bedf0d11b3' could be found. Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '03689e3a-5a21-4985-8471-11bedf0d11b3'} Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '03689e3a-5a21-4985-8471-11bedf0d11b3' could be found. Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '03689e3a-5a21-4985-8471-11bedf0d11b3' could be found. Oct 29 01:08:49.626629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:49.631555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d2995b27-a8cc-4c4e-8dc9-4838e3a72ea1 tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] Returning 404 to user: No hypervisor matching '03689e3a-5a21-4985-8471-11bedf0d11b3' could be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:49.631555 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d2995b27-a8cc-4c4e-8dc9-4838e3a72ea1 tempest-HypervisorAdminNegativeUnderV252Test-2108519542 tempest-HypervisorAdminNegativeUnderV252Test-2108519542-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/03689e3a-5a21-4985-8471-11bedf0d11b3/servers" status: 404 len: 123 microversion: 2.1 time: 0.015787 Oct 29 01:08:49.631555 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 664/1298] 10.222.0.26 () {58 vars in 1281 bytes} [Sat Oct 29 01:08:49 2022] GET /compute/v2.1/os-hypervisors/03689e3a-5a21-4985-8471-11bedf0d11b3/servers => generated 123 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:08:49.669229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cb6be7e9-d125-4292-82a5-c1cdf1a85d2d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:49.669898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cb6be7e9-d125-4292-82a5-c1cdf1a85d2d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:49.677045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb6be7e9-d125-4292-82a5-c1cdf1a85d2d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:49.677641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb6be7e9-d125-4292-82a5-c1cdf1a85d2d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:49.678261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb6be7e9-d125-4292-82a5-c1cdf1a85d2d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:49.678968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb6be7e9-d125-4292-82a5-c1cdf1a85d2d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:49.679425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb6be7e9-d125-4292-82a5-c1cdf1a85d2d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:49.679846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb6be7e9-d125-4292-82a5-c1cdf1a85d2d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:49.783176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-cb6be7e9-d125-4292-82a5-c1cdf1a85d2d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:49.805314 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cb6be7e9-d125-4292-82a5-c1cdf1a85d2d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.140698 Oct 29 01:08:49.806322 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 665/1299] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:49 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:08:50.025930 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-35cabc8e-1db0-4622-a54a-050bba9e7364 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.570622 Oct 29 01:08:50.026594 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 635/1300] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 29 01:08:49 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:50.041315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c0208526-90a0-4198-a05c-bf83cc673a2f tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Action: 'create', calling method: .version_select at 0x7f9d979cf040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-136985837", "description": "tempest-description-1449900189"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:50.484674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0c6e0f0b-c754-46d4-a946-9e0c26008822 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:50.485916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0c6e0f0b-c754-46d4-a946-9e0c26008822 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:50.494323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c6e0f0b-c754-46d4-a946-9e0c26008822 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:50.495042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c6e0f0b-c754-46d4-a946-9e0c26008822 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:50.495661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c6e0f0b-c754-46d4-a946-9e0c26008822 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:50.496568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c6e0f0b-c754-46d4-a946-9e0c26008822 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:50.497213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c6e0f0b-c754-46d4-a946-9e0c26008822 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:50.497800 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c6e0f0b-c754-46d4-a946-9e0c26008822 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:50.598559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0c6e0f0b-c754-46d4-a946-9e0c26008822 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:50.599252 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c0208526-90a0-4198-a05c-bf83cc673a2f tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.562262 Oct 29 01:08:50.600550 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 666/1301] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:08:50 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:50.608153 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0c6e0f0b-c754-46d4-a946-9e0c26008822 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1330 microversion: 2.1 time: 0.127489 Oct 29 01:08:50.617443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-150c0c39-a677-422c-9963-30cafdf97b15 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Action: 'create', calling method: .version_select at 0x7f9d97ae1e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-215319299", "description": "tempest-description-1770034799"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:50.622733 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 636/1302] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:50 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1330 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:50.836054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-803c8ce5-fc3d-416d-8bbb-7198f46683ea tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:50.836958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-803c8ce5-fc3d-416d-8bbb-7198f46683ea tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:50.843310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-803c8ce5-fc3d-416d-8bbb-7198f46683ea tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:50.844078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-803c8ce5-fc3d-416d-8bbb-7198f46683ea tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:50.844685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-803c8ce5-fc3d-416d-8bbb-7198f46683ea tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:50.845829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-803c8ce5-fc3d-416d-8bbb-7198f46683ea tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:50.847203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-803c8ce5-fc3d-416d-8bbb-7198f46683ea tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:50.847852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-803c8ce5-fc3d-416d-8bbb-7198f46683ea tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:50.940234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-803c8ce5-fc3d-416d-8bbb-7198f46683ea tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:50.963781 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-803c8ce5-fc3d-416d-8bbb-7198f46683ea tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.133068 Oct 29 01:08:50.965189 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 637/1303] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:50 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:08:51.302891 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-150c0c39-a677-422c-9963-30cafdf97b15 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.692378 Oct 29 01:08:51.306244 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 667/1304] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:08:50 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:08:51.322459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b165be8c-0b2a-4ddc-bced-aa828d93c539 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Action: 'create', calling method: .version_select at 0x7f9d97d1c0d0>, body: {"security_group_rule": {"parent_group_id": "dac891d6-30e0-45f2-a6d9-119dbb7b02ce", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "bcc9550d-b35f-4946-a4b5-f4d68b292f7c"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:51.632197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1e7e44a6-2c63-4f17-928e-844fc61701ea tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:51.632972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1e7e44a6-2c63-4f17-928e-844fc61701ea tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:51.639554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e7e44a6-2c63-4f17-928e-844fc61701ea tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:51.640267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e7e44a6-2c63-4f17-928e-844fc61701ea tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:51.640879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e7e44a6-2c63-4f17-928e-844fc61701ea tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:51.641613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e7e44a6-2c63-4f17-928e-844fc61701ea tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:51.642351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e7e44a6-2c63-4f17-928e-844fc61701ea tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:51.643606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e7e44a6-2c63-4f17-928e-844fc61701ea tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:51.772088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1e7e44a6-2c63-4f17-928e-844fc61701ea tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:51.785214 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1e7e44a6-2c63-4f17-928e-844fc61701ea tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1348 microversion: 2.1 time: 0.155599 Oct 29 01:08:51.786664 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 668/1305] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:51 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1348 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:51.992582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4872371b-b280-44a3-9f04-0ccc75082f36 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:51.993121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4872371b-b280-44a3-9f04-0ccc75082f36 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:51.999276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4872371b-b280-44a3-9f04-0ccc75082f36 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:51.999760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4872371b-b280-44a3-9f04-0ccc75082f36 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:52.000386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4872371b-b280-44a3-9f04-0ccc75082f36 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:52.007090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4872371b-b280-44a3-9f04-0ccc75082f36 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:52.007090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4872371b-b280-44a3-9f04-0ccc75082f36 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:52.007090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4872371b-b280-44a3-9f04-0ccc75082f36 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:52.099432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-4872371b-b280-44a3-9f04-0ccc75082f36 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:52.126873 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4872371b-b280-44a3-9f04-0ccc75082f36 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.138441 Oct 29 01:08:52.127883 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 669/1306] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:51 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:08:52.339063 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b165be8c-0b2a-4ddc-bced-aa828d93c539 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.018437 Oct 29 01:08:52.340293 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 638/1307] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 29 01:08:51 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:52.353078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4d131aa9-033e-47d2-a52f-51b6d088bffb tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Calling method '.version_select at 0x7f9d979eedc0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:52.623187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bc88d920-5b2f-4980-86fd-d3a8c10bb8f0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-403295118", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "aa7f8f73-d2d1-4330-a914-f73cc0db67b6"}], "security_groups": [{"name": "tempest-securitygroup--1976005246"}], "key_name": "tempest-keypair-1547659648", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:52.796950 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4d131aa9-033e-47d2-a52f-51b6d088bffb tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/bcc9550d-b35f-4946-a4b5-f4d68b292f7c" status: 202 len: 0 microversion: 2.1 time: 0.446681 Oct 29 01:08:52.797750 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 670/1308] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:08:52 2022] DELETE /compute/v2.1/os-security-groups/bcc9550d-b35f-4946-a4b5-f4d68b292f7c => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:08:52.808635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-da3e521a-c0e2-46eb-b5d0-dc48335bac44 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Calling method '.version_select at 0x7f9d97aca4c0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:52.812482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-bc88d920-5b2f-4980-86fd-d3a8c10bb8f0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] validate_networks() for [('aa7f8f73-d2d1-4330-a914-f73cc0db67b6', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:08:53.032257 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-da3e521a-c0e2-46eb-b5d0-dc48335bac44 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/dac891d6-30e0-45f2-a6d9-119dbb7b02ce" status: 200 len: 247 microversion: 2.1 time: 0.229218 Oct 29 01:08:53.032847 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 671/1309] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 29 01:08:52 2022] GET /compute/v2.1/os-security-groups/dac891d6-30e0-45f2-a6d9-119dbb7b02ce => generated 247 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:08:53.040303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0079c6b1-9ce9-4bfe-953b-4ff1836b9386 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:53.040978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0079c6b1-9ce9-4bfe-953b-4ff1836b9386 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:53.062700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0079c6b1-9ce9-4bfe-953b-4ff1836b9386 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:53.063141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0079c6b1-9ce9-4bfe-953b-4ff1836b9386 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:53.063559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0079c6b1-9ce9-4bfe-953b-4ff1836b9386 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:53.064306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0079c6b1-9ce9-4bfe-953b-4ff1836b9386 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:53.077832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0079c6b1-9ce9-4bfe-953b-4ff1836b9386 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:53.078896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0079c6b1-9ce9-4bfe-953b-4ff1836b9386 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:53.534720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0079c6b1-9ce9-4bfe-953b-4ff1836b9386 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:53.547153 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0079c6b1-9ce9-4bfe-953b-4ff1836b9386 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1378 microversion: 2.1 time: 0.513121 Oct 29 01:08:53.547980 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 672/1310] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:53 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1378 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:53.554267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4688601a-9bf0-44f6-8f6d-3859ac953eba tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Action: 'create', calling method: .version_select at 0x7f9d97ae1a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-30413786", "description": "tempest-description-1600220076"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:53.712640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-bc88d920-5b2f-4980-86fd-d3a8c10bb8f0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:08:53.713480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-bc88d920-5b2f-4980-86fd-d3a8c10bb8f0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:08:53.713954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-bc88d920-5b2f-4980-86fd-d3a8c10bb8f0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:08:53.714363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-bc88d920-5b2f-4980-86fd-d3a8c10bb8f0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:08:53.714785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-bc88d920-5b2f-4980-86fd-d3a8c10bb8f0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:08:53.732225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc88d920-5b2f-4980-86fd-d3a8c10bb8f0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:53.734888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc88d920-5b2f-4980-86fd-d3a8c10bb8f0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:53.737657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc88d920-5b2f-4980-86fd-d3a8c10bb8f0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:53.738471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc88d920-5b2f-4980-86fd-d3a8c10bb8f0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:53.738954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc88d920-5b2f-4980-86fd-d3a8c10bb8f0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:53.739383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc88d920-5b2f-4980-86fd-d3a8c10bb8f0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:53.777914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-bc88d920-5b2f-4980-86fd-d3a8c10bb8f0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Getting quotas for project 6719b662fc734d2797d515778a57296d. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:08:53.786164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-bc88d920-5b2f-4980-86fd-d3a8c10bb8f0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Getting quotas for user da623c3132aa466aa25685aa45fceaf9 and project 6719b662fc734d2797d515778a57296d. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:08:53.803385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bc88d920-5b2f-4980-86fd-d3a8c10bb8f0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:08:53.806429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bc88d920-5b2f-4980-86fd-d3a8c10bb8f0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:08:53.961664 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bc88d920-5b2f-4980-86fd-d3a8c10bb8f0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.342750 Oct 29 01:08:53.963880 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 639/1311] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:08:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:08:53.968894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0ceaa525-592f-420d-8041-54cbff1c03e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:53.969735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0ceaa525-592f-420d-8041-54cbff1c03e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:53.978782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ceaa525-592f-420d-8041-54cbff1c03e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:53.981860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ceaa525-592f-420d-8041-54cbff1c03e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:53.981860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ceaa525-592f-420d-8041-54cbff1c03e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:53.981860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ceaa525-592f-420d-8041-54cbff1c03e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:53.982974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ceaa525-592f-420d-8041-54cbff1c03e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:53.983767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ceaa525-592f-420d-8041-54cbff1c03e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:54.145070 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4688601a-9bf0-44f6-8f6d-3859ac953eba tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.582701 Oct 29 01:08:54.145070 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 673/1312] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:08:53 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:54.147939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d4126fb0-6822-432c-bb4c-3a340c9d2296 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:54.148559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d4126fb0-6822-432c-bb4c-3a340c9d2296 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:54.181764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-0ceaa525-592f-420d-8041-54cbff1c03e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:54.205436 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0ceaa525-592f-420d-8041-54cbff1c03e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.239723 Oct 29 01:08:54.206743 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 640/1313] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:53 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:54.212187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-56a661b8-ad1e-490f-be55-25451a13598a tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Action: 'create', calling method: .version_select at 0x7f9d97c673a0>, body: {"security_group_rule": {"parent_group_id": "f1d7d833-c94e-426a-a1eb-d2fc4781a267", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:54.273272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d4126fb0-6822-432c-bb4c-3a340c9d2296 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:54.299219 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d4126fb0-6822-432c-bb4c-3a340c9d2296 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1234 microversion: 2.1 time: 0.155826 Oct 29 01:08:54.319326 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 674/1314] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:54 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1234 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:54.571866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ae8a7891-f56f-4f5b-9362-0772ffa78e73 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:54.572645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ae8a7891-f56f-4f5b-9362-0772ffa78e73 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:54.589903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae8a7891-f56f-4f5b-9362-0772ffa78e73 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:54.589903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae8a7891-f56f-4f5b-9362-0772ffa78e73 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:54.589903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae8a7891-f56f-4f5b-9362-0772ffa78e73 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:54.589903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae8a7891-f56f-4f5b-9362-0772ffa78e73 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:54.589903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae8a7891-f56f-4f5b-9362-0772ffa78e73 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:54.590847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae8a7891-f56f-4f5b-9362-0772ffa78e73 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:54.908372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ae8a7891-f56f-4f5b-9362-0772ffa78e73 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:54.924596 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ae8a7891-f56f-4f5b-9362-0772ffa78e73 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1378 microversion: 2.1 time: 0.356144 Oct 29 01:08:54.928462 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 675/1315] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:54 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1378 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:08:54.932219 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-56a661b8-ad1e-490f-be55-25451a13598a tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.723730 Oct 29 01:08:54.935431 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 641/1316] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 29 01:08:54 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:54.947733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-124eeab3-0752-4b83-8ed6-f4098d325387 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Action: 'create', calling method: .version_select at 0x7f9d97c59310>, body: {"security_group_rule": {"parent_group_id": "f1d7d833-c94e-426a-a1eb-d2fc4781a267", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:55.079679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-2326b8db-2498-4a23-b1a6-43efa247a027 req-04f5c1d2-2cb6-42ee-b6f1-499c4eaea8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cedff71-8de0-4fb5-b294-af0c46e7e324", "tag": "fbf748c5-d7b1-45dc-a698-9d558f69324c"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:55.096012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2326b8db-2498-4a23-b1a6-43efa247a027 req-04f5c1d2-2cb6-42ee-b6f1-499c4eaea8f1 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:55.102373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2326b8db-2498-4a23-b1a6-43efa247a027 req-04f5c1d2-2cb6-42ee-b6f1-499c4eaea8f1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:55.102373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2326b8db-2498-4a23-b1a6-43efa247a027 req-04f5c1d2-2cb6-42ee-b6f1-499c4eaea8f1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:55.120996 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-2326b8db-2498-4a23-b1a6-43efa247a027 req-04f5c1d2-2cb6-42ee-b6f1-499c4eaea8f1 service nova] Creating event network-changed:fbf748c5-d7b1-45dc-a698-9d558f69324c for instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 on n-h2-862964-3 Oct 29 01:08:55.131567 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-2326b8db-2498-4a23-b1a6-43efa247a027 req-04f5c1d2-2cb6-42ee-b6f1-499c4eaea8f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056486 Oct 29 01:08:55.132768 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 642/1317] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:08:55.240789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7cafd989-214f-4672-a73f-63f569519100 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:55.241527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7cafd989-214f-4672-a73f-63f569519100 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:55.250345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7cafd989-214f-4672-a73f-63f569519100 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:55.254603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7cafd989-214f-4672-a73f-63f569519100 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:55.256279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7cafd989-214f-4672-a73f-63f569519100 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:55.259928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7cafd989-214f-4672-a73f-63f569519100 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:55.261865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7cafd989-214f-4672-a73f-63f569519100 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:55.262505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7cafd989-214f-4672-a73f-63f569519100 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:55.304007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:55.429301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-7cafd989-214f-4672-a73f-63f569519100 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:55.451690 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-124eeab3-0752-4b83-8ed6-f4098d325387 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.500828 Oct 29 01:08:55.451690 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 676/1318] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 29 01:08:54 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:08:55.461113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8b7d8a88-663a-4789-b109-a8ffbe9585c5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:55.461971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8b7d8a88-663a-4789-b109-a8ffbe9585c5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:55.487480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b7d8a88-663a-4789-b109-a8ffbe9585c5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:55.488454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b7d8a88-663a-4789-b109-a8ffbe9585c5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:55.491222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b7d8a88-663a-4789-b109-a8ffbe9585c5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:55.492222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b7d8a88-663a-4789-b109-a8ffbe9585c5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:55.492866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b7d8a88-663a-4789-b109-a8ffbe9585c5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:55.494622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b7d8a88-663a-4789-b109-a8ffbe9585c5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:55.499483 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7cafd989-214f-4672-a73f-63f569519100 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.263716 Oct 29 01:08:55.502871 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 643/1319] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:55 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:08:55.511377 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ca561f1e-a056-4e02-9610-8f7cae5abf0c tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Calling method '.version_select at 0x7f9d97c71700>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:55.618922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8b7d8a88-663a-4789-b109-a8ffbe9585c5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:55.631881 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8b7d8a88-663a-4789-b109-a8ffbe9585c5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1238 microversion: 2.1 time: 0.176540 Oct 29 01:08:55.633845 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 677/1320] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:55 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1238 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:55.638048 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ca561f1e-a056-4e02-9610-8f7cae5abf0c tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/f1d7d833-c94e-426a-a1eb-d2fc4781a267" status: 200 len: 663 microversion: 2.1 time: 0.133926 Oct 29 01:08:55.638846 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 644/1321] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 29 01:08:55 2022] GET /compute/v2.1/os-security-groups/f1d7d833-c94e-426a-a1eb-d2fc4781a267 => generated 663 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:55.654882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-78e25b62-41b0-4d20-8484-81b31754f8b9 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Calling method '.version_select at 0x7f9d97c59700>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:55.999818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-467b8337-10f9-4ff5-9617-57c68f21e190 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Calling method '.version_select at 0x7f9d97c52820>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:56.024451 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-78e25b62-41b0-4d20-8484-81b31754f8b9 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-group-rules/2a427f9e-e4b2-4520-8271-9f0dd654f73e" status: 202 len: 0 microversion: 2.1 time: 0.374542 Oct 29 01:08:56.027481 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 678/1322] 10.222.0.26 () {58 vars in 1287 bytes} [Sat Oct 29 01:08:55 2022] DELETE /compute/v2.1/os-security-group-rules/2a427f9e-e4b2-4520-8271-9f0dd654f73e => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:08:56.032917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b8963c5f-1510-487d-943e-2d288d101211 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:56.034114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b8963c5f-1510-487d-943e-2d288d101211 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:56.055619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8963c5f-1510-487d-943e-2d288d101211 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:56.056681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8963c5f-1510-487d-943e-2d288d101211 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:56.057890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8963c5f-1510-487d-943e-2d288d101211 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:56.058797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8963c5f-1510-487d-943e-2d288d101211 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:56.059429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8963c5f-1510-487d-943e-2d288d101211 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:56.060041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8963c5f-1510-487d-943e-2d288d101211 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:56.167717 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-467b8337-10f9-4ff5-9617-57c68f21e190 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f" status: 200 len: 371 microversion: 2.1 time: 0.400973 Oct 29 01:08:56.168317 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 645/1323] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 29 01:08:55 2022] GET /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f => generated 371 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:56.187093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-71199c6a-0dfc-40b2-843a-45ad95edb929 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Calling method '.version_select at 0x7f9d97de4670>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:56.300681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b8963c5f-1510-487d-943e-2d288d101211 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:56.316693 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b8963c5f-1510-487d-943e-2d288d101211 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1378 microversion: 2.1 time: 0.286496 Oct 29 01:08:56.316693 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 679/1324] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:56 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1378 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:56.323732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c05794d4-bd42-4841-99d1-dbc1ff7728f6 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Action: 'update', calling method: .version_select at 0x7f9d97ae1a60>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:56.407720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c05794d4-bd42-4841-99d1-dbc1ff7728f6 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:56.408212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c05794d4-bd42-4841-99d1-dbc1ff7728f6 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:56.410499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c05794d4-bd42-4841-99d1-dbc1ff7728f6 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:56.413874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c05794d4-bd42-4841-99d1-dbc1ff7728f6 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:56.415110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c05794d4-bd42-4841-99d1-dbc1ff7728f6 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:56.417130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c05794d4-bd42-4841-99d1-dbc1ff7728f6 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:56.597168 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c05794d4-bd42-4841-99d1-dbc1ff7728f6 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f" status: 200 len: 328 microversion: 2.1 time: 0.279905 Oct 29 01:08:56.619165 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-71199c6a-0dfc-40b2-843a-45ad95edb929 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/f1d7d833-c94e-426a-a1eb-d2fc4781a267" status: 202 len: 0 microversion: 2.1 time: 0.441319 Oct 29 01:08:56.619165 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 646/1325] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:08:56 2022] DELETE /compute/v2.1/os-security-groups/f1d7d833-c94e-426a-a1eb-d2fc4781a267 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:08:56.619652 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 680/1326] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 29 01:08:56 2022] PUT /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f => generated 328 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:56.620102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4528f172-6ea1-4350-99b5-1deeb7b22770 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:56.620102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4528f172-6ea1-4350-99b5-1deeb7b22770 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:56.633393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ae1ddc63-c2aa-4683-97fa-cc3c381f6ba0 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Calling method '.version_select at 0x7f9d97cae670>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:56.633853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4528f172-6ea1-4350-99b5-1deeb7b22770 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:56.634358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4528f172-6ea1-4350-99b5-1deeb7b22770 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:56.634978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4528f172-6ea1-4350-99b5-1deeb7b22770 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:56.635881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4528f172-6ea1-4350-99b5-1deeb7b22770 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:56.637064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4528f172-6ea1-4350-99b5-1deeb7b22770 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:56.637536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4528f172-6ea1-4350-99b5-1deeb7b22770 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:56.688261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG neutronclient.v2_0.client [None req-ae1ddc63-c2aa-4683-97fa-cc3c381f6ba0 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bcc9550d-b35f-4946-a4b5-f4d68b292f7c does not exist", "detail": ""}} {{(pid=121099) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:08:56.689110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.security_group_api [None req-ae1ddc63-c2aa-4683-97fa-cc3c381f6ba0 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Neutron security group bcc9550d-b35f-4946-a4b5-f4d68b292f7c not found {{(pid=121099) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 01:08:56.692211 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-ae1ddc63-c2aa-4683-97fa-cc3c381f6ba0 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] HTTP exception thrown: Security group bcc9550d-b35f-4946-a4b5-f4d68b292f7c does not exist Oct 29 01:08:56.692211 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-354c693e-cbd4-42a1-aa2b-4cffcce25a86'] Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ae1ddc63-c2aa-4683-97fa-cc3c381f6ba0 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Request method failure captured: Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/os-security-groups/bcc9550d-b35f-4946-a4b5-f4d68b292f7c HTTP/1.1 Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH0cLrl5q7iajfq5wrbAb9QiPrQfyMHJGlBMs53Jmy0n2-RrSDNS_gCoUBb7XSCADCaaYJKeUdpEXg88VtDdQrBPgvO5Mx7cx68mqY_2SqlmHVgh-t3ufax4gXp8UsT_3IDl19Jkn0aSYDi5hYFmNm_abkzMDuiMKMfxOBKvHmOYii4 Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 1cf4d58d390c47b18b0418df91e36a6a Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-278812147 Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1cf4d58d390c47b18b0418df91e36a6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1cf4d58d390c47b18b0418df91e36a6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1cf4d58d390c47b18b0418df91e36a6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1cf4d58d390c47b18b0418df91e36a6a", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-SecurityGroupRulesTestJSON-278812147 Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 1cf4d58d390c47b18b0418df91e36a6a Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-278812147 Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-SecurityGroupRulesTestJSON-278812147-project Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f290f95092ca4d468339f3c80ecaede0 Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-SecurityGroupRulesTestJSON-278812147-project Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: exception: Security group bcc9550d-b35f-4946-a4b5-f4d68b292f7c does not exist Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-354c693e-cbd4-42a1-aa2b-4cffcce25a86'] Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'bcc9550d-b35f-4946-a4b5-f4d68b292f7c'} Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:08:56.718165 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bcc9550d-b35f-4946-a4b5-f4d68b292f7c does not exist Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-354c693e-cbd4-42a1-aa2b-4cffcce25a86'] Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bcc9550d-b35f-4946-a4b5-f4d68b292f7c does not exist Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-354c693e-cbd4-42a1-aa2b-4cffcce25a86'] Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bcc9550d-b35f-4946-a4b5-f4d68b292f7c does not exist Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-354c693e-cbd4-42a1-aa2b-4cffcce25a86'] Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bcc9550d-b35f-4946-a4b5-f4d68b292f7c does not exist Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-354c693e-cbd4-42a1-aa2b-4cffcce25a86'] Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ae1ddc63-c2aa-4683-97fa-cc3c381f6ba0 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Returning 404 to user: Security group bcc9550d-b35f-4946-a4b5-f4d68b292f7c does not exist Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-354c693e-cbd4-42a1-aa2b-4cffcce25a86'] {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:56.724930 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ae1ddc63-c2aa-4683-97fa-cc3c381f6ba0 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/bcc9550d-b35f-4946-a4b5-f4d68b292f7c" status: 404 len: 194 microversion: 2.1 time: 0.096275 Oct 29 01:08:56.739688 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 681/1327] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:08:56 2022] DELETE /compute/v2.1/os-security-groups/bcc9550d-b35f-4946-a4b5-f4d68b292f7c => generated 194 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:56.782157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8be2f608-940d-4ba2-86bb-4a88734afa74 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:56.782786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8be2f608-940d-4ba2-86bb-4a88734afa74 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:56.805342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-4528f172-6ea1-4350-99b5-1deeb7b22770 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:56.834200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8be2f608-940d-4ba2-86bb-4a88734afa74 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:56.840734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8be2f608-940d-4ba2-86bb-4a88734afa74 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:56.844054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8be2f608-940d-4ba2-86bb-4a88734afa74 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:56.847547 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4528f172-6ea1-4350-99b5-1deeb7b22770 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.234322 Oct 29 01:08:56.852363 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 647/1328] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:56 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:56.858877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a71b095e-b544-4481-b763-18918b7ff878 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Calling method '.version_select at 0x7f9d97de4d30>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:56.870368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8be2f608-940d-4ba2-86bb-4a88734afa74 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:56.882983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8be2f608-940d-4ba2-86bb-4a88734afa74 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:56.884274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8be2f608-940d-4ba2-86bb-4a88734afa74 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:57.051515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8be2f608-940d-4ba2-86bb-4a88734afa74 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:57.060063 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8be2f608-940d-4ba2-86bb-4a88734afa74 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1286 microversion: 2.1 time: 0.311627 Oct 29 01:08:57.073508 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 682/1329] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:56 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1286 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:57.176250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1826456338", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:57.256529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] validate_networks() for None {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:08:57.490066 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a71b095e-b544-4481-b763-18918b7ff878 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/dac891d6-30e0-45f2-a6d9-119dbb7b02ce" status: 202 len: 0 microversion: 2.1 time: 0.636412 Oct 29 01:08:57.490720 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 648/1330] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:08:56 2022] DELETE /compute/v2.1/os-security-groups/dac891d6-30e0-45f2-a6d9-119dbb7b02ce => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:08:57.501286 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4ebf6487-6b6d-48ba-b104-17a525942ff7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:57.503538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4ebf6487-6b6d-48ba-b104-17a525942ff7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:57.511078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ebf6487-6b6d-48ba-b104-17a525942ff7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:57.511821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ebf6487-6b6d-48ba-b104-17a525942ff7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:57.512429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ebf6487-6b6d-48ba-b104-17a525942ff7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:57.513362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ebf6487-6b6d-48ba-b104-17a525942ff7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:57.513986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ebf6487-6b6d-48ba-b104-17a525942ff7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:57.514601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ebf6487-6b6d-48ba-b104-17a525942ff7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:57.822810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:08:57.824169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:08:57.824706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:08:57.825304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:08:57.825880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:08:57.838358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:57.838358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:57.838358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:57.838696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:57.838975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:57.839612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:57.850418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:57.862398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Getting quotas for project 78d9d46803b24d1bbeb580eb2cd2eb5f. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:08:57.869886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Getting quotas for user 873cb99b8f874f118fbb3bd549a5e0b3 and project 78d9d46803b24d1bbeb580eb2cd2eb5f. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:08:57.893910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.utils [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] cores quota exceeded for 78d9d46803b24d1bbeb580eb2cd2eb5f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121099) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 29 01:08:57.894944 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Request method failure captured: Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 145 Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH0mlOeAdk0of8f2OFqCXBmQP6Cc-ehmSxRbRiSIH5B8K6ACUwlNitVT3Wi5fDPuZ8yTM8SXvj5ploYAHfnFEfzOAl3RePEEheFI6AGkZNCW30Wv8p5dAdtDcxmJFZWhIy9OaEPUc4YTRn3LLDtEPWk9FPsZzR6neByNbWErSzqsmgs Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 78d9d46803b24d1bbeb580eb2cd2eb5f Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-QuotasAdminNegativeTest-886211093 Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78d9d46803b24d1bbeb580eb2cd2eb5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/78d9d46803b24d1bbeb580eb2cd2eb5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78d9d46803b24d1bbeb580eb2cd2eb5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_78d9d46803b24d1bbeb580eb2cd2eb5f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-QuotasAdminNegativeTest-886211093 Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 78d9d46803b24d1bbeb580eb2cd2eb5f Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-886211093 Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-QuotasAdminNegativeTest-886211093-project Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 873cb99b8f874f118fbb3bd549a5e0b3 Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-QuotasAdminNegativeTest-886211093-project Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1826456338", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1826456338', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452'}}} Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 01:08:57.902968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b84bd2f2-415e-47ca-96de-a090f65ab629 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.843011 Oct 29 01:08:57.907604 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 683/1331] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:08:57 2022] POST /compute/v2.1/servers => generated 111 bytes in 844 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:08:57.913659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c74091d0-b099-4119-a526-58f84112ad7a tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Calling method '.version_select at 0x7f9d97ae1b80>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:57.987234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4ebf6487-6b6d-48ba-b104-17a525942ff7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:57.996405 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4ebf6487-6b6d-48ba-b104-17a525942ff7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1378 microversion: 2.1 time: 0.503465 Oct 29 01:08:57.999092 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 649/1332] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:57 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1378 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:58.013453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e885576c-6577-49f2-ae6c-f6a14248ecc5 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:58.014075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e885576c-6577-49f2-ae6c-f6a14248ecc5 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:58.024892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e885576c-6577-49f2-ae6c-f6a14248ecc5 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:58.025887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e885576c-6577-49f2-ae6c-f6a14248ecc5 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:58.028075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e885576c-6577-49f2-ae6c-f6a14248ecc5 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:58.029181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e885576c-6577-49f2-ae6c-f6a14248ecc5 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:58.029972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e885576c-6577-49f2-ae6c-f6a14248ecc5 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:58.031069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e885576c-6577-49f2-ae6c-f6a14248ecc5 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:58.185068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-e885576c-6577-49f2-ae6c-f6a14248ecc5 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:08:58.206567 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e885576c-6577-49f2-ae6c-f6a14248ecc5 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1929 microversion: 2.75 time: 0.202269 Oct 29 01:08:58.207327 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 650/1333] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:08:57 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1929 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:08:58.212732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-60cc4a9a-8607-4285-bed4-2ef70582e238 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Action: 'update', calling method: .version_select at 0x7f9d97c52040>, body: {"quota_set": {"cores": 20}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:58.291637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60cc4a9a-8607-4285-bed4-2ef70582e238 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:58.292132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60cc4a9a-8607-4285-bed4-2ef70582e238 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:58.294487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60cc4a9a-8607-4285-bed4-2ef70582e238 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:58.295792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60cc4a9a-8607-4285-bed4-2ef70582e238 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:58.296877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60cc4a9a-8607-4285-bed4-2ef70582e238 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:58.297685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60cc4a9a-8607-4285-bed4-2ef70582e238 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:58.347770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:08:58.588086 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-60cc4a9a-8607-4285-bed4-2ef70582e238 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f" status: 200 len: 329 microversion: 2.1 time: 0.379301 Oct 29 01:08:58.601630 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 651/1334] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 29 01:08:58 2022] PUT /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f => generated 329 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:58.609957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-faa8a459-94d5-4470-877b-2499f3157962 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:58.609957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-faa8a459-94d5-4470-877b-2499f3157962 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:58.614931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faa8a459-94d5-4470-877b-2499f3157962 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:58.615436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faa8a459-94d5-4470-877b-2499f3157962 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:58.615883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faa8a459-94d5-4470-877b-2499f3157962 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:58.616606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faa8a459-94d5-4470-877b-2499f3157962 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:58.617071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faa8a459-94d5-4470-877b-2499f3157962 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:58.617533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faa8a459-94d5-4470-877b-2499f3157962 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:58.752924 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c74091d0-b099-4119-a526-58f84112ad7a tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/beb23417-9d99-4308-a24e-550c95e7fb7d" status: 202 len: 0 microversion: 2.1 time: 0.845073 Oct 29 01:08:58.753702 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 684/1335] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:08:57 2022] DELETE /compute/v2.1/os-security-groups/beb23417-9d99-4308-a24e-550c95e7fb7d => generated 0 bytes in 848 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:08:58.759330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-abeacae7-f2fd-4516-b9b2-12baff523245 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e38df889-5546-42f2-8fad-e816ed2556fa"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:58.762907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-abeacae7-f2fd-4516-b9b2-12baff523245 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:58.785514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abeacae7-f2fd-4516-b9b2-12baff523245 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:58.793360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abeacae7-f2fd-4516-b9b2-12baff523245 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:58.795571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abeacae7-f2fd-4516-b9b2-12baff523245 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:58.803407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abeacae7-f2fd-4516-b9b2-12baff523245 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:58.804141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abeacae7-f2fd-4516-b9b2-12baff523245 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:58.804605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abeacae7-f2fd-4516-b9b2-12baff523245 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:58.841398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-faa8a459-94d5-4470-877b-2499f3157962 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:58.852848 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-faa8a459-94d5-4470-877b-2499f3157962 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1292 microversion: 2.1 time: 0.249992 Oct 29 01:08:58.862863 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 652/1336] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:58 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1292 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:08:58.873843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4628aaef-7786-4d47-8e56-31f23717152c tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Calling method '.version_select at 0x7f9d97c9c550>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:58.994086 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4628aaef-7786-4d47-8e56-31f23717152c tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f" status: 200 len: 371 microversion: 2.1 time: 0.129739 Oct 29 01:08:58.994667 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 653/1337] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 29 01:08:58 2022] GET /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f => generated 371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:59.015125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cf5fde6c-bf33-4df1-8ef5-2148511f31db tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Calling method '.version_select at 0x7f9d97cae700>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:59.375954 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cf5fde6c-bf33-4df1-8ef5-2148511f31db tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/615eb9c8-5014-49e2-8d57-adf35f7f9b74" status: 202 len: 0 microversion: 2.1 time: 0.380218 Oct 29 01:08:59.376539 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 654/1338] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:08:58 2022] DELETE /compute/v2.1/os-security-groups/615eb9c8-5014-49e2-8d57-adf35f7f9b74 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:08:59.387478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b219434c-e8b7-4ed2-a066-4c9ddc0ea583 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Action: 'update', calling method: .version_select at 0x7f9d97c9ce50>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:08:59.478114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b219434c-e8b7-4ed2-a066-4c9ddc0ea583 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:59.478934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b219434c-e8b7-4ed2-a066-4c9ddc0ea583 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:59.479929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b219434c-e8b7-4ed2-a066-4c9ddc0ea583 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:59.482329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b219434c-e8b7-4ed2-a066-4c9ddc0ea583 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:59.483115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b219434c-e8b7-4ed2-a066-4c9ddc0ea583 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:59.483774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b219434c-e8b7-4ed2-a066-4c9ddc0ea583 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:59.620472 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b219434c-e8b7-4ed2-a066-4c9ddc0ea583 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f" status: 200 len: 328 microversion: 2.1 time: 0.241922 Oct 29 01:08:59.621655 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 655/1339] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 29 01:08:59 2022] PUT /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f => generated 328 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:08:59.628906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4f71e43b-4262-4d74-83d5-583df79550f8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:08:59.629950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4f71e43b-4262-4d74-83d5-583df79550f8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:08:59.638208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f71e43b-4262-4d74-83d5-583df79550f8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:59.638766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f71e43b-4262-4d74-83d5-583df79550f8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:59.639354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f71e43b-4262-4d74-83d5-583df79550f8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:59.640239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f71e43b-4262-4d74-83d5-583df79550f8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:08:59.640807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f71e43b-4262-4d74-83d5-583df79550f8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:08:59.641492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f71e43b-4262-4d74-83d5-583df79550f8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:08:59.986183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4f71e43b-4262-4d74-83d5-583df79550f8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:08:59.995341 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4f71e43b-4262-4d74-83d5-583df79550f8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1378 microversion: 2.1 time: 0.372282 Oct 29 01:08:59.996134 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 656/1340] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:08:59 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1378 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:00.057933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1f4910cf-355d-4bdc-bd96-b632339776d1 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Action: 'create', calling method: .version_select at 0x7f9d97c04ee0>, body: {"keypair": {"name": "tempest-keypair-1847294559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwC/tFh1CgjqUbkY/8NaGjEZSf1m8QWyqtGE0+0zdn23d382f0o4VGCJZ+2/26chKGKv/wvuTNDYqehzc17y2giBpj344OZ10pYf+utBxXo16QwDWI/1p/a3tiR6fF0FA=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:00.074917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-1f4910cf-355d-4bdc-bd96-b632339776d1 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Getting quotas for project 82589beab120404eac2b09ab70b5b9ab. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:00.080336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-1f4910cf-355d-4bdc-bd96-b632339776d1 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Getting quotas for user d19a2a21861641dc9ac061e1a8ba5275 and project 82589beab120404eac2b09ab70b5b9ab. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:00.178800 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1f4910cf-355d-4bdc-bd96-b632339776d1 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.181254 Oct 29 01:09:00.179406 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 657/1341] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:08:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:00.183798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b1e93b99-3a6e-4691-b66b-ec87ab1f5fb2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:00.184402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b1e93b99-3a6e-4691-b66b-ec87ab1f5fb2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:00.191555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1e93b99-3a6e-4691-b66b-ec87ab1f5fb2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:00.192110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1e93b99-3a6e-4691-b66b-ec87ab1f5fb2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:00.192629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1e93b99-3a6e-4691-b66b-ec87ab1f5fb2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:00.193351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1e93b99-3a6e-4691-b66b-ec87ab1f5fb2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:00.193808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1e93b99-3a6e-4691-b66b-ec87ab1f5fb2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:00.194226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1e93b99-3a6e-4691-b66b-ec87ab1f5fb2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:00.301881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-b1e93b99-3a6e-4691-b66b-ec87ab1f5fb2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:09:00.348451 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b1e93b99-3a6e-4691-b66b-ec87ab1f5fb2 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1935 microversion: 2.75 time: 0.167891 Oct 29 01:09:00.358466 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 658/1342] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:00 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1935 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:00.362988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a5b9fef7-5b08-478f-9f1f-eb6407024292 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Calling method '.version_select at 0x7f9d97c673a0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:00.884846 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a5b9fef7-5b08-478f-9f1f-eb6407024292 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/0ad97f8b-f89d-4688-a228-cfb6bdbd90cd" status: 202 len: 0 microversion: 2.1 time: 0.532412 Oct 29 01:09:00.885627 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 659/1343] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:09:00 2022] DELETE /compute/v2.1/os-security-groups/0ad97f8b-f89d-4688-a228-cfb6bdbd90cd => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:09:00.893212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-587783902", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:00.959487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] validate_networks() for None {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:09:01.008419 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-abeacae7-f2fd-4516-b9b2-12baff523245 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "POST /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.248762 Oct 29 01:09:01.008419 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 685/1344] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 29 01:08:58 2022] POST /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231/os-volume_attachments => generated 194 bytes in 2252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:01.020356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2ad4b5a3-81b2-4c87-8173-2812834c1e0d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:01.021376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2ad4b5a3-81b2-4c87-8173-2812834c1e0d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:01.037140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ad4b5a3-81b2-4c87-8173-2812834c1e0d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:01.037613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ad4b5a3-81b2-4c87-8173-2812834c1e0d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:01.040655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ad4b5a3-81b2-4c87-8173-2812834c1e0d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:01.042444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ad4b5a3-81b2-4c87-8173-2812834c1e0d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:01.043739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ad4b5a3-81b2-4c87-8173-2812834c1e0d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:01.044440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ad4b5a3-81b2-4c87-8173-2812834c1e0d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:01.361326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:09:01.362991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:09:01.362991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:09:01.363242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:09:01.363914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:09:01.371262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2ad4b5a3-81b2-4c87-8173-2812834c1e0d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:01.381948 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2ad4b5a3-81b2-4c87-8173-2812834c1e0d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1360 microversion: 2.1 time: 0.374151 Oct 29 01:09:01.382533 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 686/1345] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:01 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1360 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:01.388162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9081d360-e537-49ec-a561-1a8c6516ea89 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] Calling method '.version_select at 0x7f9d9796f8b0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:01.393794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:01.394517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:01.395124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:01.396071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:01.396680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:01.397453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:01.419163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Getting quotas for project 78d9d46803b24d1bbeb580eb2cd2eb5f. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:01.426361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Getting quotas for user 873cb99b8f874f118fbb3bd549a5e0b3 and project 78d9d46803b24d1bbeb580eb2cd2eb5f. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:01.442125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.utils [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] instances quota exceeded for 78d9d46803b24d1bbeb580eb2cd2eb5f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121100) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 29 01:09:01.442808 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Request method failure captured: Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 144 Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH0mlOeAdk0of8f2OFqCXBmQP6Cc-ehmSxRbRiSIH5B8K6ACUwlNitVT3Wi5fDPuZ8yTM8SXvj5ploYAHfnFEfzOAl3RePEEheFI6AGkZNCW30Wv8p5dAdtDcxmJFZWhIy9OaEPUc4YTRn3LLDtEPWk9FPsZzR6neByNbWErSzqsmgs Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 78d9d46803b24d1bbeb580eb2cd2eb5f Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-QuotasAdminNegativeTest-886211093 Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78d9d46803b24d1bbeb580eb2cd2eb5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/78d9d46803b24d1bbeb580eb2cd2eb5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78d9d46803b24d1bbeb580eb2cd2eb5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_78d9d46803b24d1bbeb580eb2cd2eb5f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-QuotasAdminNegativeTest-886211093 Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 78d9d46803b24d1bbeb580eb2cd2eb5f Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-886211093 Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-QuotasAdminNegativeTest-886211093-project Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 873cb99b8f874f118fbb3bd549a5e0b3 Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-QuotasAdminNegativeTest-886211093-project Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-587783902", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-587783902', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452'}}} Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 01:09:01.445925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3f2fc167-c9f4-46d8-8e26-aef192104942 tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.561430 Oct 29 01:09:01.456691 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 660/1346] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:09:00 2022] POST /compute/v2.1/servers => generated 119 bytes in 562 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:09:01.463894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-67d1f116-3c6e-48b5-8293-a2d5147e3af0 req-7e64a0a5-0ea7-4912-978c-fab8b69bdfcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8914c05-5333-46a4-8930-90cb1a93e5eb", "tag": "3ee3428d-0fa0-4f5f-835c-2e2776c92305"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:01.482700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-67d1f116-3c6e-48b5-8293-a2d5147e3af0 req-7e64a0a5-0ea7-4912-978c-fab8b69bdfcf service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:01.483462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-67d1f116-3c6e-48b5-8293-a2d5147e3af0 req-7e64a0a5-0ea7-4912-978c-fab8b69bdfcf service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:01.484016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-67d1f116-3c6e-48b5-8293-a2d5147e3af0 req-7e64a0a5-0ea7-4912-978c-fab8b69bdfcf service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:01.499679 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-67d1f116-3c6e-48b5-8293-a2d5147e3af0 req-7e64a0a5-0ea7-4912-978c-fab8b69bdfcf service nova] Creating event network-changed:3ee3428d-0fa0-4f5f-835c-2e2776c92305 for instance b8914c05-5333-46a4-8930-90cb1a93e5eb on n-h1-862964-3 Oct 29 01:09:01.502387 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-67d1f116-3c6e-48b5-8293-a2d5147e3af0 req-7e64a0a5-0ea7-4912-978c-fab8b69bdfcf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047176 Oct 29 01:09:01.503245 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 661/1347] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:01.511091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-32502164-0b81-442f-8db2-8b017886620e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:01.512109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-32502164-0b81-442f-8db2-8b017886620e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:01.522875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32502164-0b81-442f-8db2-8b017886620e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:01.522875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32502164-0b81-442f-8db2-8b017886620e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:01.523324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32502164-0b81-442f-8db2-8b017886620e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:01.524759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32502164-0b81-442f-8db2-8b017886620e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:01.525806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32502164-0b81-442f-8db2-8b017886620e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:01.526239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32502164-0b81-442f-8db2-8b017886620e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:01.723401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-32502164-0b81-442f-8db2-8b017886620e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:01.731900 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-32502164-0b81-442f-8db2-8b017886620e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1378 microversion: 2.1 time: 0.226405 Oct 29 01:09:01.732816 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 662/1348] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:01 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1378 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:01.751052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f3364b95-614f-4ddf-8a59-7879076845e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:01.752087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f3364b95-614f-4ddf-8a59-7879076845e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:01.759901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3364b95-614f-4ddf-8a59-7879076845e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:01.760646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3364b95-614f-4ddf-8a59-7879076845e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:01.761052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3364b95-614f-4ddf-8a59-7879076845e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:01.761854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3364b95-614f-4ddf-8a59-7879076845e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:01.762520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3364b95-614f-4ddf-8a59-7879076845e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:01.762952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3364b95-614f-4ddf-8a59-7879076845e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:01.821015 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9081d360-e537-49ec-a561-1a8c6516ea89 tempest-SecurityGroupRulesTestJSON-278812147 tempest-SecurityGroupRulesTestJSON-278812147-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/bd7a9b6f-8405-4b9a-afcf-5e23f1226f6c" status: 202 len: 0 microversion: 2.1 time: 0.437372 Oct 29 01:09:01.825769 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 687/1349] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:09:01 2022] DELETE /compute/v2.1/os-security-groups/bd7a9b6f-8405-4b9a-afcf-5e23f1226f6c => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:09:01.831364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-77bd1a4a-3cd7-4748-ad23-47b67d4dfb4f tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Action: 'update', calling method: .version_select at 0x7f9d979a5700>, body: {"quota_set": {"instances": 10}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:01.938860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=27 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:01.954512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-f3364b95-614f-4ddf-8a59-7879076845e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:09:01.954981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77bd1a4a-3cd7-4748-ad23-47b67d4dfb4f tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:01.954981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77bd1a4a-3cd7-4748-ad23-47b67d4dfb4f tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:01.954981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77bd1a4a-3cd7-4748-ad23-47b67d4dfb4f tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:01.954981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77bd1a4a-3cd7-4748-ad23-47b67d4dfb4f tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:01.954981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77bd1a4a-3cd7-4748-ad23-47b67d4dfb4f tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:01.955844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77bd1a4a-3cd7-4748-ad23-47b67d4dfb4f tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:02.019484 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f3364b95-614f-4ddf-8a59-7879076845e0 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1935 microversion: 2.75 time: 0.285176 Oct 29 01:09:02.020078 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 663/1350] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:01 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1935 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:02.152789 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-77bd1a4a-3cd7-4748-ad23-47b67d4dfb4f tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f" status: 200 len: 329 microversion: 2.1 time: 0.325635 Oct 29 01:09:02.163042 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 688/1351] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 29 01:09:01 2022] PUT /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f => generated 329 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:02.176963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-89c94732-3dbe-4445-aaaa-06237bdf7552 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Calling method '.version_select at 0x7f9d97d43a60>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:02.347102 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-89c94732-3dbe-4445-aaaa-06237bdf7552 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f" status: 200 len: 371 microversion: 2.1 time: 0.183367 Oct 29 01:09:02.369489 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 664/1352] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 29 01:09:02 2022] GET /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f => generated 371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:02.382467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9daeaf73-6ebb-46a1-9203-6fc7493c26c0 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Action: 'update', calling method: .version_select at 0x7f9d978fa3a0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:02.417906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-38b33359-ac93-47b7-b0fc-5196e09c5efa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:02.422230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-38b33359-ac93-47b7-b0fc-5196e09c5efa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:02.457245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38b33359-ac93-47b7-b0fc-5196e09c5efa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:02.457740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38b33359-ac93-47b7-b0fc-5196e09c5efa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:02.463819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38b33359-ac93-47b7-b0fc-5196e09c5efa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:02.464708 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38b33359-ac93-47b7-b0fc-5196e09c5efa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:02.473986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38b33359-ac93-47b7-b0fc-5196e09c5efa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:02.474534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38b33359-ac93-47b7-b0fc-5196e09c5efa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:02.506589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9daeaf73-6ebb-46a1-9203-6fc7493c26c0 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:02.507091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9daeaf73-6ebb-46a1-9203-6fc7493c26c0 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:02.507537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9daeaf73-6ebb-46a1-9203-6fc7493c26c0 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:02.508289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9daeaf73-6ebb-46a1-9203-6fc7493c26c0 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:02.508757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9daeaf73-6ebb-46a1-9203-6fc7493c26c0 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:02.509280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9daeaf73-6ebb-46a1-9203-6fc7493c26c0 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:02.598574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:02.712423 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9daeaf73-6ebb-46a1-9203-6fc7493c26c0 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f" status: 200 len: 325 microversion: 2.1 time: 0.334822 Oct 29 01:09:02.725182 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 689/1353] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 29 01:09:02 2022] PUT /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f => generated 325 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:02.761131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e73aa531-4611-40be-97dd-3b07a77403cd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:02.761813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e73aa531-4611-40be-97dd-3b07a77403cd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:02.770073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e73aa531-4611-40be-97dd-3b07a77403cd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:02.772067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e73aa531-4611-40be-97dd-3b07a77403cd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:02.772648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e73aa531-4611-40be-97dd-3b07a77403cd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:02.774251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e73aa531-4611-40be-97dd-3b07a77403cd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:02.777999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e73aa531-4611-40be-97dd-3b07a77403cd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:02.778470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e73aa531-4611-40be-97dd-3b07a77403cd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:03.150280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-38b33359-ac93-47b7-b0fc-5196e09c5efa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:03.162547 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-38b33359-ac93-47b7-b0fc-5196e09c5efa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1360 microversion: 2.1 time: 0.755042 Oct 29 01:09:03.166539 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 665/1354] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:02 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1360 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:03.193471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2140126506", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:03.280240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] validate_networks() for None {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:09:03.287382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e73aa531-4611-40be-97dd-3b07a77403cd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:03.304023 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e73aa531-4611-40be-97dd-3b07a77403cd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1378 microversion: 2.1 time: 0.548234 Oct 29 01:09:03.327229 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 690/1355] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:02 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1378 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:03.350992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-13b69924-370e-48b3-8790-3320153b8f59 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:03.351862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-13b69924-370e-48b3-8790-3320153b8f59 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:03.359782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13b69924-370e-48b3-8790-3320153b8f59 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:03.360453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13b69924-370e-48b3-8790-3320153b8f59 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:03.361077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13b69924-370e-48b3-8790-3320153b8f59 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:03.362114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13b69924-370e-48b3-8790-3320153b8f59 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:03.362898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13b69924-370e-48b3-8790-3320153b8f59 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:03.363743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13b69924-370e-48b3-8790-3320153b8f59 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:03.565841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-13b69924-370e-48b3-8790-3320153b8f59 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:09:03.598732 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-13b69924-370e-48b3-8790-3320153b8f59 tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1935 microversion: 2.75 time: 0.257922 Oct 29 01:09:03.599836 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 691/1356] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:03 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1935 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:03.727537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:09:03.728866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:09:03.730965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:09:03.731574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:09:03.732413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:09:03.756669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:03.758619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:03.760664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:03.761874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:03.763900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:03.765121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:03.797765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Getting quotas for project 78d9d46803b24d1bbeb580eb2cd2eb5f. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:03.806748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Getting quotas for user 873cb99b8f874f118fbb3bd549a5e0b3 and project 78d9d46803b24d1bbeb580eb2cd2eb5f. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:03.830103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.utils [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] ram quota exceeded for 78d9d46803b24d1bbeb580eb2cd2eb5f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121100) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 29 01:09:03.831253 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Request method failure captured: Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 145 Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH0mlOeAdk0of8f2OFqCXBmQP6Cc-ehmSxRbRiSIH5B8K6ACUwlNitVT3Wi5fDPuZ8yTM8SXvj5ploYAHfnFEfzOAl3RePEEheFI6AGkZNCW30Wv8p5dAdtDcxmJFZWhIy9OaEPUc4YTRn3LLDtEPWk9FPsZzR6neByNbWErSzqsmgs Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 78d9d46803b24d1bbeb580eb2cd2eb5f Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-QuotasAdminNegativeTest-886211093 Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78d9d46803b24d1bbeb580eb2cd2eb5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/78d9d46803b24d1bbeb580eb2cd2eb5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78d9d46803b24d1bbeb580eb2cd2eb5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_78d9d46803b24d1bbeb580eb2cd2eb5f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-QuotasAdminNegativeTest-886211093 Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 78d9d46803b24d1bbeb580eb2cd2eb5f Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-886211093 Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-QuotasAdminNegativeTest-886211093-project Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 873cb99b8f874f118fbb3bd549a5e0b3 Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-QuotasAdminNegativeTest-886211093-project Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2140126506", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2140126506', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452'}}} Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 01:09:03.833924 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-60bf2b3b-f7c1-4344-9539-520126a8da8d tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.669156 Oct 29 01:09:03.840143 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 666/1357] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:09:03 2022] POST /compute/v2.1/servers => generated 110 bytes in 671 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:09:03.847823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a227d7a5-d276-431e-a8d1-e9addc677fa1 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Action: 'update', calling method: .version_select at 0x7f9d97b91670>, body: {"quota_set": {"ram": 51200}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:03.948205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a227d7a5-d276-431e-a8d1-e9addc677fa1 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:03.953061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a227d7a5-d276-431e-a8d1-e9addc677fa1 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:03.953061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a227d7a5-d276-431e-a8d1-e9addc677fa1 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:03.953061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a227d7a5-d276-431e-a8d1-e9addc677fa1 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:03.953061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a227d7a5-d276-431e-a8d1-e9addc677fa1 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:03.953061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a227d7a5-d276-431e-a8d1-e9addc677fa1 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:04.120561 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a227d7a5-d276-431e-a8d1-e9addc677fa1 tempest-QuotasAdminNegativeTest-605297075 tempest-QuotasAdminNegativeTest-605297075-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f" status: 200 len: 329 microversion: 2.1 time: 0.275050 Oct 29 01:09:04.140005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3f9e4f0a-7dbd-4468-8fc8-bb3b39ac459e tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Action: 'update', calling method: .version_select at 0x7f9d97d1c820>, body: {"quota_set": {"ram": 0}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:04.140795 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 692/1358] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 29 01:09:03 2022] PUT /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f => generated 329 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:04.147549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3f9e4f0a-7dbd-4468-8fc8-bb3b39ac459e tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '873cb99b8f874f118fbb3bd549a5e0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d9d46803b24d1bbeb580eb2cd2eb5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3f9e4f0a-7dbd-4468-8fc8-bb3b39ac459e tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Request method failure captured: Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: request: PUT /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f HTTP/1.1 Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 25 Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH0mlOeAdk0of8f2OFqCXBmQP6Cc-ehmSxRbRiSIH5B8K6ACUwlNitVT3Wi5fDPuZ8yTM8SXvj5ploYAHfnFEfzOAl3RePEEheFI6AGkZNCW30Wv8p5dAdtDcxmJFZWhIy9OaEPUc4YTRn3LLDtEPWk9FPsZzR6neByNbWErSzqsmgs Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 78d9d46803b24d1bbeb580eb2cd2eb5f Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-QuotasAdminNegativeTest-886211093 Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78d9d46803b24d1bbeb580eb2cd2eb5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/78d9d46803b24d1bbeb580eb2cd2eb5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78d9d46803b24d1bbeb580eb2cd2eb5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_78d9d46803b24d1bbeb580eb2cd2eb5f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-QuotasAdminNegativeTest-886211093 Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 78d9d46803b24d1bbeb580eb2cd2eb5f Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-886211093 Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-QuotasAdminNegativeTest-886211093-project Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 873cb99b8f874f118fbb3bd549a5e0b3 Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-QuotasAdminNegativeTest-886211093-project Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: {"quota_set": {"ram": 0}} Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '78d9d46803b24d1bbeb580eb2cd2eb5f', 'body': {'quota_set': {'ram': 0}}} Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 01:09:04.164909 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 01:09:04.170283 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 01:09:04.170283 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 01:09:04.170283 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 01:09:04.170283 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 01:09:04.170283 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 29 01:09:04.170283 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:04.170283 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:04.170283 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:04.170283 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:04.170283 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:04.170283 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:04.170283 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 01:09:04.170283 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 01:09:04.170283 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 29 01:09:04.170283 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:04.172101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3f9e4f0a-7dbd-4468-8fc8-bb3b39ac459e tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:09:04.172987 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3f9e4f0a-7dbd-4468-8fc8-bb3b39ac459e tempest-QuotasAdminNegativeTest-886211093 tempest-QuotasAdminNegativeTest-886211093-project] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f" status: 403 len: 116 microversion: 2.1 time: 0.039606 Oct 29 01:09:04.173614 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 667/1359] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 29 01:09:04 2022] PUT /compute/v2.1/os-quota-sets/78d9d46803b24d1bbeb580eb2cd2eb5f => generated 116 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:09:04.195918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-62e31210-dc2c-44c3-8d19-9005f2949379 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:04.199032 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-62e31210-dc2c-44c3-8d19-9005f2949379 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:04.209890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62e31210-dc2c-44c3-8d19-9005f2949379 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:04.210385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62e31210-dc2c-44c3-8d19-9005f2949379 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:04.210831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62e31210-dc2c-44c3-8d19-9005f2949379 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:04.211653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62e31210-dc2c-44c3-8d19-9005f2949379 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:04.212026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62e31210-dc2c-44c3-8d19-9005f2949379 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:04.212460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62e31210-dc2c-44c3-8d19-9005f2949379 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:04.355309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5746629a-5b16-4e9c-b5bd-10e91c141c25 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:04.360735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5746629a-5b16-4e9c-b5bd-10e91c141c25 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:04.400184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5746629a-5b16-4e9c-b5bd-10e91c141c25 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:04.400882 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5746629a-5b16-4e9c-b5bd-10e91c141c25 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:04.402094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5746629a-5b16-4e9c-b5bd-10e91c141c25 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:04.403284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5746629a-5b16-4e9c-b5bd-10e91c141c25 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:04.403970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5746629a-5b16-4e9c-b5bd-10e91c141c25 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:04.404580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5746629a-5b16-4e9c-b5bd-10e91c141c25 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:04.879338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-62e31210-dc2c-44c3-8d19-9005f2949379 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:04.889009 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-62e31210-dc2c-44c3-8d19-9005f2949379 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1360 microversion: 2.1 time: 0.703987 Oct 29 01:09:04.893245 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 693/1360] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:04 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1360 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:04.905121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ccb3224b-2c3f-4b56-b4c1-e468058e3a5d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:04.905994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ccb3224b-2c3f-4b56-b4c1-e468058e3a5d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:04.919820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccb3224b-2c3f-4b56-b4c1-e468058e3a5d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:04.930123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccb3224b-2c3f-4b56-b4c1-e468058e3a5d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:04.930981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccb3224b-2c3f-4b56-b4c1-e468058e3a5d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:04.931925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccb3224b-2c3f-4b56-b4c1-e468058e3a5d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:04.932401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccb3224b-2c3f-4b56-b4c1-e468058e3a5d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:04.932949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccb3224b-2c3f-4b56-b4c1-e468058e3a5d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:04.997486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5746629a-5b16-4e9c-b5bd-10e91c141c25 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:05.006110 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5746629a-5b16-4e9c-b5bd-10e91c141c25 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1378 microversion: 2.1 time: 0.677290 Oct 29 01:09:05.022494 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 668/1361] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:04 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1378 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:05.115418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-ccb3224b-2c3f-4b56-b4c1-e468058e3a5d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] Lazy-loading 'services' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:09:05.164158 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ccb3224b-2c3f-4b56-b4c1-e468058e3a5d tempest-ServersAdmin275Test-1673338775 tempest-ServersAdmin275Test-1673338775-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1920 microversion: 2.75 time: 0.266551 Oct 29 01:09:05.164158 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 694/1362] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:04 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1920 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:05.230958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4dd42a9b-32bf-457d-a307-3578a8354691 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:05.231537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4dd42a9b-32bf-457d-a307-3578a8354691 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:05.256275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dd42a9b-32bf-457d-a307-3578a8354691 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:05.257086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dd42a9b-32bf-457d-a307-3578a8354691 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:05.257828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dd42a9b-32bf-457d-a307-3578a8354691 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:05.266167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dd42a9b-32bf-457d-a307-3578a8354691 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:05.266864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dd42a9b-32bf-457d-a307-3578a8354691 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:05.267322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dd42a9b-32bf-457d-a307-3578a8354691 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:05.335469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4dd42a9b-32bf-457d-a307-3578a8354691 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:09:05.429837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-ef3f6722-ca41-4503-a8a5-6abbe18ed50d req-ac8f01ef-d073-4d95-ad96-77989a9271f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cedff71-8de0-4fb5-b294-af0c46e7e324", "name": "network-vif-plugged", "status": "completed", "tag": "fbf748c5-d7b1-45dc-a698-9d558f69324c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:05.447581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ef3f6722-ca41-4503-a8a5-6abbe18ed50d req-ac8f01ef-d073-4d95-ad96-77989a9271f3 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:05.448075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ef3f6722-ca41-4503-a8a5-6abbe18ed50d req-ac8f01ef-d073-4d95-ad96-77989a9271f3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:05.450439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ef3f6722-ca41-4503-a8a5-6abbe18ed50d req-ac8f01ef-d073-4d95-ad96-77989a9271f3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:05.463988 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-ef3f6722-ca41-4503-a8a5-6abbe18ed50d req-ac8f01ef-d073-4d95-ad96-77989a9271f3 service nova] Creating event network-vif-plugged:fbf748c5-d7b1-45dc-a698-9d558f69324c for instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 on n-h2-862964-3 Oct 29 01:09:05.476566 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-ef3f6722-ca41-4503-a8a5-6abbe18ed50d req-ac8f01ef-d073-4d95-ad96-77989a9271f3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050375 Oct 29 01:09:05.477567 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 695/1363] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:09:05.778047 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4dd42a9b-32bf-457d-a307-3578a8354691 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "DELETE /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 204 len: 0 microversion: 2.75 time: 0.551646 Oct 29 01:09:05.779277 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 669/1364] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:09:05 2022] DELETE /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:09:05.788938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c035c49d-5582-4a28-ba3b-8ddfc3903620 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:05.791538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c035c49d-5582-4a28-ba3b-8ddfc3903620 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:05.806503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c035c49d-5582-4a28-ba3b-8ddfc3903620 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:05.811272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c035c49d-5582-4a28-ba3b-8ddfc3903620 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:05.811730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c035c49d-5582-4a28-ba3b-8ddfc3903620 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:05.821323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c035c49d-5582-4a28-ba3b-8ddfc3903620 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:05.822000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c035c49d-5582-4a28-ba3b-8ddfc3903620 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:05.823545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c035c49d-5582-4a28-ba3b-8ddfc3903620 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:05.922074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f1fd2ef3-ef8d-44d7-8c89-78f348206197 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:05.930376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f1fd2ef3-ef8d-44d7-8c89-78f348206197 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:05.945778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1fd2ef3-ef8d-44d7-8c89-78f348206197 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:05.945941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1fd2ef3-ef8d-44d7-8c89-78f348206197 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:05.946390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1fd2ef3-ef8d-44d7-8c89-78f348206197 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:05.947116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1fd2ef3-ef8d-44d7-8c89-78f348206197 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:05.947571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1fd2ef3-ef8d-44d7-8c89-78f348206197 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:05.956207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1fd2ef3-ef8d-44d7-8c89-78f348206197 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:05.959235 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:06.305731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f1fd2ef3-ef8d-44d7-8c89-78f348206197 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:06.318788 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f1fd2ef3-ef8d-44d7-8c89-78f348206197 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1360 microversion: 2.1 time: 0.400933 Oct 29 01:09:06.321361 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 670/1365] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:05 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1360 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:06.333753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c8aa0cb-d018-46c3-8cc1-223545f02ff1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:06.337011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9c8aa0cb-d018-46c3-8cc1-223545f02ff1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:06.345548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c8aa0cb-d018-46c3-8cc1-223545f02ff1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:06.346868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c8aa0cb-d018-46c3-8cc1-223545f02ff1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:06.347587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c8aa0cb-d018-46c3-8cc1-223545f02ff1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:06.348470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c8aa0cb-d018-46c3-8cc1-223545f02ff1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:06.349145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c8aa0cb-d018-46c3-8cc1-223545f02ff1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:06.350625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c8aa0cb-d018-46c3-8cc1-223545f02ff1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:06.489178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c035c49d-5582-4a28-ba3b-8ddfc3903620 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:06.501932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c035c49d-5582-4a28-ba3b-8ddfc3903620 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:06.508920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c035c49d-5582-4a28-ba3b-8ddfc3903620 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:06.535397 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c035c49d-5582-4a28-ba3b-8ddfc3903620 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1444 microversion: 2.75 time: 0.741248 Oct 29 01:09:06.536645 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 696/1366] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:05 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1444 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:06.732856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-880c6a09-1f56-46a4-a085-ca67d3cb254a tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:06.733605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-880c6a09-1f56-46a4-a085-ca67d3cb254a tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:06.765121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-880c6a09-1f56-46a4-a085-ca67d3cb254a tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:06.769769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-880c6a09-1f56-46a4-a085-ca67d3cb254a tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:06.770306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-880c6a09-1f56-46a4-a085-ca67d3cb254a tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:06.775502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-880c6a09-1f56-46a4-a085-ca67d3cb254a tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:06.775889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-880c6a09-1f56-46a4-a085-ca67d3cb254a tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:06.776363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-880c6a09-1f56-46a4-a085-ca67d3cb254a tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:06.816118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9c8aa0cb-d018-46c3-8cc1-223545f02ff1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:06.832604 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9c8aa0cb-d018-46c3-8cc1-223545f02ff1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1378 microversion: 2.1 time: 0.508304 Oct 29 01:09:06.855807 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 671/1367] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:06 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1378 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:07.059715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-880c6a09-1f56-46a4-a085-ca67d3cb254a tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'services' on Instance uuid 00a19183-c526-47be-95c4-d4c3a9936390 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:09:07.111030 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-880c6a09-1f56-46a4-a085-ca67d3cb254a tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 2344 microversion: 2.25 time: 0.381798 Oct 29 01:09:07.116566 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 697/1368] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:06 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 2344 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:09:07.142476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b9e4193e-6733-4152-8944-42ba3c202436 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:07.148945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9e4193e-6733-4152-8944-42ba3c202436 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:07.152477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9e4193e-6733-4152-8944-42ba3c202436 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:07.153494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9e4193e-6733-4152-8944-42ba3c202436 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:07.154412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9e4193e-6733-4152-8944-42ba3c202436 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:07.156702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9e4193e-6733-4152-8944-42ba3c202436 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:07.157261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9e4193e-6733-4152-8944-42ba3c202436 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:07.164205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=13 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:07.188772 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:07.203358 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b9e4193e-6733-4152-8944-42ba3c202436 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.064757 Oct 29 01:09:07.204763 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 672/1369] 10.222.0.26 () {60 vars in 1217 bytes} [Sat Oct 29 01:09:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:09:07.347756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-add82f59-ff73-404e-9630-fec5c3d19753 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:07.348645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-add82f59-ff73-404e-9630-fec5c3d19753 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:07.360937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-add82f59-ff73-404e-9630-fec5c3d19753 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:07.364088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-add82f59-ff73-404e-9630-fec5c3d19753 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:07.364088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-add82f59-ff73-404e-9630-fec5c3d19753 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:07.368907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-add82f59-ff73-404e-9630-fec5c3d19753 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:07.369752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-add82f59-ff73-404e-9630-fec5c3d19753 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:07.370393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-add82f59-ff73-404e-9630-fec5c3d19753 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:07.577376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4e65ce16-cfde-44b5-8b27-42513f929781 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:07.579399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4e65ce16-cfde-44b5-8b27-42513f929781 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:07.612363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e65ce16-cfde-44b5-8b27-42513f929781 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:07.616389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e65ce16-cfde-44b5-8b27-42513f929781 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:07.616972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e65ce16-cfde-44b5-8b27-42513f929781 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:07.625277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e65ce16-cfde-44b5-8b27-42513f929781 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:07.626003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e65ce16-cfde-44b5-8b27-42513f929781 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:07.626545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e65ce16-cfde-44b5-8b27-42513f929781 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:07.628551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-add82f59-ff73-404e-9630-fec5c3d19753 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:07.642955 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-add82f59-ff73-404e-9630-fec5c3d19753 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1360 microversion: 2.1 time: 0.300980 Oct 29 01:09:07.643926 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 698/1370] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:07 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1360 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:07.798139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4e65ce16-cfde-44b5-8b27-42513f929781 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:07.836795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4e65ce16-cfde-44b5-8b27-42513f929781 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:07.844846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4e65ce16-cfde-44b5-8b27-42513f929781 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:07.862398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-054455c1-f68e-49c9-8d06-6f6a9e50d977 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:07.863027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-054455c1-f68e-49c9-8d06-6f6a9e50d977 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:07.871245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-054455c1-f68e-49c9-8d06-6f6a9e50d977 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:07.871701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-054455c1-f68e-49c9-8d06-6f6a9e50d977 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:07.888716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-054455c1-f68e-49c9-8d06-6f6a9e50d977 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:07.892209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-054455c1-f68e-49c9-8d06-6f6a9e50d977 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:07.897650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-054455c1-f68e-49c9-8d06-6f6a9e50d977 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:07.898279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-054455c1-f68e-49c9-8d06-6f6a9e50d977 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:07.915838 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4e65ce16-cfde-44b5-8b27-42513f929781 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1444 microversion: 2.75 time: 0.340879 Oct 29 01:09:07.925324 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 673/1371] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:07 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1444 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:09:08.479026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-054455c1-f68e-49c9-8d06-6f6a9e50d977 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:08.494617 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-054455c1-f68e-49c9-8d06-6f6a9e50d977 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1378 microversion: 2.1 time: 0.635955 Oct 29 01:09:08.506208 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 699/1372] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:07 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1378 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:08.668484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-88814d9b-f016-4473-88b1-3056f97d5cd1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:08.669682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-88814d9b-f016-4473-88b1-3056f97d5cd1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:08.686333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88814d9b-f016-4473-88b1-3056f97d5cd1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:08.687127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88814d9b-f016-4473-88b1-3056f97d5cd1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:08.687732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88814d9b-f016-4473-88b1-3056f97d5cd1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:08.688628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88814d9b-f016-4473-88b1-3056f97d5cd1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:08.689570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88814d9b-f016-4473-88b1-3056f97d5cd1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:08.690698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88814d9b-f016-4473-88b1-3056f97d5cd1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:08.953891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1abd29bb-c7f2-4180-b6e1-3f46bc624f1a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:08.955921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1abd29bb-c7f2-4180-b6e1-3f46bc624f1a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:09.003808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1abd29bb-c7f2-4180-b6e1-3f46bc624f1a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:09.019745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1abd29bb-c7f2-4180-b6e1-3f46bc624f1a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:09.023828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1abd29bb-c7f2-4180-b6e1-3f46bc624f1a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:09.023828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1abd29bb-c7f2-4180-b6e1-3f46bc624f1a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:09.055196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1abd29bb-c7f2-4180-b6e1-3f46bc624f1a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:09.055729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1abd29bb-c7f2-4180-b6e1-3f46bc624f1a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:09.296688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1abd29bb-c7f2-4180-b6e1-3f46bc624f1a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:09.324696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1abd29bb-c7f2-4180-b6e1-3f46bc624f1a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:09.337428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1abd29bb-c7f2-4180-b6e1-3f46bc624f1a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:09.358027 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1abd29bb-c7f2-4180-b6e1-3f46bc624f1a tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1444 microversion: 2.75 time: 0.403414 Oct 29 01:09:09.361126 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 700/1373] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:08 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1444 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:09:09.502726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-88814d9b-f016-4473-88b1-3056f97d5cd1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:09.519088 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-88814d9b-f016-4473-88b1-3056f97d5cd1 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1360 microversion: 2.1 time: 0.854352 Oct 29 01:09:09.520496 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 674/1374] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:08 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1360 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:09.535385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a09c3a6d-abca-4ee3-8cbc-2cfdd3adc7cc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:09.536018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a09c3a6d-abca-4ee3-8cbc-2cfdd3adc7cc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:09.558107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a09c3a6d-abca-4ee3-8cbc-2cfdd3adc7cc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:09.558107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a09c3a6d-abca-4ee3-8cbc-2cfdd3adc7cc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:09.558107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a09c3a6d-abca-4ee3-8cbc-2cfdd3adc7cc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:09.558107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a09c3a6d-abca-4ee3-8cbc-2cfdd3adc7cc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:09.583378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a09c3a6d-abca-4ee3-8cbc-2cfdd3adc7cc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:09.585621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a09c3a6d-abca-4ee3-8cbc-2cfdd3adc7cc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:09.988855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a09c3a6d-abca-4ee3-8cbc-2cfdd3adc7cc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:10.006850 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a09c3a6d-abca-4ee3-8cbc-2cfdd3adc7cc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1527 microversion: 2.1 time: 0.476468 Oct 29 01:09:10.009518 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 701/1375] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:09 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1527 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:10.037621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-936526bc-6d49-41a6-b6bd-7e34f414a39d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:10.038247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-936526bc-6d49-41a6-b6bd-7e34f414a39d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:10.050094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-936526bc-6d49-41a6-b6bd-7e34f414a39d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:10.051001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-936526bc-6d49-41a6-b6bd-7e34f414a39d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:10.051608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-936526bc-6d49-41a6-b6bd-7e34f414a39d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:10.076965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-936526bc-6d49-41a6-b6bd-7e34f414a39d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:10.080721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-936526bc-6d49-41a6-b6bd-7e34f414a39d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:10.084117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-936526bc-6d49-41a6-b6bd-7e34f414a39d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:10.390860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b22d5ceb-0a42-480b-a9cc-47b24406f257 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:10.402114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b22d5ceb-0a42-480b-a9cc-47b24406f257 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:10.454042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-936526bc-6d49-41a6-b6bd-7e34f414a39d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:10.456877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b22d5ceb-0a42-480b-a9cc-47b24406f257 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:10.457492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b22d5ceb-0a42-480b-a9cc-47b24406f257 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:10.457977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b22d5ceb-0a42-480b-a9cc-47b24406f257 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:10.466662 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-936526bc-6d49-41a6-b6bd-7e34f414a39d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1527 microversion: 2.1 time: 0.435546 Oct 29 01:09:10.472596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b22d5ceb-0a42-480b-a9cc-47b24406f257 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:10.473850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b22d5ceb-0a42-480b-a9cc-47b24406f257 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:10.474512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b22d5ceb-0a42-480b-a9cc-47b24406f257 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:10.482784 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 675/1376] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:10 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1527 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:10.514435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-46e101f2-961f-4324-99aa-933477635f6d tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:10.650302 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-46e101f2-961f-4324-99aa-933477635f6d tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/96ff1bc9-8f29-4ce5-a655-891fcb9e939a" status: 202 len: 0 microversion: 2.1 time: 0.141605 Oct 29 01:09:10.653387 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 676/1377] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:09:10 2022] DELETE /compute/v2.1/flavors/96ff1bc9-8f29-4ce5-a655-891fcb9e939a => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:09:10.655729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b22d5ceb-0a42-480b-a9cc-47b24406f257 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:10.656912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9744fb19-55cb-4114-ba30-e2cb87d8cf6c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:10.657793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9744fb19-55cb-4114-ba30-e2cb87d8cf6c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:10.659005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b22d5ceb-0a42-480b-a9cc-47b24406f257 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:10.660452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b22d5ceb-0a42-480b-a9cc-47b24406f257 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:10.660937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-b22d5ceb-0a42-480b-a9cc-47b24406f257 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lazy-loading 'fault' on Instance uuid 01a4f398-2547-40b2-b476-2136eae44d7b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:09:10.667646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9744fb19-55cb-4114-ba30-e2cb87d8cf6c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:10.668481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9744fb19-55cb-4114-ba30-e2cb87d8cf6c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:10.669186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9744fb19-55cb-4114-ba30-e2cb87d8cf6c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:10.670140 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9744fb19-55cb-4114-ba30-e2cb87d8cf6c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:10.670925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9744fb19-55cb-4114-ba30-e2cb87d8cf6c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:10.671555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9744fb19-55cb-4114-ba30-e2cb87d8cf6c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:10.679071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:10.784970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b22d5ceb-0a42-480b-a9cc-47b24406f257 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:10.804653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b22d5ceb-0a42-480b-a9cc-47b24406f257 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:10.804653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b22d5ceb-0a42-480b-a9cc-47b24406f257 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9806b022cbf4505939c94b658f797e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4588a9c84a1442c1ac953fccdcef476b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:10.818615 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b22d5ceb-0a42-480b-a9cc-47b24406f257 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 200 len: 1449 microversion: 2.75 time: 0.431950 Oct 29 01:09:10.830331 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 702/1378] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:10 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 1449 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:10.850957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-63074b62-4431-425c-9b23-21e67412b0d7 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:10.962773 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-63074b62-4431-425c-9b23-21e67412b0d7 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.124848 Oct 29 01:09:10.965120 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 703/1379] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:09:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:10.969663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9744fb19-55cb-4114-ba30-e2cb87d8cf6c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:10.986214 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9744fb19-55cb-4114-ba30-e2cb87d8cf6c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1360 microversion: 2.1 time: 0.327511 Oct 29 01:09:10.986214 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 677/1380] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:10 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1360 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:11.004347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b876d1d-b15e-4f52-ae4e-5eb3ed3dc41c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:11.008761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7b876d1d-b15e-4f52-ae4e-5eb3ed3dc41c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:11.017049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b876d1d-b15e-4f52-ae4e-5eb3ed3dc41c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:11.018654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b876d1d-b15e-4f52-ae4e-5eb3ed3dc41c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:11.019981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b876d1d-b15e-4f52-ae4e-5eb3ed3dc41c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:11.020830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b876d1d-b15e-4f52-ae4e-5eb3ed3dc41c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:11.022110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b876d1d-b15e-4f52-ae4e-5eb3ed3dc41c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:11.022560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b876d1d-b15e-4f52-ae4e-5eb3ed3dc41c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:11.064457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7b876d1d-b15e-4f52-ae4e-5eb3ed3dc41c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:11.071809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7b876d1d-b15e-4f52-ae4e-5eb3ed3dc41c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Old instance type tempest-test_resize_flavor_-879470154, new instance type m1.heat {{(pid=121099) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 01:09:11.078878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7b876d1d-b15e-4f52-ae4e-5eb3ed3dc41c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:09:11.079504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7b876d1d-b15e-4f52-ae4e-5eb3ed3dc41c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:09:11.079978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7b876d1d-b15e-4f52-ae4e-5eb3ed3dc41c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:09:11.080909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7b876d1d-b15e-4f52-ae4e-5eb3ed3dc41c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:09:11.081464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7b876d1d-b15e-4f52-ae4e-5eb3ed3dc41c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:09:11.318562 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7b876d1d-b15e-4f52-ae4e-5eb3ed3dc41c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "POST /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324/action" status: 202 len: 0 microversion: 2.1 time: 0.322029 Oct 29 01:09:11.320353 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 704/1381] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:09:10 2022] POST /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:09:11.328559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c1f847c1-bcfe-4453-9a27-d71d4745677d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:11.331984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c1f847c1-bcfe-4453-9a27-d71d4745677d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:11.340610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1f847c1-bcfe-4453-9a27-d71d4745677d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:11.342602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1f847c1-bcfe-4453-9a27-d71d4745677d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:11.343153 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1f847c1-bcfe-4453-9a27-d71d4745677d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:11.344217 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1f847c1-bcfe-4453-9a27-d71d4745677d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:11.344950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1f847c1-bcfe-4453-9a27-d71d4745677d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:11.345623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1f847c1-bcfe-4453-9a27-d71d4745677d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:11.528569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c1f847c1-bcfe-4453-9a27-d71d4745677d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:11.539913 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c1f847c1-bcfe-4453-9a27-d71d4745677d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1536 microversion: 2.1 time: 0.215380 Oct 29 01:09:11.557180 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 678/1382] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:11 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1536 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:11.853219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a404550b-3b2f-442d-9ce7-c6830fa4c423 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:11.856071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a404550b-3b2f-442d-9ce7-c6830fa4c423 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] [instance: 01a4f398-2547-40b2-b476-2136eae44d7b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:11.869604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a404550b-3b2f-442d-9ce7-c6830fa4c423 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:11.870149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a404550b-3b2f-442d-9ce7-c6830fa4c423 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:11.872077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a404550b-3b2f-442d-9ce7-c6830fa4c423 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:11.873134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a404550b-3b2f-442d-9ce7-c6830fa4c423 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:11.874079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a404550b-3b2f-442d-9ce7-c6830fa4c423 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:11.874716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a404550b-3b2f-442d-9ce7-c6830fa4c423 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:11.895969 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-a404550b-3b2f-442d-9ce7-c6830fa4c423 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] HTTP exception thrown: Instance 01a4f398-2547-40b2-b476-2136eae44d7b could not be found. Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a404550b-3b2f-442d-9ce7-c6830fa4c423 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Request method failure captured: Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b HTTP/1.1 Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHzQENTJnmAqdOADyuVtz7uTMsNih7RuRfe_yb011-_XaJkneB7h37EDVsyToa-ctSOnhVcmXgl-yRiO7TT20OJ-MWR86WWnZrgxawhNqFj3ixRU090UQCOg7LtY9QVqZnDfxh-NWLjitD2NVJc4wh1lHHkvTdcxXs7YFSMy2P9C3o4 Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.75 Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 4588a9c84a1442c1ac953fccdcef476b Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersAdmin275Test-1406515202 Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4588a9c84a1442c1ac953fccdcef476b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4588a9c84a1442c1ac953fccdcef476b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4588a9c84a1442c1ac953fccdcef476b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4588a9c84a1442c1ac953fccdcef476b", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersAdmin275Test-1406515202 Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 4588a9c84a1442c1ac953fccdcef476b Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersAdmin275Test-1406515202 Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersAdmin275Test-1406515202-project Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: b9806b022cbf4505939c94b658f797e5 Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersAdmin275Test-1406515202-project Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 01a4f398-2547-40b2-b476-2136eae44d7b could not be found. Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '01a4f398-2547-40b2-b476-2136eae44d7b'} Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a4f398-2547-40b2-b476-2136eae44d7b could not be found. Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a4f398-2547-40b2-b476-2136eae44d7b could not be found. Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:11.898372 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:11.904005 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:11.904005 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:11.904005 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:11.904005 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:09:11.904005 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:09:11.904005 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a4f398-2547-40b2-b476-2136eae44d7b could not be found. Oct 29 01:09:11.904005 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:11.906878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a404550b-3b2f-442d-9ce7-c6830fa4c423 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] Returning 404 to user: Instance 01a4f398-2547-40b2-b476-2136eae44d7b could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:09:11.913738 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a404550b-3b2f-442d-9ce7-c6830fa4c423 tempest-ServersAdmin275Test-1406515202 tempest-ServersAdmin275Test-1406515202-project] 10.222.0.26 "GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b" status: 404 len: 111 microversion: 2.75 time: 0.059764 Oct 29 01:09:11.913738 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 705/1383] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:11 2022] GET /compute/v2.1/servers/01a4f398-2547-40b2-b476-2136eae44d7b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:09:12.008724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ba9d01fd-7147-4e90-a887-8a7e7045ca5a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:12.008724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ba9d01fd-7147-4e90-a887-8a7e7045ca5a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:12.015425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba9d01fd-7147-4e90-a887-8a7e7045ca5a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:12.016608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba9d01fd-7147-4e90-a887-8a7e7045ca5a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:12.018618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba9d01fd-7147-4e90-a887-8a7e7045ca5a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:12.019769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba9d01fd-7147-4e90-a887-8a7e7045ca5a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:12.020797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba9d01fd-7147-4e90-a887-8a7e7045ca5a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:12.021341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba9d01fd-7147-4e90-a887-8a7e7045ca5a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:12.103188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c86c6265-6b0c-49e2-94ce-23551b426432 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3aee8d5-861e-423a-9575-d5d615495c57", "device": "/dev/xvdb"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:12.109078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c86c6265-6b0c-49e2-94ce-23551b426432 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:12.119726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c86c6265-6b0c-49e2-94ce-23551b426432 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:12.121916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c86c6265-6b0c-49e2-94ce-23551b426432 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:12.123166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c86c6265-6b0c-49e2-94ce-23551b426432 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:12.124922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c86c6265-6b0c-49e2-94ce-23551b426432 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:12.127810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c86c6265-6b0c-49e2-94ce-23551b426432 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:12.128749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c86c6265-6b0c-49e2-94ce-23551b426432 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:12.226228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ba9d01fd-7147-4e90-a887-8a7e7045ca5a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:12.236262 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ba9d01fd-7147-4e90-a887-8a7e7045ca5a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1360 microversion: 2.1 time: 0.230151 Oct 29 01:09:12.236262 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 679/1384] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:12 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1360 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:12.759158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aabed009-de9d-4b98-aa4a-56277aee0893 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-770002424", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:12.865968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-aabed009-de9d-4b98-aa4a-56277aee0893 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] validate_networks() for None {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:09:12.981484 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c86c6265-6b0c-49e2-94ce-23551b426432 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "POST /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.882517 Oct 29 01:09:12.982624 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 706/1385] 10.222.0.26 () {62 vars in 1364 bytes} [Sat Oct 29 01:09:12 2022] POST /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-volume_attachments => generated 194 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:09:12.989960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c91dc3ff-4d9a-41e5-a1ca-23933881b6ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:12.994733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c91dc3ff-4d9a-41e5-a1ca-23933881b6ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:13.010708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c91dc3ff-4d9a-41e5-a1ca-23933881b6ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:13.011324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c91dc3ff-4d9a-41e5-a1ca-23933881b6ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:13.012379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c91dc3ff-4d9a-41e5-a1ca-23933881b6ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:13.014796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c91dc3ff-4d9a-41e5-a1ca-23933881b6ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:13.016151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c91dc3ff-4d9a-41e5-a1ca-23933881b6ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:13.016766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c91dc3ff-4d9a-41e5-a1ca-23933881b6ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:13.295855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-aabed009-de9d-4b98-aa4a-56277aee0893 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:09:13.296391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-aabed009-de9d-4b98-aa4a-56277aee0893 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:09:13.296939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-aabed009-de9d-4b98-aa4a-56277aee0893 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:09:13.297500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-aabed009-de9d-4b98-aa4a-56277aee0893 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:09:13.297991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-aabed009-de9d-4b98-aa4a-56277aee0893 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:09:13.310626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c91dc3ff-4d9a-41e5-a1ca-23933881b6ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:13.316153 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=83 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:13.320013 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c91dc3ff-4d9a-41e5-a1ca-23933881b6ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1536 microversion: 2.1 time: 0.336100 Oct 29 01:09:13.324102 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 707/1386] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:12 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1536 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:13.324341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aabed009-de9d-4b98-aa4a-56277aee0893 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:13.324341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aabed009-de9d-4b98-aa4a-56277aee0893 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:13.324341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aabed009-de9d-4b98-aa4a-56277aee0893 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:13.324705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aabed009-de9d-4b98-aa4a-56277aee0893 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:13.325200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aabed009-de9d-4b98-aa4a-56277aee0893 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:13.325626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aabed009-de9d-4b98-aa4a-56277aee0893 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:13.327839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-d2a630fc-86b3-4fbc-bbb8-bb927cf35d1e req-6dd48f2e-904b-4fd0-b7c4-356fc24fbddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8914c05-5333-46a4-8930-90cb1a93e5eb", "name": "network-vif-plugged", "status": "completed", "tag": "3ee3428d-0fa0-4f5f-835c-2e2776c92305"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:13.340184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d2a630fc-86b3-4fbc-bbb8-bb927cf35d1e req-6dd48f2e-904b-4fd0-b7c4-356fc24fbddf service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:13.340970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d2a630fc-86b3-4fbc-bbb8-bb927cf35d1e req-6dd48f2e-904b-4fd0-b7c4-356fc24fbddf service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:13.341782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d2a630fc-86b3-4fbc-bbb8-bb927cf35d1e req-6dd48f2e-904b-4fd0-b7c4-356fc24fbddf service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:13.348206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-aabed009-de9d-4b98-aa4a-56277aee0893 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Getting quotas for project ef26e5ad38454b2ab3102864d73268d3. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:13.355266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-aabed009-de9d-4b98-aa4a-56277aee0893 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Getting quotas for user a2163198c1624bf0989594eb0e9f9bf1 and project ef26e5ad38454b2ab3102864d73268d3. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:13.356698 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-d2a630fc-86b3-4fbc-bbb8-bb927cf35d1e req-6dd48f2e-904b-4fd0-b7c4-356fc24fbddf service nova] Creating event network-vif-plugged:3ee3428d-0fa0-4f5f-835c-2e2776c92305 for instance b8914c05-5333-46a4-8930-90cb1a93e5eb on n-h1-862964-3 Oct 29 01:09:13.363044 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-d2a630fc-86b3-4fbc-bbb8-bb927cf35d1e req-6dd48f2e-904b-4fd0-b7c4-356fc24fbddf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039868 Oct 29 01:09:13.363665 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 708/1387] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:13.370738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c8936e4b-6848-4de7-be45-ac23d7feb53c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:13.371428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c8936e4b-6848-4de7-be45-ac23d7feb53c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:13.389861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8936e4b-6848-4de7-be45-ac23d7feb53c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:13.389861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8936e4b-6848-4de7-be45-ac23d7feb53c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:13.389861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8936e4b-6848-4de7-be45-ac23d7feb53c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:13.390974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aabed009-de9d-4b98-aa4a-56277aee0893 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:09:13.391077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8936e4b-6848-4de7-be45-ac23d7feb53c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:13.391077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8936e4b-6848-4de7-be45-ac23d7feb53c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:13.391077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8936e4b-6848-4de7-be45-ac23d7feb53c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:13.391302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aabed009-de9d-4b98-aa4a-56277aee0893 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:09:13.521988 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aabed009-de9d-4b98-aa4a-56277aee0893 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.086150 Oct 29 01:09:13.532004 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 680/1388] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:09:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:09:13.535675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a89ec08f-60a9-4825-9cf2-302c3943e1b6 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:13.536996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a89ec08f-60a9-4825-9cf2-302c3943e1b6 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:13.651496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a89ec08f-60a9-4825-9cf2-302c3943e1b6 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:13.665474 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a89ec08f-60a9-4825-9cf2-302c3943e1b6 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1221 microversion: 2.1 time: 0.130969 Oct 29 01:09:13.668504 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 681/1389] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:13 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1221 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:13.712147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c8936e4b-6848-4de7-be45-ac23d7feb53c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:13.721800 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c8936e4b-6848-4de7-be45-ac23d7feb53c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1360 microversion: 2.1 time: 0.355942 Oct 29 01:09:13.727279 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 709/1390] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:13 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1360 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:14.433950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-209151b2-638f-432c-93e0-0ff6931ead58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:14.434715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-209151b2-638f-432c-93e0-0ff6931ead58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:14.446447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-209151b2-638f-432c-93e0-0ff6931ead58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:14.448480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-209151b2-638f-432c-93e0-0ff6931ead58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:14.449260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-209151b2-638f-432c-93e0-0ff6931ead58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:14.454039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-209151b2-638f-432c-93e0-0ff6931ead58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:14.455981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-209151b2-638f-432c-93e0-0ff6931ead58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:14.457536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-209151b2-638f-432c-93e0-0ff6931ead58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:14.616488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-209151b2-638f-432c-93e0-0ff6931ead58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:14.624338 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-209151b2-638f-432c-93e0-0ff6931ead58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1536 microversion: 2.1 time: 0.195756 Oct 29 01:09:14.624942 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 682/1391] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:14 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1536 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:14.701028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d6b35084-63a5-471c-bfbf-0e8dd4387215 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:14.702308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d6b35084-63a5-471c-bfbf-0e8dd4387215 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:14.712336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=12 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:14.713794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=23 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:14.753177 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fefc3dbe-fd58-45a3-b5b9-292b8b367c78 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:14.755493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fefc3dbe-fd58-45a3-b5b9-292b8b367c78 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:14.762569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fefc3dbe-fd58-45a3-b5b9-292b8b367c78 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:14.763067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fefc3dbe-fd58-45a3-b5b9-292b8b367c78 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:14.763505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fefc3dbe-fd58-45a3-b5b9-292b8b367c78 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:14.764214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fefc3dbe-fd58-45a3-b5b9-292b8b367c78 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:14.768771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fefc3dbe-fd58-45a3-b5b9-292b8b367c78 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:14.769261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fefc3dbe-fd58-45a3-b5b9-292b8b367c78 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:14.817080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d6b35084-63a5-471c-bfbf-0e8dd4387215 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:14.836444 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d6b35084-63a5-471c-bfbf-0e8dd4387215 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1221 microversion: 2.1 time: 0.141032 Oct 29 01:09:14.837058 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 710/1392] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:14 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1221 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:14.995482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fefc3dbe-fd58-45a3-b5b9-292b8b367c78 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:15.004904 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fefc3dbe-fd58-45a3-b5b9-292b8b367c78 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1360 microversion: 2.1 time: 0.256325 Oct 29 01:09:15.006101 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 683/1393] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:14 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1360 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:15.651860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6544ef87-f781-4471-81a0-047c872abb00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:15.652481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6544ef87-f781-4471-81a0-047c872abb00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:15.671055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6544ef87-f781-4471-81a0-047c872abb00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:15.673182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6544ef87-f781-4471-81a0-047c872abb00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:15.675144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6544ef87-f781-4471-81a0-047c872abb00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:15.676787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6544ef87-f781-4471-81a0-047c872abb00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:15.678392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6544ef87-f781-4471-81a0-047c872abb00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:15.679662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6544ef87-f781-4471-81a0-047c872abb00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:15.859926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a204cb64-ee7a-4ec5-b036-cdd3546c378c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:15.861366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a204cb64-ee7a-4ec5-b036-cdd3546c378c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:15.872900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a204cb64-ee7a-4ec5-b036-cdd3546c378c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:15.876253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a204cb64-ee7a-4ec5-b036-cdd3546c378c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:15.876253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a204cb64-ee7a-4ec5-b036-cdd3546c378c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:15.878509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a204cb64-ee7a-4ec5-b036-cdd3546c378c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:15.881766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a204cb64-ee7a-4ec5-b036-cdd3546c378c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:15.882253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a204cb64-ee7a-4ec5-b036-cdd3546c378c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:15.927233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6544ef87-f781-4471-81a0-047c872abb00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:15.942385 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6544ef87-f781-4471-81a0-047c872abb00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1536 microversion: 2.1 time: 0.297642 Oct 29 01:09:15.943493 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 711/1394] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:15 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1536 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:15.988324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a204cb64-ee7a-4ec5-b036-cdd3546c378c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:16.006947 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a204cb64-ee7a-4ec5-b036-cdd3546c378c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1217 microversion: 2.1 time: 0.150885 Oct 29 01:09:16.008366 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 684/1395] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:15 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:16.032717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4c50a335-e8cd-4ab0-ac54-26b3f4cd87c7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:16.034420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4c50a335-e8cd-4ab0-ac54-26b3f4cd87c7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:16.043627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c50a335-e8cd-4ab0-ac54-26b3f4cd87c7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:16.044621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c50a335-e8cd-4ab0-ac54-26b3f4cd87c7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:16.045474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c50a335-e8cd-4ab0-ac54-26b3f4cd87c7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:16.048444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c50a335-e8cd-4ab0-ac54-26b3f4cd87c7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:16.048444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c50a335-e8cd-4ab0-ac54-26b3f4cd87c7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:16.048444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c50a335-e8cd-4ab0-ac54-26b3f4cd87c7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:16.438099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4c50a335-e8cd-4ab0-ac54-26b3f4cd87c7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:16.450782 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4c50a335-e8cd-4ab0-ac54-26b3f4cd87c7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1542 microversion: 2.1 time: 0.424697 Oct 29 01:09:16.456147 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 712/1396] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:16 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1542 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:16.483195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-34382926-a1cd-450e-a017-4115e4e6377e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:16.484149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-34382926-a1cd-450e-a017-4115e4e6377e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:16.497491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34382926-a1cd-450e-a017-4115e4e6377e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:16.501441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34382926-a1cd-450e-a017-4115e4e6377e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:16.501441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34382926-a1cd-450e-a017-4115e4e6377e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:16.502453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34382926-a1cd-450e-a017-4115e4e6377e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:16.503758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34382926-a1cd-450e-a017-4115e4e6377e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:16.507529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34382926-a1cd-450e-a017-4115e4e6377e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:16.712603 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-34382926-a1cd-450e-a017-4115e4e6377e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.230642 Oct 29 01:09:16.714042 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 685/1397] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:09:16 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-interface => generated 284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:16.965452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1edddeb0-e058-4489-ae01-143c609d1f3c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:16.966802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1edddeb0-e058-4489-ae01-143c609d1f3c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:16.979375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1edddeb0-e058-4489-ae01-143c609d1f3c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:16.983572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1edddeb0-e058-4489-ae01-143c609d1f3c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:16.984406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1edddeb0-e058-4489-ae01-143c609d1f3c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:16.985394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1edddeb0-e058-4489-ae01-143c609d1f3c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:16.986284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1edddeb0-e058-4489-ae01-143c609d1f3c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:16.988174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1edddeb0-e058-4489-ae01-143c609d1f3c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:17.039129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ed8d5ceb-851d-43b6-b32f-cf5cf18c81f2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:17.039740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ed8d5ceb-851d-43b6-b32f-cf5cf18c81f2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:17.056026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed8d5ceb-851d-43b6-b32f-cf5cf18c81f2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:17.069561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed8d5ceb-851d-43b6-b32f-cf5cf18c81f2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:17.071207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed8d5ceb-851d-43b6-b32f-cf5cf18c81f2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:17.073776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed8d5ceb-851d-43b6-b32f-cf5cf18c81f2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:17.075752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed8d5ceb-851d-43b6-b32f-cf5cf18c81f2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:17.078692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed8d5ceb-851d-43b6-b32f-cf5cf18c81f2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:17.332090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ed8d5ceb-851d-43b6-b32f-cf5cf18c81f2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:17.345534 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ed8d5ceb-851d-43b6-b32f-cf5cf18c81f2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1273 microversion: 2.1 time: 0.312436 Oct 29 01:09:17.348635 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 686/1398] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:17 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1273 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:17.603901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1edddeb0-e058-4489-ae01-143c609d1f3c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:17.628054 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1edddeb0-e058-4489-ae01-143c609d1f3c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1536 microversion: 2.1 time: 0.665846 Oct 29 01:09:17.634149 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 713/1399] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:16 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1536 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:18.375767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-57ede649-64a2-4000-8f5a-939f89bd2b17 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:18.376433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-57ede649-64a2-4000-8f5a-939f89bd2b17 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:18.440439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57ede649-64a2-4000-8f5a-939f89bd2b17 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:18.450523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57ede649-64a2-4000-8f5a-939f89bd2b17 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:18.451001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57ede649-64a2-4000-8f5a-939f89bd2b17 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:18.459474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57ede649-64a2-4000-8f5a-939f89bd2b17 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:18.460283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57ede649-64a2-4000-8f5a-939f89bd2b17 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:18.460959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57ede649-64a2-4000-8f5a-939f89bd2b17 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:18.655962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5f5c2fdc-18a9-40d5-a65d-b79d8f6c86bc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:18.656489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5f5c2fdc-18a9-40d5-a65d-b79d8f6c86bc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:18.674623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f5c2fdc-18a9-40d5-a65d-b79d8f6c86bc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:18.679745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f5c2fdc-18a9-40d5-a65d-b79d8f6c86bc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:18.680244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f5c2fdc-18a9-40d5-a65d-b79d8f6c86bc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:18.681034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f5c2fdc-18a9-40d5-a65d-b79d8f6c86bc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:18.696421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f5c2fdc-18a9-40d5-a65d-b79d8f6c86bc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:18.696421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f5c2fdc-18a9-40d5-a65d-b79d8f6c86bc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:19.105547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-57ede649-64a2-4000-8f5a-939f89bd2b17 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:19.125371 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-57ede649-64a2-4000-8f5a-939f89bd2b17 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1279 microversion: 2.1 time: 0.751187 Oct 29 01:09:19.137187 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 687/1400] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:18 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1279 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:19.464903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5f5c2fdc-18a9-40d5-a65d-b79d8f6c86bc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:19.477735 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5f5c2fdc-18a9-40d5-a65d-b79d8f6c86bc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1536 microversion: 2.1 time: 0.826253 Oct 29 01:09:19.478485 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 714/1401] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:18 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1536 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:19.501308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5d8fb897-0b7c-4f30-955a-1fba2e0c6356 tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:19.506444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d8fb897-0b7c-4f30-955a-1fba2e0c6356 tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:19.506936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d8fb897-0b7c-4f30-955a-1fba2e0c6356 tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:19.507374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d8fb897-0b7c-4f30-955a-1fba2e0c6356 tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:19.508118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d8fb897-0b7c-4f30-955a-1fba2e0c6356 tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:19.533551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d8fb897-0b7c-4f30-955a-1fba2e0c6356 tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:19.534008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d8fb897-0b7c-4f30-955a-1fba2e0c6356 tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:19.601837 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5d8fb897-0b7c-4f30-955a-1fba2e0c6356 tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.452073 Oct 29 01:09:19.602715 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 688/1402] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:09:19 2022] GET /compute/v2.1/os-services => generated 944 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:19.608891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f48d5789-5185-4152-aa4e-c270ecd06a0e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:19.615250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f48d5789-5185-4152-aa4e-c270ecd06a0e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:19.634396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-b218639a-56fa-44c2-b341-af942c71abbe req-d69db0a6-97ce-4080-828f-fc38e2c78f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8914c05-5333-46a4-8930-90cb1a93e5eb", "tag": "3ee3428d-0fa0-4f5f-835c-2e2776c92305"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:19.648893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f48d5789-5185-4152-aa4e-c270ecd06a0e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:19.649518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f48d5789-5185-4152-aa4e-c270ecd06a0e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:19.649974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f48d5789-5185-4152-aa4e-c270ecd06a0e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:19.650715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f48d5789-5185-4152-aa4e-c270ecd06a0e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:19.651171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f48d5789-5185-4152-aa4e-c270ecd06a0e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:19.651594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f48d5789-5185-4152-aa4e-c270ecd06a0e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:19.663858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b218639a-56fa-44c2-b341-af942c71abbe req-d69db0a6-97ce-4080-828f-fc38e2c78f58 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:19.665900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b218639a-56fa-44c2-b341-af942c71abbe req-d69db0a6-97ce-4080-828f-fc38e2c78f58 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:19.667205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b218639a-56fa-44c2-b341-af942c71abbe req-d69db0a6-97ce-4080-828f-fc38e2c78f58 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:19.699889 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-b218639a-56fa-44c2-b341-af942c71abbe req-d69db0a6-97ce-4080-828f-fc38e2c78f58 service nova] Creating event network-changed:3ee3428d-0fa0-4f5f-835c-2e2776c92305 for instance b8914c05-5333-46a4-8930-90cb1a93e5eb on n-h1-862964-3 Oct 29 01:09:19.713940 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-b218639a-56fa-44c2-b341-af942c71abbe req-d69db0a6-97ce-4080-828f-fc38e2c78f58 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229965 Oct 29 01:09:19.715812 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 715/1403] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:19.729750 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f48d5789-5185-4152-aa4e-c270ecd06a0e tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125294 Oct 29 01:09:19.732487 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 689/1404] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:09:19 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:19.737053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-db12223e-eca2-489e-95ff-1c97b0b259e6 tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:19.742539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5054d0f8-afb6-4325-b285-0a6c80e378a7 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:19.743036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5054d0f8-afb6-4325-b285-0a6c80e378a7 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:19.748109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db12223e-eca2-489e-95ff-1c97b0b259e6 tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:19.750806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db12223e-eca2-489e-95ff-1c97b0b259e6 tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:19.751280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db12223e-eca2-489e-95ff-1c97b0b259e6 tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:19.755130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db12223e-eca2-489e-95ff-1c97b0b259e6 tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:19.755935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db12223e-eca2-489e-95ff-1c97b0b259e6 tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:19.756846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5054d0f8-afb6-4325-b285-0a6c80e378a7 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:19.757258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db12223e-eca2-489e-95ff-1c97b0b259e6 tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:19.757414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5054d0f8-afb6-4325-b285-0a6c80e378a7 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:19.757863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5054d0f8-afb6-4325-b285-0a6c80e378a7 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:19.758581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5054d0f8-afb6-4325-b285-0a6c80e378a7 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:19.764315 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5054d0f8-afb6-4325-b285-0a6c80e378a7 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:19.764979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5054d0f8-afb6-4325-b285-0a6c80e378a7 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:19.836996 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-db12223e-eca2-489e-95ff-1c97b0b259e6 tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=n-d-862964-3" status: 200 len: 578 microversion: 2.1 time: 0.115951 Oct 29 01:09:19.838588 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 716/1405] 10.222.0.26 () {58 vars in 1172 bytes} [Sat Oct 29 01:09:19 2022] GET /compute/v2.1/os-services?host=n-d-862964-3 => generated 578 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:19.868898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d6ec59ef-b565-4fcc-8e04-666d6c3b09ef tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:19.882330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6ec59ef-b565-4fcc-8e04-666d6c3b09ef tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:19.886988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6ec59ef-b565-4fcc-8e04-666d6c3b09ef tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:19.887538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6ec59ef-b565-4fcc-8e04-666d6c3b09ef tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:19.888585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6ec59ef-b565-4fcc-8e04-666d6c3b09ef tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:19.890226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6ec59ef-b565-4fcc-8e04-666d6c3b09ef tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:19.890676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6ec59ef-b565-4fcc-8e04-666d6c3b09ef tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:19.953920 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d6ec59ef-b565-4fcc-8e04-666d6c3b09ef tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.097995 Oct 29 01:09:19.954564 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 717/1406] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Oct 29 01:09:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:19.969493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-364ce6bf-184b-4b45-ad23-d968e52d46ea tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:19.975026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-364ce6bf-184b-4b45-ad23-d968e52d46ea tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:19.979372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-364ce6bf-184b-4b45-ad23-d968e52d46ea tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:19.979836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-364ce6bf-184b-4b45-ad23-d968e52d46ea tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:19.983217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-364ce6bf-184b-4b45-ad23-d968e52d46ea tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:19.990327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-364ce6bf-184b-4b45-ad23-d968e52d46ea tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:19.990825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-364ce6bf-184b-4b45-ad23-d968e52d46ea tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:20.028089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:20.062487 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-364ce6bf-184b-4b45-ad23-d968e52d46ea tempest-ServicesAdminTestJSON-1549613536 tempest-ServicesAdminTestJSON-1549613536-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.097511 Oct 29 01:09:20.082949 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 718/1407] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:09:19 2022] GET /compute/v2.1/os-services => generated 944 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:20.165669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-21eea95f-dd06-4217-be9a-ceafd40c4a07 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:20.167433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-21eea95f-dd06-4217-be9a-ceafd40c4a07 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:20.195348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21eea95f-dd06-4217-be9a-ceafd40c4a07 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:20.196188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21eea95f-dd06-4217-be9a-ceafd40c4a07 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:20.196806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21eea95f-dd06-4217-be9a-ceafd40c4a07 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:20.197713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21eea95f-dd06-4217-be9a-ceafd40c4a07 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:20.198328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21eea95f-dd06-4217-be9a-ceafd40c4a07 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:20.198914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21eea95f-dd06-4217-be9a-ceafd40c4a07 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:20.241388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-5054d0f8-afb6-4325-b285-0a6c80e378a7 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lazy-loading 'services' on Instance uuid f38f9413-877d-43ab-b4ed-294552b3c231 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:09:20.342586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:20.684200 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5054d0f8-afb6-4325-b285-0a6c80e378a7 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231/os-volume_attachments/e38df889-5546-42f2-8fad-e816ed2556fa" status: 202 len: 0 microversion: 2.1 time: 0.946409 Oct 29 01:09:20.686192 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 690/1408] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 29 01:09:19 2022] DELETE /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231/os-volume_attachments/e38df889-5546-42f2-8fad-e816ed2556fa => generated 0 bytes in 949 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:09:20.719501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5705baa2-6a72-4415-9ebb-cd3b2fe50c95 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:20.720338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5705baa2-6a72-4415-9ebb-cd3b2fe50c95 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:20.736445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5705baa2-6a72-4415-9ebb-cd3b2fe50c95 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:20.741040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5705baa2-6a72-4415-9ebb-cd3b2fe50c95 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:20.741557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5705baa2-6a72-4415-9ebb-cd3b2fe50c95 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:20.742303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5705baa2-6a72-4415-9ebb-cd3b2fe50c95 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:20.742769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5705baa2-6a72-4415-9ebb-cd3b2fe50c95 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:20.743192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5705baa2-6a72-4415-9ebb-cd3b2fe50c95 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:21.141983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-21eea95f-dd06-4217-be9a-ceafd40c4a07 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:21.171786 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-21eea95f-dd06-4217-be9a-ceafd40c4a07 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1279 microversion: 2.1 time: 1.013683 Oct 29 01:09:21.194539 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 719/1409] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:20 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1279 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:21.503293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5705baa2-6a72-4415-9ebb-cd3b2fe50c95 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:21.516587 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5705baa2-6a72-4415-9ebb-cd3b2fe50c95 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1541 microversion: 2.1 time: 0.828133 Oct 29 01:09:21.518036 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 691/1410] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:20 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1541 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:22.205986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-049f595f-82e5-47f6-9ebd-768f5f766d25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:22.205986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-049f595f-82e5-47f6-9ebd-768f5f766d25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:22.227203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-049f595f-82e5-47f6-9ebd-768f5f766d25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:22.227850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-049f595f-82e5-47f6-9ebd-768f5f766d25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:22.228887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-049f595f-82e5-47f6-9ebd-768f5f766d25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:22.229438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-049f595f-82e5-47f6-9ebd-768f5f766d25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:22.230196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-049f595f-82e5-47f6-9ebd-768f5f766d25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:22.231385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-049f595f-82e5-47f6-9ebd-768f5f766d25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:22.552959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a869cd67-28cd-4c94-8517-a8e76e9e1605 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:22.553425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a869cd67-28cd-4c94-8517-a8e76e9e1605 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:22.567102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a869cd67-28cd-4c94-8517-a8e76e9e1605 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:22.567593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a869cd67-28cd-4c94-8517-a8e76e9e1605 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:22.568025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a869cd67-28cd-4c94-8517-a8e76e9e1605 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:22.571088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a869cd67-28cd-4c94-8517-a8e76e9e1605 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:22.571755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a869cd67-28cd-4c94-8517-a8e76e9e1605 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:22.572191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a869cd67-28cd-4c94-8517-a8e76e9e1605 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:22.801657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-049f595f-82e5-47f6-9ebd-768f5f766d25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:22.813176 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-049f595f-82e5-47f6-9ebd-768f5f766d25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1321 microversion: 2.1 time: 0.615339 Oct 29 01:09:22.832581 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 720/1411] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:22 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1321 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:22.958752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a869cd67-28cd-4c94-8517-a8e76e9e1605 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:22.972055 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a869cd67-28cd-4c94-8517-a8e76e9e1605 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1541 microversion: 2.1 time: 0.426678 Oct 29 01:09:22.986506 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 692/1412] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:22 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1541 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:23.842074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-16257df5-9a31-498b-8c04-76d84484bfb5 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:23.843517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-16257df5-9a31-498b-8c04-76d84484bfb5 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:23.851517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16257df5-9a31-498b-8c04-76d84484bfb5 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:23.852371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16257df5-9a31-498b-8c04-76d84484bfb5 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:23.853066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16257df5-9a31-498b-8c04-76d84484bfb5 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:23.853918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16257df5-9a31-498b-8c04-76d84484bfb5 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:23.854489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16257df5-9a31-498b-8c04-76d84484bfb5 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:23.855160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16257df5-9a31-498b-8c04-76d84484bfb5 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:23.999406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c819c2a4-6a91-42aa-9f0e-753741034291 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:24.001273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c819c2a4-6a91-42aa-9f0e-753741034291 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:24.014123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c819c2a4-6a91-42aa-9f0e-753741034291 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:24.019087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c819c2a4-6a91-42aa-9f0e-753741034291 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:24.019925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c819c2a4-6a91-42aa-9f0e-753741034291 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:24.020921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c819c2a4-6a91-42aa-9f0e-753741034291 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:24.021802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c819c2a4-6a91-42aa-9f0e-753741034291 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:24.028018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c819c2a4-6a91-42aa-9f0e-753741034291 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:24.441495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=7 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:24.529573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c819c2a4-6a91-42aa-9f0e-753741034291 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:24.599922 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c819c2a4-6a91-42aa-9f0e-753741034291 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1541 microversion: 2.1 time: 0.605628 Oct 29 01:09:24.610602 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 693/1413] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:23 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1541 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:24.639851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-52a775ba-5784-430c-99c4-d4ca38b2e0d6 req-b3145f1a-4089-4301-8327-89859242fff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6ecee3f-2172-4154-9f8a-6365257b44e7", "tag": "24d01c5e-3ecc-4af5-ab8c-e7579f5bc941"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:24.657374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-52a775ba-5784-430c-99c4-d4ca38b2e0d6 req-b3145f1a-4089-4301-8327-89859242fff1 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:24.658172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-52a775ba-5784-430c-99c4-d4ca38b2e0d6 req-b3145f1a-4089-4301-8327-89859242fff1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:24.659522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-52a775ba-5784-430c-99c4-d4ca38b2e0d6 req-b3145f1a-4089-4301-8327-89859242fff1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:24.682894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-16257df5-9a31-498b-8c04-76d84484bfb5 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:24.694981 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-16257df5-9a31-498b-8c04-76d84484bfb5 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1321 microversion: 2.1 time: 0.858348 Oct 29 01:09:24.703700 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-52a775ba-5784-430c-99c4-d4ca38b2e0d6 req-b3145f1a-4089-4301-8327-89859242fff1 service nova] Creating event network-changed:24d01c5e-3ecc-4af5-ab8c-e7579f5bc941 for instance d6ecee3f-2172-4154-9f8a-6365257b44e7 on n-h1-862964-3 Oct 29 01:09:24.703700 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-52a775ba-5784-430c-99c4-d4ca38b2e0d6 req-b3145f1a-4089-4301-8327-89859242fff1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086173 Oct 29 01:09:24.703700 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 694/1414] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:24.713001 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 721/1415] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:23 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1321 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:25.638057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4e1c10d0-34bd-4e00-9170-24847b890591 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:25.638767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4e1c10d0-34bd-4e00-9170-24847b890591 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:25.650821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e1c10d0-34bd-4e00-9170-24847b890591 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:25.658922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e1c10d0-34bd-4e00-9170-24847b890591 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:25.658922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e1c10d0-34bd-4e00-9170-24847b890591 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:25.658922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e1c10d0-34bd-4e00-9170-24847b890591 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:25.658922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e1c10d0-34bd-4e00-9170-24847b890591 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:25.658922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e1c10d0-34bd-4e00-9170-24847b890591 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:25.726635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-922adf09-8225-4150-8e39-def9ad682e70 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:25.729459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-922adf09-8225-4150-8e39-def9ad682e70 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:25.748021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:25.764314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-922adf09-8225-4150-8e39-def9ad682e70 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:25.766399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-922adf09-8225-4150-8e39-def9ad682e70 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:25.766967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-922adf09-8225-4150-8e39-def9ad682e70 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:25.768207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-922adf09-8225-4150-8e39-def9ad682e70 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:25.769052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-922adf09-8225-4150-8e39-def9ad682e70 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:25.769882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-922adf09-8225-4150-8e39-def9ad682e70 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:25.795130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:26.126119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4e1c10d0-34bd-4e00-9170-24847b890591 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:26.138214 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4e1c10d0-34bd-4e00-9170-24847b890591 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1541 microversion: 2.1 time: 0.505999 Oct 29 01:09:26.142052 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 695/1416] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:25 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1541 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:26.247485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-922adf09-8225-4150-8e39-def9ad682e70 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:26.264299 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-922adf09-8225-4150-8e39-def9ad682e70 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1321 microversion: 2.1 time: 0.548404 Oct 29 01:09:26.265581 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 722/1417] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:25 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1321 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:26.491600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-93755590-7eac-4600-a36c-bd112800acfc tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:26.499963 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-93755590-7eac-4600-a36c-bd112800acfc tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.311453 Oct 29 01:09:26.500806 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 696/1418] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:09:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:09:26.516072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c1109761-d8d5-486d-9973-9c26162521d4 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:26.573675 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c1109761-d8d5-486d-9973-9c26162521d4 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] 10.222.0.26 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.061758 Oct 29 01:09:26.576437 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 723/1419] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 29 01:09:26 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:26.590046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a2496169-29ca-480e-843a-eabac10541e6 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:26.602352 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a2496169-29ca-480e-843a-eabac10541e6 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015726 Oct 29 01:09:26.603049 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 697/1420] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:09:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:26.616915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b981bafb-f2d9-4fc4-a90b-812fbcc52d29 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:26.626086 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b981bafb-f2d9-4fc4-a90b-812fbcc52d29 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013606 Oct 29 01:09:26.627833 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 724/1421] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:09:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:26.653174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-659de1f4-c466-42db-bc72-dccab31ca23d tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:26.695489 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-659de1f4-c466-42db-bc72-dccab31ca23d tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.046023 Oct 29 01:09:26.697785 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 698/1422] 10.222.0.26 () {58 vars in 1165 bytes} [Sat Oct 29 01:09:26 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:26.718259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-56dc4b3e-b804-4fc8-be09-f672c4ec1a4f tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:26.745486 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-56dc4b3e-b804-4fc8-be09-f672c4ec1a4f tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018523 Oct 29 01:09:26.745486 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 725/1423] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:09:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:26.758129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e091af0a-4f55-4dff-84b8-d58e5a347775 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:26.787656 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e091af0a-4f55-4dff-84b8-d58e5a347775 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.033792 Oct 29 01:09:26.788567 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 699/1424] 10.222.0.26 () {58 vars in 1169 bytes} [Sat Oct 29 01:09:26 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:26.809321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2e0bec3a-29da-4a6d-b78c-a8be8670959c tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:26.834815 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2e0bec3a-29da-4a6d-b78c-a8be8670959c tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.029933 Oct 29 01:09:26.835655 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 726/1425] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 29 01:09:26 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:26.850996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f11801ce-ecf9-4102-a569-11006805cd1f tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:26.865001 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f11801ce-ecf9-4102-a569-11006805cd1f tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017799 Oct 29 01:09:26.865959 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 700/1426] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:09:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:26.886782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-519e89d3-1d6d-4505-9d1a-054d81b994c2 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:26.942619 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-519e89d3-1d6d-4505-9d1a-054d81b994c2 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.067820 Oct 29 01:09:26.943648 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 727/1427] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Oct 29 01:09:26 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:26.963925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0f1687eb-7580-4af5-b2d2-7e938593ca71 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:26.976302 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0f1687eb-7580-4af5-b2d2-7e938593ca71 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016098 Oct 29 01:09:26.978889 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 701/1428] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:09:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:26.989899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0545755d-443a-4f9b-9593-ed9532160feb tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:27.019049 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0545755d-443a-4f9b-9593-ed9532160feb tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] 10.222.0.26 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.032714 Oct 29 01:09:27.028773 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 728/1429] 10.222.0.26 () {58 vars in 1144 bytes} [Sat Oct 29 01:09:26 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:27.034861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0fbbef65-6b89-4223-9457-74bdbae47691 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:27.044120 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0fbbef65-6b89-4223-9457-74bdbae47691 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013700 Oct 29 01:09:27.052892 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 702/1430] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:09:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:27.059119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c189a195-8cdc-444b-b0a9-3f04340f3720 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:27.090470 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c189a195-8cdc-444b-b0a9-3f04340f3720 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] 10.222.0.26 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.036014 Oct 29 01:09:27.091121 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 729/1431] 10.222.0.26 () {58 vars in 1148 bytes} [Sat Oct 29 01:09:27 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:27.107136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-24fad92d-510f-4e2c-86e2-84c20bfde17f tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:27.124751 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-24fad92d-510f-4e2c-86e2-84c20bfde17f tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] 10.222.0.26 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.021279 Oct 29 01:09:27.125890 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 703/1432] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Oct 29 01:09:27 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:27.148399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-83198b88-56a7-4a0e-b80d-faeb12c29c59 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:27.164397 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-83198b88-56a7-4a0e-b80d-faeb12c29c59 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028015 Oct 29 01:09:27.165829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-771bb8a6-c336-41a2-849b-a0bf6546f421 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:27.166661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-771bb8a6-c336-41a2-849b-a0bf6546f421 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:27.168349 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 730/1433] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:09:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:27.177853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-771bb8a6-c336-41a2-849b-a0bf6546f421 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:27.178756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-771bb8a6-c336-41a2-849b-a0bf6546f421 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:27.179348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-771bb8a6-c336-41a2-849b-a0bf6546f421 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:27.180648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-771bb8a6-c336-41a2-849b-a0bf6546f421 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:27.181399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-771bb8a6-c336-41a2-849b-a0bf6546f421 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:27.182076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-771bb8a6-c336-41a2-849b-a0bf6546f421 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:27.192973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-944c669b-ee63-4c03-86ae-b21c92376180 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:27.260097 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-944c669b-ee63-4c03-86ae-b21c92376180 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] 10.222.0.26 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.086474 Oct 29 01:09:27.260704 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 731/1434] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:09:27 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:27.277630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f8c22644-6266-4686-ab6b-05f13cb13825 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:27.304950 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f8c22644-6266-4686-ab6b-05f13cb13825 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031888 Oct 29 01:09:27.306155 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 732/1435] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:09:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:27.321223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fe60cebe-5252-4855-aabd-7a37515cdd34 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:27.323158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fe60cebe-5252-4855-aabd-7a37515cdd34 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:27.330878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe60cebe-5252-4855-aabd-7a37515cdd34 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:27.331897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe60cebe-5252-4855-aabd-7a37515cdd34 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:27.332518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe60cebe-5252-4855-aabd-7a37515cdd34 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:27.333700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe60cebe-5252-4855-aabd-7a37515cdd34 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:27.335775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe60cebe-5252-4855-aabd-7a37515cdd34 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:27.336438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe60cebe-5252-4855-aabd-7a37515cdd34 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:27.525886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-771bb8a6-c336-41a2-849b-a0bf6546f421 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:27.536965 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-771bb8a6-c336-41a2-849b-a0bf6546f421 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1541 microversion: 2.1 time: 0.375765 Oct 29 01:09:27.537592 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 704/1436] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:27 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1541 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:27.542292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3422e1f1-ebf0-418b-ad83-c8b952b92e97 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:27.550498 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3422e1f1-ebf0-418b-ad83-c8b952b92e97 tempest-FlavorsV2TestJSON-1209989742 tempest-FlavorsV2TestJSON-1209989742-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011883 Oct 29 01:09:27.565603 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 705/1437] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:09:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:27.634013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fe60cebe-5252-4855-aabd-7a37515cdd34 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:27.648128 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fe60cebe-5252-4855-aabd-7a37515cdd34 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1321 microversion: 2.1 time: 0.331313 Oct 29 01:09:27.648809 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 733/1438] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:27 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:28.568834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6ab7f65f-0053-47b2-979b-63fbf4a9b8df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:28.570081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6ab7f65f-0053-47b2-979b-63fbf4a9b8df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:28.592957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ab7f65f-0053-47b2-979b-63fbf4a9b8df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:28.593728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ab7f65f-0053-47b2-979b-63fbf4a9b8df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:28.594354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ab7f65f-0053-47b2-979b-63fbf4a9b8df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:28.595240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ab7f65f-0053-47b2-979b-63fbf4a9b8df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:28.596595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ab7f65f-0053-47b2-979b-63fbf4a9b8df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:28.597300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ab7f65f-0053-47b2-979b-63fbf4a9b8df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:28.750913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0fc9f266-fd03-47b2-bf11-da8910c20d3c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-527872637", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "95eff624-38bf-46e7-958c-9fcb3dae19f9"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:28.762232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6ab7f65f-0053-47b2-979b-63fbf4a9b8df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:28.773761 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6ab7f65f-0053-47b2-979b-63fbf4a9b8df tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1541 microversion: 2.1 time: 0.209582 Oct 29 01:09:28.777347 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 706/1439] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:28 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1541 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:28.784104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b83dd818-aadf-4db1-985a-fae8bd5dc853 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:28.784104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b83dd818-aadf-4db1-985a-fae8bd5dc853 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:28.791848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b83dd818-aadf-4db1-985a-fae8bd5dc853 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:28.792594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b83dd818-aadf-4db1-985a-fae8bd5dc853 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:28.793034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b83dd818-aadf-4db1-985a-fae8bd5dc853 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:28.793788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b83dd818-aadf-4db1-985a-fae8bd5dc853 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:28.794421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b83dd818-aadf-4db1-985a-fae8bd5dc853 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:28.794855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b83dd818-aadf-4db1-985a-fae8bd5dc853 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:28.820744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-0fc9f266-fd03-47b2-bf11-da8910c20d3c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] validate_networks() for [('95eff624-38bf-46e7-958c-9fcb3dae19f9', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:09:29.116972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b83dd818-aadf-4db1-985a-fae8bd5dc853 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:29.127739 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b83dd818-aadf-4db1-985a-fae8bd5dc853 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1321 microversion: 2.1 time: 0.351625 Oct 29 01:09:29.132777 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 707/1440] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:28 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:29.136041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-db600b7f-8aa4-4e76-b393-e6f0985a5187 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:29.140455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-db600b7f-8aa4-4e76-b393-e6f0985a5187 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:29.151087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db600b7f-8aa4-4e76-b393-e6f0985a5187 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:29.152449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db600b7f-8aa4-4e76-b393-e6f0985a5187 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:29.152993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db600b7f-8aa4-4e76-b393-e6f0985a5187 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:29.154243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db600b7f-8aa4-4e76-b393-e6f0985a5187 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:29.168950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db600b7f-8aa4-4e76-b393-e6f0985a5187 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:29.169431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db600b7f-8aa4-4e76-b393-e6f0985a5187 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:29.264126 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-db600b7f-8aa4-4e76-b393-e6f0985a5187 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.133214 Oct 29 01:09:29.268568 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 708/1441] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:09:29 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:09:29.378165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7cdf8ff7-ef5f-406f-9aac-27956ad7464c tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:29.382621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7cdf8ff7-ef5f-406f-9aac-27956ad7464c tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:29.397276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7cdf8ff7-ef5f-406f-9aac-27956ad7464c tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:29.398378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7cdf8ff7-ef5f-406f-9aac-27956ad7464c tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:29.400348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7cdf8ff7-ef5f-406f-9aac-27956ad7464c tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:29.425696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7cdf8ff7-ef5f-406f-9aac-27956ad7464c tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:29.427490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7cdf8ff7-ef5f-406f-9aac-27956ad7464c tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:29.428393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7cdf8ff7-ef5f-406f-9aac-27956ad7464c tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:29.532177 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7cdf8ff7-ef5f-406f-9aac-27956ad7464c tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.160140 Oct 29 01:09:29.534239 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 709/1442] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:09:29 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231/os-volume_attachments => generated 25 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:09:29.615153 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-481c2e7c-f00e-455b-a985-8fe3a1aab6c6 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:29.616406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-481c2e7c-f00e-455b-a985-8fe3a1aab6c6 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:29.618648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=5 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:29.620333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:29.633956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-481c2e7c-f00e-455b-a985-8fe3a1aab6c6 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:29.634418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-481c2e7c-f00e-455b-a985-8fe3a1aab6c6 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:29.634860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-481c2e7c-f00e-455b-a985-8fe3a1aab6c6 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:29.635723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-481c2e7c-f00e-455b-a985-8fe3a1aab6c6 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:29.636202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-481c2e7c-f00e-455b-a985-8fe3a1aab6c6 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:29.636613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-481c2e7c-f00e-455b-a985-8fe3a1aab6c6 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:29.723628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-481c2e7c-f00e-455b-a985-8fe3a1aab6c6 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:09:29.878858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0fc9f266-fd03-47b2-bf11-da8910c20d3c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:09:29.879415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0fc9f266-fd03-47b2-bf11-da8910c20d3c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:09:29.881069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0fc9f266-fd03-47b2-bf11-da8910c20d3c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:09:29.881752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0fc9f266-fd03-47b2-bf11-da8910c20d3c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:09:29.882640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0fc9f266-fd03-47b2-bf11-da8910c20d3c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:09:29.898932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc9f266-fd03-47b2-bf11-da8910c20d3c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:29.898932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc9f266-fd03-47b2-bf11-da8910c20d3c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:29.898932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc9f266-fd03-47b2-bf11-da8910c20d3c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:29.899974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc9f266-fd03-47b2-bf11-da8910c20d3c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:29.905406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc9f266-fd03-47b2-bf11-da8910c20d3c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:29.905990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc9f266-fd03-47b2-bf11-da8910c20d3c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:29.934835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-0fc9f266-fd03-47b2-bf11-da8910c20d3c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Getting quotas for project f421c64f9b2f49ebab46d9f8a28143d6. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:29.944657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-0fc9f266-fd03-47b2-bf11-da8910c20d3c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Getting quotas for user 4ae0a54f51ad4813b312baf3a03ba172 and project f421c64f9b2f49ebab46d9f8a28143d6. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:29.962300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0fc9f266-fd03-47b2-bf11-da8910c20d3c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:09:29.965083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0fc9f266-fd03-47b2-bf11-da8910c20d3c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:09:30.119956 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-481c2e7c-f00e-455b-a985-8fe3a1aab6c6 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 204 len: 0 microversion: 2.1 time: 0.509255 Oct 29 01:09:30.122384 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 710/1443] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:09:29 2022] DELETE /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:09:30.131624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f9fd441e-8d64-47a8-b85e-937313066c26 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:30.133646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f9fd441e-8d64-47a8-b85e-937313066c26 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:30.135470 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0fc9f266-fd03-47b2-bf11-da8910c20d3c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.533294 Oct 29 01:09:30.141328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9fd441e-8d64-47a8-b85e-937313066c26 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:30.143384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9fd441e-8d64-47a8-b85e-937313066c26 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:30.144087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9fd441e-8d64-47a8-b85e-937313066c26 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:30.146168 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9fd441e-8d64-47a8-b85e-937313066c26 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:30.146739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9fd441e-8d64-47a8-b85e-937313066c26 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:30.147266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9fd441e-8d64-47a8-b85e-937313066c26 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:30.154684 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 734/1444] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:09:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:09:30.190205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-670f29b4-daae-483e-abab-cbf3bae5b170 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:30.192752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-670f29b4-daae-483e-abab-cbf3bae5b170 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:30.204179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-670f29b4-daae-483e-abab-cbf3bae5b170 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:30.208051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-670f29b4-daae-483e-abab-cbf3bae5b170 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:30.208559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-670f29b4-daae-483e-abab-cbf3bae5b170 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:30.211997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-670f29b4-daae-483e-abab-cbf3bae5b170 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:30.215443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-670f29b4-daae-483e-abab-cbf3bae5b170 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:30.215919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-670f29b4-daae-483e-abab-cbf3bae5b170 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:30.414975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f9fd441e-8d64-47a8-b85e-937313066c26 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:30.426373 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f9fd441e-8d64-47a8-b85e-937313066c26 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1541 microversion: 2.1 time: 0.301345 Oct 29 01:09:30.429879 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 711/1445] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:30 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1541 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:30.439172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-77abf05b-3bd3-4a83-919d-51dcbd1e9daf tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:30.446024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-77abf05b-3bd3-4a83-919d-51dcbd1e9daf tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:30.575445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-77abf05b-3bd3-4a83-919d-51dcbd1e9daf tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:30.589486 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-77abf05b-3bd3-4a83-919d-51dcbd1e9daf tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1214 microversion: 2.1 time: 0.152311 Oct 29 01:09:30.590141 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 712/1446] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:30 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:30.608650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-883d378c-a3f8-4b93-a9c9-f7ee9bf7a145 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:30.609323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-883d378c-a3f8-4b93-a9c9-f7ee9bf7a145 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:30.637736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-883d378c-a3f8-4b93-a9c9-f7ee9bf7a145 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:30.643222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-883d378c-a3f8-4b93-a9c9-f7ee9bf7a145 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:30.647110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-883d378c-a3f8-4b93-a9c9-f7ee9bf7a145 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:30.648055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-883d378c-a3f8-4b93-a9c9-f7ee9bf7a145 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:30.649371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-883d378c-a3f8-4b93-a9c9-f7ee9bf7a145 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:30.651028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-883d378c-a3f8-4b93-a9c9-f7ee9bf7a145 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:30.668715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-670f29b4-daae-483e-abab-cbf3bae5b170 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:30.680627 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-670f29b4-daae-483e-abab-cbf3bae5b170 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1680 microversion: 2.1 time: 0.524746 Oct 29 01:09:30.681904 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 735/1447] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:30 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1680 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:30.690164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-18c77835-d49f-4368-ae2a-ba99c39bd652 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:30.691246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-18c77835-d49f-4368-ae2a-ba99c39bd652 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:30.698672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18c77835-d49f-4368-ae2a-ba99c39bd652 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:30.699162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18c77835-d49f-4368-ae2a-ba99c39bd652 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:30.699780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18c77835-d49f-4368-ae2a-ba99c39bd652 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:30.700709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18c77835-d49f-4368-ae2a-ba99c39bd652 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:30.701222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18c77835-d49f-4368-ae2a-ba99c39bd652 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:30.701839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18c77835-d49f-4368-ae2a-ba99c39bd652 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:30.858264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-883d378c-a3f8-4b93-a9c9-f7ee9bf7a145 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:30.869655 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-883d378c-a3f8-4b93-a9c9-f7ee9bf7a145 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1321 microversion: 2.1 time: 0.274651 Oct 29 01:09:30.870440 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 713/1448] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:30 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:30.956783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-18c77835-d49f-4368-ae2a-ba99c39bd652 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'services' on Instance uuid 00a19183-c526-47be-95c4-d4c3a9936390 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:09:30.996330 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-18c77835-d49f-4368-ae2a-ba99c39bd652 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 2422 microversion: 2.25 time: 0.312634 Oct 29 01:09:30.998128 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 736/1449] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:30 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 2422 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:31.026753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-223063ab-2284-497e-9d9b-810e0d391c83 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862964-3", "block_migration": "auto"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:31.026753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-223063ab-2284-497e-9d9b-810e0d391c83 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:31.039228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-223063ab-2284-497e-9d9b-810e0d391c83 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:31.039736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-223063ab-2284-497e-9d9b-810e0d391c83 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:31.041245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-223063ab-2284-497e-9d9b-810e0d391c83 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:31.041986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-223063ab-2284-497e-9d9b-810e0d391c83 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:31.042455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-223063ab-2284-497e-9d9b-810e0d391c83 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:31.043294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-223063ab-2284-497e-9d9b-810e0d391c83 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:31.076953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-223063ab-2284-497e-9d9b-810e0d391c83 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'flavor' on Instance uuid 00a19183-c526-47be-95c4-d4c3a9936390 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:09:31.092397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-223063ab-2284-497e-9d9b-810e0d391c83 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Going to try to live migrate instance to n-h2-862964-3 {{(pid=121099) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 01:09:31.136384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e3fce8ad-c8d2-461e-82ff-489f1c05239a tempest-ListImageFiltersNegativeTestJSON-407992236 tempest-ListImageFiltersNegativeTestJSON-407992236-project] Calling method '.version_select at 0x7f9d97b7b820>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:31.159852 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-e3fce8ad-c8d2-461e-82ff-489f1c05239a tempest-ListImageFiltersNegativeTestJSON-407992236 tempest-ListImageFiltersNegativeTestJSON-407992236-project] HTTP exception thrown: Image not found. Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e3fce8ad-c8d2-461e-82ff-489f1c05239a tempest-ListImageFiltersNegativeTestJSON-407992236 tempest-ListImageFiltersNegativeTestJSON-407992236-project] Request method failure captured: Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/images/4525731d-46f5-4ee9-b7f9-d10838f687a4 HTTP/1.1 Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH1KWzBVREPXzwUtu54ssm0rjokv-RHrBWINQC51ok89qYi74pYR9wvWef4wRp4x0G1PF360yb8aNHghQ4V5zLp5q8-V0sIqm4igMXKXmZAPrMwwhTZBVSIDRq8_YJTS1jCw3TLGet9u-g0d6eE4n-q-dtN8Z2QTucOA5EnyUW14P3s Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 737eca24cf9c4657af830bd01a19e055 Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-407992236 Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/737eca24cf9c4657af830bd01a19e055"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/737eca24cf9c4657af830bd01a19e055"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/737eca24cf9c4657af830bd01a19e055"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_737eca24cf9c4657af830bd01a19e055", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-407992236 Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 737eca24cf9c4657af830bd01a19e055 Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-407992236 Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ListImageFiltersNegativeTestJSON-407992236-project Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: efd3012432b641bf98b1855fef05b28d Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-407992236-project Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: exception: Image not found. Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '4525731d-46f5-4ee9-b7f9-d10838f687a4'} Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4525731d-46f5-4ee9-b7f9-d10838f687a4 Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 01:09:31.192893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4525731d-46f5-4ee9-b7f9-d10838f687a4 could not be found. Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e3fce8ad-c8d2-461e-82ff-489f1c05239a tempest-ListImageFiltersNegativeTestJSON-407992236 tempest-ListImageFiltersNegativeTestJSON-407992236-project] Returning 404 to user: Image not found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:09:31.198260 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e3fce8ad-c8d2-461e-82ff-489f1c05239a tempest-ListImageFiltersNegativeTestJSON-407992236 tempest-ListImageFiltersNegativeTestJSON-407992236-project] 10.222.0.26 "GET /compute/v2.1/images/4525731d-46f5-4ee9-b7f9-d10838f687a4" status: 404 len: 62 microversion: 2.1 time: 0.222948 Oct 29 01:09:31.202273 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 714/1450] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:09:30 2022] GET /compute/v2.1/images/4525731d-46f5-4ee9-b7f9-d10838f687a4 => generated 62 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 01:09:31.460923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fa9f9075-cad9-4b9a-aac3-8bf546d43cd1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:31.460923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fa9f9075-cad9-4b9a-aac3-8bf546d43cd1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:31.478499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa9f9075-cad9-4b9a-aac3-8bf546d43cd1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:31.478499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa9f9075-cad9-4b9a-aac3-8bf546d43cd1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:31.478499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa9f9075-cad9-4b9a-aac3-8bf546d43cd1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:31.478499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa9f9075-cad9-4b9a-aac3-8bf546d43cd1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:31.478499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa9f9075-cad9-4b9a-aac3-8bf546d43cd1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:31.478499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa9f9075-cad9-4b9a-aac3-8bf546d43cd1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:31.649642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fa9f9075-cad9-4b9a-aac3-8bf546d43cd1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:31.660529 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fa9f9075-cad9-4b9a-aac3-8bf546d43cd1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1541 microversion: 2.1 time: 0.208199 Oct 29 01:09:31.665460 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 715/1451] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:31 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1541 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:31.680552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0db66edc-05f5-4266-bda3-63a2ab2e14aa tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:31.682126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0db66edc-05f5-4266-bda3-63a2ab2e14aa tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:31.785092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0db66edc-05f5-4266-bda3-63a2ab2e14aa tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:31.798265 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0db66edc-05f5-4266-bda3-63a2ab2e14aa tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1214 microversion: 2.1 time: 0.132252 Oct 29 01:09:31.798526 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 716/1452] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:31 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1214 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:31.804566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-46e7df53-aa30-4029-b1fc-b0a74d440863 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:31.805396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-46e7df53-aa30-4029-b1fc-b0a74d440863 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:31.818712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-46e7df53-aa30-4029-b1fc-b0a74d440863 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:31.818712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-46e7df53-aa30-4029-b1fc-b0a74d440863 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:31.818712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-46e7df53-aa30-4029-b1fc-b0a74d440863 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:31.821708 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-46e7df53-aa30-4029-b1fc-b0a74d440863 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:31.822371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-46e7df53-aa30-4029-b1fc-b0a74d440863 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:31.822977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-46e7df53-aa30-4029-b1fc-b0a74d440863 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:32.003745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-46e7df53-aa30-4029-b1fc-b0a74d440863 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:32.018081 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-46e7df53-aa30-4029-b1fc-b0a74d440863 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1680 microversion: 2.1 time: 0.217430 Oct 29 01:09:32.021636 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 717/1453] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:31 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:32.027158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3dd7b7f1-f0f1-499b-82b0-ed85a8497f83 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:32.028111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3dd7b7f1-f0f1-499b-82b0-ed85a8497f83 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:32.045427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dd7b7f1-f0f1-499b-82b0-ed85a8497f83 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:32.046121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dd7b7f1-f0f1-499b-82b0-ed85a8497f83 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:32.046866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dd7b7f1-f0f1-499b-82b0-ed85a8497f83 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:32.047857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dd7b7f1-f0f1-499b-82b0-ed85a8497f83 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:32.048312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dd7b7f1-f0f1-499b-82b0-ed85a8497f83 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:32.048825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dd7b7f1-f0f1-499b-82b0-ed85a8497f83 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:32.073462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:32.239268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3dd7b7f1-f0f1-499b-82b0-ed85a8497f83 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:32.248143 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3dd7b7f1-f0f1-499b-82b0-ed85a8497f83 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1321 microversion: 2.1 time: 0.225065 Oct 29 01:09:32.249055 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 718/1454] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:32 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:32.685309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2aeec8e2-e1c0-48cf-887d-ad75f31f2668 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:32.687528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2aeec8e2-e1c0-48cf-887d-ad75f31f2668 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:32.703789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2aeec8e2-e1c0-48cf-887d-ad75f31f2668 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:32.708694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2aeec8e2-e1c0-48cf-887d-ad75f31f2668 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:32.708694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2aeec8e2-e1c0-48cf-887d-ad75f31f2668 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:32.708694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2aeec8e2-e1c0-48cf-887d-ad75f31f2668 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:32.708694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2aeec8e2-e1c0-48cf-887d-ad75f31f2668 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:32.708694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2aeec8e2-e1c0-48cf-887d-ad75f31f2668 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:33.046279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2aeec8e2-e1c0-48cf-887d-ad75f31f2668 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:33.063296 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2aeec8e2-e1c0-48cf-887d-ad75f31f2668 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1541 microversion: 2.1 time: 0.380019 Oct 29 01:09:33.064636 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 719/1455] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:32 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1541 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:33.104670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f752cadf-f952-44ef-94af-47219a4bf628 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:33.105850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f752cadf-f952-44ef-94af-47219a4bf628 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:33.127597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f752cadf-f952-44ef-94af-47219a4bf628 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:33.129263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f752cadf-f952-44ef-94af-47219a4bf628 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:33.130455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f752cadf-f952-44ef-94af-47219a4bf628 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:33.132094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f752cadf-f952-44ef-94af-47219a4bf628 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:33.134782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f752cadf-f952-44ef-94af-47219a4bf628 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:33.136802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f752cadf-f952-44ef-94af-47219a4bf628 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:33.853498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f752cadf-f952-44ef-94af-47219a4bf628 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:33.871507 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f752cadf-f952-44ef-94af-47219a4bf628 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1266 microversion: 2.1 time: 0.792365 Oct 29 01:09:33.872095 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 720/1456] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:33 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1266 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:33.897487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0f90b46b-17c4-4bc5-9806-86ea0124508c tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:33.903703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0f90b46b-17c4-4bc5-9806-86ea0124508c tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:33.923975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0f90b46b-17c4-4bc5-9806-86ea0124508c tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:33.924477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0f90b46b-17c4-4bc5-9806-86ea0124508c tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:33.924935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0f90b46b-17c4-4bc5-9806-86ea0124508c tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:33.925680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0f90b46b-17c4-4bc5-9806-86ea0124508c tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:33.926142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0f90b46b-17c4-4bc5-9806-86ea0124508c tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:33.931624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0f90b46b-17c4-4bc5-9806-86ea0124508c tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:34.117322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0f90b46b-17c4-4bc5-9806-86ea0124508c tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:34.129282 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0f90b46b-17c4-4bc5-9806-86ea0124508c tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1613 microversion: 2.1 time: 0.249177 Oct 29 01:09:34.133542 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 721/1457] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:33 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1613 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:34.138761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-233c8459-b63f-4d8f-bd61-674fad6e9354 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:34.146139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-233c8459-b63f-4d8f-bd61-674fad6e9354 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:34.155285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-233c8459-b63f-4d8f-bd61-674fad6e9354 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:34.160395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-233c8459-b63f-4d8f-bd61-674fad6e9354 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:34.161026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-233c8459-b63f-4d8f-bd61-674fad6e9354 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:34.162077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-233c8459-b63f-4d8f-bd61-674fad6e9354 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:34.164231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-233c8459-b63f-4d8f-bd61-674fad6e9354 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:34.166252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-233c8459-b63f-4d8f-bd61-674fad6e9354 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:34.465843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-233c8459-b63f-4d8f-bd61-674fad6e9354 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:34.473940 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-233c8459-b63f-4d8f-bd61-674fad6e9354 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1321 microversion: 2.1 time: 0.338874 Oct 29 01:09:34.474518 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 722/1458] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:34 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1321 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:34.863402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-4da67796-4546-4d22-8fd6-710928ca4d00 req-61a9e391-fb39-4b67-8fae-08218fd73b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ecee3f-2172-4154-9f8a-6365257b44e7", "name": "network-vif-plugged", "status": "completed", "tag": "24d01c5e-3ecc-4af5-ab8c-e7579f5bc941"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:34.880248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4da67796-4546-4d22-8fd6-710928ca4d00 req-61a9e391-fb39-4b67-8fae-08218fd73b35 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:34.880735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4da67796-4546-4d22-8fd6-710928ca4d00 req-61a9e391-fb39-4b67-8fae-08218fd73b35 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:34.881196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4da67796-4546-4d22-8fd6-710928ca4d00 req-61a9e391-fb39-4b67-8fae-08218fd73b35 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:34.903423 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-4da67796-4546-4d22-8fd6-710928ca4d00 req-61a9e391-fb39-4b67-8fae-08218fd73b35 service nova] Creating event network-vif-plugged:24d01c5e-3ecc-4af5-ab8c-e7579f5bc941 for instance d6ecee3f-2172-4154-9f8a-6365257b44e7 on n-h1-862964-3 Oct 29 01:09:34.910019 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-4da67796-4546-4d22-8fd6-710928ca4d00 req-61a9e391-fb39-4b67-8fae-08218fd73b35 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.431111 Oct 29 01:09:34.910644 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 723/1459] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:34.941702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a45b5e85-7351-4d6c-a85c-d195f36efefd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:34.942836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a45b5e85-7351-4d6c-a85c-d195f36efefd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:34.958146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a45b5e85-7351-4d6c-a85c-d195f36efefd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:34.958146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a45b5e85-7351-4d6c-a85c-d195f36efefd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:34.958146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a45b5e85-7351-4d6c-a85c-d195f36efefd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:34.958146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a45b5e85-7351-4d6c-a85c-d195f36efefd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:34.958893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a45b5e85-7351-4d6c-a85c-d195f36efefd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:34.959419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a45b5e85-7351-4d6c-a85c-d195f36efefd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:35.290896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a45b5e85-7351-4d6c-a85c-d195f36efefd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:35.299234 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a45b5e85-7351-4d6c-a85c-d195f36efefd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1541 microversion: 2.1 time: 0.372888 Oct 29 01:09:35.300100 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 724/1460] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:34 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1541 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:35.306113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5c9431b4-164f-4a1d-846b-5d536d990c80 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:35.306913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5c9431b4-164f-4a1d-846b-5d536d990c80 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:35.313348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c9431b4-164f-4a1d-846b-5d536d990c80 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:35.314011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c9431b4-164f-4a1d-846b-5d536d990c80 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:35.314974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c9431b4-164f-4a1d-846b-5d536d990c80 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:35.315921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c9431b4-164f-4a1d-846b-5d536d990c80 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:35.316582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c9431b4-164f-4a1d-846b-5d536d990c80 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:35.317181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c9431b4-164f-4a1d-846b-5d536d990c80 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:35.332447 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-223063ab-2284-497e-9d9b-810e0d391c83 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/action" status: 202 len: 0 microversion: 2.25 time: 4.312681 Oct 29 01:09:35.339076 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 737/1461] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 29 01:09:31 2022] POST /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/action => generated 0 bytes in 4314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:09:35.351324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-c2c51fa3-a235-4932-9439-cf935423cfee req-da33b45c-47d9-486d-8716-9fb5fc28d298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38f9413-877d-43ab-b4ed-294552b3c231", "name": "network-vif-deleted", "tag": "dba01d43-1d1a-480f-89cd-3555f1ef20a4"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:35.395020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c2c51fa3-a235-4932-9439-cf935423cfee req-da33b45c-47d9-486d-8716-9fb5fc28d298 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:35.397908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5c9431b4-164f-4a1d-846b-5d536d990c80 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:35.398374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c2c51fa3-a235-4932-9439-cf935423cfee req-da33b45c-47d9-486d-8716-9fb5fc28d298 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:35.399002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c2c51fa3-a235-4932-9439-cf935423cfee req-da33b45c-47d9-486d-8716-9fb5fc28d298 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:35.407657 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5c9431b4-164f-4a1d-846b-5d536d990c80 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1272 microversion: 2.1 time: 0.105685 Oct 29 01:09:35.409813 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 725/1462] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:35 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:35.415890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aa608174-a67b-4b8b-ac81-c6717a7f8736 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:35.416759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aa608174-a67b-4b8b-ac81-c6717a7f8736 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:35.424034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa608174-a67b-4b8b-ac81-c6717a7f8736 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:35.424435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa608174-a67b-4b8b-ac81-c6717a7f8736 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:35.425061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa608174-a67b-4b8b-ac81-c6717a7f8736 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:35.425796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa608174-a67b-4b8b-ac81-c6717a7f8736 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:35.426423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa608174-a67b-4b8b-ac81-c6717a7f8736 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:35.426853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa608174-a67b-4b8b-ac81-c6717a7f8736 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:35.441000 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-c2c51fa3-a235-4932-9439-cf935423cfee req-da33b45c-47d9-486d-8716-9fb5fc28d298 service nova] Creating event network-vif-deleted:dba01d43-1d1a-480f-89cd-3555f1ef20a4 for instance f38f9413-877d-43ab-b4ed-294552b3c231 on n-h2-862964-3 Oct 29 01:09:35.451537 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-c2c51fa3-a235-4932-9439-cf935423cfee req-da33b45c-47d9-486d-8716-9fb5fc28d298 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116115 Oct 29 01:09:35.456804 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 738/1463] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:35.469632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-255387d5-3e23-4531-b829-53c485fb93f5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:35.472683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-255387d5-3e23-4531-b829-53c485fb93f5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:35.482809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-255387d5-3e23-4531-b829-53c485fb93f5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:35.484105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-255387d5-3e23-4531-b829-53c485fb93f5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:35.484769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-255387d5-3e23-4531-b829-53c485fb93f5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:35.485567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-255387d5-3e23-4531-b829-53c485fb93f5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:35.487535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-255387d5-3e23-4531-b829-53c485fb93f5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:35.487976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-255387d5-3e23-4531-b829-53c485fb93f5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:35.520862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aa608174-a67b-4b8b-ac81-c6717a7f8736 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:35.530399 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aa608174-a67b-4b8b-ac81-c6717a7f8736 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1325 microversion: 2.1 time: 0.119014 Oct 29 01:09:35.531209 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 726/1464] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:35 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1325 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:35.704493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-255387d5-3e23-4531-b829-53c485fb93f5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:35.718400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-255387d5-3e23-4531-b829-53c485fb93f5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:35.720235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-255387d5-3e23-4531-b829-53c485fb93f5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:35.722691 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-255387d5-3e23-4531-b829-53c485fb93f5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.264540 Oct 29 01:09:35.723824 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 739/1465] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:35 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:35.735175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-60ebc2ec-7999-4427-b11f-0e3e7fb0ddfe tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Action: 'create', calling method: .version_select at 0x7f9d97a86ee0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPU4NTt22lhN/l/XzK/DnTfeGI6LuJTDdnbof/muX38mFGrCynoGQFML8nziNFvav/cX97qIgY9FAnQ0S/qGlC1zFZqdHN1R+AQiyPRW6/t9anzsa1M3qWMLHnI4sAexw=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-60ebc2ec-7999-4427-b11f-0e3e7fb0ddfe tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Request method failure captured: Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 257 Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH1PUOwb1Oa98qkykMi5GxSGdpsXAbHpDZBTV92rgywiRrW3PiVAA6DNBB2J0h6-FIH3hscoPSK-cKGKZoSy2sAF6QRK0hG7mqHLWqFMMWHyN53vH0yOftBK4os_1GmelufWJFDwu4vXQ5jVbxE4N5WSVZjVaDQ3Lwd5XZwG6_7rjN8 Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 16d5a4ada97d4e34967c328afde77bd3 Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16d5a4ada97d4e34967c328afde77bd3", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 16d5a4ada97d4e34967c328afde77bd3 Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-KeyPairsNegativeTestJSON-1640325645-project Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 5f336e68c81744e3bf151d6bb6241349 Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1640325645-project Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPU4NTt22lhN/l/XzK/DnTfeGI6LuJTDdnbof/muX38mFGrCynoGQFML8nziNFvav/cX97qIgY9FAnQ0S/qGlC1zFZqdHN1R+AQiyPRW6/t9anzsa1M3qWMLHnI4sAexw=="}} Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPU4NTt22lhN/l/XzK/DnTfeGI6LuJTDdnbof/muX38mFGrCynoGQFML8nziNFvav/cX97qIgY9FAnQ0S/qGlC1zFZqdHN1R+AQiyPRW6/t9anzsa1M3qWMLHnI4sAexw=='}}} Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 29 01:09:35.740831 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-60ebc2ec-7999-4427-b11f-0e3e7fb0ddfe tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:09:35.745508 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-60ebc2ec-7999-4427-b11f-0e3e7fb0ddfe tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.208410 Oct 29 01:09:35.748710 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 727/1466] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:09:35 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:09:35.749825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-efb04267-d841-43ec-938e-98531974aabd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:35.755848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-efb04267-d841-43ec-938e-98531974aabd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:35.757401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efb04267-d841-43ec-938e-98531974aabd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:35.757894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efb04267-d841-43ec-938e-98531974aabd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:35.758326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efb04267-d841-43ec-938e-98531974aabd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:35.759278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efb04267-d841-43ec-938e-98531974aabd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:35.759737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efb04267-d841-43ec-938e-98531974aabd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:35.760173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efb04267-d841-43ec-938e-98531974aabd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:35.763598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-74b3f3fd-ddc3-443c-9621-95a2b9256e4b tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Action: 'create', calling method: .version_select at 0x7f9d97ac1670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-150686307", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:35.787276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-74b3f3fd-ddc3-443c-9621-95a2b9256e4b tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Getting quotas for project 16d5a4ada97d4e34967c328afde77bd3. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:35.802194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-74b3f3fd-ddc3-443c-9621-95a2b9256e4b tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Getting quotas for user 5f336e68c81744e3bf151d6bb6241349 and project 16d5a4ada97d4e34967c328afde77bd3. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:35.842806 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-74b3f3fd-ddc3-443c-9621-95a2b9256e4b tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-74b3f3fd-ddc3-443c-9621-95a2b9256e4b tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Request method failure captured: Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 2166 Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH1PUOwb1Oa98qkykMi5GxSGdpsXAbHpDZBTV92rgywiRrW3PiVAA6DNBB2J0h6-FIH3hscoPSK-cKGKZoSy2sAF6QRK0hG7mqHLWqFMMWHyN53vH0yOftBK4os_1GmelufWJFDwu4vXQ5jVbxE4N5WSVZjVaDQ3Lwd5XZwG6_7rjN8 Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 16d5a4ada97d4e34967c328afde77bd3 Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16d5a4ada97d4e34967c328afde77bd3", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 16d5a4ada97d4e34967c328afde77bd3 Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-KeyPairsNegativeTestJSON-1640325645-project Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 5f336e68c81744e3bf151d6bb6241349 Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1640325645-project Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-150686307", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:09:35.862013 n-d-862964-3 devstack@n-api.service[121100]: exception: Keypair data is invalid: failed to generate fingerprint Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-150686307', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:09:35.867319 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-74b3f3fd-ddc3-443c-9621-95a2b9256e4b tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-74b3f3fd-ddc3-443c-9621-95a2b9256e4b tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.113309 Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 728/1467] 10.222.0.26 () {60 vars in 1160 bytes} [Sat Oct 29 01:09:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 01:09:35.877692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-81babee3-76fc-461e-8432-8f4fd522d3ee tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Action: 'create', calling method: .version_select at 0x7f9d97b0d0d0>, body: {"keypair": {"name": "tempest-keypair-1325545092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIkhcgOuNu8pU2CnvUk/GF8j8VM3KUYsqF7NLJEJYnBmiZK0g4dNY3k5xtaAYZ3tRiyYtdWjQ3AULZyzR+++qpjFbfQ1j5oaqBcVuNqaj3XvdgAQgWGaN3e1tsgoJF3ag=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:35.904534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-81babee3-76fc-461e-8432-8f4fd522d3ee tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Getting quotas for project 16d5a4ada97d4e34967c328afde77bd3. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:35.914587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-81babee3-76fc-461e-8432-8f4fd522d3ee tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Getting quotas for user 5f336e68c81744e3bf151d6bb6241349 and project 16d5a4ada97d4e34967c328afde77bd3. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:35.966277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-efb04267-d841-43ec-938e-98531974aabd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:35.977549 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-efb04267-d841-43ec-938e-98531974aabd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1321 microversion: 2.1 time: 0.252336 Oct 29 01:09:35.985866 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 740/1468] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:35 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:36.115858 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-81babee3-76fc-461e-8432-8f4fd522d3ee tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.244224 Oct 29 01:09:36.116592 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 729/1469] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:09:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:36.131579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fee1ed5b-fd42-4d7b-aae9-10930e64ed8a tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Action: 'create', calling method: .version_select at 0x7f9d97ac8280>, body: {"keypair": {"name": "tempest-keypair-1325545092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNl5HZ4hf+VFRMY7QdH1GMwAjrNF3cCOF5aTQGSXBuaj5MnmM/jFikVBG+5e0TQy120LahyAzs1BI+Youe5a22/FRcmuuswTy3kgl9G0SI3JdEsBfYuYoFGF3od4ck7G0A=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:36.149988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-fee1ed5b-fd42-4d7b-aae9-10930e64ed8a tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Getting quotas for project 16d5a4ada97d4e34967c328afde77bd3. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:36.155209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-fee1ed5b-fd42-4d7b-aae9-10930e64ed8a tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Getting quotas for user 5f336e68c81744e3bf151d6bb6241349 and project 16d5a4ada97d4e34967c328afde77bd3. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:36.229990 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-fee1ed5b-fd42-4d7b-aae9-10930e64ed8a tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] HTTP exception thrown: Key pair 'tempest-keypair-1325545092' already exists. Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fee1ed5b-fd42-4d7b-aae9-10930e64ed8a tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Request method failure captured: Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 273 Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH1PUOwb1Oa98qkykMi5GxSGdpsXAbHpDZBTV92rgywiRrW3PiVAA6DNBB2J0h6-FIH3hscoPSK-cKGKZoSy2sAF6QRK0hG7mqHLWqFMMWHyN53vH0yOftBK4os_1GmelufWJFDwu4vXQ5jVbxE4N5WSVZjVaDQ3Lwd5XZwG6_7rjN8 Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 16d5a4ada97d4e34967c328afde77bd3 Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16d5a4ada97d4e34967c328afde77bd3", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 16d5a4ada97d4e34967c328afde77bd3 Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-KeyPairsNegativeTestJSON-1640325645-project Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 5f336e68c81744e3bf151d6bb6241349 Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1640325645-project Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: {"keypair": {"name": "tempest-keypair-1325545092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNl5HZ4hf+VFRMY7QdH1GMwAjrNF3cCOF5aTQGSXBuaj5MnmM/jFikVBG+5e0TQy120LahyAzs1BI+Youe5a22/FRcmuuswTy3kgl9G0SI3JdEsBfYuYoFGF3od4ck7G0A=="}} Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: exception: Key pair 'tempest-keypair-1325545092' already exists. Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1325545092', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNl5HZ4hf+VFRMY7QdH1GMwAjrNF3cCOF5aTQGSXBuaj5MnmM/jFikVBG+5e0TQy120LahyAzs1BI+Youe5a22/FRcmuuswTy3kgl9G0SI3JdEsBfYuYoFGF3od4ck7G0A=='}}} Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result.read() Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '5f336e68c81744e3bf151d6bb6241349-tempest-keypair-1325545092' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 29 01:09:36.238311 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi session.flush() Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result.read() Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 01:09:36.242755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '5f336e68c81744e3bf151d6bb6241349-tempest-keypair-1325545092' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 29, 1, 9, 36, 171508), 'updated_at': None, 'name': 'tempest-keypair-1325545092', 'user_id': '5f336e68c81744e3bf151d6bb6241349', 'fingerprint': 'fd:b9:61:6a:69:73:b0:26:e4:4b:7b:7a:2d:7f:1e:4d', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNl5HZ4hf+VFRMY7QdH1GMwAjrNF3cCOF5aTQGSXBuaj5MnmM/jFikVBG+5e0TQy120LahyAzs1BI+Youe5a22/FRcmuuswTy3kgl9G0SI3JdEsBfYuYoFGF3od4ck7G0A==', 'type': 'ssh'}] Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi keypair.create() Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._create() Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1325545092' already exists. Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 29 01:09:36.247179 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1325545092' already exists. Oct 29 01:09:36.251819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.251819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:36.251819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.251819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.251819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:36.251819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:36.251819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:09:36.251819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:09:36.251819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1325545092' already exists. Oct 29 01:09:36.251819 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.251819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fee1ed5b-fd42-4d7b-aae9-10930e64ed8a tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Returning 409 to user: Key pair 'tempest-keypair-1325545092' already exists. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:09:36.251819 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fee1ed5b-fd42-4d7b-aae9-10930e64ed8a tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.113071 Oct 29 01:09:36.251819 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 741/1470] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:09:36 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:09:36.253004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e6e0e6b0-8047-4b87-b881-4ff1c0802945 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Calling method '.version_select at 0x7f9d97a86dc0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:36.323882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7110ea4c-d720-450c-bb55-5ba2e30f2e5a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:36.324537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7110ea4c-d720-450c-bb55-5ba2e30f2e5a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:36.331598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7110ea4c-d720-450c-bb55-5ba2e30f2e5a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:36.332750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7110ea4c-d720-450c-bb55-5ba2e30f2e5a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:36.333574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7110ea4c-d720-450c-bb55-5ba2e30f2e5a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:36.334007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7110ea4c-d720-450c-bb55-5ba2e30f2e5a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:36.334474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7110ea4c-d720-450c-bb55-5ba2e30f2e5a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:36.334905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7110ea4c-d720-450c-bb55-5ba2e30f2e5a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:36.388276 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e6e0e6b0-8047-4b87-b881-4ff1c0802945 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325545092" status: 202 len: 0 microversion: 2.1 time: 0.142782 Oct 29 01:09:36.389088 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 730/1471] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 29 01:09:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325545092 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:09:36.400942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e56e4bee-d861-4a96-9d77-1555bbea5e95 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Action: 'create', calling method: .version_select at 0x7f9d97ac14c0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdVvnzEvTKSHcl5uLD2p7Y4uMB6vpfhqcwuW8SsWB+cFjs8qYRWGK6dEvUf0BJ6Vk+BP4/BG4mNz6R7EcbC2gIg22Ksh+g7vWAw5QB6R5KH1qlVF0IExWSiergtuzOL2w=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e56e4bee-d861-4a96-9d77-1555bbea5e95 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Request method failure captured: Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 247 Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH1PUOwb1Oa98qkykMi5GxSGdpsXAbHpDZBTV92rgywiRrW3PiVAA6DNBB2J0h6-FIH3hscoPSK-cKGKZoSy2sAF6QRK0hG7mqHLWqFMMWHyN53vH0yOftBK4os_1GmelufWJFDwu4vXQ5jVbxE4N5WSVZjVaDQ3Lwd5XZwG6_7rjN8 Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 16d5a4ada97d4e34967c328afde77bd3 Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16d5a4ada97d4e34967c328afde77bd3", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 16d5a4ada97d4e34967c328afde77bd3 Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-KeyPairsNegativeTestJSON-1640325645-project Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 5f336e68c81744e3bf151d6bb6241349 Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1640325645-project Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdVvnzEvTKSHcl5uLD2p7Y4uMB6vpfhqcwuW8SsWB+cFjs8qYRWGK6dEvUf0BJ6Vk+BP4/BG4mNz6R7EcbC2gIg22Ksh+g7vWAw5QB6R5KH1qlVF0IExWSiergtuzOL2w=="}} Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdVvnzEvTKSHcl5uLD2p7Y4uMB6vpfhqcwuW8SsWB+cFjs8qYRWGK6dEvUf0BJ6Vk+BP4/BG4mNz6R7EcbC2gIg22Ksh+g7vWAw5QB6R5KH1qlVF0IExWSiergtuzOL2w=='}}} Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi '' Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:09:36.404906 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:09:36.410311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:09:36.410311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:09:36.410311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:09:36.410311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:09:36.410311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 29 01:09:36.410311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.410311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:36.410311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.410311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.410311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:36.410311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:36.410311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:09:36.410311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:09:36.410311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 29 01:09:36.410311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.410311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e56e4bee-d861-4a96-9d77-1555bbea5e95 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:09:36.410311 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e56e4bee-d861-4a96-9d77-1555bbea5e95 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.009284 Oct 29 01:09:36.410311 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 731/1472] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:09:36 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:09:36.417107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a322152e-bf01-44df-9e70-0f581c048504 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Action: 'create', calling method: .version_select at 0x7f9d97ae88b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-842150406", "public_key": " "}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:36.435566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-a322152e-bf01-44df-9e70-0f581c048504 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Getting quotas for project 16d5a4ada97d4e34967c328afde77bd3. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:36.441517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-a322152e-bf01-44df-9e70-0f581c048504 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Getting quotas for user 5f336e68c81744e3bf151d6bb6241349 and project 16d5a4ada97d4e34967c328afde77bd3. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:36.460363 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-a322152e-bf01-44df-9e70-0f581c048504 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a322152e-bf01-44df-9e70-0f581c048504 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Request method failure captured: Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 94 Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH1PUOwb1Oa98qkykMi5GxSGdpsXAbHpDZBTV92rgywiRrW3PiVAA6DNBB2J0h6-FIH3hscoPSK-cKGKZoSy2sAF6QRK0hG7mqHLWqFMMWHyN53vH0yOftBK4os_1GmelufWJFDwu4vXQ5jVbxE4N5WSVZjVaDQ3Lwd5XZwG6_7rjN8 Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 16d5a4ada97d4e34967c328afde77bd3 Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16d5a4ada97d4e34967c328afde77bd3", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 16d5a4ada97d4e34967c328afde77bd3 Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-KeyPairsNegativeTestJSON-1640325645-project Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 5f336e68c81744e3bf151d6bb6241349 Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1640325645-project Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-842150406", "public_key": " "}} Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: exception: Keypair data is invalid: failed to generate fingerprint Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-842150406', 'public_key': ' '}}} Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:36.462243 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a322152e-bf01-44df-9e70-0f581c048504 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a322152e-bf01-44df-9e70-0f581c048504 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.050868 Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 732/1473] 10.222.0.26 () {60 vars in 1158 bytes} [Sat Oct 29 01:09:36 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b9f72839-dacf-450b-b97f-b63efacdcce4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:36.478092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b9f72839-dacf-450b-b97f-b63efacdcce4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:36.481712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9f72839-dacf-450b-b97f-b63efacdcce4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:36.482216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9f72839-dacf-450b-b97f-b63efacdcce4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:36.482914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9f72839-dacf-450b-b97f-b63efacdcce4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:36.483686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9f72839-dacf-450b-b97f-b63efacdcce4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:36.484261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9f72839-dacf-450b-b97f-b63efacdcce4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:36.484756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9f72839-dacf-450b-b97f-b63efacdcce4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:36.485838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7110ea4c-d720-450c-bb55-5ba2e30f2e5a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:36.495049 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7110ea4c-d720-450c-bb55-5ba2e30f2e5a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1541 microversion: 2.1 time: 0.175042 Oct 29 01:09:36.507807 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 742/1474] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:36 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1541 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:36.507807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3418a43d-a3f9-497c-aa16-dfd869006707 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Action: 'create', calling method: .version_select at 0x7f9d9796f940>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0AC06cRVrZ9KiiDqms10VZ1o4yJycjTNg7uUQOOmZoNrRmHQPlPd/VVgfh33zWYXf+hQVfNnSs40jjRMnwavNHtZv/S1TwytXTTpf/PSX0YZl/YdG7PHoV2BwNAvBpg=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3418a43d-a3f9-497c-aa16-dfd869006707 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Request method failure captured: Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 507 Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH1PUOwb1Oa98qkykMi5GxSGdpsXAbHpDZBTV92rgywiRrW3PiVAA6DNBB2J0h6-FIH3hscoPSK-cKGKZoSy2sAF6QRK0hG7mqHLWqFMMWHyN53vH0yOftBK4os_1GmelufWJFDwu4vXQ5jVbxE4N5WSVZjVaDQ3Lwd5XZwG6_7rjN8 Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 16d5a4ada97d4e34967c328afde77bd3 Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16d5a4ada97d4e34967c328afde77bd3", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 16d5a4ada97d4e34967c328afde77bd3 Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-KeyPairsNegativeTestJSON-1640325645-project Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 5f336e68c81744e3bf151d6bb6241349 Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1640325645-project Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0AC06cRVrZ9KiiDqms10VZ1o4yJycjTNg7uUQOOmZoNrRmHQPlPd/VVgfh33zWYXf+hQVfNnSs40jjRMnwavNHtZv/S1TwytXTTpf/PSX0YZl/YdG7PHoV2BwNAvBpg=="}} Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0AC06cRVrZ9KiiDqms10VZ1o4yJycjTNg7uUQOOmZoNrRmHQPlPd/VVgfh33zWYXf+hQVfNnSs40jjRMnwavNHtZv/S1TwytXTTpf/PSX0YZl/YdG7PHoV2BwNAvBpg=='}}} Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 29 01:09:36.519255 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3418a43d-a3f9-497c-aa16-dfd869006707 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3418a43d-a3f9-497c-aa16-dfd869006707 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.024192 Oct 29 01:09:36.522833 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 743/1475] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:09:36 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:09:36.530686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b3d99645-b53f-4c5b-92e1-5d7edfbf92df tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Action: 'create', calling method: .version_select at 0x7f9d97823430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-416851637", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:36.547922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b3d99645-b53f-4c5b-92e1-5d7edfbf92df tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Getting quotas for project 16d5a4ada97d4e34967c328afde77bd3. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:36.553593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b3d99645-b53f-4c5b-92e1-5d7edfbf92df tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Getting quotas for user 5f336e68c81744e3bf151d6bb6241349 and project 16d5a4ada97d4e34967c328afde77bd3. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:36.570257 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-b3d99645-b53f-4c5b-92e1-5d7edfbf92df tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b3d99645-b53f-4c5b-92e1-5d7edfbf92df tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Request method failure captured: Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 117 Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH1PUOwb1Oa98qkykMi5GxSGdpsXAbHpDZBTV92rgywiRrW3PiVAA6DNBB2J0h6-FIH3hscoPSK-cKGKZoSy2sAF6QRK0hG7mqHLWqFMMWHyN53vH0yOftBK4os_1GmelufWJFDwu4vXQ5jVbxE4N5WSVZjVaDQ3Lwd5XZwG6_7rjN8 Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 16d5a4ada97d4e34967c328afde77bd3 Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16d5a4ada97d4e34967c328afde77bd3", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 16d5a4ada97d4e34967c328afde77bd3 Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-KeyPairsNegativeTestJSON-1640325645-project Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 5f336e68c81744e3bf151d6bb6241349 Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1640325645-project Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-416851637", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: exception: Keypair data is invalid: failed to generate fingerprint Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-416851637', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 29 01:09:36.579621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b3d99645-b53f-4c5b-92e1-5d7edfbf92df tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b3d99645-b53f-4c5b-92e1-5d7edfbf92df tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.047381 Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 744/1476] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:09:36 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cad62a28-63d3-43b1-9595-ab733cdf1228 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:36.585585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cad62a28-63d3-43b1-9595-ab733cdf1228 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:36.588464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cad62a28-63d3-43b1-9595-ab733cdf1228 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:36.588464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cad62a28-63d3-43b1-9595-ab733cdf1228 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:36.588464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cad62a28-63d3-43b1-9595-ab733cdf1228 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:36.588714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cad62a28-63d3-43b1-9595-ab733cdf1228 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:36.589096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cad62a28-63d3-43b1-9595-ab733cdf1228 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:36.589563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cad62a28-63d3-43b1-9595-ab733cdf1228 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:36.622663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cad62a28-63d3-43b1-9595-ab733cdf1228 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:36.623146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cad62a28-63d3-43b1-9595-ab733cdf1228 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:36.623581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cad62a28-63d3-43b1-9595-ab733cdf1228 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:36.624031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-cad62a28-63d3-43b1-9595-ab733cdf1228 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lazy-loading 'fault' on Instance uuid f38f9413-877d-43ab-b4ed-294552b3c231 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:09:36.637661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b9f72839-dacf-450b-b97f-b63efacdcce4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:36.646355 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b9f72839-dacf-450b-b97f-b63efacdcce4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1314 microversion: 2.1 time: 0.180536 Oct 29 01:09:36.646938 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 733/1477] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:36 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:36.651430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4a1c72fa-b52d-41ef-b98e-3ccbabcf7625 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Calling method '.version_select at 0x7f9d97ac1e50>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:36.673129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cad62a28-63d3-43b1-9595-ab733cdf1228 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:36.680073 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-4a1c72fa-b52d-41ef-b98e-3ccbabcf7625 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2121960698 not found for user 5f336e68c81744e3bf151d6bb6241349 Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4a1c72fa-b52d-41ef-b98e-3ccbabcf7625 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Request method failure captured: Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2121960698 HTTP/1.1 Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH1PUOwb1Oa98qkykMi5GxSGdpsXAbHpDZBTV92rgywiRrW3PiVAA6DNBB2J0h6-FIH3hscoPSK-cKGKZoSy2sAF6QRK0hG7mqHLWqFMMWHyN53vH0yOftBK4os_1GmelufWJFDwu4vXQ5jVbxE4N5WSVZjVaDQ3Lwd5XZwG6_7rjN8 Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 16d5a4ada97d4e34967c328afde77bd3 Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16d5a4ada97d4e34967c328afde77bd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16d5a4ada97d4e34967c328afde77bd3", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 16d5a4ada97d4e34967c328afde77bd3 Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1640325645 Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-KeyPairsNegativeTestJSON-1640325645-project Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 5f336e68c81744e3bf151d6bb6241349 Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1640325645-project Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: exception: Keypair tempest-keypair-non-existent-2121960698 not found for user 5f336e68c81744e3bf151d6bb6241349 Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'tempest-keypair-non-existent-2121960698'} Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-2121960698 not found for user 5f336e68c81744e3bf151d6bb6241349 Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.682241 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-2121960698 not found for user 5f336e68c81744e3bf151d6bb6241349 Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-2121960698 not found for user 5f336e68c81744e3bf151d6bb6241349 Oct 29 01:09:36.687320 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:36.689824 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cad62a28-63d3-43b1-9595-ab733cdf1228 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1330 microversion: 2.1 time: 0.106435 Oct 29 01:09:36.689934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4a1c72fa-b52d-41ef-b98e-3ccbabcf7625 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2121960698 not found for user 5f336e68c81744e3bf151d6bb6241349 {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:09:36.690037 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 745/1478] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:36 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1330 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:36.690129 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4a1c72fa-b52d-41ef-b98e-3ccbabcf7625 tempest-KeyPairsNegativeTestJSON-1640325645 tempest-KeyPairsNegativeTestJSON-1640325645-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2121960698" status: 404 len: 145 microversion: 2.1 time: 0.035805 Oct 29 01:09:36.690129 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 734/1479] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 29 01:09:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2121960698 => generated 145 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:09:36.750912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-33714e1b-5f64-423c-92cb-5e8c81d4e7b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:36.752534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-33714e1b-5f64-423c-92cb-5e8c81d4e7b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:36.759746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33714e1b-5f64-423c-92cb-5e8c81d4e7b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:36.760722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33714e1b-5f64-423c-92cb-5e8c81d4e7b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:36.761796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33714e1b-5f64-423c-92cb-5e8c81d4e7b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:36.762767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33714e1b-5f64-423c-92cb-5e8c81d4e7b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:36.764079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33714e1b-5f64-423c-92cb-5e8c81d4e7b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:36.764757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33714e1b-5f64-423c-92cb-5e8c81d4e7b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:36.926890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-33714e1b-5f64-423c-92cb-5e8c81d4e7b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:36.942562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-33714e1b-5f64-423c-92cb-5e8c81d4e7b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:36.944207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-33714e1b-5f64-423c-92cb-5e8c81d4e7b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:36.957337 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-33714e1b-5f64-423c-92cb-5e8c81d4e7b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.199074 Oct 29 01:09:36.957337 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 746/1480] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:36 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:37.000456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ba459110-1aa5-4abd-b95a-b538c3e55c9f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:37.001096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ba459110-1aa5-4abd-b95a-b538c3e55c9f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:37.008866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba459110-1aa5-4abd-b95a-b538c3e55c9f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:37.009548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba459110-1aa5-4abd-b95a-b538c3e55c9f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:37.010290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba459110-1aa5-4abd-b95a-b538c3e55c9f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:37.011236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba459110-1aa5-4abd-b95a-b538c3e55c9f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:37.011776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba459110-1aa5-4abd-b95a-b538c3e55c9f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:37.012355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba459110-1aa5-4abd-b95a-b538c3e55c9f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:37.159879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ba459110-1aa5-4abd-b95a-b538c3e55c9f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:37.169074 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ba459110-1aa5-4abd-b95a-b538c3e55c9f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1321 microversion: 2.1 time: 0.173001 Oct 29 01:09:37.169681 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 735/1481] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:36 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:37.519854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2f5dd931-701f-47dc-afdd-4d304d8e6144 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:37.520399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2f5dd931-701f-47dc-afdd-4d304d8e6144 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:37.527387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f5dd931-701f-47dc-afdd-4d304d8e6144 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:37.534484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f5dd931-701f-47dc-afdd-4d304d8e6144 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:37.534484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f5dd931-701f-47dc-afdd-4d304d8e6144 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:37.534484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f5dd931-701f-47dc-afdd-4d304d8e6144 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:37.534484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f5dd931-701f-47dc-afdd-4d304d8e6144 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:37.534484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f5dd931-701f-47dc-afdd-4d304d8e6144 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:37.676331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f5dd931-701f-47dc-afdd-4d304d8e6144 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:37.677098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b6a3fdfe-ba93-4e95-b173-ce76705869f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:37.677843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b6a3fdfe-ba93-4e95-b173-ce76705869f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:37.691994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6a3fdfe-ba93-4e95-b173-ce76705869f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:37.695094 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2f5dd931-701f-47dc-afdd-4d304d8e6144 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1541 microversion: 2.1 time: 0.179607 Oct 29 01:09:37.695691 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 747/1482] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:37 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1541 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:37.696268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6a3fdfe-ba93-4e95-b173-ce76705869f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:37.696721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6a3fdfe-ba93-4e95-b173-ce76705869f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:37.697498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6a3fdfe-ba93-4e95-b173-ce76705869f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:37.698165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6a3fdfe-ba93-4e95-b173-ce76705869f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:37.698652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6a3fdfe-ba93-4e95-b173-ce76705869f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:37.716881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f48e2360-c723-40ba-81b4-74a09b012a89 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:37.717637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f48e2360-c723-40ba-81b4-74a09b012a89 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:37.727207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f48e2360-c723-40ba-81b4-74a09b012a89 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:37.727723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f48e2360-c723-40ba-81b4-74a09b012a89 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:37.728691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f48e2360-c723-40ba-81b4-74a09b012a89 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:37.729451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f48e2360-c723-40ba-81b4-74a09b012a89 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:37.729915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f48e2360-c723-40ba-81b4-74a09b012a89 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:37.730344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f48e2360-c723-40ba-81b4-74a09b012a89 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:37.796120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:37.801860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f48e2360-c723-40ba-81b4-74a09b012a89 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:37.802524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f48e2360-c723-40ba-81b4-74a09b012a89 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:37.803169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f48e2360-c723-40ba-81b4-74a09b012a89 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:37.803799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-f48e2360-c723-40ba-81b4-74a09b012a89 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lazy-loading 'fault' on Instance uuid f38f9413-877d-43ab-b4ed-294552b3c231 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:09:37.866996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f48e2360-c723-40ba-81b4-74a09b012a89 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf36c8bc01ea4fb7b1bd4e93b91e9e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e99f2826f4133a5cd65c2962c0406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:37.875321 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f48e2360-c723-40ba-81b4-74a09b012a89 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 200 len: 1330 microversion: 2.1 time: 0.169253 Oct 29 01:09:37.875914 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 748/1483] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:37 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 1330 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:37.903899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b6a3fdfe-ba93-4e95-b173-ce76705869f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:37.912167 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b6a3fdfe-ba93-4e95-b173-ce76705869f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1314 microversion: 2.1 time: 0.244165 Oct 29 01:09:37.913002 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 736/1484] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:37 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:37.974583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c6ef1bbf-70f4-409e-b798-6ca55099da08 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:37.975231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c6ef1bbf-70f4-409e-b798-6ca55099da08 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:37.983098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6ef1bbf-70f4-409e-b798-6ca55099da08 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:37.983600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6ef1bbf-70f4-409e-b798-6ca55099da08 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:37.984043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6ef1bbf-70f4-409e-b798-6ca55099da08 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:37.984842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6ef1bbf-70f4-409e-b798-6ca55099da08 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:37.985332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6ef1bbf-70f4-409e-b798-6ca55099da08 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:37.985762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6ef1bbf-70f4-409e-b798-6ca55099da08 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:38.194019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4afc2646-fe31-4bd2-880d-c66c5fd4b995 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:38.195464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4afc2646-fe31-4bd2-880d-c66c5fd4b995 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:38.202868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4afc2646-fe31-4bd2-880d-c66c5fd4b995 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:38.209491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4afc2646-fe31-4bd2-880d-c66c5fd4b995 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:38.209491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4afc2646-fe31-4bd2-880d-c66c5fd4b995 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:38.209491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4afc2646-fe31-4bd2-880d-c66c5fd4b995 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:38.209491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4afc2646-fe31-4bd2-880d-c66c5fd4b995 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:38.209491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4afc2646-fe31-4bd2-880d-c66c5fd4b995 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:38.308382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c6ef1bbf-70f4-409e-b798-6ca55099da08 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:38.328314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c6ef1bbf-70f4-409e-b798-6ca55099da08 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:38.331336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c6ef1bbf-70f4-409e-b798-6ca55099da08 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:38.332946 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c6ef1bbf-70f4-409e-b798-6ca55099da08 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.362659 Oct 29 01:09:38.334574 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 749/1485] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:37 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:38.502166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4afc2646-fe31-4bd2-880d-c66c5fd4b995 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:38.511118 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4afc2646-fe31-4bd2-880d-c66c5fd4b995 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1471 microversion: 2.1 time: 0.322006 Oct 29 01:09:38.511757 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 737/1486] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:38 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1471 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:38.554057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-cb4b2922-a932-4738-b1ef-8f470cf9b607 req-f45f6b3e-3b49-4734-be58-60da1f4f17b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165", "tag": "88c9a8fd-f03f-4f18-a500-1e29a06ed190"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:38.571034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-cb4b2922-a932-4738-b1ef-8f470cf9b607 req-f45f6b3e-3b49-4734-be58-60da1f4f17b4 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:38.573001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-cb4b2922-a932-4738-b1ef-8f470cf9b607 req-f45f6b3e-3b49-4734-be58-60da1f4f17b4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:38.573001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-cb4b2922-a932-4738-b1ef-8f470cf9b607 req-f45f6b3e-3b49-4734-be58-60da1f4f17b4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:38.628011 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-cb4b2922-a932-4738-b1ef-8f470cf9b607 req-f45f6b3e-3b49-4734-be58-60da1f4f17b4 service nova] Creating event network-changed:88c9a8fd-f03f-4f18-a500-1e29a06ed190 for instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 on n-h2-862964-3 Oct 29 01:09:38.634282 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-cb4b2922-a932-4738-b1ef-8f470cf9b607 req-f45f6b3e-3b49-4734-be58-60da1f4f17b4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083396 Oct 29 01:09:38.637901 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 738/1487] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:38.721574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-12b9fcd6-75d7-46b4-bef4-949f2d62f572 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:38.722618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-12b9fcd6-75d7-46b4-bef4-949f2d62f572 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:38.736026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12b9fcd6-75d7-46b4-bef4-949f2d62f572 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:38.741284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12b9fcd6-75d7-46b4-bef4-949f2d62f572 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:38.741918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12b9fcd6-75d7-46b4-bef4-949f2d62f572 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:38.744229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12b9fcd6-75d7-46b4-bef4-949f2d62f572 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:38.744939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12b9fcd6-75d7-46b4-bef4-949f2d62f572 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:38.745510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12b9fcd6-75d7-46b4-bef4-949f2d62f572 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:38.888561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd6daecb-3bcf-4675-8787-5c5be55077a4 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:38.889877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bd6daecb-3bcf-4675-8787-5c5be55077a4 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] [instance: 7468f2d3-acb4-460a-9f4b-d78cb0d805b2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:38.897849 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-bd6daecb-3bcf-4675-8787-5c5be55077a4 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] HTTP exception thrown: Instance 7468f2d3-acb4-460a-9f4b-d78cb0d805b2 could not be found. Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd6daecb-3bcf-4675-8787-5c5be55077a4 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Request method failure captured: Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/7468f2d3-acb4-460a-9f4b-d78cb0d805b2/action HTTP/1.1 Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 15 Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH030j18nY1CM7C3q95P5Ku0vulVs7KQTS1F8WE0COJee9ptUd-IvSJ5zFWWR6KmhQ6AlhE4zHTK6ejtnndnD7q6WSArxYdEaK-kWwf51aDiFtvc76xBiS1jB_Rych7pVWg4o64eHNStI0QcQjaYRjsy3CKzlnnw83BCmVcWdaJ0xEM Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 3ba9ad0d9c8b469fb0b7e976a0919a0a Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-38403394 Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ba9ad0d9c8b469fb0b7e976a0919a0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3ba9ad0d9c8b469fb0b7e976a0919a0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ba9ad0d9c8b469fb0b7e976a0919a0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3ba9ad0d9c8b469fb0b7e976a0919a0a", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersAdminNegativeTestJSON-38403394 Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 3ba9ad0d9c8b469fb0b7e976a0919a0a Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-38403394 Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersAdminNegativeTestJSON-38403394-project-admin Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 83eeeee84728497d95781b5a9a41ed59 Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersAdminNegativeTestJSON-38403394-project-admin Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: {"migrate": {}} Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 7468f2d3-acb4-460a-9f4b-d78cb0d805b2 could not be found. Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '7468f2d3-acb4-460a-9f4b-d78cb0d805b2', 'body': {'migrate': {}}} Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7468f2d3-acb4-460a-9f4b-d78cb0d805b2 could not be found. Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7468f2d3-acb4-460a-9f4b-d78cb0d805b2 could not be found. Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:38.899957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:38.904705 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:38.904705 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:38.904705 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:09:38.904705 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:09:38.904705 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7468f2d3-acb4-460a-9f4b-d78cb0d805b2 could not be found. Oct 29 01:09:38.904705 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:09:38.906686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd6daecb-3bcf-4675-8787-5c5be55077a4 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Returning 404 to user: Instance 7468f2d3-acb4-460a-9f4b-d78cb0d805b2 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:09:38.908126 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bd6daecb-3bcf-4675-8787-5c5be55077a4 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/7468f2d3-acb4-460a-9f4b-d78cb0d805b2/action" status: 404 len: 111 microversion: 2.1 time: 0.369755 Oct 29 01:09:38.909300 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 750/1488] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:09:38 2022] POST /compute/v2.1/servers/7468f2d3-acb4-460a-9f4b-d78cb0d805b2/action => generated 111 bytes in 372 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:09:38.925782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-cf117b69-9bae-4365-a174-a78cf7f80c5c req-89f94ffe-aef9-4004-89fd-d260003671fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cedff71-8de0-4fb5-b294-af0c46e7e324", "name": "network-vif-unplugged", "status": "completed", "tag": "fbf748c5-d7b1-45dc-a698-9d558f69324c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:38.942448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cf117b69-9bae-4365-a174-a78cf7f80c5c req-89f94ffe-aef9-4004-89fd-d260003671fd service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:38.943160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cf117b69-9bae-4365-a174-a78cf7f80c5c req-89f94ffe-aef9-4004-89fd-d260003671fd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:38.943637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cf117b69-9bae-4365-a174-a78cf7f80c5c req-89f94ffe-aef9-4004-89fd-d260003671fd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:38.949185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-12b9fcd6-75d7-46b4-bef4-949f2d62f572 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:38.959565 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-cf117b69-9bae-4365-a174-a78cf7f80c5c req-89f94ffe-aef9-4004-89fd-d260003671fd service nova] Creating event network-vif-unplugged:fbf748c5-d7b1-45dc-a698-9d558f69324c for instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 on n-h1-862964-3 Oct 29 01:09:38.959925 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-12b9fcd6-75d7-46b4-bef4-949f2d62f572 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1540 microversion: 2.1 time: 0.243298 Oct 29 01:09:38.961309 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 739/1489] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:38 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1540 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:38.966705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c9733cc-11e9-4022-b4b9-3228d0186498 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:38.967589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9c9733cc-11e9-4022-b4b9-3228d0186498 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:38.976768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9733cc-11e9-4022-b4b9-3228d0186498 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:38.977599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9733cc-11e9-4022-b4b9-3228d0186498 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:38.983132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9733cc-11e9-4022-b4b9-3228d0186498 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:38.983319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:38.983474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9733cc-11e9-4022-b4b9-3228d0186498 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:38.983474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9733cc-11e9-4022-b4b9-3228d0186498 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:38.983474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9733cc-11e9-4022-b4b9-3228d0186498 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:38.983762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [req-cf117b69-9bae-4365-a174-a78cf7f80c5c req-89f94ffe-aef9-4004-89fd-d260003671fd service nova] Instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121099) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:09:38.997606 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-9c9733cc-11e9-4022-b4b9-3228d0186498 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] HTTP exception thrown: Instance f38f9413-877d-43ab-b4ed-294552b3c231 could not be found. Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c9733cc-11e9-4022-b4b9-3228d0186498 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Request method failure captured: Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 HTTP/1.1 Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHxyPEU1NiT0gTSI1bMqFWbyCoOEEfz4by-_zQzAjsC2nnwEzgE2336_LWkinZPdTeY8pvf-jf4_hIPFvQQNcopmcbuWJ47Cco-07SHUmtxe0EAUGyvwvbO8zJ8MPrEtqB6S2DBDVFHsrEF-lwCHt4vHLq0jWmn6dwSFWf7RiVS_65A Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 471e99f2826f4133a5cd65c2962c0406 Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-215102271 Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/471e99f2826f4133a5cd65c2962c0406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/471e99f2826f4133a5cd65c2962c0406"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/471e99f2826f4133a5cd65c2962c0406"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_471e99f2826f4133a5cd65c2962c0406", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-215102271 Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 471e99f2826f4133a5cd65c2962c0406 Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-215102271 Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AttachSCSIVolumeTestJSON-215102271-project Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: cf36c8bc01ea4fb7b1bd4e93b91e9e1e Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-215102271-project Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance f38f9413-877d-43ab-b4ed-294552b3c231 could not be found. Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'f38f9413-877d-43ab-b4ed-294552b3c231'} Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f38f9413-877d-43ab-b4ed-294552b3c231 could not be found. Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f38f9413-877d-43ab-b4ed-294552b3c231 could not be found. Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:38.999266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:39.006012 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:39.006012 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:39.006012 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:39.006012 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:09:39.006012 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:09:39.006012 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f38f9413-877d-43ab-b4ed-294552b3c231 could not be found. Oct 29 01:09:39.006012 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:39.006012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c9733cc-11e9-4022-b4b9-3228d0186498 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Returning 404 to user: Instance f38f9413-877d-43ab-b4ed-294552b3c231 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:09:39.006012 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9c9733cc-11e9-4022-b4b9-3228d0186498 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 404 len: 111 microversion: 2.1 time: 0.038090 Oct 29 01:09:39.006012 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 740/1490] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:38 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:09:39.012580 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-cf117b69-9bae-4365-a174-a78cf7f80c5c req-89f94ffe-aef9-4004-89fd-d260003671fd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096075 Oct 29 01:09:39.015366 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 751/1491] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:39.023536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3b5d7554-c53d-452c-a7da-3169708d0a94 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:39.025886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3b5d7554-c53d-452c-a7da-3169708d0a94 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:39.027718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a5213581-81fe-46c0-a759-40855bef0f78 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '.version_select at 0x7f9d977d69d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:39.039296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b5d7554-c53d-452c-a7da-3169708d0a94 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:39.043492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b5d7554-c53d-452c-a7da-3169708d0a94 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:39.046201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b5d7554-c53d-452c-a7da-3169708d0a94 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:39.049830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b5d7554-c53d-452c-a7da-3169708d0a94 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:39.052582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b5d7554-c53d-452c-a7da-3169708d0a94 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:39.053288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b5d7554-c53d-452c-a7da-3169708d0a94 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:39.175068 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a5213581-81fe-46c0-a759-40855bef0f78 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-611727957" status: 202 len: 0 microversion: 2.1 time: 0.157553 Oct 29 01:09:39.179527 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 752/1492] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 29 01:09:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-611727957 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:09:39.185694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e1d7ac9e-e0f6-4a8b-a18a-0ae5bfb65452 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-130181596", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:39.262295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-e1d7ac9e-e0f6-4a8b-a18a-0ae5bfb65452 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] validate_networks() for None {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:09:39.577906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3b5d7554-c53d-452c-a7da-3169708d0a94 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:39.594088 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3b5d7554-c53d-452c-a7da-3169708d0a94 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1314 microversion: 2.1 time: 0.591116 Oct 29 01:09:39.594685 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 741/1493] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:39 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:39.616222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1b1d5c29-ac8c-4da1-a313-83dde80b18c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:39.617006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1b1d5c29-ac8c-4da1-a313-83dde80b18c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:39.634367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b1d5c29-ac8c-4da1-a313-83dde80b18c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:39.635084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b1d5c29-ac8c-4da1-a313-83dde80b18c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:39.635530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b1d5c29-ac8c-4da1-a313-83dde80b18c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:39.638221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b1d5c29-ac8c-4da1-a313-83dde80b18c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:39.638696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b1d5c29-ac8c-4da1-a313-83dde80b18c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:39.639132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b1d5c29-ac8c-4da1-a313-83dde80b18c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:39.849632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e1d7ac9e-e0f6-4a8b-a18a-0ae5bfb65452 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:09:39.853572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e1d7ac9e-e0f6-4a8b-a18a-0ae5bfb65452 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:09:39.861190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e1d7ac9e-e0f6-4a8b-a18a-0ae5bfb65452 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:09:39.861190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e1d7ac9e-e0f6-4a8b-a18a-0ae5bfb65452 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:09:39.861190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e1d7ac9e-e0f6-4a8b-a18a-0ae5bfb65452 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:09:39.880421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1d7ac9e-e0f6-4a8b-a18a-0ae5bfb65452 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:39.885011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1d7ac9e-e0f6-4a8b-a18a-0ae5bfb65452 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:39.886025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1d7ac9e-e0f6-4a8b-a18a-0ae5bfb65452 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:39.887577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1d7ac9e-e0f6-4a8b-a18a-0ae5bfb65452 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:39.890062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1d7ac9e-e0f6-4a8b-a18a-0ae5bfb65452 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:39.890630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1d7ac9e-e0f6-4a8b-a18a-0ae5bfb65452 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:39.936707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1b1d5c29-ac8c-4da1-a313-83dde80b18c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:39.949757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1b1d5c29-ac8c-4da1-a313-83dde80b18c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:39.951604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-e1d7ac9e-e0f6-4a8b-a18a-0ae5bfb65452 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Getting quotas for project ef26e5ad38454b2ab3102864d73268d3. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:39.955055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1b1d5c29-ac8c-4da1-a313-83dde80b18c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:39.960041 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1b1d5c29-ac8c-4da1-a313-83dde80b18c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.349761 Oct 29 01:09:39.961512 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 742/1494] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:39 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:39.962933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-e1d7ac9e-e0f6-4a8b-a18a-0ae5bfb65452 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Getting quotas for user a2163198c1624bf0989594eb0e9f9bf1 and project ef26e5ad38454b2ab3102864d73268d3. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:39.991920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e855f79f-de33-4dd1-b52b-710970718a72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:39.992992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e855f79f-de33-4dd1-b52b-710970718a72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:40.004455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e855f79f-de33-4dd1-b52b-710970718a72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:40.006076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e1d7ac9e-e0f6-4a8b-a18a-0ae5bfb65452 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:09:40.015359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e855f79f-de33-4dd1-b52b-710970718a72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:40.015359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e855f79f-de33-4dd1-b52b-710970718a72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:40.015626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e1d7ac9e-e0f6-4a8b-a18a-0ae5bfb65452 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:09:40.015743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e855f79f-de33-4dd1-b52b-710970718a72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:40.015743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e855f79f-de33-4dd1-b52b-710970718a72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:40.015743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e855f79f-de33-4dd1-b52b-710970718a72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:40.348805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e855f79f-de33-4dd1-b52b-710970718a72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:40.359682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:40.361869 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e855f79f-de33-4dd1-b52b-710970718a72 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1540 microversion: 2.1 time: 0.373026 Oct 29 01:09:40.364895 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 743/1495] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:39 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1540 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:40.365418 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e1d7ac9e-e0f6-4a8b-a18a-0ae5bfb65452 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.184098 Oct 29 01:09:40.366482 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 753/1496] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:09:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:09:40.387257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8ab10103-8537-41c4-81aa-2849919558a6 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:40.388117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8ab10103-8537-41c4-81aa-2849919558a6 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:40.390275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:40.465898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8ab10103-8537-41c4-81aa-2849919558a6 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:40.476858 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8ab10103-8537-41c4-81aa-2849919558a6 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1221 microversion: 2.1 time: 0.093816 Oct 29 01:09:40.479233 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 744/1497] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:40 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1221 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:40.622295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fabc7544-a196-41b0-8de1-c3672ade02f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:40.624021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fabc7544-a196-41b0-8de1-c3672ade02f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:40.641815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fabc7544-a196-41b0-8de1-c3672ade02f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:40.641815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fabc7544-a196-41b0-8de1-c3672ade02f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:40.641815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fabc7544-a196-41b0-8de1-c3672ade02f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:40.641815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fabc7544-a196-41b0-8de1-c3672ade02f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:40.642281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fabc7544-a196-41b0-8de1-c3672ade02f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:40.644413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fabc7544-a196-41b0-8de1-c3672ade02f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:40.757052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-661b9f5a-835b-4368-a35b-4b966620a545 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Action: 'create', calling method: .version_select at 0x7f9d9781f940>, body: {"keypair": {"name": "tempest-keypair-99312878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxieTRrqw1TcsbNu+naOmPCqvEP0NWpTrwYHedYCodzyvPwvkvnDGdeilGuRIS2pTMI2+Yqxmvw+rJVL7KKQB95jRYOH3+CkMixtEeERKNWtKqqQb1cEIun5qK0OI2MFg=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:40.780726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-661b9f5a-835b-4368-a35b-4b966620a545 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Getting quotas for project df879fcba8324858ba76a77b2e6564b6. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:40.795677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-661b9f5a-835b-4368-a35b-4b966620a545 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Getting quotas for user 6611bd2d8b7942bbb37cd3b9aee6c78c and project df879fcba8324858ba76a77b2e6564b6. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:40.965689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fabc7544-a196-41b0-8de1-c3672ade02f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:40.978448 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fabc7544-a196-41b0-8de1-c3672ade02f1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1314 microversion: 2.1 time: 0.360176 Oct 29 01:09:40.980504 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 745/1498] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:40 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:40.994233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c96032e-c235-4483-bc3e-08376c601eab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:40.995150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9c96032e-c235-4483-bc3e-08376c601eab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:41.002041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c96032e-c235-4483-bc3e-08376c601eab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:41.002645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c96032e-c235-4483-bc3e-08376c601eab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:41.003162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c96032e-c235-4483-bc3e-08376c601eab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:41.004144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c96032e-c235-4483-bc3e-08376c601eab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:41.004685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c96032e-c235-4483-bc3e-08376c601eab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:41.005559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c96032e-c235-4483-bc3e-08376c601eab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:41.057111 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-661b9f5a-835b-4368-a35b-4b966620a545 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.543469 Oct 29 01:09:41.059085 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 754/1499] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Oct 29 01:09:40 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 546 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 01:09:41.066020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-2f1791da-6338-4c19-ba41-981b0a08a718 req-2e9b7d30-23f9-4bdc-8501-dc7644aa994e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cedff71-8de0-4fb5-b294-af0c46e7e324", "tag": "fbf748c5-d7b1-45dc-a698-9d558f69324c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:41.085843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2f1791da-6338-4c19-ba41-981b0a08a718 req-2e9b7d30-23f9-4bdc-8501-dc7644aa994e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:41.086682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2f1791da-6338-4c19-ba41-981b0a08a718 req-2e9b7d30-23f9-4bdc-8501-dc7644aa994e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:41.087317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2f1791da-6338-4c19-ba41-981b0a08a718 req-2e9b7d30-23f9-4bdc-8501-dc7644aa994e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:41.108811 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-2f1791da-6338-4c19-ba41-981b0a08a718 req-2e9b7d30-23f9-4bdc-8501-dc7644aa994e service nova] Creating event network-changed:fbf748c5-d7b1-45dc-a698-9d558f69324c for instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 on n-h1-862964-3 Oct 29 01:09:41.118961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [req-2f1791da-6338-4c19-ba41-981b0a08a718 req-2e9b7d30-23f9-4bdc-8501-dc7644aa994e service nova] Instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121099) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:09:41.180715 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-2f1791da-6338-4c19-ba41-981b0a08a718 req-2e9b7d30-23f9-4bdc-8501-dc7644aa994e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118942 Oct 29 01:09:41.185846 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 755/1500] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:41.202144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8ebd6687-59d2-4473-81f9-2255ed3eac73 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Calling method '.version_select at 0x7f9d977c7160>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:41.235715 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8ebd6687-59d2-4473-81f9-2255ed3eac73 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-99312878" status: 200 len: 511 microversion: 2.2 time: 0.046496 Oct 29 01:09:41.237039 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 756/1501] 10.222.0.26 () {60 vars in 1252 bytes} [Sat Oct 29 01:09:41 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-99312878 => generated 511 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:41.249481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e90d43d9-c0de-43ad-9416-551d7fc28804 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Calling method '.version_select at 0x7f9d977f1550>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:41.256935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9c96032e-c235-4483-bc3e-08376c601eab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:41.274899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9c96032e-c235-4483-bc3e-08376c601eab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:41.276673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9c96032e-c235-4483-bc3e-08376c601eab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:41.278163 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9c96032e-c235-4483-bc3e-08376c601eab tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.290620 Oct 29 01:09:41.279100 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 746/1502] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:40 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:41.390122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f26d757d-5a7b-48d9-b546-b19f03f54209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:41.390742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f26d757d-5a7b-48d9-b546-b19f03f54209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:41.403125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f26d757d-5a7b-48d9-b546-b19f03f54209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:41.403984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f26d757d-5a7b-48d9-b546-b19f03f54209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:41.404487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f26d757d-5a7b-48d9-b546-b19f03f54209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:41.405951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f26d757d-5a7b-48d9-b546-b19f03f54209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:41.406438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f26d757d-5a7b-48d9-b546-b19f03f54209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:41.406879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f26d757d-5a7b-48d9-b546-b19f03f54209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:41.426362 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e90d43d9-c0de-43ad-9416-551d7fc28804 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-99312878" status: 204 len: 0 microversion: 2.2 time: 0.180504 Oct 29 01:09:41.435528 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 757/1503] 10.222.0.26 () {60 vars in 1255 bytes} [Sat Oct 29 01:09:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-99312878 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:09:41.443686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-53e78066-71ed-41b9-bd1c-bcfaa86c92fe tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Action: 'create', calling method: .version_select at 0x7f9d97793940>, body: {"keypair": {"name": "tempest-keypair-1980910518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNccMnIvQQF6Ic151/l5jLGGVFY9jOg0m2I2sfj6ZDHdq2vZ66Lb3qadz8EbI5IVCbeGovf2vwgHgdI/bmtbaU+ohGayoc2RZYPh98SUKbTGCu2p9dI9jiV0oLBOvtktSA=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:41.476780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-53e78066-71ed-41b9-bd1c-bcfaa86c92fe tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Getting quotas for project df879fcba8324858ba76a77b2e6564b6. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:41.484464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-53e78066-71ed-41b9-bd1c-bcfaa86c92fe tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Getting quotas for user 6611bd2d8b7942bbb37cd3b9aee6c78c and project df879fcba8324858ba76a77b2e6564b6. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:41.591024 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-53e78066-71ed-41b9-bd1c-bcfaa86c92fe tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.153702 Oct 29 01:09:41.591864 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 758/1504] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Oct 29 01:09:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 155 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 01:09:41.606023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-96da2c37-99b2-4e6a-8762-7d1eca444086 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:41.606718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-96da2c37-99b2-4e6a-8762-7d1eca444086 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:41.726176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-96da2c37-99b2-4e6a-8762-7d1eca444086 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:41.735264 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-96da2c37-99b2-4e6a-8762-7d1eca444086 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1221 microversion: 2.1 time: 0.133231 Oct 29 01:09:41.736732 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 759/1505] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:41 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1221 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:41.745082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3068a0bd-1f6f-4c50-b3ee-671b6634f902 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Calling method '.version_select at 0x7f9d9778c0d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:41.914644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f26d757d-5a7b-48d9-b546-b19f03f54209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:41.924092 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f26d757d-5a7b-48d9-b546-b19f03f54209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1540 microversion: 2.1 time: 0.538299 Oct 29 01:09:41.925205 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 747/1506] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:41 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1540 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:42.006812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c671c7e-cd6d-4706-8cd3-a7a1bacc9591 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:42.007540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9c671c7e-cd6d-4706-8cd3-a7a1bacc9591 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:42.016545 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3068a0bd-1f6f-4c50-b3ee-671b6634f902 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980910518" status: 204 len: 0 microversion: 2.2 time: 0.278247 Oct 29 01:09:42.019092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c671c7e-cd6d-4706-8cd3-a7a1bacc9591 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:42.019636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c671c7e-cd6d-4706-8cd3-a7a1bacc9591 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:42.020074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c671c7e-cd6d-4706-8cd3-a7a1bacc9591 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:42.020797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c671c7e-cd6d-4706-8cd3-a7a1bacc9591 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:42.021284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c671c7e-cd6d-4706-8cd3-a7a1bacc9591 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:42.021712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c671c7e-cd6d-4706-8cd3-a7a1bacc9591 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:42.025292 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 760/1507] 10.222.0.26 () {60 vars in 1261 bytes} [Sat Oct 29 01:09:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980910518 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:09:42.035889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7a927b64-ea75-44a6-a786-f4723bb5ed93 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Action: 'create', calling method: .version_select at 0x7f9d9781fdc0>, body: {"keypair": {"name": "tempest-keypair-321566139", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:42.085643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-7a927b64-ea75-44a6-a786-f4723bb5ed93 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Getting quotas for project df879fcba8324858ba76a77b2e6564b6. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:42.091392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-7a927b64-ea75-44a6-a786-f4723bb5ed93 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Getting quotas for user 6611bd2d8b7942bbb37cd3b9aee6c78c and project df879fcba8324858ba76a77b2e6564b6. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:42.229342 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7a927b64-ea75-44a6-a786-f4723bb5ed93 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.199430 Oct 29 01:09:42.230493 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 761/1508] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Oct 29 01:09:42 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 201 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 01:09:42.241502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9c671c7e-cd6d-4706-8cd3-a7a1bacc9591 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:42.241877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1b4f8c11-8b75-44f2-9821-ea8020588f1e tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Calling method '.version_select at 0x7f9d977c7040>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:42.248476 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9c671c7e-cd6d-4706-8cd3-a7a1bacc9591 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1314 microversion: 2.1 time: 0.249110 Oct 29 01:09:42.249068 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 748/1509] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:41 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:42.306452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3dc71de6-0295-4236-9694-b0072d141eb0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:42.307651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3dc71de6-0295-4236-9694-b0072d141eb0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:42.314596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dc71de6-0295-4236-9694-b0072d141eb0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:42.314732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dc71de6-0295-4236-9694-b0072d141eb0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:42.315210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dc71de6-0295-4236-9694-b0072d141eb0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:42.316806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dc71de6-0295-4236-9694-b0072d141eb0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:42.317349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dc71de6-0295-4236-9694-b0072d141eb0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:42.317783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dc71de6-0295-4236-9694-b0072d141eb0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:42.430415 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1b4f8c11-8b75-44f2-9821-ea8020588f1e tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-321566139" status: 204 len: 0 microversion: 2.2 time: 0.191409 Oct 29 01:09:42.431763 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 762/1510] 10.222.0.26 () {60 vars in 1258 bytes} [Sat Oct 29 01:09:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-321566139 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:09:42.448363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dca6a7fd-e37a-4fdb-9948-fedebff1e1c8 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Action: 'create', calling method: .version_select at 0x7f9d977f1940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1523284256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ79f92417FD1YNs9JjZC6j1SmHbSouI/BogMpt/Az2MHkeH3CZdZZv/VXacQGqgkRVU0Fc3TLcBxy1K7fE52gkvFe5ilZYo3wOLrM+Cid/aTTHZNvROckcpffWYhxroNQ=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:42.490214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-dca6a7fd-e37a-4fdb-9948-fedebff1e1c8 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Getting quotas for project df879fcba8324858ba76a77b2e6564b6. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:42.491632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3dc71de6-0295-4236-9694-b0072d141eb0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:42.498838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-dca6a7fd-e37a-4fdb-9948-fedebff1e1c8 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Getting quotas for user 6611bd2d8b7942bbb37cd3b9aee6c78c and project df879fcba8324858ba76a77b2e6564b6. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:42.501325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3dc71de6-0295-4236-9694-b0072d141eb0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:42.503180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3dc71de6-0295-4236-9694-b0072d141eb0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:42.504358 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3dc71de6-0295-4236-9694-b0072d141eb0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.202292 Oct 29 01:09:42.505263 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 749/1511] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:42 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:09:42.618258 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dca6a7fd-e37a-4fdb-9948-fedebff1e1c8 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.177004 Oct 29 01:09:42.618901 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 763/1512] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Oct 29 01:09:42 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 178 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 01:09:42.635842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9bcc85e7-4936-4d7e-8301-756b6c5fc3be tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Action: 'create', calling method: .version_select at 0x7f9d97acd700>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1478732238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHl9Zpo41c+suKOPcvf2nGuBnlSkDCdblopqR/tAmoTI+IRBXmx1url0a/dNDqwMawkoXA0jomh2ol9TCszlB2eBgMe5XqcHUxlstIldhubffzpFSOUcaz6yYR4j36upMA=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:42.653356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-9bcc85e7-4936-4d7e-8301-756b6c5fc3be tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Getting quotas for project df879fcba8324858ba76a77b2e6564b6. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:42.659722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-9bcc85e7-4936-4d7e-8301-756b6c5fc3be tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Getting quotas for user 6611bd2d8b7942bbb37cd3b9aee6c78c and project df879fcba8324858ba76a77b2e6564b6. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:42.763509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7705aa10-1228-429f-9f67-69548a8c9abd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:42.764125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7705aa10-1228-429f-9f67-69548a8c9abd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:42.771311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7705aa10-1228-429f-9f67-69548a8c9abd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:42.771814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7705aa10-1228-429f-9f67-69548a8c9abd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:42.772249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7705aa10-1228-429f-9f67-69548a8c9abd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:42.772989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7705aa10-1228-429f-9f67-69548a8c9abd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:42.773510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7705aa10-1228-429f-9f67-69548a8c9abd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:42.774234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7705aa10-1228-429f-9f67-69548a8c9abd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:42.840060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7705aa10-1228-429f-9f67-69548a8c9abd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:42.849605 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7705aa10-1228-429f-9f67-69548a8c9abd tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1225 microversion: 2.1 time: 0.090185 Oct 29 01:09:42.850501 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 764/1513] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:42 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:42.874189 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9bcc85e7-4936-4d7e-8301-756b6c5fc3be tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.238660 Oct 29 01:09:42.874189 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 750/1514] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Oct 29 01:09:42 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 240 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 01:09:42.887663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0e386268-d8de-44b1-a1a0-d4ef2be64c32 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Action: 'create', calling method: .version_select at 0x7f9d9781f1f0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1729182877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTYSt1AhznsN4enM3nof5DU2z4Q7+LWCPfXz5HsFKEWgrX8VfUImMswti0S7huX8zD9UyvwTPPdfUE36vyGblCPjQZu0o9EOJ9h/GsZ1CvWK/VeLBCKFvaIG69XpBc/rA=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:42.898836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=4,nova_api:INSERT=7 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:42.909760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-0e386268-d8de-44b1-a1a0-d4ef2be64c32 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Getting quotas for project df879fcba8324858ba76a77b2e6564b6. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:42.915953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-0e386268-d8de-44b1-a1a0-d4ef2be64c32 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Getting quotas for user 6611bd2d8b7942bbb37cd3b9aee6c78c and project df879fcba8324858ba76a77b2e6564b6. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:42.948246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6bddf118-ca8a-4529-8f38-8c7c7b11e22c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:42.949440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6bddf118-ca8a-4529-8f38-8c7c7b11e22c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:42.957604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bddf118-ca8a-4529-8f38-8c7c7b11e22c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:42.958309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bddf118-ca8a-4529-8f38-8c7c7b11e22c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:42.958742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bddf118-ca8a-4529-8f38-8c7c7b11e22c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:42.959651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bddf118-ca8a-4529-8f38-8c7c7b11e22c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:42.960106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bddf118-ca8a-4529-8f38-8c7c7b11e22c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:42.960799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bddf118-ca8a-4529-8f38-8c7c7b11e22c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:43.081101 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0e386268-d8de-44b1-a1a0-d4ef2be64c32 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.197746 Oct 29 01:09:43.082010 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 765/1515] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Oct 29 01:09:42 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 200 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 01:09:43.094743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8fce3807-0e24-43a4-87c2-3453d7a7a20e tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Calling method '.version_select at 0x7f9d977a03a0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:43.104003 n-d-862964-3 devstack@n-api.service[121099]: WARNING oslo_db.sqlalchemy.utils [None req-8fce3807-0e24-43a4-87c2-3453d7a7a20e tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 01:09:43.117232 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8fce3807-0e24-43a4-87c2-3453d7a7a20e tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.028400 Oct 29 01:09:43.118138 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 766/1516] 10.222.0.26 () {60 vars in 1177 bytes} [Sat Oct 29 01:09:43 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:43.121511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6bddf118-ca8a-4529-8f38-8c7c7b11e22c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:43.130466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-75564057-673f-4af2-8275-0f895f38ffe0 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Calling method '.version_select at 0x7f9d977998b0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:43.130983 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6bddf118-ca8a-4529-8f38-8c7c7b11e22c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1472 microversion: 2.1 time: 0.186730 Oct 29 01:09:43.132420 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 751/1517] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:42 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1472 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:43.263937 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-75564057-673f-4af2-8275-0f895f38ffe0 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1729182877" status: 204 len: 0 microversion: 2.2 time: 0.137542 Oct 29 01:09:43.270081 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 767/1518] 10.222.0.26 () {60 vars in 1321 bytes} [Sat Oct 29 01:09:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1729182877 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:09:43.275823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-89c4d193-0694-4413-944d-43db9b2fce1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:43.276352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b1fba085-7b37-46b8-ac52-9ab1c1d70cb9 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Calling method '.version_select at 0x7f9d977a0790>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:43.276946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-89c4d193-0694-4413-944d-43db9b2fce1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:43.283853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89c4d193-0694-4413-944d-43db9b2fce1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:43.284928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89c4d193-0694-4413-944d-43db9b2fce1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:43.285486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89c4d193-0694-4413-944d-43db9b2fce1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:43.286240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89c4d193-0694-4413-944d-43db9b2fce1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:43.286686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89c4d193-0694-4413-944d-43db9b2fce1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:43.287294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89c4d193-0694-4413-944d-43db9b2fce1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:43.405145 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b1fba085-7b37-46b8-ac52-9ab1c1d70cb9 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1478732238" status: 204 len: 0 microversion: 2.2 time: 0.133584 Oct 29 01:09:43.406691 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 768/1519] 10.222.0.26 () {60 vars in 1321 bytes} [Sat Oct 29 01:09:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1478732238 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:09:43.416698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a44bf502-c171-4964-acd5-a6df9a720460 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Calling method '.version_select at 0x7f9d977c73a0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:43.447998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-89c4d193-0694-4413-944d-43db9b2fce1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:43.456497 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-89c4d193-0694-4413-944d-43db9b2fce1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1314 microversion: 2.1 time: 0.184914 Oct 29 01:09:43.457041 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 752/1520] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:43 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:43.539247 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a44bf502-c171-4964-acd5-a6df9a720460 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1523284256" status: 204 len: 0 microversion: 2.2 time: 0.127902 Oct 29 01:09:43.540431 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 769/1521] 10.222.0.26 () {60 vars in 1321 bytes} [Sat Oct 29 01:09:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1523284256 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:09:43.541124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5331f6ef-be8c-4a95-b9d5-6c8f47e386c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:43.541766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5331f6ef-be8c-4a95-b9d5-6c8f47e386c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:43.549370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5331f6ef-be8c-4a95-b9d5-6c8f47e386c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:43.549860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5331f6ef-be8c-4a95-b9d5-6c8f47e386c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:43.550298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5331f6ef-be8c-4a95-b9d5-6c8f47e386c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:43.551004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5331f6ef-be8c-4a95-b9d5-6c8f47e386c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:43.551464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5331f6ef-be8c-4a95-b9d5-6c8f47e386c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:43.551891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5331f6ef-be8c-4a95-b9d5-6c8f47e386c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:43.553920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2f6df4aa-ca44-4472-a71f-ac8bb82cdf84 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Action: 'create', calling method: .version_select at 0x7f9d977a0160>, body: {"keypair": {"name": "tempest-keypair-887460617", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxMHyIPIShaBvkr0JUl2UXzunNN8GGRf3B2EG4lqtoUOd3Qup99t03VQu2WWwfwefxMrukLank8DYy9crf/g8Tbp3vL7OtrCebqmN78DwnvaeI3fjfik0VZct5EIlG9qA=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:43.594612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-2f6df4aa-ca44-4472-a71f-ac8bb82cdf84 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Getting quotas for project df879fcba8324858ba76a77b2e6564b6. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:43.601915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-2f6df4aa-ca44-4472-a71f-ac8bb82cdf84 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Getting quotas for user 6611bd2d8b7942bbb37cd3b9aee6c78c and project df879fcba8324858ba76a77b2e6564b6. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:43.695749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5331f6ef-be8c-4a95-b9d5-6c8f47e386c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:43.701512 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2f6df4aa-ca44-4472-a71f-ac8bb82cdf84 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.152987 Oct 29 01:09:43.702576 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 770/1522] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Oct 29 01:09:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 155 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 01:09:43.705215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5331f6ef-be8c-4a95-b9d5-6c8f47e386c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:43.707138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5331f6ef-be8c-4a95-b9d5-6c8f47e386c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:43.708653 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5331f6ef-be8c-4a95-b9d5-6c8f47e386c4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.172414 Oct 29 01:09:43.709464 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 753/1523] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:43 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:43.714165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cf89bfed-9891-4205-822b-2d932669d149 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Calling method '.version_select at 0x7f9d97793280>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:43.724534 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cf89bfed-9891-4205-822b-2d932669d149 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-887460617" status: 200 len: 512 microversion: 2.2 time: 0.014670 Oct 29 01:09:43.725340 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 771/1524] 10.222.0.26 () {60 vars in 1255 bytes} [Sat Oct 29 01:09:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-887460617 => generated 512 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:09:43.738337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-45f7d1f3-6388-4e98-8333-6175fcf03ac4 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Calling method '.version_select at 0x7f9d97a9e550>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:43.742512 n-d-862964-3 devstack@n-api.service[121100]: WARNING oslo_db.sqlalchemy.utils [None req-45f7d1f3-6388-4e98-8333-6175fcf03ac4 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 01:09:43.748781 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-45f7d1f3-6388-4e98-8333-6175fcf03ac4 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.015211 Oct 29 01:09:43.749407 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 754/1525] 10.222.0.26 () {60 vars in 1177 bytes} [Sat Oct 29 01:09:43 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:43.760989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6e7bf12b-2209-4456-b498-ac6739054b62 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Calling method '.version_select at 0x7f9d9796faf0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:43.839993 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6e7bf12b-2209-4456-b498-ac6739054b62 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-887460617" status: 204 len: 0 microversion: 2.2 time: 0.083310 Oct 29 01:09:43.840589 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 772/1526] 10.222.0.26 () {60 vars in 1258 bytes} [Sat Oct 29 01:09:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-887460617 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:09:43.851046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-266d3ba9-3d67-483e-9fd4-d9f5142d5636 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Action: 'create', calling method: .version_select at 0x7f9d97acdaf0>, body: {"keypair": {"name": "tempest-keypair-663297578", "type": "x509"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:43.868165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-266d3ba9-3d67-483e-9fd4-d9f5142d5636 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Getting quotas for project df879fcba8324858ba76a77b2e6564b6. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:43.874622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-266d3ba9-3d67-483e-9fd4-d9f5142d5636 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Getting quotas for user 6611bd2d8b7942bbb37cd3b9aee6c78c and project df879fcba8324858ba76a77b2e6564b6. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:43.876112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ee41824c-d68c-4212-8f81-3c942104b32c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:43.877184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ee41824c-d68c-4212-8f81-3c942104b32c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:43.883875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee41824c-d68c-4212-8f81-3c942104b32c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:43.884442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee41824c-d68c-4212-8f81-3c942104b32c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:43.884951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee41824c-d68c-4212-8f81-3c942104b32c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:43.885752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee41824c-d68c-4212-8f81-3c942104b32c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:43.886313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee41824c-d68c-4212-8f81-3c942104b32c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:43.886984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee41824c-d68c-4212-8f81-3c942104b32c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:43.890410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.processutils [None req-266d3ba9-3d67-483e-9fd4-d9f5142d5636 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpdbmfeqts/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpdbmfeqts/temp.key -subj /CN=6611bd2d8b7942bbb37cd3b9aee6c78c -extensions v3_req_client {{(pid=121100) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 29 01:09:43.959739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ee41824c-d68c-4212-8f81-3c942104b32c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:43.968238 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ee41824c-d68c-4212-8f81-3c942104b32c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1225 microversion: 2.1 time: 0.096152 Oct 29 01:09:43.969204 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 773/1527] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:43 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:43.977084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.processutils [None req-266d3ba9-3d67-483e-9fd4-d9f5142d5636 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpdbmfeqts/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpdbmfeqts/temp.key -subj /CN=6611bd2d8b7942bbb37cd3b9aee6c78c -extensions v3_req_client" returned: 0 in 0.086s {{(pid=121100) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 29 01:09:43.978837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.processutils [None req-266d3ba9-3d67-483e-9fd4-d9f5142d5636 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpdbmfeqts/temp.key -password pass: {{(pid=121100) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 29 01:09:44.009070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.processutils [None req-266d3ba9-3d67-483e-9fd4-d9f5142d5636 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpdbmfeqts/temp.key -password pass:" returned: 0 in 0.030s {{(pid=121100) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 29 01:09:44.159175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2d6740a3-a87b-4221-9917-1ba6c1e3b705 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:44.159809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2d6740a3-a87b-4221-9917-1ba6c1e3b705 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:44.166195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d6740a3-a87b-4221-9917-1ba6c1e3b705 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:44.169206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d6740a3-a87b-4221-9917-1ba6c1e3b705 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:44.169206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d6740a3-a87b-4221-9917-1ba6c1e3b705 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:44.169206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d6740a3-a87b-4221-9917-1ba6c1e3b705 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:44.169206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d6740a3-a87b-4221-9917-1ba6c1e3b705 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:44.169206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d6740a3-a87b-4221-9917-1ba6c1e3b705 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:44.178267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-266d3ba9-3d67-483e-9fd4-d9f5142d5636 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Getting quotas for project df879fcba8324858ba76a77b2e6564b6. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:44.183868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-266d3ba9-3d67-483e-9fd4-d9f5142d5636 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Getting quotas for user 6611bd2d8b7942bbb37cd3b9aee6c78c and project df879fcba8324858ba76a77b2e6564b6. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:44.200537 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-266d3ba9-3d67-483e-9fd4-d9f5142d5636 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.353888 Oct 29 01:09:44.208509 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 755/1528] 10.222.0.26 () {62 vars in 1198 bytes} [Sat Oct 29 01:09:43 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 357 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:09:44.215210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-732b2d11-2164-453b-b146-d48f988fa480 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Calling method '.version_select at 0x7f9d97b0d1f0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:44.226069 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-732b2d11-2164-453b-b146-d48f988fa480 tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-663297578" status: 200 len: 1533 microversion: 2.2 time: 0.015726 Oct 29 01:09:44.227971 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 756/1529] 10.222.0.26 () {60 vars in 1255 bytes} [Sat Oct 29 01:09:44 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-663297578 => generated 1533 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:44.240574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a1ba2fb4-3684-4e64-af46-9f3ef62a5e1f tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Calling method '.version_select at 0x7f9d97a9e820>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:44.246741 n-d-862964-3 devstack@n-api.service[121100]: WARNING oslo_db.sqlalchemy.utils [None req-a1ba2fb4-3684-4e64-af46-9f3ef62a5e1f tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 01:09:44.254857 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a1ba2fb4-3684-4e64-af46-9f3ef62a5e1f tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.019074 Oct 29 01:09:44.255765 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 757/1530] 10.222.0.26 () {60 vars in 1177 bytes} [Sat Oct 29 01:09:44 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:44.272979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4d2cc740-9758-4e39-89dd-29b7e7b224ac tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] Calling method '.version_select at 0x7f9d97c04f70>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:44.321523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2d6740a3-a87b-4221-9917-1ba6c1e3b705 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:44.331009 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2d6740a3-a87b-4221-9917-1ba6c1e3b705 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1472 microversion: 2.1 time: 0.176102 Oct 29 01:09:44.331616 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 774/1531] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:44 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1472 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:44.395226 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4d2cc740-9758-4e39-89dd-29b7e7b224ac tempest-KeyPairsV22TestJSON-166316152 tempest-KeyPairsV22TestJSON-166316152-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-663297578" status: 204 len: 0 microversion: 2.2 time: 0.126167 Oct 29 01:09:44.396106 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 758/1532] 10.222.0.26 () {60 vars in 1258 bytes} [Sat Oct 29 01:09:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-663297578 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:09:44.486206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8f491d56-baa1-46db-884c-78ccc4970b7f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:44.486972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8f491d56-baa1-46db-884c-78ccc4970b7f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:44.493679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f491d56-baa1-46db-884c-78ccc4970b7f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:44.494163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f491d56-baa1-46db-884c-78ccc4970b7f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:44.494598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f491d56-baa1-46db-884c-78ccc4970b7f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:44.495298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f491d56-baa1-46db-884c-78ccc4970b7f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:44.495751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f491d56-baa1-46db-884c-78ccc4970b7f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:44.496175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f491d56-baa1-46db-884c-78ccc4970b7f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:44.637809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8f491d56-baa1-46db-884c-78ccc4970b7f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:44.647771 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8f491d56-baa1-46db-884c-78ccc4970b7f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1314 microversion: 2.1 time: 0.172126 Oct 29 01:09:44.648855 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 775/1533] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:44 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:44.740648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6d3f3796-d58c-47f9-8dac-7908320b8480 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:44.743122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6d3f3796-d58c-47f9-8dac-7908320b8480 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:44.754166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d3f3796-d58c-47f9-8dac-7908320b8480 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:44.755067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d3f3796-d58c-47f9-8dac-7908320b8480 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:44.755945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d3f3796-d58c-47f9-8dac-7908320b8480 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:44.757019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d3f3796-d58c-47f9-8dac-7908320b8480 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:44.757662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d3f3796-d58c-47f9-8dac-7908320b8480 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:44.758573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d3f3796-d58c-47f9-8dac-7908320b8480 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:44.995230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a32ec39d-be38-4f83-8097-362b63a96d58 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:44.996174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a32ec39d-be38-4f83-8097-362b63a96d58 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:45.003164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a32ec39d-be38-4f83-8097-362b63a96d58 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:45.005938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a32ec39d-be38-4f83-8097-362b63a96d58 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:45.009621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a32ec39d-be38-4f83-8097-362b63a96d58 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:45.010837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a32ec39d-be38-4f83-8097-362b63a96d58 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:45.011472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a32ec39d-be38-4f83-8097-362b63a96d58 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:45.012135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a32ec39d-be38-4f83-8097-362b63a96d58 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:45.068256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6d3f3796-d58c-47f9-8dac-7908320b8480 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:45.112011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6d3f3796-d58c-47f9-8dac-7908320b8480 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:45.116604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6d3f3796-d58c-47f9-8dac-7908320b8480 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:45.121747 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6d3f3796-d58c-47f9-8dac-7908320b8480 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.386798 Oct 29 01:09:45.129218 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 759/1534] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:44 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:45.142944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a32ec39d-be38-4f83-8097-362b63a96d58 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:45.151737 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a32ec39d-be38-4f83-8097-362b63a96d58 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1217 microversion: 2.1 time: 0.162552 Oct 29 01:09:45.152334 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 776/1535] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:44 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:45.354685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-446458cc-5c2c-4662-8bb6-86c480a3af9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:45.355523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-446458cc-5c2c-4662-8bb6-86c480a3af9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:45.362244 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-446458cc-5c2c-4662-8bb6-86c480a3af9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:45.367690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-446458cc-5c2c-4662-8bb6-86c480a3af9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:45.367690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-446458cc-5c2c-4662-8bb6-86c480a3af9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:45.367690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-446458cc-5c2c-4662-8bb6-86c480a3af9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:45.367690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-446458cc-5c2c-4662-8bb6-86c480a3af9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:45.367690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-446458cc-5c2c-4662-8bb6-86c480a3af9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:45.623330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-446458cc-5c2c-4662-8bb6-86c480a3af9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:45.632428 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-446458cc-5c2c-4662-8bb6-86c480a3af9a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1472 microversion: 2.1 time: 0.281582 Oct 29 01:09:45.643889 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 760/1536] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:45 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1472 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:45.677405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-102843d4-9d98-49c9-8601-dd54c9acd67b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:45.677405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-102843d4-9d98-49c9-8601-dd54c9acd67b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:45.688095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-102843d4-9d98-49c9-8601-dd54c9acd67b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:45.688607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-102843d4-9d98-49c9-8601-dd54c9acd67b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:45.689182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-102843d4-9d98-49c9-8601-dd54c9acd67b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:45.690106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-102843d4-9d98-49c9-8601-dd54c9acd67b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:45.690607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-102843d4-9d98-49c9-8601-dd54c9acd67b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:45.691062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-102843d4-9d98-49c9-8601-dd54c9acd67b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:45.916887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-102843d4-9d98-49c9-8601-dd54c9acd67b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:45.930972 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-102843d4-9d98-49c9-8601-dd54c9acd67b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1314 microversion: 2.1 time: 0.263252 Oct 29 01:09:45.933825 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 777/1537] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:45 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:46.152483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-888cf2eb-f0b0-42ed-a6e4-5d57e43c4d4d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:46.153102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-888cf2eb-f0b0-42ed-a6e4-5d57e43c4d4d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:46.164380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-888cf2eb-f0b0-42ed-a6e4-5d57e43c4d4d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:46.164809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-888cf2eb-f0b0-42ed-a6e4-5d57e43c4d4d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:46.165423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-888cf2eb-f0b0-42ed-a6e4-5d57e43c4d4d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:46.166178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-888cf2eb-f0b0-42ed-a6e4-5d57e43c4d4d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:46.166619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-888cf2eb-f0b0-42ed-a6e4-5d57e43c4d4d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:46.167048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-888cf2eb-f0b0-42ed-a6e4-5d57e43c4d4d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:46.177022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-33deb91b-d018-4b10-8df2-0303a64afdde tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:46.177711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-33deb91b-d018-4b10-8df2-0303a64afdde tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:46.185376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33deb91b-d018-4b10-8df2-0303a64afdde tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:46.186283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33deb91b-d018-4b10-8df2-0303a64afdde tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:46.186895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33deb91b-d018-4b10-8df2-0303a64afdde tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:46.187772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33deb91b-d018-4b10-8df2-0303a64afdde tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:46.188388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33deb91b-d018-4b10-8df2-0303a64afdde tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:46.189589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33deb91b-d018-4b10-8df2-0303a64afdde tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:46.277099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-33deb91b-d018-4b10-8df2-0303a64afdde tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:46.293294 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-33deb91b-d018-4b10-8df2-0303a64afdde tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1273 microversion: 2.1 time: 0.117028 Oct 29 01:09:46.294733 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 778/1538] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:46 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1273 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:46.655778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f2b83854-15de-4ee1-ae4e-0c73c1be0434 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:46.656403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f2b83854-15de-4ee1-ae4e-0c73c1be0434 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:46.667658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2b83854-15de-4ee1-ae4e-0c73c1be0434 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:46.668263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2b83854-15de-4ee1-ae4e-0c73c1be0434 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:46.669631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2b83854-15de-4ee1-ae4e-0c73c1be0434 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:46.674639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2b83854-15de-4ee1-ae4e-0c73c1be0434 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:46.675958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2b83854-15de-4ee1-ae4e-0c73c1be0434 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:46.676419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2b83854-15de-4ee1-ae4e-0c73c1be0434 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:47.112480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-888cf2eb-f0b0-42ed-a6e4-5d57e43c4d4d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:47.139781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-888cf2eb-f0b0-42ed-a6e4-5d57e43c4d4d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:47.141276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-888cf2eb-f0b0-42ed-a6e4-5d57e43c4d4d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:47.145888 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-888cf2eb-f0b0-42ed-a6e4-5d57e43c4d4d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.998361 Oct 29 01:09:47.150537 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 761/1539] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:46 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:47.158306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-47a7bd13-cfbc-484a-be07-1a9767ca5ae3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:47.159669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-47a7bd13-cfbc-484a-be07-1a9767ca5ae3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:47.175902 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a7bd13-cfbc-484a-be07-1a9767ca5ae3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:47.179550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a7bd13-cfbc-484a-be07-1a9767ca5ae3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:47.180216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a7bd13-cfbc-484a-be07-1a9767ca5ae3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:47.181922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a7bd13-cfbc-484a-be07-1a9767ca5ae3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:47.182901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f2b83854-15de-4ee1-ae4e-0c73c1be0434 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:47.184054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a7bd13-cfbc-484a-be07-1a9767ca5ae3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:47.185749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a7bd13-cfbc-484a-be07-1a9767ca5ae3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:47.195057 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f2b83854-15de-4ee1-ae4e-0c73c1be0434 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1469 microversion: 2.1 time: 0.543036 Oct 29 01:09:47.211608 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 779/1540] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:46 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1469 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:47.240720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-68aba3b2-a335-455c-a269-73596e71fb89 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:47.249501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-68aba3b2-a335-455c-a269-73596e71fb89 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:47.249501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68aba3b2-a335-455c-a269-73596e71fb89 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:47.249501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68aba3b2-a335-455c-a269-73596e71fb89 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:47.249501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68aba3b2-a335-455c-a269-73596e71fb89 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:47.250425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68aba3b2-a335-455c-a269-73596e71fb89 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:47.251116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68aba3b2-a335-455c-a269-73596e71fb89 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:47.251675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68aba3b2-a335-455c-a269-73596e71fb89 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:47.351298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68aba3b2-a335-455c-a269-73596e71fb89 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:47.351783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68aba3b2-a335-455c-a269-73596e71fb89 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:47.352270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68aba3b2-a335-455c-a269-73596e71fb89 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:47.354068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68aba3b2-a335-455c-a269-73596e71fb89 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:47.354565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68aba3b2-a335-455c-a269-73596e71fb89 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:47.355108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68aba3b2-a335-455c-a269-73596e71fb89 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:47.370836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=11 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:47.388975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-68aba3b2-a335-455c-a269-73596e71fb89 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Getting quotas for project 646dbadc4e9140348132e6950c885e81. Resources: {'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:47.395912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-68aba3b2-a335-455c-a269-73596e71fb89 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Getting quotas for user 8219d81b19964408b9bc275a4457f389 and project 646dbadc4e9140348132e6950c885e81. Resources: {'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:47.503667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-47a7bd13-cfbc-484a-be07-1a9767ca5ae3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:47.544704 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-47a7bd13-cfbc-484a-be07-1a9767ca5ae3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1314 microversion: 2.1 time: 0.372969 Oct 29 01:09:47.546045 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 762/1541] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:47 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:47.551164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c8a56f12-6c5b-4bcc-a399-e30fadef5c80 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:47.554981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c8a56f12-6c5b-4bcc-a399-e30fadef5c80 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:47.563539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8a56f12-6c5b-4bcc-a399-e30fadef5c80 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:47.565043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8a56f12-6c5b-4bcc-a399-e30fadef5c80 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:47.565686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8a56f12-6c5b-4bcc-a399-e30fadef5c80 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:47.566585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8a56f12-6c5b-4bcc-a399-e30fadef5c80 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:47.567331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8a56f12-6c5b-4bcc-a399-e30fadef5c80 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:47.567925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8a56f12-6c5b-4bcc-a399-e30fadef5c80 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:47.850137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c8a56f12-6c5b-4bcc-a399-e30fadef5c80 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:47.868158 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c8a56f12-6c5b-4bcc-a399-e30fadef5c80 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1279 microversion: 2.1 time: 0.320723 Oct 29 01:09:47.868768 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 763/1542] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:47 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1279 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:47.874500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-e8efa926-c842-411f-b1c5-2b9393a850d6 req-55ddc3bc-e347-46f6-85e2-5b96339a2eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cedff71-8de0-4fb5-b294-af0c46e7e324", "name": "network-vif-plugged", "status": "completed", "tag": "fbf748c5-d7b1-45dc-a698-9d558f69324c"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:47.916815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e8efa926-c842-411f-b1c5-2b9393a850d6 req-55ddc3bc-e347-46f6-85e2-5b96339a2eec service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:47.918405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e8efa926-c842-411f-b1c5-2b9393a850d6 req-55ddc3bc-e347-46f6-85e2-5b96339a2eec service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:47.919139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e8efa926-c842-411f-b1c5-2b9393a850d6 req-55ddc3bc-e347-46f6-85e2-5b96339a2eec service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:47.937202 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-e8efa926-c842-411f-b1c5-2b9393a850d6 req-55ddc3bc-e347-46f6-85e2-5b96339a2eec service nova] Creating event network-vif-plugged:fbf748c5-d7b1-45dc-a698-9d558f69324c for instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 on n-h1-862964-3 Oct 29 01:09:47.947052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [req-e8efa926-c842-411f-b1c5-2b9393a850d6 req-55ddc3bc-e347-46f6-85e2-5b96339a2eec service nova] Instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121100) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:09:47.950943 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-68aba3b2-a335-455c-a269-73596e71fb89 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "POST /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324/action" status: 202 len: 0 microversion: 2.1 time: 0.716654 Oct 29 01:09:47.956536 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 780/1543] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:09:47 2022] POST /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324/action => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:09:47.965442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9af5abcf-c7e0-488f-82e9-34f30d395718 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:47.967567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9af5abcf-c7e0-488f-82e9-34f30d395718 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:47.972558 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-e8efa926-c842-411f-b1c5-2b9393a850d6 req-55ddc3bc-e347-46f6-85e2-5b96339a2eec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100135 Oct 29 01:09:47.975550 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 764/1544] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:47.982609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9af5abcf-c7e0-488f-82e9-34f30d395718 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:47.983453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9af5abcf-c7e0-488f-82e9-34f30d395718 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:47.984079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9af5abcf-c7e0-488f-82e9-34f30d395718 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:47.984792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9af5abcf-c7e0-488f-82e9-34f30d395718 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:47.985271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9af5abcf-c7e0-488f-82e9-34f30d395718 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:47.985697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9af5abcf-c7e0-488f-82e9-34f30d395718 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:48.176173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-93e6e8ac-ed4e-4371-99b7-24132a0a11f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:48.176882 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-93e6e8ac-ed4e-4371-99b7-24132a0a11f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:48.184176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93e6e8ac-ed4e-4371-99b7-24132a0a11f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:48.184659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93e6e8ac-ed4e-4371-99b7-24132a0a11f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:48.185096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93e6e8ac-ed4e-4371-99b7-24132a0a11f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:48.185870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93e6e8ac-ed4e-4371-99b7-24132a0a11f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:48.186512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93e6e8ac-ed4e-4371-99b7-24132a0a11f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:48.187092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93e6e8ac-ed4e-4371-99b7-24132a0a11f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:48.212095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9af5abcf-c7e0-488f-82e9-34f30d395718 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:48.232512 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9af5abcf-c7e0-488f-82e9-34f30d395718 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1468 microversion: 2.1 time: 0.274435 Oct 29 01:09:48.242345 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 781/1545] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:47 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1468 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:48.352537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-93e6e8ac-ed4e-4371-99b7-24132a0a11f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:48.365646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-93e6e8ac-ed4e-4371-99b7-24132a0a11f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:48.368990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-93e6e8ac-ed4e-4371-99b7-24132a0a11f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:48.381335 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-93e6e8ac-ed4e-4371-99b7-24132a0a11f2 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.199720 Oct 29 01:09:48.381335 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 765/1546] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:48 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:09:48.569585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e034fbf7-e5a5-4423-8dc4-ae33474a7045 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:48.570966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e034fbf7-e5a5-4423-8dc4-ae33474a7045 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:48.581424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e034fbf7-e5a5-4423-8dc4-ae33474a7045 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:48.582207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e034fbf7-e5a5-4423-8dc4-ae33474a7045 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:48.583456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e034fbf7-e5a5-4423-8dc4-ae33474a7045 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:48.584445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e034fbf7-e5a5-4423-8dc4-ae33474a7045 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:48.589651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e034fbf7-e5a5-4423-8dc4-ae33474a7045 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:48.590209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e034fbf7-e5a5-4423-8dc4-ae33474a7045 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:48.830506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e034fbf7-e5a5-4423-8dc4-ae33474a7045 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:48.841296 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e034fbf7-e5a5-4423-8dc4-ae33474a7045 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1314 microversion: 2.1 time: 0.276967 Oct 29 01:09:48.843220 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 782/1547] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:48 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:48.892434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9e5aaee7-8f3e-4df9-89b9-e4379301b156 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:48.893684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9e5aaee7-8f3e-4df9-89b9-e4379301b156 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:48.896542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8003860f-517a-4833-ad89-a64e52c6f5fe tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:48.897208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8003860f-517a-4833-ad89-a64e52c6f5fe tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:48.902066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e5aaee7-8f3e-4df9-89b9-e4379301b156 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:48.902834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e5aaee7-8f3e-4df9-89b9-e4379301b156 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:48.903532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e5aaee7-8f3e-4df9-89b9-e4379301b156 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:48.904477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e5aaee7-8f3e-4df9-89b9-e4379301b156 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:48.905603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e5aaee7-8f3e-4df9-89b9-e4379301b156 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:48.906307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e5aaee7-8f3e-4df9-89b9-e4379301b156 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:48.912133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8003860f-517a-4833-ad89-a64e52c6f5fe tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:48.912647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8003860f-517a-4833-ad89-a64e52c6f5fe tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:48.915562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8003860f-517a-4833-ad89-a64e52c6f5fe tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:48.916610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8003860f-517a-4833-ad89-a64e52c6f5fe tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:48.917373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8003860f-517a-4833-ad89-a64e52c6f5fe tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:48.918565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8003860f-517a-4833-ad89-a64e52c6f5fe tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:48.932091 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-9e5aaee7-8f3e-4df9-89b9-e4379301b156 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] HTTP exception thrown: Instance f38f9413-877d-43ab-b4ed-294552b3c231 could not be found. Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9e5aaee7-8f3e-4df9-89b9-e4379301b156 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Request method failure captured: Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 HTTP/1.1 Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHxyPEU1NiT0gTSI1bMqFWbyCoOEEfz4by-_zQzAjsC2nnwEzgE2336_LWkinZPdTeY8pvf-jf4_hIPFvQQNcopmcbuWJ47Cco-07SHUmtxe0EAUGyvwvbO8zJ8MPrEtqB6S2DBDVFHsrEF-lwCHt4vHLq0jWmn6dwSFWf7RiVS_65A Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 471e99f2826f4133a5cd65c2962c0406 Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-215102271 Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/471e99f2826f4133a5cd65c2962c0406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/471e99f2826f4133a5cd65c2962c0406"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/471e99f2826f4133a5cd65c2962c0406"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_471e99f2826f4133a5cd65c2962c0406", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-215102271 Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 471e99f2826f4133a5cd65c2962c0406 Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-215102271 Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AttachSCSIVolumeTestJSON-215102271-project Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: cf36c8bc01ea4fb7b1bd4e93b91e9e1e Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-215102271-project Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance f38f9413-877d-43ab-b4ed-294552b3c231 could not be found. Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'f38f9413-877d-43ab-b4ed-294552b3c231'} Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f38f9413-877d-43ab-b4ed-294552b3c231 could not be found. Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:09:48.937808 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:09:48.944113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f38f9413-877d-43ab-b4ed-294552b3c231 could not be found. Oct 29 01:09:48.944113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:48.944113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:48.944113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:48.944113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:48.944113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:48.944113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:48.944113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:09:48.944113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:09:48.944113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f38f9413-877d-43ab-b4ed-294552b3c231 could not be found. Oct 29 01:09:48.944113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:48.944113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9e5aaee7-8f3e-4df9-89b9-e4379301b156 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Returning 404 to user: Instance f38f9413-877d-43ab-b4ed-294552b3c231 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:09:48.944113 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9e5aaee7-8f3e-4df9-89b9-e4379301b156 tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 404 len: 111 microversion: 2.1 time: 0.052917 Oct 29 01:09:48.944113 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 766/1548] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:09:48 2022] DELETE /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:09:48.958184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c23c99b1-99dd-4297-93b8-0616b22bdfcc tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:48.958820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c23c99b1-99dd-4297-93b8-0616b22bdfcc tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] [instance: f38f9413-877d-43ab-b4ed-294552b3c231] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:48.975252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c23c99b1-99dd-4297-93b8-0616b22bdfcc tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:48.975877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c23c99b1-99dd-4297-93b8-0616b22bdfcc tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:48.981501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c23c99b1-99dd-4297-93b8-0616b22bdfcc tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:48.981501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c23c99b1-99dd-4297-93b8-0616b22bdfcc tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:48.981501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c23c99b1-99dd-4297-93b8-0616b22bdfcc tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:48.981501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c23c99b1-99dd-4297-93b8-0616b22bdfcc tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:48.997419 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-c23c99b1-99dd-4297-93b8-0616b22bdfcc tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] HTTP exception thrown: Instance f38f9413-877d-43ab-b4ed-294552b3c231 could not be found. Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c23c99b1-99dd-4297-93b8-0616b22bdfcc tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Request method failure captured: Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 HTTP/1.1 Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHxyPEU1NiT0gTSI1bMqFWbyCoOEEfz4by-_zQzAjsC2nnwEzgE2336_LWkinZPdTeY8pvf-jf4_hIPFvQQNcopmcbuWJ47Cco-07SHUmtxe0EAUGyvwvbO8zJ8MPrEtqB6S2DBDVFHsrEF-lwCHt4vHLq0jWmn6dwSFWf7RiVS_65A Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 471e99f2826f4133a5cd65c2962c0406 Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-215102271 Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/471e99f2826f4133a5cd65c2962c0406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/471e99f2826f4133a5cd65c2962c0406"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/471e99f2826f4133a5cd65c2962c0406"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_471e99f2826f4133a5cd65c2962c0406", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-215102271 Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 471e99f2826f4133a5cd65c2962c0406 Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-215102271 Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AttachSCSIVolumeTestJSON-215102271-project Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: cf36c8bc01ea4fb7b1bd4e93b91e9e1e Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-215102271-project Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance f38f9413-877d-43ab-b4ed-294552b3c231 could not be found. Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'f38f9413-877d-43ab-b4ed-294552b3c231'} Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f38f9413-877d-43ab-b4ed-294552b3c231 could not be found. Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f38f9413-877d-43ab-b4ed-294552b3c231 could not be found. Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:09:48.999456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:49.005340 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:09:49.005340 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:09:49.005340 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:09:49.005340 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:09:49.005340 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:09:49.005340 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f38f9413-877d-43ab-b4ed-294552b3c231 could not be found. Oct 29 01:09:49.005340 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:09:49.009331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c23c99b1-99dd-4297-93b8-0616b22bdfcc tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] Returning 404 to user: Instance f38f9413-877d-43ab-b4ed-294552b3c231 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:09:49.010445 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c23c99b1-99dd-4297-93b8-0616b22bdfcc tempest-AttachSCSIVolumeTestJSON-215102271 tempest-AttachSCSIVolumeTestJSON-215102271-project] 10.222.0.26 "GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231" status: 404 len: 111 microversion: 2.1 time: 0.057747 Oct 29 01:09:49.012391 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 767/1549] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:48 2022] GET /compute/v2.1/servers/f38f9413-877d-43ab-b4ed-294552b3c231 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:09:49.023374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1711144043", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "25d40e00-6b47-4473-967f-041843db890b"}], "security_groups": [{"name": "tempest-securitygroup--633734932"}], "key_name": "tempest-keypair-1847294559", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "65917370-e712-45cb-a1b6-fed301ebd406", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:49.250026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8003860f-517a-4833-ad89-a64e52c6f5fe tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:49.259688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] validate_networks() for [('25d40e00-6b47-4473-967f-041843db890b', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:09:49.284221 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8003860f-517a-4833-ad89-a64e52c6f5fe tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1321 microversion: 2.1 time: 0.391861 Oct 29 01:09:49.297591 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 783/1550] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:48 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1321 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:49.297591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-72c551ab-7161-4d06-a256-ca2f9644ebef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:49.297591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-72c551ab-7161-4d06-a256-ca2f9644ebef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:49.301058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72c551ab-7161-4d06-a256-ca2f9644ebef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:49.302440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72c551ab-7161-4d06-a256-ca2f9644ebef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:49.303030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72c551ab-7161-4d06-a256-ca2f9644ebef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:49.304163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72c551ab-7161-4d06-a256-ca2f9644ebef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:49.304774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72c551ab-7161-4d06-a256-ca2f9644ebef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:49.305389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72c551ab-7161-4d06-a256-ca2f9644ebef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:49.330061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:49.580897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-72c551ab-7161-4d06-a256-ca2f9644ebef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:49.601188 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-72c551ab-7161-4d06-a256-ca2f9644ebef tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1468 microversion: 2.1 time: 0.314691 Oct 29 01:09:49.602229 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 784/1551] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:49 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1468 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:49.621989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7567df38-758b-43e4-a9c7-b169ca51c8e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:49.622938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7567df38-758b-43e4-a9c7-b169ca51c8e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:49.631810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7567df38-758b-43e4-a9c7-b169ca51c8e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:49.632844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7567df38-758b-43e4-a9c7-b169ca51c8e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:49.633552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7567df38-758b-43e4-a9c7-b169ca51c8e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:49.634506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7567df38-758b-43e4-a9c7-b169ca51c8e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:49.636068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7567df38-758b-43e4-a9c7-b169ca51c8e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:49.636737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7567df38-758b-43e4-a9c7-b169ca51c8e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:49.995390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7567df38-758b-43e4-a9c7-b169ca51c8e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:50.020871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7567df38-758b-43e4-a9c7-b169ca51c8e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:50.020871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7567df38-758b-43e4-a9c7-b169ca51c8e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:50.020871 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7567df38-758b-43e4-a9c7-b169ca51c8e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.414052 Oct 29 01:09:50.020871 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 785/1552] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:49 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:50.024417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d33184e5-4014-4d1e-8500-560de48b7736 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:50.025042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d33184e5-4014-4d1e-8500-560de48b7736 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:50.034264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d33184e5-4014-4d1e-8500-560de48b7736 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:50.034768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d33184e5-4014-4d1e-8500-560de48b7736 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:50.035206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d33184e5-4014-4d1e-8500-560de48b7736 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:50.036046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d33184e5-4014-4d1e-8500-560de48b7736 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:50.036529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d33184e5-4014-4d1e-8500-560de48b7736 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:50.036947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d33184e5-4014-4d1e-8500-560de48b7736 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:50.312341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Getting quotas for project 82589beab120404eac2b09ab70b5b9ab. Resources: dict_keys(['metadata_items']) {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:50.319433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Getting quotas for user d19a2a21861641dc9ac061e1a8ba5275 and project 82589beab120404eac2b09ab70b5b9ab. Resources: dict_keys(['metadata_items']) {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:50.352932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:09:50.353415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:09:50.353900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:09:50.354632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:09:50.354940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:09:50.378916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:50.379667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:50.380301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:50.381261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:50.381906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:50.382493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:50.385875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d33184e5-4014-4d1e-8500-560de48b7736 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:50.397014 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d33184e5-4014-4d1e-8500-560de48b7736 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1314 microversion: 2.1 time: 0.376521 Oct 29 01:09:50.397848 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 786/1553] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:50 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:50.413525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-2a8f29c0-240c-4eed-9a35-438f9a9b48e4 req-c0bc29ab-05db-4096-afb4-a19264c154bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165", "name": "network-vif-plugged", "status": "completed", "tag": "88c9a8fd-f03f-4f18-a500-1e29a06ed190"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:50.421386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Getting quotas for project 82589beab120404eac2b09ab70b5b9ab. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:09:50.426975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2a8f29c0-240c-4eed-9a35-438f9a9b48e4 req-c0bc29ab-05db-4096-afb4-a19264c154bc service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:50.427385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2a8f29c0-240c-4eed-9a35-438f9a9b48e4 req-c0bc29ab-05db-4096-afb4-a19264c154bc service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:50.427819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2a8f29c0-240c-4eed-9a35-438f9a9b48e4 req-c0bc29ab-05db-4096-afb4-a19264c154bc service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:50.428733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Getting quotas for user d19a2a21861641dc9ac061e1a8ba5275 and project 82589beab120404eac2b09ab70b5b9ab. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:09:50.433205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:50.454318 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-2a8f29c0-240c-4eed-9a35-438f9a9b48e4 req-c0bc29ab-05db-4096-afb4-a19264c154bc service nova] Creating event network-vif-plugged:88c9a8fd-f03f-4f18-a500-1e29a06ed190 for instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 on n-h2-862964-3 Oct 29 01:09:50.460901 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-2a8f29c0-240c-4eed-9a35-438f9a9b48e4 req-c0bc29ab-05db-4096-afb4-a19264c154bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061765 Oct 29 01:09:50.462266 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 787/1554] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:50.475033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-04e78932-a4fa-49e5-a676-fa1f74d9105c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:50.475745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-04e78932-a4fa-49e5-a676-fa1f74d9105c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:50.482564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04e78932-a4fa-49e5-a676-fa1f74d9105c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:50.483114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04e78932-a4fa-49e5-a676-fa1f74d9105c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:50.483753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04e78932-a4fa-49e5-a676-fa1f74d9105c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:50.484475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04e78932-a4fa-49e5-a676-fa1f74d9105c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:50.484943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04e78932-a4fa-49e5-a676-fa1f74d9105c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:50.485395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04e78932-a4fa-49e5-a676-fa1f74d9105c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:50.503544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:09:50.507800 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='65917370-e712-45cb-a1b6-fed301ebd406',volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:09:50.932336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-04e78932-a4fa-49e5-a676-fa1f74d9105c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:50.942247 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-04e78932-a4fa-49e5-a676-fa1f74d9105c tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1321 microversion: 2.1 time: 0.474797 Oct 29 01:09:50.954431 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 788/1555] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:50 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1321 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:50.966307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-6d0bf90c-bd46-433c-94e7-94d5e3263c92 req-ae9594da-b432-4b64-a008-f7bea6700745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea6c70b8-5b50-4590-9206-59569bc29044", "tag": "e503fc1e-f8db-4750-b6ff-80bdcd5ef7d0"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:50.979195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6d0bf90c-bd46-433c-94e7-94d5e3263c92 req-ae9594da-b432-4b64-a008-f7bea6700745 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:50.979744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6d0bf90c-bd46-433c-94e7-94d5e3263c92 req-ae9594da-b432-4b64-a008-f7bea6700745 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:50.980416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6d0bf90c-bd46-433c-94e7-94d5e3263c92 req-ae9594da-b432-4b64-a008-f7bea6700745 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:50.992167 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-6d0bf90c-bd46-433c-94e7-94d5e3263c92 req-ae9594da-b432-4b64-a008-f7bea6700745 service nova] Creating event network-changed:e503fc1e-f8db-4750-b6ff-80bdcd5ef7d0 for instance ea6c70b8-5b50-4590-9206-59569bc29044 on n-h1-862964-3 Oct 29 01:09:51.000011 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-6d0bf90c-bd46-433c-94e7-94d5e3263c92 req-ae9594da-b432-4b64-a008-f7bea6700745 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036841 Oct 29 01:09:51.000011 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 789/1556] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:51.005453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-66658689-a5d0-4813-ae5e-b49346ef55c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:51.006279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-66658689-a5d0-4813-ae5e-b49346ef55c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:51.012772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66658689-a5d0-4813-ae5e-b49346ef55c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:51.013387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66658689-a5d0-4813-ae5e-b49346ef55c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:51.014001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66658689-a5d0-4813-ae5e-b49346ef55c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:51.015776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66658689-a5d0-4813-ae5e-b49346ef55c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:51.016288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66658689-a5d0-4813-ae5e-b49346ef55c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:51.017564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66658689-a5d0-4813-ae5e-b49346ef55c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:51.158627 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-608ba896-161d-4271-8232-c17d4c5fe63c tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.140279 Oct 29 01:09:51.159634 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 768/1557] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:09:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 2146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:09:51.165634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5e6d618e-2380-4931-8e77-0673ec3ac421 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:51.167732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5e6d618e-2380-4931-8e77-0673ec3ac421 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:51.177381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e6d618e-2380-4931-8e77-0673ec3ac421 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:51.178333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e6d618e-2380-4931-8e77-0673ec3ac421 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:51.179021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e6d618e-2380-4931-8e77-0673ec3ac421 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:51.179997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e6d618e-2380-4931-8e77-0673ec3ac421 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:51.180719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e6d618e-2380-4931-8e77-0673ec3ac421 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:51.181396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e6d618e-2380-4931-8e77-0673ec3ac421 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:51.620109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-66658689-a5d0-4813-ae5e-b49346ef55c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:51.636011 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-66658689-a5d0-4813-ae5e-b49346ef55c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1468 microversion: 2.1 time: 0.633786 Oct 29 01:09:51.665005 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 790/1558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:50 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1468 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:51.665005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8fdfcf25-bb64-49d6-a1aa-e02b5f39e8a1 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:51.665005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8fdfcf25-bb64-49d6-a1aa-e02b5f39e8a1 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:51.733564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5e6d618e-2380-4931-8e77-0673ec3ac421 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:51.738869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:51.745387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5e6d618e-2380-4931-8e77-0673ec3ac421 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:51.747331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5e6d618e-2380-4931-8e77-0673ec3ac421 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:51.748802 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5e6d618e-2380-4931-8e77-0673ec3ac421 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.588209 Oct 29 01:09:51.750003 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 769/1559] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:51 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:51.768834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d131125c-84d5-4979-93c7-22bb743a2dd8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:51.770385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d131125c-84d5-4979-93c7-22bb743a2dd8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:51.777983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8fdfcf25-bb64-49d6-a1aa-e02b5f39e8a1 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:51.779668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d131125c-84d5-4979-93c7-22bb743a2dd8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:51.780593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d131125c-84d5-4979-93c7-22bb743a2dd8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:51.781204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d131125c-84d5-4979-93c7-22bb743a2dd8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:51.782151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d131125c-84d5-4979-93c7-22bb743a2dd8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:51.782830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d131125c-84d5-4979-93c7-22bb743a2dd8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:51.783484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d131125c-84d5-4979-93c7-22bb743a2dd8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:51.796785 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8fdfcf25-bb64-49d6-a1aa-e02b5f39e8a1 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1122 microversion: 2.1 time: 0.146274 Oct 29 01:09:51.809268 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 791/1560] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:51 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1122 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:51.968365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a083650a-1d24-4f48-a561-134452e44ae7 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:51.968994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a083650a-1d24-4f48-a561-134452e44ae7 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:51.983159 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a083650a-1d24-4f48-a561-134452e44ae7 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:51.983650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a083650a-1d24-4f48-a561-134452e44ae7 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:51.984093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a083650a-1d24-4f48-a561-134452e44ae7 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:51.984821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a083650a-1d24-4f48-a561-134452e44ae7 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:51.987385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a083650a-1d24-4f48-a561-134452e44ae7 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:51.987875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a083650a-1d24-4f48-a561-134452e44ae7 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:52.556035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d131125c-84d5-4979-93c7-22bb743a2dd8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:52.564517 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d131125c-84d5-4979-93c7-22bb743a2dd8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1314 microversion: 2.1 time: 0.812738 Oct 29 01:09:52.565113 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 770/1561] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:51 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1314 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:52.674575 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a083650a-1d24-4f48-a561-134452e44ae7 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:52.677633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3c5d38ba-441a-4350-ab60-cf2eb7787b68 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:52.678294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3c5d38ba-441a-4350-ab60-cf2eb7787b68 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:52.685579 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a083650a-1d24-4f48-a561-134452e44ae7 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1321 microversion: 2.1 time: 0.721255 Oct 29 01:09:52.686173 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 792/1562] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:51 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1321 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:52.704087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c5d38ba-441a-4350-ab60-cf2eb7787b68 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:52.704087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c5d38ba-441a-4350-ab60-cf2eb7787b68 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:52.704087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c5d38ba-441a-4350-ab60-cf2eb7787b68 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:52.704087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c5d38ba-441a-4350-ab60-cf2eb7787b68 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:52.704087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c5d38ba-441a-4350-ab60-cf2eb7787b68 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:52.704087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c5d38ba-441a-4350-ab60-cf2eb7787b68 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:52.780035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1103376f-9507-4f51-93f5-f383f0e157bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:52.780845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1103376f-9507-4f51-93f5-f383f0e157bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:52.788209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:52.803474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1103376f-9507-4f51-93f5-f383f0e157bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:52.803973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1103376f-9507-4f51-93f5-f383f0e157bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:52.804408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1103376f-9507-4f51-93f5-f383f0e157bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:52.805120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1103376f-9507-4f51-93f5-f383f0e157bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:52.805596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1103376f-9507-4f51-93f5-f383f0e157bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:52.806014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1103376f-9507-4f51-93f5-f383f0e157bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:53.156876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3c5d38ba-441a-4350-ab60-cf2eb7787b68 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:53.171215 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3c5d38ba-441a-4350-ab60-cf2eb7787b68 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1468 microversion: 2.1 time: 0.502162 Oct 29 01:09:53.172802 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 771/1563] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:52 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1468 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:53.186829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d24c342-4545-4214-bbbd-bb0c3b6f17ee tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:53.188172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7d24c342-4545-4214-bbbd-bb0c3b6f17ee tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:53.196970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d24c342-4545-4214-bbbd-bb0c3b6f17ee tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:53.197938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d24c342-4545-4214-bbbd-bb0c3b6f17ee tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:53.198710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d24c342-4545-4214-bbbd-bb0c3b6f17ee tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:53.200269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d24c342-4545-4214-bbbd-bb0c3b6f17ee tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:53.200999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d24c342-4545-4214-bbbd-bb0c3b6f17ee tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:53.201783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d24c342-4545-4214-bbbd-bb0c3b6f17ee tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:53.272471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1103376f-9507-4f51-93f5-f383f0e157bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:53.309463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7d24c342-4545-4214-bbbd-bb0c3b6f17ee tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:53.314824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1103376f-9507-4f51-93f5-f383f0e157bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:53.317483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1103376f-9507-4f51-93f5-f383f0e157bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:53.318857 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1103376f-9507-4f51-93f5-f383f0e157bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.542928 Oct 29 01:09:53.319903 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 793/1564] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:52 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:53.321737 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7d24c342-4545-4214-bbbd-bb0c3b6f17ee tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1172 microversion: 2.1 time: 0.146853 Oct 29 01:09:53.322934 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 772/1565] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:53 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1172 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:53.592212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1bb40ec0-114a-4e22-ae55-f4b35a99af60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:53.593265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1bb40ec0-114a-4e22-ae55-f4b35a99af60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:53.628661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1bb40ec0-114a-4e22-ae55-f4b35a99af60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:53.632109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1bb40ec0-114a-4e22-ae55-f4b35a99af60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:53.637923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1bb40ec0-114a-4e22-ae55-f4b35a99af60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:53.642298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1bb40ec0-114a-4e22-ae55-f4b35a99af60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:53.643604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1bb40ec0-114a-4e22-ae55-f4b35a99af60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:53.645874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1bb40ec0-114a-4e22-ae55-f4b35a99af60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:53.723187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-628ec82a-603f-4fef-b2e5-9a3dfff574e9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:53.723805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-628ec82a-603f-4fef-b2e5-9a3dfff574e9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:53.736628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-628ec82a-603f-4fef-b2e5-9a3dfff574e9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:53.737410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-628ec82a-603f-4fef-b2e5-9a3dfff574e9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:53.737642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-628ec82a-603f-4fef-b2e5-9a3dfff574e9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:53.739444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-628ec82a-603f-4fef-b2e5-9a3dfff574e9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:53.739928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-628ec82a-603f-4fef-b2e5-9a3dfff574e9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:53.740359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-628ec82a-603f-4fef-b2e5-9a3dfff574e9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:54.011030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1bb40ec0-114a-4e22-ae55-f4b35a99af60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:54.019701 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1bb40ec0-114a-4e22-ae55-f4b35a99af60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1501 microversion: 2.1 time: 0.431978 Oct 29 01:09:54.020232 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 794/1566] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:53 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1501 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:54.036808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-628ec82a-603f-4fef-b2e5-9a3dfff574e9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:54.054094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e9db6d2-a2e5-4bd6-8de2-f6e3388a52b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:54.055127 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-628ec82a-603f-4fef-b2e5-9a3dfff574e9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1321 microversion: 2.1 time: 0.339644 Oct 29 01:09:54.055873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e9db6d2-a2e5-4bd6-8de2-f6e3388a52b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:54.063092 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 773/1567] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:53 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:54.072864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e9db6d2-a2e5-4bd6-8de2-f6e3388a52b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:54.073714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e9db6d2-a2e5-4bd6-8de2-f6e3388a52b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:54.077670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e9db6d2-a2e5-4bd6-8de2-f6e3388a52b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:54.078479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e9db6d2-a2e5-4bd6-8de2-f6e3388a52b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:54.078962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e9db6d2-a2e5-4bd6-8de2-f6e3388a52b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:54.079398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e9db6d2-a2e5-4bd6-8de2-f6e3388a52b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:54.094321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-1fceea73-71ff-4713-b876-0a9a65622549 req-a934f703-10ec-4eb8-bbef-e92f1cd8e8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a19183-c526-47be-95c4-d4c3a9936390", "name": "network-vif-unplugged", "status": "completed", "tag": "1435293b-3554-4c79-9898-f9de315c7829"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:54.117554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1fceea73-71ff-4713-b876-0a9a65622549 req-a934f703-10ec-4eb8-bbef-e92f1cd8e8b8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:54.118259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1fceea73-71ff-4713-b876-0a9a65622549 req-a934f703-10ec-4eb8-bbef-e92f1cd8e8b8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:54.119071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1fceea73-71ff-4713-b876-0a9a65622549 req-a934f703-10ec-4eb8-bbef-e92f1cd8e8b8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:54.134940 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-1fceea73-71ff-4713-b876-0a9a65622549 req-a934f703-10ec-4eb8-bbef-e92f1cd8e8b8 service nova] Creating event network-vif-unplugged:1435293b-3554-4c79-9898-f9de315c7829 for instance 00a19183-c526-47be-95c4-d4c3a9936390 on n-h1-862964-3 Oct 29 01:09:54.141455 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-1fceea73-71ff-4713-b876-0a9a65622549 req-a934f703-10ec-4eb8-bbef-e92f1cd8e8b8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053631 Oct 29 01:09:54.143702 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 774/1568] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:09:54.152694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e9db6d2-a2e5-4bd6-8de2-f6e3388a52b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:09:54.202607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4cfa1ecf-d4fb-433d-984d-b2d851db8d94 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:54.204096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4cfa1ecf-d4fb-433d-984d-b2d851db8d94 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:54.217299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cfa1ecf-d4fb-433d-984d-b2d851db8d94 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:54.218245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cfa1ecf-d4fb-433d-984d-b2d851db8d94 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:54.218959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cfa1ecf-d4fb-433d-984d-b2d851db8d94 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:54.219892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cfa1ecf-d4fb-433d-984d-b2d851db8d94 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:54.222099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cfa1ecf-d4fb-433d-984d-b2d851db8d94 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:54.222804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cfa1ecf-d4fb-433d-984d-b2d851db8d94 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:54.498615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4cfa1ecf-d4fb-433d-984d-b2d851db8d94 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:54.509115 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4cfa1ecf-d4fb-433d-984d-b2d851db8d94 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1534 microversion: 2.1 time: 0.316309 Oct 29 01:09:54.526088 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 775/1569] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:54 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1534 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:54.526088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cdb06658-5812-403c-aad7-2e21d30d4a23 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:54.534274 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8e9db6d2-a2e5-4bd6-8de2-f6e3388a52b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "DELETE /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 204 len: 0 microversion: 2.1 time: 0.487528 Oct 29 01:09:54.536161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cdb06658-5812-403c-aad7-2e21d30d4a23 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:54.540804 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 795/1570] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:09:54 2022] DELETE /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:09:54.547734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cdb06658-5812-403c-aad7-2e21d30d4a23 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:54.548787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cdb06658-5812-403c-aad7-2e21d30d4a23 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:54.549414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cdb06658-5812-403c-aad7-2e21d30d4a23 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:54.550135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cdb06658-5812-403c-aad7-2e21d30d4a23 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:54.550594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cdb06658-5812-403c-aad7-2e21d30d4a23 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:54.551024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cdb06658-5812-403c-aad7-2e21d30d4a23 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:54.557908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d9f97fb6-6d57-48ba-ad4a-b6fff7c480fa tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:54.562004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d9f97fb6-6d57-48ba-ad4a-b6fff7c480fa tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:54.587854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9f97fb6-6d57-48ba-ad4a-b6fff7c480fa tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:54.590034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9f97fb6-6d57-48ba-ad4a-b6fff7c480fa tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:54.591203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9f97fb6-6d57-48ba-ad4a-b6fff7c480fa tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:54.592212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9f97fb6-6d57-48ba-ad4a-b6fff7c480fa tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:54.593597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9f97fb6-6d57-48ba-ad4a-b6fff7c480fa tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:54.594298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9f97fb6-6d57-48ba-ad4a-b6fff7c480fa tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:54.729108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d9f97fb6-6d57-48ba-ad4a-b6fff7c480fa tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:54.744777 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d9f97fb6-6d57-48ba-ad4a-b6fff7c480fa tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1220 microversion: 2.1 time: 0.202245 Oct 29 01:09:54.745834 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 796/1571] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:54 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1220 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:54.755467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c49555c5-64c0-4f67-a7b0-307686d12408 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:54.755963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c49555c5-64c0-4f67-a7b0-307686d12408 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:54.766671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c49555c5-64c0-4f67-a7b0-307686d12408 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:54.767774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c49555c5-64c0-4f67-a7b0-307686d12408 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:54.774955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c49555c5-64c0-4f67-a7b0-307686d12408 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:54.774955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c49555c5-64c0-4f67-a7b0-307686d12408 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:54.774955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c49555c5-64c0-4f67-a7b0-307686d12408 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:54.774955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c49555c5-64c0-4f67-a7b0-307686d12408 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:54.842347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cdb06658-5812-403c-aad7-2e21d30d4a23 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:54.852300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cdb06658-5812-403c-aad7-2e21d30d4a23 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:54.853793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cdb06658-5812-403c-aad7-2e21d30d4a23 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:54.855107 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cdb06658-5812-403c-aad7-2e21d30d4a23 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.344329 Oct 29 01:09:54.855682 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 776/1572] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:54 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:55.088284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c49555c5-64c0-4f67-a7b0-307686d12408 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:55.100201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9b44cabf-a2bb-4397-a6e2-a2dac0f8ccae tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:55.103482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9b44cabf-a2bb-4397-a6e2-a2dac0f8ccae tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:55.114552 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c49555c5-64c0-4f67-a7b0-307686d12408 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1507 microversion: 2.1 time: 0.361217 Oct 29 01:09:55.114552 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 797/1573] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:54 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1507 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:55.117035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b44cabf-a2bb-4397-a6e2-a2dac0f8ccae tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:55.117602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b44cabf-a2bb-4397-a6e2-a2dac0f8ccae tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:55.118044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b44cabf-a2bb-4397-a6e2-a2dac0f8ccae tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:55.118755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b44cabf-a2bb-4397-a6e2-a2dac0f8ccae tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:55.127803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b44cabf-a2bb-4397-a6e2-a2dac0f8ccae tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:55.128128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b44cabf-a2bb-4397-a6e2-a2dac0f8ccae tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:55.298066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9b44cabf-a2bb-4397-a6e2-a2dac0f8ccae tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:55.307042 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9b44cabf-a2bb-4397-a6e2-a2dac0f8ccae tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1321 microversion: 2.1 time: 0.217577 Oct 29 01:09:55.313568 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 777/1574] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:55 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:55.540189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5f1283a9-856a-47ae-ae07-b4529043b38c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:55.540813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5f1283a9-856a-47ae-ae07-b4529043b38c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:55.547860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f1283a9-856a-47ae-ae07-b4529043b38c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:55.548852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f1283a9-856a-47ae-ae07-b4529043b38c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:55.549315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f1283a9-856a-47ae-ae07-b4529043b38c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:55.550030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f1283a9-856a-47ae-ae07-b4529043b38c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:55.551257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f1283a9-856a-47ae-ae07-b4529043b38c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:55.551664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f1283a9-856a-47ae-ae07-b4529043b38c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:55.799509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d73637ae-ea4c-4f24-a51c-b72591db7e27 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:55.803460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d73637ae-ea4c-4f24-a51c-b72591db7e27 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:55.819477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d73637ae-ea4c-4f24-a51c-b72591db7e27 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:55.820551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d73637ae-ea4c-4f24-a51c-b72591db7e27 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:55.821788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d73637ae-ea4c-4f24-a51c-b72591db7e27 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:55.823311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d73637ae-ea4c-4f24-a51c-b72591db7e27 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:55.824636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d73637ae-ea4c-4f24-a51c-b72591db7e27 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:55.825469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d73637ae-ea4c-4f24-a51c-b72591db7e27 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:55.976491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d73637ae-ea4c-4f24-a51c-b72591db7e27 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:55.982786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5f1283a9-856a-47ae-ae07-b4529043b38c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:55.996648 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d73637ae-ea4c-4f24-a51c-b72591db7e27 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1220 microversion: 2.1 time: 0.217013 Oct 29 01:09:55.997274 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 778/1575] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:55 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1220 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:55.998806 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5f1283a9-856a-47ae-ae07-b4529043b38c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1534 microversion: 2.1 time: 0.460190 Oct 29 01:09:56.003612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f91c2a26-b13a-4714-a867-b745e036c39d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:56.004564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f91c2a26-b13a-4714-a867-b745e036c39d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:56.017495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f91c2a26-b13a-4714-a867-b745e036c39d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:56.018305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f91c2a26-b13a-4714-a867-b745e036c39d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:56.018951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f91c2a26-b13a-4714-a867-b745e036c39d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:56.019268 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 798/1576] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:55 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1534 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:56.020182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f91c2a26-b13a-4714-a867-b745e036c39d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:56.020859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f91c2a26-b13a-4714-a867-b745e036c39d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:56.021545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f91c2a26-b13a-4714-a867-b745e036c39d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:56.141283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3ddccc1e-e309-4435-a43c-c538867d1907 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:56.144460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3ddccc1e-e309-4435-a43c-c538867d1907 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:56.177066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ddccc1e-e309-4435-a43c-c538867d1907 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:56.180203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ddccc1e-e309-4435-a43c-c538867d1907 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:56.180203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ddccc1e-e309-4435-a43c-c538867d1907 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:56.183305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ddccc1e-e309-4435-a43c-c538867d1907 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:56.185045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ddccc1e-e309-4435-a43c-c538867d1907 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:56.185968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ddccc1e-e309-4435-a43c-c538867d1907 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:56.786610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f91c2a26-b13a-4714-a867-b745e036c39d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:56.804491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f91c2a26-b13a-4714-a867-b745e036c39d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:56.809098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f91c2a26-b13a-4714-a867-b745e036c39d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:56.810636 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f91c2a26-b13a-4714-a867-b745e036c39d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.812223 Oct 29 01:09:56.813579 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 779/1577] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:55 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:56.819611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-2771d28a-3749-4ec9-a6cf-4aa1d3ee1b0e req-fb3e732e-c1da-49c0-a385-aa1c9ce810c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cedff71-8de0-4fb5-b294-af0c46e7e324", "name": "network-vif-unplugged", "status": "completed", "tag": "fbf748c5-d7b1-45dc-a698-9d558f69324c"}, {"name": "network-changed", "server_uuid": "00a19183-c526-47be-95c4-d4c3a9936390", "tag": "1435293b-3554-4c79-9898-f9de315c7829"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:56.838240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2771d28a-3749-4ec9-a6cf-4aa1d3ee1b0e req-fb3e732e-c1da-49c0-a385-aa1c9ce810c7 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:56.839029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2771d28a-3749-4ec9-a6cf-4aa1d3ee1b0e req-fb3e732e-c1da-49c0-a385-aa1c9ce810c7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:56.849350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2771d28a-3749-4ec9-a6cf-4aa1d3ee1b0e req-fb3e732e-c1da-49c0-a385-aa1c9ce810c7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:56.880411 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-2771d28a-3749-4ec9-a6cf-4aa1d3ee1b0e req-fb3e732e-c1da-49c0-a385-aa1c9ce810c7 service nova] Creating event network-vif-unplugged:fbf748c5-d7b1-45dc-a698-9d558f69324c for instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 on n-h2-862964-3 Oct 29 01:09:56.887201 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-2771d28a-3749-4ec9-a6cf-4aa1d3ee1b0e req-fb3e732e-c1da-49c0-a385-aa1c9ce810c7 service nova] Creating event network-changed:1435293b-3554-4c79-9898-f9de315c7829 for instance 00a19183-c526-47be-95c4-d4c3a9936390 on n-h1-862964-3 Oct 29 01:09:56.896422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [req-2771d28a-3749-4ec9-a6cf-4aa1d3ee1b0e req-fb3e732e-c1da-49c0-a385-aa1c9ce810c7 service nova] Instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121100) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:09:56.940025 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-2771d28a-3749-4ec9-a6cf-4aa1d3ee1b0e req-fb3e732e-c1da-49c0-a385-aa1c9ce810c7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.121932 Oct 29 01:09:56.940835 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 780/1578] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:56.949603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-71211025-acc7-4183-a393-d51c512ab17d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:56.950634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3ddccc1e-e309-4435-a43c-c538867d1907 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:56.951175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-71211025-acc7-4183-a393-d51c512ab17d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:56.961380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71211025-acc7-4183-a393-d51c512ab17d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:56.962180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71211025-acc7-4183-a393-d51c512ab17d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:56.962856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71211025-acc7-4183-a393-d51c512ab17d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:56.963514 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3ddccc1e-e309-4435-a43c-c538867d1907 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1507 microversion: 2.1 time: 0.827142 Oct 29 01:09:56.964005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71211025-acc7-4183-a393-d51c512ab17d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:56.965423 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 799/1579] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:56 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1507 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:56.965553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71211025-acc7-4183-a393-d51c512ab17d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:56.965553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71211025-acc7-4183-a393-d51c512ab17d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:57.021595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-500e8366-abbb-4c50-bc22-b05fc8923016 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:57.022208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-500e8366-abbb-4c50-bc22-b05fc8923016 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:57.029509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-500e8366-abbb-4c50-bc22-b05fc8923016 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:57.038066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-500e8366-abbb-4c50-bc22-b05fc8923016 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:57.039954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-500e8366-abbb-4c50-bc22-b05fc8923016 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:57.041769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-500e8366-abbb-4c50-bc22-b05fc8923016 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:57.044066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-500e8366-abbb-4c50-bc22-b05fc8923016 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:57.044651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-500e8366-abbb-4c50-bc22-b05fc8923016 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:57.407749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-500e8366-abbb-4c50-bc22-b05fc8923016 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:57.420772 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-500e8366-abbb-4c50-bc22-b05fc8923016 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1238 microversion: 2.1 time: 0.403464 Oct 29 01:09:57.421580 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 800/1580] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:57 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1238 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:09:57.430333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0683eac0-608c-49f1-b008-2fa8992c8866 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:57.437459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0683eac0-608c-49f1-b008-2fa8992c8866 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:57.448631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0683eac0-608c-49f1-b008-2fa8992c8866 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:57.449499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0683eac0-608c-49f1-b008-2fa8992c8866 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:57.457837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0683eac0-608c-49f1-b008-2fa8992c8866 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:57.459256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0683eac0-608c-49f1-b008-2fa8992c8866 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:57.459956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0683eac0-608c-49f1-b008-2fa8992c8866 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:57.460603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0683eac0-608c-49f1-b008-2fa8992c8866 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:57.654935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:57.681067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-71211025-acc7-4183-a393-d51c512ab17d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:57.692020 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-71211025-acc7-4183-a393-d51c512ab17d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1321 microversion: 2.1 time: 0.749650 Oct 29 01:09:57.696763 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 781/1581] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:56 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1321 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:57.841798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-09e8d237-5917-4ed6-b9e4-481bb9a99e83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:57.842331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-09e8d237-5917-4ed6-b9e4-481bb9a99e83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:57.854709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-09e8d237-5917-4ed6-b9e4-481bb9a99e83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:57.855500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-09e8d237-5917-4ed6-b9e4-481bb9a99e83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:57.856266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-09e8d237-5917-4ed6-b9e4-481bb9a99e83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:57.857270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-09e8d237-5917-4ed6-b9e4-481bb9a99e83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:57.857897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-09e8d237-5917-4ed6-b9e4-481bb9a99e83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:57.859206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-09e8d237-5917-4ed6-b9e4-481bb9a99e83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:57.962306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0683eac0-608c-49f1-b008-2fa8992c8866 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:57.965866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:09:57.984441 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0683eac0-608c-49f1-b008-2fa8992c8866 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1534 microversion: 2.1 time: 0.561662 Oct 29 01:09:57.985058 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 801/1582] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:57 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1534 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:58.008085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f38a7a1-02f7-4c14-99e1-f2006eda12ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:58.008730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1f38a7a1-02f7-4c14-99e1-f2006eda12ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:58.015616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f38a7a1-02f7-4c14-99e1-f2006eda12ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:58.016670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f38a7a1-02f7-4c14-99e1-f2006eda12ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:58.017357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f38a7a1-02f7-4c14-99e1-f2006eda12ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:58.018042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f38a7a1-02f7-4c14-99e1-f2006eda12ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:58.018512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f38a7a1-02f7-4c14-99e1-f2006eda12ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:58.018950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f38a7a1-02f7-4c14-99e1-f2006eda12ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:58.263188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-09e8d237-5917-4ed6-b9e4-481bb9a99e83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:58.273875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-09e8d237-5917-4ed6-b9e4-481bb9a99e83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:58.275754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-09e8d237-5917-4ed6-b9e4-481bb9a99e83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:58.277235 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-09e8d237-5917-4ed6-b9e4-481bb9a99e83 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.439844 Oct 29 01:09:58.278367 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 782/1583] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:57 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:09:58.413233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1f38a7a1-02f7-4c14-99e1-f2006eda12ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:58.420866 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1f38a7a1-02f7-4c14-99e1-f2006eda12ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1507 microversion: 2.1 time: 0.423390 Oct 29 01:09:58.421613 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 802/1584] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:57 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1507 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:58.463988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0c5de268-3823-4c5b-adf1-4ab18bb82e41 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:58.465361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0c5de268-3823-4c5b-adf1-4ab18bb82e41 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:58.475552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c5de268-3823-4c5b-adf1-4ab18bb82e41 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:58.477087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c5de268-3823-4c5b-adf1-4ab18bb82e41 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:58.478471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c5de268-3823-4c5b-adf1-4ab18bb82e41 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:58.481039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c5de268-3823-4c5b-adf1-4ab18bb82e41 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:58.485264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c5de268-3823-4c5b-adf1-4ab18bb82e41 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:58.486059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c5de268-3823-4c5b-adf1-4ab18bb82e41 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:58.665218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0c5de268-3823-4c5b-adf1-4ab18bb82e41 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:58.682203 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0c5de268-3823-4c5b-adf1-4ab18bb82e41 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1238 microversion: 2.1 time: 0.231606 Oct 29 01:09:58.683498 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 783/1585] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:58 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1238 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:58.745384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-96052b8c-a190-4675-b095-5ca904a60b25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:58.747807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-96052b8c-a190-4675-b095-5ca904a60b25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:58.780993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96052b8c-a190-4675-b095-5ca904a60b25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:58.782293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96052b8c-a190-4675-b095-5ca904a60b25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:58.783569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96052b8c-a190-4675-b095-5ca904a60b25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:58.786320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96052b8c-a190-4675-b095-5ca904a60b25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:58.790046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96052b8c-a190-4675-b095-5ca904a60b25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:58.790532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96052b8c-a190-4675-b095-5ca904a60b25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:59.012805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-38760d25-b4b0-4700-887c-fcc07b600120 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:59.014482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-38760d25-b4b0-4700-887c-fcc07b600120 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:59.026601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38760d25-b4b0-4700-887c-fcc07b600120 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:59.028655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38760d25-b4b0-4700-887c-fcc07b600120 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:59.035339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38760d25-b4b0-4700-887c-fcc07b600120 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:59.036467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38760d25-b4b0-4700-887c-fcc07b600120 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:59.038298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38760d25-b4b0-4700-887c-fcc07b600120 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:59.039928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38760d25-b4b0-4700-887c-fcc07b600120 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:59.256448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-96052b8c-a190-4675-b095-5ca904a60b25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:59.290989 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-96052b8c-a190-4675-b095-5ca904a60b25 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1321 microversion: 2.1 time: 0.569825 Oct 29 01:09:59.294081 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 803/1586] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:58 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1321 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:59.319698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-febfb992-3d67-4ea9-b699-a34579794c99 req-7e2a4a14-0c9a-4f73-8eec-9cd199fcda95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cedff71-8de0-4fb5-b294-af0c46e7e324", "tag": "fbf748c5-d7b1-45dc-a698-9d558f69324c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:09:59.349979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-febfb992-3d67-4ea9-b699-a34579794c99 req-7e2a4a14-0c9a-4f73-8eec-9cd199fcda95 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:59.350513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-febfb992-3d67-4ea9-b699-a34579794c99 req-7e2a4a14-0c9a-4f73-8eec-9cd199fcda95 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:59.350946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-febfb992-3d67-4ea9-b699-a34579794c99 req-7e2a4a14-0c9a-4f73-8eec-9cd199fcda95 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:59.439506 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-febfb992-3d67-4ea9-b699-a34579794c99 req-7e2a4a14-0c9a-4f73-8eec-9cd199fcda95 service nova] Creating event network-changed:fbf748c5-d7b1-45dc-a698-9d558f69324c for instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 on n-h2-862964-3 Oct 29 01:09:59.462382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [req-febfb992-3d67-4ea9-b699-a34579794c99 req-7e2a4a14-0c9a-4f73-8eec-9cd199fcda95 service nova] Instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121099) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:09:59.492104 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-febfb992-3d67-4ea9-b699-a34579794c99 req-7e2a4a14-0c9a-4f73-8eec-9cd199fcda95 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196199 Oct 29 01:09:59.495393 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 804/1587] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:09:59.522080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2eba99fb-ea30-4f53-b989-f1835cdd862f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:59.538032 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2eba99fb-ea30-4f53-b989-f1835cdd862f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:59.576138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2eba99fb-ea30-4f53-b989-f1835cdd862f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:59.576914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2eba99fb-ea30-4f53-b989-f1835cdd862f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:59.581097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2eba99fb-ea30-4f53-b989-f1835cdd862f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:59.584583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2eba99fb-ea30-4f53-b989-f1835cdd862f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:59.602508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2eba99fb-ea30-4f53-b989-f1835cdd862f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:59.603164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2eba99fb-ea30-4f53-b989-f1835cdd862f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:59.732936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-38760d25-b4b0-4700-887c-fcc07b600120 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:09:59.773325 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-38760d25-b4b0-4700-887c-fcc07b600120 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1534 microversion: 2.1 time: 0.765795 Oct 29 01:09:59.777326 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 784/1588] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:59 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1534 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:09:59.784474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5132fbe4-a3a9-4a98-9a49-8051cb4f6ea3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:09:59.785645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5132fbe4-a3a9-4a98-9a49-8051cb4f6ea3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:09:59.806752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5132fbe4-a3a9-4a98-9a49-8051cb4f6ea3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:59.811270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5132fbe4-a3a9-4a98-9a49-8051cb4f6ea3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:59.811974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5132fbe4-a3a9-4a98-9a49-8051cb4f6ea3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:59.812899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5132fbe4-a3a9-4a98-9a49-8051cb4f6ea3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:59.813584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5132fbe4-a3a9-4a98-9a49-8051cb4f6ea3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:59.814283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5132fbe4-a3a9-4a98-9a49-8051cb4f6ea3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:59.900642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5132fbe4-a3a9-4a98-9a49-8051cb4f6ea3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:09:59.901448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5132fbe4-a3a9-4a98-9a49-8051cb4f6ea3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:09:59.903739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5132fbe4-a3a9-4a98-9a49-8051cb4f6ea3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:09:59.904609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-5132fbe4-a3a9-4a98-9a49-8051cb4f6ea3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lazy-loading 'fault' on Instance uuid 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:10:00.015252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5132fbe4-a3a9-4a98-9a49-8051cb4f6ea3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:00.038155 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5132fbe4-a3a9-4a98-9a49-8051cb4f6ea3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1304 microversion: 2.1 time: 0.249488 Oct 29 01:10:00.038849 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 785/1589] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:09:59 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1304 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:00.046316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e2aebf19-9803-46f4-840c-faa65cfc6672 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:00.047180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e2aebf19-9803-46f4-840c-faa65cfc6672 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:00.074783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2aebf19-9803-46f4-840c-faa65cfc6672 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:00.078828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2aebf19-9803-46f4-840c-faa65cfc6672 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:00.080237 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2aebf19-9803-46f4-840c-faa65cfc6672 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:00.081577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2aebf19-9803-46f4-840c-faa65cfc6672 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:00.082216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2aebf19-9803-46f4-840c-faa65cfc6672 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:00.084797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2aebf19-9803-46f4-840c-faa65cfc6672 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:00.260283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e2aebf19-9803-46f4-840c-faa65cfc6672 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:00.271389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2eba99fb-ea30-4f53-b989-f1835cdd862f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:00.276907 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e2aebf19-9803-46f4-840c-faa65cfc6672 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1238 microversion: 2.1 time: 0.235066 Oct 29 01:10:00.277775 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 786/1590] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:00 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1238 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:00.284177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2eba99fb-ea30-4f53-b989-f1835cdd862f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:00.290049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2eba99fb-ea30-4f53-b989-f1835cdd862f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:00.291663 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2eba99fb-ea30-4f53-b989-f1835cdd862f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.790495 Oct 29 01:10:00.294728 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 805/1591] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:09:59 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:10:00.318339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-50cf84a2-3f77-48b2-ac00-2bfb991a32e2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:00.318958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-50cf84a2-3f77-48b2-ac00-2bfb991a32e2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:00.326038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50cf84a2-3f77-48b2-ac00-2bfb991a32e2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:00.326543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50cf84a2-3f77-48b2-ac00-2bfb991a32e2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:00.327084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50cf84a2-3f77-48b2-ac00-2bfb991a32e2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:00.327816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50cf84a2-3f77-48b2-ac00-2bfb991a32e2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:00.328277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50cf84a2-3f77-48b2-ac00-2bfb991a32e2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:00.328710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50cf84a2-3f77-48b2-ac00-2bfb991a32e2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:00.341282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:00.401830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:00.452192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=40 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:00.805736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-abf03761-dab2-4f42-b2f5-ddaca79e13ed tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:00.806921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-abf03761-dab2-4f42-b2f5-ddaca79e13ed tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:00.813956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abf03761-dab2-4f42-b2f5-ddaca79e13ed tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:00.814798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abf03761-dab2-4f42-b2f5-ddaca79e13ed tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:00.815420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abf03761-dab2-4f42-b2f5-ddaca79e13ed tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:00.816318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abf03761-dab2-4f42-b2f5-ddaca79e13ed tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:00.816954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abf03761-dab2-4f42-b2f5-ddaca79e13ed tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:00.817625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abf03761-dab2-4f42-b2f5-ddaca79e13ed tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:01.456353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-50cf84a2-3f77-48b2-ac00-2bfb991a32e2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:01.487207 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-50cf84a2-3f77-48b2-ac00-2bfb991a32e2 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1321 microversion: 2.1 time: 1.172244 Oct 29 01:10:01.490317 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 787/1592] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:00 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1321 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:01.504636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9f08c41e-7f66-4b79-b6a0-175f9debfdba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:01.505603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9f08c41e-7f66-4b79-b6a0-175f9debfdba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:01.522138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f08c41e-7f66-4b79-b6a0-175f9debfdba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:01.522662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f08c41e-7f66-4b79-b6a0-175f9debfdba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:01.525187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f08c41e-7f66-4b79-b6a0-175f9debfdba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:01.526013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f08c41e-7f66-4b79-b6a0-175f9debfdba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:01.526649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f08c41e-7f66-4b79-b6a0-175f9debfdba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:01.528004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f08c41e-7f66-4b79-b6a0-175f9debfdba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:01.631798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f08c41e-7f66-4b79-b6a0-175f9debfdba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:01.632294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f08c41e-7f66-4b79-b6a0-175f9debfdba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:01.635036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f08c41e-7f66-4b79-b6a0-175f9debfdba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:01.639474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-9f08c41e-7f66-4b79-b6a0-175f9debfdba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lazy-loading 'fault' on Instance uuid 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:10:01.784805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=48 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:01.862389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9f08c41e-7f66-4b79-b6a0-175f9debfdba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:01.878755 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9f08c41e-7f66-4b79-b6a0-175f9debfdba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1304 microversion: 2.1 time: 0.386784 Oct 29 01:10:01.892254 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 788/1593] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:01 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1304 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:01.894967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c279b641-2bff-446a-819d-9ac58eef35c3 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:01.899632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c279b641-2bff-446a-819d-9ac58eef35c3 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:01.916451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c279b641-2bff-446a-819d-9ac58eef35c3 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:01.917251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c279b641-2bff-446a-819d-9ac58eef35c3 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:01.917771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c279b641-2bff-446a-819d-9ac58eef35c3 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:01.918568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c279b641-2bff-446a-819d-9ac58eef35c3 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:01.919094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c279b641-2bff-446a-819d-9ac58eef35c3 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:01.920372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c279b641-2bff-446a-819d-9ac58eef35c3 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:02.060421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-abf03761-dab2-4f42-b2f5-ddaca79e13ed tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:02.077019 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-abf03761-dab2-4f42-b2f5-ddaca79e13ed tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1534 microversion: 2.1 time: 1.281778 Oct 29 01:10:02.077629 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 806/1594] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:00 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1534 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:02.083386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6102c5e1-bd8b-43e6-bb65-d9f49f7f3aff tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:02.083993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6102c5e1-bd8b-43e6-bb65-d9f49f7f3aff tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:02.099111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6102c5e1-bd8b-43e6-bb65-d9f49f7f3aff tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:02.099606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6102c5e1-bd8b-43e6-bb65-d9f49f7f3aff tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:02.100037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6102c5e1-bd8b-43e6-bb65-d9f49f7f3aff tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:02.100951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6102c5e1-bd8b-43e6-bb65-d9f49f7f3aff tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:02.105917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6102c5e1-bd8b-43e6-bb65-d9f49f7f3aff tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:02.106375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6102c5e1-bd8b-43e6-bb65-d9f49f7f3aff tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:02.406638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c279b641-2bff-446a-819d-9ac58eef35c3 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:02.417700 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c279b641-2bff-446a-819d-9ac58eef35c3 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1305 microversion: 2.1 time: 0.535399 Oct 29 01:10:02.445818 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 789/1595] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:01 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1305 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:02.451446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-72a88b5e-ab1a-411b-99cb-397146f06eee req-1114f0ce-f271-4090-807b-014f23b139ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea6c70b8-5b50-4590-9206-59569bc29044", "name": "network-vif-plugged", "status": "completed", "tag": "e503fc1e-f8db-4750-b6ff-80bdcd5ef7d0"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:02.463023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-72a88b5e-ab1a-411b-99cb-397146f06eee req-1114f0ce-f271-4090-807b-014f23b139ea service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:02.464300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-72a88b5e-ab1a-411b-99cb-397146f06eee req-1114f0ce-f271-4090-807b-014f23b139ea service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:02.465116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-72a88b5e-ab1a-411b-99cb-397146f06eee req-1114f0ce-f271-4090-807b-014f23b139ea service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:02.480537 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-72a88b5e-ab1a-411b-99cb-397146f06eee req-1114f0ce-f271-4090-807b-014f23b139ea service nova] Creating event network-vif-plugged:e503fc1e-f8db-4750-b6ff-80bdcd5ef7d0 for instance ea6c70b8-5b50-4590-9206-59569bc29044 on n-h1-862964-3 Oct 29 01:10:02.486750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6102c5e1-bd8b-43e6-bb65-d9f49f7f3aff tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:02.487762 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-72a88b5e-ab1a-411b-99cb-397146f06eee req-1114f0ce-f271-4090-807b-014f23b139ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040321 Oct 29 01:10:02.489012 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 790/1596] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:02.499375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6102c5e1-bd8b-43e6-bb65-d9f49f7f3aff tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:02.510130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6102c5e1-bd8b-43e6-bb65-d9f49f7f3aff tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:02.510130 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6102c5e1-bd8b-43e6-bb65-d9f49f7f3aff tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.424536 Oct 29 01:10:02.510130 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 807/1597] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:10:02 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:10:02.521026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-da773a62-bbb0-4f3d-8be1-5d53fddb35a0 req-9ccd4cff-b47d-4523-9dc6-0ad5dbf1248c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165", "name": "network-vif-deleted", "tag": "88c9a8fd-f03f-4f18-a500-1e29a06ed190"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:02.579296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-da773a62-bbb0-4f3d-8be1-5d53fddb35a0 req-9ccd4cff-b47d-4523-9dc6-0ad5dbf1248c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:02.582622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-da773a62-bbb0-4f3d-8be1-5d53fddb35a0 req-9ccd4cff-b47d-4523-9dc6-0ad5dbf1248c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:02.583386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-da773a62-bbb0-4f3d-8be1-5d53fddb35a0 req-9ccd4cff-b47d-4523-9dc6-0ad5dbf1248c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:02.614911 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-da773a62-bbb0-4f3d-8be1-5d53fddb35a0 req-9ccd4cff-b47d-4523-9dc6-0ad5dbf1248c service nova] Creating event network-vif-deleted:88c9a8fd-f03f-4f18-a500-1e29a06ed190 for instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 on n-h2-862964-3 Oct 29 01:10:02.622368 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-da773a62-bbb0-4f3d-8be1-5d53fddb35a0 req-9ccd4cff-b47d-4523-9dc6-0ad5dbf1248c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122602 Oct 29 01:10:02.623639 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 791/1598] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:02.633338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3f3909a2-9633-40b7-9bb7-806472026f1f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:02.634600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3f3909a2-9633-40b7-9bb7-806472026f1f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:02.643034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f3909a2-9633-40b7-9bb7-806472026f1f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:02.643869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f3909a2-9633-40b7-9bb7-806472026f1f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:02.644537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f3909a2-9633-40b7-9bb7-806472026f1f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:02.645694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f3909a2-9633-40b7-9bb7-806472026f1f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:02.646390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f3909a2-9633-40b7-9bb7-806472026f1f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:02.647037 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f3909a2-9633-40b7-9bb7-806472026f1f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:02.723577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dee074d0-7c19-4697-b185-0920071d608a tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Action: 'create', calling method: .version_select at 0x7f9d97758280>, body: {"keypair": {"name": "tempest-keypair-1753689404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgTXs/IXbfdxpgLoHiFeUBoVdpVikkkDIrLhboOfK5hx1CTveNAv3zQjhH2JhKUkFVrxRXlxWuBx5JyaxhD8Ow1xUBS11+YYjGKQZX/cNV8gD/nI7Kuvh1JM1CFv47F5Q=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:02.740404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-dee074d0-7c19-4697-b185-0920071d608a tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Getting quotas for project fc8aa4c99cd74817bd2d771e07b55ddb. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:10:02.746433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-dee074d0-7c19-4697-b185-0920071d608a tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Getting quotas for user 485e22dee25b4eb7b1f726a5915c1dbe and project fc8aa4c99cd74817bd2d771e07b55ddb. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:10:02.829118 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dee074d0-7c19-4697-b185-0920071d608a tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.324218 Oct 29 01:10:02.831014 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 808/1599] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:10:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:02.868178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3f3909a2-9633-40b7-9bb7-806472026f1f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:02.877619 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3f3909a2-9633-40b7-9bb7-806472026f1f tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1321 microversion: 2.1 time: 0.252282 Oct 29 01:10:02.878508 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 792/1600] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:02 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:02.907699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c106c28f-7f21-498d-8199-6f64e5de9659 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:02.908689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c106c28f-7f21-498d-8199-6f64e5de9659 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:02.916478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c106c28f-7f21-498d-8199-6f64e5de9659 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:02.916983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c106c28f-7f21-498d-8199-6f64e5de9659 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:02.917454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c106c28f-7f21-498d-8199-6f64e5de9659 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:02.918459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c106c28f-7f21-498d-8199-6f64e5de9659 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:02.919107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c106c28f-7f21-498d-8199-6f64e5de9659 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:02.919702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c106c28f-7f21-498d-8199-6f64e5de9659 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:03.030942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c106c28f-7f21-498d-8199-6f64e5de9659 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:03.035297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c106c28f-7f21-498d-8199-6f64e5de9659 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:03.035979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c106c28f-7f21-498d-8199-6f64e5de9659 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:03.036629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-c106c28f-7f21-498d-8199-6f64e5de9659 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lazy-loading 'fault' on Instance uuid 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:10:03.105205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1a0e98c3-1339-4663-9c2b-be9d09974722 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:03.107146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1a0e98c3-1339-4663-9c2b-be9d09974722 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:03.119172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a0e98c3-1339-4663-9c2b-be9d09974722 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:03.119693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a0e98c3-1339-4663-9c2b-be9d09974722 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:03.120401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a0e98c3-1339-4663-9c2b-be9d09974722 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:03.121167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a0e98c3-1339-4663-9c2b-be9d09974722 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:03.124492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a0e98c3-1339-4663-9c2b-be9d09974722 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:03.125189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a0e98c3-1339-4663-9c2b-be9d09974722 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:03.163534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c106c28f-7f21-498d-8199-6f64e5de9659 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:03.176644 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c106c28f-7f21-498d-8199-6f64e5de9659 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 200 len: 1304 microversion: 2.1 time: 0.272810 Oct 29 01:10:03.193718 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 809/1601] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:02 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 1304 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:03.374932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1a0e98c3-1339-4663-9c2b-be9d09974722 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:03.390272 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1a0e98c3-1339-4663-9c2b-be9d09974722 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1534 microversion: 2.1 time: 0.285690 Oct 29 01:10:03.390272 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 793/1602] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:03 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1534 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:10:03.451953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e9699b82-8e31-461a-88b3-9f6f6ce50ee9 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:03.452721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e9699b82-8e31-461a-88b3-9f6f6ce50ee9 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:03.459185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9699b82-8e31-461a-88b3-9f6f6ce50ee9 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:03.459889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9699b82-8e31-461a-88b3-9f6f6ce50ee9 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:03.460507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9699b82-8e31-461a-88b3-9f6f6ce50ee9 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:03.461401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9699b82-8e31-461a-88b3-9f6f6ce50ee9 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:03.462042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9699b82-8e31-461a-88b3-9f6f6ce50ee9 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:03.462791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9699b82-8e31-461a-88b3-9f6f6ce50ee9 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:03.536611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aca53446-d9fe-4b6c-9f3b-a527d8191f7e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:03.537392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aca53446-d9fe-4b6c-9f3b-a527d8191f7e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:03.553984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aca53446-d9fe-4b6c-9f3b-a527d8191f7e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:03.554650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aca53446-d9fe-4b6c-9f3b-a527d8191f7e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:03.555190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aca53446-d9fe-4b6c-9f3b-a527d8191f7e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:03.556067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aca53446-d9fe-4b6c-9f3b-a527d8191f7e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:03.556648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aca53446-d9fe-4b6c-9f3b-a527d8191f7e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:03.557193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aca53446-d9fe-4b6c-9f3b-a527d8191f7e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:03.973138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aca53446-d9fe-4b6c-9f3b-a527d8191f7e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:03.990124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aca53446-d9fe-4b6c-9f3b-a527d8191f7e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:03.996097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aca53446-d9fe-4b6c-9f3b-a527d8191f7e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:03.998000 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aca53446-d9fe-4b6c-9f3b-a527d8191f7e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.468308 Oct 29 01:10:04.002634 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 794/1603] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:10:03 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:10:04.017942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-114d403e-3571-4573-aa47-a90435b88b3d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:04.018882 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-114d403e-3571-4573-aa47-a90435b88b3d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:04.031011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-114d403e-3571-4573-aa47-a90435b88b3d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:04.031939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-114d403e-3571-4573-aa47-a90435b88b3d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:04.039994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-114d403e-3571-4573-aa47-a90435b88b3d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:04.039994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-114d403e-3571-4573-aa47-a90435b88b3d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:04.046627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-114d403e-3571-4573-aa47-a90435b88b3d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:04.047546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-114d403e-3571-4573-aa47-a90435b88b3d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:04.054054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e9699b82-8e31-461a-88b3-9f6f6ce50ee9 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:04.065114 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e9699b82-8e31-461a-88b3-9f6f6ce50ee9 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1305 microversion: 2.1 time: 0.616879 Oct 29 01:10:04.075795 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 810/1604] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:03 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1305 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:04.204125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6140e294-dd48-4e8a-b44a-12eb864038c1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:04.205022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6140e294-dd48-4e8a-b44a-12eb864038c1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:04.215946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6140e294-dd48-4e8a-b44a-12eb864038c1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:04.217764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6140e294-dd48-4e8a-b44a-12eb864038c1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:04.231419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6140e294-dd48-4e8a-b44a-12eb864038c1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:04.238942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6140e294-dd48-4e8a-b44a-12eb864038c1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:04.240433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6140e294-dd48-4e8a-b44a-12eb864038c1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:04.243356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6140e294-dd48-4e8a-b44a-12eb864038c1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:04.302380 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-6140e294-dd48-4e8a-b44a-12eb864038c1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 could not be found. Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6140e294-dd48-4e8a-b44a-12eb864038c1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 HTTP/1.1 Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 could not be found. Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165'} Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 could not be found. Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 could not be found. Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:04.307416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:04.311982 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:04.311982 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:04.311982 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:04.311982 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:10:04.311982 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:10:04.311982 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 could not be found. Oct 29 01:10:04.311982 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:04.325389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6140e294-dd48-4e8a-b44a-12eb864038c1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:04.325389 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6140e294-dd48-4e8a-b44a-12eb864038c1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 404 len: 111 microversion: 2.1 time: 0.116459 Oct 29 01:10:04.328362 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 811/1605] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:04 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:10:04.410141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-29f19c40-7c59-4f04-8d07-294080ac3f11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:04.410772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-29f19c40-7c59-4f04-8d07-294080ac3f11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:04.418828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f19c40-7c59-4f04-8d07-294080ac3f11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:04.419325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f19c40-7c59-4f04-8d07-294080ac3f11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:04.419767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f19c40-7c59-4f04-8d07-294080ac3f11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:04.420470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f19c40-7c59-4f04-8d07-294080ac3f11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:04.420925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f19c40-7c59-4f04-8d07-294080ac3f11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:04.421412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f19c40-7c59-4f04-8d07-294080ac3f11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:04.750066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-114d403e-3571-4573-aa47-a90435b88b3d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:04.762409 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-114d403e-3571-4573-aa47-a90435b88b3d tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1321 microversion: 2.1 time: 0.758058 Oct 29 01:10:04.782065 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 795/1606] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:04 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1321 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:04.794393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d1495bec-8d5a-41df-a079-d38382837e08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-672456677", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "95eff624-38bf-46e7-958c-9fcb3dae19f9"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:04.944302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-d1495bec-8d5a-41df-a079-d38382837e08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] validate_networks() for [('95eff624-38bf-46e7-958c-9fcb3dae19f9', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:10:05.016105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-29f19c40-7c59-4f04-8d07-294080ac3f11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:05.077549 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-29f19c40-7c59-4f04-8d07-294080ac3f11 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1534 microversion: 2.1 time: 0.670971 Oct 29 01:10:05.078786 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 812/1607] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:04 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1534 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:05.297330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-efa63e24-5b08-4d03-b96d-a83f4ede2cfe tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:05.297943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-efa63e24-5b08-4d03-b96d-a83f4ede2cfe tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:05.316970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efa63e24-5b08-4d03-b96d-a83f4ede2cfe tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:05.317739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efa63e24-5b08-4d03-b96d-a83f4ede2cfe tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:05.318195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efa63e24-5b08-4d03-b96d-a83f4ede2cfe tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:05.318944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efa63e24-5b08-4d03-b96d-a83f4ede2cfe tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:05.327320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efa63e24-5b08-4d03-b96d-a83f4ede2cfe tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:05.328458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efa63e24-5b08-4d03-b96d-a83f4ede2cfe tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:05.997594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-efa63e24-5b08-4d03-b96d-a83f4ede2cfe tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:06.026531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-efa63e24-5b08-4d03-b96d-a83f4ede2cfe tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:06.028189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-efa63e24-5b08-4d03-b96d-a83f4ede2cfe tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:06.029861 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-efa63e24-5b08-4d03-b96d-a83f4ede2cfe tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.948869 Oct 29 01:10:06.041451 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 813/1608] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:10:05 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:10:06.064952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1ed0b33d-b5f2-4f5f-b8f8-71aa085f82fc tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:06.065982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1ed0b33d-b5f2-4f5f-b8f8-71aa085f82fc tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:06.084542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ed0b33d-b5f2-4f5f-b8f8-71aa085f82fc tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:06.085967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ed0b33d-b5f2-4f5f-b8f8-71aa085f82fc tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:06.096569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ed0b33d-b5f2-4f5f-b8f8-71aa085f82fc tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:06.099345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ed0b33d-b5f2-4f5f-b8f8-71aa085f82fc tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:06.103095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ed0b33d-b5f2-4f5f-b8f8-71aa085f82fc tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:06.104675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ed0b33d-b5f2-4f5f-b8f8-71aa085f82fc tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:07.045471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d1495bec-8d5a-41df-a079-d38382837e08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:10:07.046549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d1495bec-8d5a-41df-a079-d38382837e08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:10:07.047242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d1495bec-8d5a-41df-a079-d38382837e08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:10:07.047907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d1495bec-8d5a-41df-a079-d38382837e08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:10:07.048760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d1495bec-8d5a-41df-a079-d38382837e08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:10:07.068563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d1495bec-8d5a-41df-a079-d38382837e08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:07.086099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d1495bec-8d5a-41df-a079-d38382837e08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:07.086760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d1495bec-8d5a-41df-a079-d38382837e08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:07.087908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d1495bec-8d5a-41df-a079-d38382837e08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:07.088565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d1495bec-8d5a-41df-a079-d38382837e08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:07.089241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d1495bec-8d5a-41df-a079-d38382837e08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:07.116977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ed0b33d-b5f2-4f5f-b8f8-71aa085f82fc tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:07.129194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-d1495bec-8d5a-41df-a079-d38382837e08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Getting quotas for project f421c64f9b2f49ebab46d9f8a28143d6. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:10:07.129967 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1ed0b33d-b5f2-4f5f-b8f8-71aa085f82fc tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1305 microversion: 2.1 time: 1.087270 Oct 29 01:10:07.132005 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 814/1609] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:06 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1305 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:07.138808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-d1495bec-8d5a-41df-a079-d38382837e08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Getting quotas for user 4ae0a54f51ad4813b312baf3a03ba172 and project f421c64f9b2f49ebab46d9f8a28143d6. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:10:07.150723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3ce82086-20d0-4ef6-a461-7a41c60a9200 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:07.151608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3ce82086-20d0-4ef6-a461-7a41c60a9200 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:07.174462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d1495bec-8d5a-41df-a079-d38382837e08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:10:07.174462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d1495bec-8d5a-41df-a079-d38382837e08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:10:07.177891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ce82086-20d0-4ef6-a461-7a41c60a9200 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:07.182004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ce82086-20d0-4ef6-a461-7a41c60a9200 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:07.183689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ce82086-20d0-4ef6-a461-7a41c60a9200 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:07.184619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ce82086-20d0-4ef6-a461-7a41c60a9200 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:07.186272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ce82086-20d0-4ef6-a461-7a41c60a9200 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:07.188413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ce82086-20d0-4ef6-a461-7a41c60a9200 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:07.312065 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d1495bec-8d5a-41df-a079-d38382837e08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.527183 Oct 29 01:10:07.314053 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 796/1610] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:10:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:10:07.322119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-e6a555f4-77af-4cd6-9cfc-1f5e9ad42ef5 req-8ed864e0-457b-4519-91b6-3a1558988e73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "043b00d6-d708-4cee-a1dc-d8ca4ddcae90", "tag": "ca5d4535-1bd9-43b8-8e8d-1d33f9053107"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:07.353291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e6a555f4-77af-4cd6-9cfc-1f5e9ad42ef5 req-8ed864e0-457b-4519-91b6-3a1558988e73 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:07.354031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e6a555f4-77af-4cd6-9cfc-1f5e9ad42ef5 req-8ed864e0-457b-4519-91b6-3a1558988e73 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:07.354653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e6a555f4-77af-4cd6-9cfc-1f5e9ad42ef5 req-8ed864e0-457b-4519-91b6-3a1558988e73 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:07.378774 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-e6a555f4-77af-4cd6-9cfc-1f5e9ad42ef5 req-8ed864e0-457b-4519-91b6-3a1558988e73 service nova] Creating event network-changed:ca5d4535-1bd9-43b8-8e8d-1d33f9053107 for instance 043b00d6-d708-4cee-a1dc-d8ca4ddcae90 on n-h2-862964-3 Oct 29 01:10:07.395963 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-e6a555f4-77af-4cd6-9cfc-1f5e9ad42ef5 req-8ed864e0-457b-4519-91b6-3a1558988e73 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079377 Oct 29 01:10:07.397282 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 797/1611] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:07.402631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aa5fe03c-7231-4808-8a69-822e9a5dac6a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:07.409928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aa5fe03c-7231-4808-8a69-822e9a5dac6a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:07.427400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa5fe03c-7231-4808-8a69-822e9a5dac6a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:07.428241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa5fe03c-7231-4808-8a69-822e9a5dac6a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:07.428868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa5fe03c-7231-4808-8a69-822e9a5dac6a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:07.429812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa5fe03c-7231-4808-8a69-822e9a5dac6a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:07.430444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa5fe03c-7231-4808-8a69-822e9a5dac6a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:07.431044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa5fe03c-7231-4808-8a69-822e9a5dac6a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:07.651661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3ce82086-20d0-4ef6-a461-7a41c60a9200 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:07.677664 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3ce82086-20d0-4ef6-a461-7a41c60a9200 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1470 microversion: 2.1 time: 0.533058 Oct 29 01:10:07.677664 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 815/1612] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:07 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1470 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:07.681437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6e5224b4-bb15-45be-a25c-de0e851e174d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:07.682883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6e5224b4-bb15-45be-a25c-de0e851e174d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:07.702312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e5224b4-bb15-45be-a25c-de0e851e174d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:07.702814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e5224b4-bb15-45be-a25c-de0e851e174d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:07.703573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e5224b4-bb15-45be-a25c-de0e851e174d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:07.704251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e5224b4-bb15-45be-a25c-de0e851e174d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:07.709402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e5224b4-bb15-45be-a25c-de0e851e174d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:07.710181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e5224b4-bb15-45be-a25c-de0e851e174d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:07.854605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aa5fe03c-7231-4808-8a69-822e9a5dac6a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:07.867556 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aa5fe03c-7231-4808-8a69-822e9a5dac6a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1527 microversion: 2.1 time: 0.468661 Oct 29 01:10:07.869297 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 798/1613] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:07 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1527 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:07.878479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-16dd49ca-d93b-43e9-8e34-fa5deca5143d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:07.879160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-16dd49ca-d93b-43e9-8e34-fa5deca5143d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:07.954853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-16dd49ca-d93b-43e9-8e34-fa5deca5143d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:07.962882 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-16dd49ca-d93b-43e9-8e34-fa5deca5143d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1214 microversion: 2.1 time: 0.091909 Oct 29 01:10:07.963893 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 799/1614] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:07 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:07.969074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1cae6c62-eef7-449a-bb3e-f311598d248d tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:07.969651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1cae6c62-eef7-449a-bb3e-f311598d248d tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:07.977881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cae6c62-eef7-449a-bb3e-f311598d248d tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:07.978376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cae6c62-eef7-449a-bb3e-f311598d248d tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:07.978815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cae6c62-eef7-449a-bb3e-f311598d248d tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:07.979528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cae6c62-eef7-449a-bb3e-f311598d248d tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:07.980006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cae6c62-eef7-449a-bb3e-f311598d248d tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:07.980625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cae6c62-eef7-449a-bb3e-f311598d248d tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:07.980755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6e5224b4-bb15-45be-a25c-de0e851e174d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:08.021479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6e5224b4-bb15-45be-a25c-de0e851e174d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:08.023067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6e5224b4-bb15-45be-a25c-de0e851e174d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:08.041630 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6e5224b4-bb15-45be-a25c-de0e851e174d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.355157 Oct 29 01:10:08.042284 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 816/1615] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:10:07 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:10:08.047922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-603412305", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "c1dfc056-0982-4a5d-a724-f0f93a09337a"}], "security_groups": [{"name": "tempest-securitygroup--1072343873"}], "key_name": "tempest-keypair-1753689404", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:08.054426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-1cae6c62-eef7-449a-bb3e-f311598d248d tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Lazy-loading 'flavor' on Instance uuid ea6c70b8-5b50-4590-9206-59569bc29044 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:10:08.274528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] validate_networks() for [('c1dfc056-0982-4a5d-a724-f0f93a09337a', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:10:08.405952 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1cae6c62-eef7-449a-bb3e-f311598d248d tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044/action" status: 202 len: 0 microversion: 2.1 time: 0.437801 Oct 29 01:10:08.405952 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 800/1616] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:10:07 2022] POST /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:10:08.417479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-93395324-3f4f-4b94-914f-238602a2330b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:08.422279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-93395324-3f4f-4b94-914f-238602a2330b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:08.439657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93395324-3f4f-4b94-914f-238602a2330b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:08.440183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93395324-3f4f-4b94-914f-238602a2330b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:08.440625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93395324-3f4f-4b94-914f-238602a2330b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:08.444296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93395324-3f4f-4b94-914f-238602a2330b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:08.444844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93395324-3f4f-4b94-914f-238602a2330b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:08.447043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93395324-3f4f-4b94-914f-238602a2330b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:08.853953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-93395324-3f4f-4b94-914f-238602a2330b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:08.862758 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-93395324-3f4f-4b94-914f-238602a2330b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1527 microversion: 2.1 time: 0.457115 Oct 29 01:10:08.863345 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 801/1617] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:08 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1527 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:08.868294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-64f7ff15-acc7-4543-a436-c54dff72a2e0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:08.868915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-64f7ff15-acc7-4543-a436-c54dff72a2e0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:08.874949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64f7ff15-acc7-4543-a436-c54dff72a2e0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:08.875441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64f7ff15-acc7-4543-a436-c54dff72a2e0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:08.883727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64f7ff15-acc7-4543-a436-c54dff72a2e0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:08.883727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64f7ff15-acc7-4543-a436-c54dff72a2e0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:08.883727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64f7ff15-acc7-4543-a436-c54dff72a2e0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:08.883727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64f7ff15-acc7-4543-a436-c54dff72a2e0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:09.137531 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-64f7ff15-acc7-4543-a436-c54dff72a2e0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:09.145336 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-64f7ff15-acc7-4543-a436-c54dff72a2e0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1293 microversion: 2.1 time: 0.280686 Oct 29 01:10:09.151064 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 802/1618] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:08 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1293 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:09.155703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a0b1ef43-e35b-4232-8f18-671f9217512e tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:09.156319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a0b1ef43-e35b-4232-8f18-671f9217512e tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:09.169109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0b1ef43-e35b-4232-8f18-671f9217512e tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:09.171769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0b1ef43-e35b-4232-8f18-671f9217512e tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:09.174541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0b1ef43-e35b-4232-8f18-671f9217512e tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:09.175389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0b1ef43-e35b-4232-8f18-671f9217512e tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:09.176373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0b1ef43-e35b-4232-8f18-671f9217512e tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:09.177007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0b1ef43-e35b-4232-8f18-671f9217512e tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:09.189500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Getting quotas for project fc8aa4c99cd74817bd2d771e07b55ddb. Resources: dict_keys(['metadata_items']) {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:10:09.195650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Getting quotas for user 485e22dee25b4eb7b1f726a5915c1dbe and project fc8aa4c99cd74817bd2d771e07b55ddb. Resources: dict_keys(['metadata_items']) {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:10:09.209392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:10:09.210117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:10:09.210758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:10:09.211325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:10:09.211972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:10:09.228778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:09.229353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:09.230158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:09.231699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:09.232281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:09.233021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:09.255280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Getting quotas for project fc8aa4c99cd74817bd2d771e07b55ddb. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:10:09.261546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Getting quotas for user 485e22dee25b4eb7b1f726a5915c1dbe and project fc8aa4c99cd74817bd2d771e07b55ddb. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:10:09.283517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:10:09.286889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:10:09.420145 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e53ba80f-48db-4673-86ae-ca806f55d54e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.376740 Oct 29 01:10:09.420849 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 817/1619] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:10:08 2022] POST /compute/v2.1/servers => generated 407 bytes in 1378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:10:09.427663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-8c0daa3b-17ef-4fd8-81c7-39bc3a01e7d3 req-94899111-8b34-4030-ab80-5f705db96575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cedff71-8de0-4fb5-b294-af0c46e7e324", "name": "network-vif-plugged", "status": "completed", "tag": "fbf748c5-d7b1-45dc-a698-9d558f69324c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:09.447966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8c0daa3b-17ef-4fd8-81c7-39bc3a01e7d3 req-94899111-8b34-4030-ab80-5f705db96575 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:09.448880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8c0daa3b-17ef-4fd8-81c7-39bc3a01e7d3 req-94899111-8b34-4030-ab80-5f705db96575 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:09.449949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8c0daa3b-17ef-4fd8-81c7-39bc3a01e7d3 req-94899111-8b34-4030-ab80-5f705db96575 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:09.481826 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-8c0daa3b-17ef-4fd8-81c7-39bc3a01e7d3 req-94899111-8b34-4030-ab80-5f705db96575 service nova] Creating event network-vif-plugged:fbf748c5-d7b1-45dc-a698-9d558f69324c for instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 on n-h2-862964-3 Oct 29 01:10:09.501781 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-8c0daa3b-17ef-4fd8-81c7-39bc3a01e7d3 req-94899111-8b34-4030-ab80-5f705db96575 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078302 Oct 29 01:10:09.503722 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 818/1620] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:09.523638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-23925d81-7486-4241-a5a2-925161c971b4 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:09.539989 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-23925d81-7486-4241-a5a2-925161c971b4 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] HTTP exception thrown: Flavor 96ff1bc9-8f29-4ce5-a655-891fcb9e939a could not be found. Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-23925d81-7486-4241-a5a2-925161c971b4 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Request method failure captured: Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/flavors/96ff1bc9-8f29-4ce5-a655-891fcb9e939a HTTP/1.1 Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHx6C7RNyyNedPhE9nCqZ-V1EtF2mqTBhq5QLRU6-JLGvW6d42oiv1HbV77_A5jFaOEoDV39rE-22gFxhH_QC7zACbXJddQjaFmNwveju3Xo0eUBYv5b3vLOBCLTnbFl8oRYt0rbyDe9kWW4vr9yin-HPsgv3KaAkcayooz4lEhuwD4 Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 7e269112846c4a24a4b95af97ad0a362 Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-MigrationsAdminTest-563220540 Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e269112846c4a24a4b95af97ad0a362"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7e269112846c4a24a4b95af97ad0a362"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e269112846c4a24a4b95af97ad0a362"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7e269112846c4a24a4b95af97ad0a362", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-MigrationsAdminTest-563220540 Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 7e269112846c4a24a4b95af97ad0a362 Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-MigrationsAdminTest-563220540 Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-MigrationsAdminTest-563220540-project-admin Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 697b41dede9e4b13bee4388eeea17e69 Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-MigrationsAdminTest-563220540-project-admin Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: exception: Flavor 96ff1bc9-8f29-4ce5-a655-891fcb9e939a could not be found. Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '96ff1bc9-8f29-4ce5-a655-891fcb9e939a'} Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 96ff1bc9-8f29-4ce5-a655-891fcb9e939a could not be found. Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 96ff1bc9-8f29-4ce5-a655-891fcb9e939a could not be found. Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:09.550194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:09.562865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:09.562865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:09.562865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:09.562865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:09.562865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:10:09.562865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:10:09.562865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 96ff1bc9-8f29-4ce5-a655-891fcb9e939a could not be found. Oct 29 01:10:09.562865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:09.562865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-23925d81-7486-4241-a5a2-925161c971b4 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Returning 404 to user: Flavor 96ff1bc9-8f29-4ce5-a655-891fcb9e939a could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:09.562865 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-23925d81-7486-4241-a5a2-925161c971b4 tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/96ff1bc9-8f29-4ce5-a655-891fcb9e939a" status: 404 len: 109 microversion: 2.1 time: 0.042222 Oct 29 01:10:09.562865 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 819/1621] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:10:09 2022] DELETE /compute/v2.1/flavors/96ff1bc9-8f29-4ce5-a655-891fcb9e939a => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:10:09.565474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-63f53e01-c036-4a4c-885e-ad3e807c331f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:09.565927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-63f53e01-c036-4a4c-885e-ad3e807c331f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:09.600017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63f53e01-c036-4a4c-885e-ad3e807c331f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:09.601845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63f53e01-c036-4a4c-885e-ad3e807c331f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:09.605367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63f53e01-c036-4a4c-885e-ad3e807c331f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:09.607436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63f53e01-c036-4a4c-885e-ad3e807c331f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:09.609492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63f53e01-c036-4a4c-885e-ad3e807c331f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:09.616107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63f53e01-c036-4a4c-885e-ad3e807c331f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:09.635582 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a0b1ef43-e35b-4232-8f18-671f9217512e tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1629 microversion: 2.1 time: 0.482460 Oct 29 01:10:09.637262 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 803/1622] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:09 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1629 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:09.643696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f12cc7f4-13e9-401b-89a8-4749c582c74c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:09.644574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f12cc7f4-13e9-401b-89a8-4749c582c74c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:09.651555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f12cc7f4-13e9-401b-89a8-4749c582c74c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:09.652248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f12cc7f4-13e9-401b-89a8-4749c582c74c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:09.653481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f12cc7f4-13e9-401b-89a8-4749c582c74c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:09.655157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f12cc7f4-13e9-401b-89a8-4749c582c74c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:09.655157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f12cc7f4-13e9-401b-89a8-4749c582c74c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:09.655540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f12cc7f4-13e9-401b-89a8-4749c582c74c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:09.760165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-63f53e01-c036-4a4c-885e-ad3e807c331f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:09.798603 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-63f53e01-c036-4a4c-885e-ad3e807c331f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1266 microversion: 2.1 time: 0.244692 Oct 29 01:10:09.799233 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 820/1623] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:09 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:09.807121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ba319c81-53f6-46cd-a3c7-be7841b01226 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:09.807738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ba319c81-53f6-46cd-a3c7-be7841b01226 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:09.840005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:09.934550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ba319c81-53f6-46cd-a3c7-be7841b01226 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:09.943059 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ba319c81-53f6-46cd-a3c7-be7841b01226 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1269 microversion: 2.1 time: 0.142767 Oct 29 01:10:09.946098 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 821/1624] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:09 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1269 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:09.954867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fc5d841e-0cf5-4526-8997-208859e51083 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2025513622", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:09.971846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f12cc7f4-13e9-401b-89a8-4749c582c74c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:09.984943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f12cc7f4-13e9-401b-89a8-4749c582c74c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:09.987221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f12cc7f4-13e9-401b-89a8-4749c582c74c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:09.988794 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f12cc7f4-13e9-401b-89a8-4749c582c74c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.350325 Oct 29 01:10:10.002225 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 804/1625] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:10:09 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:10:10.053568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-fc5d841e-0cf5-4526-8997-208859e51083 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] validate_networks() for None {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:10:10.178167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-faee0f98-730e-4714-9543-8fd30b1db82d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:10.181548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-faee0f98-730e-4714-9543-8fd30b1db82d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:10.185082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:10.194079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faee0f98-730e-4714-9543-8fd30b1db82d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:10.194704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faee0f98-730e-4714-9543-8fd30b1db82d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:10.195339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faee0f98-730e-4714-9543-8fd30b1db82d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:10.202266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faee0f98-730e-4714-9543-8fd30b1db82d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:10.202266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faee0f98-730e-4714-9543-8fd30b1db82d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:10.202266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faee0f98-730e-4714-9543-8fd30b1db82d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:10.227733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:10.400275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-fc5d841e-0cf5-4526-8997-208859e51083 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:10:10.401987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-fc5d841e-0cf5-4526-8997-208859e51083 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:10:10.402992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-fc5d841e-0cf5-4526-8997-208859e51083 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:10:10.403829 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-fc5d841e-0cf5-4526-8997-208859e51083 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:10:10.404455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-fc5d841e-0cf5-4526-8997-208859e51083 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:10:10.417868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc5d841e-0cf5-4526-8997-208859e51083 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:10.418737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc5d841e-0cf5-4526-8997-208859e51083 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:10.419843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc5d841e-0cf5-4526-8997-208859e51083 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:10.420935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc5d841e-0cf5-4526-8997-208859e51083 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:10.422006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc5d841e-0cf5-4526-8997-208859e51083 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:10.424170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc5d841e-0cf5-4526-8997-208859e51083 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:10.448825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-fc5d841e-0cf5-4526-8997-208859e51083 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Getting quotas for project 646dbadc4e9140348132e6950c885e81. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:10:10.458264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-fc5d841e-0cf5-4526-8997-208859e51083 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Getting quotas for user 8219d81b19964408b9bc275a4457f389 and project 646dbadc4e9140348132e6950c885e81. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:10:10.474862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-faee0f98-730e-4714-9543-8fd30b1db82d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:10.483290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fc5d841e-0cf5-4526-8997-208859e51083 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:10:10.483879 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-faee0f98-730e-4714-9543-8fd30b1db82d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1293 microversion: 2.1 time: 0.312809 Oct 29 01:10:10.486360 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 805/1626] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:10 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1293 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:10:10.488056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fc5d841e-0cf5-4526-8997-208859e51083 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:10:10.651212 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fc5d841e-0cf5-4526-8997-208859e51083 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.703933 Oct 29 01:10:10.654214 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 822/1627] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:10:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:10:10.666487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-461a3104-6150-4160-b465-28e2388fd99a tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:10.667389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-461a3104-6150-4160-b465-28e2388fd99a tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:10.679237 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-461a3104-6150-4160-b465-28e2388fd99a tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:10.681131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-461a3104-6150-4160-b465-28e2388fd99a tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:10.682395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-461a3104-6150-4160-b465-28e2388fd99a tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:10.683031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-38e8a028-77d9-4a37-9727-6326cbebf144 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:10.683509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-461a3104-6150-4160-b465-28e2388fd99a tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:10.684439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-461a3104-6150-4160-b465-28e2388fd99a tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:10.684784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-38e8a028-77d9-4a37-9727-6326cbebf144 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:10.685495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-461a3104-6150-4160-b465-28e2388fd99a tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:10.775037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-38e8a028-77d9-4a37-9727-6326cbebf144 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:10.805529 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-38e8a028-77d9-4a37-9727-6326cbebf144 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1213 microversion: 2.1 time: 0.121306 Oct 29 01:10:10.805529 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 823/1628] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:10 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1213 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:10.825703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-407133de-2428-468f-b6fb-3cb5a10ec558 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:10.826334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-407133de-2428-468f-b6fb-3cb5a10ec558 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:10.842995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-407133de-2428-468f-b6fb-3cb5a10ec558 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:10.843504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-407133de-2428-468f-b6fb-3cb5a10ec558 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:10.843950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-407133de-2428-468f-b6fb-3cb5a10ec558 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:10.844670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-407133de-2428-468f-b6fb-3cb5a10ec558 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:10.850870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-407133de-2428-468f-b6fb-3cb5a10ec558 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:10.851391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-407133de-2428-468f-b6fb-3cb5a10ec558 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:10.980156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-407133de-2428-468f-b6fb-3cb5a10ec558 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:10.989746 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-407133de-2428-468f-b6fb-3cb5a10ec558 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1274 microversion: 2.1 time: 0.169627 Oct 29 01:10:10.997322 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 824/1629] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:10 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:10:11.023781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4980120b-9a1c-426b-ae00-2372fe79829b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:11.024418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4980120b-9a1c-426b-ae00-2372fe79829b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:11.053892 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-461a3104-6150-4160-b465-28e2388fd99a tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1612 microversion: 2.1 time: 0.391958 Oct 29 01:10:11.056155 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 806/1630] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:10 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1612 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:11.068381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c7de8083-3aff-479d-9ad6-8769eae39871 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:11.069014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c7de8083-3aff-479d-9ad6-8769eae39871 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:11.089501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7de8083-3aff-479d-9ad6-8769eae39871 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:11.090463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7de8083-3aff-479d-9ad6-8769eae39871 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:11.091095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7de8083-3aff-479d-9ad6-8769eae39871 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:11.093142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7de8083-3aff-479d-9ad6-8769eae39871 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:11.093805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7de8083-3aff-479d-9ad6-8769eae39871 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:11.095156 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7de8083-3aff-479d-9ad6-8769eae39871 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:11.101582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4980120b-9a1c-426b-ae00-2372fe79829b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:11.113663 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4980120b-9a1c-426b-ae00-2372fe79829b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1269 microversion: 2.1 time: 0.113717 Oct 29 01:10:11.114266 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 825/1631] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:10 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1269 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:11.136564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81fa2049-cc16-4154-8f56-b537de971f21 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:11.137148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-81fa2049-cc16-4154-8f56-b537de971f21 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:11.145481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81fa2049-cc16-4154-8f56-b537de971f21 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:11.146019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81fa2049-cc16-4154-8f56-b537de971f21 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:11.146407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81fa2049-cc16-4154-8f56-b537de971f21 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:11.147119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81fa2049-cc16-4154-8f56-b537de971f21 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:11.148046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81fa2049-cc16-4154-8f56-b537de971f21 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:11.148046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81fa2049-cc16-4154-8f56-b537de971f21 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:11.190234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:11.239428 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-81fa2049-cc16-4154-8f56-b537de971f21 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] HTTP exception thrown: Cannot 'migrate' instance ea6c70b8-5b50-4590-9206-59569bc29044 while it is in vm_state suspended Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81fa2049-cc16-4154-8f56-b537de971f21 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Request method failure captured: Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044/action HTTP/1.1 Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 15 Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH030j18nY1CM7C3q95P5Ku0vulVs7KQTS1F8WE0COJee9ptUd-IvSJ5zFWWR6KmhQ6AlhE4zHTK6ejtnndnD7q6WSArxYdEaK-kWwf51aDiFtvc76xBiS1jB_Rych7pVWg4o64eHNStI0QcQjaYRjsy3CKzlnnw83BCmVcWdaJ0xEM Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 3ba9ad0d9c8b469fb0b7e976a0919a0a Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-38403394 Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ba9ad0d9c8b469fb0b7e976a0919a0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3ba9ad0d9c8b469fb0b7e976a0919a0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ba9ad0d9c8b469fb0b7e976a0919a0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3ba9ad0d9c8b469fb0b7e976a0919a0a", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersAdminNegativeTestJSON-38403394 Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 3ba9ad0d9c8b469fb0b7e976a0919a0a Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-38403394 Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersAdminNegativeTestJSON-38403394-project-admin Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 83eeeee84728497d95781b5a9a41ed59 Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersAdminNegativeTestJSON-38403394-project-admin Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: {"migrate": {}} Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: exception: Cannot 'migrate' instance ea6c70b8-5b50-4590-9206-59569bc29044 while it is in vm_state suspended Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'ea6c70b8-5b50-4590-9206-59569bc29044', 'body': {'migrate': {}}} Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ea6c70b8-5b50-4590-9206-59569bc29044 in vm_state suspended. Cannot resize while the instance is in this state. Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:10:11.241064 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 29 01:10:11.246493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 01:10:11.246493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 01:10:11.246493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 01:10:11.246493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance ea6c70b8-5b50-4590-9206-59569bc29044 while it is in vm_state suspended Oct 29 01:10:11.246493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.246493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:11.246493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.246493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:11.246493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:11.246493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:11.246493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:10:11.246493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:10:11.246493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance ea6c70b8-5b50-4590-9206-59569bc29044 while it is in vm_state suspended Oct 29 01:10:11.246493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.246493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81fa2049-cc16-4154-8f56-b537de971f21 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Returning 409 to user: Cannot 'migrate' instance ea6c70b8-5b50-4590-9206-59569bc29044 while it is in vm_state suspended {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:11.246493 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-81fa2049-cc16-4154-8f56-b537de971f21 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044/action" status: 409 len: 148 microversion: 2.1 time: 0.111314 Oct 29 01:10:11.246493 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 826/1632] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:10:11 2022] POST /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044/action => generated 148 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:10:11.268254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-70996deb-db96-4b91-ad18-5ee98da3727b tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-70996deb-db96-4b91-ad18-5ee98da3727b tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Request method failure captured: Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7/action HTTP/1.1 Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 39 Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH030j18nY1CM7C3q95P5Ku0vulVs7KQTS1F8WE0COJee9ptUd-IvSJ5zFWWR6KmhQ6AlhE4zHTK6ejtnndnD7q6WSArxYdEaK-kWwf51aDiFtvc76xBiS1jB_Rych7pVWg4o64eHNStI0QcQjaYRjsy3CKzlnnw83BCmVcWdaJ0xEM Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 3ba9ad0d9c8b469fb0b7e976a0919a0a Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-38403394 Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ba9ad0d9c8b469fb0b7e976a0919a0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3ba9ad0d9c8b469fb0b7e976a0919a0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ba9ad0d9c8b469fb0b7e976a0919a0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3ba9ad0d9c8b469fb0b7e976a0919a0a", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersAdminNegativeTestJSON-38403394 Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 3ba9ad0d9c8b469fb0b7e976a0919a0a Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-38403394 Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersAdminNegativeTestJSON-38403394-project-admin Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 83eeeee84728497d95781b5a9a41ed59 Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersAdminNegativeTestJSON-38403394-project-admin Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: {"os-resetState": {"state": "invalid"}} Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'd6ecee3f-2172-4154-9f8a-6365257b44e7', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'invalid' Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:10:11.276924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:10:11.282829 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 29 01:10:11.282829 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.282829 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:11.282829 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.282829 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:11.282829 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:11.282829 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:11.282829 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:10:11.282829 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:10:11.282829 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 29 01:10:11.282829 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.286621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-70996deb-db96-4b91-ad18-5ee98da3727b tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:11.300696 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-70996deb-db96-4b91-ad18-5ee98da3727b tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7/action" status: 400 len: 144 microversion: 2.1 time: 0.030953 Oct 29 01:10:11.303987 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 827/1633] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:10:11 2022] POST /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7/action => generated 144 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:10:11.320893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3b22588a-aaa4-4425-afae-d66722c7fa33 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3b22588a-aaa4-4425-afae-d66722c7fa33 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Request method failure captured: Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7/action HTTP/1.1 Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 31 Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH030j18nY1CM7C3q95P5Ku0vulVs7KQTS1F8WE0COJee9ptUd-IvSJ5zFWWR6KmhQ6AlhE4zHTK6ejtnndnD7q6WSArxYdEaK-kWwf51aDiFtvc76xBiS1jB_Rych7pVWg4o64eHNStI0QcQjaYRjsy3CKzlnnw83BCmVcWdaJ0xEM Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 3ba9ad0d9c8b469fb0b7e976a0919a0a Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-38403394 Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ba9ad0d9c8b469fb0b7e976a0919a0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3ba9ad0d9c8b469fb0b7e976a0919a0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ba9ad0d9c8b469fb0b7e976a0919a0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3ba9ad0d9c8b469fb0b7e976a0919a0a", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersAdminNegativeTestJSON-38403394 Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 3ba9ad0d9c8b469fb0b7e976a0919a0a Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-38403394 Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersAdminNegativeTestJSON-38403394-project-admin Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 83eeeee84728497d95781b5a9a41ed59 Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersAdminNegativeTestJSON-38403394-project-admin Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: {"os-resetState": {"state": 1}} Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'd6ecee3f-2172-4154-9f8a-6365257b44e7', 'body': {'os-resetState': {'state': 1}}} Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 1 Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 29 01:10:11.328426 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.334939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:11.334939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.334939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:11.334939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:11.334939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:11.334939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:10:11.334939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:10:11.334939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 29 01:10:11.334939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.338937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3b22588a-aaa4-4425-afae-d66722c7fa33 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:11.338937 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3b22588a-aaa4-4425-afae-d66722c7fa33 tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7/action" status: 400 len: 120 microversion: 2.1 time: 0.027069 Oct 29 01:10:11.352754 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 828/1634] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:10:11 2022] POST /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7/action => generated 120 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:10:11.363413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fc64b96f-34b1-4b5c-ae4b-66a72a1363dc tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:11.378537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fc64b96f-34b1-4b5c-ae4b-66a72a1363dc tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Failed to fetch instance by id 999 {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 01:10:11.379211 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-fc64b96f-34b1-4b5c-ae4b-66a72a1363dc tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fc64b96f-34b1-4b5c-ae4b-66a72a1363dc tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Request method failure captured: Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 37 Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH030j18nY1CM7C3q95P5Ku0vulVs7KQTS1F8WE0COJee9ptUd-IvSJ5zFWWR6KmhQ6AlhE4zHTK6ejtnndnD7q6WSArxYdEaK-kWwf51aDiFtvc76xBiS1jB_Rych7pVWg4o64eHNStI0QcQjaYRjsy3CKzlnnw83BCmVcWdaJ0xEM Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 3ba9ad0d9c8b469fb0b7e976a0919a0a Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-38403394 Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ba9ad0d9c8b469fb0b7e976a0919a0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3ba9ad0d9c8b469fb0b7e976a0919a0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ba9ad0d9c8b469fb0b7e976a0919a0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3ba9ad0d9c8b469fb0b7e976a0919a0a", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersAdminNegativeTestJSON-38403394 Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 3ba9ad0d9c8b469fb0b7e976a0919a0a Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-38403394 Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersAdminNegativeTestJSON-38403394-project-admin Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 83eeeee84728497d95781b5a9a41ed59 Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersAdminNegativeTestJSON-38403394-project-admin Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: {"os-resetState": {"state": "error"}} Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 999 could not be found. Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:11.388025 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:10:11.393881 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:10:11.393881 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 29 01:10:11.393881 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:11.393881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fc64b96f-34b1-4b5c-ae4b-66a72a1363dc tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:11.393881 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fc64b96f-34b1-4b5c-ae4b-66a72a1363dc tempest-ServersAdminNegativeTestJSON-38403394 tempest-ServersAdminNegativeTestJSON-38403394-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.030298 Oct 29 01:10:11.393881 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 829/1635] 10.222.0.26 () {60 vars in 1179 bytes} [Sat Oct 29 01:10:11 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:10:11.405508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e3ec07aa-d0f3-4047-9016-fd31aa8574f9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:11.406783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e3ec07aa-d0f3-4047-9016-fd31aa8574f9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:11.415351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c7de8083-3aff-479d-9ad6-8769eae39871 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:11.415863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3ec07aa-d0f3-4047-9016-fd31aa8574f9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:11.416062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3ec07aa-d0f3-4047-9016-fd31aa8574f9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:11.416713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3ec07aa-d0f3-4047-9016-fd31aa8574f9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:11.417466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3ec07aa-d0f3-4047-9016-fd31aa8574f9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:11.417937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3ec07aa-d0f3-4047-9016-fd31aa8574f9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:11.418382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3ec07aa-d0f3-4047-9016-fd31aa8574f9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:11.424873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c7de8083-3aff-479d-9ad6-8769eae39871 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:11.426408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c7de8083-3aff-479d-9ad6-8769eae39871 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:11.427519 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c7de8083-3aff-479d-9ad6-8769eae39871 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.370405 Oct 29 01:10:11.428678 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 807/1636] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:10:11 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:10:11.451062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e3ec07aa-d0f3-4047-9016-fd31aa8574f9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:10:11.518491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c3b5d34-9c55-4554-bcaa-1a23724a3523 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:11.519321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9c3b5d34-9c55-4554-bcaa-1a23724a3523 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:11.525642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c3b5d34-9c55-4554-bcaa-1a23724a3523 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:11.530054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c3b5d34-9c55-4554-bcaa-1a23724a3523 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:11.530870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c3b5d34-9c55-4554-bcaa-1a23724a3523 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:11.534927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c3b5d34-9c55-4554-bcaa-1a23724a3523 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:11.535413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c3b5d34-9c55-4554-bcaa-1a23724a3523 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:11.535905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c3b5d34-9c55-4554-bcaa-1a23724a3523 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:11.750038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9c3b5d34-9c55-4554-bcaa-1a23724a3523 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:11.759653 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9c3b5d34-9c55-4554-bcaa-1a23724a3523 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1293 microversion: 2.1 time: 0.251489 Oct 29 01:10:11.769782 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 808/1637] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:11 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1293 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:11.831330 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e3ec07aa-d0f3-4047-9016-fd31aa8574f9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 204 len: 0 microversion: 2.1 time: 0.434034 Oct 29 01:10:11.835391 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 830/1638] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:10:11 2022] DELETE /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:10:11.837292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-477a8d70-e1c7-4280-b06b-1360a37c5bb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:11.837956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-477a8d70-e1c7-4280-b06b-1360a37c5bb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:11.842288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7bb9cc4c-963f-4372-bc69-c99868e0c74e tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:11.843004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7bb9cc4c-963f-4372-bc69-c99868e0c74e tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:11.847687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-477a8d70-e1c7-4280-b06b-1360a37c5bb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:11.848316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-477a8d70-e1c7-4280-b06b-1360a37c5bb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:11.849700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-477a8d70-e1c7-4280-b06b-1360a37c5bb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:11.850157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bb9cc4c-963f-4372-bc69-c99868e0c74e tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:11.850457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-477a8d70-e1c7-4280-b06b-1360a37c5bb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:11.850649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bb9cc4c-963f-4372-bc69-c99868e0c74e tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:11.851014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-477a8d70-e1c7-4280-b06b-1360a37c5bb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:11.851216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bb9cc4c-963f-4372-bc69-c99868e0c74e tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:11.851774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bb9cc4c-963f-4372-bc69-c99868e0c74e tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:11.852564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-477a8d70-e1c7-4280-b06b-1360a37c5bb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:11.852701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bb9cc4c-963f-4372-bc69-c99868e0c74e tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:11.855183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bb9cc4c-963f-4372-bc69-c99868e0c74e tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:11.977878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-477a8d70-e1c7-4280-b06b-1360a37c5bb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:11.989799 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-477a8d70-e1c7-4280-b06b-1360a37c5bb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1217 microversion: 2.1 time: 0.161414 Oct 29 01:10:11.991207 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 809/1639] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:11 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:12.016267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-12b4e675-221c-4215-9320-df62f7448e03 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:12.017487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-12b4e675-221c-4215-9320-df62f7448e03 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:12.023996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12b4e675-221c-4215-9320-df62f7448e03 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:12.024476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12b4e675-221c-4215-9320-df62f7448e03 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:12.025392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12b4e675-221c-4215-9320-df62f7448e03 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:12.026101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12b4e675-221c-4215-9320-df62f7448e03 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:12.026730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12b4e675-221c-4215-9320-df62f7448e03 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:12.027148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12b4e675-221c-4215-9320-df62f7448e03 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:12.083545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7bb9cc4c-963f-4372-bc69-c99868e0c74e tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:12.096561 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7bb9cc4c-963f-4372-bc69-c99868e0c74e tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1467 microversion: 2.1 time: 0.258286 Oct 29 01:10:12.111515 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 831/1640] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:11 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1467 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:12.115051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-12b4e675-221c-4215-9320-df62f7448e03 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:12.128700 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-12b4e675-221c-4215-9320-df62f7448e03 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1272 microversion: 2.1 time: 0.117054 Oct 29 01:10:12.129785 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 810/1641] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:12 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1272 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:10:12.149317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8a753fda-571f-4164-a038-1470de7f177e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:12.150069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8a753fda-571f-4164-a038-1470de7f177e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:12.156202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a753fda-571f-4164-a038-1470de7f177e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:12.156690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a753fda-571f-4164-a038-1470de7f177e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:12.157133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a753fda-571f-4164-a038-1470de7f177e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:12.159123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a753fda-571f-4164-a038-1470de7f177e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:12.159123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a753fda-571f-4164-a038-1470de7f177e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:12.159349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a753fda-571f-4164-a038-1470de7f177e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:12.238159 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8a753fda-571f-4164-a038-1470de7f177e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:12.247447 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8a753fda-571f-4164-a038-1470de7f177e tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1321 microversion: 2.1 time: 0.115315 Oct 29 01:10:12.248084 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 832/1642] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:12 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1321 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:12.457445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-77d92e68-b345-446b-97a9-6d6c2d7c1004 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:12.458938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-77d92e68-b345-446b-97a9-6d6c2d7c1004 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:12.469136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77d92e68-b345-446b-97a9-6d6c2d7c1004 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:12.469647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77d92e68-b345-446b-97a9-6d6c2d7c1004 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:12.471058 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77d92e68-b345-446b-97a9-6d6c2d7c1004 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:12.472062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77d92e68-b345-446b-97a9-6d6c2d7c1004 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:12.472529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77d92e68-b345-446b-97a9-6d6c2d7c1004 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:12.472956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77d92e68-b345-446b-97a9-6d6c2d7c1004 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:12.650732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-77d92e68-b345-446b-97a9-6d6c2d7c1004 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:12.665319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-77d92e68-b345-446b-97a9-6d6c2d7c1004 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:12.667035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-77d92e68-b345-446b-97a9-6d6c2d7c1004 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:12.668431 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-77d92e68-b345-446b-97a9-6d6c2d7c1004 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1813 microversion: 2.25 time: 0.217195 Oct 29 01:10:12.669720 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 811/1643] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:10:12 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1813 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:10:12.787759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8a0ca532-1eb7-4925-b865-fa3428829e1a tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:12.788265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8a0ca532-1eb7-4925-b865-fa3428829e1a tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:12.795423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a0ca532-1eb7-4925-b865-fa3428829e1a tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:12.795961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a0ca532-1eb7-4925-b865-fa3428829e1a tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:12.796403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a0ca532-1eb7-4925-b865-fa3428829e1a tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:12.797292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a0ca532-1eb7-4925-b865-fa3428829e1a tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:12.797751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a0ca532-1eb7-4925-b865-fa3428829e1a tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:12.798424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a0ca532-1eb7-4925-b865-fa3428829e1a tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:12.934546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8a0ca532-1eb7-4925-b865-fa3428829e1a tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:12.943791 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8a0ca532-1eb7-4925-b865-fa3428829e1a tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1293 microversion: 2.1 time: 0.162146 Oct 29 01:10:12.947619 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 833/1644] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:12 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1293 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:13.013702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e537a817-5ea0-4f59-bf12-7e68928d60d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:13.014184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e537a817-5ea0-4f59-bf12-7e68928d60d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:13.021258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e537a817-5ea0-4f59-bf12-7e68928d60d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:13.022281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e537a817-5ea0-4f59-bf12-7e68928d60d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:13.023151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e537a817-5ea0-4f59-bf12-7e68928d60d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:13.024308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e537a817-5ea0-4f59-bf12-7e68928d60d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:13.024880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e537a817-5ea0-4f59-bf12-7e68928d60d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:13.026534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e537a817-5ea0-4f59-bf12-7e68928d60d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:13.098870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e537a817-5ea0-4f59-bf12-7e68928d60d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:13.107942 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e537a817-5ea0-4f59-bf12-7e68928d60d1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1209 microversion: 2.1 time: 0.098357 Oct 29 01:10:13.108693 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 812/1645] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:13 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:13.125010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1161482f-c116-4e67-8f57-da08cdf8e8f4 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:13.125866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1161482f-c116-4e67-8f57-da08cdf8e8f4 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:13.142273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1161482f-c116-4e67-8f57-da08cdf8e8f4 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:13.143288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1161482f-c116-4e67-8f57-da08cdf8e8f4 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:13.143735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1161482f-c116-4e67-8f57-da08cdf8e8f4 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:13.144458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1161482f-c116-4e67-8f57-da08cdf8e8f4 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:13.144920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1161482f-c116-4e67-8f57-da08cdf8e8f4 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:13.145380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1161482f-c116-4e67-8f57-da08cdf8e8f4 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:13.154453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-45393436-78fe-4d00-90f7-ee86c40887a6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:13.155694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-45393436-78fe-4d00-90f7-ee86c40887a6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:13.163507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45393436-78fe-4d00-90f7-ee86c40887a6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:13.163998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45393436-78fe-4d00-90f7-ee86c40887a6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:13.164686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45393436-78fe-4d00-90f7-ee86c40887a6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:13.165453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45393436-78fe-4d00-90f7-ee86c40887a6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:13.165952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45393436-78fe-4d00-90f7-ee86c40887a6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:13.166377 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45393436-78fe-4d00-90f7-ee86c40887a6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:13.364572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1161482f-c116-4e67-8f57-da08cdf8e8f4 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:13.386672 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1161482f-c116-4e67-8f57-da08cdf8e8f4 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1467 microversion: 2.1 time: 0.266412 Oct 29 01:10:13.404639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-45393436-78fe-4d00-90f7-ee86c40887a6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:13.404875 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 834/1646] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:13 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1467 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:13.414177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b7e86bc-e6fa-4b7b-be16-13d7504e14c2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:13.415657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7b7e86bc-e6fa-4b7b-be16-13d7504e14c2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:13.415808 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-45393436-78fe-4d00-90f7-ee86c40887a6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1314 microversion: 2.1 time: 0.265337 Oct 29 01:10:13.428627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b7e86bc-e6fa-4b7b-be16-13d7504e14c2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:13.429489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b7e86bc-e6fa-4b7b-be16-13d7504e14c2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:13.432091 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 813/1647] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:13 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:10:13.437496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b7e86bc-e6fa-4b7b-be16-13d7504e14c2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:13.438349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b7e86bc-e6fa-4b7b-be16-13d7504e14c2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:13.438982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b7e86bc-e6fa-4b7b-be16-13d7504e14c2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:13.439416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b7e86bc-e6fa-4b7b-be16-13d7504e14c2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:13.510045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7b7e86bc-e6fa-4b7b-be16-13d7504e14c2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:13.523355 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7b7e86bc-e6fa-4b7b-be16-13d7504e14c2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1339 microversion: 2.1 time: 0.116820 Oct 29 01:10:13.524130 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 835/1648] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:13 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1339 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:13.698433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6aa24c09-d7ba-44c5-8c14-dbbf5f52b108 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:13.699256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6aa24c09-d7ba-44c5-8c14-dbbf5f52b108 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:13.708791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6aa24c09-d7ba-44c5-8c14-dbbf5f52b108 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:13.709982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6aa24c09-d7ba-44c5-8c14-dbbf5f52b108 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:13.710756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6aa24c09-d7ba-44c5-8c14-dbbf5f52b108 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:13.718392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6aa24c09-d7ba-44c5-8c14-dbbf5f52b108 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:13.719572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6aa24c09-d7ba-44c5-8c14-dbbf5f52b108 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:13.720760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6aa24c09-d7ba-44c5-8c14-dbbf5f52b108 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:13.963011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6aa24c09-d7ba-44c5-8c14-dbbf5f52b108 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:13.971685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c8e45e48-0852-4f2f-9c85-8cef62fd75ce tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:13.972964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c8e45e48-0852-4f2f-9c85-8cef62fd75ce tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:13.981415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6aa24c09-d7ba-44c5-8c14-dbbf5f52b108 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:13.981415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6aa24c09-d7ba-44c5-8c14-dbbf5f52b108 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:13.981415 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6aa24c09-d7ba-44c5-8c14-dbbf5f52b108 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1803 microversion: 2.25 time: 0.288566 Oct 29 01:10:13.981986 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 814/1649] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:10:13 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1803 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:10:13.983755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8e45e48-0852-4f2f-9c85-8cef62fd75ce tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:13.985406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8e45e48-0852-4f2f-9c85-8cef62fd75ce tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:13.986880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8e45e48-0852-4f2f-9c85-8cef62fd75ce tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:13.988566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8e45e48-0852-4f2f-9c85-8cef62fd75ce tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:13.989307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8e45e48-0852-4f2f-9c85-8cef62fd75ce tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:13.989970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8e45e48-0852-4f2f-9c85-8cef62fd75ce tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:14.007244 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-753d2418-5073-4754-81fc-d241f09e8a1d tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '.version_select at 0x7f9d97c52e50>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:14.011721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-753d2418-5073-4754-81fc-d241f09e8a1d tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:14.012335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-753d2418-5073-4754-81fc-d241f09e8a1d tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:14.013033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-753d2418-5073-4754-81fc-d241f09e8a1d tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:14.029629 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-753d2418-5073-4754-81fc-d241f09e8a1d tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 3625 microversion: 2.25 time: 0.025857 Oct 29 01:10:14.030798 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 815/1650] 10.222.0.26 () {60 vars in 1184 bytes} [Sat Oct 29 01:10:14 2022] GET /compute/v2.1/os-migrations => generated 3625 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:10:14.049792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8360c595-e640-4584-a9a0-ad1135c2872d tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:14.050948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8360c595-e640-4584-a9a0-ad1135c2872d tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:14.057305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8360c595-e640-4584-a9a0-ad1135c2872d tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:14.058415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8360c595-e640-4584-a9a0-ad1135c2872d tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:14.058929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8360c595-e640-4584-a9a0-ad1135c2872d tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:14.059754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8360c595-e640-4584-a9a0-ad1135c2872d tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:14.060508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8360c595-e640-4584-a9a0-ad1135c2872d tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:14.061010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8360c595-e640-4584-a9a0-ad1135c2872d tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:14.265533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c8e45e48-0852-4f2f-9c85-8cef62fd75ce tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:14.275638 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c8e45e48-0852-4f2f-9c85-8cef62fd75ce tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1293 microversion: 2.1 time: 0.312207 Oct 29 01:10:14.287479 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 836/1651] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:13 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1293 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:14.303942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-8360c595-e640-4584-a9a0-ad1135c2872d tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'services' on Instance uuid 00a19183-c526-47be-95c4-d4c3a9936390 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:10:14.304057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6bcce72a-dfb0-4959-9050-689021d5adda tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:14.304057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6bcce72a-dfb0-4959-9050-689021d5adda tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:14.309572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6bcce72a-dfb0-4959-9050-689021d5adda tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:14.310063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6bcce72a-dfb0-4959-9050-689021d5adda tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:14.310755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6bcce72a-dfb0-4959-9050-689021d5adda tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:14.311470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6bcce72a-dfb0-4959-9050-689021d5adda tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:14.311916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6bcce72a-dfb0-4959-9050-689021d5adda tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:14.312522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6bcce72a-dfb0-4959-9050-689021d5adda tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:14.316624 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8360c595-e640-4584-a9a0-ad1135c2872d tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 2422 microversion: 2.25 time: 0.272424 Oct 29 01:10:14.318413 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 816/1652] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:10:14 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 2422 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:10:14.342485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a7357d8b-6d44-4751-8ef8-ead9fb3bf350 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:14.343365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a7357d8b-6d44-4751-8ef8-ead9fb3bf350 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:14.350364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7357d8b-6d44-4751-8ef8-ead9fb3bf350 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:14.351441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7357d8b-6d44-4751-8ef8-ead9fb3bf350 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:14.352148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7357d8b-6d44-4751-8ef8-ead9fb3bf350 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:14.353420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7357d8b-6d44-4751-8ef8-ead9fb3bf350 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:14.354045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7357d8b-6d44-4751-8ef8-ead9fb3bf350 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:14.354638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7357d8b-6d44-4751-8ef8-ead9fb3bf350 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:14.401748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6bcce72a-dfb0-4959-9050-689021d5adda tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:14.421394 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6bcce72a-dfb0-4959-9050-689021d5adda tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1265 microversion: 2.1 time: 0.126855 Oct 29 01:10:14.423737 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 837/1653] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:14 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1265 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:14.429540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-685ee7a5-c330-427c-b579-f3d4bdb60cf3 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:14.431270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-685ee7a5-c330-427c-b579-f3d4bdb60cf3 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:14.440988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-685ee7a5-c330-427c-b579-f3d4bdb60cf3 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:14.441693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-685ee7a5-c330-427c-b579-f3d4bdb60cf3 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:14.442499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-685ee7a5-c330-427c-b579-f3d4bdb60cf3 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:14.443216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-685ee7a5-c330-427c-b579-f3d4bdb60cf3 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:14.443847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-685ee7a5-c330-427c-b579-f3d4bdb60cf3 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:14.444446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-685ee7a5-c330-427c-b579-f3d4bdb60cf3 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:14.611285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-685ee7a5-c330-427c-b579-f3d4bdb60cf3 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:14.627064 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-685ee7a5-c330-427c-b579-f3d4bdb60cf3 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1425 microversion: 2.1 time: 0.200623 Oct 29 01:10:14.628725 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 838/1654] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:14 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1425 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:14.650493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-35dfa6b0-a68b-4d33-aa6a-07ea5727c6c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:14.654279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-35dfa6b0-a68b-4d33-aa6a-07ea5727c6c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:14.666860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35dfa6b0-a68b-4d33-aa6a-07ea5727c6c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:14.670039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35dfa6b0-a68b-4d33-aa6a-07ea5727c6c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:14.670938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35dfa6b0-a68b-4d33-aa6a-07ea5727c6c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:14.672497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35dfa6b0-a68b-4d33-aa6a-07ea5727c6c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:14.674130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35dfa6b0-a68b-4d33-aa6a-07ea5727c6c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:14.674578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35dfa6b0-a68b-4d33-aa6a-07ea5727c6c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:14.856193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-a7357d8b-6d44-4751-8ef8-ead9fb3bf350 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'services' on Instance uuid 00a19183-c526-47be-95c4-d4c3a9936390 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:10:14.883931 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a7357d8b-6d44-4751-8ef8-ead9fb3bf350 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 2422 microversion: 2.25 time: 0.544610 Oct 29 01:10:14.885326 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 817/1655] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:10:14 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 2422 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:10:14.903574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-292f2be5-5ff1-490d-8ac6-0dbef841e5da tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:14.904747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-292f2be5-5ff1-490d-8ac6-0dbef841e5da tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:14.923768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-292f2be5-5ff1-490d-8ac6-0dbef841e5da tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:14.924656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-292f2be5-5ff1-490d-8ac6-0dbef841e5da tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:14.925374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-292f2be5-5ff1-490d-8ac6-0dbef841e5da tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:14.926291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-292f2be5-5ff1-490d-8ac6-0dbef841e5da tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:14.927072 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-292f2be5-5ff1-490d-8ac6-0dbef841e5da tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:14.927760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-292f2be5-5ff1-490d-8ac6-0dbef841e5da tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:14.996773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-35dfa6b0-a68b-4d33-aa6a-07ea5727c6c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:15.010282 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-35dfa6b0-a68b-4d33-aa6a-07ea5727c6c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1314 microversion: 2.1 time: 0.377154 Oct 29 01:10:15.010282 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 839/1656] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:14 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:15.037708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-840a4633-c4f4-4aca-b3d5-35af4a5a6a78 req-be01a355-986e-4389-b73b-2dbb970a33e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea6c70b8-5b50-4590-9206-59569bc29044", "name": "network-vif-deleted", "tag": "e503fc1e-f8db-4750-b6ff-80bdcd5ef7d0"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:15.049852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-840a4633-c4f4-4aca-b3d5-35af4a5a6a78 req-be01a355-986e-4389-b73b-2dbb970a33e9 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:15.050341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-840a4633-c4f4-4aca-b3d5-35af4a5a6a78 req-be01a355-986e-4389-b73b-2dbb970a33e9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:15.050841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-840a4633-c4f4-4aca-b3d5-35af4a5a6a78 req-be01a355-986e-4389-b73b-2dbb970a33e9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:15.053088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-292f2be5-5ff1-490d-8ac6-0dbef841e5da tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:15.064595 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-840a4633-c4f4-4aca-b3d5-35af4a5a6a78 req-be01a355-986e-4389-b73b-2dbb970a33e9 service nova] Creating event network-vif-deleted:e503fc1e-f8db-4750-b6ff-80bdcd5ef7d0 for instance ea6c70b8-5b50-4590-9206-59569bc29044 on n-h1-862964-3 Oct 29 01:10:15.066667 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-292f2be5-5ff1-490d-8ac6-0dbef841e5da tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1327 microversion: 2.1 time: 0.179939 Oct 29 01:10:15.070167 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 818/1657] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:14 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1327 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:15.070812 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-840a4633-c4f4-4aca-b3d5-35af4a5a6a78 req-be01a355-986e-4389-b73b-2dbb970a33e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042886 Oct 29 01:10:15.071668 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 840/1658] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:15.093195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-139980b1-3f90-4e8e-b959-250101af0f8f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:15.093469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-139980b1-3f90-4e8e-b959-250101af0f8f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:15.100996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-139980b1-3f90-4e8e-b959-250101af0f8f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:15.101537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-139980b1-3f90-4e8e-b959-250101af0f8f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:15.101990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-139980b1-3f90-4e8e-b959-250101af0f8f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:15.102720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-139980b1-3f90-4e8e-b959-250101af0f8f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:15.103258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-139980b1-3f90-4e8e-b959-250101af0f8f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:15.103651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-139980b1-3f90-4e8e-b959-250101af0f8f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:15.230226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-139980b1-3f90-4e8e-b959-250101af0f8f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lazy-loading 'services' on Instance uuid 00a19183-c526-47be-95c4-d4c3a9936390 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:10:15.310971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4830ccf3-2d53-4863-8a88-c3c3c7134d94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:15.311981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4830ccf3-2d53-4863-8a88-c3c3c7134d94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:15.338331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4830ccf3-2d53-4863-8a88-c3c3c7134d94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:15.341068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4830ccf3-2d53-4863-8a88-c3c3c7134d94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:15.341864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4830ccf3-2d53-4863-8a88-c3c3c7134d94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:15.342740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4830ccf3-2d53-4863-8a88-c3c3c7134d94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:15.343315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4830ccf3-2d53-4863-8a88-c3c3c7134d94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:15.345426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4830ccf3-2d53-4863-8a88-c3c3c7134d94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:15.529788 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-139980b1-3f90-4e8e-b959-250101af0f8f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "DELETE /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-volume_attachments/c3aee8d5-861e-423a-9575-d5d615495c57" status: 202 len: 0 microversion: 2.25 time: 0.441993 Oct 29 01:10:15.534772 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 819/1659] 10.222.0.26 () {60 vars in 1457 bytes} [Sat Oct 29 01:10:15 2022] DELETE /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-volume_attachments/c3aee8d5-861e-423a-9575-d5d615495c57 => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:10:15.542970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-73d4927a-ccde-4c1c-86bb-17b040b80066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:15.543938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-73d4927a-ccde-4c1c-86bb-17b040b80066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:15.552064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-73d4927a-ccde-4c1c-86bb-17b040b80066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:15.552950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-73d4927a-ccde-4c1c-86bb-17b040b80066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:15.553657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-73d4927a-ccde-4c1c-86bb-17b040b80066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:15.554810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-73d4927a-ccde-4c1c-86bb-17b040b80066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:15.555495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-73d4927a-ccde-4c1c-86bb-17b040b80066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:15.556170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-73d4927a-ccde-4c1c-86bb-17b040b80066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:15.671810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4830ccf3-2d53-4863-8a88-c3c3c7134d94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:15.696172 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4830ccf3-2d53-4863-8a88-c3c3c7134d94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1293 microversion: 2.1 time: 0.390414 Oct 29 01:10:15.697598 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 841/1660] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:15 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1293 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:10:15.706275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-73d4927a-ccde-4c1c-86bb-17b040b80066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:15.711574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-e3fcf801-e854-4f64-ad77-a23f32d30ce6 req-01cf4d28-c629-4658-a984-a3fdd4fd8d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba5e830e-0f0f-4f57-93c4-a42dcd3a3003", "tag": "14849a71-b385-4c87-92d0-caf7083bd7e3"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:15.723914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e3fcf801-e854-4f64-ad77-a23f32d30ce6 req-01cf4d28-c629-4658-a984-a3fdd4fd8d61 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:15.724776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e3fcf801-e854-4f64-ad77-a23f32d30ce6 req-01cf4d28-c629-4658-a984-a3fdd4fd8d61 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:15.725474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e3fcf801-e854-4f64-ad77-a23f32d30ce6 req-01cf4d28-c629-4658-a984-a3fdd4fd8d61 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:15.734192 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-73d4927a-ccde-4c1c-86bb-17b040b80066 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1273 microversion: 2.1 time: 0.196082 Oct 29 01:10:15.739876 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-e3fcf801-e854-4f64-ad77-a23f32d30ce6 req-01cf4d28-c629-4658-a984-a3fdd4fd8d61 service nova] Creating event network-changed:14849a71-b385-4c87-92d0-caf7083bd7e3 for instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 on n-h1-862964-3 Oct 29 01:10:15.740970 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 820/1661] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:15 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1273 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:15.754389 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-e3fcf801-e854-4f64-ad77-a23f32d30ce6 req-01cf4d28-c629-4658-a984-a3fdd4fd8d61 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054307 Oct 29 01:10:15.756066 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 842/1662] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:15.758463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6f923a42-7aca-4da9-9424-1650f28582ad tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:15.763614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-65774e77-d91c-4b39-b0b0-f57017a21691 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:15.764054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-65774e77-d91c-4b39-b0b0-f57017a21691 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:15.773066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65774e77-d91c-4b39-b0b0-f57017a21691 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:15.773529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65774e77-d91c-4b39-b0b0-f57017a21691 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:15.774222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65774e77-d91c-4b39-b0b0-f57017a21691 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:15.775112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65774e77-d91c-4b39-b0b0-f57017a21691 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:15.775783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65774e77-d91c-4b39-b0b0-f57017a21691 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:15.776369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65774e77-d91c-4b39-b0b0-f57017a21691 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:15.776569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6f923a42-7aca-4da9-9424-1650f28582ad tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:15.800891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f923a42-7aca-4da9-9424-1650f28582ad tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:15.803220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f923a42-7aca-4da9-9424-1650f28582ad tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:15.803694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f923a42-7aca-4da9-9424-1650f28582ad tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:15.804434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f923a42-7aca-4da9-9424-1650f28582ad tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:15.804905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f923a42-7aca-4da9-9424-1650f28582ad tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:15.805368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f923a42-7aca-4da9-9424-1650f28582ad tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:15.863106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:15.890284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65774e77-d91c-4b39-b0b0-f57017a21691 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:15.893473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65774e77-d91c-4b39-b0b0-f57017a21691 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:15.897226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65774e77-d91c-4b39-b0b0-f57017a21691 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:15.897973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-65774e77-d91c-4b39-b0b0-f57017a21691 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lazy-loading 'fault' on Instance uuid ea6c70b8-5b50-4590-9206-59569bc29044 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:10:15.905542 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6f923a42-7aca-4da9-9424-1650f28582ad tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.162083 Oct 29 01:10:15.912007 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 821/1663] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:10:15 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:10:16.000494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-65774e77-d91c-4b39-b0b0-f57017a21691 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:16.015592 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-65774e77-d91c-4b39-b0b0-f57017a21691 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 200 len: 1311 microversion: 2.1 time: 0.252807 Oct 29 01:10:16.017942 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 843/1664] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:15 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 1311 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:16.036374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2aba5e3c-0ca5-4d21-8c3b-256e2d27f15d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:16.037496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2aba5e3c-0ca5-4d21-8c3b-256e2d27f15d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:16.045560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2aba5e3c-0ca5-4d21-8c3b-256e2d27f15d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:16.046048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2aba5e3c-0ca5-4d21-8c3b-256e2d27f15d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:16.046481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2aba5e3c-0ca5-4d21-8c3b-256e2d27f15d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:16.060524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2aba5e3c-0ca5-4d21-8c3b-256e2d27f15d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:16.061107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2aba5e3c-0ca5-4d21-8c3b-256e2d27f15d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:16.061587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2aba5e3c-0ca5-4d21-8c3b-256e2d27f15d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:16.098679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6aa7510e-b723-44a9-b5d9-810ec66e5d63 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:16.099504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6aa7510e-b723-44a9-b5d9-810ec66e5d63 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:16.121998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6aa7510e-b723-44a9-b5d9-810ec66e5d63 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:16.124634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6aa7510e-b723-44a9-b5d9-810ec66e5d63 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:16.127392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6aa7510e-b723-44a9-b5d9-810ec66e5d63 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:16.127392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6aa7510e-b723-44a9-b5d9-810ec66e5d63 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:16.127392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6aa7510e-b723-44a9-b5d9-810ec66e5d63 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:16.132619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6aa7510e-b723-44a9-b5d9-810ec66e5d63 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:16.960606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2aba5e3c-0ca5-4d21-8c3b-256e2d27f15d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:16.970737 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2aba5e3c-0ca5-4d21-8c3b-256e2d27f15d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1314 microversion: 2.1 time: 0.941826 Oct 29 01:10:16.975795 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 822/1665] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:16 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1314 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:16.992658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-22fe1c31-13ea-4457-a88f-504ebe939267 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:16.993959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-22fe1c31-13ea-4457-a88f-504ebe939267 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:17.014711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22fe1c31-13ea-4457-a88f-504ebe939267 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:17.015291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22fe1c31-13ea-4457-a88f-504ebe939267 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:17.015748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22fe1c31-13ea-4457-a88f-504ebe939267 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:17.016484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22fe1c31-13ea-4457-a88f-504ebe939267 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:17.022105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22fe1c31-13ea-4457-a88f-504ebe939267 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:17.022577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22fe1c31-13ea-4457-a88f-504ebe939267 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:17.113953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:17.189851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6aa7510e-b723-44a9-b5d9-810ec66e5d63 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:17.202428 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6aa7510e-b723-44a9-b5d9-810ec66e5d63 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1395 microversion: 2.1 time: 1.107723 Oct 29 01:10:17.223288 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 844/1666] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:16 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1395 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:17.236855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1d125790-02e5-4037-8d3a-717e405dd112 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:17.237469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1d125790-02e5-4037-8d3a-717e405dd112 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:17.257131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d125790-02e5-4037-8d3a-717e405dd112 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:17.257885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d125790-02e5-4037-8d3a-717e405dd112 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:17.258667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d125790-02e5-4037-8d3a-717e405dd112 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:17.259654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d125790-02e5-4037-8d3a-717e405dd112 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:17.260353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d125790-02e5-4037-8d3a-717e405dd112 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:17.261469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d125790-02e5-4037-8d3a-717e405dd112 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:17.289690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:17.483044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-22fe1c31-13ea-4457-a88f-504ebe939267 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:17.492559 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-22fe1c31-13ea-4457-a88f-504ebe939267 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1293 microversion: 2.1 time: 0.514305 Oct 29 01:10:17.493264 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 823/1667] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:16 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1293 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:17.502295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ed71b677-b346-41cd-8428-58cf0397ae94 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:17.507521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ed71b677-b346-41cd-8428-58cf0397ae94 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:17.545085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed71b677-b346-41cd-8428-58cf0397ae94 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:17.545839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed71b677-b346-41cd-8428-58cf0397ae94 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:17.546464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed71b677-b346-41cd-8428-58cf0397ae94 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:17.549064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed71b677-b346-41cd-8428-58cf0397ae94 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:17.559962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed71b677-b346-41cd-8428-58cf0397ae94 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:17.559962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed71b677-b346-41cd-8428-58cf0397ae94 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:17.626863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1d125790-02e5-4037-8d3a-717e405dd112 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:17.631960 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ed71b677-b346-41cd-8428-58cf0397ae94 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.136736 Oct 29 01:10:17.634603 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 824/1668] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:10:17 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:10:17.637910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4889ed0a-5797-445d-8c00-18d4d0a51ff9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:17.640140 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1d125790-02e5-4037-8d3a-717e405dd112 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1313 microversion: 2.1 time: 0.412442 Oct 29 01:10:17.641177 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4889ed0a-5797-445d-8c00-18d4d0a51ff9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: ea6c70b8-5b50-4590-9206-59569bc29044] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:17.653962 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 845/1669] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:17 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:17.656869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4889ed0a-5797-445d-8c00-18d4d0a51ff9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:17.658187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4889ed0a-5797-445d-8c00-18d4d0a51ff9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:17.661015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4889ed0a-5797-445d-8c00-18d4d0a51ff9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:17.663368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4889ed0a-5797-445d-8c00-18d4d0a51ff9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:17.663368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4889ed0a-5797-445d-8c00-18d4d0a51ff9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:17.663368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4889ed0a-5797-445d-8c00-18d4d0a51ff9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:17.701344 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-4889ed0a-5797-445d-8c00-18d4d0a51ff9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] HTTP exception thrown: Instance ea6c70b8-5b50-4590-9206-59569bc29044 could not be found. Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4889ed0a-5797-445d-8c00-18d4d0a51ff9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Request method failure captured: Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 HTTP/1.1 Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH02dkjDWM_q0yvFvUSns471x-1Ic-J04Sjt79Zc25laS-plkvKYBw9ZBIkxfef4arl8HIsWqM5FjPp5JaJVCEASvdCMI-zi7p60WexiyFtYKOwQr5jX59pNDh9eOAeMztofPQWJTdLL3h70ZzhsCb93cOZZmLjUXCVKijtF4qLo__E Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: ef26e5ad38454b2ab3102864d73268d3 Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-230943148 Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef26e5ad38454b2ab3102864d73268d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef26e5ad38454b2ab3102864d73268d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef26e5ad38454b2ab3102864d73268d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef26e5ad38454b2ab3102864d73268d3", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersAdminNegativeTestJSON-230943148 Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: ef26e5ad38454b2ab3102864d73268d3 Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-230943148 Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersAdminNegativeTestJSON-230943148-project Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: a2163198c1624bf0989594eb0e9f9bf1 Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersAdminNegativeTestJSON-230943148-project Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance ea6c70b8-5b50-4590-9206-59569bc29044 could not be found. Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'ea6c70b8-5b50-4590-9206-59569bc29044'} Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea6c70b8-5b50-4590-9206-59569bc29044 could not be found. Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea6c70b8-5b50-4590-9206-59569bc29044 could not be found. Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:17.705566 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:17.711983 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:17.711983 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:17.711983 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:17.711983 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:17.711983 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:10:17.711983 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:10:17.711983 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea6c70b8-5b50-4590-9206-59569bc29044 could not be found. Oct 29 01:10:17.711983 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:17.711983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4889ed0a-5797-445d-8c00-18d4d0a51ff9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Returning 404 to user: Instance ea6c70b8-5b50-4590-9206-59569bc29044 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:17.711983 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4889ed0a-5797-445d-8c00-18d4d0a51ff9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044" status: 404 len: 111 microversion: 2.1 time: 0.073195 Oct 29 01:10:17.713479 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 825/1670] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:17 2022] GET /compute/v2.1/servers/ea6c70b8-5b50-4590-9206-59569bc29044 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:10:17.720967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-62037aad-5ed4-491a-b522-6fc4a1162103 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:17.721501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-62037aad-5ed4-491a-b522-6fc4a1162103 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:17.731296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62037aad-5ed4-491a-b522-6fc4a1162103 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:17.731296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62037aad-5ed4-491a-b522-6fc4a1162103 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:17.731723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62037aad-5ed4-491a-b522-6fc4a1162103 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:17.732459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62037aad-5ed4-491a-b522-6fc4a1162103 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:17.732936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62037aad-5ed4-491a-b522-6fc4a1162103 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:17.733515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62037aad-5ed4-491a-b522-6fc4a1162103 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:17.789265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-62037aad-5ed4-491a-b522-6fc4a1162103 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:10:18.002252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d3434983-b530-4507-9ce4-001a3c8537b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:18.002777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d3434983-b530-4507-9ce4-001a3c8537b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:18.019049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:18.022866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3434983-b530-4507-9ce4-001a3c8537b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:18.023671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3434983-b530-4507-9ce4-001a3c8537b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:18.024791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3434983-b530-4507-9ce4-001a3c8537b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:18.025869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3434983-b530-4507-9ce4-001a3c8537b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:18.027386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3434983-b530-4507-9ce4-001a3c8537b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:18.032489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3434983-b530-4507-9ce4-001a3c8537b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:18.199103 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-62037aad-5ed4-491a-b522-6fc4a1162103 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 204 len: 0 microversion: 2.1 time: 0.482512 Oct 29 01:10:18.201202 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 846/1671] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:10:17 2022] DELETE /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:10:18.210583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-289eb9d8-131f-4bd3-9e77-cf5e6a42cc39 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:18.211627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-289eb9d8-131f-4bd3-9e77-cf5e6a42cc39 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:18.227732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-289eb9d8-131f-4bd3-9e77-cf5e6a42cc39 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:18.228451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-289eb9d8-131f-4bd3-9e77-cf5e6a42cc39 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:18.229000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-289eb9d8-131f-4bd3-9e77-cf5e6a42cc39 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:18.229859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-289eb9d8-131f-4bd3-9e77-cf5e6a42cc39 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:18.230673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-289eb9d8-131f-4bd3-9e77-cf5e6a42cc39 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:18.231643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-289eb9d8-131f-4bd3-9e77-cf5e6a42cc39 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:18.414130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d3434983-b530-4507-9ce4-001a3c8537b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:18.429393 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d3434983-b530-4507-9ce4-001a3c8537b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1314 microversion: 2.1 time: 0.429141 Oct 29 01:10:18.432942 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 826/1672] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:17 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:10:18.448372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-84f42bb6-0699-4bb1-a3a4-c7dd75988b45 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:18.449333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-84f42bb6-0699-4bb1-a3a4-c7dd75988b45 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:18.463411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84f42bb6-0699-4bb1-a3a4-c7dd75988b45 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:18.463898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84f42bb6-0699-4bb1-a3a4-c7dd75988b45 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:18.464338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84f42bb6-0699-4bb1-a3a4-c7dd75988b45 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:18.465089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84f42bb6-0699-4bb1-a3a4-c7dd75988b45 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:18.465577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84f42bb6-0699-4bb1-a3a4-c7dd75988b45 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:18.466000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84f42bb6-0699-4bb1-a3a4-c7dd75988b45 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:18.606914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-289eb9d8-131f-4bd3-9e77-cf5e6a42cc39 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:18.620345 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-289eb9d8-131f-4bd3-9e77-cf5e6a42cc39 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1477 microversion: 2.1 time: 0.410821 Oct 29 01:10:18.621227 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 847/1673] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:18 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1477 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:18.629050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1b93bc71-3590-4d8f-958e-f08ae0fe8925 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:18.634658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1b93bc71-3590-4d8f-958e-f08ae0fe8925 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:18.644285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b93bc71-3590-4d8f-958e-f08ae0fe8925 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:18.645032 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b93bc71-3590-4d8f-958e-f08ae0fe8925 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:18.649085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b93bc71-3590-4d8f-958e-f08ae0fe8925 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:18.649085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b93bc71-3590-4d8f-958e-f08ae0fe8925 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:18.649085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b93bc71-3590-4d8f-958e-f08ae0fe8925 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:18.649085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b93bc71-3590-4d8f-958e-f08ae0fe8925 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:18.807100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-84f42bb6-0699-4bb1-a3a4-c7dd75988b45 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:18.818592 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-84f42bb6-0699-4bb1-a3a4-c7dd75988b45 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1395 microversion: 2.1 time: 0.383885 Oct 29 01:10:18.819524 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 827/1674] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:18 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1395 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:18.824677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5511391f-0d43-433c-88fe-9da3d88f20e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:18.827051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5511391f-0d43-433c-88fe-9da3d88f20e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:18.835546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5511391f-0d43-433c-88fe-9da3d88f20e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:18.836872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5511391f-0d43-433c-88fe-9da3d88f20e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:18.837606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5511391f-0d43-433c-88fe-9da3d88f20e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:18.838931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5511391f-0d43-433c-88fe-9da3d88f20e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:18.839638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5511391f-0d43-433c-88fe-9da3d88f20e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:18.840561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5511391f-0d43-433c-88fe-9da3d88f20e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:18.882569 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5511391f-0d43-433c-88fe-9da3d88f20e7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.061339 Oct 29 01:10:18.888823 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 828/1675] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:10:18 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:10:18.896976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-58a1d828-16a7-4e33-8fd3-9551e14b0a1f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:18.896976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-58a1d828-16a7-4e33-8fd3-9551e14b0a1f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:18.905263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58a1d828-16a7-4e33-8fd3-9551e14b0a1f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:18.905780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58a1d828-16a7-4e33-8fd3-9551e14b0a1f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:18.906208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58a1d828-16a7-4e33-8fd3-9551e14b0a1f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:18.906970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58a1d828-16a7-4e33-8fd3-9551e14b0a1f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:18.908111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58a1d828-16a7-4e33-8fd3-9551e14b0a1f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:18.908658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58a1d828-16a7-4e33-8fd3-9551e14b0a1f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:18.990964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1b93bc71-3590-4d8f-958e-f08ae0fe8925 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:19.004401 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1b93bc71-3590-4d8f-958e-f08ae0fe8925 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1293 microversion: 2.1 time: 0.379105 Oct 29 01:10:19.005300 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 848/1676] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:18 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1293 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:19.144095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-58a1d828-16a7-4e33-8fd3-9551e14b0a1f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:19.152547 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-58a1d828-16a7-4e33-8fd3-9551e14b0a1f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1313 microversion: 2.1 time: 0.262287 Oct 29 01:10:19.165521 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 829/1677] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:18 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:19.210835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-02e6e1ce-1ee9-4d42-8fdc-e5bc0178a3b5 req-17e753c6-21a9-4833-9b67-15519f0ae98c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a", "tag": "99177002-b761-4c56-a7bb-5911f9934cca"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:19.216172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-92878a74-8f6f-4e4c-a31a-db8afd061c39 req-2aab9a29-4778-4b53-90a9-293a77a0db16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "043b00d6-d708-4cee-a1dc-d8ca4ddcae90", "name": "network-vif-plugged", "status": "completed", "tag": "ca5d4535-1bd9-43b8-8e8d-1d33f9053107"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:19.228186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-02e6e1ce-1ee9-4d42-8fdc-e5bc0178a3b5 req-17e753c6-21a9-4833-9b67-15519f0ae98c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:19.235521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-02e6e1ce-1ee9-4d42-8fdc-e5bc0178a3b5 req-17e753c6-21a9-4833-9b67-15519f0ae98c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:19.235521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-02e6e1ce-1ee9-4d42-8fdc-e5bc0178a3b5 req-17e753c6-21a9-4833-9b67-15519f0ae98c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:19.254520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-92878a74-8f6f-4e4c-a31a-db8afd061c39 req-2aab9a29-4778-4b53-90a9-293a77a0db16 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:19.259109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-92878a74-8f6f-4e4c-a31a-db8afd061c39 req-2aab9a29-4778-4b53-90a9-293a77a0db16 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:19.260693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-92878a74-8f6f-4e4c-a31a-db8afd061c39 req-2aab9a29-4778-4b53-90a9-293a77a0db16 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:19.261484 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-02e6e1ce-1ee9-4d42-8fdc-e5bc0178a3b5 req-17e753c6-21a9-4833-9b67-15519f0ae98c service nova] Creating event network-changed:99177002-b761-4c56-a7bb-5911f9934cca for instance c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a on n-h2-862964-3 Oct 29 01:10:19.271149 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-02e6e1ce-1ee9-4d42-8fdc-e5bc0178a3b5 req-17e753c6-21a9-4833-9b67-15519f0ae98c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069389 Oct 29 01:10:19.272085 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 849/1678] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:19.292084 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-92878a74-8f6f-4e4c-a31a-db8afd061c39 req-2aab9a29-4778-4b53-90a9-293a77a0db16 service nova] Creating event network-vif-plugged:ca5d4535-1bd9-43b8-8e8d-1d33f9053107 for instance 043b00d6-d708-4cee-a1dc-d8ca4ddcae90 on n-h2-862964-3 Oct 29 01:10:19.314641 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-92878a74-8f6f-4e4c-a31a-db8afd061c39 req-2aab9a29-4778-4b53-90a9-293a77a0db16 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106368 Oct 29 01:10:19.315578 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 830/1679] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:10:19.458048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6cbd275d-aa7a-4245-912f-26f08ba2e401 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:19.460835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6cbd275d-aa7a-4245-912f-26f08ba2e401 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:19.475206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cbd275d-aa7a-4245-912f-26f08ba2e401 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:19.480199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cbd275d-aa7a-4245-912f-26f08ba2e401 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:19.481327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cbd275d-aa7a-4245-912f-26f08ba2e401 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:19.482755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cbd275d-aa7a-4245-912f-26f08ba2e401 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:19.485044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cbd275d-aa7a-4245-912f-26f08ba2e401 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:19.488653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cbd275d-aa7a-4245-912f-26f08ba2e401 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:19.653535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-91b1cead-4e7e-4bc7-95ce-21733586c5c8 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:19.654731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-91b1cead-4e7e-4bc7-95ce-21733586c5c8 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:19.682422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91b1cead-4e7e-4bc7-95ce-21733586c5c8 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:19.683552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91b1cead-4e7e-4bc7-95ce-21733586c5c8 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:19.684670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91b1cead-4e7e-4bc7-95ce-21733586c5c8 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:19.687154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91b1cead-4e7e-4bc7-95ce-21733586c5c8 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:19.687824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91b1cead-4e7e-4bc7-95ce-21733586c5c8 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:19.689103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91b1cead-4e7e-4bc7-95ce-21733586c5c8 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:19.952773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6cbd275d-aa7a-4245-912f-26f08ba2e401 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:19.962491 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6cbd275d-aa7a-4245-912f-26f08ba2e401 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1314 microversion: 2.1 time: 0.509296 Oct 29 01:10:19.974044 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 850/1680] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:19 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:19.985686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-160a0729-7ea1-461c-9386-035f57989758 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:19.986580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-160a0729-7ea1-461c-9386-035f57989758 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:19.994682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-160a0729-7ea1-461c-9386-035f57989758 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:19.995207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-160a0729-7ea1-461c-9386-035f57989758 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:19.995698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-160a0729-7ea1-461c-9386-035f57989758 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:19.996417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-160a0729-7ea1-461c-9386-035f57989758 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:19.996873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-160a0729-7ea1-461c-9386-035f57989758 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:19.997440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-160a0729-7ea1-461c-9386-035f57989758 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:20.285340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-91b1cead-4e7e-4bc7-95ce-21733586c5c8 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:20.293758 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-91b1cead-4e7e-4bc7-95ce-21733586c5c8 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1477 microversion: 2.1 time: 0.649189 Oct 29 01:10:20.294548 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 831/1681] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:19 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1477 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:20.301045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-435179c5-9b99-4d4b-9995-74c329f5ec91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:20.303679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-435179c5-9b99-4d4b-9995-74c329f5ec91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:20.310715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-435179c5-9b99-4d4b-9995-74c329f5ec91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:20.322229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-435179c5-9b99-4d4b-9995-74c329f5ec91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:20.323048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-435179c5-9b99-4d4b-9995-74c329f5ec91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:20.326136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-435179c5-9b99-4d4b-9995-74c329f5ec91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:20.326920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-435179c5-9b99-4d4b-9995-74c329f5ec91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:20.328099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-435179c5-9b99-4d4b-9995-74c329f5ec91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:20.362599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-160a0729-7ea1-461c-9386-035f57989758 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:20.374556 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-160a0729-7ea1-461c-9386-035f57989758 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1395 microversion: 2.1 time: 0.398940 Oct 29 01:10:20.405323 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 851/1682] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:19 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1395 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:20.411224 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-435179c5-9b99-4d4b-9995-74c329f5ec91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.115271 Oct 29 01:10:20.411732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7d1d9185-d2c3-4b03-bb04-3c3c81b3ff75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:20.412888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7d1d9185-d2c3-4b03-bb04-3c3c81b3ff75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:20.413484 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 832/1683] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:10:20 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:10:20.420612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4088d836-9e49-4339-ad24-cf14a691d91d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:20.420612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4088d836-9e49-4339-ad24-cf14a691d91d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:20.425088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d1d9185-d2c3-4b03-bb04-3c3c81b3ff75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:20.427982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4088d836-9e49-4339-ad24-cf14a691d91d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:20.427982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4088d836-9e49-4339-ad24-cf14a691d91d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:20.428295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4088d836-9e49-4339-ad24-cf14a691d91d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:20.429089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4088d836-9e49-4339-ad24-cf14a691d91d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:20.429582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4088d836-9e49-4339-ad24-cf14a691d91d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:20.430414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4088d836-9e49-4339-ad24-cf14a691d91d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:20.431243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d1d9185-d2c3-4b03-bb04-3c3c81b3ff75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:20.433067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d1d9185-d2c3-4b03-bb04-3c3c81b3ff75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:20.436033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d1d9185-d2c3-4b03-bb04-3c3c81b3ff75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:20.436592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d1d9185-d2c3-4b03-bb04-3c3c81b3ff75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:20.437308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d1d9185-d2c3-4b03-bb04-3c3c81b3ff75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:20.438154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:20.784069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7d1d9185-d2c3-4b03-bb04-3c3c81b3ff75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:20.793104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4088d836-9e49-4339-ad24-cf14a691d91d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:20.798646 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7d1d9185-d2c3-4b03-bb04-3c3c81b3ff75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1293 microversion: 2.1 time: 0.390807 Oct 29 01:10:20.803005 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4088d836-9e49-4339-ad24-cf14a691d91d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1313 microversion: 2.1 time: 0.388016 Oct 29 01:10:20.805647 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 833/1684] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:20 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:20.815699 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 852/1685] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:20 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1293 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:20.993988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1b1fd286-2392-4571-99ba-aecabb412e72 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:20.995253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1b1fd286-2392-4571-99ba-aecabb412e72 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:21.003357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b1fd286-2392-4571-99ba-aecabb412e72 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:21.004494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b1fd286-2392-4571-99ba-aecabb412e72 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:21.004950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b1fd286-2392-4571-99ba-aecabb412e72 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:21.005831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b1fd286-2392-4571-99ba-aecabb412e72 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:21.006306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b1fd286-2392-4571-99ba-aecabb412e72 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:21.006917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b1fd286-2392-4571-99ba-aecabb412e72 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:21.321604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-5eec32d1-670f-4e82-831e-8939748d46bc req-3f0eefb5-20b3-4b7f-b5f2-c253aeed0037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ea836d-4ec8-4646-a8f8-2c199985d829", "tag": "a2a1803b-2371-4f50-9500-0cc998cf3afa"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:21.324460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=26 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:21.347222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5eec32d1-670f-4e82-831e-8939748d46bc req-3f0eefb5-20b3-4b7f-b5f2-c253aeed0037 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:21.351756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5eec32d1-670f-4e82-831e-8939748d46bc req-3f0eefb5-20b3-4b7f-b5f2-c253aeed0037 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:21.351756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5eec32d1-670f-4e82-831e-8939748d46bc req-3f0eefb5-20b3-4b7f-b5f2-c253aeed0037 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:21.365835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1b1fd286-2392-4571-99ba-aecabb412e72 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:21.381071 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-5eec32d1-670f-4e82-831e-8939748d46bc req-3f0eefb5-20b3-4b7f-b5f2-c253aeed0037 service nova] Creating event network-changed:a2a1803b-2371-4f50-9500-0cc998cf3afa for instance b7ea836d-4ec8-4646-a8f8-2c199985d829 on n-h2-862964-3 Oct 29 01:10:21.382243 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1b1fd286-2392-4571-99ba-aecabb412e72 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1314 microversion: 2.1 time: 0.390804 Oct 29 01:10:21.390704 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-5eec32d1-670f-4e82-831e-8939748d46bc req-3f0eefb5-20b3-4b7f-b5f2-c253aeed0037 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077023 Oct 29 01:10:21.397055 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 853/1687] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:21.397270 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 834/1687] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:20 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:21.412573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bf3c51df-08e6-4258-837e-b2d6d47ed596 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:21.413511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4db7549c-6bf4-4487-964a-eadb54a93de1 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:21.413982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bf3c51df-08e6-4258-837e-b2d6d47ed596 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:21.417585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4db7549c-6bf4-4487-964a-eadb54a93de1 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:21.427112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4db7549c-6bf4-4487-964a-eadb54a93de1 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:21.428576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf3c51df-08e6-4258-837e-b2d6d47ed596 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:21.429080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf3c51df-08e6-4258-837e-b2d6d47ed596 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:21.429689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf3c51df-08e6-4258-837e-b2d6d47ed596 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:21.430595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf3c51df-08e6-4258-837e-b2d6d47ed596 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:21.430886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4db7549c-6bf4-4487-964a-eadb54a93de1 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:21.431051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf3c51df-08e6-4258-837e-b2d6d47ed596 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:21.431664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4db7549c-6bf4-4487-964a-eadb54a93de1 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:21.432300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf3c51df-08e6-4258-837e-b2d6d47ed596 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:21.433795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4db7549c-6bf4-4487-964a-eadb54a93de1 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:21.435567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4db7549c-6bf4-4487-964a-eadb54a93de1 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:21.436304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4db7549c-6bf4-4487-964a-eadb54a93de1 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:21.769466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bf3c51df-08e6-4258-837e-b2d6d47ed596 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:21.772844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4db7549c-6bf4-4487-964a-eadb54a93de1 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:21.781310 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bf3c51df-08e6-4258-837e-b2d6d47ed596 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1395 microversion: 2.1 time: 0.382144 Oct 29 01:10:21.786833 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 854/1688] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:21 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1395 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:21.793681 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4db7549c-6bf4-4487-964a-eadb54a93de1 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1477 microversion: 2.1 time: 0.395323 Oct 29 01:10:21.796720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-045a1dcb-e020-4d14-a8b7-6f859eba5601 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:21.801693 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 835/1689] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:21 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1477 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:21.806443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-045a1dcb-e020-4d14-a8b7-6f859eba5601 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:21.860290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-99bba753-1a4f-4976-a98b-c98d7dc76097 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:21.861231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-99bba753-1a4f-4976-a98b-c98d7dc76097 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:21.869016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-045a1dcb-e020-4d14-a8b7-6f859eba5601 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:21.869533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-045a1dcb-e020-4d14-a8b7-6f859eba5601 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:21.871019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99bba753-1a4f-4976-a98b-c98d7dc76097 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:21.871524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99bba753-1a4f-4976-a98b-c98d7dc76097 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:21.872340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99bba753-1a4f-4976-a98b-c98d7dc76097 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:21.873085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99bba753-1a4f-4976-a98b-c98d7dc76097 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:21.873496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-045a1dcb-e020-4d14-a8b7-6f859eba5601 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:21.874318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99bba753-1a4f-4976-a98b-c98d7dc76097 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:21.877450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99bba753-1a4f-4976-a98b-c98d7dc76097 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:21.877758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-045a1dcb-e020-4d14-a8b7-6f859eba5601 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:21.878402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-045a1dcb-e020-4d14-a8b7-6f859eba5601 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:21.878918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-045a1dcb-e020-4d14-a8b7-6f859eba5601 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:21.945658 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-045a1dcb-e020-4d14-a8b7-6f859eba5601 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.157263 Oct 29 01:10:21.950896 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 855/1690] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:10:21 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:10:21.957326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7facbfdc-845a-4bf7-9be3-653bc2f32d00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:21.958216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7facbfdc-845a-4bf7-9be3-653bc2f32d00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:21.965103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7facbfdc-845a-4bf7-9be3-653bc2f32d00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:21.966098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7facbfdc-845a-4bf7-9be3-653bc2f32d00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:21.966541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7facbfdc-845a-4bf7-9be3-653bc2f32d00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:21.967263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7facbfdc-845a-4bf7-9be3-653bc2f32d00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:21.967722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7facbfdc-845a-4bf7-9be3-653bc2f32d00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:21.968151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7facbfdc-845a-4bf7-9be3-653bc2f32d00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:22.344144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-99bba753-1a4f-4976-a98b-c98d7dc76097 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:22.356769 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-99bba753-1a4f-4976-a98b-c98d7dc76097 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1485 microversion: 2.1 time: 0.537477 Oct 29 01:10:22.359742 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 836/1691] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:21 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1485 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:22.385007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3bcbc092-bb30-496c-80ca-0ecf8191c6f1 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:22.386036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3bcbc092-bb30-496c-80ca-0ecf8191c6f1 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:22.397497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bcbc092-bb30-496c-80ca-0ecf8191c6f1 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:22.401710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7facbfdc-845a-4bf7-9be3-653bc2f32d00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:22.412765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bcbc092-bb30-496c-80ca-0ecf8191c6f1 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:22.413480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bcbc092-bb30-496c-80ca-0ecf8191c6f1 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:22.415064 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7facbfdc-845a-4bf7-9be3-653bc2f32d00 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1313 microversion: 2.1 time: 0.460386 Oct 29 01:10:22.415384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bcbc092-bb30-496c-80ca-0ecf8191c6f1 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:22.434384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bcbc092-bb30-496c-80ca-0ecf8191c6f1 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:22.435346 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 856/1692] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:21 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1313 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:22.436927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bcbc092-bb30-496c-80ca-0ecf8191c6f1 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:22.448683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3125d487-a1ac-4cfc-8347-9e56ed2881cc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:22.449965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3125d487-a1ac-4cfc-8347-9e56ed2881cc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:22.467389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3125d487-a1ac-4cfc-8347-9e56ed2881cc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:22.468062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3125d487-a1ac-4cfc-8347-9e56ed2881cc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:22.469419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3125d487-a1ac-4cfc-8347-9e56ed2881cc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:22.472749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3125d487-a1ac-4cfc-8347-9e56ed2881cc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:22.473468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3125d487-a1ac-4cfc-8347-9e56ed2881cc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:22.475666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3125d487-a1ac-4cfc-8347-9e56ed2881cc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:23.030521 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3bcbc092-bb30-496c-80ca-0ecf8191c6f1 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.649933 Oct 29 01:10:23.039305 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 837/1693] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:10:22 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90/os-interface => generated 285 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:23.046129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ac01e9aa-33f7-4761-bc4d-e41e73d74b66 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:23.049354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ac01e9aa-33f7-4761-bc4d-e41e73d74b66 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:23.053723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac01e9aa-33f7-4761-bc4d-e41e73d74b66 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:23.054223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac01e9aa-33f7-4761-bc4d-e41e73d74b66 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:23.054662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac01e9aa-33f7-4761-bc4d-e41e73d74b66 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:23.055369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac01e9aa-33f7-4761-bc4d-e41e73d74b66 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:23.056020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac01e9aa-33f7-4761-bc4d-e41e73d74b66 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:23.057329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac01e9aa-33f7-4761-bc4d-e41e73d74b66 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:23.164344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ac01e9aa-33f7-4761-bc4d-e41e73d74b66 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:23.196703 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ac01e9aa-33f7-4761-bc4d-e41e73d74b66 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1435 microversion: 2.1 time: 0.155963 Oct 29 01:10:23.209304 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 838/1694] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:23 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1435 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:23.210413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-27f20fb3-3342-42e4-86ec-e3e0304ada29 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:23.211360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-27f20fb3-3342-42e4-86ec-e3e0304ada29 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:23.225359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27f20fb3-3342-42e4-86ec-e3e0304ada29 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:23.226991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27f20fb3-3342-42e4-86ec-e3e0304ada29 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:23.229725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27f20fb3-3342-42e4-86ec-e3e0304ada29 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:23.230900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27f20fb3-3342-42e4-86ec-e3e0304ada29 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:23.231383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27f20fb3-3342-42e4-86ec-e3e0304ada29 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:23.231823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27f20fb3-3342-42e4-86ec-e3e0304ada29 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:23.260010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3125d487-a1ac-4cfc-8347-9e56ed2881cc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:23.279509 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3125d487-a1ac-4cfc-8347-9e56ed2881cc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1314 microversion: 2.1 time: 0.842757 Oct 29 01:10:23.294678 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 857/1695] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:22 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1314 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:23.300685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b65d2a45-12c2-4027-94eb-adddc7df139d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:23.319683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b65d2a45-12c2-4027-94eb-adddc7df139d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:23.344043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:23.353832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b65d2a45-12c2-4027-94eb-adddc7df139d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:23.355484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b65d2a45-12c2-4027-94eb-adddc7df139d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:23.357287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b65d2a45-12c2-4027-94eb-adddc7df139d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:23.358283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b65d2a45-12c2-4027-94eb-adddc7df139d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:23.359544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b65d2a45-12c2-4027-94eb-adddc7df139d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:23.361179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b65d2a45-12c2-4027-94eb-adddc7df139d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:23.424933 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b65d2a45-12c2-4027-94eb-adddc7df139d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.129024 Oct 29 01:10:23.431499 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 858/1696] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:10:23 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:10:23.448642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-30f56fec-53e1-4885-86e6-2a1536ee632f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:23.449807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-30f56fec-53e1-4885-86e6-2a1536ee632f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:23.463477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30f56fec-53e1-4885-86e6-2a1536ee632f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:23.465845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30f56fec-53e1-4885-86e6-2a1536ee632f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:23.467142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30f56fec-53e1-4885-86e6-2a1536ee632f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:23.467999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30f56fec-53e1-4885-86e6-2a1536ee632f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:23.470963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30f56fec-53e1-4885-86e6-2a1536ee632f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:23.471971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30f56fec-53e1-4885-86e6-2a1536ee632f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:23.772135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-27f20fb3-3342-42e4-86ec-e3e0304ada29 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:23.786979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:23.804976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-30f56fec-53e1-4885-86e6-2a1536ee632f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:23.807505 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-27f20fb3-3342-42e4-86ec-e3e0304ada29 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1395 microversion: 2.1 time: 0.600394 Oct 29 01:10:23.809523 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 839/1697] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:23 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1395 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:23.823667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-841f3a1b-d2e0-4093-bda6-dc5b124896b5 req-513ee9da-567b-49f4-b831-fe58edfd1532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ecee3f-2172-4154-9f8a-6365257b44e7", "name": "network-vif-deleted", "tag": "24d01c5e-3ecc-4af5-ab8c-e7579f5bc941"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:23.825124 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-30f56fec-53e1-4885-86e6-2a1536ee632f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1313 microversion: 2.1 time: 0.388621 Oct 29 01:10:23.826195 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 859/1698] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:23 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:23.843657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-841f3a1b-d2e0-4093-bda6-dc5b124896b5 req-513ee9da-567b-49f4-b831-fe58edfd1532 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:23.844729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-841f3a1b-d2e0-4093-bda6-dc5b124896b5 req-513ee9da-567b-49f4-b831-fe58edfd1532 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:23.845215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-841f3a1b-d2e0-4093-bda6-dc5b124896b5 req-513ee9da-567b-49f4-b831-fe58edfd1532 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:23.865415 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-841f3a1b-d2e0-4093-bda6-dc5b124896b5 req-513ee9da-567b-49f4-b831-fe58edfd1532 service nova] Creating event network-vif-deleted:24d01c5e-3ecc-4af5-ab8c-e7579f5bc941 for instance d6ecee3f-2172-4154-9f8a-6365257b44e7 on n-h1-862964-3 Oct 29 01:10:23.877452 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-841f3a1b-d2e0-4093-bda6-dc5b124896b5 req-513ee9da-567b-49f4-b831-fe58edfd1532 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065485 Oct 29 01:10:23.878187 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 840/1699] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:24.018554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3738abb2-763f-4b85-9dd0-d849b0da55b2 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] Action: 'create', calling method: .version_select at 0x7f9d97799310>, body: {"pool": null} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:24.236727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2b2b4bca-e0b2-461a-86a1-a3eb9943abd9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:24.237494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2b2b4bca-e0b2-461a-86a1-a3eb9943abd9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:24.252528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b2b4bca-e0b2-461a-86a1-a3eb9943abd9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:24.252985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b2b4bca-e0b2-461a-86a1-a3eb9943abd9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:24.254952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b2b4bca-e0b2-461a-86a1-a3eb9943abd9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:24.254952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b2b4bca-e0b2-461a-86a1-a3eb9943abd9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:24.254952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b2b4bca-e0b2-461a-86a1-a3eb9943abd9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:24.255565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b2b4bca-e0b2-461a-86a1-a3eb9943abd9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:24.308935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b2b4bca-e0b2-461a-86a1-a3eb9943abd9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:24.309601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b2b4bca-e0b2-461a-86a1-a3eb9943abd9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:24.310408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b2b4bca-e0b2-461a-86a1-a3eb9943abd9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:24.310644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-2b2b4bca-e0b2-461a-86a1-a3eb9943abd9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lazy-loading 'fault' on Instance uuid d6ecee3f-2172-4154-9f8a-6365257b44e7 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:10:24.357470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2b2b4bca-e0b2-461a-86a1-a3eb9943abd9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2163198c1624bf0989594eb0e9f9bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef26e5ad38454b2ab3102864d73268d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:24.372039 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2b2b4bca-e0b2-461a-86a1-a3eb9943abd9 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 200 len: 1311 microversion: 2.1 time: 0.147644 Oct 29 01:10:24.372989 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 841/1700] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:24 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 1311 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:24.378721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-565cd1c0-c0b9-415c-8e54-10c25ba37b60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:24.379350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-565cd1c0-c0b9-415c-8e54-10c25ba37b60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:24.387111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-565cd1c0-c0b9-415c-8e54-10c25ba37b60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:24.387621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-565cd1c0-c0b9-415c-8e54-10c25ba37b60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:24.388043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-565cd1c0-c0b9-415c-8e54-10c25ba37b60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:24.388766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-565cd1c0-c0b9-415c-8e54-10c25ba37b60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:24.389264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-565cd1c0-c0b9-415c-8e54-10c25ba37b60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:24.389697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-565cd1c0-c0b9-415c-8e54-10c25ba37b60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:24.709406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-565cd1c0-c0b9-415c-8e54-10c25ba37b60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:24.719493 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-565cd1c0-c0b9-415c-8e54-10c25ba37b60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1314 microversion: 2.1 time: 0.345086 Oct 29 01:10:24.725249 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 842/1701] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:24 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:24.739012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-52abd417-497f-4fde-9562-67385fd449cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:24.753953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-52abd417-497f-4fde-9562-67385fd449cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:24.766374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52abd417-497f-4fde-9562-67385fd449cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:24.769988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52abd417-497f-4fde-9562-67385fd449cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:24.770440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52abd417-497f-4fde-9562-67385fd449cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:24.771294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52abd417-497f-4fde-9562-67385fd449cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:24.771827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52abd417-497f-4fde-9562-67385fd449cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:24.774565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52abd417-497f-4fde-9562-67385fd449cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:24.852784 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-52abd417-497f-4fde-9562-67385fd449cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.125546 Oct 29 01:10:24.863397 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 843/1702] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:10:24 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:24.870787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e481d629-be0e-4b07-aa77-02a2715b31ba tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:24.871417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e481d629-be0e-4b07-aa77-02a2715b31ba tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:24.887287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e481d629-be0e-4b07-aa77-02a2715b31ba tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:24.887518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e481d629-be0e-4b07-aa77-02a2715b31ba tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:24.887928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e481d629-be0e-4b07-aa77-02a2715b31ba tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:24.888905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e481d629-be0e-4b07-aa77-02a2715b31ba tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:24.889107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e481d629-be0e-4b07-aa77-02a2715b31ba tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:24.897324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e481d629-be0e-4b07-aa77-02a2715b31ba tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:25.129843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e481d629-be0e-4b07-aa77-02a2715b31ba tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:25.141946 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e481d629-be0e-4b07-aa77-02a2715b31ba tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1485 microversion: 2.1 time: 0.282998 Oct 29 01:10:25.168589 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 844/1703] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:24 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1485 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:25.178453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-674ab48e-061a-483c-a224-6d9ebcbcc7c9 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:25.181300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-674ab48e-061a-483c-a224-6d9ebcbcc7c9 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:25.198899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-674ab48e-061a-483c-a224-6d9ebcbcc7c9 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:25.199523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-674ab48e-061a-483c-a224-6d9ebcbcc7c9 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:25.200159 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-674ab48e-061a-483c-a224-6d9ebcbcc7c9 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:25.201862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-674ab48e-061a-483c-a224-6d9ebcbcc7c9 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:25.204562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-674ab48e-061a-483c-a224-6d9ebcbcc7c9 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:25.205343 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-674ab48e-061a-483c-a224-6d9ebcbcc7c9 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:25.543777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-674ab48e-061a-483c-a224-6d9ebcbcc7c9 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:25.556464 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-674ab48e-061a-483c-a224-6d9ebcbcc7c9 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1395 microversion: 2.1 time: 0.386171 Oct 29 01:10:25.558115 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 845/1704] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:25 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1395 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:25.563557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-21233d74-4d54-454d-8b5f-8982e39d77eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:25.565181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-21233d74-4d54-454d-8b5f-8982e39d77eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:25.573256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21233d74-4d54-454d-8b5f-8982e39d77eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:25.574068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21233d74-4d54-454d-8b5f-8982e39d77eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:25.574751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21233d74-4d54-454d-8b5f-8982e39d77eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:25.575895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21233d74-4d54-454d-8b5f-8982e39d77eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:25.577063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21233d74-4d54-454d-8b5f-8982e39d77eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:25.577815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21233d74-4d54-454d-8b5f-8982e39d77eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:25.837262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-21233d74-4d54-454d-8b5f-8982e39d77eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:25.845953 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-21233d74-4d54-454d-8b5f-8982e39d77eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1313 microversion: 2.1 time: 0.286324 Oct 29 01:10:25.846457 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 846/1705] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:25 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:25.851420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-496ffda9-9df7-414c-a163-efff31d0e134 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:25.852219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-496ffda9-9df7-414c-a163-efff31d0e134 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] [instance: d6ecee3f-2172-4154-9f8a-6365257b44e7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:25.866524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-496ffda9-9df7-414c-a163-efff31d0e134 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:25.867017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-496ffda9-9df7-414c-a163-efff31d0e134 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:25.867686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-496ffda9-9df7-414c-a163-efff31d0e134 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:25.868405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-496ffda9-9df7-414c-a163-efff31d0e134 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:25.868866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-496ffda9-9df7-414c-a163-efff31d0e134 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:25.869331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-496ffda9-9df7-414c-a163-efff31d0e134 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:25.905509 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-496ffda9-9df7-414c-a163-efff31d0e134 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] HTTP exception thrown: Instance d6ecee3f-2172-4154-9f8a-6365257b44e7 could not be found. Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-496ffda9-9df7-414c-a163-efff31d0e134 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Request method failure captured: Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 HTTP/1.1 Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH02dkjDWM_q0yvFvUSns471x-1Ic-J04Sjt79Zc25laS-plkvKYBw9ZBIkxfef4arl8HIsWqM5FjPp5JaJVCEASvdCMI-zi7p60WexiyFtYKOwQr5jX59pNDh9eOAeMztofPQWJTdLL3h70ZzhsCb93cOZZmLjUXCVKijtF4qLo__E Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: ef26e5ad38454b2ab3102864d73268d3 Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-230943148 Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef26e5ad38454b2ab3102864d73268d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef26e5ad38454b2ab3102864d73268d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef26e5ad38454b2ab3102864d73268d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef26e5ad38454b2ab3102864d73268d3", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersAdminNegativeTestJSON-230943148 Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: ef26e5ad38454b2ab3102864d73268d3 Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-230943148 Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersAdminNegativeTestJSON-230943148-project Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: a2163198c1624bf0989594eb0e9f9bf1 Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersAdminNegativeTestJSON-230943148-project Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance d6ecee3f-2172-4154-9f8a-6365257b44e7 could not be found. Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'd6ecee3f-2172-4154-9f8a-6365257b44e7'} Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6ecee3f-2172-4154-9f8a-6365257b44e7 could not be found. Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6ecee3f-2172-4154-9f8a-6365257b44e7 could not be found. Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:25.907816 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:25.913239 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:25.913239 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:25.913239 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:25.913239 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:25.913239 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:10:25.913239 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:10:25.913239 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6ecee3f-2172-4154-9f8a-6365257b44e7 could not be found. Oct 29 01:10:25.913239 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:25.913239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-496ffda9-9df7-414c-a163-efff31d0e134 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] Returning 404 to user: Instance d6ecee3f-2172-4154-9f8a-6365257b44e7 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:25.913239 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-496ffda9-9df7-414c-a163-efff31d0e134 tempest-ServersAdminNegativeTestJSON-230943148 tempest-ServersAdminNegativeTestJSON-230943148-project] 10.222.0.26 "GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7" status: 404 len: 111 microversion: 2.1 time: 0.061957 Oct 29 01:10:25.913239 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 847/1706] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:25 2022] GET /compute/v2.1/servers/d6ecee3f-2172-4154-9f8a-6365257b44e7 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:10:25.915181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4cb5b673-8aa1-4c44-a9b6-71c78c1de363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:25.915692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4cb5b673-8aa1-4c44-a9b6-71c78c1de363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:25.922006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cb5b673-8aa1-4c44-a9b6-71c78c1de363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:25.922566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cb5b673-8aa1-4c44-a9b6-71c78c1de363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:25.923632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cb5b673-8aa1-4c44-a9b6-71c78c1de363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:25.924519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cb5b673-8aa1-4c44-a9b6-71c78c1de363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:25.925079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cb5b673-8aa1-4c44-a9b6-71c78c1de363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:25.925675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cb5b673-8aa1-4c44-a9b6-71c78c1de363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:26.184048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4cb5b673-8aa1-4c44-a9b6-71c78c1de363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:26.194146 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4cb5b673-8aa1-4c44-a9b6-71c78c1de363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1314 microversion: 2.1 time: 0.282806 Oct 29 01:10:26.194725 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 848/1707] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:25 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:26.200127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-e7951423-2c19-444b-a2e3-0a836126e89f req-06d4fd7a-b968-4b10-aee3-b12a69fc6300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "043b00d6-d708-4cee-a1dc-d8ca4ddcae90", "tag": "ca5d4535-1bd9-43b8-8e8d-1d33f9053107"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:26.211185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e7951423-2c19-444b-a2e3-0a836126e89f req-06d4fd7a-b968-4b10-aee3-b12a69fc6300 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:26.211719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e7951423-2c19-444b-a2e3-0a836126e89f req-06d4fd7a-b968-4b10-aee3-b12a69fc6300 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:26.212151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e7951423-2c19-444b-a2e3-0a836126e89f req-06d4fd7a-b968-4b10-aee3-b12a69fc6300 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:26.224811 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-e7951423-2c19-444b-a2e3-0a836126e89f req-06d4fd7a-b968-4b10-aee3-b12a69fc6300 service nova] Creating event network-changed:ca5d4535-1bd9-43b8-8e8d-1d33f9053107 for instance 043b00d6-d708-4cee-a1dc-d8ca4ddcae90 on n-h2-862964-3 Oct 29 01:10:26.230059 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-e7951423-2c19-444b-a2e3-0a836126e89f req-06d4fd7a-b968-4b10-aee3-b12a69fc6300 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033313 Oct 29 01:10:26.230873 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 849/1708] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:26.489324 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3738abb2-763f-4b85-9dd0-d849b0da55b2 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.616786 Oct 29 01:10:26.490244 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 860/1709] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 29 01:10:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:26.505316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4a72e84a-c272-47fc-9b5a-89bb521474d8 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] Calling method '.version_select at 0x7f9d97e6e940>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:26.588893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e370399f-1831-4215-b448-6465b93f7fdd tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:26.590022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e370399f-1831-4215-b448-6465b93f7fdd tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:26.599386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e370399f-1831-4215-b448-6465b93f7fdd tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:26.602300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e370399f-1831-4215-b448-6465b93f7fdd tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:26.603109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e370399f-1831-4215-b448-6465b93f7fdd tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:26.604182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e370399f-1831-4215-b448-6465b93f7fdd tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:26.604919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e370399f-1831-4215-b448-6465b93f7fdd tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:26.605568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e370399f-1831-4215-b448-6465b93f7fdd tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:26.871394 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4a72e84a-c272-47fc-9b5a-89bb521474d8 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/0d1d778a-2291-4b07-b750-e605330fff4e" status: 200 len: 142 microversion: 2.1 time: 0.370625 Oct 29 01:10:26.881029 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 850/1710] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 29 01:10:26 2022] GET /compute/v2.1/os-floating-ips/0d1d778a-2291-4b07-b750-e605330fff4e => generated 142 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:26.886555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ff85c294-6963-4f19-aa59-7bb935f80d18 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:26.888496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ff85c294-6963-4f19-aa59-7bb935f80d18 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:26.896257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e370399f-1831-4215-b448-6465b93f7fdd tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:26.908867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff85c294-6963-4f19-aa59-7bb935f80d18 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:26.909141 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e370399f-1831-4215-b448-6465b93f7fdd tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1395 microversion: 2.1 time: 0.326818 Oct 29 01:10:26.911830 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 861/1711] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:26 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1395 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:10:26.912613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff85c294-6963-4f19-aa59-7bb935f80d18 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:26.916591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff85c294-6963-4f19-aa59-7bb935f80d18 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:26.917376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff85c294-6963-4f19-aa59-7bb935f80d18 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:26.918090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff85c294-6963-4f19-aa59-7bb935f80d18 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:26.920752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff85c294-6963-4f19-aa59-7bb935f80d18 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:26.924878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6802acfc-cac2-4737-8a9c-c350fe05410a tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] Calling method '.version_select at 0x7f9d9ff75b80>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:27.268696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ff85c294-6963-4f19-aa59-7bb935f80d18 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:27.282876 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ff85c294-6963-4f19-aa59-7bb935f80d18 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1313 microversion: 2.1 time: 0.399005 Oct 29 01:10:27.303097 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 851/1712] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:26 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:27.307609 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6802acfc-cac2-4737-8a9c-c350fe05410a tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.396051 Oct 29 01:10:27.308396 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 862/1713] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 29 01:10:26 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:27.308533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-96de1715-8ccc-46a4-ba70-9b259e3274b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:27.310579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-96de1715-8ccc-46a4-ba70-9b259e3274b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:27.323201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-91e107b9-bad1-4cfb-82cd-811f0c8d9bcc tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] Calling method '.version_select at 0x7f9d9770d0d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:27.324273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96de1715-8ccc-46a4-ba70-9b259e3274b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:27.324761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96de1715-8ccc-46a4-ba70-9b259e3274b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:27.327647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96de1715-8ccc-46a4-ba70-9b259e3274b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:27.329439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96de1715-8ccc-46a4-ba70-9b259e3274b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:27.330426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96de1715-8ccc-46a4-ba70-9b259e3274b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:27.331361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96de1715-8ccc-46a4-ba70-9b259e3274b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:27.816356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-96de1715-8ccc-46a4-ba70-9b259e3274b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:27.829809 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-96de1715-8ccc-46a4-ba70-9b259e3274b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1314 microversion: 2.1 time: 0.521949 Oct 29 01:10:27.833332 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 852/1714] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:27 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:27.840619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-b1c765d1-c7f0-4870-9cdb-0e504c58d3b0 req-e858e15d-d8e2-4b24-abdc-00ee6f22b7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5e830e-0f0f-4f57-93c4-a42dcd3a3003", "name": "network-vif-plugged", "status": "completed", "tag": "14849a71-b385-4c87-92d0-caf7083bd7e3"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:27.889705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b1c765d1-c7f0-4870-9cdb-0e504c58d3b0 req-e858e15d-d8e2-4b24-abdc-00ee6f22b7f3 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:27.891219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b1c765d1-c7f0-4870-9cdb-0e504c58d3b0 req-e858e15d-d8e2-4b24-abdc-00ee6f22b7f3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:27.892308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b1c765d1-c7f0-4870-9cdb-0e504c58d3b0 req-e858e15d-d8e2-4b24-abdc-00ee6f22b7f3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:27.910826 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-b1c765d1-c7f0-4870-9cdb-0e504c58d3b0 req-e858e15d-d8e2-4b24-abdc-00ee6f22b7f3 service nova] Creating event network-vif-plugged:14849a71-b385-4c87-92d0-caf7083bd7e3 for instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 on n-h1-862964-3 Oct 29 01:10:27.921966 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-b1c765d1-c7f0-4870-9cdb-0e504c58d3b0 req-e858e15d-d8e2-4b24-abdc-00ee6f22b7f3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086405 Oct 29 01:10:27.923750 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 853/1715] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:27.944409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8c94fcfc-6e82-4e42-ace9-e0c72595a128 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:27.953704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8c94fcfc-6e82-4e42-ace9-e0c72595a128 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:27.963542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c94fcfc-6e82-4e42-ace9-e0c72595a128 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:27.965379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c94fcfc-6e82-4e42-ace9-e0c72595a128 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:27.966088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c94fcfc-6e82-4e42-ace9-e0c72595a128 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:27.967418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c94fcfc-6e82-4e42-ace9-e0c72595a128 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:27.968913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c94fcfc-6e82-4e42-ace9-e0c72595a128 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:27.970132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c94fcfc-6e82-4e42-ace9-e0c72595a128 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:28.496506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8c94fcfc-6e82-4e42-ace9-e0c72595a128 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:28.508526 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8c94fcfc-6e82-4e42-ace9-e0c72595a128 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1395 microversion: 2.1 time: 0.579835 Oct 29 01:10:28.540693 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 854/1716] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:27 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1395 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:28.547146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eee9e4b2-18ec-4c7a-b732-3bdce63f3011 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:28.547820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-eee9e4b2-18ec-4c7a-b732-3bdce63f3011 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:28.554265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eee9e4b2-18ec-4c7a-b732-3bdce63f3011 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:28.561412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eee9e4b2-18ec-4c7a-b732-3bdce63f3011 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:28.561412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eee9e4b2-18ec-4c7a-b732-3bdce63f3011 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:28.561412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eee9e4b2-18ec-4c7a-b732-3bdce63f3011 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:28.561412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eee9e4b2-18ec-4c7a-b732-3bdce63f3011 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:28.561412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eee9e4b2-18ec-4c7a-b732-3bdce63f3011 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:28.786971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-eee9e4b2-18ec-4c7a-b732-3bdce63f3011 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:28.805435 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-eee9e4b2-18ec-4c7a-b732-3bdce63f3011 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1313 microversion: 2.1 time: 0.263061 Oct 29 01:10:28.806073 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 855/1717] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:28 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:28.858824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b1da09e0-8fdd-4d0c-97f5-cb289b73d60f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:28.866120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b1da09e0-8fdd-4d0c-97f5-cb289b73d60f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:28.866120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:28.870985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1da09e0-8fdd-4d0c-97f5-cb289b73d60f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:28.872598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1da09e0-8fdd-4d0c-97f5-cb289b73d60f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:28.873299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1da09e0-8fdd-4d0c-97f5-cb289b73d60f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:28.874568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1da09e0-8fdd-4d0c-97f5-cb289b73d60f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:28.875461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1da09e0-8fdd-4d0c-97f5-cb289b73d60f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:28.876616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1da09e0-8fdd-4d0c-97f5-cb289b73d60f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:29.108751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b1da09e0-8fdd-4d0c-97f5-cb289b73d60f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:29.115252 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-91e107b9-bad1-4cfb-82cd-811f0c8d9bcc tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/0d1d778a-2291-4b07-b750-e605330fff4e" status: 202 len: 0 microversion: 2.1 time: 1.796436 Oct 29 01:10:29.115867 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 863/1718] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:10:27 2022] DELETE /compute/v2.1/os-floating-ips/0d1d778a-2291-4b07-b750-e605330fff4e => generated 0 bytes in 1798 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:10:29.120056 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b1da09e0-8fdd-4d0c-97f5-cb289b73d60f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1314 microversion: 2.1 time: 0.264507 Oct 29 01:10:29.125102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-de955ce1-19ac-4ba0-b6dd-49a24ad30274 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] Action: 'create', calling method: .version_select at 0x7f9d97773b80>, body: {"pool": null} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:29.133726 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 856/1719] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:28 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:10:29.538900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a661cb7a-c2e0-4416-9944-2b220dd832df tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:29.539582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a661cb7a-c2e0-4416-9944-2b220dd832df tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:29.550888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a661cb7a-c2e0-4416-9944-2b220dd832df tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:29.551387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a661cb7a-c2e0-4416-9944-2b220dd832df tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:29.551858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a661cb7a-c2e0-4416-9944-2b220dd832df tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:29.552579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a661cb7a-c2e0-4416-9944-2b220dd832df tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:29.553343 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a661cb7a-c2e0-4416-9944-2b220dd832df tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:29.553774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a661cb7a-c2e0-4416-9944-2b220dd832df tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:30.081865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a661cb7a-c2e0-4416-9944-2b220dd832df tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:30.095491 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a661cb7a-c2e0-4416-9944-2b220dd832df tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1395 microversion: 2.1 time: 0.559338 Oct 29 01:10:30.097134 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 857/1720] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:29 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1395 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:10:30.104339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a63c1738-f1b1-48a7-a7bd-064ef6dc9d81 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:30.105139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a63c1738-f1b1-48a7-a7bd-064ef6dc9d81 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:30.114171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a63c1738-f1b1-48a7-a7bd-064ef6dc9d81 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:30.115555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a63c1738-f1b1-48a7-a7bd-064ef6dc9d81 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:30.116299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a63c1738-f1b1-48a7-a7bd-064ef6dc9d81 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:30.117804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a63c1738-f1b1-48a7-a7bd-064ef6dc9d81 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:30.118751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a63c1738-f1b1-48a7-a7bd-064ef6dc9d81 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:30.119517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a63c1738-f1b1-48a7-a7bd-064ef6dc9d81 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:30.333450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a63c1738-f1b1-48a7-a7bd-064ef6dc9d81 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:30.347929 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a63c1738-f1b1-48a7-a7bd-064ef6dc9d81 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1313 microversion: 2.1 time: 0.249375 Oct 29 01:10:30.348724 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 858/1721] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:30 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:30.365901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-e49a17ed-d84d-434c-96d3-93c6e0f099d5 req-06d0eaf5-c8cd-4fac-abf1-298533b77f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ea836d-4ec8-4646-a8f8-2c199985d829", "name": "network-vif-plugged", "status": "completed", "tag": "a2a1803b-2371-4f50-9500-0cc998cf3afa"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:30.382355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e49a17ed-d84d-434c-96d3-93c6e0f099d5 req-06d0eaf5-c8cd-4fac-abf1-298533b77f99 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:30.382894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e49a17ed-d84d-434c-96d3-93c6e0f099d5 req-06d0eaf5-c8cd-4fac-abf1-298533b77f99 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:30.383346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e49a17ed-d84d-434c-96d3-93c6e0f099d5 req-06d0eaf5-c8cd-4fac-abf1-298533b77f99 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:30.401131 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-e49a17ed-d84d-434c-96d3-93c6e0f099d5 req-06d0eaf5-c8cd-4fac-abf1-298533b77f99 service nova] Creating event network-vif-plugged:a2a1803b-2371-4f50-9500-0cc998cf3afa for instance b7ea836d-4ec8-4646-a8f8-2c199985d829 on n-h2-862964-3 Oct 29 01:10:30.406275 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-e49a17ed-d84d-434c-96d3-93c6e0f099d5 req-06d0eaf5-c8cd-4fac-abf1-298533b77f99 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056343 Oct 29 01:10:30.407823 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 859/1722] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:30.414451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-88d41a3b-9492-4cfe-9f58-b9ac92f365e6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:30.415672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-88d41a3b-9492-4cfe-9f58-b9ac92f365e6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:30.423380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88d41a3b-9492-4cfe-9f58-b9ac92f365e6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:30.426666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88d41a3b-9492-4cfe-9f58-b9ac92f365e6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:30.427399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88d41a3b-9492-4cfe-9f58-b9ac92f365e6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:30.428111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88d41a3b-9492-4cfe-9f58-b9ac92f365e6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:30.431439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88d41a3b-9492-4cfe-9f58-b9ac92f365e6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:30.431908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88d41a3b-9492-4cfe-9f58-b9ac92f365e6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:30.492887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:30.740624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-88d41a3b-9492-4cfe-9f58-b9ac92f365e6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:30.751294 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-88d41a3b-9492-4cfe-9f58-b9ac92f365e6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1501 microversion: 2.1 time: 0.342047 Oct 29 01:10:30.766289 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 860/1723] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:30 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1501 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:30.928218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-43a2b8a9-d374-4550-a8cd-c7f767b3f2ec tempest-FlavorsV2NegativeTest-1323148832 tempest-FlavorsV2NegativeTest-1323148832-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:30.941217 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-43a2b8a9-d374-4550-a8cd-c7f767b3f2ec tempest-FlavorsV2NegativeTest-1323148832 tempest-FlavorsV2NegativeTest-1323148832-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.187098 Oct 29 01:10:30.945196 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 861/1724] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:10:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:31.123522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f6a8708c-7af6-4186-bd2e-36a5d1bc42d2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:31.125778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f6a8708c-7af6-4186-bd2e-36a5d1bc42d2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:31.133659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a8708c-7af6-4186-bd2e-36a5d1bc42d2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:31.134113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a8708c-7af6-4186-bd2e-36a5d1bc42d2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:31.134558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a8708c-7af6-4186-bd2e-36a5d1bc42d2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:31.135264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a8708c-7af6-4186-bd2e-36a5d1bc42d2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:31.135910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a8708c-7af6-4186-bd2e-36a5d1bc42d2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:31.136345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a8708c-7af6-4186-bd2e-36a5d1bc42d2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:31.368194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f6a8708c-7af6-4186-bd2e-36a5d1bc42d2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:31.376940 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f6a8708c-7af6-4186-bd2e-36a5d1bc42d2 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1395 microversion: 2.1 time: 0.257225 Oct 29 01:10:31.377960 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 862/1725] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:31 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1395 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:10:31.383167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8d1d03b8-3746-4751-aad6-dbb72a624f40 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:31.384063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8d1d03b8-3746-4751-aad6-dbb72a624f40 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:31.390600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d1d03b8-3746-4751-aad6-dbb72a624f40 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:31.391036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d1d03b8-3746-4751-aad6-dbb72a624f40 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:31.391884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d1d03b8-3746-4751-aad6-dbb72a624f40 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:31.392668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d1d03b8-3746-4751-aad6-dbb72a624f40 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:31.393219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d1d03b8-3746-4751-aad6-dbb72a624f40 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:31.393715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d1d03b8-3746-4751-aad6-dbb72a624f40 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:31.667876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8d1d03b8-3746-4751-aad6-dbb72a624f40 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:31.676688 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8d1d03b8-3746-4751-aad6-dbb72a624f40 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1313 microversion: 2.1 time: 0.297496 Oct 29 01:10:31.677331 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 863/1726] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:31 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:31.699530 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-de955ce1-19ac-4ba0-b6dd-49a24ad30274 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.578123 Oct 29 01:10:31.700131 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 864/1727] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 29 01:10:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:31.712825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-992f0be9-6808-42c3-94d5-1b82dd17b8e9 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] Calling method '.version_select at 0x7f9d97f92ca0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:32.116044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8f1ea0ce-a44c-4c17-81ed-81e9d32b28d1 tempest-FlavorsV2NegativeTest-1323148832 tempest-FlavorsV2NegativeTest-1323148832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1721958435", "imageRef": "9c882fe1-3cbf-497b-a775-13485ec1c36a", "flavorRef": "452"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:32.196989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-8f1ea0ce-a44c-4c17-81ed-81e9d32b28d1 tempest-FlavorsV2NegativeTest-1323148832 tempest-FlavorsV2NegativeTest-1323148832-project] validate_networks() for None {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:10:32.639290 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-8f1ea0ce-a44c-4c17-81ed-81e9d32b28d1 tempest-FlavorsV2NegativeTest-1323148832 tempest-FlavorsV2NegativeTest-1323148832-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8f1ea0ce-a44c-4c17-81ed-81e9d32b28d1 tempest-FlavorsV2NegativeTest-1323148832 tempest-FlavorsV2NegativeTest-1323148832-project] Request method failure captured: Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 143 Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH2GQ171uPrQUxSoLpHr-81VusikwxKwr54xpCp4Tat6uRvs_Atee7M6g83l_QA3KukQnEekuCE58fwEbTmp9Uy-2p9vmsp54xbWYslmFxAlQIP_36DEsEOnloVjzzNxU3D2tOH74uYRhgQS1W3jcYTamciw7mJoWJFbrPko328WzUE Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 4c6363827f39485896995e36c5a2c0a7 Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-FlavorsV2NegativeTest-1323148832 Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c6363827f39485896995e36c5a2c0a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4c6363827f39485896995e36c5a2c0a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c6363827f39485896995e36c5a2c0a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4c6363827f39485896995e36c5a2c0a7", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-FlavorsV2NegativeTest-1323148832 Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 4c6363827f39485896995e36c5a2c0a7 Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1323148832 Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-FlavorsV2NegativeTest-1323148832-project Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 1e4e32be1c684990a76cdf828fcdeadc Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-FlavorsV2NegativeTest-1323148832-project Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1721958435", "imageRef": "9c882fe1-3cbf-497b-a775-13485ec1c36a", "flavorRef": "452"}} Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: exception: Flavor's memory is too small for requested image. Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1721958435', 'imageRef': '9c882fe1-3cbf-497b-a775-13485ec1c36a', 'flavorRef': '452'}}} Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:10:32.649440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:10:32.654626 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:10:32.654626 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:10:32.654626 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 01:10:32.654626 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 29 01:10:32.654626 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 01:10:32.654626 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 29 01:10:32.654626 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:32.654626 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:32.654626 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:32.654626 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:32.654626 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:32.654626 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:32.654626 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:10:32.654626 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:10:32.654626 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 29 01:10:32.654626 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:32.663017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8f1ea0ce-a44c-4c17-81ed-81e9d32b28d1 tempest-FlavorsV2NegativeTest-1323148832 tempest-FlavorsV2NegativeTest-1323148832-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:32.668013 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8f1ea0ce-a44c-4c17-81ed-81e9d32b28d1 tempest-FlavorsV2NegativeTest-1323148832 tempest-FlavorsV2NegativeTest-1323148832-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.552706 Oct 29 01:10:32.668516 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 865/1728] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:10:32 2022] POST /compute/v2.1/servers => generated 93 bytes in 559 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 29 01:10:32.681109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e7dba4cc-0505-440b-b396-185af973d6ff tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:32.682284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e7dba4cc-0505-440b-b396-185af973d6ff tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:32.700523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7dba4cc-0505-440b-b396-185af973d6ff tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:32.701069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7dba4cc-0505-440b-b396-185af973d6ff tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:32.701642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7dba4cc-0505-440b-b396-185af973d6ff tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:32.702410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7dba4cc-0505-440b-b396-185af973d6ff tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:32.703244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7dba4cc-0505-440b-b396-185af973d6ff tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:32.703841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7dba4cc-0505-440b-b396-185af973d6ff tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:33.055534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e7dba4cc-0505-440b-b396-185af973d6ff tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:33.062558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:33.066714 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e7dba4cc-0505-440b-b396-185af973d6ff tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1395 microversion: 2.1 time: 0.396978 Oct 29 01:10:33.081195 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-992f0be9-6808-42c3-94d5-1b82dd17b8e9 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/38f9efea-f236-4eac-82e9-afb1cb4d2655" status: 202 len: 0 microversion: 2.1 time: 1.359470 Oct 29 01:10:33.081195 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 864/1729] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:10:31 2022] DELETE /compute/v2.1/os-floating-ips/38f9efea-f236-4eac-82e9-afb1cb4d2655 => generated 0 bytes in 1365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:10:33.081195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-de73d400-c997-46a6-88f7-06bc04151f4e req-1cc31290-b26e-4ecf-b7a6-5e2fee6f3c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a", "name": "network-vif-plugged", "status": "completed", "tag": "99177002-b761-4c56-a7bb-5911f9934cca"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:33.082814 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 866/1730] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:32 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1395 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:33.089996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c863ed2d-a337-4092-8104-bca663c4349a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:33.090192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-de73d400-c997-46a6-88f7-06bc04151f4e req-1cc31290-b26e-4ecf-b7a6-5e2fee6f3c8a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:33.090738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-de73d400-c997-46a6-88f7-06bc04151f4e req-1cc31290-b26e-4ecf-b7a6-5e2fee6f3c8a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:33.091248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-de73d400-c997-46a6-88f7-06bc04151f4e req-1cc31290-b26e-4ecf-b7a6-5e2fee6f3c8a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:33.091546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c863ed2d-a337-4092-8104-bca663c4349a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:33.098748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c863ed2d-a337-4092-8104-bca663c4349a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:33.099548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c863ed2d-a337-4092-8104-bca663c4349a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:33.100217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c863ed2d-a337-4092-8104-bca663c4349a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:33.101371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c863ed2d-a337-4092-8104-bca663c4349a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:33.102054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c863ed2d-a337-4092-8104-bca663c4349a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:33.102712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c863ed2d-a337-4092-8104-bca663c4349a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:33.104173 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-de73d400-c997-46a6-88f7-06bc04151f4e req-1cc31290-b26e-4ecf-b7a6-5e2fee6f3c8a service nova] Creating event network-vif-plugged:99177002-b761-4c56-a7bb-5911f9934cca for instance c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a on n-h2-862964-3 Oct 29 01:10:33.113193 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-de73d400-c997-46a6-88f7-06bc04151f4e req-1cc31290-b26e-4ecf-b7a6-5e2fee6f3c8a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038685 Oct 29 01:10:33.114188 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 865/1731] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:33.135980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-99791585-7706-4902-a5f9-92e1007ad0b1 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] Calling method '.version_select at 0x7f9d97de4d30>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:33.222743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG neutronclient.v2_0.client [None req-99791585-7706-4902-a5f9-92e1007ad0b1 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 38f9efea-f236-4eac-82e9-afb1cb4d2655 could not be found", "detail": ""}} {{(pid=121100) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:10:33.223587 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-99791585-7706-4902-a5f9-92e1007ad0b1 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] HTTP exception thrown: Floating IP not found for ID 38f9efea-f236-4eac-82e9-afb1cb4d2655 Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-99791585-7706-4902-a5f9-92e1007ad0b1 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] Request method failure captured: Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-floating-ips/38f9efea-f236-4eac-82e9-afb1cb4d2655 HTTP/1.1 Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH1_5wToPFc4wkRweAtgW32TN18yk2FoNpk_Iv9w-gIucRvO_csqmgQc6Ynic9tKdAmUWOgm1I-DbG5K7mfjmV-mLink4uP5Io28_UVsIjmz-k4mHN5nbiTcKsEXmnDOlc_1TS9Y9pAa-JbFlAB08Nb-GCY5YbDOtrWnnHFJvjzOYAI Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 13c1ccb2a4234b8b8ef01051a155fa52 Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FloatingIPsTestJSON-1140921175 Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13c1ccb2a4234b8b8ef01051a155fa52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/13c1ccb2a4234b8b8ef01051a155fa52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13c1ccb2a4234b8b8ef01051a155fa52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_13c1ccb2a4234b8b8ef01051a155fa52", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FloatingIPsTestJSON-1140921175 Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 13c1ccb2a4234b8b8ef01051a155fa52 Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1140921175 Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FloatingIPsTestJSON-1140921175-project Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: c91c80dc27384b9d832fa37bba22b1a4 Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FloatingIPsTestJSON-1140921175-project Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: exception: Floating IP not found for ID 38f9efea-f236-4eac-82e9-afb1cb4d2655 Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '38f9efea-f236-4eac-82e9-afb1cb4d2655'} Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 38f9efea-f236-4eac-82e9-afb1cb4d2655 could not be found Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f7dd064-cd55-4191-9867-5d19165d1e00'] Oct 29 01:10:33.225777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 38f9efea-f236-4eac-82e9-afb1cb4d2655. Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 38f9efea-f236-4eac-82e9-afb1cb4d2655 Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 38f9efea-f236-4eac-82e9-afb1cb4d2655 Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-99791585-7706-4902-a5f9-92e1007ad0b1 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] Returning 404 to user: Floating IP not found for ID 38f9efea-f236-4eac-82e9-afb1cb4d2655 {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-99791585-7706-4902-a5f9-92e1007ad0b1 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/38f9efea-f236-4eac-82e9-afb1cb4d2655" status: 404 len: 111 microversion: 2.1 time: 0.114269 Oct 29 01:10:33.233124 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 866/1732] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 29 01:10:33 2022] GET /compute/v2.1/os-floating-ips/38f9efea-f236-4eac-82e9-afb1cb4d2655 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:10:33.241765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-08c74c7b-d9ed-4e49-8bf2-6ca7a8d43519 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] Calling method '.version_select at 0x7f9d9c963dc0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:33.309566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG neutronclient.v2_0.client [None req-08c74c7b-d9ed-4e49-8bf2-6ca7a8d43519 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 38f9efea-f236-4eac-82e9-afb1cb4d2655 could not be found", "detail": ""}} {{(pid=121100) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-08c74c7b-d9ed-4e49-8bf2-6ca7a8d43519 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] HTTP exception thrown: Floating IP not found for ID 38f9efea-f236-4eac-82e9-afb1cb4d2655 Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-08c74c7b-d9ed-4e49-8bf2-6ca7a8d43519 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] Request method failure captured: Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/os-floating-ips/38f9efea-f236-4eac-82e9-afb1cb4d2655 HTTP/1.1 Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH1_5wToPFc4wkRweAtgW32TN18yk2FoNpk_Iv9w-gIucRvO_csqmgQc6Ynic9tKdAmUWOgm1I-DbG5K7mfjmV-mLink4uP5Io28_UVsIjmz-k4mHN5nbiTcKsEXmnDOlc_1TS9Y9pAa-JbFlAB08Nb-GCY5YbDOtrWnnHFJvjzOYAI Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 13c1ccb2a4234b8b8ef01051a155fa52 Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FloatingIPsTestJSON-1140921175 Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13c1ccb2a4234b8b8ef01051a155fa52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/13c1ccb2a4234b8b8ef01051a155fa52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13c1ccb2a4234b8b8ef01051a155fa52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_13c1ccb2a4234b8b8ef01051a155fa52", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FloatingIPsTestJSON-1140921175 Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 13c1ccb2a4234b8b8ef01051a155fa52 Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1140921175 Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FloatingIPsTestJSON-1140921175-project Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: c91c80dc27384b9d832fa37bba22b1a4 Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FloatingIPsTestJSON-1140921175-project Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: exception: Floating IP not found for ID 38f9efea-f236-4eac-82e9-afb1cb4d2655 Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '38f9efea-f236-4eac-82e9-afb1cb4d2655'} Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:10:33.312966 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 38f9efea-f236-4eac-82e9-afb1cb4d2655 could not be found Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8613cba-3d87-4e54-a829-201a93c89eda'] Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 38f9efea-f236-4eac-82e9-afb1cb4d2655. Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 38f9efea-f236-4eac-82e9-afb1cb4d2655 Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 38f9efea-f236-4eac-82e9-afb1cb4d2655 Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-08c74c7b-d9ed-4e49-8bf2-6ca7a8d43519 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] Returning 404 to user: Floating IP not found for ID 38f9efea-f236-4eac-82e9-afb1cb4d2655 {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-08c74c7b-d9ed-4e49-8bf2-6ca7a8d43519 tempest-FloatingIPsTestJSON-1140921175 tempest-FloatingIPsTestJSON-1140921175-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/38f9efea-f236-4eac-82e9-afb1cb4d2655" status: 404 len: 111 microversion: 2.1 time: 0.077677 Oct 29 01:10:33.319040 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 867/1733] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:10:33 2022] DELETE /compute/v2.1/os-floating-ips/38f9efea-f236-4eac-82e9-afb1cb4d2655 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:10:33.325395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a843d43e-fdf7-459d-b3b3-679495ac1140 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:33.330172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a843d43e-fdf7-459d-b3b3-679495ac1140 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:33.340871 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a843d43e-fdf7-459d-b3b3-679495ac1140 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:33.350457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a843d43e-fdf7-459d-b3b3-679495ac1140 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:33.351111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a843d43e-fdf7-459d-b3b3-679495ac1140 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:33.353020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a843d43e-fdf7-459d-b3b3-679495ac1140 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:33.355636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a843d43e-fdf7-459d-b3b3-679495ac1140 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:33.356385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a843d43e-fdf7-459d-b3b3-679495ac1140 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:33.506586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c863ed2d-a337-4092-8104-bca663c4349a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:33.518290 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c863ed2d-a337-4092-8104-bca663c4349a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1463 microversion: 2.1 time: 0.433216 Oct 29 01:10:33.519172 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 867/1734] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:33 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1463 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:33.546873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-18b072ac-e900-476b-8cfc-4cb7fe1c641f tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:33.548648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-18b072ac-e900-476b-8cfc-4cb7fe1c641f tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:33.556287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18b072ac-e900-476b-8cfc-4cb7fe1c641f tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:33.557096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18b072ac-e900-476b-8cfc-4cb7fe1c641f tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:33.558519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18b072ac-e900-476b-8cfc-4cb7fe1c641f tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:33.559692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18b072ac-e900-476b-8cfc-4cb7fe1c641f tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:33.560753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18b072ac-e900-476b-8cfc-4cb7fe1c641f tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:33.563970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18b072ac-e900-476b-8cfc-4cb7fe1c641f tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:33.728118 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a843d43e-fdf7-459d-b3b3-679495ac1140 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1811 microversion: 2.1 time: 0.411422 Oct 29 01:10:33.742465 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 868/1735] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:33 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1811 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:33.765122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c0b5ad2-ec3a-4d4a-905a-8de031b4d531 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:33.783735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c0b5ad2-ec3a-4d4a-905a-8de031b4d531 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:33.785274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c0b5ad2-ec3a-4d4a-905a-8de031b4d531 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:33.786928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c0b5ad2-ec3a-4d4a-905a-8de031b4d531 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:33.799001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c0b5ad2-ec3a-4d4a-905a-8de031b4d531 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:33.799627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c0b5ad2-ec3a-4d4a-905a-8de031b4d531 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:33.800390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c0b5ad2-ec3a-4d4a-905a-8de031b4d531 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:33.860379 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9c0b5ad2-ec3a-4d4a-905a-8de031b4d531 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.101273 Oct 29 01:10:33.861257 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 869/1736] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Oct 29 01:10:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:10:33.866278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fe690226-95f2-4eee-ae61-2b22a0851499 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "838f8644-0a24-4d5d-93e1-dc07e3a43d84"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:33.869077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fe690226-95f2-4eee-ae61-2b22a0851499 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:33.880253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe690226-95f2-4eee-ae61-2b22a0851499 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:33.881086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe690226-95f2-4eee-ae61-2b22a0851499 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:33.890865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe690226-95f2-4eee-ae61-2b22a0851499 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:33.890865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe690226-95f2-4eee-ae61-2b22a0851499 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:33.890865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe690226-95f2-4eee-ae61-2b22a0851499 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:33.890865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe690226-95f2-4eee-ae61-2b22a0851499 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:33.981986 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-18b072ac-e900-476b-8cfc-4cb7fe1c641f tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1614 microversion: 2.1 time: 0.439919 Oct 29 01:10:33.985947 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 868/1737] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:33 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1614 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:34.013111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4906df1c-0955-462f-b67d-4dae83ab518b tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:34.014103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4906df1c-0955-462f-b67d-4dae83ab518b tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:34.023604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4906df1c-0955-462f-b67d-4dae83ab518b tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:34.025599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4906df1c-0955-462f-b67d-4dae83ab518b tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:34.025898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4906df1c-0955-462f-b67d-4dae83ab518b tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:34.026858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4906df1c-0955-462f-b67d-4dae83ab518b tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:34.028431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4906df1c-0955-462f-b67d-4dae83ab518b tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:34.029107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4906df1c-0955-462f-b67d-4dae83ab518b tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:34.115105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4906df1c-0955-462f-b67d-4dae83ab518b tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '697b41dede9e4b13bee4388eeea17e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e269112846c4a24a4b95af97ad0a362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:34.120189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4906df1c-0955-462f-b67d-4dae83ab518b tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] flavor_id is None. Assuming migration. {{(pid=121099) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 29 01:10:34.120189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4906df1c-0955-462f-b67d-4dae83ab518b tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121099) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 01:10:34.771811 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4906df1c-0955-462f-b67d-4dae83ab518b tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829/action" status: 202 len: 0 microversion: 2.1 time: 0.762450 Oct 29 01:10:34.778835 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 869/1738] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:10:34 2022] POST /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829/action => generated 0 bytes in 771 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:10:34.789416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a2ed03d3-e673-4d42-9ea5-563c38adab03 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:34.790548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a2ed03d3-e673-4d42-9ea5-563c38adab03 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:34.803754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2ed03d3-e673-4d42-9ea5-563c38adab03 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:34.804323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2ed03d3-e673-4d42-9ea5-563c38adab03 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:34.804855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2ed03d3-e673-4d42-9ea5-563c38adab03 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:34.807230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2ed03d3-e673-4d42-9ea5-563c38adab03 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:34.808117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2ed03d3-e673-4d42-9ea5-563c38adab03 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:34.808996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2ed03d3-e673-4d42-9ea5-563c38adab03 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:34.931815 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fe690226-95f2-4eee-ae61-2b22a0851499 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "POST /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.069097 Oct 29 01:10:34.934406 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 870/1739] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 29 01:10:33 2022] POST /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003/os-volume_attachments => generated 194 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:34.963467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e912a4b1-556c-4313-a193-1834cebe7406 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:34.969193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e912a4b1-556c-4313-a193-1834cebe7406 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:35.007986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e912a4b1-556c-4313-a193-1834cebe7406 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:35.008496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e912a4b1-556c-4313-a193-1834cebe7406 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:35.009021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e912a4b1-556c-4313-a193-1834cebe7406 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:35.014114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e912a4b1-556c-4313-a193-1834cebe7406 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:35.016821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e912a4b1-556c-4313-a193-1834cebe7406 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:35.020034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e912a4b1-556c-4313-a193-1834cebe7406 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:35.257299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a2ed03d3-e673-4d42-9ea5-563c38adab03 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:35.267238 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a2ed03d3-e673-4d42-9ea5-563c38adab03 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1395 microversion: 2.1 time: 0.487095 Oct 29 01:10:35.267718 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 870/1740] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:34 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1395 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:35.342908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e912a4b1-556c-4313-a193-1834cebe7406 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:35.355378 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e912a4b1-556c-4313-a193-1834cebe7406 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1472 microversion: 2.1 time: 0.419214 Oct 29 01:10:35.370106 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 871/1741] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:34 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1472 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:36.290496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f42da56f-b392-4883-a2ba-e87b201d00b4 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:36.291109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f42da56f-b392-4883-a2ba-e87b201d00b4 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:36.304385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f42da56f-b392-4883-a2ba-e87b201d00b4 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:36.309278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f42da56f-b392-4883-a2ba-e87b201d00b4 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:36.310092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f42da56f-b392-4883-a2ba-e87b201d00b4 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:36.311017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f42da56f-b392-4883-a2ba-e87b201d00b4 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:36.311661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f42da56f-b392-4883-a2ba-e87b201d00b4 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:36.312258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f42da56f-b392-4883-a2ba-e87b201d00b4 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:36.381581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-af9fee07-bcdf-414d-a6ad-d5c89637afc3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:36.382882 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-af9fee07-bcdf-414d-a6ad-d5c89637afc3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:36.405453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af9fee07-bcdf-414d-a6ad-d5c89637afc3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:36.405950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af9fee07-bcdf-414d-a6ad-d5c89637afc3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:36.418207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af9fee07-bcdf-414d-a6ad-d5c89637afc3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:36.419599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af9fee07-bcdf-414d-a6ad-d5c89637afc3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:36.420094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af9fee07-bcdf-414d-a6ad-d5c89637afc3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:36.420537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af9fee07-bcdf-414d-a6ad-d5c89637afc3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:37.646507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f42da56f-b392-4883-a2ba-e87b201d00b4 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:37.662343 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f42da56f-b392-4883-a2ba-e87b201d00b4 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1575 microversion: 2.1 time: 1.376734 Oct 29 01:10:37.662932 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 871/1742] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:36 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1575 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:10:37.721918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-af9fee07-bcdf-414d-a6ad-d5c89637afc3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:37.744964 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-af9fee07-bcdf-414d-a6ad-d5c89637afc3 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1472 microversion: 2.1 time: 1.367920 Oct 29 01:10:37.754684 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 872/1743] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:36 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1472 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:10:37.766724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7c0c6c69-0823-44d5-ba75-eaca2302faa0 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:37.766724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7c0c6c69-0823-44d5-ba75-eaca2302faa0 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:37.809915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c0c6c69-0823-44d5-ba75-eaca2302faa0 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:37.810827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c0c6c69-0823-44d5-ba75-eaca2302faa0 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:37.813348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c0c6c69-0823-44d5-ba75-eaca2302faa0 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:37.818739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c0c6c69-0823-44d5-ba75-eaca2302faa0 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:37.819721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c0c6c69-0823-44d5-ba75-eaca2302faa0 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:37.821009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c0c6c69-0823-44d5-ba75-eaca2302faa0 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:38.014803 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-41cf0de2-ff31-48f4-8c5a-e9abafa43018 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] 10.222.0.26 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.337715 Oct 29 01:10:38.028803 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 872/1744] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Oct 29 01:10:37 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 01:10:38.037682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f9a37fb5-e7be-4e28-b75a-51a53fa2d4f1 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] Calling method '.version_select at 0x7f9d9feea8b0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:38.066663 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7c0c6c69-0823-44d5-ba75-eaca2302faa0 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.309135 Oct 29 01:10:38.067471 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 873/1745] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:10:37 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a/os-interface => generated 284 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:38.130552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-64f3ff81-4f0b-46c5-ac3a-eb62928f9b89 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "814e5035-9fc1-4730-b0ce-5ffe0a49ca56", "device": "/dev/xvdb"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:38.134560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-64f3ff81-4f0b-46c5-ac3a-eb62928f9b89 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:38.141039 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-f9a37fb5-e7be-4e28-b75a-51a53fa2d4f1 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] HTTP exception thrown: Image not found. Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f9a37fb5-e7be-4e28-b75a-51a53fa2d4f1 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] Request method failure captured: Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH2Mm1hGZREGPVr7D3LhIqdBS7mD7UZW0bRBo0dtrpe-z2HhNLCTimsgAi_7XYqUuHcO7iHSg-Dp9YdYvPSy0ksT4vLMhPG2aAOGH0Ut2lVoTUDDh7qZbNXNjfwHafp9XmK9vG5ZRmpFW7qi5cXrUs8M9sSCGO_EzctkK1_33X1JQsc Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 9f6f4f7101a54876a4d237eb45e016ac Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1486002127 Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f6f4f7101a54876a4d237eb45e016ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9f6f4f7101a54876a4d237eb45e016ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f6f4f7101a54876a4d237eb45e016ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9f6f4f7101a54876a4d237eb45e016ac", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1486002127 Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 9f6f4f7101a54876a4d237eb45e016ac Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1486002127 Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesDeleteNegativeTestJSON-1486002127-project Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 31f84385a86d483bbcea2b5831efaa79 Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1486002127-project Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: exception: Image not found. Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '-1'} Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.145675 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f9a37fb5-e7be-4e28-b75a-51a53fa2d4f1 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] Returning 404 to user: Image not found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f9a37fb5-e7be-4e28-b75a-51a53fa2d4f1 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] 10.222.0.26 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.118938 Oct 29 01:10:38.156528 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 873/1746] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Oct 29 01:10:38 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:10:38.184504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5bbe7a08-2846-44f2-883c-522c01c055d0 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] Calling method '.version_select at 0x7f9d9ff64820>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:38.192999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64f3ff81-4f0b-46c5-ac3a-eb62928f9b89 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:38.193531 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64f3ff81-4f0b-46c5-ac3a-eb62928f9b89 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:38.193980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64f3ff81-4f0b-46c5-ac3a-eb62928f9b89 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:38.208464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64f3ff81-4f0b-46c5-ac3a-eb62928f9b89 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:38.209055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64f3ff81-4f0b-46c5-ac3a-eb62928f9b89 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:38.214421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64f3ff81-4f0b-46c5-ac3a-eb62928f9b89 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-5bbe7a08-2846-44f2-883c-522c01c055d0 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] HTTP exception thrown: Image not found. Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5bbe7a08-2846-44f2-883c-522c01c055d0 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] Request method failure captured: Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/images/10e63785-c3b2-4662-8c37-0b3a6969c89j HTTP/1.1 Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH2Mm1hGZREGPVr7D3LhIqdBS7mD7UZW0bRBo0dtrpe-z2HhNLCTimsgAi_7XYqUuHcO7iHSg-Dp9YdYvPSy0ksT4vLMhPG2aAOGH0Ut2lVoTUDDh7qZbNXNjfwHafp9XmK9vG5ZRmpFW7qi5cXrUs8M9sSCGO_EzctkK1_33X1JQsc Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 9f6f4f7101a54876a4d237eb45e016ac Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1486002127 Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f6f4f7101a54876a4d237eb45e016ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9f6f4f7101a54876a4d237eb45e016ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f6f4f7101a54876a4d237eb45e016ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9f6f4f7101a54876a4d237eb45e016ac", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1486002127 Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 9f6f4f7101a54876a4d237eb45e016ac Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1486002127 Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesDeleteNegativeTestJSON-1486002127-project Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 31f84385a86d483bbcea2b5831efaa79 Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1486002127-project Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: exception: Image not found. Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '10e63785-c3b2-4662-8c37-0b3a6969c89j'} Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 10e63785-c3b2-4662-8c37-0b3a6969c89j to delete Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 01:10:38.274623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 10e63785-c3b2-4662-8c37-0b3a6969c89j could not be found. Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5bbe7a08-2846-44f2-883c-522c01c055d0 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] Returning 404 to user: Image not found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5bbe7a08-2846-44f2-883c-522c01c055d0 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] 10.222.0.26 "DELETE /compute/v2.1/images/10e63785-c3b2-4662-8c37-0b3a6969c89j" status: 404 len: 62 microversion: 2.1 time: 0.100779 Oct 29 01:10:38.279731 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 874/1747] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:38 2022] DELETE /compute/v2.1/images/10e63785-c3b2-4662-8c37-0b3a6969c89j => generated 62 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:10:38.284248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4723df2c-d309-4c8b-8aa6-5785853d67a5 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] Calling method '.version_select at 0x7f9d977783a0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:38.334955 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-4723df2c-d309-4c8b-8aa6-5785853d67a5 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] HTTP exception thrown: Image not found. Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4723df2c-d309-4c8b-8aa6-5785853d67a5 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] Request method failure captured: Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/images/8b6618f0-6412-4bd9-985b-ff03f04d73bc1 HTTP/1.1 Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH2Mm1hGZREGPVr7D3LhIqdBS7mD7UZW0bRBo0dtrpe-z2HhNLCTimsgAi_7XYqUuHcO7iHSg-Dp9YdYvPSy0ksT4vLMhPG2aAOGH0Ut2lVoTUDDh7qZbNXNjfwHafp9XmK9vG5ZRmpFW7qi5cXrUs8M9sSCGO_EzctkK1_33X1JQsc Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 9f6f4f7101a54876a4d237eb45e016ac Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1486002127 Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f6f4f7101a54876a4d237eb45e016ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9f6f4f7101a54876a4d237eb45e016ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f6f4f7101a54876a4d237eb45e016ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9f6f4f7101a54876a4d237eb45e016ac", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1486002127 Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 9f6f4f7101a54876a4d237eb45e016ac Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1486002127 Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesDeleteNegativeTestJSON-1486002127-project Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 31f84385a86d483bbcea2b5831efaa79 Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1486002127-project Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: exception: Image not found. Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '8b6618f0-6412-4bd9-985b-ff03f04d73bc1'} Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8b6618f0-6412-4bd9-985b-ff03f04d73bc1 to delete Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8b6618f0-6412-4bd9-985b-ff03f04d73bc1 could not be found. Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:38.336726 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4723df2c-d309-4c8b-8aa6-5785853d67a5 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] Returning 404 to user: Image not found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4723df2c-d309-4c8b-8aa6-5785853d67a5 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] 10.222.0.26 "DELETE /compute/v2.1/images/8b6618f0-6412-4bd9-985b-ff03f04d73bc1" status: 404 len: 62 microversion: 2.1 time: 0.057789 Oct 29 01:10:38.341948 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 875/1748] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:10:38 2022] DELETE /compute/v2.1/images/8b6618f0-6412-4bd9-985b-ff03f04d73bc1 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:10:38.358058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4cf9c55b-5420-4b20-9772-71c3e21892a5 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] Calling method '.version_select at 0x7f9d9ff3d4c0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:38.413790 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-4cf9c55b-5420-4b20-9772-71c3e21892a5 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] HTTP exception thrown: Image not found. Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4cf9c55b-5420-4b20-9772-71c3e21892a5 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] Request method failure captured: Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/images/tempest-invalid-438070934 HTTP/1.1 Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH2Mm1hGZREGPVr7D3LhIqdBS7mD7UZW0bRBo0dtrpe-z2HhNLCTimsgAi_7XYqUuHcO7iHSg-Dp9YdYvPSy0ksT4vLMhPG2aAOGH0Ut2lVoTUDDh7qZbNXNjfwHafp9XmK9vG5ZRmpFW7qi5cXrUs8M9sSCGO_EzctkK1_33X1JQsc Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 9f6f4f7101a54876a4d237eb45e016ac Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1486002127 Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f6f4f7101a54876a4d237eb45e016ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9f6f4f7101a54876a4d237eb45e016ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f6f4f7101a54876a4d237eb45e016ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9f6f4f7101a54876a4d237eb45e016ac", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1486002127 Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 9f6f4f7101a54876a4d237eb45e016ac Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1486002127 Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesDeleteNegativeTestJSON-1486002127-project Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 31f84385a86d483bbcea2b5831efaa79 Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1486002127-project Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: exception: Image not found. Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'tempest-invalid-438070934'} Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-438070934 to delete Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-438070934 could not be found. Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.417239 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4cf9c55b-5420-4b20-9772-71c3e21892a5 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] Returning 404 to user: Image not found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4cf9c55b-5420-4b20-9772-71c3e21892a5 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] 10.222.0.26 "DELETE /compute/v2.1/images/tempest-invalid-438070934" status: 404 len: 62 microversion: 2.1 time: 0.070297 Oct 29 01:10:38.429714 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 876/1749] 10.222.0.26 () {58 vars in 1203 bytes} [Sat Oct 29 01:10:38 2022] DELETE /compute/v2.1/images/tempest-invalid-438070934 => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:10:38.439730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-061ed915-4577-4201-91cb-43e9834c1840 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] Calling method '.version_select at 0x7f9d9ff64e50>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:38.494570 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-061ed915-4577-4201-91cb-43e9834c1840 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] HTTP exception thrown: Image not found. Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-061ed915-4577-4201-91cb-43e9834c1840 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] Request method failure captured: Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/images/6a81fc43-2312-4b61-8309-acba1b60343b HTTP/1.1 Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH2Mm1hGZREGPVr7D3LhIqdBS7mD7UZW0bRBo0dtrpe-z2HhNLCTimsgAi_7XYqUuHcO7iHSg-Dp9YdYvPSy0ksT4vLMhPG2aAOGH0Ut2lVoTUDDh7qZbNXNjfwHafp9XmK9vG5ZRmpFW7qi5cXrUs8M9sSCGO_EzctkK1_33X1JQsc Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 9f6f4f7101a54876a4d237eb45e016ac Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1486002127 Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f6f4f7101a54876a4d237eb45e016ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9f6f4f7101a54876a4d237eb45e016ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f6f4f7101a54876a4d237eb45e016ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9f6f4f7101a54876a4d237eb45e016ac", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1486002127 Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 9f6f4f7101a54876a4d237eb45e016ac Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1486002127 Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesDeleteNegativeTestJSON-1486002127-project Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 31f84385a86d483bbcea2b5831efaa79 Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1486002127-project Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: exception: Image not found. Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '6a81fc43-2312-4b61-8309-acba1b60343b'} Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6a81fc43-2312-4b61-8309-acba1b60343b to delete Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6a81fc43-2312-4b61-8309-acba1b60343b could not be found. Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:38.496379 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-061ed915-4577-4201-91cb-43e9834c1840 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] Returning 404 to user: Image not found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-061ed915-4577-4201-91cb-43e9834c1840 tempest-ImagesDeleteNegativeTestJSON-1486002127 tempest-ImagesDeleteNegativeTestJSON-1486002127-project] 10.222.0.26 "DELETE /compute/v2.1/images/6a81fc43-2312-4b61-8309-acba1b60343b" status: 404 len: 62 microversion: 2.1 time: 0.071120 Oct 29 01:10:38.510773 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 877/1750] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:38 2022] DELETE /compute/v2.1/images/6a81fc43-2312-4b61-8309-acba1b60343b => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:10:38.797261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5ec5f21b-7380-4228-a33e-c562e9ba32ac tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:38.815533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5ec5f21b-7380-4228-a33e-c562e9ba32ac tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:38.822418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ec5f21b-7380-4228-a33e-c562e9ba32ac tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:38.823875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ec5f21b-7380-4228-a33e-c562e9ba32ac tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:38.824551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ec5f21b-7380-4228-a33e-c562e9ba32ac tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:38.825933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ec5f21b-7380-4228-a33e-c562e9ba32ac tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:38.828004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ec5f21b-7380-4228-a33e-c562e9ba32ac tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:38.829815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ec5f21b-7380-4228-a33e-c562e9ba32ac tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:39.389696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5ec5f21b-7380-4228-a33e-c562e9ba32ac tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:39.396158 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5ec5f21b-7380-4228-a33e-c562e9ba32ac tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1472 microversion: 2.1 time: 0.601713 Oct 29 01:10:39.407930 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 878/1751] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:38 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1472 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:39.416000 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-64f3ff81-4f0b-46c5-ac3a-eb62928f9b89 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "POST /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.289906 Oct 29 01:10:39.429650 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 874/1752] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 29 01:10:38 2022] POST /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments => generated 194 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:10:40.423574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d5a19285-6bc3-40de-9896-24c2251253ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:40.424430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d5a19285-6bc3-40de-9896-24c2251253ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:40.438994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5a19285-6bc3-40de-9896-24c2251253ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:40.440983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5a19285-6bc3-40de-9896-24c2251253ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:40.440983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5a19285-6bc3-40de-9896-24c2251253ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:40.440983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5a19285-6bc3-40de-9896-24c2251253ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:40.441333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5a19285-6bc3-40de-9896-24c2251253ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:40.441467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5a19285-6bc3-40de-9896-24c2251253ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:40.839618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d5a19285-6bc3-40de-9896-24c2251253ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:40.862255 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d5a19285-6bc3-40de-9896-24c2251253ae tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1472 microversion: 2.1 time: 0.444124 Oct 29 01:10:40.864624 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 879/1753] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:40 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1472 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:40.998244 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0a65285b-ab10-45d4-a537-daed72014559 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:40.998979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0a65285b-ab10-45d4-a537-daed72014559 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:41.037148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a65285b-ab10-45d4-a537-daed72014559 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:41.038020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a65285b-ab10-45d4-a537-daed72014559 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:41.044469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a65285b-ab10-45d4-a537-daed72014559 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:41.044469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a65285b-ab10-45d4-a537-daed72014559 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:41.044469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a65285b-ab10-45d4-a537-daed72014559 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:41.044469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a65285b-ab10-45d4-a537-daed72014559 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:41.345240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0a65285b-ab10-45d4-a537-daed72014559 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:41.372421 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0a65285b-ab10-45d4-a537-daed72014559 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1575 microversion: 2.1 time: 0.384494 Oct 29 01:10:41.377623 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 875/1754] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:40 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1575 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:41.595532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-15aab65f-67ab-49db-a638-1d8ad06120ed req-0839c59b-bc8e-4fe1-baca-99345513a734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a", "tag": "99177002-b761-4c56-a7bb-5911f9934cca"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:41.611338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-15aab65f-67ab-49db-a638-1d8ad06120ed req-0839c59b-bc8e-4fe1-baca-99345513a734 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:41.611835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-15aab65f-67ab-49db-a638-1d8ad06120ed req-0839c59b-bc8e-4fe1-baca-99345513a734 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:41.612533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-15aab65f-67ab-49db-a638-1d8ad06120ed req-0839c59b-bc8e-4fe1-baca-99345513a734 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:41.629642 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-15aab65f-67ab-49db-a638-1d8ad06120ed req-0839c59b-bc8e-4fe1-baca-99345513a734 service nova] Creating event network-changed:99177002-b761-4c56-a7bb-5911f9934cca for instance c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a on n-h2-862964-3 Oct 29 01:10:41.639756 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-15aab65f-67ab-49db-a638-1d8ad06120ed req-0839c59b-bc8e-4fe1-baca-99345513a734 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.648496 Oct 29 01:10:41.646484 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 880/1755] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:10:41.888071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c0e529e1-f7d8-429a-9c17-1fbf20fbd385 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:41.888912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c0e529e1-f7d8-429a-9c17-1fbf20fbd385 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:41.896938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0e529e1-f7d8-429a-9c17-1fbf20fbd385 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:41.897837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0e529e1-f7d8-429a-9c17-1fbf20fbd385 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:41.898284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0e529e1-f7d8-429a-9c17-1fbf20fbd385 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:41.899009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0e529e1-f7d8-429a-9c17-1fbf20fbd385 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:41.899985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0e529e1-f7d8-429a-9c17-1fbf20fbd385 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:41.899985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0e529e1-f7d8-429a-9c17-1fbf20fbd385 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:42.321462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c0e529e1-f7d8-429a-9c17-1fbf20fbd385 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:42.335975 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c0e529e1-f7d8-429a-9c17-1fbf20fbd385 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1477 microversion: 2.1 time: 0.451833 Oct 29 01:10:42.337390 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 876/1756] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:41 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1477 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:10:43.436901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dabd6079-e083-4dd2-8c04-b50e6dd0ad8b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:43.436901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dabd6079-e083-4dd2-8c04-b50e6dd0ad8b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:43.436901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dabd6079-e083-4dd2-8c04-b50e6dd0ad8b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:43.436901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dabd6079-e083-4dd2-8c04-b50e6dd0ad8b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:43.436901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dabd6079-e083-4dd2-8c04-b50e6dd0ad8b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:43.436901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dabd6079-e083-4dd2-8c04-b50e6dd0ad8b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:43.436901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dabd6079-e083-4dd2-8c04-b50e6dd0ad8b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:43.436901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dabd6079-e083-4dd2-8c04-b50e6dd0ad8b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:43.570887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dabd6079-e083-4dd2-8c04-b50e6dd0ad8b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:43.582066 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dabd6079-e083-4dd2-8c04-b50e6dd0ad8b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1477 microversion: 2.1 time: 0.220650 Oct 29 01:10:43.583315 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 881/1757] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:43 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1477 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:44.616418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-57aec7ae-1aa6-4c24-b60a-d91ac74a7080 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:44.617796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-57aec7ae-1aa6-4c24-b60a-d91ac74a7080 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:44.624919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:44.627685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57aec7ae-1aa6-4c24-b60a-d91ac74a7080 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:44.628422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57aec7ae-1aa6-4c24-b60a-d91ac74a7080 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:44.629201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57aec7ae-1aa6-4c24-b60a-d91ac74a7080 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:44.630111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57aec7ae-1aa6-4c24-b60a-d91ac74a7080 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:44.630741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57aec7ae-1aa6-4c24-b60a-d91ac74a7080 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:44.631614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57aec7ae-1aa6-4c24-b60a-d91ac74a7080 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:44.812219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-57aec7ae-1aa6-4c24-b60a-d91ac74a7080 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:44.822823 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-57aec7ae-1aa6-4c24-b60a-d91ac74a7080 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1477 microversion: 2.1 time: 0.212309 Oct 29 01:10:44.823490 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 877/1758] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:44 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1477 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:45.859010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9f4ac747-6025-4924-aed3-71c8d8df6e0a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:45.859760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9f4ac747-6025-4924-aed3-71c8d8df6e0a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:45.869978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f4ac747-6025-4924-aed3-71c8d8df6e0a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:45.871093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f4ac747-6025-4924-aed3-71c8d8df6e0a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:45.873579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f4ac747-6025-4924-aed3-71c8d8df6e0a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:45.875341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f4ac747-6025-4924-aed3-71c8d8df6e0a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:45.877929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f4ac747-6025-4924-aed3-71c8d8df6e0a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:45.880251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f4ac747-6025-4924-aed3-71c8d8df6e0a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:46.202772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9f4ac747-6025-4924-aed3-71c8d8df6e0a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:46.227190 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9f4ac747-6025-4924-aed3-71c8d8df6e0a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1477 microversion: 2.1 time: 0.368867 Oct 29 01:10:46.227190 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 882/1759] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:45 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1477 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:47.281401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d2ded286-98d2-4941-a645-22d4c6d9edc7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:47.281401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d2ded286-98d2-4941-a645-22d4c6d9edc7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:47.281401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2ded286-98d2-4941-a645-22d4c6d9edc7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:47.281401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2ded286-98d2-4941-a645-22d4c6d9edc7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:47.281401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2ded286-98d2-4941-a645-22d4c6d9edc7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:47.281401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2ded286-98d2-4941-a645-22d4c6d9edc7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:47.281401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2ded286-98d2-4941-a645-22d4c6d9edc7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:47.281401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2ded286-98d2-4941-a645-22d4c6d9edc7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:48.294053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d2ded286-98d2-4941-a645-22d4c6d9edc7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:48.304272 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d2ded286-98d2-4941-a645-22d4c6d9edc7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1477 microversion: 2.1 time: 1.060763 Oct 29 01:10:48.309871 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 878/1760] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:47 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1477 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:49.334246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1a8244f4-b1b0-4e14-9738-95ebe58af6d4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:49.335541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1a8244f4-b1b0-4e14-9738-95ebe58af6d4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:49.352705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a8244f4-b1b0-4e14-9738-95ebe58af6d4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:49.353608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a8244f4-b1b0-4e14-9738-95ebe58af6d4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:49.354220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a8244f4-b1b0-4e14-9738-95ebe58af6d4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:49.355086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a8244f4-b1b0-4e14-9738-95ebe58af6d4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:49.355713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a8244f4-b1b0-4e14-9738-95ebe58af6d4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:49.356300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a8244f4-b1b0-4e14-9738-95ebe58af6d4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:49.759680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1a8244f4-b1b0-4e14-9738-95ebe58af6d4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:49.777234 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1a8244f4-b1b0-4e14-9738-95ebe58af6d4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1477 microversion: 2.1 time: 0.440283 Oct 29 01:10:49.785504 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 883/1761] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:49 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1477 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:50.807375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-85016960-b3c7-4668-a1c1-bb39aa6eb8e9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:50.808125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-85016960-b3c7-4668-a1c1-bb39aa6eb8e9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:50.820136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-85016960-b3c7-4668-a1c1-bb39aa6eb8e9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:50.820622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-85016960-b3c7-4668-a1c1-bb39aa6eb8e9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:50.821073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-85016960-b3c7-4668-a1c1-bb39aa6eb8e9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:50.821856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-85016960-b3c7-4668-a1c1-bb39aa6eb8e9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:50.822297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-85016960-b3c7-4668-a1c1-bb39aa6eb8e9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:50.827970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-85016960-b3c7-4668-a1c1-bb39aa6eb8e9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:51.180876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-85016960-b3c7-4668-a1c1-bb39aa6eb8e9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:51.196444 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-85016960-b3c7-4668-a1c1-bb39aa6eb8e9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1477 microversion: 2.1 time: 0.394000 Oct 29 01:10:51.197079 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 879/1762] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:50 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1477 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:52.225875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-62d7f0b4-2ad6-4660-8b1c-dd817f5468ce tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:52.227279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-62d7f0b4-2ad6-4660-8b1c-dd817f5468ce tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:52.240804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62d7f0b4-2ad6-4660-8b1c-dd817f5468ce tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:52.242817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62d7f0b4-2ad6-4660-8b1c-dd817f5468ce tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:52.244917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62d7f0b4-2ad6-4660-8b1c-dd817f5468ce tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:52.254007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62d7f0b4-2ad6-4660-8b1c-dd817f5468ce tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:52.254987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62d7f0b4-2ad6-4660-8b1c-dd817f5468ce tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:52.257234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62d7f0b4-2ad6-4660-8b1c-dd817f5468ce tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:52.692832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-62d7f0b4-2ad6-4660-8b1c-dd817f5468ce tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:52.715296 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-62d7f0b4-2ad6-4660-8b1c-dd817f5468ce tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1477 microversion: 2.1 time: 0.487368 Oct 29 01:10:52.730986 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 884/1763] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:52 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1477 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:53.536619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-316a024a-d215-4289-b666-338b9cb90a1a tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Calling method '.version_select at 0x7f9d97f6cd30>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:53.576814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG neutronclient.v2_0.client [None req-316a024a-d215-4289-b666-338b9cb90a1a tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5fefa471-be3a-4c1d-8294-e6105634ce62 does not exist", "detail": ""}} {{(pid=121100) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:10:53.577472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.security_group_api [None req-316a024a-d215-4289-b666-338b9cb90a1a tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Neutron security group 5fefa471-be3a-4c1d-8294-e6105634ce62 not found {{(pid=121100) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 01:10:53.578017 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-316a024a-d215-4289-b666-338b9cb90a1a tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] HTTP exception thrown: Security group 5fefa471-be3a-4c1d-8294-e6105634ce62 does not exist Oct 29 01:10:53.578017 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-f5523b99-6c18-43c2-a2ea-e116f3fe6e15'] Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-316a024a-d215-4289-b666-338b9cb90a1a tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Request method failure captured: Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/os-security-groups/5fefa471-be3a-4c1d-8294-e6105634ce62 HTTP/1.1 Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH2dTkz5kDN37F0SBPJN_EhnQ15s53sMUQk_ia3UD875QuDoKXTCsxjC33lVNzuGcXkFjgzWUFMIQYMf87nHyI96y47JBTQHuuFwdjIa4DD3r1xO0k11ycqfb48EVRsSK7heukTJox4GmtUZrrbuE78tqDDoEogX5dxqHC9RL_ta_EE Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 55f918566dbb485f863adda26c9abd74 Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1530740585 Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55f918566dbb485f863adda26c9abd74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/55f918566dbb485f863adda26c9abd74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55f918566dbb485f863adda26c9abd74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_55f918566dbb485f863adda26c9abd74", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1530740585 Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 55f918566dbb485f863adda26c9abd74 Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1530740585 Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-SecurityGroupsNegativeTestJSON-1530740585-project Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: e2c58e8eebe642b1bf40ef46fa211a3e Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1530740585-project Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: exception: Security group 5fefa471-be3a-4c1d-8294-e6105634ce62 does not exist Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-f5523b99-6c18-43c2-a2ea-e116f3fe6e15'] Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '5fefa471-be3a-4c1d-8294-e6105634ce62'} Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:10:53.581185 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5fefa471-be3a-4c1d-8294-e6105634ce62 does not exist Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5523b99-6c18-43c2-a2ea-e116f3fe6e15'] Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5fefa471-be3a-4c1d-8294-e6105634ce62 does not exist Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5523b99-6c18-43c2-a2ea-e116f3fe6e15'] Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5fefa471-be3a-4c1d-8294-e6105634ce62 does not exist Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5523b99-6c18-43c2-a2ea-e116f3fe6e15'] Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5fefa471-be3a-4c1d-8294-e6105634ce62 does not exist Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5523b99-6c18-43c2-a2ea-e116f3fe6e15'] Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-316a024a-d215-4289-b666-338b9cb90a1a tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Returning 404 to user: Security group 5fefa471-be3a-4c1d-8294-e6105634ce62 does not exist Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-f5523b99-6c18-43c2-a2ea-e116f3fe6e15'] {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-316a024a-d215-4289-b666-338b9cb90a1a tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/5fefa471-be3a-4c1d-8294-e6105634ce62" status: 404 len: 194 microversion: 2.1 time: 0.241615 Oct 29 01:10:53.586420 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 880/1764] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:10:53 2022] DELETE /compute/v2.1/os-security-groups/5fefa471-be3a-4c1d-8294-e6105634ce62 => generated 194 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:10:53.597211 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a6ec2411-23fa-4878-b770-094f95cd42ca tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005566 Oct 29 01:10:53.598516 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 885/1765] 10.222.0.26 () {58 vars in 1164 bytes} [Sat Oct 29 01:10:53 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 01:10:53.610280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3a56feab-c832-4614-82bb-d50a22fc9174 tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Calling method '.version_select at 0x7f9d97e79ca0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:53.745293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a31206db-4fd8-4db6-8549-d4f8c3f340e8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:53.746356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a31206db-4fd8-4db6-8549-d4f8c3f340e8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:53.754469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=35 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:53.763108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a31206db-4fd8-4db6-8549-d4f8c3f340e8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:53.764844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a31206db-4fd8-4db6-8549-d4f8c3f340e8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:53.765897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a31206db-4fd8-4db6-8549-d4f8c3f340e8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:53.768000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a31206db-4fd8-4db6-8549-d4f8c3f340e8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:53.769734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a31206db-4fd8-4db6-8549-d4f8c3f340e8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:53.770122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a31206db-4fd8-4db6-8549-d4f8c3f340e8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:54.022981 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3a56feab-c832-4614-82bb-d50a22fc9174 tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.416958 Oct 29 01:10:54.024151 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 881/1766] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 29 01:10:53 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:54.041477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-81c367ed-17e0-4e2a-9b8b-b9c93bd14d7c tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Calling method '.version_select at 0x7f9d97f6c550>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:54.202776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a31206db-4fd8-4db6-8549-d4f8c3f340e8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:54.220043 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a31206db-4fd8-4db6-8549-d4f8c3f340e8 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1477 microversion: 2.1 time: 0.476687 Oct 29 01:10:54.220775 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 886/1767] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:53 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1477 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:54.309633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c8e3bfd4-8dd1-473e-8496-9a963798b93c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Action: 'create', calling method: .version_select at 0x7f9d9fe61dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1649602508", "description": "tempest-description-932514385"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:54.341636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG neutronclient.v2_0.client [None req-81c367ed-17e0-4e2a-9b8b-b9c93bd14d7c tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=121100) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:10:54.343511 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-81c367ed-17e0-4e2a-9b8b-b9c93bd14d7c tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 29 01:10:54.343511 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-a9deea51-e465-4043-916e-07365f00871d'] Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-81c367ed-17e0-4e2a-9b8b-b9c93bd14d7c tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Request method failure captured: Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/os-security-groups/1a5938c2-b035-4c80-bb70-8da4f6e01750 HTTP/1.1 Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH2dTkz5kDN37F0SBPJN_EhnQ15s53sMUQk_ia3UD875QuDoKXTCsxjC33lVNzuGcXkFjgzWUFMIQYMf87nHyI96y47JBTQHuuFwdjIa4DD3r1xO0k11ycqfb48EVRsSK7heukTJox4GmtUZrrbuE78tqDDoEogX5dxqHC9RL_ta_EE Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 55f918566dbb485f863adda26c9abd74 Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1530740585 Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55f918566dbb485f863adda26c9abd74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/55f918566dbb485f863adda26c9abd74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55f918566dbb485f863adda26c9abd74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_55f918566dbb485f863adda26c9abd74", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1530740585 Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 55f918566dbb485f863adda26c9abd74 Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1530740585 Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-SecurityGroupsNegativeTestJSON-1530740585-project Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: e2c58e8eebe642b1bf40ef46fa211a3e Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1530740585-project Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: exception: Insufficient rights for removing default security group. Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-a9deea51-e465-4043-916e-07365f00871d'] Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '1a5938c2-b035-4c80-bb70-8da4f6e01750'} Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:10:54.347311 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9deea51-e465-4043-916e-07365f00871d'] Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9deea51-e465-4043-916e-07365f00871d'] Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9deea51-e465-4043-916e-07365f00871d'] Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9deea51-e465-4043-916e-07365f00871d'] Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-81c367ed-17e0-4e2a-9b8b-b9c93bd14d7c tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-a9deea51-e465-4043-916e-07365f00871d'] {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:54.352086 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-81c367ed-17e0-4e2a-9b8b-b9c93bd14d7c tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/1a5938c2-b035-4c80-bb70-8da4f6e01750" status: 400 len: 182 microversion: 2.1 time: 0.316351 Oct 29 01:10:54.363362 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 882/1768] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:10:54 2022] DELETE /compute/v2.1/os-security-groups/1a5938c2-b035-4c80-bb70-8da4f6e01750 => generated 182 bytes in 318 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:10:54.368361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1077be85-ece0-46cc-8548-c5af5e0f4b2e tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Calling method '.version_select at 0x7f9d97e2cca0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:54.396357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG neutronclient.v2_0.client [None req-1077be85-ece0-46cc-8548-c5af5e0f4b2e tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dbb227db-65e8-4ff3-9deb-8aab180cfbf8 does not exist", "detail": ""}} {{(pid=121100) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:10:54.397657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.security_group_api [None req-1077be85-ece0-46cc-8548-c5af5e0f4b2e tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Neutron security group dbb227db-65e8-4ff3-9deb-8aab180cfbf8 not found {{(pid=121100) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 01:10:54.398749 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-1077be85-ece0-46cc-8548-c5af5e0f4b2e tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] HTTP exception thrown: Security group dbb227db-65e8-4ff3-9deb-8aab180cfbf8 does not exist Oct 29 01:10:54.398749 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-72036f3b-2914-44b9-a6ca-371d3cf12dbe'] Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1077be85-ece0-46cc-8548-c5af5e0f4b2e tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Request method failure captured: Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-security-groups/dbb227db-65e8-4ff3-9deb-8aab180cfbf8 HTTP/1.1 Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH2dTkz5kDN37F0SBPJN_EhnQ15s53sMUQk_ia3UD875QuDoKXTCsxjC33lVNzuGcXkFjgzWUFMIQYMf87nHyI96y47JBTQHuuFwdjIa4DD3r1xO0k11ycqfb48EVRsSK7heukTJox4GmtUZrrbuE78tqDDoEogX5dxqHC9RL_ta_EE Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 55f918566dbb485f863adda26c9abd74 Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1530740585 Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55f918566dbb485f863adda26c9abd74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/55f918566dbb485f863adda26c9abd74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55f918566dbb485f863adda26c9abd74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_55f918566dbb485f863adda26c9abd74", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1530740585 Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 55f918566dbb485f863adda26c9abd74 Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1530740585 Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-SecurityGroupsNegativeTestJSON-1530740585-project Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: e2c58e8eebe642b1bf40ef46fa211a3e Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1530740585-project Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: exception: Security group dbb227db-65e8-4ff3-9deb-8aab180cfbf8 does not exist Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-72036f3b-2914-44b9-a6ca-371d3cf12dbe'] Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'dbb227db-65e8-4ff3-9deb-8aab180cfbf8'} Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:10:54.403192 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dbb227db-65e8-4ff3-9deb-8aab180cfbf8 does not exist Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72036f3b-2914-44b9-a6ca-371d3cf12dbe'] Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dbb227db-65e8-4ff3-9deb-8aab180cfbf8 does not exist Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72036f3b-2914-44b9-a6ca-371d3cf12dbe'] Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dbb227db-65e8-4ff3-9deb-8aab180cfbf8 does not exist Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72036f3b-2914-44b9-a6ca-371d3cf12dbe'] Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dbb227db-65e8-4ff3-9deb-8aab180cfbf8 does not exist Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72036f3b-2914-44b9-a6ca-371d3cf12dbe'] Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1077be85-ece0-46cc-8548-c5af5e0f4b2e tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Returning 404 to user: Security group dbb227db-65e8-4ff3-9deb-8aab180cfbf8 does not exist Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-72036f3b-2914-44b9-a6ca-371d3cf12dbe'] {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1077be85-ece0-46cc-8548-c5af5e0f4b2e tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/dbb227db-65e8-4ff3-9deb-8aab180cfbf8" status: 404 len: 194 microversion: 2.1 time: 0.042788 Oct 29 01:10:54.414036 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 883/1769] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 29 01:10:54 2022] GET /compute/v2.1/os-security-groups/dbb227db-65e8-4ff3-9deb-8aab180cfbf8 => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:10:54.425329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-07508b9a-322f-4829-b147-f67d9cbff5c2 tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Action: 'update', calling method: .version_select at 0x7f9d97f6c310>, body: {"security_group": {"name": "tempest-sg-1309432830", "description": "tempest-description-212463341"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:54.491187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG neutronclient.v2_0.client [None req-07508b9a-322f-4829-b147-f67d9cbff5c2 tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 63b5cd01-97c1-413f-95aa-19a02d0f0c22 does not exist", "detail": ""}} {{(pid=121100) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:10:54.492200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.security_group_api [None req-07508b9a-322f-4829-b147-f67d9cbff5c2 tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Neutron security group 63b5cd01-97c1-413f-95aa-19a02d0f0c22 not found {{(pid=121100) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 01:10:54.493013 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-07508b9a-322f-4829-b147-f67d9cbff5c2 tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] HTTP exception thrown: Security group 63b5cd01-97c1-413f-95aa-19a02d0f0c22 does not exist Oct 29 01:10:54.493013 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-cbc1a566-f03c-4a54-a50e-c4cbc2b6f453'] Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-07508b9a-322f-4829-b147-f67d9cbff5c2 tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Request method failure captured: Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: request: PUT /compute/v2.1/os-security-groups/63b5cd01-97c1-413f-95aa-19a02d0f0c22 HTTP/1.1 Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 101 Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH2dTkz5kDN37F0SBPJN_EhnQ15s53sMUQk_ia3UD875QuDoKXTCsxjC33lVNzuGcXkFjgzWUFMIQYMf87nHyI96y47JBTQHuuFwdjIa4DD3r1xO0k11ycqfb48EVRsSK7heukTJox4GmtUZrrbuE78tqDDoEogX5dxqHC9RL_ta_EE Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 55f918566dbb485f863adda26c9abd74 Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1530740585 Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55f918566dbb485f863adda26c9abd74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/55f918566dbb485f863adda26c9abd74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55f918566dbb485f863adda26c9abd74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_55f918566dbb485f863adda26c9abd74", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1530740585 Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 55f918566dbb485f863adda26c9abd74 Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1530740585 Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-SecurityGroupsNegativeTestJSON-1530740585-project Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: e2c58e8eebe642b1bf40ef46fa211a3e Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1530740585-project Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: {"security_group": {"name": "tempest-sg-1309432830", "description": "tempest-description-212463341"}} Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: exception: Security group 63b5cd01-97c1-413f-95aa-19a02d0f0c22 does not exist Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-cbc1a566-f03c-4a54-a50e-c4cbc2b6f453'] Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '63b5cd01-97c1-413f-95aa-19a02d0f0c22', 'body': {'security_group': {'name': 'tempest-sg-1309432830', 'description': 'tempest-description-212463341'}}} Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:10:54.495011 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 63b5cd01-97c1-413f-95aa-19a02d0f0c22 does not exist Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbc1a566-f03c-4a54-a50e-c4cbc2b6f453'] Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 63b5cd01-97c1-413f-95aa-19a02d0f0c22 does not exist Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbc1a566-f03c-4a54-a50e-c4cbc2b6f453'] Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 63b5cd01-97c1-413f-95aa-19a02d0f0c22 does not exist Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbc1a566-f03c-4a54-a50e-c4cbc2b6f453'] Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 63b5cd01-97c1-413f-95aa-19a02d0f0c22 does not exist Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbc1a566-f03c-4a54-a50e-c4cbc2b6f453'] Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-07508b9a-322f-4829-b147-f67d9cbff5c2 tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] Returning 404 to user: Security group 63b5cd01-97c1-413f-95aa-19a02d0f0c22 does not exist Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-cbc1a566-f03c-4a54-a50e-c4cbc2b6f453'] {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:10:54.502793 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-07508b9a-322f-4829-b147-f67d9cbff5c2 tempest-SecurityGroupsNegativeTestJSON-1530740585 tempest-SecurityGroupsNegativeTestJSON-1530740585-project] 10.222.0.26 "PUT /compute/v2.1/os-security-groups/63b5cd01-97c1-413f-95aa-19a02d0f0c22" status: 404 len: 194 microversion: 2.1 time: 0.083142 Oct 29 01:10:54.519813 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 884/1770] 10.222.0.26 () {60 vars in 1290 bytes} [Sat Oct 29 01:10:54 2022] PUT /compute/v2.1/os-security-groups/63b5cd01-97c1-413f-95aa-19a02d0f0c22 => generated 194 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:10:54.784900 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c8e3bfd4-8dd1-473e-8496-9a963798b93c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.552483 Oct 29 01:10:54.784900 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 887/1771] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:10:54 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:54.793798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f05a5a5e-c1f5-4658-a0e3-974734ca2bae tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Action: 'create', calling method: .version_select at 0x7f9d97e06550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1152635939", "description": "tempest-description-1271656638"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:55.197692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f3422aeb-2c26-4ce5-a099-716ffedc08ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:55.198183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f3422aeb-2c26-4ce5-a099-716ffedc08ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:55.216456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3422aeb-2c26-4ce5-a099-716ffedc08ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:55.221694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3422aeb-2c26-4ce5-a099-716ffedc08ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:55.223661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3422aeb-2c26-4ce5-a099-716ffedc08ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:55.224503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3422aeb-2c26-4ce5-a099-716ffedc08ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:55.224968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3422aeb-2c26-4ce5-a099-716ffedc08ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:55.226693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3422aeb-2c26-4ce5-a099-716ffedc08ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:55.287915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f3422aeb-2c26-4ce5-a099-716ffedc08ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:10:55.307430 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f05a5a5e-c1f5-4658-a0e3-974734ca2bae tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.520750 Oct 29 01:10:55.308035 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 885/1772] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:10:54 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:55.326220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-41ec13ee-c508-4fa6-adc3-d23884b45751 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:55.327088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-41ec13ee-c508-4fa6-adc3-d23884b45751 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:55.336599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41ec13ee-c508-4fa6-adc3-d23884b45751 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:55.337416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41ec13ee-c508-4fa6-adc3-d23884b45751 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:55.338029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41ec13ee-c508-4fa6-adc3-d23884b45751 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:55.341972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41ec13ee-c508-4fa6-adc3-d23884b45751 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:55.342680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41ec13ee-c508-4fa6-adc3-d23884b45751 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:55.343303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41ec13ee-c508-4fa6-adc3-d23884b45751 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:55.367738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:55.445677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:55.523291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-41ec13ee-c508-4fa6-adc3-d23884b45751 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:55.543000 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-41ec13ee-c508-4fa6-adc3-d23884b45751 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1477 microversion: 2.1 time: 0.233652 Oct 29 01:10:55.543861 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 886/1773] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:55 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1477 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:55.576389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ccbae2f9-92cf-4074-83a1-751574189f84 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1923359308", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "ef0bfb89-9268-4eef-b7c3-6f6a44644039"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:55.645745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-ccbae2f9-92cf-4074-83a1-751574189f84 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] validate_networks() for [('ef0bfb89-9268-4eef-b7c3-6f6a44644039', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:10:55.669264 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f3422aeb-2c26-4ce5-a099-716ffedc08ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 204 len: 0 microversion: 2.1 time: 0.476000 Oct 29 01:10:55.670452 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 888/1774] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:10:55 2022] DELETE /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:10:55.680307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-321ee967-795d-47c7-8116-04c197332a42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:55.681019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-321ee967-795d-47c7-8116-04c197332a42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:55.689645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-321ee967-795d-47c7-8116-04c197332a42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:55.690060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-321ee967-795d-47c7-8116-04c197332a42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:55.690502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-321ee967-795d-47c7-8116-04c197332a42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:55.691210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-321ee967-795d-47c7-8116-04c197332a42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:55.691664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-321ee967-795d-47c7-8116-04c197332a42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:55.692090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-321ee967-795d-47c7-8116-04c197332a42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:56.003335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-321ee967-795d-47c7-8116-04c197332a42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:56.017094 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-321ee967-795d-47c7-8116-04c197332a42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1553 microversion: 2.1 time: 0.340695 Oct 29 01:10:56.024740 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 889/1775] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:55 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1553 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:10:56.412529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ccbae2f9-92cf-4074-83a1-751574189f84 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:10:56.413623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ccbae2f9-92cf-4074-83a1-751574189f84 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:10:56.414332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ccbae2f9-92cf-4074-83a1-751574189f84 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:10:56.415240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ccbae2f9-92cf-4074-83a1-751574189f84 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:10:56.415896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ccbae2f9-92cf-4074-83a1-751574189f84 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:10:56.436652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ccbae2f9-92cf-4074-83a1-751574189f84 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:56.437661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ccbae2f9-92cf-4074-83a1-751574189f84 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:56.438589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ccbae2f9-92cf-4074-83a1-751574189f84 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:56.442278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ccbae2f9-92cf-4074-83a1-751574189f84 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:56.444008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ccbae2f9-92cf-4074-83a1-751574189f84 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:56.445414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ccbae2f9-92cf-4074-83a1-751574189f84 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:56.489255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-ccbae2f9-92cf-4074-83a1-751574189f84 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Getting quotas for project 294bcfcd48fb4cf3b3744e74498a9f73. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:10:56.524112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-ccbae2f9-92cf-4074-83a1-751574189f84 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Getting quotas for user f6e18fc75c774452bcc89f4cb817e545 and project 294bcfcd48fb4cf3b3744e74498a9f73. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:10:56.554245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ccbae2f9-92cf-4074-83a1-751574189f84 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:10:56.562049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ccbae2f9-92cf-4074-83a1-751574189f84 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:10:56.574824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a9dace3b-8e05-42cb-88dd-18b501a793a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:56.575642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a9dace3b-8e05-42cb-88dd-18b501a793a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:56.597881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9dace3b-8e05-42cb-88dd-18b501a793a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:56.598414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9dace3b-8e05-42cb-88dd-18b501a793a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:56.598869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9dace3b-8e05-42cb-88dd-18b501a793a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:56.599613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9dace3b-8e05-42cb-88dd-18b501a793a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:56.600072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9dace3b-8e05-42cb-88dd-18b501a793a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:56.600498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9dace3b-8e05-42cb-88dd-18b501a793a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:56.796374 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ccbae2f9-92cf-4074-83a1-751574189f84 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.236804 Oct 29 01:10:56.807322 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 887/1776] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:10:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:10:56.815511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0cd4ca27-f625-4b23-b647-5dc256b7be1b tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:56.816458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0cd4ca27-f625-4b23-b647-5dc256b7be1b tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:56.906127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0cd4ca27-f625-4b23-b647-5dc256b7be1b tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:56.917722 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0cd4ca27-f625-4b23-b647-5dc256b7be1b tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 200 len: 1216 microversion: 2.1 time: 0.106140 Oct 29 01:10:56.934442 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 888/1777] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:56 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 1216 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:56.941941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a9dace3b-8e05-42cb-88dd-18b501a793a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:56.952385 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a9dace3b-8e05-42cb-88dd-18b501a793a7 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1477 microversion: 2.1 time: 0.382426 Oct 29 01:10:56.954907 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 890/1778] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:56 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1477 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:10:57.055964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0216ca60-7467-4634-a7e9-21ba7f04a099 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:57.069012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0216ca60-7467-4634-a7e9-21ba7f04a099 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:57.077472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0216ca60-7467-4634-a7e9-21ba7f04a099 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:57.078512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0216ca60-7467-4634-a7e9-21ba7f04a099 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:57.079155 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0216ca60-7467-4634-a7e9-21ba7f04a099 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:57.080367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0216ca60-7467-4634-a7e9-21ba7f04a099 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:57.084534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0216ca60-7467-4634-a7e9-21ba7f04a099 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:57.084534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0216ca60-7467-4634-a7e9-21ba7f04a099 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:57.411783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0216ca60-7467-4634-a7e9-21ba7f04a099 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:57.427006 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0216ca60-7467-4634-a7e9-21ba7f04a099 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1553 microversion: 2.1 time: 0.381044 Oct 29 01:10:57.428852 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 889/1779] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:57 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1553 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:57.946481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f5b0897e-ede4-4d8e-a187-214760feccfc tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:57.947371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f5b0897e-ede4-4d8e-a187-214760feccfc tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:57.984270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-484c0aff-0b9e-489d-b5f8-584664cdebfd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:57.984270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-484c0aff-0b9e-489d-b5f8-584664cdebfd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:57.995766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-484c0aff-0b9e-489d-b5f8-584664cdebfd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:57.996428 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-484c0aff-0b9e-489d-b5f8-584664cdebfd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:57.996966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-484c0aff-0b9e-489d-b5f8-584664cdebfd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:57.997803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-484c0aff-0b9e-489d-b5f8-584664cdebfd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:57.998266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-484c0aff-0b9e-489d-b5f8-584664cdebfd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:57.998690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-484c0aff-0b9e-489d-b5f8-584664cdebfd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:58.484031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f5b0897e-ede4-4d8e-a187-214760feccfc tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:58.498585 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f5b0897e-ede4-4d8e-a187-214760feccfc tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 200 len: 1216 microversion: 2.1 time: 0.556267 Oct 29 01:10:58.502885 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 891/1780] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:57 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 1216 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:58.526316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6b00f240-744a-4c9a-b1d2-42557e16c719 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:58.527078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6b00f240-744a-4c9a-b1d2-42557e16c719 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:58.540654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b00f240-744a-4c9a-b1d2-42557e16c719 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:58.541960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b00f240-744a-4c9a-b1d2-42557e16c719 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:58.542961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b00f240-744a-4c9a-b1d2-42557e16c719 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:58.544096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b00f240-744a-4c9a-b1d2-42557e16c719 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:58.544847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b00f240-744a-4c9a-b1d2-42557e16c719 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:58.545589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b00f240-744a-4c9a-b1d2-42557e16c719 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:58.667254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-484c0aff-0b9e-489d-b5f8-584664cdebfd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:58.685074 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-484c0aff-0b9e-489d-b5f8-584664cdebfd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1477 microversion: 2.1 time: 0.707004 Oct 29 01:10:58.685995 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 890/1781] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:57 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1477 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:10:58.903736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6b00f240-744a-4c9a-b1d2-42557e16c719 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:58.918123 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6b00f240-744a-4c9a-b1d2-42557e16c719 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1553 microversion: 2.1 time: 0.412550 Oct 29 01:10:58.924011 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 892/1782] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:58 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1553 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:59.086269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-f301d98f-e685-40df-873b-f04c8d3d53ae req-09315bb4-ec94-4646-93f3-96dd767039b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5e830e-0f0f-4f57-93c4-a42dcd3a3003", "name": "network-vif-deleted", "tag": "14849a71-b385-4c87-92d0-caf7083bd7e3"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:59.103071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:10:59.119824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f301d98f-e685-40df-873b-f04c8d3d53ae req-09315bb4-ec94-4646-93f3-96dd767039b8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:59.119824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f301d98f-e685-40df-873b-f04c8d3d53ae req-09315bb4-ec94-4646-93f3-96dd767039b8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:59.120307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f301d98f-e685-40df-873b-f04c8d3d53ae req-09315bb4-ec94-4646-93f3-96dd767039b8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:59.134189 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f301d98f-e685-40df-873b-f04c8d3d53ae req-09315bb4-ec94-4646-93f3-96dd767039b8 service nova] Creating event network-vif-deleted:14849a71-b385-4c87-92d0-caf7083bd7e3 for instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 on n-h1-862964-3 Oct 29 01:10:59.140083 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-f301d98f-e685-40df-873b-f04c8d3d53ae req-09315bb4-ec94-4646-93f3-96dd767039b8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057580 Oct 29 01:10:59.140696 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 891/1783] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:59.400367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-be49baa0-10df-4e32-a768-d32c860030c5 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:59.405858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-be49baa0-10df-4e32-a768-d32c860030c5 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:59.413770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be49baa0-10df-4e32-a768-d32c860030c5 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:59.414695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be49baa0-10df-4e32-a768-d32c860030c5 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:59.415673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be49baa0-10df-4e32-a768-d32c860030c5 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:59.416642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be49baa0-10df-4e32-a768-d32c860030c5 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:59.417367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be49baa0-10df-4e32-a768-d32c860030c5 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:59.418436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be49baa0-10df-4e32-a768-d32c860030c5 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:59.529607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-80dcf972-ca45-49a1-b581-703d94e35f3c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:59.530690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-80dcf972-ca45-49a1-b581-703d94e35f3c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:59.541739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80dcf972-ca45-49a1-b581-703d94e35f3c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:59.542503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80dcf972-ca45-49a1-b581-703d94e35f3c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:59.543107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80dcf972-ca45-49a1-b581-703d94e35f3c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:59.543844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80dcf972-ca45-49a1-b581-703d94e35f3c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:59.544371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80dcf972-ca45-49a1-b581-703d94e35f3c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:59.544808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80dcf972-ca45-49a1-b581-703d94e35f3c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:59.652872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-80dcf972-ca45-49a1-b581-703d94e35f3c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:10:59.663881 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-80dcf972-ca45-49a1-b581-703d94e35f3c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 200 len: 1268 microversion: 2.1 time: 0.139608 Oct 29 01:10:59.666262 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 892/1784] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:59 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 1268 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:10:59.679438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-397eeda9-3341-4360-930d-12ecff2b1f35 req-fb6583a9-316c-4727-92c2-838afe8e8251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ea836d-4ec8-4646-a8f8-2c199985d829", "name": "network-vif-unplugged", "status": "completed", "tag": "a2a1803b-2371-4f50-9500-0cc998cf3afa"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:59.700995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-397eeda9-3341-4360-930d-12ecff2b1f35 req-fb6583a9-316c-4727-92c2-838afe8e8251 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:59.706295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-397eeda9-3341-4360-930d-12ecff2b1f35 req-fb6583a9-316c-4727-92c2-838afe8e8251 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:59.710475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-397eeda9-3341-4360-930d-12ecff2b1f35 req-fb6583a9-316c-4727-92c2-838afe8e8251 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:59.735783 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-397eeda9-3341-4360-930d-12ecff2b1f35 req-fb6583a9-316c-4727-92c2-838afe8e8251 service nova] Creating event network-vif-unplugged:a2a1803b-2371-4f50-9500-0cc998cf3afa for instance b7ea836d-4ec8-4646-a8f8-2c199985d829 on n-h1-862964-3 Oct 29 01:10:59.744079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [req-397eeda9-3341-4360-930d-12ecff2b1f35 req-fb6583a9-316c-4727-92c2-838afe8e8251 service nova] Instance b7ea836d-4ec8-4646-a8f8-2c199985d829 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121100) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:10:59.772657 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-397eeda9-3341-4360-930d-12ecff2b1f35 req-fb6583a9-316c-4727-92c2-838afe8e8251 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102638 Oct 29 01:10:59.773587 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 893/1785] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:10:59.779729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e61f8c1a-641e-4958-a972-79d693a25d4b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:10:59.785221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e61f8c1a-641e-4958-a972-79d693a25d4b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:59.806524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e61f8c1a-641e-4958-a972-79d693a25d4b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:59.808704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e61f8c1a-641e-4958-a972-79d693a25d4b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:59.808704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e61f8c1a-641e-4958-a972-79d693a25d4b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:59.809754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e61f8c1a-641e-4958-a972-79d693a25d4b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:59.810920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e61f8c1a-641e-4958-a972-79d693a25d4b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:59.812183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e61f8c1a-641e-4958-a972-79d693a25d4b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:59.880119 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-be49baa0-10df-4e32-a768-d32c860030c5 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1857 microversion: 2.1 time: 0.482579 Oct 29 01:10:59.883058 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 893/1786] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:59 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1857 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:10:59.909384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-df1acb7e-3472-4cc8-ace9-8def0487bfe6 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862964-3", "block_migration": true, "disk_over_commit": false}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:10:59.912423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-df1acb7e-3472-4cc8-ace9-8def0487bfe6 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:10:59.929173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df1acb7e-3472-4cc8-ace9-8def0487bfe6 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:59.929988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df1acb7e-3472-4cc8-ace9-8def0487bfe6 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:59.930781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df1acb7e-3472-4cc8-ace9-8def0487bfe6 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:10:59.931692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df1acb7e-3472-4cc8-ace9-8def0487bfe6 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:10:59.936438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df1acb7e-3472-4cc8-ace9-8def0487bfe6 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:10:59.937225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df1acb7e-3472-4cc8-ace9-8def0487bfe6 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:00.011534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-df1acb7e-3472-4cc8-ace9-8def0487bfe6 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lazy-loading 'flavor' on Instance uuid b8914c05-5333-46a4-8930-90cb1a93e5eb {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:11:00.027120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-df1acb7e-3472-4cc8-ace9-8def0487bfe6 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Going to try to live migrate instance to n-h2-862964-3 {{(pid=121099) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 01:11:00.344712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e61f8c1a-641e-4958-a972-79d693a25d4b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:00.356817 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e61f8c1a-641e-4958-a972-79d693a25d4b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1476 microversion: 2.1 time: 0.579573 Oct 29 01:11:00.356817 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 894/1787] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:10:59 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1476 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:00.362102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-38d30417-5a5f-4214-b7bb-c45567e87690 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:00.367500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-38d30417-5a5f-4214-b7bb-c45567e87690 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:00.385753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38d30417-5a5f-4214-b7bb-c45567e87690 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:00.385753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38d30417-5a5f-4214-b7bb-c45567e87690 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:00.385753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38d30417-5a5f-4214-b7bb-c45567e87690 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:00.385753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38d30417-5a5f-4214-b7bb-c45567e87690 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:00.385753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38d30417-5a5f-4214-b7bb-c45567e87690 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:00.385753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38d30417-5a5f-4214-b7bb-c45567e87690 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:00.617807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-38d30417-5a5f-4214-b7bb-c45567e87690 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:00.623201 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-38d30417-5a5f-4214-b7bb-c45567e87690 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1345 microversion: 2.1 time: 0.266667 Oct 29 01:11:00.629523 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 895/1788] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:00 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1345 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:00.697446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d7c1b6a0-3ce9-46cb-a2aa-a3d497f754fc tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:00.699910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d7c1b6a0-3ce9-46cb-a2aa-a3d497f754fc tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:00.715990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7c1b6a0-3ce9-46cb-a2aa-a3d497f754fc tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:00.716485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7c1b6a0-3ce9-46cb-a2aa-a3d497f754fc tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:00.716931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7c1b6a0-3ce9-46cb-a2aa-a3d497f754fc tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:00.717714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7c1b6a0-3ce9-46cb-a2aa-a3d497f754fc tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:00.721525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7c1b6a0-3ce9-46cb-a2aa-a3d497f754fc tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:00.722906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7c1b6a0-3ce9-46cb-a2aa-a3d497f754fc tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:00.971606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d7c1b6a0-3ce9-46cb-a2aa-a3d497f754fc tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:01.001626 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d7c1b6a0-3ce9-46cb-a2aa-a3d497f754fc tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 200 len: 1276 microversion: 2.1 time: 0.315966 Oct 29 01:11:01.002230 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 896/1789] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:00 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 1276 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:01.383072 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1d5ad6cb-5e8b-4366-8b9c-730184023bf9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:01.387266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1d5ad6cb-5e8b-4366-8b9c-730184023bf9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:01.395582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d5ad6cb-5e8b-4366-8b9c-730184023bf9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:01.396083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d5ad6cb-5e8b-4366-8b9c-730184023bf9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:01.398780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d5ad6cb-5e8b-4366-8b9c-730184023bf9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:01.399586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d5ad6cb-5e8b-4366-8b9c-730184023bf9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:01.402501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d5ad6cb-5e8b-4366-8b9c-730184023bf9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:01.402966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d5ad6cb-5e8b-4366-8b9c-730184023bf9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:01.834410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1d5ad6cb-5e8b-4366-8b9c-730184023bf9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:01.847010 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1d5ad6cb-5e8b-4366-8b9c-730184023bf9 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1476 microversion: 2.1 time: 0.468467 Oct 29 01:11:01.849611 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 897/1790] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:01 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1476 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:01.861696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cdbbb82e-2548-41c1-8493-770cd1cc3134 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:01.865581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cdbbb82e-2548-41c1-8493-770cd1cc3134 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:01.878051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cdbbb82e-2548-41c1-8493-770cd1cc3134 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:01.881089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cdbbb82e-2548-41c1-8493-770cd1cc3134 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:01.881863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cdbbb82e-2548-41c1-8493-770cd1cc3134 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:01.886338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cdbbb82e-2548-41c1-8493-770cd1cc3134 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:01.886862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cdbbb82e-2548-41c1-8493-770cd1cc3134 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:01.887414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cdbbb82e-2548-41c1-8493-770cd1cc3134 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:02.027551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cdbbb82e-2548-41c1-8493-770cd1cc3134 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:02.048141 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cdbbb82e-2548-41c1-8493-770cd1cc3134 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1345 microversion: 2.1 time: 0.194726 Oct 29 01:11:02.068175 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 898/1791] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:01 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1345 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:02.074490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-8727ac3b-9dac-4a77-a733-fa14d2fc7312 req-2930dca5-e5ab-42b6-b78f-a934a11c970f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ea836d-4ec8-4646-a8f8-2c199985d829", "tag": "a2a1803b-2371-4f50-9500-0cc998cf3afa"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:02.088427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8727ac3b-9dac-4a77-a733-fa14d2fc7312 req-2930dca5-e5ab-42b6-b78f-a934a11c970f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:02.090594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8727ac3b-9dac-4a77-a733-fa14d2fc7312 req-2930dca5-e5ab-42b6-b78f-a934a11c970f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:02.091122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8727ac3b-9dac-4a77-a733-fa14d2fc7312 req-2930dca5-e5ab-42b6-b78f-a934a11c970f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:02.127872 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-8727ac3b-9dac-4a77-a733-fa14d2fc7312 req-2930dca5-e5ab-42b6-b78f-a934a11c970f service nova] Creating event network-changed:a2a1803b-2371-4f50-9500-0cc998cf3afa for instance b7ea836d-4ec8-4646-a8f8-2c199985d829 on n-h1-862964-3 Oct 29 01:11:02.144191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [req-8727ac3b-9dac-4a77-a733-fa14d2fc7312 req-2930dca5-e5ab-42b6-b78f-a934a11c970f service nova] Instance b7ea836d-4ec8-4646-a8f8-2c199985d829 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121100) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:11:02.182674 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-8727ac3b-9dac-4a77-a733-fa14d2fc7312 req-2930dca5-e5ab-42b6-b78f-a934a11c970f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112376 Oct 29 01:11:02.184571 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 899/1792] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:02.192033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-06c0c5f3-9756-4205-9c20-e0a3a103752d tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:02.204945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-06c0c5f3-9756-4205-9c20-e0a3a103752d tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:02.223998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06c0c5f3-9756-4205-9c20-e0a3a103752d tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:02.224639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06c0c5f3-9756-4205-9c20-e0a3a103752d tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:02.226472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06c0c5f3-9756-4205-9c20-e0a3a103752d tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:02.228612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06c0c5f3-9756-4205-9c20-e0a3a103752d tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:02.229468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06c0c5f3-9756-4205-9c20-e0a3a103752d tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:02.230245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06c0c5f3-9756-4205-9c20-e0a3a103752d tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:02.590979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-06c0c5f3-9756-4205-9c20-e0a3a103752d tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:02.605308 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-06c0c5f3-9756-4205-9c20-e0a3a103752d tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 200 len: 1316 microversion: 2.1 time: 0.418757 Oct 29 01:11:02.626204 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 900/1793] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:02 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 1316 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:02.881858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ac4ea314-ada3-4aa3-94d0-96833889f93f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:02.882566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ac4ea314-ada3-4aa3-94d0-96833889f93f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:02.903383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac4ea314-ada3-4aa3-94d0-96833889f93f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:02.905631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac4ea314-ada3-4aa3-94d0-96833889f93f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:02.906284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac4ea314-ada3-4aa3-94d0-96833889f93f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:02.909510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac4ea314-ada3-4aa3-94d0-96833889f93f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:02.911616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac4ea314-ada3-4aa3-94d0-96833889f93f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:02.914721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac4ea314-ada3-4aa3-94d0-96833889f93f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:03.343657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ac4ea314-ada3-4aa3-94d0-96833889f93f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:03.360048 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ac4ea314-ada3-4aa3-94d0-96833889f93f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1476 microversion: 2.1 time: 0.486626 Oct 29 01:11:03.365228 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 901/1794] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:02 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1476 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:03.370270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2432596a-dbae-48c4-8303-aec7da9a4f29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:03.375904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2432596a-dbae-48c4-8303-aec7da9a4f29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:03.379490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2432596a-dbae-48c4-8303-aec7da9a4f29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:03.380406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2432596a-dbae-48c4-8303-aec7da9a4f29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:03.381088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2432596a-dbae-48c4-8303-aec7da9a4f29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:03.382164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2432596a-dbae-48c4-8303-aec7da9a4f29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:03.383060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2432596a-dbae-48c4-8303-aec7da9a4f29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:03.383855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2432596a-dbae-48c4-8303-aec7da9a4f29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:03.522239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2432596a-dbae-48c4-8303-aec7da9a4f29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:03.538884 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2432596a-dbae-48c4-8303-aec7da9a4f29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1345 microversion: 2.1 time: 0.172276 Oct 29 01:11:03.540052 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 902/1795] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:03 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1345 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:03.631779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3d793beb-6528-47b4-89f9-ede46a3d9f17 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:03.632799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3d793beb-6528-47b4-89f9-ede46a3d9f17 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:03.642136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d793beb-6528-47b4-89f9-ede46a3d9f17 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:03.644554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d793beb-6528-47b4-89f9-ede46a3d9f17 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:03.644554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d793beb-6528-47b4-89f9-ede46a3d9f17 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:03.644554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d793beb-6528-47b4-89f9-ede46a3d9f17 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:03.644848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d793beb-6528-47b4-89f9-ede46a3d9f17 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:03.645472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d793beb-6528-47b4-89f9-ede46a3d9f17 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:03.877639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3d793beb-6528-47b4-89f9-ede46a3d9f17 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:03.885958 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3d793beb-6528-47b4-89f9-ede46a3d9f17 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 200 len: 1316 microversion: 2.1 time: 0.258139 Oct 29 01:11:03.887288 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 903/1796] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:03 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:04.287332 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-df1acb7e-3472-4cc8-ace9-8def0487bfe6 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/action" status: 202 len: 0 microversion: 2.1 time: 4.383567 Oct 29 01:11:04.292182 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 894/1797] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:10:59 2022] POST /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/action => generated 0 bytes in 4385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:11:04.299870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6b9b232b-d96c-401f-8bfa-cb8f49206a62 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:04.300801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6b9b232b-d96c-401f-8bfa-cb8f49206a62 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:04.306923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4c3bda41-abd5-46ca-b4e0-47ebbd9508b0 req-d6857b9e-d904-4acd-a96c-745c2f3ffefc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9161092b-7dfe-4c41-bcac-1d65112ead16", "tag": "0ce52fe8-a1fb-40ab-a07d-d5448dd21825"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:04.308641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b9b232b-d96c-401f-8bfa-cb8f49206a62 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:04.309141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b9b232b-d96c-401f-8bfa-cb8f49206a62 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:04.309609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b9b232b-d96c-401f-8bfa-cb8f49206a62 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:04.310333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b9b232b-d96c-401f-8bfa-cb8f49206a62 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:04.310793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b9b232b-d96c-401f-8bfa-cb8f49206a62 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:04.311223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b9b232b-d96c-401f-8bfa-cb8f49206a62 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:04.340544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4c3bda41-abd5-46ca-b4e0-47ebbd9508b0 req-d6857b9e-d904-4acd-a96c-745c2f3ffefc service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:04.341056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4c3bda41-abd5-46ca-b4e0-47ebbd9508b0 req-d6857b9e-d904-4acd-a96c-745c2f3ffefc service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:04.341830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4c3bda41-abd5-46ca-b4e0-47ebbd9508b0 req-d6857b9e-d904-4acd-a96c-745c2f3ffefc service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:04.362471 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4c3bda41-abd5-46ca-b4e0-47ebbd9508b0 req-d6857b9e-d904-4acd-a96c-745c2f3ffefc service nova] Creating event network-changed:0ce52fe8-a1fb-40ab-a07d-d5448dd21825 for instance 9161092b-7dfe-4c41-bcac-1d65112ead16 on n-h1-862964-3 Oct 29 01:11:04.369404 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4c3bda41-abd5-46ca-b4e0-47ebbd9508b0 req-d6857b9e-d904-4acd-a96c-745c2f3ffefc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069277 Oct 29 01:11:04.370940 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 895/1798] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:11:04.483753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6b9b232b-d96c-401f-8bfa-cb8f49206a62 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:04.499165 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6b9b232b-d96c-401f-8bfa-cb8f49206a62 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.203502 Oct 29 01:11:04.500112 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 904/1799] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:04 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:04.567528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0afbfa99-bd0a-4a5f-a480-a2ddf37b882a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:04.568090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0afbfa99-bd0a-4a5f-a480-a2ddf37b882a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:04.576614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0afbfa99-bd0a-4a5f-a480-a2ddf37b882a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:04.577292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0afbfa99-bd0a-4a5f-a480-a2ddf37b882a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:04.577742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0afbfa99-bd0a-4a5f-a480-a2ddf37b882a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:04.578545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0afbfa99-bd0a-4a5f-a480-a2ddf37b882a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:04.579182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0afbfa99-bd0a-4a5f-a480-a2ddf37b882a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:04.579612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0afbfa99-bd0a-4a5f-a480-a2ddf37b882a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:04.621380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c88e894e-7fea-4304-a0e6-f6af377c54fa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:04.622416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c88e894e-7fea-4304-a0e6-f6af377c54fa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:04.630866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c88e894e-7fea-4304-a0e6-f6af377c54fa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:04.631402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c88e894e-7fea-4304-a0e6-f6af377c54fa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:04.632166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c88e894e-7fea-4304-a0e6-f6af377c54fa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:04.633062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c88e894e-7fea-4304-a0e6-f6af377c54fa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:04.633701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c88e894e-7fea-4304-a0e6-f6af377c54fa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:04.634292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c88e894e-7fea-4304-a0e6-f6af377c54fa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:04.686144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0afbfa99-bd0a-4a5f-a480-a2ddf37b882a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:04.690468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:04.701403 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0afbfa99-bd0a-4a5f-a480-a2ddf37b882a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1345 microversion: 2.1 time: 0.138696 Oct 29 01:11:04.702793 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 905/1800] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:04 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:04.911479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a120f520-cd0c-4f73-9802-8aec3778e336 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:04.912208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a120f520-cd0c-4f73-9802-8aec3778e336 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:04.920867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a120f520-cd0c-4f73-9802-8aec3778e336 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:04.921643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a120f520-cd0c-4f73-9802-8aec3778e336 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:04.921957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a120f520-cd0c-4f73-9802-8aec3778e336 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:04.923831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a120f520-cd0c-4f73-9802-8aec3778e336 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:04.924292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a120f520-cd0c-4f73-9802-8aec3778e336 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:04.924724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a120f520-cd0c-4f73-9802-8aec3778e336 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:05.210967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c88e894e-7fea-4304-a0e6-f6af377c54fa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:05.236419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a120f520-cd0c-4f73-9802-8aec3778e336 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:05.240663 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c88e894e-7fea-4304-a0e6-f6af377c54fa tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1474 microversion: 2.1 time: 0.847658 Oct 29 01:11:05.253758 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 896/1801] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:04 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1474 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:05.256571 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a120f520-cd0c-4f73-9802-8aec3778e336 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 200 len: 1316 microversion: 2.1 time: 0.349833 Oct 29 01:11:05.257754 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 906/1802] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:04 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:05.524799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-314d64be-db80-4877-a53c-e1320cc31dfe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:05.532401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-314d64be-db80-4877-a53c-e1320cc31dfe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:05.548595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-314d64be-db80-4877-a53c-e1320cc31dfe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:05.549438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-314d64be-db80-4877-a53c-e1320cc31dfe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:05.549898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-314d64be-db80-4877-a53c-e1320cc31dfe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:05.550639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-314d64be-db80-4877-a53c-e1320cc31dfe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:05.551107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-314d64be-db80-4877-a53c-e1320cc31dfe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:05.551537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-314d64be-db80-4877-a53c-e1320cc31dfe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:05.729050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dcd7e2b9-4a9d-449f-bade-016bac2fe84e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:05.729947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dcd7e2b9-4a9d-449f-bade-016bac2fe84e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:05.739774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-314d64be-db80-4877-a53c-e1320cc31dfe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:05.745768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dcd7e2b9-4a9d-449f-bade-016bac2fe84e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:05.748108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dcd7e2b9-4a9d-449f-bade-016bac2fe84e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:05.748793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dcd7e2b9-4a9d-449f-bade-016bac2fe84e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:05.749394 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-314d64be-db80-4877-a53c-e1320cc31dfe tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.228947 Oct 29 01:11:05.750729 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 897/1803] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:05 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:05.760988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dcd7e2b9-4a9d-449f-bade-016bac2fe84e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:05.762401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dcd7e2b9-4a9d-449f-bade-016bac2fe84e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:05.765513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dcd7e2b9-4a9d-449f-bade-016bac2fe84e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:05.883591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-dcd7e2b9-4a9d-449f-bade-016bac2fe84e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:05.895533 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dcd7e2b9-4a9d-449f-bade-016bac2fe84e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1345 microversion: 2.1 time: 0.171488 Oct 29 01:11:05.896307 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 907/1804] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:05 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1345 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:06.269246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a812a9f6-a031-4764-a9ec-9d7328f1bd38 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:06.270122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a812a9f6-a031-4764-a9ec-9d7328f1bd38 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:06.279446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a812a9f6-a031-4764-a9ec-9d7328f1bd38 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:06.280189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a812a9f6-a031-4764-a9ec-9d7328f1bd38 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:06.280787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f9d3d879-0855-4792-99f1-39a7c9275ca4 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:06.281318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a812a9f6-a031-4764-a9ec-9d7328f1bd38 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:06.282427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f9d3d879-0855-4792-99f1-39a7c9275ca4 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:06.288197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a812a9f6-a031-4764-a9ec-9d7328f1bd38 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:06.288943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a812a9f6-a031-4764-a9ec-9d7328f1bd38 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:06.295234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9d3d879-0855-4792-99f1-39a7c9275ca4 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:06.295860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9d3d879-0855-4792-99f1-39a7c9275ca4 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:06.296291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a812a9f6-a031-4764-a9ec-9d7328f1bd38 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:06.296429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9d3d879-0855-4792-99f1-39a7c9275ca4 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:06.297555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9d3d879-0855-4792-99f1-39a7c9275ca4 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:06.298302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9d3d879-0855-4792-99f1-39a7c9275ca4 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:06.302669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9d3d879-0855-4792-99f1-39a7c9275ca4 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:06.475643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:06.663635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a812a9f6-a031-4764-a9ec-9d7328f1bd38 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:06.673246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f9d3d879-0855-4792-99f1-39a7c9275ca4 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:06.681605 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a812a9f6-a031-4764-a9ec-9d7328f1bd38 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1474 microversion: 2.1 time: 0.417310 Oct 29 01:11:06.682592 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 898/1805] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:06 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1474 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:06.684363 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f9d3d879-0855-4792-99f1-39a7c9275ca4 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 200 len: 1316 microversion: 2.1 time: 0.407547 Oct 29 01:11:06.684970 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 908/1806] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:06 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:06.778782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a72eda8f-a48f-406d-8ee2-ff791c8c8f39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:06.779732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a72eda8f-a48f-406d-8ee2-ff791c8c8f39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:06.785982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a72eda8f-a48f-406d-8ee2-ff791c8c8f39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:06.786473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a72eda8f-a48f-406d-8ee2-ff791c8c8f39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:06.790937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a72eda8f-a48f-406d-8ee2-ff791c8c8f39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:06.790937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a72eda8f-a48f-406d-8ee2-ff791c8c8f39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:06.790937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a72eda8f-a48f-406d-8ee2-ff791c8c8f39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:06.790937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a72eda8f-a48f-406d-8ee2-ff791c8c8f39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:06.896500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d473a3e2-9374-4a01-a2c7-350ef4ac15e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-276829424", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f4099806-4a58-499a-8649-04716b1c047c"}], "block_device_mapping_v2": [{"uuid": "b14676b1-777e-477d-a3b1-f2c0efdfc8a2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:06.924402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:06.994800 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-d473a3e2-9374-4a01-a2c7-350ef4ac15e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] validate_networks() for [('f4099806-4a58-499a-8649-04716b1c047c', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:11:07.108797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a72eda8f-a48f-406d-8ee2-ff791c8c8f39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:07.132954 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a72eda8f-a48f-406d-8ee2-ff791c8c8f39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.358127 Oct 29 01:11:07.134703 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 899/1807] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:06 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:07.139987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9eba0038-a8ec-49aa-96a6-f603014e7026 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:07.141604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9eba0038-a8ec-49aa-96a6-f603014e7026 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:07.148417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9eba0038-a8ec-49aa-96a6-f603014e7026 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:07.149253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9eba0038-a8ec-49aa-96a6-f603014e7026 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:07.149958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9eba0038-a8ec-49aa-96a6-f603014e7026 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:07.151059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9eba0038-a8ec-49aa-96a6-f603014e7026 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:07.151754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9eba0038-a8ec-49aa-96a6-f603014e7026 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:07.152394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9eba0038-a8ec-49aa-96a6-f603014e7026 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:07.195466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9eba0038-a8ec-49aa-96a6-f603014e7026 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:07.197687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9eba0038-a8ec-49aa-96a6-f603014e7026 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:07.198196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9eba0038-a8ec-49aa-96a6-f603014e7026 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:07.198664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-9eba0038-a8ec-49aa-96a6-f603014e7026 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lazy-loading 'fault' on Instance uuid ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:11:07.300367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9eba0038-a8ec-49aa-96a6-f603014e7026 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:07.312211 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9eba0038-a8ec-49aa-96a6-f603014e7026 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 200 len: 1350 microversion: 2.1 time: 0.175855 Oct 29 01:11:07.314587 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 900/1808] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:07 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 1350 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:07.593538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d473a3e2-9374-4a01-a2c7-350ef4ac15e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:11:07.594546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d473a3e2-9374-4a01-a2c7-350ef4ac15e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:11:07.595031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d473a3e2-9374-4a01-a2c7-350ef4ac15e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:11:07.596161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d473a3e2-9374-4a01-a2c7-350ef4ac15e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:11:07.596580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d473a3e2-9374-4a01-a2c7-350ef4ac15e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:11:07.606177 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d473a3e2-9374-4a01-a2c7-350ef4ac15e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:07.606989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d473a3e2-9374-4a01-a2c7-350ef4ac15e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:07.607437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d473a3e2-9374-4a01-a2c7-350ef4ac15e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:07.608441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d473a3e2-9374-4a01-a2c7-350ef4ac15e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:07.608959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d473a3e2-9374-4a01-a2c7-350ef4ac15e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:07.609885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d473a3e2-9374-4a01-a2c7-350ef4ac15e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:07.629009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-d473a3e2-9374-4a01-a2c7-350ef4ac15e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Getting quotas for project d0adfdd6819a472baf1aa25878c5ee22. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:11:07.634559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-d473a3e2-9374-4a01-a2c7-350ef4ac15e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Getting quotas for user c56d01b83c0649e0b1d47b7563892d3f and project d0adfdd6819a472baf1aa25878c5ee22. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:11:07.707011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9d5bc30c-ac25-4528-8541-477e67d7f0c1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:07.707718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9d5bc30c-ac25-4528-8541-477e67d7f0c1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:07.710774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d473a3e2-9374-4a01-a2c7-350ef4ac15e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:11:07.712924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d473a3e2-9374-4a01-a2c7-350ef4ac15e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b14676b1-777e-477d-a3b1-f2c0efdfc8a2',volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:11:07.713577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d5bc30c-ac25-4528-8541-477e67d7f0c1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:07.714060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d5bc30c-ac25-4528-8541-477e67d7f0c1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:07.714495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d5bc30c-ac25-4528-8541-477e67d7f0c1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:07.715183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d5bc30c-ac25-4528-8541-477e67d7f0c1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:07.715632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d5bc30c-ac25-4528-8541-477e67d7f0c1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:07.716051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d5bc30c-ac25-4528-8541-477e67d7f0c1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:07.858474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9d5bc30c-ac25-4528-8541-477e67d7f0c1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:07.866566 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9d5bc30c-ac25-4528-8541-477e67d7f0c1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1471 microversion: 2.1 time: 0.164249 Oct 29 01:11:07.867147 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 901/1809] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:07 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:07.871777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1e05a557-58cf-48e1-993a-8f23daf0fb6c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:07.872382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1e05a557-58cf-48e1-993a-8f23daf0fb6c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:07.878259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e05a557-58cf-48e1-993a-8f23daf0fb6c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:07.895515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e05a557-58cf-48e1-993a-8f23daf0fb6c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:07.895515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e05a557-58cf-48e1-993a-8f23daf0fb6c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:07.895515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e05a557-58cf-48e1-993a-8f23daf0fb6c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:07.895515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e05a557-58cf-48e1-993a-8f23daf0fb6c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:07.895515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e05a557-58cf-48e1-993a-8f23daf0fb6c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:08.044835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1e05a557-58cf-48e1-993a-8f23daf0fb6c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:08.056617 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1e05a557-58cf-48e1-993a-8f23daf0fb6c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 200 len: 1316 microversion: 2.1 time: 0.188257 Oct 29 01:11:08.059188 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 902/1810] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:07 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:08.070725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-97b6e89b-874d-42f9-a82b-07c74bf2b692 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:08.077947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-97b6e89b-874d-42f9-a82b-07c74bf2b692 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:08.087925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97b6e89b-874d-42f9-a82b-07c74bf2b692 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:08.088632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97b6e89b-874d-42f9-a82b-07c74bf2b692 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:08.089185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97b6e89b-874d-42f9-a82b-07c74bf2b692 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:08.090361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97b6e89b-874d-42f9-a82b-07c74bf2b692 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:08.091077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97b6e89b-874d-42f9-a82b-07c74bf2b692 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:08.092661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97b6e89b-874d-42f9-a82b-07c74bf2b692 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:08.186581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:08.408164 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d473a3e2-9374-4a01-a2c7-350ef4ac15e1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.518014 Oct 29 01:11:08.409465 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 909/1811] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 29 01:11:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1520 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 29 01:11:08.420019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-901938e8-ae18-40e0-9a36-c5795024ffe4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:08.420740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-901938e8-ae18-40e0-9a36-c5795024ffe4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:08.430756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-901938e8-ae18-40e0-9a36-c5795024ffe4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:08.431551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-901938e8-ae18-40e0-9a36-c5795024ffe4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:08.433143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-901938e8-ae18-40e0-9a36-c5795024ffe4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:08.441609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-901938e8-ae18-40e0-9a36-c5795024ffe4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:08.442411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-901938e8-ae18-40e0-9a36-c5795024ffe4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:08.443028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-901938e8-ae18-40e0-9a36-c5795024ffe4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:08.489559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:08.543188 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-97b6e89b-874d-42f9-a82b-07c74bf2b692 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "POST /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829/action" status: 202 len: 0 microversion: 2.1 time: 0.482331 Oct 29 01:11:08.544091 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 903/1812] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:11:08 2022] POST /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:11:08.551389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f333a350-1ad3-44e0-8680-5678d7c4d72c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:08.552379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f333a350-1ad3-44e0-8680-5678d7c4d72c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:08.563975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f333a350-1ad3-44e0-8680-5678d7c4d72c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:08.564748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f333a350-1ad3-44e0-8680-5678d7c4d72c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:08.567403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f333a350-1ad3-44e0-8680-5678d7c4d72c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:08.575581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f333a350-1ad3-44e0-8680-5678d7c4d72c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:08.575581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f333a350-1ad3-44e0-8680-5678d7c4d72c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:08.575581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f333a350-1ad3-44e0-8680-5678d7c4d72c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:08.591372 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-f333a350-1ad3-44e0-8680-5678d7c4d72c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f333a350-1ad3-44e0-8680-5678d7c4d72c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 HTTP/1.1 Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'ba5e830e-0f0f-4f57-93c4-a42dcd3a3003'} Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:08.593176 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:08.599538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:08.599538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:08.599538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:08.599538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:11:08.599538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:11:08.599538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:11:08.599538 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:08.601375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f333a350-1ad3-44e0-8680-5678d7c4d72c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:11:08.602616 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f333a350-1ad3-44e0-8680-5678d7c4d72c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 404 len: 111 microversion: 2.1 time: 0.056726 Oct 29 01:11:08.604032 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 904/1813] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:08 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:11:08.650940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eb2eb07e-1330-40b3-a68c-09b206b31110 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:08.650940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eb2eb07e-1330-40b3-a68c-09b206b31110 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:08.747364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-901938e8-ae18-40e0-9a36-c5795024ffe4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:08.761551 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-901938e8-ae18-40e0-9a36-c5795024ffe4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.350718 Oct 29 01:11:08.762147 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 910/1814] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:08 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:08.779114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-24a14cb2-f7a9-4897-847d-55a470bab422 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:08.780668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-24a14cb2-f7a9-4897-847d-55a470bab422 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:08.800363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24a14cb2-f7a9-4897-847d-55a470bab422 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:08.800858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24a14cb2-f7a9-4897-847d-55a470bab422 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:08.801328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24a14cb2-f7a9-4897-847d-55a470bab422 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:08.802026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24a14cb2-f7a9-4897-847d-55a470bab422 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:08.807802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24a14cb2-f7a9-4897-847d-55a470bab422 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:08.813984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24a14cb2-f7a9-4897-847d-55a470bab422 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:08.842542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eb2eb07e-1330-40b3-a68c-09b206b31110 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:08.854744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eb2eb07e-1330-40b3-a68c-09b206b31110 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:08.862939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eb2eb07e-1330-40b3-a68c-09b206b31110 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:08.872600 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eb2eb07e-1330-40b3-a68c-09b206b31110 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1103 microversion: 2.25 time: 0.267037 Oct 29 01:11:08.876055 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 905/1815] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:08 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1103 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:08.926955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b277598f-6ff4-48e7-a7ae-da3c34897696 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:08.933502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b277598f-6ff4-48e7-a7ae-da3c34897696 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:08.948244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b277598f-6ff4-48e7-a7ae-da3c34897696 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:08.948816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b277598f-6ff4-48e7-a7ae-da3c34897696 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:08.949694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b277598f-6ff4-48e7-a7ae-da3c34897696 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:08.951986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b277598f-6ff4-48e7-a7ae-da3c34897696 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:08.951986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b277598f-6ff4-48e7-a7ae-da3c34897696 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:08.951986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b277598f-6ff4-48e7-a7ae-da3c34897696 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:08.987195 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-b277598f-6ff4-48e7-a7ae-da3c34897696 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b277598f-6ff4-48e7-a7ae-da3c34897696 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003/os-volume_attachments HTTP/1.1 Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'server_id': 'ba5e830e-0f0f-4f57-93c4-a42dcd3a3003'} Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:11:08.999242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:11:09.005931 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:11:09.005931 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:09.005931 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:09.005931 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:09.005931 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:09.005931 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:09.005931 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:09.005931 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:11:09.005931 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:11:09.005931 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:11:09.005931 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:09.009060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b277598f-6ff4-48e7-a7ae-da3c34897696 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:11:09.010456 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b277598f-6ff4-48e7-a7ae-da3c34897696 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.133180 Oct 29 01:11:09.012277 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 906/1816] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:11:08 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003/os-volume_attachments => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:11:09.084674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cf2721ff-9363-4ec6-a952-f6d95ffaf8e7 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:09.085621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cf2721ff-9363-4ec6-a952-f6d95ffaf8e7 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:09.103710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-24a14cb2-f7a9-4897-847d-55a470bab422 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:09.104719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf2721ff-9363-4ec6-a952-f6d95ffaf8e7 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:09.105677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf2721ff-9363-4ec6-a952-f6d95ffaf8e7 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:09.107580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf2721ff-9363-4ec6-a952-f6d95ffaf8e7 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:09.111652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf2721ff-9363-4ec6-a952-f6d95ffaf8e7 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:09.113253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf2721ff-9363-4ec6-a952-f6d95ffaf8e7 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:09.117894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf2721ff-9363-4ec6-a952-f6d95ffaf8e7 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:09.118718 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-24a14cb2-f7a9-4897-847d-55a470bab422 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1470 microversion: 2.1 time: 0.353452 Oct 29 01:11:09.139538 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 911/1817] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:08 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1470 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:09.320273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cd4f6d5c-8866-45ba-8cf4-03e42bc2899d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-710259536", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "95eff624-38bf-46e7-958c-9fcb3dae19f9"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:09.334941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cf2721ff-9363-4ec6-a952-f6d95ffaf8e7 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:09.343596 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cf2721ff-9363-4ec6-a952-f6d95ffaf8e7 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 200 len: 1316 microversion: 2.1 time: 0.265891 Oct 29 01:11:09.344285 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 907/1818] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:09 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:09.427611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-cd4f6d5c-8866-45ba-8cf4-03e42bc2899d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] validate_networks() for [('95eff624-38bf-46e7-958c-9fcb3dae19f9', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:11:09.782664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-6d5a2a4a-ed36-4446-8598-a9b4a1f979da req-74cc2e18-b17d-4c39-aee6-c2ba0b4c1003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ea836d-4ec8-4646-a8f8-2c199985d829", "name": "network-vif-plugged", "status": "completed", "tag": "a2a1803b-2371-4f50-9500-0cc998cf3afa"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:09.808673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6d5a2a4a-ed36-4446-8598-a9b4a1f979da req-74cc2e18-b17d-4c39-aee6-c2ba0b4c1003 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:09.814582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6d5a2a4a-ed36-4446-8598-a9b4a1f979da req-74cc2e18-b17d-4c39-aee6-c2ba0b4c1003 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:09.815380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6d5a2a4a-ed36-4446-8598-a9b4a1f979da req-74cc2e18-b17d-4c39-aee6-c2ba0b4c1003 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:09.839211 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-6d5a2a4a-ed36-4446-8598-a9b4a1f979da req-74cc2e18-b17d-4c39-aee6-c2ba0b4c1003 service nova] Creating event network-vif-plugged:a2a1803b-2371-4f50-9500-0cc998cf3afa for instance b7ea836d-4ec8-4646-a8f8-2c199985d829 on n-h1-862964-3 Oct 29 01:11:09.847519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [req-6d5a2a4a-ed36-4446-8598-a9b4a1f979da req-74cc2e18-b17d-4c39-aee6-c2ba0b4c1003 service nova] Instance b7ea836d-4ec8-4646-a8f8-2c199985d829 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121099) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:11:09.861322 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-6d5a2a4a-ed36-4446-8598-a9b4a1f979da req-74cc2e18-b17d-4c39-aee6-c2ba0b4c1003 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082976 Oct 29 01:11:09.862418 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 908/1819] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:11:09.869374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0a708213-86a4-4c56-aded-c60d2e98059f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:09.870769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0a708213-86a4-4c56-aded-c60d2e98059f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:09.878861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a708213-86a4-4c56-aded-c60d2e98059f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:09.879705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a708213-86a4-4c56-aded-c60d2e98059f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:09.880392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a708213-86a4-4c56-aded-c60d2e98059f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:09.881378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a708213-86a4-4c56-aded-c60d2e98059f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:09.882065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a708213-86a4-4c56-aded-c60d2e98059f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:09.882759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a708213-86a4-4c56-aded-c60d2e98059f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:10.249754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-cd4f6d5c-8866-45ba-8cf4-03e42bc2899d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:11:10.252346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-cd4f6d5c-8866-45ba-8cf4-03e42bc2899d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:11:10.253027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-cd4f6d5c-8866-45ba-8cf4-03e42bc2899d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:11:10.253819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-cd4f6d5c-8866-45ba-8cf4-03e42bc2899d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:11:10.254622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-cd4f6d5c-8866-45ba-8cf4-03e42bc2899d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:11:10.277520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd4f6d5c-8866-45ba-8cf4-03e42bc2899d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:10.278590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd4f6d5c-8866-45ba-8cf4-03e42bc2899d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:10.279535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd4f6d5c-8866-45ba-8cf4-03e42bc2899d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:10.283599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd4f6d5c-8866-45ba-8cf4-03e42bc2899d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:10.284735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd4f6d5c-8866-45ba-8cf4-03e42bc2899d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:10.285380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd4f6d5c-8866-45ba-8cf4-03e42bc2899d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:10.347814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0a708213-86a4-4c56-aded-c60d2e98059f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:10.361607 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0a708213-86a4-4c56-aded-c60d2e98059f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.495196 Oct 29 01:11:10.365137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-cd4f6d5c-8866-45ba-8cf4-03e42bc2899d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Getting quotas for project f421c64f9b2f49ebab46d9f8a28143d6. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:11:10.373976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-cd4f6d5c-8866-45ba-8cf4-03e42bc2899d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Getting quotas for user 4ae0a54f51ad4813b312baf3a03ba172 and project f421c64f9b2f49ebab46d9f8a28143d6. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:11:10.377127 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 909/1820] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:09 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:10.396825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-06668ed1-2bbe-4f8c-9918-8d9cc8dbda29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:10.397743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-06668ed1-2bbe-4f8c-9918-8d9cc8dbda29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:10.406106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06668ed1-2bbe-4f8c-9918-8d9cc8dbda29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:10.407395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06668ed1-2bbe-4f8c-9918-8d9cc8dbda29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:10.408105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06668ed1-2bbe-4f8c-9918-8d9cc8dbda29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:10.408989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06668ed1-2bbe-4f8c-9918-8d9cc8dbda29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:10.409643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06668ed1-2bbe-4f8c-9918-8d9cc8dbda29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:10.410328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06668ed1-2bbe-4f8c-9918-8d9cc8dbda29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:10.438877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cd4f6d5c-8866-45ba-8cf4-03e42bc2899d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:11:10.446977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cd4f6d5c-8866-45ba-8cf4-03e42bc2899d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: d6800a60-316f-41e4-a3bb-9e2c10f34939] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:11:10.648757 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cd4f6d5c-8866-45ba-8cf4-03e42bc2899d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.337877 Oct 29 01:11:10.658624 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 912/1821] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:11:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:11:10.673444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-996714e9-34ad-4e19-b3b4-0ddf5d480c19 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:10.680464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-996714e9-34ad-4e19-b3b4-0ddf5d480c19 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:10.699133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-996714e9-34ad-4e19-b3b4-0ddf5d480c19 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:10.699373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-996714e9-34ad-4e19-b3b4-0ddf5d480c19 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:10.710678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-996714e9-34ad-4e19-b3b4-0ddf5d480c19 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:10.711311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-06668ed1-2bbe-4f8c-9918-8d9cc8dbda29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:10.711458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-996714e9-34ad-4e19-b3b4-0ddf5d480c19 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:10.711458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-996714e9-34ad-4e19-b3b4-0ddf5d480c19 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:10.711458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-996714e9-34ad-4e19-b3b4-0ddf5d480c19 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:10.733954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-06668ed1-2bbe-4f8c-9918-8d9cc8dbda29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:10.744358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-06668ed1-2bbe-4f8c-9918-8d9cc8dbda29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:10.752942 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-06668ed1-2bbe-4f8c-9918-8d9cc8dbda29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1176 microversion: 2.25 time: 0.361341 Oct 29 01:11:10.760339 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 910/1822] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:10 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1176 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:10.786835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5c211fa7-c88a-4cda-90aa-b097201adce1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:10.787464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5c211fa7-c88a-4cda-90aa-b097201adce1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:10.807584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c211fa7-c88a-4cda-90aa-b097201adce1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:10.813371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c211fa7-c88a-4cda-90aa-b097201adce1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:10.813743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c211fa7-c88a-4cda-90aa-b097201adce1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:10.814487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c211fa7-c88a-4cda-90aa-b097201adce1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:10.815133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c211fa7-c88a-4cda-90aa-b097201adce1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:10.815940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c211fa7-c88a-4cda-90aa-b097201adce1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:11.225918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-996714e9-34ad-4e19-b3b4-0ddf5d480c19 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:11.238972 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-996714e9-34ad-4e19-b3b4-0ddf5d480c19 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1470 microversion: 2.1 time: 0.578974 Oct 29 01:11:11.239579 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 913/1823] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:10 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1470 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:11.254329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a885e2d5-7d9c-4bcc-8610-7fbf7c664a2f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:11.258386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a885e2d5-7d9c-4bcc-8610-7fbf7c664a2f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: d6800a60-316f-41e4-a3bb-9e2c10f34939] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:11.271260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5c211fa7-c88a-4cda-90aa-b097201adce1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:11.279370 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5c211fa7-c88a-4cda-90aa-b097201adce1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 200 len: 1316 microversion: 2.1 time: 0.508714 Oct 29 01:11:11.279870 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 911/1824] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:10 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:11.352205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a885e2d5-7d9c-4bcc-8610-7fbf7c664a2f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:11.359822 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a885e2d5-7d9c-4bcc-8610-7fbf7c664a2f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/d6800a60-316f-41e4-a3bb-9e2c10f34939" status: 200 len: 1214 microversion: 2.1 time: 0.118920 Oct 29 01:11:11.381588 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 914/1825] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:11 2022] GET /compute/v2.1/servers/d6800a60-316f-41e4-a3bb-9e2c10f34939 => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:11.387089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-92e58992-e642-4b4e-a648-9d5103197b3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:11.387964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-92e58992-e642-4b4e-a648-9d5103197b3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:11.396801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fdd05a6a-4429-425c-9469-79a5e2ac6cd2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:11.402501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fdd05a6a-4429-425c-9469-79a5e2ac6cd2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: d6800a60-316f-41e4-a3bb-9e2c10f34939] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:11.402661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92e58992-e642-4b4e-a648-9d5103197b3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:11.402944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92e58992-e642-4b4e-a648-9d5103197b3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:11.403476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92e58992-e642-4b4e-a648-9d5103197b3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:11.404196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92e58992-e642-4b4e-a648-9d5103197b3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:11.404650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92e58992-e642-4b4e-a648-9d5103197b3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:11.415673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92e58992-e642-4b4e-a648-9d5103197b3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:11.443050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fdd05a6a-4429-425c-9469-79a5e2ac6cd2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: d6800a60-316f-41e4-a3bb-9e2c10f34939] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:11:11.983543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-92e58992-e642-4b4e-a648-9d5103197b3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:12.001869 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-92e58992-e642-4b4e-a648-9d5103197b3d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.618946 Oct 29 01:11:12.008221 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 912/1826] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:11 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:12.021321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2cbfa84c-14bd-4d4c-97bb-f3ee18c3f9a6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:12.022221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2cbfa84c-14bd-4d4c-97bb-f3ee18c3f9a6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:12.032530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cbfa84c-14bd-4d4c-97bb-f3ee18c3f9a6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:12.033340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cbfa84c-14bd-4d4c-97bb-f3ee18c3f9a6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:12.035317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cbfa84c-14bd-4d4c-97bb-f3ee18c3f9a6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:12.036232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cbfa84c-14bd-4d4c-97bb-f3ee18c3f9a6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:12.050008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cbfa84c-14bd-4d4c-97bb-f3ee18c3f9a6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:12.050751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cbfa84c-14bd-4d4c-97bb-f3ee18c3f9a6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:12.128138 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.scheduler.client.report [None req-fdd05a6a-4429-425c-9469-79a5e2ac6cd2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Deleted allocations for instance d6800a60-316f-41e4-a3bb-9e2c10f34939 Oct 29 01:11:12.226104 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fdd05a6a-4429-425c-9469-79a5e2ac6cd2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d6800a60-316f-41e4-a3bb-9e2c10f34939" status: 204 len: 0 microversion: 2.1 time: 0.833204 Oct 29 01:11:12.227486 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 915/1827] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:11:11 2022] DELETE /compute/v2.1/servers/d6800a60-316f-41e4-a3bb-9e2c10f34939 => generated 0 bytes in 835 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:11:12.233903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2cbfa84c-14bd-4d4c-97bb-f3ee18c3f9a6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:12.242812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fdaef99f-bd0c-48b5-a078-93452b008c29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:12.242812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fdaef99f-bd0c-48b5-a078-93452b008c29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: d6800a60-316f-41e4-a3bb-9e2c10f34939] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:12.245633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2cbfa84c-14bd-4d4c-97bb-f3ee18c3f9a6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:12.247783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fdaef99f-bd0c-48b5-a078-93452b008c29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:12.248637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fdaef99f-bd0c-48b5-a078-93452b008c29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:12.249307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fdaef99f-bd0c-48b5-a078-93452b008c29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:12.251323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2cbfa84c-14bd-4d4c-97bb-f3ee18c3f9a6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:12.251920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fdaef99f-bd0c-48b5-a078-93452b008c29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:12.254852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fdaef99f-bd0c-48b5-a078-93452b008c29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:12.255447 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2cbfa84c-14bd-4d4c-97bb-f3ee18c3f9a6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1240 microversion: 2.25 time: 0.245767 Oct 29 01:11:12.256089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fdaef99f-bd0c-48b5-a078-93452b008c29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:12.264657 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 913/1828] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:12 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1240 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:12.272892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-46840100-d1ca-4b92-a229-7c6c3d262f1c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:12.274224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-46840100-d1ca-4b92-a229-7c6c3d262f1c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:12.290036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46840100-d1ca-4b92-a229-7c6c3d262f1c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:12.291098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46840100-d1ca-4b92-a229-7c6c3d262f1c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:12.293143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46840100-d1ca-4b92-a229-7c6c3d262f1c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:12.301445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46840100-d1ca-4b92-a229-7c6c3d262f1c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:12.301445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46840100-d1ca-4b92-a229-7c6c3d262f1c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:12.301445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46840100-d1ca-4b92-a229-7c6c3d262f1c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:12.627703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fdaef99f-bd0c-48b5-a078-93452b008c29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:12.639943 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fdaef99f-bd0c-48b5-a078-93452b008c29 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/d6800a60-316f-41e4-a3bb-9e2c10f34939" status: 200 len: 1218 microversion: 2.1 time: 0.407349 Oct 29 01:11:12.661535 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 916/1829] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:12 2022] GET /compute/v2.1/servers/d6800a60-316f-41e4-a3bb-9e2c10f34939 => generated 1218 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:12.668096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2c048208-56d9-42c4-90d2-a4c371ec22dd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:12.674793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2c048208-56d9-42c4-90d2-a4c371ec22dd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:12.689879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c048208-56d9-42c4-90d2-a4c371ec22dd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:12.690707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c048208-56d9-42c4-90d2-a4c371ec22dd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:12.692380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c048208-56d9-42c4-90d2-a4c371ec22dd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:12.704654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c048208-56d9-42c4-90d2-a4c371ec22dd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:12.704654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c048208-56d9-42c4-90d2-a4c371ec22dd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:12.704654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c048208-56d9-42c4-90d2-a4c371ec22dd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:13.198006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-46840100-d1ca-4b92-a229-7c6c3d262f1c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:13.215285 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-46840100-d1ca-4b92-a229-7c6c3d262f1c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1470 microversion: 2.1 time: 0.949299 Oct 29 01:11:13.229637 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 914/1830] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:12 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1470 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:13.237237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5a4c405f-4df4-4532-8994-8259f55e6107 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:13.238101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5a4c405f-4df4-4532-8994-8259f55e6107 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:13.244628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a4c405f-4df4-4532-8994-8259f55e6107 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:13.245362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a4c405f-4df4-4532-8994-8259f55e6107 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:13.246001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a4c405f-4df4-4532-8994-8259f55e6107 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:13.246885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a4c405f-4df4-4532-8994-8259f55e6107 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:13.247520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a4c405f-4df4-4532-8994-8259f55e6107 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:13.248126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a4c405f-4df4-4532-8994-8259f55e6107 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:13.271813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2c048208-56d9-42c4-90d2-a4c371ec22dd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:13.282668 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2c048208-56d9-42c4-90d2-a4c371ec22dd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 200 len: 1316 microversion: 2.1 time: 0.619802 Oct 29 01:11:13.288696 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 917/1831] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:12 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 1316 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:13.303583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ea6d9b43-77a4-4129-9c96-b9f0580cf7a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:13.304777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ea6d9b43-77a4-4129-9c96-b9f0580cf7a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:13.319167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea6d9b43-77a4-4129-9c96-b9f0580cf7a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:13.321209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea6d9b43-77a4-4129-9c96-b9f0580cf7a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:13.323988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea6d9b43-77a4-4129-9c96-b9f0580cf7a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:13.325313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea6d9b43-77a4-4129-9c96-b9f0580cf7a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:13.326210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea6d9b43-77a4-4129-9c96-b9f0580cf7a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:13.332957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea6d9b43-77a4-4129-9c96-b9f0580cf7a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:13.522262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ea6d9b43-77a4-4129-9c96-b9f0580cf7a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:13.536113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ea6d9b43-77a4-4129-9c96-b9f0580cf7a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:13.537927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ea6d9b43-77a4-4129-9c96-b9f0580cf7a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:13.539589 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ea6d9b43-77a4-4129-9c96-b9f0580cf7a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1250 microversion: 2.25 time: 0.248458 Oct 29 01:11:13.556375 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 918/1832] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:13 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1250 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:13.599704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5a4c405f-4df4-4532-8994-8259f55e6107 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:13.612234 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5a4c405f-4df4-4532-8994-8259f55e6107 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.381127 Oct 29 01:11:13.628041 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 915/1833] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:13 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:13.668594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b847f9f9-abc1-4c22-89c4-610de0e09277 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:13.669350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b847f9f9-abc1-4c22-89c4-610de0e09277 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: d6800a60-316f-41e4-a3bb-9e2c10f34939] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:13.675250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:13.677220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b847f9f9-abc1-4c22-89c4-610de0e09277 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:13.677802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b847f9f9-abc1-4c22-89c4-610de0e09277 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:13.678495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b847f9f9-abc1-4c22-89c4-610de0e09277 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:13.679418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b847f9f9-abc1-4c22-89c4-610de0e09277 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:13.679971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b847f9f9-abc1-4c22-89c4-610de0e09277 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:13.680607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b847f9f9-abc1-4c22-89c4-610de0e09277 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:13.695827 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-b847f9f9-abc1-4c22-89c4-610de0e09277 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance d6800a60-316f-41e4-a3bb-9e2c10f34939 could not be found. Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b847f9f9-abc1-4c22-89c4-610de0e09277 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/d6800a60-316f-41e4-a3bb-9e2c10f34939 HTTP/1.1 Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance d6800a60-316f-41e4-a3bb-9e2c10f34939 could not be found. Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'd6800a60-316f-41e4-a3bb-9e2c10f34939'} Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6800a60-316f-41e4-a3bb-9e2c10f34939 could not be found. Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6800a60-316f-41e4-a3bb-9e2c10f34939 could not be found. Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:13.697882 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:11:13.703357 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:13.703357 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:13.703357 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:13.703357 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:11:13.703357 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:11:13.703357 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6800a60-316f-41e4-a3bb-9e2c10f34939 could not be found. Oct 29 01:11:13.703357 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:11:13.705081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b847f9f9-abc1-4c22-89c4-610de0e09277 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance d6800a60-316f-41e4-a3bb-9e2c10f34939 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:11:13.706158 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b847f9f9-abc1-4c22-89c4-610de0e09277 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/d6800a60-316f-41e4-a3bb-9e2c10f34939" status: 404 len: 111 microversion: 2.1 time: 0.042121 Oct 29 01:11:13.707302 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 919/1834] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:13 2022] GET /compute/v2.1/servers/d6800a60-316f-41e4-a3bb-9e2c10f34939 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:11:13.776908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8a3d94a6-9de3-4660-ae67-33b49615a39d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1980208834", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "95eff624-38bf-46e7-958c-9fcb3dae19f9"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:13.869606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-8a3d94a6-9de3-4660-ae67-33b49615a39d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] validate_networks() for [('95eff624-38bf-46e7-958c-9fcb3dae19f9', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:11:14.245114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9af54144-0fd1-4e02-97ed-db6fb29cb505 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:14.246052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9af54144-0fd1-4e02-97ed-db6fb29cb505 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:14.271983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9af54144-0fd1-4e02-97ed-db6fb29cb505 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:14.273475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9af54144-0fd1-4e02-97ed-db6fb29cb505 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:14.275209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9af54144-0fd1-4e02-97ed-db6fb29cb505 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:14.276925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9af54144-0fd1-4e02-97ed-db6fb29cb505 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:14.277807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9af54144-0fd1-4e02-97ed-db6fb29cb505 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:14.280614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9af54144-0fd1-4e02-97ed-db6fb29cb505 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:15.292154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-8a3d94a6-9de3-4660-ae67-33b49615a39d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:11:15.292154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-8a3d94a6-9de3-4660-ae67-33b49615a39d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:11:15.292154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-8a3d94a6-9de3-4660-ae67-33b49615a39d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:11:15.292841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-8a3d94a6-9de3-4660-ae67-33b49615a39d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:11:15.293167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-8a3d94a6-9de3-4660-ae67-33b49615a39d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:11:15.358665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a3d94a6-9de3-4660-ae67-33b49615a39d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:15.359262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a3d94a6-9de3-4660-ae67-33b49615a39d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:15.360077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a3d94a6-9de3-4660-ae67-33b49615a39d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:15.361095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a3d94a6-9de3-4660-ae67-33b49615a39d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:15.361664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a3d94a6-9de3-4660-ae67-33b49615a39d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:15.362152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a3d94a6-9de3-4660-ae67-33b49615a39d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:15.396301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9af54144-0fd1-4e02-97ed-db6fb29cb505 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:15.424913 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9af54144-0fd1-4e02-97ed-db6fb29cb505 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1470 microversion: 2.1 time: 1.185497 Oct 29 01:11:15.427470 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 920/1835] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:14 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1470 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:15.442899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3e87a8c0-9940-4f6c-889e-ef013705189e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:15.443797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3e87a8c0-9940-4f6c-889e-ef013705189e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:15.448008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-8a3d94a6-9de3-4660-ae67-33b49615a39d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Getting quotas for project f421c64f9b2f49ebab46d9f8a28143d6. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:11:15.463325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-8a3d94a6-9de3-4660-ae67-33b49615a39d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Getting quotas for user 4ae0a54f51ad4813b312baf3a03ba172 and project f421c64f9b2f49ebab46d9f8a28143d6. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:11:15.463546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e87a8c0-9940-4f6c-889e-ef013705189e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:15.464021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e87a8c0-9940-4f6c-889e-ef013705189e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:15.465558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e87a8c0-9940-4f6c-889e-ef013705189e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:15.465558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e87a8c0-9940-4f6c-889e-ef013705189e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:15.467121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e87a8c0-9940-4f6c-889e-ef013705189e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:15.468872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e87a8c0-9940-4f6c-889e-ef013705189e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:15.505827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8a3d94a6-9de3-4660-ae67-33b49615a39d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:11:15.508576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8a3d94a6-9de3-4660-ae67-33b49615a39d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:11:15.734564 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8a3d94a6-9de3-4660-ae67-33b49615a39d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.962108 Oct 29 01:11:15.735960 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 916/1836] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:11:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:11:15.749780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-91020ca4-4515-4a89-aedc-e392a2a41d50 req-736a2b03-d042-4396-8f49-f974a51e72ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9161092b-7dfe-4c41-bcac-1d65112ead16", "name": "network-vif-plugged", "status": "completed", "tag": "0ce52fe8-a1fb-40ab-a07d-d5448dd21825"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:15.761245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3e87a8c0-9940-4f6c-889e-ef013705189e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:15.776101 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3e87a8c0-9940-4f6c-889e-ef013705189e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 200 len: 1316 microversion: 2.1 time: 0.347261 Oct 29 01:11:15.779699 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 921/1837] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:15 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 1316 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:15.788071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6e69fa22-de75-4d2b-b5b7-d8033bd0d81a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:15.788929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6e69fa22-de75-4d2b-b5b7-d8033bd0d81a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:15.810025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-91020ca4-4515-4a89-aedc-e392a2a41d50 req-736a2b03-d042-4396-8f49-f974a51e72ae service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:15.810777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-91020ca4-4515-4a89-aedc-e392a2a41d50 req-736a2b03-d042-4396-8f49-f974a51e72ae service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:15.811397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-91020ca4-4515-4a89-aedc-e392a2a41d50 req-736a2b03-d042-4396-8f49-f974a51e72ae service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:15.819754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e69fa22-de75-4d2b-b5b7-d8033bd0d81a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:15.820364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e69fa22-de75-4d2b-b5b7-d8033bd0d81a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:15.829705 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-91020ca4-4515-4a89-aedc-e392a2a41d50 req-736a2b03-d042-4396-8f49-f974a51e72ae service nova] Creating event network-vif-plugged:0ce52fe8-a1fb-40ab-a07d-d5448dd21825 for instance 9161092b-7dfe-4c41-bcac-1d65112ead16 on n-h1-862964-3 Oct 29 01:11:15.835796 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-91020ca4-4515-4a89-aedc-e392a2a41d50 req-736a2b03-d042-4396-8f49-f974a51e72ae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096313 Oct 29 01:11:15.836232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e69fa22-de75-4d2b-b5b7-d8033bd0d81a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:15.837397 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 917/1838] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:15.844637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-50dfd17c-ecbd-41e4-b2c7-044b79299e80 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:15.844637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-50dfd17c-ecbd-41e4-b2c7-044b79299e80 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:15.845313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e69fa22-de75-4d2b-b5b7-d8033bd0d81a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:15.848442 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e69fa22-de75-4d2b-b5b7-d8033bd0d81a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:15.848916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e69fa22-de75-4d2b-b5b7-d8033bd0d81a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:15.851726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50dfd17c-ecbd-41e4-b2c7-044b79299e80 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:15.852350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50dfd17c-ecbd-41e4-b2c7-044b79299e80 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:15.852875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50dfd17c-ecbd-41e4-b2c7-044b79299e80 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:15.853712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50dfd17c-ecbd-41e4-b2c7-044b79299e80 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:15.854300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50dfd17c-ecbd-41e4-b2c7-044b79299e80 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:15.854843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50dfd17c-ecbd-41e4-b2c7-044b79299e80 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:16.352024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-50dfd17c-ecbd-41e4-b2c7-044b79299e80 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:16.370413 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-50dfd17c-ecbd-41e4-b2c7-044b79299e80 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.531492 Oct 29 01:11:16.372438 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 918/1839] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:15 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:16.380908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0db6de7a-35dc-4c51-9ede-f95fb51c323c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:16.381815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0db6de7a-35dc-4c51-9ede-f95fb51c323c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:16.410054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6e69fa22-de75-4d2b-b5b7-d8033bd0d81a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:16.430407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6e69fa22-de75-4d2b-b5b7-d8033bd0d81a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:16.439648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6e69fa22-de75-4d2b-b5b7-d8033bd0d81a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:16.452089 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6e69fa22-de75-4d2b-b5b7-d8033bd0d81a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1292 microversion: 2.25 time: 0.668546 Oct 29 01:11:16.454374 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 922/1840] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:15 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1292 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:16.600358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0db6de7a-35dc-4c51-9ede-f95fb51c323c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:16.608715 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0db6de7a-35dc-4c51-9ede-f95fb51c323c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1215 microversion: 2.1 time: 0.235119 Oct 29 01:11:16.612760 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 919/1841] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:16 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1215 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:16.623371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b903a9eb-31b6-4a25-93c9-d0b75052c5eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:16.626041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b903a9eb-31b6-4a25-93c9-d0b75052c5eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:16.633843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:16.639109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b903a9eb-31b6-4a25-93c9-d0b75052c5eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:16.639882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b903a9eb-31b6-4a25-93c9-d0b75052c5eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:16.641122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b903a9eb-31b6-4a25-93c9-d0b75052c5eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:16.644240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b903a9eb-31b6-4a25-93c9-d0b75052c5eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:16.645434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b903a9eb-31b6-4a25-93c9-d0b75052c5eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:16.646230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b903a9eb-31b6-4a25-93c9-d0b75052c5eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:16.746804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-54ff8d0e-d4f4-4f37-95fc-3e28cba43677 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Action: 'create', calling method: .version_select at 0x7f9d9c336dc0>, body: {"keypair": {"name": "tempest-keypair-807123210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7op/U54w7Zkru/vyyf5p1zS5Wx40N5Iz+k7BIme9ctjSdsmfIy1G0EYSxg78LKZ0ktcY8EcowuvaIDTstctfy2sDeEw2GmKxyuoAyThAcH0k825t6wKnRnTxG7lfpCKw=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:16.792878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-54ff8d0e-d4f4-4f37-95fc-3e28cba43677 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Getting quotas for project d82d19d99c7e405fb679320110c9748d. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:11:16.815766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-54ff8d0e-d4f4-4f37-95fc-3e28cba43677 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Getting quotas for user 51ba2d71e9604486bef50f7d4b8a8700 and project d82d19d99c7e405fb679320110c9748d. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:11:16.994051 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-54ff8d0e-d4f4-4f37-95fc-3e28cba43677 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.535028 Oct 29 01:11:16.995030 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 923/1842] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:11:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:17.005753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-02c9a829-e826-4137-919b-8f61efa03317 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:17.006499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-02c9a829-e826-4137-919b-8f61efa03317 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:17.016807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02c9a829-e826-4137-919b-8f61efa03317 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:17.017338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02c9a829-e826-4137-919b-8f61efa03317 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:17.017783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02c9a829-e826-4137-919b-8f61efa03317 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:17.018500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02c9a829-e826-4137-919b-8f61efa03317 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:17.018959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02c9a829-e826-4137-919b-8f61efa03317 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:17.019387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02c9a829-e826-4137-919b-8f61efa03317 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:17.030184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b903a9eb-31b6-4a25-93c9-d0b75052c5eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:17.042040 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b903a9eb-31b6-4a25-93c9-d0b75052c5eb tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1470 microversion: 2.1 time: 0.427749 Oct 29 01:11:17.047570 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 920/1843] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:16 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1470 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:17.120307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-e9db26ce-0e11-4507-aef1-fbff0d9181a4 req-01e59f52-8f76-49d6-ba26-2dda6d5f6a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ea836d-4ec8-4646-a8f8-2c199985d829", "name": "network-vif-unplugged", "status": "completed", "tag": "a2a1803b-2371-4f50-9500-0cc998cf3afa"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:17.149664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e9db26ce-0e11-4507-aef1-fbff0d9181a4 req-01e59f52-8f76-49d6-ba26-2dda6d5f6a38 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:17.150720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e9db26ce-0e11-4507-aef1-fbff0d9181a4 req-01e59f52-8f76-49d6-ba26-2dda6d5f6a38 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:17.150720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e9db26ce-0e11-4507-aef1-fbff0d9181a4 req-01e59f52-8f76-49d6-ba26-2dda6d5f6a38 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:17.173041 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-e9db26ce-0e11-4507-aef1-fbff0d9181a4 req-01e59f52-8f76-49d6-ba26-2dda6d5f6a38 service nova] Creating event network-vif-unplugged:a2a1803b-2371-4f50-9500-0cc998cf3afa for instance b7ea836d-4ec8-4646-a8f8-2c199985d829 on n-h2-862964-3 Oct 29 01:11:17.180719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [req-e9db26ce-0e11-4507-aef1-fbff0d9181a4 req-01e59f52-8f76-49d6-ba26-2dda6d5f6a38 service nova] Instance b7ea836d-4ec8-4646-a8f8-2c199985d829 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121099) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:11:17.194345 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-e9db26ce-0e11-4507-aef1-fbff0d9181a4 req-01e59f52-8f76-49d6-ba26-2dda6d5f6a38 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077790 Oct 29 01:11:17.195867 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 921/1844] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:11:17.202641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-02c9a829-e826-4137-919b-8f61efa03317 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:17.213419 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-02c9a829-e826-4137-919b-8f61efa03317 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 200 len: 1316 microversion: 2.1 time: 0.217272 Oct 29 01:11:17.217436 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 924/1845] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:16 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:17.295546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-7a1b2dd3-e3bd-4a2a-b8c1-59170427b5a4 req-3d3ed503-7509-409a-81f6-0cfb54d005cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dead7b7-a0ac-4233-a0ae-ed19568a36cf", "tag": "fed62005-09de-4477-ac60-2dac49a60063"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:17.315050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7a1b2dd3-e3bd-4a2a-b8c1-59170427b5a4 req-3d3ed503-7509-409a-81f6-0cfb54d005cf service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:17.322645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7a1b2dd3-e3bd-4a2a-b8c1-59170427b5a4 req-3d3ed503-7509-409a-81f6-0cfb54d005cf service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:17.324157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7a1b2dd3-e3bd-4a2a-b8c1-59170427b5a4 req-3d3ed503-7509-409a-81f6-0cfb54d005cf service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:17.361629 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-7a1b2dd3-e3bd-4a2a-b8c1-59170427b5a4 req-3d3ed503-7509-409a-81f6-0cfb54d005cf service nova] Creating event network-changed:fed62005-09de-4477-ac60-2dac49a60063 for instance 2dead7b7-a0ac-4233-a0ae-ed19568a36cf on n-h1-862964-3 Oct 29 01:11:17.369974 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-7a1b2dd3-e3bd-4a2a-b8c1-59170427b5a4 req-3d3ed503-7509-409a-81f6-0cfb54d005cf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084912 Oct 29 01:11:17.372851 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 922/1846] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:17.398842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fcfa4672-40b8-4508-9c74-c43b312a9dfc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:17.400083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fcfa4672-40b8-4508-9c74-c43b312a9dfc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:17.411367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcfa4672-40b8-4508-9c74-c43b312a9dfc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:17.412914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcfa4672-40b8-4508-9c74-c43b312a9dfc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:17.428274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcfa4672-40b8-4508-9c74-c43b312a9dfc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:17.429289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcfa4672-40b8-4508-9c74-c43b312a9dfc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:17.429872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcfa4672-40b8-4508-9c74-c43b312a9dfc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:17.431197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcfa4672-40b8-4508-9c74-c43b312a9dfc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:17.502948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5b93a979-8884-49e1-991b-d768c6eefeaf tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:17.503988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5b93a979-8884-49e1-991b-d768c6eefeaf tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:17.521569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b93a979-8884-49e1-991b-d768c6eefeaf tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:17.524467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b93a979-8884-49e1-991b-d768c6eefeaf tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:17.525297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b93a979-8884-49e1-991b-d768c6eefeaf tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:17.528297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b93a979-8884-49e1-991b-d768c6eefeaf tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:17.530859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b93a979-8884-49e1-991b-d768c6eefeaf tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:17.532484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b93a979-8884-49e1-991b-d768c6eefeaf tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:18.046095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5b93a979-8884-49e1-991b-d768c6eefeaf tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:18.057929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fcfa4672-40b8-4508-9c74-c43b312a9dfc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:18.076145 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fcfa4672-40b8-4508-9c74-c43b312a9dfc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.682694 Oct 29 01:11:18.089426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5b93a979-8884-49e1-991b-d768c6eefeaf tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:18.094669 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 925/1847] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:17 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:18.106878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b12b8ce9-7255-4aac-9fb1-b39e19edbca7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:18.107680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b12b8ce9-7255-4aac-9fb1-b39e19edbca7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:18.110166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5b93a979-8884-49e1-991b-d768c6eefeaf tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:18.120315 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5b93a979-8884-49e1-991b-d768c6eefeaf tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1292 microversion: 2.25 time: 0.641724 Oct 29 01:11:18.124228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b12b8ce9-7255-4aac-9fb1-b39e19edbca7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:18.124742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b12b8ce9-7255-4aac-9fb1-b39e19edbca7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:18.125826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b12b8ce9-7255-4aac-9fb1-b39e19edbca7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:18.128804 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 923/1848] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:17 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1292 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:11:18.133310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b12b8ce9-7255-4aac-9fb1-b39e19edbca7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:18.134158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b12b8ce9-7255-4aac-9fb1-b39e19edbca7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:18.134854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b12b8ce9-7255-4aac-9fb1-b39e19edbca7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:18.148352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-66f0f196-72bd-4e48-81b4-8f810079e117 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:18.149447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-66f0f196-72bd-4e48-81b4-8f810079e117 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:18.174927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66f0f196-72bd-4e48-81b4-8f810079e117 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:18.175426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66f0f196-72bd-4e48-81b4-8f810079e117 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:18.175866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66f0f196-72bd-4e48-81b4-8f810079e117 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:18.176575 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66f0f196-72bd-4e48-81b4-8f810079e117 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:18.177031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66f0f196-72bd-4e48-81b4-8f810079e117 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:18.182961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66f0f196-72bd-4e48-81b4-8f810079e117 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:18.292288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b12b8ce9-7255-4aac-9fb1-b39e19edbca7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:18.292288 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b12b8ce9-7255-4aac-9fb1-b39e19edbca7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1211 microversion: 2.1 time: 0.169496 Oct 29 01:11:18.292288 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 926/1849] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:18 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1211 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:18.292288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c1823cb6-e6a6-4247-a8aa-1a20ce563622 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:18.292288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c1823cb6-e6a6-4247-a8aa-1a20ce563622 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:18.292288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1823cb6-e6a6-4247-a8aa-1a20ce563622 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:18.292288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1823cb6-e6a6-4247-a8aa-1a20ce563622 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:18.292288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1823cb6-e6a6-4247-a8aa-1a20ce563622 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:18.292288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1823cb6-e6a6-4247-a8aa-1a20ce563622 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:18.292288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1823cb6-e6a6-4247-a8aa-1a20ce563622 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:18.292288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1823cb6-e6a6-4247-a8aa-1a20ce563622 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:18.305808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:18.729625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-66f0f196-72bd-4e48-81b4-8f810079e117 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:18.742474 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-66f0f196-72bd-4e48-81b4-8f810079e117 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1470 microversion: 2.1 time: 0.611346 Oct 29 01:11:18.743377 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 924/1850] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:18 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1470 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:18.779251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c1823cb6-e6a6-4247-a8aa-1a20ce563622 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:18.788708 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c1823cb6-e6a6-4247-a8aa-1a20ce563622 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 200 len: 1504 microversion: 2.1 time: 0.520464 Oct 29 01:11:18.801520 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 927/1851] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:18 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 1504 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:18.818541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e50f11a1-ac22-4fb7-b7b3-f7b10f83911e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1649602508"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:18.819882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e50f11a1-ac22-4fb7-b7b3-f7b10f83911e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:18.827587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e50f11a1-ac22-4fb7-b7b3-f7b10f83911e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:18.828368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e50f11a1-ac22-4fb7-b7b3-f7b10f83911e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:18.829677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e50f11a1-ac22-4fb7-b7b3-f7b10f83911e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:18.830568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e50f11a1-ac22-4fb7-b7b3-f7b10f83911e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:18.831235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e50f11a1-ac22-4fb7-b7b3-f7b10f83911e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:18.832039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e50f11a1-ac22-4fb7-b7b3-f7b10f83911e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:19.051206 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.network.security_group_api [None req-e50f11a1-ac22-4fb7-b7b3-f7b10f83911e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Adding security group b3f85443-abdd-416a-b17c-3c90bfe7618d to port 0ce52fe8-a1fb-40ab-a07d-d5448dd21825 Oct 29 01:11:19.109910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-00678486-4a27-4abb-a940-1813daa9fdba tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:19.110685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-00678486-4a27-4abb-a940-1813daa9fdba tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:19.118608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00678486-4a27-4abb-a940-1813daa9fdba tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:19.119112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00678486-4a27-4abb-a940-1813daa9fdba tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:19.119552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00678486-4a27-4abb-a940-1813daa9fdba tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:19.120277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00678486-4a27-4abb-a940-1813daa9fdba tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:19.120720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00678486-4a27-4abb-a940-1813daa9fdba tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:19.121474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00678486-4a27-4abb-a940-1813daa9fdba tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:19.427319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-00678486-4a27-4abb-a940-1813daa9fdba tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:19.442042 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-00678486-4a27-4abb-a940-1813daa9fdba tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.336515 Oct 29 01:11:19.447428 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 928/1852] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:19 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:19.455062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5ac090ec-7ce6-42c5-ae3e-f09f411372f6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:19.459613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5ac090ec-7ce6-42c5-ae3e-f09f411372f6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:19.480310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ac090ec-7ce6-42c5-ae3e-f09f411372f6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:19.480933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ac090ec-7ce6-42c5-ae3e-f09f411372f6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:19.481461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ac090ec-7ce6-42c5-ae3e-f09f411372f6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:19.482570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ac090ec-7ce6-42c5-ae3e-f09f411372f6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:19.483226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ac090ec-7ce6-42c5-ae3e-f09f411372f6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:19.484074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ac090ec-7ce6-42c5-ae3e-f09f411372f6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:19.829656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5ac090ec-7ce6-42c5-ae3e-f09f411372f6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:19.846018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5ac090ec-7ce6-42c5-ae3e-f09f411372f6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:19.847512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5ac090ec-7ce6-42c5-ae3e-f09f411372f6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:19.848706 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5ac090ec-7ce6-42c5-ae3e-f09f411372f6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1292 microversion: 2.25 time: 0.400029 Oct 29 01:11:19.849286 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 929/1853] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:19 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1292 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:19.874626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-136be809-79b4-4211-84c3-9b165e5900e0 req-d3766f0b-64de-41e6-a72b-508ec39e3e7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ea836d-4ec8-4646-a8f8-2c199985d829", "tag": "a2a1803b-2371-4f50-9500-0cc998cf3afa"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:19.899449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-136be809-79b4-4211-84c3-9b165e5900e0 req-d3766f0b-64de-41e6-a72b-508ec39e3e7f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:19.899449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-136be809-79b4-4211-84c3-9b165e5900e0 req-d3766f0b-64de-41e6-a72b-508ec39e3e7f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:19.899449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-136be809-79b4-4211-84c3-9b165e5900e0 req-d3766f0b-64de-41e6-a72b-508ec39e3e7f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:19.919860 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-136be809-79b4-4211-84c3-9b165e5900e0 req-d3766f0b-64de-41e6-a72b-508ec39e3e7f service nova] Creating event network-changed:a2a1803b-2371-4f50-9500-0cc998cf3afa for instance b7ea836d-4ec8-4646-a8f8-2c199985d829 on n-h2-862964-3 Oct 29 01:11:19.930414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [req-136be809-79b4-4211-84c3-9b165e5900e0 req-d3766f0b-64de-41e6-a72b-508ec39e3e7f service nova] Instance b7ea836d-4ec8-4646-a8f8-2c199985d829 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121100) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:11:19.948224 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-136be809-79b4-4211-84c3-9b165e5900e0 req-d3766f0b-64de-41e6-a72b-508ec39e3e7f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080641 Oct 29 01:11:19.951417 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 930/1854] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:19.960741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bbccb064-99db-43b9-8805-1693a5ed28eb tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:19.961840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bbccb064-99db-43b9-8805-1693a5ed28eb tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:19.970950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbccb064-99db-43b9-8805-1693a5ed28eb tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:19.971734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbccb064-99db-43b9-8805-1693a5ed28eb tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:19.972359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbccb064-99db-43b9-8805-1693a5ed28eb tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:19.973456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbccb064-99db-43b9-8805-1693a5ed28eb tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:19.990597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbccb064-99db-43b9-8805-1693a5ed28eb tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:19.991327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbccb064-99db-43b9-8805-1693a5ed28eb tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:20.067431 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e50f11a1-ac22-4fb7-b7b3-f7b10f83911e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "POST /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16/action" status: 202 len: 0 microversion: 2.1 time: 1.253457 Oct 29 01:11:20.072368 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 925/1855] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:11:18 2022] POST /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16/action => generated 0 bytes in 1259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:11:20.082554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6d08f297-d5f2-4421-8acb-6d836fe464c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:20.082554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6d08f297-d5f2-4421-8acb-6d836fe464c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:20.099294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d08f297-d5f2-4421-8acb-6d836fe464c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:20.100163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d08f297-d5f2-4421-8acb-6d836fe464c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:20.100900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d08f297-d5f2-4421-8acb-6d836fe464c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:20.101839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d08f297-d5f2-4421-8acb-6d836fe464c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:20.102467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d08f297-d5f2-4421-8acb-6d836fe464c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:20.103089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d08f297-d5f2-4421-8acb-6d836fe464c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:20.118635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:20.160734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bbccb064-99db-43b9-8805-1693a5ed28eb tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:20.176527 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bbccb064-99db-43b9-8805-1693a5ed28eb tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1285 microversion: 2.1 time: 0.223315 Oct 29 01:11:20.187089 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 931/1856] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:19 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1285 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:20.187089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d81caa36-1bf6-4282-9ca0-8c13b2fad4c8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1152635939"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:20.187089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d81caa36-1bf6-4282-9ca0-8c13b2fad4c8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:20.195777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d81caa36-1bf6-4282-9ca0-8c13b2fad4c8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:20.196270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d81caa36-1bf6-4282-9ca0-8c13b2fad4c8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:20.196711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d81caa36-1bf6-4282-9ca0-8c13b2fad4c8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:20.197448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d81caa36-1bf6-4282-9ca0-8c13b2fad4c8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:20.197908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d81caa36-1bf6-4282-9ca0-8c13b2fad4c8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:20.198333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d81caa36-1bf6-4282-9ca0-8c13b2fad4c8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:20.320571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:20.667022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6d08f297-d5f2-4421-8acb-6d836fe464c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:20.684650 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6d08f297-d5f2-4421-8acb-6d836fe464c4 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1470 microversion: 2.1 time: 0.610777 Oct 29 01:11:20.688696 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 926/1857] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:20 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1470 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:20.694486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-957040b7-1af7-4b1c-9b20-2cbe7ff0bad6 req-8b047017-9eff-4f0a-98da-a93f7ac84cbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9161092b-7dfe-4c41-bcac-1d65112ead16", "tag": "0ce52fe8-a1fb-40ab-a07d-d5448dd21825"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:20.723931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-957040b7-1af7-4b1c-9b20-2cbe7ff0bad6 req-8b047017-9eff-4f0a-98da-a93f7ac84cbb service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:20.727480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-957040b7-1af7-4b1c-9b20-2cbe7ff0bad6 req-8b047017-9eff-4f0a-98da-a93f7ac84cbb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:20.728267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-957040b7-1af7-4b1c-9b20-2cbe7ff0bad6 req-8b047017-9eff-4f0a-98da-a93f7ac84cbb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:20.761049 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.network.security_group_api [None req-d81caa36-1bf6-4282-9ca0-8c13b2fad4c8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Adding security group 8a4534c9-23dc-460f-9717-df6331bb4d06 to port 0ce52fe8-a1fb-40ab-a07d-d5448dd21825 Oct 29 01:11:20.763069 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-957040b7-1af7-4b1c-9b20-2cbe7ff0bad6 req-8b047017-9eff-4f0a-98da-a93f7ac84cbb service nova] Creating event network-changed:0ce52fe8-a1fb-40ab-a07d-d5448dd21825 for instance 9161092b-7dfe-4c41-bcac-1d65112ead16 on n-h1-862964-3 Oct 29 01:11:20.774182 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-957040b7-1af7-4b1c-9b20-2cbe7ff0bad6 req-8b047017-9eff-4f0a-98da-a93f7ac84cbb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087361 Oct 29 01:11:20.775314 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 927/1858] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:20.782640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-21e2495a-3b97-4765-a855-6fa628ed3833 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:20.783348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-21e2495a-3b97-4765-a855-6fa628ed3833 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:20.793929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21e2495a-3b97-4765-a855-6fa628ed3833 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:20.794950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21e2495a-3b97-4765-a855-6fa628ed3833 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:20.795583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21e2495a-3b97-4765-a855-6fa628ed3833 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:20.796887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21e2495a-3b97-4765-a855-6fa628ed3833 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:20.797819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21e2495a-3b97-4765-a855-6fa628ed3833 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:20.798463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21e2495a-3b97-4765-a855-6fa628ed3833 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:21.666479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-21e2495a-3b97-4765-a855-6fa628ed3833 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:21.678081 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-21e2495a-3b97-4765-a855-6fa628ed3833 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.900934 Oct 29 01:11:21.694094 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 928/1859] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:20 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:21.701783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8983a45d-aefd-414e-a7db-157bfc174d5d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:21.709216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8983a45d-aefd-414e-a7db-157bfc174d5d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:21.716163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8983a45d-aefd-414e-a7db-157bfc174d5d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:21.716751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8983a45d-aefd-414e-a7db-157bfc174d5d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:21.717257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8983a45d-aefd-414e-a7db-157bfc174d5d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:21.718185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8983a45d-aefd-414e-a7db-157bfc174d5d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:21.718862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8983a45d-aefd-414e-a7db-157bfc174d5d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:21.719612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8983a45d-aefd-414e-a7db-157bfc174d5d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:22.166839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8983a45d-aefd-414e-a7db-157bfc174d5d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:22.193302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8983a45d-aefd-414e-a7db-157bfc174d5d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:22.193302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8983a45d-aefd-414e-a7db-157bfc174d5d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:22.193302 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8983a45d-aefd-414e-a7db-157bfc174d5d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1292 microversion: 2.25 time: 0.484325 Oct 29 01:11:22.193302 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 929/1860] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:21 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1292 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:22.193302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6366da45-3b39-4b2c-ab62-e9def1898eee tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "c703be0b-7528-438f-9fc3-140812de7e20"}], "security_groups": [{"name": "tempest-securitygroup--1888205214"}], "key_name": "tempest-keypair-807123210", "user_data": "}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:22.308566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-6366da45-3b39-4b2c-ab62-e9def1898eee tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] validate_networks() for [('c703be0b-7528-438f-9fc3-140812de7e20', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:11:22.435252 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d81caa36-1bf6-4282-9ca0-8c13b2fad4c8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "POST /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16/action" status: 202 len: 0 microversion: 2.1 time: 2.256639 Oct 29 01:11:22.436938 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 932/1861] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:11:20 2022] POST /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16/action => generated 0 bytes in 2259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:11:22.443545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f302b41b-e757-428f-b3ad-07b7a2c47cdc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:22.443995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f302b41b-e757-428f-b3ad-07b7a2c47cdc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:22.459440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f302b41b-e757-428f-b3ad-07b7a2c47cdc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:22.460644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f302b41b-e757-428f-b3ad-07b7a2c47cdc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:22.464101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f302b41b-e757-428f-b3ad-07b7a2c47cdc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:22.465215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f302b41b-e757-428f-b3ad-07b7a2c47cdc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:22.465895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f302b41b-e757-428f-b3ad-07b7a2c47cdc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:22.466504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f302b41b-e757-428f-b3ad-07b7a2c47cdc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:22.886324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f302b41b-e757-428f-b3ad-07b7a2c47cdc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:22.901322 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f302b41b-e757-428f-b3ad-07b7a2c47cdc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1315 microversion: 2.1 time: 0.459830 Oct 29 01:11:22.909441 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 933/1862] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:22 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:22.910738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d121cda8-fdbd-451f-9336-92e4ed5a431d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:22.911431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d121cda8-fdbd-451f-9336-92e4ed5a431d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:22.918683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d121cda8-fdbd-451f-9336-92e4ed5a431d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:22.920090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d121cda8-fdbd-451f-9336-92e4ed5a431d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:22.920743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d121cda8-fdbd-451f-9336-92e4ed5a431d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:22.922240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d121cda8-fdbd-451f-9336-92e4ed5a431d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:22.923576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d121cda8-fdbd-451f-9336-92e4ed5a431d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:22.924215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d121cda8-fdbd-451f-9336-92e4ed5a431d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:23.287118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d121cda8-fdbd-451f-9336-92e4ed5a431d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:23.304809 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d121cda8-fdbd-451f-9336-92e4ed5a431d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1470 microversion: 2.1 time: 0.400703 Oct 29 01:11:23.305430 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 934/1863] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:22 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1470 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:23.310671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4a8eb508-05da-4568-823b-b911875b5698 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:23.325487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4a8eb508-05da-4568-823b-b911875b5698 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:23.336418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a8eb508-05da-4568-823b-b911875b5698 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:23.337238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a8eb508-05da-4568-823b-b911875b5698 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:23.337953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a8eb508-05da-4568-823b-b911875b5698 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:23.338852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a8eb508-05da-4568-823b-b911875b5698 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:23.340010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a8eb508-05da-4568-823b-b911875b5698 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:23.340678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a8eb508-05da-4568-823b-b911875b5698 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:23.472809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-6366da45-3b39-4b2c-ab62-e9def1898eee tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:11:23.473609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-6366da45-3b39-4b2c-ab62-e9def1898eee tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:11:23.474224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-6366da45-3b39-4b2c-ab62-e9def1898eee tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:11:23.474730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-6366da45-3b39-4b2c-ab62-e9def1898eee tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:11:23.475277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-6366da45-3b39-4b2c-ab62-e9def1898eee tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:11:23.486314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6366da45-3b39-4b2c-ab62-e9def1898eee tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:23.486881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6366da45-3b39-4b2c-ab62-e9def1898eee tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:23.487396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6366da45-3b39-4b2c-ab62-e9def1898eee tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:23.488371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6366da45-3b39-4b2c-ab62-e9def1898eee tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:23.488995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6366da45-3b39-4b2c-ab62-e9def1898eee tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:23.489539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6366da45-3b39-4b2c-ab62-e9def1898eee tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:23.514295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-6366da45-3b39-4b2c-ab62-e9def1898eee tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Getting quotas for project d82d19d99c7e405fb679320110c9748d. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:11:23.521593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-6366da45-3b39-4b2c-ab62-e9def1898eee tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Getting quotas for user 51ba2d71e9604486bef50f7d4b8a8700 and project d82d19d99c7e405fb679320110c9748d. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:11:23.548861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6366da45-3b39-4b2c-ab62-e9def1898eee tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:11:23.551816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6366da45-3b39-4b2c-ab62-e9def1898eee tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:11:23.652688 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4a8eb508-05da-4568-823b-b911875b5698 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.346174 Oct 29 01:11:23.653375 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 935/1864] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Oct 29 01:11:23 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16/os-security-groups => generated 1158 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:23.658649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e380f35a-e46e-4cf0-b9b1-4bf992e36411 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:23.659266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e380f35a-e46e-4cf0-b9b1-4bf992e36411 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:23.666532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e380f35a-e46e-4cf0-b9b1-4bf992e36411 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:23.671560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e380f35a-e46e-4cf0-b9b1-4bf992e36411 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:23.671560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e380f35a-e46e-4cf0-b9b1-4bf992e36411 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:23.671560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e380f35a-e46e-4cf0-b9b1-4bf992e36411 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:23.671560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e380f35a-e46e-4cf0-b9b1-4bf992e36411 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:23.671560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e380f35a-e46e-4cf0-b9b1-4bf992e36411 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:23.770400 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6366da45-3b39-4b2c-ab62-e9def1898eee tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.588984 Oct 29 01:11:23.771237 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 930/1865] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:11:22 2022] POST /compute/v2.1/servers => generated 409 bytes in 1590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:11:23.783538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-3bb3364c-5b7a-412f-be44-ff79fa677e64 req-3bb812d5-c4bf-44f1-9b10-5030cce5fbba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9161092b-7dfe-4c41-bcac-1d65112ead16", "tag": "0ce52fe8-a1fb-40ab-a07d-d5448dd21825"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:23.796216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-3bb3364c-5b7a-412f-be44-ff79fa677e64 req-3bb812d5-c4bf-44f1-9b10-5030cce5fbba service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:23.797389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-3bb3364c-5b7a-412f-be44-ff79fa677e64 req-3bb812d5-c4bf-44f1-9b10-5030cce5fbba service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:23.797835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-3bb3364c-5b7a-412f-be44-ff79fa677e64 req-3bb812d5-c4bf-44f1-9b10-5030cce5fbba service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:23.810626 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-3bb3364c-5b7a-412f-be44-ff79fa677e64 req-3bb812d5-c4bf-44f1-9b10-5030cce5fbba service nova] Creating event network-changed:0ce52fe8-a1fb-40ab-a07d-d5448dd21825 for instance 9161092b-7dfe-4c41-bcac-1d65112ead16 on n-h1-862964-3 Oct 29 01:11:23.816087 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-3bb3364c-5b7a-412f-be44-ff79fa677e64 req-3bb812d5-c4bf-44f1-9b10-5030cce5fbba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037611 Oct 29 01:11:23.817259 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 931/1866] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:23.823291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e380f35a-e46e-4cf0-b9b1-4bf992e36411 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:23.824064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f68d1fed-46ba-4349-bcab-13216b5f3ca0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:23.824957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f68d1fed-46ba-4349-bcab-13216b5f3ca0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:23.836525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f68d1fed-46ba-4349-bcab-13216b5f3ca0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:23.837017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f68d1fed-46ba-4349-bcab-13216b5f3ca0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:23.838255 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e380f35a-e46e-4cf0-b9b1-4bf992e36411 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.183716 Oct 29 01:11:23.849215 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 936/1867] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:23 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:23.849436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f68d1fed-46ba-4349-bcab-13216b5f3ca0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:23.849436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f68d1fed-46ba-4349-bcab-13216b5f3ca0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:23.849436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f68d1fed-46ba-4349-bcab-13216b5f3ca0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:23.849436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f68d1fed-46ba-4349-bcab-13216b5f3ca0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:23.853842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d33abf6d-ac33-47bc-b7ed-c8977ae2558d tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Action: 'create', calling method: .version_select at 0x7f9d97f6c9d0>, body: {"security_group": {"name": " tempest-securitygroup -1175068390 ", "description": "tempest-description-983962869"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:24.111064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f68d1fed-46ba-4349-bcab-13216b5f3ca0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:24.119418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f68d1fed-46ba-4349-bcab-13216b5f3ca0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:24.120881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f68d1fed-46ba-4349-bcab-13216b5f3ca0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:24.122036 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f68d1fed-46ba-4349-bcab-13216b5f3ca0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1280 microversion: 2.25 time: 0.303532 Oct 29 01:11:24.122807 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 932/1868] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:23 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1280 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:24.146653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b0fb23d2-e56f-4e7f-b0fc-38208906272d tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:24.147276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b0fb23d2-e56f-4e7f-b0fc-38208906272d tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:24.216825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b0fb23d2-e56f-4e7f-b0fc-38208906272d tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ba2d71e9604486bef50f7d4b8a8700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82d19d99c7e405fb679320110c9748d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:24.224952 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b0fb23d2-e56f-4e7f-b0fc-38208906272d tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 200 len: 1225 microversion: 2.1 time: 0.086608 Oct 29 01:11:24.225597 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 933/1869] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:24 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:24.230281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-37a2dde5-292c-4839-b852-473576bebe7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:24.230896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-37a2dde5-292c-4839-b852-473576bebe7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:24.237172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37a2dde5-292c-4839-b852-473576bebe7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:24.242358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37a2dde5-292c-4839-b852-473576bebe7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:24.242358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37a2dde5-292c-4839-b852-473576bebe7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:24.242358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37a2dde5-292c-4839-b852-473576bebe7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:24.242358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37a2dde5-292c-4839-b852-473576bebe7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:24.242358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37a2dde5-292c-4839-b852-473576bebe7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:24.494635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-37a2dde5-292c-4839-b852-473576bebe7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:24.508004 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-37a2dde5-292c-4839-b852-473576bebe7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1315 microversion: 2.1 time: 0.281250 Oct 29 01:11:24.508596 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 934/1870] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:24 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:24.517373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d07678fc-819c-45d3-aef8-eced2343b52e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:24.517912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d07678fc-819c-45d3-aef8-eced2343b52e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:24.532137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d07678fc-819c-45d3-aef8-eced2343b52e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:24.538590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d07678fc-819c-45d3-aef8-eced2343b52e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:24.539383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d07678fc-819c-45d3-aef8-eced2343b52e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:24.540369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d07678fc-819c-45d3-aef8-eced2343b52e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:24.541605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d07678fc-819c-45d3-aef8-eced2343b52e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:24.546573 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d33abf6d-ac33-47bc-b7ed-c8977ae2558d tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.706190 Oct 29 01:11:24.548906 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 937/1871] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:11:23 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:24.549391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d07678fc-819c-45d3-aef8-eced2343b52e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:24.565556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e8d46850-7363-4bde-b938-093796517c6c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d97e790d0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:24.766649 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e8d46850-7363-4bde-b938-093796517c6c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/36d500ea-3f27-410b-9efd-938d3c3b7eb4" status: 200 len: 223 microversion: 2.1 time: 0.207443 Oct 29 01:11:24.768489 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 938/1872] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 29 01:11:24 2022] GET /compute/v2.1/os-security-groups/36d500ea-3f27-410b-9efd-938d3c3b7eb4 => generated 223 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:11:24.782002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f2f86106-a015-4c7c-969a-6f00b8c943a1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d97f77ee0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:24.935770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d07678fc-819c-45d3-aef8-eced2343b52e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:24.944815 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d07678fc-819c-45d3-aef8-eced2343b52e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1463 microversion: 2.1 time: 0.434838 Oct 29 01:11:24.951474 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 935/1873] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:24 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1463 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:24.951474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8c4d69eb-878a-4e3a-9ada-47e706d5c97b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:24.951474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8c4d69eb-878a-4e3a-9ada-47e706d5c97b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:24.957804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c4d69eb-878a-4e3a-9ada-47e706d5c97b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:24.958285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c4d69eb-878a-4e3a-9ada-47e706d5c97b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:24.958920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c4d69eb-878a-4e3a-9ada-47e706d5c97b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:24.959968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c4d69eb-878a-4e3a-9ada-47e706d5c97b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:24.960419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c4d69eb-878a-4e3a-9ada-47e706d5c97b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:24.960839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c4d69eb-878a-4e3a-9ada-47e706d5c97b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:25.339265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8c4d69eb-878a-4e3a-9ada-47e706d5c97b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:25.349103 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8c4d69eb-878a-4e3a-9ada-47e706d5c97b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.402015 Oct 29 01:11:25.349808 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 936/1874] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:24 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:25.354311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-de833b7e-8c42-40ec-b6c5-3e298680a08c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:25.355055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-de833b7e-8c42-40ec-b6c5-3e298680a08c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:25.371692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de833b7e-8c42-40ec-b6c5-3e298680a08c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:25.372268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de833b7e-8c42-40ec-b6c5-3e298680a08c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:25.372715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de833b7e-8c42-40ec-b6c5-3e298680a08c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:25.373464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de833b7e-8c42-40ec-b6c5-3e298680a08c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:25.373920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de833b7e-8c42-40ec-b6c5-3e298680a08c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:25.374356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de833b7e-8c42-40ec-b6c5-3e298680a08c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:25.940981 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f2f86106-a015-4c7c-969a-6f00b8c943a1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/36d500ea-3f27-410b-9efd-938d3c3b7eb4" status: 202 len: 0 microversion: 2.1 time: 1.163558 Oct 29 01:11:25.942510 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 939/1875] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:11:24 2022] DELETE /compute/v2.1/os-security-groups/36d500ea-3f27-410b-9efd-938d3c3b7eb4 => generated 0 bytes in 1166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:11:25.950644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e0df2435-8721-4f46-bfad-5eb08be08625 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:25.950644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e0df2435-8721-4f46-bfad-5eb08be08625 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:25.957433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0df2435-8721-4f46-bfad-5eb08be08625 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:25.957925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0df2435-8721-4f46-bfad-5eb08be08625 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:25.958392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0df2435-8721-4f46-bfad-5eb08be08625 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:25.959107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0df2435-8721-4f46-bfad-5eb08be08625 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:25.959653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0df2435-8721-4f46-bfad-5eb08be08625 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:25.960521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0df2435-8721-4f46-bfad-5eb08be08625 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:26.083769 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-de833b7e-8c42-40ec-b6c5-3e298680a08c tempest-MigrationsAdminTest-563220540 tempest-MigrationsAdminTest-563220540-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1614 microversion: 2.1 time: 0.732841 Oct 29 01:11:26.084694 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 937/1876] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:25 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1614 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:26.090364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d28ecda1-439d-43d3-a92f-cf9f4dd2cfcc tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:26.091176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d28ecda1-439d-43d3-a92f-cf9f4dd2cfcc tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:26.098769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d28ecda1-439d-43d3-a92f-cf9f4dd2cfcc tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:26.099655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d28ecda1-439d-43d3-a92f-cf9f4dd2cfcc tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:26.100304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d28ecda1-439d-43d3-a92f-cf9f4dd2cfcc tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:26.101760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d28ecda1-439d-43d3-a92f-cf9f4dd2cfcc tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:26.101760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d28ecda1-439d-43d3-a92f-cf9f4dd2cfcc tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:26.101974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d28ecda1-439d-43d3-a92f-cf9f4dd2cfcc tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:26.181831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d28ecda1-439d-43d3-a92f-cf9f4dd2cfcc tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ba2d71e9604486bef50f7d4b8a8700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82d19d99c7e405fb679320110c9748d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:26.186116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e0df2435-8721-4f46-bfad-5eb08be08625 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:26.190055 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d28ecda1-439d-43d3-a92f-cf9f4dd2cfcc tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 200 len: 1277 microversion: 2.1 time: 0.104005 Oct 29 01:11:26.190643 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 938/1877] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:26 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:26.195299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fb0d5e63-7f8f-4c37-87ee-465fbba47259 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:26.197325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fb0d5e63-7f8f-4c37-87ee-465fbba47259 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:26.207666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e0df2435-8721-4f46-bfad-5eb08be08625 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:26.209380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e0df2435-8721-4f46-bfad-5eb08be08625 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:26.210750 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e0df2435-8721-4f46-bfad-5eb08be08625 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1280 microversion: 2.25 time: 0.266715 Oct 29 01:11:26.211490 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 940/1878] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:25 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1280 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:26.212879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb0d5e63-7f8f-4c37-87ee-465fbba47259 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:26.213486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb0d5e63-7f8f-4c37-87ee-465fbba47259 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:26.213835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb0d5e63-7f8f-4c37-87ee-465fbba47259 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:26.214695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb0d5e63-7f8f-4c37-87ee-465fbba47259 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:26.215150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb0d5e63-7f8f-4c37-87ee-465fbba47259 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:26.215570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb0d5e63-7f8f-4c37-87ee-465fbba47259 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:26.216274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-d2073d7d-4dee-4b79-8959-3227e3dc2150 req-3b56f249-f232-4a2f-9bb5-76f5ebc52c0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11ab5390-0016-48c1-a83a-3afad408b332", "tag": "cce6d768-b86a-4d3f-b53d-62029a7a06cf"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:26.227087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d2073d7d-4dee-4b79-8959-3227e3dc2150 req-3b56f249-f232-4a2f-9bb5-76f5ebc52c0a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:26.227563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d2073d7d-4dee-4b79-8959-3227e3dc2150 req-3b56f249-f232-4a2f-9bb5-76f5ebc52c0a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:26.232052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d2073d7d-4dee-4b79-8959-3227e3dc2150 req-3b56f249-f232-4a2f-9bb5-76f5ebc52c0a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:26.241228 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-d2073d7d-4dee-4b79-8959-3227e3dc2150 req-3b56f249-f232-4a2f-9bb5-76f5ebc52c0a service nova] Creating event network-changed:cce6d768-b86a-4d3f-b53d-62029a7a06cf for instance 11ab5390-0016-48c1-a83a-3afad408b332 on n-h1-862964-3 Oct 29 01:11:26.246073 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-d2073d7d-4dee-4b79-8959-3227e3dc2150 req-3b56f249-f232-4a2f-9bb5-76f5ebc52c0a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033120 Oct 29 01:11:26.248644 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 941/1879] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:26.254432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-874cba2b-e3da-4dc7-833d-ada6b38b5569 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d9d3ef0d0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:26.306909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG neutronclient.v2_0.client [None req-874cba2b-e3da-4dc7-833d-ada6b38b5569 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 36d500ea-3f27-410b-9efd-938d3c3b7eb4 does not exist", "detail": ""}} {{(pid=121100) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:11:26.307740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.security_group_api [None req-874cba2b-e3da-4dc7-833d-ada6b38b5569 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Neutron security group 36d500ea-3f27-410b-9efd-938d3c3b7eb4 not found {{(pid=121100) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 01:11:26.308374 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-874cba2b-e3da-4dc7-833d-ada6b38b5569 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] HTTP exception thrown: Security group 36d500ea-3f27-410b-9efd-938d3c3b7eb4 does not exist Oct 29 01:11:26.308374 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-4feab3e3-0fba-4ba9-8c08-2ee2ab38f8ce'] Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-874cba2b-e3da-4dc7-833d-ada6b38b5569 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Request method failure captured: Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-security-groups/36d500ea-3f27-410b-9efd-938d3c3b7eb4 HTTP/1.1 Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH2dSOm6Gvr_7yReO_KK4LyiJmxHEpSHznGvK-Vwrpwo4GWP7Ab5YXTZuGsu1pNtwHZhTwV9418WfJZZN41caWcz_If-orG4TOArgMozy0kdFl7uiee1-gBfdA2Tv8rwYvLMwbreSpyPQ3JrbABZf0uK1xwJ_TuKV00PeAfDDKvVrXo Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_294bcfcd48fb4cf3b3744e74498a9f73", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: f6e18fc75c774452bcc89f4cb817e545 Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: exception: Security group 36d500ea-3f27-410b-9efd-938d3c3b7eb4 does not exist Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-4feab3e3-0fba-4ba9-8c08-2ee2ab38f8ce'] Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '36d500ea-3f27-410b-9efd-938d3c3b7eb4'} Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:11:26.310658 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 36d500ea-3f27-410b-9efd-938d3c3b7eb4 does not exist Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4feab3e3-0fba-4ba9-8c08-2ee2ab38f8ce'] Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 36d500ea-3f27-410b-9efd-938d3c3b7eb4 does not exist Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4feab3e3-0fba-4ba9-8c08-2ee2ab38f8ce'] Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 36d500ea-3f27-410b-9efd-938d3c3b7eb4 does not exist Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4feab3e3-0fba-4ba9-8c08-2ee2ab38f8ce'] Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 36d500ea-3f27-410b-9efd-938d3c3b7eb4 does not exist Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4feab3e3-0fba-4ba9-8c08-2ee2ab38f8ce'] Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-874cba2b-e3da-4dc7-833d-ada6b38b5569 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Returning 404 to user: Security group 36d500ea-3f27-410b-9efd-938d3c3b7eb4 does not exist Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-4feab3e3-0fba-4ba9-8c08-2ee2ab38f8ce'] {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-874cba2b-e3da-4dc7-833d-ada6b38b5569 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/36d500ea-3f27-410b-9efd-938d3c3b7eb4" status: 404 len: 194 microversion: 2.1 time: 0.062485 Oct 29 01:11:26.317004 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 942/1880] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 29 01:11:26 2022] GET /compute/v2.1/os-security-groups/36d500ea-3f27-410b-9efd-938d3c3b7eb4 => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:11:26.322576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a73d1dfd-a43b-4243-8166-32c96abb5d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:26.322576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a73d1dfd-a43b-4243-8166-32c96abb5d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:26.334027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a73d1dfd-a43b-4243-8166-32c96abb5d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:26.334860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a73d1dfd-a43b-4243-8166-32c96abb5d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:26.335311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a73d1dfd-a43b-4243-8166-32c96abb5d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:26.336142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a73d1dfd-a43b-4243-8166-32c96abb5d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:26.336771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a73d1dfd-a43b-4243-8166-32c96abb5d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:26.337040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a73d1dfd-a43b-4243-8166-32c96abb5d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:26.366684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a73d1dfd-a43b-4243-8166-32c96abb5d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:11:26.406238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fb0d5e63-7f8f-4c37-87ee-465fbba47259 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:26.414096 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fb0d5e63-7f8f-4c37-87ee-465fbba47259 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1315 microversion: 2.1 time: 0.222301 Oct 29 01:11:26.415768 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 939/1881] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:26 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:26.421529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-05a8a562-61b6-497d-bdea-eb18267a45b9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Action: 'create', calling method: .version_select at 0x7f9d9ff3d280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-38504072", "description": "tempest-description-2036388837"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:26.655879 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a73d1dfd-a43b-4243-8166-32c96abb5d5b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 204 len: 0 microversion: 2.1 time: 0.340731 Oct 29 01:11:26.656747 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 943/1882] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:11:26 2022] DELETE /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:11:26.662387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-868ef9e7-56aa-4327-9884-3c0ba22fec61 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:26.663087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-868ef9e7-56aa-4327-9884-3c0ba22fec61 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:26.669595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-868ef9e7-56aa-4327-9884-3c0ba22fec61 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:26.670086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-868ef9e7-56aa-4327-9884-3c0ba22fec61 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:26.670526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-868ef9e7-56aa-4327-9884-3c0ba22fec61 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:26.671227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-868ef9e7-56aa-4327-9884-3c0ba22fec61 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:26.672316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-868ef9e7-56aa-4327-9884-3c0ba22fec61 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:26.672963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-868ef9e7-56aa-4327-9884-3c0ba22fec61 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:26.801535 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-05a8a562-61b6-497d-bdea-eb18267a45b9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.384082 Oct 29 01:11:26.802140 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 940/1883] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:11:26 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:26.806930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0e79ebdd-c9ed-4903-8a15-6b52a9aae209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:26.813029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0e79ebdd-c9ed-4903-8a15-6b52a9aae209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:26.814955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e79ebdd-c9ed-4903-8a15-6b52a9aae209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:26.815439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e79ebdd-c9ed-4903-8a15-6b52a9aae209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:26.815869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e79ebdd-c9ed-4903-8a15-6b52a9aae209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:26.816562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e79ebdd-c9ed-4903-8a15-6b52a9aae209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:26.817019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e79ebdd-c9ed-4903-8a15-6b52a9aae209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:26.817470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e79ebdd-c9ed-4903-8a15-6b52a9aae209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:26.841873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-868ef9e7-56aa-4327-9884-3c0ba22fec61 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:26.851736 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-868ef9e7-56aa-4327-9884-3c0ba22fec61 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.193490 Oct 29 01:11:26.852439 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 944/1884] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:26 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:26.860570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-10b5a374-d2ac-4a33-83e5-1859761fa92c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Action: 'create', calling method: .version_select at 0x7f9d9c336820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-150073256", "description": "tempest-description-1940973593"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:26.867614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=20 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:26.978411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0e79ebdd-c9ed-4903-8a15-6b52a9aae209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:26.985406 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0e79ebdd-c9ed-4903-8a15-6b52a9aae209 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1469 microversion: 2.1 time: 0.182248 Oct 29 01:11:26.985992 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 941/1885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:26 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1469 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:27.117329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-2e6d8fd0-0459-4f02-9e33-17f0a26aedc3 req-50f86862-8863-472e-aa3e-5bc44c5add88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ea836d-4ec8-4646-a8f8-2c199985d829", "name": "network-vif-plugged", "status": "completed", "tag": "a2a1803b-2371-4f50-9500-0cc998cf3afa"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:27.129112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2e6d8fd0-0459-4f02-9e33-17f0a26aedc3 req-50f86862-8863-472e-aa3e-5bc44c5add88 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:27.129601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2e6d8fd0-0459-4f02-9e33-17f0a26aedc3 req-50f86862-8863-472e-aa3e-5bc44c5add88 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:27.130033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2e6d8fd0-0459-4f02-9e33-17f0a26aedc3 req-50f86862-8863-472e-aa3e-5bc44c5add88 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:27.143531 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-2e6d8fd0-0459-4f02-9e33-17f0a26aedc3 req-50f86862-8863-472e-aa3e-5bc44c5add88 service nova] Creating event network-vif-plugged:a2a1803b-2371-4f50-9500-0cc998cf3afa for instance b7ea836d-4ec8-4646-a8f8-2c199985d829 on n-h2-862964-3 Oct 29 01:11:27.148360 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-2e6d8fd0-0459-4f02-9e33-17f0a26aedc3 req-50f86862-8863-472e-aa3e-5bc44c5add88 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034812 Oct 29 01:11:27.148943 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 942/1886] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:11:27.214026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-375f3ca6-4f96-421f-a84e-edea3a5de069 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:27.214727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-375f3ca6-4f96-421f-a84e-edea3a5de069 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:27.221508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-375f3ca6-4f96-421f-a84e-edea3a5de069 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:27.221992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-375f3ca6-4f96-421f-a84e-edea3a5de069 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:27.222426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-375f3ca6-4f96-421f-a84e-edea3a5de069 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:27.223120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-375f3ca6-4f96-421f-a84e-edea3a5de069 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:27.223571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-375f3ca6-4f96-421f-a84e-edea3a5de069 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:27.223996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-375f3ca6-4f96-421f-a84e-edea3a5de069 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:27.289861 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-10b5a374-d2ac-4a33-83e5-1859761fa92c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.435506 Oct 29 01:11:27.299679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-375f3ca6-4f96-421f-a84e-edea3a5de069 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ba2d71e9604486bef50f7d4b8a8700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82d19d99c7e405fb679320110c9748d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:27.303896 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 945/1887] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:11:26 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:27.304055 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-375f3ca6-4f96-421f-a84e-edea3a5de069 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 200 len: 1277 microversion: 2.1 time: 0.092319 Oct 29 01:11:27.304055 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 943/1888] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:27 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:27.306468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d67639c0-0d6b-432f-9a39-0f7aa9970f0f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:27.307207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d67639c0-0d6b-432f-9a39-0f7aa9970f0f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:27.307347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5d34588e-3ca0-43de-b205-8e49ef76e21a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Action: 'create', calling method: .version_select at 0x7f9d9fefb820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-753661957", "description": "tempest-description-1710090583"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:27.315185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d67639c0-0d6b-432f-9a39-0f7aa9970f0f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:27.315786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d67639c0-0d6b-432f-9a39-0f7aa9970f0f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:27.316336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d67639c0-0d6b-432f-9a39-0f7aa9970f0f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:27.317803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d67639c0-0d6b-432f-9a39-0f7aa9970f0f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:27.318565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d67639c0-0d6b-432f-9a39-0f7aa9970f0f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:27.319268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d67639c0-0d6b-432f-9a39-0f7aa9970f0f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:27.490600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d67639c0-0d6b-432f-9a39-0f7aa9970f0f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:27.499141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d67639c0-0d6b-432f-9a39-0f7aa9970f0f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:27.502049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d67639c0-0d6b-432f-9a39-0f7aa9970f0f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:27.503375 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d67639c0-0d6b-432f-9a39-0f7aa9970f0f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1280 microversion: 2.25 time: 0.201508 Oct 29 01:11:27.504023 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 946/1889] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:27 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1280 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:27.525824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-322d8918-9501-4250-a8d7-ecc52cc410bf tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:27.526440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-322d8918-9501-4250-a8d7-ecc52cc410bf tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:27.533691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-322d8918-9501-4250-a8d7-ecc52cc410bf tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:27.534139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-322d8918-9501-4250-a8d7-ecc52cc410bf tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:27.534714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-322d8918-9501-4250-a8d7-ecc52cc410bf tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:27.535433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-322d8918-9501-4250-a8d7-ecc52cc410bf tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:27.535897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-322d8918-9501-4250-a8d7-ecc52cc410bf tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:27.536327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-322d8918-9501-4250-a8d7-ecc52cc410bf tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:27.697276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-322d8918-9501-4250-a8d7-ecc52cc410bf tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:27.706217 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-322d8918-9501-4250-a8d7-ecc52cc410bf tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1315 microversion: 2.1 time: 0.184341 Oct 29 01:11:27.706788 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 947/1890] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:27 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:27.750524 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5d34588e-3ca0-43de-b205-8e49ef76e21a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.446910 Oct 29 01:11:27.751901 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 944/1891] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:11:27 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:27.764554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7212f544-e7b7-4deb-90e0-0244f7848284 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d9c1c0040>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:27.875830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-26e9bef4-2b44-46e4-b99a-58cab787aa55 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:27.876438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-26e9bef4-2b44-46e4-b99a-58cab787aa55 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:27.883562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26e9bef4-2b44-46e4-b99a-58cab787aa55 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:27.884180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26e9bef4-2b44-46e4-b99a-58cab787aa55 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:27.884690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26e9bef4-2b44-46e4-b99a-58cab787aa55 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:27.885423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26e9bef4-2b44-46e4-b99a-58cab787aa55 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:27.885883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26e9bef4-2b44-46e4-b99a-58cab787aa55 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:27.886308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26e9bef4-2b44-46e4-b99a-58cab787aa55 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:28.015044 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7212f544-e7b7-4deb-90e0-0244f7848284 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.254446 Oct 29 01:11:28.016454 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 948/1892] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 29 01:11:27 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:28.021504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f51479df-db49-47d3-a1ef-948f56deea58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:28.022122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f51479df-db49-47d3-a1ef-948f56deea58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:28.029586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f51479df-db49-47d3-a1ef-948f56deea58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:28.030093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f51479df-db49-47d3-a1ef-948f56deea58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:28.030524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f51479df-db49-47d3-a1ef-948f56deea58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:28.031804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f51479df-db49-47d3-a1ef-948f56deea58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:28.032319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f51479df-db49-47d3-a1ef-948f56deea58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:28.032836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f51479df-db49-47d3-a1ef-948f56deea58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:28.055887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-26e9bef4-2b44-46e4-b99a-58cab787aa55 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:28.064710 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-26e9bef4-2b44-46e4-b99a-58cab787aa55 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.192784 Oct 29 01:11:28.065331 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 945/1893] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:27 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:28.078371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-333228c0-ae6a-4c59-9b72-67f4ca79a5ff tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d9fe61310>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:28.221419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f51479df-db49-47d3-a1ef-948f56deea58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:28.229430 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f51479df-db49-47d3-a1ef-948f56deea58 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1469 microversion: 2.1 time: 0.211704 Oct 29 01:11:28.230162 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 949/1894] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:28 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1469 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:28.331010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5e3c0325-3aa5-46c1-b37b-2db7ae1cb8f0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:28.331711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5e3c0325-3aa5-46c1-b37b-2db7ae1cb8f0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:28.337865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e3c0325-3aa5-46c1-b37b-2db7ae1cb8f0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:28.338404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e3c0325-3aa5-46c1-b37b-2db7ae1cb8f0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:28.338835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e3c0325-3aa5-46c1-b37b-2db7ae1cb8f0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:28.339532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e3c0325-3aa5-46c1-b37b-2db7ae1cb8f0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:28.339993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e3c0325-3aa5-46c1-b37b-2db7ae1cb8f0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:28.340418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e3c0325-3aa5-46c1-b37b-2db7ae1cb8f0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:28.345685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:28.372772 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-333228c0-ae6a-4c59-9b72-67f4ca79a5ff tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/6e386821-6ff4-4d80-a4ae-db2ef6ea0812" status: 202 len: 0 microversion: 2.1 time: 0.306384 Oct 29 01:11:28.375430 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 946/1895] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:11:28 2022] DELETE /compute/v2.1/os-security-groups/6e386821-6ff4-4d80-a4ae-db2ef6ea0812 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:11:28.382817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4651b4c2-989c-4746-8d8c-d08fa71eca1a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d9ff783a0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:28.422273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5e3c0325-3aa5-46c1-b37b-2db7ae1cb8f0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ba2d71e9604486bef50f7d4b8a8700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82d19d99c7e405fb679320110c9748d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:28.428763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG neutronclient.v2_0.client [None req-4651b4c2-989c-4746-8d8c-d08fa71eca1a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6e386821-6ff4-4d80-a4ae-db2ef6ea0812 does not exist", "detail": ""}} {{(pid=121099) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:11:28.429527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.security_group_api [None req-4651b4c2-989c-4746-8d8c-d08fa71eca1a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Neutron security group 6e386821-6ff4-4d80-a4ae-db2ef6ea0812 not found {{(pid=121099) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 01:11:28.430160 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-4651b4c2-989c-4746-8d8c-d08fa71eca1a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] HTTP exception thrown: Security group 6e386821-6ff4-4d80-a4ae-db2ef6ea0812 does not exist Oct 29 01:11:28.430160 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-e3529e88-5331-415c-88da-e68d90e3e6f1'] Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4651b4c2-989c-4746-8d8c-d08fa71eca1a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Request method failure captured: Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-security-groups/6e386821-6ff4-4d80-a4ae-db2ef6ea0812 HTTP/1.1 Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH2dSOm6Gvr_7yReO_KK4LyiJmxHEpSHznGvK-Vwrpwo4GWP7Ab5YXTZuGsu1pNtwHZhTwV9418WfJZZN41caWcz_If-orG4TOArgMozy0kdFl7uiee1-gBfdA2Tv8rwYvLMwbreSpyPQ3JrbABZf0uK1xwJ_TuKV00PeAfDDKvVrXo Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_294bcfcd48fb4cf3b3744e74498a9f73", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f6e18fc75c774452bcc89f4cb817e545 Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: exception: Security group 6e386821-6ff4-4d80-a4ae-db2ef6ea0812 does not exist Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-e3529e88-5331-415c-88da-e68d90e3e6f1'] Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '6e386821-6ff4-4d80-a4ae-db2ef6ea0812'} Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:11:28.432308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6e386821-6ff4-4d80-a4ae-db2ef6ea0812 does not exist Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3529e88-5331-415c-88da-e68d90e3e6f1'] Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6e386821-6ff4-4d80-a4ae-db2ef6ea0812 does not exist Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3529e88-5331-415c-88da-e68d90e3e6f1'] Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6e386821-6ff4-4d80-a4ae-db2ef6ea0812 does not exist Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3529e88-5331-415c-88da-e68d90e3e6f1'] Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6e386821-6ff4-4d80-a4ae-db2ef6ea0812 does not exist Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3529e88-5331-415c-88da-e68d90e3e6f1'] Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4651b4c2-989c-4746-8d8c-d08fa71eca1a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Returning 404 to user: Security group 6e386821-6ff4-4d80-a4ae-db2ef6ea0812 does not exist Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-e3529e88-5331-415c-88da-e68d90e3e6f1'] {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4651b4c2-989c-4746-8d8c-d08fa71eca1a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/6e386821-6ff4-4d80-a4ae-db2ef6ea0812" status: 404 len: 194 microversion: 2.1 time: 0.055289 Oct 29 01:11:28.441901 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 947/1896] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 29 01:11:28 2022] GET /compute/v2.1/os-security-groups/6e386821-6ff4-4d80-a4ae-db2ef6ea0812 => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:11:28.450319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-efe1bbb8-1651-49b8-8d88-b928417a3fba tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d9fe3a310>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:28.450899 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5e3c0325-3aa5-46c1-b37b-2db7ae1cb8f0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 200 len: 1285 microversion: 2.1 time: 0.119689 Oct 29 01:11:28.450899 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 950/1897] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:28 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 1285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:28.528164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-67bc7582-31c5-4d70-8c95-e206cea1c98f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:28.528721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-67bc7582-31c5-4d70-8c95-e206cea1c98f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:28.536285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67bc7582-31c5-4d70-8c95-e206cea1c98f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:28.536773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67bc7582-31c5-4d70-8c95-e206cea1c98f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:28.537257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67bc7582-31c5-4d70-8c95-e206cea1c98f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:28.537962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67bc7582-31c5-4d70-8c95-e206cea1c98f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:28.538419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67bc7582-31c5-4d70-8c95-e206cea1c98f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:28.538841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67bc7582-31c5-4d70-8c95-e206cea1c98f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:28.856621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-67bc7582-31c5-4d70-8c95-e206cea1c98f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:28.865804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-67bc7582-31c5-4d70-8c95-e206cea1c98f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:28.868142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-67bc7582-31c5-4d70-8c95-e206cea1c98f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:28.869300 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-67bc7582-31c5-4d70-8c95-e206cea1c98f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1280 microversion: 2.25 time: 0.345175 Oct 29 01:11:28.869870 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 951/1898] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:28 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1280 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:11:28.875008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a6503fce-3fff-4195-922d-bf6254bfefba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:28.875909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a6503fce-3fff-4195-922d-bf6254bfefba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:28.886775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6503fce-3fff-4195-922d-bf6254bfefba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:28.887588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6503fce-3fff-4195-922d-bf6254bfefba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:28.888217 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6503fce-3fff-4195-922d-bf6254bfefba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:28.889189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6503fce-3fff-4195-922d-bf6254bfefba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:28.889813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6503fce-3fff-4195-922d-bf6254bfefba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:28.890243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6503fce-3fff-4195-922d-bf6254bfefba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:29.068818 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-efe1bbb8-1651-49b8-8d88-b928417a3fba tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/8b205a22-41d8-456d-a7df-22bf92d2b852" status: 202 len: 0 microversion: 2.1 time: 0.626056 Oct 29 01:11:29.068818 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 948/1899] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:11:28 2022] DELETE /compute/v2.1/os-security-groups/8b205a22-41d8-456d-a7df-22bf92d2b852 => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:11:29.076536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e7676249-2393-4ca1-9af3-1231b0de8ea5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d9fefb310>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:29.133387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG neutronclient.v2_0.client [None req-e7676249-2393-4ca1-9af3-1231b0de8ea5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8b205a22-41d8-456d-a7df-22bf92d2b852 does not exist", "detail": ""}} {{(pid=121099) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:11:29.135540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.security_group_api [None req-e7676249-2393-4ca1-9af3-1231b0de8ea5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Neutron security group 8b205a22-41d8-456d-a7df-22bf92d2b852 not found {{(pid=121099) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 01:11:29.138062 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-e7676249-2393-4ca1-9af3-1231b0de8ea5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] HTTP exception thrown: Security group 8b205a22-41d8-456d-a7df-22bf92d2b852 does not exist Oct 29 01:11:29.138062 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-b10bedd4-2e8c-4ba0-b212-cfd47fdb9387'] Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e7676249-2393-4ca1-9af3-1231b0de8ea5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Request method failure captured: Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-security-groups/8b205a22-41d8-456d-a7df-22bf92d2b852 HTTP/1.1 Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH2dSOm6Gvr_7yReO_KK4LyiJmxHEpSHznGvK-Vwrpwo4GWP7Ab5YXTZuGsu1pNtwHZhTwV9418WfJZZN41caWcz_If-orG4TOArgMozy0kdFl7uiee1-gBfdA2Tv8rwYvLMwbreSpyPQ3JrbABZf0uK1xwJ_TuKV00PeAfDDKvVrXo Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_294bcfcd48fb4cf3b3744e74498a9f73", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f6e18fc75c774452bcc89f4cb817e545 Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: exception: Security group 8b205a22-41d8-456d-a7df-22bf92d2b852 does not exist Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-b10bedd4-2e8c-4ba0-b212-cfd47fdb9387'] Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '8b205a22-41d8-456d-a7df-22bf92d2b852'} Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:11:29.141866 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8b205a22-41d8-456d-a7df-22bf92d2b852 does not exist Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b10bedd4-2e8c-4ba0-b212-cfd47fdb9387'] Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8b205a22-41d8-456d-a7df-22bf92d2b852 does not exist Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b10bedd4-2e8c-4ba0-b212-cfd47fdb9387'] Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8b205a22-41d8-456d-a7df-22bf92d2b852 does not exist Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b10bedd4-2e8c-4ba0-b212-cfd47fdb9387'] Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8b205a22-41d8-456d-a7df-22bf92d2b852 does not exist Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b10bedd4-2e8c-4ba0-b212-cfd47fdb9387'] Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e7676249-2393-4ca1-9af3-1231b0de8ea5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Returning 404 to user: Security group 8b205a22-41d8-456d-a7df-22bf92d2b852 does not exist Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-b10bedd4-2e8c-4ba0-b212-cfd47fdb9387'] {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e7676249-2393-4ca1-9af3-1231b0de8ea5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/8b205a22-41d8-456d-a7df-22bf92d2b852" status: 404 len: 194 microversion: 2.1 time: 0.072446 Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 949/1900] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 29 01:11:29 2022] GET /compute/v2.1/os-security-groups/8b205a22-41d8-456d-a7df-22bf92d2b852 => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5cb37758-3a96-4852-aed2-47a87976b3fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:29.156968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5cb37758-3a96-4852-aed2-47a87976b3fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:29.163829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a6503fce-3fff-4195-922d-bf6254bfefba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:29.166182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cb37758-3a96-4852-aed2-47a87976b3fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:29.167011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cb37758-3a96-4852-aed2-47a87976b3fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:29.167734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cb37758-3a96-4852-aed2-47a87976b3fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:29.168368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cb37758-3a96-4852-aed2-47a87976b3fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:29.168926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cb37758-3a96-4852-aed2-47a87976b3fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:29.169634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cb37758-3a96-4852-aed2-47a87976b3fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:29.173318 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a6503fce-3fff-4195-922d-bf6254bfefba tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1315 microversion: 2.1 time: 0.301918 Oct 29 01:11:29.173983 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 952/1901] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:28 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:29.194656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bcb8e6dc-770e-47e5-9026-2e94658eb056 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d97f568b0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:29.413598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5cb37758-3a96-4852-aed2-47a87976b3fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:29.424265 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5cb37758-3a96-4852-aed2-47a87976b3fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.278186 Oct 29 01:11:29.425324 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 950/1902] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:29 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:29.449121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e327fea9-ea92-42d4-98fb-631bb430ad6b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:29.449910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e327fea9-ea92-42d4-98fb-631bb430ad6b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:29.457844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e327fea9-ea92-42d4-98fb-631bb430ad6b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:29.458329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e327fea9-ea92-42d4-98fb-631bb430ad6b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:29.458988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e327fea9-ea92-42d4-98fb-631bb430ad6b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:29.459693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e327fea9-ea92-42d4-98fb-631bb430ad6b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:29.460144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e327fea9-ea92-42d4-98fb-631bb430ad6b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:29.460569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e327fea9-ea92-42d4-98fb-631bb430ad6b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:29.604098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e327fea9-ea92-42d4-98fb-631bb430ad6b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:29.612392 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e327fea9-ea92-42d4-98fb-631bb430ad6b tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1469 microversion: 2.1 time: 0.171813 Oct 29 01:11:29.613023 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 951/1903] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:29 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:29.617739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-17c6082a-d55c-4edb-b89c-657c2bdcea17 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:29.618352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-17c6082a-d55c-4edb-b89c-657c2bdcea17 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:29.624522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17c6082a-d55c-4edb-b89c-657c2bdcea17 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:29.628789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17c6082a-d55c-4edb-b89c-657c2bdcea17 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:29.628789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17c6082a-d55c-4edb-b89c-657c2bdcea17 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:29.628789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17c6082a-d55c-4edb-b89c-657c2bdcea17 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:29.628789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17c6082a-d55c-4edb-b89c-657c2bdcea17 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:29.628789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17c6082a-d55c-4edb-b89c-657c2bdcea17 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:29.642976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:29.659826 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bcb8e6dc-770e-47e5-9026-2e94658eb056 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/4d6ee0d9-1208-4314-8ce6-499723d6aa1b" status: 202 len: 0 microversion: 2.1 time: 0.468710 Oct 29 01:11:29.663777 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 953/1904] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:11:29 2022] DELETE /compute/v2.1/os-security-groups/4d6ee0d9-1208-4314-8ce6-499723d6aa1b => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:11:29.669378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-da34e154-0bc2-4ac8-9f1d-78d26c26f40b tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d97d1c040>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:29.716186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-17c6082a-d55c-4edb-b89c-657c2bdcea17 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ba2d71e9604486bef50f7d4b8a8700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82d19d99c7e405fb679320110c9748d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:29.717290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG neutronclient.v2_0.client [None req-da34e154-0bc2-4ac8-9f1d-78d26c26f40b tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4d6ee0d9-1208-4314-8ce6-499723d6aa1b does not exist", "detail": ""}} {{(pid=121100) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:11:29.718090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.security_group_api [None req-da34e154-0bc2-4ac8-9f1d-78d26c26f40b tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Neutron security group 4d6ee0d9-1208-4314-8ce6-499723d6aa1b not found {{(pid=121100) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 01:11:29.719391 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-da34e154-0bc2-4ac8-9f1d-78d26c26f40b tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] HTTP exception thrown: Security group 4d6ee0d9-1208-4314-8ce6-499723d6aa1b does not exist Oct 29 01:11:29.719391 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-e248d1e2-e353-436a-8e76-05b97159f33d'] Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-da34e154-0bc2-4ac8-9f1d-78d26c26f40b tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Request method failure captured: Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-security-groups/4d6ee0d9-1208-4314-8ce6-499723d6aa1b HTTP/1.1 Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH2dSOm6Gvr_7yReO_KK4LyiJmxHEpSHznGvK-Vwrpwo4GWP7Ab5YXTZuGsu1pNtwHZhTwV9418WfJZZN41caWcz_If-orG4TOArgMozy0kdFl7uiee1-gBfdA2Tv8rwYvLMwbreSpyPQ3JrbABZf0uK1xwJ_TuKV00PeAfDDKvVrXo Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_294bcfcd48fb4cf3b3744e74498a9f73", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: f6e18fc75c774452bcc89f4cb817e545 Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: exception: Security group 4d6ee0d9-1208-4314-8ce6-499723d6aa1b does not exist Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-e248d1e2-e353-436a-8e76-05b97159f33d'] Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '4d6ee0d9-1208-4314-8ce6-499723d6aa1b'} Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:11:29.721714 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4d6ee0d9-1208-4314-8ce6-499723d6aa1b does not exist Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e248d1e2-e353-436a-8e76-05b97159f33d'] Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4d6ee0d9-1208-4314-8ce6-499723d6aa1b does not exist Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e248d1e2-e353-436a-8e76-05b97159f33d'] Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4d6ee0d9-1208-4314-8ce6-499723d6aa1b does not exist Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e248d1e2-e353-436a-8e76-05b97159f33d'] Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4d6ee0d9-1208-4314-8ce6-499723d6aa1b does not exist Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e248d1e2-e353-436a-8e76-05b97159f33d'] Oct 29 01:11:29.726923 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:11:29.730899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-da34e154-0bc2-4ac8-9f1d-78d26c26f40b tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Returning 404 to user: Security group 4d6ee0d9-1208-4314-8ce6-499723d6aa1b does not exist Oct 29 01:11:29.730899 n-d-862964-3 devstack@n-api.service[121100]: Neutron server returns request_ids: ['req-e248d1e2-e353-436a-8e76-05b97159f33d'] {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:11:29.732012 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-da34e154-0bc2-4ac8-9f1d-78d26c26f40b tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/4d6ee0d9-1208-4314-8ce6-499723d6aa1b" status: 404 len: 194 microversion: 2.1 time: 0.066950 Oct 29 01:11:29.732810 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 954/1905] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 29 01:11:29 2022] GET /compute/v2.1/os-security-groups/4d6ee0d9-1208-4314-8ce6-499723d6aa1b => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:11:29.733894 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-17c6082a-d55c-4edb-b89c-657c2bdcea17 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 200 len: 1283 microversion: 2.1 time: 0.119715 Oct 29 01:11:29.737841 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 952/1906] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:29 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 1283 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:29.742920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-83e0d6e1-1ae9-4744-b3bd-4d206132eb97 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d97d1c040>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:29.901346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9cad8dd0-04ab-44c0-b742-75212533b710 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:29.901968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9cad8dd0-04ab-44c0-b742-75212533b710 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:29.919442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cad8dd0-04ab-44c0-b742-75212533b710 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:29.922185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cad8dd0-04ab-44c0-b742-75212533b710 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:29.922616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cad8dd0-04ab-44c0-b742-75212533b710 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:29.923354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cad8dd0-04ab-44c0-b742-75212533b710 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:29.928310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cad8dd0-04ab-44c0-b742-75212533b710 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:29.928877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cad8dd0-04ab-44c0-b742-75212533b710 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:29.965126 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-83e0d6e1-1ae9-4744-b3bd-4d206132eb97 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.227609 Oct 29 01:11:29.966036 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 955/1907] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 29 01:11:29 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:29.972420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-f57f8399-f413-467d-9ef5-68be4f0aeb6f req-82e885b0-bfe3-4d3b-9173-735ae67b5b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ea836d-4ec8-4646-a8f8-2c199985d829", "name": "network-vif-deleted", "tag": "a2a1803b-2371-4f50-9500-0cc998cf3afa"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:29.997134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f57f8399-f413-467d-9ef5-68be4f0aeb6f req-82e885b0-bfe3-4d3b-9173-735ae67b5b20 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:29.997972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f57f8399-f413-467d-9ef5-68be4f0aeb6f req-82e885b0-bfe3-4d3b-9173-735ae67b5b20 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:29.998404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f57f8399-f413-467d-9ef5-68be4f0aeb6f req-82e885b0-bfe3-4d3b-9173-735ae67b5b20 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:30.012263 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f57f8399-f413-467d-9ef5-68be4f0aeb6f req-82e885b0-bfe3-4d3b-9173-735ae67b5b20 service nova] Creating event network-vif-deleted:a2a1803b-2371-4f50-9500-0cc998cf3afa for instance b7ea836d-4ec8-4646-a8f8-2c199985d829 on n-h2-862964-3 Oct 29 01:11:30.017994 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-f57f8399-f413-467d-9ef5-68be4f0aeb6f req-82e885b0-bfe3-4d3b-9173-735ae67b5b20 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050170 Oct 29 01:11:30.019149 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 956/1908] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:30.029050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-561f2635-999e-46a9-9707-7937cfaac026 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Action: 'create', calling method: .version_select at 0x7f9d9c042f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-561700661", "description": "tempest-description-821302960"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:30.176087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9cad8dd0-04ab-44c0-b742-75212533b710 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:30.184535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9cad8dd0-04ab-44c0-b742-75212533b710 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:30.186242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9cad8dd0-04ab-44c0-b742-75212533b710 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:30.187623 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9cad8dd0-04ab-44c0-b742-75212533b710 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1280 microversion: 2.25 time: 0.293277 Oct 29 01:11:30.189208 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 953/1909] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:29 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1280 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:30.207929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2fa7cdf2-fbe1-4c3c-b82a-4b88a52e90d4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:30.208706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2fa7cdf2-fbe1-4c3c-b82a-4b88a52e90d4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:30.216201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fa7cdf2-fbe1-4c3c-b82a-4b88a52e90d4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:30.216724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fa7cdf2-fbe1-4c3c-b82a-4b88a52e90d4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:30.217264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fa7cdf2-fbe1-4c3c-b82a-4b88a52e90d4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:30.218095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fa7cdf2-fbe1-4c3c-b82a-4b88a52e90d4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:30.218787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fa7cdf2-fbe1-4c3c-b82a-4b88a52e90d4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:30.219295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fa7cdf2-fbe1-4c3c-b82a-4b88a52e90d4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:30.438261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2fa7cdf2-fbe1-4c3c-b82a-4b88a52e90d4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:30.446068 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2fa7cdf2-fbe1-4c3c-b82a-4b88a52e90d4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1315 microversion: 2.1 time: 0.252717 Oct 29 01:11:30.462035 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 954/1910] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:30 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:30.470774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5a7fd714-3e8a-4da1-8494-f1a620042204 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:30.472211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5a7fd714-3e8a-4da1-8494-f1a620042204 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:30.479334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a7fd714-3e8a-4da1-8494-f1a620042204 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:30.480074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a7fd714-3e8a-4da1-8494-f1a620042204 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:30.480723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a7fd714-3e8a-4da1-8494-f1a620042204 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:30.481811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a7fd714-3e8a-4da1-8494-f1a620042204 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:30.482272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a7fd714-3e8a-4da1-8494-f1a620042204 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:30.482697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a7fd714-3e8a-4da1-8494-f1a620042204 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:30.644553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5a7fd714-3e8a-4da1-8494-f1a620042204 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:30.660580 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5a7fd714-3e8a-4da1-8494-f1a620042204 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.190782 Oct 29 01:11:30.664360 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 955/1911] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:30 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:30.672643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-908f5e3a-a965-493d-acc9-3f4f3a97d5dd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:30.673074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-908f5e3a-a965-493d-acc9-3f4f3a97d5dd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:30.680029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-908f5e3a-a965-493d-acc9-3f4f3a97d5dd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:30.680539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-908f5e3a-a965-493d-acc9-3f4f3a97d5dd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:30.680979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-908f5e3a-a965-493d-acc9-3f4f3a97d5dd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:30.683649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-908f5e3a-a965-493d-acc9-3f4f3a97d5dd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:30.683649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-908f5e3a-a965-493d-acc9-3f4f3a97d5dd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:30.683649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-908f5e3a-a965-493d-acc9-3f4f3a97d5dd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:30.730101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-908f5e3a-a965-493d-acc9-3f4f3a97d5dd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:30.730720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-908f5e3a-a965-493d-acc9-3f4f3a97d5dd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:30.731223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-908f5e3a-a965-493d-acc9-3f4f3a97d5dd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:30.731678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-908f5e3a-a965-493d-acc9-3f4f3a97d5dd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lazy-loading 'fault' on Instance uuid b7ea836d-4ec8-4646-a8f8-2c199985d829 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:11:30.778440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-908f5e3a-a965-493d-acc9-3f4f3a97d5dd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:30.786901 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-908f5e3a-a965-493d-acc9-3f4f3a97d5dd tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 200 len: 1303 microversion: 2.1 time: 0.121252 Oct 29 01:11:30.787495 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 956/1912] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:30 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:30.792479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fa812520-31a4-4b40-aaba-b40b338ded26 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:30.793119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fa812520-31a4-4b40-aaba-b40b338ded26 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:30.799488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa812520-31a4-4b40-aaba-b40b338ded26 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:30.800191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa812520-31a4-4b40-aaba-b40b338ded26 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:30.800827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa812520-31a4-4b40-aaba-b40b338ded26 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:30.801894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa812520-31a4-4b40-aaba-b40b338ded26 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:30.802687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa812520-31a4-4b40-aaba-b40b338ded26 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:30.803282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa812520-31a4-4b40-aaba-b40b338ded26 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:30.808068 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-561f2635-999e-46a9-9707-7937cfaac026 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.787498 Oct 29 01:11:30.808679 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 957/1913] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:11:30 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:30.823467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cdd24dfd-3281-4516-a65b-39d0438d1b3e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Action: 'create', calling method: .version_select at 0x7f9d97a03c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1961793319", "description": "tempest-description-644935956"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:30.977364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fa812520-31a4-4b40-aaba-b40b338ded26 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ba2d71e9604486bef50f7d4b8a8700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82d19d99c7e405fb679320110c9748d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:30.990441 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fa812520-31a4-4b40-aaba-b40b338ded26 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 200 len: 1351 microversion: 2.1 time: 0.201698 Oct 29 01:11:30.991468 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 957/1914] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:30 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 1351 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:31.215745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-71fd71b3-0ddd-4a9b-9c99-f2eadc70bbe5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:31.216271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-71fd71b3-0ddd-4a9b-9c99-f2eadc70bbe5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:31.224745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71fd71b3-0ddd-4a9b-9c99-f2eadc70bbe5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:31.225270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71fd71b3-0ddd-4a9b-9c99-f2eadc70bbe5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:31.225714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71fd71b3-0ddd-4a9b-9c99-f2eadc70bbe5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:31.226407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71fd71b3-0ddd-4a9b-9c99-f2eadc70bbe5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:31.226859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71fd71b3-0ddd-4a9b-9c99-f2eadc70bbe5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:31.227753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71fd71b3-0ddd-4a9b-9c99-f2eadc70bbe5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:31.393105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-71fd71b3-0ddd-4a9b-9c99-f2eadc70bbe5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:31.399419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-71fd71b3-0ddd-4a9b-9c99-f2eadc70bbe5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:31.400903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-71fd71b3-0ddd-4a9b-9c99-f2eadc70bbe5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:31.402052 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-71fd71b3-0ddd-4a9b-9c99-f2eadc70bbe5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1280 microversion: 2.25 time: 0.190609 Oct 29 01:11:31.402618 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 958/1915] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:31 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1280 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:11:31.427657 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cdd24dfd-3281-4516-a65b-39d0438d1b3e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.603174 Oct 29 01:11:31.427657 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 958/1916] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:11:30 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:11:31.474627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-37c92dce-6c72-4500-b740-7d5fd4e40475 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:31.475169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-37c92dce-6c72-4500-b740-7d5fd4e40475 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:31.481134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37c92dce-6c72-4500-b740-7d5fd4e40475 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:31.481658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37c92dce-6c72-4500-b740-7d5fd4e40475 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:31.482102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37c92dce-6c72-4500-b740-7d5fd4e40475 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:31.482808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37c92dce-6c72-4500-b740-7d5fd4e40475 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:31.483270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37c92dce-6c72-4500-b740-7d5fd4e40475 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:31.483698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37c92dce-6c72-4500-b740-7d5fd4e40475 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:31.564300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e0324912-53b8-4e5d-975d-32fc563ea856 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-880487548", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "ef0bfb89-9268-4eef-b7c3-6f6a44644039"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:31.629945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-e0324912-53b8-4e5d-975d-32fc563ea856 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] validate_networks() for [('ef0bfb89-9268-4eef-b7c3-6f6a44644039', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:11:31.633291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-37c92dce-6c72-4500-b740-7d5fd4e40475 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:31.642020 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-37c92dce-6c72-4500-b740-7d5fd4e40475 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1315 microversion: 2.1 time: 0.171629 Oct 29 01:11:31.642713 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 959/1917] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:31 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:31.680378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ffb1565b-3819-4297-a0b2-b324b1a392ed tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:31.681536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ffb1565b-3819-4297-a0b2-b324b1a392ed tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:31.688625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ffb1565b-3819-4297-a0b2-b324b1a392ed tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:31.689593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ffb1565b-3819-4297-a0b2-b324b1a392ed tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:31.690044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ffb1565b-3819-4297-a0b2-b324b1a392ed tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:31.696440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ffb1565b-3819-4297-a0b2-b324b1a392ed tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:31.696440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ffb1565b-3819-4297-a0b2-b324b1a392ed tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:31.696440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ffb1565b-3819-4297-a0b2-b324b1a392ed tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:31.906846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ffb1565b-3819-4297-a0b2-b324b1a392ed tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:31.917005 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ffb1565b-3819-4297-a0b2-b324b1a392ed tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.241415 Oct 29 01:11:31.917996 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 960/1918] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:31 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:31.923579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aa37a841-71a4-487f-a3e5-81735cb02187 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:31.924731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-aa37a841-71a4-487f-a3e5-81735cb02187 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: b7ea836d-4ec8-4646-a8f8-2c199985d829] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:31.931047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa37a841-71a4-487f-a3e5-81735cb02187 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:31.931536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa37a841-71a4-487f-a3e5-81735cb02187 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:31.931975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa37a841-71a4-487f-a3e5-81735cb02187 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:31.932709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa37a841-71a4-487f-a3e5-81735cb02187 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:31.933183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa37a841-71a4-487f-a3e5-81735cb02187 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:31.933707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa37a841-71a4-487f-a3e5-81735cb02187 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:31.949185 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-aa37a841-71a4-487f-a3e5-81735cb02187 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] HTTP exception thrown: Instance b7ea836d-4ec8-4646-a8f8-2c199985d829 could not be found. Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aa37a841-71a4-487f-a3e5-81735cb02187 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Request method failure captured: Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 HTTP/1.1 Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHx4Exy0fA7yCulwEKsYTn6p0cpQn82ha3CItdadZCftDNzAtDaMNlMq5Gu4Pyq4-p2ad3gFna2zFPNvVBuznDo-GSrDXusbeJ9jMCJCUEhQ6_ac87zN9tMgl1Cwml7V7E1rI2AghgmcK5PcN2ZzLKQO85pceUd_kEQ-NlJkVriW-Lg Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 646dbadc4e9140348132e6950c885e81 Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-MigrationsAdminTest-188021266 Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/646dbadc4e9140348132e6950c885e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/646dbadc4e9140348132e6950c885e81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/646dbadc4e9140348132e6950c885e81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_646dbadc4e9140348132e6950c885e81", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-MigrationsAdminTest-188021266 Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 646dbadc4e9140348132e6950c885e81 Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-MigrationsAdminTest-188021266 Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-MigrationsAdminTest-188021266-project Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8219d81b19964408b9bc275a4457f389 Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-MigrationsAdminTest-188021266-project Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance b7ea836d-4ec8-4646-a8f8-2c199985d829 could not be found. Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'b7ea836d-4ec8-4646-a8f8-2c199985d829'} Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ea836d-4ec8-4646-a8f8-2c199985d829 could not be found. Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ea836d-4ec8-4646-a8f8-2c199985d829 could not be found. Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:31.950853 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:31.960755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:31.960755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:31.960755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:31.960755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:11:31.960755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:11:31.960755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ea836d-4ec8-4646-a8f8-2c199985d829 could not be found. Oct 29 01:11:31.960755 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:31.960755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aa37a841-71a4-487f-a3e5-81735cb02187 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Returning 404 to user: Instance b7ea836d-4ec8-4646-a8f8-2c199985d829 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:11:31.960755 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aa37a841-71a4-487f-a3e5-81735cb02187 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829" status: 404 len: 111 microversion: 2.1 time: 0.033170 Oct 29 01:11:31.960755 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 961/1919] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:31 2022] GET /compute/v2.1/servers/b7ea836d-4ec8-4646-a8f8-2c199985d829 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:11:31.961954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-af68c62b-5063-462c-b7f2-88aeeca8e33a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:31.962450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-af68c62b-5063-462c-b7f2-88aeeca8e33a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:31.968703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af68c62b-5063-462c-b7f2-88aeeca8e33a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:31.969286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af68c62b-5063-462c-b7f2-88aeeca8e33a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:31.969668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af68c62b-5063-462c-b7f2-88aeeca8e33a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:31.970384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af68c62b-5063-462c-b7f2-88aeeca8e33a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:31.970847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af68c62b-5063-462c-b7f2-88aeeca8e33a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:31.971277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af68c62b-5063-462c-b7f2-88aeeca8e33a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:32.000726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-af68c62b-5063-462c-b7f2-88aeeca8e33a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:11:32.155014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e0324912-53b8-4e5d-975d-32fc563ea856 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:11:32.155574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e0324912-53b8-4e5d-975d-32fc563ea856 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:11:32.156427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e0324912-53b8-4e5d-975d-32fc563ea856 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:11:32.156852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e0324912-53b8-4e5d-975d-32fc563ea856 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:11:32.157307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e0324912-53b8-4e5d-975d-32fc563ea856 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:11:32.167074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0324912-53b8-4e5d-975d-32fc563ea856 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:32.167566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0324912-53b8-4e5d-975d-32fc563ea856 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:32.168004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0324912-53b8-4e5d-975d-32fc563ea856 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:32.168750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0324912-53b8-4e5d-975d-32fc563ea856 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:32.169235 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0324912-53b8-4e5d-975d-32fc563ea856 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:32.169726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0324912-53b8-4e5d-975d-32fc563ea856 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:32.190500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-e0324912-53b8-4e5d-975d-32fc563ea856 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Getting quotas for project 294bcfcd48fb4cf3b3744e74498a9f73. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:11:32.197538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-e0324912-53b8-4e5d-975d-32fc563ea856 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Getting quotas for user f6e18fc75c774452bcc89f4cb817e545 and project 294bcfcd48fb4cf3b3744e74498a9f73. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:11:32.213085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e0324912-53b8-4e5d-975d-32fc563ea856 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:11:32.216317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e0324912-53b8-4e5d-975d-32fc563ea856 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:11:32.365231 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-af68c62b-5063-462c-b7f2-88aeeca8e33a tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 204 len: 0 microversion: 2.1 time: 0.406667 Oct 29 01:11:32.365852 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 962/1920] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:11:31 2022] DELETE /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:11:32.379044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-975f1953-8e67-43bd-a214-ffecf964830a tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:32.380105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-975f1953-8e67-43bd-a214-ffecf964830a tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:32.382481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:32.389885 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e0324912-53b8-4e5d-975d-32fc563ea856 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.832808 Oct 29 01:11:32.390964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-975f1953-8e67-43bd-a214-ffecf964830a tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:32.399628 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 959/1921] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:11:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:11:32.399841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-975f1953-8e67-43bd-a214-ffecf964830a tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:32.399841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-975f1953-8e67-43bd-a214-ffecf964830a tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:32.400034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-a192c692-29c8-4887-8fbf-372fd91438f0 req-8249375c-e2d7-4c26-9cb7-76e13c80dccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8914c05-5333-46a4-8930-90cb1a93e5eb", "name": "network-vif-unplugged", "status": "completed", "tag": "3ee3428d-0fa0-4f5f-835c-2e2776c92305"}, {"name": "network-changed", "server_uuid": "b8914c05-5333-46a4-8930-90cb1a93e5eb", "tag": "3ee3428d-0fa0-4f5f-835c-2e2776c92305"}, {"name": "network-changed", "server_uuid": "61cd44bc-7c52-428d-92a9-44443fd987ce", "tag": "337dc720-1980-4d9f-aeb1-6c6ad88902d3"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:32.400601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-975f1953-8e67-43bd-a214-ffecf964830a tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:32.401821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-975f1953-8e67-43bd-a214-ffecf964830a tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:32.402476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-975f1953-8e67-43bd-a214-ffecf964830a tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:32.425472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a192c692-29c8-4887-8fbf-372fd91438f0 req-8249375c-e2d7-4c26-9cb7-76e13c80dccb service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:32.426058 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a192c692-29c8-4887-8fbf-372fd91438f0 req-8249375c-e2d7-4c26-9cb7-76e13c80dccb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:32.426401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a192c692-29c8-4887-8fbf-372fd91438f0 req-8249375c-e2d7-4c26-9cb7-76e13c80dccb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:32.455098 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-a192c692-29c8-4887-8fbf-372fd91438f0 req-8249375c-e2d7-4c26-9cb7-76e13c80dccb service nova] Creating event network-vif-unplugged:3ee3428d-0fa0-4f5f-835c-2e2776c92305 for instance b8914c05-5333-46a4-8930-90cb1a93e5eb on n-h1-862964-3 Oct 29 01:11:32.455894 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-a192c692-29c8-4887-8fbf-372fd91438f0 req-8249375c-e2d7-4c26-9cb7-76e13c80dccb service nova] Creating event network-changed:3ee3428d-0fa0-4f5f-835c-2e2776c92305 for instance b8914c05-5333-46a4-8930-90cb1a93e5eb on n-h1-862964-3 Oct 29 01:11:32.457456 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-a192c692-29c8-4887-8fbf-372fd91438f0 req-8249375c-e2d7-4c26-9cb7-76e13c80dccb service nova] Creating event network-changed:337dc720-1980-4d9f-aeb1-6c6ad88902d3 for instance 61cd44bc-7c52-428d-92a9-44443fd987ce on n-h2-862964-3 Oct 29 01:11:32.471137 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-a192c692-29c8-4887-8fbf-372fd91438f0 req-8249375c-e2d7-4c26-9cb7-76e13c80dccb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.077917 Oct 29 01:11:32.478318 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 960/1922] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:32.486054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2fc7d402-84da-4859-a228-d5f81ad17a31 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:32.486909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2fc7d402-84da-4859-a228-d5f81ad17a31 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:32.494297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fc7d402-84da-4859-a228-d5f81ad17a31 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:32.494848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fc7d402-84da-4859-a228-d5f81ad17a31 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:32.495419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fc7d402-84da-4859-a228-d5f81ad17a31 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:32.496413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fc7d402-84da-4859-a228-d5f81ad17a31 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:32.497082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fc7d402-84da-4859-a228-d5f81ad17a31 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:32.497670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fc7d402-84da-4859-a228-d5f81ad17a31 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:32.662708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-975f1953-8e67-43bd-a214-ffecf964830a tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ba2d71e9604486bef50f7d4b8a8700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82d19d99c7e405fb679320110c9748d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:32.671764 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-975f1953-8e67-43bd-a214-ffecf964830a tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 200 len: 1351 microversion: 2.1 time: 0.303953 Oct 29 01:11:32.672867 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 963/1923] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:32 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 1351 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:32.678101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ef475de5-d3d4-4946-b7d3-ae0d3976963d tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:32.678957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ef475de5-d3d4-4946-b7d3-ae0d3976963d tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:32.710736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2fc7d402-84da-4859-a228-d5f81ad17a31 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:32.721218 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2fc7d402-84da-4859-a228-d5f81ad17a31 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1533 microversion: 2.1 time: 0.240509 Oct 29 01:11:32.722491 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 961/1924] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:32 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1533 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:32.729433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cf377f3f-f3be-4963-96ad-9e9ab5536ca6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:32.730429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cf377f3f-f3be-4963-96ad-9e9ab5536ca6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:32.737976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf377f3f-f3be-4963-96ad-9e9ab5536ca6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:32.738634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf377f3f-f3be-4963-96ad-9e9ab5536ca6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:32.739133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf377f3f-f3be-4963-96ad-9e9ab5536ca6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:32.739989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf377f3f-f3be-4963-96ad-9e9ab5536ca6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:32.740662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf377f3f-f3be-4963-96ad-9e9ab5536ca6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:32.741336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf377f3f-f3be-4963-96ad-9e9ab5536ca6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:32.774846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ef475de5-d3d4-4946-b7d3-ae0d3976963d tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:32.783953 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ef475de5-d3d4-4946-b7d3-ae0d3976963d tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1215 microversion: 2.1 time: 0.109754 Oct 29 01:11:32.784508 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 964/1925] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:32 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1215 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:32.789661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-626dc03e-2e1d-4c51-aed8-cece95fb3aa1 req-c5dee767-2105-4b34-af6c-a90d4c7508bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11ab5390-0016-48c1-a83a-3afad408b332", "name": "network-vif-plugged", "status": "completed", "tag": "cce6d768-b86a-4d3f-b53d-62029a7a06cf"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:32.803068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-626dc03e-2e1d-4c51-aed8-cece95fb3aa1 req-c5dee767-2105-4b34-af6c-a90d4c7508bb service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:32.803546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-626dc03e-2e1d-4c51-aed8-cece95fb3aa1 req-c5dee767-2105-4b34-af6c-a90d4c7508bb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:32.804021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-626dc03e-2e1d-4c51-aed8-cece95fb3aa1 req-c5dee767-2105-4b34-af6c-a90d4c7508bb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:32.817520 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-626dc03e-2e1d-4c51-aed8-cece95fb3aa1 req-c5dee767-2105-4b34-af6c-a90d4c7508bb service nova] Creating event network-vif-plugged:cce6d768-b86a-4d3f-b53d-62029a7a06cf for instance 11ab5390-0016-48c1-a83a-3afad408b332 on n-h1-862964-3 Oct 29 01:11:32.822572 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-626dc03e-2e1d-4c51-aed8-cece95fb3aa1 req-c5dee767-2105-4b34-af6c-a90d4c7508bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036600 Oct 29 01:11:32.830992 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 965/1926] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:32.830992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-04071ca3-6f66-4bab-99d0-8792b9f5fc59 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:32.830992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-04071ca3-6f66-4bab-99d0-8792b9f5fc59 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:32.835878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04071ca3-6f66-4bab-99d0-8792b9f5fc59 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:32.836356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04071ca3-6f66-4bab-99d0-8792b9f5fc59 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:32.836784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04071ca3-6f66-4bab-99d0-8792b9f5fc59 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:32.837778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04071ca3-6f66-4bab-99d0-8792b9f5fc59 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:32.838246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04071ca3-6f66-4bab-99d0-8792b9f5fc59 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:32.838816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04071ca3-6f66-4bab-99d0-8792b9f5fc59 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:33.075610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cf377f3f-f3be-4963-96ad-9e9ab5536ca6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:33.088633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cf377f3f-f3be-4963-96ad-9e9ab5536ca6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:33.091600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cf377f3f-f3be-4963-96ad-9e9ab5536ca6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:33.095161 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cf377f3f-f3be-4963-96ad-9e9ab5536ca6 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1280 microversion: 2.25 time: 0.371181 Oct 29 01:11:33.095873 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 962/1927] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:32 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1280 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:33.102538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-67f8ec4e-9313-4e29-84dc-4be3ddc1b27e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:33.103750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-67f8ec4e-9313-4e29-84dc-4be3ddc1b27e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:33.119106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67f8ec4e-9313-4e29-84dc-4be3ddc1b27e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:33.120463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67f8ec4e-9313-4e29-84dc-4be3ddc1b27e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:33.122548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67f8ec4e-9313-4e29-84dc-4be3ddc1b27e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:33.123789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67f8ec4e-9313-4e29-84dc-4be3ddc1b27e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:33.124474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67f8ec4e-9313-4e29-84dc-4be3ddc1b27e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:33.126306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67f8ec4e-9313-4e29-84dc-4be3ddc1b27e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:33.221684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-04071ca3-6f66-4bab-99d0-8792b9f5fc59 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:33.231674 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-04071ca3-6f66-4bab-99d0-8792b9f5fc59 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1315 microversion: 2.1 time: 0.407197 Oct 29 01:11:33.233005 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 966/1928] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:32 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:33.345681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-67f8ec4e-9313-4e29-84dc-4be3ddc1b27e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:33.355973 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-67f8ec4e-9313-4e29-84dc-4be3ddc1b27e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.258768 Oct 29 01:11:33.356701 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 963/1929] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:33 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:33.700719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-67041f4c-dbc6-4b42-829d-de0fb4dde3c0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:33.702261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-67041f4c-dbc6-4b42-829d-de0fb4dde3c0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:33.710580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:33.712935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-67041f4c-dbc6-4b42-829d-de0fb4dde3c0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:33.713619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-67041f4c-dbc6-4b42-829d-de0fb4dde3c0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:33.714835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-67041f4c-dbc6-4b42-829d-de0fb4dde3c0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:33.715764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-67041f4c-dbc6-4b42-829d-de0fb4dde3c0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:33.716221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-67041f4c-dbc6-4b42-829d-de0fb4dde3c0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:33.716675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-67041f4c-dbc6-4b42-829d-de0fb4dde3c0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:33.753266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9eff54f1-b225-4e3c-a42a-55343b9ac4d5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:33.753955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9eff54f1-b225-4e3c-a42a-55343b9ac4d5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:33.761148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9eff54f1-b225-4e3c-a42a-55343b9ac4d5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:33.761658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9eff54f1-b225-4e3c-a42a-55343b9ac4d5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:33.762097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9eff54f1-b225-4e3c-a42a-55343b9ac4d5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:33.762808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9eff54f1-b225-4e3c-a42a-55343b9ac4d5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:33.763268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9eff54f1-b225-4e3c-a42a-55343b9ac4d5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:33.763694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9eff54f1-b225-4e3c-a42a-55343b9ac4d5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:33.963208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-67041f4c-dbc6-4b42-829d-de0fb4dde3c0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ba2d71e9604486bef50f7d4b8a8700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82d19d99c7e405fb679320110c9748d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:33.966209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9eff54f1-b225-4e3c-a42a-55343b9ac4d5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:33.972367 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-67041f4c-dbc6-4b42-829d-de0fb4dde3c0 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 200 len: 1351 microversion: 2.1 time: 0.277748 Oct 29 01:11:33.972964 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 967/1930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:33 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 1351 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:33.978236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-335fee8e-f4f7-4afc-af99-936eed00282e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:33.979177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-335fee8e-f4f7-4afc-af99-936eed00282e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:33.986612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-335fee8e-f4f7-4afc-af99-936eed00282e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:33.993360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-335fee8e-f4f7-4afc-af99-936eed00282e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:33.993360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-335fee8e-f4f7-4afc-af99-936eed00282e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:33.993360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-335fee8e-f4f7-4afc-af99-936eed00282e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:33.993360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-335fee8e-f4f7-4afc-af99-936eed00282e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:33.993360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-335fee8e-f4f7-4afc-af99-936eed00282e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:33.994022 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9eff54f1-b225-4e3c-a42a-55343b9ac4d5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1533 microversion: 2.1 time: 0.245567 Oct 29 01:11:33.994022 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 964/1931] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:33 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1533 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:34.057729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-335fee8e-f4f7-4afc-af99-936eed00282e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:34.065757 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-335fee8e-f4f7-4afc-af99-936eed00282e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1219 microversion: 2.1 time: 0.091544 Oct 29 01:11:34.066337 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 968/1932] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:33 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:34.121253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-acd6869f-79f6-4f92-8f7f-22fc8a6f4aa0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:34.121977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-acd6869f-79f6-4f92-8f7f-22fc8a6f4aa0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:34.125232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:34.128439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-acd6869f-79f6-4f92-8f7f-22fc8a6f4aa0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:34.128926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-acd6869f-79f6-4f92-8f7f-22fc8a6f4aa0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:34.129445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-acd6869f-79f6-4f92-8f7f-22fc8a6f4aa0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:34.130151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-acd6869f-79f6-4f92-8f7f-22fc8a6f4aa0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:34.130612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-acd6869f-79f6-4f92-8f7f-22fc8a6f4aa0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:34.131035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-acd6869f-79f6-4f92-8f7f-22fc8a6f4aa0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:34.262164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7e2ff22c-3c88-431c-b53b-c18e22d9ad63 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:34.262774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7e2ff22c-3c88-431c-b53b-c18e22d9ad63 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:34.266423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-acd6869f-79f6-4f92-8f7f-22fc8a6f4aa0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:34.271455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e2ff22c-3c88-431c-b53b-c18e22d9ad63 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:34.272173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e2ff22c-3c88-431c-b53b-c18e22d9ad63 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:34.272809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e2ff22c-3c88-431c-b53b-c18e22d9ad63 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:34.273983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e2ff22c-3c88-431c-b53b-c18e22d9ad63 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:34.274657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e2ff22c-3c88-431c-b53b-c18e22d9ad63 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:34.275405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e2ff22c-3c88-431c-b53b-c18e22d9ad63 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:34.276490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-acd6869f-79f6-4f92-8f7f-22fc8a6f4aa0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:34.278379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-acd6869f-79f6-4f92-8f7f-22fc8a6f4aa0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:34.281974 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-acd6869f-79f6-4f92-8f7f-22fc8a6f4aa0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1280 microversion: 2.25 time: 0.164706 Oct 29 01:11:34.282740 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 965/1933] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:34 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1280 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:34.297220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:34.381865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-41541d26-468f-4630-b44e-c8a12291a66e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:34.382650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-41541d26-468f-4630-b44e-c8a12291a66e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:34.390985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41541d26-468f-4630-b44e-c8a12291a66e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:34.391619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41541d26-468f-4630-b44e-c8a12291a66e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:34.392476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41541d26-468f-4630-b44e-c8a12291a66e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:34.393320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41541d26-468f-4630-b44e-c8a12291a66e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:34.393905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41541d26-468f-4630-b44e-c8a12291a66e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:34.394944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41541d26-468f-4630-b44e-c8a12291a66e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:34.541351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7e2ff22c-3c88-431c-b53b-c18e22d9ad63 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:34.549184 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7e2ff22c-3c88-431c-b53b-c18e22d9ad63 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1315 microversion: 2.1 time: 0.291198 Oct 29 01:11:34.550528 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 969/1934] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:34 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:34.656625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-41541d26-468f-4630-b44e-c8a12291a66e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:34.667965 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-41541d26-468f-4630-b44e-c8a12291a66e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.290124 Oct 29 01:11:34.669249 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 966/1935] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:34 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:34.837934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-c71d3f26-3cfb-42e2-9a8e-165067b0a935 req-9f974373-dc44-4c45-90b1-dcd3b9aa3ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dead7b7-a0ac-4233-a0ae-ed19568a36cf", "name": "network-vif-plugged", "status": "completed", "tag": "fed62005-09de-4477-ac60-2dac49a60063"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:34.849792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c71d3f26-3cfb-42e2-9a8e-165067b0a935 req-9f974373-dc44-4c45-90b1-dcd3b9aa3ebd service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:34.850280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c71d3f26-3cfb-42e2-9a8e-165067b0a935 req-9f974373-dc44-4c45-90b1-dcd3b9aa3ebd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:34.858111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c71d3f26-3cfb-42e2-9a8e-165067b0a935 req-9f974373-dc44-4c45-90b1-dcd3b9aa3ebd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:34.863016 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-c71d3f26-3cfb-42e2-9a8e-165067b0a935 req-9f974373-dc44-4c45-90b1-dcd3b9aa3ebd service nova] Creating event network-vif-plugged:fed62005-09de-4477-ac60-2dac49a60063 for instance 2dead7b7-a0ac-4233-a0ae-ed19568a36cf on n-h1-862964-3 Oct 29 01:11:34.867952 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-c71d3f26-3cfb-42e2-9a8e-165067b0a935 req-9f974373-dc44-4c45-90b1-dcd3b9aa3ebd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033680 Oct 29 01:11:34.868540 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 970/1936] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:34.996482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8b546afd-4b0a-4a65-844f-574571be7850 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:34.997252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8b546afd-4b0a-4a65-844f-574571be7850 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:35.005449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b546afd-4b0a-4a65-844f-574571be7850 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:35.005936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b546afd-4b0a-4a65-844f-574571be7850 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:35.006471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b546afd-4b0a-4a65-844f-574571be7850 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:35.007172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b546afd-4b0a-4a65-844f-574571be7850 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:35.007631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b546afd-4b0a-4a65-844f-574571be7850 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:35.008055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b546afd-4b0a-4a65-844f-574571be7850 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:35.019063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9362ebfd-73ea-4615-b107-4f94e7386d01 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:35.021398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9362ebfd-73ea-4615-b107-4f94e7386d01 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:35.027551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9362ebfd-73ea-4615-b107-4f94e7386d01 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:35.027878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9362ebfd-73ea-4615-b107-4f94e7386d01 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:35.028713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9362ebfd-73ea-4615-b107-4f94e7386d01 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:35.029704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9362ebfd-73ea-4615-b107-4f94e7386d01 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:35.030791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9362ebfd-73ea-4615-b107-4f94e7386d01 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:35.031318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9362ebfd-73ea-4615-b107-4f94e7386d01 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:35.578494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8b546afd-4b0a-4a65-844f-574571be7850 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ba2d71e9604486bef50f7d4b8a8700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82d19d99c7e405fb679320110c9748d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:35.584031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9362ebfd-73ea-4615-b107-4f94e7386d01 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:35.587112 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8b546afd-4b0a-4a65-844f-574571be7850 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 200 len: 1351 microversion: 2.1 time: 0.594824 Oct 29 01:11:35.587751 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 967/1937] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:34 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 1351 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:35.592311 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9362ebfd-73ea-4615-b107-4f94e7386d01 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1533 microversion: 2.1 time: 0.579981 Oct 29 01:11:35.592469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-88904c1e-58d9-4c83-b2e8-c806a947a6d6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:35.593130 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 971/1938] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:35 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1533 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:35.594465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-88904c1e-58d9-4c83-b2e8-c806a947a6d6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:35.598743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-68b2005e-6469-4369-93f5-c6ed6891ea46 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:35.599353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-68b2005e-6469-4369-93f5-c6ed6891ea46 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:35.605293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68b2005e-6469-4369-93f5-c6ed6891ea46 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:35.605787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68b2005e-6469-4369-93f5-c6ed6891ea46 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:35.606215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68b2005e-6469-4369-93f5-c6ed6891ea46 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:35.607025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68b2005e-6469-4369-93f5-c6ed6891ea46 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:35.607374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68b2005e-6469-4369-93f5-c6ed6891ea46 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:35.607802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68b2005e-6469-4369-93f5-c6ed6891ea46 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:35.610935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88904c1e-58d9-4c83-b2e8-c806a947a6d6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:35.611503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88904c1e-58d9-4c83-b2e8-c806a947a6d6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:35.611941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88904c1e-58d9-4c83-b2e8-c806a947a6d6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:35.612650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88904c1e-58d9-4c83-b2e8-c806a947a6d6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:35.613110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88904c1e-58d9-4c83-b2e8-c806a947a6d6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:35.613577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88904c1e-58d9-4c83-b2e8-c806a947a6d6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:35.701821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-88904c1e-58d9-4c83-b2e8-c806a947a6d6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:35.710322 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-88904c1e-58d9-4c83-b2e8-c806a947a6d6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1267 microversion: 2.1 time: 0.121540 Oct 29 01:11:35.711069 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 968/1939] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:35 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1267 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:35.716274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e4639ebe-09f5-42b9-912e-791edf3d3a79 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:35.716894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e4639ebe-09f5-42b9-912e-791edf3d3a79 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:35.725392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4639ebe-09f5-42b9-912e-791edf3d3a79 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:35.725951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4639ebe-09f5-42b9-912e-791edf3d3a79 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:35.726518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4639ebe-09f5-42b9-912e-791edf3d3a79 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:35.727296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4639ebe-09f5-42b9-912e-791edf3d3a79 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:35.727759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4639ebe-09f5-42b9-912e-791edf3d3a79 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:35.728186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4639ebe-09f5-42b9-912e-791edf3d3a79 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:35.765698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-68b2005e-6469-4369-93f5-c6ed6891ea46 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:35.774115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-68b2005e-6469-4369-93f5-c6ed6891ea46 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:35.775580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-68b2005e-6469-4369-93f5-c6ed6891ea46 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:35.776708 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-68b2005e-6469-4369-93f5-c6ed6891ea46 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1280 microversion: 2.25 time: 0.182532 Oct 29 01:11:35.777318 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 972/1940] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:35 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1280 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:35.782101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6b131502-9da8-49a4-97bd-30cfc63ad018 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:35.783236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6b131502-9da8-49a4-97bd-30cfc63ad018 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:35.792149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b131502-9da8-49a4-97bd-30cfc63ad018 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:35.792149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b131502-9da8-49a4-97bd-30cfc63ad018 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:35.792149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b131502-9da8-49a4-97bd-30cfc63ad018 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:35.792598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b131502-9da8-49a4-97bd-30cfc63ad018 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:35.792995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b131502-9da8-49a4-97bd-30cfc63ad018 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:35.793454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b131502-9da8-49a4-97bd-30cfc63ad018 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:35.908843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e4639ebe-09f5-42b9-912e-791edf3d3a79 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:35.916967 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e4639ebe-09f5-42b9-912e-791edf3d3a79 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1502 microversion: 2.1 time: 0.204911 Oct 29 01:11:35.917652 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 969/1941] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:35 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1502 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:35.940165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d848fc07-1cb9-4b7b-aa2b-a903db62b46f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:35.940800 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d848fc07-1cb9-4b7b-aa2b-a903db62b46f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:35.946726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d848fc07-1cb9-4b7b-aa2b-a903db62b46f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:35.951562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d848fc07-1cb9-4b7b-aa2b-a903db62b46f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:35.951562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d848fc07-1cb9-4b7b-aa2b-a903db62b46f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:35.951562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d848fc07-1cb9-4b7b-aa2b-a903db62b46f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:35.951562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d848fc07-1cb9-4b7b-aa2b-a903db62b46f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:35.951562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d848fc07-1cb9-4b7b-aa2b-a903db62b46f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:35.952629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6b131502-9da8-49a4-97bd-30cfc63ad018 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:35.961633 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6b131502-9da8-49a4-97bd-30cfc63ad018 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.183313 Oct 29 01:11:35.962221 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 973/1942] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:35 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:36.203901 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d848fc07-1cb9-4b7b-aa2b-a903db62b46f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "POST /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332/action" status: 202 len: 0 microversion: 2.1 time: 0.267440 Oct 29 01:11:36.205608 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 970/1943] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:11:35 2022] POST /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:11:36.213846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b77f2aec-751d-4e36-9aab-fe32b64db444 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:36.215086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b77f2aec-751d-4e36-9aab-fe32b64db444 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:36.222038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b77f2aec-751d-4e36-9aab-fe32b64db444 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:36.222509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b77f2aec-751d-4e36-9aab-fe32b64db444 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:36.222943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b77f2aec-751d-4e36-9aab-fe32b64db444 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:36.223634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b77f2aec-751d-4e36-9aab-fe32b64db444 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:36.224093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b77f2aec-751d-4e36-9aab-fe32b64db444 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:36.224517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b77f2aec-751d-4e36-9aab-fe32b64db444 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:36.354589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b77f2aec-751d-4e36-9aab-fe32b64db444 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:36.362463 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b77f2aec-751d-4e36-9aab-fe32b64db444 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1507 microversion: 2.1 time: 0.152494 Oct 29 01:11:36.363032 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 974/1944] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:36 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:36.612364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-57b6cbb4-4a72-4f7a-8131-e965d93f7638 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:36.614155 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-57b6cbb4-4a72-4f7a-8131-e965d93f7638 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:36.618573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-608b6b42-bccc-4479-ab61-47eb95c784a0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:36.619219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-608b6b42-bccc-4479-ab61-47eb95c784a0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:36.625753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-608b6b42-bccc-4479-ab61-47eb95c784a0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:36.627038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-608b6b42-bccc-4479-ab61-47eb95c784a0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:36.627759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-608b6b42-bccc-4479-ab61-47eb95c784a0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:36.628476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-608b6b42-bccc-4479-ab61-47eb95c784a0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:36.628932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-608b6b42-bccc-4479-ab61-47eb95c784a0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:36.629383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-608b6b42-bccc-4479-ab61-47eb95c784a0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:36.629863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57b6cbb4-4a72-4f7a-8131-e965d93f7638 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:36.632692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57b6cbb4-4a72-4f7a-8131-e965d93f7638 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:36.633272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57b6cbb4-4a72-4f7a-8131-e965d93f7638 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:36.634100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57b6cbb4-4a72-4f7a-8131-e965d93f7638 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:36.634669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57b6cbb4-4a72-4f7a-8131-e965d93f7638 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:36.641202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57b6cbb4-4a72-4f7a-8131-e965d93f7638 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:36.839417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-608b6b42-bccc-4479-ab61-47eb95c784a0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:36.846681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-57b6cbb4-4a72-4f7a-8131-e965d93f7638 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ba2d71e9604486bef50f7d4b8a8700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82d19d99c7e405fb679320110c9748d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:36.851454 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-608b6b42-bccc-4479-ab61-47eb95c784a0 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1533 microversion: 2.1 time: 0.236718 Oct 29 01:11:36.868991 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 975/1945] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:36 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1533 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:36.869219 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-57b6cbb4-4a72-4f7a-8131-e965d93f7638 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 200 len: 1351 microversion: 2.1 time: 0.247449 Oct 29 01:11:36.869219 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 971/1946] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:36 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 1351 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:36.869447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7928b9b0-43a7-4bf4-98be-65f0bb901b04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:36.869447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7928b9b0-43a7-4bf4-98be-65f0bb901b04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:36.869674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a444a65e-2ae9-4cac-8adf-413c6c19592d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:36.869674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a444a65e-2ae9-4cac-8adf-413c6c19592d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:36.869870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7928b9b0-43a7-4bf4-98be-65f0bb901b04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:36.869870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7928b9b0-43a7-4bf4-98be-65f0bb901b04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:36.869870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7928b9b0-43a7-4bf4-98be-65f0bb901b04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:36.869870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7928b9b0-43a7-4bf4-98be-65f0bb901b04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:36.869870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7928b9b0-43a7-4bf4-98be-65f0bb901b04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:36.869870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7928b9b0-43a7-4bf4-98be-65f0bb901b04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:36.870408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a444a65e-2ae9-4cac-8adf-413c6c19592d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:36.870408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a444a65e-2ae9-4cac-8adf-413c6c19592d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:36.870408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a444a65e-2ae9-4cac-8adf-413c6c19592d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:36.870408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a444a65e-2ae9-4cac-8adf-413c6c19592d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:36.870408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a444a65e-2ae9-4cac-8adf-413c6c19592d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:36.870408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a444a65e-2ae9-4cac-8adf-413c6c19592d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:36.955876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7928b9b0-43a7-4bf4-98be-65f0bb901b04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:36.964164 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7928b9b0-43a7-4bf4-98be-65f0bb901b04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1285 microversion: 2.1 time: 0.110955 Oct 29 01:11:36.969224 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 976/1947] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:36 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:36.990126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0c306af7-b994-4179-a287-7114643d592f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:36.990875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0c306af7-b994-4179-a287-7114643d592f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:36.998525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c306af7-b994-4179-a287-7114643d592f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:36.999127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c306af7-b994-4179-a287-7114643d592f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:37.002555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c306af7-b994-4179-a287-7114643d592f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:37.002555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c306af7-b994-4179-a287-7114643d592f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:37.002555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c306af7-b994-4179-a287-7114643d592f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:37.002555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c306af7-b994-4179-a287-7114643d592f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:37.143733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a444a65e-2ae9-4cac-8adf-413c6c19592d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:37.148164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:37.167401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a444a65e-2ae9-4cac-8adf-413c6c19592d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:37.171413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a444a65e-2ae9-4cac-8adf-413c6c19592d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:37.174104 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a444a65e-2ae9-4cac-8adf-413c6c19592d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1280 microversion: 2.25 time: 0.317477 Oct 29 01:11:37.189708 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 972/1948] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:36 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1280 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:37.229218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0c306af7-b994-4179-a287-7114643d592f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:37.239249 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0c306af7-b994-4179-a287-7114643d592f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.256596 Oct 29 01:11:37.239843 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 977/1949] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:36 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:37.389539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0f9c96f6-4e1f-4581-87bd-f906184b7f39 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:37.390292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0f9c96f6-4e1f-4581-87bd-f906184b7f39 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:37.401172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0f9c96f6-4e1f-4581-87bd-f906184b7f39 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:37.401172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0f9c96f6-4e1f-4581-87bd-f906184b7f39 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:37.401172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0f9c96f6-4e1f-4581-87bd-f906184b7f39 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:37.401709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0f9c96f6-4e1f-4581-87bd-f906184b7f39 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:37.402176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0f9c96f6-4e1f-4581-87bd-f906184b7f39 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:37.402602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0f9c96f6-4e1f-4581-87bd-f906184b7f39 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:37.662632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-242d88ff-b542-4f34-b4c7-c9bff943ff48 req-9404a82e-be59-4e24-b765-76be597acae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cedff71-8de0-4fb5-b294-af0c46e7e324", "name": "network-vif-unplugged", "status": "completed", "tag": "fbf748c5-d7b1-45dc-a698-9d558f69324c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:37.674761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0f9c96f6-4e1f-4581-87bd-f906184b7f39 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:37.689596 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0f9c96f6-4e1f-4581-87bd-f906184b7f39 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1487 microversion: 2.1 time: 0.306195 Oct 29 01:11:37.696957 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 973/1950] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:37 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1487 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:37.702601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-242d88ff-b542-4f34-b4c7-c9bff943ff48 req-9404a82e-be59-4e24-b765-76be597acae4 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:37.704988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-242d88ff-b542-4f34-b4c7-c9bff943ff48 req-9404a82e-be59-4e24-b765-76be597acae4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:37.706306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-242d88ff-b542-4f34-b4c7-c9bff943ff48 req-9404a82e-be59-4e24-b765-76be597acae4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:37.719473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-91c2c6ec-690a-42f4-a095-a8c91e0dd6f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:37.720548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-91c2c6ec-690a-42f4-a095-a8c91e0dd6f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:37.734303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91c2c6ec-690a-42f4-a095-a8c91e0dd6f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:37.734801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91c2c6ec-690a-42f4-a095-a8c91e0dd6f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:37.735240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91c2c6ec-690a-42f4-a095-a8c91e0dd6f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:37.737626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91c2c6ec-690a-42f4-a095-a8c91e0dd6f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:37.738332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91c2c6ec-690a-42f4-a095-a8c91e0dd6f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:37.739067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91c2c6ec-690a-42f4-a095-a8c91e0dd6f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:37.743167 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-242d88ff-b542-4f34-b4c7-c9bff943ff48 req-9404a82e-be59-4e24-b765-76be597acae4 service nova] Creating event network-vif-unplugged:fbf748c5-d7b1-45dc-a698-9d558f69324c for instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 on n-h2-862964-3 Oct 29 01:11:37.750773 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-242d88ff-b542-4f34-b4c7-c9bff943ff48 req-9404a82e-be59-4e24-b765-76be597acae4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094857 Oct 29 01:11:37.752450 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 978/1951] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:37.794066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-91c2c6ec-690a-42f4-a095-a8c91e0dd6f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:11:37.880242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7bb72271-a79e-4382-82cf-ce591ab23f70 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:37.881512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7bb72271-a79e-4382-82cf-ce591ab23f70 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:37.889591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bb72271-a79e-4382-82cf-ce591ab23f70 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:37.890405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bb72271-a79e-4382-82cf-ce591ab23f70 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:37.891068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bb72271-a79e-4382-82cf-ce591ab23f70 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:37.893431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bb72271-a79e-4382-82cf-ce591ab23f70 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:37.894142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bb72271-a79e-4382-82cf-ce591ab23f70 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:37.894911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bb72271-a79e-4382-82cf-ce591ab23f70 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:38.026376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7bb72271-a79e-4382-82cf-ce591ab23f70 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:38.035148 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7bb72271-a79e-4382-82cf-ce591ab23f70 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1491 microversion: 2.1 time: 0.161946 Oct 29 01:11:38.036466 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 979/1952] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:37 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1491 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:38.041717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b9ea3eca-bc39-40fd-87c1-985af21199de tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:38.042555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b9ea3eca-bc39-40fd-87c1-985af21199de tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:38.049478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9ea3eca-bc39-40fd-87c1-985af21199de tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:38.050227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9ea3eca-bc39-40fd-87c1-985af21199de tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:38.050850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9ea3eca-bc39-40fd-87c1-985af21199de tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:38.051745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9ea3eca-bc39-40fd-87c1-985af21199de tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:38.052368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9ea3eca-bc39-40fd-87c1-985af21199de tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:38.052960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9ea3eca-bc39-40fd-87c1-985af21199de tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:38.196209 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-91c2c6ec-690a-42f4-a095-a8c91e0dd6f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "DELETE /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 204 len: 0 microversion: 2.1 time: 0.480292 Oct 29 01:11:38.197879 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 974/1953] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:11:37 2022] DELETE /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:11:38.206033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-279137f3-52d8-4c33-bd96-164c61e561f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:38.207762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-279137f3-52d8-4c33-bd96-164c61e561f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:38.219721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-279137f3-52d8-4c33-bd96-164c61e561f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:38.221682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-279137f3-52d8-4c33-bd96-164c61e561f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:38.222361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-279137f3-52d8-4c33-bd96-164c61e561f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:38.223299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-279137f3-52d8-4c33-bd96-164c61e561f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:38.223958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-279137f3-52d8-4c33-bd96-164c61e561f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:38.224584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-279137f3-52d8-4c33-bd96-164c61e561f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:38.261514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b9ea3eca-bc39-40fd-87c1-985af21199de tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ba2d71e9604486bef50f7d4b8a8700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82d19d99c7e405fb679320110c9748d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:38.273777 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b9ea3eca-bc39-40fd-87c1-985af21199de tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 200 len: 1351 microversion: 2.1 time: 0.235919 Oct 29 01:11:38.274379 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 980/1954] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:38 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 1351 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:38.291329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-af4da771-48e7-4067-a2de-e08fe9634bc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:38.292881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-af4da771-48e7-4067-a2de-e08fe9634bc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:38.303779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af4da771-48e7-4067-a2de-e08fe9634bc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:38.304284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af4da771-48e7-4067-a2de-e08fe9634bc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:38.304907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af4da771-48e7-4067-a2de-e08fe9634bc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:38.306895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af4da771-48e7-4067-a2de-e08fe9634bc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:38.307384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af4da771-48e7-4067-a2de-e08fe9634bc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:38.308102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af4da771-48e7-4067-a2de-e08fe9634bc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:38.426046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-279137f3-52d8-4c33-bd96-164c61e561f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:38.438958 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-279137f3-52d8-4c33-bd96-164c61e561f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1315 microversion: 2.1 time: 0.240365 Oct 29 01:11:38.439762 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 975/1955] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:38 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:38.450443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5b9ecf8d-2c9b-45ab-a7a8-6b4daf42a8fe tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:38.452164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5b9ecf8d-2c9b-45ab-a7a8-6b4daf42a8fe tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:38.473976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5b9ecf8d-2c9b-45ab-a7a8-6b4daf42a8fe tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:38.474851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5b9ecf8d-2c9b-45ab-a7a8-6b4daf42a8fe tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:38.476901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5b9ecf8d-2c9b-45ab-a7a8-6b4daf42a8fe tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:38.480301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5b9ecf8d-2c9b-45ab-a7a8-6b4daf42a8fe tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:38.481608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5b9ecf8d-2c9b-45ab-a7a8-6b4daf42a8fe tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:38.487739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5b9ecf8d-2c9b-45ab-a7a8-6b4daf42a8fe tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:38.492824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-af4da771-48e7-4067-a2de-e08fe9634bc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:38.505243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-af4da771-48e7-4067-a2de-e08fe9634bc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:38.508206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-af4da771-48e7-4067-a2de-e08fe9634bc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:38.518796 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-af4da771-48e7-4067-a2de-e08fe9634bc0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1476 microversion: 2.25 time: 0.232110 Oct 29 01:11:38.519441 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 981/1956] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:38 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1476 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:38.533571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-7f8cf665-ef2b-44a2-b49e-8e5fd73f7b9e req-9ef4132c-13ee-44f7-bc1b-553dcc473ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cedff71-8de0-4fb5-b294-af0c46e7e324", "name": "network-vif-deleted", "tag": "fbf748c5-d7b1-45dc-a698-9d558f69324c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:38.567058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7f8cf665-ef2b-44a2-b49e-8e5fd73f7b9e req-9ef4132c-13ee-44f7-bc1b-553dcc473ba3 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:38.568666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7f8cf665-ef2b-44a2-b49e-8e5fd73f7b9e req-9ef4132c-13ee-44f7-bc1b-553dcc473ba3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:38.568666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7f8cf665-ef2b-44a2-b49e-8e5fd73f7b9e req-9ef4132c-13ee-44f7-bc1b-553dcc473ba3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:38.588707 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-7f8cf665-ef2b-44a2-b49e-8e5fd73f7b9e req-9ef4132c-13ee-44f7-bc1b-553dcc473ba3 service nova] Creating event network-vif-deleted:fbf748c5-d7b1-45dc-a698-9d558f69324c for instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 on n-h2-862964-3 Oct 29 01:11:38.594187 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-7f8cf665-ef2b-44a2-b49e-8e5fd73f7b9e req-9ef4132c-13ee-44f7-bc1b-553dcc473ba3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073294 Oct 29 01:11:38.595880 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 982/1957] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:38.601346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-96f6b949-bc8e-4c8c-9d44-250c82ac813a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:38.602219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-96f6b949-bc8e-4c8c-9d44-250c82ac813a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:38.609440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96f6b949-bc8e-4c8c-9d44-250c82ac813a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:38.610683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96f6b949-bc8e-4c8c-9d44-250c82ac813a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:38.611235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96f6b949-bc8e-4c8c-9d44-250c82ac813a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:38.612052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96f6b949-bc8e-4c8c-9d44-250c82ac813a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:38.612579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96f6b949-bc8e-4c8c-9d44-250c82ac813a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:38.613065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96f6b949-bc8e-4c8c-9d44-250c82ac813a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:38.741931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5b9ecf8d-2c9b-45ab-a7a8-6b4daf42a8fe tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:38.750301 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5b9ecf8d-2c9b-45ab-a7a8-6b4daf42a8fe tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1493 microversion: 2.1 time: 0.309012 Oct 29 01:11:38.750877 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 976/1958] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:38 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1493 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:38.788132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-96f6b949-bc8e-4c8c-9d44-250c82ac813a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:38.797562 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-96f6b949-bc8e-4c8c-9d44-250c82ac813a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.200450 Oct 29 01:11:38.811394 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 983/1959] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:38 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:38.897747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-224c03ef-582f-428c-a11f-0f0c0e075cc8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:38.898378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-224c03ef-582f-428c-a11f-0f0c0e075cc8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:38.905080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-224c03ef-582f-428c-a11f-0f0c0e075cc8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:38.905653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-224c03ef-582f-428c-a11f-0f0c0e075cc8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:38.905850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-224c03ef-582f-428c-a11f-0f0c0e075cc8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:38.906511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-224c03ef-582f-428c-a11f-0f0c0e075cc8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:38.907580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-224c03ef-582f-428c-a11f-0f0c0e075cc8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:38.907580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-224c03ef-582f-428c-a11f-0f0c0e075cc8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:39.065837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f6dbc5c3-4c00-44ed-a931-1edd166f60e6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:39.066466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f6dbc5c3-4c00-44ed-a931-1edd166f60e6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:39.075670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-224c03ef-582f-428c-a11f-0f0c0e075cc8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'services' on Instance uuid 2dead7b7-a0ac-4233-a0ae-ed19568a36cf {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:11:39.080158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6dbc5c3-4c00-44ed-a931-1edd166f60e6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:39.081101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6dbc5c3-4c00-44ed-a931-1edd166f60e6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:39.081675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6dbc5c3-4c00-44ed-a931-1edd166f60e6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:39.082588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6dbc5c3-4c00-44ed-a931-1edd166f60e6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:39.083120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6dbc5c3-4c00-44ed-a931-1edd166f60e6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:39.083621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6dbc5c3-4c00-44ed-a931-1edd166f60e6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:39.095932 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-224c03ef-582f-428c-a11f-0f0c0e075cc8 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1968 microversion: 2.25 time: 0.342405 Oct 29 01:11:39.096918 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 977/1960] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:38 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1968 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:39.118594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6dbc5c3-4c00-44ed-a931-1edd166f60e6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:39.119087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6dbc5c3-4c00-44ed-a931-1edd166f60e6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:39.119528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6dbc5c3-4c00-44ed-a931-1edd166f60e6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:39.119981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-f6dbc5c3-4c00-44ed-a931-1edd166f60e6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lazy-loading 'fault' on Instance uuid 0cedff71-8de0-4fb5-b294-af0c46e7e324 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:11:39.122229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cc6a34a0-90c1-4af4-aa71-508d5a8149d5 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:39.122849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cc6a34a0-90c1-4af4-aa71-508d5a8149d5 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:39.129069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc6a34a0-90c1-4af4-aa71-508d5a8149d5 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:39.129666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc6a34a0-90c1-4af4-aa71-508d5a8149d5 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:39.130234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc6a34a0-90c1-4af4-aa71-508d5a8149d5 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:39.130941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc6a34a0-90c1-4af4-aa71-508d5a8149d5 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:39.131402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc6a34a0-90c1-4af4-aa71-508d5a8149d5 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:39.131827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc6a34a0-90c1-4af4-aa71-508d5a8149d5 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:39.162945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f6dbc5c3-4c00-44ed-a931-1edd166f60e6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:39.171508 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f6dbc5c3-4c00-44ed-a931-1edd166f60e6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 200 len: 1368 microversion: 2.1 time: 0.113719 Oct 29 01:11:39.172523 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 984/1961] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:39 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 1368 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:39.263230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-cc6a34a0-90c1-4af4-aa71-508d5a8149d5 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'services' on Instance uuid 2dead7b7-a0ac-4233-a0ae-ed19568a36cf {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:11:39.276797 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cc6a34a0-90c1-4af4-aa71-508d5a8149d5 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1968 microversion: 2.25 time: 0.159034 Oct 29 01:11:39.277410 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 978/1962] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:39 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1968 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:11:39.297041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c595b71a-8ad7-4466-9af9-5e09962a6b9f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:39.297692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c595b71a-8ad7-4466-9af9-5e09962a6b9f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:39.301924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-35119e37-b310-4c0e-89bc-d95351c9a6f1 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:39.304718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c595b71a-8ad7-4466-9af9-5e09962a6b9f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:39.305234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c595b71a-8ad7-4466-9af9-5e09962a6b9f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:39.305674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c595b71a-8ad7-4466-9af9-5e09962a6b9f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:39.305903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35119e37-b310-4c0e-89bc-d95351c9a6f1 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:39.306373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c595b71a-8ad7-4466-9af9-5e09962a6b9f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:39.306501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35119e37-b310-4c0e-89bc-d95351c9a6f1 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:39.306825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c595b71a-8ad7-4466-9af9-5e09962a6b9f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:39.306938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35119e37-b310-4c0e-89bc-d95351c9a6f1 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:39.307249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c595b71a-8ad7-4466-9af9-5e09962a6b9f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:39.307618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35119e37-b310-4c0e-89bc-d95351c9a6f1 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:39.308064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35119e37-b310-4c0e-89bc-d95351c9a6f1 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:39.308494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35119e37-b310-4c0e-89bc-d95351c9a6f1 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:39.334218 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-35119e37-b310-4c0e-89bc-d95351c9a6f1 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.036033 Oct 29 01:11:39.334818 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 979/1963] 10.222.0.26 () {60 vars in 1217 bytes} [Sat Oct 29 01:11:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:11:39.347598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1edb6293-7012-454c-a290-ea0f2f6dc6b6 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862964-3", "block_migration": "auto"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:39.350242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1edb6293-7012-454c-a290-ea0f2f6dc6b6 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:39.356197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1edb6293-7012-454c-a290-ea0f2f6dc6b6 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:39.356682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1edb6293-7012-454c-a290-ea0f2f6dc6b6 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:39.357120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1edb6293-7012-454c-a290-ea0f2f6dc6b6 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:39.357841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1edb6293-7012-454c-a290-ea0f2f6dc6b6 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:39.358300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1edb6293-7012-454c-a290-ea0f2f6dc6b6 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:39.358723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1edb6293-7012-454c-a290-ea0f2f6dc6b6 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:39.383651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-1edb6293-7012-454c-a290-ea0f2f6dc6b6 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'flavor' on Instance uuid 2dead7b7-a0ac-4233-a0ae-ed19568a36cf {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:11:39.396927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1edb6293-7012-454c-a290-ea0f2f6dc6b6 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Going to try to live migrate instance to n-h2-862964-3 {{(pid=121100) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 01:11:39.442970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c595b71a-8ad7-4466-9af9-5e09962a6b9f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ba2d71e9604486bef50f7d4b8a8700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82d19d99c7e405fb679320110c9748d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:39.450688 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c595b71a-8ad7-4466-9af9-5e09962a6b9f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 200 len: 1351 microversion: 2.1 time: 0.157555 Oct 29 01:11:39.451258 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 985/1964] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:39 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 1351 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:39.467465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1c8dbc9b-2482-4b71-9924-436e9376223f tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:39.468069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1c8dbc9b-2482-4b71-9924-436e9376223f tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:39.474589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c8dbc9b-2482-4b71-9924-436e9376223f tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:39.475149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c8dbc9b-2482-4b71-9924-436e9376223f tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:39.475586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c8dbc9b-2482-4b71-9924-436e9376223f tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:39.476331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c8dbc9b-2482-4b71-9924-436e9376223f tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:39.476729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c8dbc9b-2482-4b71-9924-436e9376223f tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:39.477147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c8dbc9b-2482-4b71-9924-436e9376223f tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:39.611767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1c8dbc9b-2482-4b71-9924-436e9376223f tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:39.619625 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1c8dbc9b-2482-4b71-9924-436e9376223f tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1315 microversion: 2.1 time: 0.155792 Oct 29 01:11:39.620202 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 986/1965] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:39 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:39.776228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5c4ed3d3-2dce-4436-984a-0fe6b5d5b30c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:39.776844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5c4ed3d3-2dce-4436-984a-0fe6b5d5b30c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:39.783714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c4ed3d3-2dce-4436-984a-0fe6b5d5b30c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:39.784201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c4ed3d3-2dce-4436-984a-0fe6b5d5b30c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:39.784635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c4ed3d3-2dce-4436-984a-0fe6b5d5b30c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:39.785360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c4ed3d3-2dce-4436-984a-0fe6b5d5b30c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:39.785811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c4ed3d3-2dce-4436-984a-0fe6b5d5b30c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:39.786232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c4ed3d3-2dce-4436-984a-0fe6b5d5b30c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:39.982417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5c4ed3d3-2dce-4436-984a-0fe6b5d5b30c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:39.984956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:39.992287 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5c4ed3d3-2dce-4436-984a-0fe6b5d5b30c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1493 microversion: 2.1 time: 0.220070 Oct 29 01:11:40.004267 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 987/1966] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:39 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1493 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:40.004267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-710907e1-56c7-482e-bb33-6e708203064b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:40.004267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-710907e1-56c7-482e-bb33-6e708203064b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:40.004878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-710907e1-56c7-482e-bb33-6e708203064b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:40.005254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-710907e1-56c7-482e-bb33-6e708203064b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:40.005695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-710907e1-56c7-482e-bb33-6e708203064b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:40.007082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-710907e1-56c7-482e-bb33-6e708203064b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:40.007541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-710907e1-56c7-482e-bb33-6e708203064b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:40.007962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-710907e1-56c7-482e-bb33-6e708203064b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:40.272426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-710907e1-56c7-482e-bb33-6e708203064b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:40.287679 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-710907e1-56c7-482e-bb33-6e708203064b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.292905 Oct 29 01:11:40.288959 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 988/1967] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:39 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:40.296236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2b22e3eb-57c4-4174-8560-296cad9025de tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:40.297368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2b22e3eb-57c4-4174-8560-296cad9025de tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 0cedff71-8de0-4fb5-b294-af0c46e7e324] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:40.308604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b22e3eb-57c4-4174-8560-296cad9025de tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:40.309500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b22e3eb-57c4-4174-8560-296cad9025de tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:40.310177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b22e3eb-57c4-4174-8560-296cad9025de tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:40.311603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b22e3eb-57c4-4174-8560-296cad9025de tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:40.312048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b22e3eb-57c4-4174-8560-296cad9025de tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:40.312557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b22e3eb-57c4-4174-8560-296cad9025de tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:40.331750 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-2b22e3eb-57c4-4174-8560-296cad9025de tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] HTTP exception thrown: Instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 could not be found. Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2b22e3eb-57c4-4174-8560-296cad9025de tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Request method failure captured: Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 HTTP/1.1 Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHx4Exy0fA7yCulwEKsYTn6p0cpQn82ha3CItdadZCftDNzAtDaMNlMq5Gu4Pyq4-p2ad3gFna2zFPNvVBuznDo-GSrDXusbeJ9jMCJCUEhQ6_ac87zN9tMgl1Cwml7V7E1rI2AghgmcK5PcN2ZzLKQO85pceUd_kEQ-NlJkVriW-Lg Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 646dbadc4e9140348132e6950c885e81 Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-MigrationsAdminTest-188021266 Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/646dbadc4e9140348132e6950c885e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/646dbadc4e9140348132e6950c885e81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/646dbadc4e9140348132e6950c885e81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_646dbadc4e9140348132e6950c885e81", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-MigrationsAdminTest-188021266 Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 646dbadc4e9140348132e6950c885e81 Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-MigrationsAdminTest-188021266 Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-MigrationsAdminTest-188021266-project Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8219d81b19964408b9bc275a4457f389 Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-MigrationsAdminTest-188021266-project Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 could not be found. Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '0cedff71-8de0-4fb5-b294-af0c46e7e324'} Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 could not be found. Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 could not be found. Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:40.334431 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:40.339888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:40.339888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:40.339888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:40.339888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:11:40.339888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:11:40.339888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 could not be found. Oct 29 01:11:40.339888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:40.341542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2b22e3eb-57c4-4174-8560-296cad9025de tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Returning 404 to user: Instance 0cedff71-8de0-4fb5-b294-af0c46e7e324 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:11:40.342592 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2b22e3eb-57c4-4174-8560-296cad9025de tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324" status: 404 len: 111 microversion: 2.1 time: 0.052512 Oct 29 01:11:40.343761 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 989/1968] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:40 2022] GET /compute/v2.1/servers/0cedff71-8de0-4fb5-b294-af0c46e7e324 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:11:40.354602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b9c36c25-c0b1-4fda-9c92-178425e5c3e1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '.version_select at 0x7f9d9fe480d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:40.540401 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b9c36c25-c0b1-4fda-9c92-178425e5c3e1 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-628280039" status: 202 len: 0 microversion: 2.1 time: 0.189686 Oct 29 01:11:40.542340 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 990/1969] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 29 01:11:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-628280039 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:11:40.553277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-8efd3400-c909-4682-9ba4-df37c8b170c5 req-7354e2a2-d5a7-42d3-9dd9-e22184e199da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61cd44bc-7c52-428d-92a9-44443fd987ce", "name": "network-vif-plugged", "status": "completed", "tag": "337dc720-1980-4d9f-aeb1-6c6ad88902d3"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:40.567806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8efd3400-c909-4682-9ba4-df37c8b170c5 req-7354e2a2-d5a7-42d3-9dd9-e22184e199da service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:40.568576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8efd3400-c909-4682-9ba4-df37c8b170c5 req-7354e2a2-d5a7-42d3-9dd9-e22184e199da service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:40.569259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8efd3400-c909-4682-9ba4-df37c8b170c5 req-7354e2a2-d5a7-42d3-9dd9-e22184e199da service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:40.581549 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-8efd3400-c909-4682-9ba4-df37c8b170c5 req-7354e2a2-d5a7-42d3-9dd9-e22184e199da service nova] Creating event network-vif-plugged:337dc720-1980-4d9f-aeb1-6c6ad88902d3 for instance 61cd44bc-7c52-428d-92a9-44443fd987ce on n-h2-862964-3 Oct 29 01:11:40.586574 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-8efd3400-c909-4682-9ba4-df37c8b170c5 req-7354e2a2-d5a7-42d3-9dd9-e22184e199da service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043161 Oct 29 01:11:40.587372 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 991/1970] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:40.592498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fe41b8bf-b411-4a79-b1ae-0fe725750094 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:40.593210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fe41b8bf-b411-4a79-b1ae-0fe725750094 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:40.602143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe41b8bf-b411-4a79-b1ae-0fe725750094 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:40.602143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe41b8bf-b411-4a79-b1ae-0fe725750094 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:40.602143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe41b8bf-b411-4a79-b1ae-0fe725750094 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:40.602143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe41b8bf-b411-4a79-b1ae-0fe725750094 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:40.602143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe41b8bf-b411-4a79-b1ae-0fe725750094 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:40.602143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe41b8bf-b411-4a79-b1ae-0fe725750094 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:40.974392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fe41b8bf-b411-4a79-b1ae-0fe725750094 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ba2d71e9604486bef50f7d4b8a8700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82d19d99c7e405fb679320110c9748d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:40.984262 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fe41b8bf-b411-4a79-b1ae-0fe725750094 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 200 len: 1351 microversion: 2.1 time: 0.395568 Oct 29 01:11:40.988945 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 992/1971] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:40 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 1351 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:40.990060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e03d7d87-ddb0-4acc-bda9-72cdf40f406a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:40.990782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e03d7d87-ddb0-4acc-bda9-72cdf40f406a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:40.996821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e03d7d87-ddb0-4acc-bda9-72cdf40f406a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:40.997494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e03d7d87-ddb0-4acc-bda9-72cdf40f406a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:40.998143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e03d7d87-ddb0-4acc-bda9-72cdf40f406a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:40.999126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e03d7d87-ddb0-4acc-bda9-72cdf40f406a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:40.999546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e03d7d87-ddb0-4acc-bda9-72cdf40f406a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:41.000252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e03d7d87-ddb0-4acc-bda9-72cdf40f406a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:41.239624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e03d7d87-ddb0-4acc-bda9-72cdf40f406a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:41.248268 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e03d7d87-ddb0-4acc-bda9-72cdf40f406a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1315 microversion: 2.1 time: 0.262263 Oct 29 01:11:41.248857 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 993/1972] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:40 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:41.254097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3a83fdbc-9f65-4ddd-8f4a-f1aab5f3e3cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:41.254711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3a83fdbc-9f65-4ddd-8f4a-f1aab5f3e3cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:41.260973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a83fdbc-9f65-4ddd-8f4a-f1aab5f3e3cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:41.261465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a83fdbc-9f65-4ddd-8f4a-f1aab5f3e3cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:41.261905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a83fdbc-9f65-4ddd-8f4a-f1aab5f3e3cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:41.262610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a83fdbc-9f65-4ddd-8f4a-f1aab5f3e3cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:41.263070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a83fdbc-9f65-4ddd-8f4a-f1aab5f3e3cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:41.263509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a83fdbc-9f65-4ddd-8f4a-f1aab5f3e3cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:41.375212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3a83fdbc-9f65-4ddd-8f4a-f1aab5f3e3cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:41.389686 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3a83fdbc-9f65-4ddd-8f4a-f1aab5f3e3cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1451 microversion: 2.1 time: 0.138990 Oct 29 01:11:41.390824 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 994/1973] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:41 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1451 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:41.398090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8928d19a-855a-4c07-bf70-981918e9f2e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:41.403505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8928d19a-855a-4c07-bf70-981918e9f2e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:41.409420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8928d19a-855a-4c07-bf70-981918e9f2e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:41.410052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8928d19a-855a-4c07-bf70-981918e9f2e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:41.410597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8928d19a-855a-4c07-bf70-981918e9f2e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:41.411596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8928d19a-855a-4c07-bf70-981918e9f2e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:41.412185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8928d19a-855a-4c07-bf70-981918e9f2e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:41.412738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8928d19a-855a-4c07-bf70-981918e9f2e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:41.689565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8928d19a-855a-4c07-bf70-981918e9f2e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:41.698023 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8928d19a-855a-4c07-bf70-981918e9f2e4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.304602 Oct 29 01:11:41.698602 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 995/1974] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:41 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:41.716569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-7df2be4f-ae1f-4140-9368-28e0ede7d014 req-12068967-cbb9-4eb1-acbb-4dde4f6fb290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b3a48e-461b-4552-9d73-03c22ae8ce57", "tag": "c9db3590-6f4f-460a-9dd4-a1d9d701e0e5"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:41.726465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7df2be4f-ae1f-4140-9368-28e0ede7d014 req-12068967-cbb9-4eb1-acbb-4dde4f6fb290 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:41.726940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7df2be4f-ae1f-4140-9368-28e0ede7d014 req-12068967-cbb9-4eb1-acbb-4dde4f6fb290 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:41.727406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7df2be4f-ae1f-4140-9368-28e0ede7d014 req-12068967-cbb9-4eb1-acbb-4dde4f6fb290 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:41.738329 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-7df2be4f-ae1f-4140-9368-28e0ede7d014 req-12068967-cbb9-4eb1-acbb-4dde4f6fb290 service nova] Creating event network-changed:c9db3590-6f4f-460a-9dd4-a1d9d701e0e5 for instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 on n-h1-862964-3 Oct 29 01:11:41.743188 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-7df2be4f-ae1f-4140-9368-28e0ede7d014 req-12068967-cbb9-4eb1-acbb-4dde4f6fb290 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030342 Oct 29 01:11:41.744387 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 996/1975] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:41.749892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f5a96cc1-56d6-427f-a648-d4524f25933c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:41.750158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f5a96cc1-56d6-427f-a648-d4524f25933c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:41.757909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5a96cc1-56d6-427f-a648-d4524f25933c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:41.758414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5a96cc1-56d6-427f-a648-d4524f25933c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:41.760350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5a96cc1-56d6-427f-a648-d4524f25933c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:41.760350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5a96cc1-56d6-427f-a648-d4524f25933c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:41.760350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5a96cc1-56d6-427f-a648-d4524f25933c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:41.760700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5a96cc1-56d6-427f-a648-d4524f25933c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:41.788859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f5a96cc1-56d6-427f-a648-d4524f25933c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:11:42.134722 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f5a96cc1-56d6-427f-a648-d4524f25933c tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 204 len: 0 microversion: 2.1 time: 0.389076 Oct 29 01:11:42.135392 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 997/1976] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:11:41 2022] DELETE /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:11:42.140899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9649cb27-543d-4f85-b6aa-65f85625a8cf tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:42.141617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9649cb27-543d-4f85-b6aa-65f85625a8cf tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:42.148256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9649cb27-543d-4f85-b6aa-65f85625a8cf tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:42.148730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9649cb27-543d-4f85-b6aa-65f85625a8cf tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:42.149184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9649cb27-543d-4f85-b6aa-65f85625a8cf tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:42.149876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9649cb27-543d-4f85-b6aa-65f85625a8cf tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:42.150324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9649cb27-543d-4f85-b6aa-65f85625a8cf tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:42.150756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9649cb27-543d-4f85-b6aa-65f85625a8cf tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:42.206754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:42.292444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9649cb27-543d-4f85-b6aa-65f85625a8cf tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ba2d71e9604486bef50f7d4b8a8700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82d19d99c7e405fb679320110c9748d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:42.300812 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9649cb27-543d-4f85-b6aa-65f85625a8cf tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 200 len: 1351 microversion: 2.1 time: 0.164110 Oct 29 01:11:42.301529 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 998/1977] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:42 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 1351 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:42.305934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c03a2c08-e529-435b-a056-f57a4c72059f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:42.306537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c03a2c08-e529-435b-a056-f57a4c72059f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:42.313585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c03a2c08-e529-435b-a056-f57a4c72059f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:42.314126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c03a2c08-e529-435b-a056-f57a4c72059f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:42.314645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c03a2c08-e529-435b-a056-f57a4c72059f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:42.315344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c03a2c08-e529-435b-a056-f57a4c72059f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:42.315852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c03a2c08-e529-435b-a056-f57a4c72059f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:42.316281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c03a2c08-e529-435b-a056-f57a4c72059f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:42.454983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c03a2c08-e529-435b-a056-f57a4c72059f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:42.462828 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c03a2c08-e529-435b-a056-f57a4c72059f tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1468 microversion: 2.1 time: 0.160317 Oct 29 01:11:42.463416 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 999/1978] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:42 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1468 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:42.468734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-610658be-78bf-4bf2-9a58-fa9416c50adb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:42.469639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-610658be-78bf-4bf2-9a58-fa9416c50adb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:42.476202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-610658be-78bf-4bf2-9a58-fa9416c50adb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:42.476738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-610658be-78bf-4bf2-9a58-fa9416c50adb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:42.477205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-610658be-78bf-4bf2-9a58-fa9416c50adb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:42.477907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-610658be-78bf-4bf2-9a58-fa9416c50adb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:42.478366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-610658be-78bf-4bf2-9a58-fa9416c50adb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:42.482082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-610658be-78bf-4bf2-9a58-fa9416c50adb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:42.613507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-610658be-78bf-4bf2-9a58-fa9416c50adb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:42.621342 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-610658be-78bf-4bf2-9a58-fa9416c50adb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1315 microversion: 2.1 time: 0.156185 Oct 29 01:11:42.621928 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1000/1979] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:42 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:42.627008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7cbbd82a-7ab0-400e-be87-b71fb90dd863 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:42.627620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7cbbd82a-7ab0-400e-be87-b71fb90dd863 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:42.633602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7cbbd82a-7ab0-400e-be87-b71fb90dd863 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:42.634087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7cbbd82a-7ab0-400e-be87-b71fb90dd863 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:42.634526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7cbbd82a-7ab0-400e-be87-b71fb90dd863 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:42.635222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7cbbd82a-7ab0-400e-be87-b71fb90dd863 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:42.635680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7cbbd82a-7ab0-400e-be87-b71fb90dd863 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:42.636106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7cbbd82a-7ab0-400e-be87-b71fb90dd863 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:42.669360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7cbbd82a-7ab0-400e-be87-b71fb90dd863 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:42.669360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7cbbd82a-7ab0-400e-be87-b71fb90dd863 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:42.669755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7cbbd82a-7ab0-400e-be87-b71fb90dd863 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:42.670219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-7cbbd82a-7ab0-400e-be87-b71fb90dd863 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lazy-loading 'fault' on Instance uuid 11ab5390-0016-48c1-a83a-3afad408b332 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:11:42.716320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7cbbd82a-7ab0-400e-be87-b71fb90dd863 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:42.724735 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7cbbd82a-7ab0-400e-be87-b71fb90dd863 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1305 microversion: 2.1 time: 0.101834 Oct 29 01:11:42.725463 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1001/1980] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:42 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:42.730312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4aec1f23-e5eb-4b86-972d-6a9525ebf430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:42.730906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4aec1f23-e5eb-4b86-972d-6a9525ebf430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:42.737252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4aec1f23-e5eb-4b86-972d-6a9525ebf430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:42.737734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4aec1f23-e5eb-4b86-972d-6a9525ebf430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:42.738336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4aec1f23-e5eb-4b86-972d-6a9525ebf430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:42.739142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4aec1f23-e5eb-4b86-972d-6a9525ebf430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:42.739590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4aec1f23-e5eb-4b86-972d-6a9525ebf430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:42.740012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4aec1f23-e5eb-4b86-972d-6a9525ebf430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:42.780240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=20 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:42.894593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4aec1f23-e5eb-4b86-972d-6a9525ebf430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:42.903279 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4aec1f23-e5eb-4b86-972d-6a9525ebf430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.176617 Oct 29 01:11:42.903869 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1002/1981] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:42 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:43.324221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-492557f4-f7b5-439e-95fc-db116623abe9 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:43.324901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-492557f4-f7b5-439e-95fc-db116623abe9 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:43.334106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-492557f4-f7b5-439e-95fc-db116623abe9 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:43.334600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-492557f4-f7b5-439e-95fc-db116623abe9 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:43.335039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-492557f4-f7b5-439e-95fc-db116623abe9 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:43.335750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-492557f4-f7b5-439e-95fc-db116623abe9 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:43.336207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-492557f4-f7b5-439e-95fc-db116623abe9 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:43.336644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-492557f4-f7b5-439e-95fc-db116623abe9 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:43.490202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-492557f4-f7b5-439e-95fc-db116623abe9 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ba2d71e9604486bef50f7d4b8a8700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82d19d99c7e405fb679320110c9748d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:43.497870 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-492557f4-f7b5-439e-95fc-db116623abe9 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 200 len: 1351 microversion: 2.1 time: 0.177732 Oct 29 01:11:43.498435 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1003/1982] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:43 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 1351 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:43.508023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ab5c97e1-8eaa-474a-8331-87ac29bd0e46 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:43.508634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ab5c97e1-8eaa-474a-8331-87ac29bd0e46 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:43.514753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab5c97e1-8eaa-474a-8331-87ac29bd0e46 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:43.515230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab5c97e1-8eaa-474a-8331-87ac29bd0e46 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:43.515663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab5c97e1-8eaa-474a-8331-87ac29bd0e46 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:43.516362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab5c97e1-8eaa-474a-8331-87ac29bd0e46 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:43.518020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab5c97e1-8eaa-474a-8331-87ac29bd0e46 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:43.518482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab5c97e1-8eaa-474a-8331-87ac29bd0e46 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:43.649228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ab5c97e1-8eaa-474a-8331-87ac29bd0e46 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:43.657105 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ab5c97e1-8eaa-474a-8331-87ac29bd0e46 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1468 microversion: 2.1 time: 0.157722 Oct 29 01:11:43.657871 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1004/1983] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:43 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1468 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:43.662318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-017579d8-e5e8-4caa-a2cb-b3a7bc568651 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:43.662951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-017579d8-e5e8-4caa-a2cb-b3a7bc568651 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:43.668799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-017579d8-e5e8-4caa-a2cb-b3a7bc568651 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:43.669314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-017579d8-e5e8-4caa-a2cb-b3a7bc568651 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:43.669754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-017579d8-e5e8-4caa-a2cb-b3a7bc568651 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:43.670469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-017579d8-e5e8-4caa-a2cb-b3a7bc568651 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:43.670907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-017579d8-e5e8-4caa-a2cb-b3a7bc568651 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:43.671330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-017579d8-e5e8-4caa-a2cb-b3a7bc568651 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:43.687155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:43.804427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-017579d8-e5e8-4caa-a2cb-b3a7bc568651 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:43.812377 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-017579d8-e5e8-4caa-a2cb-b3a7bc568651 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1315 microversion: 2.1 time: 0.153541 Oct 29 01:11:43.812943 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1005/1984] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:43 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:43.818559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8568b53c-4927-4f5e-8bc7-1d2d34cec653 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:43.819168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8568b53c-4927-4f5e-8bc7-1d2d34cec653 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:43.820806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:43.825552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8568b53c-4927-4f5e-8bc7-1d2d34cec653 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:43.831420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8568b53c-4927-4f5e-8bc7-1d2d34cec653 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:43.831420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8568b53c-4927-4f5e-8bc7-1d2d34cec653 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:43.831420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8568b53c-4927-4f5e-8bc7-1d2d34cec653 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:43.831420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8568b53c-4927-4f5e-8bc7-1d2d34cec653 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:43.831420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8568b53c-4927-4f5e-8bc7-1d2d34cec653 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:43.862078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8568b53c-4927-4f5e-8bc7-1d2d34cec653 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:43.862554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8568b53c-4927-4f5e-8bc7-1d2d34cec653 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:43.862988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8568b53c-4927-4f5e-8bc7-1d2d34cec653 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:43.863431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-8568b53c-4927-4f5e-8bc7-1d2d34cec653 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lazy-loading 'fault' on Instance uuid 11ab5390-0016-48c1-a83a-3afad408b332 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:11:43.906676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8568b53c-4927-4f5e-8bc7-1d2d34cec653 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:43.915224 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8568b53c-4927-4f5e-8bc7-1d2d34cec653 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 200 len: 1305 microversion: 2.1 time: 0.101213 Oct 29 01:11:43.916043 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1006/1985] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:43 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:43.920411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-61d09693-09e7-47c1-8482-983219d1aaf1 req-e8cd48ac-4155-4732-a488-d1a702b287e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11ab5390-0016-48c1-a83a-3afad408b332", "name": "network-vif-deleted", "tag": "cce6d768-b86a-4d3f-b53d-62029a7a06cf"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:43.935270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-61d09693-09e7-47c1-8482-983219d1aaf1 req-e8cd48ac-4155-4732-a488-d1a702b287e7 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:43.935748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-61d09693-09e7-47c1-8482-983219d1aaf1 req-e8cd48ac-4155-4732-a488-d1a702b287e7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:43.936182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-61d09693-09e7-47c1-8482-983219d1aaf1 req-e8cd48ac-4155-4732-a488-d1a702b287e7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:43.947821 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-61d09693-09e7-47c1-8482-983219d1aaf1 req-e8cd48ac-4155-4732-a488-d1a702b287e7 service nova] Creating event network-vif-deleted:cce6d768-b86a-4d3f-b53d-62029a7a06cf for instance 11ab5390-0016-48c1-a83a-3afad408b332 on n-h1-862964-3 Oct 29 01:11:43.952959 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-61d09693-09e7-47c1-8482-983219d1aaf1 req-e8cd48ac-4155-4732-a488-d1a702b287e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035820 Oct 29 01:11:43.953594 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1007/1986] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:43.958588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-27876e95-c23d-47bf-af62-796cfe3a5bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:43.959285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-27876e95-c23d-47bf-af62-796cfe3a5bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:43.965390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27876e95-c23d-47bf-af62-796cfe3a5bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:43.965875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27876e95-c23d-47bf-af62-796cfe3a5bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:43.966309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27876e95-c23d-47bf-af62-796cfe3a5bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:43.967003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27876e95-c23d-47bf-af62-796cfe3a5bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:43.967460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27876e95-c23d-47bf-af62-796cfe3a5bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:43.967886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27876e95-c23d-47bf-af62-796cfe3a5bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:44.169983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-27876e95-c23d-47bf-af62-796cfe3a5bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:44.179262 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-27876e95-c23d-47bf-af62-796cfe3a5bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.224492 Oct 29 01:11:44.179836 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1008/1987] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:43 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:44.523517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c3a849ce-0e4c-45d1-89ed-d6a699c0b29f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:44.524405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c3a849ce-0e4c-45d1-89ed-d6a699c0b29f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:44.533673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3a849ce-0e4c-45d1-89ed-d6a699c0b29f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:44.534439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3a849ce-0e4c-45d1-89ed-d6a699c0b29f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:44.534984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3a849ce-0e4c-45d1-89ed-d6a699c0b29f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:44.535770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3a849ce-0e4c-45d1-89ed-d6a699c0b29f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:44.536548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3a849ce-0e4c-45d1-89ed-d6a699c0b29f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:44.537476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3a849ce-0e4c-45d1-89ed-d6a699c0b29f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:44.701676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c3a849ce-0e4c-45d1-89ed-d6a699c0b29f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ba2d71e9604486bef50f7d4b8a8700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82d19d99c7e405fb679320110c9748d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:44.710830 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c3a849ce-0e4c-45d1-89ed-d6a699c0b29f tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 200 len: 1542 microversion: 2.1 time: 0.191955 Oct 29 01:11:44.729748 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1009/1988] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:44 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 1542 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:44.735102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-db335e21-3fad-43ef-aac3-89f883e5425d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:44.736065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-db335e21-3fad-43ef-aac3-89f883e5425d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:44.743341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db335e21-3fad-43ef-aac3-89f883e5425d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:44.743855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db335e21-3fad-43ef-aac3-89f883e5425d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:44.744300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db335e21-3fad-43ef-aac3-89f883e5425d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:44.745006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db335e21-3fad-43ef-aac3-89f883e5425d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:44.745607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db335e21-3fad-43ef-aac3-89f883e5425d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:44.746038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db335e21-3fad-43ef-aac3-89f883e5425d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:44.874727 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1edb6293-7012-454c-a290-ea0f2f6dc6b6 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf/action" status: 202 len: 0 microversion: 2.25 time: 5.531168 Oct 29 01:11:44.880430 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 980/1989] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 29 01:11:39 2022] POST /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf/action => generated 0 bytes in 5537 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:11:44.885794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fa849370-94e7-4be0-8173-2db217b84279 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:44.886236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fa849370-94e7-4be0-8173-2db217b84279 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:44.894471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa849370-94e7-4be0-8173-2db217b84279 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:44.895224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa849370-94e7-4be0-8173-2db217b84279 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:44.895831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa849370-94e7-4be0-8173-2db217b84279 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:44.904036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa849370-94e7-4be0-8173-2db217b84279 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:44.904036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa849370-94e7-4be0-8173-2db217b84279 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:44.904036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa849370-94e7-4be0-8173-2db217b84279 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:45.000687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-db335e21-3fad-43ef-aac3-89f883e5425d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:45.015384 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-db335e21-3fad-43ef-aac3-89f883e5425d tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1468 microversion: 2.1 time: 0.284439 Oct 29 01:11:45.029196 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1010/1990] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:44 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1468 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:45.029196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-83c25096-9cd6-4ad3-aeb2-186ae75120f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:45.029196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-83c25096-9cd6-4ad3-aeb2-186ae75120f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:45.035530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83c25096-9cd6-4ad3-aeb2-186ae75120f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:45.035530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83c25096-9cd6-4ad3-aeb2-186ae75120f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:45.035530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83c25096-9cd6-4ad3-aeb2-186ae75120f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:45.035530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83c25096-9cd6-4ad3-aeb2-186ae75120f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:45.035530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83c25096-9cd6-4ad3-aeb2-186ae75120f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:45.035530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83c25096-9cd6-4ad3-aeb2-186ae75120f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:45.057432 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fa849370-94e7-4be0-8173-2db217b84279 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.175446 Oct 29 01:11:45.058417 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 981/1991] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:11:44 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce/os-interface => generated 285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:45.067922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4f16164b-4d11-4fba-a49f-3853e018d12b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:45.072203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4f16164b-4d11-4fba-a49f-3853e018d12b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:45.098184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f16164b-4d11-4fba-a49f-3853e018d12b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:45.098184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f16164b-4d11-4fba-a49f-3853e018d12b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:45.098184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f16164b-4d11-4fba-a49f-3853e018d12b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:45.099698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f16164b-4d11-4fba-a49f-3853e018d12b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:45.100215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f16164b-4d11-4fba-a49f-3853e018d12b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:45.100654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f16164b-4d11-4fba-a49f-3853e018d12b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:45.826483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-83c25096-9cd6-4ad3-aeb2-186ae75120f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:45.841695 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-83c25096-9cd6-4ad3-aeb2-186ae75120f9 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1315 microversion: 2.1 time: 0.823145 Oct 29 01:11:45.843135 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1011/1992] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:45 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1315 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:45.849704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3d3099fb-9b6c-4664-83c5-fb3ed038fdc3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:45.864404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3d3099fb-9b6c-4664-83c5-fb3ed038fdc3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:45.871435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4f16164b-4d11-4fba-a49f-3853e018d12b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:45.880955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4f16164b-4d11-4fba-a49f-3853e018d12b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:45.884336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d3099fb-9b6c-4664-83c5-fb3ed038fdc3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:45.884851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d3099fb-9b6c-4664-83c5-fb3ed038fdc3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:45.895789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d3099fb-9b6c-4664-83c5-fb3ed038fdc3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:45.895789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d3099fb-9b6c-4664-83c5-fb3ed038fdc3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:45.895789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d3099fb-9b6c-4664-83c5-fb3ed038fdc3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:45.895789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d3099fb-9b6c-4664-83c5-fb3ed038fdc3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:45.896304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4f16164b-4d11-4fba-a49f-3853e018d12b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:45.896304 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4f16164b-4d11-4fba-a49f-3853e018d12b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.831636 Oct 29 01:11:45.896304 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 982/1993] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:45 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:45.900256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e4c13154-36f8-46a7-aaa1-4b8a72a86761 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:45.911055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e4c13154-36f8-46a7-aaa1-4b8a72a86761 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:45.920355 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-3d3099fb-9b6c-4664-83c5-fb3ed038fdc3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance 11ab5390-0016-48c1-a83a-3afad408b332 could not be found. Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3d3099fb-9b6c-4664-83c5-fb3ed038fdc3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 HTTP/1.1 Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 11ab5390-0016-48c1-a83a-3afad408b332 could not be found. Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '11ab5390-0016-48c1-a83a-3afad408b332'} Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11ab5390-0016-48c1-a83a-3afad408b332 could not be found. Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11ab5390-0016-48c1-a83a-3afad408b332 could not be found. Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:45.922032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:45.936974 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:45.936974 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:45.936974 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:45.936974 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:11:45.936974 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:11:45.936974 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11ab5390-0016-48c1-a83a-3afad408b332 could not be found. Oct 29 01:11:45.936974 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:45.938063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e4c13154-36f8-46a7-aaa1-4b8a72a86761 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Searching by: {'deleted': False, 'project_id': '82589beab120404eac2b09ab70b5b9ab'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:11:45.938228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3d3099fb-9b6c-4664-83c5-fb3ed038fdc3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance 11ab5390-0016-48c1-a83a-3afad408b332 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:11:45.938228 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3d3099fb-9b6c-4664-83c5-fb3ed038fdc3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 404 len: 111 microversion: 2.1 time: 0.079916 Oct 29 01:11:45.938228 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1012/1994] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:45 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:11:45.939438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4c13154-36f8-46a7-aaa1-4b8a72a86761 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:45.939438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4c13154-36f8-46a7-aaa1-4b8a72a86761 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:45.939438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4c13154-36f8-46a7-aaa1-4b8a72a86761 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:45.939722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ab61759f-9046-4199-88ad-ee448971c781 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:45.939842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4c13154-36f8-46a7-aaa1-4b8a72a86761 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:45.940111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ab61759f-9046-4199-88ad-ee448971c781 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:45.940275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4c13154-36f8-46a7-aaa1-4b8a72a86761 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:45.940275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4c13154-36f8-46a7-aaa1-4b8a72a86761 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:45.942007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab61759f-9046-4199-88ad-ee448971c781 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:45.942007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab61759f-9046-4199-88ad-ee448971c781 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:45.942007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab61759f-9046-4199-88ad-ee448971c781 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:45.942792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab61759f-9046-4199-88ad-ee448971c781 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:45.944667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab61759f-9046-4199-88ad-ee448971c781 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:45.944667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab61759f-9046-4199-88ad-ee448971c781 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:45.972248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.multi_cell_list [None req-e4c13154-36f8-46a7-aaa1-4b8a72a86761 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121100) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:11:46.014193 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e4c13154-36f8-46a7-aaa1-4b8a72a86761 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.119869 Oct 29 01:11:46.015400 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 983/1995] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 29 01:11:45 2022] GET /compute/v2.1/servers => generated 344 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:46.020455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-7f1bc623-322a-4a63-8e8c-dbbb83ca987f req-40291fd4-eccb-409e-8ea0-3cd4fb6588c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f415677-47ed-437a-a567-2831f34712dc", "name": "network-vif-deleted", "tag": "7d6159a8-d4d4-4879-bf83-176011337775"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:46.030304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7f1bc623-322a-4a63-8e8c-dbbb83ca987f req-40291fd4-eccb-409e-8ea0-3cd4fb6588c2 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:46.033583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7f1bc623-322a-4a63-8e8c-dbbb83ca987f req-40291fd4-eccb-409e-8ea0-3cd4fb6588c2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:46.033583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7f1bc623-322a-4a63-8e8c-dbbb83ca987f req-40291fd4-eccb-409e-8ea0-3cd4fb6588c2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:46.044490 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-7f1bc623-322a-4a63-8e8c-dbbb83ca987f req-40291fd4-eccb-409e-8ea0-3cd4fb6588c2 service nova] Creating event network-vif-deleted:7d6159a8-d4d4-4879-bf83-176011337775 for instance 4f415677-47ed-437a-a567-2831f34712dc on n-h2-862964-3 Oct 29 01:11:46.050459 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-7f1bc623-322a-4a63-8e8c-dbbb83ca987f req-40291fd4-eccb-409e-8ea0-3cd4fb6588c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033619 Oct 29 01:11:46.051076 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 984/1996] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:46.058212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3b623b45-8744-494a-9af8-74ca321bbcb6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1641823439", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "95eff624-38bf-46e7-958c-9fcb3dae19f9"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:46.120290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-3b623b45-8744-494a-9af8-74ca321bbcb6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] validate_networks() for [('95eff624-38bf-46e7-958c-9fcb3dae19f9', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:11:46.343769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ab61759f-9046-4199-88ad-ee448971c781 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:46.354652 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ab61759f-9046-4199-88ad-ee448971c781 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.428552 Oct 29 01:11:46.356029 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1013/1997] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:45 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:46.381460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-df71cae0-69f4-4266-8bf8-57afdee486f5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:46.388825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-df71cae0-69f4-4266-8bf8-57afdee486f5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:46.390378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-df71cae0-69f4-4266-8bf8-57afdee486f5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Searching by: {'deleted': False, 'project_id': '82589beab120404eac2b09ab70b5b9ab'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:11:46.398608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df71cae0-69f4-4266-8bf8-57afdee486f5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:46.399278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df71cae0-69f4-4266-8bf8-57afdee486f5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:46.400004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df71cae0-69f4-4266-8bf8-57afdee486f5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:46.400974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df71cae0-69f4-4266-8bf8-57afdee486f5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:46.401917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df71cae0-69f4-4266-8bf8-57afdee486f5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:46.402525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df71cae0-69f4-4266-8bf8-57afdee486f5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:46.517369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-df71cae0-69f4-4266-8bf8-57afdee486f5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:11:46.649470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-df71cae0-69f4-4266-8bf8-57afdee486f5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:46.655809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df71cae0-69f4-4266-8bf8-57afdee486f5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:46.656290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df71cae0-69f4-4266-8bf8-57afdee486f5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:46.656720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df71cae0-69f4-4266-8bf8-57afdee486f5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:47.017586 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-df71cae0-69f4-4266-8bf8-57afdee486f5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 0.645348 Oct 29 01:11:47.018211 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1014/1998] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:11:46 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:47.022942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dda853a8-0ca9-4a56-9030-7cc31067a8a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:47.023546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dda853a8-0ca9-4a56-9030-7cc31067a8a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:47.029730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dda853a8-0ca9-4a56-9030-7cc31067a8a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:47.030227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dda853a8-0ca9-4a56-9030-7cc31067a8a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:47.030661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dda853a8-0ca9-4a56-9030-7cc31067a8a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:47.031349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dda853a8-0ca9-4a56-9030-7cc31067a8a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:47.031831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dda853a8-0ca9-4a56-9030-7cc31067a8a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:47.032907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dda853a8-0ca9-4a56-9030-7cc31067a8a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:47.069185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dda853a8-0ca9-4a56-9030-7cc31067a8a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:47.069756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dda853a8-0ca9-4a56-9030-7cc31067a8a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:47.070185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dda853a8-0ca9-4a56-9030-7cc31067a8a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:47.070629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-dda853a8-0ca9-4a56-9030-7cc31067a8a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lazy-loading 'fault' on Instance uuid 4f415677-47ed-437a-a567-2831f34712dc {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:11:47.123550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3b623b45-8744-494a-9af8-74ca321bbcb6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:11:47.124077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3b623b45-8744-494a-9af8-74ca321bbcb6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:11:47.124637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3b623b45-8744-494a-9af8-74ca321bbcb6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:11:47.125122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3b623b45-8744-494a-9af8-74ca321bbcb6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:11:47.125640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3b623b45-8744-494a-9af8-74ca321bbcb6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:11:47.137824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b623b45-8744-494a-9af8-74ca321bbcb6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:47.138419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b623b45-8744-494a-9af8-74ca321bbcb6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:47.138956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b623b45-8744-494a-9af8-74ca321bbcb6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:47.139793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b623b45-8744-494a-9af8-74ca321bbcb6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:47.140519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b623b45-8744-494a-9af8-74ca321bbcb6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:47.141042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b623b45-8744-494a-9af8-74ca321bbcb6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:47.164484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-3b623b45-8744-494a-9af8-74ca321bbcb6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Getting quotas for project f421c64f9b2f49ebab46d9f8a28143d6. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:11:47.168083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-3b623b45-8744-494a-9af8-74ca321bbcb6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Getting quotas for user 4ae0a54f51ad4813b312baf3a03ba172 and project f421c64f9b2f49ebab46d9f8a28143d6. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:11:47.180370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dda853a8-0ca9-4a56-9030-7cc31067a8a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:47.184830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3b623b45-8744-494a-9af8-74ca321bbcb6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:11:47.187478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3b623b45-8744-494a-9af8-74ca321bbcb6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:11:47.199693 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dda853a8-0ca9-4a56-9030-7cc31067a8a5 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 200 len: 1302 microversion: 2.1 time: 0.180375 Oct 29 01:11:47.200741 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1015/1999] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:47 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 1302 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:47.213027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b551f0b9-54d3-4f79-ba00-ae9768dec389 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:47.213673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b551f0b9-54d3-4f79-ba00-ae9768dec389 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:47.224681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b551f0b9-54d3-4f79-ba00-ae9768dec389 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:47.233622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b551f0b9-54d3-4f79-ba00-ae9768dec389 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:47.233622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b551f0b9-54d3-4f79-ba00-ae9768dec389 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:47.233622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b551f0b9-54d3-4f79-ba00-ae9768dec389 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:47.233622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b551f0b9-54d3-4f79-ba00-ae9768dec389 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:47.233622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b551f0b9-54d3-4f79-ba00-ae9768dec389 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:47.333624 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3b623b45-8744-494a-9af8-74ca321bbcb6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.281085 Oct 29 01:11:47.340654 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 985/2000] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:11:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:11:47.340654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3bd1f1ad-976d-4885-9be9-f16306fc80bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:47.340654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3bd1f1ad-976d-4885-9be9-f16306fc80bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:47.349621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bd1f1ad-976d-4885-9be9-f16306fc80bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:47.350286 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bd1f1ad-976d-4885-9be9-f16306fc80bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:47.350826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bd1f1ad-976d-4885-9be9-f16306fc80bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:47.351641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bd1f1ad-976d-4885-9be9-f16306fc80bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:47.352375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bd1f1ad-976d-4885-9be9-f16306fc80bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:47.353186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bd1f1ad-976d-4885-9be9-f16306fc80bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:47.625313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b551f0b9-54d3-4f79-ba00-ae9768dec389 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:47.633429 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b551f0b9-54d3-4f79-ba00-ae9768dec389 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1315 microversion: 2.1 time: 0.432050 Oct 29 01:11:47.634179 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1016/2001] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:47 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:47.639089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6d43aa73-67fd-4be9-835c-8ec754ecd83e tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:47.647481 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6d43aa73-67fd-4be9-835c-8ec754ecd83e tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011942 Oct 29 01:11:47.648037 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1017/2002] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:11:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:47.652968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-93b4eaff-081a-46c7-b382-db18f35c69bb tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:47.653590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-93b4eaff-081a-46c7-b382-db18f35c69bb tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:47.752439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-93b4eaff-081a-46c7-b382-db18f35c69bb tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:47.759788 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-93b4eaff-081a-46c7-b382-db18f35c69bb tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1215 microversion: 2.1 time: 0.110425 Oct 29 01:11:47.760372 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1018/2003] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:47 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1215 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:47.773291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3bd1f1ad-976d-4885-9be9-f16306fc80bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:47.773291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3bd1f1ad-976d-4885-9be9-f16306fc80bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:47.776232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3bd1f1ad-976d-4885-9be9-f16306fc80bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:47.786001 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3bd1f1ad-976d-4885-9be9-f16306fc80bd tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.441863 Oct 29 01:11:47.786001 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 986/2004] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:47 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:47.787292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-976a29f6-81b6-474e-8cbb-021b558cdf01 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:47.787292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-976a29f6-81b6-474e-8cbb-021b558cdf01 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:47.789423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-976a29f6-81b6-474e-8cbb-021b558cdf01 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:47.790089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-976a29f6-81b6-474e-8cbb-021b558cdf01 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:47.790711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-976a29f6-81b6-474e-8cbb-021b558cdf01 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:47.792015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-976a29f6-81b6-474e-8cbb-021b558cdf01 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:47.792857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-976a29f6-81b6-474e-8cbb-021b558cdf01 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:47.793335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-976a29f6-81b6-474e-8cbb-021b558cdf01 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:47.979944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-14ea6a97-9c9e-484f-8480-b2c74be70be5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:47.980731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-14ea6a97-9c9e-484f-8480-b2c74be70be5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:47.988588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-14ea6a97-9c9e-484f-8480-b2c74be70be5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:47.989546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-14ea6a97-9c9e-484f-8480-b2c74be70be5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:47.990700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-14ea6a97-9c9e-484f-8480-b2c74be70be5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:47.991623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-14ea6a97-9c9e-484f-8480-b2c74be70be5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:47.992246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-14ea6a97-9c9e-484f-8480-b2c74be70be5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:47.993054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-14ea6a97-9c9e-484f-8480-b2c74be70be5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:48.025251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:48.030994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-14ea6a97-9c9e-484f-8480-b2c74be70be5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:11:48.069859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-976a29f6-81b6-474e-8cbb-021b558cdf01 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:48.078941 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-976a29f6-81b6-474e-8cbb-021b558cdf01 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.303912 Oct 29 01:11:48.093728 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1019/2005] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:47 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:48.101361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-11bdd6db-be1b-405a-9d42-727dd6d9218c req-8e21df3c-23b1-4646-a9ab-38651d8355a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61cd44bc-7c52-428d-92a9-44443fd987ce", "tag": "337dc720-1980-4d9f-aeb1-6c6ad88902d3"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:48.111700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-11bdd6db-be1b-405a-9d42-727dd6d9218c req-8e21df3c-23b1-4646-a9ab-38651d8355a0 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:48.112463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-11bdd6db-be1b-405a-9d42-727dd6d9218c req-8e21df3c-23b1-4646-a9ab-38651d8355a0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:48.113063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-11bdd6db-be1b-405a-9d42-727dd6d9218c req-8e21df3c-23b1-4646-a9ab-38651d8355a0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:48.127529 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-11bdd6db-be1b-405a-9d42-727dd6d9218c req-8e21df3c-23b1-4646-a9ab-38651d8355a0 service nova] Creating event network-changed:337dc720-1980-4d9f-aeb1-6c6ad88902d3 for instance 61cd44bc-7c52-428d-92a9-44443fd987ce on n-h2-862964-3 Oct 29 01:11:48.132402 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-11bdd6db-be1b-405a-9d42-727dd6d9218c req-8e21df3c-23b1-4646-a9ab-38651d8355a0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037284 Oct 29 01:11:48.133006 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1020/2006] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:48.224570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a9d519eb-8976-49ff-8eba-746efe146cb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:48.225303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a9d519eb-8976-49ff-8eba-746efe146cb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 4f415677-47ed-437a-a567-2831f34712dc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:48.233283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9d519eb-8976-49ff-8eba-746efe146cb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:48.234036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9d519eb-8976-49ff-8eba-746efe146cb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:48.234666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9d519eb-8976-49ff-8eba-746efe146cb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:48.236383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9d519eb-8976-49ff-8eba-746efe146cb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:48.237284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9d519eb-8976-49ff-8eba-746efe146cb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:48.237874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9d519eb-8976-49ff-8eba-746efe146cb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:48.264973 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-a9d519eb-8976-49ff-8eba-746efe146cb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] HTTP exception thrown: Instance 4f415677-47ed-437a-a567-2831f34712dc could not be found. Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a9d519eb-8976-49ff-8eba-746efe146cb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Request method failure captured: Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc HTTP/1.1 Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHx4Exy0fA7yCulwEKsYTn6p0cpQn82ha3CItdadZCftDNzAtDaMNlMq5Gu4Pyq4-p2ad3gFna2zFPNvVBuznDo-GSrDXusbeJ9jMCJCUEhQ6_ac87zN9tMgl1Cwml7V7E1rI2AghgmcK5PcN2ZzLKQO85pceUd_kEQ-NlJkVriW-Lg Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 646dbadc4e9140348132e6950c885e81 Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-MigrationsAdminTest-188021266 Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/646dbadc4e9140348132e6950c885e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/646dbadc4e9140348132e6950c885e81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/646dbadc4e9140348132e6950c885e81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_646dbadc4e9140348132e6950c885e81", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-MigrationsAdminTest-188021266 Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 646dbadc4e9140348132e6950c885e81 Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-MigrationsAdminTest-188021266 Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-MigrationsAdminTest-188021266-project Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8219d81b19964408b9bc275a4457f389 Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-MigrationsAdminTest-188021266-project Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 4f415677-47ed-437a-a567-2831f34712dc could not be found. Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '4f415677-47ed-437a-a567-2831f34712dc'} Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f415677-47ed-437a-a567-2831f34712dc could not be found. Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f415677-47ed-437a-a567-2831f34712dc could not be found. Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:48.269197 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:48.277002 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:48.277002 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:48.277002 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:48.277002 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:11:48.277002 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:11:48.277002 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f415677-47ed-437a-a567-2831f34712dc could not be found. Oct 29 01:11:48.277002 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:48.277002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a9d519eb-8976-49ff-8eba-746efe146cb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Returning 404 to user: Instance 4f415677-47ed-437a-a567-2831f34712dc could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:11:48.277002 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a9d519eb-8976-49ff-8eba-746efe146cb6 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc" status: 404 len: 111 microversion: 2.1 time: 0.050787 Oct 29 01:11:48.279750 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1021/2007] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:48 2022] GET /compute/v2.1/servers/4f415677-47ed-437a-a567-2831f34712dc => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:11:48.284359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f882b0f7-cd12-4b8b-b67b-4694dbf6cb9e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:48.284859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f882b0f7-cd12-4b8b-b67b-4694dbf6cb9e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:48.291336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f882b0f7-cd12-4b8b-b67b-4694dbf6cb9e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:48.291804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f882b0f7-cd12-4b8b-b67b-4694dbf6cb9e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:48.292236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f882b0f7-cd12-4b8b-b67b-4694dbf6cb9e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:48.295853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f882b0f7-cd12-4b8b-b67b-4694dbf6cb9e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:48.295853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f882b0f7-cd12-4b8b-b67b-4694dbf6cb9e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:48.295853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f882b0f7-cd12-4b8b-b67b-4694dbf6cb9e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:48.623327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f882b0f7-cd12-4b8b-b67b-4694dbf6cb9e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:11:48.629592 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-14ea6a97-9c9e-484f-8480-b2c74be70be5 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "DELETE /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 204 len: 0 microversion: 2.1 time: 0.655368 Oct 29 01:11:48.631603 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 987/2008] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:11:47 2022] DELETE /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:11:48.642135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9cd06feb-78cf-4036-8343-b85c8a5e8d75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:48.643365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9cd06feb-78cf-4036-8343-b85c8a5e8d75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:48.678888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9cd06feb-78cf-4036-8343-b85c8a5e8d75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:48.679711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9cd06feb-78cf-4036-8343-b85c8a5e8d75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:48.692171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9cd06feb-78cf-4036-8343-b85c8a5e8d75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:48.694749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9cd06feb-78cf-4036-8343-b85c8a5e8d75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:48.696368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9cd06feb-78cf-4036-8343-b85c8a5e8d75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:48.697007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9cd06feb-78cf-4036-8343-b85c8a5e8d75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:48.897735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9cd06feb-78cf-4036-8343-b85c8a5e8d75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:48.906050 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9cd06feb-78cf-4036-8343-b85c8a5e8d75 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1610 microversion: 2.1 time: 0.268838 Oct 29 01:11:48.906772 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 988/2009] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:48 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1610 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:48.911708 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a599df31-bdbb-4a7f-96ed-fe5e44594e77 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:48.914137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a599df31-bdbb-4a7f-96ed-fe5e44594e77 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:48.919427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a599df31-bdbb-4a7f-96ed-fe5e44594e77 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:48.920161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a599df31-bdbb-4a7f-96ed-fe5e44594e77 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:48.920841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a599df31-bdbb-4a7f-96ed-fe5e44594e77 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:48.921823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a599df31-bdbb-4a7f-96ed-fe5e44594e77 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:48.922506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a599df31-bdbb-4a7f-96ed-fe5e44594e77 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:48.923706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a599df31-bdbb-4a7f-96ed-fe5e44594e77 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:49.081873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a599df31-bdbb-4a7f-96ed-fe5e44594e77 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:49.097856 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a599df31-bdbb-4a7f-96ed-fe5e44594e77 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1315 microversion: 2.1 time: 0.189691 Oct 29 01:11:49.112830 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 989/2010] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:48 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:49.112830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-c700ecf2-2e5b-442e-93c4-d3013a188538 req-babb571b-e7c0-4875-967d-ad01a475340f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b3a48e-461b-4552-9d73-03c22ae8ce57", "name": "network-vif-plugged", "status": "completed", "tag": "c9db3590-6f4f-460a-9dd4-a1d9d701e0e5"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:49.120953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c700ecf2-2e5b-442e-93c4-d3013a188538 req-babb571b-e7c0-4875-967d-ad01a475340f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:49.121426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c700ecf2-2e5b-442e-93c4-d3013a188538 req-babb571b-e7c0-4875-967d-ad01a475340f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:49.121911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c700ecf2-2e5b-442e-93c4-d3013a188538 req-babb571b-e7c0-4875-967d-ad01a475340f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:49.134346 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-c700ecf2-2e5b-442e-93c4-d3013a188538 req-babb571b-e7c0-4875-967d-ad01a475340f service nova] Creating event network-vif-plugged:c9db3590-6f4f-460a-9dd4-a1d9d701e0e5 for instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 on n-h1-862964-3 Oct 29 01:11:49.139493 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-c700ecf2-2e5b-442e-93c4-d3013a188538 req-babb571b-e7c0-4875-967d-ad01a475340f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038461 Oct 29 01:11:49.140153 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 990/2011] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:49.146385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5ce5affa-abc8-4d62-8233-404221826685 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:49.147096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5ce5affa-abc8-4d62-8233-404221826685 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:49.154351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ce5affa-abc8-4d62-8233-404221826685 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:49.154908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ce5affa-abc8-4d62-8233-404221826685 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:49.155375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ce5affa-abc8-4d62-8233-404221826685 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:49.156113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ce5affa-abc8-4d62-8233-404221826685 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:49.156575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ce5affa-abc8-4d62-8233-404221826685 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:49.157126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ce5affa-abc8-4d62-8233-404221826685 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:49.164273 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f882b0f7-cd12-4b8b-b67b-4694dbf6cb9e tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "DELETE /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 204 len: 0 microversion: 2.1 time: 0.883536 Oct 29 01:11:49.169423 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1022/2012] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:11:48 2022] DELETE /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 0 bytes in 885 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:11:49.176435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-76c36aa4-4fc1-431c-8ed7-26a5a279dea9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:49.177178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-76c36aa4-4fc1-431c-8ed7-26a5a279dea9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:49.183294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76c36aa4-4fc1-431c-8ed7-26a5a279dea9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:49.183779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76c36aa4-4fc1-431c-8ed7-26a5a279dea9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:49.184211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76c36aa4-4fc1-431c-8ed7-26a5a279dea9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:49.185187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76c36aa4-4fc1-431c-8ed7-26a5a279dea9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:49.185383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76c36aa4-4fc1-431c-8ed7-26a5a279dea9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:49.186047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76c36aa4-4fc1-431c-8ed7-26a5a279dea9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:49.242506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5ce5affa-abc8-4d62-8233-404221826685 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:49.250687 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5ce5affa-abc8-4d62-8233-404221826685 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1211 microversion: 2.1 time: 0.109328 Oct 29 01:11:49.251930 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 991/2013] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:49 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1211 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:49.256995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1d60b64f-b8e4-432b-b11f-fbdacfeeabe5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:49.257833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1d60b64f-b8e4-432b-b11f-fbdacfeeabe5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:49.265023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d60b64f-b8e4-432b-b11f-fbdacfeeabe5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:49.265617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d60b64f-b8e4-432b-b11f-fbdacfeeabe5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:49.266057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d60b64f-b8e4-432b-b11f-fbdacfeeabe5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:49.269360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d60b64f-b8e4-432b-b11f-fbdacfeeabe5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:49.313360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d60b64f-b8e4-432b-b11f-fbdacfeeabe5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:49.313360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d60b64f-b8e4-432b-b11f-fbdacfeeabe5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:49.526899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-76c36aa4-4fc1-431c-8ed7-26a5a279dea9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:49.526899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:49.526899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-76c36aa4-4fc1-431c-8ed7-26a5a279dea9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:49.526899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-76c36aa4-4fc1-431c-8ed7-26a5a279dea9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:49.526899 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-76c36aa4-4fc1-431c-8ed7-26a5a279dea9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.269296 Oct 29 01:11:49.526899 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1023/2014] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:49 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:49.526899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fc6604e2-4816-4171-a756-900cf673bdbc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:49.526899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fc6604e2-4816-4171-a756-900cf673bdbc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:49.526899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc6604e2-4816-4171-a756-900cf673bdbc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:49.526899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc6604e2-4816-4171-a756-900cf673bdbc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:49.526899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc6604e2-4816-4171-a756-900cf673bdbc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:49.526899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc6604e2-4816-4171-a756-900cf673bdbc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:49.528488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc6604e2-4816-4171-a756-900cf673bdbc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:49.528488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc6604e2-4816-4171-a756-900cf673bdbc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:49.529085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1d60b64f-b8e4-432b-b11f-fbdacfeeabe5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:49.529085 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1d60b64f-b8e4-432b-b11f-fbdacfeeabe5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.221051 Oct 29 01:11:49.529085 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 992/2015] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:49 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:49.587067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fc6604e2-4816-4171-a756-900cf673bdbc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:49.596667 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fc6604e2-4816-4171-a756-900cf673bdbc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1468 microversion: 2.1 time: 0.158687 Oct 29 01:11:49.597257 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1024/2016] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:49 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1468 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:49.936416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-12e4e1b5-2e4c-4fed-b1c3-65affe2d7266 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:49.937098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-12e4e1b5-2e4c-4fed-b1c3-65affe2d7266 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:49.945256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12e4e1b5-2e4c-4fed-b1c3-65affe2d7266 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:49.945776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12e4e1b5-2e4c-4fed-b1c3-65affe2d7266 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:49.946212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12e4e1b5-2e4c-4fed-b1c3-65affe2d7266 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:49.947131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12e4e1b5-2e4c-4fed-b1c3-65affe2d7266 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:49.947761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12e4e1b5-2e4c-4fed-b1c3-65affe2d7266 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:49.948189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12e4e1b5-2e4c-4fed-b1c3-65affe2d7266 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:50.092397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-12e4e1b5-2e4c-4fed-b1c3-65affe2d7266 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:50.101877 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-12e4e1b5-2e4c-4fed-b1c3-65affe2d7266 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1610 microversion: 2.1 time: 0.169684 Oct 29 01:11:50.102451 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 993/2017] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:49 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1610 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:50.125750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b140441f-8361-4bec-b33c-884fb582df66 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:50.126972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b140441f-8361-4bec-b33c-884fb582df66 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:50.133556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b140441f-8361-4bec-b33c-884fb582df66 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:50.134062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b140441f-8361-4bec-b33c-884fb582df66 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:50.134529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b140441f-8361-4bec-b33c-884fb582df66 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:50.135218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b140441f-8361-4bec-b33c-884fb582df66 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:50.135670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b140441f-8361-4bec-b33c-884fb582df66 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:50.136132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b140441f-8361-4bec-b33c-884fb582df66 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:50.275618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b140441f-8361-4bec-b33c-884fb582df66 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:50.286966 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b140441f-8361-4bec-b33c-884fb582df66 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1315 microversion: 2.1 time: 0.164488 Oct 29 01:11:50.288115 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1025/2018] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:50 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:50.319700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4210e0df-cf0f-4822-89c4-996525e7c298 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:50.320492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4210e0df-cf0f-4822-89c4-996525e7c298 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:50.327306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4210e0df-cf0f-4822-89c4-996525e7c298 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:50.330145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4210e0df-cf0f-4822-89c4-996525e7c298 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:50.330145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4210e0df-cf0f-4822-89c4-996525e7c298 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:50.330145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4210e0df-cf0f-4822-89c4-996525e7c298 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:50.330631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4210e0df-cf0f-4822-89c4-996525e7c298 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:50.331161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4210e0df-cf0f-4822-89c4-996525e7c298 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:50.430674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4210e0df-cf0f-4822-89c4-996525e7c298 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:50.438938 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4210e0df-cf0f-4822-89c4-996525e7c298 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1267 microversion: 2.1 time: 0.123792 Oct 29 01:11:50.444369 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 994/2019] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:50 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1267 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:50.471394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c2bfb706-563f-4fec-9693-96a7a1e54d74 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:50.472100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c2bfb706-563f-4fec-9693-96a7a1e54d74 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:50.487678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2bfb706-563f-4fec-9693-96a7a1e54d74 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:50.488256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2bfb706-563f-4fec-9693-96a7a1e54d74 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:50.488708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2bfb706-563f-4fec-9693-96a7a1e54d74 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:50.489813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2bfb706-563f-4fec-9693-96a7a1e54d74 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:50.490486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2bfb706-563f-4fec-9693-96a7a1e54d74 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:50.491014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2bfb706-563f-4fec-9693-96a7a1e54d74 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:50.502668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5e12e196-b461-4c46-be59-99fe40783c10 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:50.502668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5e12e196-b461-4c46-be59-99fe40783c10 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:50.506513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e12e196-b461-4c46-be59-99fe40783c10 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:50.507227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e12e196-b461-4c46-be59-99fe40783c10 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:50.507849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e12e196-b461-4c46-be59-99fe40783c10 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:50.508934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e12e196-b461-4c46-be59-99fe40783c10 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:50.509768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e12e196-b461-4c46-be59-99fe40783c10 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:50.510490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e12e196-b461-4c46-be59-99fe40783c10 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:50.726956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c2bfb706-563f-4fec-9693-96a7a1e54d74 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:50.736666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c2bfb706-563f-4fec-9693-96a7a1e54d74 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:50.738274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5e12e196-b461-4c46-be59-99fe40783c10 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:50.738495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c2bfb706-563f-4fec-9693-96a7a1e54d74 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:50.739699 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c2bfb706-563f-4fec-9693-96a7a1e54d74 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.273659 Oct 29 01:11:50.740332 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1026/2020] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:50 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:50.748040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c9cde0ba-6ea8-4ab5-b026-649610a65561 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:50.748543 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5e12e196-b461-4c46-be59-99fe40783c10 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.253498 Oct 29 01:11:50.749235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c9cde0ba-6ea8-4ab5-b026-649610a65561 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:50.749701 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 995/2021] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:50 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:50.757499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9cde0ba-6ea8-4ab5-b026-649610a65561 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:50.757990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9cde0ba-6ea8-4ab5-b026-649610a65561 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:50.758431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9cde0ba-6ea8-4ab5-b026-649610a65561 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:50.759137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9cde0ba-6ea8-4ab5-b026-649610a65561 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:50.760323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9cde0ba-6ea8-4ab5-b026-649610a65561 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:50.760760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9cde0ba-6ea8-4ab5-b026-649610a65561 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:50.907048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c9cde0ba-6ea8-4ab5-b026-649610a65561 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:50.916280 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c9cde0ba-6ea8-4ab5-b026-649610a65561 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1468 microversion: 2.1 time: 0.174068 Oct 29 01:11:50.917176 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1027/2022] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:50 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1468 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:51.127041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9b68ed17-9c7a-49fb-ae0e-82a772fa5330 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:51.127685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9b68ed17-9c7a-49fb-ae0e-82a772fa5330 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:51.134745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b68ed17-9c7a-49fb-ae0e-82a772fa5330 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:51.135233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b68ed17-9c7a-49fb-ae0e-82a772fa5330 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:51.135697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b68ed17-9c7a-49fb-ae0e-82a772fa5330 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:51.136417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b68ed17-9c7a-49fb-ae0e-82a772fa5330 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:51.136879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b68ed17-9c7a-49fb-ae0e-82a772fa5330 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:51.137353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b68ed17-9c7a-49fb-ae0e-82a772fa5330 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:51.284224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9b68ed17-9c7a-49fb-ae0e-82a772fa5330 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:51.292512 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9b68ed17-9c7a-49fb-ae0e-82a772fa5330 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1610 microversion: 2.1 time: 0.170032 Oct 29 01:11:51.293083 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 996/2023] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:51 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1610 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:51.312555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-01cc2e31-3c0b-441d-a464-53f1a17b4c00 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:51.313185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-01cc2e31-3c0b-441d-a464-53f1a17b4c00 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:51.319724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01cc2e31-3c0b-441d-a464-53f1a17b4c00 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:51.320206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01cc2e31-3c0b-441d-a464-53f1a17b4c00 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:51.320640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01cc2e31-3c0b-441d-a464-53f1a17b4c00 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:51.321363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01cc2e31-3c0b-441d-a464-53f1a17b4c00 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:51.321821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01cc2e31-3c0b-441d-a464-53f1a17b4c00 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:51.322240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01cc2e31-3c0b-441d-a464-53f1a17b4c00 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:51.463155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-01cc2e31-3c0b-441d-a464-53f1a17b4c00 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:51.472128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-99247a91-027b-441d-b251-301d6c343695 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:51.473032 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-01cc2e31-3c0b-441d-a464-53f1a17b4c00 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1315 microversion: 2.1 time: 0.164152 Oct 29 01:11:51.473032 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1028/2024] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:51 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:51.473297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-99247a91-027b-441d-b251-301d6c343695 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:51.478881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99247a91-027b-441d-b251-301d6c343695 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:51.479365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99247a91-027b-441d-b251-301d6c343695 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:51.479800 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99247a91-027b-441d-b251-301d6c343695 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:51.480527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99247a91-027b-441d-b251-301d6c343695 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:51.481023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99247a91-027b-441d-b251-301d6c343695 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:51.481480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99247a91-027b-441d-b251-301d6c343695 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:51.570214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-99247a91-027b-441d-b251-301d6c343695 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:51.579950 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-99247a91-027b-441d-b251-301d6c343695 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1267 microversion: 2.1 time: 0.111999 Oct 29 01:11:51.580640 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 997/2025] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:51 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1267 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:51.768475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-70f1ff1a-b943-4e82-8215-9eb120488daa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:51.769295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-70f1ff1a-b943-4e82-8215-9eb120488daa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:51.778311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70f1ff1a-b943-4e82-8215-9eb120488daa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:51.778962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70f1ff1a-b943-4e82-8215-9eb120488daa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:51.779672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70f1ff1a-b943-4e82-8215-9eb120488daa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:51.780622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70f1ff1a-b943-4e82-8215-9eb120488daa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:51.781367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70f1ff1a-b943-4e82-8215-9eb120488daa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:51.781657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9ab124d3-8027-4d51-82b7-6a7150768cc9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:51.782145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70f1ff1a-b943-4e82-8215-9eb120488daa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:51.783038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9ab124d3-8027-4d51-82b7-6a7150768cc9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:51.791177 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9ab124d3-8027-4d51-82b7-6a7150768cc9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:51.791665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9ab124d3-8027-4d51-82b7-6a7150768cc9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:51.792126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9ab124d3-8027-4d51-82b7-6a7150768cc9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:51.792984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9ab124d3-8027-4d51-82b7-6a7150768cc9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:51.793460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9ab124d3-8027-4d51-82b7-6a7150768cc9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:51.794110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9ab124d3-8027-4d51-82b7-6a7150768cc9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:52.074636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9ab124d3-8027-4d51-82b7-6a7150768cc9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:52.079605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-70f1ff1a-b943-4e82-8215-9eb120488daa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:52.086349 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9ab124d3-8027-4d51-82b7-6a7150768cc9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1716 microversion: 2.1 time: 0.311490 Oct 29 01:11:52.086606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-70f1ff1a-b943-4e82-8215-9eb120488daa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:52.087399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-70f1ff1a-b943-4e82-8215-9eb120488daa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:52.088581 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-70f1ff1a-b943-4e82-8215-9eb120488daa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.325212 Oct 29 01:11:52.102385 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1029/2026] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:51 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:52.105396 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 998/2027] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:51 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1716 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:52.115485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4fbaf1cb-c19a-49d6-977c-2915e49fdc1b req-2453d2e8-3316-4e2d-8326-3c3c53346da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "043b00d6-d708-4cee-a1dc-d8ca4ddcae90", "name": "network-vif-deleted", "tag": "ca5d4535-1bd9-43b8-8e8d-1d33f9053107"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:52.123201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-17841d55-8c8a-4803-bdfd-d36b5bf28650 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:52.123201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-17841d55-8c8a-4803-bdfd-d36b5bf28650 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:52.130196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17841d55-8c8a-4803-bdfd-d36b5bf28650 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:52.131391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17841d55-8c8a-4803-bdfd-d36b5bf28650 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:52.131834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17841d55-8c8a-4803-bdfd-d36b5bf28650 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:52.132548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17841d55-8c8a-4803-bdfd-d36b5bf28650 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:52.133681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17841d55-8c8a-4803-bdfd-d36b5bf28650 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:52.142516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17841d55-8c8a-4803-bdfd-d36b5bf28650 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:52.149057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4fbaf1cb-c19a-49d6-977c-2915e49fdc1b req-2453d2e8-3316-4e2d-8326-3c3c53346da5 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:52.153221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4fbaf1cb-c19a-49d6-977c-2915e49fdc1b req-2453d2e8-3316-4e2d-8326-3c3c53346da5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:52.153221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4fbaf1cb-c19a-49d6-977c-2915e49fdc1b req-2453d2e8-3316-4e2d-8326-3c3c53346da5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:52.169032 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4fbaf1cb-c19a-49d6-977c-2915e49fdc1b req-2453d2e8-3316-4e2d-8326-3c3c53346da5 service nova] Creating event network-vif-deleted:ca5d4535-1bd9-43b8-8e8d-1d33f9053107 for instance 043b00d6-d708-4cee-a1dc-d8ca4ddcae90 on n-h2-862964-3 Oct 29 01:11:52.177102 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4fbaf1cb-c19a-49d6-977c-2915e49fdc1b req-2453d2e8-3316-4e2d-8326-3c3c53346da5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073013 Oct 29 01:11:52.178524 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1030/2028] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:52.318546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-efdfc2d8-fb8f-4412-8c58-61f6fb8ae616 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:52.318546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-efdfc2d8-fb8f-4412-8c58-61f6fb8ae616 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:52.327475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efdfc2d8-fb8f-4412-8c58-61f6fb8ae616 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:52.328273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efdfc2d8-fb8f-4412-8c58-61f6fb8ae616 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:52.328711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efdfc2d8-fb8f-4412-8c58-61f6fb8ae616 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:52.329587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efdfc2d8-fb8f-4412-8c58-61f6fb8ae616 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:52.330050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efdfc2d8-fb8f-4412-8c58-61f6fb8ae616 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:52.330477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efdfc2d8-fb8f-4412-8c58-61f6fb8ae616 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:52.480021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-efdfc2d8-fb8f-4412-8c58-61f6fb8ae616 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:52.488768 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-efdfc2d8-fb8f-4412-8c58-61f6fb8ae616 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1253 microversion: 2.1 time: 0.176505 Oct 29 01:11:52.504553 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1031/2029] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:52 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1253 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:52.510318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cc9f1f64-28a0-416c-a0b9-476217d95ebf tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:52.511231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cc9f1f64-28a0-416c-a0b9-476217d95ebf tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:52.520040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc9f1f64-28a0-416c-a0b9-476217d95ebf tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:52.522228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc9f1f64-28a0-416c-a0b9-476217d95ebf tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:52.522228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc9f1f64-28a0-416c-a0b9-476217d95ebf tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:52.522228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc9f1f64-28a0-416c-a0b9-476217d95ebf tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:52.523046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc9f1f64-28a0-416c-a0b9-476217d95ebf tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:52.523661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc9f1f64-28a0-416c-a0b9-476217d95ebf tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:52.588855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-17841d55-8c8a-4803-bdfd-d36b5bf28650 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:52.602004 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-17841d55-8c8a-4803-bdfd-d36b5bf28650 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1468 microversion: 2.1 time: 0.495429 Oct 29 01:11:52.613249 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 999/2030] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:52 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1468 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:52.613249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-666294d2-f0c9-426c-a03e-6fd1ea8f2336 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:52.613249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-666294d2-f0c9-426c-a03e-6fd1ea8f2336 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:52.616961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:52.619124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-666294d2-f0c9-426c-a03e-6fd1ea8f2336 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:52.620273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-666294d2-f0c9-426c-a03e-6fd1ea8f2336 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:52.620998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-666294d2-f0c9-426c-a03e-6fd1ea8f2336 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:52.622253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-666294d2-f0c9-426c-a03e-6fd1ea8f2336 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:52.622934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-666294d2-f0c9-426c-a03e-6fd1ea8f2336 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:52.623625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-666294d2-f0c9-426c-a03e-6fd1ea8f2336 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:52.776920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-666294d2-f0c9-426c-a03e-6fd1ea8f2336 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:52.790441 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-666294d2-f0c9-426c-a03e-6fd1ea8f2336 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1285 microversion: 2.1 time: 0.185194 Oct 29 01:11:52.796054 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1000/2031] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:52 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1285 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:52.848847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cc9f1f64-28a0-416c-a0b9-476217d95ebf tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:52.857031 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cc9f1f64-28a0-416c-a0b9-476217d95ebf tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1503 microversion: 2.1 time: 0.351061 Oct 29 01:11:52.868369 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1032/2032] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:52 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1503 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:52.899269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d010fc1-65a2-40be-aea7-9df6d1b4b869 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-561700661"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:52.900174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7d010fc1-65a2-40be-aea7-9df6d1b4b869 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:52.913087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d010fc1-65a2-40be-aea7-9df6d1b4b869 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:52.913750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d010fc1-65a2-40be-aea7-9df6d1b4b869 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:52.914203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d010fc1-65a2-40be-aea7-9df6d1b4b869 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:52.915280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d010fc1-65a2-40be-aea7-9df6d1b4b869 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:52.915743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d010fc1-65a2-40be-aea7-9df6d1b4b869 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:52.916424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d010fc1-65a2-40be-aea7-9df6d1b4b869 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:53.113846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e92bd8f1-7a67-4846-8a88-0fd14f420e39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:53.114946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e92bd8f1-7a67-4846-8a88-0fd14f420e39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:53.122277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e92bd8f1-7a67-4846-8a88-0fd14f420e39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:53.123354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e92bd8f1-7a67-4846-8a88-0fd14f420e39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:53.123892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e92bd8f1-7a67-4846-8a88-0fd14f420e39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:53.125042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e92bd8f1-7a67-4846-8a88-0fd14f420e39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:53.125534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e92bd8f1-7a67-4846-8a88-0fd14f420e39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:53.126645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e92bd8f1-7a67-4846-8a88-0fd14f420e39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:53.133601 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.network.security_group_api [None req-7d010fc1-65a2-40be-aea7-9df6d1b4b869 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Adding security group 54db7ceb-0313-4240-9bc5-709b1a0b438c to port c9db3590-6f4f-460a-9dd4-a1d9d701e0e5 Oct 29 01:11:53.565308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e92bd8f1-7a67-4846-8a88-0fd14f420e39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:53.576206 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e92bd8f1-7a67-4846-8a88-0fd14f420e39 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1706 microversion: 2.1 time: 0.468038 Oct 29 01:11:53.577322 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1033/2033] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:53 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1706 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:53.584361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d8a5ec9e-3e98-4943-b6cd-a52b3d7ad2b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:53.584971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d8a5ec9e-3e98-4943-b6cd-a52b3d7ad2b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:53.591842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8a5ec9e-3e98-4943-b6cd-a52b3d7ad2b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:53.601541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8a5ec9e-3e98-4943-b6cd-a52b3d7ad2b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:53.601541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8a5ec9e-3e98-4943-b6cd-a52b3d7ad2b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:53.601541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8a5ec9e-3e98-4943-b6cd-a52b3d7ad2b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:53.601541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8a5ec9e-3e98-4943-b6cd-a52b3d7ad2b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:53.601541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8a5ec9e-3e98-4943-b6cd-a52b3d7ad2b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:53.950676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d8a5ec9e-3e98-4943-b6cd-a52b3d7ad2b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:53.961597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d8a5ec9e-3e98-4943-b6cd-a52b3d7ad2b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:53.963431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d8a5ec9e-3e98-4943-b6cd-a52b3d7ad2b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:53.965392 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d8a5ec9e-3e98-4943-b6cd-a52b3d7ad2b0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.385109 Oct 29 01:11:53.966319 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1034/2034] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:53 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:53.972655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-a6e3c4ce-db83-4e06-bd8a-d466989565a0 req-05b69758-bcf7-4f16-ac87-6ecc00824e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65c62cb3-ec7c-43fa-9840-1c0fef87ae15", "name": "network-vif-deleted", "tag": "edbb0f10-da6d-409d-8978-de8280afa7df"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:53.986557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a6e3c4ce-db83-4e06-bd8a-d466989565a0 req-05b69758-bcf7-4f16-ac87-6ecc00824e96 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:53.987110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a6e3c4ce-db83-4e06-bd8a-d466989565a0 req-05b69758-bcf7-4f16-ac87-6ecc00824e96 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:53.987613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a6e3c4ce-db83-4e06-bd8a-d466989565a0 req-05b69758-bcf7-4f16-ac87-6ecc00824e96 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:54.003182 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-a6e3c4ce-db83-4e06-bd8a-d466989565a0 req-05b69758-bcf7-4f16-ac87-6ecc00824e96 service nova] Creating event network-vif-deleted:edbb0f10-da6d-409d-8978-de8280afa7df for instance 65c62cb3-ec7c-43fa-9840-1c0fef87ae15 on n-h1-862964-3 Oct 29 01:11:54.008403 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-a6e3c4ce-db83-4e06-bd8a-d466989565a0 req-05b69758-bcf7-4f16-ac87-6ecc00824e96 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040525 Oct 29 01:11:54.009394 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1035/2035] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:54.020148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ae9307ce-39a2-4050-9b59-527c47196e94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:54.020852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ae9307ce-39a2-4050-9b59-527c47196e94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:54.028826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae9307ce-39a2-4050-9b59-527c47196e94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:54.029681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae9307ce-39a2-4050-9b59-527c47196e94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:54.030317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae9307ce-39a2-4050-9b59-527c47196e94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:54.031279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae9307ce-39a2-4050-9b59-527c47196e94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:54.031978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae9307ce-39a2-4050-9b59-527c47196e94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:54.032719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae9307ce-39a2-4050-9b59-527c47196e94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:54.108327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ae9307ce-39a2-4050-9b59-527c47196e94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:54.118873 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ae9307ce-39a2-4050-9b59-527c47196e94 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1253 microversion: 2.1 time: 0.108291 Oct 29 01:11:54.119471 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1036/2036] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:54 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1253 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:54.124007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7d9adf7d-eb69-445b-b187-5a8361a18bf3 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '.version_select at 0x7f9d9ff16670>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:54.127762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d9adf7d-eb69-445b-b187-5a8361a18bf3 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:54.128374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d9adf7d-eb69-445b-b187-5a8361a18bf3 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:54.128823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d9adf7d-eb69-445b-b187-5a8361a18bf3 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:54.140975 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7d9adf7d-eb69-445b-b187-5a8361a18bf3 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 3096 microversion: 2.1 time: 0.020515 Oct 29 01:11:54.142240 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1037/2037] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 29 01:11:54 2022] GET /compute/v2.1/os-migrations => generated 3096 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:54.147163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-895f09d8-b5d6-4495-86bc-fb240d91be32 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:54.147779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-895f09d8-b5d6-4495-86bc-fb240d91be32 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:54.153559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-895f09d8-b5d6-4495-86bc-fb240d91be32 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:54.154091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-895f09d8-b5d6-4495-86bc-fb240d91be32 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:54.154526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-895f09d8-b5d6-4495-86bc-fb240d91be32 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:54.155223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-895f09d8-b5d6-4495-86bc-fb240d91be32 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:54.155811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-895f09d8-b5d6-4495-86bc-fb240d91be32 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:54.156244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-895f09d8-b5d6-4495-86bc-fb240d91be32 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:54.193073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-895f09d8-b5d6-4495-86bc-fb240d91be32 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:54.193599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-895f09d8-b5d6-4495-86bc-fb240d91be32 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:54.194139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-895f09d8-b5d6-4495-86bc-fb240d91be32 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:54.194596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-895f09d8-b5d6-4495-86bc-fb240d91be32 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lazy-loading 'fault' on Instance uuid 65c62cb3-ec7c-43fa-9840-1c0fef87ae15 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:11:54.210076 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7d010fc1-65a2-40be-aea7-9df6d1b4b869 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "POST /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57/action" status: 202 len: 0 microversion: 2.1 time: 1.319231 Oct 29 01:11:54.211817 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1001/2038] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:11:52 2022] POST /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57/action => generated 0 bytes in 1321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:11:54.216545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c36938cf-8682-402f-b56c-2ceb766c82ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:54.217181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c36938cf-8682-402f-b56c-2ceb766c82ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:54.226579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c36938cf-8682-402f-b56c-2ceb766c82ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:54.227374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c36938cf-8682-402f-b56c-2ceb766c82ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:54.228060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c36938cf-8682-402f-b56c-2ceb766c82ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:54.229012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c36938cf-8682-402f-b56c-2ceb766c82ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:54.229699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c36938cf-8682-402f-b56c-2ceb766c82ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:54.230332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c36938cf-8682-402f-b56c-2ceb766c82ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:54.279538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-895f09d8-b5d6-4495-86bc-fb240d91be32 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219d81b19964408b9bc275a4457f389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646dbadc4e9140348132e6950c885e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:54.288010 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-895f09d8-b5d6-4495-86bc-fb240d91be32 tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 200 len: 1302 microversion: 2.1 time: 0.144640 Oct 29 01:11:54.301743 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1038/2039] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:54 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 1302 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:54.311370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-84fb2391-2a0f-48b2-8329-47af246e4180 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:54.312187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-84fb2391-2a0f-48b2-8329-47af246e4180 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:54.319160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84fb2391-2a0f-48b2-8329-47af246e4180 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:54.319675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84fb2391-2a0f-48b2-8329-47af246e4180 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:54.320619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84fb2391-2a0f-48b2-8329-47af246e4180 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:54.331628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84fb2391-2a0f-48b2-8329-47af246e4180 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:54.332331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84fb2391-2a0f-48b2-8329-47af246e4180 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:54.334844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84fb2391-2a0f-48b2-8329-47af246e4180 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:54.771124 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-84fb2391-2a0f-48b2-8329-47af246e4180 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1857 microversion: 2.1 time: 0.450617 Oct 29 01:11:54.775519 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1039/2040] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:54 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1857 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:54.780633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c28c91ef-e489-4e42-819d-7f990503b667 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d9716aa60>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:54.838678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c36938cf-8682-402f-b56c-2ceb766c82ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:54.848700 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c36938cf-8682-402f-b56c-2ceb766c82ce tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1315 microversion: 2.1 time: 0.635797 Oct 29 01:11:54.869372 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1002/2041] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:54 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1315 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:54.884927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b2e88394-63a9-4d45-8363-dee8bd3a5400 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:54.887518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b2e88394-63a9-4d45-8363-dee8bd3a5400 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:54.904443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2e88394-63a9-4d45-8363-dee8bd3a5400 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:54.904938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2e88394-63a9-4d45-8363-dee8bd3a5400 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:54.907740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2e88394-63a9-4d45-8363-dee8bd3a5400 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:54.912033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2e88394-63a9-4d45-8363-dee8bd3a5400 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:54.914272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2e88394-63a9-4d45-8363-dee8bd3a5400 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:54.921835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2e88394-63a9-4d45-8363-dee8bd3a5400 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:54.926129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:55.195115 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b2e88394-63a9-4d45-8363-dee8bd3a5400 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1857 microversion: 2.1 time: 0.320751 Oct 29 01:11:55.196029 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1003/2042] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:54 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1857 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:55.232341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c4170c0d-0c68-4f4a-b908-265e8f36f9cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:55.235723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c4170c0d-0c68-4f4a-b908-265e8f36f9cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:55.242440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4170c0d-0c68-4f4a-b908-265e8f36f9cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:55.243819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4170c0d-0c68-4f4a-b908-265e8f36f9cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:55.244484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4170c0d-0c68-4f4a-b908-265e8f36f9cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:55.245489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4170c0d-0c68-4f4a-b908-265e8f36f9cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:55.246160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4170c0d-0c68-4f4a-b908-265e8f36f9cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:55.246797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4170c0d-0c68-4f4a-b908-265e8f36f9cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:55.301901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG neutronclient.v2_0.client [None req-c28c91ef-e489-4e42-819d-7f990503b667 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 54db7ceb-0313-4240-9bc5-709b1a0b438c in use.", "detail": ""}} {{(pid=121099) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:11:55.302870 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-c28c91ef-e489-4e42-819d-7f990503b667 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] HTTP exception thrown: Security Group 54db7ceb-0313-4240-9bc5-709b1a0b438c in use. Oct 29 01:11:55.302870 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-6e37b46c-f427-4624-8c26-770c95fa0359'] Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c28c91ef-e489-4e42-819d-7f990503b667 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Request method failure captured: Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/os-security-groups/54db7ceb-0313-4240-9bc5-709b1a0b438c HTTP/1.1 Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH2dSOm6Gvr_7yReO_KK4LyiJmxHEpSHznGvK-Vwrpwo4GWP7Ab5YXTZuGsu1pNtwHZhTwV9418WfJZZN41caWcz_If-orG4TOArgMozy0kdFl7uiee1-gBfdA2Tv8rwYvLMwbreSpyPQ3JrbABZf0uK1xwJ_TuKV00PeAfDDKvVrXo Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_294bcfcd48fb4cf3b3744e74498a9f73", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f6e18fc75c774452bcc89f4cb817e545 Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: exception: Security Group 54db7ceb-0313-4240-9bc5-709b1a0b438c in use. Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-6e37b46c-f427-4624-8c26-770c95fa0359'] Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '54db7ceb-0313-4240-9bc5-709b1a0b438c'} Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:11:55.315297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 54db7ceb-0313-4240-9bc5-709b1a0b438c in use. Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e37b46c-f427-4624-8c26-770c95fa0359'] Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 54db7ceb-0313-4240-9bc5-709b1a0b438c in use. Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e37b46c-f427-4624-8c26-770c95fa0359'] Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 54db7ceb-0313-4240-9bc5-709b1a0b438c in use. Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e37b46c-f427-4624-8c26-770c95fa0359'] Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 54db7ceb-0313-4240-9bc5-709b1a0b438c in use. Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e37b46c-f427-4624-8c26-770c95fa0359'] Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c28c91ef-e489-4e42-819d-7f990503b667 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Returning 400 to user: Security Group 54db7ceb-0313-4240-9bc5-709b1a0b438c in use. Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-6e37b46c-f427-4624-8c26-770c95fa0359'] {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:11:55.324938 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c28c91ef-e489-4e42-819d-7f990503b667 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/54db7ceb-0313-4240-9bc5-709b1a0b438c" status: 400 len: 185 microversion: 2.1 time: 0.546952 Oct 29 01:11:55.328552 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1040/2043] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:11:54 2022] DELETE /compute/v2.1/os-security-groups/54db7ceb-0313-4240-9bc5-709b1a0b438c => generated 185 bytes in 549 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:11:55.332177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1afb5300-0e31-4b10-bc91-fe42c148bd2d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:55.332858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1afb5300-0e31-4b10-bc91-fe42c148bd2d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:55.340800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1afb5300-0e31-4b10-bc91-fe42c148bd2d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:55.341738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1afb5300-0e31-4b10-bc91-fe42c148bd2d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:55.347021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1afb5300-0e31-4b10-bc91-fe42c148bd2d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:55.347021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1afb5300-0e31-4b10-bc91-fe42c148bd2d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:55.347021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1afb5300-0e31-4b10-bc91-fe42c148bd2d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:55.347761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1afb5300-0e31-4b10-bc91-fe42c148bd2d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:55.466855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1afb5300-0e31-4b10-bc91-fe42c148bd2d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:55.479185 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1afb5300-0e31-4b10-bc91-fe42c148bd2d tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1253 microversion: 2.1 time: 0.152412 Oct 29 01:11:55.483013 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1041/2044] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:55 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1253 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:55.488410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a38ab599-37a5-4d84-91de-31d5b52bbefc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:55.489908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a38ab599-37a5-4d84-91de-31d5b52bbefc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] [instance: 65c62cb3-ec7c-43fa-9840-1c0fef87ae15] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:55.497769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a38ab599-37a5-4d84-91de-31d5b52bbefc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:55.498422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a38ab599-37a5-4d84-91de-31d5b52bbefc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:55.499000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a38ab599-37a5-4d84-91de-31d5b52bbefc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:55.499820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a38ab599-37a5-4d84-91de-31d5b52bbefc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:55.500426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a38ab599-37a5-4d84-91de-31d5b52bbefc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:55.503198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a38ab599-37a5-4d84-91de-31d5b52bbefc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:55.507816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c4170c0d-0c68-4f4a-b908-265e8f36f9cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:55.522845 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-a38ab599-37a5-4d84-91de-31d5b52bbefc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] HTTP exception thrown: Instance 65c62cb3-ec7c-43fa-9840-1c0fef87ae15 could not be found. Oct 29 01:11:55.524447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c4170c0d-0c68-4f4a-b908-265e8f36f9cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a38ab599-37a5-4d84-91de-31d5b52bbefc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Request method failure captured: Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 HTTP/1.1 Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHx4Exy0fA7yCulwEKsYTn6p0cpQn82ha3CItdadZCftDNzAtDaMNlMq5Gu4Pyq4-p2ad3gFna2zFPNvVBuznDo-GSrDXusbeJ9jMCJCUEhQ6_ac87zN9tMgl1Cwml7V7E1rI2AghgmcK5PcN2ZzLKQO85pceUd_kEQ-NlJkVriW-Lg Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 646dbadc4e9140348132e6950c885e81 Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-MigrationsAdminTest-188021266 Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/646dbadc4e9140348132e6950c885e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/646dbadc4e9140348132e6950c885e81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/646dbadc4e9140348132e6950c885e81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_646dbadc4e9140348132e6950c885e81", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-MigrationsAdminTest-188021266 Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 646dbadc4e9140348132e6950c885e81 Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-MigrationsAdminTest-188021266 Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-MigrationsAdminTest-188021266-project Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8219d81b19964408b9bc275a4457f389 Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-MigrationsAdminTest-188021266-project Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 65c62cb3-ec7c-43fa-9840-1c0fef87ae15 could not be found. Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '65c62cb3-ec7c-43fa-9840-1c0fef87ae15'} Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65c62cb3-ec7c-43fa-9840-1c0fef87ae15 could not be found. Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65c62cb3-ec7c-43fa-9840-1c0fef87ae15 could not be found. Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:11:55.525050 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:55.530751 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:11:55.530751 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:11:55.530751 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:11:55.530751 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:11:55.530751 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:11:55.530751 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65c62cb3-ec7c-43fa-9840-1c0fef87ae15 could not be found. Oct 29 01:11:55.530751 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:11:55.530751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a38ab599-37a5-4d84-91de-31d5b52bbefc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] Returning 404 to user: Instance 65c62cb3-ec7c-43fa-9840-1c0fef87ae15 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:11:55.533323 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a38ab599-37a5-4d84-91de-31d5b52bbefc tempest-MigrationsAdminTest-188021266 tempest-MigrationsAdminTest-188021266-project] 10.222.0.26 "GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15" status: 404 len: 111 microversion: 2.1 time: 0.050211 Oct 29 01:11:55.533609 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1042/2045] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:55 2022] GET /compute/v2.1/servers/65c62cb3-ec7c-43fa-9840-1c0fef87ae15 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:11:55.537259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c4170c0d-0c68-4f4a-b908-265e8f36f9cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:55.542296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6d4de3c7-a0be-47b4-9241-d02ea7b6cb5d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:55.542804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6d4de3c7-a0be-47b4-9241-d02ea7b6cb5d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:55.543324 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c4170c0d-0c68-4f4a-b908-265e8f36f9cb tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.332681 Oct 29 01:11:55.543916 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1004/2046] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:55 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:55.550348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3c22d07f-c06a-4d1f-bedc-adc5b7af42f6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:55.553915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3c22d07f-c06a-4d1f-bedc-adc5b7af42f6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:55.561499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c22d07f-c06a-4d1f-bedc-adc5b7af42f6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:55.564958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c22d07f-c06a-4d1f-bedc-adc5b7af42f6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:55.565677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c22d07f-c06a-4d1f-bedc-adc5b7af42f6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:55.567025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c22d07f-c06a-4d1f-bedc-adc5b7af42f6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:55.567876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d4de3c7-a0be-47b4-9241-d02ea7b6cb5d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:55.568389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d4de3c7-a0be-47b4-9241-d02ea7b6cb5d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:55.568826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d4de3c7-a0be-47b4-9241-d02ea7b6cb5d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:55.569558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d4de3c7-a0be-47b4-9241-d02ea7b6cb5d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:55.570018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d4de3c7-a0be-47b4-9241-d02ea7b6cb5d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:55.570437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d4de3c7-a0be-47b4-9241-d02ea7b6cb5d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:55.570840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c22d07f-c06a-4d1f-bedc-adc5b7af42f6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:55.572488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c22d07f-c06a-4d1f-bedc-adc5b7af42f6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:55.888680 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3c22d07f-c06a-4d1f-bedc-adc5b7af42f6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "POST /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57/action" status: 202 len: 0 microversion: 2.1 time: 0.342195 Oct 29 01:11:55.895904 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1005/2047] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:11:55 2022] POST /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:11:55.911147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-20d45cf5-e716-4913-9cd7-5f425a57ae7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:55.911147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-20d45cf5-e716-4913-9cd7-5f425a57ae7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:55.919621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20d45cf5-e716-4913-9cd7-5f425a57ae7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:55.920483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20d45cf5-e716-4913-9cd7-5f425a57ae7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:55.921693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20d45cf5-e716-4913-9cd7-5f425a57ae7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:55.923219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20d45cf5-e716-4913-9cd7-5f425a57ae7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:55.924242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20d45cf5-e716-4913-9cd7-5f425a57ae7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:55.925731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20d45cf5-e716-4913-9cd7-5f425a57ae7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:56.221878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-20d45cf5-e716-4913-9cd7-5f425a57ae7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:56.230559 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-20d45cf5-e716-4913-9cd7-5f425a57ae7d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1315 microversion: 2.1 time: 0.332040 Oct 29 01:11:56.242608 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1006/2048] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:55 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:56.254889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bef7aded-8740-4618-98b9-c2ee54da368e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:56.255725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bef7aded-8740-4618-98b9-c2ee54da368e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:56.266904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bef7aded-8740-4618-98b9-c2ee54da368e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:56.267972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bef7aded-8740-4618-98b9-c2ee54da368e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:56.268607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bef7aded-8740-4618-98b9-c2ee54da368e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:56.269557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bef7aded-8740-4618-98b9-c2ee54da368e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:56.270195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bef7aded-8740-4618-98b9-c2ee54da368e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:56.270790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bef7aded-8740-4618-98b9-c2ee54da368e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:56.459205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:56.951570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bef7aded-8740-4618-98b9-c2ee54da368e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:56.959683 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bef7aded-8740-4618-98b9-c2ee54da368e tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1573 microversion: 2.1 time: 0.711592 Oct 29 01:11:56.960290 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1007/2049] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:56 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1573 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:56.965306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-54223912-3418-4ea7-81c1-784ae0d86e9d req-7049f6a6-d570-4f67-b199-d8dd8ad44bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b3a48e-461b-4552-9d73-03c22ae8ce57", "tag": "c9db3590-6f4f-460a-9dd4-a1d9d701e0e5"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:56.978345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-54223912-3418-4ea7-81c1-784ae0d86e9d req-7049f6a6-d570-4f67-b199-d8dd8ad44bc3 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:56.978830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-54223912-3418-4ea7-81c1-784ae0d86e9d req-7049f6a6-d570-4f67-b199-d8dd8ad44bc3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:56.979269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-54223912-3418-4ea7-81c1-784ae0d86e9d req-7049f6a6-d570-4f67-b199-d8dd8ad44bc3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:56.993959 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-54223912-3418-4ea7-81c1-784ae0d86e9d req-7049f6a6-d570-4f67-b199-d8dd8ad44bc3 service nova] Creating event network-changed:c9db3590-6f4f-460a-9dd4-a1d9d701e0e5 for instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 on n-h1-862964-3 Oct 29 01:11:57.000475 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-54223912-3418-4ea7-81c1-784ae0d86e9d req-7049f6a6-d570-4f67-b199-d8dd8ad44bc3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038647 Oct 29 01:11:57.004375 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1008/2050] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:57.008750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f6ba29b3-67fe-48c6-acb7-d9c77baa8b02 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:57.023313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f6ba29b3-67fe-48c6-acb7-d9c77baa8b02 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:57.039952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6ba29b3-67fe-48c6-acb7-d9c77baa8b02 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:57.039952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6ba29b3-67fe-48c6-acb7-d9c77baa8b02 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:57.039952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6ba29b3-67fe-48c6-acb7-d9c77baa8b02 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:57.039952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6ba29b3-67fe-48c6-acb7-d9c77baa8b02 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:57.039952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6ba29b3-67fe-48c6-acb7-d9c77baa8b02 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:57.039952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6ba29b3-67fe-48c6-acb7-d9c77baa8b02 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:57.150580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:57.162925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f6ba29b3-67fe-48c6-acb7-d9c77baa8b02 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:57.175088 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f6ba29b3-67fe-48c6-acb7-d9c77baa8b02 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1253 microversion: 2.1 time: 0.172458 Oct 29 01:11:57.177321 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1009/2051] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:57 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1253 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:57.186111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-315a4d1b-b1e2-4092-a8c4-e9e794a0c013 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:57.187763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-315a4d1b-b1e2-4092-a8c4-e9e794a0c013 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:57.191132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:57.194689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-315a4d1b-b1e2-4092-a8c4-e9e794a0c013 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:57.198431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-315a4d1b-b1e2-4092-a8c4-e9e794a0c013 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:57.198431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-315a4d1b-b1e2-4092-a8c4-e9e794a0c013 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:57.198431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-315a4d1b-b1e2-4092-a8c4-e9e794a0c013 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:57.198431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-315a4d1b-b1e2-4092-a8c4-e9e794a0c013 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:57.198431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-315a4d1b-b1e2-4092-a8c4-e9e794a0c013 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:57.562498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-315a4d1b-b1e2-4092-a8c4-e9e794a0c013 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:57.572512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-315a4d1b-b1e2-4092-a8c4-e9e794a0c013 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:57.577135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-315a4d1b-b1e2-4092-a8c4-e9e794a0c013 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:57.585431 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-315a4d1b-b1e2-4092-a8c4-e9e794a0c013 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.402735 Oct 29 01:11:57.587945 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1010/2052] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:57 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:57.596236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e8e2e075-252f-4c7e-b79f-4fb72544de57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:57.597291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e8e2e075-252f-4c7e-b79f-4fb72544de57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:57.604573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8e2e075-252f-4c7e-b79f-4fb72544de57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:57.605381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8e2e075-252f-4c7e-b79f-4fb72544de57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:57.606035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8e2e075-252f-4c7e-b79f-4fb72544de57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:57.607289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8e2e075-252f-4c7e-b79f-4fb72544de57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:57.607927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8e2e075-252f-4c7e-b79f-4fb72544de57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:57.608535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8e2e075-252f-4c7e-b79f-4fb72544de57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:57.728952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:57.728952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-6d4de3c7-a0be-47b4-9241-d02ea7b6cb5d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lazy-loading 'services' on Instance uuid b8914c05-5333-46a4-8930-90cb1a93e5eb {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:11:57.810765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:11:58.055149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e8e2e075-252f-4c7e-b79f-4fb72544de57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:58.068717 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e8e2e075-252f-4c7e-b79f-4fb72544de57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1315 microversion: 2.1 time: 0.477301 Oct 29 01:11:58.069237 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1011/2053] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:57 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:58.076485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bf361209-48ca-4a1e-8a67-28810312c298 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:58.077136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bf361209-48ca-4a1e-8a67-28810312c298 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:58.091759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf361209-48ca-4a1e-8a67-28810312c298 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:58.093095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf361209-48ca-4a1e-8a67-28810312c298 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:58.093913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf361209-48ca-4a1e-8a67-28810312c298 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:58.095507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf361209-48ca-4a1e-8a67-28810312c298 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:58.096620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf361209-48ca-4a1e-8a67-28810312c298 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:58.097287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf361209-48ca-4a1e-8a67-28810312c298 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:58.318207 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6d4de3c7-a0be-47b4-9241-d02ea7b6cb5d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments/814e5035-9fc1-4730-b0ce-5ffe0a49ca56" status: 202 len: 0 microversion: 2.1 time: 2.783264 Oct 29 01:11:58.322178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bf361209-48ca-4a1e-8a67-28810312c298 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:58.324953 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1043/2054] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 29 01:11:55 2022] DELETE /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments/814e5035-9fc1-4730-b0ce-5ffe0a49ca56 => generated 0 bytes in 2791 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:11:58.342756 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bf361209-48ca-4a1e-8a67-28810312c298 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1578 microversion: 2.1 time: 0.272321 Oct 29 01:11:58.343345 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1012/2055] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:58 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1578 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:58.345334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7a539d6a-d9ea-415f-96af-64899405805f tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:58.346054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7a539d6a-d9ea-415f-96af-64899405805f tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:58.364448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-60bc3fd4-4afa-4081-8af9-95de34bc3ab8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:58.369634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a539d6a-d9ea-415f-96af-64899405805f tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:58.373200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a539d6a-d9ea-415f-96af-64899405805f tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:58.373933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a539d6a-d9ea-415f-96af-64899405805f tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:58.375656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a539d6a-d9ea-415f-96af-64899405805f tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:58.376704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a539d6a-d9ea-415f-96af-64899405805f tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:58.377135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a539d6a-d9ea-415f-96af-64899405805f tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:58.381251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-60bc3fd4-4afa-4081-8af9-95de34bc3ab8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:58.406787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60bc3fd4-4afa-4081-8af9-95de34bc3ab8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:58.408227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60bc3fd4-4afa-4081-8af9-95de34bc3ab8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:58.408856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60bc3fd4-4afa-4081-8af9-95de34bc3ab8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:58.409927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60bc3fd4-4afa-4081-8af9-95de34bc3ab8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:58.410608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60bc3fd4-4afa-4081-8af9-95de34bc3ab8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:58.411229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60bc3fd4-4afa-4081-8af9-95de34bc3ab8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:58.475974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a539d6a-d9ea-415f-96af-64899405805f tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:58.476793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a539d6a-d9ea-415f-96af-64899405805f tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:58.477739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a539d6a-d9ea-415f-96af-64899405805f tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:58.477899 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-60bc3fd4-4afa-4081-8af9-95de34bc3ab8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121089 Oct 29 01:11:58.478573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-7a539d6a-d9ea-415f-96af-64899405805f tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lazy-loading 'fault' on Instance uuid 043b00d6-d708-4cee-a1dc-d8ca4ddcae90 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:11:58.478778 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1013/2056] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:11:58 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:58.559965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7a539d6a-d9ea-415f-96af-64899405805f tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:58.571841 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7a539d6a-d9ea-415f-96af-64899405805f tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1258 microversion: 2.1 time: 0.245459 Oct 29 01:11:58.574285 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1044/2057] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:58 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1258 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:58.619364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b2423cc8-cfde-4d5f-bcc0-5f20d41ddee3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:58.619993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b2423cc8-cfde-4d5f-bcc0-5f20d41ddee3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:58.631782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2423cc8-cfde-4d5f-bcc0-5f20d41ddee3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:58.633693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2423cc8-cfde-4d5f-bcc0-5f20d41ddee3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:58.634142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2423cc8-cfde-4d5f-bcc0-5f20d41ddee3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:58.635020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2423cc8-cfde-4d5f-bcc0-5f20d41ddee3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:58.635469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2423cc8-cfde-4d5f-bcc0-5f20d41ddee3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:58.635903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2423cc8-cfde-4d5f-bcc0-5f20d41ddee3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:58.820074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b2423cc8-cfde-4d5f-bcc0-5f20d41ddee3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:58.832109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b2423cc8-cfde-4d5f-bcc0-5f20d41ddee3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:58.834076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b2423cc8-cfde-4d5f-bcc0-5f20d41ddee3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:58.835599 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b2423cc8-cfde-4d5f-bcc0-5f20d41ddee3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.220952 Oct 29 01:11:58.836167 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1014/2058] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:58 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:11:59.027654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4fb9868f-4994-4a0b-9b6d-ca9cfdbf2973 req-6a4b8ff1-fc21-4abf-8c1e-bf97166d8a31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0fe24cf-adf2-440f-bc90-819416f0da85", "tag": "668338a4-a4ff-4907-96e5-1efd14961ac4"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:59.044138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4fb9868f-4994-4a0b-9b6d-ca9cfdbf2973 req-6a4b8ff1-fc21-4abf-8c1e-bf97166d8a31 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:59.046156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4fb9868f-4994-4a0b-9b6d-ca9cfdbf2973 req-6a4b8ff1-fc21-4abf-8c1e-bf97166d8a31 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:59.046156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4fb9868f-4994-4a0b-9b6d-ca9cfdbf2973 req-6a4b8ff1-fc21-4abf-8c1e-bf97166d8a31 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:59.058386 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4fb9868f-4994-4a0b-9b6d-ca9cfdbf2973 req-6a4b8ff1-fc21-4abf-8c1e-bf97166d8a31 service nova] Creating event network-changed:668338a4-a4ff-4907-96e5-1efd14961ac4 for instance b0fe24cf-adf2-440f-bc90-819416f0da85 on n-h1-862964-3 Oct 29 01:11:59.063169 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4fb9868f-4994-4a0b-9b6d-ca9cfdbf2973 req-6a4b8ff1-fc21-4abf-8c1e-bf97166d8a31 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040514 Oct 29 01:11:59.069425 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1045/2059] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:59.092070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-392c3544-a3df-4090-bef2-92679f42328a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:59.092734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-392c3544-a3df-4090-bef2-92679f42328a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:59.100230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-392c3544-a3df-4090-bef2-92679f42328a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:59.100715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-392c3544-a3df-4090-bef2-92679f42328a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:59.101149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-392c3544-a3df-4090-bef2-92679f42328a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:59.101878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-392c3544-a3df-4090-bef2-92679f42328a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:59.102325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-392c3544-a3df-4090-bef2-92679f42328a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:59.102774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-392c3544-a3df-4090-bef2-92679f42328a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:59.244831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-392c3544-a3df-4090-bef2-92679f42328a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:59.253613 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-392c3544-a3df-4090-bef2-92679f42328a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1315 microversion: 2.1 time: 0.165537 Oct 29 01:11:59.254467 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1015/2060] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:59 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:59.371783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-679ddc61-892d-44a1-9bd5-770feef36c11 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:59.372432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-679ddc61-892d-44a1-9bd5-770feef36c11 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:59.380869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-679ddc61-892d-44a1-9bd5-770feef36c11 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:59.381546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-679ddc61-892d-44a1-9bd5-770feef36c11 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:59.382199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-679ddc61-892d-44a1-9bd5-770feef36c11 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:59.382941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-679ddc61-892d-44a1-9bd5-770feef36c11 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:59.383630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-679ddc61-892d-44a1-9bd5-770feef36c11 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:59.384735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-679ddc61-892d-44a1-9bd5-770feef36c11 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:59.496377 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5c80a1e9-2b1b-40b4-8c9e-aa41411bf895 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:59.499837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5c80a1e9-2b1b-40b4-8c9e-aa41411bf895 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:59.511149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c80a1e9-2b1b-40b4-8c9e-aa41411bf895 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:59.512165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c80a1e9-2b1b-40b4-8c9e-aa41411bf895 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:59.512914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c80a1e9-2b1b-40b4-8c9e-aa41411bf895 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:59.513931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c80a1e9-2b1b-40b4-8c9e-aa41411bf895 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:59.514605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c80a1e9-2b1b-40b4-8c9e-aa41411bf895 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:59.517950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c80a1e9-2b1b-40b4-8c9e-aa41411bf895 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:59.558598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-679ddc61-892d-44a1-9bd5-770feef36c11 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:59.570266 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-679ddc61-892d-44a1-9bd5-770feef36c11 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1571 microversion: 2.1 time: 0.204612 Oct 29 01:11:59.576086 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5c80a1e9-2b1b-40b4-8c9e-aa41411bf895 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087804 Oct 29 01:11:59.577588 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1046/2061] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:59 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1571 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:11:59.581083 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1016/2062] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:11:59 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:11:59.601411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-94b6be81-b2f5-4d13-8879-b64f6c8ad544 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1961793319"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:11:59.606719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-94b6be81-b2f5-4d13-8879-b64f6c8ad544 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:59.606874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9120c0ea-2c93-4f39-9ffc-bc3a5ff124b0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:59.606874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9120c0ea-2c93-4f39-9ffc-bc3a5ff124b0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:59.614581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94b6be81-b2f5-4d13-8879-b64f6c8ad544 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:59.614794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9120c0ea-2c93-4f39-9ffc-bc3a5ff124b0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:59.615257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9120c0ea-2c93-4f39-9ffc-bc3a5ff124b0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:59.615660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94b6be81-b2f5-4d13-8879-b64f6c8ad544 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:59.616009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9120c0ea-2c93-4f39-9ffc-bc3a5ff124b0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:59.616455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94b6be81-b2f5-4d13-8879-b64f6c8ad544 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:59.617005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9120c0ea-2c93-4f39-9ffc-bc3a5ff124b0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:59.617534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94b6be81-b2f5-4d13-8879-b64f6c8ad544 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:59.617698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9120c0ea-2c93-4f39-9ffc-bc3a5ff124b0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:59.618212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9120c0ea-2c93-4f39-9ffc-bc3a5ff124b0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:59.618489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94b6be81-b2f5-4d13-8879-b64f6c8ad544 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:59.619072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94b6be81-b2f5-4d13-8879-b64f6c8ad544 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:59.678899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9120c0ea-2c93-4f39-9ffc-bc3a5ff124b0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:59.679470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9120c0ea-2c93-4f39-9ffc-bc3a5ff124b0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:59.680110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9120c0ea-2c93-4f39-9ffc-bc3a5ff124b0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:59.680878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-9120c0ea-2c93-4f39-9ffc-bc3a5ff124b0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lazy-loading 'fault' on Instance uuid 043b00d6-d708-4cee-a1dc-d8ca4ddcae90 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:11:59.745399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9120c0ea-2c93-4f39-9ffc-bc3a5ff124b0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a2a21861641dc9ac061e1a8ba5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82589beab120404eac2b09ab70b5b9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:11:59.766241 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9120c0ea-2c93-4f39-9ffc-bc3a5ff124b0 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 200 len: 1258 microversion: 2.1 time: 0.170943 Oct 29 01:11:59.767577 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1017/2063] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:11:59 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:11:59.789246 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.network.security_group_api [None req-94b6be81-b2f5-4d13-8879-b64f6c8ad544 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Adding security group c654ac84-64b7-4e88-bce7-0856dce2f880 to port c9db3590-6f4f-460a-9dd4-a1d9d701e0e5 Oct 29 01:11:59.862008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-08ae7d0c-ed6f-44c3-8108-21c4b6b4a781 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:11:59.872056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-08ae7d0c-ed6f-44c3-8108-21c4b6b4a781 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:11:59.873008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08ae7d0c-ed6f-44c3-8108-21c4b6b4a781 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:59.873539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08ae7d0c-ed6f-44c3-8108-21c4b6b4a781 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:59.875394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08ae7d0c-ed6f-44c3-8108-21c4b6b4a781 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:11:59.877000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08ae7d0c-ed6f-44c3-8108-21c4b6b4a781 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:11:59.878612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08ae7d0c-ed6f-44c3-8108-21c4b6b4a781 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:11:59.880290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08ae7d0c-ed6f-44c3-8108-21c4b6b4a781 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:00.113434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-08ae7d0c-ed6f-44c3-8108-21c4b6b4a781 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:00.128330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-08ae7d0c-ed6f-44c3-8108-21c4b6b4a781 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:00.129886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-08ae7d0c-ed6f-44c3-8108-21c4b6b4a781 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:00.131378 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-08ae7d0c-ed6f-44c3-8108-21c4b6b4a781 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.273910 Oct 29 01:12:00.133206 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1018/2064] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:11:59 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:12:00.277276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ed76ba6f-b018-4a8e-b47c-b452355c181a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:00.278071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ed76ba6f-b018-4a8e-b47c-b452355c181a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:00.285402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed76ba6f-b018-4a8e-b47c-b452355c181a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:00.285937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed76ba6f-b018-4a8e-b47c-b452355c181a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:00.286589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed76ba6f-b018-4a8e-b47c-b452355c181a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:00.287332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed76ba6f-b018-4a8e-b47c-b452355c181a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:00.287829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed76ba6f-b018-4a8e-b47c-b452355c181a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:00.288262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed76ba6f-b018-4a8e-b47c-b452355c181a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:00.293361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:00.395244 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-94b6be81-b2f5-4d13-8879-b64f6c8ad544 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "POST /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57/action" status: 202 len: 0 microversion: 2.1 time: 0.790443 Oct 29 01:12:00.395244 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1047/2065] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:11:59 2022] POST /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57/action => generated 0 bytes in 792 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:12:00.401007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dc62fc48-d0e9-4590-a7c4-48268965f067 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d9715ac10>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:00.532592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ed76ba6f-b018-4a8e-b47c-b452355c181a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:00.544478 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ed76ba6f-b018-4a8e-b47c-b452355c181a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1315 microversion: 2.1 time: 0.270918 Oct 29 01:12:00.545243 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1019/2066] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:00 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:00.588960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ed2dc635-ee84-43fc-ae99-3b0f208e726f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:00.591417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ed2dc635-ee84-43fc-ae99-3b0f208e726f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:00.601952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed2dc635-ee84-43fc-ae99-3b0f208e726f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:00.605881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed2dc635-ee84-43fc-ae99-3b0f208e726f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:00.605881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed2dc635-ee84-43fc-ae99-3b0f208e726f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:00.605881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed2dc635-ee84-43fc-ae99-3b0f208e726f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:00.608580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed2dc635-ee84-43fc-ae99-3b0f208e726f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:00.609073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed2dc635-ee84-43fc-ae99-3b0f208e726f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:00.684266 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ed2dc635-ee84-43fc-ae99-3b0f208e726f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099656 Oct 29 01:12:00.685928 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1020/2067] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:12:00 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:00.763781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG neutronclient.v2_0.client [None req-dc62fc48-d0e9-4590-a7c4-48268965f067 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group c654ac84-64b7-4e88-bce7-0856dce2f880 in use.", "detail": ""}} {{(pid=121099) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:12:00.764688 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-dc62fc48-d0e9-4590-a7c4-48268965f067 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] HTTP exception thrown: Security Group c654ac84-64b7-4e88-bce7-0856dce2f880 in use. Oct 29 01:12:00.764688 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-0ab47a92-a9d7-4523-a3fa-7857fef9efb8'] Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dc62fc48-d0e9-4590-a7c4-48268965f067 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Request method failure captured: Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/os-security-groups/c654ac84-64b7-4e88-bce7-0856dce2f880 HTTP/1.1 Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH2dSOm6Gvr_7yReO_KK4LyiJmxHEpSHznGvK-Vwrpwo4GWP7Ab5YXTZuGsu1pNtwHZhTwV9418WfJZZN41caWcz_If-orG4TOArgMozy0kdFl7uiee1-gBfdA2Tv8rwYvLMwbreSpyPQ3JrbABZf0uK1xwJ_TuKV00PeAfDDKvVrXo Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_294bcfcd48fb4cf3b3744e74498a9f73", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f6e18fc75c774452bcc89f4cb817e545 Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: exception: Security Group c654ac84-64b7-4e88-bce7-0856dce2f880 in use. Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-0ab47a92-a9d7-4523-a3fa-7857fef9efb8'] Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'c654ac84-64b7-4e88-bce7-0856dce2f880'} Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:12:00.768046 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group c654ac84-64b7-4e88-bce7-0856dce2f880 in use. Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ab47a92-a9d7-4523-a3fa-7857fef9efb8'] Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group c654ac84-64b7-4e88-bce7-0856dce2f880 in use. Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ab47a92-a9d7-4523-a3fa-7857fef9efb8'] Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group c654ac84-64b7-4e88-bce7-0856dce2f880 in use. Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ab47a92-a9d7-4523-a3fa-7857fef9efb8'] Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group c654ac84-64b7-4e88-bce7-0856dce2f880 in use. Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ab47a92-a9d7-4523-a3fa-7857fef9efb8'] Oct 29 01:12:00.773410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:00.777865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dc62fc48-d0e9-4590-a7c4-48268965f067 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Returning 400 to user: Security Group c654ac84-64b7-4e88-bce7-0856dce2f880 in use. Oct 29 01:12:00.777865 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-0ab47a92-a9d7-4523-a3fa-7857fef9efb8'] {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:12:00.779104 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dc62fc48-d0e9-4590-a7c4-48268965f067 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/c654ac84-64b7-4e88-bce7-0856dce2f880" status: 400 len: 185 microversion: 2.1 time: 0.383428 Oct 29 01:12:00.780228 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1048/2068] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:12:00 2022] DELETE /compute/v2.1/os-security-groups/c654ac84-64b7-4e88-bce7-0856dce2f880 => generated 185 bytes in 385 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:12:00.789890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4b14cf0c-2a76-4b40-9799-5c5647a4ccb5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:00.793242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4b14cf0c-2a76-4b40-9799-5c5647a4ccb5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:00.808602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b14cf0c-2a76-4b40-9799-5c5647a4ccb5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:00.815059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b14cf0c-2a76-4b40-9799-5c5647a4ccb5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:00.815059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b14cf0c-2a76-4b40-9799-5c5647a4ccb5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:00.816592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b14cf0c-2a76-4b40-9799-5c5647a4ccb5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:00.817374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b14cf0c-2a76-4b40-9799-5c5647a4ccb5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:00.818006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b14cf0c-2a76-4b40-9799-5c5647a4ccb5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:00.898146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4b14cf0c-2a76-4b40-9799-5c5647a4ccb5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:12:00.906847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6583f195-381a-478a-8d98-e034e85fbbf0 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Action: 'update', calling method: .version_select at 0x7f9d97c710d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:01.014618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6583f195-381a-478a-8d98-e034e85fbbf0 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:01.015403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6583f195-381a-478a-8d98-e034e85fbbf0 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:01.016135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6583f195-381a-478a-8d98-e034e85fbbf0 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:01.017671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6583f195-381a-478a-8d98-e034e85fbbf0 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:01.018351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6583f195-381a-478a-8d98-e034e85fbbf0 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:01.019015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6583f195-381a-478a-8d98-e034e85fbbf0 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:01.182816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:01.247528 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6583f195-381a-478a-8d98-e034e85fbbf0 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/beab7d3c87194d1b88a756e9486020cf" status: 200 len: 148 microversion: 2.57 time: 0.525245 Oct 29 01:12:01.254816 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1021/2069] 10.222.0.26 () {62 vars in 1303 bytes} [Sat Oct 29 01:12:00 2022] PUT /compute/v2.1/os-quota-sets/beab7d3c87194d1b88a756e9486020cf => generated 148 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:12:01.255957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f8b27541-f2c9-44a7-ba43-0bda18719877 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:01.256809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f8b27541-f2c9-44a7-ba43-0bda18719877 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] [instance: 043b00d6-d708-4cee-a1dc-d8ca4ddcae90] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:01.267244 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8b27541-f2c9-44a7-ba43-0bda18719877 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:01.286723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8b27541-f2c9-44a7-ba43-0bda18719877 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:01.290860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8b27541-f2c9-44a7-ba43-0bda18719877 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:01.293310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8b27541-f2c9-44a7-ba43-0bda18719877 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:01.296339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8b27541-f2c9-44a7-ba43-0bda18719877 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:01.296965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8b27541-f2c9-44a7-ba43-0bda18719877 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:01.311952 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4b14cf0c-2a76-4b40-9799-5c5647a4ccb5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 204 len: 0 microversion: 2.1 time: 0.526061 Oct 29 01:12:01.313074 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1049/2070] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:12:00 2022] DELETE /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:12:01.320957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-7714b057-ebab-4372-97f3-45caaf9bca2f req-7dcd2460-0aee-42ae-8bc8-1888f258621a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b3a48e-461b-4552-9d73-03c22ae8ce57", "tag": "c9db3590-6f4f-460a-9dd4-a1d9d701e0e5"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:01.337651 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-f8b27541-f2c9-44a7-ba43-0bda18719877 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] HTTP exception thrown: Instance 043b00d6-d708-4cee-a1dc-d8ca4ddcae90 could not be found. Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f8b27541-f2c9-44a7-ba43-0bda18719877 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Request method failure captured: Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 HTTP/1.1 Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH0qlkiLTvI-7mY6IkZFpzD42s8krccHgkBpUplX-DT4A0nlf83r9f1eTH5SAsgIdCDa3q7dTq2ERI5OE2RN5oPml4XeVTwLJuNOWbzE97hpB0uUQH_sUQqqOTX-I_BYZkbifMxd_mI5VO9Yxld3CWac-_RBwD53lnNiM0NKevsStwY Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 82589beab120404eac2b09ab70b5b9ab Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersTestBootFromVolume-1996402668 Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82589beab120404eac2b09ab70b5b9ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82589beab120404eac2b09ab70b5b9ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82589beab120404eac2b09ab70b5b9ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82589beab120404eac2b09ab70b5b9ab", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersTestBootFromVolume-1996402668 Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 82589beab120404eac2b09ab70b5b9ab Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1996402668 Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersTestBootFromVolume-1996402668-project Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: d19a2a21861641dc9ac061e1a8ba5275 Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersTestBootFromVolume-1996402668-project Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 043b00d6-d708-4cee-a1dc-d8ca4ddcae90 could not be found. Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '043b00d6-d708-4cee-a1dc-d8ca4ddcae90'} Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 043b00d6-d708-4cee-a1dc-d8ca4ddcae90 could not be found. Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 043b00d6-d708-4cee-a1dc-d8ca4ddcae90 could not be found. Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:01.339362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:01.349624 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:01.349624 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:01.349624 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:01.349624 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:12:01.349624 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:12:01.349624 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 043b00d6-d708-4cee-a1dc-d8ca4ddcae90 could not be found. Oct 29 01:12:01.349624 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:01.349624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f8b27541-f2c9-44a7-ba43-0bda18719877 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Returning 404 to user: Instance 043b00d6-d708-4cee-a1dc-d8ca4ddcae90 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:12:01.349624 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f8b27541-f2c9-44a7-ba43-0bda18719877 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90" status: 404 len: 111 microversion: 2.1 time: 0.090753 Oct 29 01:12:01.350610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7714b057-ebab-4372-97f3-45caaf9bca2f req-7dcd2460-0aee-42ae-8bc8-1888f258621a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:01.351122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7714b057-ebab-4372-97f3-45caaf9bca2f req-7dcd2460-0aee-42ae-8bc8-1888f258621a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:01.351668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7714b057-ebab-4372-97f3-45caaf9bca2f req-7dcd2460-0aee-42ae-8bc8-1888f258621a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:01.353253 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1022/2071] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:01 2022] GET /compute/v2.1/servers/043b00d6-d708-4cee-a1dc-d8ca4ddcae90 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:12:01.359032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-15f7972f-8118-4d9e-964b-1b131840254c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:01.359657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-15f7972f-8118-4d9e-964b-1b131840254c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:01.364101 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-7714b057-ebab-4372-97f3-45caaf9bca2f req-7dcd2460-0aee-42ae-8bc8-1888f258621a service nova] Creating event network-changed:c9db3590-6f4f-460a-9dd4-a1d9d701e0e5 for instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 on n-h1-862964-3 Oct 29 01:12:01.366660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15f7972f-8118-4d9e-964b-1b131840254c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:01.367989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15f7972f-8118-4d9e-964b-1b131840254c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:01.367989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15f7972f-8118-4d9e-964b-1b131840254c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:01.368296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15f7972f-8118-4d9e-964b-1b131840254c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:01.368825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15f7972f-8118-4d9e-964b-1b131840254c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:01.369270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15f7972f-8118-4d9e-964b-1b131840254c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:01.370041 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-7714b057-ebab-4372-97f3-45caaf9bca2f req-7dcd2460-0aee-42ae-8bc8-1888f258621a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055041 Oct 29 01:12:01.374180 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1050/2072] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:01.380827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-182e17da-2b63-46ed-bd74-bebba4e317f9 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Calling method '.version_select at 0x7f9d9fe48790>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:01.467688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-182e17da-2b63-46ed-bd74-bebba4e317f9 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:01.468384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-182e17da-2b63-46ed-bd74-bebba4e317f9 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:01.468602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-182e17da-2b63-46ed-bd74-bebba4e317f9 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:01.469382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-182e17da-2b63-46ed-bd74-bebba4e317f9 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:01.470361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-182e17da-2b63-46ed-bd74-bebba4e317f9 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:01.470774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-182e17da-2b63-46ed-bd74-bebba4e317f9 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:01.493116 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-182e17da-2b63-46ed-bd74-bebba4e317f9 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/beab7d3c87194d1b88a756e9486020cf/detail" status: 200 len: 463 microversion: 2.57 time: 0.117301 Oct 29 01:12:01.493775 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1051/2073] 10.222.0.26 () {60 vars in 1304 bytes} [Sat Oct 29 01:12:01 2022] GET /compute/v2.1/os-quota-sets/beab7d3c87194d1b88a756e9486020cf/detail => generated 463 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:12:01.498865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0688f653-0307-4e83-91d3-d8aef4267a04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:01.499817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0688f653-0307-4e83-91d3-d8aef4267a04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:01.521918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0688f653-0307-4e83-91d3-d8aef4267a04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:01.522888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0688f653-0307-4e83-91d3-d8aef4267a04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:01.523621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0688f653-0307-4e83-91d3-d8aef4267a04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:01.530606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0688f653-0307-4e83-91d3-d8aef4267a04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:01.533797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0688f653-0307-4e83-91d3-d8aef4267a04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:01.535815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0688f653-0307-4e83-91d3-d8aef4267a04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:01.539648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-15f7972f-8118-4d9e-964b-1b131840254c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:01.551355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-15f7972f-8118-4d9e-964b-1b131840254c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:01.552997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-15f7972f-8118-4d9e-964b-1b131840254c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:01.554720 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-15f7972f-8118-4d9e-964b-1b131840254c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.200241 Oct 29 01:12:01.572743 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1023/2074] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:01 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:01.583118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0979ed01-f3e4-4e57-9fd5-c15ff5634060 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] Calling method '.version_select at 0x7f9d9fefcca0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:01.706558 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0979ed01-f3e4-4e57-9fd5-c15ff5634060 tempest-ServersTestBootFromVolume-1996402668 tempest-ServersTestBootFromVolume-1996402668-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1847294559" status: 202 len: 0 microversion: 2.1 time: 0.132399 Oct 29 01:12:01.717089 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1024/2075] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 29 01:12:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1847294559 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:12:01.739855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0688f653-0307-4e83-91d3-d8aef4267a04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:01.740588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d39543a8-6a9c-47a2-bea3-162816dddc67 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:01.741443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d39543a8-6a9c-47a2-bea3-162816dddc67 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:01.759661 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0688f653-0307-4e83-91d3-d8aef4267a04 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1646 microversion: 2.1 time: 0.264580 Oct 29 01:12:01.776645 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1052/2076] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:01 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1646 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:01.776903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d39543a8-6a9c-47a2-bea3-162816dddc67 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:01.776903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d39543a8-6a9c-47a2-bea3-162816dddc67 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:01.776903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d39543a8-6a9c-47a2-bea3-162816dddc67 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:01.777199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f1a673a5-e25f-47fc-ab1b-d26d265c4525 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:01.777199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f1a673a5-e25f-47fc-ab1b-d26d265c4525 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:01.777781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1a673a5-e25f-47fc-ab1b-d26d265c4525 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:01.781250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1a673a5-e25f-47fc-ab1b-d26d265c4525 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:01.782709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1a673a5-e25f-47fc-ab1b-d26d265c4525 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:01.784077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d39543a8-6a9c-47a2-bea3-162816dddc67 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:01.784502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1a673a5-e25f-47fc-ab1b-d26d265c4525 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:01.785549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1a673a5-e25f-47fc-ab1b-d26d265c4525 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:01.786465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1a673a5-e25f-47fc-ab1b-d26d265c4525 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:01.786914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d39543a8-6a9c-47a2-bea3-162816dddc67 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:01.787309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d39543a8-6a9c-47a2-bea3-162816dddc67 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:01.840286 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f1a673a5-e25f-47fc-ab1b-d26d265c4525 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078247 Oct 29 01:12:01.840974 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1053/2077] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:12:01 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:01.847485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0a91f5a4-eb64-4d30-8b71-760fa32c0e83 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Action: 'update', calling method: .version_select at 0x7f9d9fefbd30>, body: {"quota_set": {"ram": "2048"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:01.935972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a91f5a4-eb64-4d30-8b71-760fa32c0e83 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:01.936785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a91f5a4-eb64-4d30-8b71-760fa32c0e83 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:01.938357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a91f5a4-eb64-4d30-8b71-760fa32c0e83 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:01.942925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a91f5a4-eb64-4d30-8b71-760fa32c0e83 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:01.943917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a91f5a4-eb64-4d30-8b71-760fa32c0e83 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:01.944635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a91f5a4-eb64-4d30-8b71-760fa32c0e83 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:02.036546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d39543a8-6a9c-47a2-bea3-162816dddc67 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:02.041441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a91f5a4-eb64-4d30-8b71-760fa32c0e83 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:02.042130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a91f5a4-eb64-4d30-8b71-760fa32c0e83 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:02.042579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a91f5a4-eb64-4d30-8b71-760fa32c0e83 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:02.043381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a91f5a4-eb64-4d30-8b71-760fa32c0e83 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:02.043860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a91f5a4-eb64-4d30-8b71-760fa32c0e83 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:02.044298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a91f5a4-eb64-4d30-8b71-760fa32c0e83 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:02.053932 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d39543a8-6a9c-47a2-bea3-162816dddc67 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1315 microversion: 2.1 time: 0.334007 Oct 29 01:12:02.054769 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1025/2078] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:01 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:02.206775 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0a91f5a4-eb64-4d30-8b71-760fa32c0e83 tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/beab7d3c87194d1b88a756e9486020cf?user_id=fad00959cd6d49dbb9f5d78df1b92ed3" status: 200 len: 148 microversion: 2.57 time: 0.363319 Oct 29 01:12:02.208211 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1054/2079] 10.222.0.26 () {62 vars in 1384 bytes} [Sat Oct 29 01:12:01 2022] PUT /compute/v2.1/os-quota-sets/beab7d3c87194d1b88a756e9486020cf?user_id=fad00959cd6d49dbb9f5d78df1b92ed3 => generated 148 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:12:02.227300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a83f65d9-8c25-47ed-8225-907088c64fbc tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] Calling method '.version_select at 0x7f9d9ff8cdc0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:02.319905 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a83f65d9-8c25-47ed-8225-907088c64fbc tempest-QuotasAdminTestV257-828784733 tempest-QuotasAdminTestV257-828784733-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/beab7d3c87194d1b88a756e9486020cf?user_id=fad00959cd6d49dbb9f5d78df1b92ed3" status: 200 len: 190 microversion: 2.57 time: 0.097433 Oct 29 01:12:02.321207 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1026/2080] 10.222.0.26 () {60 vars in 1364 bytes} [Sat Oct 29 01:12:02 2022] GET /compute/v2.1/os-quota-sets/beab7d3c87194d1b88a756e9486020cf?user_id=fad00959cd6d49dbb9f5d78df1b92ed3 => generated 190 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:12:02.587838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-28ff3611-5120-44b2-be5b-e8144afa31c0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:02.588457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-28ff3611-5120-44b2-be5b-e8144afa31c0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:02.597747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28ff3611-5120-44b2-be5b-e8144afa31c0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:02.598245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28ff3611-5120-44b2-be5b-e8144afa31c0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:02.598684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28ff3611-5120-44b2-be5b-e8144afa31c0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:02.600817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28ff3611-5120-44b2-be5b-e8144afa31c0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:02.601334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28ff3611-5120-44b2-be5b-e8144afa31c0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:02.601773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28ff3611-5120-44b2-be5b-e8144afa31c0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:02.797206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7c29ea4b-a5cd-4849-bc12-ad94ab1a04fe tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:02.798728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7c29ea4b-a5cd-4849-bc12-ad94ab1a04fe tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:02.810754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c29ea4b-a5cd-4849-bc12-ad94ab1a04fe tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:02.811424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c29ea4b-a5cd-4849-bc12-ad94ab1a04fe tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:02.814664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c29ea4b-a5cd-4849-bc12-ad94ab1a04fe tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:02.815425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c29ea4b-a5cd-4849-bc12-ad94ab1a04fe tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:02.817892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c29ea4b-a5cd-4849-bc12-ad94ab1a04fe tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:02.818780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c29ea4b-a5cd-4849-bc12-ad94ab1a04fe tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:03.986439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-28ff3611-5120-44b2-be5b-e8144afa31c0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:03.998104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-28ff3611-5120-44b2-be5b-e8144afa31c0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:04.005579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-28ff3611-5120-44b2-be5b-e8144afa31c0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:04.014895 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-28ff3611-5120-44b2-be5b-e8144afa31c0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 1.431458 Oct 29 01:12:04.016083 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1055/2081] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:02 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:04.021958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-482cb8cb-baf9-4ae0-969e-985f1c0f214b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:04.030419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-482cb8cb-baf9-4ae0-969e-985f1c0f214b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:04.040520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-482cb8cb-baf9-4ae0-969e-985f1c0f214b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:04.045228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-482cb8cb-baf9-4ae0-969e-985f1c0f214b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:04.046214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-482cb8cb-baf9-4ae0-969e-985f1c0f214b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:04.047154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-482cb8cb-baf9-4ae0-969e-985f1c0f214b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:04.050114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-482cb8cb-baf9-4ae0-969e-985f1c0f214b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:04.050803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-482cb8cb-baf9-4ae0-969e-985f1c0f214b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:04.129043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7c29ea4b-a5cd-4849-bc12-ad94ab1a04fe tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:04.129819 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-482cb8cb-baf9-4ae0-969e-985f1c0f214b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110643 Oct 29 01:12:04.130597 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1056/2082] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:12:04 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:04.144674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-92b12e6a-28ff-4a91-8a58-6bf5359e2ad3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:04.150733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-92b12e6a-28ff-4a91-8a58-6bf5359e2ad3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:04.153073 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7c29ea4b-a5cd-4849-bc12-ad94ab1a04fe tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1646 microversion: 2.1 time: 1.357370 Oct 29 01:12:04.158355 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1027/2083] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:02 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1646 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:04.161144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92b12e6a-28ff-4a91-8a58-6bf5359e2ad3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:04.163585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92b12e6a-28ff-4a91-8a58-6bf5359e2ad3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:04.167099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92b12e6a-28ff-4a91-8a58-6bf5359e2ad3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:04.168150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92b12e6a-28ff-4a91-8a58-6bf5359e2ad3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:04.169959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92b12e6a-28ff-4a91-8a58-6bf5359e2ad3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:04.170685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92b12e6a-28ff-4a91-8a58-6bf5359e2ad3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:04.788308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-92b12e6a-28ff-4a91-8a58-6bf5359e2ad3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:04.802443 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-92b12e6a-28ff-4a91-8a58-6bf5359e2ad3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1315 microversion: 2.1 time: 0.666945 Oct 29 01:12:04.809569 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1057/2084] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:04 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1315 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:05.047266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-88f4a1c3-6327-4f89-bdb1-a07bae4cdfba tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:05.047948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-88f4a1c3-6327-4f89-bdb1-a07bae4cdfba tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:05.053447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-bf224d42-c7d3-49b7-afeb-ab8740168f80 req-384d0d31-0f0a-49fd-916b-a3c1c3382fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0fe24cf-adf2-440f-bc90-819416f0da85", "name": "network-vif-plugged", "status": "completed", "tag": "668338a4-a4ff-4907-96e5-1efd14961ac4"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:05.062738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88f4a1c3-6327-4f89-bdb1-a07bae4cdfba tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:05.065373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88f4a1c3-6327-4f89-bdb1-a07bae4cdfba tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:05.066006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88f4a1c3-6327-4f89-bdb1-a07bae4cdfba tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:05.066876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88f4a1c3-6327-4f89-bdb1-a07bae4cdfba tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:05.067456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88f4a1c3-6327-4f89-bdb1-a07bae4cdfba tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:05.068141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88f4a1c3-6327-4f89-bdb1-a07bae4cdfba tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:05.076376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-bf224d42-c7d3-49b7-afeb-ab8740168f80 req-384d0d31-0f0a-49fd-916b-a3c1c3382fff service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:05.077737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-bf224d42-c7d3-49b7-afeb-ab8740168f80 req-384d0d31-0f0a-49fd-916b-a3c1c3382fff service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:05.078894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-bf224d42-c7d3-49b7-afeb-ab8740168f80 req-384d0d31-0f0a-49fd-916b-a3c1c3382fff service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:05.099095 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-bf224d42-c7d3-49b7-afeb-ab8740168f80 req-384d0d31-0f0a-49fd-916b-a3c1c3382fff service nova] Creating event network-vif-plugged:668338a4-a4ff-4907-96e5-1efd14961ac4 for instance b0fe24cf-adf2-440f-bc90-819416f0da85 on n-h1-862964-3 Oct 29 01:12:05.120216 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-bf224d42-c7d3-49b7-afeb-ab8740168f80 req-384d0d31-0f0a-49fd-916b-a3c1c3382fff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070426 Oct 29 01:12:05.120924 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1058/2085] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:05.152847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-51497d93-d425-49f5-bd0e-177433b9ceaf tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:05.164655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-51497d93-d425-49f5-bd0e-177433b9ceaf tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:05.188665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51497d93-d425-49f5-bd0e-177433b9ceaf tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:05.190410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51497d93-d425-49f5-bd0e-177433b9ceaf tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:05.190885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51497d93-d425-49f5-bd0e-177433b9ceaf tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:05.196222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51497d93-d425-49f5-bd0e-177433b9ceaf tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:05.197298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51497d93-d425-49f5-bd0e-177433b9ceaf tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:05.200018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51497d93-d425-49f5-bd0e-177433b9ceaf tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:05.295608 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-51497d93-d425-49f5-bd0e-177433b9ceaf tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153905 Oct 29 01:12:05.296882 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1059/2086] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:12:05 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:05.304752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-efbd7691-dd25-4d60-97e9-3ebb03d31c20 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:05.305785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-efbd7691-dd25-4d60-97e9-3ebb03d31c20 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:05.312987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efbd7691-dd25-4d60-97e9-3ebb03d31c20 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:05.314975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efbd7691-dd25-4d60-97e9-3ebb03d31c20 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:05.315549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efbd7691-dd25-4d60-97e9-3ebb03d31c20 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:05.316446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efbd7691-dd25-4d60-97e9-3ebb03d31c20 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:05.316973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efbd7691-dd25-4d60-97e9-3ebb03d31c20 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:05.317816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efbd7691-dd25-4d60-97e9-3ebb03d31c20 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:05.365515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-88f4a1c3-6327-4f89-bdb1-a07bae4cdfba tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:05.390266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-88f4a1c3-6327-4f89-bdb1-a07bae4cdfba tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:05.408143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-88f4a1c3-6327-4f89-bdb1-a07bae4cdfba tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:05.408143 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-88f4a1c3-6327-4f89-bdb1-a07bae4cdfba tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.353066 Oct 29 01:12:05.408143 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1028/2087] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:05 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:05.412937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-c9dfbbe4-3725-4aa4-9923-cd4b8c75d836 req-c23e8b97-2466-4255-9928-f59c54110d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b3a48e-461b-4552-9d73-03c22ae8ce57", "name": "network-vif-deleted", "tag": "c9db3590-6f4f-460a-9dd4-a1d9d701e0e5"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:05.435922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c9dfbbe4-3725-4aa4-9923-cd4b8c75d836 req-c23e8b97-2466-4255-9928-f59c54110d14 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:05.436718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c9dfbbe4-3725-4aa4-9923-cd4b8c75d836 req-c23e8b97-2466-4255-9928-f59c54110d14 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:05.437373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c9dfbbe4-3725-4aa4-9923-cd4b8c75d836 req-c23e8b97-2466-4255-9928-f59c54110d14 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:05.470952 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-c9dfbbe4-3725-4aa4-9923-cd4b8c75d836 req-c23e8b97-2466-4255-9928-f59c54110d14 service nova] Creating event network-vif-deleted:c9db3590-6f4f-460a-9dd4-a1d9d701e0e5 for instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 on n-h1-862964-3 Oct 29 01:12:05.486515 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-c9dfbbe4-3725-4aa4-9923-cd4b8c75d836 req-c23e8b97-2466-4255-9928-f59c54110d14 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081043 Oct 29 01:12:05.487917 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1029/2088] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:05.532405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-efbd7691-dd25-4d60-97e9-3ebb03d31c20 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:05.546093 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-efbd7691-dd25-4d60-97e9-3ebb03d31c20 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1467 microversion: 2.1 time: 0.246557 Oct 29 01:12:05.551771 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1060/2089] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:05 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1467 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:05.832278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bfca45f9-48cb-4353-adca-694317e3ba91 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:05.833427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bfca45f9-48cb-4353-adca-694317e3ba91 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:05.842270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfca45f9-48cb-4353-adca-694317e3ba91 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:05.843109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfca45f9-48cb-4353-adca-694317e3ba91 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:05.843773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfca45f9-48cb-4353-adca-694317e3ba91 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:05.845436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfca45f9-48cb-4353-adca-694317e3ba91 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:05.846175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfca45f9-48cb-4353-adca-694317e3ba91 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:05.846922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfca45f9-48cb-4353-adca-694317e3ba91 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:06.023721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bfca45f9-48cb-4353-adca-694317e3ba91 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:06.034336 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bfca45f9-48cb-4353-adca-694317e3ba91 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1315 microversion: 2.1 time: 0.208598 Oct 29 01:12:06.037424 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1030/2090] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:05 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:06.427474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-709111f1-ca29-4013-ae21-9e1fbcbe0c7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:06.428796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-709111f1-ca29-4013-ae21-9e1fbcbe0c7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:06.450489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-709111f1-ca29-4013-ae21-9e1fbcbe0c7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:06.456630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-709111f1-ca29-4013-ae21-9e1fbcbe0c7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:06.458437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-709111f1-ca29-4013-ae21-9e1fbcbe0c7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:06.459425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-709111f1-ca29-4013-ae21-9e1fbcbe0c7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:06.461146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-709111f1-ca29-4013-ae21-9e1fbcbe0c7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:06.462267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-709111f1-ca29-4013-ae21-9e1fbcbe0c7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:06.699347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-756e068b-de2f-46d2-a61a-077f0ae765cb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:06.702972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-756e068b-de2f-46d2-a61a-077f0ae765cb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:06.718103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-756e068b-de2f-46d2-a61a-077f0ae765cb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:06.722427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-756e068b-de2f-46d2-a61a-077f0ae765cb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:06.723041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-756e068b-de2f-46d2-a61a-077f0ae765cb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:06.723818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-756e068b-de2f-46d2-a61a-077f0ae765cb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:06.726619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-756e068b-de2f-46d2-a61a-077f0ae765cb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:06.727106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-756e068b-de2f-46d2-a61a-077f0ae765cb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:06.825691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:06.829914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-709111f1-ca29-4013-ae21-9e1fbcbe0c7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:06.832830 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-756e068b-de2f-46d2-a61a-077f0ae765cb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.528562 Oct 29 01:12:06.834226 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1061/2091] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:12:06 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments => generated 197 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:06.840139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-872d01b5-71bf-4bbb-a3f6-ce17d78f88e3 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:06.841037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-872d01b5-71bf-4bbb-a3f6-ce17d78f88e3 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:06.848090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-872d01b5-71bf-4bbb-a3f6-ce17d78f88e3 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:06.849398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-872d01b5-71bf-4bbb-a3f6-ce17d78f88e3 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:06.850376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-872d01b5-71bf-4bbb-a3f6-ce17d78f88e3 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:06.850600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-709111f1-ca29-4013-ae21-9e1fbcbe0c7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:06.851608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-872d01b5-71bf-4bbb-a3f6-ce17d78f88e3 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:06.852315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-872d01b5-71bf-4bbb-a3f6-ce17d78f88e3 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:06.852573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-709111f1-ca29-4013-ae21-9e1fbcbe0c7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:06.853281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-872d01b5-71bf-4bbb-a3f6-ce17d78f88e3 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:06.857186 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-709111f1-ca29-4013-ae21-9e1fbcbe0c7d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.431855 Oct 29 01:12:06.859064 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1031/2092] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:06 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:06.894656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-872d01b5-71bf-4bbb-a3f6-ce17d78f88e3 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:06.900804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-872d01b5-71bf-4bbb-a3f6-ce17d78f88e3 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:06.900804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-872d01b5-71bf-4bbb-a3f6-ce17d78f88e3 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:06.900804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-872d01b5-71bf-4bbb-a3f6-ce17d78f88e3 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lazy-loading 'fault' on Instance uuid 97b3a48e-461b-4552-9d73-03c22ae8ce57 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:12:06.955494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-872d01b5-71bf-4bbb-a3f6-ce17d78f88e3 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:06.966215 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-872d01b5-71bf-4bbb-a3f6-ce17d78f88e3 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1305 microversion: 2.1 time: 0.130048 Oct 29 01:12:06.967009 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1062/2093] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:06 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1305 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:07.061688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cfc3466c-47dd-4737-a85a-9f38fcbc2412 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:07.062676 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cfc3466c-47dd-4737-a85a-9f38fcbc2412 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:07.073841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cfc3466c-47dd-4737-a85a-9f38fcbc2412 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:07.080022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cfc3466c-47dd-4737-a85a-9f38fcbc2412 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:07.080712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cfc3466c-47dd-4737-a85a-9f38fcbc2412 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:07.081968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cfc3466c-47dd-4737-a85a-9f38fcbc2412 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:07.082625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cfc3466c-47dd-4737-a85a-9f38fcbc2412 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:07.083223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cfc3466c-47dd-4737-a85a-9f38fcbc2412 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:07.384831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cfc3466c-47dd-4737-a85a-9f38fcbc2412 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:07.405499 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cfc3466c-47dd-4737-a85a-9f38fcbc2412 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1315 microversion: 2.1 time: 0.345551 Oct 29 01:12:07.421193 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1032/2094] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:07 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:07.846656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6fbdf60c-b2e0-4c65-acfb-637d6d6cd8e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:07.849292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6fbdf60c-b2e0-4c65-acfb-637d6d6cd8e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:07.860696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fbdf60c-b2e0-4c65-acfb-637d6d6cd8e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:07.861589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fbdf60c-b2e0-4c65-acfb-637d6d6cd8e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:07.862232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fbdf60c-b2e0-4c65-acfb-637d6d6cd8e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:07.863139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fbdf60c-b2e0-4c65-acfb-637d6d6cd8e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:07.863775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fbdf60c-b2e0-4c65-acfb-637d6d6cd8e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:07.864574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fbdf60c-b2e0-4c65-acfb-637d6d6cd8e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:07.889108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-80962ab2-817d-4a68-bb47-61290280f6a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:07.899561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-80962ab2-817d-4a68-bb47-61290280f6a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:07.918076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80962ab2-817d-4a68-bb47-61290280f6a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:07.921931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80962ab2-817d-4a68-bb47-61290280f6a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:07.923402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80962ab2-817d-4a68-bb47-61290280f6a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:07.924393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80962ab2-817d-4a68-bb47-61290280f6a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:07.929481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80962ab2-817d-4a68-bb47-61290280f6a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:07.930274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80962ab2-817d-4a68-bb47-61290280f6a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:07.930437 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6fbdf60c-b2e0-4c65-acfb-637d6d6cd8e8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088314 Oct 29 01:12:07.930938 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1063/2095] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:12:07 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:07.991004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ebf36de5-87a5-40c6-a98c-2849be6659cd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:07.992186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ebf36de5-87a5-40c6-a98c-2849be6659cd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:08.002623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebf36de5-87a5-40c6-a98c-2849be6659cd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:08.003503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebf36de5-87a5-40c6-a98c-2849be6659cd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:08.004530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebf36de5-87a5-40c6-a98c-2849be6659cd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:08.005628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebf36de5-87a5-40c6-a98c-2849be6659cd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:08.006343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebf36de5-87a5-40c6-a98c-2849be6659cd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:08.007012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebf36de5-87a5-40c6-a98c-2849be6659cd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:08.174195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-80962ab2-817d-4a68-bb47-61290280f6a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:08.200875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-80962ab2-817d-4a68-bb47-61290280f6a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:08.203564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-80962ab2-817d-4a68-bb47-61290280f6a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:08.206337 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-80962ab2-817d-4a68-bb47-61290280f6a7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.322130 Oct 29 01:12:08.207455 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1033/2096] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:07 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:08.245528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebf36de5-87a5-40c6-a98c-2849be6659cd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:08.245528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebf36de5-87a5-40c6-a98c-2849be6659cd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:08.245528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebf36de5-87a5-40c6-a98c-2849be6659cd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:08.246652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-ebf36de5-87a5-40c6-a98c-2849be6659cd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lazy-loading 'fault' on Instance uuid 97b3a48e-461b-4552-9d73-03c22ae8ce57 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:12:08.332813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ebf36de5-87a5-40c6-a98c-2849be6659cd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:08.350637 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ebf36de5-87a5-40c6-a98c-2849be6659cd tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 200 len: 1305 microversion: 2.1 time: 0.363269 Oct 29 01:12:08.353514 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1064/2097] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:07 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 1305 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:08.434709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1978f9b3-c847-45fb-92fd-658beb7de5ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:08.435479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1978f9b3-c847-45fb-92fd-658beb7de5ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:08.448350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1978f9b3-c847-45fb-92fd-658beb7de5ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:08.448961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1978f9b3-c847-45fb-92fd-658beb7de5ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:08.450553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1978f9b3-c847-45fb-92fd-658beb7de5ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:08.453102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1978f9b3-c847-45fb-92fd-658beb7de5ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:08.454646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1978f9b3-c847-45fb-92fd-658beb7de5ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:08.457004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1978f9b3-c847-45fb-92fd-658beb7de5ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:08.708938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1978f9b3-c847-45fb-92fd-658beb7de5ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:08.718717 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1978f9b3-c847-45fb-92fd-658beb7de5ef tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1502 microversion: 2.1 time: 0.288244 Oct 29 01:12:08.719331 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1034/2098] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:08 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1502 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:08.755652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-71c65414-2d9d-4abe-a7ac-919cd188ef08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:08.756427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-71c65414-2d9d-4abe-a7ac-919cd188ef08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:08.765138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71c65414-2d9d-4abe-a7ac-919cd188ef08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:08.765659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71c65414-2d9d-4abe-a7ac-919cd188ef08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:08.766830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71c65414-2d9d-4abe-a7ac-919cd188ef08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:08.767670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71c65414-2d9d-4abe-a7ac-919cd188ef08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:08.768126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71c65414-2d9d-4abe-a7ac-919cd188ef08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:08.768555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71c65414-2d9d-4abe-a7ac-919cd188ef08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:08.802822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-71c65414-2d9d-4abe-a7ac-919cd188ef08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lazy-loading 'flavor' on Instance uuid b0fe24cf-adf2-440f-bc90-819416f0da85 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:12:08.944074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e7b49686-d8d5-4042-aa05-b62e68f3c175 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:08.946371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e7b49686-d8d5-4042-aa05-b62e68f3c175 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:08.960728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7b49686-d8d5-4042-aa05-b62e68f3c175 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:08.961529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7b49686-d8d5-4042-aa05-b62e68f3c175 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:08.962173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7b49686-d8d5-4042-aa05-b62e68f3c175 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:08.964980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7b49686-d8d5-4042-aa05-b62e68f3c175 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:08.965776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7b49686-d8d5-4042-aa05-b62e68f3c175 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:08.967671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7b49686-d8d5-4042-aa05-b62e68f3c175 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:09.026314 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e7b49686-d8d5-4042-aa05-b62e68f3c175 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086820 Oct 29 01:12:09.033428 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1035/2099] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:12:08 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:12:09.234606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fcbb3261-5877-4ede-bea7-59c6bef46e3b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:09.236258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fcbb3261-5877-4ede-bea7-59c6bef46e3b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:09.242798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcbb3261-5877-4ede-bea7-59c6bef46e3b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:09.243336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcbb3261-5877-4ede-bea7-59c6bef46e3b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:09.243881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcbb3261-5877-4ede-bea7-59c6bef46e3b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:09.244764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcbb3261-5877-4ede-bea7-59c6bef46e3b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:09.245246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcbb3261-5877-4ede-bea7-59c6bef46e3b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:09.245910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcbb3261-5877-4ede-bea7-59c6bef46e3b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:09.415161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fcbb3261-5877-4ede-bea7-59c6bef46e3b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:09.460788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fcbb3261-5877-4ede-bea7-59c6bef46e3b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:09.473999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fcbb3261-5877-4ede-bea7-59c6bef46e3b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:09.480027 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fcbb3261-5877-4ede-bea7-59c6bef46e3b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.249123 Oct 29 01:12:09.481781 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1036/2100] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:09 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:12:09.502058 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-37e5ad6c-b6c6-47c7-b34a-5e5d9aa862f1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:09.521580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-37e5ad6c-b6c6-47c7-b34a-5e5d9aa862f1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:09.535479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37e5ad6c-b6c6-47c7-b34a-5e5d9aa862f1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:09.536777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37e5ad6c-b6c6-47c7-b34a-5e5d9aa862f1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:09.536777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37e5ad6c-b6c6-47c7-b34a-5e5d9aa862f1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:09.537120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37e5ad6c-b6c6-47c7-b34a-5e5d9aa862f1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:09.537567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37e5ad6c-b6c6-47c7-b34a-5e5d9aa862f1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:09.537990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37e5ad6c-b6c6-47c7-b34a-5e5d9aa862f1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:09.612981 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-37e5ad6c-b6c6-47c7-b34a-5e5d9aa862f1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] HTTP exception thrown: Instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 could not be found. Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-37e5ad6c-b6c6-47c7-b34a-5e5d9aa862f1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Request method failure captured: Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 HTTP/1.1 Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH2dSOm6Gvr_7yReO_KK4LyiJmxHEpSHznGvK-Vwrpwo4GWP7Ab5YXTZuGsu1pNtwHZhTwV9418WfJZZN41caWcz_If-orG4TOArgMozy0kdFl7uiee1-gBfdA2Tv8rwYvLMwbreSpyPQ3JrbABZf0uK1xwJ_TuKV00PeAfDDKvVrXo Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_294bcfcd48fb4cf3b3744e74498a9f73", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: f6e18fc75c774452bcc89f4cb817e545 Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 could not be found. Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '97b3a48e-461b-4552-9d73-03c22ae8ce57'} Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 could not be found. Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 could not be found. Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:09.620424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:09.631844 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:09.631844 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:09.631844 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:09.631844 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:12:09.631844 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:12:09.631844 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 could not be found. Oct 29 01:12:09.631844 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:09.631844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-37e5ad6c-b6c6-47c7-b34a-5e5d9aa862f1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Returning 404 to user: Instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:12:09.631844 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-37e5ad6c-b6c6-47c7-b34a-5e5d9aa862f1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 404 len: 111 microversion: 2.1 time: 0.140679 Oct 29 01:12:09.631844 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1037/2101] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:09 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:12:09.640680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7cddfb9d-d796-4832-8e14-1b30724b91e8 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:09.658046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7cddfb9d-d796-4832-8e14-1b30724b91e8 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:09.658913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7cddfb9d-d796-4832-8e14-1b30724b91e8 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Searching by: {'deleted': False, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:12:09.681107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7cddfb9d-d796-4832-8e14-1b30724b91e8 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:09.683204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7cddfb9d-d796-4832-8e14-1b30724b91e8 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:09.684601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7cddfb9d-d796-4832-8e14-1b30724b91e8 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:09.686873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7cddfb9d-d796-4832-8e14-1b30724b91e8 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:09.691638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7cddfb9d-d796-4832-8e14-1b30724b91e8 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:09.692534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7cddfb9d-d796-4832-8e14-1b30724b91e8 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:09.754340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.multi_cell_list [None req-7cddfb9d-d796-4832-8e14-1b30724b91e8 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121100) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:12:09.794705 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7cddfb9d-d796-4832-8e14-1b30724b91e8 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.163779 Oct 29 01:12:09.800753 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1038/2102] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 29 01:12:09 2022] GET /compute/v2.1/servers => generated 333 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:09.822165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-555b20a0-2410-4f54-9195-138dc740b71c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d9fef83a0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:09.923142 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-71c65414-2d9d-4abe-a7ac-919cd188ef08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "POST /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85/action" status: 202 len: 0 microversion: 2.1 time: 1.172447 Oct 29 01:12:09.931810 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1065/2103] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:12:08 2022] POST /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85/action => generated 0 bytes in 1183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:12:09.945821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c2965025-c5b3-43ca-8c81-bd4c8a77a345 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:09.968132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c2965025-c5b3-43ca-8c81-bd4c8a77a345 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:09.969796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c2965025-c5b3-43ca-8c81-bd4c8a77a345 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Searching by: {'deleted': False, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:12:09.980432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2965025-c5b3-43ca-8c81-bd4c8a77a345 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:09.988030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2965025-c5b3-43ca-8c81-bd4c8a77a345 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:09.989471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2965025-c5b3-43ca-8c81-bd4c8a77a345 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:09.990292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2965025-c5b3-43ca-8c81-bd4c8a77a345 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:09.990760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2965025-c5b3-43ca-8c81-bd4c8a77a345 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:09.993318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2965025-c5b3-43ca-8c81-bd4c8a77a345 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:10.052328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-c2965025-c5b3-43ca-8c81-bd4c8a77a345 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:12:10.165270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c2965025-c5b3-43ca-8c81-bd4c8a77a345 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:10.179310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2965025-c5b3-43ca-8c81-bd4c8a77a345 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:10.182993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2965025-c5b3-43ca-8c81-bd4c8a77a345 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:10.184462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2965025-c5b3-43ca-8c81-bd4c8a77a345 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:10.386616 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c2965025-c5b3-43ca-8c81-bd4c8a77a345 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.453169 Oct 29 01:12:10.389001 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1066/2104] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:12:09 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:10.406611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dd85f28a-b59d-4ce0-88bf-479e530524bc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:10.413747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dd85f28a-b59d-4ce0-88bf-479e530524bc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:10.417199 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-555b20a0-2410-4f54-9195-138dc740b71c tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/54db7ceb-0313-4240-9bc5-709b1a0b438c" status: 202 len: 0 microversion: 2.1 time: 0.619660 Oct 29 01:12:10.427374 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1039/2105] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:12:09 2022] DELETE /compute/v2.1/os-security-groups/54db7ceb-0313-4240-9bc5-709b1a0b438c => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:12:10.453349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6ec35d64-99fc-4d66-b34e-50aadd6af40b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:10.467376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd85f28a-b59d-4ce0-88bf-479e530524bc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:10.467926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd85f28a-b59d-4ce0-88bf-479e530524bc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:10.468404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd85f28a-b59d-4ce0-88bf-479e530524bc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:10.469126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd85f28a-b59d-4ce0-88bf-479e530524bc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:10.493225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd85f28a-b59d-4ce0-88bf-479e530524bc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:10.493708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd85f28a-b59d-4ce0-88bf-479e530524bc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:10.513010 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6ec35d64-99fc-4d66-b34e-50aadd6af40b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.077388 Oct 29 01:12:10.519227 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1040/2106] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:12:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:10.544102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f193aa5d-8cb6-4815-9cfb-b3a765cba785 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d9fefcdc0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:10.914696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dd85f28a-b59d-4ce0-88bf-479e530524bc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:10.928891 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dd85f28a-b59d-4ce0-88bf-479e530524bc tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1508 microversion: 2.1 time: 0.539933 Oct 29 01:12:10.930302 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1067/2107] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:10 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1508 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:10.936374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7fb4bfd5-b9ce-49aa-a201-442dbf2b7ea0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:10.937001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7fb4bfd5-b9ce-49aa-a201-442dbf2b7ea0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:10.956018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fb4bfd5-b9ce-49aa-a201-442dbf2b7ea0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:10.956018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fb4bfd5-b9ce-49aa-a201-442dbf2b7ea0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:10.956388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fb4bfd5-b9ce-49aa-a201-442dbf2b7ea0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:10.959027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fb4bfd5-b9ce-49aa-a201-442dbf2b7ea0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:10.960932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fb4bfd5-b9ce-49aa-a201-442dbf2b7ea0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:10.962694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fb4bfd5-b9ce-49aa-a201-442dbf2b7ea0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:11.126274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7fb4bfd5-b9ce-49aa-a201-442dbf2b7ea0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:11.135814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7fb4bfd5-b9ce-49aa-a201-442dbf2b7ea0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:11.136812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7fb4bfd5-b9ce-49aa-a201-442dbf2b7ea0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:11.138025 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7fb4bfd5-b9ce-49aa-a201-442dbf2b7ea0 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.206924 Oct 29 01:12:11.138586 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1068/2108] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:10 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:11.182894 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f193aa5d-8cb6-4815-9cfb-b3a765cba785 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/c654ac84-64b7-4e88-bce7-0856dce2f880" status: 202 len: 0 microversion: 2.1 time: 0.659189 Oct 29 01:12:11.183551 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1041/2109] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:12:10 2022] DELETE /compute/v2.1/os-security-groups/c654ac84-64b7-4e88-bce7-0856dce2f880 => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:12:11.205529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4d3234e2-0508-4924-b9a7-561613933a38 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:11.206086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4d3234e2-0508-4924-b9a7-561613933a38 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:11.210509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:11.215395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d3234e2-0508-4924-b9a7-561613933a38 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:11.216308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d3234e2-0508-4924-b9a7-561613933a38 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:11.216945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d3234e2-0508-4924-b9a7-561613933a38 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:11.218729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d3234e2-0508-4924-b9a7-561613933a38 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:11.220430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d3234e2-0508-4924-b9a7-561613933a38 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:11.230240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d3234e2-0508-4924-b9a7-561613933a38 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:11.262042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4d3234e2-0508-4924-b9a7-561613933a38 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:12:11.278658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:11.325488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-23640003-e6a4-4af9-9da9-3f98f4dc91d2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1045017993", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:11.394107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-23640003-e6a4-4af9-9da9-3f98f4dc91d2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] validate_networks() for None {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:12:11.608430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-23640003-e6a4-4af9-9da9-3f98f4dc91d2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:12:11.608852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-23640003-e6a4-4af9-9da9-3f98f4dc91d2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:12:11.609773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-23640003-e6a4-4af9-9da9-3f98f4dc91d2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:12:11.611097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-23640003-e6a4-4af9-9da9-3f98f4dc91d2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:12:11.611702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-23640003-e6a4-4af9-9da9-3f98f4dc91d2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:12:11.620990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23640003-e6a4-4af9-9da9-3f98f4dc91d2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:11.621518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23640003-e6a4-4af9-9da9-3f98f4dc91d2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:11.621965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23640003-e6a4-4af9-9da9-3f98f4dc91d2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:11.628387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23640003-e6a4-4af9-9da9-3f98f4dc91d2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:11.628387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23640003-e6a4-4af9-9da9-3f98f4dc91d2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:11.628387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23640003-e6a4-4af9-9da9-3f98f4dc91d2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:11.644975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-23640003-e6a4-4af9-9da9-3f98f4dc91d2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Getting quotas for project 36a174adc9794d23b38c2bafd8a3f1c6. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:12:11.651553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-23640003-e6a4-4af9-9da9-3f98f4dc91d2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Getting quotas for user 34a454a03ab64d4eab179c11a5165ce0 and project 36a174adc9794d23b38c2bafd8a3f1c6. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:12:11.679765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-23640003-e6a4-4af9-9da9-3f98f4dc91d2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:12:11.683119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-23640003-e6a4-4af9-9da9-3f98f4dc91d2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:12:11.711527 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4d3234e2-0508-4924-b9a7-561613933a38 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 204 len: 0 microversion: 2.1 time: 0.521722 Oct 29 01:12:11.711527 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1042/2110] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:12:11 2022] DELETE /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:12:11.715693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-11d052c8-42da-45d9-8c4d-2de75a44482d tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Action: 'create', calling method: .version_select at 0x7f9d9ff129d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1869621540", "description": "tempest-description-1600498013"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:11.880613 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-23640003-e6a4-4af9-9da9-3f98f4dc91d2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740241 Oct 29 01:12:11.881974 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1069/2111] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:12:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:12:11.888042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ed9f3cb8-1639-4c04-ae78-1a094e37973f tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:11.888922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ed9f3cb8-1639-4c04-ae78-1a094e37973f tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:11.898813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed9f3cb8-1639-4c04-ae78-1a094e37973f tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:11.898813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed9f3cb8-1639-4c04-ae78-1a094e37973f tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:11.898813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed9f3cb8-1639-4c04-ae78-1a094e37973f tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:11.898813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed9f3cb8-1639-4c04-ae78-1a094e37973f tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:11.900065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed9f3cb8-1639-4c04-ae78-1a094e37973f tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:11.900606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed9f3cb8-1639-4c04-ae78-1a094e37973f tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:12.130986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ed9f3cb8-1639-4c04-ae78-1a094e37973f tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:12.139540 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ed9f3cb8-1639-4c04-ae78-1a094e37973f tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1699 microversion: 2.1 time: 0.256281 Oct 29 01:12:12.145253 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1070/2112] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:11 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1699 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:12.147322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3278ab8b-b6d2-4133-ae5c-6ffe432ff6fd tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:12.147939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3278ab8b-b6d2-4133-ae5c-6ffe432ff6fd tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:12.204745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3278ab8b-b6d2-4133-ae5c-6ffe432ff6fd tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:12.211832 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3278ab8b-b6d2-4133-ae5c-6ffe432ff6fd tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1217 microversion: 2.1 time: 0.069354 Oct 29 01:12:12.212412 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1071/2113] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:12 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:12.216912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ee3d541e-510e-48e2-a414-caeb963ed4c5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:12.217557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ee3d541e-510e-48e2-a414-caeb963ed4c5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:12.224190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee3d541e-510e-48e2-a414-caeb963ed4c5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:12.224670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee3d541e-510e-48e2-a414-caeb963ed4c5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:12.228959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee3d541e-510e-48e2-a414-caeb963ed4c5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:12.228959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee3d541e-510e-48e2-a414-caeb963ed4c5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:12.228959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee3d541e-510e-48e2-a414-caeb963ed4c5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:12.228959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee3d541e-510e-48e2-a414-caeb963ed4c5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:12.309696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=12 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:12.399590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ee3d541e-510e-48e2-a414-caeb963ed4c5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:12.407693 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ee3d541e-510e-48e2-a414-caeb963ed4c5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1508 microversion: 2.1 time: 0.194222 Oct 29 01:12:12.408856 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1072/2114] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:12 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:12.416785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-75d76e5a-803f-4f70-b010-9deb3717bd9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:12.425394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-75d76e5a-803f-4f70-b010-9deb3717bd9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:12.425767 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-11d052c8-42da-45d9-8c4d-2de75a44482d tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.710103 Oct 29 01:12:12.425767 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1043/2115] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:12:11 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:12.425952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:12.428259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75d76e5a-803f-4f70-b010-9deb3717bd9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:12.428748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75d76e5a-803f-4f70-b010-9deb3717bd9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:12.429218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75d76e5a-803f-4f70-b010-9deb3717bd9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:12.430155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75d76e5a-803f-4f70-b010-9deb3717bd9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:12.432070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75d76e5a-803f-4f70-b010-9deb3717bd9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:12.432719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75d76e5a-803f-4f70-b010-9deb3717bd9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:12.446504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7ba34dcd-4c3b-43bf-81bb-e10fce921c12 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Action: 'update', calling method: .version_select at 0x7f9d9c336b80>, body: {"security_group": {"name": "tempest-sg-hth-2015267901", "description": "tempest-description-hth-1340241066"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:12.692452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-75d76e5a-803f-4f70-b010-9deb3717bd9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:12.706512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-75d76e5a-803f-4f70-b010-9deb3717bd9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:12.710210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-75d76e5a-803f-4f70-b010-9deb3717bd9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:12.710210 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-75d76e5a-803f-4f70-b010-9deb3717bd9a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.297019 Oct 29 01:12:12.711282 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1073/2116] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:12 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:12.794900 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7ba34dcd-4c3b-43bf-81bb-e10fce921c12 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "PUT /compute/v2.1/os-security-groups/5e6fb3f4-5eb2-4175-beb9-1414b9b1afb9" status: 200 len: 218 microversion: 2.1 time: 0.359206 Oct 29 01:12:12.796274 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1044/2117] 10.222.0.26 () {60 vars in 1290 bytes} [Sat Oct 29 01:12:12 2022] PUT /compute/v2.1/os-security-groups/5e6fb3f4-5eb2-4175-beb9-1414b9b1afb9 => generated 218 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:12.810420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7d80c512-cf3e-4653-a342-8c374a511f37 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d9fe488b0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:12.883014 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7d80c512-cf3e-4653-a342-8c374a511f37 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/5e6fb3f4-5eb2-4175-beb9-1414b9b1afb9" status: 200 len: 218 microversion: 2.1 time: 0.078195 Oct 29 01:12:12.884205 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1074/2118] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 29 01:12:12 2022] GET /compute/v2.1/os-security-groups/5e6fb3f4-5eb2-4175-beb9-1414b9b1afb9 => generated 218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:12.898702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-93190371-c25c-499c-ba79-c00db74c7cf6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d9ff4a310>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:13.186372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eff99e12-34d9-4b39-817f-3d8a54cb0187 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:13.187663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eff99e12-34d9-4b39-817f-3d8a54cb0187 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:13.207343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eff99e12-34d9-4b39-817f-3d8a54cb0187 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:13.207343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eff99e12-34d9-4b39-817f-3d8a54cb0187 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:13.207343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eff99e12-34d9-4b39-817f-3d8a54cb0187 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:13.207343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eff99e12-34d9-4b39-817f-3d8a54cb0187 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:13.207343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eff99e12-34d9-4b39-817f-3d8a54cb0187 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:13.208502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eff99e12-34d9-4b39-817f-3d8a54cb0187 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:13.255052 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-93190371-c25c-499c-ba79-c00db74c7cf6 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/5e6fb3f4-5eb2-4175-beb9-1414b9b1afb9" status: 202 len: 0 microversion: 2.1 time: 0.360462 Oct 29 01:12:13.255865 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1045/2119] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:12:12 2022] DELETE /compute/v2.1/os-security-groups/5e6fb3f4-5eb2-4175-beb9-1414b9b1afb9 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:12:13.260771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e33de7b6-1804-4959-8b7c-f70f7253aa96 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:13.261543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e33de7b6-1804-4959-8b7c-f70f7253aa96 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:13.345965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e33de7b6-1804-4959-8b7c-f70f7253aa96 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:13.357175 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e33de7b6-1804-4959-8b7c-f70f7253aa96 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1217 microversion: 2.1 time: 0.099025 Oct 29 01:12:13.358637 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1046/2120] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:13 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:13.375448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6a43b2ab-81c3-4f6f-ac69-ced0bb9823d8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:13.376558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6a43b2ab-81c3-4f6f-ac69-ced0bb9823d8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:13.393048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a43b2ab-81c3-4f6f-ac69-ced0bb9823d8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:13.396065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a43b2ab-81c3-4f6f-ac69-ced0bb9823d8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:13.396777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a43b2ab-81c3-4f6f-ac69-ced0bb9823d8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:13.397692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a43b2ab-81c3-4f6f-ac69-ced0bb9823d8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:13.399810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a43b2ab-81c3-4f6f-ac69-ced0bb9823d8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:13.400359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a43b2ab-81c3-4f6f-ac69-ced0bb9823d8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:13.429944 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-6a43b2ab-81c3-4f6f-ac69-ced0bb9823d8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] HTTP exception thrown: Instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 could not be found. Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6a43b2ab-81c3-4f6f-ac69-ced0bb9823d8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Request method failure captured: Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 HTTP/1.1 Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH2dSOm6Gvr_7yReO_KK4LyiJmxHEpSHznGvK-Vwrpwo4GWP7Ab5YXTZuGsu1pNtwHZhTwV9418WfJZZN41caWcz_If-orG4TOArgMozy0kdFl7uiee1-gBfdA2Tv8rwYvLMwbreSpyPQ3JrbABZf0uK1xwJ_TuKV00PeAfDDKvVrXo Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_294bcfcd48fb4cf3b3744e74498a9f73", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: f6e18fc75c774452bcc89f4cb817e545 Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 could not be found. Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '97b3a48e-461b-4552-9d73-03c22ae8ce57'} Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 could not be found. Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:12:13.439380 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:12:13.447941 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 could not be found. Oct 29 01:12:13.447941 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.447941 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.447941 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.447941 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.447941 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:13.447941 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:13.447941 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:12:13.447941 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:12:13.447941 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 could not be found. Oct 29 01:12:13.447941 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.447941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6a43b2ab-81c3-4f6f-ac69-ced0bb9823d8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Returning 404 to user: Instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:12:13.447941 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6a43b2ab-81c3-4f6f-ac69-ced0bb9823d8 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 404 len: 111 microversion: 2.1 time: 0.077891 Oct 29 01:12:13.447941 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1047/2121] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:12:13 2022] DELETE /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:12:13.457134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f863c1fc-d5d0-4072-8e22-7e57ebed6342 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:13.458218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f863c1fc-d5d0-4072-8e22-7e57ebed6342 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:13.462102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eff99e12-34d9-4b39-817f-3d8a54cb0187 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:13.465489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f863c1fc-d5d0-4072-8e22-7e57ebed6342 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:13.466506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f863c1fc-d5d0-4072-8e22-7e57ebed6342 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:13.466506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f863c1fc-d5d0-4072-8e22-7e57ebed6342 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:13.467128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f863c1fc-d5d0-4072-8e22-7e57ebed6342 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:13.467587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f863c1fc-d5d0-4072-8e22-7e57ebed6342 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:13.468024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f863c1fc-d5d0-4072-8e22-7e57ebed6342 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:13.471163 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eff99e12-34d9-4b39-817f-3d8a54cb0187 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1699 microversion: 2.1 time: 0.309978 Oct 29 01:12:13.473034 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1075/2122] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:13 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1699 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:13.477865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-51bfc47d-a00d-4958-ab1e-2669010d0034 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:13.479333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-51bfc47d-a00d-4958-ab1e-2669010d0034 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 97b3a48e-461b-4552-9d73-03c22ae8ce57] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:13.487323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51bfc47d-a00d-4958-ab1e-2669010d0034 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:13.488177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51bfc47d-a00d-4958-ab1e-2669010d0034 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:13.489552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51bfc47d-a00d-4958-ab1e-2669010d0034 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:13.489998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51bfc47d-a00d-4958-ab1e-2669010d0034 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:13.490755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51bfc47d-a00d-4958-ab1e-2669010d0034 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:13.491589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51bfc47d-a00d-4958-ab1e-2669010d0034 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:13.511153 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-51bfc47d-a00d-4958-ab1e-2669010d0034 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] HTTP exception thrown: Instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 could not be found. Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-51bfc47d-a00d-4958-ab1e-2669010d0034 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Request method failure captured: Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 HTTP/1.1 Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH2dSOm6Gvr_7yReO_KK4LyiJmxHEpSHznGvK-Vwrpwo4GWP7Ab5YXTZuGsu1pNtwHZhTwV9418WfJZZN41caWcz_If-orG4TOArgMozy0kdFl7uiee1-gBfdA2Tv8rwYvLMwbreSpyPQ3JrbABZf0uK1xwJ_TuKV00PeAfDDKvVrXo Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_294bcfcd48fb4cf3b3744e74498a9f73", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f6e18fc75c774452bcc89f4cb817e545 Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 could not be found. Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '97b3a48e-461b-4552-9d73-03c22ae8ce57'} Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 could not be found. Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 could not be found. Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.515330 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.521739 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.521739 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:13.521739 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:13.521739 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:12:13.521739 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:12:13.521739 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 could not be found. Oct 29 01:12:13.521739 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.523577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-51bfc47d-a00d-4958-ab1e-2669010d0034 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Returning 404 to user: Instance 97b3a48e-461b-4552-9d73-03c22ae8ce57 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:12:13.524463 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-51bfc47d-a00d-4958-ab1e-2669010d0034 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57" status: 404 len: 111 microversion: 2.1 time: 0.051264 Oct 29 01:12:13.525385 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1076/2123] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:13 2022] GET /compute/v2.1/servers/97b3a48e-461b-4552-9d73-03c22ae8ce57 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:12:13.534260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-52af52b9-bb51-4215-b4f8-149f8a446cf5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d9ff3d1f0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:13.592833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG neutronclient.v2_0.client [None req-52af52b9-bb51-4215-b4f8-149f8a446cf5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c654ac84-64b7-4e88-bce7-0856dce2f880 does not exist", "detail": ""}} {{(pid=121099) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:12:13.593598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.security_group_api [None req-52af52b9-bb51-4215-b4f8-149f8a446cf5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Neutron security group c654ac84-64b7-4e88-bce7-0856dce2f880 not found {{(pid=121099) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 01:12:13.595352 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-52af52b9-bb51-4215-b4f8-149f8a446cf5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] HTTP exception thrown: Security group c654ac84-64b7-4e88-bce7-0856dce2f880 does not exist Oct 29 01:12:13.595352 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-84bd0b7d-faf1-48ee-87af-aee6b5dd6c99'] Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-52af52b9-bb51-4215-b4f8-149f8a446cf5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Request method failure captured: Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/os-security-groups/c654ac84-64b7-4e88-bce7-0856dce2f880 HTTP/1.1 Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH2dSOm6Gvr_7yReO_KK4LyiJmxHEpSHznGvK-Vwrpwo4GWP7Ab5YXTZuGsu1pNtwHZhTwV9418WfJZZN41caWcz_If-orG4TOArgMozy0kdFl7uiee1-gBfdA2Tv8rwYvLMwbreSpyPQ3JrbABZf0uK1xwJ_TuKV00PeAfDDKvVrXo Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_294bcfcd48fb4cf3b3744e74498a9f73", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f6e18fc75c774452bcc89f4cb817e545 Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: exception: Security group c654ac84-64b7-4e88-bce7-0856dce2f880 does not exist Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-84bd0b7d-faf1-48ee-87af-aee6b5dd6c99'] Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'c654ac84-64b7-4e88-bce7-0856dce2f880'} Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:12:13.597996 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c654ac84-64b7-4e88-bce7-0856dce2f880 does not exist Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84bd0b7d-faf1-48ee-87af-aee6b5dd6c99'] Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c654ac84-64b7-4e88-bce7-0856dce2f880 does not exist Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84bd0b7d-faf1-48ee-87af-aee6b5dd6c99'] Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c654ac84-64b7-4e88-bce7-0856dce2f880 does not exist Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84bd0b7d-faf1-48ee-87af-aee6b5dd6c99'] Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c654ac84-64b7-4e88-bce7-0856dce2f880 does not exist Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84bd0b7d-faf1-48ee-87af-aee6b5dd6c99'] Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-52af52b9-bb51-4215-b4f8-149f8a446cf5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Returning 404 to user: Security group c654ac84-64b7-4e88-bce7-0856dce2f880 does not exist Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-84bd0b7d-faf1-48ee-87af-aee6b5dd6c99'] {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-52af52b9-bb51-4215-b4f8-149f8a446cf5 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/c654ac84-64b7-4e88-bce7-0856dce2f880" status: 404 len: 194 microversion: 2.1 time: 0.072003 Oct 29 01:12:13.608291 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1077/2124] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:12:13 2022] DELETE /compute/v2.1/os-security-groups/c654ac84-64b7-4e88-bce7-0856dce2f880 => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:12:13.616912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a7d62041-9fe1-4837-9873-dd237f0ec810 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d9fe484c0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:13.665035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG neutronclient.v2_0.client [None req-a7d62041-9fe1-4837-9873-dd237f0ec810 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 54db7ceb-0313-4240-9bc5-709b1a0b438c does not exist", "detail": ""}} {{(pid=121099) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:12:13.666062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.security_group_api [None req-a7d62041-9fe1-4837-9873-dd237f0ec810 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Neutron security group 54db7ceb-0313-4240-9bc5-709b1a0b438c not found {{(pid=121099) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 01:12:13.666861 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-a7d62041-9fe1-4837-9873-dd237f0ec810 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] HTTP exception thrown: Security group 54db7ceb-0313-4240-9bc5-709b1a0b438c does not exist Oct 29 01:12:13.666861 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-de31a340-73f1-4c9a-85ff-c6656ebdf6fc'] Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a7d62041-9fe1-4837-9873-dd237f0ec810 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Request method failure captured: Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/os-security-groups/54db7ceb-0313-4240-9bc5-709b1a0b438c HTTP/1.1 Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH2dSOm6Gvr_7yReO_KK4LyiJmxHEpSHznGvK-Vwrpwo4GWP7Ab5YXTZuGsu1pNtwHZhTwV9418WfJZZN41caWcz_If-orG4TOArgMozy0kdFl7uiee1-gBfdA2Tv8rwYvLMwbreSpyPQ3JrbABZf0uK1xwJ_TuKV00PeAfDDKvVrXo Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_294bcfcd48fb4cf3b3744e74498a9f73", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f6e18fc75c774452bcc89f4cb817e545 Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: exception: Security group 54db7ceb-0313-4240-9bc5-709b1a0b438c does not exist Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-de31a340-73f1-4c9a-85ff-c6656ebdf6fc'] Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '54db7ceb-0313-4240-9bc5-709b1a0b438c'} Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:12:13.668981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 54db7ceb-0313-4240-9bc5-709b1a0b438c does not exist Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de31a340-73f1-4c9a-85ff-c6656ebdf6fc'] Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 54db7ceb-0313-4240-9bc5-709b1a0b438c does not exist Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de31a340-73f1-4c9a-85ff-c6656ebdf6fc'] Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 54db7ceb-0313-4240-9bc5-709b1a0b438c does not exist Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de31a340-73f1-4c9a-85ff-c6656ebdf6fc'] Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 54db7ceb-0313-4240-9bc5-709b1a0b438c does not exist Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de31a340-73f1-4c9a-85ff-c6656ebdf6fc'] Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a7d62041-9fe1-4837-9873-dd237f0ec810 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Returning 404 to user: Security group 54db7ceb-0313-4240-9bc5-709b1a0b438c does not exist Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-de31a340-73f1-4c9a-85ff-c6656ebdf6fc'] {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a7d62041-9fe1-4837-9873-dd237f0ec810 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/54db7ceb-0313-4240-9bc5-709b1a0b438c" status: 404 len: 194 microversion: 2.1 time: 0.063668 Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1078/2125] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:12:13 2022] DELETE /compute/v2.1/os-security-groups/54db7ceb-0313-4240-9bc5-709b1a0b438c => generated 194 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:12:13.680268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fa90bf35-ab0f-46d8-9b9b-111e9f6955af tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d9ff3dca0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:13.732370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG neutronclient.v2_0.client [None req-fa90bf35-ab0f-46d8-9b9b-111e9f6955af tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4d6ee0d9-1208-4314-8ce6-499723d6aa1b does not exist", "detail": ""}} {{(pid=121099) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:12:13.732999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.security_group_api [None req-fa90bf35-ab0f-46d8-9b9b-111e9f6955af tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Neutron security group 4d6ee0d9-1208-4314-8ce6-499723d6aa1b not found {{(pid=121099) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 01:12:13.734329 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-fa90bf35-ab0f-46d8-9b9b-111e9f6955af tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] HTTP exception thrown: Security group 4d6ee0d9-1208-4314-8ce6-499723d6aa1b does not exist Oct 29 01:12:13.734329 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-3ce4368b-501d-4419-a739-612cc2a673e2'] Oct 29 01:12:13.739710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f863c1fc-d5d0-4072-8e22-7e57ebed6342 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fa90bf35-ab0f-46d8-9b9b-111e9f6955af tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Request method failure captured: Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/os-security-groups/4d6ee0d9-1208-4314-8ce6-499723d6aa1b HTTP/1.1 Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH2dSOm6Gvr_7yReO_KK4LyiJmxHEpSHznGvK-Vwrpwo4GWP7Ab5YXTZuGsu1pNtwHZhTwV9418WfJZZN41caWcz_If-orG4TOArgMozy0kdFl7uiee1-gBfdA2Tv8rwYvLMwbreSpyPQ3JrbABZf0uK1xwJ_TuKV00PeAfDDKvVrXo Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_294bcfcd48fb4cf3b3744e74498a9f73", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f6e18fc75c774452bcc89f4cb817e545 Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: exception: Security group 4d6ee0d9-1208-4314-8ce6-499723d6aa1b does not exist Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-3ce4368b-501d-4419-a739-612cc2a673e2'] Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '4d6ee0d9-1208-4314-8ce6-499723d6aa1b'} Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:12:13.746066 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4d6ee0d9-1208-4314-8ce6-499723d6aa1b does not exist Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ce4368b-501d-4419-a739-612cc2a673e2'] Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4d6ee0d9-1208-4314-8ce6-499723d6aa1b does not exist Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ce4368b-501d-4419-a739-612cc2a673e2'] Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4d6ee0d9-1208-4314-8ce6-499723d6aa1b does not exist Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ce4368b-501d-4419-a739-612cc2a673e2'] Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4d6ee0d9-1208-4314-8ce6-499723d6aa1b does not exist Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ce4368b-501d-4419-a739-612cc2a673e2'] Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fa90bf35-ab0f-46d8-9b9b-111e9f6955af tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Returning 404 to user: Security group 4d6ee0d9-1208-4314-8ce6-499723d6aa1b does not exist Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-3ce4368b-501d-4419-a739-612cc2a673e2'] {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:12:13.750838 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fa90bf35-ab0f-46d8-9b9b-111e9f6955af tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/4d6ee0d9-1208-4314-8ce6-499723d6aa1b" status: 404 len: 194 microversion: 2.1 time: 0.071680 Oct 29 01:12:13.774049 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f863c1fc-d5d0-4072-8e22-7e57ebed6342 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1508 microversion: 2.1 time: 0.307410 Oct 29 01:12:13.774049 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1048/2126] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:13 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1508 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:13.774648 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1079/2127] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:12:13 2022] DELETE /compute/v2.1/os-security-groups/4d6ee0d9-1208-4314-8ce6-499723d6aa1b => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:12:13.774648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6a4f5d04-15c4-4e43-8390-46fc61c74462 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d9fd934c0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:13.775189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-515d5851-f84c-4fe1-8d06-47dc2f5eece5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:13.775189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-515d5851-f84c-4fe1-8d06-47dc2f5eece5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:13.775189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-515d5851-f84c-4fe1-8d06-47dc2f5eece5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:13.775189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-515d5851-f84c-4fe1-8d06-47dc2f5eece5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:13.775189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-515d5851-f84c-4fe1-8d06-47dc2f5eece5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:13.775189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-515d5851-f84c-4fe1-8d06-47dc2f5eece5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:13.775189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-515d5851-f84c-4fe1-8d06-47dc2f5eece5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:13.785009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG neutronclient.v2_0.client [None req-6a4f5d04-15c4-4e43-8390-46fc61c74462 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8b205a22-41d8-456d-a7df-22bf92d2b852 does not exist", "detail": ""}} {{(pid=121099) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:12:13.785626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-515d5851-f84c-4fe1-8d06-47dc2f5eece5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:13.786107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.security_group_api [None req-6a4f5d04-15c4-4e43-8390-46fc61c74462 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Neutron security group 8b205a22-41d8-456d-a7df-22bf92d2b852 not found {{(pid=121099) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 01:12:13.786731 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-6a4f5d04-15c4-4e43-8390-46fc61c74462 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] HTTP exception thrown: Security group 8b205a22-41d8-456d-a7df-22bf92d2b852 does not exist Oct 29 01:12:13.786731 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-54faef99-6ed7-4a50-abe3-321920f47638'] Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6a4f5d04-15c4-4e43-8390-46fc61c74462 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Request method failure captured: Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/os-security-groups/8b205a22-41d8-456d-a7df-22bf92d2b852 HTTP/1.1 Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH2dSOm6Gvr_7yReO_KK4LyiJmxHEpSHznGvK-Vwrpwo4GWP7Ab5YXTZuGsu1pNtwHZhTwV9418WfJZZN41caWcz_If-orG4TOArgMozy0kdFl7uiee1-gBfdA2Tv8rwYvLMwbreSpyPQ3JrbABZf0uK1xwJ_TuKV00PeAfDDKvVrXo Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_294bcfcd48fb4cf3b3744e74498a9f73", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f6e18fc75c774452bcc89f4cb817e545 Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: exception: Security group 8b205a22-41d8-456d-a7df-22bf92d2b852 does not exist Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-54faef99-6ed7-4a50-abe3-321920f47638'] Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '8b205a22-41d8-456d-a7df-22bf92d2b852'} Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:12:13.790466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8b205a22-41d8-456d-a7df-22bf92d2b852 does not exist Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54faef99-6ed7-4a50-abe3-321920f47638'] Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8b205a22-41d8-456d-a7df-22bf92d2b852 does not exist Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54faef99-6ed7-4a50-abe3-321920f47638'] Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8b205a22-41d8-456d-a7df-22bf92d2b852 does not exist Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54faef99-6ed7-4a50-abe3-321920f47638'] Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8b205a22-41d8-456d-a7df-22bf92d2b852 does not exist Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54faef99-6ed7-4a50-abe3-321920f47638'] Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6a4f5d04-15c4-4e43-8390-46fc61c74462 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Returning 404 to user: Security group 8b205a22-41d8-456d-a7df-22bf92d2b852 does not exist Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-54faef99-6ed7-4a50-abe3-321920f47638'] {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6a4f5d04-15c4-4e43-8390-46fc61c74462 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/8b205a22-41d8-456d-a7df-22bf92d2b852" status: 404 len: 194 microversion: 2.1 time: 0.039225 Oct 29 01:12:13.798804 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1080/2128] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:12:13 2022] DELETE /compute/v2.1/os-security-groups/8b205a22-41d8-456d-a7df-22bf92d2b852 => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:12:13.804182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-96955698-8b53-4ca6-b60f-e309d37893f1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d9ff3d310>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:13.845350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG neutronclient.v2_0.client [None req-96955698-8b53-4ca6-b60f-e309d37893f1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6e386821-6ff4-4d80-a4ae-db2ef6ea0812 does not exist", "detail": ""}} {{(pid=121099) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:12:13.846272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.security_group_api [None req-96955698-8b53-4ca6-b60f-e309d37893f1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Neutron security group 6e386821-6ff4-4d80-a4ae-db2ef6ea0812 not found {{(pid=121099) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 01:12:13.846897 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-96955698-8b53-4ca6-b60f-e309d37893f1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] HTTP exception thrown: Security group 6e386821-6ff4-4d80-a4ae-db2ef6ea0812 does not exist Oct 29 01:12:13.846897 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-c581aa1b-413d-4712-86f2-69917a6970c0'] Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-96955698-8b53-4ca6-b60f-e309d37893f1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Request method failure captured: Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/os-security-groups/6e386821-6ff4-4d80-a4ae-db2ef6ea0812 HTTP/1.1 Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH2dSOm6Gvr_7yReO_KK4LyiJmxHEpSHznGvK-Vwrpwo4GWP7Ab5YXTZuGsu1pNtwHZhTwV9418WfJZZN41caWcz_If-orG4TOArgMozy0kdFl7uiee1-gBfdA2Tv8rwYvLMwbreSpyPQ3JrbABZf0uK1xwJ_TuKV00PeAfDDKvVrXo Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_294bcfcd48fb4cf3b3744e74498a9f73", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f6e18fc75c774452bcc89f4cb817e545 Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: exception: Security group 6e386821-6ff4-4d80-a4ae-db2ef6ea0812 does not exist Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-c581aa1b-413d-4712-86f2-69917a6970c0'] Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '6e386821-6ff4-4d80-a4ae-db2ef6ea0812'} Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:12:13.850080 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6e386821-6ff4-4d80-a4ae-db2ef6ea0812 does not exist Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c581aa1b-413d-4712-86f2-69917a6970c0'] Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6e386821-6ff4-4d80-a4ae-db2ef6ea0812 does not exist Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c581aa1b-413d-4712-86f2-69917a6970c0'] Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6e386821-6ff4-4d80-a4ae-db2ef6ea0812 does not exist Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c581aa1b-413d-4712-86f2-69917a6970c0'] Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6e386821-6ff4-4d80-a4ae-db2ef6ea0812 does not exist Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c581aa1b-413d-4712-86f2-69917a6970c0'] Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-96955698-8b53-4ca6-b60f-e309d37893f1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Returning 404 to user: Security group 6e386821-6ff4-4d80-a4ae-db2ef6ea0812 does not exist Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-c581aa1b-413d-4712-86f2-69917a6970c0'] {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:12:13.855920 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-96955698-8b53-4ca6-b60f-e309d37893f1 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/6e386821-6ff4-4d80-a4ae-db2ef6ea0812" status: 404 len: 194 microversion: 2.1 time: 0.053090 Oct 29 01:12:13.864454 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1081/2129] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:12:13 2022] DELETE /compute/v2.1/os-security-groups/6e386821-6ff4-4d80-a4ae-db2ef6ea0812 => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:12:13.879193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-670f17e1-163a-4131-a973-5c9eac6684f0 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d9fe48160>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:13.940150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG neutronclient.v2_0.client [None req-670f17e1-163a-4131-a973-5c9eac6684f0 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 36d500ea-3f27-410b-9efd-938d3c3b7eb4 does not exist", "detail": ""}} {{(pid=121099) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:12:13.942392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.security_group_api [None req-670f17e1-163a-4131-a973-5c9eac6684f0 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Neutron security group 36d500ea-3f27-410b-9efd-938d3c3b7eb4 not found {{(pid=121099) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 01:12:13.958665 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-670f17e1-163a-4131-a973-5c9eac6684f0 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] HTTP exception thrown: Security group 36d500ea-3f27-410b-9efd-938d3c3b7eb4 does not exist Oct 29 01:12:13.958665 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-72c2ecf0-fb17-4c8b-80a3-d58366709eae'] Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-670f17e1-163a-4131-a973-5c9eac6684f0 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Request method failure captured: Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/os-security-groups/36d500ea-3f27-410b-9efd-938d3c3b7eb4 HTTP/1.1 Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH2dSOm6Gvr_7yReO_KK4LyiJmxHEpSHznGvK-Vwrpwo4GWP7Ab5YXTZuGsu1pNtwHZhTwV9418WfJZZN41caWcz_If-orG4TOArgMozy0kdFl7uiee1-gBfdA2Tv8rwYvLMwbreSpyPQ3JrbABZf0uK1xwJ_TuKV00PeAfDDKvVrXo Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_294bcfcd48fb4cf3b3744e74498a9f73", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f6e18fc75c774452bcc89f4cb817e545 Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: exception: Security group 36d500ea-3f27-410b-9efd-938d3c3b7eb4 does not exist Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-72c2ecf0-fb17-4c8b-80a3-d58366709eae'] Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '36d500ea-3f27-410b-9efd-938d3c3b7eb4'} Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:12:13.962322 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 36d500ea-3f27-410b-9efd-938d3c3b7eb4 does not exist Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72c2ecf0-fb17-4c8b-80a3-d58366709eae'] Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 36d500ea-3f27-410b-9efd-938d3c3b7eb4 does not exist Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72c2ecf0-fb17-4c8b-80a3-d58366709eae'] Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 36d500ea-3f27-410b-9efd-938d3c3b7eb4 does not exist Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72c2ecf0-fb17-4c8b-80a3-d58366709eae'] Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 36d500ea-3f27-410b-9efd-938d3c3b7eb4 does not exist Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72c2ecf0-fb17-4c8b-80a3-d58366709eae'] Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-670f17e1-163a-4131-a973-5c9eac6684f0 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Returning 404 to user: Security group 36d500ea-3f27-410b-9efd-938d3c3b7eb4 does not exist Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-72c2ecf0-fb17-4c8b-80a3-d58366709eae'] {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-670f17e1-163a-4131-a973-5c9eac6684f0 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/36d500ea-3f27-410b-9efd-938d3c3b7eb4" status: 404 len: 194 microversion: 2.1 time: 0.102909 Oct 29 01:12:13.973557 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1082/2130] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:12:13 2022] DELETE /compute/v2.1/os-security-groups/36d500ea-3f27-410b-9efd-938d3c3b7eb4 => generated 194 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:12:13.984095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d45cd9a1-e77f-47b0-b4e2-944bb2f86edb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:13.984743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d45cd9a1-e77f-47b0-b4e2-944bb2f86edb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:13.994904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d45cd9a1-e77f-47b0-b4e2-944bb2f86edb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:13.995528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d45cd9a1-e77f-47b0-b4e2-944bb2f86edb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:13.996098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d45cd9a1-e77f-47b0-b4e2-944bb2f86edb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:13.997112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d45cd9a1-e77f-47b0-b4e2-944bb2f86edb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:13.997719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d45cd9a1-e77f-47b0-b4e2-944bb2f86edb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:13.998412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d45cd9a1-e77f-47b0-b4e2-944bb2f86edb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:14.032600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d45cd9a1-e77f-47b0-b4e2-944bb2f86edb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:12:14.045641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-515d5851-f84c-4fe1-8d06-47dc2f5eece5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:14.057592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-515d5851-f84c-4fe1-8d06-47dc2f5eece5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:14.059647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-515d5851-f84c-4fe1-8d06-47dc2f5eece5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:14.060813 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-515d5851-f84c-4fe1-8d06-47dc2f5eece5 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.307932 Oct 29 01:12:14.061566 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1049/2131] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:13 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:14.100613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:14.381999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-80d716e1-cb1c-4c4c-aa1a-885246c52386 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:14.382826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-80d716e1-cb1c-4c4c-aa1a-885246c52386 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:14.390106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80d716e1-cb1c-4c4c-aa1a-885246c52386 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:14.390664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80d716e1-cb1c-4c4c-aa1a-885246c52386 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:14.391617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80d716e1-cb1c-4c4c-aa1a-885246c52386 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:14.392592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80d716e1-cb1c-4c4c-aa1a-885246c52386 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:14.393055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80d716e1-cb1c-4c4c-aa1a-885246c52386 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:14.393534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80d716e1-cb1c-4c4c-aa1a-885246c52386 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:14.467256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-80d716e1-cb1c-4c4c-aa1a-885246c52386 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:14.478018 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d45cd9a1-e77f-47b0-b4e2-944bb2f86edb tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 204 len: 0 microversion: 2.1 time: 0.502812 Oct 29 01:12:14.478849 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-80d716e1-cb1c-4c4c-aa1a-885246c52386 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1213 microversion: 2.1 time: 0.101160 Oct 29 01:12:14.479588 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1083/2132] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:12:13 2022] DELETE /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:12:14.490860 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1050/2133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:14 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:14.491023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0a4de1c4-9527-427a-9f75-d671b8cc2302 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:14.492040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0a4de1c4-9527-427a-9f75-d671b8cc2302 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:14.502998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-052e56fd-1d18-4738-a554-f1bf874eab35 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:14.503728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-052e56fd-1d18-4738-a554-f1bf874eab35 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:14.504706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a4de1c4-9527-427a-9f75-d671b8cc2302 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:14.506021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a4de1c4-9527-427a-9f75-d671b8cc2302 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:14.506437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a4de1c4-9527-427a-9f75-d671b8cc2302 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:14.507168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a4de1c4-9527-427a-9f75-d671b8cc2302 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:14.507633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a4de1c4-9527-427a-9f75-d671b8cc2302 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:14.508063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a4de1c4-9527-427a-9f75-d671b8cc2302 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:14.512937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-052e56fd-1d18-4738-a554-f1bf874eab35 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:14.513766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-052e56fd-1d18-4738-a554-f1bf874eab35 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:14.517108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-052e56fd-1d18-4738-a554-f1bf874eab35 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:14.519436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-052e56fd-1d18-4738-a554-f1bf874eab35 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:14.520089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-052e56fd-1d18-4738-a554-f1bf874eab35 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:14.520603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-052e56fd-1d18-4738-a554-f1bf874eab35 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:14.753999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-052e56fd-1d18-4738-a554-f1bf874eab35 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:14.765338 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-052e56fd-1d18-4738-a554-f1bf874eab35 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1699 microversion: 2.1 time: 0.272936 Oct 29 01:12:14.782254 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1051/2134] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:14 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1699 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:14.787510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0f82dc15-49e6-4aec-a0a2-32d4ef6c6d1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:14.787897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0a4de1c4-9527-427a-9f75-d671b8cc2302 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:14.788663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0f82dc15-49e6-4aec-a0a2-32d4ef6c6d1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:14.795668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0f82dc15-49e6-4aec-a0a2-32d4ef6c6d1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:14.796350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0f82dc15-49e6-4aec-a0a2-32d4ef6c6d1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:14.796988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0f82dc15-49e6-4aec-a0a2-32d4ef6c6d1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:14.798507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0f82dc15-49e6-4aec-a0a2-32d4ef6c6d1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:14.799812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0f82dc15-49e6-4aec-a0a2-32d4ef6c6d1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:14.800749 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0a4de1c4-9527-427a-9f75-d671b8cc2302 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 200 len: 1648 microversion: 2.1 time: 0.316805 Oct 29 01:12:14.801295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0f82dc15-49e6-4aec-a0a2-32d4ef6c6d1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:14.801780 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1084/2135] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:14 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 1648 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:14.990747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0f82dc15-49e6-4aec-a0a2-32d4ef6c6d1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:15.001209 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0f82dc15-49e6-4aec-a0a2-32d4ef6c6d1b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1508 microversion: 2.1 time: 0.216866 Oct 29 01:12:15.002114 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1052/2136] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:14 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1508 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:15.092032 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c4aafec1-b2f1-4b9f-8a7e-5022b31cca9b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:15.092691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c4aafec1-b2f1-4b9f-8a7e-5022b31cca9b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:15.101037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4aafec1-b2f1-4b9f-8a7e-5022b31cca9b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:15.102109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4aafec1-b2f1-4b9f-8a7e-5022b31cca9b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:15.102968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4aafec1-b2f1-4b9f-8a7e-5022b31cca9b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:15.104037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4aafec1-b2f1-4b9f-8a7e-5022b31cca9b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:15.104739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4aafec1-b2f1-4b9f-8a7e-5022b31cca9b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:15.105721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4aafec1-b2f1-4b9f-8a7e-5022b31cca9b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:15.294188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c4aafec1-b2f1-4b9f-8a7e-5022b31cca9b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:15.305243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c4aafec1-b2f1-4b9f-8a7e-5022b31cca9b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:15.307118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c4aafec1-b2f1-4b9f-8a7e-5022b31cca9b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:15.308160 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c4aafec1-b2f1-4b9f-8a7e-5022b31cca9b tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.223032 Oct 29 01:12:15.308914 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1085/2137] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:15 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:15.504863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b849cffb-f7ae-462d-bcc0-95cfc3db41f4 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:15.505782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b849cffb-f7ae-462d-bcc0-95cfc3db41f4 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:15.513892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b849cffb-f7ae-462d-bcc0-95cfc3db41f4 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:15.513892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b849cffb-f7ae-462d-bcc0-95cfc3db41f4 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:15.514595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b849cffb-f7ae-462d-bcc0-95cfc3db41f4 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:15.516653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b849cffb-f7ae-462d-bcc0-95cfc3db41f4 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:15.517555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b849cffb-f7ae-462d-bcc0-95cfc3db41f4 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:15.518536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b849cffb-f7ae-462d-bcc0-95cfc3db41f4 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:15.533303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-c1eca577-2380-42e0-b6ae-1793a95b6e98 req-6f699a4c-d2c6-4c82-94ab-93324088b70b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a", "name": "network-vif-deleted", "tag": "99177002-b761-4c56-a7bb-5911f9934cca"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:15.551054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c1eca577-2380-42e0-b6ae-1793a95b6e98 req-6f699a4c-d2c6-4c82-94ab-93324088b70b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:15.553021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c1eca577-2380-42e0-b6ae-1793a95b6e98 req-6f699a4c-d2c6-4c82-94ab-93324088b70b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:15.553536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c1eca577-2380-42e0-b6ae-1793a95b6e98 req-6f699a4c-d2c6-4c82-94ab-93324088b70b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:15.582098 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-c1eca577-2380-42e0-b6ae-1793a95b6e98 req-6f699a4c-d2c6-4c82-94ab-93324088b70b service nova] Creating event network-vif-deleted:99177002-b761-4c56-a7bb-5911f9934cca for instance c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a on n-h2-862964-3 Oct 29 01:12:15.619078 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-c1eca577-2380-42e0-b6ae-1793a95b6e98 req-6f699a4c-d2c6-4c82-94ab-93324088b70b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090402 Oct 29 01:12:15.619707 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1086/2138] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:15.630125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b849cffb-f7ae-462d-bcc0-95cfc3db41f4 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:15.643592 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b849cffb-f7ae-462d-bcc0-95cfc3db41f4 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1269 microversion: 2.1 time: 0.142579 Oct 29 01:12:15.645833 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1053/2139] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:15 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1269 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:15.789115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-17753502-1496-4ada-aab0-2a07ab719df1 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:15.790100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-17753502-1496-4ada-aab0-2a07ab719df1 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:15.797090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17753502-1496-4ada-aab0-2a07ab719df1 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:15.799137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17753502-1496-4ada-aab0-2a07ab719df1 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:15.799137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17753502-1496-4ada-aab0-2a07ab719df1 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:15.799137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17753502-1496-4ada-aab0-2a07ab719df1 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:15.799426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17753502-1496-4ada-aab0-2a07ab719df1 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:15.799731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17753502-1496-4ada-aab0-2a07ab719df1 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:15.827349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7f3ed355-b1fd-4ad9-a660-75e7fcd5d57a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:15.829738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7f3ed355-b1fd-4ad9-a660-75e7fcd5d57a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:15.842379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7f3ed355-b1fd-4ad9-a660-75e7fcd5d57a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:15.843831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7f3ed355-b1fd-4ad9-a660-75e7fcd5d57a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:15.844499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7f3ed355-b1fd-4ad9-a660-75e7fcd5d57a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:15.845448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7f3ed355-b1fd-4ad9-a660-75e7fcd5d57a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:15.846085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7f3ed355-b1fd-4ad9-a660-75e7fcd5d57a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:15.851171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7f3ed355-b1fd-4ad9-a660-75e7fcd5d57a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:15.934374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-17753502-1496-4ada-aab0-2a07ab719df1 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:15.945412 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-17753502-1496-4ada-aab0-2a07ab719df1 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1354 microversion: 2.1 time: 0.160460 Oct 29 01:12:15.946322 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1087/2140] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:15 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1354 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:16.032428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a5e15b77-beb1-4178-849d-b555ce8a1593 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:16.033956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a5e15b77-beb1-4178-849d-b555ce8a1593 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:16.043107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a5e15b77-beb1-4178-849d-b555ce8a1593 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:16.043969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a5e15b77-beb1-4178-849d-b555ce8a1593 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:16.044780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a5e15b77-beb1-4178-849d-b555ce8a1593 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:16.045948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a5e15b77-beb1-4178-849d-b555ce8a1593 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:16.046568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a5e15b77-beb1-4178-849d-b555ce8a1593 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:16.048096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a5e15b77-beb1-4178-849d-b555ce8a1593 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:16.265108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7f3ed355-b1fd-4ad9-a660-75e7fcd5d57a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:16.275200 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7f3ed355-b1fd-4ad9-a660-75e7fcd5d57a tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 200 len: 1648 microversion: 2.1 time: 0.454609 Oct 29 01:12:16.287779 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1054/2141] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:15 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 1648 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:16.336005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2279c2de-1260-4558-9091-f858e2e98077 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:16.336829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2279c2de-1260-4558-9091-f858e2e98077 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:16.346917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2279c2de-1260-4558-9091-f858e2e98077 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:16.347777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2279c2de-1260-4558-9091-f858e2e98077 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:16.349274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2279c2de-1260-4558-9091-f858e2e98077 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:16.350461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2279c2de-1260-4558-9091-f858e2e98077 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:16.351521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2279c2de-1260-4558-9091-f858e2e98077 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:16.352143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2279c2de-1260-4558-9091-f858e2e98077 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:16.444865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a5e15b77-beb1-4178-849d-b555ce8a1593 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:16.461145 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a5e15b77-beb1-4178-849d-b555ce8a1593 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1508 microversion: 2.1 time: 0.438731 Oct 29 01:12:16.462540 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1088/2142] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:16 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1508 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:16.669353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-95e98c50-1d8a-402f-ac3d-4872a4f98ff6 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:16.669986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-95e98c50-1d8a-402f-ac3d-4872a4f98ff6 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:16.680925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95e98c50-1d8a-402f-ac3d-4872a4f98ff6 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:16.681446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95e98c50-1d8a-402f-ac3d-4872a4f98ff6 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:16.681891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95e98c50-1d8a-402f-ac3d-4872a4f98ff6 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:16.682601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95e98c50-1d8a-402f-ac3d-4872a4f98ff6 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:16.683065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95e98c50-1d8a-402f-ac3d-4872a4f98ff6 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:16.683494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95e98c50-1d8a-402f-ac3d-4872a4f98ff6 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:16.721741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2279c2de-1260-4558-9091-f858e2e98077 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:16.741333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2279c2de-1260-4558-9091-f858e2e98077 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:16.744079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2279c2de-1260-4558-9091-f858e2e98077 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:16.748783 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2279c2de-1260-4558-9091-f858e2e98077 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.416977 Oct 29 01:12:16.771216 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1055/2143] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:16 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:16.828843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-95e98c50-1d8a-402f-ac3d-4872a4f98ff6 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:16.837173 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-95e98c50-1d8a-402f-ac3d-4872a4f98ff6 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1269 microversion: 2.1 time: 0.173078 Oct 29 01:12:16.838786 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1089/2144] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:16 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1269 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:16.972292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-437fd817-0832-477d-b292-d8dda5a3819b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:16.973025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-437fd817-0832-477d-b292-d8dda5a3819b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:16.992111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-437fd817-0832-477d-b292-d8dda5a3819b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:16.996662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-437fd817-0832-477d-b292-d8dda5a3819b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:16.997382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-437fd817-0832-477d-b292-d8dda5a3819b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:16.998006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-437fd817-0832-477d-b292-d8dda5a3819b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:16.998487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-437fd817-0832-477d-b292-d8dda5a3819b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:17.001737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-437fd817-0832-477d-b292-d8dda5a3819b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:17.123699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-437fd817-0832-477d-b292-d8dda5a3819b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:17.136395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-437fd817-0832-477d-b292-d8dda5a3819b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:17.141630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-437fd817-0832-477d-b292-d8dda5a3819b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:17.142915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-437fd817-0832-477d-b292-d8dda5a3819b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lazy-loading 'fault' on Instance uuid c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:12:17.226196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-437fd817-0832-477d-b292-d8dda5a3819b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:17.237348 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-437fd817-0832-477d-b292-d8dda5a3819b tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1359 microversion: 2.1 time: 0.270545 Oct 29 01:12:17.239669 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1056/2145] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:16 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1359 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:17.300280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-75613584-18a0-4f37-be4d-7976cb84fd01 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:17.301721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-75613584-18a0-4f37-be4d-7976cb84fd01 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:17.321884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75613584-18a0-4f37-be4d-7976cb84fd01 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:17.324286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75613584-18a0-4f37-be4d-7976cb84fd01 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:17.330461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75613584-18a0-4f37-be4d-7976cb84fd01 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:17.331691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75613584-18a0-4f37-be4d-7976cb84fd01 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:17.337010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75613584-18a0-4f37-be4d-7976cb84fd01 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:17.340536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75613584-18a0-4f37-be4d-7976cb84fd01 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:17.467359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-4024485b-0843-411a-91ab-7f7eec553974 req-1de55f86-d202-4ec7-8830-5c5bfb54043a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9161092b-7dfe-4c41-bcac-1d65112ead16", "name": "network-vif-deleted", "tag": "0ce52fe8-a1fb-40ab-a07d-d5448dd21825"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:17.491420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4024485b-0843-411a-91ab-7f7eec553974 req-1de55f86-d202-4ec7-8830-5c5bfb54043a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:17.492340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4024485b-0843-411a-91ab-7f7eec553974 req-1de55f86-d202-4ec7-8830-5c5bfb54043a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:17.494176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4024485b-0843-411a-91ab-7f7eec553974 req-1de55f86-d202-4ec7-8830-5c5bfb54043a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:17.522632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-75613584-18a0-4f37-be4d-7976cb84fd01 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:17.539507 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-4024485b-0843-411a-91ab-7f7eec553974 req-1de55f86-d202-4ec7-8830-5c5bfb54043a service nova] Creating event network-vif-deleted:0ce52fe8-a1fb-40ab-a07d-d5448dd21825 for instance 9161092b-7dfe-4c41-bcac-1d65112ead16 on n-h1-862964-3 Oct 29 01:12:17.551520 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-75613584-18a0-4f37-be4d-7976cb84fd01 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 200 len: 1468 microversion: 2.1 time: 0.253230 Oct 29 01:12:17.565030 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1090/2146] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:17 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 1468 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:17.568650 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-4024485b-0843-411a-91ab-7f7eec553974 req-1de55f86-d202-4ec7-8830-5c5bfb54043a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115235 Oct 29 01:12:17.574950 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1057/2147] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:17.584887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cc6bac05-abf5-4cd5-8aa4-f04d02780d08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:17.585902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cc6bac05-abf5-4cd5-8aa4-f04d02780d08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:17.594935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc6bac05-abf5-4cd5-8aa4-f04d02780d08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:17.596077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc6bac05-abf5-4cd5-8aa4-f04d02780d08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:17.596690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc6bac05-abf5-4cd5-8aa4-f04d02780d08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:17.597730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc6bac05-abf5-4cd5-8aa4-f04d02780d08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:17.598503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc6bac05-abf5-4cd5-8aa4-f04d02780d08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:17.599160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc6bac05-abf5-4cd5-8aa4-f04d02780d08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:17.782831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c6df8f8f-2554-4d53-869a-bfdae591ed78 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:17.786890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c6df8f8f-2554-4d53-869a-bfdae591ed78 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:17.796059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6df8f8f-2554-4d53-869a-bfdae591ed78 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:17.797135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6df8f8f-2554-4d53-869a-bfdae591ed78 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:17.798151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6df8f8f-2554-4d53-869a-bfdae591ed78 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:17.801719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6df8f8f-2554-4d53-869a-bfdae591ed78 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:17.802810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6df8f8f-2554-4d53-869a-bfdae591ed78 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:17.806588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6df8f8f-2554-4d53-869a-bfdae591ed78 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:17.931053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cc6bac05-abf5-4cd5-8aa4-f04d02780d08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:17.944403 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cc6bac05-abf5-4cd5-8aa4-f04d02780d08 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1508 microversion: 2.1 time: 0.377913 Oct 29 01:12:17.946245 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1091/2148] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:17 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1508 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:17.953889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7a1b026e-e603-4003-bbe7-713611ad0219 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:17.956463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7a1b026e-e603-4003-bbe7-713611ad0219 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:17.964469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a1b026e-e603-4003-bbe7-713611ad0219 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:17.967302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a1b026e-e603-4003-bbe7-713611ad0219 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:17.967302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a1b026e-e603-4003-bbe7-713611ad0219 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:17.969004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a1b026e-e603-4003-bbe7-713611ad0219 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:17.970321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a1b026e-e603-4003-bbe7-713611ad0219 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:17.975276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a1b026e-e603-4003-bbe7-713611ad0219 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:18.108437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7a1b026e-e603-4003-bbe7-713611ad0219 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:18.122140 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7a1b026e-e603-4003-bbe7-713611ad0219 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1275 microversion: 2.1 time: 0.172777 Oct 29 01:12:18.124399 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1092/2149] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:17 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1275 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:18.164246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c6df8f8f-2554-4d53-869a-bfdae591ed78 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:18.183217 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c6df8f8f-2554-4d53-869a-bfdae591ed78 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:18.185514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c6df8f8f-2554-4d53-869a-bfdae591ed78 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:18.187335 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c6df8f8f-2554-4d53-869a-bfdae591ed78 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.412271 Oct 29 01:12:18.188042 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1058/2150] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:17 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:18.271765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-389bc7ea-b467-4c78-aa3c-a3e0e3ec6102 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:18.282637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-389bc7ea-b467-4c78-aa3c-a3e0e3ec6102 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:18.307872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-389bc7ea-b467-4c78-aa3c-a3e0e3ec6102 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:18.311395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-389bc7ea-b467-4c78-aa3c-a3e0e3ec6102 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:18.312661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-389bc7ea-b467-4c78-aa3c-a3e0e3ec6102 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:18.314968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-389bc7ea-b467-4c78-aa3c-a3e0e3ec6102 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:18.315931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-389bc7ea-b467-4c78-aa3c-a3e0e3ec6102 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:18.316767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-389bc7ea-b467-4c78-aa3c-a3e0e3ec6102 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:18.372843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-389bc7ea-b467-4c78-aa3c-a3e0e3ec6102 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:18.373345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-389bc7ea-b467-4c78-aa3c-a3e0e3ec6102 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:18.374628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-389bc7ea-b467-4c78-aa3c-a3e0e3ec6102 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:18.375807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-389bc7ea-b467-4c78-aa3c-a3e0e3ec6102 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lazy-loading 'fault' on Instance uuid c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:12:18.477461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-389bc7ea-b467-4c78-aa3c-a3e0e3ec6102 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485e22dee25b4eb7b1f726a5915c1dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8aa4c99cd74817bd2d771e07b55ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:18.492909 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-389bc7ea-b467-4c78-aa3c-a3e0e3ec6102 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 200 len: 1359 microversion: 2.1 time: 0.231963 Oct 29 01:12:18.509972 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1093/2151] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:18 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 1359 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:18.576723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bbd2f6ff-be10-44a9-ac83-763f592e4405 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:18.577739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bbd2f6ff-be10-44a9-ac83-763f592e4405 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:18.586956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbd2f6ff-be10-44a9-ac83-763f592e4405 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:18.587771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbd2f6ff-be10-44a9-ac83-763f592e4405 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:18.588881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbd2f6ff-be10-44a9-ac83-763f592e4405 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:18.590077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbd2f6ff-be10-44a9-ac83-763f592e4405 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:18.592451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbd2f6ff-be10-44a9-ac83-763f592e4405 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:18.593468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbd2f6ff-be10-44a9-ac83-763f592e4405 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:18.659355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbd2f6ff-be10-44a9-ac83-763f592e4405 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:18.660213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbd2f6ff-be10-44a9-ac83-763f592e4405 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:18.660888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbd2f6ff-be10-44a9-ac83-763f592e4405 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:18.661583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-bbd2f6ff-be10-44a9-ac83-763f592e4405 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lazy-loading 'fault' on Instance uuid 9161092b-7dfe-4c41-bcac-1d65112ead16 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:12:18.738292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bbd2f6ff-be10-44a9-ac83-763f592e4405 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e18fc75c774452bcc89f4cb817e545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bcfcd48fb4cf3b3744e74498a9f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:18.748147 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bbd2f6ff-be10-44a9-ac83-763f592e4405 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 200 len: 1306 microversion: 2.1 time: 0.176713 Oct 29 01:12:18.765490 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1059/2152] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:18 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 1306 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:18.972394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2e039f8b-fd87-483b-92f6-36a857b25163 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:18.974086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2e039f8b-fd87-483b-92f6-36a857b25163 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:18.981335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e039f8b-fd87-483b-92f6-36a857b25163 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:18.981903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e039f8b-fd87-483b-92f6-36a857b25163 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:18.982471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e039f8b-fd87-483b-92f6-36a857b25163 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:18.983485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e039f8b-fd87-483b-92f6-36a857b25163 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:18.984024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e039f8b-fd87-483b-92f6-36a857b25163 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:18.984528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e039f8b-fd87-483b-92f6-36a857b25163 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:19.157811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ae325fad-b237-410b-81f4-86ca3f21113f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:19.159200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ae325fad-b237-410b-81f4-86ca3f21113f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:19.169677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae325fad-b237-410b-81f4-86ca3f21113f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:19.170538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae325fad-b237-410b-81f4-86ca3f21113f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:19.171210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae325fad-b237-410b-81f4-86ca3f21113f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:19.173414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae325fad-b237-410b-81f4-86ca3f21113f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:19.174491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae325fad-b237-410b-81f4-86ca3f21113f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:19.175192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae325fad-b237-410b-81f4-86ca3f21113f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:19.243164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2e039f8b-fd87-483b-92f6-36a857b25163 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:19.295087 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2e039f8b-fd87-483b-92f6-36a857b25163 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1508 microversion: 2.1 time: 0.326378 Oct 29 01:12:19.326940 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1094/2153] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:18 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1508 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:19.349669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2271f2fd-5479-4d0c-b3dc-c28b7a61bfaa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:19.351063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2271f2fd-5479-4d0c-b3dc-c28b7a61bfaa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:19.363900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2271f2fd-5479-4d0c-b3dc-c28b7a61bfaa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:19.364393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2271f2fd-5479-4d0c-b3dc-c28b7a61bfaa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:19.364888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2271f2fd-5479-4d0c-b3dc-c28b7a61bfaa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:19.365825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2271f2fd-5479-4d0c-b3dc-c28b7a61bfaa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:19.366497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2271f2fd-5479-4d0c-b3dc-c28b7a61bfaa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:19.367093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2271f2fd-5479-4d0c-b3dc-c28b7a61bfaa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:19.440302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ae325fad-b237-410b-81f4-86ca3f21113f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:19.451217 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ae325fad-b237-410b-81f4-86ca3f21113f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1317 microversion: 2.1 time: 0.301781 Oct 29 01:12:19.452435 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1060/2154] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:19 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:19.520299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7b8b435e-ebb9-47d1-9518-134bd58dae10 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:19.520299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7b8b435e-ebb9-47d1-9518-134bd58dae10 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] [instance: c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:19.527303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b8b435e-ebb9-47d1-9518-134bd58dae10 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:19.527808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b8b435e-ebb9-47d1-9518-134bd58dae10 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:19.528317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b8b435e-ebb9-47d1-9518-134bd58dae10 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:19.533718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b8b435e-ebb9-47d1-9518-134bd58dae10 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:19.534215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b8b435e-ebb9-47d1-9518-134bd58dae10 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:19.534665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b8b435e-ebb9-47d1-9518-134bd58dae10 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:19.585648 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-7b8b435e-ebb9-47d1-9518-134bd58dae10 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] HTTP exception thrown: Instance c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a could not be found. Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7b8b435e-ebb9-47d1-9518-134bd58dae10 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Request method failure captured: Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a HTTP/1.1 Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH1p4-pbXq6icsk9Jyk37mhYARfqWGOU0b5SXx-3zjJkpj1wJkSK8cWVYJz9MJmSp9TRBi8EmwnpE0oNkD9xvtNfE_ZuSLR6U3dcEMGo3oSxCF8CpuYXf6iKzAb0XsTA-H65lWPXoPBnsjQkRW8bTt7WDe-cOt3Gq70VyGu9dA-ypOM Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: fc8aa4c99cd74817bd2d771e07b55ddb Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersTestJSON-1943700801 Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fc8aa4c99cd74817bd2d771e07b55ddb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fc8aa4c99cd74817bd2d771e07b55ddb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fc8aa4c99cd74817bd2d771e07b55ddb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fc8aa4c99cd74817bd2d771e07b55ddb", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersTestJSON-1943700801 Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: fc8aa4c99cd74817bd2d771e07b55ddb Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersTestJSON-1943700801 Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersTestJSON-1943700801-project Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 485e22dee25b4eb7b1f726a5915c1dbe Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersTestJSON-1943700801-project Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a could not be found. Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a'} Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a could not be found. Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a could not be found. Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:19.587833 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:19.594100 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:19.594100 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:19.594100 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:19.594100 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:12:19.594100 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:12:19.594100 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a could not be found. Oct 29 01:12:19.594100 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:12:19.594100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7b8b435e-ebb9-47d1-9518-134bd58dae10 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Returning 404 to user: Instance c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:12:19.594100 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7b8b435e-ebb9-47d1-9518-134bd58dae10 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a" status: 404 len: 111 microversion: 2.1 time: 0.079152 Oct 29 01:12:19.595316 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1061/2155] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:19 2022] GET /compute/v2.1/servers/c7b8c9f8-4c23-4d0b-a752-0bbe28c8799a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:12:19.606123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7ffae16d-07a9-4a18-a04b-ff4a07ee9f13 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] Calling method '.version_select at 0x7f9d9fefaee0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:19.652334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2271f2fd-5479-4d0c-b3dc-c28b7a61bfaa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:19.665019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2271f2fd-5479-4d0c-b3dc-c28b7a61bfaa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:19.668469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2271f2fd-5479-4d0c-b3dc-c28b7a61bfaa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:19.670575 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2271f2fd-5479-4d0c-b3dc-c28b7a61bfaa tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.342337 Oct 29 01:12:19.672900 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1095/2156] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:19 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:19.723512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:19.728502 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7ffae16d-07a9-4a18-a04b-ff4a07ee9f13 tempest-ServersTestJSON-1943700801 tempest-ServersTestJSON-1943700801-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1753689404" status: 202 len: 0 microversion: 2.1 time: 0.129498 Oct 29 01:12:19.729833 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1062/2157] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 29 01:12:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1753689404 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:12:19.772350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-574f171b-8d31-440d-8f10-147dbd556e51 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:19.773375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-574f171b-8d31-440d-8f10-147dbd556e51 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] [instance: 9161092b-7dfe-4c41-bcac-1d65112ead16] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:19.782478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-574f171b-8d31-440d-8f10-147dbd556e51 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:19.783172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-574f171b-8d31-440d-8f10-147dbd556e51 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:19.783858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-574f171b-8d31-440d-8f10-147dbd556e51 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:19.784779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-574f171b-8d31-440d-8f10-147dbd556e51 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:19.788258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-574f171b-8d31-440d-8f10-147dbd556e51 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:19.792684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-574f171b-8d31-440d-8f10-147dbd556e51 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:19.811502 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-574f171b-8d31-440d-8f10-147dbd556e51 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] HTTP exception thrown: Instance 9161092b-7dfe-4c41-bcac-1d65112ead16 could not be found. Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-574f171b-8d31-440d-8f10-147dbd556e51 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Request method failure captured: Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 HTTP/1.1 Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH2dSOm6Gvr_7yReO_KK4LyiJmxHEpSHznGvK-Vwrpwo4GWP7Ab5YXTZuGsu1pNtwHZhTwV9418WfJZZN41caWcz_If-orG4TOArgMozy0kdFl7uiee1-gBfdA2Tv8rwYvLMwbreSpyPQ3JrbABZf0uK1xwJ_TuKV00PeAfDDKvVrXo Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/294bcfcd48fb4cf3b3744e74498a9f73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_294bcfcd48fb4cf3b3744e74498a9f73", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 294bcfcd48fb4cf3b3744e74498a9f73 Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1925890951 Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f6e18fc75c774452bcc89f4cb817e545 Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-SecurityGroupsTestJSON-1925890951-project Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 9161092b-7dfe-4c41-bcac-1d65112ead16 could not be found. Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '9161092b-7dfe-4c41-bcac-1d65112ead16'} Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9161092b-7dfe-4c41-bcac-1d65112ead16 could not be found. Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9161092b-7dfe-4c41-bcac-1d65112ead16 could not be found. Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:19.813965 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:19.822817 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:19.822817 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:19.822817 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:19.822817 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:12:19.822817 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:12:19.822817 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9161092b-7dfe-4c41-bcac-1d65112ead16 could not be found. Oct 29 01:12:19.822817 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:19.822817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-574f171b-8d31-440d-8f10-147dbd556e51 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Returning 404 to user: Instance 9161092b-7dfe-4c41-bcac-1d65112ead16 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:12:19.822817 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-574f171b-8d31-440d-8f10-147dbd556e51 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16" status: 404 len: 111 microversion: 2.1 time: 0.048595 Oct 29 01:12:19.822817 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1096/2158] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:19 2022] GET /compute/v2.1/servers/9161092b-7dfe-4c41-bcac-1d65112ead16 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:12:19.827300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a6e92534-248f-45a4-a451-d1436a405fc2 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d9febd940>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:20.171811 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a6e92534-248f-45a4-a451-d1436a405fc2 tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/8a4534c9-23dc-460f-9717-df6331bb4d06" status: 202 len: 0 microversion: 2.1 time: 0.349107 Oct 29 01:12:20.173591 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1063/2159] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:12:19 2022] DELETE /compute/v2.1/os-security-groups/8a4534c9-23dc-460f-9717-df6331bb4d06 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:12:20.183401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b691b0a7-0dfe-4a1e-978d-34f263bf302f tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] Calling method '.version_select at 0x7f9d97769700>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:20.324309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d60a73bf-32d9-4e6e-a813-ac1e1396240e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:20.324939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d60a73bf-32d9-4e6e-a813-ac1e1396240e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:20.341135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d60a73bf-32d9-4e6e-a813-ac1e1396240e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:20.341773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d60a73bf-32d9-4e6e-a813-ac1e1396240e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:20.342077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d60a73bf-32d9-4e6e-a813-ac1e1396240e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:20.342798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d60a73bf-32d9-4e6e-a813-ac1e1396240e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:20.343260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d60a73bf-32d9-4e6e-a813-ac1e1396240e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:20.343689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d60a73bf-32d9-4e6e-a813-ac1e1396240e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:20.710696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d60a73bf-32d9-4e6e-a813-ac1e1396240e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:20.712800 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d60a73bf-32d9-4e6e-a813-ac1e1396240e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1508 microversion: 2.1 time: 0.392106 Oct 29 01:12:20.713593 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1064/2160] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:20 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1508 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:20.729572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-19f46294-69bb-43bc-85ce-9b174697514c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:20.730774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-19f46294-69bb-43bc-85ce-9b174697514c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:20.744687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19f46294-69bb-43bc-85ce-9b174697514c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:20.748901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19f46294-69bb-43bc-85ce-9b174697514c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:20.748901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19f46294-69bb-43bc-85ce-9b174697514c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:20.748901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19f46294-69bb-43bc-85ce-9b174697514c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:20.748901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19f46294-69bb-43bc-85ce-9b174697514c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:20.749907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19f46294-69bb-43bc-85ce-9b174697514c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:20.802467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:20.885985 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b691b0a7-0dfe-4a1e-978d-34f263bf302f tempest-SecurityGroupsTestJSON-1925890951 tempest-SecurityGroupsTestJSON-1925890951-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/b3f85443-abdd-416a-b17c-3c90bfe7618d" status: 202 len: 0 microversion: 2.1 time: 0.708338 Oct 29 01:12:20.887878 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1097/2161] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:12:20 2022] DELETE /compute/v2.1/os-security-groups/b3f85443-abdd-416a-b17c-3c90bfe7618d => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:12:20.898140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b27e2702-f35a-417b-8172-d1f9cd8d933e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:20.898140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b27e2702-f35a-417b-8172-d1f9cd8d933e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:20.909442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b27e2702-f35a-417b-8172-d1f9cd8d933e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:20.909924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b27e2702-f35a-417b-8172-d1f9cd8d933e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:20.910889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b27e2702-f35a-417b-8172-d1f9cd8d933e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:20.912039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b27e2702-f35a-417b-8172-d1f9cd8d933e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:20.916837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b27e2702-f35a-417b-8172-d1f9cd8d933e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:20.921197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b27e2702-f35a-417b-8172-d1f9cd8d933e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:21.150589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-19f46294-69bb-43bc-85ce-9b174697514c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:21.159065 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-19f46294-69bb-43bc-85ce-9b174697514c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1317 microversion: 2.1 time: 0.443365 Oct 29 01:12:21.173799 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1065/2162] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:20 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:21.182406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-f3832c54-ac78-4bdf-b5cb-bc3f0d7744fc req-0d1ce02e-2178-4d92-b722-c0297abd68fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dead7b7-a0ac-4233-a0ae-ed19568a36cf", "name": "network-vif-unplugged", "status": "completed", "tag": "fed62005-09de-4477-ac60-2dac49a60063"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:21.202124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f3832c54-ac78-4bdf-b5cb-bc3f0d7744fc req-0d1ce02e-2178-4d92-b722-c0297abd68fc service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:21.202124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f3832c54-ac78-4bdf-b5cb-bc3f0d7744fc req-0d1ce02e-2178-4d92-b722-c0297abd68fc service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:21.202124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f3832c54-ac78-4bdf-b5cb-bc3f0d7744fc req-0d1ce02e-2178-4d92-b722-c0297abd68fc service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:21.212259 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f3832c54-ac78-4bdf-b5cb-bc3f0d7744fc req-0d1ce02e-2178-4d92-b722-c0297abd68fc service nova] Creating event network-vif-unplugged:fed62005-09de-4477-ac60-2dac49a60063 for instance 2dead7b7-a0ac-4233-a0ae-ed19568a36cf on n-h1-862964-3 Oct 29 01:12:21.217980 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-f3832c54-ac78-4bdf-b5cb-bc3f0d7744fc req-0d1ce02e-2178-4d92-b722-c0297abd68fc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041672 Oct 29 01:12:21.218885 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1066/2163] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:21.302569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b27e2702-f35a-417b-8172-d1f9cd8d933e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:21.355351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b27e2702-f35a-417b-8172-d1f9cd8d933e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:21.361707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b27e2702-f35a-417b-8172-d1f9cd8d933e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:21.363475 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b27e2702-f35a-417b-8172-d1f9cd8d933e tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.473993 Oct 29 01:12:21.365372 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1098/2164] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:20 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:21.742155 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e1c79d70-90f5-4aba-9c07-fd506f408555 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:21.743686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e1c79d70-90f5-4aba-9c07-fd506f408555 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:21.758571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1c79d70-90f5-4aba-9c07-fd506f408555 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:21.761010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1c79d70-90f5-4aba-9c07-fd506f408555 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:21.761792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1c79d70-90f5-4aba-9c07-fd506f408555 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:21.764576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1c79d70-90f5-4aba-9c07-fd506f408555 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:21.765351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1c79d70-90f5-4aba-9c07-fd506f408555 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:21.766956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1c79d70-90f5-4aba-9c07-fd506f408555 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:22.054055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e1c79d70-90f5-4aba-9c07-fd506f408555 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:22.071045 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e1c79d70-90f5-4aba-9c07-fd506f408555 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1508 microversion: 2.1 time: 0.329311 Oct 29 01:12:22.081149 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1067/2165] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:21 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1508 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:22.187607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3413f65d-7888-4e10-908e-1d7d3f8c0628 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:22.188987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3413f65d-7888-4e10-908e-1d7d3f8c0628 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:22.199628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=11 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:22.201436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3413f65d-7888-4e10-908e-1d7d3f8c0628 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:22.201962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3413f65d-7888-4e10-908e-1d7d3f8c0628 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:22.202401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3413f65d-7888-4e10-908e-1d7d3f8c0628 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:22.207207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3413f65d-7888-4e10-908e-1d7d3f8c0628 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:22.207690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3413f65d-7888-4e10-908e-1d7d3f8c0628 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:22.208199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3413f65d-7888-4e10-908e-1d7d3f8c0628 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:22.208740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=24 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:22.394587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3daee44c-c484-4db0-a101-468a2bff56ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:22.396911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3daee44c-c484-4db0-a101-468a2bff56ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:22.424058 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3daee44c-c484-4db0-a101-468a2bff56ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:22.425539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3daee44c-c484-4db0-a101-468a2bff56ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:22.426911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3daee44c-c484-4db0-a101-468a2bff56ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:22.428016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3daee44c-c484-4db0-a101-468a2bff56ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:22.432554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3daee44c-c484-4db0-a101-468a2bff56ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:22.434109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3daee44c-c484-4db0-a101-468a2bff56ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:22.484519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3413f65d-7888-4e10-908e-1d7d3f8c0628 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:22.501718 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3413f65d-7888-4e10-908e-1d7d3f8c0628 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1317 microversion: 2.1 time: 0.318146 Oct 29 01:12:22.503004 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1099/2166] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:22 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:22.937368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3daee44c-c484-4db0-a101-468a2bff56ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:22.946542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3daee44c-c484-4db0-a101-468a2bff56ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:22.948938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3daee44c-c484-4db0-a101-468a2bff56ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:22.950402 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3daee44c-c484-4db0-a101-468a2bff56ee tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.563462 Oct 29 01:12:22.961950 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1068/2167] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:22 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:23.102468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f5c773a8-fea0-4204-92bf-a866739203c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:23.103265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f5c773a8-fea0-4204-92bf-a866739203c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:23.117169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5c773a8-fea0-4204-92bf-a866739203c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:23.123251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5c773a8-fea0-4204-92bf-a866739203c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:23.123251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5c773a8-fea0-4204-92bf-a866739203c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:23.123251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5c773a8-fea0-4204-92bf-a866739203c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:23.123251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5c773a8-fea0-4204-92bf-a866739203c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:23.123251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5c773a8-fea0-4204-92bf-a866739203c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:23.287006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-2382d1fd-22ed-4b04-9aa9-d4318f9962d2 req-3d8b79d5-9074-4e50-9931-6378842696ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dead7b7-a0ac-4233-a0ae-ed19568a36cf", "tag": "fed62005-09de-4477-ac60-2dac49a60063"}, {"name": "network-changed", "server_uuid": "71b41540-956c-41c7-8396-3bcbcfc54862", "tag": "69c1a7b0-0583-4934-a72a-4f711f4caffe"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:23.311876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2382d1fd-22ed-4b04-9aa9-d4318f9962d2 req-3d8b79d5-9074-4e50-9931-6378842696ce service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:23.312684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2382d1fd-22ed-4b04-9aa9-d4318f9962d2 req-3d8b79d5-9074-4e50-9931-6378842696ce service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:23.314251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2382d1fd-22ed-4b04-9aa9-d4318f9962d2 req-3d8b79d5-9074-4e50-9931-6378842696ce service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:23.358687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:23.368990 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-2382d1fd-22ed-4b04-9aa9-d4318f9962d2 req-3d8b79d5-9074-4e50-9931-6378842696ce service nova] Creating event network-changed:fed62005-09de-4477-ac60-2dac49a60063 for instance 2dead7b7-a0ac-4233-a0ae-ed19568a36cf on n-h1-862964-3 Oct 29 01:12:23.370667 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-2382d1fd-22ed-4b04-9aa9-d4318f9962d2 req-3d8b79d5-9074-4e50-9931-6378842696ce service nova] Creating event network-changed:69c1a7b0-0583-4934-a72a-4f711f4caffe for instance 71b41540-956c-41c7-8396-3bcbcfc54862 on n-h1-862964-3 Oct 29 01:12:23.387147 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-2382d1fd-22ed-4b04-9aa9-d4318f9962d2 req-3d8b79d5-9074-4e50-9931-6378842696ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.104155 Oct 29 01:12:23.396275 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1069/2168] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:23.530724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fbd07b20-b1ea-452a-81d1-81f286cffce1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:23.531841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fbd07b20-b1ea-452a-81d1-81f286cffce1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:23.542078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbd07b20-b1ea-452a-81d1-81f286cffce1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:23.554039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbd07b20-b1ea-452a-81d1-81f286cffce1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:23.558615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbd07b20-b1ea-452a-81d1-81f286cffce1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:23.558615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbd07b20-b1ea-452a-81d1-81f286cffce1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:23.558615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbd07b20-b1ea-452a-81d1-81f286cffce1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:23.558615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbd07b20-b1ea-452a-81d1-81f286cffce1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:23.610932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f5c773a8-fea0-4204-92bf-a866739203c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:23.627792 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f5c773a8-fea0-4204-92bf-a866739203c0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1508 microversion: 2.1 time: 0.532041 Oct 29 01:12:23.647850 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1100/2169] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:23 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1508 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:23.979547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-24784ed5-aea5-418e-9db0-6bc29abb7779 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:23.980262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-24784ed5-aea5-418e-9db0-6bc29abb7779 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:23.992039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24784ed5-aea5-418e-9db0-6bc29abb7779 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:24.002788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24784ed5-aea5-418e-9db0-6bc29abb7779 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:24.003400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24784ed5-aea5-418e-9db0-6bc29abb7779 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:24.007704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24784ed5-aea5-418e-9db0-6bc29abb7779 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:24.010076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24784ed5-aea5-418e-9db0-6bc29abb7779 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:24.010527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24784ed5-aea5-418e-9db0-6bc29abb7779 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:24.023209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fbd07b20-b1ea-452a-81d1-81f286cffce1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:24.034970 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fbd07b20-b1ea-452a-81d1-81f286cffce1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1317 microversion: 2.1 time: 0.508191 Oct 29 01:12:24.045369 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1070/2170] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:23 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1317 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:24.079171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:24.474603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-24784ed5-aea5-418e-9db0-6bc29abb7779 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:24.491946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-24784ed5-aea5-418e-9db0-6bc29abb7779 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:24.495573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-24784ed5-aea5-418e-9db0-6bc29abb7779 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:24.514204 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-24784ed5-aea5-418e-9db0-6bc29abb7779 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.539026 Oct 29 01:12:24.521148 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1101/2171] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:23 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:24.657320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-619973a5-3bac-4d7a-b2a3-05974fc30749 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:24.659977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-619973a5-3bac-4d7a-b2a3-05974fc30749 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:24.680440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-619973a5-3bac-4d7a-b2a3-05974fc30749 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:24.680440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-619973a5-3bac-4d7a-b2a3-05974fc30749 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:24.680440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-619973a5-3bac-4d7a-b2a3-05974fc30749 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:24.680440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-619973a5-3bac-4d7a-b2a3-05974fc30749 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:24.681663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-619973a5-3bac-4d7a-b2a3-05974fc30749 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:24.684823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-619973a5-3bac-4d7a-b2a3-05974fc30749 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:25.060087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7addb3a3-e3ed-4d7d-b591-fa69e7ce2d90 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:25.060937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7addb3a3-e3ed-4d7d-b591-fa69e7ce2d90 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:25.074889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7addb3a3-e3ed-4d7d-b591-fa69e7ce2d90 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:25.076277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7addb3a3-e3ed-4d7d-b591-fa69e7ce2d90 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:25.079936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7addb3a3-e3ed-4d7d-b591-fa69e7ce2d90 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:25.081539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7addb3a3-e3ed-4d7d-b591-fa69e7ce2d90 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:25.082016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7addb3a3-e3ed-4d7d-b591-fa69e7ce2d90 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:25.082450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7addb3a3-e3ed-4d7d-b591-fa69e7ce2d90 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:25.242854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-619973a5-3bac-4d7a-b2a3-05974fc30749 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:25.260707 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-619973a5-3bac-4d7a-b2a3-05974fc30749 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1508 microversion: 2.1 time: 0.612478 Oct 29 01:12:25.265300 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1071/2172] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:24 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1508 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:25.413497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7addb3a3-e3ed-4d7d-b591-fa69e7ce2d90 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:25.423963 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7addb3a3-e3ed-4d7d-b591-fa69e7ce2d90 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1317 microversion: 2.1 time: 0.369021 Oct 29 01:12:25.424788 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1102/2173] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:25 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:25.553652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6b36044c-861a-4346-8730-129af59ffa91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:25.555930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6b36044c-861a-4346-8730-129af59ffa91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:25.567356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b36044c-861a-4346-8730-129af59ffa91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:25.569213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b36044c-861a-4346-8730-129af59ffa91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:25.569213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b36044c-861a-4346-8730-129af59ffa91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:25.569928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b36044c-861a-4346-8730-129af59ffa91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:25.571480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b36044c-861a-4346-8730-129af59ffa91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:25.572069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b36044c-861a-4346-8730-129af59ffa91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:25.759545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6b36044c-861a-4346-8730-129af59ffa91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:25.773681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6b36044c-861a-4346-8730-129af59ffa91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:25.775140 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6b36044c-861a-4346-8730-129af59ffa91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:25.776885 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6b36044c-861a-4346-8730-129af59ffa91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.230336 Oct 29 01:12:25.778691 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1072/2174] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:25 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:26.286916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1e7cf552-55d5-48f7-becd-ca7355798419 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:26.287758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1e7cf552-55d5-48f7-becd-ca7355798419 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:26.307439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e7cf552-55d5-48f7-becd-ca7355798419 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:26.307950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e7cf552-55d5-48f7-becd-ca7355798419 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:26.308397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e7cf552-55d5-48f7-becd-ca7355798419 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:26.310583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e7cf552-55d5-48f7-becd-ca7355798419 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:26.311304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e7cf552-55d5-48f7-becd-ca7355798419 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:26.311868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e7cf552-55d5-48f7-becd-ca7355798419 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:26.461307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9f7302a0-02d7-4d45-8aff-10a0587cac1f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:26.462501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9f7302a0-02d7-4d45-8aff-10a0587cac1f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:26.724281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f7302a0-02d7-4d45-8aff-10a0587cac1f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:26.724281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f7302a0-02d7-4d45-8aff-10a0587cac1f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:26.724281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f7302a0-02d7-4d45-8aff-10a0587cac1f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:26.724281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f7302a0-02d7-4d45-8aff-10a0587cac1f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:26.724281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f7302a0-02d7-4d45-8aff-10a0587cac1f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:26.724281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f7302a0-02d7-4d45-8aff-10a0587cac1f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:26.727932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1e7cf552-55d5-48f7-becd-ca7355798419 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:26.727932 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1e7cf552-55d5-48f7-becd-ca7355798419 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1508 microversion: 2.1 time: 0.330146 Oct 29 01:12:26.727932 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1103/2175] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:26 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1508 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:26.784991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9f7302a0-02d7-4d45-8aff-10a0587cac1f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:26.801622 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9f7302a0-02d7-4d45-8aff-10a0587cac1f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1317 microversion: 2.1 time: 0.351957 Oct 29 01:12:26.804243 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1073/2176] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:26 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:26.821533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0796907a-4bae-4509-a65e-8ac85d3f40a4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:26.822522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0796907a-4bae-4509-a65e-8ac85d3f40a4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:26.835894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0796907a-4bae-4509-a65e-8ac85d3f40a4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:26.836872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0796907a-4bae-4509-a65e-8ac85d3f40a4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:26.840621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0796907a-4bae-4509-a65e-8ac85d3f40a4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:26.841804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0796907a-4bae-4509-a65e-8ac85d3f40a4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:26.843698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0796907a-4bae-4509-a65e-8ac85d3f40a4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:26.844532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0796907a-4bae-4509-a65e-8ac85d3f40a4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:27.044209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0796907a-4bae-4509-a65e-8ac85d3f40a4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:27.059803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0796907a-4bae-4509-a65e-8ac85d3f40a4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:27.063493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0796907a-4bae-4509-a65e-8ac85d3f40a4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:27.065101 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0796907a-4bae-4509-a65e-8ac85d3f40a4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.264723 Oct 29 01:12:27.066467 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1104/2177] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:26 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:12:27.727459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-21229189-1a0d-4d1e-8da8-6ef8e7a3299c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:27.728257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-21229189-1a0d-4d1e-8da8-6ef8e7a3299c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:27.741120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21229189-1a0d-4d1e-8da8-6ef8e7a3299c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:27.741645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21229189-1a0d-4d1e-8da8-6ef8e7a3299c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:27.742082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21229189-1a0d-4d1e-8da8-6ef8e7a3299c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:27.742793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21229189-1a0d-4d1e-8da8-6ef8e7a3299c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:27.743248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21229189-1a0d-4d1e-8da8-6ef8e7a3299c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:27.743667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21229189-1a0d-4d1e-8da8-6ef8e7a3299c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:27.827100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e8e9448e-9bce-4b94-b101-f3e9fada2639 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:27.827723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e8e9448e-9bce-4b94-b101-f3e9fada2639 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:27.842629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8e9448e-9bce-4b94-b101-f3e9fada2639 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:27.843116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8e9448e-9bce-4b94-b101-f3e9fada2639 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:27.851173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8e9448e-9bce-4b94-b101-f3e9fada2639 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:27.851998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8e9448e-9bce-4b94-b101-f3e9fada2639 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:27.852484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8e9448e-9bce-4b94-b101-f3e9fada2639 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:27.852923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8e9448e-9bce-4b94-b101-f3e9fada2639 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:28.621560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-21229189-1a0d-4d1e-8da8-6ef8e7a3299c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:28.639963 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-21229189-1a0d-4d1e-8da8-6ef8e7a3299c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1508 microversion: 2.1 time: 0.916723 Oct 29 01:12:28.653217 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1074/2178] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:27 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1508 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:28.664132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-63630d4f-b693-4f64-b531-8155aa76357d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:28.665292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-63630d4f-b693-4f64-b531-8155aa76357d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:28.680503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63630d4f-b693-4f64-b531-8155aa76357d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:28.686161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63630d4f-b693-4f64-b531-8155aa76357d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:28.688609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63630d4f-b693-4f64-b531-8155aa76357d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:28.694762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63630d4f-b693-4f64-b531-8155aa76357d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:28.696279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63630d4f-b693-4f64-b531-8155aa76357d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:28.699262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63630d4f-b693-4f64-b531-8155aa76357d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:28.760684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e8e9448e-9bce-4b94-b101-f3e9fada2639 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:28.775828 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e8e9448e-9bce-4b94-b101-f3e9fada2639 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1317 microversion: 2.1 time: 0.952428 Oct 29 01:12:28.776430 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1105/2179] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:27 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1317 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:29.462428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-736796685", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "1e5cefc3-9c8e-4620-a7e6-c6913d3fa262"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:29.572772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] validate_networks() for [('1e5cefc3-9c8e-4620-a7e6-c6913d3fa262', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:12:29.912964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-63630d4f-b693-4f64-b531-8155aa76357d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:29.953437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-63630d4f-b693-4f64-b531-8155aa76357d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:29.962864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-63630d4f-b693-4f64-b531-8155aa76357d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:29.966255 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-63630d4f-b693-4f64-b531-8155aa76357d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 1.322239 Oct 29 01:12:29.984176 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1075/2180] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:28 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:30.011415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-598fd4f7-8266-4b17-b323-5453392b8a41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:30.011415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-598fd4f7-8266-4b17-b323-5453392b8a41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:30.029940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-598fd4f7-8266-4b17-b323-5453392b8a41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:30.034397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-598fd4f7-8266-4b17-b323-5453392b8a41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:30.035843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-598fd4f7-8266-4b17-b323-5453392b8a41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:30.039799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-598fd4f7-8266-4b17-b323-5453392b8a41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:30.039799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-598fd4f7-8266-4b17-b323-5453392b8a41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:30.039799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-598fd4f7-8266-4b17-b323-5453392b8a41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:30.925584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-598fd4f7-8266-4b17-b323-5453392b8a41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:30.939561 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-598fd4f7-8266-4b17-b323-5453392b8a41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1508 microversion: 2.1 time: 0.952989 Oct 29 01:12:30.953969 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1076/2181] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:29 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1508 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:30.953969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-db5f8b6f-54bb-44ab-86bc-26c7fa3f792e tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:30.953969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-db5f8b6f-54bb-44ab-86bc-26c7fa3f792e tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:30.958564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db5f8b6f-54bb-44ab-86bc-26c7fa3f792e tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:30.959313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db5f8b6f-54bb-44ab-86bc-26c7fa3f792e tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:30.959973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db5f8b6f-54bb-44ab-86bc-26c7fa3f792e tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:30.960755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db5f8b6f-54bb-44ab-86bc-26c7fa3f792e tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:30.961339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db5f8b6f-54bb-44ab-86bc-26c7fa3f792e tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:30.961800 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db5f8b6f-54bb-44ab-86bc-26c7fa3f792e tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:31.270715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:12:31.271221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:12:31.271594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:12:31.271998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:12:31.272577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:12:31.283761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:31.284339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:31.284998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:31.285773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:31.286351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:31.286802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:31.298564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-db5f8b6f-54bb-44ab-86bc-26c7fa3f792e tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:31.307045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Getting quotas for project a09ce55a18af4f8db53d517089591340. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:12:31.307329 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-db5f8b6f-54bb-44ab-86bc-26c7fa3f792e tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1317 microversion: 2.1 time: 0.365814 Oct 29 01:12:31.312652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Getting quotas for user d5fce522753549929a06d164a5b244d7 and project a09ce55a18af4f8db53d517089591340. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:12:31.323792 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1077/2182] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:30 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:31.326081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Going to run 3 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:12:31.328503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:12:31.330388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3f8e0ce1-b0db-4b2a-a7c7-9df971925b2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:31.331000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3f8e0ce1-b0db-4b2a-a7c7-9df971925b2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:31.337207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8e0ce1-b0db-4b2a-a7c7-9df971925b2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:31.337670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8e0ce1-b0db-4b2a-a7c7-9df971925b2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:31.338111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8e0ce1-b0db-4b2a-a7c7-9df971925b2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:31.338841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8e0ce1-b0db-4b2a-a7c7-9df971925b2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:31.339523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8e0ce1-b0db-4b2a-a7c7-9df971925b2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:31.339966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8e0ce1-b0db-4b2a-a7c7-9df971925b2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:31.485796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3f8e0ce1-b0db-4b2a-a7c7-9df971925b2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:31.494804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3f8e0ce1-b0db-4b2a-a7c7-9df971925b2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:31.496498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3f8e0ce1-b0db-4b2a-a7c7-9df971925b2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:31.498056 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3f8e0ce1-b0db-4b2a-a7c7-9df971925b2c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.172863 Oct 29 01:12:31.498773 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1078/2183] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:31 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:31.730920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: 6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=69681dc4-6f48-44ea-a7c4-1b10ea9b86dd,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:12:31.939029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:12:31.972844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-54a8953d-1556-4a6b-a966-0afdc7a3d946 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:31.972844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-54a8953d-1556-4a6b-a966-0afdc7a3d946 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:31.977546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54a8953d-1556-4a6b-a966-0afdc7a3d946 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:31.978042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54a8953d-1556-4a6b-a966-0afdc7a3d946 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:31.978485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54a8953d-1556-4a6b-a966-0afdc7a3d946 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:31.979378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54a8953d-1556-4a6b-a966-0afdc7a3d946 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:31.979755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54a8953d-1556-4a6b-a966-0afdc7a3d946 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:31.980240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54a8953d-1556-4a6b-a966-0afdc7a3d946 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:32.214022 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c17aa395-1f01-4d59-8ec7-5032b1f89c38 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.159528 Oct 29 01:12:32.221922 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1106/2184] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:12:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:12:32.231385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0065b427-5cf9-4576-8482-2beaaf00d06f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:32.241072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0065b427-5cf9-4576-8482-2beaaf00d06f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:32.243469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0065b427-5cf9-4576-8482-2beaaf00d06f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Searching by: {'deleted': False, 'project_id': 'a09ce55a18af4f8db53d517089591340'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:12:32.276728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0065b427-5cf9-4576-8482-2beaaf00d06f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:32.280922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0065b427-5cf9-4576-8482-2beaaf00d06f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:32.280922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0065b427-5cf9-4576-8482-2beaaf00d06f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:32.280922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0065b427-5cf9-4576-8482-2beaaf00d06f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:32.280922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0065b427-5cf9-4576-8482-2beaaf00d06f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:32.280922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0065b427-5cf9-4576-8482-2beaaf00d06f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:32.309035 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0065b427-5cf9-4576-8482-2beaaf00d06f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.082450 Oct 29 01:12:32.333719 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1107/2185] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 29 01:12:32 2022] GET /compute/v2.1/servers => generated 1015 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:32.340546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-058d173a-f0c6-4e0e-81db-d36ed34a7faf tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:32.344082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-058d173a-f0c6-4e0e-81db-d36ed34a7faf tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:32.407319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-54a8953d-1556-4a6b-a966-0afdc7a3d946 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:32.418262 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-54a8953d-1556-4a6b-a966-0afdc7a3d946 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1508 microversion: 2.1 time: 0.457342 Oct 29 01:12:32.418846 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1079/2186] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:31 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1508 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:32.435065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2113e986-27da-47e1-beb6-5d91710ef821 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:32.438283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2113e986-27da-47e1-beb6-5d91710ef821 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:32.466192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2113e986-27da-47e1-beb6-5d91710ef821 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:32.466192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2113e986-27da-47e1-beb6-5d91710ef821 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:32.466546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2113e986-27da-47e1-beb6-5d91710ef821 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:32.471555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2113e986-27da-47e1-beb6-5d91710ef821 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:32.472093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2113e986-27da-47e1-beb6-5d91710ef821 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:32.472614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2113e986-27da-47e1-beb6-5d91710ef821 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:32.628428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-058d173a-f0c6-4e0e-81db-d36ed34a7faf tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:32.637767 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-058d173a-f0c6-4e0e-81db-d36ed34a7faf tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1222 microversion: 2.1 time: 0.302468 Oct 29 01:12:32.638362 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1108/2187] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:32 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1222 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:32.660565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fe4d097c-df5b-436e-adbc-61062a30146c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:32.662845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fe4d097c-df5b-436e-adbc-61062a30146c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:32.686673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe4d097c-df5b-436e-adbc-61062a30146c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:32.686673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe4d097c-df5b-436e-adbc-61062a30146c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:32.686673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe4d097c-df5b-436e-adbc-61062a30146c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:32.686673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe4d097c-df5b-436e-adbc-61062a30146c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:32.686673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe4d097c-df5b-436e-adbc-61062a30146c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:32.686673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe4d097c-df5b-436e-adbc-61062a30146c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:33.252261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2113e986-27da-47e1-beb6-5d91710ef821 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:33.261291 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2113e986-27da-47e1-beb6-5d91710ef821 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1317 microversion: 2.1 time: 0.840583 Oct 29 01:12:33.270055 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1080/2188] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:32 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1317 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:33.301885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-3ffe0d0e-e542-4479-8f89-8b00d28d9caa req-3bf91d72-39cd-4a2f-9919-cb6c4dee6b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b41540-956c-41c7-8396-3bcbcfc54862", "name": "network-vif-plugged", "status": "completed", "tag": "69c1a7b0-0583-4934-a72a-4f711f4caffe"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:33.328866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fe4d097c-df5b-436e-adbc-61062a30146c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:33.331127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3ffe0d0e-e542-4479-8f89-8b00d28d9caa req-3bf91d72-39cd-4a2f-9919-cb6c4dee6b04 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:33.331617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3ffe0d0e-e542-4479-8f89-8b00d28d9caa req-3bf91d72-39cd-4a2f-9919-cb6c4dee6b04 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:33.332061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3ffe0d0e-e542-4479-8f89-8b00d28d9caa req-3bf91d72-39cd-4a2f-9919-cb6c4dee6b04 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:33.336190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fe4d097c-df5b-436e-adbc-61062a30146c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:33.337671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fe4d097c-df5b-436e-adbc-61062a30146c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:33.339039 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fe4d097c-df5b-436e-adbc-61062a30146c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.692641 Oct 29 01:12:33.339616 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1109/2189] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:32 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:33.374177 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-3ffe0d0e-e542-4479-8f89-8b00d28d9caa req-3bf91d72-39cd-4a2f-9919-cb6c4dee6b04 service nova] Creating event network-vif-plugged:69c1a7b0-0583-4934-a72a-4f711f4caffe for instance 71b41540-956c-41c7-8396-3bcbcfc54862 on n-h1-862964-3 Oct 29 01:12:33.407619 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-3ffe0d0e-e542-4479-8f89-8b00d28d9caa req-3bf91d72-39cd-4a2f-9919-cb6c4dee6b04 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111393 Oct 29 01:12:33.408583 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1081/2190] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:33.447205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d0134991-c1d5-481e-8f62-0154da19d906 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:33.447205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d0134991-c1d5-481e-8f62-0154da19d906 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:33.476329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0134991-c1d5-481e-8f62-0154da19d906 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:33.476819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0134991-c1d5-481e-8f62-0154da19d906 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:33.486009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0134991-c1d5-481e-8f62-0154da19d906 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:33.493453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0134991-c1d5-481e-8f62-0154da19d906 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:33.495853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0134991-c1d5-481e-8f62-0154da19d906 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:33.502349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0134991-c1d5-481e-8f62-0154da19d906 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:33.665073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a09b4617-b723-44f9-8506-8f291e0f830c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:33.669075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a09b4617-b723-44f9-8506-8f291e0f830c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:33.818205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a09b4617-b723-44f9-8506-8f291e0f830c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:33.834102 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a09b4617-b723-44f9-8506-8f291e0f830c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1222 microversion: 2.1 time: 0.173054 Oct 29 01:12:33.835973 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1082/2191] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:33 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1222 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:34.112810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d0134991-c1d5-481e-8f62-0154da19d906 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:34.122855 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d0134991-c1d5-481e-8f62-0154da19d906 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1508 microversion: 2.1 time: 0.680371 Oct 29 01:12:34.123443 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1110/2192] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:33 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1508 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:34.301053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-58048275-d212-43b2-8734-9a9b81520e16 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:34.311097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-58048275-d212-43b2-8734-9a9b81520e16 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:34.322594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58048275-d212-43b2-8734-9a9b81520e16 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:34.323963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58048275-d212-43b2-8734-9a9b81520e16 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:34.324584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58048275-d212-43b2-8734-9a9b81520e16 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:34.327209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58048275-d212-43b2-8734-9a9b81520e16 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:34.327209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58048275-d212-43b2-8734-9a9b81520e16 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:34.327209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58048275-d212-43b2-8734-9a9b81520e16 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:34.371633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-06cc29b6-b276-4dd2-957e-8b707d74885f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:34.374734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-06cc29b6-b276-4dd2-957e-8b707d74885f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:34.386237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06cc29b6-b276-4dd2-957e-8b707d74885f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:34.386715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06cc29b6-b276-4dd2-957e-8b707d74885f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:34.387242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06cc29b6-b276-4dd2-957e-8b707d74885f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:34.387849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06cc29b6-b276-4dd2-957e-8b707d74885f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:34.388305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06cc29b6-b276-4dd2-957e-8b707d74885f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:34.388733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06cc29b6-b276-4dd2-957e-8b707d74885f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:34.715406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-06cc29b6-b276-4dd2-957e-8b707d74885f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:34.728313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-06cc29b6-b276-4dd2-957e-8b707d74885f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:34.732636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-06cc29b6-b276-4dd2-957e-8b707d74885f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:34.734253 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-06cc29b6-b276-4dd2-957e-8b707d74885f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.371966 Oct 29 01:12:34.736846 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1111/2193] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:34 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:12:34.747795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-58048275-d212-43b2-8734-9a9b81520e16 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:34.757594 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-58048275-d212-43b2-8734-9a9b81520e16 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1317 microversion: 2.1 time: 0.462902 Oct 29 01:12:34.758741 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1083/2194] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:34 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1317 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:34.866975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1a7db29e-3083-4bf8-a129-0ff7c874d21b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:34.869124 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1a7db29e-3083-4bf8-a129-0ff7c874d21b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:34.986389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1a7db29e-3083-4bf8-a129-0ff7c874d21b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:34.995605 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1a7db29e-3083-4bf8-a129-0ff7c874d21b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1222 microversion: 2.1 time: 0.132958 Oct 29 01:12:35.005643 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1112/2195] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:34 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1222 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:35.150350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-daa734f0-84b0-495b-a60f-d98750f01dae tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:35.151247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-daa734f0-84b0-495b-a60f-d98750f01dae tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:35.186698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-daa734f0-84b0-495b-a60f-d98750f01dae tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:35.187700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-daa734f0-84b0-495b-a60f-d98750f01dae tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:35.190107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-daa734f0-84b0-495b-a60f-d98750f01dae tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:35.194701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-daa734f0-84b0-495b-a60f-d98750f01dae tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:35.201358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-daa734f0-84b0-495b-a60f-d98750f01dae tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:35.203739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-daa734f0-84b0-495b-a60f-d98750f01dae tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:35.478194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-daa734f0-84b0-495b-a60f-d98750f01dae tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:35.478860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-099b7ec7-371a-4824-997c-fdb87841dda6 tempest-AZV2TestJSON-236265732 tempest-AZV2TestJSON-236265732-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:35.480435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-099b7ec7-371a-4824-997c-fdb87841dda6 tempest-AZV2TestJSON-236265732 tempest-AZV2TestJSON-236265732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:35.480921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-099b7ec7-371a-4824-997c-fdb87841dda6 tempest-AZV2TestJSON-236265732 tempest-AZV2TestJSON-236265732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:35.481494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-099b7ec7-371a-4824-997c-fdb87841dda6 tempest-AZV2TestJSON-236265732 tempest-AZV2TestJSON-236265732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:35.482768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-099b7ec7-371a-4824-997c-fdb87841dda6 tempest-AZV2TestJSON-236265732 tempest-AZV2TestJSON-236265732-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:35.483820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-099b7ec7-371a-4824-997c-fdb87841dda6 tempest-AZV2TestJSON-236265732 tempest-AZV2TestJSON-236265732-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:35.487812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-099b7ec7-371a-4824-997c-fdb87841dda6 tempest-AZV2TestJSON-236265732 tempest-AZV2TestJSON-236265732-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:35.497372 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-daa734f0-84b0-495b-a60f-d98750f01dae tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1508 microversion: 2.1 time: 0.351020 Oct 29 01:12:35.499091 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1113/2196] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:35 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1508 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:35.526944 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-099b7ec7-371a-4824-997c-fdb87841dda6 tempest-AZV2TestJSON-236265732 tempest-AZV2TestJSON-236265732-project] 10.222.0.26 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.489504 Oct 29 01:12:35.536005 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1084/2197] 10.222.0.26 () {58 vars in 1164 bytes} [Sat Oct 29 01:12:35 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:12:35.773365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fbe8faf3-fa5a-44d8-92a5-807efc9cd1de tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:35.775848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fbe8faf3-fa5a-44d8-92a5-807efc9cd1de tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:35.782430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:35.784059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e3dfe331-5ded-40a1-a489-6417615ac713 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:35.784756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e3dfe331-5ded-40a1-a489-6417615ac713 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:35.792414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbe8faf3-fa5a-44d8-92a5-807efc9cd1de tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:35.793457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbe8faf3-fa5a-44d8-92a5-807efc9cd1de tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:35.794237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbe8faf3-fa5a-44d8-92a5-807efc9cd1de tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:35.795184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbe8faf3-fa5a-44d8-92a5-807efc9cd1de tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:35.795785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbe8faf3-fa5a-44d8-92a5-807efc9cd1de tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:35.796346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3dfe331-5ded-40a1-a489-6417615ac713 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:35.796569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbe8faf3-fa5a-44d8-92a5-807efc9cd1de tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:35.797646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3dfe331-5ded-40a1-a489-6417615ac713 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:35.803294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3dfe331-5ded-40a1-a489-6417615ac713 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:35.805111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3dfe331-5ded-40a1-a489-6417615ac713 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:35.809266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3dfe331-5ded-40a1-a489-6417615ac713 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:35.811840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3dfe331-5ded-40a1-a489-6417615ac713 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:36.143908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fbe8faf3-fa5a-44d8-92a5-807efc9cd1de tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:36.148364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e3dfe331-5ded-40a1-a489-6417615ac713 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:36.152224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:36.153608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fbe8faf3-fa5a-44d8-92a5-807efc9cd1de tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:36.155204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fbe8faf3-fa5a-44d8-92a5-807efc9cd1de tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:36.157125 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fbe8faf3-fa5a-44d8-92a5-807efc9cd1de tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1486 microversion: 2.25 time: 0.395124 Oct 29 01:12:36.157923 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1114/2198] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:35 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1486 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:36.158078 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e3dfe331-5ded-40a1-a489-6417615ac713 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1317 microversion: 2.1 time: 0.378396 Oct 29 01:12:36.158803 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1085/2199] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:35 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:36.163424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-410101c8-013b-454f-855a-f7b873f626e8 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:36.164547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-410101c8-013b-454f-855a-f7b873f626e8 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:36.234979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-410101c8-013b-454f-855a-f7b873f626e8 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:36.245560 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-410101c8-013b-454f-855a-f7b873f626e8 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1222 microversion: 2.1 time: 0.085835 Oct 29 01:12:36.246818 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1115/2200] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:36 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:36.538889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-454475a1-3c4e-4dc1-a675-6b9e3fad3a7e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:36.538889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-454475a1-3c4e-4dc1-a675-6b9e3fad3a7e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:36.556480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-454475a1-3c4e-4dc1-a675-6b9e3fad3a7e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:36.557516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-454475a1-3c4e-4dc1-a675-6b9e3fad3a7e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:36.564166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-454475a1-3c4e-4dc1-a675-6b9e3fad3a7e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:36.564166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-454475a1-3c4e-4dc1-a675-6b9e3fad3a7e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:36.564166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-454475a1-3c4e-4dc1-a675-6b9e3fad3a7e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:36.564166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-454475a1-3c4e-4dc1-a675-6b9e3fad3a7e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:36.766476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-454475a1-3c4e-4dc1-a675-6b9e3fad3a7e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:36.779773 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-454475a1-3c4e-4dc1-a675-6b9e3fad3a7e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1508 microversion: 2.1 time: 0.254059 Oct 29 01:12:36.781842 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1086/2201] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:36 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:37.182201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-51f92530-db1e-4956-9519-87b0ca8e1f9d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:37.182816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-51f92530-db1e-4956-9519-87b0ca8e1f9d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:37.190386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f2a68bc1-7004-4ae2-bc82-9172b32ec580 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:37.191498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f2a68bc1-7004-4ae2-bc82-9172b32ec580 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:37.199348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51f92530-db1e-4956-9519-87b0ca8e1f9d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:37.204699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51f92530-db1e-4956-9519-87b0ca8e1f9d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:37.205126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51f92530-db1e-4956-9519-87b0ca8e1f9d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:37.205996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51f92530-db1e-4956-9519-87b0ca8e1f9d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:37.206494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51f92530-db1e-4956-9519-87b0ca8e1f9d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:37.212114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51f92530-db1e-4956-9519-87b0ca8e1f9d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:37.215360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:37.236579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2a68bc1-7004-4ae2-bc82-9172b32ec580 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:37.237108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2a68bc1-7004-4ae2-bc82-9172b32ec580 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:37.239008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2a68bc1-7004-4ae2-bc82-9172b32ec580 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:37.239983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2a68bc1-7004-4ae2-bc82-9172b32ec580 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:37.242216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2a68bc1-7004-4ae2-bc82-9172b32ec580 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:37.243891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2a68bc1-7004-4ae2-bc82-9172b32ec580 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:37.556076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-51f92530-db1e-4956-9519-87b0ca8e1f9d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:37.564945 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-51f92530-db1e-4956-9519-87b0ca8e1f9d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1466 microversion: 2.1 time: 0.386788 Oct 29 01:12:37.566283 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1116/2202] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:37 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1466 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:37.571606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-679a487e-208b-4af1-a028-087953e5c609 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:37.572217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-679a487e-208b-4af1-a028-087953e5c609 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:37.587478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-679a487e-208b-4af1-a028-087953e5c609 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:37.588415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-679a487e-208b-4af1-a028-087953e5c609 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:37.588804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-679a487e-208b-4af1-a028-087953e5c609 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:37.589682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-679a487e-208b-4af1-a028-087953e5c609 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:37.594763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-679a487e-208b-4af1-a028-087953e5c609 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:37.594763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-679a487e-208b-4af1-a028-087953e5c609 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:37.643910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f2a68bc1-7004-4ae2-bc82-9172b32ec580 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:37.666942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f2a68bc1-7004-4ae2-bc82-9172b32ec580 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:37.668253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f2a68bc1-7004-4ae2-bc82-9172b32ec580 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:37.669662 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f2a68bc1-7004-4ae2-bc82-9172b32ec580 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1476 microversion: 2.25 time: 0.490295 Oct 29 01:12:37.670668 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1087/2203] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:37 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1476 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:12:37.689723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-486a097c-f748-4ab9-b3b7-58a30397c410 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-142185541", "metadata": {"image_type": "test"}}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:37.693791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-486a097c-f748-4ab9-b3b7-58a30397c410 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:37.711452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-486a097c-f748-4ab9-b3b7-58a30397c410 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:37.711946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-486a097c-f748-4ab9-b3b7-58a30397c410 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:37.712376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-486a097c-f748-4ab9-b3b7-58a30397c410 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:37.716559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-486a097c-f748-4ab9-b3b7-58a30397c410 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:37.717294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-486a097c-f748-4ab9-b3b7-58a30397c410 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:37.718085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-486a097c-f748-4ab9-b3b7-58a30397c410 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:37.744272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-679a487e-208b-4af1-a028-087953e5c609 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:37.765507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-486a097c-f748-4ab9-b3b7-58a30397c410 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Getting quotas for project 36a174adc9794d23b38c2bafd8a3f1c6. Resources: dict_keys(['metadata_items']) {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:12:37.772893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-486a097c-f748-4ab9-b3b7-58a30397c410 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Getting quotas for user 34a454a03ab64d4eab179c11a5165ce0 and project 36a174adc9794d23b38c2bafd8a3f1c6. Resources: dict_keys(['metadata_items']) {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:12:37.774077 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-679a487e-208b-4af1-a028-087953e5c609 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1226 microversion: 2.1 time: 0.206226 Oct 29 01:12:37.777057 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1117/2204] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:37 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1226 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:37.789132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-838bee3f-277b-44ee-88a4-174482b47720 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '.version_select at 0x7f9d977730d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:37.804369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-838bee3f-277b-44ee-88a4-174482b47720 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:37.812410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-838bee3f-277b-44ee-88a4-174482b47720 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:37.812410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-838bee3f-277b-44ee-88a4-174482b47720 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:37.846090 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-838bee3f-277b-44ee-88a4-174482b47720 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 3204 microversion: 2.25 time: 0.067437 Oct 29 01:12:37.846823 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1118/2205] 10.222.0.26 () {60 vars in 1184 bytes} [Sat Oct 29 01:12:37 2022] GET /compute/v2.1/os-migrations => generated 3204 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:37.852149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6413ea5f-98c8-4773-a7dd-7752bbaf5c0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:37.852765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6413ea5f-98c8-4773-a7dd-7752bbaf5c0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:37.864198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6413ea5f-98c8-4773-a7dd-7752bbaf5c0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:37.864198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6413ea5f-98c8-4773-a7dd-7752bbaf5c0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:37.864198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6413ea5f-98c8-4773-a7dd-7752bbaf5c0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:37.864198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6413ea5f-98c8-4773-a7dd-7752bbaf5c0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:37.864898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6413ea5f-98c8-4773-a7dd-7752bbaf5c0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:37.865653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6413ea5f-98c8-4773-a7dd-7752bbaf5c0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:38.070114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6413ea5f-98c8-4773-a7dd-7752bbaf5c0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:38.078519 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6413ea5f-98c8-4773-a7dd-7752bbaf5c0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1529 microversion: 2.1 time: 0.230583 Oct 29 01:12:38.079918 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1119/2206] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:37 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1529 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:38.085429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ed1797f9-d572-4694-8b52-9424a8a45d92 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:38.087367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ed1797f9-d572-4694-8b52-9424a8a45d92 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:38.094813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed1797f9-d572-4694-8b52-9424a8a45d92 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:38.095373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed1797f9-d572-4694-8b52-9424a8a45d92 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:38.096057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed1797f9-d572-4694-8b52-9424a8a45d92 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:38.097080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed1797f9-d572-4694-8b52-9424a8a45d92 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:38.097782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed1797f9-d572-4694-8b52-9424a8a45d92 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:38.098419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed1797f9-d572-4694-8b52-9424a8a45d92 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:38.325122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-ed1797f9-d572-4694-8b52-9424a8a45d92 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] Lazy-loading 'services' on Instance uuid 2dead7b7-a0ac-4233-a0ae-ed19568a36cf {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:12:38.346532 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ed1797f9-d572-4694-8b52-9424a8a45d92 tempest-LiveAutoBlockMigrationV225Test-376433701 tempest-LiveAutoBlockMigrationV225Test-376433701-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1968 microversion: 2.25 time: 0.266316 Oct 29 01:12:38.347124 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1120/2207] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:38 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1968 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:38.391189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2739756d-ef0d-4857-8e9f-728c1e68cc0c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:38.401573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2739756d-ef0d-4857-8e9f-728c1e68cc0c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:38.409645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2739756d-ef0d-4857-8e9f-728c1e68cc0c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:38.414113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2739756d-ef0d-4857-8e9f-728c1e68cc0c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:38.414113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2739756d-ef0d-4857-8e9f-728c1e68cc0c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:38.414113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2739756d-ef0d-4857-8e9f-728c1e68cc0c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:38.415351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2739756d-ef0d-4857-8e9f-728c1e68cc0c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:38.416183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2739756d-ef0d-4857-8e9f-728c1e68cc0c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:38.453972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2739756d-ef0d-4857-8e9f-728c1e68cc0c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:12:38.510923 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-486a097c-f748-4ab9-b3b7-58a30397c410 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "POST /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862/action" status: 202 len: 0 microversion: 2.1 time: 0.838448 Oct 29 01:12:38.515089 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1088/2208] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:12:37 2022] POST /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862/action => generated 0 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 01:12:38.521438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:38.527442 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-78ac132d-8e30-4a3a-a69a-96dc4d10d96d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fef8d30>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:38.615763 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-78ac132d-8e30-4a3a-a69a-96dc4d10d96d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776" status: 200 len: 1421 microversion: 2.1 time: 0.092248 Oct 29 01:12:38.626778 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1089/2209] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:12:38 2022] GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776 => generated 1421 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:38.805938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-60c0f643-9363-451c-b08b-d6085630030c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:38.814334 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-60c0f643-9363-451c-b08b-d6085630030c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:38.815716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60c0f643-9363-451c-b08b-d6085630030c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:38.816284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60c0f643-9363-451c-b08b-d6085630030c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:38.816792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60c0f643-9363-451c-b08b-d6085630030c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:38.817619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60c0f643-9363-451c-b08b-d6085630030c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:38.818160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60c0f643-9363-451c-b08b-d6085630030c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:38.818662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60c0f643-9363-451c-b08b-d6085630030c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:38.951050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-60c0f643-9363-451c-b08b-d6085630030c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:38.980526 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-60c0f643-9363-451c-b08b-d6085630030c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1218 microversion: 2.1 time: 0.177168 Oct 29 01:12:38.983300 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1090/2210] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:38 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1218 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:39.004608 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2739756d-ef0d-4857-8e9f-728c1e68cc0c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 204 len: 0 microversion: 2.25 time: 0.616648 Oct 29 01:12:39.008980 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1121/2211] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:12:38 2022] DELETE /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 0 bytes in 623 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:12:39.029264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-edb6a21e-d16e-4e29-8e07-3169506f1d2a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:39.034169 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-edb6a21e-d16e-4e29-8e07-3169506f1d2a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:39.049734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edb6a21e-d16e-4e29-8e07-3169506f1d2a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:39.049734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edb6a21e-d16e-4e29-8e07-3169506f1d2a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:39.049734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edb6a21e-d16e-4e29-8e07-3169506f1d2a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:39.049734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edb6a21e-d16e-4e29-8e07-3169506f1d2a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:39.049734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edb6a21e-d16e-4e29-8e07-3169506f1d2a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:39.049734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edb6a21e-d16e-4e29-8e07-3169506f1d2a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:39.112676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-14c9fd95-575b-4e07-88df-d090d29be59d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:39.120364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-14c9fd95-575b-4e07-88df-d090d29be59d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:39.149673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14c9fd95-575b-4e07-88df-d090d29be59d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:39.151898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14c9fd95-575b-4e07-88df-d090d29be59d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:39.165084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14c9fd95-575b-4e07-88df-d090d29be59d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:39.165084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14c9fd95-575b-4e07-88df-d090d29be59d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:39.165084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14c9fd95-575b-4e07-88df-d090d29be59d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:39.165084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14c9fd95-575b-4e07-88df-d090d29be59d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:39.574644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-edb6a21e-d16e-4e29-8e07-3169506f1d2a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:39.587623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-edb6a21e-d16e-4e29-8e07-3169506f1d2a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:39.594222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-edb6a21e-d16e-4e29-8e07-3169506f1d2a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:39.611548 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-edb6a21e-d16e-4e29-8e07-3169506f1d2a tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1482 microversion: 2.25 time: 0.589794 Oct 29 01:12:39.628634 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1091/2212] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:39 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1482 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:12:39.635035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-edb68cf8-4ac2-48ba-abcc-5f5b14ba6bcd tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fef8430>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:39.677952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-14c9fd95-575b-4e07-88df-d090d29be59d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:39.690387 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-14c9fd95-575b-4e07-88df-d090d29be59d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1529 microversion: 2.1 time: 0.588737 Oct 29 01:12:39.705645 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1122/2213] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:39 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1529 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:39.721607 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-edb68cf8-4ac2-48ba-abcc-5f5b14ba6bcd tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776" status: 200 len: 1421 microversion: 2.1 time: 0.068825 Oct 29 01:12:39.725528 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1092/2214] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:12:39 2022] GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776 => generated 1421 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:40.008379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d3d9cbce-ea07-4f71-a6a4-22bae936c1cf tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:40.008934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d3d9cbce-ea07-4f71-a6a4-22bae936c1cf tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:40.017450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3d9cbce-ea07-4f71-a6a4-22bae936c1cf tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:40.025285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3d9cbce-ea07-4f71-a6a4-22bae936c1cf tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:40.025285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3d9cbce-ea07-4f71-a6a4-22bae936c1cf tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:40.025285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3d9cbce-ea07-4f71-a6a4-22bae936c1cf tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:40.025285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3d9cbce-ea07-4f71-a6a4-22bae936c1cf tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:40.025285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3d9cbce-ea07-4f71-a6a4-22bae936c1cf tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:40.113903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d3d9cbce-ea07-4f71-a6a4-22bae936c1cf tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:40.124861 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d3d9cbce-ea07-4f71-a6a4-22bae936c1cf tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1218 microversion: 2.1 time: 0.120408 Oct 29 01:12:40.126467 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1123/2215] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:40 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:40.650231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0a7a29c7-1289-4c23-97d0-962256cb0066 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:40.650851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0a7a29c7-1289-4c23-97d0-962256cb0066 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:40.668825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a7a29c7-1289-4c23-97d0-962256cb0066 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:40.671199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a7a29c7-1289-4c23-97d0-962256cb0066 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:40.671775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a7a29c7-1289-4c23-97d0-962256cb0066 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:40.672855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a7a29c7-1289-4c23-97d0-962256cb0066 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:40.673373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a7a29c7-1289-4c23-97d0-962256cb0066 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:40.675039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a7a29c7-1289-4c23-97d0-962256cb0066 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:40.731789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e3ad778b-4b3e-42b4-80e0-36382e793c9a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:40.733939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e3ad778b-4b3e-42b4-80e0-36382e793c9a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:40.754267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3ad778b-4b3e-42b4-80e0-36382e793c9a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:40.772558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3ad778b-4b3e-42b4-80e0-36382e793c9a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:40.774192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3ad778b-4b3e-42b4-80e0-36382e793c9a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:40.775362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3ad778b-4b3e-42b4-80e0-36382e793c9a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:40.776446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3ad778b-4b3e-42b4-80e0-36382e793c9a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:40.777351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3ad778b-4b3e-42b4-80e0-36382e793c9a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:41.014937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e3ad778b-4b3e-42b4-80e0-36382e793c9a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:41.033489 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e3ad778b-4b3e-42b4-80e0-36382e793c9a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1529 microversion: 2.1 time: 0.301925 Oct 29 01:12:41.033489 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1124/2216] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:40 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1529 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:41.033771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0a7a29c7-1289-4c23-97d0-962256cb0066 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:41.035381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3fc19d95-b002-4a3b-b22b-50c5941ff95d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9ff78820>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:41.046427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0a7a29c7-1289-4c23-97d0-962256cb0066 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:41.048645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0a7a29c7-1289-4c23-97d0-962256cb0066 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:41.049985 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0a7a29c7-1289-4c23-97d0-962256cb0066 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1482 microversion: 2.25 time: 0.410563 Oct 29 01:12:41.057821 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1093/2217] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:40 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1482 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:41.057821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-ed87d50f-4bf7-40fd-a88b-4314b512a0dc req-de9309f0-d03e-4268-b97e-c1fdec7bf235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0fe24cf-adf2-440f-bc90-819416f0da85", "name": "network-vif-plugged", "status": "completed", "tag": "668338a4-a4ff-4907-96e5-1efd14961ac4"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:41.071620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ed87d50f-4bf7-40fd-a88b-4314b512a0dc req-de9309f0-d03e-4268-b97e-c1fdec7bf235 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:41.072397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ed87d50f-4bf7-40fd-a88b-4314b512a0dc req-de9309f0-d03e-4268-b97e-c1fdec7bf235 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:41.073015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ed87d50f-4bf7-40fd-a88b-4314b512a0dc req-de9309f0-d03e-4268-b97e-c1fdec7bf235 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:41.088043 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-ed87d50f-4bf7-40fd-a88b-4314b512a0dc req-de9309f0-d03e-4268-b97e-c1fdec7bf235 service nova] Creating event network-vif-plugged:668338a4-a4ff-4907-96e5-1efd14961ac4 for instance b0fe24cf-adf2-440f-bc90-819416f0da85 on n-h1-862964-3 Oct 29 01:12:41.099478 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-ed87d50f-4bf7-40fd-a88b-4314b512a0dc req-de9309f0-d03e-4268-b97e-c1fdec7bf235 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047306 Oct 29 01:12:41.100476 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1094/2218] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:41.117963 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3fc19d95-b002-4a3b-b22b-50c5941ff95d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776" status: 200 len: 1421 microversion: 2.1 time: 0.088321 Oct 29 01:12:41.118666 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1125/2219] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:12:41 2022] GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776 => generated 1421 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:41.154577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-635c277a-fcca-4faa-a046-6e557f86385b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:41.155412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-635c277a-fcca-4faa-a046-6e557f86385b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:41.164090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-635c277a-fcca-4faa-a046-6e557f86385b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:41.164678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-635c277a-fcca-4faa-a046-6e557f86385b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:41.165211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-635c277a-fcca-4faa-a046-6e557f86385b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:41.166007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-635c277a-fcca-4faa-a046-6e557f86385b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:41.166808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-635c277a-fcca-4faa-a046-6e557f86385b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:41.167300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-635c277a-fcca-4faa-a046-6e557f86385b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:41.275337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-635c277a-fcca-4faa-a046-6e557f86385b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:41.293889 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-635c277a-fcca-4faa-a046-6e557f86385b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1274 microversion: 2.1 time: 0.142815 Oct 29 01:12:41.308409 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1095/2220] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:41 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1274 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:41.594716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-ef8d41ba-37ba-441a-b05d-b2d66dbd15af req-d34530f1-e343-4979-9d1e-59f3d2e1512f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dead7b7-a0ac-4233-a0ae-ed19568a36cf", "name": "network-vif-deleted", "tag": "fed62005-09de-4477-ac60-2dac49a60063"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:41.633470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ef8d41ba-37ba-441a-b05d-b2d66dbd15af req-d34530f1-e343-4979-9d1e-59f3d2e1512f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:41.634426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ef8d41ba-37ba-441a-b05d-b2d66dbd15af req-d34530f1-e343-4979-9d1e-59f3d2e1512f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:41.635702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ef8d41ba-37ba-441a-b05d-b2d66dbd15af req-d34530f1-e343-4979-9d1e-59f3d2e1512f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:41.661393 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-ef8d41ba-37ba-441a-b05d-b2d66dbd15af req-d34530f1-e343-4979-9d1e-59f3d2e1512f service nova] Creating event network-vif-deleted:fed62005-09de-4477-ac60-2dac49a60063 for instance 2dead7b7-a0ac-4233-a0ae-ed19568a36cf on n-h2-862964-3 Oct 29 01:12:41.667937 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-ef8d41ba-37ba-441a-b05d-b2d66dbd15af req-d34530f1-e343-4979-9d1e-59f3d2e1512f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079350 Oct 29 01:12:41.669590 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1126/2221] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:42.055749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9bffd85f-0024-42ea-a057-f264ea25216b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:42.056298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9bffd85f-0024-42ea-a057-f264ea25216b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:42.069719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9bffd85f-0024-42ea-a057-f264ea25216b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:42.072062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9bffd85f-0024-42ea-a057-f264ea25216b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:42.072062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9bffd85f-0024-42ea-a057-f264ea25216b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:42.083181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3a67efaa-9b5e-487c-8d38-c55b5ee6e036 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:42.084462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3a67efaa-9b5e-487c-8d38-c55b5ee6e036 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:42.089996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9bffd85f-0024-42ea-a057-f264ea25216b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:42.090880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9bffd85f-0024-42ea-a057-f264ea25216b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:42.093148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9bffd85f-0024-42ea-a057-f264ea25216b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:42.107143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a67efaa-9b5e-487c-8d38-c55b5ee6e036 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:42.107908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a67efaa-9b5e-487c-8d38-c55b5ee6e036 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:42.108557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a67efaa-9b5e-487c-8d38-c55b5ee6e036 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:42.112152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a67efaa-9b5e-487c-8d38-c55b5ee6e036 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:42.112650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a67efaa-9b5e-487c-8d38-c55b5ee6e036 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:42.113097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a67efaa-9b5e-487c-8d38-c55b5ee6e036 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:42.247435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3a67efaa-9b5e-487c-8d38-c55b5ee6e036 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:42.266401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3a67efaa-9b5e-487c-8d38-c55b5ee6e036 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:42.274055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3a67efaa-9b5e-487c-8d38-c55b5ee6e036 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:42.277635 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3a67efaa-9b5e-487c-8d38-c55b5ee6e036 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1265 microversion: 2.25 time: 0.196640 Oct 29 01:12:42.278268 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1127/2222] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:42 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:12:42.289633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:42.299434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bf12016a-bd8e-4291-b2a0-7eb0b49ac0fa tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d97769b80>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:42.380181 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bf12016a-bd8e-4291-b2a0-7eb0b49ac0fa tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776" status: 200 len: 1421 microversion: 2.1 time: 0.099393 Oct 29 01:12:42.381032 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1128/2223] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:12:42 2022] GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776 => generated 1421 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:42.396169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b3467d14-2eba-460c-8e64-48d92cf464a5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:42.397760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b3467d14-2eba-460c-8e64-48d92cf464a5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:42.406889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3467d14-2eba-460c-8e64-48d92cf464a5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:42.408934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3467d14-2eba-460c-8e64-48d92cf464a5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:42.409424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3467d14-2eba-460c-8e64-48d92cf464a5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:42.412559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3467d14-2eba-460c-8e64-48d92cf464a5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:42.413887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3467d14-2eba-460c-8e64-48d92cf464a5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:42.414995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3467d14-2eba-460c-8e64-48d92cf464a5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:42.430833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9bffd85f-0024-42ea-a057-f264ea25216b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:42.448327 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9bffd85f-0024-42ea-a057-f264ea25216b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1529 microversion: 2.1 time: 0.394021 Oct 29 01:12:42.454246 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1096/2224] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:42 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1529 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:42.690017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b3467d14-2eba-460c-8e64-48d92cf464a5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:42.701898 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b3467d14-2eba-460c-8e64-48d92cf464a5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1280 microversion: 2.1 time: 0.318971 Oct 29 01:12:42.703055 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1129/2225] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:42 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1280 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:43.312319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-af02ed3c-ea3e-440b-bfe6-6293998bde30 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:43.324131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-af02ed3c-ea3e-440b-bfe6-6293998bde30 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:43.327597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af02ed3c-ea3e-440b-bfe6-6293998bde30 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:43.328432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af02ed3c-ea3e-440b-bfe6-6293998bde30 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:43.329061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af02ed3c-ea3e-440b-bfe6-6293998bde30 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:43.330185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af02ed3c-ea3e-440b-bfe6-6293998bde30 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:43.338688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af02ed3c-ea3e-440b-bfe6-6293998bde30 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:43.339642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af02ed3c-ea3e-440b-bfe6-6293998bde30 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:43.396991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ab3bd20f-e715-40e1-be1f-16acb699616d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9715a160>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:43.480771 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ab3bd20f-e715-40e1-be1f-16acb699616d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776" status: 200 len: 1421 microversion: 2.1 time: 0.088420 Oct 29 01:12:43.482036 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1130/2226] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:12:43 2022] GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776 => generated 1421 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:43.502212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8ed04438-0479-429f-9826-798a8a110c4a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:43.503424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8ed04438-0479-429f-9826-798a8a110c4a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:43.543640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-af02ed3c-ea3e-440b-bfe6-6293998bde30 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:43.557744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ed04438-0479-429f-9826-798a8a110c4a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:43.560718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ed04438-0479-429f-9826-798a8a110c4a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:43.561215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-af02ed3c-ea3e-440b-bfe6-6293998bde30 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:43.561416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ed04438-0479-429f-9826-798a8a110c4a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:43.561988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ed04438-0479-429f-9826-798a8a110c4a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:43.564683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-af02ed3c-ea3e-440b-bfe6-6293998bde30 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:43.566244 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-af02ed3c-ea3e-440b-bfe6-6293998bde30 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1265 microversion: 2.25 time: 0.260929 Oct 29 01:12:43.567359 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1097/2227] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:43 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:43.569904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ed04438-0479-429f-9826-798a8a110c4a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:43.570691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ed04438-0479-429f-9826-798a8a110c4a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:43.739880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ad2877db-406c-4ca1-868f-e74736f5c802 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:43.740841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ad2877db-406c-4ca1-868f-e74736f5c802 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:43.756242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad2877db-406c-4ca1-868f-e74736f5c802 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:43.759072 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad2877db-406c-4ca1-868f-e74736f5c802 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:43.764832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad2877db-406c-4ca1-868f-e74736f5c802 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:43.766187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad2877db-406c-4ca1-868f-e74736f5c802 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:43.768483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad2877db-406c-4ca1-868f-e74736f5c802 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:43.769001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad2877db-406c-4ca1-868f-e74736f5c802 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:43.842670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:44.016995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ad2877db-406c-4ca1-868f-e74736f5c802 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:44.027051 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ad2877db-406c-4ca1-868f-e74736f5c802 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1280 microversion: 2.1 time: 0.293022 Oct 29 01:12:44.030561 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1098/2228] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:43 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1280 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:44.042533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-cd5a7c37-f6a8-4bd4-b3dd-673500b1cc85 req-f35d9943-0138-4899-8de1-359b721969f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69681dc4-6f48-44ea-a7c4-1b10ea9b86dd", "tag": "158356ab-2942-4088-a11e-87c640cd15e8"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:44.066994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-cd5a7c37-f6a8-4bd4-b3dd-673500b1cc85 req-f35d9943-0138-4899-8de1-359b721969f0 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:44.067782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-cd5a7c37-f6a8-4bd4-b3dd-673500b1cc85 req-f35d9943-0138-4899-8de1-359b721969f0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:44.068682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-cd5a7c37-f6a8-4bd4-b3dd-673500b1cc85 req-f35d9943-0138-4899-8de1-359b721969f0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:44.089731 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-cd5a7c37-f6a8-4bd4-b3dd-673500b1cc85 req-f35d9943-0138-4899-8de1-359b721969f0 service nova] Creating event network-changed:158356ab-2942-4088-a11e-87c640cd15e8 for instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd on n-h2-862964-3 Oct 29 01:12:44.098028 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-cd5a7c37-f6a8-4bd4-b3dd-673500b1cc85 req-f35d9943-0138-4899-8de1-359b721969f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064898 Oct 29 01:12:44.100030 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1099/2229] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:44.501428 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0516ad9a-11f9-402a-b753-a431ee9d607f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fe33700>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:44.666764 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0516ad9a-11f9-402a-b753-a431ee9d607f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776" status: 200 len: 1421 microversion: 2.1 time: 0.170280 Oct 29 01:12:44.668029 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1100/2230] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:12:44 2022] GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776 => generated 1421 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:44.675156 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-37fe0e8e-882f-4f07-88a7-4ae50cd63ce7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:44.680906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-37fe0e8e-882f-4f07-88a7-4ae50cd63ce7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:44.697663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37fe0e8e-882f-4f07-88a7-4ae50cd63ce7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:44.700292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37fe0e8e-882f-4f07-88a7-4ae50cd63ce7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:44.701632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37fe0e8e-882f-4f07-88a7-4ae50cd63ce7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:44.706048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37fe0e8e-882f-4f07-88a7-4ae50cd63ce7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:44.708351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37fe0e8e-882f-4f07-88a7-4ae50cd63ce7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:44.709203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37fe0e8e-882f-4f07-88a7-4ae50cd63ce7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:44.747502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8ed04438-0479-429f-9826-798a8a110c4a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:44.764453 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8ed04438-0479-429f-9826-798a8a110c4a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1524 microversion: 2.1 time: 1.281079 Oct 29 01:12:44.773723 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1131/2231] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:43 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1524 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:45.025447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-37fe0e8e-882f-4f07-88a7-4ae50cd63ce7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:45.041400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-37fe0e8e-882f-4f07-88a7-4ae50cd63ce7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:45.043828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-37fe0e8e-882f-4f07-88a7-4ae50cd63ce7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:45.045235 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-37fe0e8e-882f-4f07-88a7-4ae50cd63ce7 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1265 microversion: 2.25 time: 0.376054 Oct 29 01:12:45.047479 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1101/2232] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:44 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1265 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:45.077190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ea37904d-a73b-4274-9562-0cc755e4a8d7 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:45.077190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ea37904d-a73b-4274-9562-0cc755e4a8d7 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:45.078013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea37904d-a73b-4274-9562-0cc755e4a8d7 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:45.085326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea37904d-a73b-4274-9562-0cc755e4a8d7 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:45.086082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea37904d-a73b-4274-9562-0cc755e4a8d7 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:45.091818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea37904d-a73b-4274-9562-0cc755e4a8d7 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:45.093002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea37904d-a73b-4274-9562-0cc755e4a8d7 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:45.097982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea37904d-a73b-4274-9562-0cc755e4a8d7 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:45.316503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-7c357da2-cd54-48c3-9bda-87b5d707ba6a req-6b0b1934-3698-4135-970b-454e6348b8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4", "tag": "b01f8de2-8104-4190-b4b3-34aeca1dde7b"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:45.336953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7c357da2-cd54-48c3-9bda-87b5d707ba6a req-6b0b1934-3698-4135-970b-454e6348b8f9 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:45.337832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7c357da2-cd54-48c3-9bda-87b5d707ba6a req-6b0b1934-3698-4135-970b-454e6348b8f9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:45.338492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7c357da2-cd54-48c3-9bda-87b5d707ba6a req-6b0b1934-3698-4135-970b-454e6348b8f9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:45.363838 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-7c357da2-cd54-48c3-9bda-87b5d707ba6a req-6b0b1934-3698-4135-970b-454e6348b8f9 service nova] Creating event network-changed:b01f8de2-8104-4190-b4b3-34aeca1dde7b for instance 6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4 on n-h1-862964-3 Oct 29 01:12:45.370242 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-7c357da2-cd54-48c3-9bda-87b5d707ba6a req-6b0b1934-3698-4135-970b-454e6348b8f9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059757 Oct 29 01:12:45.371669 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1102/2233] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:45.442066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ea37904d-a73b-4274-9562-0cc755e4a8d7 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:45.464365 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ea37904d-a73b-4274-9562-0cc755e4a8d7 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1322 microversion: 2.1 time: 0.409465 Oct 29 01:12:45.466912 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1132/2234] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:45 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:45.685540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8f54b34f-77d6-4ce1-a79d-ddec36aefe90 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fefadc0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:45.709799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:45.803428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4b8e4a22-22eb-41f2-9a45-bd23f078791b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:45.804607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4b8e4a22-22eb-41f2-9a45-bd23f078791b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:45.806454 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8f54b34f-77d6-4ce1-a79d-ddec36aefe90 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776" status: 200 len: 1421 microversion: 2.1 time: 0.126475 Oct 29 01:12:45.807858 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1103/2235] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:12:45 2022] GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776 => generated 1421 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:45.826997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b8e4a22-22eb-41f2-9a45-bd23f078791b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:45.827542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b8e4a22-22eb-41f2-9a45-bd23f078791b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:45.830238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b8e4a22-22eb-41f2-9a45-bd23f078791b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:45.833480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b8e4a22-22eb-41f2-9a45-bd23f078791b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:45.835333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b8e4a22-22eb-41f2-9a45-bd23f078791b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:45.837037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b8e4a22-22eb-41f2-9a45-bd23f078791b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:46.079717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ea873146-79ce-433a-93c1-cd1274cb7f91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:46.080866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ea873146-79ce-433a-93c1-cd1274cb7f91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:46.095901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea873146-79ce-433a-93c1-cd1274cb7f91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:46.106562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea873146-79ce-433a-93c1-cd1274cb7f91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:46.110041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea873146-79ce-433a-93c1-cd1274cb7f91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:46.111497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea873146-79ce-433a-93c1-cd1274cb7f91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:46.112261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea873146-79ce-433a-93c1-cd1274cb7f91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:46.113508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea873146-79ce-433a-93c1-cd1274cb7f91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:46.240224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=12 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:46.319623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4b8e4a22-22eb-41f2-9a45-bd23f078791b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:46.328230 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4b8e4a22-22eb-41f2-9a45-bd23f078791b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1524 microversion: 2.1 time: 0.528998 Oct 29 01:12:46.328938 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1133/2236] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:45 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1524 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:46.489412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-413f60cb-0649-44c2-92d0-488d7f483882 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:46.490085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-413f60cb-0649-44c2-92d0-488d7f483882 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:46.502038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-413f60cb-0649-44c2-92d0-488d7f483882 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:46.512804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-413f60cb-0649-44c2-92d0-488d7f483882 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:46.516474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-413f60cb-0649-44c2-92d0-488d7f483882 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:46.517627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-413f60cb-0649-44c2-92d0-488d7f483882 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:46.524284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ea873146-79ce-433a-93c1-cd1274cb7f91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:46.536222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-413f60cb-0649-44c2-92d0-488d7f483882 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:46.536918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-413f60cb-0649-44c2-92d0-488d7f483882 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:46.537049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ea873146-79ce-433a-93c1-cd1274cb7f91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:46.569888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ea873146-79ce-433a-93c1-cd1274cb7f91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:46.585686 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ea873146-79ce-433a-93c1-cd1274cb7f91 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1265 microversion: 2.25 time: 0.512538 Oct 29 01:12:46.597445 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1104/2237] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:46 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1265 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:12:46.823343 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c5a3b0e4-f430-4986-bddf-9d32498ef240 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fefae50>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:47.079686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-413f60cb-0649-44c2-92d0-488d7f483882 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:47.117337 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-413f60cb-0649-44c2-92d0-488d7f483882 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1322 microversion: 2.1 time: 0.632704 Oct 29 01:12:47.131405 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1134/2238] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:46 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1322 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:47.360916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d50651c9-9d28-49c8-9207-4d1b4a650c5a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:47.361573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d50651c9-9d28-49c8-9207-4d1b4a650c5a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:47.375142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d50651c9-9d28-49c8-9207-4d1b4a650c5a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:47.375651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d50651c9-9d28-49c8-9207-4d1b4a650c5a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:47.376104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d50651c9-9d28-49c8-9207-4d1b4a650c5a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:47.382281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d50651c9-9d28-49c8-9207-4d1b4a650c5a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:47.386961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d50651c9-9d28-49c8-9207-4d1b4a650c5a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:47.392652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d50651c9-9d28-49c8-9207-4d1b4a650c5a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:48.247877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d50651c9-9d28-49c8-9207-4d1b4a650c5a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:48.269049 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d50651c9-9d28-49c8-9207-4d1b4a650c5a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1524 microversion: 2.1 time: 0.905368 Oct 29 01:12:48.272808 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1135/2239] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:47 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1524 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:12:48.288613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-534d651a-fce3-4d92-8a74-2f6e22568f60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:48.289556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-534d651a-fce3-4d92-8a74-2f6e22568f60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:48.298048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-534d651a-fce3-4d92-8a74-2f6e22568f60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:48.298968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-534d651a-fce3-4d92-8a74-2f6e22568f60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:48.299784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-534d651a-fce3-4d92-8a74-2f6e22568f60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:48.300746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-534d651a-fce3-4d92-8a74-2f6e22568f60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:48.301441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-534d651a-fce3-4d92-8a74-2f6e22568f60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:48.308029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-534d651a-fce3-4d92-8a74-2f6e22568f60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:48.435632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-534d651a-fce3-4d92-8a74-2f6e22568f60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:48.458769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-534d651a-fce3-4d92-8a74-2f6e22568f60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:48.466343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-534d651a-fce3-4d92-8a74-2f6e22568f60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:48.471218 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-534d651a-fce3-4d92-8a74-2f6e22568f60 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1265 microversion: 2.25 time: 0.195111 Oct 29 01:12:48.473859 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1136/2240] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:48 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:48.480982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-810aea50-c8f4-4c05-b3ff-765f8381dd4c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:48.481946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-810aea50-c8f4-4c05-b3ff-765f8381dd4c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:48.491086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-810aea50-c8f4-4c05-b3ff-765f8381dd4c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:48.491819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-810aea50-c8f4-4c05-b3ff-765f8381dd4c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:48.492438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-810aea50-c8f4-4c05-b3ff-765f8381dd4c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:48.493372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-810aea50-c8f4-4c05-b3ff-765f8381dd4c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:48.494693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-810aea50-c8f4-4c05-b3ff-765f8381dd4c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:48.495423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-810aea50-c8f4-4c05-b3ff-765f8381dd4c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:48.935711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-810aea50-c8f4-4c05-b3ff-765f8381dd4c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:48.947878 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-810aea50-c8f4-4c05-b3ff-765f8381dd4c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1322 microversion: 2.1 time: 0.472275 Oct 29 01:12:48.950037 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1137/2241] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:48 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:48.959025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6dca534e-00a8-432c-bef5-dd8dcfce62d7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1012433428", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "aa7f8f73-d2d1-4330-a914-f73cc0db67b6"}], "block_device_mapping_v2": [{"uuid": "e1da491c-c5b7-41e9-81b1-c7026a03f584", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:49.137588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-6dca534e-00a8-432c-bef5-dd8dcfce62d7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] validate_networks() for [('aa7f8f73-d2d1-4330-a914-f73cc0db67b6', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:12:49.746628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-6dca534e-00a8-432c-bef5-dd8dcfce62d7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:12:49.747210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-6dca534e-00a8-432c-bef5-dd8dcfce62d7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:12:49.750594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-6dca534e-00a8-432c-bef5-dd8dcfce62d7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:12:49.750594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-6dca534e-00a8-432c-bef5-dd8dcfce62d7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:12:49.750594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-6dca534e-00a8-432c-bef5-dd8dcfce62d7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:12:49.784231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dca534e-00a8-432c-bef5-dd8dcfce62d7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:49.786725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dca534e-00a8-432c-bef5-dd8dcfce62d7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:49.789439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dca534e-00a8-432c-bef5-dd8dcfce62d7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:49.789439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dca534e-00a8-432c-bef5-dd8dcfce62d7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:49.789439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dca534e-00a8-432c-bef5-dd8dcfce62d7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:49.796367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dca534e-00a8-432c-bef5-dd8dcfce62d7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:49.853458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-6dca534e-00a8-432c-bef5-dd8dcfce62d7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Getting quotas for project 6719b662fc734d2797d515778a57296d. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:12:49.867451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-6dca534e-00a8-432c-bef5-dd8dcfce62d7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Getting quotas for user da623c3132aa466aa25685aa45fceaf9 and project 6719b662fc734d2797d515778a57296d. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:12:50.042012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6dca534e-00a8-432c-bef5-dd8dcfce62d7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:12:50.044134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6dca534e-00a8-432c-bef5-dd8dcfce62d7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e1da491c-c5b7-41e9-81b1-c7026a03f584',volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:12:50.767263 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6dca534e-00a8-432c-bef5-dd8dcfce62d7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.815918 Oct 29 01:12:50.768973 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1138/2242] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:12:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:12:50.783481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-26462d81-3948-4d43-8135-84bda6032c82 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:50.784101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-26462d81-3948-4d43-8135-84bda6032c82 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:50.804140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26462d81-3948-4d43-8135-84bda6032c82 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:50.804644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26462d81-3948-4d43-8135-84bda6032c82 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:50.806365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26462d81-3948-4d43-8135-84bda6032c82 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:50.832697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26462d81-3948-4d43-8135-84bda6032c82 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:50.833313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26462d81-3948-4d43-8135-84bda6032c82 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:50.833767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26462d81-3948-4d43-8135-84bda6032c82 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:51.533738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-26462d81-3948-4d43-8135-84bda6032c82 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:51.550271 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-26462d81-3948-4d43-8135-84bda6032c82 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1524 microversion: 2.1 time: 0.779057 Oct 29 01:12:51.553371 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1139/2243] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:50 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1524 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:51.577645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-134b53ca-ce8b-41aa-ac07-c4ae1e1ce639 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:51.581126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-134b53ca-ce8b-41aa-ac07-c4ae1e1ce639 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:51.599907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-134b53ca-ce8b-41aa-ac07-c4ae1e1ce639 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:51.601734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-134b53ca-ce8b-41aa-ac07-c4ae1e1ce639 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:51.603307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-134b53ca-ce8b-41aa-ac07-c4ae1e1ce639 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:51.605463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-134b53ca-ce8b-41aa-ac07-c4ae1e1ce639 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:51.606139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-134b53ca-ce8b-41aa-ac07-c4ae1e1ce639 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:51.607743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-134b53ca-ce8b-41aa-ac07-c4ae1e1ce639 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:51.731243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-134b53ca-ce8b-41aa-ac07-c4ae1e1ce639 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:51.731814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-134b53ca-ce8b-41aa-ac07-c4ae1e1ce639 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:51.732352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-134b53ca-ce8b-41aa-ac07-c4ae1e1ce639 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:51.737807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-134b53ca-ce8b-41aa-ac07-c4ae1e1ce639 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lazy-loading 'fault' on Instance uuid 2dead7b7-a0ac-4233-a0ae-ed19568a36cf {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:12:52.057814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-134b53ca-ce8b-41aa-ac07-c4ae1e1ce639 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:52.072552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-134b53ca-ce8b-41aa-ac07-c4ae1e1ce639 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:52.086402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-134b53ca-ce8b-41aa-ac07-c4ae1e1ce639 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:52.096977 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-134b53ca-ce8b-41aa-ac07-c4ae1e1ce639 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 200 len: 1270 microversion: 2.25 time: 0.542309 Oct 29 01:12:52.101490 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1140/2244] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:51 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 1270 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:12:52.107658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-36f201a2-3bb1-4beb-86f5-5325f0ee3a37 req-ea24232a-d50f-43ef-b71a-2a728ae0980b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b41540-956c-41c7-8396-3bcbcfc54862", "name": "network-vif-plugged", "status": "completed", "tag": "69c1a7b0-0583-4934-a72a-4f711f4caffe"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:52.175920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-36f201a2-3bb1-4beb-86f5-5325f0ee3a37 req-ea24232a-d50f-43ef-b71a-2a728ae0980b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:52.176676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-36f201a2-3bb1-4beb-86f5-5325f0ee3a37 req-ea24232a-d50f-43ef-b71a-2a728ae0980b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:52.179367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-36f201a2-3bb1-4beb-86f5-5325f0ee3a37 req-ea24232a-d50f-43ef-b71a-2a728ae0980b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:52.227676 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-36f201a2-3bb1-4beb-86f5-5325f0ee3a37 req-ea24232a-d50f-43ef-b71a-2a728ae0980b service nova] Creating event network-vif-plugged:69c1a7b0-0583-4934-a72a-4f711f4caffe for instance 71b41540-956c-41c7-8396-3bcbcfc54862 on n-h1-862964-3 Oct 29 01:12:52.238141 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-36f201a2-3bb1-4beb-86f5-5325f0ee3a37 req-ea24232a-d50f-43ef-b71a-2a728ae0980b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134975 Oct 29 01:12:52.242179 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1141/2245] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:52.256212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2528bf7f-272b-4b75-9559-ddf3ed4607dc tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:52.260639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2528bf7f-272b-4b75-9559-ddf3ed4607dc tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:52.275329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2528bf7f-272b-4b75-9559-ddf3ed4607dc tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:52.275824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2528bf7f-272b-4b75-9559-ddf3ed4607dc tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:52.277056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2528bf7f-272b-4b75-9559-ddf3ed4607dc tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:52.277697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2528bf7f-272b-4b75-9559-ddf3ed4607dc tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:52.278159 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2528bf7f-272b-4b75-9559-ddf3ed4607dc tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:52.278593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2528bf7f-272b-4b75-9559-ddf3ed4607dc tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:52.331964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:53.135214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2528bf7f-272b-4b75-9559-ddf3ed4607dc tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:53.145049 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2528bf7f-272b-4b75-9559-ddf3ed4607dc tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1322 microversion: 2.1 time: 0.897915 Oct 29 01:12:53.173057 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1142/2246] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:52 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1322 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:53.178694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d9bd5bd8-6af4-4b3e-ba2d-df7b2f93e8f5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:53.179311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d9bd5bd8-6af4-4b3e-ba2d-df7b2f93e8f5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:53.221422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9bd5bd8-6af4-4b3e-ba2d-df7b2f93e8f5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:53.222263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9bd5bd8-6af4-4b3e-ba2d-df7b2f93e8f5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:53.232257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9bd5bd8-6af4-4b3e-ba2d-df7b2f93e8f5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:53.233306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9bd5bd8-6af4-4b3e-ba2d-df7b2f93e8f5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:53.237337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9bd5bd8-6af4-4b3e-ba2d-df7b2f93e8f5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:53.238011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9bd5bd8-6af4-4b3e-ba2d-df7b2f93e8f5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:53.521757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d9bd5bd8-6af4-4b3e-ba2d-df7b2f93e8f5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:53.541180 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d9bd5bd8-6af4-4b3e-ba2d-df7b2f93e8f5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1103 microversion: 2.1 time: 0.364668 Oct 29 01:12:53.544604 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1143/2247] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:53 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1103 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:53.563336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-b68776da-7741-4986-b355-635e14ffc45a req-d63aca8f-2f9e-439c-b3a6-c8b2e09a13af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcfd6276-a150-4389-aaf3-0ab17b032afd", "tag": "6101254d-0cf8-40c1-bee4-6d6023b114da"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:12:53.611910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b68776da-7741-4986-b355-635e14ffc45a req-d63aca8f-2f9e-439c-b3a6-c8b2e09a13af service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:53.618563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b68776da-7741-4986-b355-635e14ffc45a req-d63aca8f-2f9e-439c-b3a6-c8b2e09a13af service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:53.620167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b68776da-7741-4986-b355-635e14ffc45a req-d63aca8f-2f9e-439c-b3a6-c8b2e09a13af service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:53.674070 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-b68776da-7741-4986-b355-635e14ffc45a req-d63aca8f-2f9e-439c-b3a6-c8b2e09a13af service nova] Creating event network-changed:6101254d-0cf8-40c1-bee4-6d6023b114da for instance dcfd6276-a150-4389-aaf3-0ab17b032afd on n-h1-862964-3 Oct 29 01:12:53.690742 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-b68776da-7741-4986-b355-635e14ffc45a req-d63aca8f-2f9e-439c-b3a6-c8b2e09a13af service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143377 Oct 29 01:12:53.705336 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1144/2248] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:12:53.720238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2ac06c50-8d35-4c8a-bbce-15eb414aa228 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:53.721276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2ac06c50-8d35-4c8a-bbce-15eb414aa228 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:53.736175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ac06c50-8d35-4c8a-bbce-15eb414aa228 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:53.738343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ac06c50-8d35-4c8a-bbce-15eb414aa228 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:53.739345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ac06c50-8d35-4c8a-bbce-15eb414aa228 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:53.741968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ac06c50-8d35-4c8a-bbce-15eb414aa228 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:53.754912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ac06c50-8d35-4c8a-bbce-15eb414aa228 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:53.757683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ac06c50-8d35-4c8a-bbce-15eb414aa228 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:54.275724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2ac06c50-8d35-4c8a-bbce-15eb414aa228 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:54.293180 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2ac06c50-8d35-4c8a-bbce-15eb414aa228 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1524 microversion: 2.1 time: 0.585232 Oct 29 01:12:54.295830 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1145/2249] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:53 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1524 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:54.316202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-75d5f0e3-4186-4961-9e9d-492c6475a6e9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:54.319765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-75d5f0e3-4186-4961-9e9d-492c6475a6e9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 2dead7b7-a0ac-4233-a0ae-ed19568a36cf] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:54.343194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75d5f0e3-4186-4961-9e9d-492c6475a6e9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:54.344470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75d5f0e3-4186-4961-9e9d-492c6475a6e9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:54.347541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75d5f0e3-4186-4961-9e9d-492c6475a6e9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:54.348014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75d5f0e3-4186-4961-9e9d-492c6475a6e9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:54.348512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75d5f0e3-4186-4961-9e9d-492c6475a6e9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:54.357801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75d5f0e3-4186-4961-9e9d-492c6475a6e9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:54.400024 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-75d5f0e3-4186-4961-9e9d-492c6475a6e9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] HTTP exception thrown: Instance 2dead7b7-a0ac-4233-a0ae-ed19568a36cf could not be found. Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-75d5f0e3-4186-4961-9e9d-492c6475a6e9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Request method failure captured: Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf HTTP/1.1 Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwt8JRabpvp9J8kG0M67t8Iyr-SCG7c-JPFaER1eUdy9mdMDCEj57I5ypg-0c0_-vhR59XazevAWW9UCfnpvJK_2L07j2pHd2K21GogPYDil-XXkBqZo1XsB8bEUTDJZ0VVBE2QuaVkvQQHZTsiTPyIIY_dgKVrgYeW95RUKfni_RY Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.25 Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: d0adfdd6819a472baf1aa25878c5ee22 Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2081653878 Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d0adfdd6819a472baf1aa25878c5ee22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d0adfdd6819a472baf1aa25878c5ee22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d0adfdd6819a472baf1aa25878c5ee22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d0adfdd6819a472baf1aa25878c5ee22", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2081653878 Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: d0adfdd6819a472baf1aa25878c5ee22 Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2081653878 Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-LiveAutoBlockMigrationV225Test-2081653878-project Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: c56d01b83c0649e0b1d47b7563892d3f Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2081653878-project Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 2dead7b7-a0ac-4233-a0ae-ed19568a36cf could not be found. Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '2dead7b7-a0ac-4233-a0ae-ed19568a36cf'} Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dead7b7-a0ac-4233-a0ae-ed19568a36cf could not be found. Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dead7b7-a0ac-4233-a0ae-ed19568a36cf could not be found. Oct 29 01:12:54.401767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:54.404670 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:12:54.404670 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:54.404670 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:12:54.404670 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:12:54.404670 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:12:54.404670 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:12:54.404670 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:12:54.404670 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dead7b7-a0ac-4233-a0ae-ed19568a36cf could not be found. Oct 29 01:12:54.404670 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:12:54.404670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-75d5f0e3-4186-4961-9e9d-492c6475a6e9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Returning 404 to user: Instance 2dead7b7-a0ac-4233-a0ae-ed19568a36cf could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:12:54.404670 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-75d5f0e3-4186-4961-9e9d-492c6475a6e9 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf" status: 404 len: 111 microversion: 2.25 time: 0.106335 Oct 29 01:12:54.404670 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1146/2250] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:12:54 2022] GET /compute/v2.1/servers/2dead7b7-a0ac-4233-a0ae-ed19568a36cf => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:12:54.442518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-22f65cf8-46ce-42e6-90a0-b64a56c3e81c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:54.448826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-22f65cf8-46ce-42e6-90a0-b64a56c3e81c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:54.467043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22f65cf8-46ce-42e6-90a0-b64a56c3e81c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:54.467673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22f65cf8-46ce-42e6-90a0-b64a56c3e81c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:54.473397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22f65cf8-46ce-42e6-90a0-b64a56c3e81c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:54.474317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22f65cf8-46ce-42e6-90a0-b64a56c3e81c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:54.475160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22f65cf8-46ce-42e6-90a0-b64a56c3e81c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:54.476877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22f65cf8-46ce-42e6-90a0-b64a56c3e81c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:55.220793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-22f65cf8-46ce-42e6-90a0-b64a56c3e81c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:55.247488 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-22f65cf8-46ce-42e6-90a0-b64a56c3e81c tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1322 microversion: 2.1 time: 0.815615 Oct 29 01:12:55.271961 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1147/2251] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:54 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1322 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:55.307142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-58e479dc-f177-4658-ba74-8c043d3af816 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:55.308951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-58e479dc-f177-4658-ba74-8c043d3af816 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:55.348806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58e479dc-f177-4658-ba74-8c043d3af816 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:55.352244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58e479dc-f177-4658-ba74-8c043d3af816 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:55.365304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58e479dc-f177-4658-ba74-8c043d3af816 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:55.389177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58e479dc-f177-4658-ba74-8c043d3af816 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:55.391672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58e479dc-f177-4658-ba74-8c043d3af816 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:55.399206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58e479dc-f177-4658-ba74-8c043d3af816 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:55.676885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-58e479dc-f177-4658-ba74-8c043d3af816 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:55.696001 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-58e479dc-f177-4658-ba74-8c043d3af816 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1169 microversion: 2.1 time: 0.417788 Oct 29 01:12:55.709762 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1148/2252] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:55 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1169 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:55.717690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-68ada7ce-1aa3-4996-8a4f-d276595907e4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:55.719151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-68ada7ce-1aa3-4996-8a4f-d276595907e4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:55.734918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68ada7ce-1aa3-4996-8a4f-d276595907e4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:55.735780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68ada7ce-1aa3-4996-8a4f-d276595907e4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:55.736367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68ada7ce-1aa3-4996-8a4f-d276595907e4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:55.737368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68ada7ce-1aa3-4996-8a4f-d276595907e4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:55.740290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68ada7ce-1aa3-4996-8a4f-d276595907e4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:55.740967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68ada7ce-1aa3-4996-8a4f-d276595907e4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:56.094670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=34 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:56.289619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-68ada7ce-1aa3-4996-8a4f-d276595907e4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:56.311963 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-68ada7ce-1aa3-4996-8a4f-d276595907e4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1524 microversion: 2.1 time: 0.601056 Oct 29 01:12:56.337864 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1149/2253] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:55 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1524 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:56.344928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a32ab4ef-eb27-4fec-9777-a81c6dd62d64 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:56.361990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a32ab4ef-eb27-4fec-9777-a81c6dd62d64 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:56.392120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a32ab4ef-eb27-4fec-9777-a81c6dd62d64 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:56.392632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a32ab4ef-eb27-4fec-9777-a81c6dd62d64 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:56.393056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a32ab4ef-eb27-4fec-9777-a81c6dd62d64 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:56.398852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a32ab4ef-eb27-4fec-9777-a81c6dd62d64 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:56.399345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a32ab4ef-eb27-4fec-9777-a81c6dd62d64 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:56.399789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a32ab4ef-eb27-4fec-9777-a81c6dd62d64 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:56.529206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:58.590009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a32ab4ef-eb27-4fec-9777-a81c6dd62d64 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:58.603303 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a32ab4ef-eb27-4fec-9777-a81c6dd62d64 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1322 microversion: 2.1 time: 2.263732 Oct 29 01:12:58.604568 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1150/2254] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:56 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1322 bytes in 2266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:58.621677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3a0bdf39-ebf5-4a50-bd07-8f01bbe7d92e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:58.629092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3a0bdf39-ebf5-4a50-bd07-8f01bbe7d92e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:58.654761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a0bdf39-ebf5-4a50-bd07-8f01bbe7d92e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:58.659950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a0bdf39-ebf5-4a50-bd07-8f01bbe7d92e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:58.660645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a0bdf39-ebf5-4a50-bd07-8f01bbe7d92e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:58.661644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a0bdf39-ebf5-4a50-bd07-8f01bbe7d92e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:58.666212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a0bdf39-ebf5-4a50-bd07-8f01bbe7d92e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:58.667302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a0bdf39-ebf5-4a50-bd07-8f01bbe7d92e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:58.970496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3a0bdf39-ebf5-4a50-bd07-8f01bbe7d92e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:12:58.988426 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3a0bdf39-ebf5-4a50-bd07-8f01bbe7d92e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1169 microversion: 2.1 time: 0.382222 Oct 29 01:12:58.992270 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1151/2255] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:58 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1169 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:12:59.013475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-af7aacfa-bb40-4d32-a1d5-5e91df23e016 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:12:59.028284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-af7aacfa-bb40-4d32-a1d5-5e91df23e016 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:12:59.045086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af7aacfa-bb40-4d32-a1d5-5e91df23e016 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:59.051242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af7aacfa-bb40-4d32-a1d5-5e91df23e016 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:59.054556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af7aacfa-bb40-4d32-a1d5-5e91df23e016 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:59.056301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af7aacfa-bb40-4d32-a1d5-5e91df23e016 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:12:59.056988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af7aacfa-bb40-4d32-a1d5-5e91df23e016 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:12:59.059133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af7aacfa-bb40-4d32-a1d5-5e91df23e016 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:12:59.811489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:12:59.889490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:13:00.083292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-af7aacfa-bb40-4d32-a1d5-5e91df23e016 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:00.115802 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-af7aacfa-bb40-4d32-a1d5-5e91df23e016 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1524 microversion: 2.1 time: 1.112801 Oct 29 01:13:00.134343 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1152/2256] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:12:59 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1524 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:00.166366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8a00235f-abaa-4ffb-bf48-abc1a2117c03 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:00.176718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8a00235f-abaa-4ffb-bf48-abc1a2117c03 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:00.217438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a00235f-abaa-4ffb-bf48-abc1a2117c03 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:00.219712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a00235f-abaa-4ffb-bf48-abc1a2117c03 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:00.220390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a00235f-abaa-4ffb-bf48-abc1a2117c03 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:00.222025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a00235f-abaa-4ffb-bf48-abc1a2117c03 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:00.224846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a00235f-abaa-4ffb-bf48-abc1a2117c03 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:00.231148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a00235f-abaa-4ffb-bf48-abc1a2117c03 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:01.586521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8a00235f-abaa-4ffb-bf48-abc1a2117c03 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:01.615777 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8a00235f-abaa-4ffb-bf48-abc1a2117c03 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1322 microversion: 2.1 time: 1.464351 Oct 29 01:13:01.622673 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1153/2257] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:00 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1322 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:01.657286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1eef6b78-c35d-4500-9a32-72fd5e576907 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:01.658332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1eef6b78-c35d-4500-9a32-72fd5e576907 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:01.674783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1eef6b78-c35d-4500-9a32-72fd5e576907 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:01.677880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1eef6b78-c35d-4500-9a32-72fd5e576907 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:01.681564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1eef6b78-c35d-4500-9a32-72fd5e576907 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:01.684376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1eef6b78-c35d-4500-9a32-72fd5e576907 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:01.685057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1eef6b78-c35d-4500-9a32-72fd5e576907 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:01.689021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1eef6b78-c35d-4500-9a32-72fd5e576907 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:02.777107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1eef6b78-c35d-4500-9a32-72fd5e576907 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:02.790280 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1eef6b78-c35d-4500-9a32-72fd5e576907 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1211 microversion: 2.1 time: 1.166061 Oct 29 01:13:02.806678 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1154/2258] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:01 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1211 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:02.822791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-81fa9c55-1f48-4b4c-8a69-58619391cad2 req-05495cb0-e45a-4f34-9fa9-36fbb3e5074e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69681dc4-6f48-44ea-a7c4-1b10ea9b86dd", "name": "network-vif-plugged", "status": "completed", "tag": "158356ab-2942-4088-a11e-87c640cd15e8"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:02.844666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-81fa9c55-1f48-4b4c-8a69-58619391cad2 req-05495cb0-e45a-4f34-9fa9-36fbb3e5074e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:02.845618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-81fa9c55-1f48-4b4c-8a69-58619391cad2 req-05495cb0-e45a-4f34-9fa9-36fbb3e5074e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:02.846280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-81fa9c55-1f48-4b4c-8a69-58619391cad2 req-05495cb0-e45a-4f34-9fa9-36fbb3e5074e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:02.860206 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-81fa9c55-1f48-4b4c-8a69-58619391cad2 req-05495cb0-e45a-4f34-9fa9-36fbb3e5074e service nova] Creating event network-vif-plugged:158356ab-2942-4088-a11e-87c640cd15e8 for instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd on n-h2-862964-3 Oct 29 01:13:02.867489 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-81fa9c55-1f48-4b4c-8a69-58619391cad2 req-05495cb0-e45a-4f34-9fa9-36fbb3e5074e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057575 Oct 29 01:13:02.870441 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1155/2259] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:02.880187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1d291d4c-6b5f-4ac0-a61a-2f06e580a0ec tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:02.884799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1d291d4c-6b5f-4ac0-a61a-2f06e580a0ec tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:02.909779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:13:02.919147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d291d4c-6b5f-4ac0-a61a-2f06e580a0ec tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:02.921298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d291d4c-6b5f-4ac0-a61a-2f06e580a0ec tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:02.923208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d291d4c-6b5f-4ac0-a61a-2f06e580a0ec tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:02.926146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d291d4c-6b5f-4ac0-a61a-2f06e580a0ec tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:02.931789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d291d4c-6b5f-4ac0-a61a-2f06e580a0ec tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:02.932551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d291d4c-6b5f-4ac0-a61a-2f06e580a0ec tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:03.353853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1d291d4c-6b5f-4ac0-a61a-2f06e580a0ec tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:03.363225 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1d291d4c-6b5f-4ac0-a61a-2f06e580a0ec tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1524 microversion: 2.1 time: 0.491264 Oct 29 01:13:03.369881 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1156/2260] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:02 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1524 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:03.381626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fc61caab-ac9e-4fba-a914-67b206095a80 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:03.389397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fc61caab-ac9e-4fba-a914-67b206095a80 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:03.415140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc61caab-ac9e-4fba-a914-67b206095a80 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:03.415810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc61caab-ac9e-4fba-a914-67b206095a80 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:03.417610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc61caab-ac9e-4fba-a914-67b206095a80 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:03.417610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc61caab-ac9e-4fba-a914-67b206095a80 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:03.422287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc61caab-ac9e-4fba-a914-67b206095a80 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:03.422802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc61caab-ac9e-4fba-a914-67b206095a80 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:04.213057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fc61caab-ac9e-4fba-a914-67b206095a80 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:04.230921 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fc61caab-ac9e-4fba-a914-67b206095a80 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1322 microversion: 2.1 time: 0.858491 Oct 29 01:13:04.232549 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1157/2261] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:03 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1322 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:04.249109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1a89da69-8af7-4990-abdd-3820cbdcbf99 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:04.250314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1a89da69-8af7-4990-abdd-3820cbdcbf99 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:04.291563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a89da69-8af7-4990-abdd-3820cbdcbf99 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:04.292304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a89da69-8af7-4990-abdd-3820cbdcbf99 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:04.292837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a89da69-8af7-4990-abdd-3820cbdcbf99 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:04.293597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a89da69-8af7-4990-abdd-3820cbdcbf99 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:04.294062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a89da69-8af7-4990-abdd-3820cbdcbf99 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:04.294494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a89da69-8af7-4990-abdd-3820cbdcbf99 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:04.903258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1a89da69-8af7-4990-abdd-3820cbdcbf99 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:04.916005 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1a89da69-8af7-4990-abdd-3820cbdcbf99 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1211 microversion: 2.1 time: 0.682135 Oct 29 01:13:04.919248 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1158/2262] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:04 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1211 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:04.933427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ff16b1a9-92af-4ec2-916c-71f60cdc50db tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:04.934236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ff16b1a9-92af-4ec2-916c-71f60cdc50db tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:04.954009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff16b1a9-92af-4ec2-916c-71f60cdc50db tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:04.954791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff16b1a9-92af-4ec2-916c-71f60cdc50db tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:04.955624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff16b1a9-92af-4ec2-916c-71f60cdc50db tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:04.956593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff16b1a9-92af-4ec2-916c-71f60cdc50db tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:04.957338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff16b1a9-92af-4ec2-916c-71f60cdc50db tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:04.958084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff16b1a9-92af-4ec2-916c-71f60cdc50db tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:05.000584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ff16b1a9-92af-4ec2-916c-71f60cdc50db tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:13:05.164248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:13:05.383193 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ff16b1a9-92af-4ec2-916c-71f60cdc50db tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "DELETE /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 204 len: 0 microversion: 2.1 time: 0.462366 Oct 29 01:13:05.387749 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1159/2263] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:13:04 2022] DELETE /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:13:05.399069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e8bfe4ff-d159-4d32-a771-7329a871e545 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:05.404232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e8bfe4ff-d159-4d32-a771-7329a871e545 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:05.422374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8bfe4ff-d159-4d32-a771-7329a871e545 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:05.424644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8bfe4ff-d159-4d32-a771-7329a871e545 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:05.427204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8bfe4ff-d159-4d32-a771-7329a871e545 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:05.428164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8bfe4ff-d159-4d32-a771-7329a871e545 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:05.429050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8bfe4ff-d159-4d32-a771-7329a871e545 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:05.429050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8bfe4ff-d159-4d32-a771-7329a871e545 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:06.607226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e8bfe4ff-d159-4d32-a771-7329a871e545 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:06.622530 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e8bfe4ff-d159-4d32-a771-7329a871e545 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1524 microversion: 2.1 time: 1.233399 Oct 29 01:13:06.623285 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1160/2264] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:05 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1524 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:06.632098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-24d55877-14e9-4f92-8d8b-361ffbc7015f req-82326cf5-7078-4d92-b156-0a747c66a022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4", "name": "network-vif-plugged", "status": "completed", "tag": "b01f8de2-8104-4190-b4b3-34aeca1dde7b"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:06.678272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-24d55877-14e9-4f92-8d8b-361ffbc7015f req-82326cf5-7078-4d92-b156-0a747c66a022 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:06.684194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-24d55877-14e9-4f92-8d8b-361ffbc7015f req-82326cf5-7078-4d92-b156-0a747c66a022 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:06.684727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-24d55877-14e9-4f92-8d8b-361ffbc7015f req-82326cf5-7078-4d92-b156-0a747c66a022 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:06.739314 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-24d55877-14e9-4f92-8d8b-361ffbc7015f req-82326cf5-7078-4d92-b156-0a747c66a022 service nova] Creating event network-vif-plugged:b01f8de2-8104-4190-b4b3-34aeca1dde7b for instance 6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4 on n-h1-862964-3 Oct 29 01:13:06.757299 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-24d55877-14e9-4f92-8d8b-361ffbc7015f req-82326cf5-7078-4d92-b156-0a747c66a022 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130617 Oct 29 01:13:06.761507 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1161/2265] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:06.780022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4ba84877-cb88-4f85-88f2-3c3c33bea187 req-87102a3f-b775-493a-b8c5-08af71ef3f5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24ebe561-9b25-419d-b771-d5f2d212cfbb", "tag": "c9bfa9ce-2881-44eb-bf9e-16eb902a3d6a"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:06.804140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4ba84877-cb88-4f85-88f2-3c3c33bea187 req-87102a3f-b775-493a-b8c5-08af71ef3f5e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:06.806639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4ba84877-cb88-4f85-88f2-3c3c33bea187 req-87102a3f-b775-493a-b8c5-08af71ef3f5e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:06.807476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4ba84877-cb88-4f85-88f2-3c3c33bea187 req-87102a3f-b775-493a-b8c5-08af71ef3f5e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:06.849318 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4ba84877-cb88-4f85-88f2-3c3c33bea187 req-87102a3f-b775-493a-b8c5-08af71ef3f5e service nova] Creating event network-changed:c9bfa9ce-2881-44eb-bf9e-16eb902a3d6a for instance 24ebe561-9b25-419d-b771-d5f2d212cfbb on n-h1-862964-3 Oct 29 01:13:06.884971 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4ba84877-cb88-4f85-88f2-3c3c33bea187 req-87102a3f-b775-493a-b8c5-08af71ef3f5e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119449 Oct 29 01:13:06.909074 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1162/2266] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:06.931047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a62e8ea1-7cc6-40a7-adde-d9bf61e407e1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:06.935170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a62e8ea1-7cc6-40a7-adde-d9bf61e407e1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:06.974488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a62e8ea1-7cc6-40a7-adde-d9bf61e407e1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:06.976200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a62e8ea1-7cc6-40a7-adde-d9bf61e407e1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:06.980135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a62e8ea1-7cc6-40a7-adde-d9bf61e407e1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:06.988560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a62e8ea1-7cc6-40a7-adde-d9bf61e407e1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:06.990020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a62e8ea1-7cc6-40a7-adde-d9bf61e407e1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:06.994373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a62e8ea1-7cc6-40a7-adde-d9bf61e407e1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:08.074940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a62e8ea1-7cc6-40a7-adde-d9bf61e407e1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:08.083698 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a62e8ea1-7cc6-40a7-adde-d9bf61e407e1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1322 microversion: 2.1 time: 1.171016 Oct 29 01:13:08.098452 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1163/2267] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:06 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1322 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:08.121230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8434e2e5-0d5e-4405-b0d0-5dec3dc02bcd tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:08.121964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8434e2e5-0d5e-4405-b0d0-5dec3dc02bcd tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:08.159906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8434e2e5-0d5e-4405-b0d0-5dec3dc02bcd tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:08.160820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8434e2e5-0d5e-4405-b0d0-5dec3dc02bcd tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:08.166440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8434e2e5-0d5e-4405-b0d0-5dec3dc02bcd tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:08.181013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8434e2e5-0d5e-4405-b0d0-5dec3dc02bcd tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:08.183640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8434e2e5-0d5e-4405-b0d0-5dec3dc02bcd tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:08.184104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8434e2e5-0d5e-4405-b0d0-5dec3dc02bcd tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:08.668135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8434e2e5-0d5e-4405-b0d0-5dec3dc02bcd tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ba2d71e9604486bef50f7d4b8a8700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82d19d99c7e405fb679320110c9748d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:08.691667 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8434e2e5-0d5e-4405-b0d0-5dec3dc02bcd tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 200 len: 1667 microversion: 2.1 time: 0.591347 Oct 29 01:13:08.692273 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1164/2268] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:08 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 1667 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:08.716703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1de64d44-f92f-49b1-a78e-ae8648aa3650 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:08.717389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1de64d44-f92f-49b1-a78e-ae8648aa3650 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:08.759149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1de64d44-f92f-49b1-a78e-ae8648aa3650 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:08.759643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1de64d44-f92f-49b1-a78e-ae8648aa3650 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:08.760084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1de64d44-f92f-49b1-a78e-ae8648aa3650 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:08.760795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1de64d44-f92f-49b1-a78e-ae8648aa3650 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:08.780409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1de64d44-f92f-49b1-a78e-ae8648aa3650 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:08.781619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1de64d44-f92f-49b1-a78e-ae8648aa3650 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:09.405435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1de64d44-f92f-49b1-a78e-ae8648aa3650 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:09.423045 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1de64d44-f92f-49b1-a78e-ae8648aa3650 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1211 microversion: 2.1 time: 0.714850 Oct 29 01:13:09.425790 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1165/2269] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:08 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1211 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:09.445513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d3cdf4b5-0359-4382-9692-33cf22313a2f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:09.446518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d3cdf4b5-0359-4382-9692-33cf22313a2f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:09.460812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3cdf4b5-0359-4382-9692-33cf22313a2f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:09.463634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3cdf4b5-0359-4382-9692-33cf22313a2f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:09.464561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3cdf4b5-0359-4382-9692-33cf22313a2f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:09.466798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3cdf4b5-0359-4382-9692-33cf22313a2f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:09.467499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3cdf4b5-0359-4382-9692-33cf22313a2f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:09.469698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3cdf4b5-0359-4382-9692-33cf22313a2f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:09.554089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d3cdf4b5-0359-4382-9692-33cf22313a2f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:13:10.022475 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d3cdf4b5-0359-4382-9692-33cf22313a2f tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "DELETE /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 204 len: 0 microversion: 2.25 time: 0.595077 Oct 29 01:13:10.029833 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1166/2270] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:13:09 2022] DELETE /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:13:10.505305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7ad70702-7ee3-4d3c-a8cf-feb058a4a303 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Action: 'create', calling method: .version_select at 0x7f9d9779c940>, body: {"keypair": {"name": "tempest-keypair-1623003296", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCf+0/JUCqmzD9ZID3rfVaVN1+BZSAXgt4uRnVtfpi+3dSfGebRfhfBC2gBljUnRoIMa1WwVuizxuxH6Ml0fBQC/nimaDlIEmaQO+QW5f90sTAB8ok3b4/SoVVUPUP1Rgg=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:10.558518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-7ad70702-7ee3-4d3c-a8cf-feb058a4a303 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Getting quotas for project f9690bcd50e1416ca83f62fbc3940364. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:13:10.583201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-7ad70702-7ee3-4d3c-a8cf-feb058a4a303 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Getting quotas for user e1ff07349003488586b5d8f3f2aaf995 and project f9690bcd50e1416ca83f62fbc3940364. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:13:10.767888 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7ad70702-7ee3-4d3c-a8cf-feb058a4a303 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.743177 Oct 29 01:13:10.768513 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1167/2271] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:13:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:10.774347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cd180795-b2d7-4fbe-bcf6-3dc174add066 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:10.794436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cd180795-b2d7-4fbe-bcf6-3dc174add066 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:10.827075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cd180795-b2d7-4fbe-bcf6-3dc174add066 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:10.834452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cd180795-b2d7-4fbe-bcf6-3dc174add066 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:10.834916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cd180795-b2d7-4fbe-bcf6-3dc174add066 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:10.844704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cd180795-b2d7-4fbe-bcf6-3dc174add066 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:10.846713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cd180795-b2d7-4fbe-bcf6-3dc174add066 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:10.847313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cd180795-b2d7-4fbe-bcf6-3dc174add066 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:11.698979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cd180795-b2d7-4fbe-bcf6-3dc174add066 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:11.712294 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cd180795-b2d7-4fbe-bcf6-3dc174add066 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1524 microversion: 2.1 time: 0.941746 Oct 29 01:13:11.715842 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1168/2272] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:10 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1524 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:11.729125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-c9bae670-787c-40a3-b170-3b66324d8226 req-93035c41-aba9-4477-a597-0f12588d1c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcfd6276-a150-4389-aaf3-0ab17b032afd", "name": "network-vif-plugged", "status": "completed", "tag": "6101254d-0cf8-40c1-bee4-6d6023b114da"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:11.754383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c9bae670-787c-40a3-b170-3b66324d8226 req-93035c41-aba9-4477-a597-0f12588d1c21 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:11.765958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c9bae670-787c-40a3-b170-3b66324d8226 req-93035c41-aba9-4477-a597-0f12588d1c21 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:11.768448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c9bae670-787c-40a3-b170-3b66324d8226 req-93035c41-aba9-4477-a597-0f12588d1c21 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:11.848388 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-c9bae670-787c-40a3-b170-3b66324d8226 req-93035c41-aba9-4477-a597-0f12588d1c21 service nova] Creating event network-vif-plugged:6101254d-0cf8-40c1-bee4-6d6023b114da for instance dcfd6276-a150-4389-aaf3-0ab17b032afd on n-h1-862964-3 Oct 29 01:13:11.880391 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-c9bae670-787c-40a3-b170-3b66324d8226 req-93035c41-aba9-4477-a597-0f12588d1c21 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160227 Oct 29 01:13:11.883098 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1169/2273] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:11.918456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cfa404c5-fc1e-4b73-a358-f0b97e3ffc41 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:11.929207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cfa404c5-fc1e-4b73-a358-f0b97e3ffc41 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:11.996589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfa404c5-fc1e-4b73-a358-f0b97e3ffc41 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:12.000690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfa404c5-fc1e-4b73-a358-f0b97e3ffc41 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:12.004216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfa404c5-fc1e-4b73-a358-f0b97e3ffc41 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:12.005745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfa404c5-fc1e-4b73-a358-f0b97e3ffc41 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:12.010485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfa404c5-fc1e-4b73-a358-f0b97e3ffc41 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:12.011421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfa404c5-fc1e-4b73-a358-f0b97e3ffc41 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:12.643382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cfa404c5-fc1e-4b73-a358-f0b97e3ffc41 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:12.664152 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cfa404c5-fc1e-4b73-a358-f0b97e3ffc41 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1322 microversion: 2.1 time: 0.777043 Oct 29 01:13:12.664773 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1170/2274] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:11 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1322 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:12.689025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-33583027-4c41-458d-954d-d5dc3be6c208 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:12.689606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-33583027-4c41-458d-954d-d5dc3be6c208 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:12.710998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33583027-4c41-458d-954d-d5dc3be6c208 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:12.712301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33583027-4c41-458d-954d-d5dc3be6c208 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:12.713064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33583027-4c41-458d-954d-d5dc3be6c208 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:12.713969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33583027-4c41-458d-954d-d5dc3be6c208 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:12.716918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33583027-4c41-458d-954d-d5dc3be6c208 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:12.717547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33583027-4c41-458d-954d-d5dc3be6c208 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:12.848983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-33583027-4c41-458d-954d-d5dc3be6c208 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ba2d71e9604486bef50f7d4b8a8700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82d19d99c7e405fb679320110c9748d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:12.862073 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-33583027-4c41-458d-954d-d5dc3be6c208 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 200 len: 1599 microversion: 2.1 time: 0.195573 Oct 29 01:13:12.864112 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1171/2275] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:12 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 1599 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:12.901193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e29ae192-dcfe-4935-b254-f688952bb2a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:12.903192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e29ae192-dcfe-4935-b254-f688952bb2a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:12.931837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e29ae192-dcfe-4935-b254-f688952bb2a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:12.931837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e29ae192-dcfe-4935-b254-f688952bb2a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:12.931837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e29ae192-dcfe-4935-b254-f688952bb2a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:12.931837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e29ae192-dcfe-4935-b254-f688952bb2a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:12.931837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e29ae192-dcfe-4935-b254-f688952bb2a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:12.931837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e29ae192-dcfe-4935-b254-f688952bb2a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:13.302982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e29ae192-dcfe-4935-b254-f688952bb2a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:13.325350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e29ae192-dcfe-4935-b254-f688952bb2a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:13.326952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e29ae192-dcfe-4935-b254-f688952bb2a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:13.329033 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e29ae192-dcfe-4935-b254-f688952bb2a8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1731 microversion: 2.25 time: 0.459969 Oct 29 01:13:13.329653 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1172/2276] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:13:12 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1731 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:13.338035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0e100569-5358-43c8-a7a6-7a9a031b55c8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:13.354222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0e100569-5358-43c8-a7a6-7a9a031b55c8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:13.368122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e100569-5358-43c8-a7a6-7a9a031b55c8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:13.368893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e100569-5358-43c8-a7a6-7a9a031b55c8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:13.373436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e100569-5358-43c8-a7a6-7a9a031b55c8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:13.374532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e100569-5358-43c8-a7a6-7a9a031b55c8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:13.382009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e100569-5358-43c8-a7a6-7a9a031b55c8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:13.382694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e100569-5358-43c8-a7a6-7a9a031b55c8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:14.249627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0e100569-5358-43c8-a7a6-7a9a031b55c8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:14.258389 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0e100569-5358-43c8-a7a6-7a9a031b55c8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1211 microversion: 2.1 time: 0.926680 Oct 29 01:13:14.262875 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1173/2277] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:13 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1211 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:14.272884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4e98384a-914f-47f6-b36f-b9803d3377a2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:14.279427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4e98384a-914f-47f6-b36f-b9803d3377a2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:14.291672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e98384a-914f-47f6-b36f-b9803d3377a2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:14.292425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e98384a-914f-47f6-b36f-b9803d3377a2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:14.292864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e98384a-914f-47f6-b36f-b9803d3377a2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:14.299265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e98384a-914f-47f6-b36f-b9803d3377a2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:14.299776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e98384a-914f-47f6-b36f-b9803d3377a2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:14.300211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e98384a-914f-47f6-b36f-b9803d3377a2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:15.103492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4e98384a-914f-47f6-b36f-b9803d3377a2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:15.123974 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4e98384a-914f-47f6-b36f-b9803d3377a2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1524 microversion: 2.1 time: 0.859691 Oct 29 01:13:15.138081 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1174/2278] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:14 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1524 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:15.152325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-2e9f90a8-7e27-4b3e-9e2e-11dc6147687e req-735cdc51-e4da-406f-bbd2-dd6083da648b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61cd44bc-7c52-428d-92a9-44443fd987ce", "name": "network-vif-deleted", "tag": "337dc720-1980-4d9f-aeb1-6c6ad88902d3"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:15.176152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2e9f90a8-7e27-4b3e-9e2e-11dc6147687e req-735cdc51-e4da-406f-bbd2-dd6083da648b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:15.176550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2e9f90a8-7e27-4b3e-9e2e-11dc6147687e req-735cdc51-e4da-406f-bbd2-dd6083da648b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:15.176986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2e9f90a8-7e27-4b3e-9e2e-11dc6147687e req-735cdc51-e4da-406f-bbd2-dd6083da648b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:15.207137 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-2e9f90a8-7e27-4b3e-9e2e-11dc6147687e req-735cdc51-e4da-406f-bbd2-dd6083da648b service nova] Creating event network-vif-deleted:337dc720-1980-4d9f-aeb1-6c6ad88902d3 for instance 61cd44bc-7c52-428d-92a9-44443fd987ce on n-h2-862964-3 Oct 29 01:13:15.219760 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-2e9f90a8-7e27-4b3e-9e2e-11dc6147687e req-735cdc51-e4da-406f-bbd2-dd6083da648b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080180 Oct 29 01:13:15.222196 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1175/2279] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:15.227867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2a957a91-1863-41ef-b11f-5c5003c0668d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:15.228583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2a957a91-1863-41ef-b11f-5c5003c0668d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:15.235752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2a957a91-1863-41ef-b11f-5c5003c0668d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:15.236247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2a957a91-1863-41ef-b11f-5c5003c0668d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:15.236687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2a957a91-1863-41ef-b11f-5c5003c0668d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:15.237438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2a957a91-1863-41ef-b11f-5c5003c0668d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:15.237905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2a957a91-1863-41ef-b11f-5c5003c0668d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:15.238336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2a957a91-1863-41ef-b11f-5c5003c0668d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:15.473350 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c5a3b0e4-f430-4986-bddf-9d32498ef240 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776" status: 200 len: 1421 microversion: 2.1 time: 28.653779 Oct 29 01:13:15.482810 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1105/2280] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:12:46 2022] GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776 => generated 1421 bytes in 28659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:15.504882 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2707a2b8-a89d-4f61-884d-330c4bde13aa tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:15.507792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2707a2b8-a89d-4f61-884d-330c4bde13aa tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] [instance: 61cd44bc-7c52-428d-92a9-44443fd987ce] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:15.520783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2707a2b8-a89d-4f61-884d-330c4bde13aa tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:15.521320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2707a2b8-a89d-4f61-884d-330c4bde13aa tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:15.521769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2707a2b8-a89d-4f61-884d-330c4bde13aa tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:15.522535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2707a2b8-a89d-4f61-884d-330c4bde13aa tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:15.523116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2707a2b8-a89d-4f61-884d-330c4bde13aa tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:15.523621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2707a2b8-a89d-4f61-884d-330c4bde13aa tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:15.558912 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-2707a2b8-a89d-4f61-884d-330c4bde13aa tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] HTTP exception thrown: Instance 61cd44bc-7c52-428d-92a9-44443fd987ce could not be found. Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2707a2b8-a89d-4f61-884d-330c4bde13aa tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Request method failure captured: Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce HTTP/1.1 Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH2zyaGH8TusXAYwJmb6ZO5q5vXVuWTvHLmRxJClNJVP_7Qj4q81wUn93nNSdwKvFo6NNvCUYi8JyKqSfpCFSj7UvVKuzwjHWq-vFlZ-SwVLR-beBmU3fxikQ-WZItc7aAO8z58W0D9iDFhWy-H7Ieejmu9_57KYOrPcJWWRES1wxqQ Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: d82d19d99c7e405fb679320110c9748d Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersTestFqdnHostnames-1357247235 Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d82d19d99c7e405fb679320110c9748d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d82d19d99c7e405fb679320110c9748d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d82d19d99c7e405fb679320110c9748d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d82d19d99c7e405fb679320110c9748d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersTestFqdnHostnames-1357247235 Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: d82d19d99c7e405fb679320110c9748d Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1357247235 Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersTestFqdnHostnames-1357247235-project Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 51ba2d71e9604486bef50f7d4b8a8700 Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersTestFqdnHostnames-1357247235-project Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 61cd44bc-7c52-428d-92a9-44443fd987ce could not be found. Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '61cd44bc-7c52-428d-92a9-44443fd987ce'} Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61cd44bc-7c52-428d-92a9-44443fd987ce could not be found. Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61cd44bc-7c52-428d-92a9-44443fd987ce could not be found. Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:15.563573 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:13:15.567400 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:15.567400 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:15.567400 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:15.567400 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:13:15.567400 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:13:15.567400 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61cd44bc-7c52-428d-92a9-44443fd987ce could not be found. Oct 29 01:13:15.567400 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:13:15.567400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2707a2b8-a89d-4f61-884d-330c4bde13aa tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Returning 404 to user: Instance 61cd44bc-7c52-428d-92a9-44443fd987ce could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:13:15.571270 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2707a2b8-a89d-4f61-884d-330c4bde13aa tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce" status: 404 len: 111 microversion: 2.1 time: 0.092279 Oct 29 01:13:15.571867 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1106/2281] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:15 2022] GET /compute/v2.1/servers/61cd44bc-7c52-428d-92a9-44443fd987ce => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:13:15.576780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-56f22730-8441-4330-8028-24b8d15a2c24 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:15.585538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-56f22730-8441-4330-8028-24b8d15a2c24 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:15.613820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56f22730-8441-4330-8028-24b8d15a2c24 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:15.614539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56f22730-8441-4330-8028-24b8d15a2c24 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:15.615159 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56f22730-8441-4330-8028-24b8d15a2c24 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:15.616025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56f22730-8441-4330-8028-24b8d15a2c24 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:15.622067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56f22730-8441-4330-8028-24b8d15a2c24 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:15.622814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56f22730-8441-4330-8028-24b8d15a2c24 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:16.375821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-56f22730-8441-4330-8028-24b8d15a2c24 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:16.387417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-56f22730-8441-4330-8028-24b8d15a2c24 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:16.394970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-56f22730-8441-4330-8028-24b8d15a2c24 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:16.396602 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-56f22730-8441-4330-8028-24b8d15a2c24 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1663 microversion: 2.25 time: 0.823579 Oct 29 01:13:16.397611 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1107/2282] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:13:15 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1663 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:16.404818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2e20d310-6b2a-4794-a97d-b0c20ff132cb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:16.406961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2e20d310-6b2a-4794-a97d-b0c20ff132cb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:16.427864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e20d310-6b2a-4794-a97d-b0c20ff132cb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:16.432547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e20d310-6b2a-4794-a97d-b0c20ff132cb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:16.433573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e20d310-6b2a-4794-a97d-b0c20ff132cb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:16.434701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e20d310-6b2a-4794-a97d-b0c20ff132cb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:16.439118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e20d310-6b2a-4794-a97d-b0c20ff132cb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:16.439839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e20d310-6b2a-4794-a97d-b0c20ff132cb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:16.532499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2a957a91-1863-41ef-b11f-5c5003c0668d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:16.551976 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2a957a91-1863-41ef-b11f-5c5003c0668d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 200 len: 1515 microversion: 2.1 time: 1.328493 Oct 29 01:13:16.555942 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1176/2283] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:15 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 1515 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:16.575027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0d10b397-b89d-4b40-881e-2038547d9845 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] Calling method '.version_select at 0x7f9d9c0bc670>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:16.790989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2e20d310-6b2a-4794-a97d-b0c20ff132cb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:16.806823 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2e20d310-6b2a-4794-a97d-b0c20ff132cb tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1199 microversion: 2.1 time: 0.407753 Oct 29 01:13:16.807744 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1108/2284] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:16 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1199 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:16.814008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-02ce5dd3-8561-4bf8-b4a4-e79016bc5cb3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:16.814794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-02ce5dd3-8561-4bf8-b4a4-e79016bc5cb3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:16.822080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02ce5dd3-8561-4bf8-b4a4-e79016bc5cb3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:16.823164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02ce5dd3-8561-4bf8-b4a4-e79016bc5cb3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:16.823767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02ce5dd3-8561-4bf8-b4a4-e79016bc5cb3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:16.824632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02ce5dd3-8561-4bf8-b4a4-e79016bc5cb3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:16.825267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02ce5dd3-8561-4bf8-b4a4-e79016bc5cb3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:16.825869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02ce5dd3-8561-4bf8-b4a4-e79016bc5cb3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:16.892831 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0d10b397-b89d-4b40-881e-2038547d9845 tempest-ServersTestFqdnHostnames-1357247235 tempest-ServersTestFqdnHostnames-1357247235-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-807123210" status: 202 len: 0 microversion: 2.1 time: 0.334451 Oct 29 01:13:16.898161 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1177/2285] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 29 01:13:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-807123210 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:13:16.906501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e678d1d6-5971-4019-9f6c-22a73642363a tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d97773a60>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:17.053834 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e678d1d6-5971-4019-9f6c-22a73642363a tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776" status: 200 len: 1421 microversion: 2.1 time: 0.154037 Oct 29 01:13:17.068034 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1178/2286] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:16 2022] GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776 => generated 1421 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:17.080810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b251eddf-a8ad-4eda-ba96-54c819f6b091 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:17.083290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b251eddf-a8ad-4eda-ba96-54c819f6b091 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: 6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:17.114774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b251eddf-a8ad-4eda-ba96-54c819f6b091 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:17.115956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b251eddf-a8ad-4eda-ba96-54c819f6b091 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:17.117770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b251eddf-a8ad-4eda-ba96-54c819f6b091 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:17.118812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b251eddf-a8ad-4eda-ba96-54c819f6b091 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:17.119294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b251eddf-a8ad-4eda-ba96-54c819f6b091 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:17.119733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b251eddf-a8ad-4eda-ba96-54c819f6b091 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:17.816932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-02ce5dd3-8561-4bf8-b4a4-e79016bc5cb3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:17.846899 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-02ce5dd3-8561-4bf8-b4a4-e79016bc5cb3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1524 microversion: 2.1 time: 1.037852 Oct 29 01:13:17.862592 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1109/2287] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:16 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1524 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:17.878148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e6e3e38e-cee8-45ae-8ca1-35b3f883917c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:17.878791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e6e3e38e-cee8-45ae-8ca1-35b3f883917c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:17.887580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e6e3e38e-cee8-45ae-8ca1-35b3f883917c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:17.894727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e6e3e38e-cee8-45ae-8ca1-35b3f883917c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:17.894727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e6e3e38e-cee8-45ae-8ca1-35b3f883917c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:17.894727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e6e3e38e-cee8-45ae-8ca1-35b3f883917c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:17.894727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e6e3e38e-cee8-45ae-8ca1-35b3f883917c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:17.894727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e6e3e38e-cee8-45ae-8ca1-35b3f883917c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:17.952160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e6e3e38e-cee8-45ae-8ca1-35b3f883917c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:17.953723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e6e3e38e-cee8-45ae-8ca1-35b3f883917c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:17.954484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e6e3e38e-cee8-45ae-8ca1-35b3f883917c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:17.955125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-e6e3e38e-cee8-45ae-8ca1-35b3f883917c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lazy-loading 'fault' on Instance uuid 00a19183-c526-47be-95c4-d4c3a9936390 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:13:18.037526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b251eddf-a8ad-4eda-ba96-54c819f6b091 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:18.047966 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b251eddf-a8ad-4eda-ba96-54c819f6b091 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4" status: 200 len: 1515 microversion: 2.1 time: 0.982425 Oct 29 01:13:18.048569 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1179/2288] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:17 2022] GET /compute/v2.1/servers/6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4 => generated 1515 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:18.076022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-06a53c12-54b9-4747-b5a4-0dd2d8a02c2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:18.076750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-06a53c12-54b9-4747-b5a4-0dd2d8a02c2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:18.095712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06a53c12-54b9-4747-b5a4-0dd2d8a02c2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:18.096216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06a53c12-54b9-4747-b5a4-0dd2d8a02c2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:18.096667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06a53c12-54b9-4747-b5a4-0dd2d8a02c2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:18.102492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06a53c12-54b9-4747-b5a4-0dd2d8a02c2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:18.103102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06a53c12-54b9-4747-b5a4-0dd2d8a02c2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:18.103559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06a53c12-54b9-4747-b5a4-0dd2d8a02c2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:18.118586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:13:18.162507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e6e3e38e-cee8-45ae-8ca1-35b3f883917c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:18.175037 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e6e3e38e-cee8-45ae-8ca1-35b3f883917c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:18.179337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e6e3e38e-cee8-45ae-8ca1-35b3f883917c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:18.183460 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e6e3e38e-cee8-45ae-8ca1-35b3f883917c tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 200 len: 1376 microversion: 2.25 time: 0.317981 Oct 29 01:13:18.186083 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1110/2289] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:13:17 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 1376 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:18.192868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-474e3341-1cb7-4f58-8884-54889c262acc req-42ced808-ef6c-40b7-b88a-9472b489e7ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a19183-c526-47be-95c4-d4c3a9936390", "name": "network-vif-deleted", "tag": "1435293b-3554-4c79-9898-f9de315c7829"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:18.242163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-474e3341-1cb7-4f58-8884-54889c262acc req-42ced808-ef6c-40b7-b88a-9472b489e7ae service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:18.243188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-474e3341-1cb7-4f58-8884-54889c262acc req-42ced808-ef6c-40b7-b88a-9472b489e7ae service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:18.243812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-474e3341-1cb7-4f58-8884-54889c262acc req-42ced808-ef6c-40b7-b88a-9472b489e7ae service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:18.262732 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-474e3341-1cb7-4f58-8884-54889c262acc req-42ced808-ef6c-40b7-b88a-9472b489e7ae service nova] Creating event network-vif-deleted:1435293b-3554-4c79-9898-f9de315c7829 for instance 00a19183-c526-47be-95c4-d4c3a9936390 on n-h2-862964-3 Oct 29 01:13:18.271870 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-474e3341-1cb7-4f58-8884-54889c262acc req-42ced808-ef6c-40b7-b88a-9472b489e7ae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080714 Oct 29 01:13:18.276515 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1111/2290] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:18.282386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-21002f78-02ca-4924-898a-1043abbde6b8 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fed4820>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:18.401241 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-21002f78-02ca-4924-898a-1043abbde6b8 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776" status: 200 len: 1421 microversion: 2.1 time: 0.123006 Oct 29 01:13:18.401880 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1112/2291] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:18 2022] GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776 => generated 1421 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:18.426114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b35075a5-f801-447d-a805-351fa9644d95 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:18.430181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b35075a5-f801-447d-a805-351fa9644d95 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:18.443874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b35075a5-f801-447d-a805-351fa9644d95 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:18.444484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b35075a5-f801-447d-a805-351fa9644d95 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:18.445579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b35075a5-f801-447d-a805-351fa9644d95 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:18.446948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b35075a5-f801-447d-a805-351fa9644d95 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:18.447912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b35075a5-f801-447d-a805-351fa9644d95 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:18.449541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b35075a5-f801-447d-a805-351fa9644d95 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:18.693753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-06a53c12-54b9-4747-b5a4-0dd2d8a02c2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:18.715055 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-06a53c12-54b9-4747-b5a4-0dd2d8a02c2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1199 microversion: 2.1 time: 0.650504 Oct 29 01:13:18.729216 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1180/2292] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:18 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1199 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:18.878777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ff5e8a73-bf80-4ac7-b881-d3e49146fde3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:18.879862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ff5e8a73-bf80-4ac7-b881-d3e49146fde3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:18.900966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff5e8a73-bf80-4ac7-b881-d3e49146fde3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:18.902560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff5e8a73-bf80-4ac7-b881-d3e49146fde3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:18.906926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff5e8a73-bf80-4ac7-b881-d3e49146fde3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:18.907485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b35075a5-f801-447d-a805-351fa9644d95 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:18.914353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff5e8a73-bf80-4ac7-b881-d3e49146fde3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:18.915370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff5e8a73-bf80-4ac7-b881-d3e49146fde3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:18.917643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff5e8a73-bf80-4ac7-b881-d3e49146fde3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:18.922804 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b35075a5-f801-447d-a805-351fa9644d95 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/69681dc4-6f48-44ea-a7c4-1b10ea9b86dd" status: 200 len: 1515 microversion: 2.1 time: 0.517339 Oct 29 01:13:18.924336 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1113/2293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:18 2022] GET /compute/v2.1/servers/69681dc4-6f48-44ea-a7c4-1b10ea9b86dd => generated 1515 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:18.950795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c9f36489-dcf8-40ff-9660-5b29df9eba15 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:18.951482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c9f36489-dcf8-40ff-9660-5b29df9eba15 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:18.973605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9f36489-dcf8-40ff-9660-5b29df9eba15 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:18.974158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9f36489-dcf8-40ff-9660-5b29df9eba15 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:18.974618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9f36489-dcf8-40ff-9660-5b29df9eba15 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:18.981397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9f36489-dcf8-40ff-9660-5b29df9eba15 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:18.984371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9f36489-dcf8-40ff-9660-5b29df9eba15 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:18.984831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9f36489-dcf8-40ff-9660-5b29df9eba15 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:19.064288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c9f36489-dcf8-40ff-9660-5b29df9eba15 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:13:19.490577 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c9f36489-dcf8-40ff-9660-5b29df9eba15 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "DELETE /compute/v2.1/servers/69681dc4-6f48-44ea-a7c4-1b10ea9b86dd" status: 204 len: 0 microversion: 2.1 time: 0.544911 Oct 29 01:13:19.491192 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1114/2294] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:13:18 2022] DELETE /compute/v2.1/servers/69681dc4-6f48-44ea-a7c4-1b10ea9b86dd => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:13:19.496939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-88492cb7-819a-4053-89c8-222e3861c29a req-7b600490-741e-4d6f-800a-96309f6c389d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0fe24cf-adf2-440f-bc90-819416f0da85", "name": "network-vif-unplugged", "status": "completed", "tag": "668338a4-a4ff-4907-96e5-1efd14961ac4"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:19.522888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-88492cb7-819a-4053-89c8-222e3861c29a req-7b600490-741e-4d6f-800a-96309f6c389d service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:19.523388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-88492cb7-819a-4053-89c8-222e3861c29a req-7b600490-741e-4d6f-800a-96309f6c389d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:19.524038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-88492cb7-819a-4053-89c8-222e3861c29a req-7b600490-741e-4d6f-800a-96309f6c389d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:19.552396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ff5e8a73-bf80-4ac7-b881-d3e49146fde3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:19.553455 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-88492cb7-819a-4053-89c8-222e3861c29a req-7b600490-741e-4d6f-800a-96309f6c389d service nova] Creating event network-vif-unplugged:668338a4-a4ff-4907-96e5-1efd14961ac4 for instance b0fe24cf-adf2-440f-bc90-819416f0da85 on n-h1-862964-3 Oct 29 01:13:19.559599 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-88492cb7-819a-4053-89c8-222e3861c29a req-7b600490-741e-4d6f-800a-96309f6c389d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067075 Oct 29 01:13:19.561316 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ff5e8a73-bf80-4ac7-b881-d3e49146fde3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1506 microversion: 2.1 time: 0.687240 Oct 29 01:13:19.563076 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1181/2295] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:18 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1506 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:19.563435 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1115/2296] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:19.568636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5c340222-e27a-4264-bc7a-e80892db185d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:19.572514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5c340222-e27a-4264-bc7a-e80892db185d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 00a19183-c526-47be-95c4-d4c3a9936390] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:19.574364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f4368c9b-8b8c-4237-ae13-000d0bf4b8a3 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fe63040>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:19.583647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c340222-e27a-4264-bc7a-e80892db185d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:19.601515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c340222-e27a-4264-bc7a-e80892db185d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:19.601515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c340222-e27a-4264-bc7a-e80892db185d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:19.601515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c340222-e27a-4264-bc7a-e80892db185d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:19.601515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c340222-e27a-4264-bc7a-e80892db185d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:19.604861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c340222-e27a-4264-bc7a-e80892db185d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:19.641677 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-5c340222-e27a-4264-bc7a-e80892db185d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] HTTP exception thrown: Instance 00a19183-c526-47be-95c4-d4c3a9936390 could not be found. Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5c340222-e27a-4264-bc7a-e80892db185d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Request method failure captured: Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 HTTP/1.1 Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwt8JRabpvp9J8kG0M67t8Iyr-SCG7c-JPFaER1eUdy9mdMDCEj57I5ypg-0c0_-vhR59XazevAWW9UCfnpvJK_2L07j2pHd2K21GogPYDil-XXkBqZo1XsB8bEUTDJZ0VVBE2QuaVkvQQHZTsiTPyIIY_dgKVrgYeW95RUKfni_RY Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.25 Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: d0adfdd6819a472baf1aa25878c5ee22 Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2081653878 Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d0adfdd6819a472baf1aa25878c5ee22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d0adfdd6819a472baf1aa25878c5ee22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d0adfdd6819a472baf1aa25878c5ee22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d0adfdd6819a472baf1aa25878c5ee22", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2081653878 Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: d0adfdd6819a472baf1aa25878c5ee22 Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2081653878 Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-LiveAutoBlockMigrationV225Test-2081653878-project Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: c56d01b83c0649e0b1d47b7563892d3f Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2081653878-project Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 00a19183-c526-47be-95c4-d4c3a9936390 could not be found. Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '00a19183-c526-47be-95c4-d4c3a9936390'} Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00a19183-c526-47be-95c4-d4c3a9936390 could not be found. Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00a19183-c526-47be-95c4-d4c3a9936390 could not be found. Oct 29 01:13:19.643560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:19.647423 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:19.647423 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:19.647423 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:19.647423 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:19.647423 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:19.647423 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:13:19.647423 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:13:19.647423 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00a19183-c526-47be-95c4-d4c3a9936390 could not be found. Oct 29 01:13:19.647423 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:19.649313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5c340222-e27a-4264-bc7a-e80892db185d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Returning 404 to user: Instance 00a19183-c526-47be-95c4-d4c3a9936390 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:13:19.650329 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5c340222-e27a-4264-bc7a-e80892db185d tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390" status: 404 len: 111 microversion: 2.25 time: 0.085998 Oct 29 01:13:19.651526 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1182/2297] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:13:19 2022] GET /compute/v2.1/servers/00a19183-c526-47be-95c4-d4c3a9936390 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:13:19.657318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5b001471-458c-4204-8f9b-bf89b5bdae44 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:19.657950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5b001471-458c-4204-8f9b-bf89b5bdae44 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:19.658886 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f4368c9b-8b8c-4237-ae13-000d0bf4b8a3 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776" status: 200 len: 1430 microversion: 2.1 time: 0.094011 Oct 29 01:13:19.659492 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1116/2298] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:19 2022] GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776 => generated 1430 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:19.675930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b001471-458c-4204-8f9b-bf89b5bdae44 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:19.676427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b001471-458c-4204-8f9b-bf89b5bdae44 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:19.676871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b001471-458c-4204-8f9b-bf89b5bdae44 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:19.677621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b001471-458c-4204-8f9b-bf89b5bdae44 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:19.678083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b001471-458c-4204-8f9b-bf89b5bdae44 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:19.678512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b001471-458c-4204-8f9b-bf89b5bdae44 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:19.684763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6ba91d52-c5a3-4ba1-92e4-bd848581e1c8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '.version_select at 0x7f9d9fe74af0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:19.801736 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6ba91d52-c5a3-4ba1-92e4-bd848581e1c8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1561001635" status: 204 len: 0 microversion: 2.25 time: 0.140257 Oct 29 01:13:19.801874 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1117/2299] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 29 01:13:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1561001635 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:13:19.807908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dbf9104d-a6d9-4d0f-b6a5-442c14f03f5d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fefa1f0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:19.895405 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dbf9104d-a6d9-4d0f-b6a5-442c14f03f5d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776" status: 200 len: 1430 microversion: 2.1 time: 0.089851 Oct 29 01:13:19.905931 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1118/2300] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:19 2022] GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776 => generated 1430 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:19.918669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-386ec54a-47fa-4b86-9df5-34841230bdc2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:19.921778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-386ec54a-47fa-4b86-9df5-34841230bdc2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:19.942168 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-386ec54a-47fa-4b86-9df5-34841230bdc2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:19.942855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-386ec54a-47fa-4b86-9df5-34841230bdc2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:19.944020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-386ec54a-47fa-4b86-9df5-34841230bdc2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:19.946819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-386ec54a-47fa-4b86-9df5-34841230bdc2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:19.949077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-386ec54a-47fa-4b86-9df5-34841230bdc2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:19.949764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-386ec54a-47fa-4b86-9df5-34841230bdc2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:19.997192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5b001471-458c-4204-8f9b-bf89b5bdae44 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:20.006746 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5b001471-458c-4204-8f9b-bf89b5bdae44 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/69681dc4-6f48-44ea-a7c4-1b10ea9b86dd" status: 200 len: 1521 microversion: 2.1 time: 0.353798 Oct 29 01:13:20.007347 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1183/2301] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:19 2022] GET /compute/v2.1/servers/69681dc4-6f48-44ea-a7c4-1b10ea9b86dd => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:20.033957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-228021491", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "c3f53abb-2ae5-48a3-a454-74594578da09"}], "security_groups": [{"name": "tempest-securitygroup--1918010894"}], "key_name": "tempest-keypair-1623003296", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:20.314737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] validate_networks() for [('c3f53abb-2ae5-48a3-a454-74594578da09', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:13:20.429324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-386ec54a-47fa-4b86-9df5-34841230bdc2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:20.449822 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-386ec54a-47fa-4b86-9df5-34841230bdc2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1199 microversion: 2.1 time: 0.540944 Oct 29 01:13:20.451650 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1119/2302] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:19 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1199 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:20.460947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0c0319d9-e61d-4714-beae-3addddcc5da1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:20.461943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0c0319d9-e61d-4714-beae-3addddcc5da1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:20.470385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c0319d9-e61d-4714-beae-3addddcc5da1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:20.471185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c0319d9-e61d-4714-beae-3addddcc5da1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:20.471851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c0319d9-e61d-4714-beae-3addddcc5da1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:20.472797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c0319d9-e61d-4714-beae-3addddcc5da1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:20.473709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c0319d9-e61d-4714-beae-3addddcc5da1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:20.474567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c0319d9-e61d-4714-beae-3addddcc5da1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:20.622969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:13:20.864412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0c0319d9-e61d-4714-beae-3addddcc5da1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:20.878515 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0c0319d9-e61d-4714-beae-3addddcc5da1 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1466 microversion: 2.1 time: 0.424567 Oct 29 01:13:20.879593 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1120/2303] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:20 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1466 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:20.886480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a0739bb0-2bf4-4084-903b-485bac2b8507 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:20.887266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a0739bb0-2bf4-4084-903b-485bac2b8507 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:20.895467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0739bb0-2bf4-4084-903b-485bac2b8507 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:20.896243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0739bb0-2bf4-4084-903b-485bac2b8507 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:20.896844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0739bb0-2bf4-4084-903b-485bac2b8507 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:20.898669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0739bb0-2bf4-4084-903b-485bac2b8507 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:20.899276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0739bb0-2bf4-4084-903b-485bac2b8507 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:20.899844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0739bb0-2bf4-4084-903b-485bac2b8507 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:21.334224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a0739bb0-2bf4-4084-903b-485bac2b8507 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:21.342489 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a0739bb0-2bf4-4084-903b-485bac2b8507 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1506 microversion: 2.1 time: 0.461555 Oct 29 01:13:21.345483 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1121/2304] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:20 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1506 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:21.356797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5d47beb1-d1c9-42d2-b5d1-e55a895215e9 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9ff91820>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:21.411712 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5d47beb1-d1c9-42d2-b5d1-e55a895215e9 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/99205ec5-992b-4d3c-9bcd-04eb4b06191a" status: 200 len: 784 microversion: 2.1 time: 0.063823 Oct 29 01:13:21.412862 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1122/2305] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:21 2022] GET /compute/v2.1/images/99205ec5-992b-4d3c-9bcd-04eb4b06191a => generated 784 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:21.418084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e770ec41-f691-4f8c-948f-4b4bb3946d16 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:21.418956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e770ec41-f691-4f8c-948f-4b4bb3946d16 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:21.426591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e770ec41-f691-4f8c-948f-4b4bb3946d16 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:21.427819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e770ec41-f691-4f8c-948f-4b4bb3946d16 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:21.428692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e770ec41-f691-4f8c-948f-4b4bb3946d16 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:21.431116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e770ec41-f691-4f8c-948f-4b4bb3946d16 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:21.431116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e770ec41-f691-4f8c-948f-4b4bb3946d16 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:21.431116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e770ec41-f691-4f8c-948f-4b4bb3946d16 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:21.888885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Getting quotas for project f9690bcd50e1416ca83f62fbc3940364. Resources: dict_keys(['metadata_items']) {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:13:21.895928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Getting quotas for user e1ff07349003488586b5d8f3f2aaf995 and project f9690bcd50e1416ca83f62fbc3940364. Resources: dict_keys(['metadata_items']) {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:13:21.911653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:13:21.912078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:13:21.912558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:13:21.912971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:13:21.913476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:13:21.923820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:21.924468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:21.924912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:21.925787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:21.926377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:21.926880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:21.949744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Getting quotas for project f9690bcd50e1416ca83f62fbc3940364. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:13:21.956881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Getting quotas for user e1ff07349003488586b5d8f3f2aaf995 and project f9690bcd50e1416ca83f62fbc3940364. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:13:22.010677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:13:22.010677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:13:22.010677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:13:22.010908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e770ec41-f691-4f8c-948f-4b4bb3946d16 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:22.015834 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e770ec41-f691-4f8c-948f-4b4bb3946d16 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/69681dc4-6f48-44ea-a7c4-1b10ea9b86dd" status: 200 len: 1521 microversion: 2.1 time: 0.600874 Oct 29 01:13:22.018751 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1123/2306] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:21 2022] GET /compute/v2.1/servers/69681dc4-6f48-44ea-a7c4-1b10ea9b86dd => generated 1521 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:22.035928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-953b580a-7285-4781-a2db-5b07765c40c8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:22.036964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-953b580a-7285-4781-a2db-5b07765c40c8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:22.046958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-953b580a-7285-4781-a2db-5b07765c40c8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:22.047745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-953b580a-7285-4781-a2db-5b07765c40c8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:22.048308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-953b580a-7285-4781-a2db-5b07765c40c8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:22.049307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-953b580a-7285-4781-a2db-5b07765c40c8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:22.049936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-953b580a-7285-4781-a2db-5b07765c40c8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:22.051815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-953b580a-7285-4781-a2db-5b07765c40c8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:22.100348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-953b580a-7285-4781-a2db-5b07765c40c8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:13:22.190826 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b37e8780-98e9-481b-bbf0-13d08a4e0e83 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.159609 Oct 29 01:13:22.193951 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1184/2307] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:13:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 2186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:13:22.205905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a407e500-7f6e-41c8-ae8e-390b6bac9ab5 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:22.217524 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a407e500-7f6e-41c8-ae8e-390b6bac9ab5 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022307 Oct 29 01:13:22.219174 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1185/2308] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:13:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:22.225039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f0adfa5b-a9c9-457f-a4d8-e34ade79c6e3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:22.225939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f0adfa5b-a9c9-457f-a4d8-e34ade79c6e3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:22.239278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0adfa5b-a9c9-457f-a4d8-e34ade79c6e3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:22.239278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0adfa5b-a9c9-457f-a4d8-e34ade79c6e3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:22.239278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0adfa5b-a9c9-457f-a4d8-e34ade79c6e3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:22.239278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0adfa5b-a9c9-457f-a4d8-e34ade79c6e3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:22.239278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0adfa5b-a9c9-457f-a4d8-e34ade79c6e3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:22.239278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0adfa5b-a9c9-457f-a4d8-e34ade79c6e3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:22.478768 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-953b580a-7285-4781-a2db-5b07765c40c8 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 204 len: 0 microversion: 2.25 time: 0.458188 Oct 29 01:13:22.480903 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1124/2309] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:13:22 2022] DELETE /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:13:22.486561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-40c0c56f-4ac8-45b8-abcb-1aa421e9668c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:22.487204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-40c0c56f-4ac8-45b8-abcb-1aa421e9668c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:22.513598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f0adfa5b-a9c9-457f-a4d8-e34ade79c6e3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:22.524934 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f0adfa5b-a9c9-457f-a4d8-e34ade79c6e3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1199 microversion: 2.1 time: 0.304522 Oct 29 01:13:22.537600 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1186/2310] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:22 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1199 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:22.547043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d54f36e6-0639-481e-828d-34dce9144d3a tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d97a34c10>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:22.681331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-40c0c56f-4ac8-45b8-abcb-1aa421e9668c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:22.715307 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-40c0c56f-4ac8-45b8-abcb-1aa421e9668c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 200 len: 1277 microversion: 2.1 time: 0.213953 Oct 29 01:13:22.716790 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1125/2311] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:22 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:22.721990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3f497912-337c-4c2a-9a8d-673a74ab3b42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:22.723263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3f497912-337c-4c2a-9a8d-673a74ab3b42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:22.731355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f497912-337c-4c2a-9a8d-673a74ab3b42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:22.732049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f497912-337c-4c2a-9a8d-673a74ab3b42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:22.732662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f497912-337c-4c2a-9a8d-673a74ab3b42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:22.734103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f497912-337c-4c2a-9a8d-673a74ab3b42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:22.734718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f497912-337c-4c2a-9a8d-673a74ab3b42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:22.735475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f497912-337c-4c2a-9a8d-673a74ab3b42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:23.187706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3f497912-337c-4c2a-9a8d-673a74ab3b42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:23.198432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:13:23.221030 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3f497912-337c-4c2a-9a8d-673a74ab3b42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 200 len: 1509 microversion: 2.1 time: 0.502902 Oct 29 01:13:23.240302 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1126/2312] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:22 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 1509 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:23.257221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-af50cc9a-4afd-41fd-a118-65ff28dc1023 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:23.258957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-af50cc9a-4afd-41fd-a118-65ff28dc1023 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:23.268627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af50cc9a-4afd-41fd-a118-65ff28dc1023 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:23.269335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af50cc9a-4afd-41fd-a118-65ff28dc1023 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:23.269928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af50cc9a-4afd-41fd-a118-65ff28dc1023 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:23.271085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af50cc9a-4afd-41fd-a118-65ff28dc1023 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:23.271764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af50cc9a-4afd-41fd-a118-65ff28dc1023 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:23.276000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af50cc9a-4afd-41fd-a118-65ff28dc1023 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:23.709747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-af50cc9a-4afd-41fd-a118-65ff28dc1023 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:23.722203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-af50cc9a-4afd-41fd-a118-65ff28dc1023 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:23.725437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-af50cc9a-4afd-41fd-a118-65ff28dc1023 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:23.730431 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-af50cc9a-4afd-41fd-a118-65ff28dc1023 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1549 microversion: 2.25 time: 0.491958 Oct 29 01:13:23.751445 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1127/2313] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:13:23 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1549 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:23.775212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-e7cf9492-cc4c-4f56-897a-1151c7e9afde req-aab2516a-bcab-4a6e-a532-8608390e3a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69681dc4-6f48-44ea-a7c4-1b10ea9b86dd", "name": "network-vif-deleted", "tag": "158356ab-2942-4088-a11e-87c640cd15e8"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:23.802455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e7cf9492-cc4c-4f56-897a-1151c7e9afde req-aab2516a-bcab-4a6e-a532-8608390e3a20 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:23.803799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e7cf9492-cc4c-4f56-897a-1151c7e9afde req-aab2516a-bcab-4a6e-a532-8608390e3a20 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:23.804599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e7cf9492-cc4c-4f56-897a-1151c7e9afde req-aab2516a-bcab-4a6e-a532-8608390e3a20 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:23.819119 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-e7cf9492-cc4c-4f56-897a-1151c7e9afde req-aab2516a-bcab-4a6e-a532-8608390e3a20 service nova] Creating event network-vif-deleted:158356ab-2942-4088-a11e-87c640cd15e8 for instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd on n-h2-862964-3 Oct 29 01:13:23.824784 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-e7cf9492-cc4c-4f56-897a-1151c7e9afde req-aab2516a-bcab-4a6e-a532-8608390e3a20 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071776 Oct 29 01:13:23.826259 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1128/2314] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:23.833707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-87099312-51fa-4bfc-a9ba-e21eb49e3c33 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:23.834710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-87099312-51fa-4bfc-a9ba-e21eb49e3c33 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:23.849438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87099312-51fa-4bfc-a9ba-e21eb49e3c33 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:23.849438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87099312-51fa-4bfc-a9ba-e21eb49e3c33 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:23.849438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87099312-51fa-4bfc-a9ba-e21eb49e3c33 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:23.853464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87099312-51fa-4bfc-a9ba-e21eb49e3c33 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:23.854132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87099312-51fa-4bfc-a9ba-e21eb49e3c33 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:23.854721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87099312-51fa-4bfc-a9ba-e21eb49e3c33 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:23.913404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87099312-51fa-4bfc-a9ba-e21eb49e3c33 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:23.914065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87099312-51fa-4bfc-a9ba-e21eb49e3c33 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:23.914650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87099312-51fa-4bfc-a9ba-e21eb49e3c33 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:23.915251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-87099312-51fa-4bfc-a9ba-e21eb49e3c33 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lazy-loading 'fault' on Instance uuid 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:13:24.065126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-87099312-51fa-4bfc-a9ba-e21eb49e3c33 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:24.073575 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-87099312-51fa-4bfc-a9ba-e21eb49e3c33 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/69681dc4-6f48-44ea-a7c4-1b10ea9b86dd" status: 200 len: 1312 microversion: 2.1 time: 0.245862 Oct 29 01:13:24.074777 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1129/2315] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:23 2022] GET /compute/v2.1/servers/69681dc4-6f48-44ea-a7c4-1b10ea9b86dd => generated 1312 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:24.110225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5e655252-30b3-405d-ad3a-5680feecfe60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:24.112636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5e655252-30b3-405d-ad3a-5680feecfe60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:24.133907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e655252-30b3-405d-ad3a-5680feecfe60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:24.134407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e655252-30b3-405d-ad3a-5680feecfe60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:24.134939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e655252-30b3-405d-ad3a-5680feecfe60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:24.135544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e655252-30b3-405d-ad3a-5680feecfe60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:24.136001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e655252-30b3-405d-ad3a-5680feecfe60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:24.136417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e655252-30b3-405d-ad3a-5680feecfe60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:24.185070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5e655252-30b3-405d-ad3a-5680feecfe60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:13:24.197876 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.compute.api [None req-5e655252-30b3-405d-ad3a-5680feecfe60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Working on deleting snapshot b30c3e8c-d569-4411-b7f7-705561e0561e from shelved instance... Oct 29 01:13:24.511815 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d54f36e6-0639-481e-828d-34dce9144d3a tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "DELETE /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776" status: 204 len: 0 microversion: 2.1 time: 1.971452 Oct 29 01:13:24.513282 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1187/2316] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:22 2022] DELETE /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776 => generated 0 bytes in 1975 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:13:24.523529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c3a82caa-947d-48d6-a08d-515da2d0e8e9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:24.525790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c3a82caa-947d-48d6-a08d-515da2d0e8e9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:24.539512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3a82caa-947d-48d6-a08d-515da2d0e8e9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:24.540382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3a82caa-947d-48d6-a08d-515da2d0e8e9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:24.541808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3a82caa-947d-48d6-a08d-515da2d0e8e9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:24.542999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3a82caa-947d-48d6-a08d-515da2d0e8e9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:24.543697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3a82caa-947d-48d6-a08d-515da2d0e8e9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:24.544881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3a82caa-947d-48d6-a08d-515da2d0e8e9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:24.921752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c3a82caa-947d-48d6-a08d-515da2d0e8e9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:24.934033 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c3a82caa-947d-48d6-a08d-515da2d0e8e9 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1199 microversion: 2.1 time: 0.416840 Oct 29 01:13:24.934593 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1188/2317] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:24 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1199 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:24.957019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cf93acae-a7be-422b-9f5d-91802b0da73b tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:24.957783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cf93acae-a7be-422b-9f5d-91802b0da73b tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:24.965975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf93acae-a7be-422b-9f5d-91802b0da73b tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:24.965975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf93acae-a7be-422b-9f5d-91802b0da73b tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:24.966946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf93acae-a7be-422b-9f5d-91802b0da73b tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:24.968495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf93acae-a7be-422b-9f5d-91802b0da73b tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:24.969118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf93acae-a7be-422b-9f5d-91802b0da73b tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:24.969718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf93acae-a7be-422b-9f5d-91802b0da73b tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:25.058752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cf93acae-a7be-422b-9f5d-91802b0da73b tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:25.075005 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cf93acae-a7be-422b-9f5d-91802b0da73b tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 200 len: 1273 microversion: 2.1 time: 0.138170 Oct 29 01:13:25.075718 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1189/2318] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:24 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 1273 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:25.082961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-7a470a23-8d47-4497-a416-3e14e9da5219 req-2a27f441-eb5b-4608-97eb-a4c82400b265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b41540-956c-41c7-8396-3bcbcfc54862", "name": "network-vif-unplugged", "status": "completed", "tag": "69c1a7b0-0583-4934-a72a-4f711f4caffe"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:25.094874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7a470a23-8d47-4497-a416-3e14e9da5219 req-2a27f441-eb5b-4608-97eb-a4c82400b265 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:25.095698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7a470a23-8d47-4497-a416-3e14e9da5219 req-2a27f441-eb5b-4608-97eb-a4c82400b265 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:25.096595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7a470a23-8d47-4497-a416-3e14e9da5219 req-2a27f441-eb5b-4608-97eb-a4c82400b265 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:25.138140 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-7a470a23-8d47-4497-a416-3e14e9da5219 req-2a27f441-eb5b-4608-97eb-a4c82400b265 service nova] Creating event network-vif-unplugged:69c1a7b0-0583-4934-a72a-4f711f4caffe for instance 71b41540-956c-41c7-8396-3bcbcfc54862 on n-h1-862964-3 Oct 29 01:13:25.149651 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-7a470a23-8d47-4497-a416-3e14e9da5219 req-2a27f441-eb5b-4608-97eb-a4c82400b265 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071493 Oct 29 01:13:25.156269 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1190/2319] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:25.168054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-591e7d09-49d4-488f-a02a-0471891807f0 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9778cc10>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:25.214158 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-591e7d09-49d4-488f-a02a-0471891807f0 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] HTTP exception thrown: Image not found. Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-591e7d09-49d4-488f-a02a-0471891807f0 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Request method failure captured: Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776 HTTP/1.1 Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH3q8ZxW58OcTHBhLMIgDxlgk4ppaXm_caO3dB_8EXApfxgfmqw2A0us7SX0zdazXiJAKc3mJfQPCPbxtQfFLv_eYezo3J-RQ0oXLOz3WdCapakuuNGedYH5aO6DAudWwI4u5umckM9WXQyKn-e03YJLLhbeNq68HNmu38V8-wVGhC8 Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 36a174adc9794d23b38c2bafd8a3f1c6 Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesOneServerTestJSON-717376210 Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36a174adc9794d23b38c2bafd8a3f1c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36a174adc9794d23b38c2bafd8a3f1c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36a174adc9794d23b38c2bafd8a3f1c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36a174adc9794d23b38c2bafd8a3f1c6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesOneServerTestJSON-717376210 Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 36a174adc9794d23b38c2bafd8a3f1c6 Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-717376210 Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesOneServerTestJSON-717376210-project Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 34a454a03ab64d4eab179c11a5165ce0 Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesOneServerTestJSON-717376210-project Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: exception: Image not found. Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'fb46d3f1-5309-4f21-b47c-77f380357776'} Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fb46d3f1-5309-4f21-b47c-77f380357776 Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 01:13:25.216765 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fb46d3f1-5309-4f21-b47c-77f380357776 could not be found. Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:13:25.221332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:25.231887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-591e7d09-49d4-488f-a02a-0471891807f0 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Returning 404 to user: Image not found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:13:25.231887 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-591e7d09-49d4-488f-a02a-0471891807f0 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776" status: 404 len: 62 microversion: 2.1 time: 0.075418 Oct 29 01:13:25.232824 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1191/2320] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:25 2022] GET /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776 => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:13:25.245069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ea4063b3-de5d-47cd-88a0-88922b408e13 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:25.246177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ea4063b3-de5d-47cd-88a0-88922b408e13 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:25.256284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea4063b3-de5d-47cd-88a0-88922b408e13 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:25.257688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea4063b3-de5d-47cd-88a0-88922b408e13 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:25.258633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea4063b3-de5d-47cd-88a0-88922b408e13 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:25.260955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea4063b3-de5d-47cd-88a0-88922b408e13 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:25.261707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea4063b3-de5d-47cd-88a0-88922b408e13 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:25.262378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea4063b3-de5d-47cd-88a0-88922b408e13 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:25.536277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ea4063b3-de5d-47cd-88a0-88922b408e13 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:25.551284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ea4063b3-de5d-47cd-88a0-88922b408e13 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:25.558203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ea4063b3-de5d-47cd-88a0-88922b408e13 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:25.560873 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ea4063b3-de5d-47cd-88a0-88922b408e13 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 200 len: 1332 microversion: 2.25 time: 0.326581 Oct 29 01:13:25.562584 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1192/2321] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:13:25 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 1332 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:25.578181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8392d739-7297-4864-a793-fe3937251a7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:25.580263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8392d739-7297-4864-a793-fe3937251a7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:25.630213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8392d739-7297-4864-a793-fe3937251a7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:25.634763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8392d739-7297-4864-a793-fe3937251a7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:25.645378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8392d739-7297-4864-a793-fe3937251a7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:25.654671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8392d739-7297-4864-a793-fe3937251a7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:25.655781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8392d739-7297-4864-a793-fe3937251a7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:25.656407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8392d739-7297-4864-a793-fe3937251a7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:25.683477 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-8392d739-7297-4864-a793-fe3937251a7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] HTTP exception thrown: Instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd could not be found. Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8392d739-7297-4864-a793-fe3937251a7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Request method failure captured: Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/69681dc4-6f48-44ea-a7c4-1b10ea9b86dd HTTP/1.1 Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH38W6vqCIaTdiX_Mf0AsBFHYOycKxgrfn_quZzNxYU5glmKV0pJ5Mb6imPL_7tPoKyLG6oGkjAx24pAIDmJLVS2v3mYJBNXYbiScfZfLLHvclNrhga2_fsaiJbaJPuGxMdCtHnw0XVbjb7GAeFX884bWAbhQDH0y9pHeTWj3JK62eU Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: a09ce55a18af4f8db53d517089591340 Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a09ce55a18af4f8db53d517089591340"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a09ce55a18af4f8db53d517089591340"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a09ce55a18af4f8db53d517089591340"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a09ce55a18af4f8db53d517089591340", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: a09ce55a18af4f8db53d517089591340 Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ListServersNegativeTestJSON-894183019-project Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: d5fce522753549929a06d164a5b244d7 Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ListServersNegativeTestJSON-894183019-project Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd could not be found. Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '69681dc4-6f48-44ea-a7c4-1b10ea9b86dd'} Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd could not be found. Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd could not be found. Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:25.685481 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:25.688865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:25.688865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:25.688865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:25.688865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:25.688865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:13:25.688865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:13:25.688865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd could not be found. Oct 29 01:13:25.688865 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:25.690976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8392d739-7297-4864-a793-fe3937251a7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Returning 404 to user: Instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:13:25.692113 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8392d739-7297-4864-a793-fe3937251a7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/69681dc4-6f48-44ea-a7c4-1b10ea9b86dd" status: 404 len: 111 microversion: 2.1 time: 0.125173 Oct 29 01:13:25.693419 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1193/2322] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:25 2022] GET /compute/v2.1/servers/69681dc4-6f48-44ea-a7c4-1b10ea9b86dd => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:13:25.701383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c7a7ec91-5b61-4233-be9a-67c4c84a1517 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-827245579"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:25.706361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c7a7ec91-5b61-4233-be9a-67c4c84a1517 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:25.713069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7a7ec91-5b61-4233-be9a-67c4c84a1517 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:25.713887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7a7ec91-5b61-4233-be9a-67c4c84a1517 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:25.714726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7a7ec91-5b61-4233-be9a-67c4c84a1517 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:25.715653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7a7ec91-5b61-4233-be9a-67c4c84a1517 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:25.716339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7a7ec91-5b61-4233-be9a-67c4c84a1517 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:25.716973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7a7ec91-5b61-4233-be9a-67c4c84a1517 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:26.136748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5e655252-30b3-405d-ad3a-5680feecfe60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Doing local delete in cell 584133c9-70d9-4dbd-88ec-66308eedb7a2(cell1) {{(pid=121100) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 29 01:13:26.137730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e655252-30b3-405d-ad3a-5680feecfe60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:26.138205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e655252-30b3-405d-ad3a-5680feecfe60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:26.138927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e655252-30b3-405d-ad3a-5680feecfe60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:26.139376 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.compute.api [None req-5e655252-30b3-405d-ad3a-5680feecfe60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 29 01:13:26.145989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-5e655252-30b3-405d-ad3a-5680feecfe60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] deallocate_for_instance() {{(pid=121100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 29 01:13:26.531293 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c7a7ec91-5b61-4233-be9a-67c4c84a1517 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "POST /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862/action" status: 202 len: 0 microversion: 2.1 time: 0.835483 Oct 29 01:13:26.531293 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1194/2323] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:13:25 2022] POST /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862/action => generated 0 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 01:13:26.541047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9d7b75a9-13b3-4676-a231-5ee550eeafbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:26.549285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9d7b75a9-13b3-4676-a231-5ee550eeafbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:26.550181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9d7b75a9-13b3-4676-a231-5ee550eeafbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'a09ce55a18af4f8db53d517089591340'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:13:26.567883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d7b75a9-13b3-4676-a231-5ee550eeafbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:26.568377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d7b75a9-13b3-4676-a231-5ee550eeafbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:26.568818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d7b75a9-13b3-4676-a231-5ee550eeafbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:26.573924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d7b75a9-13b3-4676-a231-5ee550eeafbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:26.576526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d7b75a9-13b3-4676-a231-5ee550eeafbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:26.577833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d7b75a9-13b3-4676-a231-5ee550eeafbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:26.826532 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9d7b75a9-13b3-4676-a231-5ee550eeafbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.292627 Oct 29 01:13:26.827401 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1195/2324] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 29 01:13:26 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:13:26.851512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-2241d846-55d1-4843-9e0f-cb5b6da9db54 req-16cf16ab-68e8-4533-9aa1-9376c97ed8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6eeec1-f116-41ea-b5ed-c20d0d37114a", "name": "network-vif-deleted", "tag": "11ae0cb6-be2c-4a65-9b62-b6a49a05a7e3"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:26.868059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2241d846-55d1-4843-9e0f-cb5b6da9db54 req-16cf16ab-68e8-4533-9aa1-9376c97ed8b5 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:26.868590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2241d846-55d1-4843-9e0f-cb5b6da9db54 req-16cf16ab-68e8-4533-9aa1-9376c97ed8b5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:26.869047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2241d846-55d1-4843-9e0f-cb5b6da9db54 req-16cf16ab-68e8-4533-9aa1-9376c97ed8b5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:26.892955 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-2241d846-55d1-4843-9e0f-cb5b6da9db54 req-16cf16ab-68e8-4533-9aa1-9376c97ed8b5 service nova] Creating event network-vif-deleted:11ae0cb6-be2c-4a65-9b62-b6a49a05a7e3 for instance 9a6eeec1-f116-41ea-b5ed-c20d0d37114a on n-h2-862964-3 Oct 29 01:13:26.904357 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-2241d846-55d1-4843-9e0f-cb5b6da9db54 req-16cf16ab-68e8-4533-9aa1-9376c97ed8b5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061660 Oct 29 01:13:26.905832 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1196/2325] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:26.913875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3829983d-9f7b-41c2-b92e-055e14716578 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:26.914589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3829983d-9f7b-41c2-b92e-055e14716578 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:26.939257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3829983d-9f7b-41c2-b92e-055e14716578 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:26.939892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3829983d-9f7b-41c2-b92e-055e14716578 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:26.940348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3829983d-9f7b-41c2-b92e-055e14716578 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:26.942052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3829983d-9f7b-41c2-b92e-055e14716578 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:26.942528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3829983d-9f7b-41c2-b92e-055e14716578 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:26.944327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3829983d-9f7b-41c2-b92e-055e14716578 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:27.332834 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3829983d-9f7b-41c2-b92e-055e14716578 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:27.338208 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3829983d-9f7b-41c2-b92e-055e14716578 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1199 microversion: 2.1 time: 0.431023 Oct 29 01:13:27.339270 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1197/2326] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:26 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1199 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:27.365612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c9446811-9fa7-45dd-9998-f40df2fb1aab tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:27.381336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c9446811-9fa7-45dd-9998-f40df2fb1aab tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:27.399897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9446811-9fa7-45dd-9998-f40df2fb1aab tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:27.400827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9446811-9fa7-45dd-9998-f40df2fb1aab tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:27.401309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9446811-9fa7-45dd-9998-f40df2fb1aab tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:27.402447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9446811-9fa7-45dd-9998-f40df2fb1aab tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:27.403077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9446811-9fa7-45dd-9998-f40df2fb1aab tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:27.404949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9446811-9fa7-45dd-9998-f40df2fb1aab tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:27.508125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c9446811-9fa7-45dd-9998-f40df2fb1aab tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:27.525791 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c9446811-9fa7-45dd-9998-f40df2fb1aab tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 200 len: 1335 microversion: 2.1 time: 0.166449 Oct 29 01:13:27.540276 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1198/2327] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:27 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 1335 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:27.546403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0103e5bc-6346-4d65-9a3b-25e80eba70a6 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d97a34ee0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:27.641760 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0103e5bc-6346-4d65-9a3b-25e80eba70a6 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.097293 Oct 29 01:13:27.641760 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1199/2328] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:27 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:27.670859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cee8e6ad-9d13-45d6-ac2f-59c06bee17a3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:27.674199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cee8e6ad-9d13-45d6-ac2f-59c06bee17a3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 9a6eeec1-f116-41ea-b5ed-c20d0d37114a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:27.696629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cee8e6ad-9d13-45d6-ac2f-59c06bee17a3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:27.698404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cee8e6ad-9d13-45d6-ac2f-59c06bee17a3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:27.699150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cee8e6ad-9d13-45d6-ac2f-59c06bee17a3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:27.701574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cee8e6ad-9d13-45d6-ac2f-59c06bee17a3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:27.703958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cee8e6ad-9d13-45d6-ac2f-59c06bee17a3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:27.704648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cee8e6ad-9d13-45d6-ac2f-59c06bee17a3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:27.763601 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-cee8e6ad-9d13-45d6-ac2f-59c06bee17a3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] HTTP exception thrown: Instance 9a6eeec1-f116-41ea-b5ed-c20d0d37114a could not be found. Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cee8e6ad-9d13-45d6-ac2f-59c06bee17a3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Request method failure captured: Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a HTTP/1.1 Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwt8JRabpvp9J8kG0M67t8Iyr-SCG7c-JPFaER1eUdy9mdMDCEj57I5ypg-0c0_-vhR59XazevAWW9UCfnpvJK_2L07j2pHd2K21GogPYDil-XXkBqZo1XsB8bEUTDJZ0VVBE2QuaVkvQQHZTsiTPyIIY_dgKVrgYeW95RUKfni_RY Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.25 Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: d0adfdd6819a472baf1aa25878c5ee22 Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2081653878 Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d0adfdd6819a472baf1aa25878c5ee22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d0adfdd6819a472baf1aa25878c5ee22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d0adfdd6819a472baf1aa25878c5ee22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d0adfdd6819a472baf1aa25878c5ee22", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2081653878 Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: d0adfdd6819a472baf1aa25878c5ee22 Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2081653878 Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-LiveAutoBlockMigrationV225Test-2081653878-project Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: c56d01b83c0649e0b1d47b7563892d3f Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2081653878-project Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 9a6eeec1-f116-41ea-b5ed-c20d0d37114a could not be found. Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '9a6eeec1-f116-41ea-b5ed-c20d0d37114a'} Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a6eeec1-f116-41ea-b5ed-c20d0d37114a could not be found. Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a6eeec1-f116-41ea-b5ed-c20d0d37114a could not be found. Oct 29 01:13:27.768308 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:27.777949 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:27.777949 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:27.777949 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:27.777949 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:27.777949 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:27.777949 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:13:27.777949 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:13:27.777949 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a6eeec1-f116-41ea-b5ed-c20d0d37114a could not be found. Oct 29 01:13:27.777949 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:27.777949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cee8e6ad-9d13-45d6-ac2f-59c06bee17a3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Returning 404 to user: Instance 9a6eeec1-f116-41ea-b5ed-c20d0d37114a could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:13:27.778492 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cee8e6ad-9d13-45d6-ac2f-59c06bee17a3 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a" status: 404 len: 111 microversion: 2.25 time: 0.114902 Oct 29 01:13:27.782114 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1200/2329] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:13:27 2022] GET /compute/v2.1/servers/9a6eeec1-f116-41ea-b5ed-c20d0d37114a => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:13:27.789360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-094b9659-8cdf-4f52-8af1-d2d5aa8cefb9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-094b9659-8cdf-4f52-8af1-d2d5aa8cefb9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Request method failure captured: Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH38W6vqCIaTdiX_Mf0AsBFHYOycKxgrfn_quZzNxYU5glmKV0pJ5Mb6imPL_7tPoKyLG6oGkjAx24pAIDmJLVS2v3mYJBNXYbiScfZfLLHvclNrhga2_fsaiJbaJPuGxMdCtHnw0XVbjb7GAeFX884bWAbhQDH0y9pHeTWj3JK62eU Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: a09ce55a18af4f8db53d517089591340 Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a09ce55a18af4f8db53d517089591340"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a09ce55a18af4f8db53d517089591340"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a09ce55a18af4f8db53d517089591340"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a09ce55a18af4f8db53d517089591340", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: a09ce55a18af4f8db53d517089591340 Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ListServersNegativeTestJSON-894183019-project Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: d5fce522753549929a06d164a5b244d7 Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ListServersNegativeTestJSON-894183019-project Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: action_args: {} Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 29 01:13:27.797325 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:13:27.801603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:13:27.801603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:13:27.801603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:13:27.801603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 29 01:13:27.801603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:27.801603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:27.801603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:27.801603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:27.801603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:27.801603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:27.801603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:13:27.801603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:13:27.801603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 29 01:13:27.801603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:27.801603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-094b9659-8cdf-4f52-8af1-d2d5aa8cefb9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:13:27.801603 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-094b9659-8cdf-4f52-8af1-d2d5aa8cefb9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.012207 Oct 29 01:13:27.801603 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1201/2330] 10.222.0.26 () {58 vars in 1182 bytes} [Sat Oct 29 01:13:27 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:13:27.803015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e31ad6ff-2fdb-444e-a361-03b8df57e9e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:27.804926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e31ad6ff-2fdb-444e-a361-03b8df57e9e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:27.811141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e31ad6ff-2fdb-444e-a361-03b8df57e9e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:27.812479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e31ad6ff-2fdb-444e-a361-03b8df57e9e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:27.812660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e31ad6ff-2fdb-444e-a361-03b8df57e9e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:27.813798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e31ad6ff-2fdb-444e-a361-03b8df57e9e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:27.814261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e31ad6ff-2fdb-444e-a361-03b8df57e9e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:27.814694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e31ad6ff-2fdb-444e-a361-03b8df57e9e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:27.895056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e31ad6ff-2fdb-444e-a361-03b8df57e9e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:13:27.898899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-5e655252-30b3-405d-ad3a-5680feecfe60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Updating instance_info_cache with network_info: [] {{(pid=121100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 01:13:28.428209 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e31ad6ff-2fdb-444e-a361-03b8df57e9e4 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 204 len: 0 microversion: 2.25 time: 0.629423 Oct 29 01:13:28.430044 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1202/2331] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:13:27 2022] DELETE /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 0 bytes in 632 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:13:28.436148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7fbf3c7b-5476-461d-a3bc-f42854e34a1d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:28.442809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7fbf3c7b-5476-461d-a3bc-f42854e34a1d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:28.443795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7fbf3c7b-5476-461d-a3bc-f42854e34a1d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Searching by: {'deleted': False, 'project_id': 'a09ce55a18af4f8db53d517089591340'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:13:28.450658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fbf3c7b-5476-461d-a3bc-f42854e34a1d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:28.451547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fbf3c7b-5476-461d-a3bc-f42854e34a1d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:28.452209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fbf3c7b-5476-461d-a3bc-f42854e34a1d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:28.453184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fbf3c7b-5476-461d-a3bc-f42854e34a1d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:28.453902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fbf3c7b-5476-461d-a3bc-f42854e34a1d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:28.454510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7fbf3c7b-5476-461d-a3bc-f42854e34a1d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:28.540064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-7fbf3c7b-5476-461d-a3bc-f42854e34a1d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:13:28.548285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:13:28.611038 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7fbf3c7b-5476-461d-a3bc-f42854e34a1d tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.179018 Oct 29 01:13:28.612105 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1203/2332] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 29 01:13:28 2022] GET /compute/v2.1/servers => generated 681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:28.617538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-742863ba-7022-4ec5-a3f5-0fb78de31f80 req-92f1a15e-90e2-49b7-8550-1b8a354b169d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0fe24cf-adf2-440f-bc90-819416f0da85", "name": "network-vif-deleted", "tag": "668338a4-a4ff-4907-96e5-1efd14961ac4"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:28.633893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-742863ba-7022-4ec5-a3f5-0fb78de31f80 req-92f1a15e-90e2-49b7-8550-1b8a354b169d service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:28.634469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-742863ba-7022-4ec5-a3f5-0fb78de31f80 req-92f1a15e-90e2-49b7-8550-1b8a354b169d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:28.635122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-742863ba-7022-4ec5-a3f5-0fb78de31f80 req-92f1a15e-90e2-49b7-8550-1b8a354b169d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:28.649128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.compute.server_external_events [req-742863ba-7022-4ec5-a3f5-0fb78de31f80 req-92f1a15e-90e2-49b7-8550-1b8a354b169d service nova] Unable to find a host for instance b0fe24cf-adf2-440f-bc90-819416f0da85. Dropping event network-vif-deleted {{(pid=121099) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 29 01:13:28.650260 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-742863ba-7022-4ec5-a3f5-0fb78de31f80 req-92f1a15e-90e2-49b7-8550-1b8a354b169d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.037061 Oct 29 01:13:28.651305 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1204/2333] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 01:13:28.658453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8c74da79-4a69-4192-a0ac-0ba0ebb75ee4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:28.659588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8c74da79-4a69-4192-a0ac-0ba0ebb75ee4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:28.668083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c74da79-4a69-4192-a0ac-0ba0ebb75ee4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:28.669143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c74da79-4a69-4192-a0ac-0ba0ebb75ee4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:28.669783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c74da79-4a69-4192-a0ac-0ba0ebb75ee4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:28.671496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c74da79-4a69-4192-a0ac-0ba0ebb75ee4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:28.672147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c74da79-4a69-4192-a0ac-0ba0ebb75ee4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:28.672789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c74da79-4a69-4192-a0ac-0ba0ebb75ee4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:28.927919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8c74da79-4a69-4192-a0ac-0ba0ebb75ee4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:28.938942 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8c74da79-4a69-4192-a0ac-0ba0ebb75ee4 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1199 microversion: 2.1 time: 0.286343 Oct 29 01:13:28.939649 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1205/2334] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:28 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1199 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:28.945035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5d56bd6a-1182-4429-9d59-5a07dbdeec29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:28.945744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5d56bd6a-1182-4429-9d59-5a07dbdeec29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:28.953411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d56bd6a-1182-4429-9d59-5a07dbdeec29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:28.954310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d56bd6a-1182-4429-9d59-5a07dbdeec29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:28.954574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d56bd6a-1182-4429-9d59-5a07dbdeec29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:28.955425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d56bd6a-1182-4429-9d59-5a07dbdeec29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:28.955947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d56bd6a-1182-4429-9d59-5a07dbdeec29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:28.956474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d56bd6a-1182-4429-9d59-5a07dbdeec29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:28.986478 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5e655252-30b3-405d-ad3a-5680feecfe60 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 204 len: 0 microversion: 2.1 time: 4.910445 Oct 29 01:13:28.987155 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1130/2335] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:13:24 2022] DELETE /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 0 bytes in 4912 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:13:28.998080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d9a8e829-1222-4cd5-85da-ce3e77df259c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:29.000425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d9a8e829-1222-4cd5-85da-ce3e77df259c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:29.010422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9a8e829-1222-4cd5-85da-ce3e77df259c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:29.013848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9a8e829-1222-4cd5-85da-ce3e77df259c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:29.013848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9a8e829-1222-4cd5-85da-ce3e77df259c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:29.013848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9a8e829-1222-4cd5-85da-ce3e77df259c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:29.013848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9a8e829-1222-4cd5-85da-ce3e77df259c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:29.013848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9a8e829-1222-4cd5-85da-ce3e77df259c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:29.221065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5d56bd6a-1182-4429-9d59-5a07dbdeec29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:29.234203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5d56bd6a-1182-4429-9d59-5a07dbdeec29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:29.241067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5d56bd6a-1182-4429-9d59-5a07dbdeec29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:29.242792 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5d56bd6a-1182-4429-9d59-5a07dbdeec29 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1563 microversion: 2.25 time: 0.301931 Oct 29 01:13:29.257183 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1206/2336] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:13:28 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1563 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:29.262928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e2156963-a693-4e24-bed5-51644d24acfa tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:29.278223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e2156963-a693-4e24-bed5-51644d24acfa tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:29.281478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.compute.servers [None req-e2156963-a693-4e24-bed5-51644d24acfa tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Removing options 'limit' from query {{(pid=121099) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 01:13:29.282437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e2156963-a693-4e24-bed5-51644d24acfa tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Searching by: {'deleted': False, 'project_id': 'a09ce55a18af4f8db53d517089591340'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:13:29.292682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2156963-a693-4e24-bed5-51644d24acfa tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:29.295484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2156963-a693-4e24-bed5-51644d24acfa tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:29.297540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2156963-a693-4e24-bed5-51644d24acfa tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:29.299904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2156963-a693-4e24-bed5-51644d24acfa tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:29.300867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2156963-a693-4e24-bed5-51644d24acfa tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:29.302257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2156963-a693-4e24-bed5-51644d24acfa tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:29.353559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d9a8e829-1222-4cd5-85da-ce3e77df259c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:29.366709 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d9a8e829-1222-4cd5-85da-ce3e77df259c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 200 len: 1403 microversion: 2.1 time: 0.378119 Oct 29 01:13:29.369215 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1131/2337] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:28 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 1403 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:29.375180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fa39ae09-b5dd-48a1-ab98-0badb30e3825 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fe33e50>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:29.407923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-e2156963-a693-4e24-bed5-51644d24acfa tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:13:29.449024 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fa39ae09-b5dd-48a1-ab98-0badb30e3825 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.078356 Oct 29 01:13:29.449966 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1132/2338] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:29 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:29.469240 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e2156963-a693-4e24-bed5-51644d24acfa tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.201693 Oct 29 01:13:29.469240 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1207/2339] 10.222.0.26 () {58 vars in 1144 bytes} [Sat Oct 29 01:13:29 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:29.469240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-831e3394-b0fb-4067-a569-7b1f90e502b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:29.469240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-831e3394-b0fb-4067-a569-7b1f90e502b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:29.469240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-831e3394-b0fb-4067-a569-7b1f90e502b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:29.469240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-831e3394-b0fb-4067-a569-7b1f90e502b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:29.469240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-831e3394-b0fb-4067-a569-7b1f90e502b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:29.469240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-831e3394-b0fb-4067-a569-7b1f90e502b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:29.469240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-831e3394-b0fb-4067-a569-7b1f90e502b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:29.470474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-831e3394-b0fb-4067-a569-7b1f90e502b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:29.475079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e91abfbd-7494-4f1d-92aa-dd3e7a02e498 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e91abfbd-7494-4f1d-92aa-dd3e7a02e498 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Request method failure captured: Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH38W6vqCIaTdiX_Mf0AsBFHYOycKxgrfn_quZzNxYU5glmKV0pJ5Mb6imPL_7tPoKyLG6oGkjAx24pAIDmJLVS2v3mYJBNXYbiScfZfLLHvclNrhga2_fsaiJbaJPuGxMdCtHnw0XVbjb7GAeFX884bWAbhQDH0y9pHeTWj3JK62eU Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: a09ce55a18af4f8db53d517089591340 Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a09ce55a18af4f8db53d517089591340"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a09ce55a18af4f8db53d517089591340"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a09ce55a18af4f8db53d517089591340"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a09ce55a18af4f8db53d517089591340", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: a09ce55a18af4f8db53d517089591340 Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ListServersNegativeTestJSON-894183019-project Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: d5fce522753549929a06d164a5b244d7 Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ListServersNegativeTestJSON-894183019-project Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: action_args: {} Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi '-1' Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 29 01:13:29.480977 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 29 01:13:29.485375 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:13:29.485375 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:13:29.485375 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:13:29.485375 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:13:29.485375 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 29 01:13:29.485375 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:13:29.485375 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:29.485375 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:13:29.485375 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:29.485375 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:29.485375 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:29.485375 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:13:29.485375 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:13:29.485375 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 29 01:13:29.485375 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:13:29.488632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e91abfbd-7494-4f1d-92aa-dd3e7a02e498 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:13:29.489726 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e91abfbd-7494-4f1d-92aa-dd3e7a02e498 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.018518 Oct 29 01:13:29.496927 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1133/2340] 10.222.0.26 () {58 vars in 1142 bytes} [Sat Oct 29 01:13:29 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 01:13:29.502617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-d7481529-1472-489a-af9f-0d4b3580fdfd req-2ae20457-1515-4bf8-bc8f-a07fb4176b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ebe561-9b25-419d-b771-d5f2d212cfbb", "name": "network-vif-plugged", "status": "completed", "tag": "c9bfa9ce-2881-44eb-bf9e-16eb902a3d6a"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:29.504591 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-831e3394-b0fb-4067-a569-7b1f90e502b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance b0fe24cf-adf2-440f-bc90-819416f0da85 could not be found. Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-831e3394-b0fb-4067-a569-7b1f90e502b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 HTTP/1.1 Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance b0fe24cf-adf2-440f-bc90-819416f0da85 could not be found. Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'b0fe24cf-adf2-440f-bc90-819416f0da85'} Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0fe24cf-adf2-440f-bc90-819416f0da85 could not be found. Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0fe24cf-adf2-440f-bc90-819416f0da85 could not be found. Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:29.506581 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:29.509957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:29.509957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:29.509957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:29.509957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:13:29.509957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:13:29.509957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0fe24cf-adf2-440f-bc90-819416f0da85 could not be found. Oct 29 01:13:29.509957 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:29.512953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-831e3394-b0fb-4067-a569-7b1f90e502b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance b0fe24cf-adf2-440f-bc90-819416f0da85 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:13:29.513955 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-831e3394-b0fb-4067-a569-7b1f90e502b6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 404 len: 111 microversion: 2.1 time: 0.062041 Oct 29 01:13:29.521116 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1208/2341] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:29 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:13:29.528857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d7481529-1472-489a-af9f-0d4b3580fdfd req-2ae20457-1515-4bf8-bc8f-a07fb4176b60 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:29.530523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d7481529-1472-489a-af9f-0d4b3580fdfd req-2ae20457-1515-4bf8-bc8f-a07fb4176b60 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:29.533120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-42a9056a-b610-4d72-b71b-ffb687573caa tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:29.538241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d7481529-1472-489a-af9f-0d4b3580fdfd req-2ae20457-1515-4bf8-bc8f-a07fb4176b60 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-42a9056a-b610-4d72-b71b-ffb687573caa tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Request method failure captured: Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH38W6vqCIaTdiX_Mf0AsBFHYOycKxgrfn_quZzNxYU5glmKV0pJ5Mb6imPL_7tPoKyLG6oGkjAx24pAIDmJLVS2v3mYJBNXYbiScfZfLLHvclNrhga2_fsaiJbaJPuGxMdCtHnw0XVbjb7GAeFX884bWAbhQDH0y9pHeTWj3JK62eU Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: a09ce55a18af4f8db53d517089591340 Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a09ce55a18af4f8db53d517089591340"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a09ce55a18af4f8db53d517089591340"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a09ce55a18af4f8db53d517089591340"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a09ce55a18af4f8db53d517089591340", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: a09ce55a18af4f8db53d517089591340 Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ListServersNegativeTestJSON-894183019-project Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: d5fce522753549929a06d164a5b244d7 Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ListServersNegativeTestJSON-894183019-project Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: action_args: {} Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'testing' Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 29 01:13:29.538919 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 29 01:13:29.545044 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:13:29.545044 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:13:29.545044 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:13:29.545044 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:13:29.545044 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 29 01:13:29.545044 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:29.545044 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:29.545044 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:29.545044 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:29.545044 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:29.545044 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:29.545044 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:13:29.545044 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:13:29.545044 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 29 01:13:29.545044 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:29.549290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-42a9056a-b610-4d72-b71b-ffb687573caa tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:13:29.549575 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-42a9056a-b610-4d72-b71b-ffb687573caa tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.026505 Oct 29 01:13:29.550591 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1209/2342] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:13:29 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:13:29.560010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6af23441-e8b5-4190-ad32-b283f5882c2a tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:29.566473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6af23441-e8b5-4190-ad32-b283f5882c2a tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:29.567256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6af23441-e8b5-4190-ad32-b283f5882c2a tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'a09ce55a18af4f8db53d517089591340'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:13:29.567895 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-d7481529-1472-489a-af9f-0d4b3580fdfd req-2ae20457-1515-4bf8-bc8f-a07fb4176b60 service nova] Creating event network-vif-plugged:c9bfa9ce-2881-44eb-bf9e-16eb902a3d6a for instance 24ebe561-9b25-419d-b771-d5f2d212cfbb on n-h1-862964-3 Oct 29 01:13:29.573775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.compute.servers [None req-6af23441-e8b5-4190-ad32-b283f5882c2a tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Flavor 'non_existing_flavor' could not be found {{(pid=121099) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 29 01:13:29.575036 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-d7481529-1472-489a-af9f-0d4b3580fdfd req-2ae20457-1515-4bf8-bc8f-a07fb4176b60 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075742 Oct 29 01:13:29.575370 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6af23441-e8b5-4190-ad32-b283f5882c2a tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.019125 Oct 29 01:13:29.580011 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1134/2343] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:29.582163 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1210/2344] 10.222.0.26 () {58 vars in 1178 bytes} [Sat Oct 29 01:13:29 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:13:29.592788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3f28e7f0-4571-48a6-988c-90e255f3fe52 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:29.600060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3f28e7f0-4571-48a6-988c-90e255f3fe52 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:29.600931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3f28e7f0-4571-48a6-988c-90e255f3fe52 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'a09ce55a18af4f8db53d517089591340'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:13:29.607937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f28e7f0-4571-48a6-988c-90e255f3fe52 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:29.609199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f28e7f0-4571-48a6-988c-90e255f3fe52 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:29.609948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f28e7f0-4571-48a6-988c-90e255f3fe52 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:29.610833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f28e7f0-4571-48a6-988c-90e255f3fe52 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:29.611370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f28e7f0-4571-48a6-988c-90e255f3fe52 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:29.611871 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f28e7f0-4571-48a6-988c-90e255f3fe52 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:29.723932 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3f28e7f0-4571-48a6-988c-90e255f3fe52 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.136218 Oct 29 01:13:29.725131 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1135/2345] 10.222.0.26 () {58 vars in 1174 bytes} [Sat Oct 29 01:13:29 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:13:29.743044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dd63b57c-5015-4fa4-836c-43e0cb22cc5b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:29.751380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dd63b57c-5015-4fa4-836c-43e0cb22cc5b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:29.752079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dd63b57c-5015-4fa4-836c-43e0cb22cc5b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'a09ce55a18af4f8db53d517089591340'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:13:29.758959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd63b57c-5015-4fa4-836c-43e0cb22cc5b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:29.759710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd63b57c-5015-4fa4-836c-43e0cb22cc5b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:29.760407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd63b57c-5015-4fa4-836c-43e0cb22cc5b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:29.761730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd63b57c-5015-4fa4-836c-43e0cb22cc5b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:29.762458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd63b57c-5015-4fa4-836c-43e0cb22cc5b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:29.763042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd63b57c-5015-4fa4-836c-43e0cb22cc5b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:29.800718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e675ec51-4381-4a01-973b-61dd0f94b7d2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1755599989", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "95eff624-38bf-46e7-958c-9fcb3dae19f9"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:29.898710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-e675ec51-4381-4a01-973b-61dd0f94b7d2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] validate_networks() for [('95eff624-38bf-46e7-958c-9fcb3dae19f9', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:13:29.956880 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dd63b57c-5015-4fa4-836c-43e0cb22cc5b tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.220878 Oct 29 01:13:29.967693 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1211/2346] 10.222.0.26 () {58 vars in 1184 bytes} [Sat Oct 29 01:13:29 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:13:29.975070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b26a6a60-a6aa-4d72-9272-3a9479ca73d0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:29.975937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b26a6a60-a6aa-4d72-9272-3a9479ca73d0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:29.983576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b26a6a60-a6aa-4d72-9272-3a9479ca73d0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:29.984326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b26a6a60-a6aa-4d72-9272-3a9479ca73d0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:29.985148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b26a6a60-a6aa-4d72-9272-3a9479ca73d0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:29.986057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b26a6a60-a6aa-4d72-9272-3a9479ca73d0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:29.986687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b26a6a60-a6aa-4d72-9272-3a9479ca73d0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:29.987265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b26a6a60-a6aa-4d72-9272-3a9479ca73d0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:30.278335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b26a6a60-a6aa-4d72-9272-3a9479ca73d0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:30.286735 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b26a6a60-a6aa-4d72-9272-3a9479ca73d0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1199 microversion: 2.1 time: 0.316287 Oct 29 01:13:30.303480 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1212/2347] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:29 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1199 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:30.311396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-99436e47-1ebd-41e3-be99-cf53fcf82f9f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:30.319986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-99436e47-1ebd-41e3-be99-cf53fcf82f9f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:30.321053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-99436e47-1ebd-41e3-be99-cf53fcf82f9f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Searching by: {'deleted': False, 'project_id': 'a09ce55a18af4f8db53d517089591340'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:13:30.329866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99436e47-1ebd-41e3-be99-cf53fcf82f9f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:30.330516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99436e47-1ebd-41e3-be99-cf53fcf82f9f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:30.330959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99436e47-1ebd-41e3-be99-cf53fcf82f9f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:30.331695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99436e47-1ebd-41e3-be99-cf53fcf82f9f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:30.332257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99436e47-1ebd-41e3-be99-cf53fcf82f9f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:30.332685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99436e47-1ebd-41e3-be99-cf53fcf82f9f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:30.386531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-99436e47-1ebd-41e3-be99-cf53fcf82f9f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:13:30.461368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-99436e47-1ebd-41e3-be99-cf53fcf82f9f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:30.476356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99436e47-1ebd-41e3-be99-cf53fcf82f9f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:30.476902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99436e47-1ebd-41e3-be99-cf53fcf82f9f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:30.477390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99436e47-1ebd-41e3-be99-cf53fcf82f9f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:31.027041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e675ec51-4381-4a01-973b-61dd0f94b7d2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:13:31.028819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e675ec51-4381-4a01-973b-61dd0f94b7d2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:13:31.030392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e675ec51-4381-4a01-973b-61dd0f94b7d2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:13:31.043132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e675ec51-4381-4a01-973b-61dd0f94b7d2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:13:31.048879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e675ec51-4381-4a01-973b-61dd0f94b7d2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:13:31.070762 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-99436e47-1ebd-41e3-be99-cf53fcf82f9f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.765867 Oct 29 01:13:31.071651 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1213/2348] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:13:30 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:31.078190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e675ec51-4381-4a01-973b-61dd0f94b7d2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:31.080375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e675ec51-4381-4a01-973b-61dd0f94b7d2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:31.084149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e675ec51-4381-4a01-973b-61dd0f94b7d2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:31.086049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e675ec51-4381-4a01-973b-61dd0f94b7d2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:31.086693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e675ec51-4381-4a01-973b-61dd0f94b7d2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:31.090846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e675ec51-4381-4a01-973b-61dd0f94b7d2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:31.101571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4016ab4f-075e-4aae-9f36-98a1a924b1f1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:31.102205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4016ab4f-075e-4aae-9f36-98a1a924b1f1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:31.119734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4016ab4f-075e-4aae-9f36-98a1a924b1f1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:31.120360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4016ab4f-075e-4aae-9f36-98a1a924b1f1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:31.121136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4016ab4f-075e-4aae-9f36-98a1a924b1f1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:31.121875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4016ab4f-075e-4aae-9f36-98a1a924b1f1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:31.122749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4016ab4f-075e-4aae-9f36-98a1a924b1f1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:31.123191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4016ab4f-075e-4aae-9f36-98a1a924b1f1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:31.131240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-e675ec51-4381-4a01-973b-61dd0f94b7d2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Getting quotas for project f421c64f9b2f49ebab46d9f8a28143d6. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:13:31.147818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-e675ec51-4381-4a01-973b-61dd0f94b7d2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Getting quotas for user 4ae0a54f51ad4813b312baf3a03ba172 and project f421c64f9b2f49ebab46d9f8a28143d6. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:13:31.182353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e675ec51-4381-4a01-973b-61dd0f94b7d2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:13:31.185560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e675ec51-4381-4a01-973b-61dd0f94b7d2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:13:31.213361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4016ab4f-075e-4aae-9f36-98a1a924b1f1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:31.213860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4016ab4f-075e-4aae-9f36-98a1a924b1f1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:31.214306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4016ab4f-075e-4aae-9f36-98a1a924b1f1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:31.214770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-4016ab4f-075e-4aae-9f36-98a1a924b1f1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lazy-loading 'fault' on Instance uuid 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:13:31.279107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4016ab4f-075e-4aae-9f36-98a1a924b1f1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:31.296078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4016ab4f-075e-4aae-9f36-98a1a924b1f1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:31.297857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4016ab4f-075e-4aae-9f36-98a1a924b1f1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56d01b83c0649e0b1d47b7563892d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0adfdd6819a472baf1aa25878c5ee22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:31.299191 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4016ab4f-075e-4aae-9f36-98a1a924b1f1 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 200 len: 1352 microversion: 2.25 time: 0.216116 Oct 29 01:13:31.330718 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1214/2349] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:13:31 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 1352 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:13:31.350567 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e675ec51-4381-4a01-973b-61dd0f94b7d2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.554002 Oct 29 01:13:31.351746 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1136/2350] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:13:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:13:31.356147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1b57e9b3-df3d-432b-ab38-04579b76409f tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:31.356147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1b57e9b3-df3d-432b-ab38-04579b76409f tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:31.357476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-8ad4c358-45b3-465a-80be-3f5828f1e19d req-fd4863ca-7b24-41b5-9ab6-d3cc41dd7982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba8acd1-344c-42b0-be43-a35cc5ff6f8e", "name": "network-vif-deleted", "tag": "cd682e5a-2996-4509-aa56-a7726f2d94bc"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:31.368543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b57e9b3-df3d-432b-ab38-04579b76409f tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:31.369334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b57e9b3-df3d-432b-ab38-04579b76409f tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:31.371779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b57e9b3-df3d-432b-ab38-04579b76409f tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:31.372972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b57e9b3-df3d-432b-ab38-04579b76409f tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:31.373456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8ad4c358-45b3-465a-80be-3f5828f1e19d req-fd4863ca-7b24-41b5-9ab6-d3cc41dd7982 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:31.374087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b57e9b3-df3d-432b-ab38-04579b76409f tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:31.374326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8ad4c358-45b3-465a-80be-3f5828f1e19d req-fd4863ca-7b24-41b5-9ab6-d3cc41dd7982 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:31.374917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8ad4c358-45b3-465a-80be-3f5828f1e19d req-fd4863ca-7b24-41b5-9ab6-d3cc41dd7982 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:31.386943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b57e9b3-df3d-432b-ab38-04579b76409f tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:31.388796 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-8ad4c358-45b3-465a-80be-3f5828f1e19d req-fd4863ca-7b24-41b5-9ab6-d3cc41dd7982 service nova] Creating event network-vif-deleted:cd682e5a-2996-4509-aa56-a7726f2d94bc for instance 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e on n-h2-862964-3 Oct 29 01:13:31.398330 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-8ad4c358-45b3-465a-80be-3f5828f1e19d req-fd4863ca-7b24-41b5-9ab6-d3cc41dd7982 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045301 Oct 29 01:13:31.399546 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1137/2351] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:31.408013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7acf6510-cf71-49f6-a0ed-ec0e32f0fd58 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fd775e0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:31.485081 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7acf6510-cf71-49f6-a0ed-ec0e32f0fd58 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.083917 Oct 29 01:13:31.493490 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1138/2352] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:31 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:31.503295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c5d95728-9c9c-41ab-addb-4b168ca9f649 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:31.508301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c5d95728-9c9c-41ab-addb-4b168ca9f649 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:31.509434 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c5d95728-9c9c-41ab-addb-4b168ca9f649 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.022295 Oct 29 01:13:31.510082 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1139/2353] 10.222.0.26 () {58 vars in 1178 bytes} [Sat Oct 29 01:13:31 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:13:31.526272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fa69ea39-c6c8-477f-8674-f40eeec2af68 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:31.532276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fa69ea39-c6c8-477f-8674-f40eeec2af68 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:31.543520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa69ea39-c6c8-477f-8674-f40eeec2af68 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:31.544007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa69ea39-c6c8-477f-8674-f40eeec2af68 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:31.544474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa69ea39-c6c8-477f-8674-f40eeec2af68 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:31.545138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa69ea39-c6c8-477f-8674-f40eeec2af68 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:31.545625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa69ea39-c6c8-477f-8674-f40eeec2af68 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:31.546207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa69ea39-c6c8-477f-8674-f40eeec2af68 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:31.858360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1b57e9b3-df3d-432b-ab38-04579b76409f tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:31.867457 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1b57e9b3-df3d-432b-ab38-04579b76409f tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 200 len: 1403 microversion: 2.1 time: 0.533485 Oct 29 01:13:31.871909 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1215/2354] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:31 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 1403 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:31.881048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-230beccb-35d4-42ac-8747-0ed74c965314 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:31.882443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-230beccb-35d4-42ac-8747-0ed74c965314 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:31.913658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fa69ea39-c6c8-477f-8674-f40eeec2af68 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:31.946864 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fa69ea39-c6c8-477f-8674-f40eeec2af68 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1199 microversion: 2.1 time: 0.435447 Oct 29 01:13:31.950454 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1140/2355] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:31 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1199 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:31.966665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1613b06a-de94-475d-af75-8a4f60df7fbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:31.979036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1613b06a-de94-475d-af75-8a4f60df7fbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:31.980076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1613b06a-de94-475d-af75-8a4f60df7fbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Searching by: {'deleted': False, 'project_id': 'a09ce55a18af4f8db53d517089591340'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:13:31.989914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1613b06a-de94-475d-af75-8a4f60df7fbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:31.991090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1613b06a-de94-475d-af75-8a4f60df7fbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:31.991999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1613b06a-de94-475d-af75-8a4f60df7fbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:31.993103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1613b06a-de94-475d-af75-8a4f60df7fbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:31.993778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1613b06a-de94-475d-af75-8a4f60df7fbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:31.994400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1613b06a-de94-475d-af75-8a4f60df7fbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:32.021104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-230beccb-35d4-42ac-8747-0ed74c965314 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:32.033034 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-230beccb-35d4-42ac-8747-0ed74c965314 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1215 microversion: 2.1 time: 0.159517 Oct 29 01:13:32.037192 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1216/2356] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:31 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:32.052256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.multi_cell_list [None req-1613b06a-de94-475d-af75-8a4f60df7fbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121100) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:13:32.090925 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1613b06a-de94-475d-af75-8a4f60df7fbe tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.139014 Oct 29 01:13:32.091520 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1141/2357] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 29 01:13:31 2022] GET /compute/v2.1/servers => generated 681 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:32.106106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1b4a1e43-01b0-41b5-b837-fda310920226 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:32.107865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1b4a1e43-01b0-41b5-b837-fda310920226 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:32.118660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b4a1e43-01b0-41b5-b837-fda310920226 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:32.119179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b4a1e43-01b0-41b5-b837-fda310920226 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:32.119635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b4a1e43-01b0-41b5-b837-fda310920226 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:32.120536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b4a1e43-01b0-41b5-b837-fda310920226 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:32.121486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b4a1e43-01b0-41b5-b837-fda310920226 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:32.121924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b4a1e43-01b0-41b5-b837-fda310920226 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:32.153537 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-1b4a1e43-01b0-41b5-b837-fda310920226 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] HTTP exception thrown: Instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd could not be found. Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1b4a1e43-01b0-41b5-b837-fda310920226 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Request method failure captured: Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/69681dc4-6f48-44ea-a7c4-1b10ea9b86dd HTTP/1.1 Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH38W6vqCIaTdiX_Mf0AsBFHYOycKxgrfn_quZzNxYU5glmKV0pJ5Mb6imPL_7tPoKyLG6oGkjAx24pAIDmJLVS2v3mYJBNXYbiScfZfLLHvclNrhga2_fsaiJbaJPuGxMdCtHnw0XVbjb7GAeFX884bWAbhQDH0y9pHeTWj3JK62eU Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: a09ce55a18af4f8db53d517089591340 Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a09ce55a18af4f8db53d517089591340"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a09ce55a18af4f8db53d517089591340"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a09ce55a18af4f8db53d517089591340"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a09ce55a18af4f8db53d517089591340", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: a09ce55a18af4f8db53d517089591340 Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ListServersNegativeTestJSON-894183019-project Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: d5fce522753549929a06d164a5b244d7 Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ListServersNegativeTestJSON-894183019-project Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd could not be found. Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '69681dc4-6f48-44ea-a7c4-1b10ea9b86dd'} Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd could not be found. Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:13:32.156007 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:13:32.159645 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd could not be found. Oct 29 01:13:32.159645 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:32.159645 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:32.159645 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:32.159645 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:32.159645 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:32.159645 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:32.159645 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:13:32.159645 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:13:32.159645 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd could not be found. Oct 29 01:13:32.159645 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:32.160991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1b4a1e43-01b0-41b5-b837-fda310920226 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Returning 404 to user: Instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:13:32.161928 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1b4a1e43-01b0-41b5-b837-fda310920226 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "DELETE /compute/v2.1/servers/69681dc4-6f48-44ea-a7c4-1b10ea9b86dd" status: 404 len: 111 microversion: 2.1 time: 0.060188 Oct 29 01:13:32.165578 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1217/2358] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:13:32 2022] DELETE /compute/v2.1/servers/69681dc4-6f48-44ea-a7c4-1b10ea9b86dd => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:13:32.173688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6addbde0-19be-4617-975e-403d820eacb3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:32.174195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6addbde0-19be-4617-975e-403d820eacb3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: 6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:32.179692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:13:32.181217 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6addbde0-19be-4617-975e-403d820eacb3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:32.182120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6addbde0-19be-4617-975e-403d820eacb3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:32.182719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6addbde0-19be-4617-975e-403d820eacb3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:32.183775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6addbde0-19be-4617-975e-403d820eacb3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:32.184412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6addbde0-19be-4617-975e-403d820eacb3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:32.184991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6addbde0-19be-4617-975e-403d820eacb3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:32.215653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6addbde0-19be-4617-975e-403d820eacb3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: 6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:13:32.253777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:13:32.333773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c1a773d9-e402-4a9e-91e4-7e79bff36114 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:32.334395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c1a773d9-e402-4a9e-91e4-7e79bff36114 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] [instance: 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:32.341298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1a773d9-e402-4a9e-91e4-7e79bff36114 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:32.342455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1a773d9-e402-4a9e-91e4-7e79bff36114 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:32.342959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1a773d9-e402-4a9e-91e4-7e79bff36114 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:32.343818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1a773d9-e402-4a9e-91e4-7e79bff36114 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:32.344277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1a773d9-e402-4a9e-91e4-7e79bff36114 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:32.345024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1a773d9-e402-4a9e-91e4-7e79bff36114 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:32.365511 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-c1a773d9-e402-4a9e-91e4-7e79bff36114 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] HTTP exception thrown: Instance 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e could not be found. Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c1a773d9-e402-4a9e-91e4-7e79bff36114 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Request method failure captured: Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e HTTP/1.1 Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHwt8JRabpvp9J8kG0M67t8Iyr-SCG7c-JPFaER1eUdy9mdMDCEj57I5ypg-0c0_-vhR59XazevAWW9UCfnpvJK_2L07j2pHd2K21GogPYDil-XXkBqZo1XsB8bEUTDJZ0VVBE2QuaVkvQQHZTsiTPyIIY_dgKVrgYeW95RUKfni_RY Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.25 Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: d0adfdd6819a472baf1aa25878c5ee22 Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2081653878 Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d0adfdd6819a472baf1aa25878c5ee22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d0adfdd6819a472baf1aa25878c5ee22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d0adfdd6819a472baf1aa25878c5ee22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d0adfdd6819a472baf1aa25878c5ee22", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2081653878 Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: d0adfdd6819a472baf1aa25878c5ee22 Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2081653878 Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-LiveAutoBlockMigrationV225Test-2081653878-project Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: c56d01b83c0649e0b1d47b7563892d3f Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2081653878-project Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e could not be found. Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '7ba8acd1-344c-42b0-be43-a35cc5ff6f8e'} Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e could not be found. Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e could not be found. Oct 29 01:13:32.367963 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:32.371848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:32.371848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:32.371848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:32.371848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:32.371848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:32.371848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:13:32.371848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:13:32.371848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e could not be found. Oct 29 01:13:32.371848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:32.373308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c1a773d9-e402-4a9e-91e4-7e79bff36114 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] Returning 404 to user: Instance 7ba8acd1-344c-42b0-be43-a35cc5ff6f8e could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:13:32.374635 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c1a773d9-e402-4a9e-91e4-7e79bff36114 tempest-LiveAutoBlockMigrationV225Test-2081653878 tempest-LiveAutoBlockMigrationV225Test-2081653878-project] 10.222.0.26 "GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e" status: 404 len: 111 microversion: 2.25 time: 0.045479 Oct 29 01:13:32.375679 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1218/2359] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:13:32 2022] GET /compute/v2.1/servers/7ba8acd1-344c-42b0-be43-a35cc5ff6f8e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 29 01:13:32.507610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7c078433-8f0f-4c28-b3f4-e42e812c3796 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9796f4c0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:32.597102 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7c078433-8f0f-4c28-b3f4-e42e812c3796 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.099625 Oct 29 01:13:32.605416 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1219/2360] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:32 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:32.696466 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6addbde0-19be-4617-975e-403d820eacb3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4" status: 204 len: 0 microversion: 2.1 time: 0.527218 Oct 29 01:13:32.697120 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1142/2361] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:13:32 2022] DELETE /compute/v2.1/servers/6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:13:32.707784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-723cd41d-c87b-4333-b1a7-3fdf9733a7f1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:32.708291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-723cd41d-c87b-4333-b1a7-3fdf9733a7f1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:32.717304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-723cd41d-c87b-4333-b1a7-3fdf9733a7f1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:32.717906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-723cd41d-c87b-4333-b1a7-3fdf9733a7f1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:32.718931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-723cd41d-c87b-4333-b1a7-3fdf9733a7f1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:32.720206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-723cd41d-c87b-4333-b1a7-3fdf9733a7f1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:32.720825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-723cd41d-c87b-4333-b1a7-3fdf9733a7f1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:32.721458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-723cd41d-c87b-4333-b1a7-3fdf9733a7f1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:32.754473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-723cd41d-c87b-4333-b1a7-3fdf9733a7f1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:13:32.899073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-49608c1d-084f-4144-a8ec-1f3d3212190c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:32.899826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-49608c1d-084f-4144-a8ec-1f3d3212190c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:32.911586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49608c1d-084f-4144-a8ec-1f3d3212190c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:32.912930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49608c1d-084f-4144-a8ec-1f3d3212190c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:32.914069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49608c1d-084f-4144-a8ec-1f3d3212190c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:32.914789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49608c1d-084f-4144-a8ec-1f3d3212190c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:32.918593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49608c1d-084f-4144-a8ec-1f3d3212190c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:32.919037 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49608c1d-084f-4144-a8ec-1f3d3212190c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:33.148785 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-723cd41d-c87b-4333-b1a7-3fdf9733a7f1 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 204 len: 0 microversion: 2.1 time: 0.446467 Oct 29 01:13:33.149610 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1220/2362] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:13:32 2022] DELETE /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:13:33.161645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-61a7bfb5-4571-4544-ad7d-081e7ace1f08 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:33.162415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-61a7bfb5-4571-4544-ad7d-081e7ace1f08 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:33.170523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61a7bfb5-4571-4544-ad7d-081e7ace1f08 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:33.171113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61a7bfb5-4571-4544-ad7d-081e7ace1f08 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:33.171901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61a7bfb5-4571-4544-ad7d-081e7ace1f08 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:33.172349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61a7bfb5-4571-4544-ad7d-081e7ace1f08 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:33.172811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61a7bfb5-4571-4544-ad7d-081e7ace1f08 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:33.173260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61a7bfb5-4571-4544-ad7d-081e7ace1f08 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:33.541075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-49608c1d-084f-4144-a8ec-1f3d3212190c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:33.550847 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-49608c1d-084f-4144-a8ec-1f3d3212190c tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 200 len: 1403 microversion: 2.1 time: 0.658587 Oct 29 01:13:33.551755 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1143/2363] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:32 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 1403 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:33.556502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f2afdb3c-070b-4384-8e58-5ed06af8c2c9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:33.557335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f2afdb3c-070b-4384-8e58-5ed06af8c2c9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:33.565609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2afdb3c-070b-4384-8e58-5ed06af8c2c9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:33.566378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2afdb3c-070b-4384-8e58-5ed06af8c2c9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:33.566993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2afdb3c-070b-4384-8e58-5ed06af8c2c9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:33.567872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2afdb3c-070b-4384-8e58-5ed06af8c2c9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:33.568485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2afdb3c-070b-4384-8e58-5ed06af8c2c9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:33.569351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2afdb3c-070b-4384-8e58-5ed06af8c2c9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:33.577736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-61a7bfb5-4571-4544-ad7d-081e7ace1f08 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:33.587264 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-61a7bfb5-4571-4544-ad7d-081e7ace1f08 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1382 microversion: 2.1 time: 0.433708 Oct 29 01:13:33.594380 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1221/2364] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:33 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1382 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:33.599766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f820edb6-f068-4783-a9f8-d42f5c7ddcc2 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:33.600379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f820edb6-f068-4783-a9f8-d42f5c7ddcc2 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:33.629791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f820edb6-f068-4783-a9f8-d42f5c7ddcc2 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:33.630779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f820edb6-f068-4783-a9f8-d42f5c7ddcc2 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:33.631379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f820edb6-f068-4783-a9f8-d42f5c7ddcc2 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:33.632360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f820edb6-f068-4783-a9f8-d42f5c7ddcc2 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:33.633023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f820edb6-f068-4783-a9f8-d42f5c7ddcc2 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:33.634160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f820edb6-f068-4783-a9f8-d42f5c7ddcc2 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:33.669484 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-f820edb6-f068-4783-a9f8-d42f5c7ddcc2 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] HTTP exception thrown: Instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd could not be found. Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f820edb6-f068-4783-a9f8-d42f5c7ddcc2 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Request method failure captured: Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/69681dc4-6f48-44ea-a7c4-1b10ea9b86dd HTTP/1.1 Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH38W6vqCIaTdiX_Mf0AsBFHYOycKxgrfn_quZzNxYU5glmKV0pJ5Mb6imPL_7tPoKyLG6oGkjAx24pAIDmJLVS2v3mYJBNXYbiScfZfLLHvclNrhga2_fsaiJbaJPuGxMdCtHnw0XVbjb7GAeFX884bWAbhQDH0y9pHeTWj3JK62eU Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: a09ce55a18af4f8db53d517089591340 Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a09ce55a18af4f8db53d517089591340"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a09ce55a18af4f8db53d517089591340"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a09ce55a18af4f8db53d517089591340"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a09ce55a18af4f8db53d517089591340", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: a09ce55a18af4f8db53d517089591340 Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ListServersNegativeTestJSON-894183019-project Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: d5fce522753549929a06d164a5b244d7 Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ListServersNegativeTestJSON-894183019-project Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd could not be found. Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '69681dc4-6f48-44ea-a7c4-1b10ea9b86dd'} Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd could not be found. Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd could not be found. Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:33.675108 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:33.679177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:33.679177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:33.679177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:33.679177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:33.679177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:13:33.679177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:13:33.679177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd could not be found. Oct 29 01:13:33.679177 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:33.681936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f820edb6-f068-4783-a9f8-d42f5c7ddcc2 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Returning 404 to user: Instance 69681dc4-6f48-44ea-a7c4-1b10ea9b86dd could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:13:33.683225 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f820edb6-f068-4783-a9f8-d42f5c7ddcc2 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/69681dc4-6f48-44ea-a7c4-1b10ea9b86dd" status: 404 len: 111 microversion: 2.1 time: 0.087692 Oct 29 01:13:33.684889 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1222/2365] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:33 2022] GET /compute/v2.1/servers/69681dc4-6f48-44ea-a7c4-1b10ea9b86dd => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:13:33.706808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-7efee9da-4f34-46d4-ac13-0a0fc753da70 req-cf6cec06-4746-4bcb-a3ab-91858d77fc51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b41540-956c-41c7-8396-3bcbcfc54862", "name": "network-vif-plugged", "status": "completed", "tag": "69c1a7b0-0583-4934-a72a-4f711f4caffe"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:33.707481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f2afdb3c-070b-4384-8e58-5ed06af8c2c9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:33.721773 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f2afdb3c-070b-4384-8e58-5ed06af8c2c9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1219 microversion: 2.1 time: 0.168554 Oct 29 01:13:33.724545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7efee9da-4f34-46d4-ac13-0a0fc753da70 req-cf6cec06-4746-4bcb-a3ab-91858d77fc51 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:33.733047 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1144/2366] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:33 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1219 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:33.733206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7efee9da-4f34-46d4-ac13-0a0fc753da70 req-cf6cec06-4746-4bcb-a3ab-91858d77fc51 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:33.733206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7efee9da-4f34-46d4-ac13-0a0fc753da70 req-cf6cec06-4746-4bcb-a3ab-91858d77fc51 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:33.737700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-ac98899d-4a8a-47bc-828d-a191cc3becbe req-e3ac88c8-24b8-47eb-977a-4b8696e60e93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e8218af-8624-4be9-8ae8-3c335c4af98b", "tag": "0a9971a0-79e6-4307-9847-31fa1d9d3699"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:33.743000 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-7efee9da-4f34-46d4-ac13-0a0fc753da70 req-cf6cec06-4746-4bcb-a3ab-91858d77fc51 service nova] Creating event network-vif-plugged:69c1a7b0-0583-4934-a72a-4f711f4caffe for instance 71b41540-956c-41c7-8396-3bcbcfc54862 on n-h1-862964-3 Oct 29 01:13:33.748294 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-7efee9da-4f34-46d4-ac13-0a0fc753da70 req-cf6cec06-4746-4bcb-a3ab-91858d77fc51 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061933 Oct 29 01:13:33.749806 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1223/2367] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:33.756889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c9152068-dd52-44a0-9aac-0109ff8e9ee8 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d979cf4c0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:33.764594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ac98899d-4a8a-47bc-828d-a191cc3becbe req-e3ac88c8-24b8-47eb-977a-4b8696e60e93 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:33.765187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ac98899d-4a8a-47bc-828d-a191cc3becbe req-e3ac88c8-24b8-47eb-977a-4b8696e60e93 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:33.766153 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ac98899d-4a8a-47bc-828d-a191cc3becbe req-e3ac88c8-24b8-47eb-977a-4b8696e60e93 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:33.785722 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-ac98899d-4a8a-47bc-828d-a191cc3becbe req-e3ac88c8-24b8-47eb-977a-4b8696e60e93 service nova] Creating event network-changed:0a9971a0-79e6-4307-9847-31fa1d9d3699 for instance 0e8218af-8624-4be9-8ae8-3c335c4af98b on n-h2-862964-3 Oct 29 01:13:33.802166 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-ac98899d-4a8a-47bc-828d-a191cc3becbe req-e3ac88c8-24b8-47eb-977a-4b8696e60e93 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075697 Oct 29 01:13:33.802796 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1145/2368] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:33.814106 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c9152068-dd52-44a0-9aac-0109ff8e9ee8 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.062792 Oct 29 01:13:33.815882 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1224/2369] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:33 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:33.821354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7ae858b5-4afb-43a6-8dcf-0c6b530fd9b5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:33.822272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7ae858b5-4afb-43a6-8dcf-0c6b530fd9b5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: 6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:33.832643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ae858b5-4afb-43a6-8dcf-0c6b530fd9b5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:33.833517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ae858b5-4afb-43a6-8dcf-0c6b530fd9b5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:33.834210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ae858b5-4afb-43a6-8dcf-0c6b530fd9b5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:33.835785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ae858b5-4afb-43a6-8dcf-0c6b530fd9b5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:33.836451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ae858b5-4afb-43a6-8dcf-0c6b530fd9b5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:33.837645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ae858b5-4afb-43a6-8dcf-0c6b530fd9b5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:34.103421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-063d5bca-2ac9-429a-854b-9b55f5c6a1a4 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:34.104399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-063d5bca-2ac9-429a-854b-9b55f5c6a1a4 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:34.118892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-063d5bca-2ac9-429a-854b-9b55f5c6a1a4 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:34.119623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-063d5bca-2ac9-429a-854b-9b55f5c6a1a4 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:34.120275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-063d5bca-2ac9-429a-854b-9b55f5c6a1a4 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:34.121265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-063d5bca-2ac9-429a-854b-9b55f5c6a1a4 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:34.121962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-063d5bca-2ac9-429a-854b-9b55f5c6a1a4 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:34.122596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-063d5bca-2ac9-429a-854b-9b55f5c6a1a4 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:34.155204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7ae858b5-4afb-43a6-8dcf-0c6b530fd9b5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:34.166698 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7ae858b5-4afb-43a6-8dcf-0c6b530fd9b5 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4" status: 200 len: 1521 microversion: 2.1 time: 0.349238 Oct 29 01:13:34.170277 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1225/2370] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:33 2022] GET /compute/v2.1/servers/6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:34.388037 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-063d5bca-2ac9-429a-854b-9b55f5c6a1a4 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1533 microversion: 2.1 time: 0.583939 Oct 29 01:13:34.401957 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1146/2371] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:33 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1533 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:34.412041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e9b3010d-dcf9-4bc2-aed7-2226ba68bb1c tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:34.413078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e9b3010d-dcf9-4bc2-aed7-2226ba68bb1c tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:34.420820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9b3010d-dcf9-4bc2-aed7-2226ba68bb1c tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:34.421437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9b3010d-dcf9-4bc2-aed7-2226ba68bb1c tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:34.429575 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9b3010d-dcf9-4bc2-aed7-2226ba68bb1c tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:34.430390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9b3010d-dcf9-4bc2-aed7-2226ba68bb1c tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:34.430948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9b3010d-dcf9-4bc2-aed7-2226ba68bb1c tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:34.431750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9b3010d-dcf9-4bc2-aed7-2226ba68bb1c tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:34.460811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:13:34.578084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1ef19fe1-df43-426f-8de5-3aca97457807 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:34.579443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1ef19fe1-df43-426f-8de5-3aca97457807 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:34.599679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ef19fe1-df43-426f-8de5-3aca97457807 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:34.601443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ef19fe1-df43-426f-8de5-3aca97457807 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:34.603669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ef19fe1-df43-426f-8de5-3aca97457807 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:34.605539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ef19fe1-df43-426f-8de5-3aca97457807 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:34.607289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ef19fe1-df43-426f-8de5-3aca97457807 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:34.615897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ef19fe1-df43-426f-8de5-3aca97457807 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:34.748615 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e9b3010d-dcf9-4bc2-aed7-2226ba68bb1c tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1533 microversion: 2.1 time: 0.339584 Oct 29 01:13:34.751933 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1226/2372] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:34 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1533 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:34.765799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-29b69157-d724-4856-b00d-26be5fef600d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:34.768068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-29b69157-d724-4856-b00d-26be5fef600d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:34.783209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29b69157-d724-4856-b00d-26be5fef600d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:34.784614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29b69157-d724-4856-b00d-26be5fef600d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:34.785188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29b69157-d724-4856-b00d-26be5fef600d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:34.787872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29b69157-d724-4856-b00d-26be5fef600d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:34.788518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29b69157-d724-4856-b00d-26be5fef600d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:34.789256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29b69157-d724-4856-b00d-26be5fef600d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:34.973709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-29b69157-d724-4856-b00d-26be5fef600d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:34.985729 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-29b69157-d724-4856-b00d-26be5fef600d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1211 microversion: 2.1 time: 0.227863 Oct 29 01:13:34.986881 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1227/2373] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:34 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1211 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:34.993098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-582a8835-01ab-4b69-8243-21f12d548353 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:35.000517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-582a8835-01ab-4b69-8243-21f12d548353 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:35.001354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-582a8835-01ab-4b69-8243-21f12d548353 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:35.002139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-582a8835-01ab-4b69-8243-21f12d548353 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:35.003116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-582a8835-01ab-4b69-8243-21f12d548353 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:35.003779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-582a8835-01ab-4b69-8243-21f12d548353 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:35.004425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-582a8835-01ab-4b69-8243-21f12d548353 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:35.046645 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-582a8835-01ab-4b69-8243-21f12d548353 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.057620 Oct 29 01:13:35.054610 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1228/2374] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Oct 29 01:13:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:35.071752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f477d0fa-6f2d-4e3e-877d-905c4bd41816 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d978234c0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:35.167156 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f477d0fa-6f2d-4e3e-877d-905c4bd41816 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.110229 Oct 29 01:13:35.182310 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1229/2375] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:35 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:35.194549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8cb3cd6d-5475-42c1-9623-2cb7a8b13a28 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862964-3", "block_migration": false, "disk_over_commit": false}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:35.197038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8cb3cd6d-5475-42c1-9623-2cb7a8b13a28 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:35.235464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cb3cd6d-5475-42c1-9623-2cb7a8b13a28 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:35.235464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cb3cd6d-5475-42c1-9623-2cb7a8b13a28 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:35.235464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cb3cd6d-5475-42c1-9623-2cb7a8b13a28 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:35.235792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cb3cd6d-5475-42c1-9623-2cb7a8b13a28 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:35.236213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cb3cd6d-5475-42c1-9623-2cb7a8b13a28 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:35.236663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cb3cd6d-5475-42c1-9623-2cb7a8b13a28 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:35.303069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1ef19fe1-df43-426f-8de5-3aca97457807 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:35.320412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-8cb3cd6d-5475-42c1-9623-2cb7a8b13a28 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lazy-loading 'flavor' on Instance uuid 24ebe561-9b25-419d-b771-d5f2d212cfbb {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:13:35.333394 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1ef19fe1-df43-426f-8de5-3aca97457807 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 200 len: 1403 microversion: 2.1 time: 0.757950 Oct 29 01:13:35.333394 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1147/2376] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:34 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 1403 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:35.363646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-18c3d2c5-193e-421f-a05b-c087e4cc0d7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:35.368523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-18c3d2c5-193e-421f-a05b-c087e4cc0d7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: 6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:35.384559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18c3d2c5-193e-421f-a05b-c087e4cc0d7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:35.387711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18c3d2c5-193e-421f-a05b-c087e4cc0d7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:35.391425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18c3d2c5-193e-421f-a05b-c087e4cc0d7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:35.396096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18c3d2c5-193e-421f-a05b-c087e4cc0d7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:35.396368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8cb3cd6d-5475-42c1-9623-2cb7a8b13a28 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Going to try to live migrate instance to n-h2-862964-3 {{(pid=121099) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 01:13:35.399055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18c3d2c5-193e-421f-a05b-c087e4cc0d7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:35.402433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18c3d2c5-193e-421f-a05b-c087e4cc0d7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:35.427237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:13:35.713561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-18c3d2c5-193e-421f-a05b-c087e4cc0d7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:35.728514 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-18c3d2c5-193e-421f-a05b-c087e4cc0d7f tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4" status: 200 len: 1521 microversion: 2.1 time: 0.386750 Oct 29 01:13:35.729440 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1148/2377] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:35 2022] GET /compute/v2.1/servers/6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4 => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:36.014081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6bf688df-e112-4871-8304-4934f488dc31 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:36.014819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6bf688df-e112-4871-8304-4934f488dc31 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:36.038428 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bf688df-e112-4871-8304-4934f488dc31 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:36.038932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bf688df-e112-4871-8304-4934f488dc31 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:36.039374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bf688df-e112-4871-8304-4934f488dc31 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:36.040091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bf688df-e112-4871-8304-4934f488dc31 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:36.040548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bf688df-e112-4871-8304-4934f488dc31 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:36.040970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bf688df-e112-4871-8304-4934f488dc31 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:36.234779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6bf688df-e112-4871-8304-4934f488dc31 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:36.248688 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6bf688df-e112-4871-8304-4934f488dc31 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1275 microversion: 2.1 time: 0.236967 Oct 29 01:13:36.265713 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1149/2378] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:36 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1275 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:36.275202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e6554478-5394-490b-93eb-6a8a90840f5c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fd2f0d0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:36.340898 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e6554478-5394-490b-93eb-6a8a90840f5c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.073738 Oct 29 01:13:36.342760 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1150/2379] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:36 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:36.365233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5783501b-26d5-4a2f-9161-58d674aa4d08 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:36.366183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5783501b-26d5-4a2f-9161-58d674aa4d08 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:36.374661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5783501b-26d5-4a2f-9161-58d674aa4d08 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:36.377698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5783501b-26d5-4a2f-9161-58d674aa4d08 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:36.377698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5783501b-26d5-4a2f-9161-58d674aa4d08 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:36.377698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5783501b-26d5-4a2f-9161-58d674aa4d08 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:36.380783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5783501b-26d5-4a2f-9161-58d674aa4d08 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:36.384795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5783501b-26d5-4a2f-9161-58d674aa4d08 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:36.875564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5783501b-26d5-4a2f-9161-58d674aa4d08 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:36.886016 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5783501b-26d5-4a2f-9161-58d674aa4d08 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 200 len: 1403 microversion: 2.1 time: 0.530215 Oct 29 01:13:36.886612 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1151/2380] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:36 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 1403 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:36.898151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-68af08f9-bfd3-4a5b-8e35-2c0c155121a9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:36.898778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-68af08f9-bfd3-4a5b-8e35-2c0c155121a9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: 6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:36.937865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68af08f9-bfd3-4a5b-8e35-2c0c155121a9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:36.938366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68af08f9-bfd3-4a5b-8e35-2c0c155121a9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:36.938807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68af08f9-bfd3-4a5b-8e35-2c0c155121a9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:36.939830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68af08f9-bfd3-4a5b-8e35-2c0c155121a9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:36.940294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68af08f9-bfd3-4a5b-8e35-2c0c155121a9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:36.957331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68af08f9-bfd3-4a5b-8e35-2c0c155121a9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:37.300801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-68af08f9-bfd3-4a5b-8e35-2c0c155121a9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:37.336655 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-68af08f9-bfd3-4a5b-8e35-2c0c155121a9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4" status: 200 len: 1521 microversion: 2.1 time: 0.421881 Oct 29 01:13:37.336655 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1152/2381] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:36 2022] GET /compute/v2.1/servers/6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:37.336655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bc2eb003-0d57-409a-a804-f73d514a3db3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:37.336655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bc2eb003-0d57-409a-a804-f73d514a3db3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:37.352317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc2eb003-0d57-409a-a804-f73d514a3db3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:37.352810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc2eb003-0d57-409a-a804-f73d514a3db3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:37.353263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc2eb003-0d57-409a-a804-f73d514a3db3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:37.356972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc2eb003-0d57-409a-a804-f73d514a3db3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:37.357545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc2eb003-0d57-409a-a804-f73d514a3db3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:37.358966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc2eb003-0d57-409a-a804-f73d514a3db3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:37.490962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bc2eb003-0d57-409a-a804-f73d514a3db3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:37.542770 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bc2eb003-0d57-409a-a804-f73d514a3db3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1273 microversion: 2.1 time: 0.186442 Oct 29 01:13:37.542770 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1153/2382] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:37 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1273 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:37.566543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-59f0650d-465a-40e5-873f-1c391a092afe tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fd85790>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:37.997093 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-59f0650d-465a-40e5-873f-1c391a092afe tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.478950 Oct 29 01:13:37.999701 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1154/2383] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:37 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:38.006399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-94f84501-45ea-4509-8009-c0e5573fe964 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:38.007023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-94f84501-45ea-4509-8009-c0e5573fe964 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:38.047875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94f84501-45ea-4509-8009-c0e5573fe964 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:38.053759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94f84501-45ea-4509-8009-c0e5573fe964 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:38.053759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94f84501-45ea-4509-8009-c0e5573fe964 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:38.053759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94f84501-45ea-4509-8009-c0e5573fe964 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:38.053759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94f84501-45ea-4509-8009-c0e5573fe964 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:38.055719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94f84501-45ea-4509-8009-c0e5573fe964 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:39.764755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-94f84501-45ea-4509-8009-c0e5573fe964 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:39.779854 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-94f84501-45ea-4509-8009-c0e5573fe964 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 200 len: 1403 microversion: 2.1 time: 1.779022 Oct 29 01:13:39.781780 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1155/2384] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:37 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 1403 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:39.837719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-c8c27672-31e1-4021-8c10-e5b555bd53f4 req-556745be-16ff-4013-9fa1-eceb0656f1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8218af-8624-4be9-8ae8-3c335c4af98b", "name": "network-vif-plugged", "status": "completed", "tag": "0a9971a0-79e6-4307-9847-31fa1d9d3699"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:39.868735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c8c27672-31e1-4021-8c10-e5b555bd53f4 req-556745be-16ff-4013-9fa1-eceb0656f1d5 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:39.869287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c8c27672-31e1-4021-8c10-e5b555bd53f4 req-556745be-16ff-4013-9fa1-eceb0656f1d5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:39.869725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c8c27672-31e1-4021-8c10-e5b555bd53f4 req-556745be-16ff-4013-9fa1-eceb0656f1d5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:39.912232 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-c8c27672-31e1-4021-8c10-e5b555bd53f4 req-556745be-16ff-4013-9fa1-eceb0656f1d5 service nova] Creating event network-vif-plugged:0a9971a0-79e6-4307-9847-31fa1d9d3699 for instance 0e8218af-8624-4be9-8ae8-3c335c4af98b on n-h2-862964-3 Oct 29 01:13:39.924884 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-c8c27672-31e1-4021-8c10-e5b555bd53f4 req-556745be-16ff-4013-9fa1-eceb0656f1d5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121193 Oct 29 01:13:39.928749 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1156/2385] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:39.939258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-90e16ef3-439f-4c89-9679-a5890c04d7ee tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:39.939981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-90e16ef3-439f-4c89-9679-a5890c04d7ee tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: 6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:39.967656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90e16ef3-439f-4c89-9679-a5890c04d7ee tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:39.969475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90e16ef3-439f-4c89-9679-a5890c04d7ee tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:39.969475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90e16ef3-439f-4c89-9679-a5890c04d7ee tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:39.969475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90e16ef3-439f-4c89-9679-a5890c04d7ee tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:39.969754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90e16ef3-439f-4c89-9679-a5890c04d7ee tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:39.981510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90e16ef3-439f-4c89-9679-a5890c04d7ee tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:40.119031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90e16ef3-439f-4c89-9679-a5890c04d7ee tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:40.119530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90e16ef3-439f-4c89-9679-a5890c04d7ee tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:40.126340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90e16ef3-439f-4c89-9679-a5890c04d7ee tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:40.127998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-90e16ef3-439f-4c89-9679-a5890c04d7ee tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lazy-loading 'fault' on Instance uuid 6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:13:40.297668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-90e16ef3-439f-4c89-9679-a5890c04d7ee tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fce522753549929a06d164a5b244d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09ce55a18af4f8db53d517089591340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:40.311121 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-90e16ef3-439f-4c89-9679-a5890c04d7ee tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4" status: 200 len: 1312 microversion: 2.1 time: 0.380473 Oct 29 01:13:40.312926 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1157/2386] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:39 2022] GET /compute/v2.1/servers/6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4 => generated 1312 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:40.320417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bd9266ce-8f8e-4a97-aa66-d284bb745f22 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:40.321427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bd9266ce-8f8e-4a97-aa66-d284bb745f22 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:40.336520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd9266ce-8f8e-4a97-aa66-d284bb745f22 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:40.343203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd9266ce-8f8e-4a97-aa66-d284bb745f22 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:40.344099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd9266ce-8f8e-4a97-aa66-d284bb745f22 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:40.345089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd9266ce-8f8e-4a97-aa66-d284bb745f22 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:40.345994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd9266ce-8f8e-4a97-aa66-d284bb745f22 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:40.346655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd9266ce-8f8e-4a97-aa66-d284bb745f22 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:40.955054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bd9266ce-8f8e-4a97-aa66-d284bb745f22 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:40.955054 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bd9266ce-8f8e-4a97-aa66-d284bb745f22 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1315 microversion: 2.1 time: 0.603509 Oct 29 01:13:40.955054 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1158/2387] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:40 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:40.955054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-cb2a79c8-dc3b-47e7-b45b-dc5b952c1271 req-32de207c-9ffb-4c88-a554-e7df9fa89be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcfd6276-a150-4389-aaf3-0ab17b032afd", "name": "network-vif-deleted", "tag": "6101254d-0cf8-40c1-bee4-6d6023b114da"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:41.031946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-cb2a79c8-dc3b-47e7-b45b-dc5b952c1271 req-32de207c-9ffb-4c88-a554-e7df9fa89be5 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:41.033624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-cb2a79c8-dc3b-47e7-b45b-dc5b952c1271 req-32de207c-9ffb-4c88-a554-e7df9fa89be5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:41.034297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-cb2a79c8-dc3b-47e7-b45b-dc5b952c1271 req-32de207c-9ffb-4c88-a554-e7df9fa89be5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:41.051963 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-cb2a79c8-dc3b-47e7-b45b-dc5b952c1271 req-32de207c-9ffb-4c88-a554-e7df9fa89be5 service nova] Creating event network-vif-deleted:6101254d-0cf8-40c1-bee4-6d6023b114da for instance dcfd6276-a150-4389-aaf3-0ab17b032afd on n-h1-862964-3 Oct 29 01:13:41.060791 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-cb2a79c8-dc3b-47e7-b45b-dc5b952c1271 req-32de207c-9ffb-4c88-a554-e7df9fa89be5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131059 Oct 29 01:13:41.062499 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1159/2388] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:41.069824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0b3cb519-fc1c-4b98-a173-cb4e2960b46d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fd85670>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:41.166530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:13:41.847446 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8cb3cd6d-5475-42c1-9623-2cb7a8b13a28 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb/action" status: 202 len: 0 microversion: 2.1 time: 6.665045 Oct 29 01:13:41.854299 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1230/2389] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:13:35 2022] POST /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb/action => generated 0 bytes in 6667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:13:41.854299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-6cf0056e-ab26-49fe-b0a4-bc557d60fe4f req-76fa6667-8545-4850-bf9e-e6f33fe72e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4", "name": "network-vif-deleted", "tag": "b01f8de2-8104-4190-b4b3-34aeca1dde7b"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:41.877287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6cf0056e-ab26-49fe-b0a4-bc557d60fe4f req-76fa6667-8545-4850-bf9e-e6f33fe72e7a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:41.884631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6cf0056e-ab26-49fe-b0a4-bc557d60fe4f req-76fa6667-8545-4850-bf9e-e6f33fe72e7a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:41.885472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6cf0056e-ab26-49fe-b0a4-bc557d60fe4f req-76fa6667-8545-4850-bf9e-e6f33fe72e7a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:41.908841 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-6cf0056e-ab26-49fe-b0a4-bc557d60fe4f req-76fa6667-8545-4850-bf9e-e6f33fe72e7a service nova] Creating event network-vif-deleted:b01f8de2-8104-4190-b4b3-34aeca1dde7b for instance 6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4 on n-h1-862964-3 Oct 29 01:13:41.918554 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-6cf0056e-ab26-49fe-b0a4-bc557d60fe4f req-76fa6667-8545-4850-bf9e-e6f33fe72e7a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067945 Oct 29 01:13:41.925460 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1231/2390] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:41.936763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd2fb373-959f-499e-9ccd-0eea1643c509 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:41.946685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bd2fb373-959f-499e-9ccd-0eea1643c509 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:41.963686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd2fb373-959f-499e-9ccd-0eea1643c509 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:41.965543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd2fb373-959f-499e-9ccd-0eea1643c509 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:41.993294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd2fb373-959f-499e-9ccd-0eea1643c509 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:41.998582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd2fb373-959f-499e-9ccd-0eea1643c509 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:42.000379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd2fb373-959f-499e-9ccd-0eea1643c509 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:42.002122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd2fb373-959f-499e-9ccd-0eea1643c509 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:42.013615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:13:42.091427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=14 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:13:42.728089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bd2fb373-959f-499e-9ccd-0eea1643c509 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:42.751665 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bd2fb373-959f-499e-9ccd-0eea1643c509 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 200 len: 1403 microversion: 2.1 time: 0.824318 Oct 29 01:13:42.754901 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1232/2391] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:41 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 1403 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:42.763191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bdc03148-0697-4802-b539-1c519d02a0f3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:42.765186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bdc03148-0697-4802-b539-1c519d02a0f3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: 6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:42.786608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdc03148-0697-4802-b539-1c519d02a0f3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:42.788139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdc03148-0697-4802-b539-1c519d02a0f3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:42.791815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdc03148-0697-4802-b539-1c519d02a0f3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:42.794158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdc03148-0697-4802-b539-1c519d02a0f3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:42.795790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdc03148-0697-4802-b539-1c519d02a0f3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:42.801372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdc03148-0697-4802-b539-1c519d02a0f3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:42.839972 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-bdc03148-0697-4802-b539-1c519d02a0f3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] HTTP exception thrown: Instance 6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4 could not be found. Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bdc03148-0697-4802-b539-1c519d02a0f3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Request method failure captured: Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4 HTTP/1.1 Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH38W6vqCIaTdiX_Mf0AsBFHYOycKxgrfn_quZzNxYU5glmKV0pJ5Mb6imPL_7tPoKyLG6oGkjAx24pAIDmJLVS2v3mYJBNXYbiScfZfLLHvclNrhga2_fsaiJbaJPuGxMdCtHnw0XVbjb7GAeFX884bWAbhQDH0y9pHeTWj3JK62eU Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: a09ce55a18af4f8db53d517089591340 Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a09ce55a18af4f8db53d517089591340"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a09ce55a18af4f8db53d517089591340"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a09ce55a18af4f8db53d517089591340"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a09ce55a18af4f8db53d517089591340", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: a09ce55a18af4f8db53d517089591340 Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ListServersNegativeTestJSON-894183019-project Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: d5fce522753549929a06d164a5b244d7 Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ListServersNegativeTestJSON-894183019-project Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4 could not be found. Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4'} Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4 could not be found. Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4 could not be found. Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:42.846208 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:42.851554 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:42.851554 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:42.851554 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:42.851554 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:42.851554 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:13:42.851554 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:13:42.851554 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4 could not be found. Oct 29 01:13:42.851554 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:42.859881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bdc03148-0697-4802-b539-1c519d02a0f3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Returning 404 to user: Instance 6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:13:42.862241 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bdc03148-0697-4802-b539-1c519d02a0f3 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4" status: 404 len: 111 microversion: 2.1 time: 0.106104 Oct 29 01:13:42.864405 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1233/2392] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:42 2022] GET /compute/v2.1/servers/6aa556aa-2df4-4557-b22a-ac7a8ff5c5a4 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:13:42.873979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e03c7a7-6778-4e40-bf95-c0999924566e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:42.875099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e03c7a7-6778-4e40-bf95-c0999924566e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:42.892828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e03c7a7-6778-4e40-bf95-c0999924566e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:42.896905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e03c7a7-6778-4e40-bf95-c0999924566e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:42.896905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e03c7a7-6778-4e40-bf95-c0999924566e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:42.896905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e03c7a7-6778-4e40-bf95-c0999924566e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:42.896905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e03c7a7-6778-4e40-bf95-c0999924566e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:42.896905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e03c7a7-6778-4e40-bf95-c0999924566e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:43.388030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8e03c7a7-6778-4e40-bf95-c0999924566e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:43.407454 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8e03c7a7-6778-4e40-bf95-c0999924566e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 0.538061 Oct 29 01:13:43.408063 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1234/2393] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:42 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:43.436295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a3d5d054-4604-4067-a5ec-02d4fa7dd82a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:43.437121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a3d5d054-4604-4067-a5ec-02d4fa7dd82a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:43.453402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3d5d054-4604-4067-a5ec-02d4fa7dd82a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:43.454166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3d5d054-4604-4067-a5ec-02d4fa7dd82a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:43.454644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3d5d054-4604-4067-a5ec-02d4fa7dd82a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:43.455375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3d5d054-4604-4067-a5ec-02d4fa7dd82a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:43.455839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3d5d054-4604-4067-a5ec-02d4fa7dd82a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:43.456272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3d5d054-4604-4067-a5ec-02d4fa7dd82a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:44.048556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a3d5d054-4604-4067-a5ec-02d4fa7dd82a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:44.067577 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a3d5d054-4604-4067-a5ec-02d4fa7dd82a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1315 microversion: 2.1 time: 0.637469 Oct 29 01:13:44.082142 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1235/2394] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:43 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1315 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:44.106982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-791114ba-9635-4775-bc9a-735543e403e9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:44.107966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-791114ba-9635-4775-bc9a-735543e403e9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] [instance: dcfd6276-a150-4389-aaf3-0ab17b032afd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:44.126067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-791114ba-9635-4775-bc9a-735543e403e9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:44.131635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-791114ba-9635-4775-bc9a-735543e403e9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:44.133499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-791114ba-9635-4775-bc9a-735543e403e9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:44.135525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-791114ba-9635-4775-bc9a-735543e403e9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:44.138236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-791114ba-9635-4775-bc9a-735543e403e9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:44.139198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-791114ba-9635-4775-bc9a-735543e403e9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:44.177670 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-791114ba-9635-4775-bc9a-735543e403e9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] HTTP exception thrown: Instance dcfd6276-a150-4389-aaf3-0ab17b032afd could not be found. Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-791114ba-9635-4775-bc9a-735543e403e9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Request method failure captured: Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd HTTP/1.1 Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH38W6vqCIaTdiX_Mf0AsBFHYOycKxgrfn_quZzNxYU5glmKV0pJ5Mb6imPL_7tPoKyLG6oGkjAx24pAIDmJLVS2v3mYJBNXYbiScfZfLLHvclNrhga2_fsaiJbaJPuGxMdCtHnw0XVbjb7GAeFX884bWAbhQDH0y9pHeTWj3JK62eU Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: a09ce55a18af4f8db53d517089591340 Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a09ce55a18af4f8db53d517089591340"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a09ce55a18af4f8db53d517089591340"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a09ce55a18af4f8db53d517089591340"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a09ce55a18af4f8db53d517089591340", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: a09ce55a18af4f8db53d517089591340 Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-894183019 Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ListServersNegativeTestJSON-894183019-project Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: d5fce522753549929a06d164a5b244d7 Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ListServersNegativeTestJSON-894183019-project Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance dcfd6276-a150-4389-aaf3-0ab17b032afd could not be found. Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'dcfd6276-a150-4389-aaf3-0ab17b032afd'} Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcfd6276-a150-4389-aaf3-0ab17b032afd could not be found. Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcfd6276-a150-4389-aaf3-0ab17b032afd could not be found. Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:44.184299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:13:44.188445 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:44.188445 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:13:44.188445 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:13:44.188445 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:13:44.188445 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:13:44.188445 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:13:44.188445 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcfd6276-a150-4389-aaf3-0ab17b032afd could not be found. Oct 29 01:13:44.188445 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:13:44.192407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-791114ba-9635-4775-bc9a-735543e403e9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] Returning 404 to user: Instance dcfd6276-a150-4389-aaf3-0ab17b032afd could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:13:44.193667 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-791114ba-9635-4775-bc9a-735543e403e9 tempest-ListServersNegativeTestJSON-894183019 tempest-ListServersNegativeTestJSON-894183019-project] 10.222.0.26 "GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd" status: 404 len: 111 microversion: 2.1 time: 0.110164 Oct 29 01:13:44.201337 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1236/2395] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:44 2022] GET /compute/v2.1/servers/dcfd6276-a150-4389-aaf3-0ab17b032afd => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:13:44.210700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-dbb13959-4816-4c07-adeb-a445b28d0594 req-476cc8ac-e3b2-4a9a-ab51-b2cdd19a1e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a40f1fe3-0af2-43d1-a530-0960ed7c8eb3", "tag": "82d33a0e-7fe8-4b63-8cfd-c90c7593d175"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:44.245132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-dbb13959-4816-4c07-adeb-a445b28d0594 req-476cc8ac-e3b2-4a9a-ab51-b2cdd19a1e90 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:44.245132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-dbb13959-4816-4c07-adeb-a445b28d0594 req-476cc8ac-e3b2-4a9a-ab51-b2cdd19a1e90 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:44.245132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-dbb13959-4816-4c07-adeb-a445b28d0594 req-476cc8ac-e3b2-4a9a-ab51-b2cdd19a1e90 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:44.276151 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-dbb13959-4816-4c07-adeb-a445b28d0594 req-476cc8ac-e3b2-4a9a-ab51-b2cdd19a1e90 service nova] Creating event network-changed:82d33a0e-7fe8-4b63-8cfd-c90c7593d175 for instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 on n-h2-862964-3 Oct 29 01:13:44.286060 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-dbb13959-4816-4c07-adeb-a445b28d0594 req-476cc8ac-e3b2-4a9a-ab51-b2cdd19a1e90 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087025 Oct 29 01:13:44.291039 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1237/2396] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:44.305056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b749a04f-b477-485c-9ebb-7a7ec7b47ca7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:44.306263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b749a04f-b477-485c-9ebb-7a7ec7b47ca7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:44.323883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b749a04f-b477-485c-9ebb-7a7ec7b47ca7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:44.326381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b749a04f-b477-485c-9ebb-7a7ec7b47ca7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:44.328700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b749a04f-b477-485c-9ebb-7a7ec7b47ca7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:44.330868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b749a04f-b477-485c-9ebb-7a7ec7b47ca7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:44.331571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b749a04f-b477-485c-9ebb-7a7ec7b47ca7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:44.337352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b749a04f-b477-485c-9ebb-7a7ec7b47ca7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:44.974512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b749a04f-b477-485c-9ebb-7a7ec7b47ca7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:44.989333 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b749a04f-b477-485c-9ebb-7a7ec7b47ca7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 200 len: 1590 microversion: 2.1 time: 0.696543 Oct 29 01:13:45.002390 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1238/2397] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:44 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 1590 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:45.025879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-10190697-46e8-4498-afce-f250e50a7ecf tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:45.029765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-10190697-46e8-4498-afce-f250e50a7ecf tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:45.051906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=14 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:13:45.071401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10190697-46e8-4498-afce-f250e50a7ecf tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:45.076789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10190697-46e8-4498-afce-f250e50a7ecf tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:45.078486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10190697-46e8-4498-afce-f250e50a7ecf tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:45.083138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10190697-46e8-4498-afce-f250e50a7ecf tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:45.085237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10190697-46e8-4498-afce-f250e50a7ecf tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:45.088672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10190697-46e8-4498-afce-f250e50a7ecf tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:46.127944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-10190697-46e8-4498-afce-f250e50a7ecf tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:46.141011 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-10190697-46e8-4498-afce-f250e50a7ecf tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 1.135430 Oct 29 01:13:46.142638 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1239/2398] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:45 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:46.154691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f64256e0-2dc8-425e-9f5c-3b19d68a107a tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:46.161960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f64256e0-2dc8-425e-9f5c-3b19d68a107a tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:46.179262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f64256e0-2dc8-425e-9f5c-3b19d68a107a tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:46.179968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f64256e0-2dc8-425e-9f5c-3b19d68a107a tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:46.180565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f64256e0-2dc8-425e-9f5c-3b19d68a107a tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:46.181502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f64256e0-2dc8-425e-9f5c-3b19d68a107a tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:46.182111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f64256e0-2dc8-425e-9f5c-3b19d68a107a tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:46.182714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f64256e0-2dc8-425e-9f5c-3b19d68a107a tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:46.796541 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f64256e0-2dc8-425e-9f5c-3b19d68a107a tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.647662 Oct 29 01:13:46.805014 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1240/2399] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:13:46 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b/os-interface => generated 284 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:46.811412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e6e06291-39c3-42a2-bda4-57879844ebd6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:46.812262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e6e06291-39c3-42a2-bda4-57879844ebd6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:46.835774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6e06291-39c3-42a2-bda4-57879844ebd6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:46.837469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6e06291-39c3-42a2-bda4-57879844ebd6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:46.838114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6e06291-39c3-42a2-bda4-57879844ebd6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:46.839052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6e06291-39c3-42a2-bda4-57879844ebd6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:46.839923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6e06291-39c3-42a2-bda4-57879844ebd6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:46.840685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6e06291-39c3-42a2-bda4-57879844ebd6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:47.609360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e6e06291-39c3-42a2-bda4-57879844ebd6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:47.644467 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e6e06291-39c3-42a2-bda4-57879844ebd6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1315 microversion: 2.1 time: 0.837936 Oct 29 01:13:47.657236 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1241/2400] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:46 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1315 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:47.676589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7a59c184-cd3e-4c05-abea-21b40caee573 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:47.678379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7a59c184-cd3e-4c05-abea-21b40caee573 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:47.685456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a59c184-cd3e-4c05-abea-21b40caee573 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:47.686191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a59c184-cd3e-4c05-abea-21b40caee573 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:47.687225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a59c184-cd3e-4c05-abea-21b40caee573 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:47.687708 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0b3cb519-fc1c-4b98-a173-cb4e2960b46d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 6.623333 Oct 29 01:13:47.688881 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1160/2401] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:41 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 6626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:47.698970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a59c184-cd3e-4c05-abea-21b40caee573 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:47.700101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a59c184-cd3e-4c05-abea-21b40caee573 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:47.700781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a59c184-cd3e-4c05-abea-21b40caee573 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:48.211218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ecb7380e-afc5-4427-8590-db8e71fa2d0f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-318415955", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "1ca9e574-496a-4a8a-8b4d-3f828f1809d3"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:48.383073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-ecb7380e-afc5-4427-8590-db8e71fa2d0f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] validate_networks() for [('1ca9e574-496a-4a8a-8b4d-3f828f1809d3', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:13:48.912360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7a59c184-cd3e-4c05-abea-21b40caee573 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:48.924886 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7a59c184-cd3e-4c05-abea-21b40caee573 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 1.263406 Oct 29 01:13:48.927335 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1242/2402] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:47 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:48.951383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c9844244-2474-4f0c-b2cf-e58a32552ae6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:48.954508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c9844244-2474-4f0c-b2cf-e58a32552ae6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:48.978860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9844244-2474-4f0c-b2cf-e58a32552ae6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:48.983839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9844244-2474-4f0c-b2cf-e58a32552ae6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:48.987892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9844244-2474-4f0c-b2cf-e58a32552ae6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:48.987892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9844244-2474-4f0c-b2cf-e58a32552ae6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:48.987892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9844244-2474-4f0c-b2cf-e58a32552ae6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:48.988648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9844244-2474-4f0c-b2cf-e58a32552ae6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:51.051251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:13:51.075873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c9844244-2474-4f0c-b2cf-e58a32552ae6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:51.099958 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c9844244-2474-4f0c-b2cf-e58a32552ae6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1315 microversion: 2.1 time: 2.171171 Oct 29 01:13:51.108886 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1243/2403] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:48 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1315 bytes in 2181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:51.122116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-248b4c8f-6b88-4da3-863b-defbc5bd2123 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9704f670>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:51.247675 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-248b4c8f-6b88-4da3-863b-defbc5bd2123 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.137343 Oct 29 01:13:51.251562 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1244/2404] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:51 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:51.260746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f6280b96-2129-4476-acb0-56f3fd46b381 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:51.261815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f6280b96-2129-4476-acb0-56f3fd46b381 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:51.274629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6280b96-2129-4476-acb0-56f3fd46b381 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:51.279247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6280b96-2129-4476-acb0-56f3fd46b381 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:51.279708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6280b96-2129-4476-acb0-56f3fd46b381 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:51.281029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6280b96-2129-4476-acb0-56f3fd46b381 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:51.281526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6280b96-2129-4476-acb0-56f3fd46b381 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:51.281962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6280b96-2129-4476-acb0-56f3fd46b381 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:52.589349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f6280b96-2129-4476-acb0-56f3fd46b381 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:52.604464 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f6280b96-2129-4476-acb0-56f3fd46b381 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 1.351154 Oct 29 01:13:52.605349 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1245/2405] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:51 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:52.613810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-ead7a072-60ca-4660-94a7-5b584bd4a079 req-302faf5f-ed8e-4fc9-b41f-98749b18620b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40f1fe3-0af2-43d1-a530-0960ed7c8eb3", "name": "network-vif-plugged", "status": "completed", "tag": "82d33a0e-7fe8-4b63-8cfd-c90c7593d175"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:52.637754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ead7a072-60ca-4660-94a7-5b584bd4a079 req-302faf5f-ed8e-4fc9-b41f-98749b18620b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:52.640975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ead7a072-60ca-4660-94a7-5b584bd4a079 req-302faf5f-ed8e-4fc9-b41f-98749b18620b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:52.642747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ead7a072-60ca-4660-94a7-5b584bd4a079 req-302faf5f-ed8e-4fc9-b41f-98749b18620b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:52.678893 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-ead7a072-60ca-4660-94a7-5b584bd4a079 req-302faf5f-ed8e-4fc9-b41f-98749b18620b service nova] Creating event network-vif-plugged:82d33a0e-7fe8-4b63-8cfd-c90c7593d175 for instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 on n-h2-862964-3 Oct 29 01:13:52.694688 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-ead7a072-60ca-4660-94a7-5b584bd4a079 req-302faf5f-ed8e-4fc9-b41f-98749b18620b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087917 Oct 29 01:13:52.700933 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1246/2406] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:52.716771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5cbe81fa-d6bf-4990-95f6-6f5023f07df1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:52.718250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5cbe81fa-d6bf-4990-95f6-6f5023f07df1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:52.750516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cbe81fa-d6bf-4990-95f6-6f5023f07df1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:52.750985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cbe81fa-d6bf-4990-95f6-6f5023f07df1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:52.751434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cbe81fa-d6bf-4990-95f6-6f5023f07df1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:52.761677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cbe81fa-d6bf-4990-95f6-6f5023f07df1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:52.763557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cbe81fa-d6bf-4990-95f6-6f5023f07df1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:52.764714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cbe81fa-d6bf-4990-95f6-6f5023f07df1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:52.825720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:13:53.474162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ecb7380e-afc5-4427-8590-db8e71fa2d0f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:13:53.475475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ecb7380e-afc5-4427-8590-db8e71fa2d0f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:13:53.476166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ecb7380e-afc5-4427-8590-db8e71fa2d0f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:13:53.476830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ecb7380e-afc5-4427-8590-db8e71fa2d0f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:13:53.477511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ecb7380e-afc5-4427-8590-db8e71fa2d0f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:13:53.506481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ecb7380e-afc5-4427-8590-db8e71fa2d0f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:53.517810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ecb7380e-afc5-4427-8590-db8e71fa2d0f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:53.519225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ecb7380e-afc5-4427-8590-db8e71fa2d0f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:53.524139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ecb7380e-afc5-4427-8590-db8e71fa2d0f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:53.524714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ecb7380e-afc5-4427-8590-db8e71fa2d0f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:53.537821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ecb7380e-afc5-4427-8590-db8e71fa2d0f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:53.592778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-ecb7380e-afc5-4427-8590-db8e71fa2d0f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Getting quotas for project 9d0066a293d6440fb9f5c55b3d636d51. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:13:53.600205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-ecb7380e-afc5-4427-8590-db8e71fa2d0f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Getting quotas for user 187158ff3fc04e5789d8865fee46f01f and project 9d0066a293d6440fb9f5c55b3d636d51. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:13:53.618900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ecb7380e-afc5-4427-8590-db8e71fa2d0f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Going to run 2 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:13:53.621608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ecb7380e-afc5-4427-8590-db8e71fa2d0f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 6068e5d6-cd2f-48c1-a7aa-6c28ee2684ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:13:53.820921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ecb7380e-afc5-4427-8590-db8e71fa2d0f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=6068e5d6-cd2f-48c1-a7aa-6c28ee2684ff,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:13:53.963644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5cbe81fa-d6bf-4990-95f6-6f5023f07df1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:53.994425 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5cbe81fa-d6bf-4990-95f6-6f5023f07df1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1315 microversion: 2.1 time: 1.291459 Oct 29 01:13:54.001818 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1247/2407] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:52 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1315 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:54.006716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0359e316-d47d-4c29-b204-f4aae2967874 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d97073430>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:54.039283 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ecb7380e-afc5-4427-8590-db8e71fa2d0f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.915254 Oct 29 01:13:54.047248 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1161/2408] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:13:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 5924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:13:54.058246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0fd7a192-280c-4e29-8918-6d44fa4dd5fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:54.059090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0fd7a192-280c-4e29-8918-6d44fa4dd5fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:54.077904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fd7a192-280c-4e29-8918-6d44fa4dd5fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:54.078687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fd7a192-280c-4e29-8918-6d44fa4dd5fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:54.080194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fd7a192-280c-4e29-8918-6d44fa4dd5fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:54.081137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fd7a192-280c-4e29-8918-6d44fa4dd5fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:54.082024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fd7a192-280c-4e29-8918-6d44fa4dd5fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:54.086852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fd7a192-280c-4e29-8918-6d44fa4dd5fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:54.135486 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0359e316-d47d-4c29-b204-f4aae2967874 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.127425 Oct 29 01:13:54.138577 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1248/2409] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:54 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:54.156209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a648bc6d-9094-4577-86b6-bdbe7dc474f6 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:54.162211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a648bc6d-9094-4577-86b6-bdbe7dc474f6 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:54.174003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a648bc6d-9094-4577-86b6-bdbe7dc474f6 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:54.174490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a648bc6d-9094-4577-86b6-bdbe7dc474f6 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:54.174994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a648bc6d-9094-4577-86b6-bdbe7dc474f6 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:54.175725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a648bc6d-9094-4577-86b6-bdbe7dc474f6 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:54.176185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a648bc6d-9094-4577-86b6-bdbe7dc474f6 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:54.176625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a648bc6d-9094-4577-86b6-bdbe7dc474f6 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:54.604664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0fd7a192-280c-4e29-8918-6d44fa4dd5fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:54.614588 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0fd7a192-280c-4e29-8918-6d44fa4dd5fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 0.566006 Oct 29 01:13:54.622839 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1162/2410] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:54 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:54.631537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-837d7845-f9ca-46e7-ac11-633cc5a388de req-0e7913e6-ee36-40a8-91e6-0ed40cb5d315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e8218af-8624-4be9-8ae8-3c335c4af98b", "tag": "0a9971a0-79e6-4307-9847-31fa1d9d3699"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:54.676274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-837d7845-f9ca-46e7-ac11-633cc5a388de req-0e7913e6-ee36-40a8-91e6-0ed40cb5d315 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:54.679842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-837d7845-f9ca-46e7-ac11-633cc5a388de req-0e7913e6-ee36-40a8-91e6-0ed40cb5d315 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:54.682511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-837d7845-f9ca-46e7-ac11-633cc5a388de req-0e7913e6-ee36-40a8-91e6-0ed40cb5d315 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:54.702945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a648bc6d-9094-4577-86b6-bdbe7dc474f6 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:54.713438 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a648bc6d-9094-4577-86b6-bdbe7dc474f6 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 200 len: 1590 microversion: 2.1 time: 0.573722 Oct 29 01:13:54.719839 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1249/2411] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:54 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 1590 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:54.730598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-66920de3-9214-4f3c-85ac-dab2d4382aeb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:54.742203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-66920de3-9214-4f3c-85ac-dab2d4382aeb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:54.744982 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-837d7845-f9ca-46e7-ac11-633cc5a388de req-0e7913e6-ee36-40a8-91e6-0ed40cb5d315 service nova] Creating event network-changed:0a9971a0-79e6-4307-9847-31fa1d9d3699 for instance 0e8218af-8624-4be9-8ae8-3c335c4af98b on n-h2-862964-3 Oct 29 01:13:54.755563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-66920de3-9214-4f3c-85ac-dab2d4382aeb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Searching by: {'deleted': False, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:13:54.761268 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-837d7845-f9ca-46e7-ac11-633cc5a388de req-0e7913e6-ee36-40a8-91e6-0ed40cb5d315 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134923 Oct 29 01:13:54.762199 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1163/2412] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:54.803252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66920de3-9214-4f3c-85ac-dab2d4382aeb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:54.807954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66920de3-9214-4f3c-85ac-dab2d4382aeb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:54.808660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66920de3-9214-4f3c-85ac-dab2d4382aeb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:54.809750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66920de3-9214-4f3c-85ac-dab2d4382aeb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:54.810402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66920de3-9214-4f3c-85ac-dab2d4382aeb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:54.816006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66920de3-9214-4f3c-85ac-dab2d4382aeb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:54.872516 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-66920de3-9214-4f3c-85ac-dab2d4382aeb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.145827 Oct 29 01:13:54.873751 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1250/2413] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 29 01:13:54 2022] GET /compute/v2.1/servers => generated 675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:13:54.886620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7cfbe883-b940-43f6-8121-1667ba9cd27f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:54.887752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7cfbe883-b940-43f6-8121-1667ba9cd27f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:55.020750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-86902473-742f-4f2e-b8e7-5077a0fcd38e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:55.022165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-86902473-742f-4f2e-b8e7-5077a0fcd38e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:55.035759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86902473-742f-4f2e-b8e7-5077a0fcd38e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:55.040326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86902473-742f-4f2e-b8e7-5077a0fcd38e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:55.042208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86902473-742f-4f2e-b8e7-5077a0fcd38e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:55.046547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86902473-742f-4f2e-b8e7-5077a0fcd38e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:55.050517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86902473-742f-4f2e-b8e7-5077a0fcd38e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:55.051336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86902473-742f-4f2e-b8e7-5077a0fcd38e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:55.097538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7cfbe883-b940-43f6-8121-1667ba9cd27f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:55.109105 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7cfbe883-b940-43f6-8121-1667ba9cd27f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1219 microversion: 2.1 time: 0.223658 Oct 29 01:13:55.113040 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1164/2414] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:54 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1219 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:55.152599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a28c59c0-e08a-451d-9db1-17bd4ecc36bc tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fd67940>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:55.236314 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a28c59c0-e08a-451d-9db1-17bd4ecc36bc tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.088101 Oct 29 01:13:55.237444 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1165/2415] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:55 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:55.489440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-86902473-742f-4f2e-b8e7-5077a0fcd38e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:55.499457 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-86902473-742f-4f2e-b8e7-5077a0fcd38e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1501 microversion: 2.1 time: 0.482052 Oct 29 01:13:55.515985 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1251/2416] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:55 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1501 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:55.532384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cb0bf3fa-1cc1-401f-a832-6e79819664b3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:13:55.565664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb0bf3fa-1cc1-401f-a832-6e79819664b3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:55.568319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb0bf3fa-1cc1-401f-a832-6e79819664b3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:55.568319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb0bf3fa-1cc1-401f-a832-6e79819664b3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:55.650011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ff0d5394-373a-4272-869b-9dc7910f5450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:55.650974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ff0d5394-373a-4272-869b-9dc7910f5450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:55.663142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff0d5394-373a-4272-869b-9dc7910f5450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:55.663993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff0d5394-373a-4272-869b-9dc7910f5450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:55.668253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff0d5394-373a-4272-869b-9dc7910f5450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:55.669379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff0d5394-373a-4272-869b-9dc7910f5450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:55.670036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff0d5394-373a-4272-869b-9dc7910f5450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:55.671177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff0d5394-373a-4272-869b-9dc7910f5450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:55.694360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cb0bf3fa-1cc1-401f-a832-6e79819664b3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Going to try to stop instance {{(pid=121100) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 01:13:55.976520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ff0d5394-373a-4272-869b-9dc7910f5450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:55.993529 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ff0d5394-373a-4272-869b-9dc7910f5450 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 0.345744 Oct 29 01:13:55.996199 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1252/2417] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:55 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:13:56.136790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e733d5f4-fd98-4fd7-85e0-3457786fea66 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:56.137548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e733d5f4-fd98-4fd7-85e0-3457786fea66 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:56.399626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e733d5f4-fd98-4fd7-85e0-3457786fea66 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:56.419351 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e733d5f4-fd98-4fd7-85e0-3457786fea66 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1219 microversion: 2.1 time: 0.286668 Oct 29 01:13:56.437187 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1253/2418] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:56 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1219 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:56.448281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e610c6b9-25e3-424a-93b9-4d4ec194532c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9770c820>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:56.564010 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e610c6b9-25e3-424a-93b9-4d4ec194532c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.135128 Oct 29 01:13:56.565095 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1254/2419] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:56 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:56.778647 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cb0bf3fa-1cc1-401f-a832-6e79819664b3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "POST /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3/action" status: 202 len: 0 microversion: 2.1 time: 1.255646 Oct 29 01:13:56.780772 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1166/2420] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:13:55 2022] POST /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3/action => generated 0 bytes in 1259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:13:56.794388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1af2b0e9-7676-4ac5-a865-4bce74853f52 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:56.795519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1af2b0e9-7676-4ac5-a865-4bce74853f52 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:56.814647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1af2b0e9-7676-4ac5-a865-4bce74853f52 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:56.819594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1af2b0e9-7676-4ac5-a865-4bce74853f52 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:56.820351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1af2b0e9-7676-4ac5-a865-4bce74853f52 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:56.822482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1af2b0e9-7676-4ac5-a865-4bce74853f52 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:56.824101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1af2b0e9-7676-4ac5-a865-4bce74853f52 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:56.827430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1af2b0e9-7676-4ac5-a865-4bce74853f52 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:57.025937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-96ded882-fe49-4860-8768-b61d55ca9d50 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:57.028031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-96ded882-fe49-4860-8768-b61d55ca9d50 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:57.053689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96ded882-fe49-4860-8768-b61d55ca9d50 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:57.054189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96ded882-fe49-4860-8768-b61d55ca9d50 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:57.054962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96ded882-fe49-4860-8768-b61d55ca9d50 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:57.055869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96ded882-fe49-4860-8768-b61d55ca9d50 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:57.056485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96ded882-fe49-4860-8768-b61d55ca9d50 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:57.057836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96ded882-fe49-4860-8768-b61d55ca9d50 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:57.389897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1af2b0e9-7676-4ac5-a865-4bce74853f52 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:57.399520 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1af2b0e9-7676-4ac5-a865-4bce74853f52 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1511 microversion: 2.1 time: 0.614149 Oct 29 01:13:57.415946 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1255/2421] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:56 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1511 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:57.455903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b77731b0-3bba-4912-bc8e-eff048452ad6 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:57.456595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b77731b0-3bba-4912-bc8e-eff048452ad6 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:57.526540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-96ded882-fe49-4860-8768-b61d55ca9d50 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:57.541646 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-96ded882-fe49-4860-8768-b61d55ca9d50 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 0.524614 Oct 29 01:13:57.544300 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1167/2422] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:57 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:57.585280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aa88ac5f-9dfb-4979-9f2d-9b38eb328073 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fd679d0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:57.658377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b77731b0-3bba-4912-bc8e-eff048452ad6 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:57.674350 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b77731b0-3bba-4912-bc8e-eff048452ad6 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1219 microversion: 2.1 time: 0.224213 Oct 29 01:13:57.677918 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1256/2423] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:57 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1219 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:57.686912 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aa88ac5f-9dfb-4979-9f2d-9b38eb328073 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.108691 Oct 29 01:13:57.695328 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1168/2424] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:57 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:58.425842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-acd2c30e-bf3c-4c51-af75-2bc5070eddf9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:58.427787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-acd2c30e-bf3c-4c51-af75-2bc5070eddf9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:58.447117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-acd2c30e-bf3c-4c51-af75-2bc5070eddf9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:58.449091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-acd2c30e-bf3c-4c51-af75-2bc5070eddf9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:58.453579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-acd2c30e-bf3c-4c51-af75-2bc5070eddf9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:58.454581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-acd2c30e-bf3c-4c51-af75-2bc5070eddf9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:58.455326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-acd2c30e-bf3c-4c51-af75-2bc5070eddf9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:58.456005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-acd2c30e-bf3c-4c51-af75-2bc5070eddf9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:58.570383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-69d88dcb-df77-4505-8e4c-3658ee8dbe45 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:58.571616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-69d88dcb-df77-4505-8e4c-3658ee8dbe45 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:58.598356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69d88dcb-df77-4505-8e4c-3658ee8dbe45 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:58.600335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69d88dcb-df77-4505-8e4c-3658ee8dbe45 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:58.601003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69d88dcb-df77-4505-8e4c-3658ee8dbe45 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:58.602805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69d88dcb-df77-4505-8e4c-3658ee8dbe45 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:58.606471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69d88dcb-df77-4505-8e4c-3658ee8dbe45 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:58.607637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69d88dcb-df77-4505-8e4c-3658ee8dbe45 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:58.893780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-acd2c30e-bf3c-4c51-af75-2bc5070eddf9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:58.902125 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-acd2c30e-bf3c-4c51-af75-2bc5070eddf9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1511 microversion: 2.1 time: 0.482630 Oct 29 01:13:58.903834 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1257/2425] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:58 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1511 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:58.909077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4fcd03ee-0fae-4504-8dcf-b49b2ddc7719 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:58.909893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4fcd03ee-0fae-4504-8dcf-b49b2ddc7719 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:59.013046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4fcd03ee-0fae-4504-8dcf-b49b2ddc7719 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:59.013046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4fcd03ee-0fae-4504-8dcf-b49b2ddc7719 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:59.013046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4fcd03ee-0fae-4504-8dcf-b49b2ddc7719 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:59.013046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4fcd03ee-0fae-4504-8dcf-b49b2ddc7719 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:59.013046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4fcd03ee-0fae-4504-8dcf-b49b2ddc7719 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:59.013046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4fcd03ee-0fae-4504-8dcf-b49b2ddc7719 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:59.015042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-69d88dcb-df77-4505-8e4c-3658ee8dbe45 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:59.015042 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-69d88dcb-df77-4505-8e4c-3658ee8dbe45 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 0.374135 Oct 29 01:13:59.015042 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1169/2426] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:58 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:59.015042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d74d6635-be07-4e3f-875b-d3d888b3825d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fe5bc10>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:59.016077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4fcd03ee-0fae-4504-8dcf-b49b2ddc7719 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:13:59.016182 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d74d6635-be07-4e3f-875b-d3d888b3825d tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.054687 Oct 29 01:13:59.016182 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1170/2427] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:13:58 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:59.016333 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4fcd03ee-0fae-4504-8dcf-b49b2ddc7719 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1215 microversion: 2.1 time: 0.093161 Oct 29 01:13:59.016333 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1258/2428] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:58 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:13:59.932724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6b261efb-e5cb-4423-a24e-5a1e4af7d1b8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:13:59.939756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6b261efb-e5cb-4423-a24e-5a1e4af7d1b8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:13:59.950624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b261efb-e5cb-4423-a24e-5a1e4af7d1b8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:59.953281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b261efb-e5cb-4423-a24e-5a1e4af7d1b8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:59.954366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b261efb-e5cb-4423-a24e-5a1e4af7d1b8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:13:59.955992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b261efb-e5cb-4423-a24e-5a1e4af7d1b8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:13:59.957107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b261efb-e5cb-4423-a24e-5a1e4af7d1b8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:13:59.958308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b261efb-e5cb-4423-a24e-5a1e4af7d1b8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:00.043029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3e91dd31-7605-4e73-bb50-aaa6c3b8ce7f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9797b0d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:00.130718 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3e91dd31-7605-4e73-bb50-aaa6c3b8ce7f tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.116892 Oct 29 01:14:00.131874 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1259/2429] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:14:00 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:00.136971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-381b4883-c329-4b87-ad4c-d5dffa0ec098 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:00.137966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-381b4883-c329-4b87-ad4c-d5dffa0ec098 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:00.147550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-381b4883-c329-4b87-ad4c-d5dffa0ec098 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:00.148408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-381b4883-c329-4b87-ad4c-d5dffa0ec098 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:00.149025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-381b4883-c329-4b87-ad4c-d5dffa0ec098 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:00.149962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-381b4883-c329-4b87-ad4c-d5dffa0ec098 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:00.150571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-381b4883-c329-4b87-ad4c-d5dffa0ec098 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:00.151381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-381b4883-c329-4b87-ad4c-d5dffa0ec098 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:00.152299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6b261efb-e5cb-4423-a24e-5a1e4af7d1b8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:00.168171 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6b261efb-e5cb-4423-a24e-5a1e4af7d1b8 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1511 microversion: 2.1 time: 0.234227 Oct 29 01:14:00.168171 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1171/2430] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:13:59 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1511 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:00.169664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5cccf2f1-c834-49a4-b255-6fbb11e6f47d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:00.171018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5cccf2f1-c834-49a4-b255-6fbb11e6f47d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:00.186890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cccf2f1-c834-49a4-b255-6fbb11e6f47d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:00.187378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cccf2f1-c834-49a4-b255-6fbb11e6f47d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:00.187881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cccf2f1-c834-49a4-b255-6fbb11e6f47d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:00.189546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cccf2f1-c834-49a4-b255-6fbb11e6f47d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:00.190261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cccf2f1-c834-49a4-b255-6fbb11e6f47d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:00.190848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cccf2f1-c834-49a4-b255-6fbb11e6f47d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:00.472031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5cccf2f1-c834-49a4-b255-6fbb11e6f47d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:00.486087 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5cccf2f1-c834-49a4-b255-6fbb11e6f47d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1271 microversion: 2.1 time: 0.320484 Oct 29 01:14:00.495501 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1172/2431] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:00 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1271 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:00.967465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-381b4883-c329-4b87-ad4c-d5dffa0ec098 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:00.988559 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-381b4883-c329-4b87-ad4c-d5dffa0ec098 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 0.846299 Oct 29 01:14:00.989997 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1260/2432] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:00 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:01.148202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d28a716c-453c-4343-8846-9be06b1c633a tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fed4550>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:01.191025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7c5d72a1-5b31-4ebb-9743-aa094367c90f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:01.192393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7c5d72a1-5b31-4ebb-9743-aa094367c90f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:01.206718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c5d72a1-5b31-4ebb-9743-aa094367c90f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:01.207944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c5d72a1-5b31-4ebb-9743-aa094367c90f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:01.210122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c5d72a1-5b31-4ebb-9743-aa094367c90f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:01.221642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c5d72a1-5b31-4ebb-9743-aa094367c90f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:01.223747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c5d72a1-5b31-4ebb-9743-aa094367c90f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:01.224319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c5d72a1-5b31-4ebb-9743-aa094367c90f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:01.278046 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d28a716c-453c-4343-8846-9be06b1c633a tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.133985 Oct 29 01:14:01.278641 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1173/2433] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:14:01 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:01.477658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7c5d72a1-5b31-4ebb-9743-aa094367c90f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:01.489848 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7c5d72a1-5b31-4ebb-9743-aa094367c90f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1511 microversion: 2.1 time: 0.298543 Oct 29 01:14:01.491184 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1261/2434] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:01 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1511 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:01.527093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aa7137bc-52c0-48f1-8a43-161d86c37189 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:01.530267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aa7137bc-52c0-48f1-8a43-161d86c37189 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:01.554253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa7137bc-52c0-48f1-8a43-161d86c37189 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:01.559124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa7137bc-52c0-48f1-8a43-161d86c37189 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:01.560049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa7137bc-52c0-48f1-8a43-161d86c37189 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:01.563415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa7137bc-52c0-48f1-8a43-161d86c37189 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:01.564986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa7137bc-52c0-48f1-8a43-161d86c37189 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:01.571912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa7137bc-52c0-48f1-8a43-161d86c37189 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:01.700945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aa7137bc-52c0-48f1-8a43-161d86c37189 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:01.721758 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aa7137bc-52c0-48f1-8a43-161d86c37189 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1277 microversion: 2.1 time: 0.199507 Oct 29 01:14:01.723566 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1174/2435] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:01 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:02.017292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-db462484-96c3-4eda-a28a-ac83aa98ddf3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:02.017906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-db462484-96c3-4eda-a28a-ac83aa98ddf3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:02.029218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db462484-96c3-4eda-a28a-ac83aa98ddf3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:02.032626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db462484-96c3-4eda-a28a-ac83aa98ddf3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:02.033109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db462484-96c3-4eda-a28a-ac83aa98ddf3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:02.040611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db462484-96c3-4eda-a28a-ac83aa98ddf3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:02.041118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db462484-96c3-4eda-a28a-ac83aa98ddf3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:02.041663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db462484-96c3-4eda-a28a-ac83aa98ddf3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:02.305255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ca57aa0f-5b75-46d1-9cb0-53dc18c4a0f4 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fed4550>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:02.402532 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ca57aa0f-5b75-46d1-9cb0-53dc18c4a0f4 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.109030 Oct 29 01:14:02.404427 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1175/2436] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:14:02 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:02.435650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-db462484-96c3-4eda-a28a-ac83aa98ddf3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:02.456842 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-db462484-96c3-4eda-a28a-ac83aa98ddf3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 0.443893 Oct 29 01:14:02.480252 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1262/2437] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:02 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:02.522065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-13845b78-6df4-4b15-b5c8-9c56639c680d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:02.522910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-13845b78-6df4-4b15-b5c8-9c56639c680d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:02.543353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13845b78-6df4-4b15-b5c8-9c56639c680d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:02.553194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13845b78-6df4-4b15-b5c8-9c56639c680d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:02.553194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13845b78-6df4-4b15-b5c8-9c56639c680d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:02.553194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13845b78-6df4-4b15-b5c8-9c56639c680d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:02.553194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13845b78-6df4-4b15-b5c8-9c56639c680d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:02.553194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13845b78-6df4-4b15-b5c8-9c56639c680d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:02.718277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-13845b78-6df4-4b15-b5c8-9c56639c680d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:02.726886 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-13845b78-6df4-4b15-b5c8-9c56639c680d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1511 microversion: 2.1 time: 0.215950 Oct 29 01:14:02.743425 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1176/2438] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:02 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1511 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:02.751157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cc9ba9c8-872f-4bc1-91d2-005238d2357b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:02.751884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cc9ba9c8-872f-4bc1-91d2-005238d2357b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:02.758994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc9ba9c8-872f-4bc1-91d2-005238d2357b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:02.760046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc9ba9c8-872f-4bc1-91d2-005238d2357b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:02.760259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc9ba9c8-872f-4bc1-91d2-005238d2357b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:02.761208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc9ba9c8-872f-4bc1-91d2-005238d2357b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:02.761857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc9ba9c8-872f-4bc1-91d2-005238d2357b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:02.762478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc9ba9c8-872f-4bc1-91d2-005238d2357b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:02.840967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cc9ba9c8-872f-4bc1-91d2-005238d2357b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:02.853037 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cc9ba9c8-872f-4bc1-91d2-005238d2357b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1277 microversion: 2.1 time: 0.106993 Oct 29 01:14:02.854238 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1263/2439] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:02 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:03.423480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3ee3df25-ba8c-44b1-ac27-058a6d60d557 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fed4ca0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:03.487402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b8f4392b-0ca6-4951-bfb7-a4f8823a7b9d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:03.490165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b8f4392b-0ca6-4951-bfb7-a4f8823a7b9d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:03.510472 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3ee3df25-ba8c-44b1-ac27-058a6d60d557 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.093515 Oct 29 01:14:03.511120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8f4392b-0ca6-4951-bfb7-a4f8823a7b9d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:03.512967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8f4392b-0ca6-4951-bfb7-a4f8823a7b9d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:03.534868 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1177/2440] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:14:03 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:03.535827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8f4392b-0ca6-4951-bfb7-a4f8823a7b9d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:03.536748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8f4392b-0ca6-4951-bfb7-a4f8823a7b9d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:03.537948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8f4392b-0ca6-4951-bfb7-a4f8823a7b9d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:03.538543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8f4392b-0ca6-4951-bfb7-a4f8823a7b9d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:03.751204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-10e4603a-10f1-4d4f-a293-7851c7a9bf73 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:03.751831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-10e4603a-10f1-4d4f-a293-7851c7a9bf73 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:03.767546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:03.776800 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10e4603a-10f1-4d4f-a293-7851c7a9bf73 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:03.777352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10e4603a-10f1-4d4f-a293-7851c7a9bf73 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:03.777809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10e4603a-10f1-4d4f-a293-7851c7a9bf73 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:03.778564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10e4603a-10f1-4d4f-a293-7851c7a9bf73 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:03.789673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10e4603a-10f1-4d4f-a293-7851c7a9bf73 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:03.790295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10e4603a-10f1-4d4f-a293-7851c7a9bf73 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:03.872129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b8f4392b-0ca6-4951-bfb7-a4f8823a7b9d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:03.884302 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b8f4392b-0ca6-4951-bfb7-a4f8823a7b9d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 0.402133 Oct 29 01:14:03.887828 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1264/2441] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:03 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:03.894206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d6c8caaf-5afc-4507-8b3a-39887f30da68 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:03.895118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d6c8caaf-5afc-4507-8b3a-39887f30da68 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:03.902983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6c8caaf-5afc-4507-8b3a-39887f30da68 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:03.904085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6c8caaf-5afc-4507-8b3a-39887f30da68 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:03.905379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6c8caaf-5afc-4507-8b3a-39887f30da68 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:03.906743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6c8caaf-5afc-4507-8b3a-39887f30da68 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:03.907420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6c8caaf-5afc-4507-8b3a-39887f30da68 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:03.907998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6c8caaf-5afc-4507-8b3a-39887f30da68 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:04.343815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-10e4603a-10f1-4d4f-a293-7851c7a9bf73 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:04.384148 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-10e4603a-10f1-4d4f-a293-7851c7a9bf73 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1511 microversion: 2.1 time: 0.637492 Oct 29 01:14:04.386114 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1178/2442] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:03 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1511 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:04.389912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-6ded28c2-8420-401f-be43-f82653dba8f8 req-cd79658c-ebad-462a-96e5-60376aeacedb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ebe561-9b25-419d-b771-d5f2d212cfbb", "name": "network-vif-unplugged", "status": "completed", "tag": "c9bfa9ce-2881-44eb-bf9e-16eb902a3d6a"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:04.494452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6ded28c2-8420-401f-be43-f82653dba8f8 req-cd79658c-ebad-462a-96e5-60376aeacedb service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:04.494452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6ded28c2-8420-401f-be43-f82653dba8f8 req-cd79658c-ebad-462a-96e5-60376aeacedb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:04.494452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6ded28c2-8420-401f-be43-f82653dba8f8 req-cd79658c-ebad-462a-96e5-60376aeacedb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:04.495470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d6c8caaf-5afc-4507-8b3a-39887f30da68 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:04.495470 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d6c8caaf-5afc-4507-8b3a-39887f30da68 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1319 microversion: 2.1 time: 0.587664 Oct 29 01:14:04.495470 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1265/2443] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:03 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1319 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:04.496147 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-6ded28c2-8420-401f-be43-f82653dba8f8 req-cd79658c-ebad-462a-96e5-60376aeacedb service nova] Creating event network-vif-unplugged:c9bfa9ce-2881-44eb-bf9e-16eb902a3d6a for instance 24ebe561-9b25-419d-b771-d5f2d212cfbb on n-h1-862964-3 Oct 29 01:14:04.505418 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-6ded28c2-8420-401f-be43-f82653dba8f8 req-cd79658c-ebad-462a-96e5-60376aeacedb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113527 Oct 29 01:14:04.512840 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1179/2444] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:04.553486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-275f04b1-3a6d-4f30-bfc1-8382b0f40891 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9770c790>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:04.626395 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-275f04b1-3a6d-4f30-bfc1-8382b0f40891 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.099404 Oct 29 01:14:04.626996 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1266/2445] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:14:04 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:04.916990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c1c3469e-0fe8-462c-aa28-db583315485b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:04.918304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c1c3469e-0fe8-462c-aa28-db583315485b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:04.925856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1c3469e-0fe8-462c-aa28-db583315485b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:04.926354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1c3469e-0fe8-462c-aa28-db583315485b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:04.926828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1c3469e-0fe8-462c-aa28-db583315485b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:04.927591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1c3469e-0fe8-462c-aa28-db583315485b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:04.928069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1c3469e-0fe8-462c-aa28-db583315485b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:04.928492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1c3469e-0fe8-462c-aa28-db583315485b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:05.082458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:05.086774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-a544c5aa-512b-48da-8719-803d26192936 req-fd16859b-b5c8-4c38-8317-cb4432a01690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6068e5d6-cd2f-48c1-a7aa-6c28ee2684ff", "tag": "53469bc8-aa5e-4172-b572-b2c995e9c398"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:05.104464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:05.108355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a544c5aa-512b-48da-8719-803d26192936 req-fd16859b-b5c8-4c38-8317-cb4432a01690 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:05.108852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a544c5aa-512b-48da-8719-803d26192936 req-fd16859b-b5c8-4c38-8317-cb4432a01690 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:05.109371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a544c5aa-512b-48da-8719-803d26192936 req-fd16859b-b5c8-4c38-8317-cb4432a01690 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:05.171169 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-a544c5aa-512b-48da-8719-803d26192936 req-fd16859b-b5c8-4c38-8317-cb4432a01690 service nova] Creating event network-changed:53469bc8-aa5e-4172-b572-b2c995e9c398 for instance 6068e5d6-cd2f-48c1-a7aa-6c28ee2684ff on n-h1-862964-3 Oct 29 01:14:05.171933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c1c3469e-0fe8-462c-aa28-db583315485b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:05.172035 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-a544c5aa-512b-48da-8719-803d26192936 req-fd16859b-b5c8-4c38-8317-cb4432a01690 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072761 Oct 29 01:14:05.172035 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1267/2446] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:14:05.172180 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c1c3469e-0fe8-462c-aa28-db583315485b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 0.250701 Oct 29 01:14:05.172180 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1180/2447] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:04 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:05.484044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-24e684b7-fafa-4891-aaec-64b45f988f74 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:05.484895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-24e684b7-fafa-4891-aaec-64b45f988f74 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:05.519685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24e684b7-fafa-4891-aaec-64b45f988f74 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:05.520359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24e684b7-fafa-4891-aaec-64b45f988f74 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:05.522743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24e684b7-fafa-4891-aaec-64b45f988f74 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:05.525467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24e684b7-fafa-4891-aaec-64b45f988f74 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:05.527846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24e684b7-fafa-4891-aaec-64b45f988f74 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:05.532971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24e684b7-fafa-4891-aaec-64b45f988f74 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:05.564949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-83553a0e-47b8-461a-b9f0-da5d58952439 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:05.564949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-83553a0e-47b8-461a-b9f0-da5d58952439 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:05.564949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:05.589639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83553a0e-47b8-461a-b9f0-da5d58952439 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:05.589639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83553a0e-47b8-461a-b9f0-da5d58952439 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:05.589639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83553a0e-47b8-461a-b9f0-da5d58952439 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:05.596904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83553a0e-47b8-461a-b9f0-da5d58952439 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:05.597416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83553a0e-47b8-461a-b9f0-da5d58952439 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:05.597860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83553a0e-47b8-461a-b9f0-da5d58952439 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:05.954034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-83553a0e-47b8-461a-b9f0-da5d58952439 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:05.969283 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-83553a0e-47b8-461a-b9f0-da5d58952439 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1319 microversion: 2.1 time: 0.412761 Oct 29 01:14:05.972774 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1181/2448] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:05 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1319 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:05.988528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-48de9b16-a35d-414a-b604-e7b9c6a07a2a tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9fe69310>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:06.098823 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-48de9b16-a35d-414a-b604-e7b9c6a07a2a tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1426 microversion: 2.1 time: 0.121088 Oct 29 01:14:06.104586 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1182/2449] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:14:05 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1426 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:06.197920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-675ce791-5ea2-4770-ad79-09766966ca13 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:06.198600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-675ce791-5ea2-4770-ad79-09766966ca13 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:06.212767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-675ce791-5ea2-4770-ad79-09766966ca13 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:06.217874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-675ce791-5ea2-4770-ad79-09766966ca13 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:06.217874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-675ce791-5ea2-4770-ad79-09766966ca13 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:06.219582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-675ce791-5ea2-4770-ad79-09766966ca13 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:06.220088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-675ce791-5ea2-4770-ad79-09766966ca13 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:06.220591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-675ce791-5ea2-4770-ad79-09766966ca13 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:06.434631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-24e684b7-fafa-4891-aaec-64b45f988f74 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:06.444398 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-24e684b7-fafa-4891-aaec-64b45f988f74 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1511 microversion: 2.1 time: 0.965801 Oct 29 01:14:06.447208 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1268/2450] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:05 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1511 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:06.502675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-675ce791-5ea2-4770-ad79-09766966ca13 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:06.516325 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-675ce791-5ea2-4770-ad79-09766966ca13 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 0.323529 Oct 29 01:14:06.532881 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1183/2451] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:06 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:06.543269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-892edc83-de6a-42eb-9269-2bc00fafe110 req-d879e2cf-d039-42ec-b4c5-279632921e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24ebe561-9b25-419d-b771-d5f2d212cfbb", "tag": "c9bfa9ce-2881-44eb-bf9e-16eb902a3d6a"}, {"name": "network-changed", "server_uuid": "2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7", "tag": "276338d2-9ccf-4af2-bdee-6a489385647d"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:06.561912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-892edc83-de6a-42eb-9269-2bc00fafe110 req-d879e2cf-d039-42ec-b4c5-279632921e59 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:06.562733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-892edc83-de6a-42eb-9269-2bc00fafe110 req-d879e2cf-d039-42ec-b4c5-279632921e59 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:06.563460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-892edc83-de6a-42eb-9269-2bc00fafe110 req-d879e2cf-d039-42ec-b4c5-279632921e59 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:06.578428 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-892edc83-de6a-42eb-9269-2bc00fafe110 req-d879e2cf-d039-42ec-b4c5-279632921e59 service nova] Creating event network-changed:c9bfa9ce-2881-44eb-bf9e-16eb902a3d6a for instance 24ebe561-9b25-419d-b771-d5f2d212cfbb on n-h1-862964-3 Oct 29 01:14:06.578862 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-892edc83-de6a-42eb-9269-2bc00fafe110 req-d879e2cf-d039-42ec-b4c5-279632921e59 service nova] Creating event network-changed:276338d2-9ccf-4af2-bdee-6a489385647d for instance 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 on n-h1-862964-3 Oct 29 01:14:06.586110 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-892edc83-de6a-42eb-9269-2bc00fafe110 req-d879e2cf-d039-42ec-b4c5-279632921e59 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.050243 Oct 29 01:14:06.590544 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1269/2452] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:14:06.994912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-faddbf5f-78ff-4abf-80f1-a796485f10e9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:06.996123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-faddbf5f-78ff-4abf-80f1-a796485f10e9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:07.006255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faddbf5f-78ff-4abf-80f1-a796485f10e9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:07.006255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faddbf5f-78ff-4abf-80f1-a796485f10e9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:07.006255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faddbf5f-78ff-4abf-80f1-a796485f10e9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:07.006514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faddbf5f-78ff-4abf-80f1-a796485f10e9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:07.007158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faddbf5f-78ff-4abf-80f1-a796485f10e9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:07.007907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faddbf5f-78ff-4abf-80f1-a796485f10e9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:07.124238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-64b2c478-0c2a-4300-91bf-e9f3ae6c7e34 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d97073700>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:07.179889 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-64b2c478-0c2a-4300-91bf-e9f3ae6c7e34 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1435 microversion: 2.1 time: 0.061849 Oct 29 01:14:07.180525 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1270/2453] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:14:07 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1435 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:07.196840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2678f384-40ca-4ff8-bbef-6fbd24e42c50 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9700aa60>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:07.203714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-faddbf5f-78ff-4abf-80f1-a796485f10e9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:07.214550 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-faddbf5f-78ff-4abf-80f1-a796485f10e9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1319 microversion: 2.1 time: 0.224209 Oct 29 01:14:07.225241 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1184/2454] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:06 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:07.253702 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2678f384-40ca-4ff8-bbef-6fbd24e42c50 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 200 len: 1435 microversion: 2.1 time: 0.061379 Oct 29 01:14:07.254383 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1271/2455] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:14:07 2022] GET /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 1435 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:07.269195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5d7355a7-7ea9-45e4-acfc-490739c474a2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:07.269813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5d7355a7-7ea9-45e4-acfc-490739c474a2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:07.276472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d7355a7-7ea9-45e4-acfc-490739c474a2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:07.276936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d7355a7-7ea9-45e4-acfc-490739c474a2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:07.277390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d7355a7-7ea9-45e4-acfc-490739c474a2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:07.278088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d7355a7-7ea9-45e4-acfc-490739c474a2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:07.278542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d7355a7-7ea9-45e4-acfc-490739c474a2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:07.278962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d7355a7-7ea9-45e4-acfc-490739c474a2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:07.440570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5d7355a7-7ea9-45e4-acfc-490739c474a2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:07.450294 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5d7355a7-7ea9-45e4-acfc-490739c474a2 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1479 microversion: 2.1 time: 0.185292 Oct 29 01:14:07.450780 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1185/2456] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:07 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1479 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:07.469962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9826d0a5-3b15-4e1c-8362-0411a71cc34b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:07.470832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9826d0a5-3b15-4e1c-8362-0411a71cc34b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:07.477353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9826d0a5-3b15-4e1c-8362-0411a71cc34b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:07.477918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9826d0a5-3b15-4e1c-8362-0411a71cc34b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:07.478425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9826d0a5-3b15-4e1c-8362-0411a71cc34b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:07.479244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9826d0a5-3b15-4e1c-8362-0411a71cc34b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:07.479770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9826d0a5-3b15-4e1c-8362-0411a71cc34b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:07.480383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9826d0a5-3b15-4e1c-8362-0411a71cc34b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:07.550161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d1df0dc5-70ac-4b95-89c9-a566cf5da037 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:07.551072 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d1df0dc5-70ac-4b95-89c9-a566cf5da037 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:07.563928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d1df0dc5-70ac-4b95-89c9-a566cf5da037 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:07.567453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d1df0dc5-70ac-4b95-89c9-a566cf5da037 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:07.568031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d1df0dc5-70ac-4b95-89c9-a566cf5da037 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:07.568896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d1df0dc5-70ac-4b95-89c9-a566cf5da037 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:07.569593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d1df0dc5-70ac-4b95-89c9-a566cf5da037 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:07.570260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d1df0dc5-70ac-4b95-89c9-a566cf5da037 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:07.591851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:07.675655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9826d0a5-3b15-4e1c-8362-0411a71cc34b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:07.675655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:07.676268 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9826d0a5-3b15-4e1c-8362-0411a71cc34b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1511 microversion: 2.1 time: 0.210410 Oct 29 01:14:07.676518 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1272/2457] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:07 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1511 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:07.730333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d1df0dc5-70ac-4b95-89c9-a566cf5da037 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:07.738473 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d1df0dc5-70ac-4b95-89c9-a566cf5da037 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 0.195753 Oct 29 01:14:07.743132 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1186/2458] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:07 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:08.240020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-609102ef-3055-44aa-99cf-93f765675c3d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:08.240624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-609102ef-3055-44aa-99cf-93f765675c3d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:08.247765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-609102ef-3055-44aa-99cf-93f765675c3d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:08.248061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-609102ef-3055-44aa-99cf-93f765675c3d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:08.248724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-609102ef-3055-44aa-99cf-93f765675c3d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:08.249519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-609102ef-3055-44aa-99cf-93f765675c3d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:08.249977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-609102ef-3055-44aa-99cf-93f765675c3d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:08.250393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-609102ef-3055-44aa-99cf-93f765675c3d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:08.414398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-609102ef-3055-44aa-99cf-93f765675c3d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:08.423422 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-609102ef-3055-44aa-99cf-93f765675c3d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1319 microversion: 2.1 time: 0.187161 Oct 29 01:14:08.424247 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1273/2459] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:08 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:08.474155 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eb1e8f5e-9cdb-4fd7-a948-dbb09015ee3b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:08.474771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-eb1e8f5e-9cdb-4fd7-a948-dbb09015ee3b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:08.481652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb1e8f5e-9cdb-4fd7-a948-dbb09015ee3b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:08.482138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb1e8f5e-9cdb-4fd7-a948-dbb09015ee3b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:08.494969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb1e8f5e-9cdb-4fd7-a948-dbb09015ee3b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:08.494969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb1e8f5e-9cdb-4fd7-a948-dbb09015ee3b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:08.494969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb1e8f5e-9cdb-4fd7-a948-dbb09015ee3b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:08.494969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb1e8f5e-9cdb-4fd7-a948-dbb09015ee3b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:08.699852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0fefaf3b-486f-4ba5-bbbf-5b04718be09b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:08.702244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0fefaf3b-486f-4ba5-bbbf-5b04718be09b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:08.705542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=77 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:08.710872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fefaf3b-486f-4ba5-bbbf-5b04718be09b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:08.711360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fefaf3b-486f-4ba5-bbbf-5b04718be09b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:08.712033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fefaf3b-486f-4ba5-bbbf-5b04718be09b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:08.712709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fefaf3b-486f-4ba5-bbbf-5b04718be09b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:08.713187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fefaf3b-486f-4ba5-bbbf-5b04718be09b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:08.713620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fefaf3b-486f-4ba5-bbbf-5b04718be09b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:08.718574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:08.878253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-eb1e8f5e-9cdb-4fd7-a948-dbb09015ee3b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:08.890558 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-eb1e8f5e-9cdb-4fd7-a948-dbb09015ee3b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1479 microversion: 2.1 time: 0.419387 Oct 29 01:14:08.891230 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1187/2460] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:08 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1479 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:08.898291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-47a8bbcc-9637-4945-93e2-a27d27dfac2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:08.900022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-47a8bbcc-9637-4945-93e2-a27d27dfac2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:08.919457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a8bbcc-9637-4945-93e2-a27d27dfac2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:08.920062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a8bbcc-9637-4945-93e2-a27d27dfac2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:08.920863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a8bbcc-9637-4945-93e2-a27d27dfac2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:08.921865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a8bbcc-9637-4945-93e2-a27d27dfac2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:08.922533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a8bbcc-9637-4945-93e2-a27d27dfac2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:08.923189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a8bbcc-9637-4945-93e2-a27d27dfac2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:08.934376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0fefaf3b-486f-4ba5-bbbf-5b04718be09b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:08.947764 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0fefaf3b-486f-4ba5-bbbf-5b04718be09b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1511 microversion: 2.1 time: 0.252384 Oct 29 01:14:08.948584 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1274/2461] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:08 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1511 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:09.074327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-47a8bbcc-9637-4945-93e2-a27d27dfac2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:09.082434 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-47a8bbcc-9637-4945-93e2-a27d27dfac2e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 0.188257 Oct 29 01:14:09.083017 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1188/2462] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:08 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:09.467414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9fb8c427-3fad-4b45-88dd-1adbfa733d5b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:09.468398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9fb8c427-3fad-4b45-88dd-1adbfa733d5b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:09.476083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fb8c427-3fad-4b45-88dd-1adbfa733d5b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:09.486941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fb8c427-3fad-4b45-88dd-1adbfa733d5b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:09.487410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fb8c427-3fad-4b45-88dd-1adbfa733d5b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:09.490517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fb8c427-3fad-4b45-88dd-1adbfa733d5b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:09.491173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fb8c427-3fad-4b45-88dd-1adbfa733d5b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:09.491821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fb8c427-3fad-4b45-88dd-1adbfa733d5b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:09.658213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9fb8c427-3fad-4b45-88dd-1adbfa733d5b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:09.663272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-13c51ea2-541e-4300-b738-053ab083ba0e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1218397029", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:09.670308 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9fb8c427-3fad-4b45-88dd-1adbfa733d5b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1319 microversion: 2.1 time: 0.222545 Oct 29 01:14:09.671988 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1275/2463] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:09 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:09.735127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-13c51ea2-541e-4300-b738-053ab083ba0e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] validate_networks() for None {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:14:09.924922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-98140c52-973d-41fb-b82e-c3d44568861c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:09.925665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-98140c52-973d-41fb-b82e-c3d44568861c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:09.932203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98140c52-973d-41fb-b82e-c3d44568861c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:09.933089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98140c52-973d-41fb-b82e-c3d44568861c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:09.933730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98140c52-973d-41fb-b82e-c3d44568861c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:09.934529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98140c52-973d-41fb-b82e-c3d44568861c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:09.935203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98140c52-973d-41fb-b82e-c3d44568861c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:09.935688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98140c52-973d-41fb-b82e-c3d44568861c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:09.982318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-13c51ea2-541e-4300-b738-053ab083ba0e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:14:09.983731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-13c51ea2-541e-4300-b738-053ab083ba0e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:14:09.984518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-13c51ea2-541e-4300-b738-053ab083ba0e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:14:09.985397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-13c51ea2-541e-4300-b738-053ab083ba0e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:14:09.985980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-13c51ea2-541e-4300-b738-053ab083ba0e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:14:09.996421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13c51ea2-541e-4300-b738-053ab083ba0e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:10.000266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13c51ea2-541e-4300-b738-053ab083ba0e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:10.000981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13c51ea2-541e-4300-b738-053ab083ba0e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:10.003238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13c51ea2-541e-4300-b738-053ab083ba0e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:10.005333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13c51ea2-541e-4300-b738-053ab083ba0e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:10.008172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13c51ea2-541e-4300-b738-053ab083ba0e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:10.033675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-13c51ea2-541e-4300-b738-053ab083ba0e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Getting quotas for project 5bdf61e2cbca4cdc95494b38c827ce63. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:14:10.043795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-13c51ea2-541e-4300-b738-053ab083ba0e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Getting quotas for user 60969ed444b545b9a5b02e27eb7eaea3 and project 5bdf61e2cbca4cdc95494b38c827ce63. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:14:10.060956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-13c51ea2-541e-4300-b738-053ab083ba0e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:14:10.065067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-13c51ea2-541e-4300-b738-053ab083ba0e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:14:10.223482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-98140c52-973d-41fb-b82e-c3d44568861c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:10.263367 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-98140c52-973d-41fb-b82e-c3d44568861c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1466 microversion: 2.1 time: 0.336283 Oct 29 01:14:10.288552 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1276/2464] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:09 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1466 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:10.305912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-62688541-38bc-41d2-80ae-3816cb10dc6e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:10.306890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-62688541-38bc-41d2-80ae-3816cb10dc6e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:10.317118 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-13c51ea2-541e-4300-b738-053ab083ba0e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.818458 Oct 29 01:14:10.318409 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1189/2465] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:14:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:14:10.327727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a7b342ad-9893-45ce-a759-f184fa4b3b72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:10.338325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62688541-38bc-41d2-80ae-3816cb10dc6e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:10.343974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62688541-38bc-41d2-80ae-3816cb10dc6e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:10.344748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62688541-38bc-41d2-80ae-3816cb10dc6e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:10.345730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62688541-38bc-41d2-80ae-3816cb10dc6e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:10.346404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62688541-38bc-41d2-80ae-3816cb10dc6e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:10.347941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62688541-38bc-41d2-80ae-3816cb10dc6e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:10.351494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a7b342ad-9893-45ce-a759-f184fa4b3b72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:10.384117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7b342ad-9893-45ce-a759-f184fa4b3b72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:10.384861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7b342ad-9893-45ce-a759-f184fa4b3b72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:10.385643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7b342ad-9893-45ce-a759-f184fa4b3b72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:10.389469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7b342ad-9893-45ce-a759-f184fa4b3b72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:10.400868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7b342ad-9893-45ce-a759-f184fa4b3b72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:10.401507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7b342ad-9893-45ce-a759-f184fa4b3b72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:10.812349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-62688541-38bc-41d2-80ae-3816cb10dc6e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:10.823490 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-62688541-38bc-41d2-80ae-3816cb10dc6e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1511 microversion: 2.1 time: 0.533456 Oct 29 01:14:10.837642 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1277/2466] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:10 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1511 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:10.847435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-91aec5bd-5e5a-4bd8-8ef2-c2ef3c80b82b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d97073310>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:10.882658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a7b342ad-9893-45ce-a759-f184fa4b3b72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:10.894331 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a7b342ad-9893-45ce-a759-f184fa4b3b72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 0.574689 Oct 29 01:14:10.911146 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1190/2467] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:10 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:10.916822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-99e0bce6-e9e4-480f-b6ac-eb8b504ac9c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-178329625", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:10.983352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-99e0bce6-e9e4-480f-b6ac-eb8b504ac9c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] validate_networks() for None {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:14:11.381469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-99e0bce6-e9e4-480f-b6ac-eb8b504ac9c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:14:11.381901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-99e0bce6-e9e4-480f-b6ac-eb8b504ac9c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:14:11.382429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-99e0bce6-e9e4-480f-b6ac-eb8b504ac9c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:14:11.382847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-99e0bce6-e9e4-480f-b6ac-eb8b504ac9c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:14:11.383329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-99e0bce6-e9e4-480f-b6ac-eb8b504ac9c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:14:11.400728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99e0bce6-e9e4-480f-b6ac-eb8b504ac9c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:11.400728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99e0bce6-e9e4-480f-b6ac-eb8b504ac9c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:11.400728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99e0bce6-e9e4-480f-b6ac-eb8b504ac9c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:11.400728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99e0bce6-e9e4-480f-b6ac-eb8b504ac9c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:11.400728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99e0bce6-e9e4-480f-b6ac-eb8b504ac9c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:11.400728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99e0bce6-e9e4-480f-b6ac-eb8b504ac9c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:11.443546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-99e0bce6-e9e4-480f-b6ac-eb8b504ac9c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Getting quotas for project 5bdf61e2cbca4cdc95494b38c827ce63. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:14:11.449334 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-99e0bce6-e9e4-480f-b6ac-eb8b504ac9c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Getting quotas for user 60969ed444b545b9a5b02e27eb7eaea3 and project 5bdf61e2cbca4cdc95494b38c827ce63. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:14:11.464985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-99e0bce6-e9e4-480f-b6ac-eb8b504ac9c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:14:11.467716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-99e0bce6-e9e4-480f-b6ac-eb8b504ac9c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:14:11.806599 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-99e0bce6-e9e4-480f-b6ac-eb8b504ac9c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.893984 Oct 29 01:14:11.809322 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1191/2468] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:14:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:14:11.822995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d3d6cd15-9c52-46b7-a7bb-375048f001a0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:11.825995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d3d6cd15-9c52-46b7-a7bb-375048f001a0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:11.847949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3d6cd15-9c52-46b7-a7bb-375048f001a0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:11.848838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3d6cd15-9c52-46b7-a7bb-375048f001a0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:11.849621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3d6cd15-9c52-46b7-a7bb-375048f001a0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:11.850379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3d6cd15-9c52-46b7-a7bb-375048f001a0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:11.850838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3d6cd15-9c52-46b7-a7bb-375048f001a0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:11.851258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3d6cd15-9c52-46b7-a7bb-375048f001a0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:12.231432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d3d6cd15-9c52-46b7-a7bb-375048f001a0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:12.241679 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d3d6cd15-9c52-46b7-a7bb-375048f001a0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1319 microversion: 2.1 time: 0.430477 Oct 29 01:14:12.242585 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1192/2469] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:11 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1319 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:12.250305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-b480f71d-19fa-4819-8c1a-32f5d7811baf req-e78cc1ee-db69-4074-a850-45e8838bcef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b41540-956c-41c7-8396-3bcbcfc54862", "name": "network-vif-unplugged", "status": "completed", "tag": "69c1a7b0-0583-4934-a72a-4f711f4caffe"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:12.261604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b480f71d-19fa-4819-8c1a-32f5d7811baf req-e78cc1ee-db69-4074-a850-45e8838bcef4 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:12.265918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b480f71d-19fa-4819-8c1a-32f5d7811baf req-e78cc1ee-db69-4074-a850-45e8838bcef4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:12.265918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b480f71d-19fa-4819-8c1a-32f5d7811baf req-e78cc1ee-db69-4074-a850-45e8838bcef4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:12.282401 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-b480f71d-19fa-4819-8c1a-32f5d7811baf req-e78cc1ee-db69-4074-a850-45e8838bcef4 service nova] Creating event network-vif-unplugged:69c1a7b0-0583-4934-a72a-4f711f4caffe for instance 71b41540-956c-41c7-8396-3bcbcfc54862 on n-h1-862964-3 Oct 29 01:14:12.289098 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-b480f71d-19fa-4819-8c1a-32f5d7811baf req-e78cc1ee-db69-4074-a850-45e8838bcef4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044274 Oct 29 01:14:12.290260 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1193/2470] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:12.300751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fd3ee2f7-822a-4fc1-b625-cb95f2795c1b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:12.301490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fd3ee2f7-822a-4fc1-b625-cb95f2795c1b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:12.375302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fd3ee2f7-822a-4fc1-b625-cb95f2795c1b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:12.386249 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fd3ee2f7-822a-4fc1-b625-cb95f2795c1b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1213 microversion: 2.1 time: 0.094202 Oct 29 01:14:12.387107 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1194/2471] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:12 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:12.394220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-07a30070-7af6-47a0-aaf0-9334b2efa03e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:12.395081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-07a30070-7af6-47a0-aaf0-9334b2efa03e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:12.403036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07a30070-7af6-47a0-aaf0-9334b2efa03e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:12.405944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07a30070-7af6-47a0-aaf0-9334b2efa03e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:12.406301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07a30070-7af6-47a0-aaf0-9334b2efa03e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:12.407299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07a30070-7af6-47a0-aaf0-9334b2efa03e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:12.408149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07a30070-7af6-47a0-aaf0-9334b2efa03e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:12.408922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07a30070-7af6-47a0-aaf0-9334b2efa03e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:12.694505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-07a30070-7af6-47a0-aaf0-9334b2efa03e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:12.706407 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-07a30070-7af6-47a0-aaf0-9334b2efa03e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1511 microversion: 2.1 time: 0.317911 Oct 29 01:14:12.707190 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1195/2472] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:12 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1511 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:12.712374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6b286f9f-b4d2-4290-b737-9424845581e2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:12.713018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6b286f9f-b4d2-4290-b737-9424845581e2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:12.725035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b286f9f-b4d2-4290-b737-9424845581e2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:12.725594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b286f9f-b4d2-4290-b737-9424845581e2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:12.729989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b286f9f-b4d2-4290-b737-9424845581e2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:12.732245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b286f9f-b4d2-4290-b737-9424845581e2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:12.733926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b286f9f-b4d2-4290-b737-9424845581e2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:12.735955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b286f9f-b4d2-4290-b737-9424845581e2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:13.041344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6b286f9f-b4d2-4290-b737-9424845581e2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:13.057898 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6b286f9f-b4d2-4290-b737-9424845581e2 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 0.349213 Oct 29 01:14:13.058725 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1196/2473] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:12 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:13.269245 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-91aec5bd-5e5a-4bd8-8ef2-c2ef3c80b82b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "DELETE /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb" status: 204 len: 0 microversion: 2.1 time: 2.420134 Oct 29 01:14:13.269245 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1278/2474] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:10 2022] DELETE /compute/v2.1/images/c96d953e-5375-4fa8-b3aa-8c8b30b16afb => generated 0 bytes in 2422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:14:13.271068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-57d92268-6d2f-4968-bf2a-c0dfb97bd7f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:13.272134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-57d92268-6d2f-4968-bf2a-c0dfb97bd7f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:13.282036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dd530228-10a8-4fd0-9935-bf5d4b7031fb tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '.version_select at 0x7f9d9705aaf0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:13.283834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57d92268-6d2f-4968-bf2a-c0dfb97bd7f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:13.284491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57d92268-6d2f-4968-bf2a-c0dfb97bd7f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:13.285100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57d92268-6d2f-4968-bf2a-c0dfb97bd7f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:13.292522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57d92268-6d2f-4968-bf2a-c0dfb97bd7f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:13.293698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57d92268-6d2f-4968-bf2a-c0dfb97bd7f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:13.294311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57d92268-6d2f-4968-bf2a-c0dfb97bd7f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:13.333657 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-dd530228-10a8-4fd0-9935-bf5d4b7031fb tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] HTTP exception thrown: Image not found. Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dd530228-10a8-4fd0-9935-bf5d4b7031fb tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Request method failure captured: Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776 HTTP/1.1 Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH3q8ZxW58OcTHBhLMIgDxlgk4ppaXm_caO3dB_8EXApfxgfmqw2A0us7SX0zdazXiJAKc3mJfQPCPbxtQfFLv_eYezo3J-RQ0oXLOz3WdCapakuuNGedYH5aO6DAudWwI4u5umckM9WXQyKn-e03YJLLhbeNq68HNmu38V8-wVGhC8 Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 36a174adc9794d23b38c2bafd8a3f1c6 Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesOneServerTestJSON-717376210 Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36a174adc9794d23b38c2bafd8a3f1c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36a174adc9794d23b38c2bafd8a3f1c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36a174adc9794d23b38c2bafd8a3f1c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36a174adc9794d23b38c2bafd8a3f1c6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesOneServerTestJSON-717376210 Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 36a174adc9794d23b38c2bafd8a3f1c6 Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-717376210 Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesOneServerTestJSON-717376210-project Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 34a454a03ab64d4eab179c11a5165ce0 Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesOneServerTestJSON-717376210-project Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: exception: Image not found. Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'fb46d3f1-5309-4f21-b47c-77f380357776'} Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fb46d3f1-5309-4f21-b47c-77f380357776 to delete Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fb46d3f1-5309-4f21-b47c-77f380357776 could not be found. Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:13.335550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dd530228-10a8-4fd0-9935-bf5d4b7031fb tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Returning 404 to user: Image not found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dd530228-10a8-4fd0-9935-bf5d4b7031fb tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "DELETE /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776" status: 404 len: 62 microversion: 2.1 time: 0.070689 Oct 29 01:14:13.340690 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1279/2475] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:13 2022] DELETE /compute/v2.1/images/fb46d3f1-5309-4f21-b47c-77f380357776 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:14:13.347330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-92893e38-4934-45cc-81ca-3f4c5e929b84 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:13.355856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-92893e38-4934-45cc-81ca-3f4c5e929b84 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:13.371105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92893e38-4934-45cc-81ca-3f4c5e929b84 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:13.371618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92893e38-4934-45cc-81ca-3f4c5e929b84 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:13.372070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92893e38-4934-45cc-81ca-3f4c5e929b84 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:13.372861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92893e38-4934-45cc-81ca-3f4c5e929b84 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:13.373874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92893e38-4934-45cc-81ca-3f4c5e929b84 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:13.374328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92893e38-4934-45cc-81ca-3f4c5e929b84 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:13.417110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-92893e38-4934-45cc-81ca-3f4c5e929b84 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:14:13.684791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-57d92268-6d2f-4968-bf2a-c0dfb97bd7f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:13.699076 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-57d92268-6d2f-4968-bf2a-c0dfb97bd7f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1319 microversion: 2.1 time: 0.429273 Oct 29 01:14:13.699731 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1197/2476] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:13 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:13.712158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cc8b8bf2-27f4-44db-a092-41ff88725feb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:13.713927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cc8b8bf2-27f4-44db-a092-41ff88725feb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:13.815503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cc8b8bf2-27f4-44db-a092-41ff88725feb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:13.830299 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cc8b8bf2-27f4-44db-a092-41ff88725feb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1213 microversion: 2.1 time: 0.125256 Oct 29 01:14:13.832068 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1198/2477] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:13 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1213 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:13.840976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0554755f-91b4-447f-bb56-1d5950c7cf04 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:13.842120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0554755f-91b4-447f-bb56-1d5950c7cf04 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:13.870059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0554755f-91b4-447f-bb56-1d5950c7cf04 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:13.870722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0554755f-91b4-447f-bb56-1d5950c7cf04 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:13.871365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0554755f-91b4-447f-bb56-1d5950c7cf04 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:13.872373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0554755f-91b4-447f-bb56-1d5950c7cf04 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:13.873814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0554755f-91b4-447f-bb56-1d5950c7cf04 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:13.874403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0554755f-91b4-447f-bb56-1d5950c7cf04 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:14.058976 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-92893e38-4934-45cc-81ca-3f4c5e929b84 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "DELETE /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 204 len: 0 microversion: 2.1 time: 0.711553 Oct 29 01:14:14.058976 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1280/2478] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:14:13 2022] DELETE /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:14:14.064897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5371e6f0-8d1d-4662-8d1a-2724115171fe tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:14.065669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5371e6f0-8d1d-4662-8d1a-2724115171fe tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:14.072067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5371e6f0-8d1d-4662-8d1a-2724115171fe tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:14.072792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5371e6f0-8d1d-4662-8d1a-2724115171fe tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:14.073437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5371e6f0-8d1d-4662-8d1a-2724115171fe tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:14.074352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5371e6f0-8d1d-4662-8d1a-2724115171fe tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:14.074970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5371e6f0-8d1d-4662-8d1a-2724115171fe tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:14.075593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5371e6f0-8d1d-4662-8d1a-2724115171fe tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:14.183258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0554755f-91b4-447f-bb56-1d5950c7cf04 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:14.216008 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0554755f-91b4-447f-bb56-1d5950c7cf04 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1511 microversion: 2.1 time: 0.380674 Oct 29 01:14:14.220875 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1199/2479] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:13 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1511 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:14.230161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-11f92da2-0796-471f-8fca-0b9b0749694c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:14.231780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-11f92da2-0796-471f-8fca-0b9b0749694c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:14.243620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-11f92da2-0796-471f-8fca-0b9b0749694c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:14.246050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-11f92da2-0796-471f-8fca-0b9b0749694c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:14.246611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-11f92da2-0796-471f-8fca-0b9b0749694c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:14.247501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-11f92da2-0796-471f-8fca-0b9b0749694c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:14.250977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-11f92da2-0796-471f-8fca-0b9b0749694c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:14.251670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-11f92da2-0796-471f-8fca-0b9b0749694c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:14.799749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-11f92da2-0796-471f-8fca-0b9b0749694c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:14.803977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5371e6f0-8d1d-4662-8d1a-2724115171fe tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:14.808530 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-11f92da2-0796-471f-8fca-0b9b0749694c tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 0.584541 Oct 29 01:14:14.809115 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1200/2480] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:14 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:14.818260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-421995ce-f900-46c1-9da4-196eef9d7dd3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:14.819175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-421995ce-f900-46c1-9da4-196eef9d7dd3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:14.832352 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5371e6f0-8d1d-4662-8d1a-2724115171fe tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1472 microversion: 2.1 time: 0.771954 Oct 29 01:14:14.833441 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1281/2481] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:14 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1472 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:14.837639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-421995ce-f900-46c1-9da4-196eef9d7dd3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:14.839977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-421995ce-f900-46c1-9da4-196eef9d7dd3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:14.839977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-421995ce-f900-46c1-9da4-196eef9d7dd3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:14.839977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-421995ce-f900-46c1-9da4-196eef9d7dd3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:14.839977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-421995ce-f900-46c1-9da4-196eef9d7dd3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:14.845754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-421995ce-f900-46c1-9da4-196eef9d7dd3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:14.863555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-60599684-5081-4984-bb94-88d630d575c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:14.864176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-60599684-5081-4984-bb94-88d630d575c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:14.875524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60599684-5081-4984-bb94-88d630d575c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:14.881377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60599684-5081-4984-bb94-88d630d575c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:14.881377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60599684-5081-4984-bb94-88d630d575c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:14.881377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60599684-5081-4984-bb94-88d630d575c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:14.881377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60599684-5081-4984-bb94-88d630d575c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:14.881377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60599684-5081-4984-bb94-88d630d575c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:15.004023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-60599684-5081-4984-bb94-88d630d575c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:15.015233 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-60599684-5081-4984-bb94-88d630d575c0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1217 microversion: 2.1 time: 0.156544 Oct 29 01:14:15.016332 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1282/2482] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:14 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:15.071744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-421995ce-f900-46c1-9da4-196eef9d7dd3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:15.081133 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-421995ce-f900-46c1-9da4-196eef9d7dd3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1319 microversion: 2.1 time: 0.266669 Oct 29 01:14:15.082354 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1201/2483] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:14 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:15.251026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-156e984b-d0d9-487c-9a62-be1ccaf70568 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:15.252164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-156e984b-d0d9-487c-9a62-be1ccaf70568 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:15.261815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-156e984b-d0d9-487c-9a62-be1ccaf70568 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:15.262462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-156e984b-d0d9-487c-9a62-be1ccaf70568 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:15.263591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-156e984b-d0d9-487c-9a62-be1ccaf70568 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:15.264421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-156e984b-d0d9-487c-9a62-be1ccaf70568 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:15.265460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-156e984b-d0d9-487c-9a62-be1ccaf70568 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:15.265996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-156e984b-d0d9-487c-9a62-be1ccaf70568 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:15.438940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-156e984b-d0d9-487c-9a62-be1ccaf70568 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:15.448386 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-156e984b-d0d9-487c-9a62-be1ccaf70568 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1511 microversion: 2.1 time: 0.203167 Oct 29 01:14:15.463226 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1283/2484] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:15 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:15.840361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4b31b569-d32a-4700-9c4d-950ddc948ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:15.841018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4b31b569-d32a-4700-9c4d-950ddc948ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:15.852900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b31b569-d32a-4700-9c4d-950ddc948ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:15.853796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b31b569-d32a-4700-9c4d-950ddc948ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:15.856298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b31b569-d32a-4700-9c4d-950ddc948ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:15.859970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b31b569-d32a-4700-9c4d-950ddc948ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:15.863750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b31b569-d32a-4700-9c4d-950ddc948ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:15.863988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3d8a3d7c-11c4-40bb-8acd-96e7da11956a tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:15.864693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3d8a3d7c-11c4-40bb-8acd-96e7da11956a tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:15.866347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b31b569-d32a-4700-9c4d-950ddc948ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:15.876787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d8a3d7c-11c4-40bb-8acd-96e7da11956a tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:15.878803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d8a3d7c-11c4-40bb-8acd-96e7da11956a tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:15.878803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d8a3d7c-11c4-40bb-8acd-96e7da11956a tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:15.878803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d8a3d7c-11c4-40bb-8acd-96e7da11956a tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:15.884790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d8a3d7c-11c4-40bb-8acd-96e7da11956a tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:15.885025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d8a3d7c-11c4-40bb-8acd-96e7da11956a tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:16.215137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4b31b569-d32a-4700-9c4d-950ddc948ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:16.241190 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4b31b569-d32a-4700-9c4d-950ddc948ca5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 0.411606 Oct 29 01:14:16.255853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3d8a3d7c-11c4-40bb-8acd-96e7da11956a tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:16.271180 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3d8a3d7c-11c4-40bb-8acd-96e7da11956a tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1472 microversion: 2.1 time: 0.410891 Oct 29 01:14:16.273385 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1284/2485] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:15 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1472 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:16.273888 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1202/2486] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:15 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:16.288341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-81689f5c-669a-476b-bb9e-d13bf6172264 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:16.291710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-81689f5c-669a-476b-bb9e-d13bf6172264 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:16.316518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81689f5c-669a-476b-bb9e-d13bf6172264 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:16.317527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81689f5c-669a-476b-bb9e-d13bf6172264 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:16.319919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81689f5c-669a-476b-bb9e-d13bf6172264 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:16.321287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81689f5c-669a-476b-bb9e-d13bf6172264 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:16.322807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81689f5c-669a-476b-bb9e-d13bf6172264 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:16.325804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81689f5c-669a-476b-bb9e-d13bf6172264 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:16.397171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-adcae1a7-ced2-44da-b2e0-8442cfd61597 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1108993900", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "739df829-b1de-4312-9656-960cba8a538e"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:16.474778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-adcae1a7-ced2-44da-b2e0-8442cfd61597 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] validate_networks() for [('739df829-b1de-4312-9656-960cba8a538e', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:14:16.497429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-81689f5c-669a-476b-bb9e-d13bf6172264 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:16.507829 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-81689f5c-669a-476b-bb9e-d13bf6172264 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1217 microversion: 2.1 time: 0.232743 Oct 29 01:14:16.508498 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1203/2487] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:16 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1217 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:16.515468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f6487eaf-c6ad-423e-a013-5abd2a511763 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:16.516413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f6487eaf-c6ad-423e-a013-5abd2a511763 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:16.523406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6487eaf-c6ad-423e-a013-5abd2a511763 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:16.524444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6487eaf-c6ad-423e-a013-5abd2a511763 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:16.525182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6487eaf-c6ad-423e-a013-5abd2a511763 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:16.526172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6487eaf-c6ad-423e-a013-5abd2a511763 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:16.526835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6487eaf-c6ad-423e-a013-5abd2a511763 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:16.527482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6487eaf-c6ad-423e-a013-5abd2a511763 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:16.929029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f6487eaf-c6ad-423e-a013-5abd2a511763 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:16.951952 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f6487eaf-c6ad-423e-a013-5abd2a511763 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1319 microversion: 2.1 time: 0.435955 Oct 29 01:14:16.952836 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1204/2488] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:16 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1319 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:16.966380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-9daa17c0-7e76-48c8-a429-1bddb60d5785 req-411de88b-6aad-4b2d-b183-71c0a5f4727f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6068e5d6-cd2f-48c1-a7aa-6c28ee2684ff", "name": "network-vif-plugged", "status": "completed", "tag": "53469bc8-aa5e-4172-b572-b2c995e9c398"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:16.994246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9daa17c0-7e76-48c8-a429-1bddb60d5785 req-411de88b-6aad-4b2d-b183-71c0a5f4727f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:16.994737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9daa17c0-7e76-48c8-a429-1bddb60d5785 req-411de88b-6aad-4b2d-b183-71c0a5f4727f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:16.995497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9daa17c0-7e76-48c8-a429-1bddb60d5785 req-411de88b-6aad-4b2d-b183-71c0a5f4727f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:17.028573 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-9daa17c0-7e76-48c8-a429-1bddb60d5785 req-411de88b-6aad-4b2d-b183-71c0a5f4727f service nova] Creating event network-vif-plugged:53469bc8-aa5e-4172-b572-b2c995e9c398 for instance 6068e5d6-cd2f-48c1-a7aa-6c28ee2684ff on n-h1-862964-3 Oct 29 01:14:17.045641 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-9daa17c0-7e76-48c8-a429-1bddb60d5785 req-411de88b-6aad-4b2d-b183-71c0a5f4727f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090534 Oct 29 01:14:17.046679 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1205/2489] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:17.053186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d64726dd-71f1-4397-bba4-6c44ad14938a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:17.055369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d64726dd-71f1-4397-bba4-6c44ad14938a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:17.067666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d64726dd-71f1-4397-bba4-6c44ad14938a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:17.068189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d64726dd-71f1-4397-bba4-6c44ad14938a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:17.068636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d64726dd-71f1-4397-bba4-6c44ad14938a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:17.069416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d64726dd-71f1-4397-bba4-6c44ad14938a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:17.069884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d64726dd-71f1-4397-bba4-6c44ad14938a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:17.070314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d64726dd-71f1-4397-bba4-6c44ad14938a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:17.868155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-adcae1a7-ced2-44da-b2e0-8442cfd61597 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:14:17.869186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-adcae1a7-ced2-44da-b2e0-8442cfd61597 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:14:17.869817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-adcae1a7-ced2-44da-b2e0-8442cfd61597 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:14:17.870377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-adcae1a7-ced2-44da-b2e0-8442cfd61597 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:14:17.870940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-adcae1a7-ced2-44da-b2e0-8442cfd61597 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:14:17.889061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adcae1a7-ced2-44da-b2e0-8442cfd61597 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:17.889894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adcae1a7-ced2-44da-b2e0-8442cfd61597 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:17.895959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adcae1a7-ced2-44da-b2e0-8442cfd61597 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:17.896965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adcae1a7-ced2-44da-b2e0-8442cfd61597 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:17.897668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adcae1a7-ced2-44da-b2e0-8442cfd61597 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:17.898258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adcae1a7-ced2-44da-b2e0-8442cfd61597 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:17.941006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-adcae1a7-ced2-44da-b2e0-8442cfd61597 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Getting quotas for project 0dabcb4dc77b4cb982e41d436ffaf844. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:14:17.949801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-adcae1a7-ced2-44da-b2e0-8442cfd61597 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Getting quotas for user 5470f9c5ba1e481fb7644b70c4a70766 and project 0dabcb4dc77b4cb982e41d436ffaf844. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:14:17.969254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-adcae1a7-ced2-44da-b2e0-8442cfd61597 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:14:17.980437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-adcae1a7-ced2-44da-b2e0-8442cfd61597 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:14:18.030879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d64726dd-71f1-4397-bba4-6c44ad14938a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:18.044626 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d64726dd-71f1-4397-bba4-6c44ad14938a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1511 microversion: 2.1 time: 0.994500 Oct 29 01:14:18.047356 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1206/2490] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:17 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1511 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:18.065719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a5f67a05-f205-4931-9983-bd084b34b0fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:18.066835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a5f67a05-f205-4931-9983-bd084b34b0fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:18.077277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a5f67a05-f205-4931-9983-bd084b34b0fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:18.079198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a5f67a05-f205-4931-9983-bd084b34b0fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:18.080610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a5f67a05-f205-4931-9983-bd084b34b0fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:18.081799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a5f67a05-f205-4931-9983-bd084b34b0fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:18.082487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a5f67a05-f205-4931-9983-bd084b34b0fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:18.083146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a5f67a05-f205-4931-9983-bd084b34b0fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:18.300299 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-adcae1a7-ced2-44da-b2e0-8442cfd61597 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.021813 Oct 29 01:14:18.306076 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1285/2491] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:14:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:14:18.312266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a5f67a05-f205-4931-9983-bd084b34b0fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:18.314822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5af7d105-2d2c-4b24-b154-352229bd9c0b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:18.316793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:18.317298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5af7d105-2d2c-4b24-b154-352229bd9c0b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:18.329457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5af7d105-2d2c-4b24-b154-352229bd9c0b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:18.330476 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a5f67a05-f205-4931-9983-bd084b34b0fa tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 0.279817 Oct 29 01:14:18.330742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5af7d105-2d2c-4b24-b154-352229bd9c0b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:18.338547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5af7d105-2d2c-4b24-b154-352229bd9c0b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:18.339523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5af7d105-2d2c-4b24-b154-352229bd9c0b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:18.340513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5af7d105-2d2c-4b24-b154-352229bd9c0b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:18.340962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5af7d105-2d2c-4b24-b154-352229bd9c0b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:18.344254 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1207/2492] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:18 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:18.360970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ae163a8b-38f9-45cc-947c-e2b5accd9855 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:18.361610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ae163a8b-38f9-45cc-947c-e2b5accd9855 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:18.380751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae163a8b-38f9-45cc-947c-e2b5accd9855 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:18.381478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae163a8b-38f9-45cc-947c-e2b5accd9855 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:18.382195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae163a8b-38f9-45cc-947c-e2b5accd9855 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:18.383122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae163a8b-38f9-45cc-947c-e2b5accd9855 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:18.383981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae163a8b-38f9-45cc-947c-e2b5accd9855 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:18.384575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae163a8b-38f9-45cc-947c-e2b5accd9855 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:18.501335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5af7d105-2d2c-4b24-b154-352229bd9c0b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:18.518842 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5af7d105-2d2c-4b24-b154-352229bd9c0b tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1430 microversion: 2.1 time: 0.211179 Oct 29 01:14:18.519433 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1286/2493] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:18 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1430 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:18.532546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-102085b0-12cd-4c4c-b90d-446c45866c9f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:18.532546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-102085b0-12cd-4c4c-b90d-446c45866c9f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:18.560587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-102085b0-12cd-4c4c-b90d-446c45866c9f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:18.561505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-102085b0-12cd-4c4c-b90d-446c45866c9f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:18.562099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-102085b0-12cd-4c4c-b90d-446c45866c9f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:18.562980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-102085b0-12cd-4c4c-b90d-446c45866c9f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:18.563705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-102085b0-12cd-4c4c-b90d-446c45866c9f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:18.564287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-102085b0-12cd-4c4c-b90d-446c45866c9f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:18.586810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ae163a8b-38f9-45cc-947c-e2b5accd9855 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:18.597402 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ae163a8b-38f9-45cc-947c-e2b5accd9855 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1273 microversion: 2.1 time: 0.251055 Oct 29 01:14:18.598784 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1208/2494] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:18 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1273 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:18.605930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-9d6cd325-5e3a-4bb4-9ea4-4d4d1093685f req-ba418617-e882-4533-93f1-ecc5f852eec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b41540-956c-41c7-8396-3bcbcfc54862", "name": "network-vif-deleted", "tag": "69c1a7b0-0583-4934-a72a-4f711f4caffe"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:18.617857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9d6cd325-5e3a-4bb4-9ea4-4d4d1093685f req-ba418617-e882-4533-93f1-ecc5f852eec6 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:18.618727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9d6cd325-5e3a-4bb4-9ea4-4d4d1093685f req-ba418617-e882-4533-93f1-ecc5f852eec6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:18.619594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9d6cd325-5e3a-4bb4-9ea4-4d4d1093685f req-ba418617-e882-4533-93f1-ecc5f852eec6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:18.642385 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-9d6cd325-5e3a-4bb4-9ea4-4d4d1093685f req-ba418617-e882-4533-93f1-ecc5f852eec6 service nova] Creating event network-vif-deleted:69c1a7b0-0583-4934-a72a-4f711f4caffe for instance 71b41540-956c-41c7-8396-3bcbcfc54862 on n-h1-862964-3 Oct 29 01:14:18.651655 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-9d6cd325-5e3a-4bb4-9ea4-4d4d1093685f req-ba418617-e882-4533-93f1-ecc5f852eec6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051394 Oct 29 01:14:18.655277 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1209/2495] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:18.663047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e6aca5e6-53aa-4415-9b03-1b78e70539e6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:18.663960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e6aca5e6-53aa-4415-9b03-1b78e70539e6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:18.778756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e6aca5e6-53aa-4415-9b03-1b78e70539e6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:18.792736 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e6aca5e6-53aa-4415-9b03-1b78e70539e6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1225 microversion: 2.1 time: 0.134069 Oct 29 01:14:18.793542 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1210/2496] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:18 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1225 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:18.811675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-102085b0-12cd-4c4c-b90d-446c45866c9f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:18.821505 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-102085b0-12cd-4c4c-b90d-446c45866c9f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1319 microversion: 2.1 time: 0.295895 Oct 29 01:14:18.822104 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1287/2497] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:18 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:19.066865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-28f177ec-90f7-438e-bf9f-4561cf7b5f02 req-82ca828d-3c0c-415c-9506-e08b60b0e79c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7", "name": "network-vif-plugged", "status": "completed", "tag": "276338d2-9ccf-4af2-bdee-6a489385647d"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:19.071749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0bf9e558-aafe-4013-968a-f78d38842827 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:19.072252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0bf9e558-aafe-4013-968a-f78d38842827 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:19.080619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0bf9e558-aafe-4013-968a-f78d38842827 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:19.081756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0bf9e558-aafe-4013-968a-f78d38842827 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:19.082068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0bf9e558-aafe-4013-968a-f78d38842827 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:19.083128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0bf9e558-aafe-4013-968a-f78d38842827 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:19.083266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-28f177ec-90f7-438e-bf9f-4561cf7b5f02 req-82ca828d-3c0c-415c-9506-e08b60b0e79c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:19.083977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0bf9e558-aafe-4013-968a-f78d38842827 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:19.084229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-28f177ec-90f7-438e-bf9f-4561cf7b5f02 req-82ca828d-3c0c-415c-9506-e08b60b0e79c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:19.084716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0bf9e558-aafe-4013-968a-f78d38842827 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:19.085232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-28f177ec-90f7-438e-bf9f-4561cf7b5f02 req-82ca828d-3c0c-415c-9506-e08b60b0e79c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:19.114597 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-28f177ec-90f7-438e-bf9f-4561cf7b5f02 req-82ca828d-3c0c-415c-9506-e08b60b0e79c service nova] Creating event network-vif-plugged:276338d2-9ccf-4af2-bdee-6a489385647d for instance 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 on n-h1-862964-3 Oct 29 01:14:19.124066 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-28f177ec-90f7-438e-bf9f-4561cf7b5f02 req-82ca828d-3c0c-415c-9506-e08b60b0e79c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064346 Oct 29 01:14:19.125066 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1211/2498] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:19.369261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8d257d58-9e61-4fd1-8945-42a3fe38dffc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:19.370232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8d257d58-9e61-4fd1-8945-42a3fe38dffc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:19.382262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d257d58-9e61-4fd1-8945-42a3fe38dffc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:19.383084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d257d58-9e61-4fd1-8945-42a3fe38dffc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:19.383774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d257d58-9e61-4fd1-8945-42a3fe38dffc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:19.384703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d257d58-9e61-4fd1-8945-42a3fe38dffc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:19.385405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d257d58-9e61-4fd1-8945-42a3fe38dffc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:19.386046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d257d58-9e61-4fd1-8945-42a3fe38dffc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:19.388142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0bf9e558-aafe-4013-968a-f78d38842827 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:19.416601 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0bf9e558-aafe-4013-968a-f78d38842827 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1511 microversion: 2.1 time: 0.349523 Oct 29 01:14:19.418352 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1288/2499] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:19 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1511 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:19.560944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-404d9421-0475-4004-8f10-ba880ff5e447 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:19.563129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-404d9421-0475-4004-8f10-ba880ff5e447 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:19.580089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-404d9421-0475-4004-8f10-ba880ff5e447 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:19.580585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-404d9421-0475-4004-8f10-ba880ff5e447 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:19.581016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-404d9421-0475-4004-8f10-ba880ff5e447 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:19.591624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-404d9421-0475-4004-8f10-ba880ff5e447 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:19.593013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-404d9421-0475-4004-8f10-ba880ff5e447 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:19.593390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-404d9421-0475-4004-8f10-ba880ff5e447 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:19.694267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-404d9421-0475-4004-8f10-ba880ff5e447 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:19.704069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-404d9421-0475-4004-8f10-ba880ff5e447 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:19.718021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-404d9421-0475-4004-8f10-ba880ff5e447 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:19.718021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-404d9421-0475-4004-8f10-ba880ff5e447 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lazy-loading 'fault' on Instance uuid 71b41540-956c-41c7-8396-3bcbcfc54862 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:14:20.175389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-404d9421-0475-4004-8f10-ba880ff5e447 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a454a03ab64d4eab179c11a5165ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a174adc9794d23b38c2bafd8a3f1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:20.194062 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-404d9421-0475-4004-8f10-ba880ff5e447 tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 200 len: 1307 microversion: 2.1 time: 0.647032 Oct 29 01:14:20.195372 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1289/2500] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:19 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 1307 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:20.200519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-45a9601f-ae72-4e55-bc94-408e96749923 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:20.201144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-45a9601f-ae72-4e55-bc94-408e96749923 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:20.210955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45a9601f-ae72-4e55-bc94-408e96749923 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:20.211454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45a9601f-ae72-4e55-bc94-408e96749923 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:20.211894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45a9601f-ae72-4e55-bc94-408e96749923 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:20.212599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45a9601f-ae72-4e55-bc94-408e96749923 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:20.218280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45a9601f-ae72-4e55-bc94-408e96749923 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:20.218983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45a9601f-ae72-4e55-bc94-408e96749923 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:20.244038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8d257d58-9e61-4fd1-8945-42a3fe38dffc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:20.260418 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8d257d58-9e61-4fd1-8945-42a3fe38dffc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1392 microversion: 2.1 time: 0.892305 Oct 29 01:14:20.273319 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1212/2501] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:19 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1392 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:20.298912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-76b847b8-75be-4097-ba3e-2456a574c739 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:20.299781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-76b847b8-75be-4097-ba3e-2456a574c739 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:20.322838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76b847b8-75be-4097-ba3e-2456a574c739 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:20.322838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76b847b8-75be-4097-ba3e-2456a574c739 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:20.322838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76b847b8-75be-4097-ba3e-2456a574c739 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:20.324821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76b847b8-75be-4097-ba3e-2456a574c739 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:20.327622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76b847b8-75be-4097-ba3e-2456a574c739 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:20.328132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76b847b8-75be-4097-ba3e-2456a574c739 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:20.397648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-45a9601f-ae72-4e55-bc94-408e96749923 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:20.419691 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-45a9601f-ae72-4e55-bc94-408e96749923 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1271 microversion: 2.1 time: 0.223019 Oct 29 01:14:20.421475 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1290/2502] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:20 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1271 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:20.427477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c673becd-8e86-41c5-bcf3-f920fa065e03 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:20.428559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c673becd-8e86-41c5-bcf3-f920fa065e03 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:20.435764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c673becd-8e86-41c5-bcf3-f920fa065e03 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:20.436524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c673becd-8e86-41c5-bcf3-f920fa065e03 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:20.437669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c673becd-8e86-41c5-bcf3-f920fa065e03 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:20.438784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c673becd-8e86-41c5-bcf3-f920fa065e03 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:20.439565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c673becd-8e86-41c5-bcf3-f920fa065e03 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:20.440209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c673becd-8e86-41c5-bcf3-f920fa065e03 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:20.472189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:20.499530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-76b847b8-75be-4097-ba3e-2456a574c739 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:20.509685 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-76b847b8-75be-4097-ba3e-2456a574c739 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1229 microversion: 2.1 time: 0.234738 Oct 29 01:14:20.511034 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1213/2503] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:20 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1229 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:20.518268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9a0fe98f-e236-4555-b063-44f3882a71df tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:20.519255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9a0fe98f-e236-4555-b063-44f3882a71df tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:20.527131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a0fe98f-e236-4555-b063-44f3882a71df tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:20.528113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a0fe98f-e236-4555-b063-44f3882a71df tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:20.529022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a0fe98f-e236-4555-b063-44f3882a71df tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:20.530920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a0fe98f-e236-4555-b063-44f3882a71df tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:20.531581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a0fe98f-e236-4555-b063-44f3882a71df tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:20.532609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a0fe98f-e236-4555-b063-44f3882a71df tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:20.715536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c673becd-8e86-41c5-bcf3-f920fa065e03 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:20.725277 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c673becd-8e86-41c5-bcf3-f920fa065e03 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1319 microversion: 2.1 time: 0.302292 Oct 29 01:14:20.726445 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1291/2504] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:20 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:20.755386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9a0fe98f-e236-4555-b063-44f3882a71df tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:20.767480 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9a0fe98f-e236-4555-b063-44f3882a71df tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1511 microversion: 2.1 time: 0.255218 Oct 29 01:14:20.768444 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1214/2505] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:20 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1511 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:21.219831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5b710d55-fc7a-484b-872c-690a16b6be7c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:21.220453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5b710d55-fc7a-484b-872c-690a16b6be7c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] [instance: 71b41540-956c-41c7-8396-3bcbcfc54862] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:21.232763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b710d55-fc7a-484b-872c-690a16b6be7c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:21.236603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b710d55-fc7a-484b-872c-690a16b6be7c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:21.237278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b710d55-fc7a-484b-872c-690a16b6be7c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:21.241483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b710d55-fc7a-484b-872c-690a16b6be7c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:21.242046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b710d55-fc7a-484b-872c-690a16b6be7c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:21.242442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b710d55-fc7a-484b-872c-690a16b6be7c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:21.273242 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-5b710d55-fc7a-484b-872c-690a16b6be7c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] HTTP exception thrown: Instance 71b41540-956c-41c7-8396-3bcbcfc54862 could not be found. Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5b710d55-fc7a-484b-872c-690a16b6be7c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Request method failure captured: Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 HTTP/1.1 Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH3q8ZxW58OcTHBhLMIgDxlgk4ppaXm_caO3dB_8EXApfxgfmqw2A0us7SX0zdazXiJAKc3mJfQPCPbxtQfFLv_eYezo3J-RQ0oXLOz3WdCapakuuNGedYH5aO6DAudWwI4u5umckM9WXQyKn-e03YJLLhbeNq68HNmu38V8-wVGhC8 Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 36a174adc9794d23b38c2bafd8a3f1c6 Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesOneServerTestJSON-717376210 Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36a174adc9794d23b38c2bafd8a3f1c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36a174adc9794d23b38c2bafd8a3f1c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36a174adc9794d23b38c2bafd8a3f1c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36a174adc9794d23b38c2bafd8a3f1c6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesOneServerTestJSON-717376210 Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 36a174adc9794d23b38c2bafd8a3f1c6 Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-717376210 Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesOneServerTestJSON-717376210-project Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 34a454a03ab64d4eab179c11a5165ce0 Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesOneServerTestJSON-717376210-project Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 71b41540-956c-41c7-8396-3bcbcfc54862 could not be found. Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '71b41540-956c-41c7-8396-3bcbcfc54862'} Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b41540-956c-41c7-8396-3bcbcfc54862 could not be found. Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b41540-956c-41c7-8396-3bcbcfc54862 could not be found. Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:14:21.276621 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:21.280522 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:21.280522 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:14:21.280522 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:14:21.280522 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:14:21.280522 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:14:21.280522 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b41540-956c-41c7-8396-3bcbcfc54862 could not be found. Oct 29 01:14:21.280522 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:21.287499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-32770877-e1c1-4640-a95c-4ba6735ecfd3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:21.288697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-32770877-e1c1-4640-a95c-4ba6735ecfd3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:21.291796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:21.297860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5b710d55-fc7a-484b-872c-690a16b6be7c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] Returning 404 to user: Instance 71b41540-956c-41c7-8396-3bcbcfc54862 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:14:21.300501 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5b710d55-fc7a-484b-872c-690a16b6be7c tempest-ImagesOneServerTestJSON-717376210 tempest-ImagesOneServerTestJSON-717376210-project] 10.222.0.26 "GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862" status: 404 len: 111 microversion: 2.1 time: 0.084451 Oct 29 01:14:21.302792 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1292/2506] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:21 2022] GET /compute/v2.1/servers/71b41540-956c-41c7-8396-3bcbcfc54862 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:14:21.308514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32770877-e1c1-4640-a95c-4ba6735ecfd3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:21.311581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32770877-e1c1-4640-a95c-4ba6735ecfd3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:21.312746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32770877-e1c1-4640-a95c-4ba6735ecfd3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:21.317536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32770877-e1c1-4640-a95c-4ba6735ecfd3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:21.318257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32770877-e1c1-4640-a95c-4ba6735ecfd3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:21.318856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32770877-e1c1-4640-a95c-4ba6735ecfd3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:21.408879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:21.449997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-162c2013-bcf7-45bc-bf5d-8161b35fc989 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:21.450625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-162c2013-bcf7-45bc-bf5d-8161b35fc989 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:21.461388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-162c2013-bcf7-45bc-bf5d-8161b35fc989 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:21.462409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-162c2013-bcf7-45bc-bf5d-8161b35fc989 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:21.464502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-162c2013-bcf7-45bc-bf5d-8161b35fc989 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:21.465549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-162c2013-bcf7-45bc-bf5d-8161b35fc989 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:21.466180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-162c2013-bcf7-45bc-bf5d-8161b35fc989 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:21.469012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-162c2013-bcf7-45bc-bf5d-8161b35fc989 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:21.856255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-32770877-e1c1-4640-a95c-4ba6735ecfd3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:21.866521 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-32770877-e1c1-4640-a95c-4ba6735ecfd3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1382 microversion: 2.1 time: 0.583675 Oct 29 01:14:21.867106 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1215/2507] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:21 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1382 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:21.877804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-25cf4f32-3aca-4ff7-9d14-c949151dd6a1 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:21.877804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-25cf4f32-3aca-4ff7-9d14-c949151dd6a1 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:21.882348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-25cf4f32-3aca-4ff7-9d14-c949151dd6a1 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:21.883541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-25cf4f32-3aca-4ff7-9d14-c949151dd6a1 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:21.884077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-25cf4f32-3aca-4ff7-9d14-c949151dd6a1 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:21.884944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-25cf4f32-3aca-4ff7-9d14-c949151dd6a1 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:21.885608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-25cf4f32-3aca-4ff7-9d14-c949151dd6a1 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:21.886184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-25cf4f32-3aca-4ff7-9d14-c949151dd6a1 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:22.093596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-25cf4f32-3aca-4ff7-9d14-c949151dd6a1 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:22.104126 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-25cf4f32-3aca-4ff7-9d14-c949151dd6a1 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1277 microversion: 2.1 time: 0.235611 Oct 29 01:14:22.105408 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1216/2508] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:21 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1277 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:22.114040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7abb95a3-9ea1-4426-badb-802f21ef88b9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:22.114988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7abb95a3-9ea1-4426-badb-802f21ef88b9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:22.127114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-162c2013-bcf7-45bc-bf5d-8161b35fc989 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:22.141416 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-162c2013-bcf7-45bc-bf5d-8161b35fc989 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1313 microversion: 2.1 time: 0.695605 Oct 29 01:14:22.144644 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1293/2509] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:21 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1313 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:22.154508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7abb95a3-9ea1-4426-badb-802f21ef88b9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:22.155391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7abb95a3-9ea1-4426-badb-802f21ef88b9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:22.167110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2d574d97-d541-4c85-8381-4fda9f393c1e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:22.171286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2d574d97-d541-4c85-8381-4fda9f393c1e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:22.176640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7abb95a3-9ea1-4426-badb-802f21ef88b9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:22.177781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7abb95a3-9ea1-4426-badb-802f21ef88b9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:22.187040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7abb95a3-9ea1-4426-badb-802f21ef88b9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:22.190078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7abb95a3-9ea1-4426-badb-802f21ef88b9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:22.193256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d574d97-d541-4c85-8381-4fda9f393c1e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:22.195053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d574d97-d541-4c85-8381-4fda9f393c1e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:22.198002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d574d97-d541-4c85-8381-4fda9f393c1e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:22.200260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d574d97-d541-4c85-8381-4fda9f393c1e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:22.202774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d574d97-d541-4c85-8381-4fda9f393c1e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:22.203946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d574d97-d541-4c85-8381-4fda9f393c1e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:22.885423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2d574d97-d541-4c85-8381-4fda9f393c1e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:22.891158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7abb95a3-9ea1-4426-badb-802f21ef88b9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:22.902353 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2d574d97-d541-4c85-8381-4fda9f393c1e tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1511 microversion: 2.1 time: 0.755445 Oct 29 01:14:22.903342 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1294/2510] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:22 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1511 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:22.907368 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7abb95a3-9ea1-4426-badb-802f21ef88b9 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1319 microversion: 2.1 time: 0.800563 Oct 29 01:14:22.908619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eee9b3d0-a936-4cf4-aff2-a1756bf09c1f tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '.version_select at 0x7f9d96fe8040>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:22.912366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eee9b3d0-a936-4cf4-aff2-a1756bf09c1f tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:22.913049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eee9b3d0-a936-4cf4-aff2-a1756bf09c1f tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:22.914136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eee9b3d0-a936-4cf4-aff2-a1756bf09c1f tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:22.921544 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1217/2511] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:22 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1319 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:22.933358 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eee9b3d0-a936-4cf4-aff2-a1756bf09c1f tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.028358 Oct 29 01:14:22.944986 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1295/2512] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 29 01:14:22 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:22.952251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ee0b1ba1-2afd-47a4-88be-1bd91fbbe891 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:22.953198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ee0b1ba1-2afd-47a4-88be-1bd91fbbe891 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:22.989407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee0b1ba1-2afd-47a4-88be-1bd91fbbe891 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:22.989942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee0b1ba1-2afd-47a4-88be-1bd91fbbe891 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:22.991405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee0b1ba1-2afd-47a4-88be-1bd91fbbe891 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:22.992632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee0b1ba1-2afd-47a4-88be-1bd91fbbe891 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:22.993275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee0b1ba1-2afd-47a4-88be-1bd91fbbe891 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:22.993853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee0b1ba1-2afd-47a4-88be-1bd91fbbe891 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:23.150800 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-9f30873c-c98a-4670-8d21-06d2935ff8bc req-6d7c1728-8640-4882-ac04-4b718c9e75dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b88cce5a-4c01-4354-895a-54148d701f7c", "tag": "3cdeecea-ff58-4590-b370-37477a47edc3"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:23.161668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9f30873c-c98a-4670-8d21-06d2935ff8bc req-6d7c1728-8640-4882-ac04-4b718c9e75dd service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:23.162262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9f30873c-c98a-4670-8d21-06d2935ff8bc req-6d7c1728-8640-4882-ac04-4b718c9e75dd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:23.162706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9f30873c-c98a-4670-8d21-06d2935ff8bc req-6d7c1728-8640-4882-ac04-4b718c9e75dd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:23.175801 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-9f30873c-c98a-4670-8d21-06d2935ff8bc req-6d7c1728-8640-4882-ac04-4b718c9e75dd service nova] Creating event network-changed:3cdeecea-ff58-4590-b370-37477a47edc3 for instance b88cce5a-4c01-4354-895a-54148d701f7c on n-h1-862964-3 Oct 29 01:14:23.181428 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-9f30873c-c98a-4670-8d21-06d2935ff8bc req-6d7c1728-8640-4882-ac04-4b718c9e75dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258359 Oct 29 01:14:23.182833 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1218/2513] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:23.188642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2d7874fc-ab38-4581-b372-0b200d28b924 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:23.190810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2d7874fc-ab38-4581-b372-0b200d28b924 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:23.195864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d7874fc-ab38-4581-b372-0b200d28b924 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:23.196544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d7874fc-ab38-4581-b372-0b200d28b924 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:23.197202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d7874fc-ab38-4581-b372-0b200d28b924 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:23.198102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d7874fc-ab38-4581-b372-0b200d28b924 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:23.199285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d7874fc-ab38-4581-b372-0b200d28b924 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:23.199285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d7874fc-ab38-4581-b372-0b200d28b924 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:23.249127 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ee0b1ba1-2afd-47a4-88be-1bd91fbbe891 tempest-LiveMigrationTest-589971035 tempest-LiveMigrationTest-589971035-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1533 microversion: 2.1 time: 0.297554 Oct 29 01:14:23.249127 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1296/2514] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:22 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1533 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:23.251549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d73e4a42-b3de-4372-8e11-74dfd2defc83 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:23.252422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d73e4a42-b3de-4372-8e11-74dfd2defc83 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:23.260154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d73e4a42-b3de-4372-8e11-74dfd2defc83 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:23.260924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d73e4a42-b3de-4372-8e11-74dfd2defc83 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:23.261749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d73e4a42-b3de-4372-8e11-74dfd2defc83 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:23.263079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d73e4a42-b3de-4372-8e11-74dfd2defc83 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:23.280221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d73e4a42-b3de-4372-8e11-74dfd2defc83 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:23.280221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d73e4a42-b3de-4372-8e11-74dfd2defc83 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:23.297321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2d7874fc-ab38-4581-b372-0b200d28b924 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:23.314369 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2d7874fc-ab38-4581-b372-0b200d28b924 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1283 microversion: 2.1 time: 0.130211 Oct 29 01:14:23.316287 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1219/2515] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:23 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1283 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:23.329138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5e972348-3772-46ee-9b47-5d665a1f9430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:23.329682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5e972348-3772-46ee-9b47-5d665a1f9430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:23.347911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e972348-3772-46ee-9b47-5d665a1f9430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:23.352154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e972348-3772-46ee-9b47-5d665a1f9430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:23.352154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e972348-3772-46ee-9b47-5d665a1f9430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:23.353931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e972348-3772-46ee-9b47-5d665a1f9430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:23.354981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e972348-3772-46ee-9b47-5d665a1f9430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:23.356094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e972348-3772-46ee-9b47-5d665a1f9430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:23.416117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5e972348-3772-46ee-9b47-5d665a1f9430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:14:23.509553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d73e4a42-b3de-4372-8e11-74dfd2defc83 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:23.525111 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d73e4a42-b3de-4372-8e11-74dfd2defc83 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1313 microversion: 2.1 time: 0.278909 Oct 29 01:14:23.533615 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1297/2516] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:23 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:23.620405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-998e109b-6917-46f5-a2ef-652400823ca8 req-eb39cc1a-7596-40b6-9c66-f1f5352c8551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "756326f6-781c-4fad-a611-b908891aed66", "tag": "57bdfbf3-fabe-41ec-b284-ce6b9d6eaa5a"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:23.631339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-998e109b-6917-46f5-a2ef-652400823ca8 req-eb39cc1a-7596-40b6-9c66-f1f5352c8551 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:23.631753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-998e109b-6917-46f5-a2ef-652400823ca8 req-eb39cc1a-7596-40b6-9c66-f1f5352c8551 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:23.632207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-998e109b-6917-46f5-a2ef-652400823ca8 req-eb39cc1a-7596-40b6-9c66-f1f5352c8551 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:23.645459 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-998e109b-6917-46f5-a2ef-652400823ca8 req-eb39cc1a-7596-40b6-9c66-f1f5352c8551 service nova] Creating event network-changed:57bdfbf3-fabe-41ec-b284-ce6b9d6eaa5a for instance 756326f6-781c-4fad-a611-b908891aed66 on n-h1-862964-3 Oct 29 01:14:23.650979 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-998e109b-6917-46f5-a2ef-652400823ca8 req-eb39cc1a-7596-40b6-9c66-f1f5352c8551 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039648 Oct 29 01:14:23.652551 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1298/2517] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:14:23.932978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6f0e070b-b6a5-45b5-94e1-ec07f9e7ac1a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:23.932978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6f0e070b-b6a5-45b5-94e1-ec07f9e7ac1a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:23.940443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f0e070b-b6a5-45b5-94e1-ec07f9e7ac1a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:23.941035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f0e070b-b6a5-45b5-94e1-ec07f9e7ac1a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:23.941501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f0e070b-b6a5-45b5-94e1-ec07f9e7ac1a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:23.942203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f0e070b-b6a5-45b5-94e1-ec07f9e7ac1a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:23.942655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f0e070b-b6a5-45b5-94e1-ec07f9e7ac1a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:23.943074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f0e070b-b6a5-45b5-94e1-ec07f9e7ac1a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:23.964959 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5e972348-3772-46ee-9b47-5d665a1f9430 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "DELETE /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 204 len: 0 microversion: 2.1 time: 0.645689 Oct 29 01:14:23.966241 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1220/2518] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:14:23 2022] DELETE /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:14:23.972236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7b722b76-3aa7-4196-9a98-164f5e1aded5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:23.973287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7b722b76-3aa7-4196-9a98-164f5e1aded5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:23.979529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b722b76-3aa7-4196-9a98-164f5e1aded5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:23.980074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b722b76-3aa7-4196-9a98-164f5e1aded5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:23.980843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b722b76-3aa7-4196-9a98-164f5e1aded5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:23.981593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b722b76-3aa7-4196-9a98-164f5e1aded5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:23.982055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b722b76-3aa7-4196-9a98-164f5e1aded5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:23.982534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b722b76-3aa7-4196-9a98-164f5e1aded5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:24.216070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6f0e070b-b6a5-45b5-94e1-ec07f9e7ac1a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:24.238695 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6f0e070b-b6a5-45b5-94e1-ec07f9e7ac1a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1488 microversion: 2.1 time: 0.311803 Oct 29 01:14:24.241929 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1299/2519] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:23 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1488 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:24.247216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7b722b76-3aa7-4196-9a98-164f5e1aded5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:24.250799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-af308917-f9c9-4639-85e5-c6a038898bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:24.251913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-af308917-f9c9-4639-85e5-c6a038898bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:24.274210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af308917-f9c9-4639-85e5-c6a038898bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:24.275492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af308917-f9c9-4639-85e5-c6a038898bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:24.276224 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7b722b76-3aa7-4196-9a98-164f5e1aded5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 200 len: 1506 microversion: 2.1 time: 0.308406 Oct 29 01:14:24.277024 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1221/2520] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:23 2022] GET /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:24.278056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af308917-f9c9-4639-85e5-c6a038898bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:24.278806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af308917-f9c9-4639-85e5-c6a038898bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:24.280248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af308917-f9c9-4639-85e5-c6a038898bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:24.280902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af308917-f9c9-4639-85e5-c6a038898bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:24.309304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-91abeb72-a938-438a-b311-92e4da4193f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:24.310329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-91abeb72-a938-438a-b311-92e4da4193f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:24.318756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91abeb72-a938-438a-b311-92e4da4193f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:24.319585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91abeb72-a938-438a-b311-92e4da4193f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:24.320368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91abeb72-a938-438a-b311-92e4da4193f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:24.321816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91abeb72-a938-438a-b311-92e4da4193f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:24.322712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91abeb72-a938-438a-b311-92e4da4193f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:24.323464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91abeb72-a938-438a-b311-92e4da4193f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:24.375278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-91abeb72-a938-438a-b311-92e4da4193f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:14:24.617248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-af308917-f9c9-4639-85e5-c6a038898bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:24.626203 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-af308917-f9c9-4639-85e5-c6a038898bff tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1388 microversion: 2.1 time: 0.383033 Oct 29 01:14:24.627149 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1300/2521] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:24 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1388 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:24.631970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b0bfb714-982a-40f6-aaef-c23febfb8b3e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:24.632742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b0bfb714-982a-40f6-aaef-c23febfb8b3e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 6068e5d6-cd2f-48c1-a7aa-6c28ee2684ff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:24.639766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0bfb714-982a-40f6-aaef-c23febfb8b3e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:24.640447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0bfb714-982a-40f6-aaef-c23febfb8b3e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:24.641083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0bfb714-982a-40f6-aaef-c23febfb8b3e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:24.641941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0bfb714-982a-40f6-aaef-c23febfb8b3e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:24.642560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0bfb714-982a-40f6-aaef-c23febfb8b3e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:24.643127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0bfb714-982a-40f6-aaef-c23febfb8b3e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:24.701187 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-91abeb72-a938-438a-b311-92e4da4193f5 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 204 len: 0 microversion: 2.1 time: 0.420780 Oct 29 01:14:24.702334 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1222/2522] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:14:24 2022] DELETE /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:14:24.717316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3464fca5-d574-476a-a096-e1a0a61cc53f tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:24.717316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3464fca5-d574-476a-a096-e1a0a61cc53f tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:24.717316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3464fca5-d574-476a-a096-e1a0a61cc53f tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:24.717316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3464fca5-d574-476a-a096-e1a0a61cc53f tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:24.717316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3464fca5-d574-476a-a096-e1a0a61cc53f tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:24.717316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3464fca5-d574-476a-a096-e1a0a61cc53f tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:24.717316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3464fca5-d574-476a-a096-e1a0a61cc53f tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:24.717937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3464fca5-d574-476a-a096-e1a0a61cc53f tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:24.844571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b0bfb714-982a-40f6-aaef-c23febfb8b3e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:24.853106 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b0bfb714-982a-40f6-aaef-c23febfb8b3e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/6068e5d6-cd2f-48c1-a7aa-6c28ee2684ff" status: 200 len: 1506 microversion: 2.1 time: 0.224801 Oct 29 01:14:24.865390 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1301/2523] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:24 2022] GET /compute/v2.1/servers/6068e5d6-cd2f-48c1-a7aa-6c28ee2684ff => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:24.874900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-843aca10-4695-4f86-ad33-ecf0620a55cd tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:24.875571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-843aca10-4695-4f86-ad33-ecf0620a55cd tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:24.890383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-843aca10-4695-4f86-ad33-ecf0620a55cd tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:24.891169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-843aca10-4695-4f86-ad33-ecf0620a55cd tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:24.891617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-843aca10-4695-4f86-ad33-ecf0620a55cd tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:24.892428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-843aca10-4695-4f86-ad33-ecf0620a55cd tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:24.893583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-843aca10-4695-4f86-ad33-ecf0620a55cd tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:24.894463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-843aca10-4695-4f86-ad33-ecf0620a55cd tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:24.930927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3464fca5-d574-476a-a096-e1a0a61cc53f tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:24.972461 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3464fca5-d574-476a-a096-e1a0a61cc53f tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1325 microversion: 2.1 time: 0.267797 Oct 29 01:14:24.975646 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1223/2524] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:24 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1325 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:24.986474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4c7935ed-5efb-49e3-abb6-d28452a86f41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:24.987823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4c7935ed-5efb-49e3-abb6-d28452a86f41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:25.001600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c7935ed-5efb-49e3-abb6-d28452a86f41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:25.002459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c7935ed-5efb-49e3-abb6-d28452a86f41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:25.003455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c7935ed-5efb-49e3-abb6-d28452a86f41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:25.004989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c7935ed-5efb-49e3-abb6-d28452a86f41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:25.015404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c7935ed-5efb-49e3-abb6-d28452a86f41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:25.015892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c7935ed-5efb-49e3-abb6-d28452a86f41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:25.025387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:25.151329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-843aca10-4695-4f86-ad33-ecf0620a55cd tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:25.159314 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-843aca10-4695-4f86-ad33-ecf0620a55cd tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1313 microversion: 2.1 time: 0.292424 Oct 29 01:14:25.159913 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1302/2525] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:24 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:25.183049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-de2cd77e-b34a-485e-b202-ececd237d42e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:25.183049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-de2cd77e-b34a-485e-b202-ececd237d42e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 6068e5d6-cd2f-48c1-a7aa-6c28ee2684ff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:25.183552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de2cd77e-b34a-485e-b202-ececd237d42e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:25.184052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de2cd77e-b34a-485e-b202-ececd237d42e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:25.184651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de2cd77e-b34a-485e-b202-ececd237d42e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:25.186524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de2cd77e-b34a-485e-b202-ececd237d42e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:25.187000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de2cd77e-b34a-485e-b202-ececd237d42e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:25.187429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de2cd77e-b34a-485e-b202-ececd237d42e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:25.214385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4c7935ed-5efb-49e3-abb6-d28452a86f41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:25.215272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-de2cd77e-b34a-485e-b202-ececd237d42e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 6068e5d6-cd2f-48c1-a7aa-6c28ee2684ff] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:14:25.225107 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4c7935ed-5efb-49e3-abb6-d28452a86f41 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1494 microversion: 2.1 time: 0.247442 Oct 29 01:14:25.225694 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1224/2526] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:24 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1494 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:25.415486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-c504ec79-7739-4600-abc6-b1cff98e8b84 req-6d533052-41cb-4179-86b4-9af036c967a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c277e3-48a6-4a97-9e52-689482955506", "tag": "db5809d9-cc6a-4331-aa7f-a691edfa6ab0"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:25.428023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c504ec79-7739-4600-abc6-b1cff98e8b84 req-6d533052-41cb-4179-86b4-9af036c967a2 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:25.429736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c504ec79-7739-4600-abc6-b1cff98e8b84 req-6d533052-41cb-4179-86b4-9af036c967a2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:25.429736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c504ec79-7739-4600-abc6-b1cff98e8b84 req-6d533052-41cb-4179-86b4-9af036c967a2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:25.441620 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-c504ec79-7739-4600-abc6-b1cff98e8b84 req-6d533052-41cb-4179-86b4-9af036c967a2 service nova] Creating event network-changed:db5809d9-cc6a-4331-aa7f-a691edfa6ab0 for instance 78c277e3-48a6-4a97-9e52-689482955506 on n-h2-862964-3 Oct 29 01:14:25.447478 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-c504ec79-7739-4600-abc6-b1cff98e8b84 req-6d533052-41cb-4179-86b4-9af036c967a2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035532 Oct 29 01:14:25.448753 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1225/2527] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:25.507724 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-de2cd77e-b34a-485e-b202-ececd237d42e tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6068e5d6-cd2f-48c1-a7aa-6c28ee2684ff" status: 204 len: 0 microversion: 2.1 time: 0.346292 Oct 29 01:14:25.508324 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1303/2528] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:14:25 2022] DELETE /compute/v2.1/servers/6068e5d6-cd2f-48c1-a7aa-6c28ee2684ff => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:14:25.517870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e17f1920-1f5d-44fb-8aa1-1f39f72d7a07 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:25.518491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e17f1920-1f5d-44fb-8aa1-1f39f72d7a07 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:25.525342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e17f1920-1f5d-44fb-8aa1-1f39f72d7a07 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:25.525832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e17f1920-1f5d-44fb-8aa1-1f39f72d7a07 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:25.526271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e17f1920-1f5d-44fb-8aa1-1f39f72d7a07 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:25.527127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e17f1920-1f5d-44fb-8aa1-1f39f72d7a07 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:25.527579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e17f1920-1f5d-44fb-8aa1-1f39f72d7a07 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:25.528006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e17f1920-1f5d-44fb-8aa1-1f39f72d7a07 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:25.555823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e17f1920-1f5d-44fb-8aa1-1f39f72d7a07 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:14:25.653139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6eaed97d-9bad-4b5f-b079-b35c5794288d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:25.653885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6eaed97d-9bad-4b5f-b079-b35c5794288d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:25.660857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6eaed97d-9bad-4b5f-b079-b35c5794288d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:25.661605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6eaed97d-9bad-4b5f-b079-b35c5794288d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:25.662046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6eaed97d-9bad-4b5f-b079-b35c5794288d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:25.662922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6eaed97d-9bad-4b5f-b079-b35c5794288d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:25.663544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6eaed97d-9bad-4b5f-b079-b35c5794288d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:25.664127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6eaed97d-9bad-4b5f-b079-b35c5794288d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:25.866934 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e17f1920-1f5d-44fb-8aa1-1f39f72d7a07 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7" status: 204 len: 0 microversion: 2.1 time: 0.353727 Oct 29 01:14:25.869764 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1226/2529] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:14:25 2022] DELETE /compute/v2.1/servers/2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:14:25.916326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6eaed97d-9bad-4b5f-b079-b35c5794288d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:25.925283 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6eaed97d-9bad-4b5f-b079-b35c5794288d tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1388 microversion: 2.1 time: 0.278204 Oct 29 01:14:25.926016 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1304/2530] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:25 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1388 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:25.987869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a5caf926-74a3-4236-917c-41eb9908811c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1218238821", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "1ca9e574-496a-4a8a-8b4d-3f828f1809d3"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:26.000234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1949aa53-017e-4667-b56d-2436ee35db7d tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:26.000847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1949aa53-017e-4667-b56d-2436ee35db7d tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:26.007645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1949aa53-017e-4667-b56d-2436ee35db7d tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:26.008151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1949aa53-017e-4667-b56d-2436ee35db7d tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:26.008654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1949aa53-017e-4667-b56d-2436ee35db7d tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:26.009378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1949aa53-017e-4667-b56d-2436ee35db7d tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:26.009872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1949aa53-017e-4667-b56d-2436ee35db7d tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:26.010285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1949aa53-017e-4667-b56d-2436ee35db7d tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:26.068764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-a5caf926-74a3-4236-917c-41eb9908811c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] validate_networks() for [('1ca9e574-496a-4a8a-8b4d-3f828f1809d3', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:14:26.386244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1949aa53-017e-4667-b56d-2436ee35db7d tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:26.400852 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1949aa53-017e-4667-b56d-2436ee35db7d tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1325 microversion: 2.1 time: 0.405241 Oct 29 01:14:26.415561 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1305/2531] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:25 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1325 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:26.419984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-751a79a4-0f2c-4754-9913-1a6677ee227d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:26.420849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-751a79a4-0f2c-4754-9913-1a6677ee227d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:26.428283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-751a79a4-0f2c-4754-9913-1a6677ee227d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:26.428780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-751a79a4-0f2c-4754-9913-1a6677ee227d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:26.429251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-751a79a4-0f2c-4754-9913-1a6677ee227d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:26.430154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-751a79a4-0f2c-4754-9913-1a6677ee227d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:26.430621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-751a79a4-0f2c-4754-9913-1a6677ee227d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:26.431193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-751a79a4-0f2c-4754-9913-1a6677ee227d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:26.990040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-751a79a4-0f2c-4754-9913-1a6677ee227d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:27.000670 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-751a79a4-0f2c-4754-9913-1a6677ee227d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1313 microversion: 2.1 time: 0.584840 Oct 29 01:14:27.001391 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1306/2532] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:26 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1313 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:27.007249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fcf8dca8-d7dc-4f73-8076-b6d423f2556a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:27.008141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fcf8dca8-d7dc-4f73-8076-b6d423f2556a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:27.016521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fcf8dca8-d7dc-4f73-8076-b6d423f2556a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:27.017239 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fcf8dca8-d7dc-4f73-8076-b6d423f2556a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:27.017938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fcf8dca8-d7dc-4f73-8076-b6d423f2556a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:27.018846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fcf8dca8-d7dc-4f73-8076-b6d423f2556a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:27.023840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fcf8dca8-d7dc-4f73-8076-b6d423f2556a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:27.023840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fcf8dca8-d7dc-4f73-8076-b6d423f2556a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:27.128784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-a5caf926-74a3-4236-917c-41eb9908811c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:14:27.129289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-a5caf926-74a3-4236-917c-41eb9908811c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:14:27.129759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-a5caf926-74a3-4236-917c-41eb9908811c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:14:27.130148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-a5caf926-74a3-4236-917c-41eb9908811c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:14:27.130557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-a5caf926-74a3-4236-917c-41eb9908811c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:14:27.144147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a5caf926-74a3-4236-917c-41eb9908811c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:27.144821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a5caf926-74a3-4236-917c-41eb9908811c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:27.145337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a5caf926-74a3-4236-917c-41eb9908811c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:27.146576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a5caf926-74a3-4236-917c-41eb9908811c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:27.147036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a5caf926-74a3-4236-917c-41eb9908811c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:27.147462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a5caf926-74a3-4236-917c-41eb9908811c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:27.171571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-a5caf926-74a3-4236-917c-41eb9908811c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Getting quotas for project 9d0066a293d6440fb9f5c55b3d636d51. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:14:27.178367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-a5caf926-74a3-4236-917c-41eb9908811c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Getting quotas for user 187158ff3fc04e5789d8865fee46f01f and project 9d0066a293d6440fb9f5c55b3d636d51. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:14:27.192333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fcf8dca8-d7dc-4f73-8076-b6d423f2556a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:27.202654 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fcf8dca8-d7dc-4f73-8076-b6d423f2556a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1494 microversion: 2.1 time: 0.200024 Oct 29 01:14:27.203417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a5caf926-74a3-4236-917c-41eb9908811c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Going to run 2 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:14:27.206880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a5caf926-74a3-4236-917c-41eb9908811c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 101e0729-34a2-439c-8ee6-23afc29b2fbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:14:27.218896 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1307/2533] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:27 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1494 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:27.226220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0eec7e0c-8474-4c5d-8443-b9d05d5efa51 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:27.227183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0eec7e0c-8474-4c5d-8443-b9d05d5efa51 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:27.247207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0eec7e0c-8474-4c5d-8443-b9d05d5efa51 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:27.249925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0eec7e0c-8474-4c5d-8443-b9d05d5efa51 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:27.250687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0eec7e0c-8474-4c5d-8443-b9d05d5efa51 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:27.251579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0eec7e0c-8474-4c5d-8443-b9d05d5efa51 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:27.252367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0eec7e0c-8474-4c5d-8443-b9d05d5efa51 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:27.252521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0eec7e0c-8474-4c5d-8443-b9d05d5efa51 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:27.274200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:27.330675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a5caf926-74a3-4236-917c-41eb9908811c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=101e0729-34a2-439c-8ee6-23afc29b2fbe,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:14:27.427356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0eec7e0c-8474-4c5d-8443-b9d05d5efa51 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:27.436439 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0eec7e0c-8474-4c5d-8443-b9d05d5efa51 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1388 microversion: 2.1 time: 0.215703 Oct 29 01:14:27.437694 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1308/2534] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:27 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1388 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:27.442604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f0b357bc-cd48-41b5-99c4-829032fd4776 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:27.443743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f0b357bc-cd48-41b5-99c4-829032fd4776 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:27.449311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0b357bc-cd48-41b5-99c4-829032fd4776 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:27.450155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0b357bc-cd48-41b5-99c4-829032fd4776 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:27.450911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0b357bc-cd48-41b5-99c4-829032fd4776 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:27.452298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0b357bc-cd48-41b5-99c4-829032fd4776 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:27.452945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0b357bc-cd48-41b5-99c4-829032fd4776 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:27.453435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0b357bc-cd48-41b5-99c4-829032fd4776 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:27.521452 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a5caf926-74a3-4236-917c-41eb9908811c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.544672 Oct 29 01:14:27.523863 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1227/2535] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:14:25 2022] POST /compute/v2.1/servers => generated 32 bytes in 1549 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 29 01:14:27.540701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-067e4d6a-2a9e-475c-b077-2af78d29824f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:27.552527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-067e4d6a-2a9e-475c-b077-2af78d29824f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:27.553546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-067e4d6a-2a9e-475c-b077-2af78d29824f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Searching by: {'deleted': False, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:14:27.594937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-067e4d6a-2a9e-475c-b077-2af78d29824f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:27.597279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-067e4d6a-2a9e-475c-b077-2af78d29824f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:27.597767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-067e4d6a-2a9e-475c-b077-2af78d29824f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:27.598540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-067e4d6a-2a9e-475c-b077-2af78d29824f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:27.599010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-067e4d6a-2a9e-475c-b077-2af78d29824f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:27.599442 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-067e4d6a-2a9e-475c-b077-2af78d29824f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:27.648536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.multi_cell_list [None req-067e4d6a-2a9e-475c-b077-2af78d29824f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=121100) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:14:27.652340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f0b357bc-cd48-41b5-99c4-829032fd4776 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:27.662690 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f0b357bc-cd48-41b5-99c4-829032fd4776 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1325 microversion: 2.1 time: 0.223886 Oct 29 01:14:27.664178 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1309/2536] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:27 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1325 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:27.680921 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-067e4d6a-2a9e-475c-b077-2af78d29824f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.153993 Oct 29 01:14:27.689315 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1228/2537] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 29 01:14:27 2022] GET /compute/v2.1/servers => generated 1335 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:27.695988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-067c671a-cba8-4337-be09-d1a080b55727 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:27.695988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-067c671a-cba8-4337-be09-d1a080b55727 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:27.777574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-067c671a-cba8-4337-be09-d1a080b55727 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:27.786411 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-067c671a-cba8-4337-be09-d1a080b55727 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1218 microversion: 2.1 time: 0.095034 Oct 29 01:14:27.789199 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1310/2538] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:27 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:28.027833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3e5fa444-daea-4de7-acee-880e86e585f5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:28.029512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3e5fa444-daea-4de7-acee-880e86e585f5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:28.036883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e5fa444-daea-4de7-acee-880e86e585f5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:28.037528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e5fa444-daea-4de7-acee-880e86e585f5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:28.038063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e5fa444-daea-4de7-acee-880e86e585f5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:28.039033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e5fa444-daea-4de7-acee-880e86e585f5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:28.039561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e5fa444-daea-4de7-acee-880e86e585f5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:28.040524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e5fa444-daea-4de7-acee-880e86e585f5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:28.237860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:28.613619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8eb04be7-c464-4e90-a212-d8b00c5b6d42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:28.614250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8eb04be7-c464-4e90-a212-d8b00c5b6d42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:28.622878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8eb04be7-c464-4e90-a212-d8b00c5b6d42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:28.634668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8eb04be7-c464-4e90-a212-d8b00c5b6d42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:28.641384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8eb04be7-c464-4e90-a212-d8b00c5b6d42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:28.642365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8eb04be7-c464-4e90-a212-d8b00c5b6d42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:28.646089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8eb04be7-c464-4e90-a212-d8b00c5b6d42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:28.652378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8eb04be7-c464-4e90-a212-d8b00c5b6d42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:29.149404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8eb04be7-c464-4e90-a212-d8b00c5b6d42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:29.167367 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8eb04be7-c464-4e90-a212-d8b00c5b6d42 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1287 microversion: 2.1 time: 0.937009 Oct 29 01:14:29.168969 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1311/2539] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:28 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1287 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:29.186096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-b2993172-b7b0-467f-afcc-788123668f2e req-925f2a24-1aa1-4dff-879f-f9ee73c538ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ebe561-9b25-419d-b771-d5f2d212cfbb", "name": "network-vif-deleted", "tag": "c9bfa9ce-2881-44eb-bf9e-16eb902a3d6a"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:29.199179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3e5fa444-daea-4de7-acee-880e86e585f5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:29.217133 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3e5fa444-daea-4de7-acee-880e86e585f5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1313 microversion: 2.1 time: 1.186494 Oct 29 01:14:29.219986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:29.224355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b2993172-b7b0-467f-afcc-788123668f2e req-925f2a24-1aa1-4dff-879f-f9ee73c538ea service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:29.226865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b2993172-b7b0-467f-afcc-788123668f2e req-925f2a24-1aa1-4dff-879f-f9ee73c538ea service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:29.228148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b2993172-b7b0-467f-afcc-788123668f2e req-925f2a24-1aa1-4dff-879f-f9ee73c538ea service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:29.229688 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1229/2540] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:28 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1313 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:29.244848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1ac40f5e-6f3d-4133-9111-f83d61ce51ea tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:29.249282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1ac40f5e-6f3d-4133-9111-f83d61ce51ea tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:29.262501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ac40f5e-6f3d-4133-9111-f83d61ce51ea tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:29.265851 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-b2993172-b7b0-467f-afcc-788123668f2e req-925f2a24-1aa1-4dff-879f-f9ee73c538ea service nova] Creating event network-vif-deleted:c9bfa9ce-2881-44eb-bf9e-16eb902a3d6a for instance 24ebe561-9b25-419d-b771-d5f2d212cfbb on n-h2-862964-3 Oct 29 01:14:29.266367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ac40f5e-6f3d-4133-9111-f83d61ce51ea tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:29.266888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ac40f5e-6f3d-4133-9111-f83d61ce51ea tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:29.268243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ac40f5e-6f3d-4133-9111-f83d61ce51ea tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:29.272276 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-b2993172-b7b0-467f-afcc-788123668f2e req-925f2a24-1aa1-4dff-879f-f9ee73c538ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101260 Oct 29 01:14:29.272712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ac40f5e-6f3d-4133-9111-f83d61ce51ea tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:29.273411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ac40f5e-6f3d-4133-9111-f83d61ce51ea tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:29.273559 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1312/2541] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:29.280898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dd0d57c9-4866-4e4c-a071-39c5627de79b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:29.281667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dd0d57c9-4866-4e4c-a071-39c5627de79b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:29.289791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd0d57c9-4866-4e4c-a071-39c5627de79b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:29.290411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd0d57c9-4866-4e4c-a071-39c5627de79b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:29.290859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd0d57c9-4866-4e4c-a071-39c5627de79b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:29.291568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd0d57c9-4866-4e4c-a071-39c5627de79b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:29.293206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd0d57c9-4866-4e4c-a071-39c5627de79b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:29.294037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd0d57c9-4866-4e4c-a071-39c5627de79b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:29.525766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1ac40f5e-6f3d-4133-9111-f83d61ce51ea tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:29.541366 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1ac40f5e-6f3d-4133-9111-f83d61ce51ea tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1184 microversion: 2.1 time: 0.309859 Oct 29 01:14:29.558179 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1230/2542] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:29 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1184 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:29.559207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c38cd0be-139e-47b7-82ba-f5e9e1aae891 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:29.564742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c38cd0be-139e-47b7-82ba-f5e9e1aae891 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:29.678299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c38cd0be-139e-47b7-82ba-f5e9e1aae891 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:29.689967 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c38cd0be-139e-47b7-82ba-f5e9e1aae891 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1218 microversion: 2.1 time: 0.134674 Oct 29 01:14:29.690678 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1231/2543] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:29 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:29.971862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-6e3f329c-58fd-4ae4-8fe5-a48040d8a527 req-9d957652-5b6c-457e-9750-9ff391f55129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88cce5a-4c01-4354-895a-54148d701f7c", "name": "network-vif-plugged", "status": "completed", "tag": "3cdeecea-ff58-4590-b370-37477a47edc3"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:29.986859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dd0d57c9-4866-4e4c-a071-39c5627de79b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:29.994420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6e3f329c-58fd-4ae4-8fe5-a48040d8a527 req-9d957652-5b6c-457e-9750-9ff391f55129 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:29.995775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6e3f329c-58fd-4ae4-8fe5-a48040d8a527 req-9d957652-5b6c-457e-9750-9ff391f55129 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:29.998655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6e3f329c-58fd-4ae4-8fe5-a48040d8a527 req-9d957652-5b6c-457e-9750-9ff391f55129 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:30.000689 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dd0d57c9-4866-4e4c-a071-39c5627de79b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1325 microversion: 2.1 time: 0.725646 Oct 29 01:14:30.002196 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1313/2544] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:29 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1325 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:30.026610 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-6e3f329c-58fd-4ae4-8fe5-a48040d8a527 req-9d957652-5b6c-457e-9750-9ff391f55129 service nova] Creating event network-vif-plugged:3cdeecea-ff58-4590-b370-37477a47edc3 for instance b88cce5a-4c01-4354-895a-54148d701f7c on n-h1-862964-3 Oct 29 01:14:30.040249 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-6e3f329c-58fd-4ae4-8fe5-a48040d8a527 req-9d957652-5b6c-457e-9750-9ff391f55129 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067384 Oct 29 01:14:30.045474 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1232/2545] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:30.191260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4ae852dc-1f1f-465d-81f4-80624df602cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:30.192133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4ae852dc-1f1f-465d-81f4-80624df602cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:30.228302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ae852dc-1f1f-465d-81f4-80624df602cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:30.238045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ae852dc-1f1f-465d-81f4-80624df602cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:30.238749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ae852dc-1f1f-465d-81f4-80624df602cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:30.239845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ae852dc-1f1f-465d-81f4-80624df602cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:30.240832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ae852dc-1f1f-465d-81f4-80624df602cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:30.241484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ae852dc-1f1f-465d-81f4-80624df602cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:30.244513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cce2953e-210c-41c1-a137-5e319d6b150b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:30.245411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cce2953e-210c-41c1-a137-5e319d6b150b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:30.267735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cce2953e-210c-41c1-a137-5e319d6b150b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:30.268420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cce2953e-210c-41c1-a137-5e319d6b150b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:30.269015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cce2953e-210c-41c1-a137-5e319d6b150b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:30.270272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cce2953e-210c-41c1-a137-5e319d6b150b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:30.271030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cce2953e-210c-41c1-a137-5e319d6b150b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:30.271729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cce2953e-210c-41c1-a137-5e319d6b150b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:30.338123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ae852dc-1f1f-465d-81f4-80624df602cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:30.340479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ae852dc-1f1f-465d-81f4-80624df602cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:30.347788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ae852dc-1f1f-465d-81f4-80624df602cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:30.348431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-4ae852dc-1f1f-465d-81f4-80624df602cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lazy-loading 'fault' on Instance uuid a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:14:30.702948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4ae852dc-1f1f-465d-81f4-80624df602cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:30.726119 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4ae852dc-1f1f-465d-81f4-80624df602cd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1305 microversion: 2.1 time: 0.538679 Oct 29 01:14:30.729490 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1314/2546] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:30 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1305 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:30.742050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-30111556-0daa-464b-9785-d2e2f5bf9e9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:30.743232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-30111556-0daa-464b-9785-d2e2f5bf9e9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:30.751652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30111556-0daa-464b-9785-d2e2f5bf9e9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:30.752341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30111556-0daa-464b-9785-d2e2f5bf9e9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:30.752886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30111556-0daa-464b-9785-d2e2f5bf9e9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:30.753873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30111556-0daa-464b-9785-d2e2f5bf9e9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:30.754500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30111556-0daa-464b-9785-d2e2f5bf9e9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:30.755395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30111556-0daa-464b-9785-d2e2f5bf9e9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:30.826385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cce2953e-210c-41c1-a137-5e319d6b150b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:30.835388 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cce2953e-210c-41c1-a137-5e319d6b150b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1313 microversion: 2.1 time: 0.595443 Oct 29 01:14:30.838395 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1233/2547] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:30 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1313 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:30.844445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-afb8f67b-c36a-4d47-acc7-11086847fcf8 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:30.845356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-afb8f67b-c36a-4d47-acc7-11086847fcf8 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:30.847869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-30111556-0daa-464b-9785-d2e2f5bf9e9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:30.861470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afb8f67b-c36a-4d47-acc7-11086847fcf8 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:30.861988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afb8f67b-c36a-4d47-acc7-11086847fcf8 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:30.862435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afb8f67b-c36a-4d47-acc7-11086847fcf8 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:30.862860 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-30111556-0daa-464b-9785-d2e2f5bf9e9f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1184 microversion: 2.1 time: 0.131756 Oct 29 01:14:30.863164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afb8f67b-c36a-4d47-acc7-11086847fcf8 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:30.863636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afb8f67b-c36a-4d47-acc7-11086847fcf8 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:30.864061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afb8f67b-c36a-4d47-acc7-11086847fcf8 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:30.866925 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1315/2548] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:30 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1184 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:30.958233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-afb8f67b-c36a-4d47-acc7-11086847fcf8 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:30.966555 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-afb8f67b-c36a-4d47-acc7-11086847fcf8 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1270 microversion: 2.1 time: 0.126693 Oct 29 01:14:30.980965 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1234/2549] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:30 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1270 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:31.026679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c5fd7b95-b8b2-4862-ac8b-6773602f6ffd tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:31.027169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c5fd7b95-b8b2-4862-ac8b-6773602f6ffd tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:31.036465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5fd7b95-b8b2-4862-ac8b-6773602f6ffd tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:31.036965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5fd7b95-b8b2-4862-ac8b-6773602f6ffd tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:31.037419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5fd7b95-b8b2-4862-ac8b-6773602f6ffd tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:31.038126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5fd7b95-b8b2-4862-ac8b-6773602f6ffd tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:31.038578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5fd7b95-b8b2-4862-ac8b-6773602f6ffd tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:31.040615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5fd7b95-b8b2-4862-ac8b-6773602f6ffd tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:31.165680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-037554aa-691e-4c12-a096-71ac4c2a21be req-376ee840-130e-4804-8b0f-56f54f2276e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7", "name": "network-vif-deleted", "tag": "276338d2-9ccf-4af2-bdee-6a489385647d"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:31.188380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-037554aa-691e-4c12-a096-71ac4c2a21be req-376ee840-130e-4804-8b0f-56f54f2276e5 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:31.188863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-037554aa-691e-4c12-a096-71ac4c2a21be req-376ee840-130e-4804-8b0f-56f54f2276e5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:31.189377 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-037554aa-691e-4c12-a096-71ac4c2a21be req-376ee840-130e-4804-8b0f-56f54f2276e5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:31.232607 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-037554aa-691e-4c12-a096-71ac4c2a21be req-376ee840-130e-4804-8b0f-56f54f2276e5 service nova] Creating event network-vif-deleted:276338d2-9ccf-4af2-bdee-6a489385647d for instance 2e7aaeda-18ec-429f-b9c5-c5a9124ce4a7 on n-h1-862964-3 Oct 29 01:14:31.247129 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-037554aa-691e-4c12-a096-71ac4c2a21be req-376ee840-130e-4804-8b0f-56f54f2276e5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085036 Oct 29 01:14:31.247759 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1235/2550] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:14:31.352489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-30a63b05-f16b-4af4-b172-23b3e9fc1b30 req-073dfd23-6623-4c80-93cc-40117136038a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40f1fe3-0af2-43d1-a530-0960ed7c8eb3", "name": "network-vif-deleted", "tag": "82d33a0e-7fe8-4b63-8cfd-c90c7593d175"}, {"server_uuid": "6068e5d6-cd2f-48c1-a7aa-6c28ee2684ff", "name": "network-vif-deleted", "tag": "53469bc8-aa5e-4172-b572-b2c995e9c398"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:31.378354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-30a63b05-f16b-4af4-b172-23b3e9fc1b30 req-073dfd23-6623-4c80-93cc-40117136038a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:31.378844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-30a63b05-f16b-4af4-b172-23b3e9fc1b30 req-073dfd23-6623-4c80-93cc-40117136038a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:31.379323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-30a63b05-f16b-4af4-b172-23b3e9fc1b30 req-073dfd23-6623-4c80-93cc-40117136038a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:31.427523 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-30a63b05-f16b-4af4-b172-23b3e9fc1b30 req-073dfd23-6623-4c80-93cc-40117136038a service nova] Creating event network-vif-deleted:82d33a0e-7fe8-4b63-8cfd-c90c7593d175 for instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 on n-h2-862964-3 Oct 29 01:14:31.428381 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-30a63b05-f16b-4af4-b172-23b3e9fc1b30 req-073dfd23-6623-4c80-93cc-40117136038a service nova] Creating event network-vif-deleted:53469bc8-aa5e-4172-b572-b2c995e9c398 for instance 6068e5d6-cd2f-48c1-a7aa-6c28ee2684ff on n-h1-862964-3 Oct 29 01:14:31.447801 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-30a63b05-f16b-4af4-b172-23b3e9fc1b30 req-073dfd23-6623-4c80-93cc-40117136038a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.098398 Oct 29 01:14:31.449299 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1236/2551] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:31.605983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c5fd7b95-b8b2-4862-ac8b-6773602f6ffd tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:31.629333 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c5fd7b95-b8b2-4862-ac8b-6773602f6ffd tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1325 microversion: 2.1 time: 0.599594 Oct 29 01:14:31.629333 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1316/2552] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:31 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1325 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:31.761626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-03575604-d344-400a-9400-85dda8223464 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:31.764188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-03575604-d344-400a-9400-85dda8223464 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:31.783269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03575604-d344-400a-9400-85dda8223464 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:31.785428 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03575604-d344-400a-9400-85dda8223464 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:31.787373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03575604-d344-400a-9400-85dda8223464 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:31.788279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03575604-d344-400a-9400-85dda8223464 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:31.789570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03575604-d344-400a-9400-85dda8223464 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:31.791107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03575604-d344-400a-9400-85dda8223464 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:31.837959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03575604-d344-400a-9400-85dda8223464 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:31.838911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03575604-d344-400a-9400-85dda8223464 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:31.839598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03575604-d344-400a-9400-85dda8223464 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:31.840209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-03575604-d344-400a-9400-85dda8223464 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lazy-loading 'fault' on Instance uuid a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:14:31.869362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6459aea5-f0a2-4930-82d1-c5a7b2781689 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:31.871095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6459aea5-f0a2-4930-82d1-c5a7b2781689 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:31.881776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6459aea5-f0a2-4930-82d1-c5a7b2781689 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:31.882549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6459aea5-f0a2-4930-82d1-c5a7b2781689 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:31.883146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6459aea5-f0a2-4930-82d1-c5a7b2781689 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:31.884750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6459aea5-f0a2-4930-82d1-c5a7b2781689 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:31.885621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6459aea5-f0a2-4930-82d1-c5a7b2781689 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:31.886256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6459aea5-f0a2-4930-82d1-c5a7b2781689 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:31.910837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-03575604-d344-400a-9400-85dda8223464 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:31.928188 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-03575604-d344-400a-9400-85dda8223464 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 200 len: 1305 microversion: 2.1 time: 0.175118 Oct 29 01:14:31.929535 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1237/2553] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:31 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 1305 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:31.950444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4865a275-c5ec-466a-8e71-ad8157fdb5de tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:31.951820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4865a275-c5ec-466a-8e71-ad8157fdb5de tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:31.963219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4865a275-c5ec-466a-8e71-ad8157fdb5de tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:31.967401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4865a275-c5ec-466a-8e71-ad8157fdb5de tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:31.968013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4865a275-c5ec-466a-8e71-ad8157fdb5de tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:31.969144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4865a275-c5ec-466a-8e71-ad8157fdb5de tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:31.971086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4865a275-c5ec-466a-8e71-ad8157fdb5de tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:31.973637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4865a275-c5ec-466a-8e71-ad8157fdb5de tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:32.233112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4865a275-c5ec-466a-8e71-ad8157fdb5de tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:32.247046 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4865a275-c5ec-466a-8e71-ad8157fdb5de tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1184 microversion: 2.1 time: 0.308516 Oct 29 01:14:32.251664 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1238/2554] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:31 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1184 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:32.261055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-44eb4afc-29ca-4d5c-b2e7-b72a8e27007c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:32.266017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-44eb4afc-29ca-4d5c-b2e7-b72a8e27007c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:32.275855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44eb4afc-29ca-4d5c-b2e7-b72a8e27007c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:32.277714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44eb4afc-29ca-4d5c-b2e7-b72a8e27007c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:32.278789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44eb4afc-29ca-4d5c-b2e7-b72a8e27007c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:32.282719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44eb4afc-29ca-4d5c-b2e7-b72a8e27007c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:32.283383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44eb4afc-29ca-4d5c-b2e7-b72a8e27007c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:32.285673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44eb4afc-29ca-4d5c-b2e7-b72a8e27007c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:32.293346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6459aea5-f0a2-4930-82d1-c5a7b2781689 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:32.307882 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6459aea5-f0a2-4930-82d1-c5a7b2781689 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1313 microversion: 2.1 time: 0.446525 Oct 29 01:14:32.308502 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1317/2555] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:31 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1313 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:32.402989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-44eb4afc-29ca-4d5c-b2e7-b72a8e27007c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:32.429520 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-44eb4afc-29ca-4d5c-b2e7-b72a8e27007c tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1270 microversion: 2.1 time: 0.176537 Oct 29 01:14:32.436720 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1239/2556] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:32 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1270 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:32.652438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f2b5d1b5-a5cf-44a3-9a14-6e0d0de73dc2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:32.653101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f2b5d1b5-a5cf-44a3-9a14-6e0d0de73dc2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:32.670849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2b5d1b5-a5cf-44a3-9a14-6e0d0de73dc2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:32.673699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2b5d1b5-a5cf-44a3-9a14-6e0d0de73dc2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:32.674696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2b5d1b5-a5cf-44a3-9a14-6e0d0de73dc2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:32.678193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2b5d1b5-a5cf-44a3-9a14-6e0d0de73dc2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:32.678711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2b5d1b5-a5cf-44a3-9a14-6e0d0de73dc2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:32.679154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2b5d1b5-a5cf-44a3-9a14-6e0d0de73dc2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:32.953118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a771bfe5-4a92-45ce-a9a6-edb93365ccac tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:32.953897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a771bfe5-4a92-45ce-a9a6-edb93365ccac tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:32.963846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a771bfe5-4a92-45ce-a9a6-edb93365ccac tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:32.967461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a771bfe5-4a92-45ce-a9a6-edb93365ccac tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:32.969758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a771bfe5-4a92-45ce-a9a6-edb93365ccac tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:32.971000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a771bfe5-4a92-45ce-a9a6-edb93365ccac tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:32.971645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a771bfe5-4a92-45ce-a9a6-edb93365ccac tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:32.977063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a771bfe5-4a92-45ce-a9a6-edb93365ccac tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:33.005415 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-a771bfe5-4a92-45ce-a9a6-edb93365ccac tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 could not be found. Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a771bfe5-4a92-45ce-a9a6-edb93365ccac tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 HTTP/1.1 Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 could not be found. Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'a40f1fe3-0af2-43d1-a530-0960ed7c8eb3'} Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 could not be found. Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 could not be found. Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:14:33.008452 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:14:33.012275 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:33.012275 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:14:33.012275 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:14:33.012275 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:14:33.012275 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:14:33.012275 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 could not be found. Oct 29 01:14:33.012275 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:14:33.030755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a771bfe5-4a92-45ce-a9a6-edb93365ccac tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:14:33.033145 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a771bfe5-4a92-45ce-a9a6-edb93365ccac tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 404 len: 111 microversion: 2.1 time: 0.085047 Oct 29 01:14:33.036213 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1240/2557] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:32 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:14:33.141504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4464cdde-37c7-414e-912e-266388f5d48f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1911577226", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "95eff624-38bf-46e7-958c-9fcb3dae19f9"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:33.249027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-4464cdde-37c7-414e-912e-266388f5d48f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] validate_networks() for [('95eff624-38bf-46e7-958c-9fcb3dae19f9', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:14:33.327830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f2b5d1b5-a5cf-44a3-9a14-6e0d0de73dc2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:33.339795 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f2b5d1b5-a5cf-44a3-9a14-6e0d0de73dc2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1325 microversion: 2.1 time: 0.691383 Oct 29 01:14:33.341471 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1318/2558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:32 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1325 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:33.353760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6ed8cfd4-234a-4c29-8167-2ac5f9a263a8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:33.354385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6ed8cfd4-234a-4c29-8167-2ac5f9a263a8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:33.398247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ed8cfd4-234a-4c29-8167-2ac5f9a263a8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:33.398950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ed8cfd4-234a-4c29-8167-2ac5f9a263a8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:33.405521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ed8cfd4-234a-4c29-8167-2ac5f9a263a8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:33.405521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ed8cfd4-234a-4c29-8167-2ac5f9a263a8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:33.405521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ed8cfd4-234a-4c29-8167-2ac5f9a263a8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:33.408189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ed8cfd4-234a-4c29-8167-2ac5f9a263a8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:33.531571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6ed8cfd4-234a-4c29-8167-2ac5f9a263a8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:33.548392 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6ed8cfd4-234a-4c29-8167-2ac5f9a263a8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1184 microversion: 2.1 time: 0.205251 Oct 29 01:14:33.548996 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1319/2559] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:33 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1184 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:33.554068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f2f0ba10-9b78-418b-9e88-7641d2daeae5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:33.554746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f2f0ba10-9b78-418b-9e88-7641d2daeae5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:33.571230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2f0ba10-9b78-418b-9e88-7641d2daeae5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:33.577520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2f0ba10-9b78-418b-9e88-7641d2daeae5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:33.577520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2f0ba10-9b78-418b-9e88-7641d2daeae5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:33.577520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2f0ba10-9b78-418b-9e88-7641d2daeae5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:33.577520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2f0ba10-9b78-418b-9e88-7641d2daeae5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:33.577520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2f0ba10-9b78-418b-9e88-7641d2daeae5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:35.351908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f2f0ba10-9b78-418b-9e88-7641d2daeae5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:35.391420 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f2f0ba10-9b78-418b-9e88-7641d2daeae5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1313 microversion: 2.1 time: 1.833779 Oct 29 01:14:35.398112 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1320/2560] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:33 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1313 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:35.415006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ef4250ad-166e-4d38-ab12-bbbc6eab6057 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:35.422489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ef4250ad-166e-4d38-ab12-bbbc6eab6057 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:35.459856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-4464cdde-37c7-414e-912e-266388f5d48f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:14:35.461833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef4250ad-166e-4d38-ab12-bbbc6eab6057 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:35.463658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-4464cdde-37c7-414e-912e-266388f5d48f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:14:35.464423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-4464cdde-37c7-414e-912e-266388f5d48f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:14:35.465007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-4464cdde-37c7-414e-912e-266388f5d48f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:14:35.466200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-4464cdde-37c7-414e-912e-266388f5d48f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:14:35.479419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef4250ad-166e-4d38-ab12-bbbc6eab6057 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:35.480311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef4250ad-166e-4d38-ab12-bbbc6eab6057 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:35.481424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef4250ad-166e-4d38-ab12-bbbc6eab6057 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:35.484384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef4250ad-166e-4d38-ab12-bbbc6eab6057 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:35.485176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef4250ad-166e-4d38-ab12-bbbc6eab6057 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:35.486981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4464cdde-37c7-414e-912e-266388f5d48f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:35.488212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4464cdde-37c7-414e-912e-266388f5d48f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:35.491573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4464cdde-37c7-414e-912e-266388f5d48f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:35.493843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4464cdde-37c7-414e-912e-266388f5d48f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:35.494337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4464cdde-37c7-414e-912e-266388f5d48f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:35.494781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4464cdde-37c7-414e-912e-266388f5d48f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:35.558427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-4464cdde-37c7-414e-912e-266388f5d48f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Getting quotas for project f421c64f9b2f49ebab46d9f8a28143d6. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:14:35.573527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-4464cdde-37c7-414e-912e-266388f5d48f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Getting quotas for user 4ae0a54f51ad4813b312baf3a03ba172 and project f421c64f9b2f49ebab46d9f8a28143d6. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:14:35.578477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:35.592107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4464cdde-37c7-414e-912e-266388f5d48f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:14:35.596660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4464cdde-37c7-414e-912e-266388f5d48f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:14:35.839909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ef4250ad-166e-4d38-ab12-bbbc6eab6057 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:35.847116 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ef4250ad-166e-4d38-ab12-bbbc6eab6057 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1276 microversion: 2.1 time: 0.447899 Oct 29 01:14:35.858357 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1321/2561] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:35 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1276 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:35.865273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c981c4a6-dec1-4699-ac3f-c385a8e317ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:35.867483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c981c4a6-dec1-4699-ac3f-c385a8e317ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:35.877644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c981c4a6-dec1-4699-ac3f-c385a8e317ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:35.879397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c981c4a6-dec1-4699-ac3f-c385a8e317ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:35.879397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c981c4a6-dec1-4699-ac3f-c385a8e317ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:35.879749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c981c4a6-dec1-4699-ac3f-c385a8e317ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:35.880343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c981c4a6-dec1-4699-ac3f-c385a8e317ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:35.880925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c981c4a6-dec1-4699-ac3f-c385a8e317ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:36.098074 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4464cdde-37c7-414e-912e-266388f5d48f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.961158 Oct 29 01:14:36.098637 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1241/2562] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:14:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:14:36.113400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-469674aa-40a3-470e-974c-6ff0a29c49ee tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:36.115714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-469674aa-40a3-470e-974c-6ff0a29c49ee tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:36.120855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c981c4a6-dec1-4699-ac3f-c385a8e317ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:36.126991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-469674aa-40a3-470e-974c-6ff0a29c49ee tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:36.128189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-469674aa-40a3-470e-974c-6ff0a29c49ee tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:36.128880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-469674aa-40a3-470e-974c-6ff0a29c49ee tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:36.129830 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c981c4a6-dec1-4699-ac3f-c385a8e317ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1325 microversion: 2.1 time: 0.270153 Oct 29 01:14:36.129989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-469674aa-40a3-470e-974c-6ff0a29c49ee tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:36.130428 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1322/2563] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:35 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1325 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:36.143780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-84e832d7-4af3-4f62-80f9-0acfe48dd1a6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:36.149270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-469674aa-40a3-470e-974c-6ff0a29c49ee tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:36.150059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-469674aa-40a3-470e-974c-6ff0a29c49ee tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:36.171473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-84e832d7-4af3-4f62-80f9-0acfe48dd1a6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:36.273960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-469674aa-40a3-470e-974c-6ff0a29c49ee tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:36.284337 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-469674aa-40a3-470e-974c-6ff0a29c49ee tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1184 microversion: 2.1 time: 0.183305 Oct 29 01:14:36.289614 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1242/2564] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:36 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1184 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:36.320062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-84e832d7-4af3-4f62-80f9-0acfe48dd1a6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:36.334569 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-84e832d7-4af3-4f62-80f9-0acfe48dd1a6 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1215 microversion: 2.1 time: 0.198961 Oct 29 01:14:36.336520 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1323/2565] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:36 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1215 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:36.425720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d2397a44-c7c0-4eab-a88e-9eb83a679c55 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:36.426721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d2397a44-c7c0-4eab-a88e-9eb83a679c55 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:36.443984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2397a44-c7c0-4eab-a88e-9eb83a679c55 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:36.447228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2397a44-c7c0-4eab-a88e-9eb83a679c55 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:36.448699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2397a44-c7c0-4eab-a88e-9eb83a679c55 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:36.457848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2397a44-c7c0-4eab-a88e-9eb83a679c55 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:36.458612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2397a44-c7c0-4eab-a88e-9eb83a679c55 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:36.460736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2397a44-c7c0-4eab-a88e-9eb83a679c55 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:36.793369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d2397a44-c7c0-4eab-a88e-9eb83a679c55 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:36.809120 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d2397a44-c7c0-4eab-a88e-9eb83a679c55 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1313 microversion: 2.1 time: 0.387937 Oct 29 01:14:36.830748 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1243/2566] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:36 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:36.893561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-37c8e897-286a-4682-99a6-b0dbf9faf6fd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:36.893561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-37c8e897-286a-4682-99a6-b0dbf9faf6fd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:36.903727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37c8e897-286a-4682-99a6-b0dbf9faf6fd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:36.904269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37c8e897-286a-4682-99a6-b0dbf9faf6fd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:36.904775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37c8e897-286a-4682-99a6-b0dbf9faf6fd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:36.905603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37c8e897-286a-4682-99a6-b0dbf9faf6fd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:36.907694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37c8e897-286a-4682-99a6-b0dbf9faf6fd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:36.913967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37c8e897-286a-4682-99a6-b0dbf9faf6fd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:37.021435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-37c8e897-286a-4682-99a6-b0dbf9faf6fd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:37.042195 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-37c8e897-286a-4682-99a6-b0dbf9faf6fd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1276 microversion: 2.1 time: 0.157803 Oct 29 01:14:37.042929 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1324/2567] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:36 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:37.156077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-103c68b7-96b9-44a1-9610-8c6c333d2df2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:37.156721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-103c68b7-96b9-44a1-9610-8c6c333d2df2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:37.173675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-103c68b7-96b9-44a1-9610-8c6c333d2df2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:37.175900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-103c68b7-96b9-44a1-9610-8c6c333d2df2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:37.176057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-103c68b7-96b9-44a1-9610-8c6c333d2df2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:37.176811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-103c68b7-96b9-44a1-9610-8c6c333d2df2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:37.177330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-103c68b7-96b9-44a1-9610-8c6c333d2df2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:37.181611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-103c68b7-96b9-44a1-9610-8c6c333d2df2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:37.191986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:37.313808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3067ca8b-0e69-4296-a3d0-8514adbf8f3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:37.315633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3067ca8b-0e69-4296-a3d0-8514adbf8f3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:37.329143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3067ca8b-0e69-4296-a3d0-8514adbf8f3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:37.334510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3067ca8b-0e69-4296-a3d0-8514adbf8f3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:37.335347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3067ca8b-0e69-4296-a3d0-8514adbf8f3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:37.336638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3067ca8b-0e69-4296-a3d0-8514adbf8f3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:37.337409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3067ca8b-0e69-4296-a3d0-8514adbf8f3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:37.339319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3067ca8b-0e69-4296-a3d0-8514adbf8f3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:37.473138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3067ca8b-0e69-4296-a3d0-8514adbf8f3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:37.487050 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3067ca8b-0e69-4296-a3d0-8514adbf8f3e tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 200 len: 1184 microversion: 2.1 time: 0.180163 Oct 29 01:14:37.488160 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1325/2568] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:37 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 1184 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:37.493796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e31a07db-81df-4ad0-aab2-a183242578aa tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:37.494616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e31a07db-81df-4ad0-aab2-a183242578aa tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:37.611920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e31a07db-81df-4ad0-aab2-a183242578aa tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:37.622496 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e31a07db-81df-4ad0-aab2-a183242578aa tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1215 microversion: 2.1 time: 0.132895 Oct 29 01:14:37.625391 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1326/2569] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:37 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:37.674685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-103c68b7-96b9-44a1-9610-8c6c333d2df2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:37.676047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-363338cb-5d78-4985-9764-6b98d08db005 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Action: 'create', calling method: .version_select at 0x7f9d97019820>, body: {"keypair": {"name": "tempest-keypair-1311749174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbcsm3pKPWYD5RNJNIW07rMKIx/J2uslpm57fNqxmN+QB/RSHxAmREt1ZI8fOokSJCNJvZInDKbM9wMYLxAIIJ7cX2iT2VjaTdBz5Yxfk2Avh0OdkpiMGwl/k39ClK1+Q=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:37.689772 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-103c68b7-96b9-44a1-9610-8c6c333d2df2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1325 microversion: 2.1 time: 0.535465 Oct 29 01:14:37.690347 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1244/2570] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:37 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1325 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:37.739036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-363338cb-5d78-4985-9764-6b98d08db005 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Getting quotas for project c1fcdbf3d7bd4e48961102aa20056235. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:14:37.767827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-363338cb-5d78-4985-9764-6b98d08db005 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Getting quotas for user 4b1364600ce14da69e3b735cafac00d9 and project c1fcdbf3d7bd4e48961102aa20056235. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:14:37.838764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7126f3f5-e069-4e7f-a2e2-71bc2619e116 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:37.839744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7126f3f5-e069-4e7f-a2e2-71bc2619e116 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:37.855430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7126f3f5-e069-4e7f-a2e2-71bc2619e116 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:37.856179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7126f3f5-e069-4e7f-a2e2-71bc2619e116 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:37.858199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7126f3f5-e069-4e7f-a2e2-71bc2619e116 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:37.858731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7126f3f5-e069-4e7f-a2e2-71bc2619e116 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:37.859411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7126f3f5-e069-4e7f-a2e2-71bc2619e116 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:37.860176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7126f3f5-e069-4e7f-a2e2-71bc2619e116 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:37.925846 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-363338cb-5d78-4985-9764-6b98d08db005 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.251617 Oct 29 01:14:37.928692 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1327/2571] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 29 01:14:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 259 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 29 01:14:38.067629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d95406cb-ebf2-4af8-b261-03fcf993410a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:38.068242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d95406cb-ebf2-4af8-b261-03fcf993410a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:38.078352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d95406cb-ebf2-4af8-b261-03fcf993410a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:38.085909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d95406cb-ebf2-4af8-b261-03fcf993410a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:38.085909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d95406cb-ebf2-4af8-b261-03fcf993410a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:38.085909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d95406cb-ebf2-4af8-b261-03fcf993410a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:38.085909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d95406cb-ebf2-4af8-b261-03fcf993410a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:38.085909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d95406cb-ebf2-4af8-b261-03fcf993410a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:38.308154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7126f3f5-e069-4e7f-a2e2-71bc2619e116 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:38.320091 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7126f3f5-e069-4e7f-a2e2-71bc2619e116 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1313 microversion: 2.1 time: 0.485246 Oct 29 01:14:38.321652 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1245/2572] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:37 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1313 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:38.362699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d95406cb-ebf2-4af8-b261-03fcf993410a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:38.374654 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d95406cb-ebf2-4af8-b261-03fcf993410a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1318 microversion: 2.1 time: 0.310584 Oct 29 01:14:38.377096 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1328/2573] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:38 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:38.523601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b770eeaa-19f3-4bca-a635-1fb616a6a67b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:38.524262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b770eeaa-19f3-4bca-a635-1fb616a6a67b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: 24ebe561-9b25-419d-b771-d5f2d212cfbb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:38.553465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b770eeaa-19f3-4bca-a635-1fb616a6a67b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:38.553987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b770eeaa-19f3-4bca-a635-1fb616a6a67b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:38.554433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b770eeaa-19f3-4bca-a635-1fb616a6a67b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:38.555171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b770eeaa-19f3-4bca-a635-1fb616a6a67b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:38.555641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b770eeaa-19f3-4bca-a635-1fb616a6a67b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:38.556082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b770eeaa-19f3-4bca-a635-1fb616a6a67b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:38.587283 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-b770eeaa-19f3-4bca-a635-1fb616a6a67b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] HTTP exception thrown: Instance 24ebe561-9b25-419d-b771-d5f2d212cfbb could not be found. Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b770eeaa-19f3-4bca-a635-1fb616a6a67b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Request method failure captured: Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb HTTP/1.1 Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHysm59IN0QR7Jpvigs9GaW_uCJQ55SiVY14MKtY6qPM4WbIwqFtUZTCNxaqprF7gUzb79C0LARakiE-HVm_wnGXjWkH234yu8nfYitOC-p8n53Vma3Rsp_PyqBePucgE1GZlfP3KJ-5aDlu_LQv4Xy_7_U1cZrl8KdjAkHwpH4Q-Co Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 6719b662fc734d2797d515778a57296d Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-LiveMigrationTest-173269399 Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6719b662fc734d2797d515778a57296d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6719b662fc734d2797d515778a57296d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6719b662fc734d2797d515778a57296d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6719b662fc734d2797d515778a57296d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-LiveMigrationTest-173269399 Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 6719b662fc734d2797d515778a57296d Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-LiveMigrationTest-173269399 Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-LiveMigrationTest-173269399-project Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: da623c3132aa466aa25685aa45fceaf9 Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-LiveMigrationTest-173269399-project Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 24ebe561-9b25-419d-b771-d5f2d212cfbb could not be found. Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '24ebe561-9b25-419d-b771-d5f2d212cfbb'} Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24ebe561-9b25-419d-b771-d5f2d212cfbb could not be found. Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24ebe561-9b25-419d-b771-d5f2d212cfbb could not be found. Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:14:38.590070 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:14:38.595883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:38.595883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:14:38.595883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:14:38.595883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:14:38.595883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:14:38.595883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24ebe561-9b25-419d-b771-d5f2d212cfbb could not be found. Oct 29 01:14:38.595883 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:14:38.595883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b770eeaa-19f3-4bca-a635-1fb616a6a67b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Returning 404 to user: Instance 24ebe561-9b25-419d-b771-d5f2d212cfbb could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:14:38.596456 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b770eeaa-19f3-4bca-a635-1fb616a6a67b tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb" status: 404 len: 111 microversion: 2.1 time: 0.087483 Oct 29 01:14:38.599996 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1246/2574] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:38 2022] GET /compute/v2.1/servers/24ebe561-9b25-419d-b771-d5f2d212cfbb => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:14:38.650872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-87ab02a3-1ae2-4d55-97cb-cb9594b9eaa0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:38.651813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-87ab02a3-1ae2-4d55-97cb-cb9594b9eaa0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:38.661647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87ab02a3-1ae2-4d55-97cb-cb9594b9eaa0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:38.663231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87ab02a3-1ae2-4d55-97cb-cb9594b9eaa0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:38.663690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87ab02a3-1ae2-4d55-97cb-cb9594b9eaa0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:38.666719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87ab02a3-1ae2-4d55-97cb-cb9594b9eaa0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:38.668562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87ab02a3-1ae2-4d55-97cb-cb9594b9eaa0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:38.669027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87ab02a3-1ae2-4d55-97cb-cb9594b9eaa0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:38.718026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-28f4ba4a-d9d4-4823-8900-6ef2abb6968e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:38.718483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-28f4ba4a-d9d4-4823-8900-6ef2abb6968e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:38.724745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28f4ba4a-d9d4-4823-8900-6ef2abb6968e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:38.725112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28f4ba4a-d9d4-4823-8900-6ef2abb6968e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:38.736216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:38.740351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28f4ba4a-d9d4-4823-8900-6ef2abb6968e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:38.741180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28f4ba4a-d9d4-4823-8900-6ef2abb6968e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:38.741681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28f4ba4a-d9d4-4823-8900-6ef2abb6968e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:38.746640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28f4ba4a-d9d4-4823-8900-6ef2abb6968e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:39.008553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-87ab02a3-1ae2-4d55-97cb-cb9594b9eaa0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:39.014981 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-87ab02a3-1ae2-4d55-97cb-cb9594b9eaa0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1267 microversion: 2.1 time: 0.369184 Oct 29 01:14:39.027683 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1329/2575] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:38 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1267 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:39.283771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-28f4ba4a-d9d4-4823-8900-6ef2abb6968e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:39.297693 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-28f4ba4a-d9d4-4823-8900-6ef2abb6968e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1325 microversion: 2.1 time: 0.584013 Oct 29 01:14:39.316769 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1247/2576] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:38 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1325 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:39.345209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5f781207-a8b6-43e5-b4a2-03d8486526ba tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:39.346254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5f781207-a8b6-43e5-b4a2-03d8486526ba tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:39.369539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f781207-a8b6-43e5-b4a2-03d8486526ba tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:39.369647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f781207-a8b6-43e5-b4a2-03d8486526ba tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:39.370070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f781207-a8b6-43e5-b4a2-03d8486526ba tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:39.370821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f781207-a8b6-43e5-b4a2-03d8486526ba tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:39.378017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f781207-a8b6-43e5-b4a2-03d8486526ba tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:39.378561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f781207-a8b6-43e5-b4a2-03d8486526ba tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:39.404213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a565a5b4-8917-4fcb-aaea-a68154408b7b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:39.413578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a565a5b4-8917-4fcb-aaea-a68154408b7b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:39.425638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a565a5b4-8917-4fcb-aaea-a68154408b7b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:39.429800 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a565a5b4-8917-4fcb-aaea-a68154408b7b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:39.430444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a565a5b4-8917-4fcb-aaea-a68154408b7b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:39.433515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a565a5b4-8917-4fcb-aaea-a68154408b7b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:39.434216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a565a5b4-8917-4fcb-aaea-a68154408b7b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:39.436955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a565a5b4-8917-4fcb-aaea-a68154408b7b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:40.117458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5f781207-a8b6-43e5-b4a2-03d8486526ba tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:40.128951 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5f781207-a8b6-43e5-b4a2-03d8486526ba tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1313 microversion: 2.1 time: 0.786185 Oct 29 01:14:40.139404 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1330/2577] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:39 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1313 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:40.153090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8262c2b2-79d8-493f-bb62-3e7b08b2985a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:40.153090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8262c2b2-79d8-493f-bb62-3e7b08b2985a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:40.173243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8262c2b2-79d8-493f-bb62-3e7b08b2985a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:40.182645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8262c2b2-79d8-493f-bb62-3e7b08b2985a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:40.183276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8262c2b2-79d8-493f-bb62-3e7b08b2985a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:40.184152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8262c2b2-79d8-493f-bb62-3e7b08b2985a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:40.187425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8262c2b2-79d8-493f-bb62-3e7b08b2985a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:40.193389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8262c2b2-79d8-493f-bb62-3e7b08b2985a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:40.312856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8262c2b2-79d8-493f-bb62-3e7b08b2985a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:40.329868 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8262c2b2-79d8-493f-bb62-3e7b08b2985a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1285 microversion: 2.1 time: 0.180754 Oct 29 01:14:40.333310 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1331/2578] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:40 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1285 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:40.338391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8b515086-220a-4ad7-8d21-1714c04ec1c2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:40.339320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8b515086-220a-4ad7-8d21-1714c04ec1c2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:40.355947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b515086-220a-4ad7-8d21-1714c04ec1c2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:40.356776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b515086-220a-4ad7-8d21-1714c04ec1c2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:40.359016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b515086-220a-4ad7-8d21-1714c04ec1c2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:40.360062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b515086-220a-4ad7-8d21-1714c04ec1c2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:40.367426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a565a5b4-8917-4fcb-aaea-a68154408b7b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:40.375746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b515086-220a-4ad7-8d21-1714c04ec1c2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:40.378920 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a565a5b4-8917-4fcb-aaea-a68154408b7b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1318 microversion: 2.1 time: 0.980644 Oct 29 01:14:40.379971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b515086-220a-4ad7-8d21-1714c04ec1c2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:40.385738 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1248/2579] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:39 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1318 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:40.730973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8b515086-220a-4ad7-8d21-1714c04ec1c2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:40.741646 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8b515086-220a-4ad7-8d21-1714c04ec1c2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1325 microversion: 2.1 time: 0.406881 Oct 29 01:14:40.762391 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1332/2580] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:40 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1325 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:41.159602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cf487743-908a-4a21-ab2f-4614201748f1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:41.160227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cf487743-908a-4a21-ab2f-4614201748f1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:41.175674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf487743-908a-4a21-ab2f-4614201748f1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:41.177749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf487743-908a-4a21-ab2f-4614201748f1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:41.178652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf487743-908a-4a21-ab2f-4614201748f1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:41.180113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf487743-908a-4a21-ab2f-4614201748f1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:41.182196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf487743-908a-4a21-ab2f-4614201748f1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:41.182816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf487743-908a-4a21-ab2f-4614201748f1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:41.358380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-182b3578-80c6-4c2c-a19d-d86b9188df37 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:41.359966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-182b3578-80c6-4c2c-a19d-d86b9188df37 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:41.397510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-182b3578-80c6-4c2c-a19d-d86b9188df37 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:41.398226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-182b3578-80c6-4c2c-a19d-d86b9188df37 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:41.399089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-182b3578-80c6-4c2c-a19d-d86b9188df37 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:41.403891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-182b3578-80c6-4c2c-a19d-d86b9188df37 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:41.405253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-182b3578-80c6-4c2c-a19d-d86b9188df37 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:41.405888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-182b3578-80c6-4c2c-a19d-d86b9188df37 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:41.651212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-182b3578-80c6-4c2c-a19d-d86b9188df37 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:41.678745 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-182b3578-80c6-4c2c-a19d-d86b9188df37 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1273 microversion: 2.1 time: 0.326421 Oct 29 01:14:41.680093 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1333/2581] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:41 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1273 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:41.685516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e93232b7-32c6-45b5-9f05-89846d14cab7 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:41.687065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e93232b7-32c6-45b5-9f05-89846d14cab7 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:41.694473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e93232b7-32c6-45b5-9f05-89846d14cab7 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:41.695333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e93232b7-32c6-45b5-9f05-89846d14cab7 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:41.696235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e93232b7-32c6-45b5-9f05-89846d14cab7 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:41.697573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e93232b7-32c6-45b5-9f05-89846d14cab7 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:41.698258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e93232b7-32c6-45b5-9f05-89846d14cab7 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:41.698370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cf487743-908a-4a21-ab2f-4614201748f1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:41.699656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e93232b7-32c6-45b5-9f05-89846d14cab7 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:41.714085 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cf487743-908a-4a21-ab2f-4614201748f1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1313 microversion: 2.1 time: 0.560063 Oct 29 01:14:41.714686 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1249/2582] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:41 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:41.775115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-417d0903-7b84-4717-abdd-325c192a8ff6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:41.777186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-417d0903-7b84-4717-abdd-325c192a8ff6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:41.798575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-417d0903-7b84-4717-abdd-325c192a8ff6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:41.799071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-417d0903-7b84-4717-abdd-325c192a8ff6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:41.799739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-417d0903-7b84-4717-abdd-325c192a8ff6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:41.801543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-417d0903-7b84-4717-abdd-325c192a8ff6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:41.802217 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-417d0903-7b84-4717-abdd-325c192a8ff6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:41.807319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-417d0903-7b84-4717-abdd-325c192a8ff6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:41.948814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e93232b7-32c6-45b5-9f05-89846d14cab7 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:41.959304 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e93232b7-32c6-45b5-9f05-89846d14cab7 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1318 microversion: 2.1 time: 0.275441 Oct 29 01:14:41.959963 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1334/2583] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:41 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:42.140186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-417d0903-7b84-4717-abdd-325c192a8ff6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:42.163884 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-417d0903-7b84-4717-abdd-325c192a8ff6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1325 microversion: 2.1 time: 0.398194 Oct 29 01:14:42.177339 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1250/2584] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:41 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1325 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:42.185772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-e4ae33dd-134a-40e3-b6bd-9de096ae5fcb req-d52d0183-4f03-43aa-bdff-5dfb97821a84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756326f6-781c-4fad-a611-b908891aed66", "name": "network-vif-plugged", "status": "completed", "tag": "57bdfbf3-fabe-41ec-b284-ce6b9d6eaa5a"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:42.216180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-966a2d0c-85f5-44cb-8861-e03a338ddf1e req-fab67e3f-de04-4e17-877c-4d14829bf71a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d98dce2e-4cfb-48a3-8879-8ec89269b331", "tag": "f39e58bb-12ac-471a-b9cd-378133a0bcea"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:42.255095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-966a2d0c-85f5-44cb-8861-e03a338ddf1e req-fab67e3f-de04-4e17-877c-4d14829bf71a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:42.256726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-966a2d0c-85f5-44cb-8861-e03a338ddf1e req-fab67e3f-de04-4e17-877c-4d14829bf71a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:42.259030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-966a2d0c-85f5-44cb-8861-e03a338ddf1e req-fab67e3f-de04-4e17-877c-4d14829bf71a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:42.259888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e4ae33dd-134a-40e3-b6bd-9de096ae5fcb req-d52d0183-4f03-43aa-bdff-5dfb97821a84 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:42.260382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e4ae33dd-134a-40e3-b6bd-9de096ae5fcb req-d52d0183-4f03-43aa-bdff-5dfb97821a84 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:42.260817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e4ae33dd-134a-40e3-b6bd-9de096ae5fcb req-d52d0183-4f03-43aa-bdff-5dfb97821a84 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:42.301490 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-966a2d0c-85f5-44cb-8861-e03a338ddf1e req-fab67e3f-de04-4e17-877c-4d14829bf71a service nova] Creating event network-changed:f39e58bb-12ac-471a-b9cd-378133a0bcea for instance d98dce2e-4cfb-48a3-8879-8ec89269b331 on n-h1-862964-3 Oct 29 01:14:42.320666 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-966a2d0c-85f5-44cb-8861-e03a338ddf1e req-fab67e3f-de04-4e17-877c-4d14829bf71a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111785 Oct 29 01:14:42.335851 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1251/2585] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:42.340023 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-e4ae33dd-134a-40e3-b6bd-9de096ae5fcb req-d52d0183-4f03-43aa-bdff-5dfb97821a84 service nova] Creating event network-vif-plugged:57bdfbf3-fabe-41ec-b284-ce6b9d6eaa5a for instance 756326f6-781c-4fad-a611-b908891aed66 on n-h1-862964-3 Oct 29 01:14:42.372618 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-e4ae33dd-134a-40e3-b6bd-9de096ae5fcb req-d52d0183-4f03-43aa-bdff-5dfb97821a84 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.330749 Oct 29 01:14:42.374568 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1335/2586] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:14:42.708315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-27209420-de2c-4021-a082-e3dac6531041 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:42.709481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-27209420-de2c-4021-a082-e3dac6531041 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:42.732863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27209420-de2c-4021-a082-e3dac6531041 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:42.737997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27209420-de2c-4021-a082-e3dac6531041 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:42.738871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27209420-de2c-4021-a082-e3dac6531041 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:42.739795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27209420-de2c-4021-a082-e3dac6531041 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:42.740423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27209420-de2c-4021-a082-e3dac6531041 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:42.741006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27209420-de2c-4021-a082-e3dac6531041 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:42.743810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-988b7965-7fd6-425b-9293-8429d5541e4b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1549596749", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "9f7b032c-0aed-4adf-929f-4f69d989902b"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:42.885519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-988b7965-7fd6-425b-9293-8429d5541e4b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] validate_networks() for [('9f7b032c-0aed-4adf-929f-4f69d989902b', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:14:43.658317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-27209420-de2c-4021-a082-e3dac6531041 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:43.677663 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-27209420-de2c-4021-a082-e3dac6531041 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1315 microversion: 2.1 time: 0.973969 Oct 29 01:14:43.682804 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1336/2587] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:42 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1315 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:43.704184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0b64af63-a8a0-4d99-999d-ce44af05b6eb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:43.704924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0b64af63-a8a0-4d99-999d-ce44af05b6eb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:43.724766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b64af63-a8a0-4d99-999d-ce44af05b6eb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:43.725359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b64af63-a8a0-4d99-999d-ce44af05b6eb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:43.725824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b64af63-a8a0-4d99-999d-ce44af05b6eb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:43.726618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b64af63-a8a0-4d99-999d-ce44af05b6eb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:43.727091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b64af63-a8a0-4d99-999d-ce44af05b6eb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:43.727521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b64af63-a8a0-4d99-999d-ce44af05b6eb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:44.267851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0b64af63-a8a0-4d99-999d-ce44af05b6eb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:44.285598 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0b64af63-a8a0-4d99-999d-ce44af05b6eb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1313 microversion: 2.1 time: 0.601427 Oct 29 01:14:44.297358 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1337/2588] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:43 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1313 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:44.322143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1dc0bd67-5ff3-498f-8c56-38af11029e93 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:44.324497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1dc0bd67-5ff3-498f-8c56-38af11029e93 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:44.343126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dc0bd67-5ff3-498f-8c56-38af11029e93 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:44.345643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dc0bd67-5ff3-498f-8c56-38af11029e93 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:44.346492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dc0bd67-5ff3-498f-8c56-38af11029e93 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:44.347869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dc0bd67-5ff3-498f-8c56-38af11029e93 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:44.348761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dc0bd67-5ff3-498f-8c56-38af11029e93 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:44.349425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-988b7965-7fd6-425b-9293-8429d5541e4b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:14:44.352034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dc0bd67-5ff3-498f-8c56-38af11029e93 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:44.352457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-988b7965-7fd6-425b-9293-8429d5541e4b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:14:44.352457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-988b7965-7fd6-425b-9293-8429d5541e4b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:14:44.352457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-988b7965-7fd6-425b-9293-8429d5541e4b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:14:44.352457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-988b7965-7fd6-425b-9293-8429d5541e4b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:14:44.368817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=33 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:44.372515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-988b7965-7fd6-425b-9293-8429d5541e4b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:44.373143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-988b7965-7fd6-425b-9293-8429d5541e4b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:44.373641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-988b7965-7fd6-425b-9293-8429d5541e4b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:44.374586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-988b7965-7fd6-425b-9293-8429d5541e4b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:44.375073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-988b7965-7fd6-425b-9293-8429d5541e4b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:44.375508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-988b7965-7fd6-425b-9293-8429d5541e4b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:44.424544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-988b7965-7fd6-425b-9293-8429d5541e4b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Getting quotas for project 328d1dd53c6a4bc2b14376dd1a1cecb6. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:14:44.447696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-988b7965-7fd6-425b-9293-8429d5541e4b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Getting quotas for user b89f11ebd96141a5afe08dad79b0b20c and project 328d1dd53c6a4bc2b14376dd1a1cecb6. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:14:44.475634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-988b7965-7fd6-425b-9293-8429d5541e4b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:14:44.478729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-988b7965-7fd6-425b-9293-8429d5541e4b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:14:44.664636 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-988b7965-7fd6-425b-9293-8429d5541e4b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.074661 Oct 29 01:14:44.665344 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1252/2589] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:14:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:14:44.693391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3745a60b-97ac-44d8-86e5-ec217f2d0f1b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:44.694040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3745a60b-97ac-44d8-86e5-ec217f2d0f1b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:44.711261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3745a60b-97ac-44d8-86e5-ec217f2d0f1b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:44.711797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3745a60b-97ac-44d8-86e5-ec217f2d0f1b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:44.712252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3745a60b-97ac-44d8-86e5-ec217f2d0f1b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:44.715129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3745a60b-97ac-44d8-86e5-ec217f2d0f1b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:44.715927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3745a60b-97ac-44d8-86e5-ec217f2d0f1b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:44.723019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3745a60b-97ac-44d8-86e5-ec217f2d0f1b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:44.870475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1dc0bd67-5ff3-498f-8c56-38af11029e93 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:44.881047 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1dc0bd67-5ff3-498f-8c56-38af11029e93 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1318 microversion: 2.1 time: 0.581359 Oct 29 01:14:44.882047 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1338/2590] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:44 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1318 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:44.887343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-7ca25d68-9ed8-4c91-9cba-40866c7fbce7 req-11fafd98-901f-473e-8571-7e3b5a2a1ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c277e3-48a6-4a97-9e52-689482955506", "name": "network-vif-plugged", "status": "completed", "tag": "db5809d9-cc6a-4331-aa7f-a691edfa6ab0"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:44.900626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7ca25d68-9ed8-4c91-9cba-40866c7fbce7 req-11fafd98-901f-473e-8571-7e3b5a2a1ff8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:44.901403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7ca25d68-9ed8-4c91-9cba-40866c7fbce7 req-11fafd98-901f-473e-8571-7e3b5a2a1ff8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:44.901994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7ca25d68-9ed8-4c91-9cba-40866c7fbce7 req-11fafd98-901f-473e-8571-7e3b5a2a1ff8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:44.917034 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-7ca25d68-9ed8-4c91-9cba-40866c7fbce7 req-11fafd98-901f-473e-8571-7e3b5a2a1ff8 service nova] Creating event network-vif-plugged:db5809d9-cc6a-4331-aa7f-a691edfa6ab0 for instance 78c277e3-48a6-4a97-9e52-689482955506 on n-h2-862964-3 Oct 29 01:14:44.923443 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-7ca25d68-9ed8-4c91-9cba-40866c7fbce7 req-11fafd98-901f-473e-8571-7e3b5a2a1ff8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039880 Oct 29 01:14:44.924477 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1339/2591] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:44.931219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-af931026-e528-4b35-bf46-4a53fe7c974b req-2ea69346-0b83-40bf-908b-a32e4b425b64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101e0729-34a2-439c-8ee6-23afc29b2fbe", "tag": "bff7bfcb-a949-4c76-9885-bf8a435a3c11"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:44.946229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-af931026-e528-4b35-bf46-4a53fe7c974b req-2ea69346-0b83-40bf-908b-a32e4b425b64 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:44.947325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-af931026-e528-4b35-bf46-4a53fe7c974b req-2ea69346-0b83-40bf-908b-a32e4b425b64 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:44.947973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-af931026-e528-4b35-bf46-4a53fe7c974b req-2ea69346-0b83-40bf-908b-a32e4b425b64 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:44.962639 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-af931026-e528-4b35-bf46-4a53fe7c974b req-2ea69346-0b83-40bf-908b-a32e4b425b64 service nova] Creating event network-changed:bff7bfcb-a949-4c76-9885-bf8a435a3c11 for instance 101e0729-34a2-439c-8ee6-23afc29b2fbe on n-h2-862964-3 Oct 29 01:14:44.970414 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-af931026-e528-4b35-bf46-4a53fe7c974b req-2ea69346-0b83-40bf-908b-a32e4b425b64 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042978 Oct 29 01:14:44.971813 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1340/2592] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:44.985048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-550ec556-d089-4b03-b7bd-9ccbc2c4b4bf tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:44.985794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-550ec556-d089-4b03-b7bd-9ccbc2c4b4bf tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:45.215188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-550ec556-d089-4b03-b7bd-9ccbc2c4b4bf tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:45.217619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=17 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:45.226575 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-550ec556-d089-4b03-b7bd-9ccbc2c4b4bf tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1225 microversion: 2.1 time: 0.245806 Oct 29 01:14:45.227545 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1341/2593] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:44 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1225 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:45.237526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f37d8213-9f43-4ad5-89f7-38aaff152321 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:45.238152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f37d8213-9f43-4ad5-89f7-38aaff152321 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:45.260954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f37d8213-9f43-4ad5-89f7-38aaff152321 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:45.261561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f37d8213-9f43-4ad5-89f7-38aaff152321 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:45.262009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f37d8213-9f43-4ad5-89f7-38aaff152321 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:45.262735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f37d8213-9f43-4ad5-89f7-38aaff152321 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:45.263243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f37d8213-9f43-4ad5-89f7-38aaff152321 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:45.263682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f37d8213-9f43-4ad5-89f7-38aaff152321 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:45.331201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3745a60b-97ac-44d8-86e5-ec217f2d0f1b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:45.342955 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3745a60b-97ac-44d8-86e5-ec217f2d0f1b tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1325 microversion: 2.1 time: 0.665337 Oct 29 01:14:45.362395 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1253/2594] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:44 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1325 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:45.379700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-986b0d1f-406f-4a86-9354-a888207c31c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:45.380447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-986b0d1f-406f-4a86-9354-a888207c31c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:45.415847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-986b0d1f-406f-4a86-9354-a888207c31c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:45.416350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-986b0d1f-406f-4a86-9354-a888207c31c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:45.420643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-986b0d1f-406f-4a86-9354-a888207c31c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:45.424311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-986b0d1f-406f-4a86-9354-a888207c31c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:45.424978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-986b0d1f-406f-4a86-9354-a888207c31c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:45.428391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-986b0d1f-406f-4a86-9354-a888207c31c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:45.682485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f37d8213-9f43-4ad5-89f7-38aaff152321 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:45.708995 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f37d8213-9f43-4ad5-89f7-38aaff152321 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1315 microversion: 2.1 time: 0.480227 Oct 29 01:14:45.726231 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1342/2595] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:45 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:45.800904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b3dee96b-e523-4623-a0a0-7883ac17ae69 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:45.801634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b3dee96b-e523-4623-a0a0-7883ac17ae69 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:45.818166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3dee96b-e523-4623-a0a0-7883ac17ae69 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:45.819212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3dee96b-e523-4623-a0a0-7883ac17ae69 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:45.819358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3dee96b-e523-4623-a0a0-7883ac17ae69 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:45.823573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3dee96b-e523-4623-a0a0-7883ac17ae69 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:45.824822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3dee96b-e523-4623-a0a0-7883ac17ae69 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:45.824822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3dee96b-e523-4623-a0a0-7883ac17ae69 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:45.900841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b3dee96b-e523-4623-a0a0-7883ac17ae69 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:14:45.938439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-986b0d1f-406f-4a86-9354-a888207c31c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:45.947289 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-986b0d1f-406f-4a86-9354-a888207c31c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1463 microversion: 2.1 time: 0.584188 Oct 29 01:14:45.951772 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1254/2596] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:45 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1463 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:45.968330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2be97415-1f1d-463d-8e26-1b7fe5a92714 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:45.972215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2be97415-1f1d-463d-8e26-1b7fe5a92714 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:45.986546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2be97415-1f1d-463d-8e26-1b7fe5a92714 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:45.992424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2be97415-1f1d-463d-8e26-1b7fe5a92714 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:45.992424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2be97415-1f1d-463d-8e26-1b7fe5a92714 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:45.992424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2be97415-1f1d-463d-8e26-1b7fe5a92714 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:45.992424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2be97415-1f1d-463d-8e26-1b7fe5a92714 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:45.992424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2be97415-1f1d-463d-8e26-1b7fe5a92714 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:46.216788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2be97415-1f1d-463d-8e26-1b7fe5a92714 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:46.232766 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2be97415-1f1d-463d-8e26-1b7fe5a92714 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1318 microversion: 2.1 time: 0.277401 Oct 29 01:14:46.233523 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1255/2597] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:45 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:46.240454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e28a6c47-18a1-4b35-8f93-ee434ade7489 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:46.241340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e28a6c47-18a1-4b35-8f93-ee434ade7489 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:46.250553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e28a6c47-18a1-4b35-8f93-ee434ade7489 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:46.251404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e28a6c47-18a1-4b35-8f93-ee434ade7489 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:46.252109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e28a6c47-18a1-4b35-8f93-ee434ade7489 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:46.253248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e28a6c47-18a1-4b35-8f93-ee434ade7489 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:46.253946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e28a6c47-18a1-4b35-8f93-ee434ade7489 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:46.254611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e28a6c47-18a1-4b35-8f93-ee434ade7489 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:46.346591 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b3dee96b-e523-4623-a0a0-7883ac17ae69 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 204 len: 0 microversion: 2.1 time: 0.550437 Oct 29 01:14:46.351931 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1343/2598] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:14:45 2022] DELETE /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:14:46.367857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6fd5459f-f815-4603-ade1-8b23f1a98bad tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:46.373524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6fd5459f-f815-4603-ade1-8b23f1a98bad tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:46.508933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6fd5459f-f815-4603-ade1-8b23f1a98bad tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:46.513734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e28a6c47-18a1-4b35-8f93-ee434ade7489 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:46.525388 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e28a6c47-18a1-4b35-8f93-ee434ade7489 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1464 microversion: 2.1 time: 0.288562 Oct 29 01:14:46.526523 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1256/2599] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:46 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1464 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:46.540047 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6fd5459f-f815-4603-ade1-8b23f1a98bad tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1225 microversion: 2.1 time: 0.184503 Oct 29 01:14:46.541482 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1344/2600] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:46 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1225 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:46.555094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2305314a-cc3b-4874-bae6-f40039a325fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:46.564461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-b6d9f34c-2b8f-464b-80f0-4c62559ebc2d req-e40d3226-c8bc-49ba-8b22-bd0a9563ea39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74263965-ee1f-46a3-8115-7da1ba849c83", "tag": "f927c0ed-022d-4814-9d05-eb446907453d"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:46.565403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2305314a-cc3b-4874-bae6-f40039a325fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:46.577638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2305314a-cc3b-4874-bae6-f40039a325fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:46.578531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2305314a-cc3b-4874-bae6-f40039a325fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:46.579374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2305314a-cc3b-4874-bae6-f40039a325fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:46.580580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2305314a-cc3b-4874-bae6-f40039a325fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:46.581329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2305314a-cc3b-4874-bae6-f40039a325fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:46.581970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2305314a-cc3b-4874-bae6-f40039a325fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:46.588860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b6d9f34c-2b8f-464b-80f0-4c62559ebc2d req-e40d3226-c8bc-49ba-8b22-bd0a9563ea39 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:46.593825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b6d9f34c-2b8f-464b-80f0-4c62559ebc2d req-e40d3226-c8bc-49ba-8b22-bd0a9563ea39 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:46.593825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b6d9f34c-2b8f-464b-80f0-4c62559ebc2d req-e40d3226-c8bc-49ba-8b22-bd0a9563ea39 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:46.659137 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-b6d9f34c-2b8f-464b-80f0-4c62559ebc2d req-e40d3226-c8bc-49ba-8b22-bd0a9563ea39 service nova] Creating event network-changed:f927c0ed-022d-4814-9d05-eb446907453d for instance 74263965-ee1f-46a3-8115-7da1ba849c83 on n-h1-862964-3 Oct 29 01:14:46.667597 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-b6d9f34c-2b8f-464b-80f0-4c62559ebc2d req-e40d3226-c8bc-49ba-8b22-bd0a9563ea39 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139661 Oct 29 01:14:46.669914 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1257/2601] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:46.675568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0aa49513-0481-4b50-b8a7-35dac6ac8782 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:46.676640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0aa49513-0481-4b50-b8a7-35dac6ac8782 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:46.688400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0aa49513-0481-4b50-b8a7-35dac6ac8782 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:46.689340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0aa49513-0481-4b50-b8a7-35dac6ac8782 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:46.690032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0aa49513-0481-4b50-b8a7-35dac6ac8782 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:46.690999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0aa49513-0481-4b50-b8a7-35dac6ac8782 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:46.691667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0aa49513-0481-4b50-b8a7-35dac6ac8782 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:46.692307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0aa49513-0481-4b50-b8a7-35dac6ac8782 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:46.858205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2305314a-cc3b-4874-bae6-f40039a325fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:46.868002 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2305314a-cc3b-4874-bae6-f40039a325fc tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1666 microversion: 2.1 time: 0.324836 Oct 29 01:14:46.868776 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1345/2602] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:46 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1666 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:46.873891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8b480473-bf29-49b9-8198-9456916ad7f2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-476750617", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b88cce5a-4c01-4354-895a-54148d701f7c"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:46.906877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0aa49513-0481-4b50-b8a7-35dac6ac8782 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:46.916311 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0aa49513-0481-4b50-b8a7-35dac6ac8782 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1325 microversion: 2.1 time: 0.244380 Oct 29 01:14:46.917192 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1258/2603] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:46 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1325 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:46.922897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c277f9be-a9e0-47e8-aa2d-325e8c980e98 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1388520214", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e0b6db83-de5c-4aa6-9ef9-6e4156bd5c62"}, {"port": "27a1b433-eeb0-4aaa-86e0-7e13f0a59c70", "tag": "port-1"}, {"port": "eb30986f-1ab2-4e01-a0ab-fea8fcfc435c", "tag": "port-2"}, {"uuid": "2efb2262-4c3c-406c-b869-f9b60a49a43d", "tag": "net-1"}, {"uuid": "2efb2262-4c3c-406c-b869-f9b60a49a43d"}, {"uuid": "80875836-49da-4bcc-9f45-8f208b6a5b04", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "80875836-49da-4bcc-9f45-8f208b6a5b04", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "c9eafbf3-5b6e-4c30-b714-c31484e21df4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "60707ae9-8d02-4666-a224-bd2550b882b0", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "dddfe9d3-4209-4ae9-bd0a-770498f6894e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1713602236"}], "key_name": "tempest-keypair-1311749174", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:46.936288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-8b480473-bf29-49b9-8198-9456916ad7f2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] validate_networks() for None {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:14:47.111698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-c277f9be-a9e0-47e8-aa2d-325e8c980e98 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] validate_networks() for [('e0b6db83-de5c-4aa6-9ef9-6e4156bd5c62', None, None, None, None, None), (None, None, '27a1b433-eeb0-4aaa-86e0-7e13f0a59c70', None, None, None), (None, None, 'eb30986f-1ab2-4e01-a0ab-fea8fcfc435c', None, None, None), ('2efb2262-4c3c-406c-b869-f9b60a49a43d', None, None, None, None, None), ('2efb2262-4c3c-406c-b869-f9b60a49a43d', None, None, None, None, None), ('80875836-49da-4bcc-9f45-8f208b6a5b04', '10.2.2.100', None, None, None, None), ('80875836-49da-4bcc-9f45-8f208b6a5b04', '10.2.2.200', None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:14:47.278496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-8b480473-bf29-49b9-8198-9456916ad7f2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:14:47.279450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-8b480473-bf29-49b9-8198-9456916ad7f2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:14:47.279929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-8b480473-bf29-49b9-8198-9456916ad7f2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:14:47.280343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-8b480473-bf29-49b9-8198-9456916ad7f2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:14:47.280768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-8b480473-bf29-49b9-8198-9456916ad7f2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:14:47.290447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b480473-bf29-49b9-8198-9456916ad7f2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:47.291165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b480473-bf29-49b9-8198-9456916ad7f2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:47.293720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b480473-bf29-49b9-8198-9456916ad7f2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:47.297820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b480473-bf29-49b9-8198-9456916ad7f2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:47.297820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b480473-bf29-49b9-8198-9456916ad7f2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:47.297820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b480473-bf29-49b9-8198-9456916ad7f2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:47.320308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-8b480473-bf29-49b9-8198-9456916ad7f2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Getting quotas for project 5bdf61e2cbca4cdc95494b38c827ce63. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:14:47.322294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:47.331139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-8b480473-bf29-49b9-8198-9456916ad7f2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Getting quotas for user 60969ed444b545b9a5b02e27eb7eaea3 and project 5bdf61e2cbca4cdc95494b38c827ce63. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:14:47.350282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8b480473-bf29-49b9-8198-9456916ad7f2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:14:47.352948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8b480473-bf29-49b9-8198-9456916ad7f2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:14:47.496670 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8b480473-bf29-49b9-8198-9456916ad7f2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626913 Oct 29 01:14:47.497372 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1346/2604] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:14:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:14:47.503090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-883f66d5-a3b7-44c2-a4c1-1aaa40929273 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:47.503709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-883f66d5-a3b7-44c2-a4c1-1aaa40929273 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:47.510041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-883f66d5-a3b7-44c2-a4c1-1aaa40929273 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:47.510523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-883f66d5-a3b7-44c2-a4c1-1aaa40929273 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:47.510959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-883f66d5-a3b7-44c2-a4c1-1aaa40929273 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:47.511667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-883f66d5-a3b7-44c2-a4c1-1aaa40929273 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:47.512123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-883f66d5-a3b7-44c2-a4c1-1aaa40929273 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:47.512559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-883f66d5-a3b7-44c2-a4c1-1aaa40929273 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:47.777394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-883f66d5-a3b7-44c2-a4c1-1aaa40929273 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:47.789901 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-883f66d5-a3b7-44c2-a4c1-1aaa40929273 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1315 microversion: 2.1 time: 0.290149 Oct 29 01:14:47.791209 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1347/2605] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:47 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:47.796775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a425d5d9-0f6d-4284-9fb7-e2155ecf691d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:47.797964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a425d5d9-0f6d-4284-9fb7-e2155ecf691d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:47.804776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a425d5d9-0f6d-4284-9fb7-e2155ecf691d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:47.805453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a425d5d9-0f6d-4284-9fb7-e2155ecf691d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:47.806108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a425d5d9-0f6d-4284-9fb7-e2155ecf691d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:47.806985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a425d5d9-0f6d-4284-9fb7-e2155ecf691d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:47.808008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a425d5d9-0f6d-4284-9fb7-e2155ecf691d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:47.808531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a425d5d9-0f6d-4284-9fb7-e2155ecf691d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:48.385025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a425d5d9-0f6d-4284-9fb7-e2155ecf691d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:48.393982 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a425d5d9-0f6d-4284-9fb7-e2155ecf691d tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1318 microversion: 2.1 time: 0.601502 Oct 29 01:14:48.394576 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1348/2606] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:47 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1318 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:48.399281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-be6bf878-c4a3-4a03-b876-88559200127a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:48.400551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-be6bf878-c4a3-4a03-b876-88559200127a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:48.520812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-be6bf878-c4a3-4a03-b876-88559200127a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:48.528307 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-be6bf878-c4a3-4a03-b876-88559200127a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1213 microversion: 2.1 time: 0.132735 Oct 29 01:14:48.529107 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1349/2607] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:48 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1213 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:48.549807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3aeb97b3-24ad-466a-a4fe-e7479132a1f2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:48.556190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3aeb97b3-24ad-466a-a4fe-e7479132a1f2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:48.556539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3aeb97b3-24ad-466a-a4fe-e7479132a1f2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:48.557033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3aeb97b3-24ad-466a-a4fe-e7479132a1f2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:48.557510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3aeb97b3-24ad-466a-a4fe-e7479132a1f2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:48.558214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3aeb97b3-24ad-466a-a4fe-e7479132a1f2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:48.558674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3aeb97b3-24ad-466a-a4fe-e7479132a1f2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:48.559104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3aeb97b3-24ad-466a-a4fe-e7479132a1f2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:48.564081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:48.652744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3aeb97b3-24ad-466a-a4fe-e7479132a1f2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:48.660634 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3aeb97b3-24ad-466a-a4fe-e7479132a1f2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1229 microversion: 2.1 time: 0.114657 Oct 29 01:14:48.661423 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1350/2608] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:48 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1229 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:48.666013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-11cb2dee-57cc-47c2-9bb3-47eb142bfe09 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:48.666623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-11cb2dee-57cc-47c2-9bb3-47eb142bfe09 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:48.673320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11cb2dee-57cc-47c2-9bb3-47eb142bfe09 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:48.673817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11cb2dee-57cc-47c2-9bb3-47eb142bfe09 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:48.674260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11cb2dee-57cc-47c2-9bb3-47eb142bfe09 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:48.675096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11cb2dee-57cc-47c2-9bb3-47eb142bfe09 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:48.675652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11cb2dee-57cc-47c2-9bb3-47eb142bfe09 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:48.676054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11cb2dee-57cc-47c2-9bb3-47eb142bfe09 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:48.957124 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-11cb2dee-57cc-47c2-9bb3-47eb142bfe09 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:48.965815 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-11cb2dee-57cc-47c2-9bb3-47eb142bfe09 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1666 microversion: 2.1 time: 0.303441 Oct 29 01:14:48.967690 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1351/2609] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:48 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1666 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:48.972704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0cbf8009-9226-4698-bcdb-60027becc570 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:48.973335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0cbf8009-9226-4698-bcdb-60027becc570 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:48.979860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cbf8009-9226-4698-bcdb-60027becc570 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:48.980352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cbf8009-9226-4698-bcdb-60027becc570 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:48.980794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cbf8009-9226-4698-bcdb-60027becc570 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:48.981527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cbf8009-9226-4698-bcdb-60027becc570 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:48.982418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cbf8009-9226-4698-bcdb-60027becc570 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:48.982918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cbf8009-9226-4698-bcdb-60027becc570 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:49.335523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0cbf8009-9226-4698-bcdb-60027becc570 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:49.349035 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0cbf8009-9226-4698-bcdb-60027becc570 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1325 microversion: 2.1 time: 0.380228 Oct 29 01:14:49.351666 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1352/2610] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:48 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1325 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:49.356199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-01a08bf7-69c4-43be-86b5-dbb90641a8d3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:49.358292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-01a08bf7-69c4-43be-86b5-dbb90641a8d3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:49.365427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01a08bf7-69c4-43be-86b5-dbb90641a8d3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:49.366449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01a08bf7-69c4-43be-86b5-dbb90641a8d3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:49.366828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01a08bf7-69c4-43be-86b5-dbb90641a8d3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:49.367651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01a08bf7-69c4-43be-86b5-dbb90641a8d3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:49.368184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01a08bf7-69c4-43be-86b5-dbb90641a8d3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:49.368681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01a08bf7-69c4-43be-86b5-dbb90641a8d3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:49.663249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-01a08bf7-69c4-43be-86b5-dbb90641a8d3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:49.671756 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-01a08bf7-69c4-43be-86b5-dbb90641a8d3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1315 microversion: 2.1 time: 0.320157 Oct 29 01:14:49.672711 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1353/2611] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:49 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:49.677366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a44e1193-646b-4076-832b-50752b352cec tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:49.678251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a44e1193-646b-4076-832b-50752b352cec tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:49.684894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a44e1193-646b-4076-832b-50752b352cec tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:49.685557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a44e1193-646b-4076-832b-50752b352cec tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:49.686229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a44e1193-646b-4076-832b-50752b352cec tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:49.687167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a44e1193-646b-4076-832b-50752b352cec tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:49.687626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a44e1193-646b-4076-832b-50752b352cec tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:49.688123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a44e1193-646b-4076-832b-50752b352cec tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:49.986969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a44e1193-646b-4076-832b-50752b352cec tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:49.995640 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a44e1193-646b-4076-832b-50752b352cec tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1318 microversion: 2.1 time: 0.321838 Oct 29 01:14:49.996241 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1354/2612] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:49 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:50.003113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0c07a0bd-c966-4d82-846b-031443c1ab9b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:50.003902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0c07a0bd-c966-4d82-846b-031443c1ab9b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:50.010310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c07a0bd-c966-4d82-846b-031443c1ab9b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:50.010879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c07a0bd-c966-4d82-846b-031443c1ab9b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:50.011417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c07a0bd-c966-4d82-846b-031443c1ab9b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:50.012567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c07a0bd-c966-4d82-846b-031443c1ab9b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:50.014037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c07a0bd-c966-4d82-846b-031443c1ab9b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:50.014837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c07a0bd-c966-4d82-846b-031443c1ab9b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:50.127039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0c07a0bd-c966-4d82-846b-031443c1ab9b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:50.139107 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0c07a0bd-c966-4d82-846b-031443c1ab9b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1265 microversion: 2.1 time: 0.140760 Oct 29 01:14:50.140281 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1355/2613] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:49 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:50.146179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ebd338d1-3974-4605-adc1-29b3c828d082 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:50.147324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ebd338d1-3974-4605-adc1-29b3c828d082 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:50.161727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebd338d1-3974-4605-adc1-29b3c828d082 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:50.161727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebd338d1-3974-4605-adc1-29b3c828d082 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:50.161727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebd338d1-3974-4605-adc1-29b3c828d082 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:50.161727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebd338d1-3974-4605-adc1-29b3c828d082 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:50.161727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebd338d1-3974-4605-adc1-29b3c828d082 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:50.161727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebd338d1-3974-4605-adc1-29b3c828d082 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:50.256895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ebd338d1-3974-4605-adc1-29b3c828d082 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:50.271052 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ebd338d1-3974-4605-adc1-29b3c828d082 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1285 microversion: 2.1 time: 0.128074 Oct 29 01:14:50.272783 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1356/2614] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:50 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:50.282375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-edc13288-b3ca-4311-a5dc-806cc027f47a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:50.283468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-edc13288-b3ca-4311-a5dc-806cc027f47a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:50.291535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edc13288-b3ca-4311-a5dc-806cc027f47a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:50.291829 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edc13288-b3ca-4311-a5dc-806cc027f47a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:50.292752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edc13288-b3ca-4311-a5dc-806cc027f47a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:50.294648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edc13288-b3ca-4311-a5dc-806cc027f47a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:50.295010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edc13288-b3ca-4311-a5dc-806cc027f47a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:50.295542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edc13288-b3ca-4311-a5dc-806cc027f47a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:50.554733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-edc13288-b3ca-4311-a5dc-806cc027f47a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:50.568254 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-edc13288-b3ca-4311-a5dc-806cc027f47a tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1666 microversion: 2.1 time: 0.293628 Oct 29 01:14:50.569245 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1357/2615] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:50 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1666 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:50.576663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-be460a02-d37b-4232-8fd9-b365023cfdc3 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:50.577772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-be460a02-d37b-4232-8fd9-b365023cfdc3 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:50.590851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be460a02-d37b-4232-8fd9-b365023cfdc3 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:50.592000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be460a02-d37b-4232-8fd9-b365023cfdc3 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:50.592625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be460a02-d37b-4232-8fd9-b365023cfdc3 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:50.594616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be460a02-d37b-4232-8fd9-b365023cfdc3 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:50.594616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be460a02-d37b-4232-8fd9-b365023cfdc3 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:50.595208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be460a02-d37b-4232-8fd9-b365023cfdc3 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:50.831802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-be460a02-d37b-4232-8fd9-b365023cfdc3 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:50.843004 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-be460a02-d37b-4232-8fd9-b365023cfdc3 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1523 microversion: 2.1 time: 0.272476 Oct 29 01:14:50.852050 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1358/2616] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:50 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:50.852050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4597f619-547c-4b39-87f5-62c6b51e8339 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:50.852050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4597f619-547c-4b39-87f5-62c6b51e8339 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:50.863610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4597f619-547c-4b39-87f5-62c6b51e8339 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:50.864368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4597f619-547c-4b39-87f5-62c6b51e8339 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:50.864920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4597f619-547c-4b39-87f5-62c6b51e8339 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:50.866374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4597f619-547c-4b39-87f5-62c6b51e8339 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:50.866374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4597f619-547c-4b39-87f5-62c6b51e8339 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:50.866976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4597f619-547c-4b39-87f5-62c6b51e8339 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:51.051073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-c277f9be-a9e0-47e8-aa2d-325e8c980e98 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:14:51.052076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-c277f9be-a9e0-47e8-aa2d-325e8c980e98 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:14:51.052704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-c277f9be-a9e0-47e8-aa2d-325e8c980e98 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:14:51.053328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-c277f9be-a9e0-47e8-aa2d-325e8c980e98 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:14:51.053945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-c277f9be-a9e0-47e8-aa2d-325e8c980e98 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:14:51.067237 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c277f9be-a9e0-47e8-aa2d-325e8c980e98 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:51.067991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c277f9be-a9e0-47e8-aa2d-325e8c980e98 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:51.068586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c277f9be-a9e0-47e8-aa2d-325e8c980e98 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:51.069555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c277f9be-a9e0-47e8-aa2d-325e8c980e98 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:51.070366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c277f9be-a9e0-47e8-aa2d-325e8c980e98 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:51.070945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c277f9be-a9e0-47e8-aa2d-325e8c980e98 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:51.077469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4597f619-547c-4b39-87f5-62c6b51e8339 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:51.087690 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4597f619-547c-4b39-87f5-62c6b51e8339 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1315 microversion: 2.1 time: 0.242886 Oct 29 01:14:51.089707 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1359/2617] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:50 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:51.095737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-293b82fb-3b6f-4753-838e-fbd5892972ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:51.096695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-293b82fb-3b6f-4753-838e-fbd5892972ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:51.104132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-293b82fb-3b6f-4753-838e-fbd5892972ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:51.105067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-293b82fb-3b6f-4753-838e-fbd5892972ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:51.106040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-293b82fb-3b6f-4753-838e-fbd5892972ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:51.107812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-293b82fb-3b6f-4753-838e-fbd5892972ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:51.109055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-293b82fb-3b6f-4753-838e-fbd5892972ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:51.109732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-293b82fb-3b6f-4753-838e-fbd5892972ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:51.114590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-c277f9be-a9e0-47e8-aa2d-325e8c980e98 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Getting quotas for project c1fcdbf3d7bd4e48961102aa20056235. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:14:51.120418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-c277f9be-a9e0-47e8-aa2d-325e8c980e98 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Getting quotas for user 4b1364600ce14da69e3b735cafac00d9 and project c1fcdbf3d7bd4e48961102aa20056235. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:14:51.141808 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-293b82fb-3b6f-4753-838e-fbd5892972ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] HTTP exception thrown: Instance is not a member of specified network Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-293b82fb-3b6f-4753-838e-fbd5892972ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Request method failure captured: Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506/ips/invalid HTTP/1.1 Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH5nNAplj1T43_IOwSGlKrdZ_PHp5HBKzej6Pc7HMT_XfhommOt9x8oRQOE3sNFSDBkm0_3iFPGepygxq660qrt8i3kKvNa36Q4USn7DBRF2FWoAbBAHwH5CcH_A9MNY5P93GFhLU59TCDk7g0lpMQ96ORHsZ1YbTEvu58UK5FYCiwo Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 0dabcb4dc77b4cb982e41d436ffaf844 Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1547635981 Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0dabcb4dc77b4cb982e41d436ffaf844"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0dabcb4dc77b4cb982e41d436ffaf844"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0dabcb4dc77b4cb982e41d436ffaf844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0dabcb4dc77b4cb982e41d436ffaf844", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1547635981 Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 0dabcb4dc77b4cb982e41d436ffaf844 Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1547635981 Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerAddressesNegativeTestJSON-1547635981-project Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 5470f9c5ba1e481fb7644b70c4a70766 Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1547635981-project Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance is not a member of specified network Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'server_id': '78c277e3-48a6-4a97-9e52-689482955506', 'id': 'invalid'} Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 29 01:14:51.147280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:51.151006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-293b82fb-3b6f-4753-838e-fbd5892972ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Returning 404 to user: Instance is not a member of specified network {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:14:51.151006 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-293b82fb-3b6f-4753-838e-fbd5892972ce tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.057836 Oct 29 01:14:51.151006 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1360/2618] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:14:51 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506/ips/invalid => generated 91 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:14:51.161615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6d1a0b66-5a72-412f-8bb4-0443160b9cef tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:51.162205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6d1a0b66-5a72-412f-8bb4-0443160b9cef tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:51.171280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d1a0b66-5a72-412f-8bb4-0443160b9cef tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:51.171870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d1a0b66-5a72-412f-8bb4-0443160b9cef tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:51.172308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d1a0b66-5a72-412f-8bb4-0443160b9cef tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:51.173063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d1a0b66-5a72-412f-8bb4-0443160b9cef tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:51.173542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d1a0b66-5a72-412f-8bb4-0443160b9cef tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:51.173963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d1a0b66-5a72-412f-8bb4-0443160b9cef tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:51.309452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c277f9be-a9e0-47e8-aa2d-325e8c980e98 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:14:51.313056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c277f9be-a9e0-47e8-aa2d-325e8c980e98 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='c9eafbf3-5b6e-4c30-b714-c31484e21df4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='60707ae9-8d02-4666-a224-bd2550b882b0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dddfe9d3-4209-4ae9-bd0a-770498f6894e',volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:14:51.346104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6d1a0b66-5a72-412f-8bb4-0443160b9cef tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:51.354183 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6d1a0b66-5a72-412f-8bb4-0443160b9cef tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1318 microversion: 2.1 time: 0.197229 Oct 29 01:14:51.354778 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1361/2619] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:51 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:51.359680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-00528741-618b-4f73-8b52-790982cc8bc2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:51.360147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-00528741-618b-4f73-8b52-790982cc8bc2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Failed to fetch instance by id 999 {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 01:14:51.360644 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-00528741-618b-4f73-8b52-790982cc8bc2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] HTTP exception thrown: Instance 999 could not be found. Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-00528741-618b-4f73-8b52-790982cc8bc2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Request method failure captured: Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH5nNAplj1T43_IOwSGlKrdZ_PHp5HBKzej6Pc7HMT_XfhommOt9x8oRQOE3sNFSDBkm0_3iFPGepygxq660qrt8i3kKvNa36Q4USn7DBRF2FWoAbBAHwH5CcH_A9MNY5P93GFhLU59TCDk7g0lpMQ96ORHsZ1YbTEvu58UK5FYCiwo Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 0dabcb4dc77b4cb982e41d436ffaf844 Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1547635981 Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0dabcb4dc77b4cb982e41d436ffaf844"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0dabcb4dc77b4cb982e41d436ffaf844"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0dabcb4dc77b4cb982e41d436ffaf844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0dabcb4dc77b4cb982e41d436ffaf844", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1547635981 Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 0dabcb4dc77b4cb982e41d436ffaf844 Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1547635981 Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerAddressesNegativeTestJSON-1547635981-project Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 5470f9c5ba1e481fb7644b70c4a70766 Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1547635981-project Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 999 could not be found. Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'server_id': '999'} Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 29 01:14:51.362086 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:51.367233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-00528741-618b-4f73-8b52-790982cc8bc2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Returning 404 to user: Instance 999 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:14:51.368042 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-00528741-618b-4f73-8b52-790982cc8bc2 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.012167 Oct 29 01:14:51.374227 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1362/2620] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 29 01:14:51 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:14:51.378899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4e7d5220-c9b5-4235-9d0b-d698258f23aa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:51.379795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4e7d5220-c9b5-4235-9d0b-d698258f23aa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:51.388577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e7d5220-c9b5-4235-9d0b-d698258f23aa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:51.389228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e7d5220-c9b5-4235-9d0b-d698258f23aa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:51.389666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e7d5220-c9b5-4235-9d0b-d698258f23aa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:51.390375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e7d5220-c9b5-4235-9d0b-d698258f23aa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:51.390828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e7d5220-c9b5-4235-9d0b-d698258f23aa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:51.391263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e7d5220-c9b5-4235-9d0b-d698258f23aa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:51.476914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4e7d5220-c9b5-4235-9d0b-d698258f23aa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:51.485639 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4e7d5220-c9b5-4235-9d0b-d698258f23aa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1265 microversion: 2.1 time: 0.110277 Oct 29 01:14:51.486733 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1363/2621] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:51 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:51.491813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b3c838e2-2abf-4a5b-b467-18b6476cf6ab tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:51.492673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b3c838e2-2abf-4a5b-b467-18b6476cf6ab tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:51.499332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3c838e2-2abf-4a5b-b467-18b6476cf6ab tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:51.499889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3c838e2-2abf-4a5b-b467-18b6476cf6ab tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:51.500581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3c838e2-2abf-4a5b-b467-18b6476cf6ab tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:51.501392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3c838e2-2abf-4a5b-b467-18b6476cf6ab tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:51.501991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3c838e2-2abf-4a5b-b467-18b6476cf6ab tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:51.502587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3c838e2-2abf-4a5b-b467-18b6476cf6ab tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:51.569583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b3c838e2-2abf-4a5b-b467-18b6476cf6ab tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:51.580691 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b3c838e2-2abf-4a5b-b467-18b6476cf6ab tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1285 microversion: 2.1 time: 0.092603 Oct 29 01:14:51.598860 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1364/2622] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:51 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:51.603728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9fd41607-97f9-47de-8ffe-dddb979c7926 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:51.604219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9fd41607-97f9-47de-8ffe-dddb979c7926 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:51.610642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd41607-97f9-47de-8ffe-dddb979c7926 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:51.611121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd41607-97f9-47de-8ffe-dddb979c7926 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:51.611604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd41607-97f9-47de-8ffe-dddb979c7926 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:51.612286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd41607-97f9-47de-8ffe-dddb979c7926 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:51.612902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd41607-97f9-47de-8ffe-dddb979c7926 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:51.613403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd41607-97f9-47de-8ffe-dddb979c7926 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:51.642171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9fd41607-97f9-47de-8ffe-dddb979c7926 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:14:51.935077 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9fd41607-97f9-47de-8ffe-dddb979c7926 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "DELETE /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 204 len: 0 microversion: 2.1 time: 0.334710 Oct 29 01:14:51.936197 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1365/2623] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:14:51 2022] DELETE /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:14:51.942775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-adac9661-c84c-4bf6-b3fe-f2c5482a562e req-2824d572-a17e-49c3-8c6c-22b063fa5dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101e0729-34a2-439c-8ee6-23afc29b2fbe", "name": "network-vif-plugged", "status": "completed", "tag": "bff7bfcb-a949-4c76-9885-bf8a435a3c11"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:51.952263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-adac9661-c84c-4bf6-b3fe-f2c5482a562e req-2824d572-a17e-49c3-8c6c-22b063fa5dba service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:51.952743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-adac9661-c84c-4bf6-b3fe-f2c5482a562e req-2824d572-a17e-49c3-8c6c-22b063fa5dba service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:51.953311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-adac9661-c84c-4bf6-b3fe-f2c5482a562e req-2824d572-a17e-49c3-8c6c-22b063fa5dba service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:51.967545 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-adac9661-c84c-4bf6-b3fe-f2c5482a562e req-2824d572-a17e-49c3-8c6c-22b063fa5dba service nova] Creating event network-vif-plugged:bff7bfcb-a949-4c76-9885-bf8a435a3c11 for instance 101e0729-34a2-439c-8ee6-23afc29b2fbe on n-h2-862964-3 Oct 29 01:14:51.972925 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-adac9661-c84c-4bf6-b3fe-f2c5482a562e req-2824d572-a17e-49c3-8c6c-22b063fa5dba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035148 Oct 29 01:14:51.973891 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1366/2624] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:51.979192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-88d25100-c711-4ec9-a642-ab9245b9a0c0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:51.985770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-88d25100-c711-4ec9-a642-ab9245b9a0c0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:51.987979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88d25100-c711-4ec9-a642-ab9245b9a0c0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:51.988574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88d25100-c711-4ec9-a642-ab9245b9a0c0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:51.988978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88d25100-c711-4ec9-a642-ab9245b9a0c0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:51.989796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88d25100-c711-4ec9-a642-ab9245b9a0c0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:51.990218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88d25100-c711-4ec9-a642-ab9245b9a0c0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:51.990649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88d25100-c711-4ec9-a642-ab9245b9a0c0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:51.995191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:52.024930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88d25100-c711-4ec9-a642-ab9245b9a0c0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:52.025445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88d25100-c711-4ec9-a642-ab9245b9a0c0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:52.025882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88d25100-c711-4ec9-a642-ab9245b9a0c0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:52.026328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-88d25100-c711-4ec9-a642-ab9245b9a0c0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lazy-loading 'fault' on Instance uuid b8914c05-5333-46a4-8930-90cb1a93e5eb {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:14:52.074181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-88d25100-c711-4ec9-a642-ab9245b9a0c0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:52.082943 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-88d25100-c711-4ec9-a642-ab9245b9a0c0 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1324 microversion: 2.1 time: 0.107570 Oct 29 01:14:52.083532 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1367/2625] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:51 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1324 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:52.097330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-c0590248-00e6-4c69-beff-88bd50ddca52 req-c02f2c05-0c53-4b30-a60b-ce8da53722a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8914c05-5333-46a4-8930-90cb1a93e5eb", "name": "network-vif-deleted", "tag": "3ee3428d-0fa0-4f5f-835c-2e2776c92305"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:52.097983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c0590248-00e6-4c69-beff-88bd50ddca52 req-c02f2c05-0c53-4b30-a60b-ce8da53722a7 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:52.098934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c0590248-00e6-4c69-beff-88bd50ddca52 req-c02f2c05-0c53-4b30-a60b-ce8da53722a7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:52.098934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c0590248-00e6-4c69-beff-88bd50ddca52 req-c02f2c05-0c53-4b30-a60b-ce8da53722a7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:52.110241 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-c0590248-00e6-4c69-beff-88bd50ddca52 req-c02f2c05-0c53-4b30-a60b-ce8da53722a7 service nova] Creating event network-vif-deleted:3ee3428d-0fa0-4f5f-835c-2e2776c92305 for instance b8914c05-5333-46a4-8930-90cb1a93e5eb on n-h2-862964-3 Oct 29 01:14:52.115308 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-c0590248-00e6-4c69-beff-88bd50ddca52 req-c02f2c05-0c53-4b30-a60b-ce8da53722a7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030553 Oct 29 01:14:52.115930 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1368/2626] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:52.127742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d168f319-4324-497b-99ad-77ebec97d3a7 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:52.127742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d168f319-4324-497b-99ad-77ebec97d3a7 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:52.130424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d168f319-4324-497b-99ad-77ebec97d3a7 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:52.130917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d168f319-4324-497b-99ad-77ebec97d3a7 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:52.131358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d168f319-4324-497b-99ad-77ebec97d3a7 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:52.132062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d168f319-4324-497b-99ad-77ebec97d3a7 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:52.132519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d168f319-4324-497b-99ad-77ebec97d3a7 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:52.133069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d168f319-4324-497b-99ad-77ebec97d3a7 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:52.273318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d168f319-4324-497b-99ad-77ebec97d3a7 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:52.282611 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d168f319-4324-497b-99ad-77ebec97d3a7 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1529 microversion: 2.1 time: 0.165541 Oct 29 01:14:52.283280 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1369/2627] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:52 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1529 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:52.288012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-382eae6a-0616-45f4-be91-8b46f8710d11 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:52.288721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-382eae6a-0616-45f4-be91-8b46f8710d11 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:52.294977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-382eae6a-0616-45f4-be91-8b46f8710d11 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:52.295681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-382eae6a-0616-45f4-be91-8b46f8710d11 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:52.296119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-382eae6a-0616-45f4-be91-8b46f8710d11 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:52.296813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-382eae6a-0616-45f4-be91-8b46f8710d11 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:52.297537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-382eae6a-0616-45f4-be91-8b46f8710d11 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:52.297970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-382eae6a-0616-45f4-be91-8b46f8710d11 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:52.417563 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c277f9be-a9e0-47e8-aa2d-325e8c980e98 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 5.499146 Oct 29 01:14:52.432217 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1259/2628] 10.222.0.26 () {62 vars in 1189 bytes} [Sat Oct 29 01:14:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 5514 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 01:14:52.446023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c47227fc-f4cc-46cd-a221-f23ae82b8590 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:52.449926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c47227fc-f4cc-46cd-a221-f23ae82b8590 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:52.466580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c47227fc-f4cc-46cd-a221-f23ae82b8590 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:52.466580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c47227fc-f4cc-46cd-a221-f23ae82b8590 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:52.466580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c47227fc-f4cc-46cd-a221-f23ae82b8590 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:52.467165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c47227fc-f4cc-46cd-a221-f23ae82b8590 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:52.467792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c47227fc-f4cc-46cd-a221-f23ae82b8590 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:52.468377 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c47227fc-f4cc-46cd-a221-f23ae82b8590 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:52.669309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-382eae6a-0616-45f4-be91-8b46f8710d11 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:52.681508 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-382eae6a-0616-45f4-be91-8b46f8710d11 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1315 microversion: 2.1 time: 0.397025 Oct 29 01:14:52.683135 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1370/2629] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:52 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:52.690360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2400680d-d334-4314-b6e4-08e272e52222 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:52.691286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2400680d-d334-4314-b6e4-08e272e52222 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:52.805185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2400680d-d334-4314-b6e4-08e272e52222 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:52.808389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c47227fc-f4cc-46cd-a221-f23ae82b8590 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:52.817257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2400680d-d334-4314-b6e4-08e272e52222 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:52.819772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2400680d-d334-4314-b6e4-08e272e52222 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:52.820968 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c47227fc-f4cc-46cd-a221-f23ae82b8590 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1318 microversion: 2.1 time: 0.378780 Oct 29 01:14:52.821335 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2400680d-d334-4314-b6e4-08e272e52222 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1286 microversion: 2.42 time: 0.136676 Oct 29 01:14:52.822491 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1371/2630] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:14:52 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1286 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:14:52.830426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1824b6df-027a-4a06-8c5d-c4b10470285d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:52.831822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1824b6df-027a-4a06-8c5d-c4b10470285d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:52.841372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1824b6df-027a-4a06-8c5d-c4b10470285d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:52.842082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1824b6df-027a-4a06-8c5d-c4b10470285d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:52.842690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1824b6df-027a-4a06-8c5d-c4b10470285d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:52.843436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1824b6df-027a-4a06-8c5d-c4b10470285d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:52.843896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1824b6df-027a-4a06-8c5d-c4b10470285d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:52.844416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1824b6df-027a-4a06-8c5d-c4b10470285d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:52.845397 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1260/2631] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:52 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:52.880372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2cd69e06-0df2-4d80-8af5-00279502dac1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:52.881006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2cd69e06-0df2-4d80-8af5-00279502dac1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:52.894544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cd69e06-0df2-4d80-8af5-00279502dac1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:52.897435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cd69e06-0df2-4d80-8af5-00279502dac1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:52.897799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cd69e06-0df2-4d80-8af5-00279502dac1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:52.898534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cd69e06-0df2-4d80-8af5-00279502dac1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:52.902367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cd69e06-0df2-4d80-8af5-00279502dac1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:52.902960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cd69e06-0df2-4d80-8af5-00279502dac1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:52.959095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1824b6df-027a-4a06-8c5d-c4b10470285d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:52.974611 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1824b6df-027a-4a06-8c5d-c4b10470285d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1265 microversion: 2.1 time: 0.145911 Oct 29 01:14:52.977219 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1372/2632] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:52 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:53.007385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2cd69e06-0df2-4d80-8af5-00279502dac1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:53.019915 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2cd69e06-0df2-4d80-8af5-00279502dac1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1283 microversion: 2.1 time: 0.148763 Oct 29 01:14:53.020607 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1261/2633] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:52 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1283 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:53.115078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f20ede8-f230-4742-96a2-93e22bea39a5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:53.116426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1f20ede8-f230-4742-96a2-93e22bea39a5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:53.134114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f20ede8-f230-4742-96a2-93e22bea39a5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:53.134818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f20ede8-f230-4742-96a2-93e22bea39a5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:53.135532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f20ede8-f230-4742-96a2-93e22bea39a5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:53.136756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f20ede8-f230-4742-96a2-93e22bea39a5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:53.137664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f20ede8-f230-4742-96a2-93e22bea39a5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:53.138992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f20ede8-f230-4742-96a2-93e22bea39a5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:53.196957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f20ede8-f230-4742-96a2-93e22bea39a5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:53.197735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f20ede8-f230-4742-96a2-93e22bea39a5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:53.198198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f20ede8-f230-4742-96a2-93e22bea39a5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:53.198715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-1f20ede8-f230-4742-96a2-93e22bea39a5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lazy-loading 'fault' on Instance uuid b8914c05-5333-46a4-8930-90cb1a93e5eb {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:14:53.306462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b4afc5f7-61cd-45d9-a52f-ac7f51d9fd59 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:53.307730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b4afc5f7-61cd-45d9-a52f-ac7f51d9fd59 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:53.334087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4afc5f7-61cd-45d9-a52f-ac7f51d9fd59 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:53.339609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4afc5f7-61cd-45d9-a52f-ac7f51d9fd59 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:53.340166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4afc5f7-61cd-45d9-a52f-ac7f51d9fd59 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:53.342890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4afc5f7-61cd-45d9-a52f-ac7f51d9fd59 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:53.343854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4afc5f7-61cd-45d9-a52f-ac7f51d9fd59 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:53.344307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4afc5f7-61cd-45d9-a52f-ac7f51d9fd59 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:53.499961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1f20ede8-f230-4742-96a2-93e22bea39a5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:53.520917 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1f20ede8-f230-4742-96a2-93e22bea39a5 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1324 microversion: 2.1 time: 0.416695 Oct 29 01:14:53.521843 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1373/2634] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:53 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1324 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:53.635690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b4afc5f7-61cd-45d9-a52f-ac7f51d9fd59 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:53.648387 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b4afc5f7-61cd-45d9-a52f-ac7f51d9fd59 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1529 microversion: 2.1 time: 0.343849 Oct 29 01:14:53.648387 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1262/2635] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:53 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1529 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:53.707595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9bae3291-1719-4001-ba20-9042d0ec30bd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:53.708428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9bae3291-1719-4001-ba20-9042d0ec30bd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:53.715465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bae3291-1719-4001-ba20-9042d0ec30bd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:53.721892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bae3291-1719-4001-ba20-9042d0ec30bd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:53.722479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bae3291-1719-4001-ba20-9042d0ec30bd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:53.723304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bae3291-1719-4001-ba20-9042d0ec30bd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:53.725718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bae3291-1719-4001-ba20-9042d0ec30bd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:53.726340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bae3291-1719-4001-ba20-9042d0ec30bd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:53.854085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2287625c-6e98-4b7e-a852-039c6ab7873f tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:53.855643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2287625c-6e98-4b7e-a852-039c6ab7873f tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:53.906708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9bae3291-1719-4001-ba20-9042d0ec30bd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:53.916092 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9bae3291-1719-4001-ba20-9042d0ec30bd tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1315 microversion: 2.1 time: 0.212722 Oct 29 01:14:53.917071 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1374/2636] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:53 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:53.922468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-744f6779-fa07-4a05-a736-5245585de37b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:53.922740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-744f6779-fa07-4a05-a736-5245585de37b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:53.929130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-744f6779-fa07-4a05-a736-5245585de37b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:53.929560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-744f6779-fa07-4a05-a736-5245585de37b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:53.930070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-744f6779-fa07-4a05-a736-5245585de37b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:53.933174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2287625c-6e98-4b7e-a852-039c6ab7873f tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:53.938433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-744f6779-fa07-4a05-a736-5245585de37b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:53.938948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-744f6779-fa07-4a05-a736-5245585de37b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:53.939393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-744f6779-fa07-4a05-a736-5245585de37b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:53.947959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2287625c-6e98-4b7e-a852-039c6ab7873f tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:53.947959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2287625c-6e98-4b7e-a852-039c6ab7873f tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:53.947959 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2287625c-6e98-4b7e-a852-039c6ab7873f tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1286 microversion: 2.42 time: 0.095608 Oct 29 01:14:53.947959 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1263/2637] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:14:53 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:14:53.999082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e42986b3-8a41-43ba-9277-7a55208407c7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:53.999707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e42986b3-8a41-43ba-9277-7a55208407c7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:54.005987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e42986b3-8a41-43ba-9277-7a55208407c7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:54.007062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e42986b3-8a41-43ba-9277-7a55208407c7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:54.007503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e42986b3-8a41-43ba-9277-7a55208407c7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:54.008502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e42986b3-8a41-43ba-9277-7a55208407c7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:54.009216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e42986b3-8a41-43ba-9277-7a55208407c7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:54.009664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e42986b3-8a41-43ba-9277-7a55208407c7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:54.114354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e42986b3-8a41-43ba-9277-7a55208407c7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:54.132919 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e42986b3-8a41-43ba-9277-7a55208407c7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1271 microversion: 2.1 time: 0.137913 Oct 29 01:14:54.134005 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1264/2638] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:53 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1271 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:54.143948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-67a5b524-8d6d-47c2-acde-d6eb1c4d61cf req-d7d33783-40ae-445a-a5b1-cf5db576025a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d98dce2e-4cfb-48a3-8879-8ec89269b331", "name": "network-vif-plugged", "status": "completed", "tag": "f39e58bb-12ac-471a-b9cd-378133a0bcea"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:54.156843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-67a5b524-8d6d-47c2-acde-d6eb1c4d61cf req-d7d33783-40ae-445a-a5b1-cf5db576025a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:54.157403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-67a5b524-8d6d-47c2-acde-d6eb1c4d61cf req-d7d33783-40ae-445a-a5b1-cf5db576025a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:54.161036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-67a5b524-8d6d-47c2-acde-d6eb1c4d61cf req-d7d33783-40ae-445a-a5b1-cf5db576025a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:54.162832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:54.171696 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-67a5b524-8d6d-47c2-acde-d6eb1c4d61cf req-d7d33783-40ae-445a-a5b1-cf5db576025a service nova] Creating event network-vif-plugged:f39e58bb-12ac-471a-b9cd-378133a0bcea for instance d98dce2e-4cfb-48a3-8879-8ec89269b331 on n-h1-862964-3 Oct 29 01:14:54.177101 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-67a5b524-8d6d-47c2-acde-d6eb1c4d61cf req-d7d33783-40ae-445a-a5b1-cf5db576025a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041610 Oct 29 01:14:54.179146 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1265/2639] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:54.188697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a468ee94-fe33-4725-ae15-bd173cf0974b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:54.189904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a468ee94-fe33-4725-ae15-bd173cf0974b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:54.199420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a468ee94-fe33-4725-ae15-bd173cf0974b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:54.200262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a468ee94-fe33-4725-ae15-bd173cf0974b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:54.201781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a468ee94-fe33-4725-ae15-bd173cf0974b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:54.203025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a468ee94-fe33-4725-ae15-bd173cf0974b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:54.203662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a468ee94-fe33-4725-ae15-bd173cf0974b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:54.204389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a468ee94-fe33-4725-ae15-bd173cf0974b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:54.383848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-744f6779-fa07-4a05-a736-5245585de37b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:54.403198 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-744f6779-fa07-4a05-a736-5245585de37b tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1318 microversion: 2.1 time: 0.483402 Oct 29 01:14:54.407233 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1375/2640] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:53 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:54.545795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b77cbf37-a4b7-4a2d-a24b-830df8f11029 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:54.546418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b77cbf37-a4b7-4a2d-a24b-830df8f11029 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:54.557591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b77cbf37-a4b7-4a2d-a24b-830df8f11029 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:54.558418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b77cbf37-a4b7-4a2d-a24b-830df8f11029 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:54.563713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b77cbf37-a4b7-4a2d-a24b-830df8f11029 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:54.563713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b77cbf37-a4b7-4a2d-a24b-830df8f11029 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:54.563713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b77cbf37-a4b7-4a2d-a24b-830df8f11029 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:54.563713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b77cbf37-a4b7-4a2d-a24b-830df8f11029 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:54.646165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b77cbf37-a4b7-4a2d-a24b-830df8f11029 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:54.650196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a468ee94-fe33-4725-ae15-bd173cf0974b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:54.651444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b77cbf37-a4b7-4a2d-a24b-830df8f11029 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:54.652502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b77cbf37-a4b7-4a2d-a24b-830df8f11029 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:54.652995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-b77cbf37-a4b7-4a2d-a24b-830df8f11029 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lazy-loading 'fault' on Instance uuid b8914c05-5333-46a4-8930-90cb1a93e5eb {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:14:54.666280 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a468ee94-fe33-4725-ae15-bd173cf0974b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1325 microversion: 2.1 time: 0.485475 Oct 29 01:14:54.667191 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1266/2641] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:54 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1325 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:54.688788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c9f6f901-33d7-4b89-9852-309768cdf3d5 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:54.689499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c9f6f901-33d7-4b89-9852-309768cdf3d5 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:54.697147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9f6f901-33d7-4b89-9852-309768cdf3d5 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:54.697925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9f6f901-33d7-4b89-9852-309768cdf3d5 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:54.698533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9f6f901-33d7-4b89-9852-309768cdf3d5 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:54.699510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9f6f901-33d7-4b89-9852-309768cdf3d5 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:54.700123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9f6f901-33d7-4b89-9852-309768cdf3d5 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:54.700826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9f6f901-33d7-4b89-9852-309768cdf3d5 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:54.754170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b77cbf37-a4b7-4a2d-a24b-830df8f11029 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:54.774353 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b77cbf37-a4b7-4a2d-a24b-830df8f11029 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 200 len: 1324 microversion: 2.1 time: 0.234177 Oct 29 01:14:54.774948 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1376/2642] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:54 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 1324 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:54.944243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a8adb4e5-1b1a-4667-9c37-d3d933d7174f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:54.948723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a8adb4e5-1b1a-4667-9c37-d3d933d7174f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:54.955758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8adb4e5-1b1a-4667-9c37-d3d933d7174f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:54.956068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8adb4e5-1b1a-4667-9c37-d3d933d7174f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:54.957394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8adb4e5-1b1a-4667-9c37-d3d933d7174f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:54.958128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8adb4e5-1b1a-4667-9c37-d3d933d7174f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:54.958599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8adb4e5-1b1a-4667-9c37-d3d933d7174f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:54.959034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8adb4e5-1b1a-4667-9c37-d3d933d7174f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:54.993714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c9f6f901-33d7-4b89-9852-309768cdf3d5 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:55.002842 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c9f6f901-33d7-4b89-9852-309768cdf3d5 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1529 microversion: 2.1 time: 0.318917 Oct 29 01:14:55.017671 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1267/2643] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:54 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1529 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:55.024655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8be0601e-f2d9-4f10-9758-223517ab70ed tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:55.025556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8be0601e-f2d9-4f10-9758-223517ab70ed tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:55.032466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8be0601e-f2d9-4f10-9758-223517ab70ed tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:55.033372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8be0601e-f2d9-4f10-9758-223517ab70ed tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:55.033981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8be0601e-f2d9-4f10-9758-223517ab70ed tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:55.034891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8be0601e-f2d9-4f10-9758-223517ab70ed tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:55.035514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8be0601e-f2d9-4f10-9758-223517ab70ed tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:55.036101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8be0601e-f2d9-4f10-9758-223517ab70ed tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:55.277689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8be0601e-f2d9-4f10-9758-223517ab70ed tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:55.289025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8be0601e-f2d9-4f10-9758-223517ab70ed tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:55.290754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8be0601e-f2d9-4f10-9758-223517ab70ed tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:55.291991 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8be0601e-f2d9-4f10-9758-223517ab70ed tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1528 microversion: 2.42 time: 0.273252 Oct 29 01:14:55.292563 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1268/2644] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:14:55 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1528 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:14:55.311963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ae7ccd69-ce3d-4221-88a6-3a0be2a98bb0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:55.315329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ae7ccd69-ce3d-4221-88a6-3a0be2a98bb0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:55.331846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae7ccd69-ce3d-4221-88a6-3a0be2a98bb0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:55.332445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae7ccd69-ce3d-4221-88a6-3a0be2a98bb0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:55.333548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae7ccd69-ce3d-4221-88a6-3a0be2a98bb0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:55.339866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae7ccd69-ce3d-4221-88a6-3a0be2a98bb0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:55.340451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae7ccd69-ce3d-4221-88a6-3a0be2a98bb0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:55.340974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae7ccd69-ce3d-4221-88a6-3a0be2a98bb0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:55.392111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a8adb4e5-1b1a-4667-9c37-d3d933d7174f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:55.401186 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a8adb4e5-1b1a-4667-9c37-d3d933d7174f tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1315 microversion: 2.1 time: 0.462826 Oct 29 01:14:55.412118 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1377/2645] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:54 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:55.420116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-54a624c1-d232-4f09-9bff-fe0faac20e6d req-85d85831-1b4e-407a-9eff-5b6093a32897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c277e3-48a6-4a97-9e52-689482955506", "name": "network-vif-deleted", "tag": "db5809d9-cc6a-4331-aa7f-a691edfa6ab0"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:55.437401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-54a624c1-d232-4f09-9bff-fe0faac20e6d req-85d85831-1b4e-407a-9eff-5b6093a32897 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:55.438101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-54a624c1-d232-4f09-9bff-fe0faac20e6d req-85d85831-1b4e-407a-9eff-5b6093a32897 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:55.438757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-54a624c1-d232-4f09-9bff-fe0faac20e6d req-85d85831-1b4e-407a-9eff-5b6093a32897 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:55.454322 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-54a624c1-d232-4f09-9bff-fe0faac20e6d req-85d85831-1b4e-407a-9eff-5b6093a32897 service nova] Creating event network-vif-deleted:db5809d9-cc6a-4331-aa7f-a691edfa6ab0 for instance 78c277e3-48a6-4a97-9e52-689482955506 on n-h2-862964-3 Oct 29 01:14:55.461207 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-54a624c1-d232-4f09-9bff-fe0faac20e6d req-85d85831-1b4e-407a-9eff-5b6093a32897 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047110 Oct 29 01:14:55.462220 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1378/2646] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:55.469375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4f7f068a-c6e7-484c-8ecd-000259495deb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:55.470038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4f7f068a-c6e7-484c-8ecd-000259495deb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:55.481392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f7f068a-c6e7-484c-8ecd-000259495deb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:55.481392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f7f068a-c6e7-484c-8ecd-000259495deb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:55.481392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f7f068a-c6e7-484c-8ecd-000259495deb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:55.481392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f7f068a-c6e7-484c-8ecd-000259495deb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:55.481392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f7f068a-c6e7-484c-8ecd-000259495deb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:55.481392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f7f068a-c6e7-484c-8ecd-000259495deb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:55.687960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ae7ccd69-ce3d-4221-88a6-3a0be2a98bb0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:55.692271 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ae7ccd69-ce3d-4221-88a6-3a0be2a98bb0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1313 microversion: 2.1 time: 0.393163 Oct 29 01:14:55.693133 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1269/2647] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:55 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:55.698768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bb13e64a-9a96-4997-a547-637781a4acc2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:55.699385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bb13e64a-9a96-4997-a547-637781a4acc2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:55.706734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb13e64a-9a96-4997-a547-637781a4acc2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:55.711979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb13e64a-9a96-4997-a547-637781a4acc2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:55.711979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb13e64a-9a96-4997-a547-637781a4acc2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:55.711979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb13e64a-9a96-4997-a547-637781a4acc2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:55.711979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb13e64a-9a96-4997-a547-637781a4acc2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:55.711979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb13e64a-9a96-4997-a547-637781a4acc2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:55.846921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4f7f068a-c6e7-484c-8ecd-000259495deb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:55.857489 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4f7f068a-c6e7-484c-8ecd-000259495deb tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1318 microversion: 2.1 time: 0.393455 Oct 29 01:14:55.873232 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1379/2648] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:55 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:55.882075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fa51b463-85fa-4d59-ab81-3b696fdbda12 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:55.883528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fa51b463-85fa-4d59-ab81-3b696fdbda12 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: b8914c05-5333-46a4-8930-90cb1a93e5eb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:55.892432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa51b463-85fa-4d59-ab81-3b696fdbda12 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:55.893173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa51b463-85fa-4d59-ab81-3b696fdbda12 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:55.893759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa51b463-85fa-4d59-ab81-3b696fdbda12 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:55.894663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa51b463-85fa-4d59-ab81-3b696fdbda12 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:55.895329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa51b463-85fa-4d59-ab81-3b696fdbda12 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:55.895972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa51b463-85fa-4d59-ab81-3b696fdbda12 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:55.917900 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-fa51b463-85fa-4d59-ab81-3b696fdbda12 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] HTTP exception thrown: Instance b8914c05-5333-46a4-8930-90cb1a93e5eb could not be found. Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fa51b463-85fa-4d59-ab81-3b696fdbda12 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Request method failure captured: Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb HTTP/1.1 Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHysm59IN0QR7Jpvigs9GaW_uCJQ55SiVY14MKtY6qPM4WbIwqFtUZTCNxaqprF7gUzb79C0LARakiE-HVm_wnGXjWkH234yu8nfYitOC-p8n53Vma3Rsp_PyqBePucgE1GZlfP3KJ-5aDlu_LQv4Xy_7_U1cZrl8KdjAkHwpH4Q-Co Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6719b662fc734d2797d515778a57296d Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-LiveMigrationTest-173269399 Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6719b662fc734d2797d515778a57296d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6719b662fc734d2797d515778a57296d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6719b662fc734d2797d515778a57296d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6719b662fc734d2797d515778a57296d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-LiveMigrationTest-173269399 Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6719b662fc734d2797d515778a57296d Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-LiveMigrationTest-173269399 Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-LiveMigrationTest-173269399-project Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: da623c3132aa466aa25685aa45fceaf9 Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-LiveMigrationTest-173269399-project Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance b8914c05-5333-46a4-8930-90cb1a93e5eb could not be found. Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'b8914c05-5333-46a4-8930-90cb1a93e5eb'} Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8914c05-5333-46a4-8930-90cb1a93e5eb could not be found. Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8914c05-5333-46a4-8930-90cb1a93e5eb could not be found. Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:14:55.920485 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:55.930503 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:55.930503 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:14:55.930503 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:14:55.930503 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:14:55.930503 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:14:55.930503 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8914c05-5333-46a4-8930-90cb1a93e5eb could not be found. Oct 29 01:14:55.930503 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:55.930503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fa51b463-85fa-4d59-ab81-3b696fdbda12 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Returning 404 to user: Instance b8914c05-5333-46a4-8930-90cb1a93e5eb could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:14:55.930503 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fa51b463-85fa-4d59-ab81-3b696fdbda12 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb" status: 404 len: 111 microversion: 2.1 time: 0.053977 Oct 29 01:14:55.930503 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1380/2649] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:55 2022] GET /compute/v2.1/servers/b8914c05-5333-46a4-8930-90cb1a93e5eb => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:14:55.931164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-246354b7-05e2-4391-92db-fc1d0b4e18c8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '.version_select at 0x7f9d97ae1dc0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:55.944445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bb13e64a-9a96-4997-a547-637781a4acc2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:55.954528 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bb13e64a-9a96-4997-a547-637781a4acc2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1325 microversion: 2.1 time: 0.260324 Oct 29 01:14:55.955835 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1270/2650] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:55 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1325 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:56.033624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aed3d553-ed81-4660-8b8a-a8e46c581ce6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:56.034706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aed3d553-ed81-4660-8b8a-a8e46c581ce6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:56.042245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aed3d553-ed81-4660-8b8a-a8e46c581ce6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:56.042734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aed3d553-ed81-4660-8b8a-a8e46c581ce6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:56.043164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aed3d553-ed81-4660-8b8a-a8e46c581ce6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:56.053226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aed3d553-ed81-4660-8b8a-a8e46c581ce6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:56.053841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aed3d553-ed81-4660-8b8a-a8e46c581ce6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:56.054297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aed3d553-ed81-4660-8b8a-a8e46c581ce6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:56.085005 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-246354b7-05e2-4391-92db-fc1d0b4e18c8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1547659648" status: 202 len: 0 microversion: 2.1 time: 0.157869 Oct 29 01:14:56.086101 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1381/2651] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 29 01:14:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1547659648 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:14:56.111108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:56.115691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aed3d553-ed81-4660-8b8a-a8e46c581ce6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:56.115691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aed3d553-ed81-4660-8b8a-a8e46c581ce6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:56.115691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aed3d553-ed81-4660-8b8a-a8e46c581ce6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:56.120038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-aed3d553-ed81-4660-8b8a-a8e46c581ce6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lazy-loading 'fault' on Instance uuid 78c277e3-48a6-4a97-9e52-689482955506 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:14:56.136037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-e5c00e1f-1a10-49ac-b6af-fdd7de2acf75 req-d46b7f17-b38f-4073-824f-abe27f761058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfc8b0b3-923e-4144-a9ca-aeb9da2897f7", "tag": "0cf4a048-b062-4c55-871f-f69792faebb0"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:56.148125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e5c00e1f-1a10-49ac-b6af-fdd7de2acf75 req-d46b7f17-b38f-4073-824f-abe27f761058 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:56.149074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e5c00e1f-1a10-49ac-b6af-fdd7de2acf75 req-d46b7f17-b38f-4073-824f-abe27f761058 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:56.149828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e5c00e1f-1a10-49ac-b6af-fdd7de2acf75 req-d46b7f17-b38f-4073-824f-abe27f761058 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:56.163591 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-e5c00e1f-1a10-49ac-b6af-fdd7de2acf75 req-d46b7f17-b38f-4073-824f-abe27f761058 service nova] Creating event network-changed:0cf4a048-b062-4c55-871f-f69792faebb0 for instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 on n-h1-862964-3 Oct 29 01:14:56.172021 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-e5c00e1f-1a10-49ac-b6af-fdd7de2acf75 req-d46b7f17-b38f-4073-824f-abe27f761058 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039631 Oct 29 01:14:56.173276 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1382/2652] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:14:56.181144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-daa8c60e-83c3-4c72-b69e-506f8f7322f9 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:56.187747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-daa8c60e-83c3-4c72-b69e-506f8f7322f9 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:56.189327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-daa8c60e-83c3-4c72-b69e-506f8f7322f9 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Searching by: {'deleted': False, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:14:56.200574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-daa8c60e-83c3-4c72-b69e-506f8f7322f9 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:56.200574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-daa8c60e-83c3-4c72-b69e-506f8f7322f9 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:56.200574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-daa8c60e-83c3-4c72-b69e-506f8f7322f9 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:56.200574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-daa8c60e-83c3-4c72-b69e-506f8f7322f9 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:56.200574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-daa8c60e-83c3-4c72-b69e-506f8f7322f9 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:56.200574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-daa8c60e-83c3-4c72-b69e-506f8f7322f9 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:56.211995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aed3d553-ed81-4660-8b8a-a8e46c581ce6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:56.221594 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aed3d553-ed81-4660-8b8a-a8e46c581ce6 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1315 microversion: 2.1 time: 0.194901 Oct 29 01:14:56.223565 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1271/2653] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:56 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:14:56.256085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-daa8c60e-83c3-4c72-b69e-506f8f7322f9 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:14:56.295957 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-daa8c60e-83c3-4c72-b69e-506f8f7322f9 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.119981 Oct 29 01:14:56.301284 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1383/2654] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 29 01:14:56 2022] GET /compute/v2.1/servers => generated 339 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:56.311001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b6f9a63a-f7e7-4273-a603-798db6fbd835 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:56.316881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b6f9a63a-f7e7-4273-a603-798db6fbd835 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:56.317988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b6f9a63a-f7e7-4273-a603-798db6fbd835 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Searching by: {'deleted': False, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:14:56.324691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6f9a63a-f7e7-4273-a603-798db6fbd835 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:56.325763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6f9a63a-f7e7-4273-a603-798db6fbd835 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:56.326420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6f9a63a-f7e7-4273-a603-798db6fbd835 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:56.332732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6f9a63a-f7e7-4273-a603-798db6fbd835 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:56.332732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6f9a63a-f7e7-4273-a603-798db6fbd835 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:56.332732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6f9a63a-f7e7-4273-a603-798db6fbd835 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:56.333020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9e73ed1f-460f-40c6-b8a0-c6638621afc1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:56.333330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9e73ed1f-460f-40c6-b8a0-c6638621afc1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:56.339438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:56.345335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e73ed1f-460f-40c6-b8a0-c6638621afc1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:56.346086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e73ed1f-460f-40c6-b8a0-c6638621afc1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:56.346753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e73ed1f-460f-40c6-b8a0-c6638621afc1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:56.349477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e73ed1f-460f-40c6-b8a0-c6638621afc1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:56.350168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e73ed1f-460f-40c6-b8a0-c6638621afc1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:56.352051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e73ed1f-460f-40c6-b8a0-c6638621afc1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:56.358868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=11 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:56.435413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.multi_cell_list [None req-b6f9a63a-f7e7-4273-a603-798db6fbd835 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121100) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:14:56.510907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9e73ed1f-460f-40c6-b8a0-c6638621afc1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:56.536645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9e73ed1f-460f-40c6-b8a0-c6638621afc1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:56.543866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9e73ed1f-460f-40c6-b8a0-c6638621afc1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:56.545783 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9e73ed1f-460f-40c6-b8a0-c6638621afc1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1576 microversion: 2.42 time: 0.223382 Oct 29 01:14:56.546826 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1384/2655] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:14:56 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1576 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:14:56.551786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-07627ee8-0213-4993-8bb7-ecfe9bdf1581 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:56.560211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-07627ee8-0213-4993-8bb7-ecfe9bdf1581 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:56.564457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b6f9a63a-f7e7-4273-a603-798db6fbd835 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:56.572977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6f9a63a-f7e7-4273-a603-798db6fbd835 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:56.573710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6f9a63a-f7e7-4273-a603-798db6fbd835 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:56.574617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6f9a63a-f7e7-4273-a603-798db6fbd835 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:56.578314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07627ee8-0213-4993-8bb7-ecfe9bdf1581 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:56.578818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07627ee8-0213-4993-8bb7-ecfe9bdf1581 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:56.579308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07627ee8-0213-4993-8bb7-ecfe9bdf1581 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:56.580016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07627ee8-0213-4993-8bb7-ecfe9bdf1581 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:56.580634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07627ee8-0213-4993-8bb7-ecfe9bdf1581 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:56.582097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07627ee8-0213-4993-8bb7-ecfe9bdf1581 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:56.983980 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b6f9a63a-f7e7-4273-a603-798db6fbd835 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.677551 Oct 29 01:14:57.002337 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1272/2656] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:14:56 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:57.007777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7911b1c0-23bf-4740-91c7-fd7b4dd4ce00 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:57.010185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7911b1c0-23bf-4740-91c7-fd7b4dd4ce00 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:57.017489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7911b1c0-23bf-4740-91c7-fd7b4dd4ce00 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:57.018350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7911b1c0-23bf-4740-91c7-fd7b4dd4ce00 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:57.018669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7911b1c0-23bf-4740-91c7-fd7b4dd4ce00 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:57.019489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7911b1c0-23bf-4740-91c7-fd7b4dd4ce00 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:57.020081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7911b1c0-23bf-4740-91c7-fd7b4dd4ce00 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:57.020801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7911b1c0-23bf-4740-91c7-fd7b4dd4ce00 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:57.024489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-07627ee8-0213-4993-8bb7-ecfe9bdf1581 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:57.040279 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-07627ee8-0213-4993-8bb7-ecfe9bdf1581 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1315 microversion: 2.1 time: 0.490143 Oct 29 01:14:57.040456 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1385/2657] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:56 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:57.048019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5e2e4671-6c11-4dc0-87ad-1ab0cd396660 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:57.048854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5e2e4671-6c11-4dc0-87ad-1ab0cd396660 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:57.056998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e2e4671-6c11-4dc0-87ad-1ab0cd396660 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:57.057366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e2e4671-6c11-4dc0-87ad-1ab0cd396660 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:57.058772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e2e4671-6c11-4dc0-87ad-1ab0cd396660 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:57.059311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e2e4671-6c11-4dc0-87ad-1ab0cd396660 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:57.060165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e2e4671-6c11-4dc0-87ad-1ab0cd396660 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:57.060611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e2e4671-6c11-4dc0-87ad-1ab0cd396660 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:57.458691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5e2e4671-6c11-4dc0-87ad-1ab0cd396660 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:57.458916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7911b1c0-23bf-4740-91c7-fd7b4dd4ce00 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:57.467470 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7911b1c0-23bf-4740-91c7-fd7b4dd4ce00 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1313 microversion: 2.1 time: 0.463639 Oct 29 01:14:57.468126 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1273/2658] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:57 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1313 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:57.478694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c025ff7f-1ff4-42f6-b4c3-bf48e194fb0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:57.479311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c025ff7f-1ff4-42f6-b4c3-bf48e194fb0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:57.498615 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5e2e4671-6c11-4dc0-87ad-1ab0cd396660 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1505 microversion: 2.1 time: 0.455814 Oct 29 01:14:57.505975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c025ff7f-1ff4-42f6-b4c3-bf48e194fb0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:57.506566 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1386/2659] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:57 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1505 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:57.506655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c025ff7f-1ff4-42f6-b4c3-bf48e194fb0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:57.506655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c025ff7f-1ff4-42f6-b4c3-bf48e194fb0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:57.506655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c025ff7f-1ff4-42f6-b4c3-bf48e194fb0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:57.506655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c025ff7f-1ff4-42f6-b4c3-bf48e194fb0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:57.506655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c025ff7f-1ff4-42f6-b4c3-bf48e194fb0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:57.515230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b2eb772f-9c68-4fd6-8fbd-8fbc24a3d17b tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:57.556144 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b2eb772f-9c68-4fd6-8fbd-8fbc24a3d17b tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.052686 Oct 29 01:14:57.560958 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1387/2660] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:14:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:57.568439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7bf5813f-fbb9-43dd-b095-3ce58d8bcc1e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:57.572791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7bf5813f-fbb9-43dd-b095-3ce58d8bcc1e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:57.586243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bf5813f-fbb9-43dd-b095-3ce58d8bcc1e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:57.586999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bf5813f-fbb9-43dd-b095-3ce58d8bcc1e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:57.588481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bf5813f-fbb9-43dd-b095-3ce58d8bcc1e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:57.589977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bf5813f-fbb9-43dd-b095-3ce58d8bcc1e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:57.594205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bf5813f-fbb9-43dd-b095-3ce58d8bcc1e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:57.594205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bf5813f-fbb9-43dd-b095-3ce58d8bcc1e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:57.609733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:57.644982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bf5813f-fbb9-43dd-b095-3ce58d8bcc1e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:57.645886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bf5813f-fbb9-43dd-b095-3ce58d8bcc1e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:57.646504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7bf5813f-fbb9-43dd-b095-3ce58d8bcc1e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:57.646959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-7bf5813f-fbb9-43dd-b095-3ce58d8bcc1e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lazy-loading 'fault' on Instance uuid 78c277e3-48a6-4a97-9e52-689482955506 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:14:57.740050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7bf5813f-fbb9-43dd-b095-3ce58d8bcc1e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5470f9c5ba1e481fb7644b70c4a70766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dabcb4dc77b4cb982e41d436ffaf844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:57.755646 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7bf5813f-fbb9-43dd-b095-3ce58d8bcc1e tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 200 len: 1315 microversion: 2.1 time: 0.188064 Oct 29 01:14:57.755646 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1388/2661] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:57 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:57.756344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-52389a90-3b27-45c3-801c-2c8fffb9e3a5 req-2d6cf9dd-0017-4ab0-89ea-bf84412a44e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74263965-ee1f-46a3-8115-7da1ba849c83", "name": "network-vif-plugged", "status": "completed", "tag": "f927c0ed-022d-4814-9d05-eb446907453d"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:57.769063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-52389a90-3b27-45c3-801c-2c8fffb9e3a5 req-2d6cf9dd-0017-4ab0-89ea-bf84412a44e8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:57.769831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-52389a90-3b27-45c3-801c-2c8fffb9e3a5 req-2d6cf9dd-0017-4ab0-89ea-bf84412a44e8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:57.770267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-52389a90-3b27-45c3-801c-2c8fffb9e3a5 req-2d6cf9dd-0017-4ab0-89ea-bf84412a44e8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:57.786001 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-52389a90-3b27-45c3-801c-2c8fffb9e3a5 req-2d6cf9dd-0017-4ab0-89ea-bf84412a44e8 service nova] Creating event network-vif-plugged:f927c0ed-022d-4814-9d05-eb446907453d for instance 74263965-ee1f-46a3-8115-7da1ba849c83 on n-h1-862964-3 Oct 29 01:14:57.792032 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-52389a90-3b27-45c3-801c-2c8fffb9e3a5 req-2d6cf9dd-0017-4ab0-89ea-bf84412a44e8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038992 Oct 29 01:14:57.797847 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1389/2662] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:57.804150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-73b1ea58-02d3-4de0-9837-ed31f097fa98 req-ed88c7fe-8129-4c18-958a-ff82306e18e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a8fb980-1b51-4e3d-a3b7-b359dbe890a4", "tag": "0a737a69-c605-43d6-9cbb-dca20e04416c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:14:57.815606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-73b1ea58-02d3-4de0-9837-ed31f097fa98 req-ed88c7fe-8129-4c18-958a-ff82306e18e4 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:57.817666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-73b1ea58-02d3-4de0-9837-ed31f097fa98 req-ed88c7fe-8129-4c18-958a-ff82306e18e4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:57.818333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-73b1ea58-02d3-4de0-9837-ed31f097fa98 req-ed88c7fe-8129-4c18-958a-ff82306e18e4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:57.819181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c025ff7f-1ff4-42f6-b4c3-bf48e194fb0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:57.827811 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c025ff7f-1ff4-42f6-b4c3-bf48e194fb0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1325 microversion: 2.1 time: 0.354579 Oct 29 01:14:57.839403 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-73b1ea58-02d3-4de0-9837-ed31f097fa98 req-ed88c7fe-8129-4c18-958a-ff82306e18e4 service nova] Creating event network-changed:0a737a69-c605-43d6-9cbb-dca20e04416c for instance 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 on n-h1-862964-3 Oct 29 01:14:57.842807 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1274/2663] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:57 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1325 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:57.845638 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-73b1ea58-02d3-4de0-9837-ed31f097fa98 req-ed88c7fe-8129-4c18-958a-ff82306e18e4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046033 Oct 29 01:14:57.846748 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1390/2664] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:14:57.850960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1009bb4c-616b-4ab4-a59e-123b3b562f46 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:57.851867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1009bb4c-616b-4ab4-a59e-123b3b562f46 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 101e0729-34a2-439c-8ee6-23afc29b2fbe] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:57.852175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c114ded2-02a1-454c-b4cd-aa562e58f253 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:57.852893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c114ded2-02a1-454c-b4cd-aa562e58f253 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:57.860559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1009bb4c-616b-4ab4-a59e-123b3b562f46 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:57.860722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c114ded2-02a1-454c-b4cd-aa562e58f253 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:57.863821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c114ded2-02a1-454c-b4cd-aa562e58f253 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:57.863939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1009bb4c-616b-4ab4-a59e-123b3b562f46 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:57.864052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c114ded2-02a1-454c-b4cd-aa562e58f253 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:57.864144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1009bb4c-616b-4ab4-a59e-123b3b562f46 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:57.864232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c114ded2-02a1-454c-b4cd-aa562e58f253 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:57.864232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c114ded2-02a1-454c-b4cd-aa562e58f253 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:57.864232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c114ded2-02a1-454c-b4cd-aa562e58f253 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:57.865199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1009bb4c-616b-4ab4-a59e-123b3b562f46 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:57.865818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1009bb4c-616b-4ab4-a59e-123b3b562f46 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:57.866356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1009bb4c-616b-4ab4-a59e-123b3b562f46 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:57.959059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c114ded2-02a1-454c-b4cd-aa562e58f253 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:57.972376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c114ded2-02a1-454c-b4cd-aa562e58f253 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:57.974095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c114ded2-02a1-454c-b4cd-aa562e58f253 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:57.975410 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c114ded2-02a1-454c-b4cd-aa562e58f253 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1594 microversion: 2.42 time: 0.127412 Oct 29 01:14:57.976665 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1391/2665] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:14:57 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1594 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:14:57.981490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dc2b56b6-726e-4640-bd28-20ffe56d2116 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:57.982735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dc2b56b6-726e-4640-bd28-20ffe56d2116 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:57.989558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc2b56b6-726e-4640-bd28-20ffe56d2116 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:57.990241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc2b56b6-726e-4640-bd28-20ffe56d2116 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:57.990814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc2b56b6-726e-4640-bd28-20ffe56d2116 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:57.991648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc2b56b6-726e-4640-bd28-20ffe56d2116 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:57.992274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc2b56b6-726e-4640-bd28-20ffe56d2116 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:57.992834 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc2b56b6-726e-4640-bd28-20ffe56d2116 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:58.024275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dc2b56b6-726e-4640-bd28-20ffe56d2116 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:14:58.038911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1009bb4c-616b-4ab4-a59e-123b3b562f46 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:58.049141 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1009bb4c-616b-4ab4-a59e-123b3b562f46 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/101e0729-34a2-439c-8ee6-23afc29b2fbe" status: 200 len: 1505 microversion: 2.1 time: 0.205080 Oct 29 01:14:58.049738 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1275/2666] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:57 2022] GET /compute/v2.1/servers/101e0729-34a2-439c-8ee6-23afc29b2fbe => generated 1505 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:58.065572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1f20ea3a-3fce-46cb-b7df-ca7026b4bbfc tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:58.067201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1f20ea3a-3fce-46cb-b7df-ca7026b4bbfc tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:58.077672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f20ea3a-3fce-46cb-b7df-ca7026b4bbfc tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:58.078480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f20ea3a-3fce-46cb-b7df-ca7026b4bbfc tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:58.079014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f20ea3a-3fce-46cb-b7df-ca7026b4bbfc tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:58.079782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f20ea3a-3fce-46cb-b7df-ca7026b4bbfc tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:58.080342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f20ea3a-3fce-46cb-b7df-ca7026b4bbfc tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:58.080819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f20ea3a-3fce-46cb-b7df-ca7026b4bbfc tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:58.109231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1f20ea3a-3fce-46cb-b7df-ca7026b4bbfc tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:14:58.364632 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dc2b56b6-726e-4640-bd28-20ffe56d2116 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 204 len: 0 microversion: 2.1 time: 0.386178 Oct 29 01:14:58.365252 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1392/2667] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:14:57 2022] DELETE /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:14:58.379855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1a6625bf-7ae7-4d08-8959-4199b9db1a26 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:58.380576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1a6625bf-7ae7-4d08-8959-4199b9db1a26 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:58.387784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a6625bf-7ae7-4d08-8959-4199b9db1a26 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:58.389543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a6625bf-7ae7-4d08-8959-4199b9db1a26 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:58.389984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a6625bf-7ae7-4d08-8959-4199b9db1a26 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:58.390701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a6625bf-7ae7-4d08-8959-4199b9db1a26 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:58.391250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a6625bf-7ae7-4d08-8959-4199b9db1a26 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:58.391739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a6625bf-7ae7-4d08-8959-4199b9db1a26 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:58.448888 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1f20ea3a-3fce-46cb-b7df-ca7026b4bbfc tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 204 len: 0 microversion: 2.1 time: 0.394317 Oct 29 01:14:58.449993 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1276/2668] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:14:58 2022] DELETE /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:14:58.457792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-91a09a0f-2562-4305-afdf-251d18d01408 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:58.458514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-91a09a0f-2562-4305-afdf-251d18d01408 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 101e0729-34a2-439c-8ee6-23afc29b2fbe] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:58.466699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91a09a0f-2562-4305-afdf-251d18d01408 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:58.467578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91a09a0f-2562-4305-afdf-251d18d01408 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:58.468556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91a09a0f-2562-4305-afdf-251d18d01408 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:58.469363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91a09a0f-2562-4305-afdf-251d18d01408 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:58.469825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91a09a0f-2562-4305-afdf-251d18d01408 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:58.470455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91a09a0f-2562-4305-afdf-251d18d01408 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:58.504398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-91a09a0f-2562-4305-afdf-251d18d01408 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 101e0729-34a2-439c-8ee6-23afc29b2fbe] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:14:58.566901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1a6625bf-7ae7-4d08-8959-4199b9db1a26 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:58.575749 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1a6625bf-7ae7-4d08-8959-4199b9db1a26 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1315 microversion: 2.1 time: 0.204956 Oct 29 01:14:58.576490 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1393/2669] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:58 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:58.581611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0760f98b-147b-4224-b0ae-c1d56abfa564 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:58.582275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0760f98b-147b-4224-b0ae-c1d56abfa564 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:58.589771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0760f98b-147b-4224-b0ae-c1d56abfa564 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:58.590558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0760f98b-147b-4224-b0ae-c1d56abfa564 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:58.592228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0760f98b-147b-4224-b0ae-c1d56abfa564 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:58.593030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0760f98b-147b-4224-b0ae-c1d56abfa564 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:58.593589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0760f98b-147b-4224-b0ae-c1d56abfa564 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:58.594185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0760f98b-147b-4224-b0ae-c1d56abfa564 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:58.755737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0760f98b-147b-4224-b0ae-c1d56abfa564 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:58.764424 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0760f98b-147b-4224-b0ae-c1d56abfa564 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1484 microversion: 2.1 time: 0.186517 Oct 29 01:14:58.765002 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1394/2670] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:58 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1484 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:58.777765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-65c49bd9-50f5-42ef-8df5-462e85fb57a2 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:58.777765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-65c49bd9-50f5-42ef-8df5-462e85fb57a2 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:58.777765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65c49bd9-50f5-42ef-8df5-462e85fb57a2 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:58.777765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65c49bd9-50f5-42ef-8df5-462e85fb57a2 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:58.777765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65c49bd9-50f5-42ef-8df5-462e85fb57a2 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:58.778154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65c49bd9-50f5-42ef-8df5-462e85fb57a2 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:58.778299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65c49bd9-50f5-42ef-8df5-462e85fb57a2 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:58.779636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65c49bd9-50f5-42ef-8df5-462e85fb57a2 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:58.797242 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-91a09a0f-2562-4305-afdf-251d18d01408 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "DELETE /compute/v2.1/servers/101e0729-34a2-439c-8ee6-23afc29b2fbe" status: 204 len: 0 microversion: 2.1 time: 0.345386 Oct 29 01:14:58.798071 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1277/2671] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:14:58 2022] DELETE /compute/v2.1/servers/101e0729-34a2-439c-8ee6-23afc29b2fbe => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:14:58.803681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-295eb00a-241d-429d-994b-34b2e752632d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:58.804380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-295eb00a-241d-429d-994b-34b2e752632d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:58.812869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-295eb00a-241d-429d-994b-34b2e752632d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:58.816771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-295eb00a-241d-429d-994b-34b2e752632d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:58.816771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-295eb00a-241d-429d-994b-34b2e752632d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:58.816771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-295eb00a-241d-429d-994b-34b2e752632d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:58.816771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-295eb00a-241d-429d-994b-34b2e752632d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:58.816771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-295eb00a-241d-429d-994b-34b2e752632d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:58.820649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:14:58.971358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-65c49bd9-50f5-42ef-8df5-462e85fb57a2 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:58.980358 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-65c49bd9-50f5-42ef-8df5-462e85fb57a2 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 200 len: 1715 microversion: 2.1 time: 0.214212 Oct 29 01:14:58.981137 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1395/2672] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:58 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 1715 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:58.999195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-295eb00a-241d-429d-994b-34b2e752632d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:59.002566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5411ff88-98db-4501-815f-3c8fca124549 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:59.004930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5411ff88-98db-4501-815f-3c8fca124549 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] [instance: 78c277e3-48a6-4a97-9e52-689482955506] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:59.011119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5411ff88-98db-4501-815f-3c8fca124549 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:59.011745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5411ff88-98db-4501-815f-3c8fca124549 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:59.012186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5411ff88-98db-4501-815f-3c8fca124549 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:59.012716 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-295eb00a-241d-429d-994b-34b2e752632d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1313 microversion: 2.1 time: 0.213101 Oct 29 01:14:59.012958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5411ff88-98db-4501-815f-3c8fca124549 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:59.013450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5411ff88-98db-4501-815f-3c8fca124549 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:59.013910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5411ff88-98db-4501-815f-3c8fca124549 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:59.014398 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1278/2673] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:58 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:59.019315 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3e61ea3b-b308-4a45-9b5d-da4ba3ce538a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:59.019942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3e61ea3b-b308-4a45-9b5d-da4ba3ce538a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:59.026133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e61ea3b-b308-4a45-9b5d-da4ba3ce538a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:59.028294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e61ea3b-b308-4a45-9b5d-da4ba3ce538a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:59.028294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e61ea3b-b308-4a45-9b5d-da4ba3ce538a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:59.028294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e61ea3b-b308-4a45-9b5d-da4ba3ce538a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:59.029296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e61ea3b-b308-4a45-9b5d-da4ba3ce538a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:59.030115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e61ea3b-b308-4a45-9b5d-da4ba3ce538a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:59.032219 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-5411ff88-98db-4501-815f-3c8fca124549 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] HTTP exception thrown: Instance 78c277e3-48a6-4a97-9e52-689482955506 could not be found. Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5411ff88-98db-4501-815f-3c8fca124549 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Request method failure captured: Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 HTTP/1.1 Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH5nNAplj1T43_IOwSGlKrdZ_PHp5HBKzej6Pc7HMT_XfhommOt9x8oRQOE3sNFSDBkm0_3iFPGepygxq660qrt8i3kKvNa36Q4USn7DBRF2FWoAbBAHwH5CcH_A9MNY5P93GFhLU59TCDk7g0lpMQ96ORHsZ1YbTEvu58UK5FYCiwo Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 0dabcb4dc77b4cb982e41d436ffaf844 Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1547635981 Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0dabcb4dc77b4cb982e41d436ffaf844"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0dabcb4dc77b4cb982e41d436ffaf844"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0dabcb4dc77b4cb982e41d436ffaf844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0dabcb4dc77b4cb982e41d436ffaf844", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1547635981 Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 0dabcb4dc77b4cb982e41d436ffaf844 Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1547635981 Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerAddressesNegativeTestJSON-1547635981-project Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 5470f9c5ba1e481fb7644b70c4a70766 Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1547635981-project Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 78c277e3-48a6-4a97-9e52-689482955506 could not be found. Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '78c277e3-48a6-4a97-9e52-689482955506'} Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c277e3-48a6-4a97-9e52-689482955506 could not be found. Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c277e3-48a6-4a97-9e52-689482955506 could not be found. Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:59.033918 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:14:59.039094 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:59.039094 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:14:59.039094 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:14:59.039094 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:14:59.039094 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:14:59.039094 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:14:59.039094 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c277e3-48a6-4a97-9e52-689482955506 could not be found. Oct 29 01:14:59.039094 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:14:59.039094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5411ff88-98db-4501-815f-3c8fca124549 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] Returning 404 to user: Instance 78c277e3-48a6-4a97-9e52-689482955506 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:14:59.039094 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5411ff88-98db-4501-815f-3c8fca124549 tempest-ServerAddressesNegativeTestJSON-1547635981 tempest-ServerAddressesNegativeTestJSON-1547635981-project] 10.222.0.26 "GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506" status: 404 len: 111 microversion: 2.1 time: 0.044393 Oct 29 01:14:59.039094 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1396/2674] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:58 2022] GET /compute/v2.1/servers/78c277e3-48a6-4a97-9e52-689482955506 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:14:59.040861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-37f9f92a-384f-4059-b9c8-9cdc011c0ff5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:59.041501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-37f9f92a-384f-4059-b9c8-9cdc011c0ff5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:59.048940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37f9f92a-384f-4059-b9c8-9cdc011c0ff5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:59.049386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37f9f92a-384f-4059-b9c8-9cdc011c0ff5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:59.049829 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37f9f92a-384f-4059-b9c8-9cdc011c0ff5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:59.051383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37f9f92a-384f-4059-b9c8-9cdc011c0ff5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:59.051383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37f9f92a-384f-4059-b9c8-9cdc011c0ff5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:59.051383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37f9f92a-384f-4059-b9c8-9cdc011c0ff5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:59.065289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3e61ea3b-b308-4a45-9b5d-da4ba3ce538a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:14:59.204858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-37f9f92a-384f-4059-b9c8-9cdc011c0ff5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:59.212810 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-37f9f92a-384f-4059-b9c8-9cdc011c0ff5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1325 microversion: 2.1 time: 0.175804 Oct 29 01:14:59.213650 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1397/2675] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:59 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1325 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:59.240320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7889d5b1-6729-4806-ad3e-9ea8d1f09c5b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:59.241213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7889d5b1-6729-4806-ad3e-9ea8d1f09c5b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:59.248754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7889d5b1-6729-4806-ad3e-9ea8d1f09c5b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:59.249434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7889d5b1-6729-4806-ad3e-9ea8d1f09c5b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:59.249870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7889d5b1-6729-4806-ad3e-9ea8d1f09c5b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:59.250576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7889d5b1-6729-4806-ad3e-9ea8d1f09c5b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:59.251028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7889d5b1-6729-4806-ad3e-9ea8d1f09c5b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:59.251499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7889d5b1-6729-4806-ad3e-9ea8d1f09c5b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:59.345559 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3e61ea3b-b308-4a45-9b5d-da4ba3ce538a tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 204 len: 0 microversion: 2.1 time: 0.329923 Oct 29 01:14:59.346419 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1279/2676] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:14:59 2022] DELETE /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:14:59.356467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-57e1ba17-004b-40ea-8b5f-d0a64e04c9f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:59.358332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-57e1ba17-004b-40ea-8b5f-d0a64e04c9f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 101e0729-34a2-439c-8ee6-23afc29b2fbe] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:59.366580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57e1ba17-004b-40ea-8b5f-d0a64e04c9f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:59.367264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57e1ba17-004b-40ea-8b5f-d0a64e04c9f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:59.368152 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57e1ba17-004b-40ea-8b5f-d0a64e04c9f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:59.372163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57e1ba17-004b-40ea-8b5f-d0a64e04c9f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:59.372163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57e1ba17-004b-40ea-8b5f-d0a64e04c9f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:59.372163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57e1ba17-004b-40ea-8b5f-d0a64e04c9f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:59.438080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7889d5b1-6729-4806-ad3e-9ea8d1f09c5b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:59.449681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7889d5b1-6729-4806-ad3e-9ea8d1f09c5b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:59.451741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7889d5b1-6729-4806-ad3e-9ea8d1f09c5b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:59.453390 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7889d5b1-6729-4806-ad3e-9ea8d1f09c5b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1662 microversion: 2.42 time: 0.238870 Oct 29 01:14:59.454691 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1398/2677] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:14:59 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1662 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:14:59.539997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-57e1ba17-004b-40ea-8b5f-d0a64e04c9f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:59.548702 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-57e1ba17-004b-40ea-8b5f-d0a64e04c9f0 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/101e0729-34a2-439c-8ee6-23afc29b2fbe" status: 200 len: 1511 microversion: 2.1 time: 0.197552 Oct 29 01:14:59.549744 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1280/2678] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:59 2022] GET /compute/v2.1/servers/101e0729-34a2-439c-8ee6-23afc29b2fbe => generated 1511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:59.599295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-da460cbe-d8a6-447a-99fe-3d5043cd337d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:59.599915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-da460cbe-d8a6-447a-99fe-3d5043cd337d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:59.606411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da460cbe-d8a6-447a-99fe-3d5043cd337d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:59.607108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da460cbe-d8a6-447a-99fe-3d5043cd337d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:59.607771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da460cbe-d8a6-447a-99fe-3d5043cd337d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:59.608486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da460cbe-d8a6-447a-99fe-3d5043cd337d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:59.608953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da460cbe-d8a6-447a-99fe-3d5043cd337d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:59.609408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da460cbe-d8a6-447a-99fe-3d5043cd337d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:59.768502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-da460cbe-d8a6-447a-99fe-3d5043cd337d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:59.779725 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-da460cbe-d8a6-447a-99fe-3d5043cd337d tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1315 microversion: 2.1 time: 0.184136 Oct 29 01:14:59.780385 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1399/2679] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:59 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:14:59.794542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0717455e-b7ad-4052-be30-3e647c0a1794 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:14:59.796054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0717455e-b7ad-4052-be30-3e647c0a1794 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:14:59.806930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0717455e-b7ad-4052-be30-3e647c0a1794 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:59.807881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0717455e-b7ad-4052-be30-3e647c0a1794 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:59.808570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0717455e-b7ad-4052-be30-3e647c0a1794 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:59.809560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0717455e-b7ad-4052-be30-3e647c0a1794 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:14:59.810699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0717455e-b7ad-4052-be30-3e647c0a1794 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:14:59.811291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0717455e-b7ad-4052-be30-3e647c0a1794 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:14:59.969325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0717455e-b7ad-4052-be30-3e647c0a1794 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:14:59.978163 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0717455e-b7ad-4052-be30-3e647c0a1794 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1484 microversion: 2.1 time: 0.188469 Oct 29 01:14:59.978948 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1281/2680] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:14:59 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1484 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:00.005526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-453ee467-3ea4-43a9-afa0-cb54c90ed248 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:00.006312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-453ee467-3ea4-43a9-afa0-cb54c90ed248 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:00.014062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-453ee467-3ea4-43a9-afa0-cb54c90ed248 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:00.014706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-453ee467-3ea4-43a9-afa0-cb54c90ed248 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:00.015272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-453ee467-3ea4-43a9-afa0-cb54c90ed248 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:00.016088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-453ee467-3ea4-43a9-afa0-cb54c90ed248 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:00.016653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-453ee467-3ea4-43a9-afa0-cb54c90ed248 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:00.017212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-453ee467-3ea4-43a9-afa0-cb54c90ed248 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:00.039725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aa4f62f3-1f02-4024-b1e4-c13d83d79071 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:00.040665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aa4f62f3-1f02-4024-b1e4-c13d83d79071 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:00.048648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa4f62f3-1f02-4024-b1e4-c13d83d79071 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:00.049780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa4f62f3-1f02-4024-b1e4-c13d83d79071 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:00.050455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa4f62f3-1f02-4024-b1e4-c13d83d79071 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:00.051335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa4f62f3-1f02-4024-b1e4-c13d83d79071 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:00.051958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa4f62f3-1f02-4024-b1e4-c13d83d79071 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:00.052570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa4f62f3-1f02-4024-b1e4-c13d83d79071 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:00.234979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-453ee467-3ea4-43a9-afa0-cb54c90ed248 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:00.243373 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-453ee467-3ea4-43a9-afa0-cb54c90ed248 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 200 len: 1715 microversion: 2.1 time: 0.241891 Oct 29 01:15:00.257692 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1400/2681] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:00 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 1715 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:00.266314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cb802a4d-f328-4d5c-949d-2bc270cb6648 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:00.266943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cb802a4d-f328-4d5c-949d-2bc270cb6648 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:00.273547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb802a4d-f328-4d5c-949d-2bc270cb6648 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:00.273929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb802a4d-f328-4d5c-949d-2bc270cb6648 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:00.274383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb802a4d-f328-4d5c-949d-2bc270cb6648 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:00.275241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb802a4d-f328-4d5c-949d-2bc270cb6648 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:00.275706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb802a4d-f328-4d5c-949d-2bc270cb6648 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:00.276136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb802a4d-f328-4d5c-949d-2bc270cb6648 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:00.284336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aa4f62f3-1f02-4024-b1e4-c13d83d79071 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:00.293664 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aa4f62f3-1f02-4024-b1e4-c13d83d79071 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1313 microversion: 2.1 time: 0.260131 Oct 29 01:15:00.296850 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1282/2682] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:00 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:00.447457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cb802a4d-f328-4d5c-949d-2bc270cb6648 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:00.457433 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cb802a4d-f328-4d5c-949d-2bc270cb6648 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1325 microversion: 2.1 time: 0.198317 Oct 29 01:15:00.458204 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1401/2683] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:00 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1325 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:00.479102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e359e0bb-a1eb-4818-804f-7372c5ba80f7 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:00.480224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e359e0bb-a1eb-4818-804f-7372c5ba80f7 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:00.486731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e359e0bb-a1eb-4818-804f-7372c5ba80f7 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:00.487199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e359e0bb-a1eb-4818-804f-7372c5ba80f7 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:00.487635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e359e0bb-a1eb-4818-804f-7372c5ba80f7 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:00.488338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e359e0bb-a1eb-4818-804f-7372c5ba80f7 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:00.488791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e359e0bb-a1eb-4818-804f-7372c5ba80f7 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:00.498201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e359e0bb-a1eb-4818-804f-7372c5ba80f7 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:00.573171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dfc7f02c-d3f7-40e0-a4e2-809279520ebd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:00.573912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dfc7f02c-d3f7-40e0-a4e2-809279520ebd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 101e0729-34a2-439c-8ee6-23afc29b2fbe] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:00.584468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dfc7f02c-d3f7-40e0-a4e2-809279520ebd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:00.585073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dfc7f02c-d3f7-40e0-a4e2-809279520ebd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:00.585613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dfc7f02c-d3f7-40e0-a4e2-809279520ebd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:00.588873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dfc7f02c-d3f7-40e0-a4e2-809279520ebd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:00.589466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dfc7f02c-d3f7-40e0-a4e2-809279520ebd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:00.590003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dfc7f02c-d3f7-40e0-a4e2-809279520ebd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:00.724264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e359e0bb-a1eb-4818-804f-7372c5ba80f7 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:00.749997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e359e0bb-a1eb-4818-804f-7372c5ba80f7 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:00.751647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e359e0bb-a1eb-4818-804f-7372c5ba80f7 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:00.752849 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e359e0bb-a1eb-4818-804f-7372c5ba80f7 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1662 microversion: 2.42 time: 0.277662 Oct 29 01:15:00.757633 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1283/2684] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:00 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1662 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:00.805498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d0dae1e5-2e84-41a9-af57-11c56fb8b4a3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:00.808825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d0dae1e5-2e84-41a9-af57-11c56fb8b4a3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:00.815164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d0dae1e5-2e84-41a9-af57-11c56fb8b4a3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:00.815944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d0dae1e5-2e84-41a9-af57-11c56fb8b4a3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:00.816748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d0dae1e5-2e84-41a9-af57-11c56fb8b4a3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:00.817870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d0dae1e5-2e84-41a9-af57-11c56fb8b4a3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:00.818535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d0dae1e5-2e84-41a9-af57-11c56fb8b4a3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:00.819186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d0dae1e5-2e84-41a9-af57-11c56fb8b4a3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:00.824325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dfc7f02c-d3f7-40e0-a4e2-809279520ebd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:00.835992 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dfc7f02c-d3f7-40e0-a4e2-809279520ebd tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/101e0729-34a2-439c-8ee6-23afc29b2fbe" status: 200 len: 1511 microversion: 2.1 time: 0.267546 Oct 29 01:15:00.849243 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1402/2685] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:00 2022] GET /compute/v2.1/servers/101e0729-34a2-439c-8ee6-23afc29b2fbe => generated 1511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:01.004390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4fc411b7-a7c8-4339-ac08-bab9519db003 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:01.006513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4fc411b7-a7c8-4339-ac08-bab9519db003 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:01.014696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4fc411b7-a7c8-4339-ac08-bab9519db003 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:01.015622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4fc411b7-a7c8-4339-ac08-bab9519db003 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:01.016485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4fc411b7-a7c8-4339-ac08-bab9519db003 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:01.018268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4fc411b7-a7c8-4339-ac08-bab9519db003 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:01.018268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4fc411b7-a7c8-4339-ac08-bab9519db003 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:01.018719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4fc411b7-a7c8-4339-ac08-bab9519db003 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:01.039721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d0dae1e5-2e84-41a9-af57-11c56fb8b4a3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:01.050135 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d0dae1e5-2e84-41a9-af57-11c56fb8b4a3 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1315 microversion: 2.1 time: 0.249864 Oct 29 01:15:01.055270 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1284/2686] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:00 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:01.278390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e1e99413-8e9e-42e5-948c-c618ed2823bb tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:01.278390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e1e99413-8e9e-42e5-948c-c618ed2823bb tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:01.290379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1e99413-8e9e-42e5-948c-c618ed2823bb tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:01.290993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1e99413-8e9e-42e5-948c-c618ed2823bb tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:01.291302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1e99413-8e9e-42e5-948c-c618ed2823bb tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:01.292022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1e99413-8e9e-42e5-948c-c618ed2823bb tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:01.292474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1e99413-8e9e-42e5-948c-c618ed2823bb tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:01.297937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1e99413-8e9e-42e5-948c-c618ed2823bb tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:01.327902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4fc411b7-a7c8-4339-ac08-bab9519db003 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:01.343568 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4fc411b7-a7c8-4339-ac08-bab9519db003 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1484 microversion: 2.1 time: 0.344745 Oct 29 01:15:01.344407 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1403/2687] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:00 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1484 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:01.353136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5a7e94bf-2b79-4ed9-b2e9-f22aae5c6d09 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:01.354047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5a7e94bf-2b79-4ed9-b2e9-f22aae5c6d09 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:01.381035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a7e94bf-2b79-4ed9-b2e9-f22aae5c6d09 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:01.383004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a7e94bf-2b79-4ed9-b2e9-f22aae5c6d09 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:01.383004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a7e94bf-2b79-4ed9-b2e9-f22aae5c6d09 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:01.383004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a7e94bf-2b79-4ed9-b2e9-f22aae5c6d09 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:01.387159 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a7e94bf-2b79-4ed9-b2e9-f22aae5c6d09 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:01.387660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a7e94bf-2b79-4ed9-b2e9-f22aae5c6d09 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:01.698328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e1e99413-8e9e-42e5-948c-c618ed2823bb tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:01.714017 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e1e99413-8e9e-42e5-948c-c618ed2823bb tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 200 len: 1715 microversion: 2.1 time: 0.448463 Oct 29 01:15:01.730291 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1285/2688] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:01 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 1715 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:01.737969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-088a241e-69e6-46ee-acfb-6e1cf91a4f39 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:01.738796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-088a241e-69e6-46ee-acfb-6e1cf91a4f39 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:01.754895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-088a241e-69e6-46ee-acfb-6e1cf91a4f39 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:01.755806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-088a241e-69e6-46ee-acfb-6e1cf91a4f39 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:01.756261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-088a241e-69e6-46ee-acfb-6e1cf91a4f39 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:01.757131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-088a241e-69e6-46ee-acfb-6e1cf91a4f39 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:01.757895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-088a241e-69e6-46ee-acfb-6e1cf91a4f39 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:01.758479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-088a241e-69e6-46ee-acfb-6e1cf91a4f39 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:01.792781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5a7e94bf-2b79-4ed9-b2e9-f22aae5c6d09 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:01.800446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:01.807028 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5a7e94bf-2b79-4ed9-b2e9-f22aae5c6d09 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1313 microversion: 2.1 time: 0.460052 Oct 29 01:15:01.822501 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1404/2689] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:01 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1313 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:01.833212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b798da3e-7a1d-405f-a5b3-2962a6ac1397 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:01.834556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b798da3e-7a1d-405f-a5b3-2962a6ac1397 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:01.847843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b798da3e-7a1d-405f-a5b3-2962a6ac1397 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:01.848773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b798da3e-7a1d-405f-a5b3-2962a6ac1397 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:01.849394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b798da3e-7a1d-405f-a5b3-2962a6ac1397 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:01.850281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b798da3e-7a1d-405f-a5b3-2962a6ac1397 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:01.850937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b798da3e-7a1d-405f-a5b3-2962a6ac1397 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:01.851502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b798da3e-7a1d-405f-a5b3-2962a6ac1397 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:02.139819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-088a241e-69e6-46ee-acfb-6e1cf91a4f39 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:02.152141 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-088a241e-69e6-46ee-acfb-6e1cf91a4f39 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1325 microversion: 2.1 time: 0.420388 Oct 29 01:15:02.157852 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1286/2690] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:01 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1325 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:02.183074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1cacd7c9-6206-4f1a-be85-5a1f62a7baf3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:02.187702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1cacd7c9-6206-4f1a-be85-5a1f62a7baf3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 101e0729-34a2-439c-8ee6-23afc29b2fbe] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:02.199801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cacd7c9-6206-4f1a-be85-5a1f62a7baf3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:02.202408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cacd7c9-6206-4f1a-be85-5a1f62a7baf3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:02.202957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cacd7c9-6206-4f1a-be85-5a1f62a7baf3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:02.206979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cacd7c9-6206-4f1a-be85-5a1f62a7baf3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:02.207785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cacd7c9-6206-4f1a-be85-5a1f62a7baf3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:02.208442 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cacd7c9-6206-4f1a-be85-5a1f62a7baf3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:02.269887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b798da3e-7a1d-405f-a5b3-2962a6ac1397 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:02.288899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b798da3e-7a1d-405f-a5b3-2962a6ac1397 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:02.290486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b798da3e-7a1d-405f-a5b3-2962a6ac1397 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:02.291685 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b798da3e-7a1d-405f-a5b3-2962a6ac1397 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1709 microversion: 2.42 time: 0.467744 Oct 29 01:15:02.293829 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1405/2691] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:01 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1709 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:02.342155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f8fcc9a5-4d56-4663-b9c9-f6d32956a289 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:02.342819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f8fcc9a5-4d56-4663-b9c9-f6d32956a289 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:02.355510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8fcc9a5-4d56-4663-b9c9-f6d32956a289 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:02.356009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8fcc9a5-4d56-4663-b9c9-f6d32956a289 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:02.356452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8fcc9a5-4d56-4663-b9c9-f6d32956a289 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:02.357613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8fcc9a5-4d56-4663-b9c9-f6d32956a289 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:02.358082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8fcc9a5-4d56-4663-b9c9-f6d32956a289 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:02.358511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8fcc9a5-4d56-4663-b9c9-f6d32956a289 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:02.813784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=13 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:03.296861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f8fcc9a5-4d56-4663-b9c9-f6d32956a289 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:03.299982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1cacd7c9-6206-4f1a-be85-5a1f62a7baf3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:03.309715 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1cacd7c9-6206-4f1a-be85-5a1f62a7baf3 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/101e0729-34a2-439c-8ee6-23afc29b2fbe" status: 200 len: 1511 microversion: 2.1 time: 1.136006 Oct 29 01:15:03.329190 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1287/2692] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:02 2022] GET /compute/v2.1/servers/101e0729-34a2-439c-8ee6-23afc29b2fbe => generated 1511 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:03.329397 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f8fcc9a5-4d56-4663-b9c9-f6d32956a289 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1315 microversion: 2.1 time: 1.006870 Oct 29 01:15:03.329397 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1406/2693] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:02 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1315 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:03.329558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-fd968177-3470-4695-90c9-6504ac48686a req-60e5e690-9cc7-4f98-88d5-0a93c1819a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f346c718-28f2-4983-84f1-70909b4505a7", "name": "network-vif-deleted", "tag": "dce0d611-7bbc-4151-915f-2f5d25b6d83b"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:03.332633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-435858d9-ffb1-459e-a22f-71d98d4db064 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:03.333398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-435858d9-ffb1-459e-a22f-71d98d4db064 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:03.353780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-435858d9-ffb1-459e-a22f-71d98d4db064 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:03.353990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-fd968177-3470-4695-90c9-6504ac48686a req-60e5e690-9cc7-4f98-88d5-0a93c1819a1c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:03.353990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-fd968177-3470-4695-90c9-6504ac48686a req-60e5e690-9cc7-4f98-88d5-0a93c1819a1c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:03.353990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-fd968177-3470-4695-90c9-6504ac48686a req-60e5e690-9cc7-4f98-88d5-0a93c1819a1c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:03.354260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-435858d9-ffb1-459e-a22f-71d98d4db064 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:03.354611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-435858d9-ffb1-459e-a22f-71d98d4db064 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:03.364704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-435858d9-ffb1-459e-a22f-71d98d4db064 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:03.364704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-435858d9-ffb1-459e-a22f-71d98d4db064 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:03.364704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-435858d9-ffb1-459e-a22f-71d98d4db064 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:03.379604 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-fd968177-3470-4695-90c9-6504ac48686a req-60e5e690-9cc7-4f98-88d5-0a93c1819a1c service nova] Creating event network-vif-deleted:dce0d611-7bbc-4151-915f-2f5d25b6d83b for instance f346c718-28f2-4983-84f1-70909b4505a7 on n-h2-862964-3 Oct 29 01:15:03.391075 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-fd968177-3470-4695-90c9-6504ac48686a req-60e5e690-9cc7-4f98-88d5-0a93c1819a1c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071448 Oct 29 01:15:03.392622 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1288/2694] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:03.414701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f7c05287-707c-4cca-93b4-8270a9916bd7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:03.419842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f7c05287-707c-4cca-93b4-8270a9916bd7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:03.446678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7c05287-707c-4cca-93b4-8270a9916bd7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:03.457879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-435858d9-ffb1-459e-a22f-71d98d4db064 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:03.458663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-435858d9-ffb1-459e-a22f-71d98d4db064 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:03.461442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-435858d9-ffb1-459e-a22f-71d98d4db064 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:03.461614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7c05287-707c-4cca-93b4-8270a9916bd7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:03.462250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7c05287-707c-4cca-93b4-8270a9916bd7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:03.462409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-435858d9-ffb1-459e-a22f-71d98d4db064 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lazy-loading 'fault' on Instance uuid f346c718-28f2-4983-84f1-70909b4505a7 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:15:03.463092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7c05287-707c-4cca-93b4-8270a9916bd7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:03.463579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7c05287-707c-4cca-93b4-8270a9916bd7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:03.464021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7c05287-707c-4cca-93b4-8270a9916bd7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:03.746010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-435858d9-ffb1-459e-a22f-71d98d4db064 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:03.757599 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-435858d9-ffb1-459e-a22f-71d98d4db064 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 200 len: 1301 microversion: 2.1 time: 0.438831 Oct 29 01:15:03.775353 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1407/2695] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:03 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 1301 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:03.783673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3dea3c94-b3e2-4436-9cd4-5c42284f651f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:03.784522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3dea3c94-b3e2-4436-9cd4-5c42284f651f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:03.791914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3dea3c94-b3e2-4436-9cd4-5c42284f651f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:03.792721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3dea3c94-b3e2-4436-9cd4-5c42284f651f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:03.793609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3dea3c94-b3e2-4436-9cd4-5c42284f651f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:03.795975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3dea3c94-b3e2-4436-9cd4-5c42284f651f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:03.796493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3dea3c94-b3e2-4436-9cd4-5c42284f651f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:03.796934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3dea3c94-b3e2-4436-9cd4-5c42284f651f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:03.960650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f7c05287-707c-4cca-93b4-8270a9916bd7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:03.972603 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f7c05287-707c-4cca-93b4-8270a9916bd7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 200 len: 1715 microversion: 2.1 time: 0.578496 Oct 29 01:15:03.989494 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1289/2696] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:03 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 1715 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:03.989494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f072b564-64d1-40a8-8d5f-c4b1c3165d47 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:03.989494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f072b564-64d1-40a8-8d5f-c4b1c3165d47 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:03.989494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f072b564-64d1-40a8-8d5f-c4b1c3165d47 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:03.989494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f072b564-64d1-40a8-8d5f-c4b1c3165d47 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:03.989494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f072b564-64d1-40a8-8d5f-c4b1c3165d47 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:03.989494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f072b564-64d1-40a8-8d5f-c4b1c3165d47 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:03.989494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f072b564-64d1-40a8-8d5f-c4b1c3165d47 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:03.990268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f072b564-64d1-40a8-8d5f-c4b1c3165d47 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:04.558100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3dea3c94-b3e2-4436-9cd4-5c42284f651f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:04.563140 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f072b564-64d1-40a8-8d5f-c4b1c3165d47 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:04.569707 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3dea3c94-b3e2-4436-9cd4-5c42284f651f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1313 microversion: 2.1 time: 0.792688 Oct 29 01:15:04.570514 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1408/2697] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:03 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1313 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:04.576109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-010f287b-54c4-4e11-8685-ea7db59216da tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:04.576285 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f072b564-64d1-40a8-8d5f-c4b1c3165d47 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1325 microversion: 2.1 time: 0.597802 Oct 29 01:15:04.577288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-010f287b-54c4-4e11-8685-ea7db59216da tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:04.577593 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1290/2698] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:03 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1325 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:04.589346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-010f287b-54c4-4e11-8685-ea7db59216da tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:04.589346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-010f287b-54c4-4e11-8685-ea7db59216da tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:04.589346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-010f287b-54c4-4e11-8685-ea7db59216da tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:04.589346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-010f287b-54c4-4e11-8685-ea7db59216da tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:04.589346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-010f287b-54c4-4e11-8685-ea7db59216da tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:04.589346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-010f287b-54c4-4e11-8685-ea7db59216da tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:04.601448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-aae3a617-988f-4c15-81f7-c07ab2f41280 req-e6a7ba79-f9fd-4190-854a-40ced9b8e5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfc8b0b3-923e-4144-a9ca-aeb9da2897f7", "name": "network-vif-plugged", "status": "completed", "tag": "0cf4a048-b062-4c55-871f-f69792faebb0"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:04.633534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-aae3a617-988f-4c15-81f7-c07ab2f41280 req-e6a7ba79-f9fd-4190-854a-40ced9b8e5ef service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:04.634151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-aae3a617-988f-4c15-81f7-c07ab2f41280 req-e6a7ba79-f9fd-4190-854a-40ced9b8e5ef service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:04.634862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-aae3a617-988f-4c15-81f7-c07ab2f41280 req-e6a7ba79-f9fd-4190-854a-40ced9b8e5ef service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:04.667608 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-aae3a617-988f-4c15-81f7-c07ab2f41280 req-e6a7ba79-f9fd-4190-854a-40ced9b8e5ef service nova] Creating event network-vif-plugged:0cf4a048-b062-4c55-871f-f69792faebb0 for instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 on n-h1-862964-3 Oct 29 01:15:04.683673 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-aae3a617-988f-4c15-81f7-c07ab2f41280 req-e6a7ba79-f9fd-4190-854a-40ced9b8e5ef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085215 Oct 29 01:15:04.684463 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1291/2699] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:04.692116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e3c6a07b-7245-4b90-8ef1-d028c4b10f70 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:04.697512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e3c6a07b-7245-4b90-8ef1-d028c4b10f70 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:04.701903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3c6a07b-7245-4b90-8ef1-d028c4b10f70 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:04.702556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3c6a07b-7245-4b90-8ef1-d028c4b10f70 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:04.703302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3c6a07b-7245-4b90-8ef1-d028c4b10f70 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:04.704125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3c6a07b-7245-4b90-8ef1-d028c4b10f70 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:04.704703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3c6a07b-7245-4b90-8ef1-d028c4b10f70 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:04.705295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3c6a07b-7245-4b90-8ef1-d028c4b10f70 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:05.056778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-010f287b-54c4-4e11-8685-ea7db59216da tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:05.073232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-010f287b-54c4-4e11-8685-ea7db59216da tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:05.075158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-010f287b-54c4-4e11-8685-ea7db59216da tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:05.077682 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-010f287b-54c4-4e11-8685-ea7db59216da tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1756 microversion: 2.42 time: 0.506066 Oct 29 01:15:05.096906 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1409/2700] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:04 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1756 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:05.104736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e3c6a07b-7245-4b90-8ef1-d028c4b10f70 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:05.112929 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e3c6a07b-7245-4b90-8ef1-d028c4b10f70 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1315 microversion: 2.1 time: 0.426252 Oct 29 01:15:05.113269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-79c71819-3ab7-4485-9a14-dcbfba45a478 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:05.114426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-79c71819-3ab7-4485-9a14-dcbfba45a478 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 101e0729-34a2-439c-8ee6-23afc29b2fbe] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:05.118441 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1292/2701] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:04 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:05.139680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-4cdd127f-8b9c-4638-b04c-997694ca0f4b req-6ba419a1-3a15-4bc0-a94f-178dc56746a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101e0729-34a2-439c-8ee6-23afc29b2fbe", "name": "network-vif-deleted", "tag": "bff7bfcb-a949-4c76-9885-bf8a435a3c11"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:05.160225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4cdd127f-8b9c-4638-b04c-997694ca0f4b req-6ba419a1-3a15-4bc0-a94f-178dc56746a4 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:05.161080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4cdd127f-8b9c-4638-b04c-997694ca0f4b req-6ba419a1-3a15-4bc0-a94f-178dc56746a4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:05.170070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4cdd127f-8b9c-4638-b04c-997694ca0f4b req-6ba419a1-3a15-4bc0-a94f-178dc56746a4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:05.186012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79c71819-3ab7-4485-9a14-dcbfba45a478 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:05.188129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79c71819-3ab7-4485-9a14-dcbfba45a478 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:05.192873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79c71819-3ab7-4485-9a14-dcbfba45a478 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:05.200288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79c71819-3ab7-4485-9a14-dcbfba45a478 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:05.205111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79c71819-3ab7-4485-9a14-dcbfba45a478 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:05.206025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79c71819-3ab7-4485-9a14-dcbfba45a478 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:05.247885 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-4cdd127f-8b9c-4638-b04c-997694ca0f4b req-6ba419a1-3a15-4bc0-a94f-178dc56746a4 service nova] Creating event network-vif-deleted:bff7bfcb-a949-4c76-9885-bf8a435a3c11 for instance 101e0729-34a2-439c-8ee6-23afc29b2fbe on n-h2-862964-3 Oct 29 01:15:05.260688 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-4cdd127f-8b9c-4638-b04c-997694ca0f4b req-6ba419a1-3a15-4bc0-a94f-178dc56746a4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139559 Oct 29 01:15:05.265143 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1293/2702] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:05.284864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8fccbd99-34c0-459f-9ab5-d66035d3bc8f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:05.285375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8fccbd99-34c0-459f-9ab5-d66035d3bc8f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: f346c718-28f2-4983-84f1-70909b4505a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:05.293099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8fccbd99-34c0-459f-9ab5-d66035d3bc8f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:05.293883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8fccbd99-34c0-459f-9ab5-d66035d3bc8f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:05.294402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8fccbd99-34c0-459f-9ab5-d66035d3bc8f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:05.295276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8fccbd99-34c0-459f-9ab5-d66035d3bc8f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:05.295923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8fccbd99-34c0-459f-9ab5-d66035d3bc8f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:05.304756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8fccbd99-34c0-459f-9ab5-d66035d3bc8f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:05.305021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79c71819-3ab7-4485-9a14-dcbfba45a478 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:05.306027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79c71819-3ab7-4485-9a14-dcbfba45a478 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:05.306743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79c71819-3ab7-4485-9a14-dcbfba45a478 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:05.307506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-79c71819-3ab7-4485-9a14-dcbfba45a478 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lazy-loading 'fault' on Instance uuid 101e0729-34a2-439c-8ee6-23afc29b2fbe {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:15:05.331166 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-8fccbd99-34c0-459f-9ab5-d66035d3bc8f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] HTTP exception thrown: Instance f346c718-28f2-4983-84f1-70909b4505a7 could not be found. Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8fccbd99-34c0-459f-9ab5-d66035d3bc8f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Request method failure captured: Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 HTTP/1.1 Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXHysm59IN0QR7Jpvigs9GaW_uCJQ55SiVY14MKtY6qPM4WbIwqFtUZTCNxaqprF7gUzb79C0LARakiE-HVm_wnGXjWkH234yu8nfYitOC-p8n53Vma3Rsp_PyqBePucgE1GZlfP3KJ-5aDlu_LQv4Xy_7_U1cZrl8KdjAkHwpH4Q-Co Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 6719b662fc734d2797d515778a57296d Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-LiveMigrationTest-173269399 Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6719b662fc734d2797d515778a57296d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6719b662fc734d2797d515778a57296d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6719b662fc734d2797d515778a57296d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6719b662fc734d2797d515778a57296d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-LiveMigrationTest-173269399 Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 6719b662fc734d2797d515778a57296d Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-LiveMigrationTest-173269399 Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-LiveMigrationTest-173269399-project Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: da623c3132aa466aa25685aa45fceaf9 Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-LiveMigrationTest-173269399-project Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance f346c718-28f2-4983-84f1-70909b4505a7 could not be found. Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'f346c718-28f2-4983-84f1-70909b4505a7'} Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f346c718-28f2-4983-84f1-70909b4505a7 could not be found. Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f346c718-28f2-4983-84f1-70909b4505a7 could not be found. Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:05.342939 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:05.355123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:05.355123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:05.355123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:05.355123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:05.355123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:05.355123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f346c718-28f2-4983-84f1-70909b4505a7 could not be found. Oct 29 01:15:05.355123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:05.355123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8fccbd99-34c0-459f-9ab5-d66035d3bc8f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Returning 404 to user: Instance f346c718-28f2-4983-84f1-70909b4505a7 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:05.355123 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8fccbd99-34c0-459f-9ab5-d66035d3bc8f tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7" status: 404 len: 111 microversion: 2.1 time: 0.080269 Oct 29 01:15:05.355123 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1294/2703] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:05 2022] GET /compute/v2.1/servers/f346c718-28f2-4983-84f1-70909b4505a7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:05.355123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7baa79b5-87f0-467a-9fef-9d7085b6dc77 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:05.357758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7baa79b5-87f0-467a-9fef-9d7085b6dc77 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:05.376937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7baa79b5-87f0-467a-9fef-9d7085b6dc77 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:05.377461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7baa79b5-87f0-467a-9fef-9d7085b6dc77 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:05.377901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7baa79b5-87f0-467a-9fef-9d7085b6dc77 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:05.378976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7baa79b5-87f0-467a-9fef-9d7085b6dc77 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:05.379700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7baa79b5-87f0-467a-9fef-9d7085b6dc77 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:05.380363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7baa79b5-87f0-467a-9fef-9d7085b6dc77 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:05.412389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-79c71819-3ab7-4485-9a14-dcbfba45a478 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:05.424722 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-79c71819-3ab7-4485-9a14-dcbfba45a478 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/101e0729-34a2-439c-8ee6-23afc29b2fbe" status: 200 len: 1308 microversion: 2.1 time: 0.326176 Oct 29 01:15:05.428263 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1410/2704] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:05 2022] GET /compute/v2.1/servers/101e0729-34a2-439c-8ee6-23afc29b2fbe => generated 1308 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:05.438074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b027ba1e-7f72-479a-9053-0a588a0185a3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:05.442070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b027ba1e-7f72-479a-9053-0a588a0185a3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:05.477730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b027ba1e-7f72-479a-9053-0a588a0185a3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:05.480764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b027ba1e-7f72-479a-9053-0a588a0185a3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:05.482505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b027ba1e-7f72-479a-9053-0a588a0185a3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:05.483303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b027ba1e-7f72-479a-9053-0a588a0185a3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:05.489401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b027ba1e-7f72-479a-9053-0a588a0185a3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:05.490240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b027ba1e-7f72-479a-9053-0a588a0185a3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:05.578147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b027ba1e-7f72-479a-9053-0a588a0185a3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:15:05.702398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7baa79b5-87f0-467a-9fef-9d7085b6dc77 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:05.713777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:05.722085 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7baa79b5-87f0-467a-9fef-9d7085b6dc77 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 200 len: 1647 microversion: 2.1 time: 0.373260 Oct 29 01:15:05.737186 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1295/2705] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:05 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 1647 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:05.737186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6bd06797-5bff-416d-bdfa-1cf507a20c8c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:05.737186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6bd06797-5bff-416d-bdfa-1cf507a20c8c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:05.745851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bd06797-5bff-416d-bdfa-1cf507a20c8c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:05.746350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bd06797-5bff-416d-bdfa-1cf507a20c8c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:05.746794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bd06797-5bff-416d-bdfa-1cf507a20c8c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:05.748031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bd06797-5bff-416d-bdfa-1cf507a20c8c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:05.748659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bd06797-5bff-416d-bdfa-1cf507a20c8c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:05.749346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bd06797-5bff-416d-bdfa-1cf507a20c8c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:06.046299 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b027ba1e-7f72-479a-9053-0a588a0185a3 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 204 len: 0 microversion: 2.1 time: 0.616478 Oct 29 01:15:06.047958 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1411/2706] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:15:05 2022] DELETE /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:15:06.063913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d4477eb8-1565-40f6-afa3-563bcf7ab91c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:06.066768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d4477eb8-1565-40f6-afa3-563bcf7ab91c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:06.076241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4477eb8-1565-40f6-afa3-563bcf7ab91c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:06.077707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4477eb8-1565-40f6-afa3-563bcf7ab91c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:06.082675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4477eb8-1565-40f6-afa3-563bcf7ab91c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:06.082675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4477eb8-1565-40f6-afa3-563bcf7ab91c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:06.082675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4477eb8-1565-40f6-afa3-563bcf7ab91c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:06.082675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d4477eb8-1565-40f6-afa3-563bcf7ab91c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:06.102958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6bd06797-5bff-416d-bdfa-1cf507a20c8c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:06.135157 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6bd06797-5bff-416d-bdfa-1cf507a20c8c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1313 microversion: 2.1 time: 0.410918 Oct 29 01:15:06.136462 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1296/2707] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:05 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:06.144056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fc1f96f8-cebf-4285-a4d9-5a9410394d72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:06.146354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fc1f96f8-cebf-4285-a4d9-5a9410394d72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:06.155511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc1f96f8-cebf-4285-a4d9-5a9410394d72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:06.156298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc1f96f8-cebf-4285-a4d9-5a9410394d72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:06.156887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc1f96f8-cebf-4285-a4d9-5a9410394d72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:06.157923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc1f96f8-cebf-4285-a4d9-5a9410394d72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:06.158527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc1f96f8-cebf-4285-a4d9-5a9410394d72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:06.159130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc1f96f8-cebf-4285-a4d9-5a9410394d72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:06.207670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:06.541750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=15 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:06.624201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d4477eb8-1565-40f6-afa3-563bcf7ab91c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:06.637980 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d4477eb8-1565-40f6-afa3-563bcf7ab91c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1325 microversion: 2.1 time: 0.587377 Oct 29 01:15:06.639230 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1412/2708] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:06 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1325 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:06.649710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c9808568-f29e-4fb3-b033-c71d63bf6641 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:06.676589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c9808568-f29e-4fb3-b033-c71d63bf6641 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:06.676589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9808568-f29e-4fb3-b033-c71d63bf6641 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:06.676589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9808568-f29e-4fb3-b033-c71d63bf6641 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:06.676589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9808568-f29e-4fb3-b033-c71d63bf6641 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:06.676589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9808568-f29e-4fb3-b033-c71d63bf6641 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:06.676589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9808568-f29e-4fb3-b033-c71d63bf6641 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:06.676589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9808568-f29e-4fb3-b033-c71d63bf6641 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:06.690941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fc1f96f8-cebf-4285-a4d9-5a9410394d72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:06.705504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:06.718221 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fc1f96f8-cebf-4285-a4d9-5a9410394d72 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1499 microversion: 2.1 time: 0.577522 Oct 29 01:15:06.721079 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1297/2709] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:06 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1499 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:06.730997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2f24436b-d28e-4f29-8976-16041716d5c7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:06.877194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2f24436b-d28e-4f29-8976-16041716d5c7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:06.877194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f24436b-d28e-4f29-8976-16041716d5c7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:06.877194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f24436b-d28e-4f29-8976-16041716d5c7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:06.877194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f24436b-d28e-4f29-8976-16041716d5c7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:06.877194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f24436b-d28e-4f29-8976-16041716d5c7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:06.877194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f24436b-d28e-4f29-8976-16041716d5c7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:06.877194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f24436b-d28e-4f29-8976-16041716d5c7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:06.878579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c9808568-f29e-4fb3-b033-c71d63bf6641 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:06.880288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c9808568-f29e-4fb3-b033-c71d63bf6641 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:06.881995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c9808568-f29e-4fb3-b033-c71d63bf6641 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:06.883181 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c9808568-f29e-4fb3-b033-c71d63bf6641 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1756 microversion: 2.42 time: 0.239735 Oct 29 01:15:06.897212 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1413/2710] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:06 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1756 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:06.910207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-ac35fa28-be04-463e-9f17-41f5b4d9fedf req-439b4ba4-47d7-4e40-b8eb-4c3eb51a747e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8218af-8624-4be9-8ae8-3c335c4af98b", "name": "network-vif-deleted", "tag": "0a9971a0-79e6-4307-9847-31fa1d9d3699"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:06.939313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ac35fa28-be04-463e-9f17-41f5b4d9fedf req-439b4ba4-47d7-4e40-b8eb-4c3eb51a747e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:06.940308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ac35fa28-be04-463e-9f17-41f5b4d9fedf req-439b4ba4-47d7-4e40-b8eb-4c3eb51a747e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:06.940755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ac35fa28-be04-463e-9f17-41f5b4d9fedf req-439b4ba4-47d7-4e40-b8eb-4c3eb51a747e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:06.978391 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-ac35fa28-be04-463e-9f17-41f5b4d9fedf req-439b4ba4-47d7-4e40-b8eb-4c3eb51a747e service nova] Creating event network-vif-deleted:0a9971a0-79e6-4307-9847-31fa1d9d3699 for instance 0e8218af-8624-4be9-8ae8-3c335c4af98b on n-h2-862964-3 Oct 29 01:15:06.989655 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-ac35fa28-be04-463e-9f17-41f5b4d9fedf req-439b4ba4-47d7-4e40-b8eb-4c3eb51a747e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103304 Oct 29 01:15:06.990792 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1414/2711] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:06.996520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-27c6f317-abae-43a7-ad39-4f8df4b03e7f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:06.997704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-27c6f317-abae-43a7-ad39-4f8df4b03e7f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: 101e0729-34a2-439c-8ee6-23afc29b2fbe] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:07.005975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27c6f317-abae-43a7-ad39-4f8df4b03e7f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:07.006532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27c6f317-abae-43a7-ad39-4f8df4b03e7f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:07.006970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27c6f317-abae-43a7-ad39-4f8df4b03e7f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:07.007848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27c6f317-abae-43a7-ad39-4f8df4b03e7f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:07.008309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27c6f317-abae-43a7-ad39-4f8df4b03e7f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:07.008735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27c6f317-abae-43a7-ad39-4f8df4b03e7f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:07.030998 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-27c6f317-abae-43a7-ad39-4f8df4b03e7f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] HTTP exception thrown: Instance 101e0729-34a2-439c-8ee6-23afc29b2fbe could not be found. Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-27c6f317-abae-43a7-ad39-4f8df4b03e7f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Request method failure captured: Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/101e0729-34a2-439c-8ee6-23afc29b2fbe HTTP/1.1 Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH5LVFJfCOFS129dkiAvUCZaO8XtVoicy8oV3vayiy_e2Lroc9weD8Gu4mI67UG2-o1bqO0akx248ZDgLcSSIiurbegmn9Yv5ZsNoAu0_4glH-6xMot6OaaqCYtnCBLkziC2EwEr4u-oURVe6WiY7x_oxgJvTsKVKEcaOTegXDzRm00 Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 9d0066a293d6440fb9f5c55b3d636d51 Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-MultipleCreateTestJSON-1507763444 Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9d0066a293d6440fb9f5c55b3d636d51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9d0066a293d6440fb9f5c55b3d636d51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9d0066a293d6440fb9f5c55b3d636d51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9d0066a293d6440fb9f5c55b3d636d51", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-MultipleCreateTestJSON-1507763444 Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 9d0066a293d6440fb9f5c55b3d636d51 Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1507763444 Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-MultipleCreateTestJSON-1507763444-project Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 187158ff3fc04e5789d8865fee46f01f Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-MultipleCreateTestJSON-1507763444-project Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 101e0729-34a2-439c-8ee6-23afc29b2fbe could not be found. Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '101e0729-34a2-439c-8ee6-23afc29b2fbe'} Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 101e0729-34a2-439c-8ee6-23afc29b2fbe could not be found. Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 101e0729-34a2-439c-8ee6-23afc29b2fbe could not be found. Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:07.032867 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:07.039037 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:07.039037 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:07.039037 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:07.039037 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:07.039037 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:07.039037 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 101e0729-34a2-439c-8ee6-23afc29b2fbe could not be found. Oct 29 01:15:07.039037 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:07.039037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-27c6f317-abae-43a7-ad39-4f8df4b03e7f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Returning 404 to user: Instance 101e0729-34a2-439c-8ee6-23afc29b2fbe could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:07.039037 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-27c6f317-abae-43a7-ad39-4f8df4b03e7f tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/101e0729-34a2-439c-8ee6-23afc29b2fbe" status: 404 len: 111 microversion: 2.1 time: 0.042505 Oct 29 01:15:07.039037 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1415/2712] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:06 2022] GET /compute/v2.1/servers/101e0729-34a2-439c-8ee6-23afc29b2fbe => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:07.040859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1efaa646-79f1-432f-85cb-25430c489a90 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:07.041511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1efaa646-79f1-432f-85cb-25430c489a90 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:07.049553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1efaa646-79f1-432f-85cb-25430c489a90 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:07.050039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1efaa646-79f1-432f-85cb-25430c489a90 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:07.050654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1efaa646-79f1-432f-85cb-25430c489a90 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:07.051528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1efaa646-79f1-432f-85cb-25430c489a90 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:07.052240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1efaa646-79f1-432f-85cb-25430c489a90 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:07.052810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1efaa646-79f1-432f-85cb-25430c489a90 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:07.072758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2f24436b-d28e-4f29-8976-16041716d5c7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:07.085428 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2f24436b-d28e-4f29-8976-16041716d5c7 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1501 microversion: 2.1 time: 0.360317 Oct 29 01:15:07.101753 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1298/2713] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:06 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1501 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:07.101753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-277067c9-3a33-4bb7-97c8-3d2572b95ea5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:07.101753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-277067c9-3a33-4bb7-97c8-3d2572b95ea5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:07.101753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-277067c9-3a33-4bb7-97c8-3d2572b95ea5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:07.103194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-277067c9-3a33-4bb7-97c8-3d2572b95ea5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:07.103194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-277067c9-3a33-4bb7-97c8-3d2572b95ea5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:07.103429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-277067c9-3a33-4bb7-97c8-3d2572b95ea5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:07.104125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-277067c9-3a33-4bb7-97c8-3d2572b95ea5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:07.104557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-277067c9-3a33-4bb7-97c8-3d2572b95ea5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:07.114520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1efaa646-79f1-432f-85cb-25430c489a90 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:07.115970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1efaa646-79f1-432f-85cb-25430c489a90 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:07.116581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1efaa646-79f1-432f-85cb-25430c489a90 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:07.117261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-1efaa646-79f1-432f-85cb-25430c489a90 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lazy-loading 'fault' on Instance uuid 0e8218af-8624-4be9-8ae8-3c335c4af98b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:15:07.168298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1efaa646-79f1-432f-85cb-25430c489a90 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff07349003488586b5d8f3f2aaf995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9690bcd50e1416ca83f62fbc3940364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:07.185355 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1efaa646-79f1-432f-85cb-25430c489a90 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 200 len: 1367 microversion: 2.1 time: 0.148479 Oct 29 01:15:07.190354 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1416/2714] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:07 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:07.199893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c611b016-9cb2-4779-9966-fb54bb5aad2c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:07.202423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c611b016-9cb2-4779-9966-fb54bb5aad2c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:07.217774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c611b016-9cb2-4779-9966-fb54bb5aad2c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:07.218333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c611b016-9cb2-4779-9966-fb54bb5aad2c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:07.219902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c611b016-9cb2-4779-9966-fb54bb5aad2c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:07.220719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c611b016-9cb2-4779-9966-fb54bb5aad2c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:07.221213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c611b016-9cb2-4779-9966-fb54bb5aad2c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:07.229302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c611b016-9cb2-4779-9966-fb54bb5aad2c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:07.268716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-277067c9-3a33-4bb7-97c8-3d2572b95ea5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:07.280310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-c611b016-9cb2-4779-9966-fb54bb5aad2c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lazy-loading 'flavor' on Instance uuid 74263965-ee1f-46a3-8115-7da1ba849c83 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:15:07.280522 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-277067c9-3a33-4bb7-97c8-3d2572b95ea5 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1469 microversion: 2.1 time: 0.192966 Oct 29 01:15:07.281404 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1299/2715] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:07 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1469 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:07.289389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-13941fa7-f6e2-4261-b0b5-45ffef56bf67 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:07.291761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-13941fa7-f6e2-4261-b0b5-45ffef56bf67 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:07.306604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13941fa7-f6e2-4261-b0b5-45ffef56bf67 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:07.307420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13941fa7-f6e2-4261-b0b5-45ffef56bf67 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:07.308197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13941fa7-f6e2-4261-b0b5-45ffef56bf67 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:07.310451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13941fa7-f6e2-4261-b0b5-45ffef56bf67 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:07.310857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13941fa7-f6e2-4261-b0b5-45ffef56bf67 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:07.311290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13941fa7-f6e2-4261-b0b5-45ffef56bf67 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:07.537434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-13941fa7-f6e2-4261-b0b5-45ffef56bf67 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:07.546234 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-13941fa7-f6e2-4261-b0b5-45ffef56bf67 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1313 microversion: 2.1 time: 0.263202 Oct 29 01:15:07.547361 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1300/2716] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:07 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:07.555323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-6af24c54-9cc5-4f1b-a867-87402387570b req-4beafeeb-e302-433b-b0f5-74eb989b377f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d98dce2e-4cfb-48a3-8879-8ec89269b331", "name": "network-vif-deleted", "tag": "f39e58bb-12ac-471a-b9cd-378133a0bcea"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:07.567924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6af24c54-9cc5-4f1b-a867-87402387570b req-4beafeeb-e302-433b-b0f5-74eb989b377f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:07.574317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6af24c54-9cc5-4f1b-a867-87402387570b req-4beafeeb-e302-433b-b0f5-74eb989b377f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:07.580052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6af24c54-9cc5-4f1b-a867-87402387570b req-4beafeeb-e302-433b-b0f5-74eb989b377f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:07.606011 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-6af24c54-9cc5-4f1b-a867-87402387570b req-4beafeeb-e302-433b-b0f5-74eb989b377f service nova] Creating event network-vif-deleted:f39e58bb-12ac-471a-b9cd-378133a0bcea for instance d98dce2e-4cfb-48a3-8879-8ec89269b331 on n-h1-862964-3 Oct 29 01:15:07.615011 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-6af24c54-9cc5-4f1b-a867-87402387570b req-4beafeeb-e302-433b-b0f5-74eb989b377f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066932 Oct 29 01:15:07.620532 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1301/2717] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:07.663729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ae8e7820-96eb-4273-ac96-09d43e14409d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:07.664700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ae8e7820-96eb-4273-ac96-09d43e14409d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:07.670974 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c611b016-9cb2-4779-9966-fb54bb5aad2c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "POST /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83/action" status: 202 len: 0 microversion: 2.1 time: 0.479646 Oct 29 01:15:07.674704 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1417/2718] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:15:07 2022] POST /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:15:07.676928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae8e7820-96eb-4273-ac96-09d43e14409d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:07.683066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae8e7820-96eb-4273-ac96-09d43e14409d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:07.683715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae8e7820-96eb-4273-ac96-09d43e14409d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:07.684703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae8e7820-96eb-4273-ac96-09d43e14409d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:07.685417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae8e7820-96eb-4273-ac96-09d43e14409d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:07.686192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae8e7820-96eb-4273-ac96-09d43e14409d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:07.688365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e5b00878-f6d5-4ec4-93dd-a5b6625ba992 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:07.692146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e5b00878-f6d5-4ec4-93dd-a5b6625ba992 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:07.713762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5b00878-f6d5-4ec4-93dd-a5b6625ba992 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:07.715061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5b00878-f6d5-4ec4-93dd-a5b6625ba992 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:07.716551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5b00878-f6d5-4ec4-93dd-a5b6625ba992 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:07.718718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5b00878-f6d5-4ec4-93dd-a5b6625ba992 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:07.719255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5b00878-f6d5-4ec4-93dd-a5b6625ba992 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:07.721052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5b00878-f6d5-4ec4-93dd-a5b6625ba992 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:07.782088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:08.230200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e5b00878-f6d5-4ec4-93dd-a5b6625ba992 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:08.245812 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e5b00878-f6d5-4ec4-93dd-a5b6625ba992 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1509 microversion: 2.1 time: 0.568945 Oct 29 01:15:08.261196 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1418/2719] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:07 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1509 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:08.269349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d78e0922-d783-44f3-9d7a-9e2014968aa8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:08.273909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d78e0922-d783-44f3-9d7a-9e2014968aa8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:08.291619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d78e0922-d783-44f3-9d7a-9e2014968aa8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:08.292144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d78e0922-d783-44f3-9d7a-9e2014968aa8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:08.294113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d78e0922-d783-44f3-9d7a-9e2014968aa8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:08.301080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d78e0922-d783-44f3-9d7a-9e2014968aa8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:08.301080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d78e0922-d783-44f3-9d7a-9e2014968aa8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:08.301080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d78e0922-d783-44f3-9d7a-9e2014968aa8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:08.351623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ae8e7820-96eb-4273-ac96-09d43e14409d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:08.363158 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ae8e7820-96eb-4273-ac96-09d43e14409d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1325 microversion: 2.1 time: 0.703660 Oct 29 01:15:08.369922 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1302/2720] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:07 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1325 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:08.370063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9ebd3f77-7952-48da-89f0-49c50b6ba754 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:08.370795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9ebd3f77-7952-48da-89f0-49c50b6ba754 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:08.378699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9ebd3f77-7952-48da-89f0-49c50b6ba754 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:08.379272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9ebd3f77-7952-48da-89f0-49c50b6ba754 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:08.379824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9ebd3f77-7952-48da-89f0-49c50b6ba754 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:08.380652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9ebd3f77-7952-48da-89f0-49c50b6ba754 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:08.381300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9ebd3f77-7952-48da-89f0-49c50b6ba754 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:08.381972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9ebd3f77-7952-48da-89f0-49c50b6ba754 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:08.665858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d78e0922-d783-44f3-9d7a-9e2014968aa8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:08.698667 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d78e0922-d783-44f3-9d7a-9e2014968aa8 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1499 microversion: 2.1 time: 0.446451 Oct 29 01:15:08.702985 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1419/2721] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:08 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1499 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:08.720207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fed25ac2-d145-428f-9632-9ab4887937e7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:08.723010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fed25ac2-d145-428f-9632-9ab4887937e7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] [instance: 0e8218af-8624-4be9-8ae8-3c335c4af98b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:08.740334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fed25ac2-d145-428f-9632-9ab4887937e7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:08.743702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fed25ac2-d145-428f-9632-9ab4887937e7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:08.743702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fed25ac2-d145-428f-9632-9ab4887937e7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:08.743702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fed25ac2-d145-428f-9632-9ab4887937e7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:08.743702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fed25ac2-d145-428f-9632-9ab4887937e7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:08.743702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fed25ac2-d145-428f-9632-9ab4887937e7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:08.770721 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-fed25ac2-d145-428f-9632-9ab4887937e7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] HTTP exception thrown: Instance 0e8218af-8624-4be9-8ae8-3c335c4af98b could not be found. Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fed25ac2-d145-428f-9632-9ab4887937e7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Request method failure captured: Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b HTTP/1.1 Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH4igazQajKA915w05DXV0HwRlilkZ1p3ABgiCP4yYX1H9_XKys4L1hygMy5HJtr0MlUfaHydOk7vOsx2JULy6VnUtN3RY4OPF4ttS0Xev818MF1Ivifs9U03E1FWcdEEhDVBAKYQNaKI21XvFQYWj0-WXIVa3qIIY5N1LPmFKpARuA Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f9690bcd50e1416ca83f62fbc3940364 Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestManualDisk-1586666418 Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9690bcd50e1416ca83f62fbc3940364"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f9690bcd50e1416ca83f62fbc3940364"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9690bcd50e1416ca83f62fbc3940364"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f9690bcd50e1416ca83f62fbc3940364", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestManualDisk-1586666418 Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f9690bcd50e1416ca83f62fbc3940364 Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestManualDisk-1586666418 Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestManualDisk-1586666418-project Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: e1ff07349003488586b5d8f3f2aaf995 Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestManualDisk-1586666418-project Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 0e8218af-8624-4be9-8ae8-3c335c4af98b could not be found. Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '0e8218af-8624-4be9-8ae8-3c335c4af98b'} Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e8218af-8624-4be9-8ae8-3c335c4af98b could not be found. Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e8218af-8624-4be9-8ae8-3c335c4af98b could not be found. Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:08.773052 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:08.784401 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:08.784401 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:08.784401 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:08.784401 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:08.784401 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:08.784401 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e8218af-8624-4be9-8ae8-3c335c4af98b could not be found. Oct 29 01:15:08.784401 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:08.784401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fed25ac2-d145-428f-9632-9ab4887937e7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Returning 404 to user: Instance 0e8218af-8624-4be9-8ae8-3c335c4af98b could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:08.784401 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fed25ac2-d145-428f-9632-9ab4887937e7 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b" status: 404 len: 111 microversion: 2.1 time: 0.069926 Oct 29 01:15:08.784401 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1420/2722] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:08 2022] GET /compute/v2.1/servers/0e8218af-8624-4be9-8ae8-3c335c4af98b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:08.792069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8b3ed9fb-2d66-43ce-a77e-09b983ca4a78 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:08.792901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8b3ed9fb-2d66-43ce-a77e-09b983ca4a78 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:08.801168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b3ed9fb-2d66-43ce-a77e-09b983ca4a78 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:08.801854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b3ed9fb-2d66-43ce-a77e-09b983ca4a78 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:08.802492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b3ed9fb-2d66-43ce-a77e-09b983ca4a78 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:08.803639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b3ed9fb-2d66-43ce-a77e-09b983ca4a78 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:08.804188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b3ed9fb-2d66-43ce-a77e-09b983ca4a78 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:08.804729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b3ed9fb-2d66-43ce-a77e-09b983ca4a78 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:08.850783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b3ed9fb-2d66-43ce-a77e-09b983ca4a78 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:08.851789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b3ed9fb-2d66-43ce-a77e-09b983ca4a78 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:08.852612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b3ed9fb-2d66-43ce-a77e-09b983ca4a78 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:08.853378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-8b3ed9fb-2d66-43ce-a77e-09b983ca4a78 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lazy-loading 'fault' on Instance uuid d98dce2e-4cfb-48a3-8879-8ec89269b331 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:15:08.949002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8b3ed9fb-2d66-43ce-a77e-09b983ca4a78 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187158ff3fc04e5789d8865fee46f01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0066a293d6440fb9f5c55b3d636d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:08.962513 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8b3ed9fb-2d66-43ce-a77e-09b983ca4a78 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 200 len: 1308 microversion: 2.1 time: 0.176466 Oct 29 01:15:08.963107 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1421/2723] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:08 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 1308 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:08.981138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-14818eb1-2b01-4341-9f37-5ba234be10c9 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:08.985542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-14818eb1-2b01-4341-9f37-5ba234be10c9 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:09.002047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14818eb1-2b01-4341-9f37-5ba234be10c9 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:09.002047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14818eb1-2b01-4341-9f37-5ba234be10c9 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:09.002047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14818eb1-2b01-4341-9f37-5ba234be10c9 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:09.002047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14818eb1-2b01-4341-9f37-5ba234be10c9 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:09.002448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14818eb1-2b01-4341-9f37-5ba234be10c9 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:09.002563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14818eb1-2b01-4341-9f37-5ba234be10c9 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:09.004386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9ebd3f77-7952-48da-89f0-49c50b6ba754 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:09.019297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9ebd3f77-7952-48da-89f0-49c50b6ba754 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:09.020763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9ebd3f77-7952-48da-89f0-49c50b6ba754 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:09.021982 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9ebd3f77-7952-48da-89f0-49c50b6ba754 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1803 microversion: 2.42 time: 0.656532 Oct 29 01:15:09.022550 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1303/2724] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:08 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1803 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:09.049338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0eaafded-855b-4752-ac3f-185193af21d6 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] Calling method '.version_select at 0x7f9d97e6ed30>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:09.158632 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0eaafded-855b-4752-ac3f-185193af21d6 tempest-ServersTestManualDisk-1586666418 tempest-ServersTestManualDisk-1586666418-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1623003296" status: 202 len: 0 microversion: 2.1 time: 0.122915 Oct 29 01:15:09.163599 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1304/2725] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 29 01:15:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1623003296 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:15:09.163703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-ad605e02-5fc9-4609-b87f-8b8fa5fa74a4 req-cb2c6245-d42c-4e64-b386-d70f60e2c743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5", "name": "network-vif-deleted", "tag": "3696a714-c84c-4ccf-a78d-0b8a642038f9"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:09.194883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ad605e02-5fc9-4609-b87f-8b8fa5fa74a4 req-cb2c6245-d42c-4e64-b386-d70f60e2c743 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:09.195374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ad605e02-5fc9-4609-b87f-8b8fa5fa74a4 req-cb2c6245-d42c-4e64-b386-d70f60e2c743 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:09.195812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ad605e02-5fc9-4609-b87f-8b8fa5fa74a4 req-cb2c6245-d42c-4e64-b386-d70f60e2c743 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:09.231280 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-ad605e02-5fc9-4609-b87f-8b8fa5fa74a4 req-cb2c6245-d42c-4e64-b386-d70f60e2c743 service nova] Creating event network-vif-deleted:3696a714-c84c-4ccf-a78d-0b8a642038f9 for instance cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 on n-h2-862964-3 Oct 29 01:15:09.242840 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-ad605e02-5fc9-4609-b87f-8b8fa5fa74a4 req-cb2c6245-d42c-4e64-b386-d70f60e2c743 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082278 Oct 29 01:15:09.247964 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1305/2726] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:09.277878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-04305ca3-d2f1-4bda-b957-427c26823c57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:09.283097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-04305ca3-d2f1-4bda-b957-427c26823c57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:09.307346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04305ca3-d2f1-4bda-b957-427c26823c57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:09.310623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04305ca3-d2f1-4bda-b957-427c26823c57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:09.312658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04305ca3-d2f1-4bda-b957-427c26823c57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:09.313637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04305ca3-d2f1-4bda-b957-427c26823c57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:09.315755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04305ca3-d2f1-4bda-b957-427c26823c57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:09.316793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04305ca3-d2f1-4bda-b957-427c26823c57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:09.660566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-14818eb1-2b01-4341-9f37-5ba234be10c9 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:09.677082 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-14818eb1-2b01-4341-9f37-5ba234be10c9 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1313 microversion: 2.1 time: 0.709787 Oct 29 01:15:09.679082 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1422/2727] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:08 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1313 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:09.696598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-dee2ffcf-353d-446c-aa06-ecea1bcc0789 req-f0749ac2-e15e-4fcc-b309-9969c6afbb47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8fb980-1b51-4e3d-a3b7-b359dbe890a4", "name": "network-vif-plugged", "status": "completed", "tag": "0a737a69-c605-43d6-9cbb-dca20e04416c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:09.723896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:09.732871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-dee2ffcf-353d-446c-aa06-ecea1bcc0789 req-f0749ac2-e15e-4fcc-b309-9969c6afbb47 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:09.733690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-dee2ffcf-353d-446c-aa06-ecea1bcc0789 req-f0749ac2-e15e-4fcc-b309-9969c6afbb47 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:09.734392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-dee2ffcf-353d-446c-aa06-ecea1bcc0789 req-f0749ac2-e15e-4fcc-b309-9969c6afbb47 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:09.753674 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-dee2ffcf-353d-446c-aa06-ecea1bcc0789 req-f0749ac2-e15e-4fcc-b309-9969c6afbb47 service nova] Creating event network-vif-plugged:0a737a69-c605-43d6-9cbb-dca20e04416c for instance 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 on n-h1-862964-3 Oct 29 01:15:09.765518 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-dee2ffcf-353d-446c-aa06-ecea1bcc0789 req-f0749ac2-e15e-4fcc-b309-9969c6afbb47 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080950 Oct 29 01:15:09.767348 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1423/2728] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:09.778998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-82de9050-7bd2-462b-ae02-40af14d53206 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:09.780766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-82de9050-7bd2-462b-ae02-40af14d53206 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:09.784787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-04305ca3-d2f1-4bda-b957-427c26823c57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:09.796332 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-04305ca3-d2f1-4bda-b957-427c26823c57 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1492 microversion: 2.1 time: 0.522141 Oct 29 01:15:09.813401 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1306/2729] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:09 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1492 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:09.816659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82de9050-7bd2-462b-ae02-40af14d53206 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:09.818967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82de9050-7bd2-462b-ae02-40af14d53206 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:09.819716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82de9050-7bd2-462b-ae02-40af14d53206 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:09.842440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c72dcfe3-8efc-49e9-8e42-1df18c779da7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:09.842672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82de9050-7bd2-462b-ae02-40af14d53206 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:09.842672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82de9050-7bd2-462b-ae02-40af14d53206 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:09.842862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c72dcfe3-8efc-49e9-8e42-1df18c779da7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:09.842965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82de9050-7bd2-462b-ae02-40af14d53206 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:09.846466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c72dcfe3-8efc-49e9-8e42-1df18c779da7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:09.848117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c72dcfe3-8efc-49e9-8e42-1df18c779da7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:09.850959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c72dcfe3-8efc-49e9-8e42-1df18c779da7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:09.851900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c72dcfe3-8efc-49e9-8e42-1df18c779da7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:09.852623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c72dcfe3-8efc-49e9-8e42-1df18c779da7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:09.857869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c72dcfe3-8efc-49e9-8e42-1df18c779da7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:09.926875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c72dcfe3-8efc-49e9-8e42-1df18c779da7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:09.927500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c72dcfe3-8efc-49e9-8e42-1df18c779da7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:09.928847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c72dcfe3-8efc-49e9-8e42-1df18c779da7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:09.928847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-c72dcfe3-8efc-49e9-8e42-1df18c779da7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lazy-loading 'fault' on Instance uuid cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:15:10.038667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c72dcfe3-8efc-49e9-8e42-1df18c779da7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da623c3132aa466aa25685aa45fceaf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6719b662fc734d2797d515778a57296d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:10.064237 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c72dcfe3-8efc-49e9-8e42-1df18c779da7 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 200 len: 1301 microversion: 2.1 time: 0.250837 Oct 29 01:15:10.065519 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1307/2730] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:09 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 1301 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:10.079637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8a7010ae-8ad3-4cb4-a5c8-65a09bd81eb4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:10.083746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8a7010ae-8ad3-4cb4-a5c8-65a09bd81eb4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:10.087403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a7010ae-8ad3-4cb4-a5c8-65a09bd81eb4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:10.088542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a7010ae-8ad3-4cb4-a5c8-65a09bd81eb4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:10.089145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a7010ae-8ad3-4cb4-a5c8-65a09bd81eb4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:10.090041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a7010ae-8ad3-4cb4-a5c8-65a09bd81eb4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:10.090646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a7010ae-8ad3-4cb4-a5c8-65a09bd81eb4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:10.091488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a7010ae-8ad3-4cb4-a5c8-65a09bd81eb4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:10.125517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8a7010ae-8ad3-4cb4-a5c8-65a09bd81eb4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:15:10.237548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-82de9050-7bd2-462b-ae02-40af14d53206 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:10.253958 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-82de9050-7bd2-462b-ae02-40af14d53206 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1523 microversion: 2.1 time: 0.482850 Oct 29 01:15:10.254563 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1424/2731] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:09 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1523 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:10.271341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bf8de93b-db59-4786-b26a-7ca779443e47 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:10.272226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bf8de93b-db59-4786-b26a-7ca779443e47 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] [instance: d98dce2e-4cfb-48a3-8879-8ec89269b331] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:10.279332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf8de93b-db59-4786-b26a-7ca779443e47 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:10.281697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf8de93b-db59-4786-b26a-7ca779443e47 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:10.283973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf8de93b-db59-4786-b26a-7ca779443e47 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:10.285503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf8de93b-db59-4786-b26a-7ca779443e47 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:10.287734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf8de93b-db59-4786-b26a-7ca779443e47 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:10.288174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf8de93b-db59-4786-b26a-7ca779443e47 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:10.324009 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-bf8de93b-db59-4786-b26a-7ca779443e47 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] HTTP exception thrown: Instance d98dce2e-4cfb-48a3-8879-8ec89269b331 could not be found. Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bf8de93b-db59-4786-b26a-7ca779443e47 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Request method failure captured: Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 HTTP/1.1 Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH5LVFJfCOFS129dkiAvUCZaO8XtVoicy8oV3vayiy_e2Lroc9weD8Gu4mI67UG2-o1bqO0akx248ZDgLcSSIiurbegmn9Yv5ZsNoAu0_4glH-6xMot6OaaqCYtnCBLkziC2EwEr4u-oURVe6WiY7x_oxgJvTsKVKEcaOTegXDzRm00 Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 9d0066a293d6440fb9f5c55b3d636d51 Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-MultipleCreateTestJSON-1507763444 Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9d0066a293d6440fb9f5c55b3d636d51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9d0066a293d6440fb9f5c55b3d636d51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9d0066a293d6440fb9f5c55b3d636d51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9d0066a293d6440fb9f5c55b3d636d51", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-MultipleCreateTestJSON-1507763444 Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 9d0066a293d6440fb9f5c55b3d636d51 Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1507763444 Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-MultipleCreateTestJSON-1507763444-project Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 187158ff3fc04e5789d8865fee46f01f Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-MultipleCreateTestJSON-1507763444-project Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance d98dce2e-4cfb-48a3-8879-8ec89269b331 could not be found. Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'd98dce2e-4cfb-48a3-8879-8ec89269b331'} Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d98dce2e-4cfb-48a3-8879-8ec89269b331 could not be found. Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d98dce2e-4cfb-48a3-8879-8ec89269b331 could not be found. Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:10.327238 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:10.331461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:10.331461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:10.331461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:10.331461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:10.331461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:10.331461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d98dce2e-4cfb-48a3-8879-8ec89269b331 could not be found. Oct 29 01:15:10.331461 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:10.334504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bf8de93b-db59-4786-b26a-7ca779443e47 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] Returning 404 to user: Instance d98dce2e-4cfb-48a3-8879-8ec89269b331 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:10.338119 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bf8de93b-db59-4786-b26a-7ca779443e47 tempest-MultipleCreateTestJSON-1507763444 tempest-MultipleCreateTestJSON-1507763444-project] 10.222.0.26 "GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331" status: 404 len: 111 microversion: 2.1 time: 0.078137 Oct 29 01:15:10.338119 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1425/2732] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:10 2022] GET /compute/v2.1/servers/d98dce2e-4cfb-48a3-8879-8ec89269b331 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:10.354327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a94a07b7-3ed7-4619-901e-643fc700d43a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:10.356131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a94a07b7-3ed7-4619-901e-643fc700d43a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:10.375582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a94a07b7-3ed7-4619-901e-643fc700d43a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:10.377969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a94a07b7-3ed7-4619-901e-643fc700d43a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:10.379970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a94a07b7-3ed7-4619-901e-643fc700d43a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:10.380896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a94a07b7-3ed7-4619-901e-643fc700d43a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:10.382754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a94a07b7-3ed7-4619-901e-643fc700d43a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:10.383569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a94a07b7-3ed7-4619-901e-643fc700d43a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:10.422042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:10.523034 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8a7010ae-8ad3-4cb4-a5c8-65a09bd81eb4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "DELETE /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 204 len: 0 microversion: 2.1 time: 0.456024 Oct 29 01:15:10.527174 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1308/2733] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:15:10 2022] DELETE /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:15:10.537194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d752387-2a80-462c-b9dc-86fb7c11a31d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:10.540361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7d752387-2a80-462c-b9dc-86fb7c11a31d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:10.552183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d752387-2a80-462c-b9dc-86fb7c11a31d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:10.552598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d752387-2a80-462c-b9dc-86fb7c11a31d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:10.553032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d752387-2a80-462c-b9dc-86fb7c11a31d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:10.559145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d752387-2a80-462c-b9dc-86fb7c11a31d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:10.567658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d752387-2a80-462c-b9dc-86fb7c11a31d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:10.567658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d752387-2a80-462c-b9dc-86fb7c11a31d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:10.742514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a94a07b7-3ed7-4619-901e-643fc700d43a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:10.755556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a94a07b7-3ed7-4619-901e-643fc700d43a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:10.758669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a94a07b7-3ed7-4619-901e-643fc700d43a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:10.760154 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a94a07b7-3ed7-4619-901e-643fc700d43a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1850 microversion: 2.42 time: 0.421900 Oct 29 01:15:10.761573 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1426/2734] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:10 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1850 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:10.773256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6b376783-fb90-41a3-8e2e-f3b6d5731435 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:10.777368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6b376783-fb90-41a3-8e2e-f3b6d5731435 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:10.784302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b376783-fb90-41a3-8e2e-f3b6d5731435 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:10.785084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b376783-fb90-41a3-8e2e-f3b6d5731435 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:10.785757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b376783-fb90-41a3-8e2e-f3b6d5731435 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:10.786793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b376783-fb90-41a3-8e2e-f3b6d5731435 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:10.787255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b376783-fb90-41a3-8e2e-f3b6d5731435 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:10.787679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b376783-fb90-41a3-8e2e-f3b6d5731435 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:11.026532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7d752387-2a80-462c-b9dc-86fb7c11a31d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:11.042007 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7d752387-2a80-462c-b9dc-86fb7c11a31d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1523 microversion: 2.1 time: 0.511895 Oct 29 01:15:11.044841 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1309/2735] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:10 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1523 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:11.052294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a754df3c-4928-421c-93a4-73af1844f335 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:11.053297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a754df3c-4928-421c-93a4-73af1844f335 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:11.065767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a754df3c-4928-421c-93a4-73af1844f335 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:11.065767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a754df3c-4928-421c-93a4-73af1844f335 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:11.065767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a754df3c-4928-421c-93a4-73af1844f335 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:11.066779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a754df3c-4928-421c-93a4-73af1844f335 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:11.067466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a754df3c-4928-421c-93a4-73af1844f335 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:11.068091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a754df3c-4928-421c-93a4-73af1844f335 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:11.130993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6b376783-fb90-41a3-8e2e-f3b6d5731435 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:11.159394 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6b376783-fb90-41a3-8e2e-f3b6d5731435 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1498 microversion: 2.1 time: 0.395123 Oct 29 01:15:11.180236 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1427/2736] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:10 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1498 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:11.203445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8f30a027-9198-4b40-bab0-88c69b7f7225 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1856506387", "metadata": {"": ""}}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8f30a027-9198-4b40-bab0-88c69b7f7225 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Request method failure captured: Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7/action HTTP/1.1 Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 107 Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH6CzaWy1ufa72id6aheZbBREgQ1G2SbUhEpvcj_QTDF--UNn0kMcxBhslM6smsky4izROjyCZSxF91rcQGlVQlVrhfbQfHOyxM9K_r3ikSiecmNSXh8mpJTcen08ouic-cdYaYkhVKjr1CpS6bd1t3acwqY6OPH7aEAkOLl4egaxt8 Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_328d1dd53c6a4bc2b14376dd1a1cecb6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: b89f11ebd96141a5afe08dad79b0b20c Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1856506387", "metadata": {"": ""}}} Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'cfc8b0b3-923e-4144-a9ca-aeb9da2897f7', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1856506387', 'metadata': {'': ''}}}} Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'': ''} Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:15:11.209344 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:15:11.219730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:15:11.219730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:15:11.219730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:15:11.219730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:15:11.219730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:15:11.219730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:15:11.219730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:11.219730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:11.219730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:11.219730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:11.219730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:11.219730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:11.219730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:15:11.219730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:15:11.219730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:15:11.219730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:11.219730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8f30a027-9198-4b40-bab0-88c69b7f7225 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:11.219730 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8f30a027-9198-4b40-bab0-88c69b7f7225 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "POST /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7/action" status: 400 len: 170 microversion: 2.1 time: 0.025585 Oct 29 01:15:11.219730 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1428/2737] 10.222.0.26 () {60 vars in 1279 bytes} [Sat Oct 29 01:15:11 2022] POST /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7/action => generated 170 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:15:11.226287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-31a50697-002f-46eb-80c3-5d572ead9657 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:11.227155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-31a50697-002f-46eb-80c3-5d572ead9657 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] [instance: cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:11.237567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31a50697-002f-46eb-80c3-5d572ead9657 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:11.238407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31a50697-002f-46eb-80c3-5d572ead9657 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:11.239036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31a50697-002f-46eb-80c3-5d572ead9657 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:11.239935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31a50697-002f-46eb-80c3-5d572ead9657 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:11.240611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31a50697-002f-46eb-80c3-5d572ead9657 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:11.243255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31a50697-002f-46eb-80c3-5d572ead9657 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:11.261020 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-31a50697-002f-46eb-80c3-5d572ead9657 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] HTTP exception thrown: Instance cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 could not be found. Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-31a50697-002f-46eb-80c3-5d572ead9657 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Request method failure captured: Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 HTTP/1.1 Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXHysm59IN0QR7Jpvigs9GaW_uCJQ55SiVY14MKtY6qPM4WbIwqFtUZTCNxaqprF7gUzb79C0LARakiE-HVm_wnGXjWkH234yu8nfYitOC-p8n53Vma3Rsp_PyqBePucgE1GZlfP3KJ-5aDlu_LQv4Xy_7_U1cZrl8KdjAkHwpH4Q-Co Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6719b662fc734d2797d515778a57296d Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-LiveMigrationTest-173269399 Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6719b662fc734d2797d515778a57296d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6719b662fc734d2797d515778a57296d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6719b662fc734d2797d515778a57296d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6719b662fc734d2797d515778a57296d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-LiveMigrationTest-173269399 Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6719b662fc734d2797d515778a57296d Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-LiveMigrationTest-173269399 Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-LiveMigrationTest-173269399-project Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: da623c3132aa466aa25685aa45fceaf9 Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-LiveMigrationTest-173269399-project Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 could not be found. Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5'} Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 could not be found. Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 could not be found. Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:11.264246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:11.271664 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:11.271664 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:11.271664 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:11.271664 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:11.271664 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:11.271664 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 could not be found. Oct 29 01:15:11.271664 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:11.276276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-31a50697-002f-46eb-80c3-5d572ead9657 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] Returning 404 to user: Instance cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:11.277799 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-31a50697-002f-46eb-80c3-5d572ead9657 tempest-LiveMigrationTest-173269399 tempest-LiveMigrationTest-173269399-project] 10.222.0.26 "GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5" status: 404 len: 111 microversion: 2.1 time: 0.064111 Oct 29 01:15:11.283904 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1429/2738] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:11 2022] GET /compute/v2.1/servers/cfd21f6b-c258-4438-aad8-9d2fbaeaa4b5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:11.292123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c0825d0d-06d0-4f05-ba9f-346dbcb970ff tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:11.293287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c0825d0d-06d0-4f05-ba9f-346dbcb970ff tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:11.306138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0825d0d-06d0-4f05-ba9f-346dbcb970ff tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:11.306810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0825d0d-06d0-4f05-ba9f-346dbcb970ff tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:11.310630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0825d0d-06d0-4f05-ba9f-346dbcb970ff tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:11.311719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0825d0d-06d0-4f05-ba9f-346dbcb970ff tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:11.312348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0825d0d-06d0-4f05-ba9f-346dbcb970ff tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:11.313067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0825d0d-06d0-4f05-ba9f-346dbcb970ff tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:11.392098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a754df3c-4928-421c-93a4-73af1844f335 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:11.411362 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a754df3c-4928-421c-93a4-73af1844f335 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1313 microversion: 2.1 time: 0.360726 Oct 29 01:15:11.415225 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1310/2739] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:11 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:11.790182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0167ab51-dbbe-49d2-8faf-71e8ccf67de4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:11.791420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0167ab51-dbbe-49d2-8faf-71e8ccf67de4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:11.799621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0167ab51-dbbe-49d2-8faf-71e8ccf67de4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:11.800696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0167ab51-dbbe-49d2-8faf-71e8ccf67de4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:11.801417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0167ab51-dbbe-49d2-8faf-71e8ccf67de4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:11.802525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0167ab51-dbbe-49d2-8faf-71e8ccf67de4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:11.803287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0167ab51-dbbe-49d2-8faf-71e8ccf67de4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:11.803892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0167ab51-dbbe-49d2-8faf-71e8ccf67de4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:12.117751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0167ab51-dbbe-49d2-8faf-71e8ccf67de4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:12.123327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c0825d0d-06d0-4f05-ba9f-346dbcb970ff tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:12.135918 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c0825d0d-06d0-4f05-ba9f-346dbcb970ff tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1523 microversion: 2.1 time: 0.850858 Oct 29 01:15:12.136490 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1430/2740] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:11 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1523 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:12.146858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0167ab51-dbbe-49d2-8faf-71e8ccf67de4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:12.155643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0167ab51-dbbe-49d2-8faf-71e8ccf67de4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:12.157407 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0167ab51-dbbe-49d2-8faf-71e8ccf67de4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1850 microversion: 2.42 time: 0.371230 Oct 29 01:15:12.158652 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1311/2741] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:11 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1850 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:12.195973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-53ecda65-cb93-4067-b694-5e12d70f6d5e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:12.196560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-53ecda65-cb93-4067-b694-5e12d70f6d5e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:12.199398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-06c8faee-3a78-4184-923b-32277b9b3eb9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:12.202429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-06c8faee-3a78-4184-923b-32277b9b3eb9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:12.212105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53ecda65-cb93-4067-b694-5e12d70f6d5e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:12.212105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53ecda65-cb93-4067-b694-5e12d70f6d5e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:12.212105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53ecda65-cb93-4067-b694-5e12d70f6d5e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:12.212105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53ecda65-cb93-4067-b694-5e12d70f6d5e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:12.212105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53ecda65-cb93-4067-b694-5e12d70f6d5e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:12.216140 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06c8faee-3a78-4184-923b-32277b9b3eb9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:12.217493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06c8faee-3a78-4184-923b-32277b9b3eb9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:12.217738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53ecda65-cb93-4067-b694-5e12d70f6d5e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:12.218994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06c8faee-3a78-4184-923b-32277b9b3eb9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:12.220055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06c8faee-3a78-4184-923b-32277b9b3eb9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:12.220922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06c8faee-3a78-4184-923b-32277b9b3eb9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:12.221587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06c8faee-3a78-4184-923b-32277b9b3eb9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:12.580898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-06c8faee-3a78-4184-923b-32277b9b3eb9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:12.583604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-53ecda65-cb93-4067-b694-5e12d70f6d5e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:12.590981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:12.596137 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-53ecda65-cb93-4067-b694-5e12d70f6d5e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1523 microversion: 2.1 time: 0.407003 Oct 29 01:15:12.600193 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1431/2742] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:12 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:12.608449 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-06c8faee-3a78-4184-923b-32277b9b3eb9 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1498 microversion: 2.1 time: 0.411819 Oct 29 01:15:12.608449 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1312/2743] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:12 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1498 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:12.610317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-21a21caf-a328-4487-804f-9588cf7250c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:12.612619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-21a21caf-a328-4487-804f-9588cf7250c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:12.622696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21a21caf-a328-4487-804f-9588cf7250c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:12.623446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21a21caf-a328-4487-804f-9588cf7250c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:12.624120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21a21caf-a328-4487-804f-9588cf7250c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:12.625064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21a21caf-a328-4487-804f-9588cf7250c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:12.627623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21a21caf-a328-4487-804f-9588cf7250c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:12.630142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21a21caf-a328-4487-804f-9588cf7250c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:12.637546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1b308199-9472-41ce-9904-46730a7619dd tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1811915166", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1b308199-9472-41ce-9904-46730a7619dd tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Request method failure captured: Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7/action HTTP/1.1 Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 619 Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH6CzaWy1ufa72id6aheZbBREgQ1G2SbUhEpvcj_QTDF--UNn0kMcxBhslM6smsky4izROjyCZSxF91rcQGlVQlVrhfbQfHOyxM9K_r3ikSiecmNSXh8mpJTcen08ouic-cdYaYkhVKjr1CpS6bd1t3acwqY6OPH7aEAkOLl4egaxt8 Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_328d1dd53c6a4bc2b14376dd1a1cecb6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: b89f11ebd96141a5afe08dad79b0b20c Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1811915166", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'cfc8b0b3-923e-4144-a9ca-aeb9da2897f7', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1811915166', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:15:12.653021 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:15:12.656389 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:12.661805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1b308199-9472-41ce-9904-46730a7619dd tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:12.666272 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1b308199-9472-41ce-9904-46730a7619dd tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "POST /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7/action" status: 400 len: 938 microversion: 2.1 time: 0.036760 Oct 29 01:15:12.669770 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1313/2744] 10.222.0.26 () {60 vars in 1279 bytes} [Sat Oct 29 01:15:12 2022] POST /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7/action => generated 938 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:15:12.687921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-abf95e0f-8c04-4ade-a113-6a3ac597e19c req-9e6ad0e9-0e7c-4bf6-9ac1-7c802bc165e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "tag": "d00f19cc-89ea-4719-aa7c-b9d320f81a37"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:12.732955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-abf95e0f-8c04-4ade-a113-6a3ac597e19c req-9e6ad0e9-0e7c-4bf6-9ac1-7c802bc165e8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:12.733744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-abf95e0f-8c04-4ade-a113-6a3ac597e19c req-9e6ad0e9-0e7c-4bf6-9ac1-7c802bc165e8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:12.734181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-abf95e0f-8c04-4ade-a113-6a3ac597e19c req-9e6ad0e9-0e7c-4bf6-9ac1-7c802bc165e8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:12.755178 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-abf95e0f-8c04-4ade-a113-6a3ac597e19c req-9e6ad0e9-0e7c-4bf6-9ac1-7c802bc165e8 service nova] Creating event network-changed:d00f19cc-89ea-4719-aa7c-b9d320f81a37 for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:15:12.765122 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-abf95e0f-8c04-4ade-a113-6a3ac597e19c req-9e6ad0e9-0e7c-4bf6-9ac1-7c802bc165e8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090069 Oct 29 01:15:12.766661 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1314/2745] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:12.773649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eb0ab2d4-3922-4d06-a9bb-e2dd2c450e0a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:12.775614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-eb0ab2d4-3922-4d06-a9bb-e2dd2c450e0a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:12.782973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb0ab2d4-3922-4d06-a9bb-e2dd2c450e0a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:12.783859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb0ab2d4-3922-4d06-a9bb-e2dd2c450e0a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:12.784470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb0ab2d4-3922-4d06-a9bb-e2dd2c450e0a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:12.785536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb0ab2d4-3922-4d06-a9bb-e2dd2c450e0a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:12.786179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb0ab2d4-3922-4d06-a9bb-e2dd2c450e0a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:12.786851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb0ab2d4-3922-4d06-a9bb-e2dd2c450e0a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:12.906089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-21a21caf-a328-4487-804f-9588cf7250c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:12.916426 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-21a21caf-a328-4487-804f-9588cf7250c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1313 microversion: 2.1 time: 0.314947 Oct 29 01:15:12.917052 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1432/2746] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:12 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:13.143884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-eb0ab2d4-3922-4d06-a9bb-e2dd2c450e0a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:13.150281 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-eb0ab2d4-3922-4d06-a9bb-e2dd2c450e0a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1523 microversion: 2.1 time: 0.382185 Oct 29 01:15:13.151422 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1315/2747] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:12 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1523 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:13.181293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-422cb0e9-6f44-44dd-b229-f719aedc40ce tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:13.182464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-422cb0e9-6f44-44dd-b229-f719aedc40ce tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:13.192084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3afecef2-ce53-41e7-8433-46fc7bf6fba2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:13.192818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3afecef2-ce53-41e7-8433-46fc7bf6fba2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:13.214954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3afecef2-ce53-41e7-8433-46fc7bf6fba2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:13.214954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3afecef2-ce53-41e7-8433-46fc7bf6fba2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:13.214954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3afecef2-ce53-41e7-8433-46fc7bf6fba2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:13.214954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3afecef2-ce53-41e7-8433-46fc7bf6fba2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:13.214954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3afecef2-ce53-41e7-8433-46fc7bf6fba2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:13.214954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3afecef2-ce53-41e7-8433-46fc7bf6fba2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:13.215459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-422cb0e9-6f44-44dd-b229-f719aedc40ce tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:13.215459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-422cb0e9-6f44-44dd-b229-f719aedc40ce tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:13.215459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-422cb0e9-6f44-44dd-b229-f719aedc40ce tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:13.215459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-422cb0e9-6f44-44dd-b229-f719aedc40ce tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:13.215459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-422cb0e9-6f44-44dd-b229-f719aedc40ce tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:13.215459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-422cb0e9-6f44-44dd-b229-f719aedc40ce tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:13.752879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3afecef2-ce53-41e7-8433-46fc7bf6fba2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:13.762364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3afecef2-ce53-41e7-8433-46fc7bf6fba2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:13.764563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3afecef2-ce53-41e7-8433-46fc7bf6fba2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:13.766066 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3afecef2-ce53-41e7-8433-46fc7bf6fba2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1850 microversion: 2.42 time: 0.577985 Oct 29 01:15:13.781602 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1316/2748] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:13 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1850 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:13.791214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d48763f9-1497-43c5-820e-41e61482f41b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:13.792097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d48763f9-1497-43c5-820e-41e61482f41b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:13.799247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d48763f9-1497-43c5-820e-41e61482f41b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:13.800011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d48763f9-1497-43c5-820e-41e61482f41b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:13.800625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d48763f9-1497-43c5-820e-41e61482f41b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:13.806815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d48763f9-1497-43c5-820e-41e61482f41b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:13.806815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d48763f9-1497-43c5-820e-41e61482f41b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:13.806815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d48763f9-1497-43c5-820e-41e61482f41b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:13.818388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-422cb0e9-6f44-44dd-b229-f719aedc40ce tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:13.857101 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-422cb0e9-6f44-44dd-b229-f719aedc40ce tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1523 microversion: 2.1 time: 0.679018 Oct 29 01:15:13.858117 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1433/2749] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:13 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1523 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:13.882285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd0bdb33-8cfb-4b3c-af93-e0bfd992f162 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd0bdb33-8cfb-4b3c-af93-e0bfd992f162 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Request method failure captured: Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7/action HTTP/1.1 Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 285 Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH6CzaWy1ufa72id6aheZbBREgQ1G2SbUhEpvcj_QTDF--UNn0kMcxBhslM6smsky4izROjyCZSxF91rcQGlVQlVrhfbQfHOyxM9K_r3ikSiecmNSXh8mpJTcen08ouic-cdYaYkhVKjr1CpS6bd1t3acwqY6OPH7aEAkOLl4egaxt8 Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_328d1dd53c6a4bc2b14376dd1a1cecb6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: b89f11ebd96141a5afe08dad79b0b20c Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'cfc8b0b3-923e-4144-a9ca-aeb9da2897f7', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:13.887419 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 01:15:13.891169 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:13.894234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd0bdb33-8cfb-4b3c-af93-e0bfd992f162 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:13.895188 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bd0bdb33-8cfb-4b3c-af93-e0bfd992f162 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "POST /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7/action" status: 400 len: 619 microversion: 2.1 time: 0.017374 Oct 29 01:15:13.896144 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1434/2750] 10.222.0.26 () {60 vars in 1279 bytes} [Sat Oct 29 01:15:13 2022] POST /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7/action => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 01:15:13.906059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5881c292-e227-4de6-8c2f-e33a87dce64c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:13.906728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5881c292-e227-4de6-8c2f-e33a87dce64c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:13.916710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5881c292-e227-4de6-8c2f-e33a87dce64c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:13.918153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5881c292-e227-4de6-8c2f-e33a87dce64c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:13.920889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5881c292-e227-4de6-8c2f-e33a87dce64c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:13.921856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5881c292-e227-4de6-8c2f-e33a87dce64c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:13.928822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5881c292-e227-4de6-8c2f-e33a87dce64c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:13.929634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5881c292-e227-4de6-8c2f-e33a87dce64c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:14.199414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d48763f9-1497-43c5-820e-41e61482f41b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:14.210257 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d48763f9-1497-43c5-820e-41e61482f41b tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1498 microversion: 2.1 time: 0.426757 Oct 29 01:15:14.229669 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1317/2751] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:13 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1498 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:14.236024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d334f875-6e9a-4d25-8e29-cf0f15e47dbf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:14.236697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d334f875-6e9a-4d25-8e29-cf0f15e47dbf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:14.270394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d334f875-6e9a-4d25-8e29-cf0f15e47dbf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:14.271303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d334f875-6e9a-4d25-8e29-cf0f15e47dbf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:14.271924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d334f875-6e9a-4d25-8e29-cf0f15e47dbf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:14.272876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d334f875-6e9a-4d25-8e29-cf0f15e47dbf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:14.273525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d334f875-6e9a-4d25-8e29-cf0f15e47dbf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:14.274932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d334f875-6e9a-4d25-8e29-cf0f15e47dbf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:14.419339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5881c292-e227-4de6-8c2f-e33a87dce64c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:14.431645 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5881c292-e227-4de6-8c2f-e33a87dce64c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1523 microversion: 2.1 time: 0.530242 Oct 29 01:15:14.458472 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1435/2752] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:13 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1523 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:14.467735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-073b3098-a658-4cad-be82-6dd68e60470f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:14.469467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-073b3098-a658-4cad-be82-6dd68e60470f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:14.477822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-073b3098-a658-4cad-be82-6dd68e60470f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:14.478695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-073b3098-a658-4cad-be82-6dd68e60470f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:14.479399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-073b3098-a658-4cad-be82-6dd68e60470f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:14.480861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-073b3098-a658-4cad-be82-6dd68e60470f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:14.481676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-073b3098-a658-4cad-be82-6dd68e60470f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:14.482346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-073b3098-a658-4cad-be82-6dd68e60470f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:14.818971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d334f875-6e9a-4d25-8e29-cf0f15e47dbf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:14.844375 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d334f875-6e9a-4d25-8e29-cf0f15e47dbf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1463 microversion: 2.1 time: 0.613485 Oct 29 01:15:14.858549 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1318/2753] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:14 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1463 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:14.878601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-07b61f6a-372f-4ca6-b6fb-7bcc354d620a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:14.910845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-07b61f6a-372f-4ca6-b6fb-7bcc354d620a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:14.923272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-073b3098-a658-4cad-be82-6dd68e60470f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:14.933277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07b61f6a-372f-4ca6-b6fb-7bcc354d620a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:14.934104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07b61f6a-372f-4ca6-b6fb-7bcc354d620a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:14.935257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07b61f6a-372f-4ca6-b6fb-7bcc354d620a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:14.936206 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-073b3098-a658-4cad-be82-6dd68e60470f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1523 microversion: 2.1 time: 0.474328 Oct 29 01:15:14.941820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07b61f6a-372f-4ca6-b6fb-7bcc354d620a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:14.943490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07b61f6a-372f-4ca6-b6fb-7bcc354d620a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:14.944106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07b61f6a-372f-4ca6-b6fb-7bcc354d620a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:14.955231 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1436/2754] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:14 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1523 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:14.966293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-cb55e438-c27a-432f-a47e-f58f6b2b2c51 req-362420b0-a336-4347-851b-8dd9d72db75c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74263965-ee1f-46a3-8115-7da1ba849c83", "name": "network-vif-deleted", "tag": "f927c0ed-022d-4814-9d05-eb446907453d"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:14.977103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cb55e438-c27a-432f-a47e-f58f6b2b2c51 req-362420b0-a336-4347-851b-8dd9d72db75c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:14.977894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cb55e438-c27a-432f-a47e-f58f6b2b2c51 req-362420b0-a336-4347-851b-8dd9d72db75c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:14.978525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cb55e438-c27a-432f-a47e-f58f6b2b2c51 req-362420b0-a336-4347-851b-8dd9d72db75c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:14.992768 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-cb55e438-c27a-432f-a47e-f58f6b2b2c51 req-362420b0-a336-4347-851b-8dd9d72db75c service nova] Creating event network-vif-deleted:f927c0ed-022d-4814-9d05-eb446907453d for instance 74263965-ee1f-46a3-8115-7da1ba849c83 on n-h1-862964-3 Oct 29 01:15:14.999500 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-cb55e438-c27a-432f-a47e-f58f6b2b2c51 req-362420b0-a336-4347-851b-8dd9d72db75c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042455 Oct 29 01:15:15.000657 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1437/2755] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:15.412017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-31828b03-e0c7-434d-bb75-d597b4962384 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:15.420290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-31828b03-e0c7-434d-bb75-d597b4962384 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Searching by: {'deleted': False, 'project_id': '2448bff0b9d84fafade11a13757320ca'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:15:15.453192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31828b03-e0c7-434d-bb75-d597b4962384 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:15.456152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31828b03-e0c7-434d-bb75-d597b4962384 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:15.456802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31828b03-e0c7-434d-bb75-d597b4962384 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:15.462526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31828b03-e0c7-434d-bb75-d597b4962384 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:15.467342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31828b03-e0c7-434d-bb75-d597b4962384 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:15.468067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31828b03-e0c7-434d-bb75-d597b4962384 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:15.578216 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-31828b03-e0c7-434d-bb75-d597b4962384 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.575823 Oct 29 01:15:15.579564 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1438/2756] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:15:15 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:15:15.588881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5df47741-0fc7-4d6e-8843-730363430d9d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1499700499"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:15.593615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5df47741-0fc7-4d6e-8843-730363430d9d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:15.628364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df47741-0fc7-4d6e-8843-730363430d9d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:15.633809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df47741-0fc7-4d6e-8843-730363430d9d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:15.633809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df47741-0fc7-4d6e-8843-730363430d9d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:15.633809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df47741-0fc7-4d6e-8843-730363430d9d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:15.633809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df47741-0fc7-4d6e-8843-730363430d9d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:15.633809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df47741-0fc7-4d6e-8843-730363430d9d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:15.634509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-07b61f6a-372f-4ca6-b6fb-7bcc354d620a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:15.646789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-07b61f6a-372f-4ca6-b6fb-7bcc354d620a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:15.648243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-07b61f6a-372f-4ca6-b6fb-7bcc354d620a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:15.649459 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-07b61f6a-372f-4ca6-b6fb-7bcc354d620a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1871 microversion: 2.42 time: 0.788759 Oct 29 01:15:15.650489 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1319/2757] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:14 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1871 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:15.657055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6831ad26-d1d6-47ce-ba36-92f2031d2815 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:15.657965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6831ad26-d1d6-47ce-ba36-92f2031d2815 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:15.664279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6831ad26-d1d6-47ce-ba36-92f2031d2815 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:15.664767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6831ad26-d1d6-47ce-ba36-92f2031d2815 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:15.665235 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6831ad26-d1d6-47ce-ba36-92f2031d2815 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:15.666157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6831ad26-d1d6-47ce-ba36-92f2031d2815 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:15.666779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6831ad26-d1d6-47ce-ba36-92f2031d2815 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:15.667367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6831ad26-d1d6-47ce-ba36-92f2031d2815 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:15.708869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6831ad26-d1d6-47ce-ba36-92f2031d2815 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:15.709087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6831ad26-d1d6-47ce-ba36-92f2031d2815 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:15.709426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6831ad26-d1d6-47ce-ba36-92f2031d2815 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:15.709882 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-6831ad26-d1d6-47ce-ba36-92f2031d2815 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lazy-loading 'fault' on Instance uuid 74263965-ee1f-46a3-8115-7da1ba849c83 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:15:15.759944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6831ad26-d1d6-47ce-ba36-92f2031d2815 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0a54f51ad4813b312baf3a03ba172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f421c64f9b2f49ebab46d9f8a28143d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:15.770608 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6831ad26-d1d6-47ce-ba36-92f2031d2815 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 200 len: 1305 microversion: 2.1 time: 0.118846 Oct 29 01:15:15.771860 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1320/2758] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:15 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 1305 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:15.794190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-32bee965-c9ef-4bc9-afbf-442ea99b44da tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:15.797951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-32bee965-c9ef-4bc9-afbf-442ea99b44da tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Searching by: {'deleted': False} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:15:15.804491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32bee965-c9ef-4bc9-afbf-442ea99b44da tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:15.805227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32bee965-c9ef-4bc9-afbf-442ea99b44da tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:15.806114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32bee965-c9ef-4bc9-afbf-442ea99b44da tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:15.807035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32bee965-c9ef-4bc9-afbf-442ea99b44da tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:15.807654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32bee965-c9ef-4bc9-afbf-442ea99b44da tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:15.808417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32bee965-c9ef-4bc9-afbf-442ea99b44da tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:15.976996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.multi_cell_list [None req-32bee965-c9ef-4bc9-afbf-442ea99b44da tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=121100) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:15:16.077222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:16.115053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32bee965-c9ef-4bc9-afbf-442ea99b44da tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:16.116073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32bee965-c9ef-4bc9-afbf-442ea99b44da tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:16.117478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32bee965-c9ef-4bc9-afbf-442ea99b44da tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:16.319834 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5df47741-0fc7-4d6e-8843-730363430d9d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "POST /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7/action" status: 202 len: 0 microversion: 2.1 time: 0.726769 Oct 29 01:15:16.320607 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1439/2759] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:15:15 2022] POST /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7/action => generated 0 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 01:15:16.335031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-edfd8b65-97ee-48e1-b991-000f0db1c0f7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-697389367"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:16.341072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-edfd8b65-97ee-48e1-b991-000f0db1c0f7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:16.373861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edfd8b65-97ee-48e1-b991-000f0db1c0f7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:16.374377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edfd8b65-97ee-48e1-b991-000f0db1c0f7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:16.374826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edfd8b65-97ee-48e1-b991-000f0db1c0f7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:16.375558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edfd8b65-97ee-48e1-b991-000f0db1c0f7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:16.376022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edfd8b65-97ee-48e1-b991-000f0db1c0f7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:16.376454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edfd8b65-97ee-48e1-b991-000f0db1c0f7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:16.875109 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-edfd8b65-97ee-48e1-b991-000f0db1c0f7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] HTTP exception thrown: Cannot 'createImage' instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 while it is in task_state image_snapshot_pending Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-edfd8b65-97ee-48e1-b991-000f0db1c0f7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Request method failure captured: Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7/action HTTP/1.1 Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 84 Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH6CzaWy1ufa72id6aheZbBREgQ1G2SbUhEpvcj_QTDF--UNn0kMcxBhslM6smsky4izROjyCZSxF91rcQGlVQlVrhfbQfHOyxM9K_r3ikSiecmNSXh8mpJTcen08ouic-cdYaYkhVKjr1CpS6bd1t3acwqY6OPH7aEAkOLl4egaxt8 Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_328d1dd53c6a4bc2b14376dd1a1cecb6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: b89f11ebd96141a5afe08dad79b0b20c Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-697389367"}} Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: exception: Cannot 'createImage' instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 while it is in task_state image_snapshot_pending Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'cfc8b0b3-923e-4144-a9ca-aeb9da2897f7', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-697389367'}}} Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 01:15:16.877560 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 01:15:16.881727 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 while it is in task_state image_snapshot_pending Oct 29 01:15:16.881727 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:16.881727 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:16.881727 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:16.881727 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:16.881727 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:16.881727 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:16.881727 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:16.881727 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:16.881727 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 while it is in task_state image_snapshot_pending Oct 29 01:15:16.881727 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:16.885721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-edfd8b65-97ee-48e1-b991-000f0db1c0f7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Returning 409 to user: Cannot 'createImage' instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 while it is in task_state image_snapshot_pending {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:16.894524 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-edfd8b65-97ee-48e1-b991-000f0db1c0f7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "POST /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7/action" status: 409 len: 167 microversion: 2.1 time: 0.565593 Oct 29 01:15:16.895893 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1440/2760] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:15:16 2022] POST /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7/action => generated 167 bytes in 568 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:15:16.900962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f9ea73f4-461e-4b04-9f22-8eff3b4ca618 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:16.907760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f9ea73f4-461e-4b04-9f22-8eff3b4ca618 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:16.924353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9ea73f4-461e-4b04-9f22-8eff3b4ca618 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:16.924353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9ea73f4-461e-4b04-9f22-8eff3b4ca618 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:16.924353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9ea73f4-461e-4b04-9f22-8eff3b4ca618 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:16.924353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9ea73f4-461e-4b04-9f22-8eff3b4ca618 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:16.924353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9ea73f4-461e-4b04-9f22-8eff3b4ca618 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:16.924733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9ea73f4-461e-4b04-9f22-8eff3b4ca618 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:17.930144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f9ea73f4-461e-4b04-9f22-8eff3b4ca618 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:17.946736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f9ea73f4-461e-4b04-9f22-8eff3b4ca618 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:17.948352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f9ea73f4-461e-4b04-9f22-8eff3b4ca618 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:17.952837 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f9ea73f4-461e-4b04-9f22-8eff3b4ca618 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1871 microversion: 2.42 time: 1.055666 Oct 29 01:15:17.957911 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1441/2761] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:16 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1871 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:17.965282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-38962a55-f257-4f65-bfd2-51087f80d0e0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:17.970421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-38962a55-f257-4f65-bfd2-51087f80d0e0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:17.979072 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-32bee965-c9ef-4bc9-afbf-442ea99b44da tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 9802 microversion: 2.1 time: 2.205916 Oct 29 01:15:17.980014 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1321/2762] 10.222.0.26 () {58 vars in 1171 bytes} [Sat Oct 29 01:15:15 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 9802 bytes in 2207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:18.002610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e356851b-0968-460e-a1f1-3b2ca55ef66d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '.version_select at 0x7f9d97f56550>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:18.006331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38962a55-f257-4f65-bfd2-51087f80d0e0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:18.007518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38962a55-f257-4f65-bfd2-51087f80d0e0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:18.008810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38962a55-f257-4f65-bfd2-51087f80d0e0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:18.022881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38962a55-f257-4f65-bfd2-51087f80d0e0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:18.023725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38962a55-f257-4f65-bfd2-51087f80d0e0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:18.024289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38962a55-f257-4f65-bfd2-51087f80d0e0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:18.073293 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-38962a55-f257-4f65-bfd2-51087f80d0e0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance 74263965-ee1f-46a3-8115-7da1ba849c83 could not be found. Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-38962a55-f257-4f65-bfd2-51087f80d0e0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 HTTP/1.1 Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 74263965-ee1f-46a3-8115-7da1ba849c83 could not be found. Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '74263965-ee1f-46a3-8115-7da1ba849c83'} Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74263965-ee1f-46a3-8115-7da1ba849c83 could not be found. Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74263965-ee1f-46a3-8115-7da1ba849c83 could not be found. Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:18.084774 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.089495 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:18.089495 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:18.089495 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:18.089495 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:18.089495 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:18.089495 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74263965-ee1f-46a3-8115-7da1ba849c83 could not be found. Oct 29 01:15:18.089495 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.092556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-38962a55-f257-4f65-bfd2-51087f80d0e0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance 74263965-ee1f-46a3-8115-7da1ba849c83 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:18.093777 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-38962a55-f257-4f65-bfd2-51087f80d0e0 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 404 len: 111 microversion: 2.1 time: 0.134364 Oct 29 01:15:18.095349 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1442/2763] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:17 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:18.106308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-39752c23-42e9-427d-ab43-1e756d51def9 req-25a111b9-268d-4559-859a-70df3d957b54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "tag": "27a1b433-eeb0-4aaa-86e0-7e13f0a59c70"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:18.120922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-39752c23-42e9-427d-ab43-1e756d51def9 req-25a111b9-268d-4559-859a-70df3d957b54 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:18.121809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-39752c23-42e9-427d-ab43-1e756d51def9 req-25a111b9-268d-4559-859a-70df3d957b54 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:18.122670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-39752c23-42e9-427d-ab43-1e756d51def9 req-25a111b9-268d-4559-859a-70df3d957b54 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:18.151601 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-39752c23-42e9-427d-ab43-1e756d51def9 req-25a111b9-268d-4559-859a-70df3d957b54 service nova] Creating event network-changed:27a1b433-eeb0-4aaa-86e0-7e13f0a59c70 for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:15:18.159966 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-39752c23-42e9-427d-ab43-1e756d51def9 req-25a111b9-268d-4559-859a-70df3d957b54 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060880 Oct 29 01:15:18.162397 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1443/2764] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:18.176113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d7dec6aa-2056-485c-babe-4ae0f86670f0 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:18.203434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d7dec6aa-2056-485c-babe-4ae0f86670f0 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Searching by: {'deleted': False, 'project_id': '2448bff0b9d84fafade11a13757320ca'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:15:18.219372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7dec6aa-2056-485c-babe-4ae0f86670f0 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:18.221312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7dec6aa-2056-485c-babe-4ae0f86670f0 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:18.222916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7dec6aa-2056-485c-babe-4ae0f86670f0 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:18.225996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7dec6aa-2056-485c-babe-4ae0f86670f0 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:18.227002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7dec6aa-2056-485c-babe-4ae0f86670f0 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:18.228235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7dec6aa-2056-485c-babe-4ae0f86670f0 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:18.282888 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d7dec6aa-2056-485c-babe-4ae0f86670f0 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?tenant_id=5bdf61e2cbca4cdc95494b38c827ce63" status: 200 len: 15 microversion: 2.1 time: 0.118330 Oct 29 01:15:18.284132 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1444/2765] 10.222.0.26 () {58 vars in 1231 bytes} [Sat Oct 29 01:15:18 2022] GET /compute/v2.1/servers/detail?tenant_id=5bdf61e2cbca4cdc95494b38c827ce63 => generated 15 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:15:18.290822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-35017b81-c83a-43b1-8ab1-de0a97a085b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:18.292026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-35017b81-c83a-43b1-8ab1-de0a97a085b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:18.311270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35017b81-c83a-43b1-8ab1-de0a97a085b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:18.311934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35017b81-c83a-43b1-8ab1-de0a97a085b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:18.312492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35017b81-c83a-43b1-8ab1-de0a97a085b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:18.313376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35017b81-c83a-43b1-8ab1-de0a97a085b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:18.313950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35017b81-c83a-43b1-8ab1-de0a97a085b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:18.314513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35017b81-c83a-43b1-8ab1-de0a97a085b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:18.332919 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-35017b81-c83a-43b1-8ab1-de0a97a085b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance 74263965-ee1f-46a3-8115-7da1ba849c83 could not be found. Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-35017b81-c83a-43b1-8ab1-de0a97a085b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 HTTP/1.1 Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 74263965-ee1f-46a3-8115-7da1ba849c83 could not be found. Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '74263965-ee1f-46a3-8115-7da1ba849c83'} Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74263965-ee1f-46a3-8115-7da1ba849c83 could not be found. Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:18.335425 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:18.341896 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74263965-ee1f-46a3-8115-7da1ba849c83 could not be found. Oct 29 01:15:18.341896 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.341896 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:18.341896 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.341896 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:18.341896 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:18.341896 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:18.341896 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:18.341896 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:18.341896 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74263965-ee1f-46a3-8115-7da1ba849c83 could not be found. Oct 29 01:15:18.341896 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.341896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-35017b81-c83a-43b1-8ab1-de0a97a085b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance 74263965-ee1f-46a3-8115-7da1ba849c83 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:18.341896 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-35017b81-c83a-43b1-8ab1-de0a97a085b1 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "DELETE /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 404 len: 111 microversion: 2.1 time: 0.051636 Oct 29 01:15:18.349659 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1445/2766] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:15:18 2022] DELETE /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:18.355051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4712af84-4b09-4e94-8c7b-6a9eecdf195a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:18.369572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4712af84-4b09-4e94-8c7b-6a9eecdf195a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Searching by: {'tenant_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'deleted': False} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:15:18.380278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4712af84-4b09-4e94-8c7b-6a9eecdf195a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:18.380702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4712af84-4b09-4e94-8c7b-6a9eecdf195a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:18.381173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4712af84-4b09-4e94-8c7b-6a9eecdf195a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:18.381920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4712af84-4b09-4e94-8c7b-6a9eecdf195a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:18.382379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4712af84-4b09-4e94-8c7b-6a9eecdf195a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:18.382822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4712af84-4b09-4e94-8c7b-6a9eecdf195a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:18.434406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-4712af84-4b09-4e94-8c7b-6a9eecdf195a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:15:18.437279 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e356851b-0968-460e-a1f1-3b2ca55ef66d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "DELETE /compute/v2.1/images/cd1aa078-eb67-4031-afe9-08df7b75babe" status: 204 len: 0 microversion: 2.1 time: 0.455943 Oct 29 01:15:18.438226 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1322/2767] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:17 2022] DELETE /compute/v2.1/images/cd1aa078-eb67-4031-afe9-08df7b75babe => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:15:18.452416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-15b97ead-1b37-48cb-9f11-2aada29a196a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:18.453670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-15b97ead-1b37-48cb-9f11-2aada29a196a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 74263965-ee1f-46a3-8115-7da1ba849c83] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:18.463866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15b97ead-1b37-48cb-9f11-2aada29a196a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:18.464654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15b97ead-1b37-48cb-9f11-2aada29a196a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:18.465726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15b97ead-1b37-48cb-9f11-2aada29a196a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:18.467375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15b97ead-1b37-48cb-9f11-2aada29a196a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:18.468212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15b97ead-1b37-48cb-9f11-2aada29a196a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:18.468952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15b97ead-1b37-48cb-9f11-2aada29a196a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:18.494044 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-15b97ead-1b37-48cb-9f11-2aada29a196a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance 74263965-ee1f-46a3-8115-7da1ba849c83 could not be found. Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-15b97ead-1b37-48cb-9f11-2aada29a196a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 HTTP/1.1 Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 74263965-ee1f-46a3-8115-7da1ba849c83 could not be found. Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '74263965-ee1f-46a3-8115-7da1ba849c83'} Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74263965-ee1f-46a3-8115-7da1ba849c83 could not be found. Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74263965-ee1f-46a3-8115-7da1ba849c83 could not be found. Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:18.495942 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.501517 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:18.501517 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:18.501517 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:18.501517 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:18.501517 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:18.501517 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74263965-ee1f-46a3-8115-7da1ba849c83 could not be found. Oct 29 01:15:18.501517 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.507173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-15b97ead-1b37-48cb-9f11-2aada29a196a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance 74263965-ee1f-46a3-8115-7da1ba849c83 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:18.508628 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-15b97ead-1b37-48cb-9f11-2aada29a196a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83" status: 404 len: 111 microversion: 2.1 time: 0.061243 Oct 29 01:15:18.514119 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1323/2768] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:18 2022] GET /compute/v2.1/servers/74263965-ee1f-46a3-8115-7da1ba849c83 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:18.528966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-461d7a66-a186-444f-9149-84078b0423fc tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:18.530118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-461d7a66-a186-444f-9149-84078b0423fc tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:18.541257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-461d7a66-a186-444f-9149-84078b0423fc tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:18.545798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4712af84-4b09-4e94-8c7b-6a9eecdf195a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:18.547587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-461d7a66-a186-444f-9149-84078b0423fc tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:18.547587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-461d7a66-a186-444f-9149-84078b0423fc tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:18.547813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4712af84-4b09-4e94-8c7b-6a9eecdf195a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:18.547813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4712af84-4b09-4e94-8c7b-6a9eecdf195a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:18.551287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-461d7a66-a186-444f-9149-84078b0423fc tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:18.551883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-461d7a66-a186-444f-9149-84078b0423fc tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:18.561927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-461d7a66-a186-444f-9149-84078b0423fc tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:18.906819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-461d7a66-a186-444f-9149-84078b0423fc tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:18.917814 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-461d7a66-a186-444f-9149-84078b0423fc tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1535 microversion: 2.1 time: 0.402227 Oct 29 01:15:18.919537 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1324/2769] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:18 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1535 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:18.928150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e34c9eb6-8761-4030-a482-3cdf0524b61a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:18.928653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e34c9eb6-8761-4030-a482-3cdf0524b61a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:18.951360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e34c9eb6-8761-4030-a482-3cdf0524b61a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:18.952110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e34c9eb6-8761-4030-a482-3cdf0524b61a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:18.952697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e34c9eb6-8761-4030-a482-3cdf0524b61a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:18.953616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e34c9eb6-8761-4030-a482-3cdf0524b61a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:18.954225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e34c9eb6-8761-4030-a482-3cdf0524b61a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:18.954804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e34c9eb6-8761-4030-a482-3cdf0524b61a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:18.988431 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-e34c9eb6-8761-4030-a482-3cdf0524b61a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 could not be found. Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e34c9eb6-8761-4030-a482-3cdf0524b61a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 HTTP/1.1 Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 could not be found. Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'a40f1fe3-0af2-43d1-a530-0960ed7c8eb3'} Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 could not be found. Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:18.990206 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:18.994265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 could not be found. Oct 29 01:15:18.994265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.994265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:18.994265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.994265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:18.994265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:18.994265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:18.994265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:18.994265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:18.994265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 could not be found. Oct 29 01:15:18.994265 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:18.994265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e34c9eb6-8761-4030-a482-3cdf0524b61a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:18.994265 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e34c9eb6-8761-4030-a482-3cdf0524b61a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 404 len: 111 microversion: 2.1 time: 0.068016 Oct 29 01:15:18.995689 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1325/2770] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:15:18 2022] DELETE /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:19.006983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6f0fc157-712e-4ecb-ace9-a72f24110146 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:19.007632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6f0fc157-712e-4ecb-ace9-a72f24110146 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:19.008763 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4712af84-4b09-4e94-8c7b-6a9eecdf195a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5bdf61e2cbca4cdc95494b38c827ce63" status: 200 len: 4826 microversion: 2.1 time: 0.657714 Oct 29 01:15:19.009416 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1446/2771] 10.222.0.26 () {58 vars in 1257 bytes} [Sat Oct 29 01:15:18 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5bdf61e2cbca4cdc95494b38c827ce63 => generated 4826 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:19.016310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-405117c7-153b-4002-9483-f64ad1d05223 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:19.017129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-405117c7-153b-4002-9483-f64ad1d05223 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: a40f1fe3-0af2-43d1-a530-0960ed7c8eb3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:19.025711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-405117c7-153b-4002-9483-f64ad1d05223 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.026380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-405117c7-153b-4002-9483-f64ad1d05223 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.026987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-405117c7-153b-4002-9483-f64ad1d05223 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.028656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-405117c7-153b-4002-9483-f64ad1d05223 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.029356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-405117c7-153b-4002-9483-f64ad1d05223 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.030160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-405117c7-153b-4002-9483-f64ad1d05223 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.038855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f0fc157-712e-4ecb-ace9-a72f24110146 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.044517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f0fc157-712e-4ecb-ace9-a72f24110146 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.044517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f0fc157-712e-4ecb-ace9-a72f24110146 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.044517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f0fc157-712e-4ecb-ace9-a72f24110146 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.044517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f0fc157-712e-4ecb-ace9-a72f24110146 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.044517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f0fc157-712e-4ecb-ace9-a72f24110146 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.049665 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-405117c7-153b-4002-9483-f64ad1d05223 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 could not be found. Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-405117c7-153b-4002-9483-f64ad1d05223 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 HTTP/1.1 Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 could not be found. Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'a40f1fe3-0af2-43d1-a530-0960ed7c8eb3'} Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 could not be found. Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 could not be found. Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:19.052198 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.056359 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.056359 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:19.056359 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:19.056359 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:19.056359 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:19.056359 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 could not be found. Oct 29 01:15:19.056359 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.057613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-405117c7-153b-4002-9483-f64ad1d05223 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:19.059182 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-405117c7-153b-4002-9483-f64ad1d05223 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3" status: 404 len: 111 microversion: 2.1 time: 0.048105 Oct 29 01:15:19.061061 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1447/2772] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:19 2022] GET /compute/v2.1/servers/a40f1fe3-0af2-43d1-a530-0960ed7c8eb3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:19.072454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b025cdc0-a273-43c3-96ab-1ccb61ec3188 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:19.079086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b025cdc0-a273-43c3-96ab-1ccb61ec3188 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Searching by: {'tenant_id': '2448bff0b9d84fafade11a13757320ca', 'deleted': False} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:15:19.084926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b025cdc0-a273-43c3-96ab-1ccb61ec3188 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.085822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b025cdc0-a273-43c3-96ab-1ccb61ec3188 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.086577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b025cdc0-a273-43c3-96ab-1ccb61ec3188 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.087486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b025cdc0-a273-43c3-96ab-1ccb61ec3188 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.093788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b025cdc0-a273-43c3-96ab-1ccb61ec3188 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.093788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b025cdc0-a273-43c3-96ab-1ccb61ec3188 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.123895 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b025cdc0-a273-43c3-96ab-1ccb61ec3188 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2448bff0b9d84fafade11a13757320ca" status: 200 len: 15 microversion: 2.1 time: 0.059522 Oct 29 01:15:19.126687 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1448/2773] 10.222.0.26 () {58 vars in 1257 bytes} [Sat Oct 29 01:15:19 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2448bff0b9d84fafade11a13757320ca => generated 15 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:15:19.133074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6320f246-8cd5-4411-be16-26972ce99528 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:19.133775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6320f246-8cd5-4411-be16-26972ce99528 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:19.145806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6320f246-8cd5-4411-be16-26972ce99528 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.149405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6320f246-8cd5-4411-be16-26972ce99528 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.156543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6320f246-8cd5-4411-be16-26972ce99528 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.156543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6320f246-8cd5-4411-be16-26972ce99528 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.156543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6320f246-8cd5-4411-be16-26972ce99528 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.156543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6320f246-8cd5-4411-be16-26972ce99528 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.170287 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-6320f246-8cd5-4411-be16-26972ce99528 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance b0fe24cf-adf2-440f-bc90-819416f0da85 could not be found. Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6320f246-8cd5-4411-be16-26972ce99528 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 HTTP/1.1 Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance b0fe24cf-adf2-440f-bc90-819416f0da85 could not be found. Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'b0fe24cf-adf2-440f-bc90-819416f0da85'} Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0fe24cf-adf2-440f-bc90-819416f0da85 could not be found. Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:19.172032 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:19.176131 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0fe24cf-adf2-440f-bc90-819416f0da85 could not be found. Oct 29 01:15:19.176131 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.176131 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:19.176131 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.176131 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.176131 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:19.176131 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:19.176131 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:19.176131 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:19.176131 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0fe24cf-adf2-440f-bc90-819416f0da85 could not be found. Oct 29 01:15:19.176131 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.177719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6320f246-8cd5-4411-be16-26972ce99528 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance b0fe24cf-adf2-440f-bc90-819416f0da85 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:19.178747 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6320f246-8cd5-4411-be16-26972ce99528 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 404 len: 111 microversion: 2.1 time: 0.050933 Oct 29 01:15:19.182591 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1449/2774] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:15:19 2022] DELETE /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:19.188174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9f6875cc-fe36-4d5f-88b1-96f0dd1e816a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:19.194703 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9f6875cc-fe36-4d5f-88b1-96f0dd1e816a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010841 Oct 29 01:15:19.195773 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1450/2775] 10.222.0.26 () {58 vars in 1189 bytes} [Sat Oct 29 01:15:19 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:15:19.201720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e691fb44-4396-49d3-893f-f49186abcec2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:19.203164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e691fb44-4396-49d3-893f-f49186abcec2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: b0fe24cf-adf2-440f-bc90-819416f0da85] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:19.211899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e691fb44-4396-49d3-893f-f49186abcec2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.214911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e691fb44-4396-49d3-893f-f49186abcec2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.215193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e691fb44-4396-49d3-893f-f49186abcec2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.216828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e691fb44-4396-49d3-893f-f49186abcec2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.217975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e691fb44-4396-49d3-893f-f49186abcec2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.218568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e691fb44-4396-49d3-893f-f49186abcec2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.235218 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-e691fb44-4396-49d3-893f-f49186abcec2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance b0fe24cf-adf2-440f-bc90-819416f0da85 could not be found. Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e691fb44-4396-49d3-893f-f49186abcec2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 HTTP/1.1 Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance b0fe24cf-adf2-440f-bc90-819416f0da85 could not be found. Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'b0fe24cf-adf2-440f-bc90-819416f0da85'} Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0fe24cf-adf2-440f-bc90-819416f0da85 could not be found. Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0fe24cf-adf2-440f-bc90-819416f0da85 could not be found. Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:19.237801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.247639 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.247639 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:19.247639 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:19.247639 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:19.247639 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:19.247639 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0fe24cf-adf2-440f-bc90-819416f0da85 could not be found. Oct 29 01:15:19.247639 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.247639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e691fb44-4396-49d3-893f-f49186abcec2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance b0fe24cf-adf2-440f-bc90-819416f0da85 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:19.247639 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e691fb44-4396-49d3-893f-f49186abcec2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85" status: 404 len: 111 microversion: 2.1 time: 0.042661 Oct 29 01:15:19.249294 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1451/2776] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:19 2022] GET /compute/v2.1/servers/b0fe24cf-adf2-440f-bc90-819416f0da85 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:19.255701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0d05d287-5c95-434e-8692-a675647322e7 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:19.258757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0d05d287-5c95-434e-8692-a675647322e7 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:19.270970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d05d287-5c95-434e-8692-a675647322e7 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.270970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d05d287-5c95-434e-8692-a675647322e7 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.270970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d05d287-5c95-434e-8692-a675647322e7 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.270970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d05d287-5c95-434e-8692-a675647322e7 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.270970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d05d287-5c95-434e-8692-a675647322e7 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.270970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d05d287-5c95-434e-8692-a675647322e7 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.550575 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0d05d287-5c95-434e-8692-a675647322e7 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c/action" status: 202 len: 0 microversion: 2.1 time: 0.299388 Oct 29 01:15:19.551785 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1452/2777] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:15:19 2022] POST /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:15:19.557451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-578a3b9b-90ab-41e5-93f1-f0c63106208c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:19.558152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-578a3b9b-90ab-41e5-93f1-f0c63106208c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:19.566388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-578a3b9b-90ab-41e5-93f1-f0c63106208c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.567112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-578a3b9b-90ab-41e5-93f1-f0c63106208c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.567701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-578a3b9b-90ab-41e5-93f1-f0c63106208c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.568644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-578a3b9b-90ab-41e5-93f1-f0c63106208c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.569327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-578a3b9b-90ab-41e5-93f1-f0c63106208c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.569905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-578a3b9b-90ab-41e5-93f1-f0c63106208c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.587200 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-578a3b9b-90ab-41e5-93f1-f0c63106208c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance 11ab5390-0016-48c1-a83a-3afad408b332 could not be found. Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-578a3b9b-90ab-41e5-93f1-f0c63106208c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 HTTP/1.1 Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 11ab5390-0016-48c1-a83a-3afad408b332 could not be found. Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '11ab5390-0016-48c1-a83a-3afad408b332'} Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11ab5390-0016-48c1-a83a-3afad408b332 could not be found. Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:19.589082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:19.594088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11ab5390-0016-48c1-a83a-3afad408b332 could not be found. Oct 29 01:15:19.594088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.594088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:19.594088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.594088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.594088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:19.594088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:19.594088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:19.594088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:19.594088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11ab5390-0016-48c1-a83a-3afad408b332 could not be found. Oct 29 01:15:19.594088 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.596602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-578a3b9b-90ab-41e5-93f1-f0c63106208c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance 11ab5390-0016-48c1-a83a-3afad408b332 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:19.597807 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-578a3b9b-90ab-41e5-93f1-f0c63106208c tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "DELETE /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 404 len: 111 microversion: 2.1 time: 0.044719 Oct 29 01:15:19.601828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6f0fc157-712e-4ecb-ace9-a72f24110146 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:19.602252 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1453/2778] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:15:19 2022] DELETE /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:19.608956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b472beea-e0a5-4f22-8b56-d1534ded6020 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:19.614191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b472beea-e0a5-4f22-8b56-d1534ded6020 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:19.615086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b472beea-e0a5-4f22-8b56-d1534ded6020 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:15:19.619257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6f0fc157-712e-4ecb-ace9-a72f24110146 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:19.621567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b472beea-e0a5-4f22-8b56-d1534ded6020 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.622356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6f0fc157-712e-4ecb-ace9-a72f24110146 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:19.622862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b472beea-e0a5-4f22-8b56-d1534ded6020 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.623733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b472beea-e0a5-4f22-8b56-d1534ded6020 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.624686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b472beea-e0a5-4f22-8b56-d1534ded6020 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.625368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b472beea-e0a5-4f22-8b56-d1534ded6020 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.626621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b472beea-e0a5-4f22-8b56-d1534ded6020 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.628860 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6f0fc157-712e-4ecb-ace9-a72f24110146 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1871 microversion: 2.42 time: 0.630495 Oct 29 01:15:19.629615 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1326/2779] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:18 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1871 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:19.645148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e510b66e-3254-4714-88c2-e7ecc0ad1805 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:19.646117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e510b66e-3254-4714-88c2-e7ecc0ad1805 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 11ab5390-0016-48c1-a83a-3afad408b332] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:19.663207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e510b66e-3254-4714-88c2-e7ecc0ad1805 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.663976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e510b66e-3254-4714-88c2-e7ecc0ad1805 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.664462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e510b66e-3254-4714-88c2-e7ecc0ad1805 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.665291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e510b66e-3254-4714-88c2-e7ecc0ad1805 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.665827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e510b66e-3254-4714-88c2-e7ecc0ad1805 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.666347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e510b66e-3254-4714-88c2-e7ecc0ad1805 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.692957 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-e510b66e-3254-4714-88c2-e7ecc0ad1805 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance 11ab5390-0016-48c1-a83a-3afad408b332 could not be found. Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e510b66e-3254-4714-88c2-e7ecc0ad1805 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 HTTP/1.1 Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 11ab5390-0016-48c1-a83a-3afad408b332 could not be found. Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '11ab5390-0016-48c1-a83a-3afad408b332'} Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11ab5390-0016-48c1-a83a-3afad408b332 could not be found. Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11ab5390-0016-48c1-a83a-3afad408b332 could not be found. Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:19.696561 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.701628 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.701628 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:19.701628 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:19.701628 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:19.701628 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:19.701628 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11ab5390-0016-48c1-a83a-3afad408b332 could not be found. Oct 29 01:15:19.701628 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.701628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e510b66e-3254-4714-88c2-e7ecc0ad1805 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance 11ab5390-0016-48c1-a83a-3afad408b332 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:19.702942 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e510b66e-3254-4714-88c2-e7ecc0ad1805 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332" status: 404 len: 111 microversion: 2.1 time: 0.071684 Oct 29 01:15:19.706388 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1327/2780] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:19 2022] GET /compute/v2.1/servers/11ab5390-0016-48c1-a83a-3afad408b332 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:19.720976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0b05b6d4-d919-40f1-9187-dba2a21269b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:19.721522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0b05b6d4-d919-40f1-9187-dba2a21269b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: d6800a60-316f-41e4-a3bb-9e2c10f34939] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:19.735709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b05b6d4-d919-40f1-9187-dba2a21269b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.739694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b05b6d4-d919-40f1-9187-dba2a21269b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.743118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b05b6d4-d919-40f1-9187-dba2a21269b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.743118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b05b6d4-d919-40f1-9187-dba2a21269b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.743118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b05b6d4-d919-40f1-9187-dba2a21269b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.743118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b05b6d4-d919-40f1-9187-dba2a21269b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.748879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-b472beea-e0a5-4f22-8b56-d1534ded6020 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:15:19.778755 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-0b05b6d4-d919-40f1-9187-dba2a21269b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance d6800a60-316f-41e4-a3bb-9e2c10f34939 could not be found. Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0b05b6d4-d919-40f1-9187-dba2a21269b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/d6800a60-316f-41e4-a3bb-9e2c10f34939 HTTP/1.1 Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance d6800a60-316f-41e4-a3bb-9e2c10f34939 could not be found. Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'd6800a60-316f-41e4-a3bb-9e2c10f34939'} Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6800a60-316f-41e4-a3bb-9e2c10f34939 could not be found. Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:19.780376 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:19.785435 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6800a60-316f-41e4-a3bb-9e2c10f34939 could not be found. Oct 29 01:15:19.785435 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.785435 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:19.785435 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.785435 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.785435 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:19.785435 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:19.785435 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:19.785435 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:19.785435 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6800a60-316f-41e4-a3bb-9e2c10f34939 could not be found. Oct 29 01:15:19.785435 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.785435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0b05b6d4-d919-40f1-9187-dba2a21269b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance d6800a60-316f-41e4-a3bb-9e2c10f34939 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:19.785435 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0b05b6d4-d919-40f1-9187-dba2a21269b2 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d6800a60-316f-41e4-a3bb-9e2c10f34939" status: 404 len: 111 microversion: 2.1 time: 0.074296 Oct 29 01:15:19.790815 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1328/2781] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:15:19 2022] DELETE /compute/v2.1/servers/d6800a60-316f-41e4-a3bb-9e2c10f34939 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:19.799192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-19ae6711-e9b9-46d2-9dac-a724437ba319 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:19.799814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-19ae6711-e9b9-46d2-9dac-a724437ba319 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: d6800a60-316f-41e4-a3bb-9e2c10f34939] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:19.818905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19ae6711-e9b9-46d2-9dac-a724437ba319 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.818905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19ae6711-e9b9-46d2-9dac-a724437ba319 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.818905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19ae6711-e9b9-46d2-9dac-a724437ba319 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.818905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19ae6711-e9b9-46d2-9dac-a724437ba319 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.819360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19ae6711-e9b9-46d2-9dac-a724437ba319 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.819763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19ae6711-e9b9-46d2-9dac-a724437ba319 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.848849 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b472beea-e0a5-4f22-8b56-d1534ded6020 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.245150 Oct 29 01:15:19.850446 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1454/2782] 10.222.0.26 () {58 vars in 1150 bytes} [Sat Oct 29 01:15:19 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:19.858944 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-19ae6711-e9b9-46d2-9dac-a724437ba319 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance d6800a60-316f-41e4-a3bb-9e2c10f34939 could not be found. Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-19ae6711-e9b9-46d2-9dac-a724437ba319 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/d6800a60-316f-41e4-a3bb-9e2c10f34939 HTTP/1.1 Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance d6800a60-316f-41e4-a3bb-9e2c10f34939 could not be found. Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'd6800a60-316f-41e4-a3bb-9e2c10f34939'} Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6800a60-316f-41e4-a3bb-9e2c10f34939 could not be found. Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6800a60-316f-41e4-a3bb-9e2c10f34939 could not be found. Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:19.860513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.865390 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:19.865390 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:19.865390 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:19.865390 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:19.865390 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:19.865390 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6800a60-316f-41e4-a3bb-9e2c10f34939 could not be found. Oct 29 01:15:19.865390 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:19.865390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-19ae6711-e9b9-46d2-9dac-a724437ba319 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance d6800a60-316f-41e4-a3bb-9e2c10f34939 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:19.865390 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-19ae6711-e9b9-46d2-9dac-a724437ba319 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/d6800a60-316f-41e4-a3bb-9e2c10f34939" status: 404 len: 111 microversion: 2.1 time: 0.070101 Oct 29 01:15:19.865390 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1329/2783] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:19 2022] GET /compute/v2.1/servers/d6800a60-316f-41e4-a3bb-9e2c10f34939 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:19.874567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5ed5dee8-588e-449e-b569-4364915a6799 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:19.878599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5ed5dee8-588e-449e-b569-4364915a6799 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:19.888977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ed5dee8-588e-449e-b569-4364915a6799 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.889850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ed5dee8-588e-449e-b569-4364915a6799 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.890469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ed5dee8-588e-449e-b569-4364915a6799 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.891363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ed5dee8-588e-449e-b569-4364915a6799 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.896245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ed5dee8-588e-449e-b569-4364915a6799 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.896245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ed5dee8-588e-449e-b569-4364915a6799 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.946582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-16835725-e17e-4eed-8abe-f317827f0d0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:19.947121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-16835725-e17e-4eed-8abe-f317827f0d0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:19.959601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16835725-e17e-4eed-8abe-f317827f0d0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.960085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16835725-e17e-4eed-8abe-f317827f0d0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.960514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16835725-e17e-4eed-8abe-f317827f0d0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:19.961252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16835725-e17e-4eed-8abe-f317827f0d0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:19.961705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16835725-e17e-4eed-8abe-f317827f0d0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:19.962123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16835725-e17e-4eed-8abe-f317827f0d0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:20.248521 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5ed5dee8-588e-449e-b569-4364915a6799 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c/action" status: 202 len: 0 microversion: 2.1 time: 0.389591 Oct 29 01:15:20.249346 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1455/2784] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:15:19 2022] POST /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:15:20.259304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f1ab02aa-6838-4648-b7b2-b4957929c594 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:20.261065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f1ab02aa-6838-4648-b7b2-b4957929c594 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:20.275840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1ab02aa-6838-4648-b7b2-b4957929c594 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:20.280399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1ab02aa-6838-4648-b7b2-b4957929c594 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:20.282466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1ab02aa-6838-4648-b7b2-b4957929c594 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:20.285891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1ab02aa-6838-4648-b7b2-b4957929c594 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:20.288575 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1ab02aa-6838-4648-b7b2-b4957929c594 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:20.290946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1ab02aa-6838-4648-b7b2-b4957929c594 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:20.733221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-16835725-e17e-4eed-8abe-f317827f0d0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:20.743322 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-16835725-e17e-4eed-8abe-f317827f0d0b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1541 microversion: 2.1 time: 0.800743 Oct 29 01:15:20.748585 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1330/2785] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:19 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1541 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:20.766418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a9706754-2f52-4af6-bd3a-a6f45c70e987 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:20.773603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a9706754-2f52-4af6-bd3a-a6f45c70e987 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:20.801063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a9706754-2f52-4af6-bd3a-a6f45c70e987 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:20.802282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a9706754-2f52-4af6-bd3a-a6f45c70e987 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:20.802822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a9706754-2f52-4af6-bd3a-a6f45c70e987 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:20.805010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a9706754-2f52-4af6-bd3a-a6f45c70e987 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:20.807713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a9706754-2f52-4af6-bd3a-a6f45c70e987 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:20.808387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a9706754-2f52-4af6-bd3a-a6f45c70e987 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:21.376175 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f1ab02aa-6838-4648-b7b2-b4957929c594 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1615 microversion: 2.1 time: 1.122659 Oct 29 01:15:21.389233 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1456/2786] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:20 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1615 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:21.406745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b92889f4-0dfc-4727-bdf2-23adee139699 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:21.408005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b92889f4-0dfc-4727-bdf2-23adee139699 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:21.430038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b92889f4-0dfc-4727-bdf2-23adee139699 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:21.431818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b92889f4-0dfc-4727-bdf2-23adee139699 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:21.432400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b92889f4-0dfc-4727-bdf2-23adee139699 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:21.433810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b92889f4-0dfc-4727-bdf2-23adee139699 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:21.435417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b92889f4-0dfc-4727-bdf2-23adee139699 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:21.438156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b92889f4-0dfc-4727-bdf2-23adee139699 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:22.118876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a9706754-2f52-4af6-bd3a-a6f45c70e987 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:22.163510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a9706754-2f52-4af6-bd3a-a6f45c70e987 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:22.166696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a9706754-2f52-4af6-bd3a-a6f45c70e987 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:22.170252 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a9706754-2f52-4af6-bd3a-a6f45c70e987 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1892 microversion: 2.42 time: 1.416125 Oct 29 01:15:22.171689 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1331/2787] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:20 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1892 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:22.190478 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b92889f4-0dfc-4727-bdf2-23adee139699 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1615 microversion: 2.1 time: 0.780274 Oct 29 01:15:22.191710 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1457/2788] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:21 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1615 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:22.191970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1d99c21d-e7c5-4d07-8aae-9af27253636f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:22.193057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1d99c21d-e7c5-4d07-8aae-9af27253636f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:22.211155 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d99c21d-e7c5-4d07-8aae-9af27253636f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:22.211909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d99c21d-e7c5-4d07-8aae-9af27253636f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:22.212505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d99c21d-e7c5-4d07-8aae-9af27253636f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:22.213706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d99c21d-e7c5-4d07-8aae-9af27253636f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:22.214321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c40372db-b3e1-46c9-ae48-2f7937a96b8f tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:22.214804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d99c21d-e7c5-4d07-8aae-9af27253636f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:22.215424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d99c21d-e7c5-4d07-8aae-9af27253636f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:22.220611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c40372db-b3e1-46c9-ae48-2f7937a96b8f tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Searching by: {'host': 'n-h1-862964-3', 'deleted': False} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:15:22.238739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c40372db-b3e1-46c9-ae48-2f7937a96b8f tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:22.239235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c40372db-b3e1-46c9-ae48-2f7937a96b8f tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:22.239756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c40372db-b3e1-46c9-ae48-2f7937a96b8f tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:22.240833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c40372db-b3e1-46c9-ae48-2f7937a96b8f tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:22.241480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c40372db-b3e1-46c9-ae48-2f7937a96b8f tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:22.242065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c40372db-b3e1-46c9-ae48-2f7937a96b8f tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:22.487854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-c40372db-b3e1-46c9-ae48-2f7937a96b8f tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:15:22.577087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:22.601795 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c40372db-b3e1-46c9-ae48-2f7937a96b8f tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] 10.222.0.26 "GET /compute/v2.1/servers?host=n-h1-862964-3&all_tenants=1" status: 200 len: 1326 microversion: 2.1 time: 0.391229 Oct 29 01:15:22.641873 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1458/2789] 10.222.0.26 () {58 vars in 1190 bytes} [Sat Oct 29 01:15:22 2022] GET /compute/v2.1/servers?host=n-h1-862964-3&all_tenants=1 => generated 1326 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:22.641873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b69c8328-e615-4b9d-b1ac-fe70dffe85a4 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:22.641873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b69c8328-e615-4b9d-b1ac-fe70dffe85a4 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:15:22.646266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b69c8328-e615-4b9d-b1ac-fe70dffe85a4 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:22.646886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b69c8328-e615-4b9d-b1ac-fe70dffe85a4 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:22.647497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b69c8328-e615-4b9d-b1ac-fe70dffe85a4 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:22.648324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b69c8328-e615-4b9d-b1ac-fe70dffe85a4 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:22.648852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b69c8328-e615-4b9d-b1ac-fe70dffe85a4 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:22.649896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b69c8328-e615-4b9d-b1ac-fe70dffe85a4 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:22.674923 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b69c8328-e615-4b9d-b1ac-fe70dffe85a4 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] 10.222.0.26 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.062553 Oct 29 01:15:22.675859 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1459/2790] 10.222.0.26 () {58 vars in 1196 bytes} [Sat Oct 29 01:15:22 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:15:22.696767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-46b92a17-8d0d-40bb-bf79-a7e99e8104ef tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:22.711475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-46b92a17-8d0d-40bb-bf79-a7e99e8104ef tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:22.714234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46b92a17-8d0d-40bb-bf79-a7e99e8104ef tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:22.715887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46b92a17-8d0d-40bb-bf79-a7e99e8104ef tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:22.716618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46b92a17-8d0d-40bb-bf79-a7e99e8104ef tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:22.717712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46b92a17-8d0d-40bb-bf79-a7e99e8104ef tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:22.718414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46b92a17-8d0d-40bb-bf79-a7e99e8104ef tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:22.719231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46b92a17-8d0d-40bb-bf79-a7e99e8104ef tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:22.881892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1d99c21d-e7c5-4d07-8aae-9af27253636f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:22.898348 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1d99c21d-e7c5-4d07-8aae-9af27253636f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1541 microversion: 2.1 time: 0.725128 Oct 29 01:15:22.899715 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1332/2791] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:22 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1541 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:22.964765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-e3666d76-483a-4beb-a8ef-ed5db91ae252 req-4ae269d1-7599-41a1-9736-8127df778785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "tag": "eb30986f-1ab2-4e01-a0ab-fea8fcfc435c"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:22.988681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e3666d76-483a-4beb-a8ef-ed5db91ae252 req-4ae269d1-7599-41a1-9736-8127df778785 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:22.989589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e3666d76-483a-4beb-a8ef-ed5db91ae252 req-4ae269d1-7599-41a1-9736-8127df778785 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:22.990194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e3666d76-483a-4beb-a8ef-ed5db91ae252 req-4ae269d1-7599-41a1-9736-8127df778785 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:23.006576 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-e3666d76-483a-4beb-a8ef-ed5db91ae252 req-4ae269d1-7599-41a1-9736-8127df778785 service nova] Creating event network-changed:eb30986f-1ab2-4e01-a0ab-fea8fcfc435c for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:15:23.012872 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-e3666d76-483a-4beb-a8ef-ed5db91ae252 req-4ae269d1-7599-41a1-9736-8127df778785 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058158 Oct 29 01:15:23.014280 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1333/2792] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:23.124912 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-46b92a17-8d0d-40bb-bf79-a7e99e8104ef tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c/action" status: 202 len: 0 microversion: 2.1 time: 0.435539 Oct 29 01:15:23.135608 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1460/2793] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:15:22 2022] POST /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:15:23.135759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:23.139836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:23.152768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:23.153835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:23.158771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:23.161025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:23.164438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:23.164438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:23.202301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-48433a4b-f40b-4b42-a5e9-8676022e7ce6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:23.203036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-48433a4b-f40b-4b42-a5e9-8676022e7ce6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:23.220395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48433a4b-f40b-4b42-a5e9-8676022e7ce6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:23.221114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48433a4b-f40b-4b42-a5e9-8676022e7ce6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:23.226221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48433a4b-f40b-4b42-a5e9-8676022e7ce6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:23.226221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48433a4b-f40b-4b42-a5e9-8676022e7ce6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:23.226221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48433a4b-f40b-4b42-a5e9-8676022e7ce6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:23.226221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48433a4b-f40b-4b42-a5e9-8676022e7ce6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:23.367582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:15:23.367983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:15:23.368456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:15:23.368866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:15:23.369301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:15:23.401090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:23.607024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:23.617199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:23.618450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:23.619130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:23.620289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:23.621385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:23.623111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:23.670143 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c8d818ad-03e7-4b65-bce1-2324715e1960 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "POST /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c/action" status: 202 len: 1068 microversion: 2.1 time: 0.537585 Oct 29 01:15:23.671359 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1334/2794] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:15:23 2022] POST /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c/action => generated 1068 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 29 01:15:23.695184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3781d380-f92a-4458-b705-56405f89dc7b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:23.696054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3781d380-f92a-4458-b705-56405f89dc7b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:23.703321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3781d380-f92a-4458-b705-56405f89dc7b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:23.704040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3781d380-f92a-4458-b705-56405f89dc7b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:23.704639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3781d380-f92a-4458-b705-56405f89dc7b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:23.705536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3781d380-f92a-4458-b705-56405f89dc7b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:23.706149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3781d380-f92a-4458-b705-56405f89dc7b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:23.706762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3781d380-f92a-4458-b705-56405f89dc7b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:24.363208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-48433a4b-f40b-4b42-a5e9-8676022e7ce6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:24.405118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-48433a4b-f40b-4b42-a5e9-8676022e7ce6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:24.408180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3781d380-f92a-4458-b705-56405f89dc7b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:24.416891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-48433a4b-f40b-4b42-a5e9-8676022e7ce6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:24.422577 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3781d380-f92a-4458-b705-56405f89dc7b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1472 microversion: 2.1 time: 0.731171 Oct 29 01:15:24.426115 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1335/2795] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:23 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1472 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:24.441557 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-48433a4b-f40b-4b42-a5e9-8676022e7ce6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1892 microversion: 2.42 time: 1.233743 Oct 29 01:15:24.441557 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1461/2796] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:23 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1892 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:24.441557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-addff639-ef4b-4761-8ad4-9ab43b2c9514 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:24.441557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-addff639-ef4b-4761-8ad4-9ab43b2c9514 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:24.452147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-8649f0e9-fcc5-479e-a8dc-b41e797f1847 req-539adc17-904a-4b32-9594-fa648fd51930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfc8b0b3-923e-4144-a9ca-aeb9da2897f7", "name": "network-vif-plugged", "status": "completed", "tag": "0cf4a048-b062-4c55-871f-f69792faebb0"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:24.454920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-addff639-ef4b-4761-8ad4-9ab43b2c9514 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:24.455598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-addff639-ef4b-4761-8ad4-9ab43b2c9514 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:24.457698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-addff639-ef4b-4761-8ad4-9ab43b2c9514 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:24.458635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-addff639-ef4b-4761-8ad4-9ab43b2c9514 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:24.461913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-addff639-ef4b-4761-8ad4-9ab43b2c9514 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:24.462750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-addff639-ef4b-4761-8ad4-9ab43b2c9514 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:24.479262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8649f0e9-fcc5-479e-a8dc-b41e797f1847 req-539adc17-904a-4b32-9594-fa648fd51930 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:24.484036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8649f0e9-fcc5-479e-a8dc-b41e797f1847 req-539adc17-904a-4b32-9594-fa648fd51930 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:24.484679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8649f0e9-fcc5-479e-a8dc-b41e797f1847 req-539adc17-904a-4b32-9594-fa648fd51930 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:24.516357 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-8649f0e9-fcc5-479e-a8dc-b41e797f1847 req-539adc17-904a-4b32-9594-fa648fd51930 service nova] Creating event network-vif-plugged:0cf4a048-b062-4c55-871f-f69792faebb0 for instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 on n-h1-862964-3 Oct 29 01:15:24.525955 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-8649f0e9-fcc5-479e-a8dc-b41e797f1847 req-539adc17-904a-4b32-9594-fa648fd51930 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081770 Oct 29 01:15:24.537597 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1336/2797] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:24.863151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-addff639-ef4b-4761-8ad4-9ab43b2c9514 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:24.876461 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-addff639-ef4b-4761-8ad4-9ab43b2c9514 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1541 microversion: 2.1 time: 0.445162 Oct 29 01:15:24.901430 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1462/2798] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:24 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1541 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:25.463794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1ca4566a-6f02-4f98-b53e-bffdb739e6f0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:25.467329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1ca4566a-6f02-4f98-b53e-bffdb739e6f0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:25.469963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-773f8153-1807-4671-8354-45327030f97e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:25.472998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-773f8153-1807-4671-8354-45327030f97e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:25.498408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ca4566a-6f02-4f98-b53e-bffdb739e6f0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:25.501059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ca4566a-6f02-4f98-b53e-bffdb739e6f0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:25.502044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ca4566a-6f02-4f98-b53e-bffdb739e6f0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:25.503866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-773f8153-1807-4671-8354-45327030f97e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:25.505787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ca4566a-6f02-4f98-b53e-bffdb739e6f0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:25.509300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-773f8153-1807-4671-8354-45327030f97e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:25.517371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ca4566a-6f02-4f98-b53e-bffdb739e6f0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:25.518341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ca4566a-6f02-4f98-b53e-bffdb739e6f0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:25.518834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-773f8153-1807-4671-8354-45327030f97e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:25.519845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-773f8153-1807-4671-8354-45327030f97e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:25.521948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-773f8153-1807-4671-8354-45327030f97e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:25.524369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-773f8153-1807-4671-8354-45327030f97e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:25.906004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:26.102347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:26.260136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-773f8153-1807-4671-8354-45327030f97e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:26.273432 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-773f8153-1807-4671-8354-45327030f97e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1472 microversion: 2.1 time: 0.818552 Oct 29 01:15:26.275794 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1337/2799] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:25 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1472 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:26.291687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f441e3b2-befb-41de-a02c-48d8f9b7966b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:26.302371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f441e3b2-befb-41de-a02c-48d8f9b7966b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:26.308598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f441e3b2-befb-41de-a02c-48d8f9b7966b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:26.309083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f441e3b2-befb-41de-a02c-48d8f9b7966b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:26.315971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f441e3b2-befb-41de-a02c-48d8f9b7966b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:26.316980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f441e3b2-befb-41de-a02c-48d8f9b7966b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:26.317349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f441e3b2-befb-41de-a02c-48d8f9b7966b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:26.317791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f441e3b2-befb-41de-a02c-48d8f9b7966b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:26.342159 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ca4566a-6f02-4f98-b53e-bffdb739e6f0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:26.368918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ca4566a-6f02-4f98-b53e-bffdb739e6f0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:26.371183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ca4566a-6f02-4f98-b53e-bffdb739e6f0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:26.376368 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1ca4566a-6f02-4f98-b53e-bffdb739e6f0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.920770 Oct 29 01:15:26.377816 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1463/2800] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:25 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:26.389245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-fa2db8a0-0217-47d0-b53f-7bc53afcb3cc req-635424d0-2aa9-4341-8962-0cfd10bf043f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "tag": "f39a3550-9b81-4cf3-b84a-f81318c9a9cb"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:26.418853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-fa2db8a0-0217-47d0-b53f-7bc53afcb3cc req-635424d0-2aa9-4341-8962-0cfd10bf043f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:26.423682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-fa2db8a0-0217-47d0-b53f-7bc53afcb3cc req-635424d0-2aa9-4341-8962-0cfd10bf043f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:26.423682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-fa2db8a0-0217-47d0-b53f-7bc53afcb3cc req-635424d0-2aa9-4341-8962-0cfd10bf043f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:26.446168 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-fa2db8a0-0217-47d0-b53f-7bc53afcb3cc req-635424d0-2aa9-4341-8962-0cfd10bf043f service nova] Creating event network-changed:f39a3550-9b81-4cf3-b84a-f81318c9a9cb for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:15:26.462057 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-fa2db8a0-0217-47d0-b53f-7bc53afcb3cc req-635424d0-2aa9-4341-8962-0cfd10bf043f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081055 Oct 29 01:15:26.463133 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1464/2801] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:26.845687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f441e3b2-befb-41de-a02c-48d8f9b7966b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:26.861022 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f441e3b2-befb-41de-a02c-48d8f9b7966b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1523 microversion: 2.1 time: 0.583892 Oct 29 01:15:26.878167 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1338/2802] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:26 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1523 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:26.909025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-22d8e92f-8635-443c-866d-53ad86fe3751 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:26.909728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-22d8e92f-8635-443c-866d-53ad86fe3751 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:26.928694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22d8e92f-8635-443c-866d-53ad86fe3751 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:26.929215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22d8e92f-8635-443c-866d-53ad86fe3751 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:26.929892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22d8e92f-8635-443c-866d-53ad86fe3751 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:26.930627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22d8e92f-8635-443c-866d-53ad86fe3751 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:26.931354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22d8e92f-8635-443c-866d-53ad86fe3751 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:26.931983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22d8e92f-8635-443c-866d-53ad86fe3751 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:26.966525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-22d8e92f-8635-443c-866d-53ad86fe3751 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:15:27.304982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-139b2e90-02d1-4263-a895-21d63de414ac tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:27.306041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-139b2e90-02d1-4263-a895-21d63de414ac tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:27.318601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-139b2e90-02d1-4263-a895-21d63de414ac tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:27.320433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-139b2e90-02d1-4263-a895-21d63de414ac tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:27.321712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-139b2e90-02d1-4263-a895-21d63de414ac tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:27.323327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-139b2e90-02d1-4263-a895-21d63de414ac tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:27.324016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-139b2e90-02d1-4263-a895-21d63de414ac tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:27.324662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-139b2e90-02d1-4263-a895-21d63de414ac tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:27.396584 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-22d8e92f-8635-443c-866d-53ad86fe3751 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 204 len: 0 microversion: 2.1 time: 0.507206 Oct 29 01:15:27.397529 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1465/2803] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:15:26 2022] DELETE /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:15:27.407212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e2155588-9bef-42ff-acd7-2818c6799584 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:27.408021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e2155588-9bef-42ff-acd7-2818c6799584 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:27.425950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2155588-9bef-42ff-acd7-2818c6799584 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:27.426666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2155588-9bef-42ff-acd7-2818c6799584 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:27.428143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2155588-9bef-42ff-acd7-2818c6799584 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:27.429125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2155588-9bef-42ff-acd7-2818c6799584 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:27.430085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2155588-9bef-42ff-acd7-2818c6799584 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:27.430848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2155588-9bef-42ff-acd7-2818c6799584 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:27.868741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-139b2e90-02d1-4263-a895-21d63de414ac tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:27.880599 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-139b2e90-02d1-4263-a895-21d63de414ac tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1472 microversion: 2.1 time: 0.581601 Oct 29 01:15:27.881924 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1339/2804] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:27 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1472 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:27.895641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9b0f8e51-04c0-4828-9d12-0984753b1cf8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:27.899114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9b0f8e51-04c0-4828-9d12-0984753b1cf8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:27.911317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b0f8e51-04c0-4828-9d12-0984753b1cf8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:27.911589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e2155588-9bef-42ff-acd7-2818c6799584 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:27.913403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b0f8e51-04c0-4828-9d12-0984753b1cf8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:27.914332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b0f8e51-04c0-4828-9d12-0984753b1cf8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:27.916314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b0f8e51-04c0-4828-9d12-0984753b1cf8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:27.917138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b0f8e51-04c0-4828-9d12-0984753b1cf8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:27.918055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b0f8e51-04c0-4828-9d12-0984753b1cf8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:27.929208 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e2155588-9bef-42ff-acd7-2818c6799584 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1529 microversion: 2.1 time: 0.526869 Oct 29 01:15:27.947857 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1466/2805] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:27 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1529 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:27.958919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-331615c0-12e8-4b7f-9974-65e51fa22b0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:27.959713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-331615c0-12e8-4b7f-9974-65e51fa22b0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:27.971806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-331615c0-12e8-4b7f-9974-65e51fa22b0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:27.982335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-331615c0-12e8-4b7f-9974-65e51fa22b0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:27.983212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-331615c0-12e8-4b7f-9974-65e51fa22b0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:27.984172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-331615c0-12e8-4b7f-9974-65e51fa22b0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:27.984843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-331615c0-12e8-4b7f-9974-65e51fa22b0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:27.985579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-331615c0-12e8-4b7f-9974-65e51fa22b0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:28.007006 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-331615c0-12e8-4b7f-9974-65e51fa22b0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-331615c0-12e8-4b7f-9974-65e51fa22b0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 HTTP/1.1 Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'ba5e830e-0f0f-4f57-93c4-a42dcd3a3003'} Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:28.008962 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:28.013229 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:15:28.013229 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.013229 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:28.013229 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.013229 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:28.013229 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:28.013229 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:28.013229 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:28.013229 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:28.013229 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:15:28.013229 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.014279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-331615c0-12e8-4b7f-9974-65e51fa22b0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:28.016063 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-331615c0-12e8-4b7f-9974-65e51fa22b0a tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 404 len: 111 microversion: 2.1 time: 0.061211 Oct 29 01:15:28.019693 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1467/2806] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:15:27 2022] DELETE /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:15:28.029127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b0ae9e88-4042-4746-a773-a63ba92e02b4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:28.030741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b0ae9e88-4042-4746-a773-a63ba92e02b4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: ba5e830e-0f0f-4f57-93c4-a42dcd3a3003] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:28.038552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0ae9e88-4042-4746-a773-a63ba92e02b4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:28.039043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0ae9e88-4042-4746-a773-a63ba92e02b4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:28.039668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0ae9e88-4042-4746-a773-a63ba92e02b4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:28.040592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0ae9e88-4042-4746-a773-a63ba92e02b4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:28.041262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0ae9e88-4042-4746-a773-a63ba92e02b4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:28.042633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0ae9e88-4042-4746-a773-a63ba92e02b4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:28.083429 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-b0ae9e88-4042-4746-a773-a63ba92e02b4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b0ae9e88-4042-4746-a773-a63ba92e02b4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 HTTP/1.1 Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'ba5e830e-0f0f-4f57-93c4-a42dcd3a3003'} Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:28.086821 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.095676 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:28.095676 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:28.095676 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:28.095676 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:28.095676 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:28.095676 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. Oct 29 01:15:28.095676 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.095676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b0ae9e88-4042-4746-a773-a63ba92e02b4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:28.098757 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b0ae9e88-4042-4746-a773-a63ba92e02b4 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003" status: 404 len: 111 microversion: 2.1 time: 0.064330 Oct 29 01:15:28.099951 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1468/2807] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:28 2022] GET /compute/v2.1/servers/ba5e830e-0f0f-4f57-93c4-a42dcd3a3003 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:28.114542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-77da2ed0-7ba0-42b2-b27d-74ba2c3cb840 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:28.115371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-77da2ed0-7ba0-42b2-b27d-74ba2c3cb840 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:28.118075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:28.140963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77da2ed0-7ba0-42b2-b27d-74ba2c3cb840 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:28.142857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77da2ed0-7ba0-42b2-b27d-74ba2c3cb840 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:28.144009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77da2ed0-7ba0-42b2-b27d-74ba2c3cb840 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:28.151948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77da2ed0-7ba0-42b2-b27d-74ba2c3cb840 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:28.157838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77da2ed0-7ba0-42b2-b27d-74ba2c3cb840 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:28.157838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77da2ed0-7ba0-42b2-b27d-74ba2c3cb840 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:28.183764 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-77da2ed0-7ba0-42b2-b27d-74ba2c3cb840 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 could not be found. Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-77da2ed0-7ba0-42b2-b27d-74ba2c3cb840 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 HTTP/1.1 Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 could not be found. Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165'} Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 could not be found. Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:28.186521 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:28.193858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 could not be found. Oct 29 01:15:28.193858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.193858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:28.193858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.193858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:28.193858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:28.193858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:28.193858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:28.193858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:28.193858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 could not be found. Oct 29 01:15:28.193858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.193858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-77da2ed0-7ba0-42b2-b27d-74ba2c3cb840 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:28.193858 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-77da2ed0-7ba0-42b2-b27d-74ba2c3cb840 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "DELETE /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 404 len: 111 microversion: 2.1 time: 0.082533 Oct 29 01:15:28.193858 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1469/2808] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:15:28 2022] DELETE /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:28.203075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-960ffa16-42b4-4044-b17f-d8845b530363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:28.203932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-960ffa16-42b4-4044-b17f-d8845b530363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] [instance: 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:28.211756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-960ffa16-42b4-4044-b17f-d8845b530363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:28.212747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-960ffa16-42b4-4044-b17f-d8845b530363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:28.213440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-960ffa16-42b4-4044-b17f-d8845b530363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:28.218660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-960ffa16-42b4-4044-b17f-d8845b530363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:28.218660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-960ffa16-42b4-4044-b17f-d8845b530363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:28.218660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-960ffa16-42b4-4044-b17f-d8845b530363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:28.252619 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-960ffa16-42b4-4044-b17f-d8845b530363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] HTTP exception thrown: Instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 could not be found. Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-960ffa16-42b4-4044-b17f-d8845b530363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Request method failure captured: Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 HTTP/1.1 Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH1IesAHA1_7WgYfY2_T-6e74XmAa9Zjg7ShCO11nAfSDoDWq8nBhH-Yn0OwBNX6PDTsTUk2i7wC3IwCnW0BLdbMGxo2Fks38eC3vIgmN9JOUrd3r-curamqugt8ZxCtogPiyd9AIjCYtBhmSoTmktQMvaoHOdtF64MyHzy1FIXv45w Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f421c64f9b2f49ebab46d9f8a28143d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f421c64f9b2f49ebab46d9f8a28143d6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f421c64f9b2f49ebab46d9f8a28143d6 Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212712855 Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 4ae0a54f51ad4813b312baf3a03ba172 Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersTestJSON-1212712855-project Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 could not be found. Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165'} Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 could not be found. Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 could not be found. Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:28.254549 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.259115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:28.259115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:28.259115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:28.259115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:28.259115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:28.259115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 could not be found. Oct 29 01:15:28.259115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:28.260898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-960ffa16-42b4-4044-b17f-d8845b530363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] Returning 404 to user: Instance 90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:28.262438 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-960ffa16-42b4-4044-b17f-d8845b530363 tempest-DeleteServersTestJSON-1212712855 tempest-DeleteServersTestJSON-1212712855-project] 10.222.0.26 "GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165" status: 404 len: 111 microversion: 2.1 time: 0.065888 Oct 29 01:15:28.263605 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1470/2809] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:28 2022] GET /compute/v2.1/servers/90eb0e7f-0f4c-4b36-a1f2-77a2e4de4165 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:28.910448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1023230f-4e66-49ed-8ad7-cc50772f6e58 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:28.911298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1023230f-4e66-49ed-8ad7-cc50772f6e58 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:28.913588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:28.928559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1023230f-4e66-49ed-8ad7-cc50772f6e58 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:28.936216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1023230f-4e66-49ed-8ad7-cc50772f6e58 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:28.936216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1023230f-4e66-49ed-8ad7-cc50772f6e58 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:28.936216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1023230f-4e66-49ed-8ad7-cc50772f6e58 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:28.936216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1023230f-4e66-49ed-8ad7-cc50772f6e58 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:28.936216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1023230f-4e66-49ed-8ad7-cc50772f6e58 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:28.988118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9b0f8e51-04c0-4828-9d12-0984753b1cf8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:29.022586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9b0f8e51-04c0-4828-9d12-0984753b1cf8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:29.031008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9b0f8e51-04c0-4828-9d12-0984753b1cf8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:29.034927 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9b0f8e51-04c0-4828-9d12-0984753b1cf8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 1.150661 Oct 29 01:15:29.036403 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1340/2810] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:27 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:29.052701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b7fd1b35-107d-41f3-af4f-5f18ef722fa8 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:29.057132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b7fd1b35-107d-41f3-af4f-5f18ef722fa8 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:29.078928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7fd1b35-107d-41f3-af4f-5f18ef722fa8 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:29.078928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7fd1b35-107d-41f3-af4f-5f18ef722fa8 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:29.078928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7fd1b35-107d-41f3-af4f-5f18ef722fa8 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:29.078928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7fd1b35-107d-41f3-af4f-5f18ef722fa8 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:29.083134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7fd1b35-107d-41f3-af4f-5f18ef722fa8 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:29.084141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7fd1b35-107d-41f3-af4f-5f18ef722fa8 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:29.495830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1023230f-4e66-49ed-8ad7-cc50772f6e58 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:29.507702 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1023230f-4e66-49ed-8ad7-cc50772f6e58 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1472 microversion: 2.1 time: 0.601482 Oct 29 01:15:29.524014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b7fd1b35-107d-41f3-af4f-5f18ef722fa8 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:29.540470 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1471/2811] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:28 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1472 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:29.579247 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b7fd1b35-107d-41f3-af4f-5f18ef722fa8 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1529 microversion: 2.1 time: 0.532328 Oct 29 01:15:29.579935 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1341/2812] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:29 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1529 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:29.826838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-f15bc998-cff1-4773-8bd7-09035168e5b1 req-6fe9e5a8-6a66-4afb-ae04-b848ca9854a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "tag": "913a07b9-ad16-4d31-879a-a34b9897edf8"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:29.846922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f15bc998-cff1-4773-8bd7-09035168e5b1 req-6fe9e5a8-6a66-4afb-ae04-b848ca9854a1 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:29.847392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f15bc998-cff1-4773-8bd7-09035168e5b1 req-6fe9e5a8-6a66-4afb-ae04-b848ca9854a1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:29.847842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f15bc998-cff1-4773-8bd7-09035168e5b1 req-6fe9e5a8-6a66-4afb-ae04-b848ca9854a1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:29.867100 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-f15bc998-cff1-4773-8bd7-09035168e5b1 req-6fe9e5a8-6a66-4afb-ae04-b848ca9854a1 service nova] Creating event network-changed:913a07b9-ad16-4d31-879a-a34b9897edf8 for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:15:29.883054 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-f15bc998-cff1-4773-8bd7-09035168e5b1 req-6fe9e5a8-6a66-4afb-ae04-b848ca9854a1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070281 Oct 29 01:15:29.884433 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1472/2813] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:30.068321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5ae52646-7c8d-4ad8-b534-cebeca4bd44c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:30.070611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5ae52646-7c8d-4ad8-b534-cebeca4bd44c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:30.096110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ae52646-7c8d-4ad8-b534-cebeca4bd44c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:30.097263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ae52646-7c8d-4ad8-b534-cebeca4bd44c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:30.098585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ae52646-7c8d-4ad8-b534-cebeca4bd44c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:30.099751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ae52646-7c8d-4ad8-b534-cebeca4bd44c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:30.100403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ae52646-7c8d-4ad8-b534-cebeca4bd44c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:30.101410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ae52646-7c8d-4ad8-b534-cebeca4bd44c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:30.139642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-93872aea-e56c-4f5c-be4f-3c3f2d97c5f8 req-94d4ee8e-f91d-4878-bd06-4bb29116bf57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfc8b0b3-923e-4144-a9ca-aeb9da2897f7", "name": "network-vif-unplugged", "status": "completed", "tag": "0cf4a048-b062-4c55-871f-f69792faebb0"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:30.158031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-93872aea-e56c-4f5c-be4f-3c3f2d97c5f8 req-94d4ee8e-f91d-4878-bd06-4bb29116bf57 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:30.160282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-93872aea-e56c-4f5c-be4f-3c3f2d97c5f8 req-94d4ee8e-f91d-4878-bd06-4bb29116bf57 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:30.165935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-93872aea-e56c-4f5c-be4f-3c3f2d97c5f8 req-94d4ee8e-f91d-4878-bd06-4bb29116bf57 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:30.189504 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-93872aea-e56c-4f5c-be4f-3c3f2d97c5f8 req-94d4ee8e-f91d-4878-bd06-4bb29116bf57 service nova] Creating event network-vif-unplugged:0cf4a048-b062-4c55-871f-f69792faebb0 for instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 on n-h1-862964-3 Oct 29 01:15:30.200433 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-93872aea-e56c-4f5c-be4f-3c3f2d97c5f8 req-94d4ee8e-f91d-4878-bd06-4bb29116bf57 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066368 Oct 29 01:15:30.213359 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1473/2814] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:15:30.562148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-93194756-2e55-4373-91a7-03fd3cee8a02 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:30.563294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-93194756-2e55-4373-91a7-03fd3cee8a02 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:30.573907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93194756-2e55-4373-91a7-03fd3cee8a02 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:30.575928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93194756-2e55-4373-91a7-03fd3cee8a02 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:30.576791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93194756-2e55-4373-91a7-03fd3cee8a02 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:30.578447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93194756-2e55-4373-91a7-03fd3cee8a02 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:30.579265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93194756-2e55-4373-91a7-03fd3cee8a02 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:30.579912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93194756-2e55-4373-91a7-03fd3cee8a02 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:30.616532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5ae52646-7c8d-4ad8-b534-cebeca4bd44c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:30.631828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5ae52646-7c8d-4ad8-b534-cebeca4bd44c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:30.633324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5ae52646-7c8d-4ad8-b534-cebeca4bd44c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:30.636650 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5ae52646-7c8d-4ad8-b534-cebeca4bd44c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.574248 Oct 29 01:15:30.639872 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1342/2815] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:30 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:30.658017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-57927f42-48aa-4e58-8a75-383ec41546b9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:30.659900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-57927f42-48aa-4e58-8a75-383ec41546b9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:30.676714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57927f42-48aa-4e58-8a75-383ec41546b9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:30.678028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57927f42-48aa-4e58-8a75-383ec41546b9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:30.679570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57927f42-48aa-4e58-8a75-383ec41546b9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:30.681925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57927f42-48aa-4e58-8a75-383ec41546b9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:30.682631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57927f42-48aa-4e58-8a75-383ec41546b9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:30.690381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57927f42-48aa-4e58-8a75-383ec41546b9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:31.139891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-57927f42-48aa-4e58-8a75-383ec41546b9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:31.157266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-93194756-2e55-4373-91a7-03fd3cee8a02 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:31.167733 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-93194756-2e55-4373-91a7-03fd3cee8a02 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1472 microversion: 2.1 time: 0.611485 Oct 29 01:15:31.168262 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1474/2816] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:30 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1472 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:31.170913 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-57927f42-48aa-4e58-8a75-383ec41546b9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 200 len: 1529 microversion: 2.1 time: 0.529711 Oct 29 01:15:31.171498 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1343/2817] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:30 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 1529 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:31.311528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-949d3a00-dfb3-47c2-a620-b5a5d434b138 req-fa919996-1d1c-49cd-8d50-044d94508388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfc8b0b3-923e-4144-a9ca-aeb9da2897f7", "name": "network-vif-deleted", "tag": "0cf4a048-b062-4c55-871f-f69792faebb0"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:31.349752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-949d3a00-dfb3-47c2-a620-b5a5d434b138 req-fa919996-1d1c-49cd-8d50-044d94508388 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:31.350225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-949d3a00-dfb3-47c2-a620-b5a5d434b138 req-fa919996-1d1c-49cd-8d50-044d94508388 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:31.352778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-949d3a00-dfb3-47c2-a620-b5a5d434b138 req-fa919996-1d1c-49cd-8d50-044d94508388 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:31.388011 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-949d3a00-dfb3-47c2-a620-b5a5d434b138 req-fa919996-1d1c-49cd-8d50-044d94508388 service nova] Creating event network-vif-deleted:0cf4a048-b062-4c55-871f-f69792faebb0 for instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 on n-h1-862964-3 Oct 29 01:15:31.400437 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-949d3a00-dfb3-47c2-a620-b5a5d434b138 req-fa919996-1d1c-49cd-8d50-044d94508388 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092892 Oct 29 01:15:31.403819 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1344/2818] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:31.416236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1e4056a7-406e-458b-bd7a-bd6a908c0d62 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-303019612", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:31.525213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-1e4056a7-406e-458b-bd7a-bd6a908c0d62 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] validate_networks() for [('eb1e4b43-f38b-43e7-af11-a5ae719fd6c0', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:15:31.669957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4c59cda8-d78c-4dfa-b6b1-d1d94dcc2991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:31.672672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4c59cda8-d78c-4dfa-b6b1-d1d94dcc2991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:31.690488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c59cda8-d78c-4dfa-b6b1-d1d94dcc2991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:31.693278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c59cda8-d78c-4dfa-b6b1-d1d94dcc2991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:31.699381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c59cda8-d78c-4dfa-b6b1-d1d94dcc2991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:31.703550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c59cda8-d78c-4dfa-b6b1-d1d94dcc2991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:31.704481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c59cda8-d78c-4dfa-b6b1-d1d94dcc2991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:31.705710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c59cda8-d78c-4dfa-b6b1-d1d94dcc2991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:32.264599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4c59cda8-d78c-4dfa-b6b1-d1d94dcc2991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:32.277320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4c59cda8-d78c-4dfa-b6b1-d1d94dcc2991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:32.291078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4c59cda8-d78c-4dfa-b6b1-d1d94dcc2991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:32.292621 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4c59cda8-d78c-4dfa-b6b1-d1d94dcc2991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.628836 Oct 29 01:15:32.293281 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1345/2819] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:31 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:32.298514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e0d35f8c-e908-438c-85f6-d098c8ad0b53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:32.303115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e0d35f8c-e908-438c-85f6-d098c8ad0b53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:32.326493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0d35f8c-e908-438c-85f6-d098c8ad0b53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:32.328891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0d35f8c-e908-438c-85f6-d098c8ad0b53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:32.329710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0d35f8c-e908-438c-85f6-d098c8ad0b53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:32.334449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0d35f8c-e908-438c-85f6-d098c8ad0b53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:32.335260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0d35f8c-e908-438c-85f6-d098c8ad0b53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:32.336606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0d35f8c-e908-438c-85f6-d098c8ad0b53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:32.656133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=14 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:32.996136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e0d35f8c-e908-438c-85f6-d098c8ad0b53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:33.015400 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e0d35f8c-e908-438c-85f6-d098c8ad0b53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1472 microversion: 2.1 time: 0.710830 Oct 29 01:15:33.026003 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1346/2820] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:32 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1472 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:33.044649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fa99cbf6-8419-43e0-adde-2fd546118bf4 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:33.046781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fa99cbf6-8419-43e0-adde-2fd546118bf4 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:33.075762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa99cbf6-8419-43e0-adde-2fd546118bf4 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:33.075762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa99cbf6-8419-43e0-adde-2fd546118bf4 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:33.075762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa99cbf6-8419-43e0-adde-2fd546118bf4 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:33.075762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa99cbf6-8419-43e0-adde-2fd546118bf4 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:33.075762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa99cbf6-8419-43e0-adde-2fd546118bf4 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:33.075762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa99cbf6-8419-43e0-adde-2fd546118bf4 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:33.106712 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-fa99cbf6-8419-43e0-adde-2fd546118bf4 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] HTTP exception thrown: Instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 could not be found. Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fa99cbf6-8419-43e0-adde-2fd546118bf4 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Request method failure captured: Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 HTTP/1.1 Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH6CzaWy1ufa72id6aheZbBREgQ1G2SbUhEpvcj_QTDF--UNn0kMcxBhslM6smsky4izROjyCZSxF91rcQGlVQlVrhfbQfHOyxM9K_r3ikSiecmNSXh8mpJTcen08ouic-cdYaYkhVKjr1CpS6bd1t3acwqY6OPH7aEAkOLl4egaxt8 Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_328d1dd53c6a4bc2b14376dd1a1cecb6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: b89f11ebd96141a5afe08dad79b0b20c Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 could not be found. Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'cfc8b0b3-923e-4144-a9ca-aeb9da2897f7'} Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 could not be found. Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 could not be found. Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:33.108657 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:33.112574 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:33.112574 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:33.112574 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:33.112574 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:33.112574 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:33.112574 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:33.112574 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 could not be found. Oct 29 01:15:33.112574 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:15:33.113035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1e4056a7-406e-458b-bd7a-bd6a908c0d62 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:15:33.113035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1e4056a7-406e-458b-bd7a-bd6a908c0d62 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:15:33.113035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1e4056a7-406e-458b-bd7a-bd6a908c0d62 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:15:33.113035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1e4056a7-406e-458b-bd7a-bd6a908c0d62 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:15:33.113035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1e4056a7-406e-458b-bd7a-bd6a908c0d62 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:15:33.114848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fa99cbf6-8419-43e0-adde-2fd546118bf4 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Returning 404 to user: Instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:33.120631 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fa99cbf6-8419-43e0-adde-2fd546118bf4 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 404 len: 111 microversion: 2.1 time: 0.093378 Oct 29 01:15:33.121709 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1347/2821] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:33 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:15:33.144690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e4056a7-406e-458b-bd7a-bd6a908c0d62 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:33.150900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e4056a7-406e-458b-bd7a-bd6a908c0d62 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:33.150900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e4056a7-406e-458b-bd7a-bd6a908c0d62 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:33.153058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e4056a7-406e-458b-bd7a-bd6a908c0d62 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:33.163852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e4056a7-406e-458b-bd7a-bd6a908c0d62 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:33.167610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-373081f6-6add-4b54-9d28-02e9759f3727 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Action: 'create', calling method: .version_select at 0x7f9d97d99c10>, body: {"keypair": {"name": "tempest-keypair-79084493", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLGct5iHFmIztoW5xKxHwWImpurK9SZdssTqKqzvhtCj+WRJ32mmCLMowpf8O12DF/N47WOGV7UIjXIeInLMceC67T/tXdrKDDvNvbxJMaUXcQs7mlTlLHbX1CS9/0FVg=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:33.171276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e4056a7-406e-458b-bd7a-bd6a908c0d62 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:33.218159 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-373081f6-6add-4b54-9d28-02e9759f3727 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Getting quotas for project 328d1dd53c6a4bc2b14376dd1a1cecb6. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:15:33.232695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-373081f6-6add-4b54-9d28-02e9759f3727 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Getting quotas for user b89f11ebd96141a5afe08dad79b0b20c and project 328d1dd53c6a4bc2b14376dd1a1cecb6. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:15:33.294996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-1e4056a7-406e-458b-bd7a-bd6a908c0d62 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Getting quotas for project 1de00f139aa846cbb6147e9c1ce282b8. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:15:33.316443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-1e4056a7-406e-458b-bd7a-bd6a908c0d62 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Getting quotas for user db6907e28b7e4c078e13c92e27e1030d and project 1de00f139aa846cbb6147e9c1ce282b8. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:15:33.369130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1e4056a7-406e-458b-bd7a-bd6a908c0d62 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:15:33.372865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1e4056a7-406e-458b-bd7a-bd6a908c0d62 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:15:33.393021 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-373081f6-6add-4b54-9d28-02e9759f3727 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.257092 Oct 29 01:15:33.405709 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1348/2822] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:15:33 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:33.428986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c81a9a85-72d5-4f7b-93dd-a0eabd6b33d1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:33.429819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c81a9a85-72d5-4f7b-93dd-a0eabd6b33d1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:33.438438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:33.465443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c81a9a85-72d5-4f7b-93dd-a0eabd6b33d1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:33.466921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c81a9a85-72d5-4f7b-93dd-a0eabd6b33d1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:33.467926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c81a9a85-72d5-4f7b-93dd-a0eabd6b33d1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:33.469115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c81a9a85-72d5-4f7b-93dd-a0eabd6b33d1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:33.469967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c81a9a85-72d5-4f7b-93dd-a0eabd6b33d1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:33.471149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c81a9a85-72d5-4f7b-93dd-a0eabd6b33d1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:33.589871 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1e4056a7-406e-458b-bd7a-bd6a908c0d62 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.416080 Oct 29 01:15:33.591177 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1475/2823] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:15:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 2422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:15:33.609621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-969d2a53-0507-4387-8997-582b88873f0b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:33.610634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-969d2a53-0507-4387-8997-582b88873f0b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:33.765740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-969d2a53-0507-4387-8997-582b88873f0b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:33.775295 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-969d2a53-0507-4387-8997-582b88873f0b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1222 microversion: 2.1 time: 0.175729 Oct 29 01:15:33.777374 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1476/2824] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:33 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1222 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:34.038799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2ef8fb2d-fa9e-4b4c-bd0e-29f882fb94e0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:34.039426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2ef8fb2d-fa9e-4b4c-bd0e-29f882fb94e0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:34.054271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ef8fb2d-fa9e-4b4c-bd0e-29f882fb94e0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:34.054779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ef8fb2d-fa9e-4b4c-bd0e-29f882fb94e0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:34.060076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ef8fb2d-fa9e-4b4c-bd0e-29f882fb94e0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:34.073129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ef8fb2d-fa9e-4b4c-bd0e-29f882fb94e0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:34.073658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ef8fb2d-fa9e-4b4c-bd0e-29f882fb94e0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:34.074107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ef8fb2d-fa9e-4b4c-bd0e-29f882fb94e0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:34.754135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c81a9a85-72d5-4f7b-93dd-a0eabd6b33d1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:34.781064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c81a9a85-72d5-4f7b-93dd-a0eabd6b33d1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:34.783724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c81a9a85-72d5-4f7b-93dd-a0eabd6b33d1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:34.785750 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c81a9a85-72d5-4f7b-93dd-a0eabd6b33d1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 1.378366 Oct 29 01:15:34.786957 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1349/2825] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:33 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:34.792580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-dfe20221-e5c1-47d5-bba6-7c649acb2495 req-63b75482-0c9b-4dee-a6c1-4e89ec6daa63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "tag": "e7524267-ec12-4093-8a7b-fe4b7e069f3a"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:34.807444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-dfe20221-e5c1-47d5-bba6-7c649acb2495 req-63b75482-0c9b-4dee-a6c1-4e89ec6daa63 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:34.808101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-dfe20221-e5c1-47d5-bba6-7c649acb2495 req-63b75482-0c9b-4dee-a6c1-4e89ec6daa63 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:34.808814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-dfe20221-e5c1-47d5-bba6-7c649acb2495 req-63b75482-0c9b-4dee-a6c1-4e89ec6daa63 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:34.836038 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-dfe20221-e5c1-47d5-bba6-7c649acb2495 req-63b75482-0c9b-4dee-a6c1-4e89ec6daa63 service nova] Creating event network-changed:e7524267-ec12-4093-8a7b-fe4b7e069f3a for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:15:34.839860 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-dfe20221-e5c1-47d5-bba6-7c649acb2495 req-63b75482-0c9b-4dee-a6c1-4e89ec6daa63 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050841 Oct 29 01:15:34.840908 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1350/2826] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:34.847531 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a4ea1f3f-48e6-4dd9-91b5-086b5844a8a5 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:34.848481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a4ea1f3f-48e6-4dd9-91b5-086b5844a8a5 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:34.869376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2ef8fb2d-fa9e-4b4c-bd0e-29f882fb94e0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:34.884784 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2ef8fb2d-fa9e-4b4c-bd0e-29f882fb94e0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1472 microversion: 2.1 time: 0.844450 Oct 29 01:15:34.886897 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1477/2827] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:34 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1472 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:35.056945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a4ea1f3f-48e6-4dd9-91b5-086b5844a8a5 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:35.075342 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a4ea1f3f-48e6-4dd9-91b5-086b5844a8a5 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1222 microversion: 2.1 time: 0.232611 Oct 29 01:15:35.075966 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1351/2828] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:34 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1222 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:35.819042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1e2f844f-4564-4a61-8472-79e6a5b84310 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:35.819669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1e2f844f-4564-4a61-8472-79e6a5b84310 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:35.835127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e2f844f-4564-4a61-8472-79e6a5b84310 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:35.835628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e2f844f-4564-4a61-8472-79e6a5b84310 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:35.836073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e2f844f-4564-4a61-8472-79e6a5b84310 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:35.836883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e2f844f-4564-4a61-8472-79e6a5b84310 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:35.837387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e2f844f-4564-4a61-8472-79e6a5b84310 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:35.838459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e2f844f-4564-4a61-8472-79e6a5b84310 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:35.911848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-22baddc4-a818-44d2-81c6-957bf010cb4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:35.912622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-22baddc4-a818-44d2-81c6-957bf010cb4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:35.923228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22baddc4-a818-44d2-81c6-957bf010cb4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:35.925898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22baddc4-a818-44d2-81c6-957bf010cb4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:35.929651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22baddc4-a818-44d2-81c6-957bf010cb4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:35.930797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22baddc4-a818-44d2-81c6-957bf010cb4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:35.931291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22baddc4-a818-44d2-81c6-957bf010cb4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:35.933632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22baddc4-a818-44d2-81c6-957bf010cb4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:36.547088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-22baddc4-a818-44d2-81c6-957bf010cb4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:36.579576 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-22baddc4-a818-44d2-81c6-957bf010cb4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1472 microversion: 2.1 time: 0.672916 Oct 29 01:15:36.582480 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1352/2829] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:35 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1472 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:36.597143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-156cea0a-9b5d-4eb3-b3c9-d2320ebfe560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:36.606021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-156cea0a-9b5d-4eb3-b3c9-d2320ebfe560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:36.621064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-156cea0a-9b5d-4eb3-b3c9-d2320ebfe560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:36.625115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-156cea0a-9b5d-4eb3-b3c9-d2320ebfe560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:36.630877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-156cea0a-9b5d-4eb3-b3c9-d2320ebfe560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:36.631881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-156cea0a-9b5d-4eb3-b3c9-d2320ebfe560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:36.636382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-156cea0a-9b5d-4eb3-b3c9-d2320ebfe560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:36.637203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-156cea0a-9b5d-4eb3-b3c9-d2320ebfe560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:36.742894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1e2f844f-4564-4a61-8472-79e6a5b84310 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:36.758838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1e2f844f-4564-4a61-8472-79e6a5b84310 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:36.760531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1e2f844f-4564-4a61-8472-79e6a5b84310 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:36.761951 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1e2f844f-4564-4a61-8472-79e6a5b84310 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.946988 Oct 29 01:15:36.767841 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1478/2830] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:35 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:36.860616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-156cea0a-9b5d-4eb3-b3c9-d2320ebfe560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:36.877810 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-156cea0a-9b5d-4eb3-b3c9-d2320ebfe560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1274 microversion: 2.1 time: 0.293853 Oct 29 01:15:36.878739 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1353/2831] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:36 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1274 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:37.611611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-66053b5c-0a61-41ac-aba4-a03e64aed5fb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:37.612499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-66053b5c-0a61-41ac-aba4-a03e64aed5fb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:37.632448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66053b5c-0a61-41ac-aba4-a03e64aed5fb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:37.633455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66053b5c-0a61-41ac-aba4-a03e64aed5fb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:37.634164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66053b5c-0a61-41ac-aba4-a03e64aed5fb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:37.635138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66053b5c-0a61-41ac-aba4-a03e64aed5fb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:37.635802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66053b5c-0a61-41ac-aba4-a03e64aed5fb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:37.636231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66053b5c-0a61-41ac-aba4-a03e64aed5fb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:37.700396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:37.799991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fae3264c-1b32-4c4b-8deb-cbdec2c18794 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:37.809399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fae3264c-1b32-4c4b-8deb-cbdec2c18794 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:37.821076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fae3264c-1b32-4c4b-8deb-cbdec2c18794 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:37.821574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fae3264c-1b32-4c4b-8deb-cbdec2c18794 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:37.823324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fae3264c-1b32-4c4b-8deb-cbdec2c18794 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:37.823324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fae3264c-1b32-4c4b-8deb-cbdec2c18794 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:37.823324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fae3264c-1b32-4c4b-8deb-cbdec2c18794 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:37.823630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fae3264c-1b32-4c4b-8deb-cbdec2c18794 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:38.065317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:38.218201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-66053b5c-0a61-41ac-aba4-a03e64aed5fb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:38.226429 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-66053b5c-0a61-41ac-aba4-a03e64aed5fb tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1478 microversion: 2.1 time: 0.621604 Oct 29 01:15:38.237194 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1479/2832] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:37 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1478 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:38.237194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-658a1284-183f-468b-b329-5b216e2dfbca tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:38.237194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-658a1284-183f-468b-b329-5b216e2dfbca tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:38.249605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-658a1284-183f-468b-b329-5b216e2dfbca tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:38.250116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-658a1284-183f-468b-b329-5b216e2dfbca tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:38.250716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-658a1284-183f-468b-b329-5b216e2dfbca tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:38.251694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-658a1284-183f-468b-b329-5b216e2dfbca tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:38.252387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-658a1284-183f-468b-b329-5b216e2dfbca tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:38.253033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-658a1284-183f-468b-b329-5b216e2dfbca tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:38.388604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fae3264c-1b32-4c4b-8deb-cbdec2c18794 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:38.398347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-658a1284-183f-468b-b329-5b216e2dfbca tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:38.401861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fae3264c-1b32-4c4b-8deb-cbdec2c18794 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:38.403863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fae3264c-1b32-4c4b-8deb-cbdec2c18794 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:38.404963 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fae3264c-1b32-4c4b-8deb-cbdec2c18794 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.611625 Oct 29 01:15:38.406543 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1354/2833] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:37 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:38.409839 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-658a1284-183f-468b-b329-5b216e2dfbca tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1280 microversion: 2.1 time: 0.181399 Oct 29 01:15:38.414639 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1480/2834] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:38 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1280 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:38.436272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-86a598c8-eb19-4c58-9321-312cc399651f req-b1f134ab-8266-40bc-b2d2-9aa747028c00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "tag": "1848d527-bac1-41c8-956e-7737379b67ca"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:38.460148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-86a598c8-eb19-4c58-9321-312cc399651f req-b1f134ab-8266-40bc-b2d2-9aa747028c00 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:38.466666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-86a598c8-eb19-4c58-9321-312cc399651f req-b1f134ab-8266-40bc-b2d2-9aa747028c00 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:38.467298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-86a598c8-eb19-4c58-9321-312cc399651f req-b1f134ab-8266-40bc-b2d2-9aa747028c00 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:38.497439 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-86a598c8-eb19-4c58-9321-312cc399651f req-b1f134ab-8266-40bc-b2d2-9aa747028c00 service nova] Creating event network-changed:1848d527-bac1-41c8-956e-7737379b67ca for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:15:38.503391 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-86a598c8-eb19-4c58-9321-312cc399651f req-b1f134ab-8266-40bc-b2d2-9aa747028c00 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081542 Oct 29 01:15:38.504838 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1355/2835] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:39.255824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-05547cc2-e833-4c0d-9068-6ec0dd87561e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:39.256448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-05547cc2-e833-4c0d-9068-6ec0dd87561e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:39.275382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05547cc2-e833-4c0d-9068-6ec0dd87561e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:39.280317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05547cc2-e833-4c0d-9068-6ec0dd87561e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:39.280998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05547cc2-e833-4c0d-9068-6ec0dd87561e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:39.283294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05547cc2-e833-4c0d-9068-6ec0dd87561e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:39.288570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05547cc2-e833-4c0d-9068-6ec0dd87561e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:39.290468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05547cc2-e833-4c0d-9068-6ec0dd87561e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:39.438879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-029b5bd7-65ba-4328-aebf-98c6c512f92b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:39.441019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-029b5bd7-65ba-4328-aebf-98c6c512f92b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:39.460436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-029b5bd7-65ba-4328-aebf-98c6c512f92b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:39.463249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-029b5bd7-65ba-4328-aebf-98c6c512f92b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:39.465322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-029b5bd7-65ba-4328-aebf-98c6c512f92b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:39.468011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-029b5bd7-65ba-4328-aebf-98c6c512f92b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:39.468750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-029b5bd7-65ba-4328-aebf-98c6c512f92b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:39.469708 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-029b5bd7-65ba-4328-aebf-98c6c512f92b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:40.098840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-029b5bd7-65ba-4328-aebf-98c6c512f92b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:40.111860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-029b5bd7-65ba-4328-aebf-98c6c512f92b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:40.114263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-029b5bd7-65ba-4328-aebf-98c6c512f92b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:40.118448 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-029b5bd7-65ba-4328-aebf-98c6c512f92b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.686021 Oct 29 01:15:40.119491 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1356/2836] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:39 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:40.143549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-05547cc2-e833-4c0d-9068-6ec0dd87561e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:40.167009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fac8da90-11a0-41fb-a88e-82caa2a3fe11 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:40.169643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fac8da90-11a0-41fb-a88e-82caa2a3fe11 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:40.170481 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-05547cc2-e833-4c0d-9068-6ec0dd87561e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1478 microversion: 2.1 time: 0.916804 Oct 29 01:15:40.171840 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1481/2837] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:39 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1478 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:40.200213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fac8da90-11a0-41fb-a88e-82caa2a3fe11 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:40.205246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fac8da90-11a0-41fb-a88e-82caa2a3fe11 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:40.205246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fac8da90-11a0-41fb-a88e-82caa2a3fe11 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:40.205246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fac8da90-11a0-41fb-a88e-82caa2a3fe11 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:40.205246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fac8da90-11a0-41fb-a88e-82caa2a3fe11 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:40.206560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fac8da90-11a0-41fb-a88e-82caa2a3fe11 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:40.642774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fac8da90-11a0-41fb-a88e-82caa2a3fe11 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:40.663006 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fac8da90-11a0-41fb-a88e-82caa2a3fe11 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1280 microversion: 2.1 time: 0.542331 Oct 29 01:15:40.697840 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1357/2838] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:40 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1280 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:40.764594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-bf954497-fb75-486d-a45c-4b911a76a8d4 req-2c79a5cd-464c-4414-96d8-a5a9c604719f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88cce5a-4c01-4354-895a-54148d701f7c", "name": "network-vif-unplugged", "status": "completed", "tag": "3cdeecea-ff58-4590-b370-37477a47edc3"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:40.775993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-bf954497-fb75-486d-a45c-4b911a76a8d4 req-2c79a5cd-464c-4414-96d8-a5a9c604719f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:40.776639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-bf954497-fb75-486d-a45c-4b911a76a8d4 req-2c79a5cd-464c-4414-96d8-a5a9c604719f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:40.777035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-bf954497-fb75-486d-a45c-4b911a76a8d4 req-2c79a5cd-464c-4414-96d8-a5a9c604719f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:40.789507 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-bf954497-fb75-486d-a45c-4b911a76a8d4 req-2c79a5cd-464c-4414-96d8-a5a9c604719f service nova] Creating event network-vif-unplugged:3cdeecea-ff58-4590-b370-37477a47edc3 for instance b88cce5a-4c01-4354-895a-54148d701f7c on n-h1-862964-3 Oct 29 01:15:40.796393 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-bf954497-fb75-486d-a45c-4b911a76a8d4 req-2c79a5cd-464c-4414-96d8-a5a9c604719f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035700 Oct 29 01:15:40.797677 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1482/2839] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:41.159977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-21aeeff1-6f52-48ec-8238-5e0f4ec2ed62 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:41.159977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-21aeeff1-6f52-48ec-8238-5e0f4ec2ed62 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:41.166463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21aeeff1-6f52-48ec-8238-5e0f4ec2ed62 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:41.167323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21aeeff1-6f52-48ec-8238-5e0f4ec2ed62 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:41.168050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21aeeff1-6f52-48ec-8238-5e0f4ec2ed62 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:41.169731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21aeeff1-6f52-48ec-8238-5e0f4ec2ed62 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:41.170499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21aeeff1-6f52-48ec-8238-5e0f4ec2ed62 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:41.171418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21aeeff1-6f52-48ec-8238-5e0f4ec2ed62 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:41.201113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-93a8f058-f07d-4636-b680-312dfcc23cfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:41.202214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-93a8f058-f07d-4636-b680-312dfcc23cfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:41.221274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93a8f058-f07d-4636-b680-312dfcc23cfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:41.221582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93a8f058-f07d-4636-b680-312dfcc23cfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:41.222321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93a8f058-f07d-4636-b680-312dfcc23cfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:41.223054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93a8f058-f07d-4636-b680-312dfcc23cfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:41.223526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93a8f058-f07d-4636-b680-312dfcc23cfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:41.224051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93a8f058-f07d-4636-b680-312dfcc23cfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:42.179462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-93a8f058-f07d-4636-b680-312dfcc23cfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:42.190296 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-93a8f058-f07d-4636-b680-312dfcc23cfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1478 microversion: 2.1 time: 0.994474 Oct 29 01:15:42.191502 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1483/2840] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:41 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1478 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:42.197870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a466fbc6-eb10-4693-a849-aa4aaf414ead tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:42.198824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a466fbc6-eb10-4693-a849-aa4aaf414ead tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:42.216534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a466fbc6-eb10-4693-a849-aa4aaf414ead tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:42.217759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a466fbc6-eb10-4693-a849-aa4aaf414ead tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:42.219616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a466fbc6-eb10-4693-a849-aa4aaf414ead tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:42.221757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a466fbc6-eb10-4693-a849-aa4aaf414ead tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:42.222822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a466fbc6-eb10-4693-a849-aa4aaf414ead tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:42.223678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a466fbc6-eb10-4693-a849-aa4aaf414ead tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:42.365454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-21aeeff1-6f52-48ec-8238-5e0f4ec2ed62 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:42.397613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-21aeeff1-6f52-48ec-8238-5e0f4ec2ed62 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:42.399813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-21aeeff1-6f52-48ec-8238-5e0f4ec2ed62 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:42.401170 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-21aeeff1-6f52-48ec-8238-5e0f4ec2ed62 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 1.252216 Oct 29 01:15:42.401861 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1358/2841] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:41 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:42.740286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a466fbc6-eb10-4693-a849-aa4aaf414ead tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:42.773709 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a466fbc6-eb10-4693-a849-aa4aaf414ead tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1322 microversion: 2.1 time: 0.563708 Oct 29 01:15:42.779930 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1484/2842] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:42 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1322 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:43.216307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-942be8f9-30f4-47bd-9109-50ff2c5c1674 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:43.216968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-942be8f9-30f4-47bd-9109-50ff2c5c1674 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:43.236191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-942be8f9-30f4-47bd-9109-50ff2c5c1674 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:43.236692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-942be8f9-30f4-47bd-9109-50ff2c5c1674 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:43.237205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-942be8f9-30f4-47bd-9109-50ff2c5c1674 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:43.237931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-942be8f9-30f4-47bd-9109-50ff2c5c1674 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:43.238390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-942be8f9-30f4-47bd-9109-50ff2c5c1674 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:43.238815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-942be8f9-30f4-47bd-9109-50ff2c5c1674 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:43.432256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6313c6fa-9346-4b47-9b6a-86027877d440 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:43.433576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6313c6fa-9346-4b47-9b6a-86027877d440 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:43.441064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:43.443744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6313c6fa-9346-4b47-9b6a-86027877d440 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:43.444480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6313c6fa-9346-4b47-9b6a-86027877d440 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:43.445174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6313c6fa-9346-4b47-9b6a-86027877d440 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:43.446143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6313c6fa-9346-4b47-9b6a-86027877d440 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:43.447110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6313c6fa-9346-4b47-9b6a-86027877d440 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:43.447767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6313c6fa-9346-4b47-9b6a-86027877d440 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:43.771497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=8 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:43.817374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-942be8f9-30f4-47bd-9109-50ff2c5c1674 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:43.832399 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-942be8f9-30f4-47bd-9109-50ff2c5c1674 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1464 microversion: 2.1 time: 0.619313 Oct 29 01:15:43.853018 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1359/2843] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:43 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1464 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:43.884057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5734c16f-dbb2-4f2a-b7c6-41ef6496bb82 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-385671223", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:43.980019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6313c6fa-9346-4b47-9b6a-86027877d440 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:43.994807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-5734c16f-dbb2-4f2a-b7c6-41ef6496bb82 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] validate_networks() for [('9f7b032c-0aed-4adf-929f-4f69d989902b', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:15:44.002710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6313c6fa-9346-4b47-9b6a-86027877d440 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:44.004225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6313c6fa-9346-4b47-9b6a-86027877d440 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:44.005657 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6313c6fa-9346-4b47-9b6a-86027877d440 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.577656 Oct 29 01:15:44.016429 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1485/2844] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:43 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:44.016429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0964b86f-3c2e-438e-856a-0aaba3eb2016 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:44.016429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0964b86f-3c2e-438e-856a-0aaba3eb2016 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:44.027399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0964b86f-3c2e-438e-856a-0aaba3eb2016 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:44.028750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0964b86f-3c2e-438e-856a-0aaba3eb2016 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:44.029437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0964b86f-3c2e-438e-856a-0aaba3eb2016 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:44.033010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0964b86f-3c2e-438e-856a-0aaba3eb2016 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:44.033010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0964b86f-3c2e-438e-856a-0aaba3eb2016 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:44.033010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0964b86f-3c2e-438e-856a-0aaba3eb2016 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:44.596796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0964b86f-3c2e-438e-856a-0aaba3eb2016 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:44.614300 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0964b86f-3c2e-438e-856a-0aaba3eb2016 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1322 microversion: 2.1 time: 0.606616 Oct 29 01:15:44.615631 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1486/2845] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:44 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1322 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:44.631421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dcaefc70-2be9-4ece-ada5-445aeed719b8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:44.632302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dcaefc70-2be9-4ece-ada5-445aeed719b8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:44.652643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcaefc70-2be9-4ece-ada5-445aeed719b8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:44.654073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcaefc70-2be9-4ece-ada5-445aeed719b8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:44.655471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcaefc70-2be9-4ece-ada5-445aeed719b8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:44.656586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcaefc70-2be9-4ece-ada5-445aeed719b8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:44.658409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcaefc70-2be9-4ece-ada5-445aeed719b8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:44.658949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcaefc70-2be9-4ece-ada5-445aeed719b8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:45.063641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:45.347304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-5734c16f-dbb2-4f2a-b7c6-41ef6496bb82 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:15:45.347304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-5734c16f-dbb2-4f2a-b7c6-41ef6496bb82 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:15:45.347304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-5734c16f-dbb2-4f2a-b7c6-41ef6496bb82 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:15:45.347304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-5734c16f-dbb2-4f2a-b7c6-41ef6496bb82 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:15:45.347304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-5734c16f-dbb2-4f2a-b7c6-41ef6496bb82 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:15:45.395723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5734c16f-dbb2-4f2a-b7c6-41ef6496bb82 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:45.396917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5734c16f-dbb2-4f2a-b7c6-41ef6496bb82 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:45.397407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5734c16f-dbb2-4f2a-b7c6-41ef6496bb82 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:45.398431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5734c16f-dbb2-4f2a-b7c6-41ef6496bb82 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:45.412366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dcaefc70-2be9-4ece-ada5-445aeed719b8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:45.437498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5734c16f-dbb2-4f2a-b7c6-41ef6496bb82 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:45.437498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5734c16f-dbb2-4f2a-b7c6-41ef6496bb82 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:45.448772 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dcaefc70-2be9-4ece-ada5-445aeed719b8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1464 microversion: 2.1 time: 0.831203 Oct 29 01:15:45.450713 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1487/2846] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:44 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1464 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:45.475476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-e04995c2-f8f4-4d2a-962a-cf42a0f7b957 req-bb5e3fab-3a0a-4bcb-aab6-6a40ed1dc331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88cce5a-4c01-4354-895a-54148d701f7c", "name": "network-vif-plugged", "status": "completed", "tag": "3cdeecea-ff58-4590-b370-37477a47edc3"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:45.513435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e04995c2-f8f4-4d2a-962a-cf42a0f7b957 req-bb5e3fab-3a0a-4bcb-aab6-6a40ed1dc331 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:45.516086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e04995c2-f8f4-4d2a-962a-cf42a0f7b957 req-bb5e3fab-3a0a-4bcb-aab6-6a40ed1dc331 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:45.517857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e04995c2-f8f4-4d2a-962a-cf42a0f7b957 req-bb5e3fab-3a0a-4bcb-aab6-6a40ed1dc331 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:45.554967 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-e04995c2-f8f4-4d2a-962a-cf42a0f7b957 req-bb5e3fab-3a0a-4bcb-aab6-6a40ed1dc331 service nova] Creating event network-vif-plugged:3cdeecea-ff58-4590-b370-37477a47edc3 for instance b88cce5a-4c01-4354-895a-54148d701f7c on n-h1-862964-3 Oct 29 01:15:45.561088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-5734c16f-dbb2-4f2a-b7c6-41ef6496bb82 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Getting quotas for project 328d1dd53c6a4bc2b14376dd1a1cecb6. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:15:45.571012 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-e04995c2-f8f4-4d2a-962a-cf42a0f7b957 req-bb5e3fab-3a0a-4bcb-aab6-6a40ed1dc331 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117734 Oct 29 01:15:45.578856 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1488/2847] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:45.582416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-5734c16f-dbb2-4f2a-b7c6-41ef6496bb82 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Getting quotas for user b89f11ebd96141a5afe08dad79b0b20c and project 328d1dd53c6a4bc2b14376dd1a1cecb6. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:15:45.599561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d75ab5ae-e318-4b2d-bb62-77028ce34000 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:45.604804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d75ab5ae-e318-4b2d-bb62-77028ce34000 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:45.625566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d75ab5ae-e318-4b2d-bb62-77028ce34000 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:45.625963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d75ab5ae-e318-4b2d-bb62-77028ce34000 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:45.630165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5734c16f-dbb2-4f2a-b7c6-41ef6496bb82 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:15:45.631053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d75ab5ae-e318-4b2d-bb62-77028ce34000 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:45.633709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d75ab5ae-e318-4b2d-bb62-77028ce34000 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:45.636259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d75ab5ae-e318-4b2d-bb62-77028ce34000 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:45.637582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d75ab5ae-e318-4b2d-bb62-77028ce34000 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:45.654490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5734c16f-dbb2-4f2a-b7c6-41ef6496bb82 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:15:45.904294 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5734c16f-dbb2-4f2a-b7c6-41ef6496bb82 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.049955 Oct 29 01:15:45.911549 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1360/2848] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:15:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 2053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:15:45.919575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:45.922529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:45.939329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:45.941772 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:45.941772 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:45.941772 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:45.944170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:45.944796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:46.088346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:15:46.089648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:15:46.091070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:15:46.091692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:15:46.092309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:15:46.132357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d75ab5ae-e318-4b2d-bb62-77028ce34000 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:46.147709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d75ab5ae-e318-4b2d-bb62-77028ce34000 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:46.147709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d75ab5ae-e318-4b2d-bb62-77028ce34000 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:46.157497 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d75ab5ae-e318-4b2d-bb62-77028ce34000 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.568058 Oct 29 01:15:46.158625 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1489/2849] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:45 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:46.163698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a92b350c-3279-4dc3-a697-d87676f40d02 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:46.165057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a92b350c-3279-4dc3-a697-d87676f40d02 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:46.175674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a92b350c-3279-4dc3-a697-d87676f40d02 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:46.179880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a92b350c-3279-4dc3-a697-d87676f40d02 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:46.181883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a92b350c-3279-4dc3-a697-d87676f40d02 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:46.188121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a92b350c-3279-4dc3-a697-d87676f40d02 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:46.188121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a92b350c-3279-4dc3-a697-d87676f40d02 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:46.188121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a92b350c-3279-4dc3-a697-d87676f40d02 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:46.374273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:46.395331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:46.396068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:46.398637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:46.401308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:46.402272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:46.408658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:46.494842 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-341c03cc-0314-4781-9e89-231fb63b359d tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "POST /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c/action" status: 202 len: 1068 microversion: 2.1 time: 0.584040 Oct 29 01:15:46.497416 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1361/2850] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:15:45 2022] POST /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c/action => generated 1068 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 29 01:15:46.507954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-faa7abf3-8aca-4a58-89e6-ab41b1f0d950 req-d840fb68-b43d-486e-b7e2-0c0d3332f469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "919adddc-a598-47f8-9823-170d101dbdc8", "tag": "e555ad33-2662-4f2a-8f28-923c3ff8a45e"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:46.534209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-faa7abf3-8aca-4a58-89e6-ab41b1f0d950 req-d840fb68-b43d-486e-b7e2-0c0d3332f469 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:46.537781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-faa7abf3-8aca-4a58-89e6-ab41b1f0d950 req-d840fb68-b43d-486e-b7e2-0c0d3332f469 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:46.538465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-faa7abf3-8aca-4a58-89e6-ab41b1f0d950 req-d840fb68-b43d-486e-b7e2-0c0d3332f469 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:46.568286 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-faa7abf3-8aca-4a58-89e6-ab41b1f0d950 req-d840fb68-b43d-486e-b7e2-0c0d3332f469 service nova] Creating event network-changed:e555ad33-2662-4f2a-8f28-923c3ff8a45e for instance 919adddc-a598-47f8-9823-170d101dbdc8 on n-h2-862964-3 Oct 29 01:15:46.575523 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-faa7abf3-8aca-4a58-89e6-ab41b1f0d950 req-d840fb68-b43d-486e-b7e2-0c0d3332f469 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076543 Oct 29 01:15:46.576647 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1362/2851] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:46.588136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c5c9c5da-3912-4fdf-ae8c-e6a9006e3ca1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:46.589103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c5c9c5da-3912-4fdf-ae8c-e6a9006e3ca1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:46.650977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a92b350c-3279-4dc3-a697-d87676f40d02 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:46.666342 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a92b350c-3279-4dc3-a697-d87676f40d02 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1322 microversion: 2.1 time: 0.505594 Oct 29 01:15:46.667762 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1490/2852] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:46 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1322 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:46.700170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c5c9c5da-3912-4fdf-ae8c-e6a9006e3ca1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:46.712650 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c5c9c5da-3912-4fdf-ae8c-e6a9006e3ca1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1224 microversion: 2.1 time: 0.134273 Oct 29 01:15:46.714761 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1363/2853] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:46 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1224 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:46.724354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-55471c40-566f-41fa-b231-d032514557db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:46.725172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-55471c40-566f-41fa-b231-d032514557db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:46.738751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55471c40-566f-41fa-b231-d032514557db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:46.741885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55471c40-566f-41fa-b231-d032514557db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:46.741885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55471c40-566f-41fa-b231-d032514557db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:46.741885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55471c40-566f-41fa-b231-d032514557db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:46.741885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55471c40-566f-41fa-b231-d032514557db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:46.741885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55471c40-566f-41fa-b231-d032514557db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:47.226089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4c1d3cd8-1e4c-4c1b-b472-7caf93f8fe0b tempest-ServerGroup264TestJSON-1189725959 tempest-ServerGroup264TestJSON-1189725959-project] Action: 'create', calling method: .version_select at 0x7f9d978fac10>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:47.293651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-4c1d3cd8-1e4c-4c1b-b472-7caf93f8fe0b tempest-ServerGroup264TestJSON-1189725959 tempest-ServerGroup264TestJSON-1189725959-project] Getting quotas for project db72b57466ec41d795ca4439ef2514c9. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:15:47.319213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-55471c40-566f-41fa-b231-d032514557db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:47.351784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-4c1d3cd8-1e4c-4c1b-b472-7caf93f8fe0b tempest-ServerGroup264TestJSON-1189725959 tempest-ServerGroup264TestJSON-1189725959-project] Getting quotas for user 71d868a70e0a49188726835a6a813983 and project db72b57466ec41d795ca4439ef2514c9. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:15:47.378384 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-55471c40-566f-41fa-b231-d032514557db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1473 microversion: 2.1 time: 0.660725 Oct 29 01:15:47.393309 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1364/2854] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:46 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1473 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:47.455995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4fb95854-0e62-456a-a6ea-94c246837daf tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:47.456966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4fb95854-0e62-456a-a6ea-94c246837daf tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:47.484772 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fb95854-0e62-456a-a6ea-94c246837daf tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:47.487812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fb95854-0e62-456a-a6ea-94c246837daf tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:47.488585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fb95854-0e62-456a-a6ea-94c246837daf tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:47.489772 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fb95854-0e62-456a-a6ea-94c246837daf tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:47.491337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fb95854-0e62-456a-a6ea-94c246837daf tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:47.491878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fb95854-0e62-456a-a6ea-94c246837daf tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:47.643643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-4c1d3cd8-1e4c-4c1b-b472-7caf93f8fe0b tempest-ServerGroup264TestJSON-1189725959 tempest-ServerGroup264TestJSON-1189725959-project] Getting quotas for project db72b57466ec41d795ca4439ef2514c9. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:15:47.690588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-4c1d3cd8-1e4c-4c1b-b472-7caf93f8fe0b tempest-ServerGroup264TestJSON-1189725959 tempest-ServerGroup264TestJSON-1189725959-project] Getting quotas for user 71d868a70e0a49188726835a6a813983 and project db72b57466ec41d795ca4439ef2514c9. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:15:47.762252 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4c1d3cd8-1e4c-4c1b-b472-7caf93f8fe0b tempest-ServerGroup264TestJSON-1189725959 tempest-ServerGroup264TestJSON-1189725959-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 1.089795 Oct 29 01:15:47.771499 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1491/2855] 10.222.0.26 () {62 vars in 1214 bytes} [Sat Oct 29 01:15:46 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:15:47.788439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4bacc68a-864a-47cf-9bbb-a0a777236da8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:47.794319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4bacc68a-864a-47cf-9bbb-a0a777236da8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:47.819505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bacc68a-864a-47cf-9bbb-a0a777236da8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:47.823063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bacc68a-864a-47cf-9bbb-a0a777236da8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:47.823613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bacc68a-864a-47cf-9bbb-a0a777236da8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:47.826894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bacc68a-864a-47cf-9bbb-a0a777236da8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:47.827998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bacc68a-864a-47cf-9bbb-a0a777236da8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:47.830954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bacc68a-864a-47cf-9bbb-a0a777236da8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:48.998210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4bacc68a-864a-47cf-9bbb-a0a777236da8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:49.012663 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4bacc68a-864a-47cf-9bbb-a0a777236da8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1322 microversion: 2.1 time: 1.241780 Oct 29 01:15:49.013679 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1492/2856] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:47 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1322 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:49.022367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d94af621-28f3-4d6d-a64e-d735e33c0548 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:49.025930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d94af621-28f3-4d6d-a64e-d735e33c0548 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:49.032657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4fb95854-0e62-456a-a6ea-94c246837daf tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:49.039111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d94af621-28f3-4d6d-a64e-d735e33c0548 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:49.044568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d94af621-28f3-4d6d-a64e-d735e33c0548 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:49.044568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d94af621-28f3-4d6d-a64e-d735e33c0548 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:49.044568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d94af621-28f3-4d6d-a64e-d735e33c0548 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:49.045697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d94af621-28f3-4d6d-a64e-d735e33c0548 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:49.049836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d94af621-28f3-4d6d-a64e-d735e33c0548 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:49.059824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4fb95854-0e62-456a-a6ea-94c246837daf tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:49.070727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4fb95854-0e62-456a-a6ea-94c246837daf tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:49.072565 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4fb95854-0e62-456a-a6ea-94c246837daf tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 1.634786 Oct 29 01:15:49.090308 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1365/2857] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:47 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:49.103904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-61a3c03d-d84c-47b9-8745-5881b18972e1 tempest-ServerGroup264TestJSON-1189725959 tempest-ServerGroup264TestJSON-1189725959-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:49.128099 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-61a3c03d-d84c-47b9-8745-5881b18972e1 tempest-ServerGroup264TestJSON-1189725959 tempest-ServerGroup264TestJSON-1189725959-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.046939 Oct 29 01:15:49.138575 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1366/2858] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 29 01:15:49 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:15:49.141983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4711d1ef-2ff5-4d42-9997-acab98d02788 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:49.142915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4711d1ef-2ff5-4d42-9997-acab98d02788 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:49.161862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4711d1ef-2ff5-4d42-9997-acab98d02788 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:49.161862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4711d1ef-2ff5-4d42-9997-acab98d02788 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:49.161862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4711d1ef-2ff5-4d42-9997-acab98d02788 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:49.161862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4711d1ef-2ff5-4d42-9997-acab98d02788 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:49.161862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4711d1ef-2ff5-4d42-9997-acab98d02788 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:49.161862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4711d1ef-2ff5-4d42-9997-acab98d02788 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:49.204060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d94af621-28f3-4d6d-a64e-d735e33c0548 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:49.230548 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d94af621-28f3-4d6d-a64e-d735e33c0548 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1276 microversion: 2.1 time: 0.208522 Oct 29 01:15:49.232302 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1493/2859] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:49 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1276 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:49.238744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-793cfa32-772c-4aec-958e-fb115f538a6a tempest-ServerGroup264TestJSON-1189725959 tempest-ServerGroup264TestJSON-1189725959-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:49.268187 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-793cfa32-772c-4aec-958e-fb115f538a6a tempest-ServerGroup264TestJSON-1189725959 tempest-ServerGroup264TestJSON-1189725959-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/9f7beb0a-cdf9-4e7e-afe5-5b7d53673ebd" status: 200 len: 235 microversion: 2.64 time: 0.034726 Oct 29 01:15:49.273394 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1494/2860] 10.222.0.26 () {60 vars in 1304 bytes} [Sat Oct 29 01:15:49 2022] GET /compute/v2.1/os-server-groups/9f7beb0a-cdf9-4e7e-afe5-5b7d53673ebd => generated 235 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:15:49.282488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2de55f40-52c0-477c-800b-4f71c7844a9b tempest-ServerGroup264TestJSON-1189725959 tempest-ServerGroup264TestJSON-1189725959-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:49.315960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:49.409369 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2de55f40-52c0-477c-800b-4f71c7844a9b tempest-ServerGroup264TestJSON-1189725959 tempest-ServerGroup264TestJSON-1189725959-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/9f7beb0a-cdf9-4e7e-afe5-5b7d53673ebd" status: 204 len: 0 microversion: 2.64 time: 0.130783 Oct 29 01:15:49.409955 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1495/2861] 10.222.0.26 () {60 vars in 1307 bytes} [Sat Oct 29 01:15:49 2022] DELETE /compute/v2.1/os-server-groups/9f7beb0a-cdf9-4e7e-afe5-5b7d53673ebd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 29 01:15:49.419554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fe85011d-3963-4a0f-bea5-94ce3c4e8b3c tempest-ServerGroup264TestJSON-1189725959 tempest-ServerGroup264TestJSON-1189725959-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:49.438443 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-fe85011d-3963-4a0f-bea5-94ce3c4e8b3c tempest-ServerGroup264TestJSON-1189725959 tempest-ServerGroup264TestJSON-1189725959-project] HTTP exception thrown: Instance group 9f7beb0a-cdf9-4e7e-afe5-5b7d53673ebd could not be found. Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fe85011d-3963-4a0f-bea5-94ce3c4e8b3c tempest-ServerGroup264TestJSON-1189725959 tempest-ServerGroup264TestJSON-1189725959-project] Request method failure captured: Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/os-server-groups/9f7beb0a-cdf9-4e7e-afe5-5b7d53673ebd HTTP/1.1 Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH7CnG4rm2npYsrPTbEdIuTxoF7XPlKur6CXc5zFy5YKgOSx7In1vWwKbI17yqqAbBLLB59OyT1BjA9Vm2ocM-No5n-II6QSpON5tLYI4g1VPz478uq740f1J8445UeE6GpvhaWybpVMe9Ft5buAlaoN_V2ztHUU6BzGDD_V1f6QoK0 Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.64 Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db72b57466ec41d795ca4439ef2514c9 Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerGroup264TestJSON-1189725959 Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db72b57466ec41d795ca4439ef2514c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db72b57466ec41d795ca4439ef2514c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db72b57466ec41d795ca4439ef2514c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db72b57466ec41d795ca4439ef2514c9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerGroup264TestJSON-1189725959 Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db72b57466ec41d795ca4439ef2514c9 Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1189725959 Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerGroup264TestJSON-1189725959-project Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 71d868a70e0a49188726835a6a813983 Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerGroup264TestJSON-1189725959-project Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance group 9f7beb0a-cdf9-4e7e-afe5-5b7d53673ebd could not be found. Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '9f7beb0a-cdf9-4e7e-afe5-5b7d53673ebd'} Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9f7beb0a-cdf9-4e7e-afe5-5b7d53673ebd could not be found. Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9f7beb0a-cdf9-4e7e-afe5-5b7d53673ebd could not be found. Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:49.453298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:15:49.461763 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:15:49.461763 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:15:49.461763 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:15:49.461763 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:15:49.461763 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9f7beb0a-cdf9-4e7e-afe5-5b7d53673ebd could not be found. Oct 29 01:15:49.461763 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:15:49.465508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fe85011d-3963-4a0f-bea5-94ce3c4e8b3c tempest-ServerGroup264TestJSON-1189725959 tempest-ServerGroup264TestJSON-1189725959-project] Returning 404 to user: Instance group 9f7beb0a-cdf9-4e7e-afe5-5b7d53673ebd could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:15:49.467449 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fe85011d-3963-4a0f-bea5-94ce3c4e8b3c tempest-ServerGroup264TestJSON-1189725959 tempest-ServerGroup264TestJSON-1189725959-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/9f7beb0a-cdf9-4e7e-afe5-5b7d53673ebd" status: 404 len: 117 microversion: 2.64 time: 0.052137 Oct 29 01:15:49.468602 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1496/2862] 10.222.0.26 () {60 vars in 1307 bytes} [Sat Oct 29 01:15:49 2022] DELETE /compute/v2.1/os-server-groups/9f7beb0a-cdf9-4e7e-afe5-5b7d53673ebd => generated 117 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 29 01:15:49.650025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4711d1ef-2ff5-4d42-9997-acab98d02788 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:49.673056 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4711d1ef-2ff5-4d42-9997-acab98d02788 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1473 microversion: 2.1 time: 0.537275 Oct 29 01:15:49.676390 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1367/2863] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:49 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1473 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:49.991085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b86d5c08-0dbc-41d1-a738-899af72d6240 tempest-QuotaClassesAdmin257Test-64070831 tempest-QuotaClassesAdmin257Test-64070831-project-admin] Calling method '.version_select at 0x7f9d978230d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:50.013239 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b86d5c08-0dbc-41d1-a738-899af72d6240 tempest-QuotaClassesAdmin257Test-64070831 tempest-QuotaClassesAdmin257Test-64070831-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.543154 Oct 29 01:15:50.018373 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1497/2864] 10.222.0.26 () {60 vars in 1226 bytes} [Sat Oct 29 01:15:49 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:15:50.041715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ba59932f-3dc8-4ddc-b0bc-6240ba6ec2d1 tempest-QuotaClassesAdmin257Test-64070831 tempest-QuotaClassesAdmin257Test-64070831-project-admin] Action: 'update', calling method: .version_select at 0x7f9d97c52160>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:50.042961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6c7ea906-f5d8-4f07-8fee-0b1d43f39653 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:50.044192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6c7ea906-f5d8-4f07-8fee-0b1d43f39653 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:50.054098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c7ea906-f5d8-4f07-8fee-0b1d43f39653 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:50.054920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c7ea906-f5d8-4f07-8fee-0b1d43f39653 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:50.056677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c7ea906-f5d8-4f07-8fee-0b1d43f39653 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:50.057742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c7ea906-f5d8-4f07-8fee-0b1d43f39653 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:50.058433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c7ea906-f5d8-4f07-8fee-0b1d43f39653 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:50.060086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c7ea906-f5d8-4f07-8fee-0b1d43f39653 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:50.384906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6c7ea906-f5d8-4f07-8fee-0b1d43f39653 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:50.394876 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6c7ea906-f5d8-4f07-8fee-0b1d43f39653 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1322 microversion: 2.1 time: 0.358617 Oct 29 01:15:50.399835 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1498/2865] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:50 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:50.410276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1d1cbcee-8382-4d82-b335-1f345bb23a51 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:50.410897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1d1cbcee-8382-4d82-b335-1f345bb23a51 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:50.417089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d1cbcee-8382-4d82-b335-1f345bb23a51 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:50.420034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d1cbcee-8382-4d82-b335-1f345bb23a51 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:50.420768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d1cbcee-8382-4d82-b335-1f345bb23a51 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:50.421892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d1cbcee-8382-4d82-b335-1f345bb23a51 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:50.423260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d1cbcee-8382-4d82-b335-1f345bb23a51 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:50.429192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d1cbcee-8382-4d82-b335-1f345bb23a51 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:50.862725 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ba59932f-3dc8-4ddc-b0bc-6240ba6ec2d1 tempest-QuotaClassesAdmin257Test-64070831 tempest-QuotaClassesAdmin257Test-64070831-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.830866 Oct 29 01:15:50.875641 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1368/2866] 10.222.0.26 () {62 vars in 1247 bytes} [Sat Oct 29 01:15:50 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:15:50.881351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1331ad64-027b-44ef-9466-825c898fd329 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:50.882215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1331ad64-027b-44ef-9466-825c898fd329 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:50.890113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1331ad64-027b-44ef-9466-825c898fd329 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:50.890495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1331ad64-027b-44ef-9466-825c898fd329 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:50.891224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1331ad64-027b-44ef-9466-825c898fd329 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:50.891939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1331ad64-027b-44ef-9466-825c898fd329 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:50.892388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1331ad64-027b-44ef-9466-825c898fd329 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:50.892991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1331ad64-027b-44ef-9466-825c898fd329 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:51.090564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1331ad64-027b-44ef-9466-825c898fd329 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:51.103646 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1331ad64-027b-44ef-9466-825c898fd329 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1282 microversion: 2.1 time: 0.226805 Oct 29 01:15:51.105682 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1369/2867] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:50 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1282 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:51.113674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-480d0fe7-aa10-40df-aa71-f22cdeb6a578 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:51.115266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-480d0fe7-aa10-40df-aa71-f22cdeb6a578 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:51.129300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-480d0fe7-aa10-40df-aa71-f22cdeb6a578 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:51.130170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-480d0fe7-aa10-40df-aa71-f22cdeb6a578 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:51.131304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-480d0fe7-aa10-40df-aa71-f22cdeb6a578 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:51.132204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-480d0fe7-aa10-40df-aa71-f22cdeb6a578 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:51.136287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-480d0fe7-aa10-40df-aa71-f22cdeb6a578 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:51.136287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-480d0fe7-aa10-40df-aa71-f22cdeb6a578 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:51.196123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1d1cbcee-8382-4d82-b335-1f345bb23a51 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:51.212354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1d1cbcee-8382-4d82-b335-1f345bb23a51 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:51.215832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1d1cbcee-8382-4d82-b335-1f345bb23a51 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:51.218395 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1d1cbcee-8382-4d82-b335-1f345bb23a51 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.816885 Oct 29 01:15:51.250332 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1499/2868] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:50 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:51.256175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a83277b6-d9e7-4d96-9d1a-a902dec693c7 tempest-QuotaClassesAdmin257Test-64070831 tempest-QuotaClassesAdmin257Test-64070831-project-admin] Calling method '.version_select at 0x7f9d96f9e790>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:51.274516 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a83277b6-d9e7-4d96-9d1a-a902dec693c7 tempest-QuotaClassesAdmin257Test-64070831 tempest-QuotaClassesAdmin257Test-64070831-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.021840 Oct 29 01:15:51.277729 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1500/2869] 10.222.0.26 () {60 vars in 1226 bytes} [Sat Oct 29 01:15:51 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:15:51.299367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5ffed74b-fedd-4540-a17e-b02bbcea2aa8 tempest-QuotaClassesAdmin257Test-64070831 tempest-QuotaClassesAdmin257Test-64070831-project-admin] Action: 'update', calling method: .version_select at 0x7f9d96f9e5e0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:51.490792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-480d0fe7-aa10-40df-aa71-f22cdeb6a578 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:51.516131 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-480d0fe7-aa10-40df-aa71-f22cdeb6a578 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1473 microversion: 2.1 time: 0.407635 Oct 29 01:15:51.516962 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1370/2870] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:51 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1473 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:51.525091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0628c28c-6023-44f5-94ef-af76a6fa3992 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:51.526011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0628c28c-6023-44f5-94ef-af76a6fa3992 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:51.542660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0628c28c-6023-44f5-94ef-af76a6fa3992 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:51.544999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0628c28c-6023-44f5-94ef-af76a6fa3992 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:51.545743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0628c28c-6023-44f5-94ef-af76a6fa3992 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:51.546835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0628c28c-6023-44f5-94ef-af76a6fa3992 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:51.547493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0628c28c-6023-44f5-94ef-af76a6fa3992 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:51.548127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0628c28c-6023-44f5-94ef-af76a6fa3992 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:51.956604 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5ffed74b-fedd-4540-a17e-b02bbcea2aa8 tempest-QuotaClassesAdmin257Test-64070831 tempest-QuotaClassesAdmin257Test-64070831-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.671082 Oct 29 01:15:51.957763 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1501/2871] 10.222.0.26 () {62 vars in 1247 bytes} [Sat Oct 29 01:15:51 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:15:52.133904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4cd1a75f-a5b8-42ec-8687-bd5fec4ff422 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:52.134605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4cd1a75f-a5b8-42ec-8687-bd5fec4ff422 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:52.149634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4cd1a75f-a5b8-42ec-8687-bd5fec4ff422 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:52.150731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0628c28c-6023-44f5-94ef-af76a6fa3992 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:52.151666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4cd1a75f-a5b8-42ec-8687-bd5fec4ff422 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:52.152492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4cd1a75f-a5b8-42ec-8687-bd5fec4ff422 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:52.154755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4cd1a75f-a5b8-42ec-8687-bd5fec4ff422 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:52.156117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4cd1a75f-a5b8-42ec-8687-bd5fec4ff422 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:52.157053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4cd1a75f-a5b8-42ec-8687-bd5fec4ff422 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:52.164424 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0628c28c-6023-44f5-94ef-af76a6fa3992 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1322 microversion: 2.1 time: 0.646116 Oct 29 01:15:52.169471 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1371/2872] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:51 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1322 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:52.253497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dd1820af-dd6b-48fd-9d6c-9f825ed45991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:52.255366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dd1820af-dd6b-48fd-9d6c-9f825ed45991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:52.269834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dd1820af-dd6b-48fd-9d6c-9f825ed45991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:52.270425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dd1820af-dd6b-48fd-9d6c-9f825ed45991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:52.270953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dd1820af-dd6b-48fd-9d6c-9f825ed45991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:52.273694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dd1820af-dd6b-48fd-9d6c-9f825ed45991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:52.274290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dd1820af-dd6b-48fd-9d6c-9f825ed45991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:52.276051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dd1820af-dd6b-48fd-9d6c-9f825ed45991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:52.796155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4cd1a75f-a5b8-42ec-8687-bd5fec4ff422 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:52.810720 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4cd1a75f-a5b8-42ec-8687-bd5fec4ff422 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1324 microversion: 2.1 time: 0.681536 Oct 29 01:15:52.815554 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1502/2873] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:52 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1324 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:52.825826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-93f83787-8f93-47d0-ab0c-5413ddc32239 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:52.826692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-93f83787-8f93-47d0-ab0c-5413ddc32239 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:52.842096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93f83787-8f93-47d0-ab0c-5413ddc32239 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:52.845147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93f83787-8f93-47d0-ab0c-5413ddc32239 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:52.845813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93f83787-8f93-47d0-ab0c-5413ddc32239 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:52.846708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93f83787-8f93-47d0-ab0c-5413ddc32239 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:52.850553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93f83787-8f93-47d0-ab0c-5413ddc32239 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:52.851258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93f83787-8f93-47d0-ab0c-5413ddc32239 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:53.057583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-dd1820af-dd6b-48fd-9d6c-9f825ed45991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:53.078755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-dd1820af-dd6b-48fd-9d6c-9f825ed45991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:53.085522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-dd1820af-dd6b-48fd-9d6c-9f825ed45991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:53.087131 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dd1820af-dd6b-48fd-9d6c-9f825ed45991 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.839400 Oct 29 01:15:53.088270 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1372/2874] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:52 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:53.196013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4242fe5f-8097-4c90-a358-b4f4b940ce51 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:53.197465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4242fe5f-8097-4c90-a358-b4f4b940ce51 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:53.204591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4242fe5f-8097-4c90-a358-b4f4b940ce51 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:53.213603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4242fe5f-8097-4c90-a358-b4f4b940ce51 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:53.224684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4242fe5f-8097-4c90-a358-b4f4b940ce51 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:53.224684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4242fe5f-8097-4c90-a358-b4f4b940ce51 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:53.224684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4242fe5f-8097-4c90-a358-b4f4b940ce51 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:53.224684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4242fe5f-8097-4c90-a358-b4f4b940ce51 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:53.440058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-93f83787-8f93-47d0-ab0c-5413ddc32239 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:53.451845 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-93f83787-8f93-47d0-ab0c-5413ddc32239 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1473 microversion: 2.1 time: 0.634273 Oct 29 01:15:53.453467 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1503/2875] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:52 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1473 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:53.590490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4242fe5f-8097-4c90-a358-b4f4b940ce51 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:53.598764 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4242fe5f-8097-4c90-a358-b4f4b940ce51 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1322 microversion: 2.1 time: 0.406950 Oct 29 01:15:53.603967 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1373/2876] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:53 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:53.839482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6ca30196-2ade-4195-9726-c2930f5c862e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:53.840785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6ca30196-2ade-4195-9726-c2930f5c862e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:53.853369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ca30196-2ade-4195-9726-c2930f5c862e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:53.853860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ca30196-2ade-4195-9726-c2930f5c862e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:53.856917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ca30196-2ade-4195-9726-c2930f5c862e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:53.859642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ca30196-2ade-4195-9726-c2930f5c862e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:53.860843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ca30196-2ade-4195-9726-c2930f5c862e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:53.866983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ca30196-2ade-4195-9726-c2930f5c862e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:53.901825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:54.120236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-08dba916-2741-4ad2-8e41-6b14a4ee2dd4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:54.120742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-08dba916-2741-4ad2-8e41-6b14a4ee2dd4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:54.128891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08dba916-2741-4ad2-8e41-6b14a4ee2dd4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:54.129753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08dba916-2741-4ad2-8e41-6b14a4ee2dd4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:54.130966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08dba916-2741-4ad2-8e41-6b14a4ee2dd4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:54.132481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08dba916-2741-4ad2-8e41-6b14a4ee2dd4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:54.133190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08dba916-2741-4ad2-8e41-6b14a4ee2dd4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:54.133789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08dba916-2741-4ad2-8e41-6b14a4ee2dd4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:54.164501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:54.803484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6ca30196-2ade-4195-9726-c2930f5c862e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:54.820303 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6ca30196-2ade-4195-9726-c2930f5c862e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1324 microversion: 2.1 time: 0.982070 Oct 29 01:15:54.821286 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1504/2877] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:53 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1324 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:54.848386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-731f67e5-64b6-4544-bec8-cb72e5f4dbfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:54.849933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-731f67e5-64b6-4544-bec8-cb72e5f4dbfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:54.861577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-731f67e5-64b6-4544-bec8-cb72e5f4dbfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:54.862607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-731f67e5-64b6-4544-bec8-cb72e5f4dbfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:54.863570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-731f67e5-64b6-4544-bec8-cb72e5f4dbfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:54.864460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-731f67e5-64b6-4544-bec8-cb72e5f4dbfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:54.865098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-731f67e5-64b6-4544-bec8-cb72e5f4dbfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:54.865893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-731f67e5-64b6-4544-bec8-cb72e5f4dbfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:55.327234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-08dba916-2741-4ad2-8e41-6b14a4ee2dd4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:55.347692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-08dba916-2741-4ad2-8e41-6b14a4ee2dd4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:55.349524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-08dba916-2741-4ad2-8e41-6b14a4ee2dd4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:55.351277 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-08dba916-2741-4ad2-8e41-6b14a4ee2dd4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 1.237502 Oct 29 01:15:55.352026 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1374/2878] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:54 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:15:55.356935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e5c6c0b-d283-44e9-a154-a1d1d7038c35 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:55.366073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7e5c6c0b-d283-44e9-a154-a1d1d7038c35 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:55.377757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e5c6c0b-d283-44e9-a154-a1d1d7038c35 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:55.378705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e5c6c0b-d283-44e9-a154-a1d1d7038c35 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:55.379365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e5c6c0b-d283-44e9-a154-a1d1d7038c35 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:55.380266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e5c6c0b-d283-44e9-a154-a1d1d7038c35 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:55.380906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e5c6c0b-d283-44e9-a154-a1d1d7038c35 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:55.381543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e5c6c0b-d283-44e9-a154-a1d1d7038c35 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:55.480326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-731f67e5-64b6-4544-bec8-cb72e5f4dbfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:55.492856 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-731f67e5-64b6-4544-bec8-cb72e5f4dbfa tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1473 microversion: 2.1 time: 0.654269 Oct 29 01:15:55.497083 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1505/2879] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:54 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1473 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:55.515091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-9a415529-f6ee-4093-a1fa-0a5b52dcbf78 req-d23bee26-6f13-4889-993e-9c248f3951f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919adddc-a598-47f8-9823-170d101dbdc8", "name": "network-vif-plugged", "status": "completed", "tag": "e555ad33-2662-4f2a-8f28-923c3ff8a45e"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:55.540434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:55.544615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9a415529-f6ee-4093-a1fa-0a5b52dcbf78 req-d23bee26-6f13-4889-993e-9c248f3951f6 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:55.545402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9a415529-f6ee-4093-a1fa-0a5b52dcbf78 req-d23bee26-6f13-4889-993e-9c248f3951f6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:55.546212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9a415529-f6ee-4093-a1fa-0a5b52dcbf78 req-d23bee26-6f13-4889-993e-9c248f3951f6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:55.564459 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-9a415529-f6ee-4093-a1fa-0a5b52dcbf78 req-d23bee26-6f13-4889-993e-9c248f3951f6 service nova] Creating event network-vif-plugged:e555ad33-2662-4f2a-8f28-923c3ff8a45e for instance 919adddc-a598-47f8-9823-170d101dbdc8 on n-h2-862964-3 Oct 29 01:15:55.572661 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-9a415529-f6ee-4093-a1fa-0a5b52dcbf78 req-d23bee26-6f13-4889-993e-9c248f3951f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073907 Oct 29 01:15:55.575008 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1506/2880] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:55.991570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-d0ef4e30-c260-4a89-88ec-38caffc33116 req-d15da707-9a2b-4e89-94fc-c0f4a6502ffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d34640d-e769-4799-9215-b36526af8817", "tag": "e24a49b8-f412-493b-8773-37bc96951756"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:56.024868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d0ef4e30-c260-4a89-88ec-38caffc33116 req-d15da707-9a2b-4e89-94fc-c0f4a6502ffa service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:56.026105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d0ef4e30-c260-4a89-88ec-38caffc33116 req-d15da707-9a2b-4e89-94fc-c0f4a6502ffa service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:56.026721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d0ef4e30-c260-4a89-88ec-38caffc33116 req-d15da707-9a2b-4e89-94fc-c0f4a6502ffa service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:56.046033 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-d0ef4e30-c260-4a89-88ec-38caffc33116 req-d15da707-9a2b-4e89-94fc-c0f4a6502ffa service nova] Creating event network-changed:e24a49b8-f412-493b-8773-37bc96951756 for instance 7d34640d-e769-4799-9215-b36526af8817 on n-h1-862964-3 Oct 29 01:15:56.057504 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-d0ef4e30-c260-4a89-88ec-38caffc33116 req-d15da707-9a2b-4e89-94fc-c0f4a6502ffa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.305445 Oct 29 01:15:56.057504 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1507/2881] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:15:56.064733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-351dc023-b324-4a1f-817a-cdffddffbda0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:56.066368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-351dc023-b324-4a1f-817a-cdffddffbda0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:56.075430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351dc023-b324-4a1f-817a-cdffddffbda0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:56.076325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351dc023-b324-4a1f-817a-cdffddffbda0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:56.077065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351dc023-b324-4a1f-817a-cdffddffbda0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:56.078178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351dc023-b324-4a1f-817a-cdffddffbda0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:56.079064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351dc023-b324-4a1f-817a-cdffddffbda0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:56.080163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351dc023-b324-4a1f-817a-cdffddffbda0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:56.098788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7e5c6c0b-d283-44e9-a154-a1d1d7038c35 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:56.107980 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e5c6c0b-d283-44e9-a154-a1d1d7038c35 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1322 microversion: 2.1 time: 0.754692 Oct 29 01:15:56.125817 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1375/2882] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:55 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1322 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:56.388713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-309c4410-0837-417e-8dd1-c4d97ca464a5 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:56.390412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-309c4410-0837-417e-8dd1-c4d97ca464a5 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:56.402225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-309c4410-0837-417e-8dd1-c4d97ca464a5 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:56.403484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-309c4410-0837-417e-8dd1-c4d97ca464a5 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:56.404049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-309c4410-0837-417e-8dd1-c4d97ca464a5 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:56.415693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-309c4410-0837-417e-8dd1-c4d97ca464a5 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:56.416160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-309c4410-0837-417e-8dd1-c4d97ca464a5 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:56.416626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-309c4410-0837-417e-8dd1-c4d97ca464a5 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:56.626956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-351dc023-b324-4a1f-817a-cdffddffbda0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:56.637405 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-351dc023-b324-4a1f-817a-cdffddffbda0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1324 microversion: 2.1 time: 0.580347 Oct 29 01:15:56.638119 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1508/2883] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:56 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1324 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:56.681048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-08d6b2f2-ffb1-44df-975a-ab119c97512c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:56.681048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-08d6b2f2-ffb1-44df-975a-ab119c97512c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:56.708770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08d6b2f2-ffb1-44df-975a-ab119c97512c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:56.710504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08d6b2f2-ffb1-44df-975a-ab119c97512c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:56.711131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08d6b2f2-ffb1-44df-975a-ab119c97512c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:56.718150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08d6b2f2-ffb1-44df-975a-ab119c97512c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:56.719037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08d6b2f2-ffb1-44df-975a-ab119c97512c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:56.719657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08d6b2f2-ffb1-44df-975a-ab119c97512c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:57.287468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-309c4410-0837-417e-8dd1-c4d97ca464a5 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:57.304640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-309c4410-0837-417e-8dd1-c4d97ca464a5 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:57.308517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-309c4410-0837-417e-8dd1-c4d97ca464a5 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:57.313282 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-309c4410-0837-417e-8dd1-c4d97ca464a5 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.927445 Oct 29 01:15:57.320070 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1376/2884] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:56 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:57.325375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e721be18-9d5f-4b8f-a030-32c423f42b9d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:57.326114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e721be18-9d5f-4b8f-a030-32c423f42b9d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:57.344069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e721be18-9d5f-4b8f-a030-32c423f42b9d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:57.344688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e721be18-9d5f-4b8f-a030-32c423f42b9d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:57.345226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e721be18-9d5f-4b8f-a030-32c423f42b9d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:57.346657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e721be18-9d5f-4b8f-a030-32c423f42b9d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:57.348473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e721be18-9d5f-4b8f-a030-32c423f42b9d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:57.350401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e721be18-9d5f-4b8f-a030-32c423f42b9d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:57.506608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-08d6b2f2-ffb1-44df-975a-ab119c97512c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:57.541685 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-08d6b2f2-ffb1-44df-975a-ab119c97512c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1473 microversion: 2.1 time: 0.896359 Oct 29 01:15:57.561237 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1509/2885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:56 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1473 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:57.663130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9f0e8117-b5ac-44ca-9422-a53eb8dfa58e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:57.664052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9f0e8117-b5ac-44ca-9422-a53eb8dfa58e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:57.679579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f0e8117-b5ac-44ca-9422-a53eb8dfa58e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:57.679579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f0e8117-b5ac-44ca-9422-a53eb8dfa58e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:57.679579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f0e8117-b5ac-44ca-9422-a53eb8dfa58e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:57.679855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f0e8117-b5ac-44ca-9422-a53eb8dfa58e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:57.680206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f0e8117-b5ac-44ca-9422-a53eb8dfa58e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:57.680640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f0e8117-b5ac-44ca-9422-a53eb8dfa58e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:57.742602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e721be18-9d5f-4b8f-a030-32c423f42b9d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:57.759149 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e721be18-9d5f-4b8f-a030-32c423f42b9d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1322 microversion: 2.1 time: 0.436825 Oct 29 01:15:57.783604 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1377/2886] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:57 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1322 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:57.980255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9f0e8117-b5ac-44ca-9422-a53eb8dfa58e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:57.993428 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9f0e8117-b5ac-44ca-9422-a53eb8dfa58e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1324 microversion: 2.1 time: 0.329920 Oct 29 01:15:58.001614 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1510/2887] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:57 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1324 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:15:58.344551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e010dd3-cd68-4e3e-8b1d-d094114840a1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:58.345192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7e010dd3-cd68-4e3e-8b1d-d094114840a1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:58.347092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:UPDATE=7 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:15:58.351960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e010dd3-cd68-4e3e-8b1d-d094114840a1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:58.352456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e010dd3-cd68-4e3e-8b1d-d094114840a1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:58.352895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e010dd3-cd68-4e3e-8b1d-d094114840a1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:58.355165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e010dd3-cd68-4e3e-8b1d-d094114840a1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:58.356146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e010dd3-cd68-4e3e-8b1d-d094114840a1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:58.356912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e010dd3-cd68-4e3e-8b1d-d094114840a1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:58.569117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2f3a6395-e738-42e7-b3e9-b254f2e3b3e2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:58.569842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2f3a6395-e738-42e7-b3e9-b254f2e3b3e2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:58.582097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f3a6395-e738-42e7-b3e9-b254f2e3b3e2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:58.582747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f3a6395-e738-42e7-b3e9-b254f2e3b3e2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:58.583667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f3a6395-e738-42e7-b3e9-b254f2e3b3e2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:58.584555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f3a6395-e738-42e7-b3e9-b254f2e3b3e2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:58.585028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f3a6395-e738-42e7-b3e9-b254f2e3b3e2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:58.586673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f3a6395-e738-42e7-b3e9-b254f2e3b3e2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:58.682814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7e010dd3-cd68-4e3e-8b1d-d094114840a1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:58.703208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7e010dd3-cd68-4e3e-8b1d-d094114840a1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:58.706611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7e010dd3-cd68-4e3e-8b1d-d094114840a1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:58.707952 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e010dd3-cd68-4e3e-8b1d-d094114840a1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.367911 Oct 29 01:15:58.713244 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1378/2888] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:15:58 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:15:58.785680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2e548d6f-6d26-4e89-a941-a379818e85b3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:58.786357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2e548d6f-6d26-4e89-a941-a379818e85b3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:58.800887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e548d6f-6d26-4e89-a941-a379818e85b3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:58.803162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e548d6f-6d26-4e89-a941-a379818e85b3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:58.803619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e548d6f-6d26-4e89-a941-a379818e85b3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:58.804357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e548d6f-6d26-4e89-a941-a379818e85b3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:58.804835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e548d6f-6d26-4e89-a941-a379818e85b3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:58.808981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e548d6f-6d26-4e89-a941-a379818e85b3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:58.814375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f3a6395-e738-42e7-b3e9-b254f2e3b3e2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:58.825058 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2f3a6395-e738-42e7-b3e9-b254f2e3b3e2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1473 microversion: 2.1 time: 0.259275 Oct 29 01:15:58.827939 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1511/2889] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:58 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1473 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:59.007595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2e548d6f-6d26-4e89-a941-a379818e85b3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:59.013208 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2e548d6f-6d26-4e89-a941-a379818e85b3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1517 microversion: 2.1 time: 0.233634 Oct 29 01:15:59.015665 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1379/2890] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:58 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1517 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:59.016475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2af44429-d3bf-4802-91b0-fed514170291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:59.017199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2af44429-d3bf-4802-91b0-fed514170291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:59.024164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2af44429-d3bf-4802-91b0-fed514170291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:59.024975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2af44429-d3bf-4802-91b0-fed514170291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:59.025654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2af44429-d3bf-4802-91b0-fed514170291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:59.026594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2af44429-d3bf-4802-91b0-fed514170291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:59.027265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2af44429-d3bf-4802-91b0-fed514170291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:59.028442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2af44429-d3bf-4802-91b0-fed514170291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:59.039169 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4ad55491-1b4a-4b92-9b4e-fe12b0bd74c5 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:59.041617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4ad55491-1b4a-4b92-9b4e-fe12b0bd74c5 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:59.048354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ad55491-1b4a-4b92-9b4e-fe12b0bd74c5 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:59.048847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ad55491-1b4a-4b92-9b4e-fe12b0bd74c5 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:59.049319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ad55491-1b4a-4b92-9b4e-fe12b0bd74c5 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:59.050033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ad55491-1b4a-4b92-9b4e-fe12b0bd74c5 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:59.050559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ad55491-1b4a-4b92-9b4e-fe12b0bd74c5 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:59.051099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ad55491-1b4a-4b92-9b4e-fe12b0bd74c5 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:59.130527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-4ad55491-1b4a-4b92-9b4e-fe12b0bd74c5 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lazy-loading 'flavor' on Instance uuid 919adddc-a598-47f8-9823-170d101dbdc8 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:15:59.316596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2af44429-d3bf-4802-91b0-fed514170291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:15:59.339666 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2af44429-d3bf-4802-91b0-fed514170291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1324 microversion: 2.1 time: 0.327446 Oct 29 01:15:59.343365 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1512/2891] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:59 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1324 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:15:59.349605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ddf026b3-769d-4138-948b-dcf6fa7fa500 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1771307706", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "67b36d90-dad1-40bd-bfb3-8b1fd00724d0"}, {"uuid": "5e89768e-6d21-4a26-9091-980252078aa1"}, {"uuid": "67b36d90-dad1-40bd-bfb3-8b1fd00724d0"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:15:59.484133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-ddf026b3-769d-4138-948b-dcf6fa7fa500 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] validate_networks() for [('67b36d90-dad1-40bd-bfb3-8b1fd00724d0', None, None, None, None, None), ('5e89768e-6d21-4a26-9091-980252078aa1', None, None, None, None, None), ('67b36d90-dad1-40bd-bfb3-8b1fd00724d0', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:15:59.666313 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4ad55491-1b4a-4b92-9b4e-fe12b0bd74c5 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "POST /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8/action" status: 200 len: 32 microversion: 2.1 time: 0.631218 Oct 29 01:15:59.667504 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1380/2892] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:15:59 2022] POST /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8/action => generated 32 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:15:59.678895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8b11f42c-608b-4204-a46a-7c3f98565bf8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:15:59.681032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8b11f42c-608b-4204-a46a-7c3f98565bf8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:15:59.696183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b11f42c-608b-4204-a46a-7c3f98565bf8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:59.696875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b11f42c-608b-4204-a46a-7c3f98565bf8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:59.698091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b11f42c-608b-4204-a46a-7c3f98565bf8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:15:59.713138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b11f42c-608b-4204-a46a-7c3f98565bf8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:15:59.714186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b11f42c-608b-4204-a46a-7c3f98565bf8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:15:59.714947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b11f42c-608b-4204-a46a-7c3f98565bf8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:00.189757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8b11f42c-608b-4204-a46a-7c3f98565bf8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:00.198275 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8b11f42c-608b-4204-a46a-7c3f98565bf8 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.524420 Oct 29 01:16:00.198864 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1381/2893] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:15:59 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:00.220310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6da15055-b970-47e3-9639-97ce037c8ce0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:00.220942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6da15055-b970-47e3-9639-97ce037c8ce0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:00.228803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6da15055-b970-47e3-9639-97ce037c8ce0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:00.231829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6da15055-b970-47e3-9639-97ce037c8ce0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:00.232951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6da15055-b970-47e3-9639-97ce037c8ce0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:00.236627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6da15055-b970-47e3-9639-97ce037c8ce0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:00.238151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6da15055-b970-47e3-9639-97ce037c8ce0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:00.239017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6da15055-b970-47e3-9639-97ce037c8ce0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:00.861661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=16,nova_cell0:UPDATE=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:01.859484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6da15055-b970-47e3-9639-97ce037c8ce0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:01.878844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6da15055-b970-47e3-9639-97ce037c8ce0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:01.885505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6da15055-b970-47e3-9639-97ce037c8ce0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:01.891320 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6da15055-b970-47e3-9639-97ce037c8ce0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 1.677968 Oct 29 01:16:01.893067 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1382/2894] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:00 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:01.904104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-30c84f4e-69b1-4f85-b6f1-35750da04a04 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:01.907054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-30c84f4e-69b1-4f85-b6f1-35750da04a04 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:01.925551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-30c84f4e-69b1-4f85-b6f1-35750da04a04 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:01.927696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-30c84f4e-69b1-4f85-b6f1-35750da04a04 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:01.929774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-30c84f4e-69b1-4f85-b6f1-35750da04a04 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:01.931788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-30c84f4e-69b1-4f85-b6f1-35750da04a04 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:01.935226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-30c84f4e-69b1-4f85-b6f1-35750da04a04 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:01.936012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-30c84f4e-69b1-4f85-b6f1-35750da04a04 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:01.949974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=14 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:02.308369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-30c84f4e-69b1-4f85-b6f1-35750da04a04 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:02.317776 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-30c84f4e-69b1-4f85-b6f1-35750da04a04 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1473 microversion: 2.1 time: 0.423395 Oct 29 01:16:02.318369 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1383/2895] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:01 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1473 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:02.331402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0798e441-67fc-4322-9dab-f894f6801291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:02.332217 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0798e441-67fc-4322-9dab-f894f6801291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:02.350721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0798e441-67fc-4322-9dab-f894f6801291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:02.351412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0798e441-67fc-4322-9dab-f894f6801291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:02.351848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0798e441-67fc-4322-9dab-f894f6801291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:02.352568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0798e441-67fc-4322-9dab-f894f6801291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:02.353021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0798e441-67fc-4322-9dab-f894f6801291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:02.353709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0798e441-67fc-4322-9dab-f894f6801291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:02.398664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ddf026b3-769d-4138-948b-dcf6fa7fa500 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:16:02.399270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ddf026b3-769d-4138-948b-dcf6fa7fa500 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:16:02.399550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ddf026b3-769d-4138-948b-dcf6fa7fa500 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:16:02.399959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ddf026b3-769d-4138-948b-dcf6fa7fa500 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:16:02.400490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ddf026b3-769d-4138-948b-dcf6fa7fa500 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:16:02.429987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ddf026b3-769d-4138-948b-dcf6fa7fa500 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:02.430481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ddf026b3-769d-4138-948b-dcf6fa7fa500 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:02.430927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ddf026b3-769d-4138-948b-dcf6fa7fa500 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:02.431671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ddf026b3-769d-4138-948b-dcf6fa7fa500 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:02.438817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ddf026b3-769d-4138-948b-dcf6fa7fa500 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:02.443206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ddf026b3-769d-4138-948b-dcf6fa7fa500 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:02.508076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-ddf026b3-769d-4138-948b-dcf6fa7fa500 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Getting quotas for project 677550341e2d495eb0ff2e343c286caa. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:16:02.527291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-ddf026b3-769d-4138-948b-dcf6fa7fa500 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Getting quotas for user 2eb4c4f2d60f4affbf6162bd6481f3a3 and project 677550341e2d495eb0ff2e343c286caa. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:16:02.573518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ddf026b3-769d-4138-948b-dcf6fa7fa500 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:16:02.582906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ddf026b3-769d-4138-948b-dcf6fa7fa500 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:16:02.636010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0798e441-67fc-4322-9dab-f894f6801291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:02.675034 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0798e441-67fc-4322-9dab-f894f6801291 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1324 microversion: 2.1 time: 0.353524 Oct 29 01:16:02.675677 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1384/2896] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:02 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1324 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:02.707278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b533e011-ecfc-460b-89db-e605d4f9b07d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:02.707924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b533e011-ecfc-460b-89db-e605d4f9b07d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:02.744923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b533e011-ecfc-460b-89db-e605d4f9b07d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:02.745744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b533e011-ecfc-460b-89db-e605d4f9b07d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:02.747647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b533e011-ecfc-460b-89db-e605d4f9b07d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:02.751899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b533e011-ecfc-460b-89db-e605d4f9b07d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:02.755021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b533e011-ecfc-460b-89db-e605d4f9b07d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:02.758808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b533e011-ecfc-460b-89db-e605d4f9b07d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:02.816738 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ddf026b3-769d-4138-948b-dcf6fa7fa500 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.472064 Oct 29 01:16:02.831552 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1513/2897] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:15:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:16:02.853635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-19db7d89-39b8-43d5-a0df-8f2e53b63020 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Calling method '.version_select at 0x7f9d96f9eca0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:02.946989 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-19db7d89-39b8-43d5-a0df-8f2e53b63020 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] 10.222.0.26 "GET /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02" status: 200 len: 636 microversion: 2.1 time: 0.112351 Oct 29 01:16:02.949764 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1514/2898] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:16:02 2022] GET /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02 => generated 636 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:02.973688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8b75f4a0-b27a-4021-a7bf-19ec5360ff79 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:02.975067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8b75f4a0-b27a-4021-a7bf-19ec5360ff79 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:03.143559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8b75f4a0-b27a-4021-a7bf-19ec5360ff79 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:03.159258 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8b75f4a0-b27a-4021-a7bf-19ec5360ff79 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1213 microversion: 2.1 time: 0.202854 Oct 29 01:16:03.161559 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1515/2899] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:02 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1213 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:03.168814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-275d47f0-4b5c-4f35-9456-d5b42544cf30 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:03.170459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-275d47f0-4b5c-4f35-9456-d5b42544cf30 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:03.179056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-275d47f0-4b5c-4f35-9456-d5b42544cf30 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:03.183390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-275d47f0-4b5c-4f35-9456-d5b42544cf30 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:03.183390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-275d47f0-4b5c-4f35-9456-d5b42544cf30 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:03.183390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-275d47f0-4b5c-4f35-9456-d5b42544cf30 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:03.183390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-275d47f0-4b5c-4f35-9456-d5b42544cf30 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:03.183390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-275d47f0-4b5c-4f35-9456-d5b42544cf30 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:03.203222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b533e011-ecfc-460b-89db-e605d4f9b07d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:03.219097 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b533e011-ecfc-460b-89db-e605d4f9b07d tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.534429 Oct 29 01:16:03.221367 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1385/2900] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:02 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:03.229965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-354ce2d1-bedd-40c0-a2aa-37ec09252a3c tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Action: 'update_all', calling method: .version_select at 0x7f9d97cae1f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:03.348168 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-354ce2d1-bedd-40c0-a2aa-37ec09252a3c tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Getting quotas for project ffb84789d7ae4dfeab222029f2db4086. Resources: dict_keys(['metadata_items']) {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:16:03.388296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-354ce2d1-bedd-40c0-a2aa-37ec09252a3c tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Getting quotas for user 1d460bc136fb4a618494dad6525323b6 and project ffb84789d7ae4dfeab222029f2db4086. Resources: dict_keys(['metadata_items']) {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:16:03.618058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-275d47f0-4b5c-4f35-9456-d5b42544cf30 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:03.637408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-275d47f0-4b5c-4f35-9456-d5b42544cf30 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:03.641788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-275d47f0-4b5c-4f35-9456-d5b42544cf30 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:03.646346 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-275d47f0-4b5c-4f35-9456-d5b42544cf30 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.483155 Oct 29 01:16:03.649390 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1516/2901] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:03 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:03.661065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a65509a3-1c6a-4ba1-b7bf-7b49d242ca4f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:03.666471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a65509a3-1c6a-4ba1-b7bf-7b49d242ca4f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:03.679925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a65509a3-1c6a-4ba1-b7bf-7b49d242ca4f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:03.680429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a65509a3-1c6a-4ba1-b7bf-7b49d242ca4f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:03.681067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a65509a3-1c6a-4ba1-b7bf-7b49d242ca4f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:03.681848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a65509a3-1c6a-4ba1-b7bf-7b49d242ca4f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:03.682305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a65509a3-1c6a-4ba1-b7bf-7b49d242ca4f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:03.682910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a65509a3-1c6a-4ba1-b7bf-7b49d242ca4f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:04.096237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a65509a3-1c6a-4ba1-b7bf-7b49d242ca4f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:04.111832 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a65509a3-1c6a-4ba1-b7bf-7b49d242ca4f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1473 microversion: 2.1 time: 0.460761 Oct 29 01:16:04.113757 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1517/2902] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:03 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1473 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:04.121883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a904c741-f449-44f9-af30-321f4a55a1d2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:04.123049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a904c741-f449-44f9-af30-321f4a55a1d2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:04.131394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a904c741-f449-44f9-af30-321f4a55a1d2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:04.133312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a904c741-f449-44f9-af30-321f4a55a1d2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:04.134048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a904c741-f449-44f9-af30-321f4a55a1d2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:04.135139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a904c741-f449-44f9-af30-321f4a55a1d2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:04.135956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a904c741-f449-44f9-af30-321f4a55a1d2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:04.137693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a904c741-f449-44f9-af30-321f4a55a1d2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:04.231633 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-354ce2d1-bedd-40c0-a2aa-37ec09252a3c tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] 10.222.0.26 "PUT /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata" status: 200 len: 61 microversion: 2.1 time: 1.008689 Oct 29 01:16:04.232796 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1386/2903] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:16:03 2022] PUT /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata => generated 61 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:16:04.242813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c63bc90e-a0fd-4418-81ce-f490b88082b0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:04.246638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c63bc90e-a0fd-4418-81ce-f490b88082b0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:04.366797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c63bc90e-a0fd-4418-81ce-f490b88082b0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:04.381916 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c63bc90e-a0fd-4418-81ce-f490b88082b0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1213 microversion: 2.1 time: 0.147812 Oct 29 01:16:04.382747 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1387/2904] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:04 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1213 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:04.462562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a904c741-f449-44f9-af30-321f4a55a1d2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:04.479399 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a904c741-f449-44f9-af30-321f4a55a1d2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1324 microversion: 2.1 time: 0.364009 Oct 29 01:16:04.493188 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1518/2905] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:04 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1324 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:04.493188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9e42756d-e575-4778-826a-4e2c87689d16 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Calling method '.version_select at 0x7f9d979eed30>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:04.605330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1a3561d8-a1ba-4180-9a6e-12db3adc7dd9 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-275828095", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": "none"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:04.727637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-1a3561d8-a1ba-4180-9a6e-12db3adc7dd9 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:16:04.729013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-1a3561d8-a1ba-4180-9a6e-12db3adc7dd9 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:16:04.729013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-1a3561d8-a1ba-4180-9a6e-12db3adc7dd9 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:16:04.729264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-1a3561d8-a1ba-4180-9a6e-12db3adc7dd9 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:16:04.729587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-1a3561d8-a1ba-4180-9a6e-12db3adc7dd9 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:16:04.763610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a3561d8-a1ba-4180-9a6e-12db3adc7dd9 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:04.764340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a3561d8-a1ba-4180-9a6e-12db3adc7dd9 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:04.765131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a3561d8-a1ba-4180-9a6e-12db3adc7dd9 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:04.766086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a3561d8-a1ba-4180-9a6e-12db3adc7dd9 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:04.766699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a3561d8-a1ba-4180-9a6e-12db3adc7dd9 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:04.767604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a3561d8-a1ba-4180-9a6e-12db3adc7dd9 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:04.794744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-1a3561d8-a1ba-4180-9a6e-12db3adc7dd9 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Getting quotas for project 81eb4814cf6748558e7a3bb61b792f0d. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:16:04.804635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-1a3561d8-a1ba-4180-9a6e-12db3adc7dd9 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Getting quotas for user 12935cbb311c44da9dbf2c827e297af8 and project 81eb4814cf6748558e7a3bb61b792f0d. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:16:04.821752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1a3561d8-a1ba-4180-9a6e-12db3adc7dd9 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:16:04.826071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1a3561d8-a1ba-4180-9a6e-12db3adc7dd9 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 11738ed9-de76-4b69-ab44-0844209dde02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:16:05.034923 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9e42756d-e575-4778-826a-4e2c87689d16 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] 10.222.0.26 "DELETE /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.552667 Oct 29 01:16:05.035917 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1519/2906] 10.222.0.26 () {58 vars in 1296 bytes} [Sat Oct 29 01:16:04 2022] DELETE /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata/os_version => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:16:05.040644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ce1be400-850a-4de9-928b-6c5af3c4b81c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:05.041631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ce1be400-850a-4de9-928b-6c5af3c4b81c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:05.049908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ce1be400-850a-4de9-928b-6c5af3c4b81c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:05.050406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ce1be400-850a-4de9-928b-6c5af3c4b81c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:05.050855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ce1be400-850a-4de9-928b-6c5af3c4b81c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:05.051582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ce1be400-850a-4de9-928b-6c5af3c4b81c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:05.052231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ce1be400-850a-4de9-928b-6c5af3c4b81c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:05.052836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ce1be400-850a-4de9-928b-6c5af3c4b81c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:05.089462 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1a3561d8-a1ba-4180-9a6e-12db3adc7dd9 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.705340 Oct 29 01:16:05.098553 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1388/2907] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 29 01:16:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 01:16:05.103794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3fd5e4de-a382-4f9b-a0b1-cd9dcc338b01 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:05.104407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3fd5e4de-a382-4f9b-a0b1-cd9dcc338b01 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:05.120033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3fd5e4de-a382-4f9b-a0b1-cd9dcc338b01 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:05.120450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3fd5e4de-a382-4f9b-a0b1-cd9dcc338b01 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:05.127249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3fd5e4de-a382-4f9b-a0b1-cd9dcc338b01 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:05.127249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3fd5e4de-a382-4f9b-a0b1-cd9dcc338b01 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:05.127249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3fd5e4de-a382-4f9b-a0b1-cd9dcc338b01 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:05.127249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3fd5e4de-a382-4f9b-a0b1-cd9dcc338b01 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:05.458330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ce1be400-850a-4de9-928b-6c5af3c4b81c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:05.472491 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ce1be400-850a-4de9-928b-6c5af3c4b81c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.435354 Oct 29 01:16:05.473085 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1520/2908] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:05 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:05.496280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-1d45a8fc-80af-4dc9-8cc1-4b171d867f23 req-9dca6374-2072-45ec-89cb-c183a89ed920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d34640d-e769-4799-9215-b36526af8817", "name": "network-vif-plugged", "status": "completed", "tag": "e24a49b8-f412-493b-8773-37bc96951756"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:05.515171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1d45a8fc-80af-4dc9-8cc1-4b171d867f23 req-9dca6374-2072-45ec-89cb-c183a89ed920 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:05.515659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1d45a8fc-80af-4dc9-8cc1-4b171d867f23 req-9dca6374-2072-45ec-89cb-c183a89ed920 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:05.516091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1d45a8fc-80af-4dc9-8cc1-4b171d867f23 req-9dca6374-2072-45ec-89cb-c183a89ed920 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:05.541423 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-1d45a8fc-80af-4dc9-8cc1-4b171d867f23 req-9dca6374-2072-45ec-89cb-c183a89ed920 service nova] Creating event network-vif-plugged:e24a49b8-f412-493b-8773-37bc96951756 for instance 7d34640d-e769-4799-9215-b36526af8817 on n-h1-862964-3 Oct 29 01:16:05.553438 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-1d45a8fc-80af-4dc9-8cc1-4b171d867f23 req-9dca6374-2072-45ec-89cb-c183a89ed920 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062465 Oct 29 01:16:05.556664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3fd5e4de-a382-4f9b-a0b1-cd9dcc338b01 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:05.557556 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1521/2909] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:05.571381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3fd5e4de-a382-4f9b-a0b1-cd9dcc338b01 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:05.571381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3fd5e4de-a382-4f9b-a0b1-cd9dcc338b01 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:05.571381 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3fd5e4de-a382-4f9b-a0b1-cd9dcc338b01 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.471009 Oct 29 01:16:05.571381 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1389/2910] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:05 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:05.574589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eb64fcd9-3c50-4b6e-a124-05f204bcb124 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Calling method '.version_select at 0x7f9d96f9e700>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:05.581720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c790a574-ae79-4843-9dfd-9ef6aee97d51 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:05.582499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c790a574-ae79-4843-9dfd-9ef6aee97d51 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 11738ed9-de76-4b69-ab44-0844209dde02] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:05.633283 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eb64fcd9-3c50-4b6e-a124-05f204bcb124 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] 10.222.0.26 "GET /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata" status: 200 len: 37 microversion: 2.1 time: 0.074051 Oct 29 01:16:05.635088 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1522/2911] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 29 01:16:05 2022] GET /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata => generated 37 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:16:05.646940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-11fe782d-635a-4f99-bb0c-75cd35f104a0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:05.648234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-11fe782d-635a-4f99-bb0c-75cd35f104a0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:05.656001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11fe782d-635a-4f99-bb0c-75cd35f104a0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:05.656710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11fe782d-635a-4f99-bb0c-75cd35f104a0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:05.657360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11fe782d-635a-4f99-bb0c-75cd35f104a0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:05.658073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11fe782d-635a-4f99-bb0c-75cd35f104a0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:05.658531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11fe782d-635a-4f99-bb0c-75cd35f104a0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:05.658960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11fe782d-635a-4f99-bb0c-75cd35f104a0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:05.678839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c790a574-ae79-4843-9dfd-9ef6aee97d51 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:05.690864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c790a574-ae79-4843-9dfd-9ef6aee97d51 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:05.692650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c790a574-ae79-4843-9dfd-9ef6aee97d51 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:05.693854 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c790a574-ae79-4843-9dfd-9ef6aee97d51 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/11738ed9-de76-4b69-ab44-0844209dde02" status: 200 len: 1277 microversion: 2.47 time: 0.121735 Oct 29 01:16:05.694617 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1390/2912] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:05 2022] GET /compute/v2.1/servers/11738ed9-de76-4b69-ab44-0844209dde02 => generated 1277 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:05.700013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3c1cb713-2502-4ec5-a549-4dea36347f9f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:05.700969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3c1cb713-2502-4ec5-a549-4dea36347f9f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:05.708831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c1cb713-2502-4ec5-a549-4dea36347f9f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:05.709656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c1cb713-2502-4ec5-a549-4dea36347f9f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:05.710360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c1cb713-2502-4ec5-a549-4dea36347f9f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:05.711072 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c1cb713-2502-4ec5-a549-4dea36347f9f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:05.711539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c1cb713-2502-4ec5-a549-4dea36347f9f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:05.711964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c1cb713-2502-4ec5-a549-4dea36347f9f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:05.853417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3c1cb713-2502-4ec5-a549-4dea36347f9f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:05.876065 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3c1cb713-2502-4ec5-a549-4dea36347f9f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1209 microversion: 2.1 time: 0.177882 Oct 29 01:16:05.876693 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1391/2913] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:05 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1209 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:05.912251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-11fe782d-635a-4f99-bb0c-75cd35f104a0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:05.928972 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-11fe782d-635a-4f99-bb0c-75cd35f104a0 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1473 microversion: 2.1 time: 0.292449 Oct 29 01:16:05.929779 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1523/2914] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:05 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1473 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:05.950269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-76783785-155d-4047-9066-9ad316cb8bad tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:05.951191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-76783785-155d-4047-9066-9ad316cb8bad tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:05.959140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76783785-155d-4047-9066-9ad316cb8bad tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:05.959754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76783785-155d-4047-9066-9ad316cb8bad tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:05.960787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76783785-155d-4047-9066-9ad316cb8bad tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:05.961807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76783785-155d-4047-9066-9ad316cb8bad tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:05.962602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76783785-155d-4047-9066-9ad316cb8bad tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:05.963390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76783785-155d-4047-9066-9ad316cb8bad tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:05.982734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f51cf524-3736-4c50-8ff2-94abb4a6c7ba tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-677524850", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "cf6aad5d-0be8-4512-b7f4-3cb1f0efd9d9"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:06.052963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-f51cf524-3736-4c50-8ff2-94abb4a6c7ba tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] validate_networks() for [('cf6aad5d-0be8-4512-b7f4-3cb1f0efd9d9', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:16:06.243625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-76783785-155d-4047-9066-9ad316cb8bad tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:06.264945 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-76783785-155d-4047-9066-9ad316cb8bad tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1324 microversion: 2.1 time: 0.323767 Oct 29 01:16:06.264945 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1524/2915] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:05 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1324 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:06.271156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-af826b69-7f81-40f8-9e61-47bcb5ad5e22 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Action: 'update_all', calling method: .version_select at 0x7f9d9779cee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:06.332662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-af826b69-7f81-40f8-9e61-47bcb5ad5e22 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Getting quotas for project ffb84789d7ae4dfeab222029f2db4086. Resources: dict_keys(['metadata_items']) {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:16:06.346367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-af826b69-7f81-40f8-9e61-47bcb5ad5e22 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Getting quotas for user 1d460bc136fb4a618494dad6525323b6 and project ffb84789d7ae4dfeab222029f2db4086. Resources: dict_keys(['metadata_items']) {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:16:06.767117 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-af826b69-7f81-40f8-9e61-47bcb5ad5e22 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] 10.222.0.26 "PUT /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata" status: 200 len: 61 microversion: 2.1 time: 0.502516 Oct 29 01:16:06.768838 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1525/2916] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:16:06 2022] PUT /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata => generated 61 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:16:06.778228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e8a59e73-c1da-4bab-8cd8-fb356517de86 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2040687048", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": "none"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:06.781307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f51cf524-3736-4c50-8ff2-94abb4a6c7ba tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:16:06.781811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f51cf524-3736-4c50-8ff2-94abb4a6c7ba tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:16:06.796859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f51cf524-3736-4c50-8ff2-94abb4a6c7ba tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:16:06.798170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f51cf524-3736-4c50-8ff2-94abb4a6c7ba tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:16:06.799180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f51cf524-3736-4c50-8ff2-94abb4a6c7ba tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:16:06.829692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f51cf524-3736-4c50-8ff2-94abb4a6c7ba tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:06.830330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f51cf524-3736-4c50-8ff2-94abb4a6c7ba tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:06.834941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f51cf524-3736-4c50-8ff2-94abb4a6c7ba tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:06.836881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f51cf524-3736-4c50-8ff2-94abb4a6c7ba tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:06.836881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f51cf524-3736-4c50-8ff2-94abb4a6c7ba tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:06.837650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f51cf524-3736-4c50-8ff2-94abb4a6c7ba tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:06.849342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e8a59e73-c1da-4bab-8cd8-fb356517de86 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:16:06.850002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e8a59e73-c1da-4bab-8cd8-fb356517de86 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:16:06.852303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e8a59e73-c1da-4bab-8cd8-fb356517de86 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:16:06.852888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e8a59e73-c1da-4bab-8cd8-fb356517de86 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:16:06.853521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e8a59e73-c1da-4bab-8cd8-fb356517de86 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:16:06.868746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8a59e73-c1da-4bab-8cd8-fb356517de86 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:06.869956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8a59e73-c1da-4bab-8cd8-fb356517de86 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:06.870921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8a59e73-c1da-4bab-8cd8-fb356517de86 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:06.872783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8a59e73-c1da-4bab-8cd8-fb356517de86 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:06.873504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8a59e73-c1da-4bab-8cd8-fb356517de86 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:06.874093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8a59e73-c1da-4bab-8cd8-fb356517de86 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:06.895429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-e8a59e73-c1da-4bab-8cd8-fb356517de86 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Getting quotas for project 81eb4814cf6748558e7a3bb61b792f0d. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:16:06.901650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-e8a59e73-c1da-4bab-8cd8-fb356517de86 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Getting quotas for user 12935cbb311c44da9dbf2c827e297af8 and project 81eb4814cf6748558e7a3bb61b792f0d. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:16:06.905360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=7,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:06.920131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e8a59e73-c1da-4bab-8cd8-fb356517de86 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:16:06.923831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e8a59e73-c1da-4bab-8cd8-fb356517de86 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:16:06.924745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-f51cf524-3736-4c50-8ff2-94abb4a6c7ba tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Getting quotas for project fe3d614a2f6f48c9b3c495b5c79f2ae2. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:16:06.934556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-f51cf524-3736-4c50-8ff2-94abb4a6c7ba tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Getting quotas for user ff8c558bdbb445a484065b9b16fe38ac and project fe3d614a2f6f48c9b3c495b5c79f2ae2. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:16:06.974289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f51cf524-3736-4c50-8ff2-94abb4a6c7ba tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:16:06.976623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f51cf524-3736-4c50-8ff2-94abb4a6c7ba tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:16:07.144436 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e8a59e73-c1da-4bab-8cd8-fb356517de86 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.374346 Oct 29 01:16:07.145608 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1526/2917] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 29 01:16:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 01:16:07.150442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f6320ec2-e90f-438c-87e6-a83e6e7fd04b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:07.151052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f6320ec2-e90f-438c-87e6-a83e6e7fd04b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:07.159772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6320ec2-e90f-438c-87e6-a83e6e7fd04b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:07.160305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6320ec2-e90f-438c-87e6-a83e6e7fd04b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:07.160744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6320ec2-e90f-438c-87e6-a83e6e7fd04b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:07.162161 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6320ec2-e90f-438c-87e6-a83e6e7fd04b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:07.162628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6320ec2-e90f-438c-87e6-a83e6e7fd04b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:07.163065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6320ec2-e90f-438c-87e6-a83e6e7fd04b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:07.204078 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f51cf524-3736-4c50-8ff2-94abb4a6c7ba tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.304797 Oct 29 01:16:07.225494 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1392/2918] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 29 01:16:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1345 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 01:16:07.235341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-754915aa-3244-4e8c-a68b-3abe1aa2f833 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:07.238324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-754915aa-3244-4e8c-a68b-3abe1aa2f833 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:07.260432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-754915aa-3244-4e8c-a68b-3abe1aa2f833 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:07.262281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-754915aa-3244-4e8c-a68b-3abe1aa2f833 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:07.262856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-754915aa-3244-4e8c-a68b-3abe1aa2f833 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:07.265565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-754915aa-3244-4e8c-a68b-3abe1aa2f833 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:07.266298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-754915aa-3244-4e8c-a68b-3abe1aa2f833 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:07.269204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-754915aa-3244-4e8c-a68b-3abe1aa2f833 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:07.275613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:07.577958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f6320ec2-e90f-438c-87e6-a83e6e7fd04b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:07.598579 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f6320ec2-e90f-438c-87e6-a83e6e7fd04b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.451831 Oct 29 01:16:07.600438 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1527/2919] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:07 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:07.620602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5bd78534-b8ad-4228-b382-d6aa8375cca7 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Calling method '.version_select at 0x7f9d978fa8b0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:07.710149 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5bd78534-b8ad-4228-b382-d6aa8375cca7 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] 10.222.0.26 "GET /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.101342 Oct 29 01:16:07.710149 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1528/2920] 10.222.0.26 () {58 vars in 1290 bytes} [Sat Oct 29 01:16:07 2022] GET /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata/os_distro => generated 33 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:16:07.718394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0f019422-fc04-46e4-941f-7269f229400e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:07.720208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0f019422-fc04-46e4-941f-7269f229400e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:07.729055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f019422-fc04-46e4-941f-7269f229400e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:07.736036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f019422-fc04-46e4-941f-7269f229400e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:07.736539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f019422-fc04-46e4-941f-7269f229400e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:07.740783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f019422-fc04-46e4-941f-7269f229400e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:07.741313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f019422-fc04-46e4-941f-7269f229400e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:07.741759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f019422-fc04-46e4-941f-7269f229400e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:07.771661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-754915aa-3244-4e8c-a68b-3abe1aa2f833 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:07.795125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-754915aa-3244-4e8c-a68b-3abe1aa2f833 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:07.797464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-754915aa-3244-4e8c-a68b-3abe1aa2f833 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:07.801112 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-754915aa-3244-4e8c-a68b-3abe1aa2f833 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.577671 Oct 29 01:16:07.804187 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1393/2921] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:07 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:07.823322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3a4b0a9f-9177-4b6e-9964-86f80115e7c5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:07.824625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3a4b0a9f-9177-4b6e-9964-86f80115e7c5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:07.833475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a4b0a9f-9177-4b6e-9964-86f80115e7c5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:07.833475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a4b0a9f-9177-4b6e-9964-86f80115e7c5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:07.833475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a4b0a9f-9177-4b6e-9964-86f80115e7c5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:07.833762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a4b0a9f-9177-4b6e-9964-86f80115e7c5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:07.835130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a4b0a9f-9177-4b6e-9964-86f80115e7c5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:07.835130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a4b0a9f-9177-4b6e-9964-86f80115e7c5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:07.869610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0f019422-fc04-46e4-941f-7269f229400e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:07.881106 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0f019422-fc04-46e4-941f-7269f229400e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1271 microversion: 2.1 time: 0.175792 Oct 29 01:16:07.882662 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1529/2922] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:07 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1271 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:07.889430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-de919abb-fffd-442c-a907-8b6e02bd2790 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:07.892657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-de919abb-fffd-442c-a907-8b6e02bd2790 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:07.971337 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-de919abb-fffd-442c-a907-8b6e02bd2790 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "PUT /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 992 microversion: 2.47 time: 0.086820 Oct 29 01:16:07.977000 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1530/2923] 10.222.0.26 () {62 vars in 1297 bytes} [Sat Oct 29 01:16:07 2022] PUT /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 992 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:16:07.989923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-151429ec-e0b1-4c90-8fc9-3e4764720694 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:07.990755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-151429ec-e0b1-4c90-8fc9-3e4764720694 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:08.059628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3a4b0a9f-9177-4b6e-9964-86f80115e7c5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:08.067936 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3a4b0a9f-9177-4b6e-9964-86f80115e7c5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1473 microversion: 2.1 time: 0.262306 Oct 29 01:16:08.069033 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1394/2924] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:07 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1473 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:08.074455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3d9cc7c5-320e-4059-924a-8285573b2076 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:08.075090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3d9cc7c5-320e-4059-924a-8285573b2076 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:08.084570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d9cc7c5-320e-4059-924a-8285573b2076 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:08.085554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d9cc7c5-320e-4059-924a-8285573b2076 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:08.086250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d9cc7c5-320e-4059-924a-8285573b2076 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:08.087040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d9cc7c5-320e-4059-924a-8285573b2076 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:08.087596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d9cc7c5-320e-4059-924a-8285573b2076 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:08.088101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d9cc7c5-320e-4059-924a-8285573b2076 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:08.111842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-151429ec-e0b1-4c90-8fc9-3e4764720694 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:08.124043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-151429ec-e0b1-4c90-8fc9-3e4764720694 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:08.127306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-151429ec-e0b1-4c90-8fc9-3e4764720694 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:08.128477 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-151429ec-e0b1-4c90-8fc9-3e4764720694 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1258 microversion: 2.21 time: 0.149785 Oct 29 01:16:08.133899 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1531/2925] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:07 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:08.146076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-09866ffd-f32c-4d0c-97d1-a218fc7ae1b2 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Action: 'update_all', calling method: .version_select at 0x7f9d977d6f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:08.281486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-09866ffd-f32c-4d0c-97d1-a218fc7ae1b2 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Getting quotas for project ffb84789d7ae4dfeab222029f2db4086. Resources: dict_keys(['metadata_items']) {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:16:08.297128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-09866ffd-f32c-4d0c-97d1-a218fc7ae1b2 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Getting quotas for user 1d460bc136fb4a618494dad6525323b6 and project ffb84789d7ae4dfeab222029f2db4086. Resources: dict_keys(['metadata_items']) {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:16:08.372209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3d9cc7c5-320e-4059-924a-8285573b2076 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:08.383578 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3d9cc7c5-320e-4059-924a-8285573b2076 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1521 microversion: 2.1 time: 0.312352 Oct 29 01:16:08.384077 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1395/2926] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:08 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:08.390329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0285e898-cc75-4529-820e-f5dc9524af11 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:08.391020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0285e898-cc75-4529-820e-f5dc9524af11 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:08.499893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0285e898-cc75-4529-820e-f5dc9524af11 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:08.529530 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-09866ffd-f32c-4d0c-97d1-a218fc7ae1b2 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] 10.222.0.26 "PUT /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata" status: 200 len: 61 microversion: 2.1 time: 0.393894 Oct 29 01:16:08.530295 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1532/2927] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:16:08 2022] PUT /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata => generated 61 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:16:08.538632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a65190ff-7d3b-4b2e-b788-41591d335fae tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:08.539509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0285e898-cc75-4529-820e-f5dc9524af11 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:08.544544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a65190ff-7d3b-4b2e-b788-41591d335fae tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:08.545573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0285e898-cc75-4529-820e-f5dc9524af11 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:08.551498 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0285e898-cc75-4529-820e-f5dc9524af11 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1278 microversion: 2.47 time: 0.163673 Oct 29 01:16:08.553699 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1396/2928] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:08 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:08.566823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2072ebe4-0248-405e-9cc9-bc623e2f1396 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Calling method '.version_select at 0x7f9d9fd2f3a0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:08.570060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a65190ff-7d3b-4b2e-b788-41591d335fae tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:08.570694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a65190ff-7d3b-4b2e-b788-41591d335fae tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:08.571394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a65190ff-7d3b-4b2e-b788-41591d335fae tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:08.573148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a65190ff-7d3b-4b2e-b788-41591d335fae tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:08.573825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a65190ff-7d3b-4b2e-b788-41591d335fae tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:08.575076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a65190ff-7d3b-4b2e-b788-41591d335fae tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:08.611663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:08.656215 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2072ebe4-0248-405e-9cc9-bc623e2f1396 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] 10.222.0.26 "GET /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata" status: 200 len: 61 microversion: 2.1 time: 0.099568 Oct 29 01:16:08.664904 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1397/2929] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 29 01:16:08 2022] GET /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata => generated 61 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:16:08.674144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-99125a00-aa1a-487c-9fcf-5e50e8b96a67 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:08.674765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-99125a00-aa1a-487c-9fcf-5e50e8b96a67 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:08.692407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99125a00-aa1a-487c-9fcf-5e50e8b96a67 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:08.694600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99125a00-aa1a-487c-9fcf-5e50e8b96a67 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:08.695546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99125a00-aa1a-487c-9fcf-5e50e8b96a67 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:08.696487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99125a00-aa1a-487c-9fcf-5e50e8b96a67 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:08.697137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99125a00-aa1a-487c-9fcf-5e50e8b96a67 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:08.698553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99125a00-aa1a-487c-9fcf-5e50e8b96a67 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:08.882464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a65190ff-7d3b-4b2e-b788-41591d335fae tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:08.898383 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a65190ff-7d3b-4b2e-b788-41591d335fae tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1521 microversion: 2.1 time: 0.366371 Oct 29 01:16:08.899477 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1533/2930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:08 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:08.906985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-be6f5b79-b35d-4bdc-82a1-541b8d891e0b tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Action: 'update_all', calling method: .version_select at 0x7f9d9797b670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:08.945327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-99125a00-aa1a-487c-9fcf-5e50e8b96a67 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:08.957455 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-99125a00-aa1a-487c-9fcf-5e50e8b96a67 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.289744 Oct 29 01:16:08.958466 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1398/2931] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:08 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:08.963074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-05292c0c-db5f-447b-be81-a5af48d9ec28 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:08.963677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-05292c0c-db5f-447b-be81-a5af48d9ec28 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:08.970125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-05292c0c-db5f-447b-be81-a5af48d9ec28 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:08.970729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-05292c0c-db5f-447b-be81-a5af48d9ec28 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:08.971166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-05292c0c-db5f-447b-be81-a5af48d9ec28 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:08.971867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-05292c0c-db5f-447b-be81-a5af48d9ec28 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:08.972304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-05292c0c-db5f-447b-be81-a5af48d9ec28 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:08.972979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-05292c0c-db5f-447b-be81-a5af48d9ec28 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:09.435844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-be6f5b79-b35d-4bdc-82a1-541b8d891e0b tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Getting quotas for project ffb84789d7ae4dfeab222029f2db4086. Resources: dict_keys(['metadata_items']) {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:16:09.435844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-be6f5b79-b35d-4bdc-82a1-541b8d891e0b tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Getting quotas for user 1d460bc136fb4a618494dad6525323b6 and project ffb84789d7ae4dfeab222029f2db4086. Resources: dict_keys(['metadata_items']) {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:16:09.438116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-05292c0c-db5f-447b-be81-a5af48d9ec28 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:09.438116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-05292c0c-db5f-447b-be81-a5af48d9ec28 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:09.438116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-05292c0c-db5f-447b-be81-a5af48d9ec28 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:09.438116 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-05292c0c-db5f-447b-be81-a5af48d9ec28 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.230865 Oct 29 01:16:09.438116 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1399/2932] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:08 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:09.485180 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-be6f5b79-b35d-4bdc-82a1-541b8d891e0b tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] 10.222.0.26 "PUT /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata" status: 200 len: 61 microversion: 2.1 time: 0.291290 Oct 29 01:16:09.485180 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1534/2933] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:16:08 2022] PUT /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata => generated 61 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:16:09.486975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d4bcf199-71d5-4e94-8846-e1e631555821 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:09.486975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d4bcf199-71d5-4e94-8846-e1e631555821 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:09.487573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7aa2ef9f-0cc8-420a-94f7-99bf3d5a87bc tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1463170400"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:09.487573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7aa2ef9f-0cc8-420a-94f7-99bf3d5a87bc tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:09.488388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4bcf199-71d5-4e94-8846-e1e631555821 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:09.488388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4bcf199-71d5-4e94-8846-e1e631555821 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:09.488388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4bcf199-71d5-4e94-8846-e1e631555821 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:09.488388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4bcf199-71d5-4e94-8846-e1e631555821 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:09.488388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4bcf199-71d5-4e94-8846-e1e631555821 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:09.489310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7aa2ef9f-0cc8-420a-94f7-99bf3d5a87bc tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:09.489915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4bcf199-71d5-4e94-8846-e1e631555821 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:09.490347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7aa2ef9f-0cc8-420a-94f7-99bf3d5a87bc tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:09.490347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7aa2ef9f-0cc8-420a-94f7-99bf3d5a87bc tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:09.490347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7aa2ef9f-0cc8-420a-94f7-99bf3d5a87bc tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:09.490347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7aa2ef9f-0cc8-420a-94f7-99bf3d5a87bc tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:09.490347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7aa2ef9f-0cc8-420a-94f7-99bf3d5a87bc tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:09.491010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d4bcf199-71d5-4e94-8846-e1e631555821 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:09.491010 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d4bcf199-71d5-4e94-8846-e1e631555821 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1313 microversion: 2.1 time: 0.166412 Oct 29 01:16:09.491010 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1400/2934] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:09 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:09.491010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d57c99fa-265f-403f-b2bb-e2f0bdeb4c2f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:09.491010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d57c99fa-265f-403f-b2bb-e2f0bdeb4c2f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:09.491010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d57c99fa-265f-403f-b2bb-e2f0bdeb4c2f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:09.491010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d57c99fa-265f-403f-b2bb-e2f0bdeb4c2f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:09.491010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d57c99fa-265f-403f-b2bb-e2f0bdeb4c2f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:09.491010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d57c99fa-265f-403f-b2bb-e2f0bdeb4c2f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:09.491010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d57c99fa-265f-403f-b2bb-e2f0bdeb4c2f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:09.491010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d57c99fa-265f-403f-b2bb-e2f0bdeb4c2f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:09.511951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d57c99fa-265f-403f-b2bb-e2f0bdeb4c2f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:09.520109 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d57c99fa-265f-403f-b2bb-e2f0bdeb4c2f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1473 microversion: 2.1 time: 0.159132 Oct 29 01:16:09.520680 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1401/2935] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:09 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1473 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:09.525210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d03ce476-6a2a-43e0-8924-7ebdc69a6600 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:09.525810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d03ce476-6a2a-43e0-8924-7ebdc69a6600 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:09.588229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d03ce476-6a2a-43e0-8924-7ebdc69a6600 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:09.594187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d03ce476-6a2a-43e0-8924-7ebdc69a6600 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:09.595989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d03ce476-6a2a-43e0-8924-7ebdc69a6600 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:09.597867 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d03ce476-6a2a-43e0-8924-7ebdc69a6600 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1258 microversion: 2.21 time: 0.075970 Oct 29 01:16:09.610444 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1402/2936] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:09 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1258 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:09.618335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-405708bf-dc89-41dc-8198-6c8391752faa tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Action: 'update_all', calling method: .version_select at 0x7f9d9fd2f4c0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:09.689229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-405708bf-dc89-41dc-8198-6c8391752faa tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Getting quotas for project ffb84789d7ae4dfeab222029f2db4086. Resources: dict_keys(['metadata_items']) {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:16:09.695727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-405708bf-dc89-41dc-8198-6c8391752faa tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Getting quotas for user 1d460bc136fb4a618494dad6525323b6 and project ffb84789d7ae4dfeab222029f2db4086. Resources: dict_keys(['metadata_items']) {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:16:09.846879 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7aa2ef9f-0cc8-420a-94f7-99bf3d5a87bc tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "POST /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817/action" status: 202 len: 0 microversion: 2.1 time: 0.651134 Oct 29 01:16:09.846879 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1535/2937] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:16:09 2022] POST /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 01:16:09.853821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b0e26c3b-24a0-46a9-8ddc-17193fa703fd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:09.854836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b0e26c3b-24a0-46a9-8ddc-17193fa703fd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:09.875395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0e26c3b-24a0-46a9-8ddc-17193fa703fd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:09.880128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0e26c3b-24a0-46a9-8ddc-17193fa703fd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:09.880128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0e26c3b-24a0-46a9-8ddc-17193fa703fd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:09.880128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0e26c3b-24a0-46a9-8ddc-17193fa703fd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:09.880128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0e26c3b-24a0-46a9-8ddc-17193fa703fd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:09.880128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0e26c3b-24a0-46a9-8ddc-17193fa703fd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:09.988733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b0e26c3b-24a0-46a9-8ddc-17193fa703fd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:10.002979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b0e26c3b-24a0-46a9-8ddc-17193fa703fd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:10.005425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b0e26c3b-24a0-46a9-8ddc-17193fa703fd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:10.011382 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b0e26c3b-24a0-46a9-8ddc-17193fa703fd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1274 microversion: 2.47 time: 0.162176 Oct 29 01:16:10.012755 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1536/2938] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:09 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1274 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:10.023959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-90b8c9a7-a4cc-475f-a752-2acc24f9fb97 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '.version_select at 0x7f9d9779c670>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:10.291828 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-405708bf-dc89-41dc-8198-6c8391752faa tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] 10.222.0.26 "PUT /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata" status: 200 len: 64 microversion: 2.1 time: 0.679542 Oct 29 01:16:10.294619 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1403/2939] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:16:09 2022] PUT /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata => generated 64 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:16:10.306211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4cc5bb71-625c-4808-8381-73e8a024c032 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:10.306211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4cc5bb71-625c-4808-8381-73e8a024c032 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:10.308095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cc5bb71-625c-4808-8381-73e8a024c032 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:10.308672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cc5bb71-625c-4808-8381-73e8a024c032 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:10.309616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cc5bb71-625c-4808-8381-73e8a024c032 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:10.310396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cc5bb71-625c-4808-8381-73e8a024c032 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:10.310939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cc5bb71-625c-4808-8381-73e8a024c032 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:10.311668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cc5bb71-625c-4808-8381-73e8a024c032 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:10.395779 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-90b8c9a7-a4cc-475f-a752-2acc24f9fb97 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "DELETE /compute/v2.1/images/d926c697-9eb7-493b-ba15-80e5f2762767" status: 204 len: 0 microversion: 2.1 time: 0.381638 Oct 29 01:16:10.396454 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1537/2940] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:10 2022] DELETE /compute/v2.1/images/d926c697-9eb7-493b-ba15-80e5f2762767 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:16:10.406012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4c05a284-57bd-4856-b5b7-3192c42cf167 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Calling method '.version_select at 0x7f9d9778cf70>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:10.462523 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4c05a284-57bd-4856-b5b7-3192c42cf167 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] 10.222.0.26 "GET /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata" status: 200 len: 64 microversion: 2.1 time: 0.064941 Oct 29 01:16:10.463757 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1538/2941] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 29 01:16:10 2022] GET /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata => generated 64 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:16:10.480036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-be83e8d3-e884-4287-b183-a03ca6f1f1f2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '.version_select at 0x7f9d9779ce50>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:10.506651 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-be83e8d3-e884-4287-b183-a03ca6f1f1f2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] HTTP exception thrown: Image not found. Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-be83e8d3-e884-4287-b183-a03ca6f1f1f2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Request method failure captured: Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/images/d926c697-9eb7-493b-ba15-80e5f2762767 HTTP/1.1 Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH6CzaWy1ufa72id6aheZbBREgQ1G2SbUhEpvcj_QTDF--UNn0kMcxBhslM6smsky4izROjyCZSxF91rcQGlVQlVrhfbQfHOyxM9K_r3ikSiecmNSXh8mpJTcen08ouic-cdYaYkhVKjr1CpS6bd1t3acwqY6OPH7aEAkOLl4egaxt8 Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_328d1dd53c6a4bc2b14376dd1a1cecb6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: b89f11ebd96141a5afe08dad79b0b20c Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: exception: Image not found. Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'd926c697-9eb7-493b-ba15-80e5f2762767'} Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d926c697-9eb7-493b-ba15-80e5f2762767 Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 01:16:10.508891 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d926c697-9eb7-493b-ba15-80e5f2762767 could not be found. Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-be83e8d3-e884-4287-b183-a03ca6f1f1f2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Returning 404 to user: Image not found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-be83e8d3-e884-4287-b183-a03ca6f1f1f2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/images/d926c697-9eb7-493b-ba15-80e5f2762767" status: 404 len: 62 microversion: 2.1 time: 0.045813 Oct 29 01:16:10.518430 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1539/2942] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:16:10 2022] GET /compute/v2.1/images/d926c697-9eb7-493b-ba15-80e5f2762767 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:16:10.531540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d3154838-9602-4463-b9f1-557d83e7e7c9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:10.532521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d3154838-9602-4463-b9f1-557d83e7e7c9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:10.548901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3154838-9602-4463-b9f1-557d83e7e7c9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:10.551268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3154838-9602-4463-b9f1-557d83e7e7c9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:10.551558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3154838-9602-4463-b9f1-557d83e7e7c9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:10.554631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3154838-9602-4463-b9f1-557d83e7e7c9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:10.555386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3154838-9602-4463-b9f1-557d83e7e7c9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:10.556016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3154838-9602-4463-b9f1-557d83e7e7c9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:10.568817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4cc5bb71-625c-4808-8381-73e8a024c032 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:10.576427 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4cc5bb71-625c-4808-8381-73e8a024c032 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.280402 Oct 29 01:16:10.579394 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1404/2943] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:10 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:10.584230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-58c55b34-f583-4356-ae24-a2820d21cd6a tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Action: 'update_all', calling method: .version_select at 0x7f9d9fd8d430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:10.653088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:10.670792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-58c55b34-f583-4356-ae24-a2820d21cd6a tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Getting quotas for project ffb84789d7ae4dfeab222029f2db4086. Resources: dict_keys(['metadata_items']) {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:16:10.682356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-58c55b34-f583-4356-ae24-a2820d21cd6a tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Getting quotas for user 1d460bc136fb4a618494dad6525323b6 and project ffb84789d7ae4dfeab222029f2db4086. Resources: dict_keys(['metadata_items']) {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:16:10.913515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d3154838-9602-4463-b9f1-557d83e7e7c9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:10.926983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d3154838-9602-4463-b9f1-557d83e7e7c9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:10.936982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d3154838-9602-4463-b9f1-557d83e7e7c9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:10.944053 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d3154838-9602-4463-b9f1-557d83e7e7c9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.422270 Oct 29 01:16:10.946063 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1540/2944] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:10 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:10.955673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f61142da-b652-44a1-902e-a1ec59de0e8a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:10.960355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f61142da-b652-44a1-902e-a1ec59de0e8a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:10.964773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f61142da-b652-44a1-902e-a1ec59de0e8a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:10.965683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f61142da-b652-44a1-902e-a1ec59de0e8a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:10.966524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f61142da-b652-44a1-902e-a1ec59de0e8a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:10.967476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f61142da-b652-44a1-902e-a1ec59de0e8a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:10.968099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f61142da-b652-44a1-902e-a1ec59de0e8a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:10.968774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f61142da-b652-44a1-902e-a1ec59de0e8a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:11.205811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f61142da-b652-44a1-902e-a1ec59de0e8a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:11.223827 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f61142da-b652-44a1-902e-a1ec59de0e8a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1355 microversion: 2.1 time: 0.266654 Oct 29 01:16:11.223827 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1541/2945] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:10 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1355 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:11.223827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8202050d-39e3-4f87-a183-f76946902c67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:11.223827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8202050d-39e3-4f87-a183-f76946902c67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:11.231420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8202050d-39e3-4f87-a183-f76946902c67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:11.232062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8202050d-39e3-4f87-a183-f76946902c67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:11.232499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8202050d-39e3-4f87-a183-f76946902c67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:11.233411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8202050d-39e3-4f87-a183-f76946902c67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:11.234028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8202050d-39e3-4f87-a183-f76946902c67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:11.234516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8202050d-39e3-4f87-a183-f76946902c67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:11.249526 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-58c55b34-f583-4356-ae24-a2820d21cd6a tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] 10.222.0.26 "PUT /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata" status: 200 len: 61 microversion: 2.1 time: 0.668780 Oct 29 01:16:11.250124 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1405/2946] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:16:10 2022] PUT /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata => generated 61 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:16:11.255415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f5404377-d522-48a0-9332-4527cd072bf8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:11.256032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f5404377-d522-48a0-9332-4527cd072bf8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:11.263385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5404377-d522-48a0-9332-4527cd072bf8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:11.263878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5404377-d522-48a0-9332-4527cd072bf8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:11.264304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5404377-d522-48a0-9332-4527cd072bf8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:11.265009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5404377-d522-48a0-9332-4527cd072bf8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:11.265507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5404377-d522-48a0-9332-4527cd072bf8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:11.265920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5404377-d522-48a0-9332-4527cd072bf8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:11.478399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8202050d-39e3-4f87-a183-f76946902c67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:11.489411 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8202050d-39e3-4f87-a183-f76946902c67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1533 microversion: 2.1 time: 0.272827 Oct 29 01:16:11.490077 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1542/2947] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:11 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1533 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:11.494471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f5404377-d522-48a0-9332-4527cd072bf8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:11.496986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2606bf62-0014-4f26-ab99-557ba1afe692 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:11.497866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2606bf62-0014-4f26-ab99-557ba1afe692 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:11.504070 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f5404377-d522-48a0-9332-4527cd072bf8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1473 microversion: 2.1 time: 0.252482 Oct 29 01:16:11.513429 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1406/2948] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:11 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1473 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:11.526216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cb19b8dd-7071-47c0-845a-bbe701c7deaf tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:11.527240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cb19b8dd-7071-47c0-845a-bbe701c7deaf tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:11.531290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2606bf62-0014-4f26-ab99-557ba1afe692 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:11.531785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2606bf62-0014-4f26-ab99-557ba1afe692 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:11.532225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2606bf62-0014-4f26-ab99-557ba1afe692 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:11.534739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb19b8dd-7071-47c0-845a-bbe701c7deaf tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:11.535233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb19b8dd-7071-47c0-845a-bbe701c7deaf tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:11.535664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb19b8dd-7071-47c0-845a-bbe701c7deaf tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:11.536409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb19b8dd-7071-47c0-845a-bbe701c7deaf tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:11.536836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2606bf62-0014-4f26-ab99-557ba1afe692 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:11.537236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb19b8dd-7071-47c0-845a-bbe701c7deaf tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:11.537353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2606bf62-0014-4f26-ab99-557ba1afe692 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:11.537783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2606bf62-0014-4f26-ab99-557ba1afe692 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:11.538104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb19b8dd-7071-47c0-845a-bbe701c7deaf tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:11.625598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cb19b8dd-7071-47c0-845a-bbe701c7deaf tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:11.642653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cb19b8dd-7071-47c0-845a-bbe701c7deaf tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:11.644299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cb19b8dd-7071-47c0-845a-bbe701c7deaf tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:11.646702 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cb19b8dd-7071-47c0-845a-bbe701c7deaf tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1338 microversion: 2.47 time: 0.130645 Oct 29 01:16:11.646702 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1407/2949] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:11 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1338 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:11.651715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c4450a92-5845-4f29-83c5-ee108f5cf35e tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Action: 'update', calling method: .version_select at 0x7f9d9fe633a0>, body: {"meta": {"os_version": "alt"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:11.687227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2606bf62-0014-4f26-ab99-557ba1afe692 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:11.728691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2606bf62-0014-4f26-ab99-557ba1afe692 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:11.734517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2606bf62-0014-4f26-ab99-557ba1afe692 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:11.738251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-c4450a92-5845-4f29-83c5-ee108f5cf35e tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Getting quotas for project ffb84789d7ae4dfeab222029f2db4086. Resources: dict_keys(['metadata_items']) {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:16:11.738717 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2606bf62-0014-4f26-ab99-557ba1afe692 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1310 microversion: 2.21 time: 0.244611 Oct 29 01:16:11.740862 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1543/2950] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:11 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1310 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:11.758459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0ee23ae5-f848-4515-89a3-2c2a0cfcef79 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:11.763399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-c4450a92-5845-4f29-83c5-ee108f5cf35e tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Getting quotas for user 1d460bc136fb4a618494dad6525323b6 and project ffb84789d7ae4dfeab222029f2db4086. Resources: dict_keys(['metadata_items']) {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:16:11.765535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0ee23ae5-f848-4515-89a3-2c2a0cfcef79 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:11.773135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ee23ae5-f848-4515-89a3-2c2a0cfcef79 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:11.773894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ee23ae5-f848-4515-89a3-2c2a0cfcef79 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:11.774779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ee23ae5-f848-4515-89a3-2c2a0cfcef79 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:11.775787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ee23ae5-f848-4515-89a3-2c2a0cfcef79 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:11.776440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ee23ae5-f848-4515-89a3-2c2a0cfcef79 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:11.778062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ee23ae5-f848-4515-89a3-2c2a0cfcef79 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:11.957518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0ee23ae5-f848-4515-89a3-2c2a0cfcef79 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:11.969654 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0ee23ae5-f848-4515-89a3-2c2a0cfcef79 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.223310 Oct 29 01:16:11.970654 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1544/2951] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:11 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:11.977502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0fc69c83-b4ba-4576-afb0-505a8719e406 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:11.978531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0fc69c83-b4ba-4576-afb0-505a8719e406 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:11.986388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc69c83-b4ba-4576-afb0-505a8719e406 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:11.987427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc69c83-b4ba-4576-afb0-505a8719e406 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:11.987749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc69c83-b4ba-4576-afb0-505a8719e406 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:11.988955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc69c83-b4ba-4576-afb0-505a8719e406 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:11.989603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc69c83-b4ba-4576-afb0-505a8719e406 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:11.990191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc69c83-b4ba-4576-afb0-505a8719e406 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:12.159844 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c4450a92-5845-4f29-83c5-ee108f5cf35e tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] 10.222.0.26 "PUT /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.512297 Oct 29 01:16:12.160446 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1408/2952] 10.222.0.26 () {60 vars in 1313 bytes} [Sat Oct 29 01:16:11 2022] PUT /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata/os_version => generated 31 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:16:12.173278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c6db7a96-edf9-4b90-8cb1-bed4fbddd8cb tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Calling method '.version_select at 0x7f9d97d6a5e0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:12.220010 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c6db7a96-edf9-4b90-8cb1-bed4fbddd8cb tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] 10.222.0.26 "GET /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata" status: 200 len: 58 microversion: 2.1 time: 0.050960 Oct 29 01:16:12.220842 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1409/2953] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 29 01:16:12 2022] GET /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata => generated 58 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:16:12.236913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0d851cce-cbde-44e4-965d-ff568fe80186 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Action: 'update_all', calling method: .version_select at 0x7f9d9fe33820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:12.237294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0fc69c83-b4ba-4576-afb0-505a8719e406 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:12.247963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0fc69c83-b4ba-4576-afb0-505a8719e406 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:12.249446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0fc69c83-b4ba-4576-afb0-505a8719e406 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:12.250648 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0fc69c83-b4ba-4576-afb0-505a8719e406 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.278628 Oct 29 01:16:12.251210 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1545/2954] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:11 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:12.256229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e16da232-00d3-4bf0-b487-c79f373e6de6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:12.256833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e16da232-00d3-4bf0-b487-c79f373e6de6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:12.264004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e16da232-00d3-4bf0-b487-c79f373e6de6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:12.264500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e16da232-00d3-4bf0-b487-c79f373e6de6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:12.264932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e16da232-00d3-4bf0-b487-c79f373e6de6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:12.265832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e16da232-00d3-4bf0-b487-c79f373e6de6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:12.266444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e16da232-00d3-4bf0-b487-c79f373e6de6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:12.267112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e16da232-00d3-4bf0-b487-c79f373e6de6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:12.288953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-0d851cce-cbde-44e4-965d-ff568fe80186 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Getting quotas for project ffb84789d7ae4dfeab222029f2db4086. Resources: dict_keys(['metadata_items']) {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:16:12.295126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-0d851cce-cbde-44e4-965d-ff568fe80186 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Getting quotas for user 1d460bc136fb4a618494dad6525323b6 and project ffb84789d7ae4dfeab222029f2db4086. Resources: dict_keys(['metadata_items']) {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:16:12.436215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e16da232-00d3-4bf0-b487-c79f373e6de6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:12.444485 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e16da232-00d3-4bf0-b487-c79f373e6de6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1355 microversion: 2.1 time: 0.191918 Oct 29 01:16:12.445281 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1546/2955] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:12 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1355 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:12.519453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a175c242-19a4-4e0b-bd05-03f5779f3550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:12.519735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a175c242-19a4-4e0b-bd05-03f5779f3550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:12.530377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a175c242-19a4-4e0b-bd05-03f5779f3550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:12.530876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a175c242-19a4-4e0b-bd05-03f5779f3550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:12.531317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a175c242-19a4-4e0b-bd05-03f5779f3550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:12.532030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a175c242-19a4-4e0b-bd05-03f5779f3550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:12.532538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a175c242-19a4-4e0b-bd05-03f5779f3550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:12.533301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a175c242-19a4-4e0b-bd05-03f5779f3550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:12.638147 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0d851cce-cbde-44e4-965d-ff568fe80186 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] 10.222.0.26 "PUT /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata" status: 200 len: 61 microversion: 2.1 time: 0.410572 Oct 29 01:16:12.640118 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1410/2956] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:16:12 2022] PUT /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata => generated 61 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:16:12.649831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8e83a6e6-71b3-4337-b3e5-6e86bbcfe1ed tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:12.650730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8e83a6e6-71b3-4337-b3e5-6e86bbcfe1ed tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:12.658906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e83a6e6-71b3-4337-b3e5-6e86bbcfe1ed tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:12.659551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e83a6e6-71b3-4337-b3e5-6e86bbcfe1ed tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:12.660065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e83a6e6-71b3-4337-b3e5-6e86bbcfe1ed tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:12.660776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e83a6e6-71b3-4337-b3e5-6e86bbcfe1ed tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:12.661276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e83a6e6-71b3-4337-b3e5-6e86bbcfe1ed tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:12.661709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e83a6e6-71b3-4337-b3e5-6e86bbcfe1ed tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:12.686973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a175c242-19a4-4e0b-bd05-03f5779f3550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:12.695054 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a175c242-19a4-4e0b-bd05-03f5779f3550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1533 microversion: 2.1 time: 0.180159 Oct 29 01:16:12.695848 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1547/2957] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:12 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1533 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:12.701464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2e33912f-153a-449d-b663-02cae778e9e7 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Action: 'create', calling method: .version_select at 0x7f9d97060d30>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:12.769594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-2e33912f-153a-449d-b663-02cae778e9e7 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Getting quotas for project ffb84789d7ae4dfeab222029f2db4086. Resources: dict_keys(['metadata_items']) {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:16:12.790648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-2e33912f-153a-449d-b663-02cae778e9e7 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Getting quotas for user 1d460bc136fb4a618494dad6525323b6 and project ffb84789d7ae4dfeab222029f2db4086. Resources: dict_keys(['metadata_items']) {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:16:12.864607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8e83a6e6-71b3-4337-b3e5-6e86bbcfe1ed tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:12.874193 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8e83a6e6-71b3-4337-b3e5-6e86bbcfe1ed tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1473 microversion: 2.1 time: 0.231855 Oct 29 01:16:12.874544 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1411/2958] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:12 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1473 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:12.879820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-21279c00-6b44-4d09-97a0-49ea957a427c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:12.880433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-21279c00-6b44-4d09-97a0-49ea957a427c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:12.888342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21279c00-6b44-4d09-97a0-49ea957a427c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:12.889062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21279c00-6b44-4d09-97a0-49ea957a427c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:12.889532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21279c00-6b44-4d09-97a0-49ea957a427c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:12.890241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21279c00-6b44-4d09-97a0-49ea957a427c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:12.890698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21279c00-6b44-4d09-97a0-49ea957a427c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:12.891123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21279c00-6b44-4d09-97a0-49ea957a427c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:12.984085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-21279c00-6b44-4d09-97a0-49ea957a427c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:12.993936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-21279c00-6b44-4d09-97a0-49ea957a427c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:12.995850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-21279c00-6b44-4d09-97a0-49ea957a427c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:13.000867 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-21279c00-6b44-4d09-97a0-49ea957a427c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1336 microversion: 2.47 time: 0.125400 Oct 29 01:16:13.001780 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1412/2959] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:12 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1336 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:13.006494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6402ad57-aa1c-4a36-94f6-f91040083e5a tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:13.007096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6402ad57-aa1c-4a36-94f6-f91040083e5a tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:13.013929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6402ad57-aa1c-4a36-94f6-f91040083e5a tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:13.014582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6402ad57-aa1c-4a36-94f6-f91040083e5a tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:13.015182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6402ad57-aa1c-4a36-94f6-f91040083e5a tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:13.015889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6402ad57-aa1c-4a36-94f6-f91040083e5a tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:13.016371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6402ad57-aa1c-4a36-94f6-f91040083e5a tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:13.016949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6402ad57-aa1c-4a36-94f6-f91040083e5a tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:13.083397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6402ad57-aa1c-4a36-94f6-f91040083e5a tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:13.092834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6402ad57-aa1c-4a36-94f6-f91040083e5a tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:13.094813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6402ad57-aa1c-4a36-94f6-f91040083e5a tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:13.096227 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6402ad57-aa1c-4a36-94f6-f91040083e5a tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1318 microversion: 2.21 time: 0.093327 Oct 29 01:16:13.097294 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1413/2960] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:13 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1318 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:13.111668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-859f32a0-f660-4d54-a055-c226fe7423cf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:13.112611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-859f32a0-f660-4d54-a055-c226fe7423cf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:13.119221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-859f32a0-f660-4d54-a055-c226fe7423cf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:13.119966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-859f32a0-f660-4d54-a055-c226fe7423cf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:13.121339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-859f32a0-f660-4d54-a055-c226fe7423cf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:13.122460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-859f32a0-f660-4d54-a055-c226fe7423cf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:13.123081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-859f32a0-f660-4d54-a055-c226fe7423cf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:13.123671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-859f32a0-f660-4d54-a055-c226fe7423cf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:13.304600 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2e33912f-153a-449d-b663-02cae778e9e7 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] 10.222.0.26 "POST /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata" status: 200 len: 85 microversion: 2.1 time: 0.606995 Oct 29 01:16:13.305813 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1548/2961] 10.222.0.26 () {60 vars in 1281 bytes} [Sat Oct 29 01:16:12 2022] POST /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata => generated 85 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:16:13.313084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dd4e703a-a803-48cc-a217-05cb6eb73c33 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:13.314032 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dd4e703a-a803-48cc-a217-05cb6eb73c33 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:13.320888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-859f32a0-f660-4d54-a055-c226fe7423cf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:13.321487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd4e703a-a803-48cc-a217-05cb6eb73c33 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:13.322359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd4e703a-a803-48cc-a217-05cb6eb73c33 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:13.323014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd4e703a-a803-48cc-a217-05cb6eb73c33 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:13.325139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd4e703a-a803-48cc-a217-05cb6eb73c33 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:13.325873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd4e703a-a803-48cc-a217-05cb6eb73c33 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:13.326719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd4e703a-a803-48cc-a217-05cb6eb73c33 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:13.329882 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-859f32a0-f660-4d54-a055-c226fe7423cf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.231411 Oct 29 01:16:13.330679 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1414/2962] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:13 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:13.335401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bea42436-62bd-42b6-b1b0-a20303d0bbd2 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] Calling method '.version_select at 0x7f9d97ac1e50>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:13.386234 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bea42436-62bd-42b6-b1b0-a20303d0bbd2 tempest-ImagesMetadataTestJSON-1254200567 tempest-ImagesMetadataTestJSON-1254200567-project] 10.222.0.26 "GET /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata" status: 200 len: 85 microversion: 2.1 time: 0.054332 Oct 29 01:16:13.392757 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1415/2963] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 29 01:16:13 2022] GET /compute/v2.1/images/4f6ebf2d-4fa6-49e8-b25d-cf3985245e02/metadata => generated 85 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:16:13.469609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d917c609-3fe2-4f99-a7b9-6a92b9454a78 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:13.470218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d917c609-3fe2-4f99-a7b9-6a92b9454a78 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:13.480070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d917c609-3fe2-4f99-a7b9-6a92b9454a78 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:13.482795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d917c609-3fe2-4f99-a7b9-6a92b9454a78 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:13.483256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d917c609-3fe2-4f99-a7b9-6a92b9454a78 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:13.484162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d917c609-3fe2-4f99-a7b9-6a92b9454a78 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:13.484780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d917c609-3fe2-4f99-a7b9-6a92b9454a78 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:13.486397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d917c609-3fe2-4f99-a7b9-6a92b9454a78 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:13.692420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dd4e703a-a803-48cc-a217-05cb6eb73c33 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:13.706676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dd4e703a-a803-48cc-a217-05cb6eb73c33 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:13.714197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dd4e703a-a803-48cc-a217-05cb6eb73c33 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:13.715593 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dd4e703a-a803-48cc-a217-05cb6eb73c33 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.408466 Oct 29 01:16:13.716330 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1549/2964] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:13 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:13.726643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-09d717cf-c8fe-47f3-952f-e2c6eaef342c req-ca206140-4b71-41e2-9b60-32183def01fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6448587-2777-40b9-a6c5-514e56ac388d", "tag": "2d6f74f2-830a-4bad-8269-f210111534c9"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:13.748237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-09d717cf-c8fe-47f3-952f-e2c6eaef342c req-ca206140-4b71-41e2-9b60-32183def01fc service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:13.748721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-09d717cf-c8fe-47f3-952f-e2c6eaef342c req-ca206140-4b71-41e2-9b60-32183def01fc service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:13.749172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-09d717cf-c8fe-47f3-952f-e2c6eaef342c req-ca206140-4b71-41e2-9b60-32183def01fc service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:13.769655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d917c609-3fe2-4f99-a7b9-6a92b9454a78 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:13.782147 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-09d717cf-c8fe-47f3-952f-e2c6eaef342c req-ca206140-4b71-41e2-9b60-32183def01fc service nova] Creating event network-changed:2d6f74f2-830a-4bad-8269-f210111534c9 for instance b6448587-2777-40b9-a6c5-514e56ac388d on n-h2-862964-3 Oct 29 01:16:13.786019 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d917c609-3fe2-4f99-a7b9-6a92b9454a78 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1355 microversion: 2.1 time: 0.321908 Oct 29 01:16:13.793248 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1416/2965] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:13 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1355 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:13.795142 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-09d717cf-c8fe-47f3-952f-e2c6eaef342c req-ca206140-4b71-41e2-9b60-32183def01fc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077305 Oct 29 01:16:13.795852 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1550/2966] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:13.805751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e970ccc9-a1c5-4bb7-a347-5d9c78cd19d7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:13.806376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e970ccc9-a1c5-4bb7-a347-5d9c78cd19d7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:13.813734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e970ccc9-a1c5-4bb7-a347-5d9c78cd19d7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:13.814103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e970ccc9-a1c5-4bb7-a347-5d9c78cd19d7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:13.814549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e970ccc9-a1c5-4bb7-a347-5d9c78cd19d7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:13.815224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e970ccc9-a1c5-4bb7-a347-5d9c78cd19d7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:13.815760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e970ccc9-a1c5-4bb7-a347-5d9c78cd19d7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:13.816080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e970ccc9-a1c5-4bb7-a347-5d9c78cd19d7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:13.899158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-035953ed-434d-4c20-a866-82bed93d5e0c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:13.899986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-035953ed-434d-4c20-a866-82bed93d5e0c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:13.910381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-035953ed-434d-4c20-a866-82bed93d5e0c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:13.913066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-035953ed-434d-4c20-a866-82bed93d5e0c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:13.915659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-035953ed-434d-4c20-a866-82bed93d5e0c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:13.916542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-035953ed-434d-4c20-a866-82bed93d5e0c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:13.917253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-035953ed-434d-4c20-a866-82bed93d5e0c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:13.918987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-035953ed-434d-4c20-a866-82bed93d5e0c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:14.072993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e970ccc9-a1c5-4bb7-a347-5d9c78cd19d7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:14.090991 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e970ccc9-a1c5-4bb7-a347-5d9c78cd19d7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1539 microversion: 2.1 time: 0.294817 Oct 29 01:16:14.093468 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1417/2967] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:13 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1539 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:14.126692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1eebbfc4-e4d1-4f2b-b415-64a0826e8210 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:14.127997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1eebbfc4-e4d1-4f2b-b415-64a0826e8210 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:14.160832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1eebbfc4-e4d1-4f2b-b415-64a0826e8210 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:14.164026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1eebbfc4-e4d1-4f2b-b415-64a0826e8210 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:14.164565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1eebbfc4-e4d1-4f2b-b415-64a0826e8210 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:14.166503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1eebbfc4-e4d1-4f2b-b415-64a0826e8210 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:14.169840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1eebbfc4-e4d1-4f2b-b415-64a0826e8210 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:14.171049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1eebbfc4-e4d1-4f2b-b415-64a0826e8210 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:14.235373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-035953ed-434d-4c20-a866-82bed93d5e0c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:14.245018 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-035953ed-434d-4c20-a866-82bed93d5e0c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1473 microversion: 2.1 time: 0.350342 Oct 29 01:16:14.249178 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1551/2968] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:13 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1473 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:14.254069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-93e7eff2-f070-484c-826e-b5b5bb017422 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:14.260545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-93e7eff2-f070-484c-826e-b5b5bb017422 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:14.280702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93e7eff2-f070-484c-826e-b5b5bb017422 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:14.281228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93e7eff2-f070-484c-826e-b5b5bb017422 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:14.281676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93e7eff2-f070-484c-826e-b5b5bb017422 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:14.287283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93e7eff2-f070-484c-826e-b5b5bb017422 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:14.288826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93e7eff2-f070-484c-826e-b5b5bb017422 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:14.290729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93e7eff2-f070-484c-826e-b5b5bb017422 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:14.378319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1eebbfc4-e4d1-4f2b-b415-64a0826e8210 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:14.385472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:14.394094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1eebbfc4-e4d1-4f2b-b415-64a0826e8210 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:14.395698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1eebbfc4-e4d1-4f2b-b415-64a0826e8210 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:14.397694 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1eebbfc4-e4d1-4f2b-b415-64a0826e8210 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1336 microversion: 2.47 time: 0.281889 Oct 29 01:16:14.398266 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1418/2969] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:14 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1336 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:14.406836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a6a8e7a9-d7e7-4655-b267-baacca684a93 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:14.407456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a6a8e7a9-d7e7-4655-b267-baacca684a93 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:14.425867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6a8e7a9-d7e7-4655-b267-baacca684a93 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:14.429541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6a8e7a9-d7e7-4655-b267-baacca684a93 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:14.430351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6a8e7a9-d7e7-4655-b267-baacca684a93 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:14.431260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6a8e7a9-d7e7-4655-b267-baacca684a93 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:14.433641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6a8e7a9-d7e7-4655-b267-baacca684a93 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:14.434960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6a8e7a9-d7e7-4655-b267-baacca684a93 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:14.483858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-93e7eff2-f070-484c-826e-b5b5bb017422 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:14.493998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-93e7eff2-f070-484c-826e-b5b5bb017422 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:14.495437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-93e7eff2-f070-484c-826e-b5b5bb017422 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:14.497956 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-93e7eff2-f070-484c-826e-b5b5bb017422 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1318 microversion: 2.21 time: 0.247648 Oct 29 01:16:14.498784 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1552/2970] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:14 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:14.631098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a6a8e7a9-d7e7-4655-b267-baacca684a93 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:14.641349 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a6a8e7a9-d7e7-4655-b267-baacca684a93 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.241943 Oct 29 01:16:14.641938 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1419/2971] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:14 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:14.745232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-83b02576-07e7-4d1c-aae6-bc30bd654bf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:14.746565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-83b02576-07e7-4d1c-aae6-bc30bd654bf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:14.763929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83b02576-07e7-4d1c-aae6-bc30bd654bf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:14.765820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83b02576-07e7-4d1c-aae6-bc30bd654bf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:14.766789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83b02576-07e7-4d1c-aae6-bc30bd654bf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:14.767943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83b02576-07e7-4d1c-aae6-bc30bd654bf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:14.768553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83b02576-07e7-4d1c-aae6-bc30bd654bf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:14.769072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83b02576-07e7-4d1c-aae6-bc30bd654bf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:14.819604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0cde77fb-4f01-43ae-91a8-2b0bb1d478bc tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:14.820393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0cde77fb-4f01-43ae-91a8-2b0bb1d478bc tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:14.835148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cde77fb-4f01-43ae-91a8-2b0bb1d478bc tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:14.835907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cde77fb-4f01-43ae-91a8-2b0bb1d478bc tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:14.838465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cde77fb-4f01-43ae-91a8-2b0bb1d478bc tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:14.839485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cde77fb-4f01-43ae-91a8-2b0bb1d478bc tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:14.841997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cde77fb-4f01-43ae-91a8-2b0bb1d478bc tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:14.842866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cde77fb-4f01-43ae-91a8-2b0bb1d478bc tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:15.336120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0cde77fb-4f01-43ae-91a8-2b0bb1d478bc tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:15.354419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-83b02576-07e7-4d1c-aae6-bc30bd654bf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:15.372809 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0cde77fb-4f01-43ae-91a8-2b0bb1d478bc tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1355 microversion: 2.1 time: 0.557213 Oct 29 01:16:15.375162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-83b02576-07e7-4d1c-aae6-bc30bd654bf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:15.376407 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1420/2972] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:14 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1355 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:15.383268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-83b02576-07e7-4d1c-aae6-bc30bd654bf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:15.384692 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-83b02576-07e7-4d1c-aae6-bc30bd654bf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.644195 Oct 29 01:16:15.385300 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1553/2973] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:14 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:15.389872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-56b2af6f-6dff-4c2a-ab0f-c589e50f3443 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:15.390489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-56b2af6f-6dff-4c2a-ab0f-c589e50f3443 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:15.396939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6b393652-4690-43bd-bed6-b593f711945c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:15.397617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6b393652-4690-43bd-bed6-b593f711945c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:15.403601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56b2af6f-6dff-4c2a-ab0f-c589e50f3443 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:15.404095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56b2af6f-6dff-4c2a-ab0f-c589e50f3443 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:15.404530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56b2af6f-6dff-4c2a-ab0f-c589e50f3443 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:15.408198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56b2af6f-6dff-4c2a-ab0f-c589e50f3443 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:15.422092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56b2af6f-6dff-4c2a-ab0f-c589e50f3443 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:15.424029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56b2af6f-6dff-4c2a-ab0f-c589e50f3443 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:15.425018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b393652-4690-43bd-bed6-b593f711945c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:15.428054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b393652-4690-43bd-bed6-b593f711945c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:15.428511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b393652-4690-43bd-bed6-b593f711945c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:15.429263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b393652-4690-43bd-bed6-b593f711945c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:15.429736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b393652-4690-43bd-bed6-b593f711945c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:15.430147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b393652-4690-43bd-bed6-b593f711945c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:15.446667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:16.095799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-56b2af6f-6dff-4c2a-ab0f-c589e50f3443 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:16.110950 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-56b2af6f-6dff-4c2a-ab0f-c589e50f3443 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1539 microversion: 2.1 time: 0.732269 Oct 29 01:16:16.111877 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1421/2974] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:15 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1539 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:16.123328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-127fa564-99f3-4450-924c-0324d1c3ea4c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:16.124479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-127fa564-99f3-4450-924c-0324d1c3ea4c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:16.149411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-127fa564-99f3-4450-924c-0324d1c3ea4c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:16.153010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-127fa564-99f3-4450-924c-0324d1c3ea4c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:16.156975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-127fa564-99f3-4450-924c-0324d1c3ea4c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:16.156975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-127fa564-99f3-4450-924c-0324d1c3ea4c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:16.156975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-127fa564-99f3-4450-924c-0324d1c3ea4c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:16.157878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-127fa564-99f3-4450-924c-0324d1c3ea4c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:16.163744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6b393652-4690-43bd-bed6-b593f711945c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:16.179017 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6b393652-4690-43bd-bed6-b593f711945c tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1479 microversion: 2.1 time: 0.785611 Oct 29 01:16:16.180567 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1554/2975] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:15 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1479 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:16.187717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-083a9aa4-51b4-4252-a4b0-b84682f3dc99 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:16.189043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-083a9aa4-51b4-4252-a4b0-b84682f3dc99 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:16.198005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-083a9aa4-51b4-4252-a4b0-b84682f3dc99 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:16.200096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-083a9aa4-51b4-4252-a4b0-b84682f3dc99 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:16.200096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-083a9aa4-51b4-4252-a4b0-b84682f3dc99 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:16.200778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-083a9aa4-51b4-4252-a4b0-b84682f3dc99 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:16.201268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-083a9aa4-51b4-4252-a4b0-b84682f3dc99 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:16.201899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-083a9aa4-51b4-4252-a4b0-b84682f3dc99 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:16.303629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-127fa564-99f3-4450-924c-0324d1c3ea4c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:16.336572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-127fa564-99f3-4450-924c-0324d1c3ea4c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:16.340860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-127fa564-99f3-4450-924c-0324d1c3ea4c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:16.342566 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-127fa564-99f3-4450-924c-0324d1c3ea4c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1336 microversion: 2.47 time: 0.229402 Oct 29 01:16:16.347480 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1422/2976] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:16 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1336 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:16.354498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b272ed71-765f-48e3-aa74-9d0f1541d77b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:16.357023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b272ed71-765f-48e3-aa74-9d0f1541d77b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:16.371216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b272ed71-765f-48e3-aa74-9d0f1541d77b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:16.373895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b272ed71-765f-48e3-aa74-9d0f1541d77b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:16.374421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b272ed71-765f-48e3-aa74-9d0f1541d77b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:16.375291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b272ed71-765f-48e3-aa74-9d0f1541d77b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:16.375848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b272ed71-765f-48e3-aa74-9d0f1541d77b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:16.376380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b272ed71-765f-48e3-aa74-9d0f1541d77b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:16.461455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-083a9aa4-51b4-4252-a4b0-b84682f3dc99 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:16.478046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-083a9aa4-51b4-4252-a4b0-b84682f3dc99 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:16.483331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-083a9aa4-51b4-4252-a4b0-b84682f3dc99 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:16.483331 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-083a9aa4-51b4-4252-a4b0-b84682f3dc99 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1370 microversion: 2.21 time: 0.301470 Oct 29 01:16:16.483750 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1555/2977] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:16 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1370 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:16.507324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-df126767-eb1c-47bd-96ce-139da66d5099 req-ec878191-9650-4007-a84c-9709f8722c8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6448587-2777-40b9-a6c5-514e56ac388d", "tag": "946b5a67-b144-4570-bffa-a10da029250f"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:16.517718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-df126767-eb1c-47bd-96ce-139da66d5099 req-ec878191-9650-4007-a84c-9709f8722c8e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:16.518302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-df126767-eb1c-47bd-96ce-139da66d5099 req-ec878191-9650-4007-a84c-9709f8722c8e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:16.518730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-df126767-eb1c-47bd-96ce-139da66d5099 req-ec878191-9650-4007-a84c-9709f8722c8e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:16.534011 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-df126767-eb1c-47bd-96ce-139da66d5099 req-ec878191-9650-4007-a84c-9709f8722c8e service nova] Creating event network-changed:946b5a67-b144-4570-bffa-a10da029250f for instance b6448587-2777-40b9-a6c5-514e56ac388d on n-h2-862964-3 Oct 29 01:16:16.541992 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-df126767-eb1c-47bd-96ce-139da66d5099 req-ec878191-9650-4007-a84c-9709f8722c8e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056576 Oct 29 01:16:16.542712 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1556/2978] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:16.550560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-08a55803-d047-4641-a365-48e33c16dd5e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:16.551780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-08a55803-d047-4641-a365-48e33c16dd5e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:16.557947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08a55803-d047-4641-a365-48e33c16dd5e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:16.559260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08a55803-d047-4641-a365-48e33c16dd5e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:16.559965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08a55803-d047-4641-a365-48e33c16dd5e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:16.560853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08a55803-d047-4641-a365-48e33c16dd5e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:16.561492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08a55803-d047-4641-a365-48e33c16dd5e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:16.562075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08a55803-d047-4641-a365-48e33c16dd5e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:16.636100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b272ed71-765f-48e3-aa74-9d0f1541d77b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:16.644641 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b272ed71-765f-48e3-aa74-9d0f1541d77b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.295989 Oct 29 01:16:16.653558 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1423/2979] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:16 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:16.653558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9e2c2521-ffd8-4671-b527-a22962c87fc8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:16.653558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9e2c2521-ffd8-4671-b527-a22962c87fc8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:16.658886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e2c2521-ffd8-4671-b527-a22962c87fc8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:16.659390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e2c2521-ffd8-4671-b527-a22962c87fc8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:16.659829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e2c2521-ffd8-4671-b527-a22962c87fc8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:16.660529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e2c2521-ffd8-4671-b527-a22962c87fc8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:16.660991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e2c2521-ffd8-4671-b527-a22962c87fc8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:16.661448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e2c2521-ffd8-4671-b527-a22962c87fc8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:16.818425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-08a55803-d047-4641-a365-48e33c16dd5e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:16.830949 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-08a55803-d047-4641-a365-48e33c16dd5e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1355 microversion: 2.1 time: 0.286616 Oct 29 01:16:16.844387 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1557/2980] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:16 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1355 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:16.857934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4b76aecc-2eb9-4fd0-9ffe-dd4bea5b5d6f req-8b43fa23-e89c-4426-9040-071cfb209bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d34640d-e769-4799-9215-b36526af8817", "name": "network-vif-plugged", "status": "completed", "tag": "e24a49b8-f412-493b-8773-37bc96951756"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:16.867380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:16.870228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4b76aecc-2eb9-4fd0-9ffe-dd4bea5b5d6f req-8b43fa23-e89c-4426-9040-071cfb209bae service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:16.871021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4b76aecc-2eb9-4fd0-9ffe-dd4bea5b5d6f req-8b43fa23-e89c-4426-9040-071cfb209bae service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:16.871365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4b76aecc-2eb9-4fd0-9ffe-dd4bea5b5d6f req-8b43fa23-e89c-4426-9040-071cfb209bae service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:16.886262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:16.890621 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4b76aecc-2eb9-4fd0-9ffe-dd4bea5b5d6f req-8b43fa23-e89c-4426-9040-071cfb209bae service nova] Creating event network-vif-plugged:e24a49b8-f412-493b-8773-37bc96951756 for instance 7d34640d-e769-4799-9215-b36526af8817 on n-h1-862964-3 Oct 29 01:16:16.901805 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4b76aecc-2eb9-4fd0-9ffe-dd4bea5b5d6f req-8b43fa23-e89c-4426-9040-071cfb209bae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068894 Oct 29 01:16:16.915335 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1558/2981] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:16.915547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9e2c2521-ffd8-4671-b527-a22962c87fc8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:16.923242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9e2c2521-ffd8-4671-b527-a22962c87fc8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:16.924746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9e2c2521-ffd8-4671-b527-a22962c87fc8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:16.925953 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9e2c2521-ffd8-4671-b527-a22962c87fc8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.279781 Oct 29 01:16:16.926545 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1424/2982] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:16 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:17.138215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e872900c-cbb2-40ff-ad96-d9c594f0a551 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:17.139397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e872900c-cbb2-40ff-ad96-d9c594f0a551 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:17.146375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e872900c-cbb2-40ff-ad96-d9c594f0a551 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:17.146861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e872900c-cbb2-40ff-ad96-d9c594f0a551 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:17.147429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e872900c-cbb2-40ff-ad96-d9c594f0a551 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:17.148147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e872900c-cbb2-40ff-ad96-d9c594f0a551 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:17.148593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e872900c-cbb2-40ff-ad96-d9c594f0a551 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:17.149149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e872900c-cbb2-40ff-ad96-d9c594f0a551 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:17.209531 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ea083e4a-9621-45ef-b69a-acbf77fe2842 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:17.216108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ea083e4a-9621-45ef-b69a-acbf77fe2842 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:17.219482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea083e4a-9621-45ef-b69a-acbf77fe2842 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:17.220252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea083e4a-9621-45ef-b69a-acbf77fe2842 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:17.220880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea083e4a-9621-45ef-b69a-acbf77fe2842 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:17.221812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea083e4a-9621-45ef-b69a-acbf77fe2842 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:17.222450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea083e4a-9621-45ef-b69a-acbf77fe2842 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:17.223060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea083e4a-9621-45ef-b69a-acbf77fe2842 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:17.506896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e872900c-cbb2-40ff-ad96-d9c594f0a551 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:17.517766 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e872900c-cbb2-40ff-ad96-d9c594f0a551 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1539 microversion: 2.1 time: 0.385210 Oct 29 01:16:17.534969 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1559/2983] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:17 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1539 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:17.546754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-90b90905-ab3d-4791-bea6-48e4dd8d3540 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:17.547728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-90b90905-ab3d-4791-bea6-48e4dd8d3540 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:17.549946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ea083e4a-9621-45ef-b69a-acbf77fe2842 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:17.558664 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ea083e4a-9621-45ef-b69a-acbf77fe2842 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1479 microversion: 2.1 time: 0.355546 Oct 29 01:16:17.563002 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1425/2984] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:17 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1479 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:17.563389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90b90905-ab3d-4791-bea6-48e4dd8d3540 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:17.563389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90b90905-ab3d-4791-bea6-48e4dd8d3540 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:17.563389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90b90905-ab3d-4791-bea6-48e4dd8d3540 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:17.566005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ab021ac6-3f3e-4eb1-85f4-2923c03c9634 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:17.566615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ab021ac6-3f3e-4eb1-85f4-2923c03c9634 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:17.573013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab021ac6-3f3e-4eb1-85f4-2923c03c9634 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:17.573719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab021ac6-3f3e-4eb1-85f4-2923c03c9634 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:17.574976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab021ac6-3f3e-4eb1-85f4-2923c03c9634 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:17.575849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab021ac6-3f3e-4eb1-85f4-2923c03c9634 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:17.576463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab021ac6-3f3e-4eb1-85f4-2923c03c9634 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:17.577048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab021ac6-3f3e-4eb1-85f4-2923c03c9634 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:17.578454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90b90905-ab3d-4791-bea6-48e4dd8d3540 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:17.578961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90b90905-ab3d-4791-bea6-48e4dd8d3540 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:17.579414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90b90905-ab3d-4791-bea6-48e4dd8d3540 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:17.697427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-90b90905-ab3d-4791-bea6-48e4dd8d3540 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:17.706427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-90b90905-ab3d-4791-bea6-48e4dd8d3540 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:17.708034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-90b90905-ab3d-4791-bea6-48e4dd8d3540 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:17.709476 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-90b90905-ab3d-4791-bea6-48e4dd8d3540 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1336 microversion: 2.47 time: 0.173080 Oct 29 01:16:17.710519 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1560/2985] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:17 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1336 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:17.827154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ab021ac6-3f3e-4eb1-85f4-2923c03c9634 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:17.838377 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ab021ac6-3f3e-4eb1-85f4-2923c03c9634 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:17.842000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ab021ac6-3f3e-4eb1-85f4-2923c03c9634 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:17.843509 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ab021ac6-3f3e-4eb1-85f4-2923c03c9634 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1358 microversion: 2.21 time: 0.282929 Oct 29 01:16:17.844256 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1426/2986] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:17 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1358 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:17.852366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9915a429-3a35-4423-8c28-2acb0a5864a6 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] Calling method '.version_select at 0x7f9d9770d5e0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:17.868199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d06813c7-a2ac-4c89-9823-c6ed606e1510 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:17.868856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d06813c7-a2ac-4c89-9823-c6ed606e1510 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:17.877947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d06813c7-a2ac-4c89-9823-c6ed606e1510 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:17.877947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d06813c7-a2ac-4c89-9823-c6ed606e1510 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:17.877947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d06813c7-a2ac-4c89-9823-c6ed606e1510 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:17.877947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d06813c7-a2ac-4c89-9823-c6ed606e1510 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:17.878414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d06813c7-a2ac-4c89-9823-c6ed606e1510 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:17.878847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d06813c7-a2ac-4c89-9823-c6ed606e1510 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:17.889602 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-9915a429-3a35-4423-8c28-2acb0a5864a6 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] HTTP exception thrown: Image not found. Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9915a429-3a35-4423-8c28-2acb0a5864a6 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] Request method failure captured: Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/images/6fad38ea-70e9-475b-927e-dacee376cb33/metadata/os_distro HTTP/1.1 Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH7hQS4QacbsElqJ9aXT67YEF2159apJfwxof-JKN4uY565CFFsBSArHIFR1RXwUMfNCDDneepzG4BoPuMYcguUHE1hPVvLGVgFgWgFhVa5Y5Kon0vNUEjNMYE5dgZd8dcLA_4CEbPP9WD8q-9y-HaQIRZALohWtnVza3dhkpC0jB5M Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f180ee619fd04c599f71122e0cb547fd Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1453576138 Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f180ee619fd04c599f71122e0cb547fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f180ee619fd04c599f71122e0cb547fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f180ee619fd04c599f71122e0cb547fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f180ee619fd04c599f71122e0cb547fd", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1453576138 Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f180ee619fd04c599f71122e0cb547fd Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1453576138 Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesMetadataNegativeTestJSON-1453576138-project Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: a7cdab23cc1943619106f2f5d09931fb Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1453576138-project Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: exception: Image not found. Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'image_id': '6fad38ea-70e9-475b-927e-dacee376cb33', 'id': 'os_distro'} Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6fad38ea-70e9-475b-927e-dacee376cb33 Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 01:16:17.895422 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6fad38ea-70e9-475b-927e-dacee376cb33 could not be found. Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9915a429-3a35-4423-8c28-2acb0a5864a6 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] Returning 404 to user: Image not found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9915a429-3a35-4423-8c28-2acb0a5864a6 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] 10.222.0.26 "DELETE /compute/v2.1/images/6fad38ea-70e9-475b-927e-dacee376cb33/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.185492 Oct 29 01:16:17.905438 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1561/2987] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Oct 29 01:16:17 2022] DELETE /compute/v2.1/images/6fad38ea-70e9-475b-927e-dacee376cb33/metadata/os_distro => generated 62 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:16:17.908790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e88b8e67-a9ec-4256-b0e0-6507f4f5dc76 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:17.908790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e88b8e67-a9ec-4256-b0e0-6507f4f5dc76 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:17.916568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e88b8e67-a9ec-4256-b0e0-6507f4f5dc76 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:17.917487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e88b8e67-a9ec-4256-b0e0-6507f4f5dc76 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:17.918777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e88b8e67-a9ec-4256-b0e0-6507f4f5dc76 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:17.920200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e88b8e67-a9ec-4256-b0e0-6507f4f5dc76 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:17.920870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e88b8e67-a9ec-4256-b0e0-6507f4f5dc76 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:17.922113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e88b8e67-a9ec-4256-b0e0-6507f4f5dc76 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:18.162658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d06813c7-a2ac-4c89-9823-c6ed606e1510 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:18.172475 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d06813c7-a2ac-4c89-9823-c6ed606e1510 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.326974 Oct 29 01:16:18.173782 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1427/2988] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:17 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:18.179944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b00283da-fdb5-44c6-9bb4-fdeb04ba3d67 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] Calling method '.version_select at 0x7f9d9ff23670>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:18.206124 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-b00283da-fdb5-44c6-9bb4-fdeb04ba3d67 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] HTTP exception thrown: Image not found. Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b00283da-fdb5-44c6-9bb4-fdeb04ba3d67 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] Request method failure captured: Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/images/d06c7f9e-4aac-4dc7-8d65-7b9d06e01e87/metadata/os_version HTTP/1.1 Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7hQS4QacbsElqJ9aXT67YEF2159apJfwxof-JKN4uY565CFFsBSArHIFR1RXwUMfNCDDneepzG4BoPuMYcguUHE1hPVvLGVgFgWgFhVa5Y5Kon0vNUEjNMYE5dgZd8dcLA_4CEbPP9WD8q-9y-HaQIRZALohWtnVza3dhkpC0jB5M Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: f180ee619fd04c599f71122e0cb547fd Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1453576138 Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f180ee619fd04c599f71122e0cb547fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f180ee619fd04c599f71122e0cb547fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f180ee619fd04c599f71122e0cb547fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f180ee619fd04c599f71122e0cb547fd", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1453576138 Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: f180ee619fd04c599f71122e0cb547fd Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1453576138 Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesMetadataNegativeTestJSON-1453576138-project Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: a7cdab23cc1943619106f2f5d09931fb Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1453576138-project Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: exception: Image not found. Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'image_id': 'd06c7f9e-4aac-4dc7-8d65-7b9d06e01e87', 'id': 'os_version'} Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d06c7f9e-4aac-4dc7-8d65-7b9d06e01e87 Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 01:16:18.209708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d06c7f9e-4aac-4dc7-8d65-7b9d06e01e87 could not be found. Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b00283da-fdb5-44c6-9bb4-fdeb04ba3d67 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] Returning 404 to user: Image not found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b00283da-fdb5-44c6-9bb4-fdeb04ba3d67 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] 10.222.0.26 "GET /compute/v2.1/images/d06c7f9e-4aac-4dc7-8d65-7b9d06e01e87/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.036213 Oct 29 01:16:18.216351 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1428/2989] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Oct 29 01:16:18 2022] GET /compute/v2.1/images/d06c7f9e-4aac-4dc7-8d65-7b9d06e01e87/metadata/os_version => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:16:18.221649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-99d391fb-f6f5-465a-a8d9-bc6f89dc44ce tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:18.221649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-99d391fb-f6f5-465a-a8d9-bc6f89dc44ce tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:18.221951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e88b8e67-a9ec-4256-b0e0-6507f4f5dc76 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:18.229872 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e88b8e67-a9ec-4256-b0e0-6507f4f5dc76 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1355 microversion: 2.1 time: 0.331109 Oct 29 01:16:18.230643 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1562/2990] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:17 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1355 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:18.238235 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99d391fb-f6f5-465a-a8d9-bc6f89dc44ce tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:18.238831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99d391fb-f6f5-465a-a8d9-bc6f89dc44ce tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:18.239277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99d391fb-f6f5-465a-a8d9-bc6f89dc44ce tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:18.244621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99d391fb-f6f5-465a-a8d9-bc6f89dc44ce tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:18.244621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99d391fb-f6f5-465a-a8d9-bc6f89dc44ce tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:18.244621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99d391fb-f6f5-465a-a8d9-bc6f89dc44ce tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:18.250809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8ef9f981-71fc-43b2-9665-cbd220261397 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] Calling method '.version_select at 0x7f9d977999d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:18.273575 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-8ef9f981-71fc-43b2-9665-cbd220261397 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] HTTP exception thrown: Image not found. Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8ef9f981-71fc-43b2-9665-cbd220261397 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] Request method failure captured: Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/images/353804a7-d3ba-4132-bf57-48e2d6e931be/metadata HTTP/1.1 Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH7hQS4QacbsElqJ9aXT67YEF2159apJfwxof-JKN4uY565CFFsBSArHIFR1RXwUMfNCDDneepzG4BoPuMYcguUHE1hPVvLGVgFgWgFhVa5Y5Kon0vNUEjNMYE5dgZd8dcLA_4CEbPP9WD8q-9y-HaQIRZALohWtnVza3dhkpC0jB5M Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f180ee619fd04c599f71122e0cb547fd Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1453576138 Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f180ee619fd04c599f71122e0cb547fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f180ee619fd04c599f71122e0cb547fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f180ee619fd04c599f71122e0cb547fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f180ee619fd04c599f71122e0cb547fd", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1453576138 Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f180ee619fd04c599f71122e0cb547fd Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1453576138 Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesMetadataNegativeTestJSON-1453576138-project Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: a7cdab23cc1943619106f2f5d09931fb Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1453576138-project Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: exception: Image not found. Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'image_id': '353804a7-d3ba-4132-bf57-48e2d6e931be'} Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 353804a7-d3ba-4132-bf57-48e2d6e931be Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 01:16:18.276203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 353804a7-d3ba-4132-bf57-48e2d6e931be could not be found. Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8ef9f981-71fc-43b2-9665-cbd220261397 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] Returning 404 to user: Image not found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8ef9f981-71fc-43b2-9665-cbd220261397 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] 10.222.0.26 "GET /compute/v2.1/images/353804a7-d3ba-4132-bf57-48e2d6e931be/metadata" status: 404 len: 62 microversion: 2.1 time: 0.032421 Oct 29 01:16:18.282652 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1563/2991] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 29 01:16:18 2022] GET /compute/v2.1/images/353804a7-d3ba-4132-bf57-48e2d6e931be/metadata => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:16:18.292731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-18aba5af-3d9e-4b87-9ba3-8eab2e66f7bd tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] Action: 'update_all', calling method: .version_select at 0x7f9d977d6550>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:18.323537 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-18aba5af-3d9e-4b87-9ba3-8eab2e66f7bd tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] HTTP exception thrown: Image not found. Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-18aba5af-3d9e-4b87-9ba3-8eab2e66f7bd tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] Request method failure captured: Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: request: PUT /compute/v2.1/images/c4e8fc5f-8f26-4c8c-a52f-8b0a636e1034/metadata HTTP/1.1 Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 57 Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH7hQS4QacbsElqJ9aXT67YEF2159apJfwxof-JKN4uY565CFFsBSArHIFR1RXwUMfNCDDneepzG4BoPuMYcguUHE1hPVvLGVgFgWgFhVa5Y5Kon0vNUEjNMYE5dgZd8dcLA_4CEbPP9WD8q-9y-HaQIRZALohWtnVza3dhkpC0jB5M Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f180ee619fd04c599f71122e0cb547fd Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1453576138 Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f180ee619fd04c599f71122e0cb547fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f180ee619fd04c599f71122e0cb547fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f180ee619fd04c599f71122e0cb547fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f180ee619fd04c599f71122e0cb547fd", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1453576138 Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f180ee619fd04c599f71122e0cb547fd Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1453576138 Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesMetadataNegativeTestJSON-1453576138-project Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: a7cdab23cc1943619106f2f5d09931fb Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1453576138-project Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: exception: Image not found. Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'image_id': 'c4e8fc5f-8f26-4c8c-a52f-8b0a636e1034', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c4e8fc5f-8f26-4c8c-a52f-8b0a636e1034 Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 01:16:18.326441 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c4e8fc5f-8f26-4c8c-a52f-8b0a636e1034 could not be found. Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-18aba5af-3d9e-4b87-9ba3-8eab2e66f7bd tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] Returning 404 to user: Image not found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-18aba5af-3d9e-4b87-9ba3-8eab2e66f7bd tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] 10.222.0.26 "PUT /compute/v2.1/images/c4e8fc5f-8f26-4c8c-a52f-8b0a636e1034/metadata" status: 404 len: 62 microversion: 2.1 time: 0.039188 Oct 29 01:16:18.333714 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1564/2992] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:16:18 2022] PUT /compute/v2.1/images/c4e8fc5f-8f26-4c8c-a52f-8b0a636e1034/metadata => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 01:16:18.342025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f0e4682-54d3-4f9a-a671-2ad640ec01f4 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] Action: 'update', calling method: .version_select at 0x7f9d9779ce50>, body: {"meta": {"os_distro": "alt"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:18.365575 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-1f0e4682-54d3-4f9a-a671-2ad640ec01f4 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] HTTP exception thrown: Image not found. Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f0e4682-54d3-4f9a-a671-2ad640ec01f4 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] Request method failure captured: Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: request: PUT /compute/v2.1/images/f198579c-09ff-4c5c-95bd-d57194af5d60/metadata/os_distro HTTP/1.1 Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 30 Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH7hQS4QacbsElqJ9aXT67YEF2159apJfwxof-JKN4uY565CFFsBSArHIFR1RXwUMfNCDDneepzG4BoPuMYcguUHE1hPVvLGVgFgWgFhVa5Y5Kon0vNUEjNMYE5dgZd8dcLA_4CEbPP9WD8q-9y-HaQIRZALohWtnVza3dhkpC0jB5M Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f180ee619fd04c599f71122e0cb547fd Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1453576138 Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f180ee619fd04c599f71122e0cb547fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f180ee619fd04c599f71122e0cb547fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f180ee619fd04c599f71122e0cb547fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f180ee619fd04c599f71122e0cb547fd", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1453576138 Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f180ee619fd04c599f71122e0cb547fd Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1453576138 Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesMetadataNegativeTestJSON-1453576138-project Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: a7cdab23cc1943619106f2f5d09931fb Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1453576138-project Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: {"meta": {"os_distro": "alt"}} Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: exception: Image not found. Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'image_id': 'f198579c-09ff-4c5c-95bd-d57194af5d60', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f198579c-09ff-4c5c-95bd-d57194af5d60 Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 01:16:18.368536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f198579c-09ff-4c5c-95bd-d57194af5d60 could not be found. Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f0e4682-54d3-4f9a-a671-2ad640ec01f4 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] Returning 404 to user: Image not found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1f0e4682-54d3-4f9a-a671-2ad640ec01f4 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] 10.222.0.26 "PUT /compute/v2.1/images/f198579c-09ff-4c5c-95bd-d57194af5d60/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.032709 Oct 29 01:16:18.378846 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1565/2993] 10.222.0.26 () {60 vars in 1310 bytes} [Sat Oct 29 01:16:18 2022] PUT /compute/v2.1/images/f198579c-09ff-4c5c-95bd-d57194af5d60/metadata/os_distro => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:16:18.388172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b94396be-b12d-4217-a52b-24fc2f61ac94 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] Action: 'create', calling method: .version_select at 0x7f9d97773670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:18.412702 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-b94396be-b12d-4217-a52b-24fc2f61ac94 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] HTTP exception thrown: Image not found. Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b94396be-b12d-4217-a52b-24fc2f61ac94 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] Request method failure captured: Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/images/0850fb0e-3b51-4b64-8c20-1cfe7d688125/metadata HTTP/1.1 Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 57 Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH7hQS4QacbsElqJ9aXT67YEF2159apJfwxof-JKN4uY565CFFsBSArHIFR1RXwUMfNCDDneepzG4BoPuMYcguUHE1hPVvLGVgFgWgFhVa5Y5Kon0vNUEjNMYE5dgZd8dcLA_4CEbPP9WD8q-9y-HaQIRZALohWtnVza3dhkpC0jB5M Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: f180ee619fd04c599f71122e0cb547fd Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1453576138 Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f180ee619fd04c599f71122e0cb547fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f180ee619fd04c599f71122e0cb547fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f180ee619fd04c599f71122e0cb547fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f180ee619fd04c599f71122e0cb547fd", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1453576138 Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: f180ee619fd04c599f71122e0cb547fd Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1453576138 Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesMetadataNegativeTestJSON-1453576138-project Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: a7cdab23cc1943619106f2f5d09931fb Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1453576138-project Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: exception: Image not found. Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'image_id': '0850fb0e-3b51-4b64-8c20-1cfe7d688125', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0850fb0e-3b51-4b64-8c20-1cfe7d688125 Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 01:16:18.414908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0850fb0e-3b51-4b64-8c20-1cfe7d688125 could not be found. Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b94396be-b12d-4217-a52b-24fc2f61ac94 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] Returning 404 to user: Image not found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b94396be-b12d-4217-a52b-24fc2f61ac94 tempest-ImagesMetadataNegativeTestJSON-1453576138 tempest-ImagesMetadataNegativeTestJSON-1453576138-project] 10.222.0.26 "POST /compute/v2.1/images/0850fb0e-3b51-4b64-8c20-1cfe7d688125/metadata" status: 404 len: 62 microversion: 2.1 time: 0.033865 Oct 29 01:16:18.421884 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1566/2994] 10.222.0.26 () {60 vars in 1281 bytes} [Sat Oct 29 01:16:18 2022] POST /compute/v2.1/images/0850fb0e-3b51-4b64-8c20-1cfe7d688125/metadata => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 01:16:18.529755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-99d391fb-f6f5-465a-a8d9-bc6f89dc44ce tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:18.541669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-99d391fb-f6f5-465a-a8d9-bc6f89dc44ce tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:18.543416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-99d391fb-f6f5-465a-a8d9-bc6f89dc44ce tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:18.544877 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-99d391fb-f6f5-465a-a8d9-bc6f89dc44ce tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.331149 Oct 29 01:16:18.553659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f0d7a2fa-f43c-42f8-8e1b-b7b9ed02cdcb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:18.554836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f0d7a2fa-f43c-42f8-8e1b-b7b9ed02cdcb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:18.558729 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1429/2995] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:18 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:18.566532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0d7a2fa-f43c-42f8-8e1b-b7b9ed02cdcb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:18.571596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0d7a2fa-f43c-42f8-8e1b-b7b9ed02cdcb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:18.571596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0d7a2fa-f43c-42f8-8e1b-b7b9ed02cdcb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:18.571596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0d7a2fa-f43c-42f8-8e1b-b7b9ed02cdcb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:18.571596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0d7a2fa-f43c-42f8-8e1b-b7b9ed02cdcb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:18.571596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0d7a2fa-f43c-42f8-8e1b-b7b9ed02cdcb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:18.572109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-017b6f2e-119e-49af-9fd1-64663bb00425 req-ea85fb3a-5f25-488d-aec9-d2e89e309623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6448587-2777-40b9-a6c5-514e56ac388d", "tag": "c3863196-8c5a-43b7-805d-2e866f9ea0f9"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:18.583291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-017b6f2e-119e-49af-9fd1-64663bb00425 req-ea85fb3a-5f25-488d-aec9-d2e89e309623 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:18.584012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-017b6f2e-119e-49af-9fd1-64663bb00425 req-ea85fb3a-5f25-488d-aec9-d2e89e309623 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:18.584669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-017b6f2e-119e-49af-9fd1-64663bb00425 req-ea85fb3a-5f25-488d-aec9-d2e89e309623 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:18.597559 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-017b6f2e-119e-49af-9fd1-64663bb00425 req-ea85fb3a-5f25-488d-aec9-d2e89e309623 service nova] Creating event network-changed:c3863196-8c5a-43b7-805d-2e866f9ea0f9 for instance b6448587-2777-40b9-a6c5-514e56ac388d on n-h2-862964-3 Oct 29 01:16:18.603479 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-017b6f2e-119e-49af-9fd1-64663bb00425 req-ea85fb3a-5f25-488d-aec9-d2e89e309623 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043034 Oct 29 01:16:18.604256 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1430/2996] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:18.609760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-936483e3-2569-4a3d-a0ce-c5b1e9f6c125 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:18.610465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-936483e3-2569-4a3d-a0ce-c5b1e9f6c125 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:18.616877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-936483e3-2569-4a3d-a0ce-c5b1e9f6c125 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:18.617402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-936483e3-2569-4a3d-a0ce-c5b1e9f6c125 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:18.617845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-936483e3-2569-4a3d-a0ce-c5b1e9f6c125 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:18.618544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-936483e3-2569-4a3d-a0ce-c5b1e9f6c125 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:18.619185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-936483e3-2569-4a3d-a0ce-c5b1e9f6c125 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:18.619940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-936483e3-2569-4a3d-a0ce-c5b1e9f6c125 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:18.865107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f0d7a2fa-f43c-42f8-8e1b-b7b9ed02cdcb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:18.875903 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f0d7a2fa-f43c-42f8-8e1b-b7b9ed02cdcb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1539 microversion: 2.1 time: 0.333867 Oct 29 01:16:18.876898 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1567/2997] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:18 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1539 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:18.882748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-87419999-0af6-4088-aa4d-32106b6c2767 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:18.883803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-87419999-0af6-4088-aa4d-32106b6c2767 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:18.891945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87419999-0af6-4088-aa4d-32106b6c2767 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:18.892933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87419999-0af6-4088-aa4d-32106b6c2767 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:18.893505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87419999-0af6-4088-aa4d-32106b6c2767 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:18.894404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87419999-0af6-4088-aa4d-32106b6c2767 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:18.894972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87419999-0af6-4088-aa4d-32106b6c2767 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:18.895504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87419999-0af6-4088-aa4d-32106b6c2767 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:18.961534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-936483e3-2569-4a3d-a0ce-c5b1e9f6c125 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:18.972340 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-936483e3-2569-4a3d-a0ce-c5b1e9f6c125 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1479 microversion: 2.1 time: 0.366714 Oct 29 01:16:18.973484 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1431/2998] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:18 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1479 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:18.982280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-6047dd8f-7698-4c83-bfaa-bcb10eeaf2b3 req-97b217e3-04b1-4d94-882f-632b12af347d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66e51083-7f72-4e67-a945-1607eddf7b3c", "tag": "39918983-d363-4e1e-ab8a-57bfa5a575e1"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:18.992175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6047dd8f-7698-4c83-bfaa-bcb10eeaf2b3 req-97b217e3-04b1-4d94-882f-632b12af347d service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:18.993078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6047dd8f-7698-4c83-bfaa-bcb10eeaf2b3 req-97b217e3-04b1-4d94-882f-632b12af347d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:18.997252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6047dd8f-7698-4c83-bfaa-bcb10eeaf2b3 req-97b217e3-04b1-4d94-882f-632b12af347d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:19.004796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-87419999-0af6-4088-aa4d-32106b6c2767 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:19.007908 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-6047dd8f-7698-4c83-bfaa-bcb10eeaf2b3 req-97b217e3-04b1-4d94-882f-632b12af347d service nova] Creating event network-changed:39918983-d363-4e1e-ab8a-57bfa5a575e1 for instance 66e51083-7f72-4e67-a945-1607eddf7b3c on n-h1-862964-3 Oct 29 01:16:19.015839 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-6047dd8f-7698-4c83-bfaa-bcb10eeaf2b3 req-97b217e3-04b1-4d94-882f-632b12af347d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037894 Oct 29 01:16:19.018155 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1432/2999] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:19.022816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-87419999-0af6-4088-aa4d-32106b6c2767 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:19.025170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4f77149f-ab9c-42da-89cc-06adc22461fd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:19.026806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4f77149f-ab9c-42da-89cc-06adc22461fd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:19.028864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-87419999-0af6-4088-aa4d-32106b6c2767 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:19.030781 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-87419999-0af6-4088-aa4d-32106b6c2767 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1336 microversion: 2.47 time: 0.152658 Oct 29 01:16:19.031466 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1568/3000] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:18 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1336 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:19.036093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-1edf4b80-5035-4748-ac0a-cefc15054f19 req-03c76da5-822b-47fa-b25a-3aa49be574fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88cce5a-4c01-4354-895a-54148d701f7c", "name": "network-vif-unplugged", "status": "completed", "tag": "3cdeecea-ff58-4590-b370-37477a47edc3"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:19.042529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f77149f-ab9c-42da-89cc-06adc22461fd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:19.042529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f77149f-ab9c-42da-89cc-06adc22461fd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:19.042529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f77149f-ab9c-42da-89cc-06adc22461fd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:19.042529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f77149f-ab9c-42da-89cc-06adc22461fd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:19.042529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f77149f-ab9c-42da-89cc-06adc22461fd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:19.042529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f77149f-ab9c-42da-89cc-06adc22461fd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:19.044020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:19.046809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1edf4b80-5035-4748-ac0a-cefc15054f19 req-03c76da5-822b-47fa-b25a-3aa49be574fe service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:19.047289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1edf4b80-5035-4748-ac0a-cefc15054f19 req-03c76da5-822b-47fa-b25a-3aa49be574fe service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:19.047723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1edf4b80-5035-4748-ac0a-cefc15054f19 req-03c76da5-822b-47fa-b25a-3aa49be574fe service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:19.059282 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-1edf4b80-5035-4748-ac0a-cefc15054f19 req-03c76da5-822b-47fa-b25a-3aa49be574fe service nova] Creating event network-vif-unplugged:3cdeecea-ff58-4590-b370-37477a47edc3 for instance b88cce5a-4c01-4354-895a-54148d701f7c on n-h1-862964-3 Oct 29 01:16:19.064185 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-1edf4b80-5035-4748-ac0a-cefc15054f19 req-03c76da5-822b-47fa-b25a-3aa49be574fe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031386 Oct 29 01:16:19.064929 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1569/3001] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:19.185537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4f77149f-ab9c-42da-89cc-06adc22461fd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:19.193832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4f77149f-ab9c-42da-89cc-06adc22461fd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:19.195467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4f77149f-ab9c-42da-89cc-06adc22461fd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:19.196581 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4f77149f-ab9c-42da-89cc-06adc22461fd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1358 microversion: 2.21 time: 0.176872 Oct 29 01:16:19.197125 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1433/3002] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:19 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:19.202425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4b7ef336-65e5-4bc3-a6ca-28cde5833621 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:19.203138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4b7ef336-65e5-4bc3-a6ca-28cde5833621 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:19.209238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b7ef336-65e5-4bc3-a6ca-28cde5833621 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:19.209919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b7ef336-65e5-4bc3-a6ca-28cde5833621 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:19.211624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b7ef336-65e5-4bc3-a6ca-28cde5833621 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:19.211624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b7ef336-65e5-4bc3-a6ca-28cde5833621 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:19.211624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b7ef336-65e5-4bc3-a6ca-28cde5833621 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:19.211889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b7ef336-65e5-4bc3-a6ca-28cde5833621 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:19.252978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a37ff19d-9269-4aae-ac64-cccdb22746ac tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:19.253766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a37ff19d-9269-4aae-ac64-cccdb22746ac tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:19.261185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a37ff19d-9269-4aae-ac64-cccdb22746ac tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:19.262125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a37ff19d-9269-4aae-ac64-cccdb22746ac tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:19.262248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a37ff19d-9269-4aae-ac64-cccdb22746ac tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:19.264067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a37ff19d-9269-4aae-ac64-cccdb22746ac tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:19.264067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a37ff19d-9269-4aae-ac64-cccdb22746ac tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:19.264067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a37ff19d-9269-4aae-ac64-cccdb22746ac tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:19.499771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4b7ef336-65e5-4bc3-a6ca-28cde5833621 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:19.507499 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4b7ef336-65e5-4bc3-a6ca-28cde5833621 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.311371 Oct 29 01:16:19.508067 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1570/3003] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:19 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:19.522417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a37ff19d-9269-4aae-ac64-cccdb22746ac tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:19.530425 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a37ff19d-9269-4aae-ac64-cccdb22746ac tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1355 microversion: 2.1 time: 0.281760 Oct 29 01:16:19.531193 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1434/3004] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:19 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1355 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:19.575567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-727bd3b7-82f8-4514-b8bb-ef34e03fffb0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:19.576173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-727bd3b7-82f8-4514-b8bb-ef34e03fffb0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:19.582147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-727bd3b7-82f8-4514-b8bb-ef34e03fffb0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:19.582622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-727bd3b7-82f8-4514-b8bb-ef34e03fffb0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:19.583053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-727bd3b7-82f8-4514-b8bb-ef34e03fffb0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:19.583732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-727bd3b7-82f8-4514-b8bb-ef34e03fffb0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:19.584184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-727bd3b7-82f8-4514-b8bb-ef34e03fffb0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:19.584602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-727bd3b7-82f8-4514-b8bb-ef34e03fffb0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:19.790158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-727bd3b7-82f8-4514-b8bb-ef34e03fffb0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:19.800118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-727bd3b7-82f8-4514-b8bb-ef34e03fffb0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:19.801707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-727bd3b7-82f8-4514-b8bb-ef34e03fffb0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:19.802733 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-727bd3b7-82f8-4514-b8bb-ef34e03fffb0 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.231763 Oct 29 01:16:19.803304 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1571/3005] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:19 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:19.899875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0a84d718-783b-441b-9368-0ba76ea75af2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:19.900415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0a84d718-783b-441b-9368-0ba76ea75af2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:19.908025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a84d718-783b-441b-9368-0ba76ea75af2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:19.908506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a84d718-783b-441b-9368-0ba76ea75af2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:19.908938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a84d718-783b-441b-9368-0ba76ea75af2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:19.909658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a84d718-783b-441b-9368-0ba76ea75af2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:19.910108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a84d718-783b-441b-9368-0ba76ea75af2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:19.910676 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a84d718-783b-441b-9368-0ba76ea75af2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:19.997780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-02055f72-7afe-4600-a9f5-5e1d4bedad95 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:19.998400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-02055f72-7afe-4600-a9f5-5e1d4bedad95 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:20.004628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02055f72-7afe-4600-a9f5-5e1d4bedad95 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:20.005418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02055f72-7afe-4600-a9f5-5e1d4bedad95 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:20.006125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02055f72-7afe-4600-a9f5-5e1d4bedad95 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:20.007017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02055f72-7afe-4600-a9f5-5e1d4bedad95 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:20.007645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02055f72-7afe-4600-a9f5-5e1d4bedad95 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:20.008215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02055f72-7afe-4600-a9f5-5e1d4bedad95 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:20.063754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0a84d718-783b-441b-9368-0ba76ea75af2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:20.072378 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0a84d718-783b-441b-9368-0ba76ea75af2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1539 microversion: 2.1 time: 0.176542 Oct 29 01:16:20.073052 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1435/3006] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:19 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1539 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:20.083302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2b5876ad-211b-47b4-b08d-7d229770a9f4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:20.084124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2b5876ad-211b-47b4-b08d-7d229770a9f4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:20.090943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b5876ad-211b-47b4-b08d-7d229770a9f4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:20.091430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b5876ad-211b-47b4-b08d-7d229770a9f4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:20.091874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b5876ad-211b-47b4-b08d-7d229770a9f4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:20.092840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b5876ad-211b-47b4-b08d-7d229770a9f4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:20.093560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b5876ad-211b-47b4-b08d-7d229770a9f4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:20.093993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b5876ad-211b-47b4-b08d-7d229770a9f4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:20.175222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2b5876ad-211b-47b4-b08d-7d229770a9f4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:20.183740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2b5876ad-211b-47b4-b08d-7d229770a9f4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:20.185240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2b5876ad-211b-47b4-b08d-7d229770a9f4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:20.186388 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2b5876ad-211b-47b4-b08d-7d229770a9f4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1336 microversion: 2.47 time: 0.111901 Oct 29 01:16:20.186963 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1436/3007] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:20 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1336 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:20.192008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-02055f72-7afe-4600-a9f5-5e1d4bedad95 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:20.200765 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-02055f72-7afe-4600-a9f5-5e1d4bedad95 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1479 microversion: 2.1 time: 0.208549 Oct 29 01:16:20.201638 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1572/3008] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:19 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1479 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:20.224086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5f665d5b-ed93-4b48-af94-b194045edba4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:20.224702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5f665d5b-ed93-4b48-af94-b194045edba4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:20.231210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f665d5b-ed93-4b48-af94-b194045edba4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:20.231706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f665d5b-ed93-4b48-af94-b194045edba4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:20.232146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f665d5b-ed93-4b48-af94-b194045edba4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:20.232847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f665d5b-ed93-4b48-af94-b194045edba4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:20.233339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f665d5b-ed93-4b48-af94-b194045edba4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:20.233786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f665d5b-ed93-4b48-af94-b194045edba4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:20.379580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5f665d5b-ed93-4b48-af94-b194045edba4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:20.383520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:20.389586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5f665d5b-ed93-4b48-af94-b194045edba4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:20.391049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5f665d5b-ed93-4b48-af94-b194045edba4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:20.392162 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5f665d5b-ed93-4b48-af94-b194045edba4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1358 microversion: 2.21 time: 0.171941 Oct 29 01:16:20.393698 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1437/3009] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:20 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:20.532618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-87a61cf6-e01d-4f66-84ad-0b0b89678e5c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:20.533279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-87a61cf6-e01d-4f66-84ad-0b0b89678e5c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:20.539468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87a61cf6-e01d-4f66-84ad-0b0b89678e5c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:20.539949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87a61cf6-e01d-4f66-84ad-0b0b89678e5c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:20.540387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87a61cf6-e01d-4f66-84ad-0b0b89678e5c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:20.541077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87a61cf6-e01d-4f66-84ad-0b0b89678e5c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:20.541560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87a61cf6-e01d-4f66-84ad-0b0b89678e5c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:20.546804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87a61cf6-e01d-4f66-84ad-0b0b89678e5c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:20.553494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a913269d-d8c5-4276-b851-eec925e29cd7 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:20.554373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a913269d-d8c5-4276-b851-eec925e29cd7 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:20.563071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a913269d-d8c5-4276-b851-eec925e29cd7 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:20.563681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a913269d-d8c5-4276-b851-eec925e29cd7 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:20.564605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a913269d-d8c5-4276-b851-eec925e29cd7 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:20.565591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a913269d-d8c5-4276-b851-eec925e29cd7 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:20.566256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a913269d-d8c5-4276-b851-eec925e29cd7 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:20.566889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a913269d-d8c5-4276-b851-eec925e29cd7 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:20.799734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-87a61cf6-e01d-4f66-84ad-0b0b89678e5c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:20.804242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a913269d-d8c5-4276-b851-eec925e29cd7 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:20.808981 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-87a61cf6-e01d-4f66-84ad-0b0b89678e5c tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.279533 Oct 29 01:16:20.813201 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a913269d-d8c5-4276-b851-eec925e29cd7 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1355 microversion: 2.1 time: 0.263621 Oct 29 01:16:20.814032 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1438/3010] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:20 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1355 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:20.825361 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1573/3011] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:20 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:20.830403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f068d6f4-db6a-48ef-bcc9-9cbd650d99d2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:20.831014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f068d6f4-db6a-48ef-bcc9-9cbd650d99d2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:20.837456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f068d6f4-db6a-48ef-bcc9-9cbd650d99d2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:20.839836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f068d6f4-db6a-48ef-bcc9-9cbd650d99d2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:20.839836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f068d6f4-db6a-48ef-bcc9-9cbd650d99d2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:20.840362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f068d6f4-db6a-48ef-bcc9-9cbd650d99d2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:20.840822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f068d6f4-db6a-48ef-bcc9-9cbd650d99d2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:20.841380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f068d6f4-db6a-48ef-bcc9-9cbd650d99d2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:21.051775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f068d6f4-db6a-48ef-bcc9-9cbd650d99d2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:21.062492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f068d6f4-db6a-48ef-bcc9-9cbd650d99d2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:21.064104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f068d6f4-db6a-48ef-bcc9-9cbd650d99d2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:21.071460 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f068d6f4-db6a-48ef-bcc9-9cbd650d99d2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.238905 Oct 29 01:16:21.071460 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1574/3012] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:20 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:21.079397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-4d316154-5cc4-4f80-94ce-9e4d8a686623 req-9b7d6c21-5c6d-4e11-a5cc-0b87b10fd089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "name": "network-vif-plugged", "status": "completed", "tag": "d00f19cc-89ea-4719-aa7c-b9d320f81a37"}, {"server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "name": "network-vif-plugged", "status": "completed", "tag": "913a07b9-ad16-4d31-879a-a34b9897edf8"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:21.093217 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4d316154-5cc4-4f80-94ce-9e4d8a686623 req-9b7d6c21-5c6d-4e11-a5cc-0b87b10fd089 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:21.093992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4d316154-5cc4-4f80-94ce-9e4d8a686623 req-9b7d6c21-5c6d-4e11-a5cc-0b87b10fd089 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:21.094434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4d316154-5cc4-4f80-94ce-9e4d8a686623 req-9b7d6c21-5c6d-4e11-a5cc-0b87b10fd089 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:21.096540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bfe20565-27e0-4659-a528-24469636ff89 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:21.097411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bfe20565-27e0-4659-a528-24469636ff89 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:21.104352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfe20565-27e0-4659-a528-24469636ff89 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:21.105811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfe20565-27e0-4659-a528-24469636ff89 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:21.106500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfe20565-27e0-4659-a528-24469636ff89 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:21.107608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfe20565-27e0-4659-a528-24469636ff89 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:21.108347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfe20565-27e0-4659-a528-24469636ff89 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:21.108558 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-4d316154-5cc4-4f80-94ce-9e4d8a686623 req-9b7d6c21-5c6d-4e11-a5cc-0b87b10fd089 service nova] Creating event network-vif-plugged:d00f19cc-89ea-4719-aa7c-b9d320f81a37 for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:16:21.109080 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-4d316154-5cc4-4f80-94ce-9e4d8a686623 req-9b7d6c21-5c6d-4e11-a5cc-0b87b10fd089 service nova] Creating event network-vif-plugged:913a07b9-ad16-4d31-879a-a34b9897edf8 for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:16:21.109381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfe20565-27e0-4659-a528-24469636ff89 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:21.115109 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-4d316154-5cc4-4f80-94ce-9e4d8a686623 req-9b7d6c21-5c6d-4e11-a5cc-0b87b10fd089 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039595 Oct 29 01:16:21.116196 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1439/3013] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:21.212521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-36394ae6-f3d7-487f-9e4c-0195cf8bc469 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:21.213676 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-36394ae6-f3d7-487f-9e4c-0195cf8bc469 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:21.222476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36394ae6-f3d7-487f-9e4c-0195cf8bc469 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:21.223273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36394ae6-f3d7-487f-9e4c-0195cf8bc469 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:21.223877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36394ae6-f3d7-487f-9e4c-0195cf8bc469 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:21.224758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36394ae6-f3d7-487f-9e4c-0195cf8bc469 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:21.225411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36394ae6-f3d7-487f-9e4c-0195cf8bc469 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:21.226012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36394ae6-f3d7-487f-9e4c-0195cf8bc469 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:21.263440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bfe20565-27e0-4659-a528-24469636ff89 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:21.271798 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bfe20565-27e0-4659-a528-24469636ff89 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1539 microversion: 2.1 time: 0.179672 Oct 29 01:16:21.272638 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1575/3014] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:21 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1539 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:21.277581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-93de61f9-d06e-412e-8f07-42a3a03315c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:21.278435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-93de61f9-d06e-412e-8f07-42a3a03315c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:21.284893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93de61f9-d06e-412e-8f07-42a3a03315c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:21.285788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93de61f9-d06e-412e-8f07-42a3a03315c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:21.286397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93de61f9-d06e-412e-8f07-42a3a03315c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:21.289825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93de61f9-d06e-412e-8f07-42a3a03315c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:21.289825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93de61f9-d06e-412e-8f07-42a3a03315c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:21.289825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93de61f9-d06e-412e-8f07-42a3a03315c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:21.316642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-36394ae6-f3d7-487f-9e4c-0195cf8bc469 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:21.327119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-36394ae6-f3d7-487f-9e4c-0195cf8bc469 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:21.328997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-36394ae6-f3d7-487f-9e4c-0195cf8bc469 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:21.330274 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-36394ae6-f3d7-487f-9e4c-0195cf8bc469 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1336 microversion: 2.47 time: 0.122079 Oct 29 01:16:21.331023 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1440/3015] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:21 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1336 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:21.419239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bbb0d358-11fb-43c2-8aac-91496fdfcd5b tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:21.420883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bbb0d358-11fb-43c2-8aac-91496fdfcd5b tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:21.428507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbb0d358-11fb-43c2-8aac-91496fdfcd5b tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:21.434124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbb0d358-11fb-43c2-8aac-91496fdfcd5b tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:21.434124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbb0d358-11fb-43c2-8aac-91496fdfcd5b tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:21.434124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbb0d358-11fb-43c2-8aac-91496fdfcd5b tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:21.434124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbb0d358-11fb-43c2-8aac-91496fdfcd5b tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:21.434124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbb0d358-11fb-43c2-8aac-91496fdfcd5b tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:21.471705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-93de61f9-d06e-412e-8f07-42a3a03315c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:21.482594 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-93de61f9-d06e-412e-8f07-42a3a03315c1 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1479 microversion: 2.1 time: 0.207936 Oct 29 01:16:21.483666 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1576/3016] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:21 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1479 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:21.600163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bbb0d358-11fb-43c2-8aac-91496fdfcd5b tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:21.610393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bbb0d358-11fb-43c2-8aac-91496fdfcd5b tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:21.612617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bbb0d358-11fb-43c2-8aac-91496fdfcd5b tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:21.613794 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bbb0d358-11fb-43c2-8aac-91496fdfcd5b tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1358 microversion: 2.21 time: 0.199445 Oct 29 01:16:21.614358 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1441/3017] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:21 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:16:21.837447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-67e38885-10fd-4ef2-9a7e-273a565bffaf tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:21.838066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-67e38885-10fd-4ef2-9a7e-273a565bffaf tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:21.844690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c4a282c4-99ec-452c-8ff8-bdb9dfb3486b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:21.845633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c4a282c4-99ec-452c-8ff8-bdb9dfb3486b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:21.859144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67e38885-10fd-4ef2-9a7e-273a565bffaf tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:21.859644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67e38885-10fd-4ef2-9a7e-273a565bffaf tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:21.860109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67e38885-10fd-4ef2-9a7e-273a565bffaf tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:21.860812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67e38885-10fd-4ef2-9a7e-273a565bffaf tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:21.862606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4a282c4-99ec-452c-8ff8-bdb9dfb3486b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:21.863269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4a282c4-99ec-452c-8ff8-bdb9dfb3486b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:21.863711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4a282c4-99ec-452c-8ff8-bdb9dfb3486b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:21.864405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4a282c4-99ec-452c-8ff8-bdb9dfb3486b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:21.864855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4a282c4-99ec-452c-8ff8-bdb9dfb3486b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:21.865874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67e38885-10fd-4ef2-9a7e-273a565bffaf tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:21.866557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67e38885-10fd-4ef2-9a7e-273a565bffaf tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:21.867584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4a282c4-99ec-452c-8ff8-bdb9dfb3486b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:22.302354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=40 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:22.495263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-67e38885-10fd-4ef2-9a7e-273a565bffaf tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:22.512433 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-67e38885-10fd-4ef2-9a7e-273a565bffaf tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1355 microversion: 2.1 time: 0.678926 Oct 29 01:16:22.519764 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1442/3018] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:21 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1355 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:22.528221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-091bca1a-e8ad-4ea0-ba0c-e465342aab35 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:22.538134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c4a282c4-99ec-452c-8ff8-bdb9dfb3486b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:22.540194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-091bca1a-e8ad-4ea0-ba0c-e465342aab35 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:22.549688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-091bca1a-e8ad-4ea0-ba0c-e465342aab35 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:22.550504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-091bca1a-e8ad-4ea0-ba0c-e465342aab35 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:22.551146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-091bca1a-e8ad-4ea0-ba0c-e465342aab35 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:22.552078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-091bca1a-e8ad-4ea0-ba0c-e465342aab35 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:22.559799 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c4a282c4-99ec-452c-8ff8-bdb9dfb3486b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.729011 Oct 29 01:16:22.560647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-091bca1a-e8ad-4ea0-ba0c-e465342aab35 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:22.561418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-091bca1a-e8ad-4ea0-ba0c-e465342aab35 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:22.564576 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1577/3019] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:21 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:22.578527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9b98de80-09ee-4668-b4f1-ed4e18da4bc6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:22.581128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9b98de80-09ee-4668-b4f1-ed4e18da4bc6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:22.593338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b98de80-09ee-4668-b4f1-ed4e18da4bc6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:22.594493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b98de80-09ee-4668-b4f1-ed4e18da4bc6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:22.595279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b98de80-09ee-4668-b4f1-ed4e18da4bc6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:22.596192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b98de80-09ee-4668-b4f1-ed4e18da4bc6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:22.596842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b98de80-09ee-4668-b4f1-ed4e18da4bc6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:22.597612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b98de80-09ee-4668-b4f1-ed4e18da4bc6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:22.624977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:22.799874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=32 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:23.046419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9b98de80-09ee-4668-b4f1-ed4e18da4bc6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:23.058739 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9b98de80-09ee-4668-b4f1-ed4e18da4bc6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1534 microversion: 2.1 time: 0.490126 Oct 29 01:16:23.058739 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1578/3020] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:22 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1534 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:23.065327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd25111c-71da-4373-b2b5-f240db91e482 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:23.066179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bd25111c-71da-4373-b2b5-f240db91e482 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:23.076537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-091bca1a-e8ad-4ea0-ba0c-e465342aab35 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:23.077129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd25111c-71da-4373-b2b5-f240db91e482 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:23.078127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd25111c-71da-4373-b2b5-f240db91e482 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:23.078869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd25111c-71da-4373-b2b5-f240db91e482 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:23.079589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd25111c-71da-4373-b2b5-f240db91e482 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:23.080754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd25111c-71da-4373-b2b5-f240db91e482 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:23.081229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd25111c-71da-4373-b2b5-f240db91e482 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:23.098362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-091bca1a-e8ad-4ea0-ba0c-e465342aab35 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:23.100355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-091bca1a-e8ad-4ea0-ba0c-e465342aab35 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:23.102903 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-091bca1a-e8ad-4ea0-ba0c-e465342aab35 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.581652 Oct 29 01:16:23.104101 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1443/3021] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:22 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:23.114587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aa70a4fc-53d4-4491-80e9-12a05674ef65 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:23.115609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aa70a4fc-53d4-4491-80e9-12a05674ef65 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:23.127960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa70a4fc-53d4-4491-80e9-12a05674ef65 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:23.128520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa70a4fc-53d4-4491-80e9-12a05674ef65 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:23.129138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa70a4fc-53d4-4491-80e9-12a05674ef65 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:23.133055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa70a4fc-53d4-4491-80e9-12a05674ef65 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:23.133055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa70a4fc-53d4-4491-80e9-12a05674ef65 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:23.133055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa70a4fc-53d4-4491-80e9-12a05674ef65 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:23.188694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bd25111c-71da-4373-b2b5-f240db91e482 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:23.199542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bd25111c-71da-4373-b2b5-f240db91e482 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:23.200918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bd25111c-71da-4373-b2b5-f240db91e482 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:23.202352 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bd25111c-71da-4373-b2b5-f240db91e482 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1357 microversion: 2.47 time: 0.141028 Oct 29 01:16:23.203356 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1579/3022] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:23 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1357 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:23.213241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f3611cae-f2b5-4121-8c05-e954948931de tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:23.214069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f3611cae-f2b5-4121-8c05-e954948931de tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:23.222618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3611cae-f2b5-4121-8c05-e954948931de tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:23.223824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3611cae-f2b5-4121-8c05-e954948931de tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:23.224351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3611cae-f2b5-4121-8c05-e954948931de tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:23.225258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3611cae-f2b5-4121-8c05-e954948931de tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:23.225868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3611cae-f2b5-4121-8c05-e954948931de tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:23.226470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3611cae-f2b5-4121-8c05-e954948931de tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:23.360849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aa70a4fc-53d4-4491-80e9-12a05674ef65 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:23.368907 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aa70a4fc-53d4-4491-80e9-12a05674ef65 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1479 microversion: 2.1 time: 0.263404 Oct 29 01:16:23.383006 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1444/3023] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:23 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1479 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:23.389205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-98eaf727-93ef-4ef5-81e8-80dd76077fad req-19378e69-3474-41c7-a045-a9c31e889738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "name": "network-vif-plugged", "status": "completed", "tag": "f39a3550-9b81-4cf3-b84a-f81318c9a9cb"}, {"server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "name": "network-vif-plugged", "status": "completed", "tag": "eb30986f-1ab2-4e01-a0ab-fea8fcfc435c"}, {"server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "name": "network-vif-plugged", "status": "completed", "tag": "27a1b433-eeb0-4aaa-86e0-7e13f0a59c70"}, {"server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "name": "network-vif-plugged", "status": "completed", "tag": "1848d527-bac1-41c8-956e-7737379b67ca"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:23.399434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-98eaf727-93ef-4ef5-81e8-80dd76077fad req-19378e69-3474-41c7-a045-a9c31e889738 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:23.399946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-98eaf727-93ef-4ef5-81e8-80dd76077fad req-19378e69-3474-41c7-a045-a9c31e889738 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:23.400375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-98eaf727-93ef-4ef5-81e8-80dd76077fad req-19378e69-3474-41c7-a045-a9c31e889738 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:23.410899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f3611cae-f2b5-4121-8c05-e954948931de tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:23.427873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f3611cae-f2b5-4121-8c05-e954948931de tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:23.429306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f3611cae-f2b5-4121-8c05-e954948931de tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:23.430730 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f3611cae-f2b5-4121-8c05-e954948931de tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1358 microversion: 2.21 time: 0.225812 Oct 29 01:16:23.439052 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1580/3024] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:23 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:23.439052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:23.441058 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-98eaf727-93ef-4ef5-81e8-80dd76077fad req-19378e69-3474-41c7-a045-a9c31e889738 service nova] Creating event network-vif-plugged:f39a3550-9b81-4cf3-b84a-f81318c9a9cb for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:16:23.441595 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-98eaf727-93ef-4ef5-81e8-80dd76077fad req-19378e69-3474-41c7-a045-a9c31e889738 service nova] Creating event network-vif-plugged:eb30986f-1ab2-4e01-a0ab-fea8fcfc435c for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:16:23.441912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:23.442087 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-98eaf727-93ef-4ef5-81e8-80dd76077fad req-19378e69-3474-41c7-a045-a9c31e889738 service nova] Creating event network-vif-plugged:27a1b433-eeb0-4aaa-86e0-7e13f0a59c70 for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:16:23.442583 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-98eaf727-93ef-4ef5-81e8-80dd76077fad req-19378e69-3474-41c7-a045-a9c31e889738 service nova] Creating event network-vif-plugged:1848d527-bac1-41c8-956e-7737379b67ca for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:16:23.449572 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-98eaf727-93ef-4ef5-81e8-80dd76077fad req-19378e69-3474-41c7-a045-a9c31e889738 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.077587 Oct 29 01:16:23.450305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:23.450886 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1445/3025] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:23.451277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:23.451923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:23.452638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:23.453106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:23.453638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:23.547276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2241636e-27e5-4dbf-8a14-a112afd4a8b4 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:23.548741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2241636e-27e5-4dbf-8a14-a112afd4a8b4 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:23.552289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:16:23.552798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:16:23.553423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:16:23.553991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:16:23.554410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:16:23.556767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2241636e-27e5-4dbf-8a14-a112afd4a8b4 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:23.557563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2241636e-27e5-4dbf-8a14-a112afd4a8b4 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:23.558290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2241636e-27e5-4dbf-8a14-a112afd4a8b4 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:23.559363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2241636e-27e5-4dbf-8a14-a112afd4a8b4 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:23.560022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2241636e-27e5-4dbf-8a14-a112afd4a8b4 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:23.560645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2241636e-27e5-4dbf-8a14-a112afd4a8b4 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:23.783436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:23.792151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:23.793058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:23.793773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:23.795881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:23.796553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:23.797347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:23.838084 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1cf1cfe1-f273-411d-81b5-6862e7cad38d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "POST /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46/action" status: 202 len: 1079 microversion: 2.47 time: 0.405066 Oct 29 01:16:23.839105 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1581/3026] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 29 01:16:23 2022] POST /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46/action => generated 1079 bytes in 407 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 29 01:16:23.844388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eab427dd-a414-4dbd-b9d9-d6a35b7bebc3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:23.845434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eab427dd-a414-4dbd-b9d9-d6a35b7bebc3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:23.852758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eab427dd-a414-4dbd-b9d9-d6a35b7bebc3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:23.853615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eab427dd-a414-4dbd-b9d9-d6a35b7bebc3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:23.854319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eab427dd-a414-4dbd-b9d9-d6a35b7bebc3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:23.855354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eab427dd-a414-4dbd-b9d9-d6a35b7bebc3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:23.856201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eab427dd-a414-4dbd-b9d9-d6a35b7bebc3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:23.857143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eab427dd-a414-4dbd-b9d9-d6a35b7bebc3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:24.388373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2241636e-27e5-4dbf-8a14-a112afd4a8b4 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:24.407597 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2241636e-27e5-4dbf-8a14-a112afd4a8b4 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1355 microversion: 2.1 time: 0.865204 Oct 29 01:16:24.408512 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1446/3027] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:23 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1355 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:24.428911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b598b30e-1553-4b2c-8c28-7a0a39a70163 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:24.430015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b598b30e-1553-4b2c-8c28-7a0a39a70163 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:24.437761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b598b30e-1553-4b2c-8c28-7a0a39a70163 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:24.438250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b598b30e-1553-4b2c-8c28-7a0a39a70163 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:24.438824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b598b30e-1553-4b2c-8c28-7a0a39a70163 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:24.439557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b598b30e-1553-4b2c-8c28-7a0a39a70163 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:24.440015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b598b30e-1553-4b2c-8c28-7a0a39a70163 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:24.440603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b598b30e-1553-4b2c-8c28-7a0a39a70163 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:24.501348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eab427dd-a414-4dbd-b9d9-d6a35b7bebc3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:24.515979 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eab427dd-a414-4dbd-b9d9-d6a35b7bebc3 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.675528 Oct 29 01:16:24.518281 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1582/3028] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:23 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:24.526434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aceddd37-96c9-4a6f-9330-5bddec32980b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:24.529723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b598b30e-1553-4b2c-8c28-7a0a39a70163 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:24.550949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-aceddd37-96c9-4a6f-9330-5bddec32980b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:24.557413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b598b30e-1553-4b2c-8c28-7a0a39a70163 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:24.559521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b598b30e-1553-4b2c-8c28-7a0a39a70163 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:24.561726 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b598b30e-1553-4b2c-8c28-7a0a39a70163 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1366 microversion: 2.47 time: 0.151263 Oct 29 01:16:24.562619 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1447/3029] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:24 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:24.563624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aceddd37-96c9-4a6f-9330-5bddec32980b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:24.564237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aceddd37-96c9-4a6f-9330-5bddec32980b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:24.564743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aceddd37-96c9-4a6f-9330-5bddec32980b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:24.565576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aceddd37-96c9-4a6f-9330-5bddec32980b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:24.566317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aceddd37-96c9-4a6f-9330-5bddec32980b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:24.566815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aceddd37-96c9-4a6f-9330-5bddec32980b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:24.589015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-79eadf3a-7329-49f1-9a5b-0f8b648491ab tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:24.589015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-79eadf3a-7329-49f1-9a5b-0f8b648491ab tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:24.596169 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79eadf3a-7329-49f1-9a5b-0f8b648491ab tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:24.596953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79eadf3a-7329-49f1-9a5b-0f8b648491ab tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:24.597488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79eadf3a-7329-49f1-9a5b-0f8b648491ab tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:24.598132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79eadf3a-7329-49f1-9a5b-0f8b648491ab tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:24.598625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79eadf3a-7329-49f1-9a5b-0f8b648491ab tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:24.599262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79eadf3a-7329-49f1-9a5b-0f8b648491ab tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:25.004921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-aceddd37-96c9-4a6f-9330-5bddec32980b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:25.014337 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aceddd37-96c9-4a6f-9330-5bddec32980b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1521 microversion: 2.1 time: 0.494698 Oct 29 01:16:25.033189 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1583/3030] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:24 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:25.033189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-11eb1745-6382-4889-82a4-1f80bdd465d7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:25.033189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-11eb1745-6382-4889-82a4-1f80bdd465d7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:25.033189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11eb1745-6382-4889-82a4-1f80bdd465d7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:25.033189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11eb1745-6382-4889-82a4-1f80bdd465d7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:25.033189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11eb1745-6382-4889-82a4-1f80bdd465d7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:25.033189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11eb1745-6382-4889-82a4-1f80bdd465d7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:25.033189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11eb1745-6382-4889-82a4-1f80bdd465d7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:25.033189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11eb1745-6382-4889-82a4-1f80bdd465d7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:25.133255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-79eadf3a-7329-49f1-9a5b-0f8b648491ab tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:25.150052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-79eadf3a-7329-49f1-9a5b-0f8b648491ab tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:25.151953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-79eadf3a-7329-49f1-9a5b-0f8b648491ab tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:25.154580 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-79eadf3a-7329-49f1-9a5b-0f8b648491ab tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.590864 Oct 29 01:16:25.176603 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1448/3031] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:24 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:25.186690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-00f9bf33-3dfd-4648-b4b8-aa03fe139986 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:25.187415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-00f9bf33-3dfd-4648-b4b8-aa03fe139986 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:25.190460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:25.195497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00f9bf33-3dfd-4648-b4b8-aa03fe139986 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:25.195988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00f9bf33-3dfd-4648-b4b8-aa03fe139986 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:25.196427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00f9bf33-3dfd-4648-b4b8-aa03fe139986 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:25.197138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00f9bf33-3dfd-4648-b4b8-aa03fe139986 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:25.197757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00f9bf33-3dfd-4648-b4b8-aa03fe139986 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:25.198049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00f9bf33-3dfd-4648-b4b8-aa03fe139986 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:25.479335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-11eb1745-6382-4889-82a4-1f80bdd465d7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:25.499339 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-11eb1745-6382-4889-82a4-1f80bdd465d7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1464 microversion: 2.1 time: 0.483363 Oct 29 01:16:25.503875 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1584/3032] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:25 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1464 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:25.507612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4ffbb119-4f66-4616-a2cb-b09a1acb528d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:25.512651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4ffbb119-4f66-4616-a2cb-b09a1acb528d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:25.519902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ffbb119-4f66-4616-a2cb-b09a1acb528d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:25.520615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ffbb119-4f66-4616-a2cb-b09a1acb528d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:25.521401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ffbb119-4f66-4616-a2cb-b09a1acb528d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:25.522898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ffbb119-4f66-4616-a2cb-b09a1acb528d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:25.523517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ffbb119-4f66-4616-a2cb-b09a1acb528d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:25.524564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ffbb119-4f66-4616-a2cb-b09a1acb528d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:25.568581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4ffbb119-4f66-4616-a2cb-b09a1acb528d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:16:25.660342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-00f9bf33-3dfd-4648-b4b8-aa03fe139986 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:25.671480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-00f9bf33-3dfd-4648-b4b8-aa03fe139986 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:25.673669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-00f9bf33-3dfd-4648-b4b8-aa03fe139986 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:25.675051 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-00f9bf33-3dfd-4648-b4b8-aa03fe139986 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1358 microversion: 2.21 time: 0.493153 Oct 29 01:16:25.675693 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1449/3033] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:25 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1358 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:25.681143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8c6cb2b3-3142-45c0-abcc-4b58674918ef tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:25.681876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8c6cb2b3-3142-45c0-abcc-4b58674918ef tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:25.694056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c6cb2b3-3142-45c0-abcc-4b58674918ef tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:25.694857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c6cb2b3-3142-45c0-abcc-4b58674918ef tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:25.695463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c6cb2b3-3142-45c0-abcc-4b58674918ef tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:25.696364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c6cb2b3-3142-45c0-abcc-4b58674918ef tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:25.696905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c6cb2b3-3142-45c0-abcc-4b58674918ef tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:25.697560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c6cb2b3-3142-45c0-abcc-4b58674918ef tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:25.912689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8c6cb2b3-3142-45c0-abcc-4b58674918ef tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:25.923421 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8c6cb2b3-3142-45c0-abcc-4b58674918ef tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1355 microversion: 2.1 time: 0.246596 Oct 29 01:16:25.925841 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1450/3034] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:25 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1355 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:25.931916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-ac1b823e-23eb-401c-98b8-f889f39a96dd req-8cbc2ced-8ab0-43fc-8222-0c361f39e920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "name": "network-vif-plugged", "status": "completed", "tag": "e7524267-ec12-4093-8a7b-fe4b7e069f3a"}, {"server_uuid": "b88cce5a-4c01-4354-895a-54148d701f7c", "name": "network-vif-plugged", "status": "completed", "tag": "3cdeecea-ff58-4590-b370-37477a47edc3"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:25.943854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ac1b823e-23eb-401c-98b8-f889f39a96dd req-8cbc2ced-8ab0-43fc-8222-0c361f39e920 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:25.944475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ac1b823e-23eb-401c-98b8-f889f39a96dd req-8cbc2ced-8ab0-43fc-8222-0c361f39e920 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:25.945266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ac1b823e-23eb-401c-98b8-f889f39a96dd req-8cbc2ced-8ab0-43fc-8222-0c361f39e920 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:25.960653 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-ac1b823e-23eb-401c-98b8-f889f39a96dd req-8cbc2ced-8ab0-43fc-8222-0c361f39e920 service nova] Creating event network-vif-plugged:e7524267-ec12-4093-8a7b-fe4b7e069f3a for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:16:25.961514 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-ac1b823e-23eb-401c-98b8-f889f39a96dd req-8cbc2ced-8ab0-43fc-8222-0c361f39e920 service nova] Creating event network-vif-plugged:3cdeecea-ff58-4590-b370-37477a47edc3 for instance b88cce5a-4c01-4354-895a-54148d701f7c on n-h1-862964-3 Oct 29 01:16:25.962258 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4ffbb119-4f66-4616-a2cb-b09a1acb528d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 204 len: 0 microversion: 2.1 time: 0.459557 Oct 29 01:16:25.962997 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1585/3035] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:16:25 2022] DELETE /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:16:25.970236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-767e1ef7-665f-414d-bbd5-9c8c93f8c052 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:25.971852 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-ac1b823e-23eb-401c-98b8-f889f39a96dd req-8cbc2ced-8ab0-43fc-8222-0c361f39e920 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043913 Oct 29 01:16:25.977392 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1451/3036] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:25.979295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-767e1ef7-665f-414d-bbd5-9c8c93f8c052 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:25.979703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f6aab899-b439-4f70-b681-e7d714fcfe37 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:25.979703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f6aab899-b439-4f70-b681-e7d714fcfe37 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:25.980475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-767e1ef7-665f-414d-bbd5-9c8c93f8c052 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:25.981078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-767e1ef7-665f-414d-bbd5-9c8c93f8c052 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:25.981431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-767e1ef7-665f-414d-bbd5-9c8c93f8c052 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:25.981966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-767e1ef7-665f-414d-bbd5-9c8c93f8c052 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:25.982671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-767e1ef7-665f-414d-bbd5-9c8c93f8c052 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:25.982892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-767e1ef7-665f-414d-bbd5-9c8c93f8c052 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:25.985944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6aab899-b439-4f70-b681-e7d714fcfe37 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:25.986435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6aab899-b439-4f70-b681-e7d714fcfe37 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:25.986872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6aab899-b439-4f70-b681-e7d714fcfe37 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:25.987571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6aab899-b439-4f70-b681-e7d714fcfe37 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:25.988029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6aab899-b439-4f70-b681-e7d714fcfe37 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:25.988454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6aab899-b439-4f70-b681-e7d714fcfe37 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:26.304069 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-767e1ef7-665f-414d-bbd5-9c8c93f8c052 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c/action" status: 202 len: 0 microversion: 2.1 time: 0.339752 Oct 29 01:16:26.305409 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1586/3037] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:16:25 2022] POST /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:16:26.311904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-986bcc43-a96a-4862-b061-9dbcc70bab51 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:26.312575 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-986bcc43-a96a-4862-b061-9dbcc70bab51 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:26.319681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-986bcc43-a96a-4862-b061-9dbcc70bab51 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:26.321985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-986bcc43-a96a-4862-b061-9dbcc70bab51 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:26.322451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-986bcc43-a96a-4862-b061-9dbcc70bab51 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:26.323194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-986bcc43-a96a-4862-b061-9dbcc70bab51 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:26.323696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-986bcc43-a96a-4862-b061-9dbcc70bab51 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:26.324263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-986bcc43-a96a-4862-b061-9dbcc70bab51 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:26.352229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f6aab899-b439-4f70-b681-e7d714fcfe37 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:26.364189 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f6aab899-b439-4f70-b681-e7d714fcfe37 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.390577 Oct 29 01:16:26.372500 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1452/3038] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:25 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:26.377667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-31b8e19e-1d61-40ea-a7f0-13b047113b02 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:26.381144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-31b8e19e-1d61-40ea-a7f0-13b047113b02 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:26.396452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31b8e19e-1d61-40ea-a7f0-13b047113b02 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:26.396787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31b8e19e-1d61-40ea-a7f0-13b047113b02 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:26.397450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31b8e19e-1d61-40ea-a7f0-13b047113b02 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:26.399155 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31b8e19e-1d61-40ea-a7f0-13b047113b02 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:26.400031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31b8e19e-1d61-40ea-a7f0-13b047113b02 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:26.400945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31b8e19e-1d61-40ea-a7f0-13b047113b02 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:26.451362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-986bcc43-a96a-4862-b061-9dbcc70bab51 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:26.477286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-986bcc43-a96a-4862-b061-9dbcc70bab51 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:26.477286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-986bcc43-a96a-4862-b061-9dbcc70bab51 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:26.477286 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-986bcc43-a96a-4862-b061-9dbcc70bab51 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1366 microversion: 2.47 time: 0.157519 Oct 29 01:16:26.477286 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1587/3039] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:26 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:26.477286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e111ad5-14f3-46b9-aaf2-6b348c4aaa5a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:26.477286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e111ad5-14f3-46b9-aaf2-6b348c4aaa5a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:26.488041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e111ad5-14f3-46b9-aaf2-6b348c4aaa5a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:26.488560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e111ad5-14f3-46b9-aaf2-6b348c4aaa5a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:26.491237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e111ad5-14f3-46b9-aaf2-6b348c4aaa5a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:26.491237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e111ad5-14f3-46b9-aaf2-6b348c4aaa5a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:26.491568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e111ad5-14f3-46b9-aaf2-6b348c4aaa5a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:26.491902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e111ad5-14f3-46b9-aaf2-6b348c4aaa5a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:26.743873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-31b8e19e-1d61-40ea-a7f0-13b047113b02 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:26.753640 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-31b8e19e-1d61-40ea-a7f0-13b047113b02 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1527 microversion: 2.1 time: 0.379743 Oct 29 01:16:26.754602 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1453/3040] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:26 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1527 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:26.792198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c6f12397-8ee1-440c-8495-9e4c17741e8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:26.806368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c6f12397-8ee1-440c-8495-9e4c17741e8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:26.818983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f12397-8ee1-440c-8495-9e4c17741e8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:26.819692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f12397-8ee1-440c-8495-9e4c17741e8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:26.820338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f12397-8ee1-440c-8495-9e4c17741e8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:26.821602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f12397-8ee1-440c-8495-9e4c17741e8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:26.822068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f12397-8ee1-440c-8495-9e4c17741e8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:26.822697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f12397-8ee1-440c-8495-9e4c17741e8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:26.856173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8e111ad5-14f3-46b9-aaf2-6b348c4aaa5a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:26.865835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8e111ad5-14f3-46b9-aaf2-6b348c4aaa5a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:26.867297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8e111ad5-14f3-46b9-aaf2-6b348c4aaa5a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:26.868513 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8e111ad5-14f3-46b9-aaf2-6b348c4aaa5a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.401745 Oct 29 01:16:26.869089 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1588/3041] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:26 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:26.886920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f12397-8ee1-440c-8495-9e4c17741e8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:26.887310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dc9e51db-b9ea-485e-96ce-209fc9435a08 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:26.887941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dc9e51db-b9ea-485e-96ce-209fc9435a08 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:26.888837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f12397-8ee1-440c-8495-9e4c17741e8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:26.890021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f12397-8ee1-440c-8495-9e4c17741e8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:26.891622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-c6f12397-8ee1-440c-8495-9e4c17741e8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lazy-loading 'fault' on Instance uuid b88cce5a-4c01-4354-895a-54148d701f7c {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:16:26.896275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc9e51db-b9ea-485e-96ce-209fc9435a08 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:26.896752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc9e51db-b9ea-485e-96ce-209fc9435a08 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:26.897230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc9e51db-b9ea-485e-96ce-209fc9435a08 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:26.897957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc9e51db-b9ea-485e-96ce-209fc9435a08 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:26.898423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc9e51db-b9ea-485e-96ce-209fc9435a08 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:26.898862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc9e51db-b9ea-485e-96ce-209fc9435a08 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:26.924620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:27.232628 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c6f12397-8ee1-440c-8495-9e4c17741e8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1598 microversion: 2.1 time: 0.476782 Oct 29 01:16:27.233497 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1454/3042] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:26 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1598 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:27.239599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ea899bd0-2577-4b65-a7e9-b5176edf0653 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:27.240422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ea899bd0-2577-4b65-a7e9-b5176edf0653 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:27.247578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea899bd0-2577-4b65-a7e9-b5176edf0653 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:27.248335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea899bd0-2577-4b65-a7e9-b5176edf0653 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:27.249258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea899bd0-2577-4b65-a7e9-b5176edf0653 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:27.250198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea899bd0-2577-4b65-a7e9-b5176edf0653 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:27.250988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea899bd0-2577-4b65-a7e9-b5176edf0653 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:27.251620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea899bd0-2577-4b65-a7e9-b5176edf0653 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:27.270090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dc9e51db-b9ea-485e-96ce-209fc9435a08 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:27.286162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dc9e51db-b9ea-485e-96ce-209fc9435a08 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:27.288924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dc9e51db-b9ea-485e-96ce-209fc9435a08 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:27.290564 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dc9e51db-b9ea-485e-96ce-209fc9435a08 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1358 microversion: 2.21 time: 0.416671 Oct 29 01:16:27.291770 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1589/3043] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:26 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1358 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:27.297814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-455203bb-65c4-4411-9dd3-2ef8b669fe8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:27.300134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-455203bb-65c4-4411-9dd3-2ef8b669fe8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:27.307349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-455203bb-65c4-4411-9dd3-2ef8b669fe8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:27.307860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-455203bb-65c4-4411-9dd3-2ef8b669fe8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:27.308548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-455203bb-65c4-4411-9dd3-2ef8b669fe8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:27.309284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-455203bb-65c4-4411-9dd3-2ef8b669fe8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:27.310038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-455203bb-65c4-4411-9dd3-2ef8b669fe8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:27.310465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-455203bb-65c4-4411-9dd3-2ef8b669fe8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:27.473669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ea899bd0-2577-4b65-a7e9-b5176edf0653 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:27.483276 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ea899bd0-2577-4b65-a7e9-b5176edf0653 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1355 microversion: 2.1 time: 0.248369 Oct 29 01:16:27.484172 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1455/3044] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:27 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1355 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:27.491305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-de937f3e-b1ff-405d-b063-bb8bd7d62f57 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:27.492429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-de937f3e-b1ff-405d-b063-bb8bd7d62f57 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:27.499485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de937f3e-b1ff-405d-b063-bb8bd7d62f57 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:27.499981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de937f3e-b1ff-405d-b063-bb8bd7d62f57 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:27.500425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de937f3e-b1ff-405d-b063-bb8bd7d62f57 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:27.501494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de937f3e-b1ff-405d-b063-bb8bd7d62f57 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:27.502612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de937f3e-b1ff-405d-b063-bb8bd7d62f57 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:27.504485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de937f3e-b1ff-405d-b063-bb8bd7d62f57 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:27.510792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:27.572375 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-455203bb-65c4-4411-9dd3-2ef8b669fe8a tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c/action" status: 202 len: 0 microversion: 2.1 time: 0.278999 Oct 29 01:16:27.573591 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1590/3045] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:16:27 2022] POST /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:16:27.579564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-21d9c3a0-f572-4881-b10e-5040459300af tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:27.579895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-21d9c3a0-f572-4881-b10e-5040459300af tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:27.586591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21d9c3a0-f572-4881-b10e-5040459300af tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:27.587300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21d9c3a0-f572-4881-b10e-5040459300af tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:27.587974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21d9c3a0-f572-4881-b10e-5040459300af tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:27.588716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21d9c3a0-f572-4881-b10e-5040459300af tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:27.589736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21d9c3a0-f572-4881-b10e-5040459300af tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:27.590569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21d9c3a0-f572-4881-b10e-5040459300af tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:27.694007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-21d9c3a0-f572-4881-b10e-5040459300af tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:27.702513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-21d9c3a0-f572-4881-b10e-5040459300af tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:27.704072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-21d9c3a0-f572-4881-b10e-5040459300af tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:27.705366 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-21d9c3a0-f572-4881-b10e-5040459300af tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1366 microversion: 2.47 time: 0.130530 Oct 29 01:16:27.705962 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1591/3046] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:27 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:27.710298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-64e3c531-93d1-4e73-94fb-6280d9035ba1 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:27.710903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-64e3c531-93d1-4e73-94fb-6280d9035ba1 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:27.718465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-64e3c531-93d1-4e73-94fb-6280d9035ba1 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:27.718909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-64e3c531-93d1-4e73-94fb-6280d9035ba1 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:27.726380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-64e3c531-93d1-4e73-94fb-6280d9035ba1 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:27.726380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-64e3c531-93d1-4e73-94fb-6280d9035ba1 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:27.726380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-64e3c531-93d1-4e73-94fb-6280d9035ba1 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:27.726380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-64e3c531-93d1-4e73-94fb-6280d9035ba1 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:27.786760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-de937f3e-b1ff-405d-b063-bb8bd7d62f57 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:27.796043 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-de937f3e-b1ff-405d-b063-bb8bd7d62f57 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.310447 Oct 29 01:16:27.796619 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1456/3047] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:27 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:27.801076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bd9bd879-9e72-4bc8-b88c-1208a4776159 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:27.801890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bd9bd879-9e72-4bc8-b88c-1208a4776159 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:27.809000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd9bd879-9e72-4bc8-b88c-1208a4776159 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:27.809504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd9bd879-9e72-4bc8-b88c-1208a4776159 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:27.810129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd9bd879-9e72-4bc8-b88c-1208a4776159 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:27.810833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd9bd879-9e72-4bc8-b88c-1208a4776159 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:27.811284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd9bd879-9e72-4bc8-b88c-1208a4776159 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:27.811901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd9bd879-9e72-4bc8-b88c-1208a4776159 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:27.936291 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-64e3c531-93d1-4e73-94fb-6280d9035ba1 tempest-ServersAdminTestJSON-214455543 tempest-ServersAdminTestJSON-214455543-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1615 microversion: 2.1 time: 0.229077 Oct 29 01:16:27.937226 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1592/3048] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:27 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1615 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:27.946002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d759864e-0d78-4f63-95aa-95c2ba8b4238 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:27.947006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d759864e-0d78-4f63-95aa-95c2ba8b4238 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:27.955020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d759864e-0d78-4f63-95aa-95c2ba8b4238 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:27.955505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d759864e-0d78-4f63-95aa-95c2ba8b4238 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:27.955937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d759864e-0d78-4f63-95aa-95c2ba8b4238 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:27.956633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d759864e-0d78-4f63-95aa-95c2ba8b4238 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:27.957084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d759864e-0d78-4f63-95aa-95c2ba8b4238 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:27.957601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d759864e-0d78-4f63-95aa-95c2ba8b4238 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:28.026603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bd9bd879-9e72-4bc8-b88c-1208a4776159 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:28.038039 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bd9bd879-9e72-4bc8-b88c-1208a4776159 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1527 microversion: 2.1 time: 0.240307 Oct 29 01:16:28.054783 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1457/3049] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:27 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1527 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:28.061260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-44c81a40-1826-4514-af53-b4795814bbc8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:28.062718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-44c81a40-1826-4514-af53-b4795814bbc8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:28.072592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44c81a40-1826-4514-af53-b4795814bbc8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:28.073092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44c81a40-1826-4514-af53-b4795814bbc8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:28.073594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44c81a40-1826-4514-af53-b4795814bbc8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:28.074310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44c81a40-1826-4514-af53-b4795814bbc8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:28.074845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44c81a40-1826-4514-af53-b4795814bbc8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:28.075279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44c81a40-1826-4514-af53-b4795814bbc8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:28.102985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-44c81a40-1826-4514-af53-b4795814bbc8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:16:28.207697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d759864e-0d78-4f63-95aa-95c2ba8b4238 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:28.218779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d759864e-0d78-4f63-95aa-95c2ba8b4238 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:28.220223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d759864e-0d78-4f63-95aa-95c2ba8b4238 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:28.221424 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d759864e-0d78-4f63-95aa-95c2ba8b4238 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1880 microversion: 2.42 time: 0.282997 Oct 29 01:16:28.222396 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1593/3050] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:27 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1880 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:28.226989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-846d44a2-f333-4b2b-87b2-18a853f206f0 req-747bd352-79fb-487d-ad1f-628dc94c1878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d34640d-e769-4799-9215-b36526af8817", "name": "network-vif-unplugged", "status": "completed", "tag": "e24a49b8-f412-493b-8773-37bc96951756"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:28.237555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-846d44a2-f333-4b2b-87b2-18a853f206f0 req-747bd352-79fb-487d-ad1f-628dc94c1878 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:28.238027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-846d44a2-f333-4b2b-87b2-18a853f206f0 req-747bd352-79fb-487d-ad1f-628dc94c1878 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:28.238456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-846d44a2-f333-4b2b-87b2-18a853f206f0 req-747bd352-79fb-487d-ad1f-628dc94c1878 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:28.251425 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-846d44a2-f333-4b2b-87b2-18a853f206f0 req-747bd352-79fb-487d-ad1f-628dc94c1878 service nova] Creating event network-vif-unplugged:e24a49b8-f412-493b-8773-37bc96951756 for instance 7d34640d-e769-4799-9215-b36526af8817 on n-h1-862964-3 Oct 29 01:16:28.257930 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-846d44a2-f333-4b2b-87b2-18a853f206f0 req-747bd352-79fb-487d-ad1f-628dc94c1878 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033942 Oct 29 01:16:28.261318 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1594/3051] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:28.336194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-16226ddb-7297-4b46-b19c-a0f8fe5bce11 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:28.338133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-16226ddb-7297-4b46-b19c-a0f8fe5bce11 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:28.351895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16226ddb-7297-4b46-b19c-a0f8fe5bce11 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:28.352394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16226ddb-7297-4b46-b19c-a0f8fe5bce11 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:28.352990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16226ddb-7297-4b46-b19c-a0f8fe5bce11 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:28.353816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16226ddb-7297-4b46-b19c-a0f8fe5bce11 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:28.354437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16226ddb-7297-4b46-b19c-a0f8fe5bce11 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:28.357016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16226ddb-7297-4b46-b19c-a0f8fe5bce11 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:28.454487 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-44c81a40-1826-4514-af53-b4795814bbc8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 204 len: 0 microversion: 2.1 time: 0.396661 Oct 29 01:16:28.455106 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1458/3052] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:16:28 2022] DELETE /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:16:28.467672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c00c9431-b572-4f8a-90b6-2410a160f624 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:28.468560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c00c9431-b572-4f8a-90b6-2410a160f624 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:28.475794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c00c9431-b572-4f8a-90b6-2410a160f624 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:28.476363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c00c9431-b572-4f8a-90b6-2410a160f624 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:28.476908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c00c9431-b572-4f8a-90b6-2410a160f624 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:28.478035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c00c9431-b572-4f8a-90b6-2410a160f624 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:28.478852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c00c9431-b572-4f8a-90b6-2410a160f624 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:28.480509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c00c9431-b572-4f8a-90b6-2410a160f624 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:28.618635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-16226ddb-7297-4b46-b19c-a0f8fe5bce11 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:28.634454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-16226ddb-7297-4b46-b19c-a0f8fe5bce11 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:28.634454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-16226ddb-7297-4b46-b19c-a0f8fe5bce11 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:28.634454 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-16226ddb-7297-4b46-b19c-a0f8fe5bce11 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1358 microversion: 2.21 time: 0.309064 Oct 29 01:16:28.635446 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1595/3053] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:28 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1358 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:28.640272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-be7b36e5-5f99-4d76-89ac-311f4b34efc9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:28.640876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-be7b36e5-5f99-4d76-89ac-311f4b34efc9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:28.647658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be7b36e5-5f99-4d76-89ac-311f4b34efc9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:28.648144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be7b36e5-5f99-4d76-89ac-311f4b34efc9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:28.648582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be7b36e5-5f99-4d76-89ac-311f4b34efc9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:28.649331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be7b36e5-5f99-4d76-89ac-311f4b34efc9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:28.649788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be7b36e5-5f99-4d76-89ac-311f4b34efc9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:28.670231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be7b36e5-5f99-4d76-89ac-311f4b34efc9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:28.703548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c00c9431-b572-4f8a-90b6-2410a160f624 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:28.713794 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c00c9431-b572-4f8a-90b6-2410a160f624 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1469 microversion: 2.1 time: 0.252866 Oct 29 01:16:28.735057 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1459/3054] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:28 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1469 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:28.741324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-661d071e-0dd8-406c-85f7-22c2b28b6abd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:28.745191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-661d071e-0dd8-406c-85f7-22c2b28b6abd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:28.753494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-661d071e-0dd8-406c-85f7-22c2b28b6abd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:28.754220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-661d071e-0dd8-406c-85f7-22c2b28b6abd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:28.754971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-661d071e-0dd8-406c-85f7-22c2b28b6abd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:28.755939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-661d071e-0dd8-406c-85f7-22c2b28b6abd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:28.756579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-661d071e-0dd8-406c-85f7-22c2b28b6abd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:28.761830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-661d071e-0dd8-406c-85f7-22c2b28b6abd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:28.897994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-661d071e-0dd8-406c-85f7-22c2b28b6abd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:28.911042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-661d071e-0dd8-406c-85f7-22c2b28b6abd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:28.913475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-661d071e-0dd8-406c-85f7-22c2b28b6abd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:28.918038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-be7b36e5-5f99-4d76-89ac-311f4b34efc9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:28.923027 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-661d071e-0dd8-406c-85f7-22c2b28b6abd tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1366 microversion: 2.47 time: 0.186282 Oct 29 01:16:28.923667 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1460/3055] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:28 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:28.927454 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-be7b36e5-5f99-4d76-89ac-311f4b34efc9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1355 microversion: 2.1 time: 0.290913 Oct 29 01:16:28.928043 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1596/3056] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:28 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1355 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:28.935475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4e8395da-bd90-4474-8f3b-7393b272b52b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:28.936155 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4e8395da-bd90-4474-8f3b-7393b272b52b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:28.942609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e8395da-bd90-4474-8f3b-7393b272b52b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:28.943179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e8395da-bd90-4474-8f3b-7393b272b52b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:28.944213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e8395da-bd90-4474-8f3b-7393b272b52b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:28.944871 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e8395da-bd90-4474-8f3b-7393b272b52b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:28.945621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e8395da-bd90-4474-8f3b-7393b272b52b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:28.945922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e8395da-bd90-4474-8f3b-7393b272b52b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:29.064956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ccf9841a-2c07-4d42-90c0-9f1987c91550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:29.067053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ccf9841a-2c07-4d42-90c0-9f1987c91550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:29.078263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccf9841a-2c07-4d42-90c0-9f1987c91550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:29.078806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccf9841a-2c07-4d42-90c0-9f1987c91550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:29.079244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccf9841a-2c07-4d42-90c0-9f1987c91550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:29.080022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccf9841a-2c07-4d42-90c0-9f1987c91550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:29.080532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccf9841a-2c07-4d42-90c0-9f1987c91550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:29.080894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccf9841a-2c07-4d42-90c0-9f1987c91550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:29.122108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4e8395da-bd90-4474-8f3b-7393b272b52b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:29.136003 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4e8395da-bd90-4474-8f3b-7393b272b52b tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.205569 Oct 29 01:16:29.137844 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1461/3057] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:28 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:29.249275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-078b68b6-3701-409f-9bda-0a5eef8763c3 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:29.250810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-078b68b6-3701-409f-9bda-0a5eef8763c3 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:29.264965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-078b68b6-3701-409f-9bda-0a5eef8763c3 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:29.265639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-078b68b6-3701-409f-9bda-0a5eef8763c3 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:29.266205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-078b68b6-3701-409f-9bda-0a5eef8763c3 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:29.267174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-078b68b6-3701-409f-9bda-0a5eef8763c3 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:29.267740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-078b68b6-3701-409f-9bda-0a5eef8763c3 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:29.268210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ccf9841a-2c07-4d42-90c0-9f1987c91550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:29.268351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-078b68b6-3701-409f-9bda-0a5eef8763c3 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:29.281669 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ccf9841a-2c07-4d42-90c0-9f1987c91550 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1527 microversion: 2.1 time: 0.222415 Oct 29 01:16:29.293843 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1597/3058] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:29 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1527 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:29.493053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-078b68b6-3701-409f-9bda-0a5eef8763c3 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:29.503968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-078b68b6-3701-409f-9bda-0a5eef8763c3 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:29.505464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-078b68b6-3701-409f-9bda-0a5eef8763c3 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:29.506771 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-078b68b6-3701-409f-9bda-0a5eef8763c3 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 2835 microversion: 2.42 time: 0.262736 Oct 29 01:16:29.507736 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1462/3059] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:29 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 2835 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:16:29.540455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-157763bd-8c06-4ded-9dbb-86c27e7b7bde tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:29.541241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-157763bd-8c06-4ded-9dbb-86c27e7b7bde tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:29.550432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-157763bd-8c06-4ded-9dbb-86c27e7b7bde tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:29.551408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-157763bd-8c06-4ded-9dbb-86c27e7b7bde tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:29.552002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-157763bd-8c06-4ded-9dbb-86c27e7b7bde tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:29.552918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-157763bd-8c06-4ded-9dbb-86c27e7b7bde tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:29.553562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-157763bd-8c06-4ded-9dbb-86c27e7b7bde tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:29.554380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-157763bd-8c06-4ded-9dbb-86c27e7b7bde tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:29.669825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bb78f5e3-8137-408e-a389-1e992d659db2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:29.670448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bb78f5e3-8137-408e-a389-1e992d659db2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:29.681548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb78f5e3-8137-408e-a389-1e992d659db2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:29.682041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb78f5e3-8137-408e-a389-1e992d659db2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:29.686154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb78f5e3-8137-408e-a389-1e992d659db2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:29.686968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb78f5e3-8137-408e-a389-1e992d659db2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:29.687439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb78f5e3-8137-408e-a389-1e992d659db2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:29.687870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb78f5e3-8137-408e-a389-1e992d659db2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:29.695285 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-157763bd-8c06-4ded-9dbb-86c27e7b7bde tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.158844 Oct 29 01:16:29.696234 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1598/3060] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Oct 29 01:16:29 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635/os-interface => generated 1831 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:29.742289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a75d0175-860f-43b7-b94a-e265e948a19b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:29.742976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a75d0175-860f-43b7-b94a-e265e948a19b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:29.762565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a75d0175-860f-43b7-b94a-e265e948a19b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:29.762835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a75d0175-860f-43b7-b94a-e265e948a19b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:29.765686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a75d0175-860f-43b7-b94a-e265e948a19b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:29.767870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a75d0175-860f-43b7-b94a-e265e948a19b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:29.768585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a75d0175-860f-43b7-b94a-e265e948a19b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:29.769027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a75d0175-860f-43b7-b94a-e265e948a19b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:30.030174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bb78f5e3-8137-408e-a389-1e992d659db2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:30.042340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bb78f5e3-8137-408e-a389-1e992d659db2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:30.049879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bb78f5e3-8137-408e-a389-1e992d659db2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:30.054582 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bb78f5e3-8137-408e-a389-1e992d659db2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1358 microversion: 2.21 time: 0.394431 Oct 29 01:16:30.059517 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1463/3061] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:29 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1358 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:30.072833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1c4036ca-d0e2-4d81-a6af-eb0b81f1b9ef tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:30.077281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1c4036ca-d0e2-4d81-a6af-eb0b81f1b9ef tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:30.081806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a75d0175-860f-43b7-b94a-e265e948a19b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:30.090165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c4036ca-d0e2-4d81-a6af-eb0b81f1b9ef tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:30.090895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c4036ca-d0e2-4d81-a6af-eb0b81f1b9ef tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:30.091834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c4036ca-d0e2-4d81-a6af-eb0b81f1b9ef tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:30.092758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c4036ca-d0e2-4d81-a6af-eb0b81f1b9ef tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:30.093425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c4036ca-d0e2-4d81-a6af-eb0b81f1b9ef tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:30.094021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c4036ca-d0e2-4d81-a6af-eb0b81f1b9ef tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:30.096156 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a75d0175-860f-43b7-b94a-e265e948a19b tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1469 microversion: 2.1 time: 0.357871 Oct 29 01:16:30.097695 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1599/3062] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:29 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1469 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:30.105732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-083f34ad-34b1-4aa5-9167-a872b651bbb3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:30.106902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-083f34ad-34b1-4aa5-9167-a872b651bbb3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:30.114574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-083f34ad-34b1-4aa5-9167-a872b651bbb3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:30.115407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-083f34ad-34b1-4aa5-9167-a872b651bbb3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:30.116030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-083f34ad-34b1-4aa5-9167-a872b651bbb3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:30.117603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-083f34ad-34b1-4aa5-9167-a872b651bbb3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:30.118141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-083f34ad-34b1-4aa5-9167-a872b651bbb3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:30.118691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-083f34ad-34b1-4aa5-9167-a872b651bbb3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:30.237760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1c4036ca-d0e2-4d81-a6af-eb0b81f1b9ef tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:30.250254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1c4036ca-d0e2-4d81-a6af-eb0b81f1b9ef tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:30.251913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1c4036ca-d0e2-4d81-a6af-eb0b81f1b9ef tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:30.253147 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1c4036ca-d0e2-4d81-a6af-eb0b81f1b9ef tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1366 microversion: 2.47 time: 0.191063 Oct 29 01:16:30.260463 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1464/3063] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:30 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:30.269347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4476c9a7-fd7f-4b14-b937-fd2ddff7ff46 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:30.281399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4476c9a7-fd7f-4b14-b937-fd2ddff7ff46 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:30.297636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4476c9a7-fd7f-4b14-b937-fd2ddff7ff46 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:30.298145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4476c9a7-fd7f-4b14-b937-fd2ddff7ff46 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:30.298595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4476c9a7-fd7f-4b14-b937-fd2ddff7ff46 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:30.299329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4476c9a7-fd7f-4b14-b937-fd2ddff7ff46 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:30.299799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4476c9a7-fd7f-4b14-b937-fd2ddff7ff46 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:30.300234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4476c9a7-fd7f-4b14-b937-fd2ddff7ff46 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:30.433613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-083f34ad-34b1-4aa5-9167-a872b651bbb3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:30.444862 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-083f34ad-34b1-4aa5-9167-a872b651bbb3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1355 microversion: 2.1 time: 0.345813 Oct 29 01:16:30.445516 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1600/3064] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:30 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1355 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:30.460476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6b795144-687f-4a08-b673-8ddc291fb8b5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:30.461367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6b795144-687f-4a08-b673-8ddc291fb8b5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:30.471249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b795144-687f-4a08-b673-8ddc291fb8b5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:30.471757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b795144-687f-4a08-b673-8ddc291fb8b5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:30.472201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b795144-687f-4a08-b673-8ddc291fb8b5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:30.472931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b795144-687f-4a08-b673-8ddc291fb8b5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:30.473459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b795144-687f-4a08-b673-8ddc291fb8b5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:30.473896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b795144-687f-4a08-b673-8ddc291fb8b5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:30.624304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4476c9a7-fd7f-4b14-b937-fd2ddff7ff46 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:30.632496 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4476c9a7-fd7f-4b14-b937-fd2ddff7ff46 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.369153 Oct 29 01:16:30.645705 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1465/3065] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:30 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:30.654487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-ad92d18e-03f0-4d82-b5e5-f7ae0cf0ede4 req-30ebb5e2-98c2-4f7f-b5c3-17e0dd85ea03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6448587-2777-40b9-a6c5-514e56ac388d", "name": "network-vif-plugged", "status": "completed", "tag": "946b5a67-b144-4570-bffa-a10da029250f"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:30.664843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ad92d18e-03f0-4d82-b5e5-f7ae0cf0ede4 req-30ebb5e2-98c2-4f7f-b5c3-17e0dd85ea03 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:30.665388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ad92d18e-03f0-4d82-b5e5-f7ae0cf0ede4 req-30ebb5e2-98c2-4f7f-b5c3-17e0dd85ea03 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:30.665825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ad92d18e-03f0-4d82-b5e5-f7ae0cf0ede4 req-30ebb5e2-98c2-4f7f-b5c3-17e0dd85ea03 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:30.685330 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-ad92d18e-03f0-4d82-b5e5-f7ae0cf0ede4 req-30ebb5e2-98c2-4f7f-b5c3-17e0dd85ea03 service nova] Creating event network-vif-plugged:946b5a67-b144-4570-bffa-a10da029250f for instance b6448587-2777-40b9-a6c5-514e56ac388d on n-h2-862964-3 Oct 29 01:16:30.692512 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-ad92d18e-03f0-4d82-b5e5-f7ae0cf0ede4 req-30ebb5e2-98c2-4f7f-b5c3-17e0dd85ea03 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044076 Oct 29 01:16:30.696653 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1466/3066] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:30.721880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6b795144-687f-4a08-b673-8ddc291fb8b5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:30.735786 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6b795144-687f-4a08-b673-8ddc291fb8b5 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1527 microversion: 2.1 time: 0.288922 Oct 29 01:16:30.736979 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1601/3067] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:30 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1527 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:31.085290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-90366b9f-68f1-4067-b760-cb20557623bb tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:31.086119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-90366b9f-68f1-4067-b760-cb20557623bb tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:31.097995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90366b9f-68f1-4067-b760-cb20557623bb tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:31.097995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90366b9f-68f1-4067-b760-cb20557623bb tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:31.097995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90366b9f-68f1-4067-b760-cb20557623bb tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:31.097995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90366b9f-68f1-4067-b760-cb20557623bb tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:31.097995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90366b9f-68f1-4067-b760-cb20557623bb tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:31.098457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90366b9f-68f1-4067-b760-cb20557623bb tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:31.123921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb052387-5dfe-485d-bed5-1a4c77bf7412 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:31.128153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bb052387-5dfe-485d-bed5-1a4c77bf7412 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:31.145579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb052387-5dfe-485d-bed5-1a4c77bf7412 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:31.149630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb052387-5dfe-485d-bed5-1a4c77bf7412 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:31.150346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb052387-5dfe-485d-bed5-1a4c77bf7412 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:31.153340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb052387-5dfe-485d-bed5-1a4c77bf7412 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:31.155401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb052387-5dfe-485d-bed5-1a4c77bf7412 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:31.156105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb052387-5dfe-485d-bed5-1a4c77bf7412 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:31.812074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bb052387-5dfe-485d-bed5-1a4c77bf7412 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:31.817321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-90366b9f-68f1-4067-b760-cb20557623bb tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:31.820959 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bb052387-5dfe-485d-bed5-1a4c77bf7412 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1469 microversion: 2.1 time: 0.702658 Oct 29 01:16:31.821944 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1602/3068] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:31 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1469 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:31.824856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-90366b9f-68f1-4067-b760-cb20557623bb tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:31.826568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-90366b9f-68f1-4067-b760-cb20557623bb tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:31.827908 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-90366b9f-68f1-4067-b760-cb20557623bb tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1358 microversion: 2.21 time: 0.747619 Oct 29 01:16:31.830830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-51b25a58-9657-423a-9ec6-93e03d56392f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:31.832200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-51b25a58-9657-423a-9ec6-93e03d56392f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:31.839832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51b25a58-9657-423a-9ec6-93e03d56392f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:31.840599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51b25a58-9657-423a-9ec6-93e03d56392f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:31.841222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51b25a58-9657-423a-9ec6-93e03d56392f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:31.842122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51b25a58-9657-423a-9ec6-93e03d56392f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:31.842797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51b25a58-9657-423a-9ec6-93e03d56392f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:31.843464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51b25a58-9657-423a-9ec6-93e03d56392f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:31.845308 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1467/3069] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:31 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1358 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:31.958719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-51b25a58-9657-423a-9ec6-93e03d56392f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:31.982777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-51b25a58-9657-423a-9ec6-93e03d56392f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:31.984808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-51b25a58-9657-423a-9ec6-93e03d56392f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:31.986084 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-51b25a58-9657-423a-9ec6-93e03d56392f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1366 microversion: 2.47 time: 0.162754 Oct 29 01:16:32.001783 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1603/3070] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:31 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:32.013301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0df95f93-1f0a-4807-acd4-f32c068f2fea tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:32.014551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0df95f93-1f0a-4807-acd4-f32c068f2fea tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:32.025268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0df95f93-1f0a-4807-acd4-f32c068f2fea tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:32.026165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0df95f93-1f0a-4807-acd4-f32c068f2fea tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:32.033025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b01271ba-0df3-4659-835e-e9e842982502 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1152050441", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "417ddcf9-7930-440b-995d-5ce0b1f48a9f"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:32.036927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0df95f93-1f0a-4807-acd4-f32c068f2fea tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:32.039243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0df95f93-1f0a-4807-acd4-f32c068f2fea tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:32.039903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0df95f93-1f0a-4807-acd4-f32c068f2fea tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:32.042995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0df95f93-1f0a-4807-acd4-f32c068f2fea tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:32.124424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-b01271ba-0df3-4659-835e-e9e842982502 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] validate_networks() for [('417ddcf9-7930-440b-995d-5ce0b1f48a9f', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:16:32.504578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0df95f93-1f0a-4807-acd4-f32c068f2fea tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:32.543934 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0df95f93-1f0a-4807-acd4-f32c068f2fea tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1355 microversion: 2.1 time: 0.538001 Oct 29 01:16:32.545825 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1604/3071] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:32 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1355 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:32.557006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6deefac8-3e4d-4c95-a65f-e27dd47352ea tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:32.560195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6deefac8-3e4d-4c95-a65f-e27dd47352ea tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:32.570385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6deefac8-3e4d-4c95-a65f-e27dd47352ea tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:32.571283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6deefac8-3e4d-4c95-a65f-e27dd47352ea tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:32.571976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6deefac8-3e4d-4c95-a65f-e27dd47352ea tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:32.575188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6deefac8-3e4d-4c95-a65f-e27dd47352ea tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:32.576698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6deefac8-3e4d-4c95-a65f-e27dd47352ea tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:32.577410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6deefac8-3e4d-4c95-a65f-e27dd47352ea tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:33.046660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6deefac8-3e4d-4c95-a65f-e27dd47352ea tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:33.051793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:33.059304 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6deefac8-3e4d-4c95-a65f-e27dd47352ea tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.511935 Oct 29 01:16:33.063049 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1605/3072] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:32 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:33.077146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-08dfde38-60c6-4d86-9d79-6c4d1f51cfff req-c3ef5dc9-5264-4f9c-973a-92635ffe478f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "tag": "d00f19cc-89ea-4719-aa7c-b9d320f81a37"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:33.093206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-08dfde38-60c6-4d86-9d79-6c4d1f51cfff req-c3ef5dc9-5264-4f9c-973a-92635ffe478f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:33.094035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-08dfde38-60c6-4d86-9d79-6c4d1f51cfff req-c3ef5dc9-5264-4f9c-973a-92635ffe478f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:33.094538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-08dfde38-60c6-4d86-9d79-6c4d1f51cfff req-c3ef5dc9-5264-4f9c-973a-92635ffe478f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:33.109342 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-08dfde38-60c6-4d86-9d79-6c4d1f51cfff req-c3ef5dc9-5264-4f9c-973a-92635ffe478f service nova] Creating event network-changed:d00f19cc-89ea-4719-aa7c-b9d320f81a37 for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:16:33.115606 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-08dfde38-60c6-4d86-9d79-6c4d1f51cfff req-c3ef5dc9-5264-4f9c-973a-92635ffe478f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049226 Oct 29 01:16:33.116587 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1606/3073] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:33.125231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4c79e3c4-2c74-4e55-b56a-69c915403e67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:33.125974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4c79e3c4-2c74-4e55-b56a-69c915403e67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:33.141330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c79e3c4-2c74-4e55-b56a-69c915403e67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:33.141883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c79e3c4-2c74-4e55-b56a-69c915403e67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:33.142881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c79e3c4-2c74-4e55-b56a-69c915403e67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:33.143605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c79e3c4-2c74-4e55-b56a-69c915403e67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:33.144064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c79e3c4-2c74-4e55-b56a-69c915403e67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:33.144489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c79e3c4-2c74-4e55-b56a-69c915403e67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:33.320637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4c79e3c4-2c74-4e55-b56a-69c915403e67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:33.338427 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4c79e3c4-2c74-4e55-b56a-69c915403e67 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1485 microversion: 2.1 time: 0.220426 Oct 29 01:16:33.340532 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1607/3074] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:33 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1485 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:33.351305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-9ed5fde5-8b7f-4b04-ad51-220232f704e8 req-82b00675-0fa0-4985-8999-a88a48408482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6448587-2777-40b9-a6c5-514e56ac388d", "name": "network-vif-plugged", "status": "completed", "tag": "2d6f74f2-830a-4bad-8269-f210111534c9"}, {"server_uuid": "b6448587-2777-40b9-a6c5-514e56ac388d", "name": "network-vif-plugged", "status": "completed", "tag": "c3863196-8c5a-43b7-805d-2e866f9ea0f9"}, {"server_uuid": "66e51083-7f72-4e67-a945-1607eddf7b3c", "name": "network-vif-plugged", "status": "completed", "tag": "39918983-d363-4e1e-ab8a-57bfa5a575e1"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:33.384928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9ed5fde5-8b7f-4b04-ad51-220232f704e8 req-82b00675-0fa0-4985-8999-a88a48408482 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:33.385566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9ed5fde5-8b7f-4b04-ad51-220232f704e8 req-82b00675-0fa0-4985-8999-a88a48408482 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:33.388753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9ed5fde5-8b7f-4b04-ad51-220232f704e8 req-82b00675-0fa0-4985-8999-a88a48408482 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:33.433240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-b01271ba-0df3-4659-835e-e9e842982502 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:16:33.433897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-b01271ba-0df3-4659-835e-e9e842982502 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:16:33.434126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-b01271ba-0df3-4659-835e-e9e842982502 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:16:33.434746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-b01271ba-0df3-4659-835e-e9e842982502 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:16:33.435372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-b01271ba-0df3-4659-835e-e9e842982502 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:16:33.435743 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-9ed5fde5-8b7f-4b04-ad51-220232f704e8 req-82b00675-0fa0-4985-8999-a88a48408482 service nova] Creating event network-vif-plugged:2d6f74f2-830a-4bad-8269-f210111534c9 for instance b6448587-2777-40b9-a6c5-514e56ac388d on n-h2-862964-3 Oct 29 01:16:33.438135 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-9ed5fde5-8b7f-4b04-ad51-220232f704e8 req-82b00675-0fa0-4985-8999-a88a48408482 service nova] Creating event network-vif-plugged:c3863196-8c5a-43b7-805d-2e866f9ea0f9 for instance b6448587-2777-40b9-a6c5-514e56ac388d on n-h2-862964-3 Oct 29 01:16:33.447834 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-9ed5fde5-8b7f-4b04-ad51-220232f704e8 req-82b00675-0fa0-4985-8999-a88a48408482 service nova] Creating event network-vif-plugged:39918983-d363-4e1e-ab8a-57bfa5a575e1 for instance 66e51083-7f72-4e67-a945-1607eddf7b3c on n-h1-862964-3 Oct 29 01:16:33.466705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b01271ba-0df3-4659-835e-e9e842982502 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:33.467734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b01271ba-0df3-4659-835e-e9e842982502 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:33.469104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b01271ba-0df3-4659-835e-e9e842982502 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:33.473878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b01271ba-0df3-4659-835e-e9e842982502 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:33.473878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b01271ba-0df3-4659-835e-e9e842982502 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:33.473878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b01271ba-0df3-4659-835e-e9e842982502 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:33.489202 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-9ed5fde5-8b7f-4b04-ad51-220232f704e8 req-82b00675-0fa0-4985-8999-a88a48408482 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.147550 Oct 29 01:16:33.490368 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1608/3075] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:33.497120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-b01271ba-0df3-4659-835e-e9e842982502 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Getting quotas for project b284e70790cf43e2b474559bb3e20faf. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:16:33.504042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-b01271ba-0df3-4659-835e-e9e842982502 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Getting quotas for user a35b358af11846f78debaf9e422a9558 and project b284e70790cf43e2b474559bb3e20faf. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:16:33.519040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fea36f78-ad09-4157-a52f-e0bdbd0940e7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:33.524677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fea36f78-ad09-4157-a52f-e0bdbd0940e7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:33.548775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b01271ba-0df3-4659-835e-e9e842982502 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:16:33.554016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b01271ba-0df3-4659-835e-e9e842982502 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:16:33.573005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fea36f78-ad09-4157-a52f-e0bdbd0940e7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:33.574802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fea36f78-ad09-4157-a52f-e0bdbd0940e7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:33.576111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fea36f78-ad09-4157-a52f-e0bdbd0940e7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:33.577518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fea36f78-ad09-4157-a52f-e0bdbd0940e7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:33.582784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fea36f78-ad09-4157-a52f-e0bdbd0940e7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:33.582784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fea36f78-ad09-4157-a52f-e0bdbd0940e7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:33.763012 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b01271ba-0df3-4659-835e-e9e842982502 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.916008 Oct 29 01:16:33.763682 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1468/3076] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:16:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:16:33.772860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-84a48ef7-fcba-4309-abce-9f4fba266aab tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:33.773498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-84a48ef7-fcba-4309-abce-9f4fba266aab tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:33.803932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84a48ef7-fcba-4309-abce-9f4fba266aab tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:33.805908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84a48ef7-fcba-4309-abce-9f4fba266aab tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:33.806369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84a48ef7-fcba-4309-abce-9f4fba266aab tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:33.807091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84a48ef7-fcba-4309-abce-9f4fba266aab tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:33.810719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84a48ef7-fcba-4309-abce-9f4fba266aab tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:33.810719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84a48ef7-fcba-4309-abce-9f4fba266aab tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:34.055457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fea36f78-ad09-4157-a52f-e0bdbd0940e7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:34.064976 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fea36f78-ad09-4157-a52f-e0bdbd0940e7 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1469 microversion: 2.1 time: 0.567950 Oct 29 01:16:34.067831 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1609/3077] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:33 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1469 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:34.099133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-12fb9dfa-2376-4d14-8cb0-63865000e40a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:34.099892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-12fb9dfa-2376-4d14-8cb0-63865000e40a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:34.112558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12fb9dfa-2376-4d14-8cb0-63865000e40a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:34.113052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12fb9dfa-2376-4d14-8cb0-63865000e40a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:34.113518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12fb9dfa-2376-4d14-8cb0-63865000e40a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:34.114230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12fb9dfa-2376-4d14-8cb0-63865000e40a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:34.114719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12fb9dfa-2376-4d14-8cb0-63865000e40a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:34.115205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12fb9dfa-2376-4d14-8cb0-63865000e40a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:34.253816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-84a48ef7-fcba-4309-abce-9f4fba266aab tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:34.272422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-84a48ef7-fcba-4309-abce-9f4fba266aab tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:34.278127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-84a48ef7-fcba-4309-abce-9f4fba266aab tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:34.289804 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-84a48ef7-fcba-4309-abce-9f4fba266aab tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1358 microversion: 2.21 time: 0.517446 Oct 29 01:16:34.290681 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1469/3078] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:33 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1358 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:34.307123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-7b3f69e2-c549-4807-a3d5-34fe8c4eb1ff req-3ccb5052-ff1d-4256-8924-534f0c163eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d34640d-e769-4799-9215-b36526af8817", "name": "network-vif-deleted", "tag": "e24a49b8-f412-493b-8773-37bc96951756"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:34.330462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-12fb9dfa-2376-4d14-8cb0-63865000e40a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:34.348225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-12fb9dfa-2376-4d14-8cb0-63865000e40a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:34.349815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7b3f69e2-c549-4807-a3d5-34fe8c4eb1ff req-3ccb5052-ff1d-4256-8924-534f0c163eeb service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:34.351567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-12fb9dfa-2376-4d14-8cb0-63865000e40a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:34.352194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7b3f69e2-c549-4807-a3d5-34fe8c4eb1ff req-3ccb5052-ff1d-4256-8924-534f0c163eeb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:34.352856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7b3f69e2-c549-4807-a3d5-34fe8c4eb1ff req-3ccb5052-ff1d-4256-8924-534f0c163eeb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:34.354256 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-12fb9dfa-2376-4d14-8cb0-63865000e40a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1366 microversion: 2.47 time: 0.267627 Oct 29 01:16:34.359891 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1610/3079] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:34 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:34.376302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80472c45-c04e-4a1d-ad8e-e4b2022cbf32 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:34.377402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-80472c45-c04e-4a1d-ad8e-e4b2022cbf32 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:34.399084 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-7b3f69e2-c549-4807-a3d5-34fe8c4eb1ff req-3ccb5052-ff1d-4256-8924-534f0c163eeb service nova] Creating event network-vif-deleted:e24a49b8-f412-493b-8773-37bc96951756 for instance 7d34640d-e769-4799-9215-b36526af8817 on n-h1-862964-3 Oct 29 01:16:34.412792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80472c45-c04e-4a1d-ad8e-e4b2022cbf32 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:34.413806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80472c45-c04e-4a1d-ad8e-e4b2022cbf32 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:34.416652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80472c45-c04e-4a1d-ad8e-e4b2022cbf32 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:34.418099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80472c45-c04e-4a1d-ad8e-e4b2022cbf32 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:34.420834 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80472c45-c04e-4a1d-ad8e-e4b2022cbf32 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:34.422962 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-7b3f69e2-c549-4807-a3d5-34fe8c4eb1ff req-3ccb5052-ff1d-4256-8924-534f0c163eeb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130949 Oct 29 01:16:34.423867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80472c45-c04e-4a1d-ad8e-e4b2022cbf32 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:34.427351 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1470/3080] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:34.449958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a923f2b8-e231-4bb1-9a72-e1050ff134a8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:34.452002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a923f2b8-e231-4bb1-9a72-e1050ff134a8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:34.695882 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a923f2b8-e231-4bb1-9a72-e1050ff134a8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:34.705340 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a923f2b8-e231-4bb1-9a72-e1050ff134a8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 200 len: 1208 microversion: 2.1 time: 0.272738 Oct 29 01:16:34.717622 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1471/3081] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:34 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 1208 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:34.727792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8161dcca-bc64-4b4d-9ea3-7a70d6cde5bf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:34.731065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8161dcca-bc64-4b4d-9ea3-7a70d6cde5bf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:34.737558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8161dcca-bc64-4b4d-9ea3-7a70d6cde5bf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:34.738293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8161dcca-bc64-4b4d-9ea3-7a70d6cde5bf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:34.738911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8161dcca-bc64-4b4d-9ea3-7a70d6cde5bf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:34.739833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8161dcca-bc64-4b4d-9ea3-7a70d6cde5bf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:34.740462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8161dcca-bc64-4b4d-9ea3-7a70d6cde5bf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:34.741063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8161dcca-bc64-4b4d-9ea3-7a70d6cde5bf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:34.808034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-80472c45-c04e-4a1d-ad8e-e4b2022cbf32 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:34.817459 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-80472c45-c04e-4a1d-ad8e-e4b2022cbf32 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1355 microversion: 2.1 time: 0.455904 Oct 29 01:16:34.818413 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1611/3082] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:34 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1355 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:34.824320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-48ef8e61-35f8-44cb-b0ca-a60eda72b703 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:34.825865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-48ef8e61-35f8-44cb-b0ca-a60eda72b703 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:34.840629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48ef8e61-35f8-44cb-b0ca-a60eda72b703 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:34.843050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48ef8e61-35f8-44cb-b0ca-a60eda72b703 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:34.844907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48ef8e61-35f8-44cb-b0ca-a60eda72b703 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:34.848782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48ef8e61-35f8-44cb-b0ca-a60eda72b703 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:34.849409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48ef8e61-35f8-44cb-b0ca-a60eda72b703 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:34.851997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48ef8e61-35f8-44cb-b0ca-a60eda72b703 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:34.892457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48ef8e61-35f8-44cb-b0ca-a60eda72b703 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:34.893191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48ef8e61-35f8-44cb-b0ca-a60eda72b703 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:34.893814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48ef8e61-35f8-44cb-b0ca-a60eda72b703 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:34.895164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-48ef8e61-35f8-44cb-b0ca-a60eda72b703 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lazy-loading 'fault' on Instance uuid 7d34640d-e769-4799-9215-b36526af8817 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:16:34.976446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-48ef8e61-35f8-44cb-b0ca-a60eda72b703 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:34.988220 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-48ef8e61-35f8-44cb-b0ca-a60eda72b703 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1314 microversion: 2.1 time: 0.168710 Oct 29 01:16:34.989101 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1612/3083] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:34 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:35.015122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8161dcca-bc64-4b4d-9ea3-7a70d6cde5bf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:35.023221 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8161dcca-bc64-4b4d-9ea3-7a70d6cde5bf tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.304060 Oct 29 01:16:35.027321 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1472/3084] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:34 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:35.093404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-40f1e8a5-2ca5-420b-9d90-0f2da869ed4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:35.094140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-40f1e8a5-2ca5-420b-9d90-0f2da869ed4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:35.100135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:35.102898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40f1e8a5-2ca5-420b-9d90-0f2da869ed4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:35.103048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40f1e8a5-2ca5-420b-9d90-0f2da869ed4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:35.103500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40f1e8a5-2ca5-420b-9d90-0f2da869ed4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:35.104530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40f1e8a5-2ca5-420b-9d90-0f2da869ed4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:35.105625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40f1e8a5-2ca5-420b-9d90-0f2da869ed4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:35.106232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40f1e8a5-2ca5-420b-9d90-0f2da869ed4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:35.140177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40f1e8a5-2ca5-420b-9d90-0f2da869ed4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:35.140672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40f1e8a5-2ca5-420b-9d90-0f2da869ed4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:35.141115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40f1e8a5-2ca5-420b-9d90-0f2da869ed4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:35.141628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-40f1e8a5-2ca5-420b-9d90-0f2da869ed4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lazy-loading 'fault' on Instance uuid 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:16:35.190863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-40f1e8a5-2ca5-420b-9d90-0f2da869ed4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:35.200589 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-40f1e8a5-2ca5-420b-9d90-0f2da869ed4a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1303 microversion: 2.1 time: 0.111739 Oct 29 01:16:35.201212 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1613/3085] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:35 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:35.320222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2657f43e-544a-46dc-822c-f65e9b7e9751 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:35.320843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2657f43e-544a-46dc-822c-f65e9b7e9751 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:35.327849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2657f43e-544a-46dc-822c-f65e9b7e9751 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:35.328346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2657f43e-544a-46dc-822c-f65e9b7e9751 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:35.328789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2657f43e-544a-46dc-822c-f65e9b7e9751 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:35.329533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2657f43e-544a-46dc-822c-f65e9b7e9751 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:35.330211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2657f43e-544a-46dc-822c-f65e9b7e9751 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:35.330865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2657f43e-544a-46dc-822c-f65e9b7e9751 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:35.390387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fc01ef3b-9944-4409-96f6-27b4acb83821 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:35.391118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fc01ef3b-9944-4409-96f6-27b4acb83821 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:35.398223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc01ef3b-9944-4409-96f6-27b4acb83821 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:35.398846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc01ef3b-9944-4409-96f6-27b4acb83821 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:35.399510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc01ef3b-9944-4409-96f6-27b4acb83821 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:35.400288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc01ef3b-9944-4409-96f6-27b4acb83821 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:35.400952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc01ef3b-9944-4409-96f6-27b4acb83821 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:35.401695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc01ef3b-9944-4409-96f6-27b4acb83821 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:35.496739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fc01ef3b-9944-4409-96f6-27b4acb83821 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:35.508945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fc01ef3b-9944-4409-96f6-27b4acb83821 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:35.510962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fc01ef3b-9944-4409-96f6-27b4acb83821 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:35.513963 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fc01ef3b-9944-4409-96f6-27b4acb83821 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1366 microversion: 2.47 time: 0.127157 Oct 29 01:16:35.514544 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1614/3086] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:35 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1366 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:16:35.532832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2657f43e-544a-46dc-822c-f65e9b7e9751 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:35.550880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2657f43e-544a-46dc-822c-f65e9b7e9751 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:35.552475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2657f43e-544a-46dc-822c-f65e9b7e9751 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:35.553641 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2657f43e-544a-46dc-822c-f65e9b7e9751 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1358 microversion: 2.21 time: 0.237635 Oct 29 01:16:35.554691 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1473/3087] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:35 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:35.733853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1c35593e-c18a-4e58-b5f2-7c2762d1e7cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:35.734793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1c35593e-c18a-4e58-b5f2-7c2762d1e7cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:35.744105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c35593e-c18a-4e58-b5f2-7c2762d1e7cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:35.744970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c35593e-c18a-4e58-b5f2-7c2762d1e7cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:35.746333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c35593e-c18a-4e58-b5f2-7c2762d1e7cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:35.747293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c35593e-c18a-4e58-b5f2-7c2762d1e7cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:35.747985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c35593e-c18a-4e58-b5f2-7c2762d1e7cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:35.748940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c35593e-c18a-4e58-b5f2-7c2762d1e7cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:35.822467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1c35593e-c18a-4e58-b5f2-7c2762d1e7cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:35.831291 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1c35593e-c18a-4e58-b5f2-7c2762d1e7cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 200 len: 1212 microversion: 2.1 time: 0.102186 Oct 29 01:16:35.831871 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1615/3088] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:35 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 1212 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:35.844634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-42682256-b043-431a-a0f8-84d5a5d84537 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:35.852421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-42682256-b043-431a-a0f8-84d5a5d84537 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:35.864621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42682256-b043-431a-a0f8-84d5a5d84537 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:35.865146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42682256-b043-431a-a0f8-84d5a5d84537 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:35.865605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42682256-b043-431a-a0f8-84d5a5d84537 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:35.866310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42682256-b043-431a-a0f8-84d5a5d84537 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:35.866768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42682256-b043-431a-a0f8-84d5a5d84537 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:35.867203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42682256-b043-431a-a0f8-84d5a5d84537 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:35.902799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:36.015210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-875c024c-ad4a-4cee-882a-e272dde2d17d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:36.016009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-875c024c-ad4a-4cee-882a-e272dde2d17d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:36.026095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-875c024c-ad4a-4cee-882a-e272dde2d17d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:36.026835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-875c024c-ad4a-4cee-882a-e272dde2d17d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:36.027518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-875c024c-ad4a-4cee-882a-e272dde2d17d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:36.029022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-875c024c-ad4a-4cee-882a-e272dde2d17d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:36.029743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-875c024c-ad4a-4cee-882a-e272dde2d17d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:36.030442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-875c024c-ad4a-4cee-882a-e272dde2d17d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:36.045984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-42682256-b043-431a-a0f8-84d5a5d84537 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:36.055175 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-42682256-b043-431a-a0f8-84d5a5d84537 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1355 microversion: 2.1 time: 0.213803 Oct 29 01:16:36.055517 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1474/3089] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:35 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1355 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:36.060768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5707bf46-a228-4e66-8e09-be7fe9432cb4 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:36.061399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5707bf46-a228-4e66-8e09-be7fe9432cb4 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:36.071203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5707bf46-a228-4e66-8e09-be7fe9432cb4 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:36.071690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5707bf46-a228-4e66-8e09-be7fe9432cb4 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:36.072130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5707bf46-a228-4e66-8e09-be7fe9432cb4 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:36.072838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5707bf46-a228-4e66-8e09-be7fe9432cb4 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:36.073335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5707bf46-a228-4e66-8e09-be7fe9432cb4 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:36.076201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5707bf46-a228-4e66-8e09-be7fe9432cb4 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:36.087971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-875c024c-ad4a-4cee-882a-e272dde2d17d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:36.088454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-875c024c-ad4a-4cee-882a-e272dde2d17d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:36.088888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-875c024c-ad4a-4cee-882a-e272dde2d17d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:36.090088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-875c024c-ad4a-4cee-882a-e272dde2d17d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lazy-loading 'fault' on Instance uuid 7d34640d-e769-4799-9215-b36526af8817 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:16:36.156706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-875c024c-ad4a-4cee-882a-e272dde2d17d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:36.165112 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-875c024c-ad4a-4cee-882a-e272dde2d17d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 200 len: 1314 microversion: 2.1 time: 0.154723 Oct 29 01:16:36.166381 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1616/3090] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:36 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:36.223776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5ddedb10-8cb3-4657-a2a0-a71183c2d1cf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:36.224388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5ddedb10-8cb3-4657-a2a0-a71183c2d1cf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:36.231828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ddedb10-8cb3-4657-a2a0-a71183c2d1cf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:36.232314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ddedb10-8cb3-4657-a2a0-a71183c2d1cf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:36.232747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ddedb10-8cb3-4657-a2a0-a71183c2d1cf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:36.233537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ddedb10-8cb3-4657-a2a0-a71183c2d1cf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:36.233999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ddedb10-8cb3-4657-a2a0-a71183c2d1cf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:36.234422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ddedb10-8cb3-4657-a2a0-a71183c2d1cf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:36.241239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5707bf46-a228-4e66-8e09-be7fe9432cb4 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:36.250174 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5707bf46-a228-4e66-8e09-be7fe9432cb4 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1523 microversion: 2.1 time: 0.193604 Oct 29 01:16:36.250753 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1475/3091] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:36 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:36.270080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ddedb10-8cb3-4657-a2a0-a71183c2d1cf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:36.270549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ddedb10-8cb3-4657-a2a0-a71183c2d1cf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:36.270984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ddedb10-8cb3-4657-a2a0-a71183c2d1cf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:36.271424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-5ddedb10-8cb3-4657-a2a0-a71183c2d1cf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lazy-loading 'fault' on Instance uuid 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:16:36.315114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5ddedb10-8cb3-4657-a2a0-a71183c2d1cf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:36.323287 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5ddedb10-8cb3-4657-a2a0-a71183c2d1cf tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 200 len: 1303 microversion: 2.1 time: 0.103316 Oct 29 01:16:36.323989 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1617/3092] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:36 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:36.442269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-6554f2f5-3f65-4964-ae6d-bec193a44f8d req-289779f2-203a-419c-871f-09ad843a15a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8fb980-1b51-4e3d-a3b7-b359dbe890a4", "name": "network-vif-deleted", "tag": "0a737a69-c605-43d6-9cbb-dca20e04416c"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:36.452648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6554f2f5-3f65-4964-ae6d-bec193a44f8d req-289779f2-203a-419c-871f-09ad843a15a2 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:36.453128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6554f2f5-3f65-4964-ae6d-bec193a44f8d req-289779f2-203a-419c-871f-09ad843a15a2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:36.453582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6554f2f5-3f65-4964-ae6d-bec193a44f8d req-289779f2-203a-419c-871f-09ad843a15a2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:36.467167 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-6554f2f5-3f65-4964-ae6d-bec193a44f8d req-289779f2-203a-419c-871f-09ad843a15a2 service nova] Creating event network-vif-deleted:0a737a69-c605-43d6-9cbb-dca20e04416c for instance 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 on n-h1-862964-3 Oct 29 01:16:36.471739 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-6554f2f5-3f65-4964-ae6d-bec193a44f8d req-289779f2-203a-419c-871f-09ad843a15a2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033200 Oct 29 01:16:36.472316 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1476/3093] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:36.541531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ebbfd2c8-a971-4c84-9c45-106d733036b2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:36.542140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ebbfd2c8-a971-4c84-9c45-106d733036b2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:36.551484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebbfd2c8-a971-4c84-9c45-106d733036b2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:36.551968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebbfd2c8-a971-4c84-9c45-106d733036b2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:36.552398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebbfd2c8-a971-4c84-9c45-106d733036b2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:36.553088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebbfd2c8-a971-4c84-9c45-106d733036b2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:36.553569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebbfd2c8-a971-4c84-9c45-106d733036b2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:36.554095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebbfd2c8-a971-4c84-9c45-106d733036b2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:36.580226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fae6be6e-f824-41f8-a8b0-4b3fe9f7de5c tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:36.580897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fae6be6e-f824-41f8-a8b0-4b3fe9f7de5c tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:36.587306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fae6be6e-f824-41f8-a8b0-4b3fe9f7de5c tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:36.587795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fae6be6e-f824-41f8-a8b0-4b3fe9f7de5c tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:36.588234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fae6be6e-f824-41f8-a8b0-4b3fe9f7de5c tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:36.588937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fae6be6e-f824-41f8-a8b0-4b3fe9f7de5c tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:36.589938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fae6be6e-f824-41f8-a8b0-4b3fe9f7de5c tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:36.590598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fae6be6e-f824-41f8-a8b0-4b3fe9f7de5c tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:36.631003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ebbfd2c8-a971-4c84-9c45-106d733036b2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:36.639715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ebbfd2c8-a971-4c84-9c45-106d733036b2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:36.641205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ebbfd2c8-a971-4c84-9c45-106d733036b2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:36.642384 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ebbfd2c8-a971-4c84-9c45-106d733036b2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1366 microversion: 2.47 time: 0.105091 Oct 29 01:16:36.642969 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1618/3094] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:36 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:36.734612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fae6be6e-f824-41f8-a8b0-4b3fe9f7de5c tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:36.742980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fae6be6e-f824-41f8-a8b0-4b3fe9f7de5c tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:36.744423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fae6be6e-f824-41f8-a8b0-4b3fe9f7de5c tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:36.746159 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fae6be6e-f824-41f8-a8b0-4b3fe9f7de5c tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1551 microversion: 2.21 time: 0.169774 Oct 29 01:16:36.746716 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1477/3095] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:36 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1551 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:36.771778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e314eede-232e-4537-861e-7f8833e5d9e4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:36.772276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e314eede-232e-4537-861e-7f8833e5d9e4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:36.778350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e314eede-232e-4537-861e-7f8833e5d9e4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:36.778833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e314eede-232e-4537-861e-7f8833e5d9e4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:36.779271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e314eede-232e-4537-861e-7f8833e5d9e4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:36.779966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e314eede-232e-4537-861e-7f8833e5d9e4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:36.780423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e314eede-232e-4537-861e-7f8833e5d9e4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:36.780849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e314eede-232e-4537-861e-7f8833e5d9e4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:36.809626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e314eede-232e-4537-861e-7f8833e5d9e4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:16:36.859125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-15be70b7-0d4d-49d4-8392-60281e197906 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:36.859752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-15be70b7-0d4d-49d4-8392-60281e197906 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:36.867484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15be70b7-0d4d-49d4-8392-60281e197906 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:36.867983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15be70b7-0d4d-49d4-8392-60281e197906 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:36.868415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15be70b7-0d4d-49d4-8392-60281e197906 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:36.874623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15be70b7-0d4d-49d4-8392-60281e197906 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:36.874623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15be70b7-0d4d-49d4-8392-60281e197906 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:36.874623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15be70b7-0d4d-49d4-8392-60281e197906 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:36.934574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-15be70b7-0d4d-49d4-8392-60281e197906 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:36.943072 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-15be70b7-0d4d-49d4-8392-60281e197906 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 200 len: 1212 microversion: 2.1 time: 0.088948 Oct 29 01:16:36.944071 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1478/3096] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:36 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 1212 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:37.080019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7db34896-1523-4a35-b997-5e6efe444a95 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:37.080626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7db34896-1523-4a35-b997-5e6efe444a95 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:37.086725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db34896-1523-4a35-b997-5e6efe444a95 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:37.087209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db34896-1523-4a35-b997-5e6efe444a95 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:37.087410 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e314eede-232e-4537-861e-7f8833e5d9e4 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "DELETE /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 204 len: 0 microversion: 2.21 time: 0.319017 Oct 29 01:16:37.088142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db34896-1523-4a35-b997-5e6efe444a95 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:37.088314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db34896-1523-4a35-b997-5e6efe444a95 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:37.088573 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1619/3097] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:16:36 2022] DELETE /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:16:37.088745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db34896-1523-4a35-b997-5e6efe444a95 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:37.089179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db34896-1523-4a35-b997-5e6efe444a95 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:37.103474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-024b6793-3826-4106-b79b-2c69da828ebd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:37.104811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-024b6793-3826-4106-b79b-2c69da828ebd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:37.116382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-024b6793-3826-4106-b79b-2c69da828ebd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:37.116382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-024b6793-3826-4106-b79b-2c69da828ebd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:37.116382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-024b6793-3826-4106-b79b-2c69da828ebd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:37.116382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-024b6793-3826-4106-b79b-2c69da828ebd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:37.116382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-024b6793-3826-4106-b79b-2c69da828ebd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:37.116382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-024b6793-3826-4106-b79b-2c69da828ebd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:37.317327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7db34896-1523-4a35-b997-5e6efe444a95 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:37.326449 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7db34896-1523-4a35-b997-5e6efe444a95 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1804 microversion: 2.1 time: 0.250357 Oct 29 01:16:37.327374 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1479/3098] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:37 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1804 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:37.337429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-946fd6c8-bd32-490a-a471-83e9a77026db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:37.338054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-946fd6c8-bd32-490a-a471-83e9a77026db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:37.349759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-024b6793-3826-4106-b79b-2c69da828ebd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:37.352094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:37.357426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-946fd6c8-bd32-490a-a471-83e9a77026db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:37.358109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-946fd6c8-bd32-490a-a471-83e9a77026db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:37.358745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-946fd6c8-bd32-490a-a471-83e9a77026db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:37.359982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-946fd6c8-bd32-490a-a471-83e9a77026db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:37.360198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-024b6793-3826-4106-b79b-2c69da828ebd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:37.360619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-946fd6c8-bd32-490a-a471-83e9a77026db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:37.361122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-946fd6c8-bd32-490a-a471-83e9a77026db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:37.361631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-024b6793-3826-4106-b79b-2c69da828ebd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:37.363595 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-024b6793-3826-4106-b79b-2c69da828ebd tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1557 microversion: 2.21 time: 0.269800 Oct 29 01:16:37.376037 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1620/3099] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:37 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1557 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:16:37.383716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0076892a-b3a5-4cd0-a0e0-bc70bdf11807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:37.384650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0076892a-b3a5-4cd0-a0e0-bc70bdf11807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:37.397628 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-946fd6c8-bd32-490a-a471-83e9a77026db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] HTTP exception thrown: Instance 7d34640d-e769-4799-9215-b36526af8817 could not be found. Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-946fd6c8-bd32-490a-a471-83e9a77026db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Request method failure captured: Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 HTTP/1.1 Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH6CzaWy1ufa72id6aheZbBREgQ1G2SbUhEpvcj_QTDF--UNn0kMcxBhslM6smsky4izROjyCZSxF91rcQGlVQlVrhfbQfHOyxM9K_r3ikSiecmNSXh8mpJTcen08ouic-cdYaYkhVKjr1CpS6bd1t3acwqY6OPH7aEAkOLl4egaxt8 Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_328d1dd53c6a4bc2b14376dd1a1cecb6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: b89f11ebd96141a5afe08dad79b0b20c Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 7d34640d-e769-4799-9215-b36526af8817 could not be found. Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '7d34640d-e769-4799-9215-b36526af8817'} Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d34640d-e769-4799-9215-b36526af8817 could not be found. Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d34640d-e769-4799-9215-b36526af8817 could not be found. Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:16:37.401456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:37.405715 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:16:37.405715 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:37.405715 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:37.405715 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:37.405715 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:16:37.405715 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:16:37.405715 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d34640d-e769-4799-9215-b36526af8817 could not be found. Oct 29 01:16:37.405715 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:16:37.405715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-946fd6c8-bd32-490a-a471-83e9a77026db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Returning 404 to user: Instance 7d34640d-e769-4799-9215-b36526af8817 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:16:37.405715 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-946fd6c8-bd32-490a-a471-83e9a77026db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 404 len: 111 microversion: 2.1 time: 0.075535 Oct 29 01:16:37.405715 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1480/3100] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:37 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:16:37.409326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0076892a-b3a5-4cd0-a0e0-bc70bdf11807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:37.410228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a0866684-55d3-45ed-ab95-420026efdb53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:37.410946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a0866684-55d3-45ed-ab95-420026efdb53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:37.411185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0076892a-b3a5-4cd0-a0e0-bc70bdf11807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:37.412619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0076892a-b3a5-4cd0-a0e0-bc70bdf11807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:37.413640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0076892a-b3a5-4cd0-a0e0-bc70bdf11807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:37.414327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0076892a-b3a5-4cd0-a0e0-bc70bdf11807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:37.415000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0076892a-b3a5-4cd0-a0e0-bc70bdf11807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:37.417762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0866684-55d3-45ed-ab95-420026efdb53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:37.418868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0866684-55d3-45ed-ab95-420026efdb53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:37.421099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0866684-55d3-45ed-ab95-420026efdb53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:37.421099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0866684-55d3-45ed-ab95-420026efdb53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:37.421099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0866684-55d3-45ed-ab95-420026efdb53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:37.422006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0866684-55d3-45ed-ab95-420026efdb53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:37.439627 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-a0866684-55d3-45ed-ab95-420026efdb53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] HTTP exception thrown: Instance 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 could not be found. Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a0866684-55d3-45ed-ab95-420026efdb53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Request method failure captured: Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 HTTP/1.1 Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH5gyXkSGUYok4VorbYUzbXvqeTdDDq_qf15RaIJS-1BomiYu21QMIPLZg9iLhQtxY8H65wQ4oCKhP4PSRY_obIBI7mA3VkHOi2BeAGp77T-n3IQKktJeMf_18Yvwuifb4DNAxQo1aAx9xRYT_0he7ixf1DsbiSnaI-9qk4otUSsVyo Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 5bdf61e2cbca4cdc95494b38c827ce63 Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersAdminTestJSON-736361139 Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bdf61e2cbca4cdc95494b38c827ce63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5bdf61e2cbca4cdc95494b38c827ce63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bdf61e2cbca4cdc95494b38c827ce63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5bdf61e2cbca4cdc95494b38c827ce63", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersAdminTestJSON-736361139 Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 5bdf61e2cbca4cdc95494b38c827ce63 Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersAdminTestJSON-736361139 Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersAdminTestJSON-736361139-project Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 60969ed444b545b9a5b02e27eb7eaea3 Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersAdminTestJSON-736361139-project Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 could not be found. Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '6a8fb980-1b51-4e3d-a3b7-b359dbe890a4'} Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 could not be found. Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 could not be found. Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:37.441447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:16:37.446239 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:37.446239 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:37.446239 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:37.446239 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:16:37.446239 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:16:37.446239 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 could not be found. Oct 29 01:16:37.446239 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:16:37.459018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a0866684-55d3-45ed-ab95-420026efdb53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Returning 404 to user: Instance 6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:16:37.461238 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a0866684-55d3-45ed-ab95-420026efdb53 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4" status: 404 len: 111 microversion: 2.1 time: 0.055583 Oct 29 01:16:37.461719 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1481/3101] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:37 2022] GET /compute/v2.1/servers/6a8fb980-1b51-4e3d-a3b7-b359dbe890a4 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:16:37.472054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f3c591b5-5b08-4404-b2f4-33c7d9c9d546 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:37.472587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f3c591b5-5b08-4404-b2f4-33c7d9c9d546 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:37.488108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3c591b5-5b08-4404-b2f4-33c7d9c9d546 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:37.490381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3c591b5-5b08-4404-b2f4-33c7d9c9d546 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:37.493111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3c591b5-5b08-4404-b2f4-33c7d9c9d546 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:37.494407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3c591b5-5b08-4404-b2f4-33c7d9c9d546 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:37.495741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3c591b5-5b08-4404-b2f4-33c7d9c9d546 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:37.497677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3c591b5-5b08-4404-b2f4-33c7d9c9d546 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:37.548463 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f3c591b5-5b08-4404-b2f4-33c7d9c9d546 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d/ips" status: 200 len: 217 microversion: 2.1 time: 0.085648 Oct 29 01:16:37.556200 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1482/3102] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 29 01:16:37 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d/ips => generated 217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:37.562546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ae08ef43-0c33-40b1-9a28-a5848984078f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:37.563247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ae08ef43-0c33-40b1-9a28-a5848984078f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:37.570029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae08ef43-0c33-40b1-9a28-a5848984078f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:37.570717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae08ef43-0c33-40b1-9a28-a5848984078f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:37.571310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae08ef43-0c33-40b1-9a28-a5848984078f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:37.572345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae08ef43-0c33-40b1-9a28-a5848984078f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:37.572968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae08ef43-0c33-40b1-9a28-a5848984078f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:37.573579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae08ef43-0c33-40b1-9a28-a5848984078f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:37.612756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ae08ef43-0c33-40b1-9a28-a5848984078f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:16:37.640084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0076892a-b3a5-4cd0-a0e0-bc70bdf11807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:37.644955 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0076892a-b3a5-4cd0-a0e0-bc70bdf11807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1503 microversion: 2.1 time: 0.267344 Oct 29 01:16:37.645561 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1621/3103] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:37 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1503 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:37.650033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7ef0477b-4647-4ed5-aa66-c91d13aaa158 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:37.650690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7ef0477b-4647-4ed5-aa66-c91d13aaa158 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:37.657612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ef0477b-4647-4ed5-aa66-c91d13aaa158 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:37.658376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ef0477b-4647-4ed5-aa66-c91d13aaa158 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:37.659075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ef0477b-4647-4ed5-aa66-c91d13aaa158 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:37.660036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ef0477b-4647-4ed5-aa66-c91d13aaa158 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:37.660884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ef0477b-4647-4ed5-aa66-c91d13aaa158 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:37.661602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ef0477b-4647-4ed5-aa66-c91d13aaa158 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:37.691368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7ef0477b-4647-4ed5-aa66-c91d13aaa158 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:16:37.955517 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ae08ef43-0c33-40b1-9a28-a5848984078f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "DELETE /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 204 len: 0 microversion: 2.1 time: 0.397738 Oct 29 01:16:37.956101 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1483/3104] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:16:37 2022] DELETE /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:16:37.962188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6df7cd11-2d85-4b0d-9354-0547f03f0f46 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-114842521", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:37.971425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:37.995450 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7ef0477b-4647-4ed5-aa66-c91d13aaa158 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 204 len: 0 microversion: 2.1 time: 0.348647 Oct 29 01:16:37.996318 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1622/3105] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:16:37 2022] DELETE /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:16:38.001425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5a8dec89-11f9-4deb-98b6-4e9ad2a0e2a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:38.002202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5a8dec89-11f9-4deb-98b6-4e9ad2a0e2a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:38.008188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a8dec89-11f9-4deb-98b6-4e9ad2a0e2a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:38.008783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a8dec89-11f9-4deb-98b6-4e9ad2a0e2a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:38.009129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a8dec89-11f9-4deb-98b6-4e9ad2a0e2a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:38.009882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a8dec89-11f9-4deb-98b6-4e9ad2a0e2a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:38.010360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a8dec89-11f9-4deb-98b6-4e9ad2a0e2a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:38.010781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a8dec89-11f9-4deb-98b6-4e9ad2a0e2a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:38.028625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-6df7cd11-2d85-4b0d-9354-0547f03f0f46 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] validate_networks() for [('9f7b032c-0aed-4adf-929f-4f69d989902b', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:16:38.098571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5a8dec89-11f9-4deb-98b6-4e9ad2a0e2a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:38.107511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5a8dec89-11f9-4deb-98b6-4e9ad2a0e2a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:38.108943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5a8dec89-11f9-4deb-98b6-4e9ad2a0e2a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:38.110147 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5a8dec89-11f9-4deb-98b6-4e9ad2a0e2a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1366 microversion: 2.47 time: 0.112853 Oct 29 01:16:38.110740 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1623/3106] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:37 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:38.115073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-56661b09-fc3f-4391-bae7-97c1485fc215 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Action: 'create', calling method: .version_select at 0x7f9d977864c0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-119815824", "description": "tempest-description-998493170"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:38.537256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-6df7cd11-2d85-4b0d-9354-0547f03f0f46 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:16:38.537685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-6df7cd11-2d85-4b0d-9354-0547f03f0f46 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:16:38.538163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-6df7cd11-2d85-4b0d-9354-0547f03f0f46 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:16:38.538578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-6df7cd11-2d85-4b0d-9354-0547f03f0f46 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:16:38.538994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-6df7cd11-2d85-4b0d-9354-0547f03f0f46 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:16:38.548371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6df7cd11-2d85-4b0d-9354-0547f03f0f46 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:38.549217 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6df7cd11-2d85-4b0d-9354-0547f03f0f46 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:38.549668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6df7cd11-2d85-4b0d-9354-0547f03f0f46 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:38.550406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6df7cd11-2d85-4b0d-9354-0547f03f0f46 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:38.550866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6df7cd11-2d85-4b0d-9354-0547f03f0f46 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:38.551294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6df7cd11-2d85-4b0d-9354-0547f03f0f46 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:38.568745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-6df7cd11-2d85-4b0d-9354-0547f03f0f46 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Getting quotas for project 328d1dd53c6a4bc2b14376dd1a1cecb6. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:16:38.574658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-6df7cd11-2d85-4b0d-9354-0547f03f0f46 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Getting quotas for user b89f11ebd96141a5afe08dad79b0b20c and project 328d1dd53c6a4bc2b14376dd1a1cecb6. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:16:38.583460 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-56661b09-fc3f-4391-bae7-97c1485fc215 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.471632 Oct 29 01:16:38.584093 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1624/3107] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:16:38 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:38.588672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dd47a724-431e-4b2c-8384-35b0e6a5332e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:38.588828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6df7cd11-2d85-4b0d-9354-0547f03f0f46 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:16:38.589408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dd47a724-431e-4b2c-8384-35b0e6a5332e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:38.591796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6df7cd11-2d85-4b0d-9354-0547f03f0f46 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:16:38.596506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd47a724-431e-4b2c-8384-35b0e6a5332e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:38.597029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd47a724-431e-4b2c-8384-35b0e6a5332e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:38.597496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd47a724-431e-4b2c-8384-35b0e6a5332e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:38.598203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd47a724-431e-4b2c-8384-35b0e6a5332e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:38.598657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd47a724-431e-4b2c-8384-35b0e6a5332e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:38.599086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd47a724-431e-4b2c-8384-35b0e6a5332e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:38.718500 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6df7cd11-2d85-4b0d-9354-0547f03f0f46 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.760981 Oct 29 01:16:38.725585 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1484/3108] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:16:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:16:38.729871 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3f8dde75-9aaa-4660-b12e-a90df3e54b0f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:38.730964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3f8dde75-9aaa-4660-b12e-a90df3e54b0f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:38.733246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dd47a724-431e-4b2c-8384-35b0e6a5332e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:38.738190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8dde75-9aaa-4660-b12e-a90df3e54b0f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:38.738689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8dde75-9aaa-4660-b12e-a90df3e54b0f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:38.739185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8dde75-9aaa-4660-b12e-a90df3e54b0f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:38.740141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8dde75-9aaa-4660-b12e-a90df3e54b0f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:38.740776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8dde75-9aaa-4660-b12e-a90df3e54b0f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:38.741288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8dde75-9aaa-4660-b12e-a90df3e54b0f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:38.741652 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dd47a724-431e-4b2c-8384-35b0e6a5332e tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1469 microversion: 2.1 time: 0.156428 Oct 29 01:16:38.742729 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1625/3109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:38 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:38.751259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e5b6202d-38db-4346-97e0-c33aef6e9755 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:38.752101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e5b6202d-38db-4346-97e0-c33aef6e9755 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:38.758555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5b6202d-38db-4346-97e0-c33aef6e9755 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:38.759286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5b6202d-38db-4346-97e0-c33aef6e9755 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:38.759911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5b6202d-38db-4346-97e0-c33aef6e9755 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:38.760902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5b6202d-38db-4346-97e0-c33aef6e9755 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:38.762141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5b6202d-38db-4346-97e0-c33aef6e9755 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:38.762838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5b6202d-38db-4346-97e0-c33aef6e9755 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:38.814070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3f8dde75-9aaa-4660-b12e-a90df3e54b0f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:38.823702 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3f8dde75-9aaa-4660-b12e-a90df3e54b0f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 200 len: 1260 microversion: 2.1 time: 0.102940 Oct 29 01:16:38.824976 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1485/3110] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:38 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 1260 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:38.830770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6ed2de01-c077-4fc9-b651-32a87f74a03e tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:38.831484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6ed2de01-c077-4fc9-b651-32a87f74a03e tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:38.837542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ed2de01-c077-4fc9-b651-32a87f74a03e tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:38.838147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ed2de01-c077-4fc9-b651-32a87f74a03e tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:38.838882 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ed2de01-c077-4fc9-b651-32a87f74a03e tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:38.840651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ed2de01-c077-4fc9-b651-32a87f74a03e tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:38.842338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ed2de01-c077-4fc9-b651-32a87f74a03e tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:38.842338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ed2de01-c077-4fc9-b651-32a87f74a03e tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:38.984544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e5b6202d-38db-4346-97e0-c33aef6e9755 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:38.992812 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e5b6202d-38db-4346-97e0-c33aef6e9755 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1810 microversion: 2.1 time: 0.248887 Oct 29 01:16:38.993519 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1626/3111] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:38 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1810 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:38.999099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-75eb802a-3ea1-4157-8497-c662aeccd589 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-119815824"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:38.999631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-75eb802a-3ea1-4157-8497-c662aeccd589 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:39.005486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75eb802a-3ea1-4157-8497-c662aeccd589 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:39.005958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75eb802a-3ea1-4157-8497-c662aeccd589 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:39.006387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75eb802a-3ea1-4157-8497-c662aeccd589 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:39.007108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75eb802a-3ea1-4157-8497-c662aeccd589 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:39.007554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75eb802a-3ea1-4157-8497-c662aeccd589 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:39.007969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75eb802a-3ea1-4157-8497-c662aeccd589 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:39.017418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6ed2de01-c077-4fc9-b651-32a87f74a03e tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:39.025886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6ed2de01-c077-4fc9-b651-32a87f74a03e tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:39.028130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6ed2de01-c077-4fc9-b651-32a87f74a03e tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:39.029662 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6ed2de01-c077-4fc9-b651-32a87f74a03e tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1557 microversion: 2.21 time: 0.203903 Oct 29 01:16:39.030407 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1486/3112] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:38 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1557 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:39.035187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-73ca9660-05e9-40dd-b484-2ef2b84e965b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:39.035803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-73ca9660-05e9-40dd-b484-2ef2b84e965b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:39.117683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-73ca9660-05e9-40dd-b484-2ef2b84e965b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:39.125911 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-73ca9660-05e9-40dd-b484-2ef2b84e965b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1224 microversion: 2.1 time: 0.094323 Oct 29 01:16:39.126577 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1487/3113] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:39 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:39.137354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-17023fd5-9052-45f3-b455-f21a9e8f8273 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:39.138062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-17023fd5-9052-45f3-b455-f21a9e8f8273 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:39.144229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17023fd5-9052-45f3-b455-f21a9e8f8273 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:39.144799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17023fd5-9052-45f3-b455-f21a9e8f8273 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:39.145461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17023fd5-9052-45f3-b455-f21a9e8f8273 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:39.146239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17023fd5-9052-45f3-b455-f21a9e8f8273 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:39.146819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17023fd5-9052-45f3-b455-f21a9e8f8273 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:39.147306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17023fd5-9052-45f3-b455-f21a9e8f8273 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:39.177615 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.network.security_group_api [None req-75eb802a-3ea1-4157-8497-c662aeccd589 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Adding security group c3280745-8285-41c3-aabf-4e734790acba to port e555ad33-2662-4f2a-8f28-923c3ff8a45e Oct 29 01:16:39.250220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-17023fd5-9052-45f3-b455-f21a9e8f8273 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:39.258395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-17023fd5-9052-45f3-b455-f21a9e8f8273 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:39.259829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-17023fd5-9052-45f3-b455-f21a9e8f8273 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:39.260994 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-17023fd5-9052-45f3-b455-f21a9e8f8273 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1366 microversion: 2.47 time: 0.127878 Oct 29 01:16:39.262951 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1488/3114] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:39 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1366 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:16:39.638980 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-75eb802a-3ea1-4157-8497-c662aeccd589 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "POST /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8/action" status: 202 len: 0 microversion: 2.1 time: 0.644374 Oct 29 01:16:39.639588 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1627/3115] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:16:38 2022] POST /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8/action => generated 0 bytes in 646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:16:39.647759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-98dd6b81-b37f-4aa4-b01f-73d1191afb03 req-e35c8cc5-e418-462a-944e-148a5e61463c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "919adddc-a598-47f8-9823-170d101dbdc8", "tag": "e555ad33-2662-4f2a-8f28-923c3ff8a45e"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:39.648195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e070b8c5-b1b7-4f4c-9dd2-efcb82d7a9e2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-119815824"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:39.648809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e070b8c5-b1b7-4f4c-9dd2-efcb82d7a9e2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:39.655269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e070b8c5-b1b7-4f4c-9dd2-efcb82d7a9e2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:39.656056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e070b8c5-b1b7-4f4c-9dd2-efcb82d7a9e2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:39.656511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e070b8c5-b1b7-4f4c-9dd2-efcb82d7a9e2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:39.657327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e070b8c5-b1b7-4f4c-9dd2-efcb82d7a9e2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:39.661396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e070b8c5-b1b7-4f4c-9dd2-efcb82d7a9e2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:39.661396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e070b8c5-b1b7-4f4c-9dd2-efcb82d7a9e2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:39.661590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-98dd6b81-b37f-4aa4-b01f-73d1191afb03 req-e35c8cc5-e418-462a-944e-148a5e61463c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:39.661590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-98dd6b81-b37f-4aa4-b01f-73d1191afb03 req-e35c8cc5-e418-462a-944e-148a5e61463c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:39.661590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-98dd6b81-b37f-4aa4-b01f-73d1191afb03 req-e35c8cc5-e418-462a-944e-148a5e61463c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:39.673238 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-98dd6b81-b37f-4aa4-b01f-73d1191afb03 req-e35c8cc5-e418-462a-944e-148a5e61463c service nova] Creating event network-changed:e555ad33-2662-4f2a-8f28-923c3ff8a45e for instance 919adddc-a598-47f8-9823-170d101dbdc8 on n-h2-862964-3 Oct 29 01:16:39.678444 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-98dd6b81-b37f-4aa4-b01f-73d1191afb03 req-e35c8cc5-e418-462a-944e-148a5e61463c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035386 Oct 29 01:16:39.679296 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1489/3116] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:16:39.770520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f2330f4c-5f8a-448b-b90d-1114ed6be616 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:39.771923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f2330f4c-5f8a-448b-b90d-1114ed6be616 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:39.779837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2330f4c-5f8a-448b-b90d-1114ed6be616 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:39.780331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2330f4c-5f8a-448b-b90d-1114ed6be616 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:39.780777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2330f4c-5f8a-448b-b90d-1114ed6be616 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:39.781635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2330f4c-5f8a-448b-b90d-1114ed6be616 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:39.782104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2330f4c-5f8a-448b-b90d-1114ed6be616 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:39.782576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2330f4c-5f8a-448b-b90d-1114ed6be616 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:39.847308 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.network.security_group_api [None req-e070b8c5-b1b7-4f4c-9dd2-efcb82d7a9e2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Removing security group c3280745-8285-41c3-aabf-4e734790acba from port e555ad33-2662-4f2a-8f28-923c3ff8a45e Oct 29 01:16:40.055604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f2330f4c-5f8a-448b-b90d-1114ed6be616 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:40.064127 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f2330f4c-5f8a-448b-b90d-1114ed6be616 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1469 microversion: 2.1 time: 0.302295 Oct 29 01:16:40.077192 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1490/3117] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:39 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1469 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:40.077192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d6c957fd-75b8-4303-bf4e-e7ba9af79a4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:40.077192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d6c957fd-75b8-4303-bf4e-e7ba9af79a4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:40.084156 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6c957fd-75b8-4303-bf4e-e7ba9af79a4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:40.084654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6c957fd-75b8-4303-bf4e-e7ba9af79a4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:40.085483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6c957fd-75b8-4303-bf4e-e7ba9af79a4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:40.086381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6c957fd-75b8-4303-bf4e-e7ba9af79a4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:40.087004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6c957fd-75b8-4303-bf4e-e7ba9af79a4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:40.087444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6c957fd-75b8-4303-bf4e-e7ba9af79a4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:40.556142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d6c957fd-75b8-4303-bf4e-e7ba9af79a4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:40.570622 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d6c957fd-75b8-4303-bf4e-e7ba9af79a4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 200 len: 1268 microversion: 2.1 time: 0.504284 Oct 29 01:16:40.573252 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1491/3118] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:40 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 1268 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:40.577905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-57260aa6-25b1-44db-875e-ba0c60ed7a2b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:40.578763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-57260aa6-25b1-44db-875e-ba0c60ed7a2b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:40.585597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57260aa6-25b1-44db-875e-ba0c60ed7a2b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:40.586098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57260aa6-25b1-44db-875e-ba0c60ed7a2b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:40.586551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57260aa6-25b1-44db-875e-ba0c60ed7a2b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:40.587256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57260aa6-25b1-44db-875e-ba0c60ed7a2b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:40.587775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57260aa6-25b1-44db-875e-ba0c60ed7a2b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:40.588318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57260aa6-25b1-44db-875e-ba0c60ed7a2b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:41.272684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-57260aa6-25b1-44db-875e-ba0c60ed7a2b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:41.291838 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-57260aa6-25b1-44db-875e-ba0c60ed7a2b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1810 microversion: 2.1 time: 0.719332 Oct 29 01:16:41.292903 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1492/3119] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:40 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1810 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:41.298236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2e05e70b-a0fc-4e30-b8b8-4055dfcb9617 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:41.298843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2e05e70b-a0fc-4e30-b8b8-4055dfcb9617 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:41.304901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e05e70b-a0fc-4e30-b8b8-4055dfcb9617 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:41.317583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e05e70b-a0fc-4e30-b8b8-4055dfcb9617 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:41.319577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e05e70b-a0fc-4e30-b8b8-4055dfcb9617 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:41.319577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e05e70b-a0fc-4e30-b8b8-4055dfcb9617 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:41.319577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e05e70b-a0fc-4e30-b8b8-4055dfcb9617 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:41.320575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e05e70b-a0fc-4e30-b8b8-4055dfcb9617 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:41.565266 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e070b8c5-b1b7-4f4c-9dd2-efcb82d7a9e2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "POST /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8/action" status: 202 len: 0 microversion: 2.1 time: 1.921395 Oct 29 01:16:41.567064 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1628/3120] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:16:39 2022] POST /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8/action => generated 0 bytes in 1924 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:16:41.575163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ac7b57cb-5471-4c89-916f-ae72b7f0495e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:41.575811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ac7b57cb-5471-4c89-916f-ae72b7f0495e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:41.582439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac7b57cb-5471-4c89-916f-ae72b7f0495e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:41.583285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac7b57cb-5471-4c89-916f-ae72b7f0495e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:41.584126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac7b57cb-5471-4c89-916f-ae72b7f0495e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:41.585091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac7b57cb-5471-4c89-916f-ae72b7f0495e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:41.585876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac7b57cb-5471-4c89-916f-ae72b7f0495e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:41.586526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac7b57cb-5471-4c89-916f-ae72b7f0495e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:41.780597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ac7b57cb-5471-4c89-916f-ae72b7f0495e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:41.790022 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ac7b57cb-5471-4c89-916f-ae72b7f0495e tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1284 microversion: 2.1 time: 0.221369 Oct 29 01:16:41.802054 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1629/3121] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:41 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1284 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:41.815753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a88a570e-ed39-4a4f-80f0-05af789f40f2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:41.815753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a88a570e-ed39-4a4f-80f0-05af789f40f2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:41.822258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a88a570e-ed39-4a4f-80f0-05af789f40f2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:41.823142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a88a570e-ed39-4a4f-80f0-05af789f40f2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:41.823852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a88a570e-ed39-4a4f-80f0-05af789f40f2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:41.825985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a88a570e-ed39-4a4f-80f0-05af789f40f2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:41.826528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a88a570e-ed39-4a4f-80f0-05af789f40f2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:41.827007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a88a570e-ed39-4a4f-80f0-05af789f40f2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:41.987424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2e05e70b-a0fc-4e30-b8b8-4055dfcb9617 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:41.987672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a88a570e-ed39-4a4f-80f0-05af789f40f2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:41.991961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:41.998053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a88a570e-ed39-4a4f-80f0-05af789f40f2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:42.009582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2e05e70b-a0fc-4e30-b8b8-4055dfcb9617 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:42.009863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a88a570e-ed39-4a4f-80f0-05af789f40f2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:42.012094 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a88a570e-ed39-4a4f-80f0-05af789f40f2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1366 microversion: 2.47 time: 0.200895 Oct 29 01:16:42.012893 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1630/3122] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:41 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:42.014434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2e05e70b-a0fc-4e30-b8b8-4055dfcb9617 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:42.018035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-39cd25cd-b240-4cb7-9eb3-8232f28ef88f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:42.019528 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2e05e70b-a0fc-4e30-b8b8-4055dfcb9617 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1557 microversion: 2.21 time: 0.724350 Oct 29 01:16:42.020178 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1493/3123] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:41 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1557 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:42.026480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-39cd25cd-b240-4cb7-9eb3-8232f28ef88f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:42.028022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-ff5c17bc-07a1-4076-85fd-2a9ed053d81f req-c71665e1-1a35-4021-82ec-4fccf724dfab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6448587-2777-40b9-a6c5-514e56ac388d", "name": "network-vif-deleted", "tag": "946b5a67-b144-4570-bffa-a10da029250f"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:42.042433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39cd25cd-b240-4cb7-9eb3-8232f28ef88f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:42.044106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39cd25cd-b240-4cb7-9eb3-8232f28ef88f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:42.045997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39cd25cd-b240-4cb7-9eb3-8232f28ef88f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:42.046927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39cd25cd-b240-4cb7-9eb3-8232f28ef88f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:42.054582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39cd25cd-b240-4cb7-9eb3-8232f28ef88f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:42.054582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39cd25cd-b240-4cb7-9eb3-8232f28ef88f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:42.057619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ff5c17bc-07a1-4076-85fd-2a9ed053d81f req-c71665e1-1a35-4021-82ec-4fccf724dfab service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:42.058396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ff5c17bc-07a1-4076-85fd-2a9ed053d81f req-c71665e1-1a35-4021-82ec-4fccf724dfab service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:42.062086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ff5c17bc-07a1-4076-85fd-2a9ed053d81f req-c71665e1-1a35-4021-82ec-4fccf724dfab service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:42.085662 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-ff5c17bc-07a1-4076-85fd-2a9ed053d81f req-c71665e1-1a35-4021-82ec-4fccf724dfab service nova] Creating event network-vif-deleted:946b5a67-b144-4570-bffa-a10da029250f for instance b6448587-2777-40b9-a6c5-514e56ac388d on n-h2-862964-3 Oct 29 01:16:42.094395 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-ff5c17bc-07a1-4076-85fd-2a9ed053d81f req-c71665e1-1a35-4021-82ec-4fccf724dfab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070546 Oct 29 01:16:42.095709 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1494/3124] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:42.101634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-288a6920-d292-47c2-96ba-163cd7276cca tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Action: 'create', calling method: .version_select at 0x7f9d9727c670>, body: {"pool": null} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:42.642234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-39cd25cd-b240-4cb7-9eb3-8232f28ef88f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:42.658398 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-39cd25cd-b240-4cb7-9eb3-8232f28ef88f tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1469 microversion: 2.1 time: 0.643926 Oct 29 01:16:42.667429 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1631/3125] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:42 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1469 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:42.677199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6fca8bba-6599-43a6-a084-fd25061ecf47 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:42.677821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6fca8bba-6599-43a6-a084-fd25061ecf47 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:42.688417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fca8bba-6599-43a6-a084-fd25061ecf47 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:42.688909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fca8bba-6599-43a6-a084-fd25061ecf47 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:42.689526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fca8bba-6599-43a6-a084-fd25061ecf47 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:42.691048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fca8bba-6599-43a6-a084-fd25061ecf47 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:42.691653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fca8bba-6599-43a6-a084-fd25061ecf47 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:42.696765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fca8bba-6599-43a6-a084-fd25061ecf47 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:42.839263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6fca8bba-6599-43a6-a084-fd25061ecf47 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:42.850920 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6fca8bba-6599-43a6-a084-fd25061ecf47 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 200 len: 1266 microversion: 2.1 time: 0.189441 Oct 29 01:16:42.851505 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1632/3126] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:42 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:42.865346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-99ba765a-3984-4329-8273-65c260d7d9ca req-3c670457-cb71-4dc3-ab8e-5d535b723b4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "919adddc-a598-47f8-9823-170d101dbdc8", "tag": "e555ad33-2662-4f2a-8f28-923c3ff8a45e"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:42.885640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-99ba765a-3984-4329-8273-65c260d7d9ca req-3c670457-cb71-4dc3-ab8e-5d535b723b4a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:42.890146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-99ba765a-3984-4329-8273-65c260d7d9ca req-3c670457-cb71-4dc3-ab8e-5d535b723b4a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:42.890146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-99ba765a-3984-4329-8273-65c260d7d9ca req-3c670457-cb71-4dc3-ab8e-5d535b723b4a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:42.905934 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-99ba765a-3984-4329-8273-65c260d7d9ca req-3c670457-cb71-4dc3-ab8e-5d535b723b4a service nova] Creating event network-changed:e555ad33-2662-4f2a-8f28-923c3ff8a45e for instance 919adddc-a598-47f8-9823-170d101dbdc8 on n-h2-862964-3 Oct 29 01:16:42.912319 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-99ba765a-3984-4329-8273-65c260d7d9ca req-3c670457-cb71-4dc3-ab8e-5d535b723b4a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059239 Oct 29 01:16:42.920021 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1633/3127] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:42.920021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8ffc30d3-5782-4179-8def-d73132287fd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:42.920021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8ffc30d3-5782-4179-8def-d73132287fd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:42.926929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ffc30d3-5782-4179-8def-d73132287fd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:42.927667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ffc30d3-5782-4179-8def-d73132287fd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:42.928120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ffc30d3-5782-4179-8def-d73132287fd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:42.928838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ffc30d3-5782-4179-8def-d73132287fd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:42.929318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ffc30d3-5782-4179-8def-d73132287fd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:42.929928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ffc30d3-5782-4179-8def-d73132287fd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:43.035178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8ffc30d3-5782-4179-8def-d73132287fd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:43.048774 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8ffc30d3-5782-4179-8def-d73132287fd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 200 len: 1567 microversion: 2.1 time: 0.134560 Oct 29 01:16:43.050971 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1634/3128] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:42 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 1567 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:43.061736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5cfd9c63-a280-4c9a-86ad-0f4fd199afe7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:43.063707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5cfd9c63-a280-4c9a-86ad-0f4fd199afe7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:43.091136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cfd9c63-a280-4c9a-86ad-0f4fd199afe7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:43.098320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cfd9c63-a280-4c9a-86ad-0f4fd199afe7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:43.098320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cfd9c63-a280-4c9a-86ad-0f4fd199afe7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:43.098320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cfd9c63-a280-4c9a-86ad-0f4fd199afe7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:43.098320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cfd9c63-a280-4c9a-86ad-0f4fd199afe7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:43.098320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cfd9c63-a280-4c9a-86ad-0f4fd199afe7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:43.642075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5cfd9c63-a280-4c9a-86ad-0f4fd199afe7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:43.654154 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5cfd9c63-a280-4c9a-86ad-0f4fd199afe7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1324 microversion: 2.1 time: 0.601835 Oct 29 01:16:43.654955 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1635/3129] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:43 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1324 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:43.660121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-18731cb4-f1e4-4e99-b3c1-c0c4ca3776e2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:43.660925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-18731cb4-f1e4-4e99-b3c1-c0c4ca3776e2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:43.670019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18731cb4-f1e4-4e99-b3c1-c0c4ca3776e2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:43.670765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18731cb4-f1e4-4e99-b3c1-c0c4ca3776e2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:43.671360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18731cb4-f1e4-4e99-b3c1-c0c4ca3776e2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:43.672215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18731cb4-f1e4-4e99-b3c1-c0c4ca3776e2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:43.673067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18731cb4-f1e4-4e99-b3c1-c0c4ca3776e2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:43.673691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18731cb4-f1e4-4e99-b3c1-c0c4ca3776e2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:43.807647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-18731cb4-f1e4-4e99-b3c1-c0c4ca3776e2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:43.819379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-18731cb4-f1e4-4e99-b3c1-c0c4ca3776e2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:43.821237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-18731cb4-f1e4-4e99-b3c1-c0c4ca3776e2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:43.823664 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-18731cb4-f1e4-4e99-b3c1-c0c4ca3776e2 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1366 microversion: 2.47 time: 0.166039 Oct 29 01:16:43.825180 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1636/3130] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:43 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:43.850999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e1a01fd7-cada-4bc1-a2aa-e319cc14fdbe tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:43.851919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e1a01fd7-cada-4bc1-a2aa-e319cc14fdbe tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:43.861958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1a01fd7-cada-4bc1-a2aa-e319cc14fdbe tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:43.863058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1a01fd7-cada-4bc1-a2aa-e319cc14fdbe tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:43.863694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1a01fd7-cada-4bc1-a2aa-e319cc14fdbe tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:43.864571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1a01fd7-cada-4bc1-a2aa-e319cc14fdbe tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:43.865199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1a01fd7-cada-4bc1-a2aa-e319cc14fdbe tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:43.866249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1a01fd7-cada-4bc1-a2aa-e319cc14fdbe tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:43.992596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1a01fd7-cada-4bc1-a2aa-e319cc14fdbe tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:43.993107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1a01fd7-cada-4bc1-a2aa-e319cc14fdbe tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:43.995104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1a01fd7-cada-4bc1-a2aa-e319cc14fdbe tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:43.995577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-e1a01fd7-cada-4bc1-a2aa-e319cc14fdbe tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lazy-loading 'fault' on Instance uuid 66e51083-7f72-4e67-a945-1607eddf7b3c {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:16:44.130565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e1a01fd7-cada-4bc1-a2aa-e319cc14fdbe tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:44.132876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:44.148201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e1a01fd7-cada-4bc1-a2aa-e319cc14fdbe tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:44.149796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e1a01fd7-cada-4bc1-a2aa-e319cc14fdbe tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8c558bdbb445a484065b9b16fe38ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3d614a2f6f48c9b3c495b5c79f2ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:44.169487 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e1a01fd7-cada-4bc1-a2aa-e319cc14fdbe tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 200 len: 1348 microversion: 2.21 time: 0.311628 Oct 29 01:16:44.185670 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1637/3131] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:43 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 1348 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:44.200694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a62479d1-1fe1-4178-b1d8-a5501f9c6884 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:44.201397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a62479d1-1fe1-4178-b1d8-a5501f9c6884 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:44.211399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a62479d1-1fe1-4178-b1d8-a5501f9c6884 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:44.211907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a62479d1-1fe1-4178-b1d8-a5501f9c6884 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:44.212355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a62479d1-1fe1-4178-b1d8-a5501f9c6884 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:44.213079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a62479d1-1fe1-4178-b1d8-a5501f9c6884 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:44.214056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a62479d1-1fe1-4178-b1d8-a5501f9c6884 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:44.215031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a62479d1-1fe1-4178-b1d8-a5501f9c6884 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:44.315873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a62479d1-1fe1-4178-b1d8-a5501f9c6884 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:44.316375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a62479d1-1fe1-4178-b1d8-a5501f9c6884 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:44.316816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a62479d1-1fe1-4178-b1d8-a5501f9c6884 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:44.317324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-a62479d1-1fe1-4178-b1d8-a5501f9c6884 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lazy-loading 'fault' on Instance uuid 756326f6-781c-4fad-a611-b908891aed66 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:16:44.718986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a62479d1-1fe1-4178-b1d8-a5501f9c6884 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:44.736535 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a62479d1-1fe1-4178-b1d8-a5501f9c6884 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 200 len: 1303 microversion: 2.1 time: 0.539213 Oct 29 01:16:44.736535 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1638/3132] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:44 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 1303 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:44.736535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-87b30445-aa09-476f-b0be-ff8c573fefb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:44.736535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-87b30445-aa09-476f-b0be-ff8c573fefb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:44.738204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87b30445-aa09-476f-b0be-ff8c573fefb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:44.738751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87b30445-aa09-476f-b0be-ff8c573fefb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:44.739187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87b30445-aa09-476f-b0be-ff8c573fefb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:44.740092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87b30445-aa09-476f-b0be-ff8c573fefb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:44.740696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87b30445-aa09-476f-b0be-ff8c573fefb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:44.741189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87b30445-aa09-476f-b0be-ff8c573fefb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.000605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-87b30445-aa09-476f-b0be-ff8c573fefb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:45.008813 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-87b30445-aa09-476f-b0be-ff8c573fefb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 200 len: 1308 microversion: 2.1 time: 0.280805 Oct 29 01:16:45.009687 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1639/3133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:44 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 1308 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:45.022224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ee974a7f-c3f1-4eab-9b62-7644feaa1be9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:45.022224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ee974a7f-c3f1-4eab-9b62-7644feaa1be9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:45.023291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee974a7f-c3f1-4eab-9b62-7644feaa1be9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.024606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee974a7f-c3f1-4eab-9b62-7644feaa1be9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.025323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee974a7f-c3f1-4eab-9b62-7644feaa1be9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.026244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee974a7f-c3f1-4eab-9b62-7644feaa1be9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.027825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee974a7f-c3f1-4eab-9b62-7644feaa1be9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.029316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee974a7f-c3f1-4eab-9b62-7644feaa1be9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.047515 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-ee974a7f-c3f1-4eab-9b62-7644feaa1be9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] HTTP exception thrown: Instance b6448587-2777-40b9-a6c5-514e56ac388d could not be found. Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ee974a7f-c3f1-4eab-9b62-7644feaa1be9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Request method failure captured: Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d HTTP/1.1 Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH7I4HOyzycOoRJE1MrmYWPYKdvgOgA_mj7I6jvMAXMxyNsmk1ITdG8ol9j2K6AZgXRkk7nDMoUWX-ee1qpaAwK34VqxNX_wM6_i6Aa29pAt0Y29sew1zKSBO3EKWU0O9YcjyZ6YAVsqWXJBiEKrRuXIPFMnB5bd_LjRA_2qw4we144 Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 677550341e2d495eb0ff2e343c286caa Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestMultiNic-153387240 Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/677550341e2d495eb0ff2e343c286caa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/677550341e2d495eb0ff2e343c286caa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/677550341e2d495eb0ff2e343c286caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_677550341e2d495eb0ff2e343c286caa", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestMultiNic-153387240 Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 677550341e2d495eb0ff2e343c286caa Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestMultiNic-153387240 Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestMultiNic-153387240-project Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 2eb4c4f2d60f4affbf6162bd6481f3a3 Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestMultiNic-153387240-project Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance b6448587-2777-40b9-a6c5-514e56ac388d could not be found. Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'b6448587-2777-40b9-a6c5-514e56ac388d'} Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6448587-2777-40b9-a6c5-514e56ac388d could not be found. Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6448587-2777-40b9-a6c5-514e56ac388d could not be found. Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:45.049341 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.054298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:45.054298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:45.054298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:45.054298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:16:45.054298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:16:45.054298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6448587-2777-40b9-a6c5-514e56ac388d could not be found. Oct 29 01:16:45.054298 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.054298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ee974a7f-c3f1-4eab-9b62-7644feaa1be9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Returning 404 to user: Instance b6448587-2777-40b9-a6c5-514e56ac388d could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:16:45.054298 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ee974a7f-c3f1-4eab-9b62-7644feaa1be9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 404 len: 111 microversion: 2.1 time: 0.040013 Oct 29 01:16:45.055507 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1640/3134] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:45 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:16:45.059637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-dc281c7b-f7b2-4ad6-9fd1-0b83892e65a5 req-09c8e405-4197-408c-b05c-5534a0c62a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6448587-2777-40b9-a6c5-514e56ac388d", "name": "network-vif-deleted", "tag": "2d6f74f2-830a-4bad-8269-f210111534c9"}, {"server_uuid": "b6448587-2777-40b9-a6c5-514e56ac388d", "name": "network-vif-deleted", "tag": "c3863196-8c5a-43b7-805d-2e866f9ea0f9"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:45.073191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-dc281c7b-f7b2-4ad6-9fd1-0b83892e65a5 req-09c8e405-4197-408c-b05c-5534a0c62a05 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.073661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-dc281c7b-f7b2-4ad6-9fd1-0b83892e65a5 req-09c8e405-4197-408c-b05c-5534a0c62a05 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.074606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-dc281c7b-f7b2-4ad6-9fd1-0b83892e65a5 req-09c8e405-4197-408c-b05c-5534a0c62a05 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.086840 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-dc281c7b-f7b2-4ad6-9fd1-0b83892e65a5 req-09c8e405-4197-408c-b05c-5534a0c62a05 service nova] Creating event network-vif-deleted:2d6f74f2-830a-4bad-8269-f210111534c9 for instance b6448587-2777-40b9-a6c5-514e56ac388d on n-h2-862964-3 Oct 29 01:16:45.087464 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-dc281c7b-f7b2-4ad6-9fd1-0b83892e65a5 req-09c8e405-4197-408c-b05c-5534a0c62a05 service nova] Creating event network-vif-deleted:c3863196-8c5a-43b7-805d-2e866f9ea0f9 for instance b6448587-2777-40b9-a6c5-514e56ac388d on n-h2-862964-3 Oct 29 01:16:45.093418 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-dc281c7b-f7b2-4ad6-9fd1-0b83892e65a5 req-09c8e405-4197-408c-b05c-5534a0c62a05 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037358 Oct 29 01:16:45.094431 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1641/3135] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:45.099863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-53e38854-d291-42fc-84fb-dd99fbca56aa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:45.100673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-53e38854-d291-42fc-84fb-dd99fbca56aa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:45.108451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53e38854-d291-42fc-84fb-dd99fbca56aa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.109182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53e38854-d291-42fc-84fb-dd99fbca56aa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.109803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53e38854-d291-42fc-84fb-dd99fbca56aa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.110504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53e38854-d291-42fc-84fb-dd99fbca56aa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.110951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53e38854-d291-42fc-84fb-dd99fbca56aa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.111551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53e38854-d291-42fc-84fb-dd99fbca56aa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.336867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-53e38854-d291-42fc-84fb-dd99fbca56aa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:45.345672 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-53e38854-d291-42fc-84fb-dd99fbca56aa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1324 microversion: 2.1 time: 0.249737 Oct 29 01:16:45.346549 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1642/3136] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:45 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1324 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:45.367254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ec7dc121-1d61-4068-a220-f61a89413dae tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:45.368544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ec7dc121-1d61-4068-a220-f61a89413dae tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:45.375330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec7dc121-1d61-4068-a220-f61a89413dae tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.375735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec7dc121-1d61-4068-a220-f61a89413dae tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.376171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec7dc121-1d61-4068-a220-f61a89413dae tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.376886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec7dc121-1d61-4068-a220-f61a89413dae tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.377494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec7dc121-1d61-4068-a220-f61a89413dae tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.377777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec7dc121-1d61-4068-a220-f61a89413dae tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.480028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ec7dc121-1d61-4068-a220-f61a89413dae tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:45.490073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ec7dc121-1d61-4068-a220-f61a89413dae tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:45.491630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ec7dc121-1d61-4068-a220-f61a89413dae tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:45.492861 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ec7dc121-1d61-4068-a220-f61a89413dae tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1366 microversion: 2.47 time: 0.129965 Oct 29 01:16:45.493833 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1643/3137] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:45 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:45.499358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-326c3116-579c-4ee6-ab9a-9eba2f79a630 req-7331b1d6-a0a0-4bb0-a437-2f5cd0c45e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66e51083-7f72-4e67-a945-1607eddf7b3c", "name": "network-vif-deleted", "tag": "39918983-d363-4e1e-ab8a-57bfa5a575e1"}, {"server_uuid": "756326f6-781c-4fad-a611-b908891aed66", "name": "network-vif-deleted", "tag": "57bdfbf3-fabe-41ec-b284-ce6b9d6eaa5a"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:45.520772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-326c3116-579c-4ee6-ab9a-9eba2f79a630 req-7331b1d6-a0a0-4bb0-a437-2f5cd0c45e45 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.521354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-326c3116-579c-4ee6-ab9a-9eba2f79a630 req-7331b1d6-a0a0-4bb0-a437-2f5cd0c45e45 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.521791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-326c3116-579c-4ee6-ab9a-9eba2f79a630 req-7331b1d6-a0a0-4bb0-a437-2f5cd0c45e45 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.539221 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-326c3116-579c-4ee6-ab9a-9eba2f79a630 req-7331b1d6-a0a0-4bb0-a437-2f5cd0c45e45 service nova] Creating event network-vif-deleted:39918983-d363-4e1e-ab8a-57bfa5a575e1 for instance 66e51083-7f72-4e67-a945-1607eddf7b3c on n-h1-862964-3 Oct 29 01:16:45.539817 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-326c3116-579c-4ee6-ab9a-9eba2f79a630 req-7331b1d6-a0a0-4bb0-a437-2f5cd0c45e45 service nova] Creating event network-vif-deleted:57bdfbf3-fabe-41ec-b284-ce6b9d6eaa5a for instance 756326f6-781c-4fad-a611-b908891aed66 on n-h1-862964-3 Oct 29 01:16:45.549901 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-326c3116-579c-4ee6-ab9a-9eba2f79a630 req-7331b1d6-a0a0-4bb0-a437-2f5cd0c45e45 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054572 Oct 29 01:16:45.550995 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1644/3138] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:45.556502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0579dde8-b864-4dd0-a9e4-fab08ec29288 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:45.557199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0579dde8-b864-4dd0-a9e4-fab08ec29288 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:45.563860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0579dde8-b864-4dd0-a9e4-fab08ec29288 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.564407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0579dde8-b864-4dd0-a9e4-fab08ec29288 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.565262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0579dde8-b864-4dd0-a9e4-fab08ec29288 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.565872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0579dde8-b864-4dd0-a9e4-fab08ec29288 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.566319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0579dde8-b864-4dd0-a9e4-fab08ec29288 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.568066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0579dde8-b864-4dd0-a9e4-fab08ec29288 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.581565 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-0579dde8-b864-4dd0-a9e4-fab08ec29288 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] HTTP exception thrown: Instance 66e51083-7f72-4e67-a945-1607eddf7b3c could not be found. Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0579dde8-b864-4dd0-a9e4-fab08ec29288 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Request method failure captured: Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c HTTP/1.1 Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH7VAwBye9OguGmli6tVt6JFybOompmU4h0ku6b4qIE6druK-X66qGdVtlfjanyX9rsi-EULUixnBPqLs-UXo_oDoQtNhCDbr_Je5HH6d__tsW1yur3AGzZoR_Tf86iF32kitUfC3l2_MwYBvK7XbrqW2Zq63MmUC34lS8Q1IN9CsyM Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.21 Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: fe3d614a2f6f48c9b3c495b5c79f2ae2 Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1757122209 Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fe3d614a2f6f48c9b3c495b5c79f2ae2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fe3d614a2f6f48c9b3c495b5c79f2ae2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fe3d614a2f6f48c9b3c495b5c79f2ae2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fe3d614a2f6f48c9b3c495b5c79f2ae2", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-InstanceActionsV221TestJSON-1757122209 Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: fe3d614a2f6f48c9b3c495b5c79f2ae2 Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1757122209 Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-InstanceActionsV221TestJSON-1757122209-project Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: ff8c558bdbb445a484065b9b16fe38ac Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-InstanceActionsV221TestJSON-1757122209-project Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 66e51083-7f72-4e67-a945-1607eddf7b3c could not be found. Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '66e51083-7f72-4e67-a945-1607eddf7b3c'} Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66e51083-7f72-4e67-a945-1607eddf7b3c could not be found. Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66e51083-7f72-4e67-a945-1607eddf7b3c could not be found. Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.583416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:45.588493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.588493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:45.588493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:45.588493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:45.588493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:16:45.588493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:16:45.588493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66e51083-7f72-4e67-a945-1607eddf7b3c could not be found. Oct 29 01:16:45.588493 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.588493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0579dde8-b864-4dd0-a9e4-fab08ec29288 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Returning 404 to user: Instance 66e51083-7f72-4e67-a945-1607eddf7b3c could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:16:45.588493 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0579dde8-b864-4dd0-a9e4-fab08ec29288 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 404 len: 111 microversion: 2.21 time: 0.032679 Oct 29 01:16:45.591150 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1645/3139] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:45 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:16:45.596086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5cf398cc-abb7-4bb6-91c8-827c42a1f4b7 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '.version_select at 0x7f9d9715a8b0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:45.597140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5cf398cc-abb7-4bb6-91c8-827c42a1f4b7 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:45.603336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cf398cc-abb7-4bb6-91c8-827c42a1f4b7 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.603910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cf398cc-abb7-4bb6-91c8-827c42a1f4b7 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.604419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cf398cc-abb7-4bb6-91c8-827c42a1f4b7 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.605397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cf398cc-abb7-4bb6-91c8-827c42a1f4b7 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.605933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cf398cc-abb7-4bb6-91c8-827c42a1f4b7 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.606436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5cf398cc-abb7-4bb6-91c8-827c42a1f4b7 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.684212 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5cf398cc-abb7-4bb6-91c8-827c42a1f4b7 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.092745 Oct 29 01:16:45.689328 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1646/3140] 10.222.0.26 () {60 vars in 1337 bytes} [Sat Oct 29 01:16:45 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c/os-instance-actions => generated 611 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:16:45.703059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb1496a4-bef9-4d6b-8c1e-46469c769b28 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:45.705272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bb1496a4-bef9-4d6b-8c1e-46469c769b28 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:45.711352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb1496a4-bef9-4d6b-8c1e-46469c769b28 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.711933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb1496a4-bef9-4d6b-8c1e-46469c769b28 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.712462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb1496a4-bef9-4d6b-8c1e-46469c769b28 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.713294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb1496a4-bef9-4d6b-8c1e-46469c769b28 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.713754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb1496a4-bef9-4d6b-8c1e-46469c769b28 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.714980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb1496a4-bef9-4d6b-8c1e-46469c769b28 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.731865 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-bb1496a4-bef9-4d6b-8c1e-46469c769b28 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] HTTP exception thrown: Instance 66e51083-7f72-4e67-a945-1607eddf7b3c could not be found. Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb1496a4-bef9-4d6b-8c1e-46469c769b28 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Request method failure captured: Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c HTTP/1.1 Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH7VAwBye9OguGmli6tVt6JFybOompmU4h0ku6b4qIE6druK-X66qGdVtlfjanyX9rsi-EULUixnBPqLs-UXo_oDoQtNhCDbr_Je5HH6d__tsW1yur3AGzZoR_Tf86iF32kitUfC3l2_MwYBvK7XbrqW2Zq63MmUC34lS8Q1IN9CsyM Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.21 Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: fe3d614a2f6f48c9b3c495b5c79f2ae2 Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1757122209 Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fe3d614a2f6f48c9b3c495b5c79f2ae2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fe3d614a2f6f48c9b3c495b5c79f2ae2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fe3d614a2f6f48c9b3c495b5c79f2ae2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fe3d614a2f6f48c9b3c495b5c79f2ae2", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-InstanceActionsV221TestJSON-1757122209 Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: fe3d614a2f6f48c9b3c495b5c79f2ae2 Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1757122209 Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-InstanceActionsV221TestJSON-1757122209-project Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: ff8c558bdbb445a484065b9b16fe38ac Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-InstanceActionsV221TestJSON-1757122209-project Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 66e51083-7f72-4e67-a945-1607eddf7b3c could not be found. Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '66e51083-7f72-4e67-a945-1607eddf7b3c'} Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66e51083-7f72-4e67-a945-1607eddf7b3c could not be found. Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:16:45.734353 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:16:45.746185 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66e51083-7f72-4e67-a945-1607eddf7b3c could not be found. Oct 29 01:16:45.746185 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.746185 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:45.746185 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.746185 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:45.746185 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:45.746185 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:45.746185 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:16:45.746185 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:16:45.746185 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66e51083-7f72-4e67-a945-1607eddf7b3c could not be found. Oct 29 01:16:45.746185 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.746185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb1496a4-bef9-4d6b-8c1e-46469c769b28 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Returning 404 to user: Instance 66e51083-7f72-4e67-a945-1607eddf7b3c could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:16:45.746185 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bb1496a4-bef9-4d6b-8c1e-46469c769b28 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "DELETE /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 404 len: 111 microversion: 2.21 time: 0.038439 Oct 29 01:16:45.746185 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1647/3141] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:16:45 2022] DELETE /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:16:45.748768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b8fcc78-8c40-46dc-9c82-0d2e8c8c89b2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:45.749737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7b8fcc78-8c40-46dc-9c82-0d2e8c8c89b2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] [instance: 66e51083-7f72-4e67-a945-1607eddf7b3c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:45.758804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b8fcc78-8c40-46dc-9c82-0d2e8c8c89b2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.759658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b8fcc78-8c40-46dc-9c82-0d2e8c8c89b2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.761363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b8fcc78-8c40-46dc-9c82-0d2e8c8c89b2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.762625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b8fcc78-8c40-46dc-9c82-0d2e8c8c89b2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.763102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b8fcc78-8c40-46dc-9c82-0d2e8c8c89b2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.763608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b8fcc78-8c40-46dc-9c82-0d2e8c8c89b2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.789724 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-7b8fcc78-8c40-46dc-9c82-0d2e8c8c89b2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] HTTP exception thrown: Instance 66e51083-7f72-4e67-a945-1607eddf7b3c could not be found. Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b8fcc78-8c40-46dc-9c82-0d2e8c8c89b2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Request method failure captured: Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c HTTP/1.1 Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH7VAwBye9OguGmli6tVt6JFybOompmU4h0ku6b4qIE6druK-X66qGdVtlfjanyX9rsi-EULUixnBPqLs-UXo_oDoQtNhCDbr_Je5HH6d__tsW1yur3AGzZoR_Tf86iF32kitUfC3l2_MwYBvK7XbrqW2Zq63MmUC34lS8Q1IN9CsyM Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.21 Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: fe3d614a2f6f48c9b3c495b5c79f2ae2 Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1757122209 Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fe3d614a2f6f48c9b3c495b5c79f2ae2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fe3d614a2f6f48c9b3c495b5c79f2ae2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fe3d614a2f6f48c9b3c495b5c79f2ae2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fe3d614a2f6f48c9b3c495b5c79f2ae2", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-InstanceActionsV221TestJSON-1757122209 Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: fe3d614a2f6f48c9b3c495b5c79f2ae2 Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1757122209 Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-InstanceActionsV221TestJSON-1757122209-project Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: ff8c558bdbb445a484065b9b16fe38ac Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-InstanceActionsV221TestJSON-1757122209-project Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 66e51083-7f72-4e67-a945-1607eddf7b3c could not be found. Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '66e51083-7f72-4e67-a945-1607eddf7b3c'} Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66e51083-7f72-4e67-a945-1607eddf7b3c could not be found. Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66e51083-7f72-4e67-a945-1607eddf7b3c could not be found. Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.791515 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:45.796390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.796390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:45.796390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:45.796390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:45.796390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:16:45.796390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:16:45.796390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66e51083-7f72-4e67-a945-1607eddf7b3c could not be found. Oct 29 01:16:45.796390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.796390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b8fcc78-8c40-46dc-9c82-0d2e8c8c89b2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] Returning 404 to user: Instance 66e51083-7f72-4e67-a945-1607eddf7b3c could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:16:45.796390 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7b8fcc78-8c40-46dc-9c82-0d2e8c8c89b2 tempest-InstanceActionsV221TestJSON-1757122209 tempest-InstanceActionsV221TestJSON-1757122209-project] 10.222.0.26 "GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c" status: 404 len: 111 microversion: 2.21 time: 0.051609 Oct 29 01:16:45.796390 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1648/3142] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:45 2022] GET /compute/v2.1/servers/66e51083-7f72-4e67-a945-1607eddf7b3c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:16:45.801398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dccd53c3-d3cc-48b1-9e96-cb9e75e9aaf3 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:45.801398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dccd53c3-d3cc-48b1-9e96-cb9e75e9aaf3 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: 756326f6-781c-4fad-a611-b908891aed66] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:45.806387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dccd53c3-d3cc-48b1-9e96-cb9e75e9aaf3 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.806876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dccd53c3-d3cc-48b1-9e96-cb9e75e9aaf3 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.817014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dccd53c3-d3cc-48b1-9e96-cb9e75e9aaf3 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.817014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dccd53c3-d3cc-48b1-9e96-cb9e75e9aaf3 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.817014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dccd53c3-d3cc-48b1-9e96-cb9e75e9aaf3 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.817014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dccd53c3-d3cc-48b1-9e96-cb9e75e9aaf3 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.825279 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-dccd53c3-d3cc-48b1-9e96-cb9e75e9aaf3 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] HTTP exception thrown: Instance 756326f6-781c-4fad-a611-b908891aed66 could not be found. Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dccd53c3-d3cc-48b1-9e96-cb9e75e9aaf3 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Request method failure captured: Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 HTTP/1.1 Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH5gyXkSGUYok4VorbYUzbXvqeTdDDq_qf15RaIJS-1BomiYu21QMIPLZg9iLhQtxY8H65wQ4oCKhP4PSRY_obIBI7mA3VkHOi2BeAGp77T-n3IQKktJeMf_18Yvwuifb4DNAxQo1aAx9xRYT_0he7ixf1DsbiSnaI-9qk4otUSsVyo Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 5bdf61e2cbca4cdc95494b38c827ce63 Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersAdminTestJSON-736361139 Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bdf61e2cbca4cdc95494b38c827ce63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5bdf61e2cbca4cdc95494b38c827ce63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bdf61e2cbca4cdc95494b38c827ce63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5bdf61e2cbca4cdc95494b38c827ce63", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersAdminTestJSON-736361139 Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 5bdf61e2cbca4cdc95494b38c827ce63 Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersAdminTestJSON-736361139 Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersAdminTestJSON-736361139-project Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 60969ed444b545b9a5b02e27eb7eaea3 Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersAdminTestJSON-736361139-project Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 756326f6-781c-4fad-a611-b908891aed66 could not be found. Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '756326f6-781c-4fad-a611-b908891aed66'} Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 756326f6-781c-4fad-a611-b908891aed66 could not be found. Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 756326f6-781c-4fad-a611-b908891aed66 could not be found. Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:45.827226 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.831250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:45.831250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:45.831250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:45.831250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:16:45.831250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:16:45.831250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 756326f6-781c-4fad-a611-b908891aed66 could not be found. Oct 29 01:16:45.831250 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:45.831250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dccd53c3-d3cc-48b1-9e96-cb9e75e9aaf3 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Returning 404 to user: Instance 756326f6-781c-4fad-a611-b908891aed66 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:16:45.831745 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dccd53c3-d3cc-48b1-9e96-cb9e75e9aaf3 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66" status: 404 len: 111 microversion: 2.1 time: 0.036023 Oct 29 01:16:45.833107 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1649/3143] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:45 2022] GET /compute/v2.1/servers/756326f6-781c-4fad-a611-b908891aed66 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:16:45.843705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0e429d91-4791-4366-b2bf-41a6c7613488 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:45.844607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0e429d91-4791-4366-b2bf-41a6c7613488 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:45.851877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e429d91-4791-4366-b2bf-41a6c7613488 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.858576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e429d91-4791-4366-b2bf-41a6c7613488 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.858576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e429d91-4791-4366-b2bf-41a6c7613488 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.858576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e429d91-4791-4366-b2bf-41a6c7613488 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.858576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e429d91-4791-4366-b2bf-41a6c7613488 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.858576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e429d91-4791-4366-b2bf-41a6c7613488 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.887575 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-288a6920-d292-47c2-96ba-163cd7276cca tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.789318 Oct 29 01:16:45.888570 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1495/3144] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 29 01:16:42 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:45.894127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0e429d91-4791-4366-b2bf-41a6c7613488 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:16:45.901508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8feabc97-b472-40eb-87ff-2a7cf92c183e tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.145"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:45.906332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8feabc97-b472-40eb-87ff-2a7cf92c183e tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:45.914769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8feabc97-b472-40eb-87ff-2a7cf92c183e tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.916877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8feabc97-b472-40eb-87ff-2a7cf92c183e tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.918179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8feabc97-b472-40eb-87ff-2a7cf92c183e tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.919960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8feabc97-b472-40eb-87ff-2a7cf92c183e tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:45.926340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8feabc97-b472-40eb-87ff-2a7cf92c183e tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:45.926340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8feabc97-b472-40eb-87ff-2a7cf92c183e tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:45.961691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8feabc97-b472-40eb-87ff-2a7cf92c183e tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "refresh_cache-919adddc-a598-47f8-9823-170d101dbdc8" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 01:16:45.962562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8feabc97-b472-40eb-87ff-2a7cf92c183e tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquired lock "refresh_cache-919adddc-a598-47f8-9823-170d101dbdc8" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 01:16:46.186662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:46.299464 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0e429d91-4791-4366-b2bf-41a6c7613488 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 204 len: 0 microversion: 2.1 time: 0.461644 Oct 29 01:16:46.302119 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1650/3145] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:16:45 2022] DELETE /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:16:46.313745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c26526e8-ea65-4e98-a472-c1476570624b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:46.314599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c26526e8-ea65-4e98-a472-c1476570624b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:46.322476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c26526e8-ea65-4e98-a472-c1476570624b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:46.323870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c26526e8-ea65-4e98-a472-c1476570624b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:46.331357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c26526e8-ea65-4e98-a472-c1476570624b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:46.331357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c26526e8-ea65-4e98-a472-c1476570624b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:46.331357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c26526e8-ea65-4e98-a472-c1476570624b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:46.331357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c26526e8-ea65-4e98-a472-c1476570624b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:46.700277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c26526e8-ea65-4e98-a472-c1476570624b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:46.709699 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c26526e8-ea65-4e98-a472-c1476570624b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 200 len: 1308 microversion: 2.1 time: 0.402742 Oct 29 01:16:46.725646 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1651/3146] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:46 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 1308 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:46.725646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b3663a1e-2348-4967-b637-89125c3c55c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:46.725646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b3663a1e-2348-4967-b637-89125c3c55c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:46.725646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3663a1e-2348-4967-b637-89125c3c55c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:46.725646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3663a1e-2348-4967-b637-89125c3c55c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:46.725646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3663a1e-2348-4967-b637-89125c3c55c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:46.725646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3663a1e-2348-4967-b637-89125c3c55c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:46.725646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3663a1e-2348-4967-b637-89125c3c55c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:46.725646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3663a1e-2348-4967-b637-89125c3c55c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:47.065703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b3663a1e-2348-4967-b637-89125c3c55c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:47.077212 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b3663a1e-2348-4967-b637-89125c3c55c2 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1470 microversion: 2.1 time: 0.365534 Oct 29 01:16:47.084719 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1652/3147] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:46 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1470 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:47.093177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-096d540f-f457-40a3-b2a6-bed05b03c3b7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:47.094479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-096d540f-f457-40a3-b2a6-bed05b03c3b7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:47.102864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-096d540f-f457-40a3-b2a6-bed05b03c3b7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:47.106509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-096d540f-f457-40a3-b2a6-bed05b03c3b7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:47.106509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-096d540f-f457-40a3-b2a6-bed05b03c3b7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:47.106509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-096d540f-f457-40a3-b2a6-bed05b03c3b7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:47.106509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-096d540f-f457-40a3-b2a6-bed05b03c3b7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:47.106509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-096d540f-f457-40a3-b2a6-bed05b03c3b7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:47.514882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-096d540f-f457-40a3-b2a6-bed05b03c3b7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:47.525921 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-096d540f-f457-40a3-b2a6-bed05b03c3b7 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1324 microversion: 2.1 time: 0.439416 Oct 29 01:16:47.526619 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1653/3148] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:47 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1324 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:47.533572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b2c18be-cfa4-4648-a033-4b947087ce4d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:47.534259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7b2c18be-cfa4-4648-a033-4b947087ce4d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:47.541045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b2c18be-cfa4-4648-a033-4b947087ce4d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:47.541945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b2c18be-cfa4-4648-a033-4b947087ce4d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:47.542378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b2c18be-cfa4-4648-a033-4b947087ce4d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:47.543715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b2c18be-cfa4-4648-a033-4b947087ce4d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:47.544176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b2c18be-cfa4-4648-a033-4b947087ce4d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:47.544847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b2c18be-cfa4-4648-a033-4b947087ce4d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:47.665145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7b2c18be-cfa4-4648-a033-4b947087ce4d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:47.678042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7b2c18be-cfa4-4648-a033-4b947087ce4d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:47.680050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7b2c18be-cfa4-4648-a033-4b947087ce4d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:47.681559 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7b2c18be-cfa4-4648-a033-4b947087ce4d tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1366 microversion: 2.47 time: 0.152643 Oct 29 01:16:47.702611 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1654/3149] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:47 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:47.708281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-cd05e79b-1502-4b94-adac-130e2d44d33a req-83b37bbf-137d-4ae8-8038-4536f21e354d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6135c50e-cec0-4078-b9ef-bfabb3d7a52e", "tag": "144eca99-84d8-4c80-bfbe-18327d225155"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:47.722369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cd05e79b-1502-4b94-adac-130e2d44d33a req-83b37bbf-137d-4ae8-8038-4536f21e354d service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:47.723217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cd05e79b-1502-4b94-adac-130e2d44d33a req-83b37bbf-137d-4ae8-8038-4536f21e354d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:47.724049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cd05e79b-1502-4b94-adac-130e2d44d33a req-83b37bbf-137d-4ae8-8038-4536f21e354d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:47.743040 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-cd05e79b-1502-4b94-adac-130e2d44d33a req-83b37bbf-137d-4ae8-8038-4536f21e354d service nova] Creating event network-changed:144eca99-84d8-4c80-bfbe-18327d225155 for instance 6135c50e-cec0-4078-b9ef-bfabb3d7a52e on n-h1-862964-3 Oct 29 01:16:47.748904 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-cd05e79b-1502-4b94-adac-130e2d44d33a req-83b37bbf-137d-4ae8-8038-4536f21e354d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044500 Oct 29 01:16:47.749605 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1655/3150] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:47.755463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-da75ba32-0b27-48a3-a3bd-9895047f74b3 req-ec62b2af-3cf9-4b2d-9bd9-a4e28f816701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9692f5b-742e-4f42-ac47-05a1e536ac05", "tag": "95874789-ba8d-4fde-af5a-a4ae2d7a894c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:47.767292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-da75ba32-0b27-48a3-a3bd-9895047f74b3 req-ec62b2af-3cf9-4b2d-9bd9-a4e28f816701 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:47.767781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-da75ba32-0b27-48a3-a3bd-9895047f74b3 req-ec62b2af-3cf9-4b2d-9bd9-a4e28f816701 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:47.768219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-da75ba32-0b27-48a3-a3bd-9895047f74b3 req-ec62b2af-3cf9-4b2d-9bd9-a4e28f816701 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:47.781050 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-da75ba32-0b27-48a3-a3bd-9895047f74b3 req-ec62b2af-3cf9-4b2d-9bd9-a4e28f816701 service nova] Creating event network-changed:95874789-ba8d-4fde-af5a-a4ae2d7a894c for instance d9692f5b-742e-4f42-ac47-05a1e536ac05 on n-h2-862964-3 Oct 29 01:16:47.786247 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-da75ba32-0b27-48a3-a3bd-9895047f74b3 req-ec62b2af-3cf9-4b2d-9bd9-a4e28f816701 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035040 Oct 29 01:16:47.787346 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1656/3151] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:47.794051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-00ec9497-f467-47c8-83f5-beff49768f6c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:47.795207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-00ec9497-f467-47c8-83f5-beff49768f6c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:47.807666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00ec9497-f467-47c8-83f5-beff49768f6c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:47.808173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00ec9497-f467-47c8-83f5-beff49768f6c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:47.809131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00ec9497-f467-47c8-83f5-beff49768f6c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:47.809584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00ec9497-f467-47c8-83f5-beff49768f6c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:47.810082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00ec9497-f467-47c8-83f5-beff49768f6c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:47.810515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00ec9497-f467-47c8-83f5-beff49768f6c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:48.098450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-00ec9497-f467-47c8-83f5-beff49768f6c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:48.103860 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-00ec9497-f467-47c8-83f5-beff49768f6c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 200 len: 1308 microversion: 2.1 time: 0.315188 Oct 29 01:16:48.105641 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1657/3152] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:47 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:48.110599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-98c0234a-530d-4119-b336-acf4cc6dcd5a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:48.111574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-98c0234a-530d-4119-b336-acf4cc6dcd5a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:48.118111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98c0234a-530d-4119-b336-acf4cc6dcd5a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:48.118890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98c0234a-530d-4119-b336-acf4cc6dcd5a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:48.119567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98c0234a-530d-4119-b336-acf4cc6dcd5a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:48.120491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98c0234a-530d-4119-b336-acf4cc6dcd5a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:48.121771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98c0234a-530d-4119-b336-acf4cc6dcd5a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:48.122419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98c0234a-530d-4119-b336-acf4cc6dcd5a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:48.140253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:48.269744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-8feabc97-b472-40eb-87ff-2a7cf92c183e tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Building network info cache for instance {{(pid=121100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 01:16:48.527545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-98c0234a-530d-4119-b336-acf4cc6dcd5a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:48.536321 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-98c0234a-530d-4119-b336-acf4cc6dcd5a tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1470 microversion: 2.1 time: 0.429281 Oct 29 01:16:48.545044 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1658/3153] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:48 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1470 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:48.559439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:48.560728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-85e2774e-31e1-4940-a1bf-642eba227d8d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:48.561517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-85e2774e-31e1-4940-a1bf-642eba227d8d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:48.572243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85e2774e-31e1-4940-a1bf-642eba227d8d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:48.572741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85e2774e-31e1-4940-a1bf-642eba227d8d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:48.573188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85e2774e-31e1-4940-a1bf-642eba227d8d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:48.580803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85e2774e-31e1-4940-a1bf-642eba227d8d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:48.581509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85e2774e-31e1-4940-a1bf-642eba227d8d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:48.587721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85e2774e-31e1-4940-a1bf-642eba227d8d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:49.123978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=16 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:49.576652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-85e2774e-31e1-4940-a1bf-642eba227d8d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:49.584340 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-85e2774e-31e1-4940-a1bf-642eba227d8d tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1324 microversion: 2.1 time: 1.028053 Oct 29 01:16:49.588218 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1659/3154] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:48 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1324 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:49.602137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81500063-29b3-4ecb-9cb7-bdfe5e342c43 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:49.602793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-81500063-29b3-4ecb-9cb7-bdfe5e342c43 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:49.623422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81500063-29b3-4ecb-9cb7-bdfe5e342c43 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:49.623888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81500063-29b3-4ecb-9cb7-bdfe5e342c43 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:49.624582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81500063-29b3-4ecb-9cb7-bdfe5e342c43 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:49.625429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81500063-29b3-4ecb-9cb7-bdfe5e342c43 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:49.625853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81500063-29b3-4ecb-9cb7-bdfe5e342c43 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:49.626395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81500063-29b3-4ecb-9cb7-bdfe5e342c43 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:49.748660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-81500063-29b3-4ecb-9cb7-bdfe5e342c43 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:49.776414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-81500063-29b3-4ecb-9cb7-bdfe5e342c43 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:49.779709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-81500063-29b3-4ecb-9cb7-bdfe5e342c43 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:49.785893 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-81500063-29b3-4ecb-9cb7-bdfe5e342c43 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1366 microversion: 2.47 time: 0.193652 Oct 29 01:16:49.804148 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1660/3155] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:49 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:49.814610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b8452a3a-2c77-491e-b0cb-28802a7a0272 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:49.814610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b8452a3a-2c77-491e-b0cb-28802a7a0272 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:49.827749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8452a3a-2c77-491e-b0cb-28802a7a0272 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:49.828308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8452a3a-2c77-491e-b0cb-28802a7a0272 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:49.828753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8452a3a-2c77-491e-b0cb-28802a7a0272 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:49.829534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8452a3a-2c77-491e-b0cb-28802a7a0272 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:49.830008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8452a3a-2c77-491e-b0cb-28802a7a0272 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:49.832457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8452a3a-2c77-491e-b0cb-28802a7a0272 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:50.495419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b8452a3a-2c77-491e-b0cb-28802a7a0272 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:50.504234 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b8452a3a-2c77-491e-b0cb-28802a7a0272 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 200 len: 1308 microversion: 2.1 time: 0.698843 Oct 29 01:16:50.504915 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1661/3156] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:49 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 1308 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:50.509958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-97db64cb-fab5-49cf-8f76-dfe2d64ae8d8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:50.510763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-97db64cb-fab5-49cf-8f76-dfe2d64ae8d8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:50.518795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97db64cb-fab5-49cf-8f76-dfe2d64ae8d8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:50.519525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97db64cb-fab5-49cf-8f76-dfe2d64ae8d8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:50.520167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97db64cb-fab5-49cf-8f76-dfe2d64ae8d8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:50.521086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97db64cb-fab5-49cf-8f76-dfe2d64ae8d8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:50.521993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97db64cb-fab5-49cf-8f76-dfe2d64ae8d8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:50.522749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97db64cb-fab5-49cf-8f76-dfe2d64ae8d8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:50.718734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-8feabc97-b472-40eb-87ff-2a7cf92c183e tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Updating instance_info_cache with network_info: [{"id": "e555ad33-2662-4f2a-8f28-923c3ff8a45e", "address": "fa:16:3e:0a:7b:64", "network": {"id": "eb1e4b43-f38b-43e7-af11-a5ae719fd6c0", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2017352599-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1de00f139aa846cbb6147e9c1ce282b8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape555ad33-26", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 01:16:50.801273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8feabc97-b472-40eb-87ff-2a7cf92c183e tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Releasing lock "refresh_cache-919adddc-a598-47f8-9823-170d101dbdc8" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 01:16:50.802782 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8feabc97-b472-40eb-87ff-2a7cf92c183e tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "POST /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8/action" status: 202 len: 0 microversion: 2.1 time: 4.905466 Oct 29 01:16:50.806756 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1496/3157] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:16:45 2022] POST /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8/action => generated 0 bytes in 4907 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 29 01:16:50.809869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-da4e9e3e-582f-4352-b660-543905b1ab7b req-da912810-b2ca-4665-8730-2b6ddeb52a9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "919adddc-a598-47f8-9823-170d101dbdc8", "tag": "e555ad33-2662-4f2a-8f28-923c3ff8a45e"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:50.821473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-da4e9e3e-582f-4352-b660-543905b1ab7b req-da912810-b2ca-4665-8730-2b6ddeb52a9c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:50.822242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-da4e9e3e-582f-4352-b660-543905b1ab7b req-da912810-b2ca-4665-8730-2b6ddeb52a9c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:50.822682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-da4e9e3e-582f-4352-b660-543905b1ab7b req-da912810-b2ca-4665-8730-2b6ddeb52a9c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:50.837478 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-da4e9e3e-582f-4352-b660-543905b1ab7b req-da912810-b2ca-4665-8730-2b6ddeb52a9c service nova] Creating event network-changed:e555ad33-2662-4f2a-8f28-923c3ff8a45e for instance 919adddc-a598-47f8-9823-170d101dbdc8 on n-h2-862964-3 Oct 29 01:16:50.845185 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-da4e9e3e-582f-4352-b660-543905b1ab7b req-da912810-b2ca-4665-8730-2b6ddeb52a9c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039957 Oct 29 01:16:50.846888 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1497/3158] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:50.852960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1ccff6f4-8fc4-4450-beb2-1126d60372db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:50.853692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1ccff6f4-8fc4-4450-beb2-1126d60372db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:50.861471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ccff6f4-8fc4-4450-beb2-1126d60372db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:50.862404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ccff6f4-8fc4-4450-beb2-1126d60372db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:50.863029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ccff6f4-8fc4-4450-beb2-1126d60372db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:50.863963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ccff6f4-8fc4-4450-beb2-1126d60372db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:50.864629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ccff6f4-8fc4-4450-beb2-1126d60372db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:50.865246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ccff6f4-8fc4-4450-beb2-1126d60372db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:51.026419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-97db64cb-fab5-49cf-8f76-dfe2d64ae8d8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:51.041633 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-97db64cb-fab5-49cf-8f76-dfe2d64ae8d8 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1470 microversion: 2.1 time: 0.535233 Oct 29 01:16:51.042279 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1662/3159] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:50 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1470 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:51.048614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2d7f06b6-0bcc-4f96-8b57-5167cc638807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Action: 'action', calling method: .version_select at 0x7f9d9d8c1c10>, body: {"removeFloatingIp": {"address": "172.25.8.145"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:51.362645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1ccff6f4-8fc4-4450-beb2-1126d60372db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:51.373035 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1ccff6f4-8fc4-4450-beb2-1126d60372db tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1324 microversion: 2.1 time: 0.524510 Oct 29 01:16:51.390996 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1498/3160] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:50 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1324 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:51.397775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-06c4fc62-b65a-4cc8-ab6d-d02db085df76 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:51.400024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-06c4fc62-b65a-4cc8-ab6d-d02db085df76 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:51.409226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06c4fc62-b65a-4cc8-ab6d-d02db085df76 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:51.410387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06c4fc62-b65a-4cc8-ab6d-d02db085df76 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:51.411472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06c4fc62-b65a-4cc8-ab6d-d02db085df76 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:51.412435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06c4fc62-b65a-4cc8-ab6d-d02db085df76 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:51.413319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06c4fc62-b65a-4cc8-ab6d-d02db085df76 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:51.414035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06c4fc62-b65a-4cc8-ab6d-d02db085df76 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:51.418610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2d7f06b6-0bcc-4f96-8b57-5167cc638807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:51.426197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d7f06b6-0bcc-4f96-8b57-5167cc638807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:51.426689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d7f06b6-0bcc-4f96-8b57-5167cc638807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:51.427199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d7f06b6-0bcc-4f96-8b57-5167cc638807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:51.427899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d7f06b6-0bcc-4f96-8b57-5167cc638807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:51.428319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d7f06b6-0bcc-4f96-8b57-5167cc638807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:51.428749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d7f06b6-0bcc-4f96-8b57-5167cc638807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:51.601095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-06c4fc62-b65a-4cc8-ab6d-d02db085df76 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:51.614440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-06c4fc62-b65a-4cc8-ab6d-d02db085df76 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:51.615924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-06c4fc62-b65a-4cc8-ab6d-d02db085df76 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:51.617088 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-06c4fc62-b65a-4cc8-ab6d-d02db085df76 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1366 microversion: 2.47 time: 0.224249 Oct 29 01:16:51.623274 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1499/3161] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:51 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:51.624785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-626d21fe-1a5e-4e91-bae6-207342a55876 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:51.625624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-626d21fe-1a5e-4e91-bae6-207342a55876 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:51.636792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-626d21fe-1a5e-4e91-bae6-207342a55876 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:51.637529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-626d21fe-1a5e-4e91-bae6-207342a55876 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:51.638113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-626d21fe-1a5e-4e91-bae6-207342a55876 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:51.639080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-626d21fe-1a5e-4e91-bae6-207342a55876 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:51.639692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-626d21fe-1a5e-4e91-bae6-207342a55876 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:51.640274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-626d21fe-1a5e-4e91-bae6-207342a55876 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:52.403359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d7f06b6-0bcc-4f96-8b57-5167cc638807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "refresh_cache-919adddc-a598-47f8-9823-170d101dbdc8" {{(pid=121099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 01:16:52.404494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d7f06b6-0bcc-4f96-8b57-5167cc638807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquired lock "refresh_cache-919adddc-a598-47f8-9823-170d101dbdc8" {{(pid=121099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 01:16:52.428914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-626d21fe-1a5e-4e91-bae6-207342a55876 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:52.432875 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-626d21fe-1a5e-4e91-bae6-207342a55876 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 200 len: 1308 microversion: 2.1 time: 0.814157 Oct 29 01:16:52.435680 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1500/3162] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:51 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 1308 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:52.440313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e107814a-ee11-49b8-b4d3-42a44e6311db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:52.440953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e107814a-ee11-49b8-b4d3-42a44e6311db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:52.467222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e107814a-ee11-49b8-b4d3-42a44e6311db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:52.467716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e107814a-ee11-49b8-b4d3-42a44e6311db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:52.468361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e107814a-ee11-49b8-b4d3-42a44e6311db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:52.469083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e107814a-ee11-49b8-b4d3-42a44e6311db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:52.469581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e107814a-ee11-49b8-b4d3-42a44e6311db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:52.470009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e107814a-ee11-49b8-b4d3-42a44e6311db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:52.569972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e107814a-ee11-49b8-b4d3-42a44e6311db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60969ed444b545b9a5b02e27eb7eaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bdf61e2cbca4cdc95494b38c827ce63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:52.585435 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e107814a-ee11-49b8-b4d3-42a44e6311db tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 200 len: 1428 microversion: 2.1 time: 0.144725 Oct 29 01:16:52.586081 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1501/3163] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:52 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 1428 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:52.596793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7bcf73b1-ce8a-43ff-b018-f069d9c2b9fb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:52.599933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7bcf73b1-ce8a-43ff-b018-f069d9c2b9fb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:52.618042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7bcf73b1-ce8a-43ff-b018-f069d9c2b9fb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:52.618541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7bcf73b1-ce8a-43ff-b018-f069d9c2b9fb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:52.619185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7bcf73b1-ce8a-43ff-b018-f069d9c2b9fb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:52.620095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7bcf73b1-ce8a-43ff-b018-f069d9c2b9fb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:52.621384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7bcf73b1-ce8a-43ff-b018-f069d9c2b9fb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:52.622284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7bcf73b1-ce8a-43ff-b018-f069d9c2b9fb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:52.927466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7bcf73b1-ce8a-43ff-b018-f069d9c2b9fb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:52.942956 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7bcf73b1-ce8a-43ff-b018-f069d9c2b9fb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1324 microversion: 2.1 time: 0.355520 Oct 29 01:16:52.945899 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1502/3164] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:52 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1324 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:52.973889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3d03aa2f-4236-4f63-b44b-cc1fc98e9c8a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:52.975533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3d03aa2f-4236-4f63-b44b-cc1fc98e9c8a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:52.984322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d03aa2f-4236-4f63-b44b-cc1fc98e9c8a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:52.985002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d03aa2f-4236-4f63-b44b-cc1fc98e9c8a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:52.985471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d03aa2f-4236-4f63-b44b-cc1fc98e9c8a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:52.986296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d03aa2f-4236-4f63-b44b-cc1fc98e9c8a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:52.986982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d03aa2f-4236-4f63-b44b-cc1fc98e9c8a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:52.987508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d03aa2f-4236-4f63-b44b-cc1fc98e9c8a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:53.125082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3d03aa2f-4236-4f63-b44b-cc1fc98e9c8a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:53.137890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3d03aa2f-4236-4f63-b44b-cc1fc98e9c8a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:53.140597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3d03aa2f-4236-4f63-b44b-cc1fc98e9c8a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:53.142918 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3d03aa2f-4236-4f63-b44b-cc1fc98e9c8a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1366 microversion: 2.47 time: 0.195914 Oct 29 01:16:53.144306 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1503/3165] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:52 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:53.154945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-26ccb214-8d4b-47e7-80ac-95166c8aca31 req-c58d84e2-3f95-4452-8191-9e5d57212420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88cce5a-4c01-4354-895a-54148d701f7c", "name": "network-vif-deleted", "tag": "3cdeecea-ff58-4590-b370-37477a47edc3"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:53.165775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-26ccb214-8d4b-47e7-80ac-95166c8aca31 req-c58d84e2-3f95-4452-8191-9e5d57212420 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:53.166676 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-26ccb214-8d4b-47e7-80ac-95166c8aca31 req-c58d84e2-3f95-4452-8191-9e5d57212420 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:53.167518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-26ccb214-8d4b-47e7-80ac-95166c8aca31 req-c58d84e2-3f95-4452-8191-9e5d57212420 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:53.187728 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-26ccb214-8d4b-47e7-80ac-95166c8aca31 req-c58d84e2-3f95-4452-8191-9e5d57212420 service nova] Creating event network-vif-deleted:3cdeecea-ff58-4590-b370-37477a47edc3 for instance b88cce5a-4c01-4354-895a-54148d701f7c on n-h1-862964-3 Oct 29 01:16:53.196687 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-26ccb214-8d4b-47e7-80ac-95166c8aca31 req-c58d84e2-3f95-4452-8191-9e5d57212420 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050852 Oct 29 01:16:53.198232 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1504/3166] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:53.387588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-151545c1-fe31-46d6-82b9-a6eee26caa12 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-748587885", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "ad3d59cb-136e-48fa-944a-86d54ec0261d"}, {"uuid": "2fb57df4-e26d-41e8-a3c2-c2c310665da4"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:53.479563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-151545c1-fe31-46d6-82b9-a6eee26caa12 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] validate_networks() for [('ad3d59cb-136e-48fa-944a-86d54ec0261d', None, None, None, None, None), ('2fb57df4-e26d-41e8-a3c2-c2c310665da4', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:16:53.874084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-2d7f06b6-0bcc-4f96-8b57-5167cc638807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Building network info cache for instance {{(pid=121099) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 01:16:54.731149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-151545c1-fe31-46d6-82b9-a6eee26caa12 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:16:54.732210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-151545c1-fe31-46d6-82b9-a6eee26caa12 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:16:54.732890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-151545c1-fe31-46d6-82b9-a6eee26caa12 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:16:54.733346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-151545c1-fe31-46d6-82b9-a6eee26caa12 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:16:54.733917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-151545c1-fe31-46d6-82b9-a6eee26caa12 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:16:54.749750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-151545c1-fe31-46d6-82b9-a6eee26caa12 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:54.750513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-151545c1-fe31-46d6-82b9-a6eee26caa12 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:54.754831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-151545c1-fe31-46d6-82b9-a6eee26caa12 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:54.754831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-151545c1-fe31-46d6-82b9-a6eee26caa12 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:54.754831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-151545c1-fe31-46d6-82b9-a6eee26caa12 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:54.754831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-151545c1-fe31-46d6-82b9-a6eee26caa12 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:54.773113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-151545c1-fe31-46d6-82b9-a6eee26caa12 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Getting quotas for project 677550341e2d495eb0ff2e343c286caa. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:16:54.782715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-151545c1-fe31-46d6-82b9-a6eee26caa12 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Getting quotas for user 2eb4c4f2d60f4affbf6162bd6481f3a3 and project 677550341e2d495eb0ff2e343c286caa. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:16:54.796400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-151545c1-fe31-46d6-82b9-a6eee26caa12 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:16:54.799679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-151545c1-fe31-46d6-82b9-a6eee26caa12 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:16:54.867743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-2d7f06b6-0bcc-4f96-8b57-5167cc638807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Updating instance_info_cache with network_info: [{"id": "e555ad33-2662-4f2a-8f28-923c3ff8a45e", "address": "fa:16:3e:0a:7b:64", "network": {"id": "eb1e4b43-f38b-43e7-af11-a5ae719fd6c0", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2017352599-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1de00f139aa846cbb6147e9c1ce282b8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape555ad33-26", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121099) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 01:16:55.015060 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-151545c1-fe31-46d6-82b9-a6eee26caa12 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.631114 Oct 29 01:16:55.015967 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1505/3167] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:16:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:16:55.029517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d7f06b6-0bcc-4f96-8b57-5167cc638807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Releasing lock "refresh_cache-919adddc-a598-47f8-9823-170d101dbdc8" {{(pid=121099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 01:16:55.030994 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2d7f06b6-0bcc-4f96-8b57-5167cc638807 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "POST /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8/action" status: 202 len: 0 microversion: 2.1 time: 3.985923 Oct 29 01:16:55.031748 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1663/3168] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:16:51 2022] POST /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8/action => generated 0 bytes in 3989 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 01:16:55.037856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a601072c-151d-419a-9dce-89f1ff838bdb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:55.039635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a601072c-151d-419a-9dce-89f1ff838bdb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:55.047799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-98398a0d-dbd0-442c-b094-f1fb7eacc8e5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:55.049848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-98398a0d-dbd0-442c-b094-f1fb7eacc8e5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] [instance: b88cce5a-4c01-4354-895a-54148d701f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:55.052239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a601072c-151d-419a-9dce-89f1ff838bdb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:55.052943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a601072c-151d-419a-9dce-89f1ff838bdb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:55.053545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a601072c-151d-419a-9dce-89f1ff838bdb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:55.054390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a601072c-151d-419a-9dce-89f1ff838bdb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:55.054964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a601072c-151d-419a-9dce-89f1ff838bdb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:55.055506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a601072c-151d-419a-9dce-89f1ff838bdb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:55.073946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98398a0d-dbd0-442c-b094-f1fb7eacc8e5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:55.075033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98398a0d-dbd0-442c-b094-f1fb7eacc8e5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:55.076535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98398a0d-dbd0-442c-b094-f1fb7eacc8e5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:55.077139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98398a0d-dbd0-442c-b094-f1fb7eacc8e5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:55.078208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98398a0d-dbd0-442c-b094-f1fb7eacc8e5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:55.079205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98398a0d-dbd0-442c-b094-f1fb7eacc8e5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:55.100198 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-98398a0d-dbd0-442c-b094-f1fb7eacc8e5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] HTTP exception thrown: Instance b88cce5a-4c01-4354-895a-54148d701f7c could not be found. Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-98398a0d-dbd0-442c-b094-f1fb7eacc8e5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Request method failure captured: Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c HTTP/1.1 Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH5gyXkSGUYok4VorbYUzbXvqeTdDDq_qf15RaIJS-1BomiYu21QMIPLZg9iLhQtxY8H65wQ4oCKhP4PSRY_obIBI7mA3VkHOi2BeAGp77T-n3IQKktJeMf_18Yvwuifb4DNAxQo1aAx9xRYT_0he7ixf1DsbiSnaI-9qk4otUSsVyo Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 5bdf61e2cbca4cdc95494b38c827ce63 Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersAdminTestJSON-736361139 Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bdf61e2cbca4cdc95494b38c827ce63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5bdf61e2cbca4cdc95494b38c827ce63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bdf61e2cbca4cdc95494b38c827ce63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5bdf61e2cbca4cdc95494b38c827ce63", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersAdminTestJSON-736361139 Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 5bdf61e2cbca4cdc95494b38c827ce63 Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersAdminTestJSON-736361139 Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersAdminTestJSON-736361139-project Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 60969ed444b545b9a5b02e27eb7eaea3 Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersAdminTestJSON-736361139-project Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance b88cce5a-4c01-4354-895a-54148d701f7c could not be found. Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'b88cce5a-4c01-4354-895a-54148d701f7c'} Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b88cce5a-4c01-4354-895a-54148d701f7c could not be found. Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b88cce5a-4c01-4354-895a-54148d701f7c could not be found. Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:16:55.102735 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:55.109061 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:16:55.109061 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:16:55.109061 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:16:55.109061 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:16:55.109061 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:16:55.109061 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b88cce5a-4c01-4354-895a-54148d701f7c could not be found. Oct 29 01:16:55.109061 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:16:55.112468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-98398a0d-dbd0-442c-b094-f1fb7eacc8e5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] Returning 404 to user: Instance b88cce5a-4c01-4354-895a-54148d701f7c could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:16:55.113573 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-98398a0d-dbd0-442c-b094-f1fb7eacc8e5 tempest-ServersAdminTestJSON-736361139 tempest-ServersAdminTestJSON-736361139-project] 10.222.0.26 "GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c" status: 404 len: 111 microversion: 2.1 time: 0.080723 Oct 29 01:16:55.114629 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1664/3169] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:55 2022] GET /compute/v2.1/servers/b88cce5a-4c01-4354-895a-54148d701f7c => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:16:55.121386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f2d35bab-79bc-420a-862f-b640c19ff9cb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:55.122659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f2d35bab-79bc-420a-862f-b640c19ff9cb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:55.141428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2d35bab-79bc-420a-862f-b640c19ff9cb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:55.142782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2d35bab-79bc-420a-862f-b640c19ff9cb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:55.143280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2d35bab-79bc-420a-862f-b640c19ff9cb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:55.144053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2d35bab-79bc-420a-862f-b640c19ff9cb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:55.144517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2d35bab-79bc-420a-862f-b640c19ff9cb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:55.145351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2d35bab-79bc-420a-862f-b640c19ff9cb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:55.452833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a601072c-151d-419a-9dce-89f1ff838bdb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:55.468686 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a601072c-151d-419a-9dce-89f1ff838bdb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 200 len: 1308 microversion: 2.1 time: 0.442807 Oct 29 01:16:55.468686 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1506/3170] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:55 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 1308 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:55.473670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-21c41a41-f2b0-428f-ad8b-86d45919064e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:55.474288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-21c41a41-f2b0-428f-ad8b-86d45919064e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:55.478540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f2d35bab-79bc-420a-862f-b640c19ff9cb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:55.488337 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f2d35bab-79bc-420a-862f-b640c19ff9cb tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1324 microversion: 2.1 time: 0.372349 Oct 29 01:16:55.490071 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1665/3171] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:55 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1324 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:55.495613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-47922530-1390-4375-ae35-ba1f437f2d72 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:55.496899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-47922530-1390-4375-ae35-ba1f437f2d72 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:55.498842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21c41a41-f2b0-428f-ad8b-86d45919064e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:55.499472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21c41a41-f2b0-428f-ad8b-86d45919064e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:55.499930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21c41a41-f2b0-428f-ad8b-86d45919064e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:55.500731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21c41a41-f2b0-428f-ad8b-86d45919064e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:55.503177 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21c41a41-f2b0-428f-ad8b-86d45919064e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:55.504107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21c41a41-f2b0-428f-ad8b-86d45919064e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:55.573179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-47922530-1390-4375-ae35-ba1f437f2d72 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:55.584025 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-47922530-1390-4375-ae35-ba1f437f2d72 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1212 microversion: 2.1 time: 0.092875 Oct 29 01:16:55.595928 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1666/3172] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:55 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1212 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:55.595928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-adfb218f-9a93-4486-b3ea-d5400d48b982 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '.version_select at 0x7f9d9716a8b0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:55.694673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-21c41a41-f2b0-428f-ad8b-86d45919064e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:55.705052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-21c41a41-f2b0-428f-ad8b-86d45919064e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:55.706642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-21c41a41-f2b0-428f-ad8b-86d45919064e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:55.708098 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-21c41a41-f2b0-428f-ad8b-86d45919064e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1366 microversion: 2.47 time: 0.240144 Oct 29 01:16:55.709260 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1507/3173] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:55 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:55.717347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-c4b3f881-6e01-4063-873b-fb6c471dce0a req-eef1dc60-5289-42c4-8874-1ad3fd390d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "919adddc-a598-47f8-9823-170d101dbdc8", "tag": "e555ad33-2662-4f2a-8f28-923c3ff8a45e"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:55.727906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c4b3f881-6e01-4063-873b-fb6c471dce0a req-eef1dc60-5289-42c4-8874-1ad3fd390d3c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:55.728844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c4b3f881-6e01-4063-873b-fb6c471dce0a req-eef1dc60-5289-42c4-8874-1ad3fd390d3c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:55.729586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c4b3f881-6e01-4063-873b-fb6c471dce0a req-eef1dc60-5289-42c4-8874-1ad3fd390d3c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:55.743176 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-c4b3f881-6e01-4063-873b-fb6c471dce0a req-eef1dc60-5289-42c4-8874-1ad3fd390d3c service nova] Creating event network-changed:e555ad33-2662-4f2a-8f28-923c3ff8a45e for instance 919adddc-a598-47f8-9823-170d101dbdc8 on n-h2-862964-3 Oct 29 01:16:55.748961 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-c4b3f881-6e01-4063-873b-fb6c471dce0a req-eef1dc60-5289-42c4-8874-1ad3fd390d3c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038348 Oct 29 01:16:55.751387 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1508/3174] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:56.493115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6eacdd04-0394-4824-af4c-de617325140b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:56.495269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6eacdd04-0394-4824-af4c-de617325140b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:56.506528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6eacdd04-0394-4824-af4c-de617325140b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:56.509047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6eacdd04-0394-4824-af4c-de617325140b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:56.513421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6eacdd04-0394-4824-af4c-de617325140b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:56.518204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6eacdd04-0394-4824-af4c-de617325140b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:56.518204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6eacdd04-0394-4824-af4c-de617325140b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:56.518204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6eacdd04-0394-4824-af4c-de617325140b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:56.913586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6eacdd04-0394-4824-af4c-de617325140b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:56.925283 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6eacdd04-0394-4824-af4c-de617325140b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 200 len: 1308 microversion: 2.1 time: 0.437521 Oct 29 01:16:56.925884 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1509/3175] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:56 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 1308 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:56.938818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d395ebca-1499-412d-b447-c5be0b22515b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:56.939450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d395ebca-1499-412d-b447-c5be0b22515b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:56.946080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d395ebca-1499-412d-b447-c5be0b22515b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:56.946575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d395ebca-1499-412d-b447-c5be0b22515b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:56.947245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d395ebca-1499-412d-b447-c5be0b22515b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:56.948149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d395ebca-1499-412d-b447-c5be0b22515b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:56.949461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d395ebca-1499-412d-b447-c5be0b22515b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:56.950066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d395ebca-1499-412d-b447-c5be0b22515b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:57.232847 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-adfb218f-9a93-4486-b3ea-d5400d48b982 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/50685f0a-1028-46b4-8fa5-016308a074ed" status: 202 len: 0 microversion: 2.1 time: 1.641688 Oct 29 01:16:57.233995 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1667/3176] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:16:55 2022] DELETE /compute/v2.1/os-floating-ips/50685f0a-1028-46b4-8fa5-016308a074ed => generated 0 bytes in 1644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:16:57.241301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d395ebca-1499-412d-b447-c5be0b22515b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:57.243483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2cf9cf99-8390-4e56-9d05-1ec49855fa10 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:57.248177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2cf9cf99-8390-4e56-9d05-1ec49855fa10 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:57.262142 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d395ebca-1499-412d-b447-c5be0b22515b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1324 microversion: 2.1 time: 0.333255 Oct 29 01:16:57.265639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cf9cf99-8390-4e56-9d05-1ec49855fa10 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:57.265639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cf9cf99-8390-4e56-9d05-1ec49855fa10 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:57.265639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cf9cf99-8390-4e56-9d05-1ec49855fa10 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:57.265919 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1510/3177] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:56 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1324 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:57.266000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cf9cf99-8390-4e56-9d05-1ec49855fa10 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:57.266000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cf9cf99-8390-4e56-9d05-1ec49855fa10 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:57.266000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cf9cf99-8390-4e56-9d05-1ec49855fa10 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:57.270912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3325d641-c91b-40fe-bd14-24615db89f3c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:57.271747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3325d641-c91b-40fe-bd14-24615db89f3c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:57.278263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3325d641-c91b-40fe-bd14-24615db89f3c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:57.279024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3325d641-c91b-40fe-bd14-24615db89f3c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:57.279660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3325d641-c91b-40fe-bd14-24615db89f3c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:57.280565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3325d641-c91b-40fe-bd14-24615db89f3c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:57.281462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3325d641-c91b-40fe-bd14-24615db89f3c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:57.282081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3325d641-c91b-40fe-bd14-24615db89f3c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:57.418773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2cf9cf99-8390-4e56-9d05-1ec49855fa10 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:57.420226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3325d641-c91b-40fe-bd14-24615db89f3c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:57.432112 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2cf9cf99-8390-4e56-9d05-1ec49855fa10 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1264 microversion: 2.1 time: 0.196751 Oct 29 01:16:57.433878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3325d641-c91b-40fe-bd14-24615db89f3c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:57.434262 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1668/3178] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:57 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1264 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:57.440570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3325d641-c91b-40fe-bd14-24615db89f3c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:57.440570 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3325d641-c91b-40fe-bd14-24615db89f3c tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1372 microversion: 2.47 time: 0.171885 Oct 29 01:16:57.440570 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1511/3179] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:57 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:57.450006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-75d0a160-0e0c-4017-86e1-c360500a5990 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '.version_select at 0x7f9d9fd85670>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:57.453046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-51f824e4-1027-4f7c-b390-d57ee9d60ff8 req-ba2f1879-31c4-4e0f-8264-a7176f99c225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6135c50e-cec0-4078-b9ef-bfabb3d7a52e", "name": "network-vif-plugged", "status": "completed", "tag": "144eca99-84d8-4c80-bfbe-18327d225155"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:57.503728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-51f824e4-1027-4f7c-b390-d57ee9d60ff8 req-ba2f1879-31c4-4e0f-8264-a7176f99c225 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:57.506917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-51f824e4-1027-4f7c-b390-d57ee9d60ff8 req-ba2f1879-31c4-4e0f-8264-a7176f99c225 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:57.507834 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-51f824e4-1027-4f7c-b390-d57ee9d60ff8 req-ba2f1879-31c4-4e0f-8264-a7176f99c225 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:57.552814 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-51f824e4-1027-4f7c-b390-d57ee9d60ff8 req-ba2f1879-31c4-4e0f-8264-a7176f99c225 service nova] Creating event network-vif-plugged:144eca99-84d8-4c80-bfbe-18327d225155 for instance 6135c50e-cec0-4078-b9ef-bfabb3d7a52e on n-h1-862964-3 Oct 29 01:16:57.566367 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-51f824e4-1027-4f7c-b390-d57ee9d60ff8 req-ba2f1879-31c4-4e0f-8264-a7176f99c225 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129062 Oct 29 01:16:57.568894 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1669/3180] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:16:57.869196 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-75d0a160-0e0c-4017-86e1-c360500a5990 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/c3280745-8285-41c3-aabf-4e734790acba" status: 202 len: 0 microversion: 2.1 time: 0.430104 Oct 29 01:16:57.870086 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1512/3181] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:16:57 2022] DELETE /compute/v2.1/os-security-groups/c3280745-8285-41c3-aabf-4e734790acba => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:16:57.879096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-46753aed-7921-41bf-a822-9b702ad2526f tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:57.880161 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-46753aed-7921-41bf-a822-9b702ad2526f tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:57.891676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46753aed-7921-41bf-a822-9b702ad2526f tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:57.892750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46753aed-7921-41bf-a822-9b702ad2526f tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:57.893401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46753aed-7921-41bf-a822-9b702ad2526f tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:57.894217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46753aed-7921-41bf-a822-9b702ad2526f tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:57.894817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46753aed-7921-41bf-a822-9b702ad2526f tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:57.895304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46753aed-7921-41bf-a822-9b702ad2526f tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:57.927192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-46753aed-7921-41bf-a822-9b702ad2526f tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:16:57.954868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-21c00567-5fcc-4175-85db-6eecb2c778f3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:57.955932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-21c00567-5fcc-4175-85db-6eecb2c778f3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:57.963279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21c00567-5fcc-4175-85db-6eecb2c778f3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:57.965028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21c00567-5fcc-4175-85db-6eecb2c778f3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:57.965874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21c00567-5fcc-4175-85db-6eecb2c778f3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:57.970765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21c00567-5fcc-4175-85db-6eecb2c778f3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:57.970765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21c00567-5fcc-4175-85db-6eecb2c778f3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:57.970765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21c00567-5fcc-4175-85db-6eecb2c778f3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:58.154780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-21c00567-5fcc-4175-85db-6eecb2c778f3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:58.164319 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-21c00567-5fcc-4175-85db-6eecb2c778f3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 200 len: 1308 microversion: 2.1 time: 0.215250 Oct 29 01:16:58.164925 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1513/3182] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:57 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 1308 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:16:58.280176 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-46753aed-7921-41bf-a822-9b702ad2526f tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "DELETE /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 204 len: 0 microversion: 2.1 time: 0.401554 Oct 29 01:16:58.286350 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1670/3183] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:16:57 2022] DELETE /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:16:58.288983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c450d566-dca8-4c01-9f41-3e7b78c97690 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:58.289648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c450d566-dca8-4c01-9f41-3e7b78c97690 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:58.301112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c450d566-dca8-4c01-9f41-3e7b78c97690 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:58.302543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c450d566-dca8-4c01-9f41-3e7b78c97690 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:58.302898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd56cf5c-e5ff-4868-bfaf-3339d7bc20a2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:58.303029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c450d566-dca8-4c01-9f41-3e7b78c97690 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:58.306288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bd56cf5c-e5ff-4868-bfaf-3339d7bc20a2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:58.306443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c450d566-dca8-4c01-9f41-3e7b78c97690 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:58.306443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c450d566-dca8-4c01-9f41-3e7b78c97690 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:58.307117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c450d566-dca8-4c01-9f41-3e7b78c97690 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:58.315820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd56cf5c-e5ff-4868-bfaf-3339d7bc20a2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:58.317128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd56cf5c-e5ff-4868-bfaf-3339d7bc20a2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:58.318685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd56cf5c-e5ff-4868-bfaf-3339d7bc20a2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:58.319708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd56cf5c-e5ff-4868-bfaf-3339d7bc20a2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:58.320879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd56cf5c-e5ff-4868-bfaf-3339d7bc20a2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:58.321712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd56cf5c-e5ff-4868-bfaf-3339d7bc20a2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:58.662745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bd56cf5c-e5ff-4868-bfaf-3339d7bc20a2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:58.672742 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bd56cf5c-e5ff-4868-bfaf-3339d7bc20a2 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1509 microversion: 2.1 time: 0.384097 Oct 29 01:16:58.693412 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1671/3184] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:58 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1509 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:58.700033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f3572681-3409-42b3-babe-d0cf44e7203b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:58.700893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f3572681-3409-42b3-babe-d0cf44e7203b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:58.708009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3572681-3409-42b3-babe-d0cf44e7203b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:58.711302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3572681-3409-42b3-babe-d0cf44e7203b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:58.711302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3572681-3409-42b3-babe-d0cf44e7203b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:58.711302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3572681-3409-42b3-babe-d0cf44e7203b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:58.711302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3572681-3409-42b3-babe-d0cf44e7203b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:58.712481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3572681-3409-42b3-babe-d0cf44e7203b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:58.770580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c450d566-dca8-4c01-9f41-3e7b78c97690 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:58.782008 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c450d566-dca8-4c01-9f41-3e7b78c97690 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1324 microversion: 2.1 time: 0.497838 Oct 29 01:16:58.787595 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1514/3185] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:58 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1324 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:58.795022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ac0e44a6-bd23-4574-8b96-484ef1594b9a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:58.796479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ac0e44a6-bd23-4574-8b96-484ef1594b9a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:58.803346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac0e44a6-bd23-4574-8b96-484ef1594b9a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:58.804027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac0e44a6-bd23-4574-8b96-484ef1594b9a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:58.804653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac0e44a6-bd23-4574-8b96-484ef1594b9a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:58.805447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac0e44a6-bd23-4574-8b96-484ef1594b9a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:58.805914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac0e44a6-bd23-4574-8b96-484ef1594b9a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:58.806347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac0e44a6-bd23-4574-8b96-484ef1594b9a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:58.812358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:16:58.834284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f3572681-3409-42b3-babe-d0cf44e7203b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:58.845213 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f3572681-3409-42b3-babe-d0cf44e7203b tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1264 microversion: 2.1 time: 0.148613 Oct 29 01:16:58.855978 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1672/3186] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:58 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:58.887753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ac0e44a6-bd23-4574-8b96-484ef1594b9a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:58.896506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ac0e44a6-bd23-4574-8b96-484ef1594b9a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:58.902500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ac0e44a6-bd23-4574-8b96-484ef1594b9a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:58.902500 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ac0e44a6-bd23-4574-8b96-484ef1594b9a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1372 microversion: 2.47 time: 0.110379 Oct 29 01:16:58.902500 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1515/3187] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:16:58 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:16:59.188640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2d2026d9-ae85-419b-93c5-8a1b22b16dde tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:59.189335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2d2026d9-ae85-419b-93c5-8a1b22b16dde tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:59.200644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d2026d9-ae85-419b-93c5-8a1b22b16dde tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:59.200644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d2026d9-ae85-419b-93c5-8a1b22b16dde tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:59.200644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d2026d9-ae85-419b-93c5-8a1b22b16dde tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:59.200644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d2026d9-ae85-419b-93c5-8a1b22b16dde tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:59.200644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d2026d9-ae85-419b-93c5-8a1b22b16dde tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:59.200644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d2026d9-ae85-419b-93c5-8a1b22b16dde tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:59.404909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2d2026d9-ae85-419b-93c5-8a1b22b16dde tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:16:59.414595 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2d2026d9-ae85-419b-93c5-8a1b22b16dde tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 200 len: 1308 microversion: 2.1 time: 0.229959 Oct 29 01:16:59.425925 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1673/3188] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:59 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 1308 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:16:59.701886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-60c3f716-6f6d-44ca-b43a-d122e1989d76 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:59.702502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-60c3f716-6f6d-44ca-b43a-d122e1989d76 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:59.709999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60c3f716-6f6d-44ca-b43a-d122e1989d76 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:59.710827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60c3f716-6f6d-44ca-b43a-d122e1989d76 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:59.711488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60c3f716-6f6d-44ca-b43a-d122e1989d76 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:59.713386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60c3f716-6f6d-44ca-b43a-d122e1989d76 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:59.714082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60c3f716-6f6d-44ca-b43a-d122e1989d76 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:59.715342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60c3f716-6f6d-44ca-b43a-d122e1989d76 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:59.739731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-fcb7082d-bf34-469d-be69-73b8605aa351 req-438b170e-a1df-45c8-9414-e3c0f3cb2506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9692f5b-742e-4f42-ac47-05a1e536ac05", "name": "network-vif-plugged", "status": "completed", "tag": "95874789-ba8d-4fde-af5a-a4ae2d7a894c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:16:59.757983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-fcb7082d-bf34-469d-be69-73b8605aa351 req-438b170e-a1df-45c8-9414-e3c0f3cb2506 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:59.759362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-fcb7082d-bf34-469d-be69-73b8605aa351 req-438b170e-a1df-45c8-9414-e3c0f3cb2506 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:59.761970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-fcb7082d-bf34-469d-be69-73b8605aa351 req-438b170e-a1df-45c8-9414-e3c0f3cb2506 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:59.792864 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-fcb7082d-bf34-469d-be69-73b8605aa351 req-438b170e-a1df-45c8-9414-e3c0f3cb2506 service nova] Creating event network-vif-plugged:95874789-ba8d-4fde-af5a-a4ae2d7a894c for instance d9692f5b-742e-4f42-ac47-05a1e536ac05 on n-h2-862964-3 Oct 29 01:16:59.810834 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-fcb7082d-bf34-469d-be69-73b8605aa351 req-438b170e-a1df-45c8-9414-e3c0f3cb2506 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074707 Oct 29 01:16:59.813895 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1674/3189] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:16:59.830646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-20f7c683-93fb-43c5-966d-50221e35c1b6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:16:59.832263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-20f7c683-93fb-43c5-966d-50221e35c1b6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:16:59.851978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20f7c683-93fb-43c5-966d-50221e35c1b6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:59.858716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20f7c683-93fb-43c5-966d-50221e35c1b6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:59.858716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20f7c683-93fb-43c5-966d-50221e35c1b6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:16:59.858716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20f7c683-93fb-43c5-966d-50221e35c1b6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:16:59.858716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20f7c683-93fb-43c5-966d-50221e35c1b6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:16:59.858716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20f7c683-93fb-43c5-966d-50221e35c1b6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:00.567185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-60c3f716-6f6d-44ca-b43a-d122e1989d76 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:00.576827 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-60c3f716-6f6d-44ca-b43a-d122e1989d76 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1509 microversion: 2.1 time: 0.881413 Oct 29 01:17:00.577505 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1516/3190] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:59 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1509 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:00.589905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-38de12b6-cafb-46ee-800c-76674c6bbc5c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:00.589905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-38de12b6-cafb-46ee-800c-76674c6bbc5c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:00.589905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38de12b6-cafb-46ee-800c-76674c6bbc5c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:00.590690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38de12b6-cafb-46ee-800c-76674c6bbc5c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:00.591323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38de12b6-cafb-46ee-800c-76674c6bbc5c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:00.592456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38de12b6-cafb-46ee-800c-76674c6bbc5c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:00.593146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38de12b6-cafb-46ee-800c-76674c6bbc5c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:00.593808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-38de12b6-cafb-46ee-800c-76674c6bbc5c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:00.594444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-20f7c683-93fb-43c5-966d-50221e35c1b6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:00.607030 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-20f7c683-93fb-43c5-966d-50221e35c1b6 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1324 microversion: 2.1 time: 0.791547 Oct 29 01:17:00.607776 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1675/3191] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:16:59 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1324 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:00.616055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f0088bf5-1805-4666-8492-5aba776b4e06 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:00.616709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f0088bf5-1805-4666-8492-5aba776b4e06 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:00.624291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0088bf5-1805-4666-8492-5aba776b4e06 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:00.624781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0088bf5-1805-4666-8492-5aba776b4e06 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:00.625252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0088bf5-1805-4666-8492-5aba776b4e06 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:00.626261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0088bf5-1805-4666-8492-5aba776b4e06 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:00.626855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0088bf5-1805-4666-8492-5aba776b4e06 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:00.632382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0088bf5-1805-4666-8492-5aba776b4e06 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:00.651460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:00.701823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-38de12b6-cafb-46ee-800c-76674c6bbc5c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:00.715114 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-38de12b6-cafb-46ee-800c-76674c6bbc5c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1272 microversion: 2.1 time: 0.136238 Oct 29 01:17:00.716780 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1517/3192] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:00 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1272 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:00.722200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9d9ab002-328e-450e-a628-74b90800a6f4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:00.723124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9d9ab002-328e-450e-a628-74b90800a6f4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:00.733228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d9ab002-328e-450e-a628-74b90800a6f4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:00.734013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d9ab002-328e-450e-a628-74b90800a6f4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:00.734778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d9ab002-328e-450e-a628-74b90800a6f4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:00.736088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d9ab002-328e-450e-a628-74b90800a6f4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:00.736723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d9ab002-328e-450e-a628-74b90800a6f4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:00.737427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d9ab002-328e-450e-a628-74b90800a6f4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:00.753930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f0088bf5-1805-4666-8492-5aba776b4e06 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:00.766613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f0088bf5-1805-4666-8492-5aba776b4e06 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:00.768210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f0088bf5-1805-4666-8492-5aba776b4e06 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:00.769453 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f0088bf5-1805-4666-8492-5aba776b4e06 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1372 microversion: 2.47 time: 0.160448 Oct 29 01:17:00.770437 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1676/3193] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:00 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:01.013895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9d9ab002-328e-450e-a628-74b90800a6f4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:01.024602 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9d9ab002-328e-450e-a628-74b90800a6f4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 200 len: 1308 microversion: 2.1 time: 0.305487 Oct 29 01:17:01.038183 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1518/3194] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:00 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 1308 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:01.385569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9d2157e6-0637-4822-b12b-d606e963bd3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-89176028", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": "none"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:01.446380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9d2157e6-0637-4822-b12b-d606e963bd3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:17:01.446836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9d2157e6-0637-4822-b12b-d606e963bd3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:17:01.447376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9d2157e6-0637-4822-b12b-d606e963bd3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:17:01.447795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9d2157e6-0637-4822-b12b-d606e963bd3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:17:01.448213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9d2157e6-0637-4822-b12b-d606e963bd3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:17:01.457487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d2157e6-0637-4822-b12b-d606e963bd3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:01.457928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d2157e6-0637-4822-b12b-d606e963bd3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:01.458374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d2157e6-0637-4822-b12b-d606e963bd3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:01.459112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d2157e6-0637-4822-b12b-d606e963bd3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:01.459574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d2157e6-0637-4822-b12b-d606e963bd3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:01.460007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d2157e6-0637-4822-b12b-d606e963bd3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:01.478793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-9d2157e6-0637-4822-b12b-d606e963bd3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Getting quotas for project 067ac836f982469a8701fcafb6fa6917. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:17:01.485219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-9d2157e6-0637-4822-b12b-d606e963bd3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Getting quotas for user 6a43d479af304be49d42098b90bb228d and project 067ac836f982469a8701fcafb6fa6917. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:17:01.500876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9d2157e6-0637-4822-b12b-d606e963bd3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:17:01.503318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9d2157e6-0637-4822-b12b-d606e963bd3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:17:01.604496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3bf0d316-1215-4524-8b53-33d97501f560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:01.605988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3bf0d316-1215-4524-8b53-33d97501f560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:01.618855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bf0d316-1215-4524-8b53-33d97501f560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:01.619509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bf0d316-1215-4524-8b53-33d97501f560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:01.620235 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bf0d316-1215-4524-8b53-33d97501f560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:01.622127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bf0d316-1215-4524-8b53-33d97501f560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:01.622727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bf0d316-1215-4524-8b53-33d97501f560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:01.623284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bf0d316-1215-4524-8b53-33d97501f560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:01.663554 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9d2157e6-0637-4822-b12b-d606e963bd3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.433877 Oct 29 01:17:01.672565 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1677/3195] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 29 01:17:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 444 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 01:17:01.700155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cbeca091-171a-4b2f-92b3-4a5882c28d81 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:01.700155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cbeca091-171a-4b2f-92b3-4a5882c28d81 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:01.717657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cbeca091-171a-4b2f-92b3-4a5882c28d81 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:01.718138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cbeca091-171a-4b2f-92b3-4a5882c28d81 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:01.734355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cbeca091-171a-4b2f-92b3-4a5882c28d81 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:01.738903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cbeca091-171a-4b2f-92b3-4a5882c28d81 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:01.739408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cbeca091-171a-4b2f-92b3-4a5882c28d81 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:01.739860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cbeca091-171a-4b2f-92b3-4a5882c28d81 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:02.015613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3bf0d316-1215-4524-8b53-33d97501f560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:02.031543 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3bf0d316-1215-4524-8b53-33d97501f560 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1509 microversion: 2.1 time: 0.429842 Oct 29 01:17:02.033183 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1519/3196] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:01 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1509 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:02.047860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e3706719-b1d4-4f2b-abda-ba266061f961 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:02.050840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e3706719-b1d4-4f2b-abda-ba266061f961 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:02.070633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:02.272082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e3706719-b1d4-4f2b-abda-ba266061f961 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:02.282027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e3706719-b1d4-4f2b-abda-ba266061f961 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:02.287138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e3706719-b1d4-4f2b-abda-ba266061f961 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:02.299282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cbeca091-171a-4b2f-92b3-4a5882c28d81 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:02.302091 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e3706719-b1d4-4f2b-abda-ba266061f961 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1450 microversion: 2.91 time: 0.267425 Oct 29 01:17:02.302767 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1520/3197] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:02 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1450 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:02.310548 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cbeca091-171a-4b2f-92b3-4a5882c28d81 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1324 microversion: 2.1 time: 0.619715 Oct 29 01:17:02.312562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d96f4609-ab09-471d-a3e9-604c8eee5c0a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:02.313311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d96f4609-ab09-471d-a3e9-604c8eee5c0a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:02.313980 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1678/3198] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:01 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1324 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:02.323138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cb04de03-733c-4c04-8c6a-b2fd7a3cc4da tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:02.329861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cb04de03-733c-4c04-8c6a-b2fd7a3cc4da tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:02.337456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d96f4609-ab09-471d-a3e9-604c8eee5c0a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:02.337954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d96f4609-ab09-471d-a3e9-604c8eee5c0a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:02.338392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d96f4609-ab09-471d-a3e9-604c8eee5c0a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:02.338524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb04de03-733c-4c04-8c6a-b2fd7a3cc4da tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:02.339154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d96f4609-ab09-471d-a3e9-604c8eee5c0a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:02.339510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb04de03-733c-4c04-8c6a-b2fd7a3cc4da tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:02.339796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d96f4609-ab09-471d-a3e9-604c8eee5c0a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:02.340242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d96f4609-ab09-471d-a3e9-604c8eee5c0a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:02.340904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb04de03-733c-4c04-8c6a-b2fd7a3cc4da tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:02.357694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb04de03-733c-4c04-8c6a-b2fd7a3cc4da tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:02.360022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb04de03-733c-4c04-8c6a-b2fd7a3cc4da tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:02.367953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb04de03-733c-4c04-8c6a-b2fd7a3cc4da tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:02.495088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cb04de03-733c-4c04-8c6a-b2fd7a3cc4da tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:02.505729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d96f4609-ab09-471d-a3e9-604c8eee5c0a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:02.522986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cb04de03-733c-4c04-8c6a-b2fd7a3cc4da tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:02.526371 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d96f4609-ab09-471d-a3e9-604c8eee5c0a tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1270 microversion: 2.1 time: 0.221650 Oct 29 01:17:02.527749 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1521/3199] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:02 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1270 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:02.535729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f7cf38c2-1851-4bea-88cd-26207439e093 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:02.536889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f7cf38c2-1851-4bea-88cd-26207439e093 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:02.537411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cb04de03-733c-4c04-8c6a-b2fd7a3cc4da tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:02.538858 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cb04de03-733c-4c04-8c6a-b2fd7a3cc4da tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1357 microversion: 2.47 time: 0.222344 Oct 29 01:17:02.541179 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1679/3200] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:02 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:02.571836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7cf38c2-1851-4bea-88cd-26207439e093 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:02.572754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7cf38c2-1851-4bea-88cd-26207439e093 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:02.573507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7cf38c2-1851-4bea-88cd-26207439e093 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:02.574635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7cf38c2-1851-4bea-88cd-26207439e093 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:02.575327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7cf38c2-1851-4bea-88cd-26207439e093 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:02.576342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7cf38c2-1851-4bea-88cd-26207439e093 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:02.577209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-813510ad-3834-4867-ac4a-670dfc19d8a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:02.588377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-813510ad-3834-4867-ac4a-670dfc19d8a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:02.594701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-813510ad-3834-4867-ac4a-670dfc19d8a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Searching by: {'deleted': False, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:17:02.611456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-813510ad-3834-4867-ac4a-670dfc19d8a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:02.612155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-813510ad-3834-4867-ac4a-670dfc19d8a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:02.614346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-813510ad-3834-4867-ac4a-670dfc19d8a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:02.614346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-813510ad-3834-4867-ac4a-670dfc19d8a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:02.620755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-813510ad-3834-4867-ac4a-670dfc19d8a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:02.622393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-813510ad-3834-4867-ac4a-670dfc19d8a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:02.762704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-813510ad-3834-4867-ac4a-670dfc19d8a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:17:02.848515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-813510ad-3834-4867-ac4a-670dfc19d8a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:02.856566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-813510ad-3834-4867-ac4a-670dfc19d8a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:02.856792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-813510ad-3834-4867-ac4a-670dfc19d8a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:02.857249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-813510ad-3834-4867-ac4a-670dfc19d8a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:02.869188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-813510ad-3834-4867-ac4a-670dfc19d8a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:02.871358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-813510ad-3834-4867-ac4a-670dfc19d8a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:02.879513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f7cf38c2-1851-4bea-88cd-26207439e093 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:02.888291 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f7cf38c2-1851-4bea-88cd-26207439e093 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 200 len: 1488 microversion: 2.1 time: 0.358982 Oct 29 01:17:02.888881 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1522/3201] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:02 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 1488 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:02.893428 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-5e4a1620-baea-49b5-874b-9b76e79a43a4 req-24d130b4-e5c7-4a8a-9a29-b60996f32408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919adddc-a598-47f8-9823-170d101dbdc8", "name": "network-vif-deleted", "tag": "e555ad33-2662-4f2a-8f28-923c3ff8a45e"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:02.903912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5e4a1620-baea-49b5-874b-9b76e79a43a4 req-24d130b4-e5c7-4a8a-9a29-b60996f32408 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:02.904652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5e4a1620-baea-49b5-874b-9b76e79a43a4 req-24d130b4-e5c7-4a8a-9a29-b60996f32408 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:02.905263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5e4a1620-baea-49b5-874b-9b76e79a43a4 req-24d130b4-e5c7-4a8a-9a29-b60996f32408 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:02.919039 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-5e4a1620-baea-49b5-874b-9b76e79a43a4 req-24d130b4-e5c7-4a8a-9a29-b60996f32408 service nova] Creating event network-vif-deleted:e555ad33-2662-4f2a-8f28-923c3ff8a45e for instance 919adddc-a598-47f8-9823-170d101dbdc8 on n-h2-862964-3 Oct 29 01:17:02.924500 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-5e4a1620-baea-49b5-874b-9b76e79a43a4 req-24d130b4-e5c7-4a8a-9a29-b60996f32408 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034290 Oct 29 01:17:02.925240 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1523/3202] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:02.930457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-48717009-d9f5-4917-af54-d9704063cd0e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:02.931078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-48717009-d9f5-4917-af54-d9704063cd0e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:02.939817 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-813510ad-3834-4867-ac4a-670dfc19d8a6 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.368048 Oct 29 01:17:02.952759 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1680/3203] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Oct 29 01:17:02 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:02.969860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48717009-d9f5-4917-af54-d9704063cd0e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:02.969860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48717009-d9f5-4917-af54-d9704063cd0e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:02.969860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48717009-d9f5-4917-af54-d9704063cd0e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:02.969860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48717009-d9f5-4917-af54-d9704063cd0e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:02.969860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48717009-d9f5-4917-af54-d9704063cd0e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:02.969860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48717009-d9f5-4917-af54-d9704063cd0e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:02.978209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a0b2606e-a196-4cbc-ba22-b113dc290932 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:02.978717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a0b2606e-a196-4cbc-ba22-b113dc290932 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:02.987227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0b2606e-a196-4cbc-ba22-b113dc290932 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:02.990558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0b2606e-a196-4cbc-ba22-b113dc290932 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:02.990558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0b2606e-a196-4cbc-ba22-b113dc290932 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:02.990558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0b2606e-a196-4cbc-ba22-b113dc290932 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:02.990558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0b2606e-a196-4cbc-ba22-b113dc290932 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:02.991175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0b2606e-a196-4cbc-ba22-b113dc290932 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:03.026116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a0b2606e-a196-4cbc-ba22-b113dc290932 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:17:03.336448 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-48717009-d9f5-4917-af54-d9704063cd0e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "POST /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05/action" status: 202 len: 0 microversion: 2.1 time: 0.409741 Oct 29 01:17:03.337828 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1524/3204] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:17:02 2022] POST /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:17:03.345354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4ea8784e-97a6-4a97-89d3-2e4b44b540a9 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:03.346866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4ea8784e-97a6-4a97-89d3-2e4b44b540a9 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:03.357918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ea8784e-97a6-4a97-89d3-2e4b44b540a9 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:03.363610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ea8784e-97a6-4a97-89d3-2e4b44b540a9 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:03.364534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ea8784e-97a6-4a97-89d3-2e4b44b540a9 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:03.365602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ea8784e-97a6-4a97-89d3-2e4b44b540a9 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:03.366587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ea8784e-97a6-4a97-89d3-2e4b44b540a9 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:03.367641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ea8784e-97a6-4a97-89d3-2e4b44b540a9 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:03.409583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ea8784e-97a6-4a97-89d3-2e4b44b540a9 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:03.410209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ea8784e-97a6-4a97-89d3-2e4b44b540a9 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:03.410731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ea8784e-97a6-4a97-89d3-2e4b44b540a9 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:03.411324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-4ea8784e-97a6-4a97-89d3-2e4b44b540a9 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lazy-loading 'fault' on Instance uuid 919adddc-a598-47f8-9823-170d101dbdc8 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:17:03.493537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4ea8784e-97a6-4a97-89d3-2e4b44b540a9 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db6907e28b7e4c078e13c92e27e1030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de00f139aa846cbb6147e9c1ce282b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:03.505146 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4ea8784e-97a6-4a97-89d3-2e4b44b540a9 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 200 len: 1312 microversion: 2.1 time: 0.165765 Oct 29 01:17:03.507696 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1525/3205] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:03 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:03.515995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c726bf9d-ec4b-47af-9ef5-56ccfe2967ed tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:03.517063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c726bf9d-ec4b-47af-9ef5-56ccfe2967ed tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:03.525885 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a0b2606e-a196-4cbc-ba22-b113dc290932 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 204 len: 0 microversion: 2.47 time: 0.549024 Oct 29 01:17:03.530561 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1681/3206] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:17:02 2022] DELETE /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 29 01:17:03.545393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c726bf9d-ec4b-47af-9ef5-56ccfe2967ed tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:03.546070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c726bf9d-ec4b-47af-9ef5-56ccfe2967ed tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:03.546535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c726bf9d-ec4b-47af-9ef5-56ccfe2967ed tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:03.547326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c726bf9d-ec4b-47af-9ef5-56ccfe2967ed tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:03.547762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c726bf9d-ec4b-47af-9ef5-56ccfe2967ed tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:03.549106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c726bf9d-ec4b-47af-9ef5-56ccfe2967ed tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:03.554745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8a6ac859-3e2c-4fb5-a551-d1d13e92e646 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:03.555585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8a6ac859-3e2c-4fb5-a551-d1d13e92e646 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:03.569904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a6ac859-3e2c-4fb5-a551-d1d13e92e646 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:03.570560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a6ac859-3e2c-4fb5-a551-d1d13e92e646 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:03.571071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a6ac859-3e2c-4fb5-a551-d1d13e92e646 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:03.571908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a6ac859-3e2c-4fb5-a551-d1d13e92e646 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:03.572622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a6ac859-3e2c-4fb5-a551-d1d13e92e646 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:03.573310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a6ac859-3e2c-4fb5-a551-d1d13e92e646 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:03.873999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c726bf9d-ec4b-47af-9ef5-56ccfe2967ed tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:03.891095 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c726bf9d-ec4b-47af-9ef5-56ccfe2967ed tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 200 len: 1493 microversion: 2.1 time: 0.380758 Oct 29 01:17:03.892533 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1526/3207] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:03 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 1493 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:03.898370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7470f9a3-dd7c-4f8f-9d71-651f7d1a558e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:03.899183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7470f9a3-dd7c-4f8f-9d71-651f7d1a558e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:03.906230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7470f9a3-dd7c-4f8f-9d71-651f7d1a558e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:03.906981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7470f9a3-dd7c-4f8f-9d71-651f7d1a558e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:03.907740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7470f9a3-dd7c-4f8f-9d71-651f7d1a558e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:03.908632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7470f9a3-dd7c-4f8f-9d71-651f7d1a558e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:03.909418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7470f9a3-dd7c-4f8f-9d71-651f7d1a558e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:03.910118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7470f9a3-dd7c-4f8f-9d71-651f7d1a558e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:04.036081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8a6ac859-3e2c-4fb5-a551-d1d13e92e646 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:04.050068 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8a6ac859-3e2c-4fb5-a551-d1d13e92e646 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1522 microversion: 2.1 time: 0.517296 Oct 29 01:17:04.051587 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1682/3208] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:03 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1522 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:04.060673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd14b036-a987-43bf-853f-b13cda51642f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:04.066205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bd14b036-a987-43bf-853f-b13cda51642f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:04.087489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd14b036-a987-43bf-853f-b13cda51642f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:04.088551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd14b036-a987-43bf-853f-b13cda51642f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:04.089119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd14b036-a987-43bf-853f-b13cda51642f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:04.094278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd14b036-a987-43bf-853f-b13cda51642f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:04.095032 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd14b036-a987-43bf-853f-b13cda51642f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:04.095970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd14b036-a987-43bf-853f-b13cda51642f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:04.158374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7470f9a3-dd7c-4f8f-9d71-651f7d1a558e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:04.182602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7470f9a3-dd7c-4f8f-9d71-651f7d1a558e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:04.189932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7470f9a3-dd7c-4f8f-9d71-651f7d1a558e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:04.203925 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7470f9a3-dd7c-4f8f-9d71-651f7d1a558e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1454 microversion: 2.91 time: 0.309963 Oct 29 01:17:04.209027 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1527/3209] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:03 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1454 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:04.214928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f2228ec9-0867-4b46-ae4c-a93efc3c4bd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:04.215984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f2228ec9-0867-4b46-ae4c-a93efc3c4bd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:04.232468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2228ec9-0867-4b46-ae4c-a93efc3c4bd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:04.233275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2228ec9-0867-4b46-ae4c-a93efc3c4bd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:04.233885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2228ec9-0867-4b46-ae4c-a93efc3c4bd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:04.234692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2228ec9-0867-4b46-ae4c-a93efc3c4bd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:04.235244 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2228ec9-0867-4b46-ae4c-a93efc3c4bd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:04.235752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2228ec9-0867-4b46-ae4c-a93efc3c4bd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:04.254727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bd14b036-a987-43bf-853f-b13cda51642f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:04.268096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bd14b036-a987-43bf-853f-b13cda51642f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:04.273121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bd14b036-a987-43bf-853f-b13cda51642f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:04.274372 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bd14b036-a987-43bf-853f-b13cda51642f tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1363 microversion: 2.47 time: 0.219801 Oct 29 01:17:04.278367 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1683/3210] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:04 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:04.288387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-918b6c3a-bb68-44e6-9f09-89c905d46db0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:04.289414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-918b6c3a-bb68-44e6-9f09-89c905d46db0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:04.304723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-918b6c3a-bb68-44e6-9f09-89c905d46db0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:04.311394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-918b6c3a-bb68-44e6-9f09-89c905d46db0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:04.311394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-918b6c3a-bb68-44e6-9f09-89c905d46db0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:04.311394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-918b6c3a-bb68-44e6-9f09-89c905d46db0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:04.311394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-918b6c3a-bb68-44e6-9f09-89c905d46db0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:04.311394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-918b6c3a-bb68-44e6-9f09-89c905d46db0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:04.364662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-918b6c3a-bb68-44e6-9f09-89c905d46db0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:17:04.408933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f2228ec9-0867-4b46-ae4c-a93efc3c4bd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:04.420678 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f2228ec9-0867-4b46-ae4c-a93efc3c4bd0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1312 microversion: 2.1 time: 0.210056 Oct 29 01:17:04.428509 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1528/3211] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:04 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1312 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:04.538956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-05ab0eeb-9fab-4c2b-9dbd-9f0e7f02e228 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:04.539839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-05ab0eeb-9fab-4c2b-9dbd-9f0e7f02e228 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] [instance: 919adddc-a598-47f8-9823-170d101dbdc8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:04.552068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-05ab0eeb-9fab-4c2b-9dbd-9f0e7f02e228 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:04.553433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-05ab0eeb-9fab-4c2b-9dbd-9f0e7f02e228 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:04.554228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-05ab0eeb-9fab-4c2b-9dbd-9f0e7f02e228 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:04.555172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-05ab0eeb-9fab-4c2b-9dbd-9f0e7f02e228 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:04.555796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-05ab0eeb-9fab-4c2b-9dbd-9f0e7f02e228 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:04.556422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-05ab0eeb-9fab-4c2b-9dbd-9f0e7f02e228 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:04.575407 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-05ab0eeb-9fab-4c2b-9dbd-9f0e7f02e228 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] HTTP exception thrown: Instance 919adddc-a598-47f8-9823-170d101dbdc8 could not be found. Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-05ab0eeb-9fab-4c2b-9dbd-9f0e7f02e228 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Request method failure captured: Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 HTTP/1.1 Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH6yXpadXwVH3qkQE7H9ic2cI3sIHPIxiu4yFQsQRRWtQNLekaLjiyq1c2DytqKIZ4cetJ3wzkQCWM_BOsvyFJ512dFtFzTR2gGbxtGE2Sjaq_rUbNXbRiLTnuAN4w83Zn9GoXdUT-DVij8hgqg4Vn4ZKVRND6VBuaVBfqNsSU6hl0Y Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 1de00f139aa846cbb6147e9c1ce282b8 Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-997299447 Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1de00f139aa846cbb6147e9c1ce282b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1de00f139aa846cbb6147e9c1ce282b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1de00f139aa846cbb6147e9c1ce282b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1de00f139aa846cbb6147e9c1ce282b8", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-997299447 Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 1de00f139aa846cbb6147e9c1ce282b8 Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-997299447 Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerRescueTestJSONUnderV235-997299447-project Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db6907e28b7e4c078e13c92e27e1030d Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-997299447-project Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 919adddc-a598-47f8-9823-170d101dbdc8 could not be found. Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '919adddc-a598-47f8-9823-170d101dbdc8'} Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 919adddc-a598-47f8-9823-170d101dbdc8 could not be found. Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 919adddc-a598-47f8-9823-170d101dbdc8 could not be found. Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:04.577106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:04.585996 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:04.585996 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:04.585996 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:04.585996 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:04.585996 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:04.585996 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:04.585996 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 919adddc-a598-47f8-9823-170d101dbdc8 could not be found. Oct 29 01:17:04.585996 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:04.585996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-05ab0eeb-9fab-4c2b-9dbd-9f0e7f02e228 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] Returning 404 to user: Instance 919adddc-a598-47f8-9823-170d101dbdc8 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:04.585996 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-05ab0eeb-9fab-4c2b-9dbd-9f0e7f02e228 tempest-ServerRescueTestJSONUnderV235-997299447 tempest-ServerRescueTestJSONUnderV235-997299447-project] 10.222.0.26 "GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8" status: 404 len: 111 microversion: 2.1 time: 0.043870 Oct 29 01:17:04.585996 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1529/3212] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:04 2022] GET /compute/v2.1/servers/919adddc-a598-47f8-9823-170d101dbdc8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:17:04.722066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:04.812444 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-918b6c3a-bb68-44e6-9f09-89c905d46db0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 204 len: 0 microversion: 2.1 time: 0.531723 Oct 29 01:17:04.813417 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1684/3213] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:17:04 2022] DELETE /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:17:04.823162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-41826c3f-8e71-46db-b516-09bf3689543b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:04.824420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-41826c3f-8e71-46db-b516-09bf3689543b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:04.827422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:04.833672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41826c3f-8e71-46db-b516-09bf3689543b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:04.837493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41826c3f-8e71-46db-b516-09bf3689543b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:04.837493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41826c3f-8e71-46db-b516-09bf3689543b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:04.837493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41826c3f-8e71-46db-b516-09bf3689543b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:04.837493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41826c3f-8e71-46db-b516-09bf3689543b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:04.837493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41826c3f-8e71-46db-b516-09bf3689543b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:04.916520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d1715b8b-1284-4ffc-9a66-c54b949319c2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:04.918071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d1715b8b-1284-4ffc-9a66-c54b949319c2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:04.930122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1715b8b-1284-4ffc-9a66-c54b949319c2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:04.931602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1715b8b-1284-4ffc-9a66-c54b949319c2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:04.932204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1715b8b-1284-4ffc-9a66-c54b949319c2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:04.934034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1715b8b-1284-4ffc-9a66-c54b949319c2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:04.934885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1715b8b-1284-4ffc-9a66-c54b949319c2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:04.935585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1715b8b-1284-4ffc-9a66-c54b949319c2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:05.202925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-41826c3f-8e71-46db-b516-09bf3689543b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:05.221878 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-41826c3f-8e71-46db-b516-09bf3689543b tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1528 microversion: 2.1 time: 0.400050 Oct 29 01:17:05.226136 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1530/3214] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:04 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1528 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:05.242041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4c37569e-89ae-432c-9f93-57cedebd9b2f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:05.242812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4c37569e-89ae-432c-9f93-57cedebd9b2f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:05.258927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c37569e-89ae-432c-9f93-57cedebd9b2f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:05.259411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c37569e-89ae-432c-9f93-57cedebd9b2f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:05.259907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c37569e-89ae-432c-9f93-57cedebd9b2f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:05.260674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c37569e-89ae-432c-9f93-57cedebd9b2f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:05.261286 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c37569e-89ae-432c-9f93-57cedebd9b2f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:05.261729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c37569e-89ae-432c-9f93-57cedebd9b2f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:05.321699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d1715b8b-1284-4ffc-9a66-c54b949319c2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:05.335672 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d1715b8b-1284-4ffc-9a66-c54b949319c2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 200 len: 1473 microversion: 2.1 time: 0.423255 Oct 29 01:17:05.336288 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1685/3215] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:04 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 1473 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:05.375687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-894d7467-458c-43c9-a271-cf81f91343f1 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:05.376564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-894d7467-458c-43c9-a271-cf81f91343f1 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:05.384360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-894d7467-458c-43c9-a271-cf81f91343f1 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:05.388720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-894d7467-458c-43c9-a271-cf81f91343f1 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:05.388720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-894d7467-458c-43c9-a271-cf81f91343f1 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:05.388720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-894d7467-458c-43c9-a271-cf81f91343f1 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:05.388720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-894d7467-458c-43c9-a271-cf81f91343f1 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:05.390158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-894d7467-458c-43c9-a271-cf81f91343f1 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:05.841399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4c37569e-89ae-432c-9f93-57cedebd9b2f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:05.859532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4c37569e-89ae-432c-9f93-57cedebd9b2f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:05.860922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4c37569e-89ae-432c-9f93-57cedebd9b2f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:05.878811 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4c37569e-89ae-432c-9f93-57cedebd9b2f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1502 microversion: 2.91 time: 0.648467 Oct 29 01:17:05.879742 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1531/3216] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:05 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1502 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:05.895001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7537fcdc-4902-49b0-9b4a-f388d709a5ab tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-761742910"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:05.902767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7537fcdc-4902-49b0-9b4a-f388d709a5ab tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:05.908170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-894d7467-458c-43c9-a271-cf81f91343f1 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:05.910277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7537fcdc-4902-49b0-9b4a-f388d709a5ab tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:05.912020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7537fcdc-4902-49b0-9b4a-f388d709a5ab tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:05.912833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7537fcdc-4902-49b0-9b4a-f388d709a5ab tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:05.913813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7537fcdc-4902-49b0-9b4a-f388d709a5ab tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:05.914438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7537fcdc-4902-49b0-9b4a-f388d709a5ab tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:05.915043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7537fcdc-4902-49b0-9b4a-f388d709a5ab tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:05.921474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-894d7467-458c-43c9-a271-cf81f91343f1 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:05.927925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-894d7467-458c-43c9-a271-cf81f91343f1 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:05.929779 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-894d7467-458c-43c9-a271-cf81f91343f1 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1363 microversion: 2.47 time: 0.564831 Oct 29 01:17:05.930637 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1686/3217] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:05 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1363 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:05.939319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-472f6ae9-5c6f-4eb1-8345-1a7986b6a520 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:05.939319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-472f6ae9-5c6f-4eb1-8345-1a7986b6a520 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:05.950751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-472f6ae9-5c6f-4eb1-8345-1a7986b6a520 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:05.951437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-472f6ae9-5c6f-4eb1-8345-1a7986b6a520 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:05.952008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-472f6ae9-5c6f-4eb1-8345-1a7986b6a520 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:05.952852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-472f6ae9-5c6f-4eb1-8345-1a7986b6a520 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:05.953699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-472f6ae9-5c6f-4eb1-8345-1a7986b6a520 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:05.954293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-472f6ae9-5c6f-4eb1-8345-1a7986b6a520 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:05.983723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:06.201874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-472f6ae9-5c6f-4eb1-8345-1a7986b6a520 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:06.210614 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-472f6ae9-5c6f-4eb1-8345-1a7986b6a520 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1333 microversion: 2.1 time: 0.278682 Oct 29 01:17:06.229275 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1687/3218] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:05 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1333 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:06.252394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-141bc57f-37a9-4576-b94b-ad1847b0fda2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:06.254426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-141bc57f-37a9-4576-b94b-ad1847b0fda2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:06.267670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-141bc57f-37a9-4576-b94b-ad1847b0fda2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:06.268444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-141bc57f-37a9-4576-b94b-ad1847b0fda2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:06.269070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-141bc57f-37a9-4576-b94b-ad1847b0fda2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:06.270165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-141bc57f-37a9-4576-b94b-ad1847b0fda2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:06.270881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-141bc57f-37a9-4576-b94b-ad1847b0fda2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:06.272786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-141bc57f-37a9-4576-b94b-ad1847b0fda2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:06.438428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-141bc57f-37a9-4576-b94b-ad1847b0fda2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:06.446748 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-141bc57f-37a9-4576-b94b-ad1847b0fda2 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1528 microversion: 2.1 time: 0.199321 Oct 29 01:17:06.447337 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1688/3219] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:06 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1528 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:06.556110 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7537fcdc-4902-49b0-9b4a-f388d709a5ab tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "POST /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05/action" status: 202 len: 0 microversion: 2.1 time: 0.674914 Oct 29 01:17:06.568824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-511f8f75-692f-4ab7-a442-d734080d866b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9716a1f0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:06.576274 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1532/3220] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:17:05 2022] POST /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05/action => generated 0 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 01:17:06.621617 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-511f8f75-692f-4ab7-a442-d734080d866b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.055956 Oct 29 01:17:06.622261 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1689/3221] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:06 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:06.925819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fb0da60a-6672-4266-8e23-1a75d36ed4ee tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:06.926725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fb0da60a-6672-4266-8e23-1a75d36ed4ee tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:06.936082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb0da60a-6672-4266-8e23-1a75d36ed4ee tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:06.936964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb0da60a-6672-4266-8e23-1a75d36ed4ee tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:06.937808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb0da60a-6672-4266-8e23-1a75d36ed4ee tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:06.938789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb0da60a-6672-4266-8e23-1a75d36ed4ee tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:06.939469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb0da60a-6672-4266-8e23-1a75d36ed4ee tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:06.940757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb0da60a-6672-4266-8e23-1a75d36ed4ee tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:06.967743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5b1ef874-6dff-4bee-abdc-2e89f12428d8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:06.969733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5b1ef874-6dff-4bee-abdc-2e89f12428d8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:06.976998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b1ef874-6dff-4bee-abdc-2e89f12428d8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:06.977736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b1ef874-6dff-4bee-abdc-2e89f12428d8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:06.978347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b1ef874-6dff-4bee-abdc-2e89f12428d8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:06.979497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b1ef874-6dff-4bee-abdc-2e89f12428d8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:06.980912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b1ef874-6dff-4bee-abdc-2e89f12428d8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:06.983988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b1ef874-6dff-4bee-abdc-2e89f12428d8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:07.208609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5b1ef874-6dff-4bee-abdc-2e89f12428d8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:07.211865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fb0da60a-6672-4266-8e23-1a75d36ed4ee tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:07.220038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:07.225604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5b1ef874-6dff-4bee-abdc-2e89f12428d8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:07.227048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5b1ef874-6dff-4bee-abdc-2e89f12428d8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:07.228246 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5b1ef874-6dff-4bee-abdc-2e89f12428d8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1363 microversion: 2.47 time: 0.271032 Oct 29 01:17:07.234721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fb0da60a-6672-4266-8e23-1a75d36ed4ee tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:07.242891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fb0da60a-6672-4266-8e23-1a75d36ed4ee tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:07.249857 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1690/3222] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:06 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:17:07.255960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5d5e843a-bf3e-4150-9a4a-c7d5a3188ed9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:07.256838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5d5e843a-bf3e-4150-9a4a-c7d5a3188ed9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:07.260750 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fb0da60a-6672-4266-8e23-1a75d36ed4ee tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1502 microversion: 2.91 time: 0.347215 Oct 29 01:17:07.266171 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1533/3223] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:06 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1502 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:07.268999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d5e843a-bf3e-4150-9a4a-c7d5a3188ed9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:07.271614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d5e843a-bf3e-4150-9a4a-c7d5a3188ed9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:07.272250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d5e843a-bf3e-4150-9a4a-c7d5a3188ed9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:07.272985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d5e843a-bf3e-4150-9a4a-c7d5a3188ed9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:07.273470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d5e843a-bf3e-4150-9a4a-c7d5a3188ed9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:07.273894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d5e843a-bf3e-4150-9a4a-c7d5a3188ed9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:07.463618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5d5e843a-bf3e-4150-9a4a-c7d5a3188ed9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:07.472067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8414a90d-f651-48b0-a5ad-f6762a0ad967 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:07.473139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8414a90d-f651-48b0-a5ad-f6762a0ad967 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:07.479954 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5d5e843a-bf3e-4150-9a4a-c7d5a3188ed9 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1333 microversion: 2.1 time: 0.228441 Oct 29 01:17:07.481268 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1691/3224] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:07 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1333 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:07.510672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8414a90d-f651-48b0-a5ad-f6762a0ad967 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:07.511747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8414a90d-f651-48b0-a5ad-f6762a0ad967 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:07.512350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8414a90d-f651-48b0-a5ad-f6762a0ad967 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:07.513365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8414a90d-f651-48b0-a5ad-f6762a0ad967 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:07.513980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8414a90d-f651-48b0-a5ad-f6762a0ad967 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:07.514596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8414a90d-f651-48b0-a5ad-f6762a0ad967 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:07.641448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f99b71ac-7b51-4427-9461-4bc578caf55b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9716a5e0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:07.735295 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f99b71ac-7b51-4427-9461-4bc578caf55b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.101605 Oct 29 01:17:07.736717 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1692/3225] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:07 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:07.883659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8414a90d-f651-48b0-a5ad-f6762a0ad967 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:07.907874 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8414a90d-f651-48b0-a5ad-f6762a0ad967 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1528 microversion: 2.1 time: 0.440223 Oct 29 01:17:07.921431 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1534/3226] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:07 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1528 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:07.975951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-17f60057-c7af-4278-b44d-1695c68a27b4 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Action: 'create', calling method: .version_select at 0x7f9d9fd66040>, body: {"keypair": {"name": "tempest-keypair-680022167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6C5anCrdmQCz3xAt6PawckoSYhuFB2pYiBCBjcINJCeQ7ZrZ7zUXEMczNdibFWMaIK2oXGrkyIYk+Zvd8k6xBB9zI9OIZ28/4aAkGO+apUe92MaCTKSy5DOqRm/HxbWg=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:08.017048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-17f60057-c7af-4278-b44d-1695c68a27b4 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Getting quotas for project d45b8f0077804db29ad5864327aa6bbb. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:17:08.034719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-17f60057-c7af-4278-b44d-1695c68a27b4 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Getting quotas for user 7d922c9f49ff4e87b7b1ca2e10766c53 and project d45b8f0077804db29ad5864327aa6bbb. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:17:08.145580 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-17f60057-c7af-4278-b44d-1695c68a27b4 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.267980 Oct 29 01:17:08.146496 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1693/3227] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:17:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:08.259630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c293ea1f-a1c6-417e-8769-fb2afc8bd4c8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:08.262106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c293ea1f-a1c6-417e-8769-fb2afc8bd4c8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:08.272081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c293ea1f-a1c6-417e-8769-fb2afc8bd4c8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:08.272910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c293ea1f-a1c6-417e-8769-fb2afc8bd4c8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:08.273732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c293ea1f-a1c6-417e-8769-fb2afc8bd4c8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:08.274956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c293ea1f-a1c6-417e-8769-fb2afc8bd4c8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:08.281056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c293ea1f-a1c6-417e-8769-fb2afc8bd4c8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:08.281056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c293ea1f-a1c6-417e-8769-fb2afc8bd4c8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:08.301594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4e5c9912-df04-46ff-a0cc-c4bb9d0fc693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:08.302217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4e5c9912-df04-46ff-a0cc-c4bb9d0fc693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:08.313960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e5c9912-df04-46ff-a0cc-c4bb9d0fc693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:08.314471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e5c9912-df04-46ff-a0cc-c4bb9d0fc693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:08.314921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e5c9912-df04-46ff-a0cc-c4bb9d0fc693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:08.321285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e5c9912-df04-46ff-a0cc-c4bb9d0fc693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:08.321909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e5c9912-df04-46ff-a0cc-c4bb9d0fc693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:08.322381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e5c9912-df04-46ff-a0cc-c4bb9d0fc693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:08.369626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c293ea1f-a1c6-417e-8769-fb2afc8bd4c8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:08.370143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c293ea1f-a1c6-417e-8769-fb2afc8bd4c8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:08.370809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c293ea1f-a1c6-417e-8769-fb2afc8bd4c8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:08.372876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-c293ea1f-a1c6-417e-8769-fb2afc8bd4c8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lazy-loading 'fault' on Instance uuid 2553486f-18b6-4846-8e4b-240e692a9e46 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:17:08.514745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4e5c9912-df04-46ff-a0cc-c4bb9d0fc693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:08.530619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4e5c9912-df04-46ff-a0cc-c4bb9d0fc693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:08.532780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4e5c9912-df04-46ff-a0cc-c4bb9d0fc693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:08.549088 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4e5c9912-df04-46ff-a0cc-c4bb9d0fc693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1520 microversion: 2.91 time: 0.252155 Oct 29 01:17:08.550234 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1694/3228] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:08 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:17:08.561785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c293ea1f-a1c6-417e-8769-fb2afc8bd4c8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:08.569665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-c98e4eb3-d43c-4e87-8048-874241eae5bf req-a063c027-2275-4838-aed6-bfe6ed7c9508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6048315f-8aea-4750-95b0-669ad146085f", "tag": "21841ba3-8287-44aa-b879-22f03c697604"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:08.581590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c293ea1f-a1c6-417e-8769-fb2afc8bd4c8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:08.581931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c293ea1f-a1c6-417e-8769-fb2afc8bd4c8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:08.585094 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c293ea1f-a1c6-417e-8769-fb2afc8bd4c8 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 200 len: 1368 microversion: 2.47 time: 0.332492 Oct 29 01:17:08.592723 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1535/3229] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:08 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 1368 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:17:08.606551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b7a9a886-99ab-4f7b-92b7-62aab0671aa6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:08.615474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b7a9a886-99ab-4f7b-92b7-62aab0671aa6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:08.615665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c98e4eb3-d43c-4e87-8048-874241eae5bf req-a063c027-2275-4838-aed6-bfe6ed7c9508 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:08.615665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c98e4eb3-d43c-4e87-8048-874241eae5bf req-a063c027-2275-4838-aed6-bfe6ed7c9508 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:08.615665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c98e4eb3-d43c-4e87-8048-874241eae5bf req-a063c027-2275-4838-aed6-bfe6ed7c9508 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:08.634923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7a9a886-99ab-4f7b-92b7-62aab0671aa6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:08.635448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7a9a886-99ab-4f7b-92b7-62aab0671aa6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:08.636425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7a9a886-99ab-4f7b-92b7-62aab0671aa6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:08.643634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7a9a886-99ab-4f7b-92b7-62aab0671aa6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:08.649065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7a9a886-99ab-4f7b-92b7-62aab0671aa6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:08.649065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7a9a886-99ab-4f7b-92b7-62aab0671aa6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:08.658504 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-c98e4eb3-d43c-4e87-8048-874241eae5bf req-a063c027-2275-4838-aed6-bfe6ed7c9508 service nova] Creating event network-changed:21841ba3-8287-44aa-b879-22f03c697604 for instance 6048315f-8aea-4750-95b0-669ad146085f on n-h1-862964-3 Oct 29 01:17:08.679576 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-c98e4eb3-d43c-4e87-8048-874241eae5bf req-a063c027-2275-4838-aed6-bfe6ed7c9508 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123533 Oct 29 01:17:08.682049 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1695/3230] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:08.764170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80aa1a68-0e56-43fb-9f9a-d82be1834ce7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96c68e50>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:08.876649 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-80aa1a68-0e56-43fb-9f9a-d82be1834ce7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.125912 Oct 29 01:17:08.877333 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1696/3231] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:08 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:08.938207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-65d0fd88-6db2-47ff-a8bd-dd43e981aaaa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:08.939558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-65d0fd88-6db2-47ff-a8bd-dd43e981aaaa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:08.962501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65d0fd88-6db2-47ff-a8bd-dd43e981aaaa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:08.963066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65d0fd88-6db2-47ff-a8bd-dd43e981aaaa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:08.967001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65d0fd88-6db2-47ff-a8bd-dd43e981aaaa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:08.970672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65d0fd88-6db2-47ff-a8bd-dd43e981aaaa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:08.972452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65d0fd88-6db2-47ff-a8bd-dd43e981aaaa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:08.972925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65d0fd88-6db2-47ff-a8bd-dd43e981aaaa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:09.322437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-65d0fd88-6db2-47ff-a8bd-dd43e981aaaa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:09.336272 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-65d0fd88-6db2-47ff-a8bd-dd43e981aaaa tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1486 microversion: 2.1 time: 0.402045 Oct 29 01:17:09.361376 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1697/3232] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:08 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1486 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:09.370760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-fe1d5e7a-71a7-48a8-a146-dbf43d77c2f1 req-d2316c1a-5027-4d15-9c50-698d52718567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6135c50e-cec0-4078-b9ef-bfabb3d7a52e", "name": "network-vif-deleted", "tag": "144eca99-84d8-4c80-bfbe-18327d225155"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:09.393857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-fe1d5e7a-71a7-48a8-a146-dbf43d77c2f1 req-d2316c1a-5027-4d15-9c50-698d52718567 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:09.396752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-fe1d5e7a-71a7-48a8-a146-dbf43d77c2f1 req-d2316c1a-5027-4d15-9c50-698d52718567 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:09.400552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-fe1d5e7a-71a7-48a8-a146-dbf43d77c2f1 req-d2316c1a-5027-4d15-9c50-698d52718567 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:09.432490 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-fe1d5e7a-71a7-48a8-a146-dbf43d77c2f1 req-d2316c1a-5027-4d15-9c50-698d52718567 service nova] Creating event network-vif-deleted:144eca99-84d8-4c80-bfbe-18327d225155 for instance 6135c50e-cec0-4078-b9ef-bfabb3d7a52e on n-h1-862964-3 Oct 29 01:17:09.457777 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-fe1d5e7a-71a7-48a8-a146-dbf43d77c2f1 req-d2316c1a-5027-4d15-9c50-698d52718567 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087710 Oct 29 01:17:09.460060 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1698/3233] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:09.597616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-73dcba3f-d969-4c81-84c4-82dbb144455a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:09.598435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-73dcba3f-d969-4c81-84c4-82dbb144455a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:09.605705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73dcba3f-d969-4c81-84c4-82dbb144455a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:09.606480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73dcba3f-d969-4c81-84c4-82dbb144455a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:09.607132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73dcba3f-d969-4c81-84c4-82dbb144455a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:09.608222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73dcba3f-d969-4c81-84c4-82dbb144455a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:09.608841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73dcba3f-d969-4c81-84c4-82dbb144455a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:09.609508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73dcba3f-d969-4c81-84c4-82dbb144455a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:09.713059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b7a9a886-99ab-4f7b-92b7-62aab0671aa6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:09.724140 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b7a9a886-99ab-4f7b-92b7-62aab0671aa6 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1333 microversion: 2.1 time: 1.129789 Oct 29 01:17:09.725133 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1536/3234] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:08 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1333 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:09.731646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b26d7bc6-422f-4daa-b638-cda4a4d12fe4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:09.734202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b26d7bc6-422f-4daa-b638-cda4a4d12fe4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 2553486f-18b6-4846-8e4b-240e692a9e46] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:09.751423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b26d7bc6-422f-4daa-b638-cda4a4d12fe4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:09.752211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b26d7bc6-422f-4daa-b638-cda4a4d12fe4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:09.752969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b26d7bc6-422f-4daa-b638-cda4a4d12fe4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:09.755852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b26d7bc6-422f-4daa-b638-cda4a4d12fe4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:09.757284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b26d7bc6-422f-4daa-b638-cda4a4d12fe4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:09.758883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b26d7bc6-422f-4daa-b638-cda4a4d12fe4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:09.789879 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-b26d7bc6-422f-4daa-b638-cda4a4d12fe4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] HTTP exception thrown: Instance 2553486f-18b6-4846-8e4b-240e692a9e46 could not be found. Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b26d7bc6-422f-4daa-b638-cda4a4d12fe4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Request method failure captured: Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 HTTP/1.1 Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7TTme0BhyqxOvZWhT6QzCbeEnXR6TD4vzbSKwf2TjfWOxKhYpCBVBhIiwJ2TuJRdPFeAB0-BCPFTggf6jZTyeHPF1AdPoP7X6FXc4hFM_vWDcYt21eYQ4k5se-qQlKQoT4rVTkQ9dA1sGVyqZwXszRFiV4BcMoBOA7yfJYyxP2Rgs Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-Openstack-Nova-Api-Version: 2.47 Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 81eb4814cf6748558e7a3bb61b792f0d Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerShowV247Test-423930010 Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81eb4814cf6748558e7a3bb61b792f0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/81eb4814cf6748558e7a3bb61b792f0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81eb4814cf6748558e7a3bb61b792f0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_81eb4814cf6748558e7a3bb61b792f0d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerShowV247Test-423930010 Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 81eb4814cf6748558e7a3bb61b792f0d Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerShowV247Test-423930010 Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerShowV247Test-423930010-project Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 12935cbb311c44da9dbf2c827e297af8 Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerShowV247Test-423930010-project Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 2553486f-18b6-4846-8e4b-240e692a9e46 could not be found. Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '2553486f-18b6-4846-8e4b-240e692a9e46'} Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2553486f-18b6-4846-8e4b-240e692a9e46 could not be found. Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2553486f-18b6-4846-8e4b-240e692a9e46 could not be found. Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:09.791888 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:09.798103 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:09.798103 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:09.798103 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:09.798103 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:09.798103 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:09.798103 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2553486f-18b6-4846-8e4b-240e692a9e46 could not be found. Oct 29 01:17:09.798103 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:09.806930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b26d7bc6-422f-4daa-b638-cda4a4d12fe4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Returning 404 to user: Instance 2553486f-18b6-4846-8e4b-240e692a9e46 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:09.813709 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b26d7bc6-422f-4daa-b638-cda4a4d12fe4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46" status: 404 len: 111 microversion: 2.47 time: 0.081117 Oct 29 01:17:09.813709 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1537/3235] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:09 2022] GET /compute/v2.1/servers/2553486f-18b6-4846-8e4b-240e692a9e46 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:17:09.818552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-28520d9e-8e1e-4716-a680-0510a82a8a02 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:09.819256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-28520d9e-8e1e-4716-a680-0510a82a8a02 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 11738ed9-de76-4b69-ab44-0844209dde02] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:09.828337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28520d9e-8e1e-4716-a680-0510a82a8a02 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:09.828756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28520d9e-8e1e-4716-a680-0510a82a8a02 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:09.829238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28520d9e-8e1e-4716-a680-0510a82a8a02 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:09.830420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28520d9e-8e1e-4716-a680-0510a82a8a02 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:09.830917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28520d9e-8e1e-4716-a680-0510a82a8a02 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:09.831352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28520d9e-8e1e-4716-a680-0510a82a8a02 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:09.859867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-28520d9e-8e1e-4716-a680-0510a82a8a02 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 11738ed9-de76-4b69-ab44-0844209dde02] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:17:09.886389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-73dcba3f-d969-4c81-84c4-82dbb144455a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:09.903043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-73dcba3f-d969-4c81-84c4-82dbb144455a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:09.905113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-73dcba3f-d969-4c81-84c4-82dbb144455a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:09.922790 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-73dcba3f-d969-4c81-84c4-82dbb144455a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1508 microversion: 2.91 time: 0.319566 Oct 29 01:17:09.922790 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1699/3236] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:09 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1508 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:09.934252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-de54b259-5ef4-4a99-846c-88bb28518c96 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97799c10>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:10.019763 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-de54b259-5ef4-4a99-846c-88bb28518c96 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.095989 Oct 29 01:17:10.020365 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1700/3237] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:09 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:10.371054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cfbd2efe-b24d-471d-abc8-37133dd3c0c9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:10.371928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cfbd2efe-b24d-471d-abc8-37133dd3c0c9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:10.381010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfbd2efe-b24d-471d-abc8-37133dd3c0c9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:10.381487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfbd2efe-b24d-471d-abc8-37133dd3c0c9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:10.387462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfbd2efe-b24d-471d-abc8-37133dd3c0c9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:10.388416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfbd2efe-b24d-471d-abc8-37133dd3c0c9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:10.389610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfbd2efe-b24d-471d-abc8-37133dd3c0c9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:10.390211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfbd2efe-b24d-471d-abc8-37133dd3c0c9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:10.445201 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-28520d9e-8e1e-4716-a680-0510a82a8a02 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "DELETE /compute/v2.1/servers/11738ed9-de76-4b69-ab44-0844209dde02" status: 204 len: 0 microversion: 2.47 time: 0.629220 Oct 29 01:17:10.451103 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1538/3238] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:17:09 2022] DELETE /compute/v2.1/servers/11738ed9-de76-4b69-ab44-0844209dde02 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:17:10.457962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-56b29702-223c-44ac-8747-47413632b83e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:10.458924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-56b29702-223c-44ac-8747-47413632b83e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 11738ed9-de76-4b69-ab44-0844209dde02] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:10.472922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56b29702-223c-44ac-8747-47413632b83e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:10.475361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56b29702-223c-44ac-8747-47413632b83e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:10.476755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56b29702-223c-44ac-8747-47413632b83e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:10.483481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56b29702-223c-44ac-8747-47413632b83e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:10.484398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56b29702-223c-44ac-8747-47413632b83e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:10.485249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56b29702-223c-44ac-8747-47413632b83e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:10.502188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cfbd2efe-b24d-471d-abc8-37133dd3c0c9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:10.524621 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cfbd2efe-b24d-471d-abc8-37133dd3c0c9 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1486 microversion: 2.1 time: 0.159954 Oct 29 01:17:10.534229 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1701/3239] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:10 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1486 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:10.607326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-56b29702-223c-44ac-8747-47413632b83e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:10.623698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-56b29702-223c-44ac-8747-47413632b83e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:10.625793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-56b29702-223c-44ac-8747-47413632b83e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:10.627652 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-56b29702-223c-44ac-8747-47413632b83e tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/11738ed9-de76-4b69-ab44-0844209dde02" status: 200 len: 1362 microversion: 2.47 time: 0.174998 Oct 29 01:17:10.629021 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1539/3240] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:10 2022] GET /compute/v2.1/servers/11738ed9-de76-4b69-ab44-0844209dde02 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:10.748428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fa9eca35-8c2e-40a0-b07a-83156f2bd810 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:10.749823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fa9eca35-8c2e-40a0-b07a-83156f2bd810 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:10.756369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa9eca35-8c2e-40a0-b07a-83156f2bd810 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:10.757054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa9eca35-8c2e-40a0-b07a-83156f2bd810 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:10.757704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa9eca35-8c2e-40a0-b07a-83156f2bd810 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:10.758604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa9eca35-8c2e-40a0-b07a-83156f2bd810 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:10.759745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa9eca35-8c2e-40a0-b07a-83156f2bd810 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:10.760497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa9eca35-8c2e-40a0-b07a-83156f2bd810 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:10.864119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-6645c419-d7dd-4f8d-9b77-64592ba97821 req-33f7b856-4bc5-4821-b2c7-f4469914f89f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6048315f-8aea-4750-95b0-669ad146085f", "tag": "e2d8f50f-d52b-4eae-b9d6-9a3aab2c7149"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:10.876281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6645c419-d7dd-4f8d-9b77-64592ba97821 req-33f7b856-4bc5-4821-b2c7-f4469914f89f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:10.877246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6645c419-d7dd-4f8d-9b77-64592ba97821 req-33f7b856-4bc5-4821-b2c7-f4469914f89f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:10.878711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6645c419-d7dd-4f8d-9b77-64592ba97821 req-33f7b856-4bc5-4821-b2c7-f4469914f89f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:10.898448 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-6645c419-d7dd-4f8d-9b77-64592ba97821 req-33f7b856-4bc5-4821-b2c7-f4469914f89f service nova] Creating event network-changed:e2d8f50f-d52b-4eae-b9d6-9a3aab2c7149 for instance 6048315f-8aea-4750-95b0-669ad146085f on n-h1-862964-3 Oct 29 01:17:10.906451 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-6645c419-d7dd-4f8d-9b77-64592ba97821 req-33f7b856-4bc5-4821-b2c7-f4469914f89f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047494 Oct 29 01:17:10.907802 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1540/3241] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:10.969490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-16657aab-34e4-49f3-aba6-fba04932b685 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:10.970548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-16657aab-34e4-49f3-aba6-fba04932b685 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:10.982882 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16657aab-34e4-49f3-aba6-fba04932b685 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:10.987881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16657aab-34e4-49f3-aba6-fba04932b685 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:10.988454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16657aab-34e4-49f3-aba6-fba04932b685 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:10.989587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16657aab-34e4-49f3-aba6-fba04932b685 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:10.990612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16657aab-34e4-49f3-aba6-fba04932b685 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:10.991165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16657aab-34e4-49f3-aba6-fba04932b685 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:11.011564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fa9eca35-8c2e-40a0-b07a-83156f2bd810 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:11.020555 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fa9eca35-8c2e-40a0-b07a-83156f2bd810 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1333 microversion: 2.1 time: 0.276315 Oct 29 01:17:11.021636 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1702/3242] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:10 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1333 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:11.040301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aab55be8-0929-4447-b8ad-65f95553dd07 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96e934c0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:11.074276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-16657aab-34e4-49f3-aba6-fba04932b685 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:11.089889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-16657aab-34e4-49f3-aba6-fba04932b685 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:11.092208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-16657aab-34e4-49f3-aba6-fba04932b685 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:11.098077 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-16657aab-34e4-49f3-aba6-fba04932b685 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1508 microversion: 2.91 time: 0.137583 Oct 29 01:17:11.098667 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1541/3243] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:10 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1508 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:11.102145 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aab55be8-0929-4447-b8ad-65f95553dd07 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.068883 Oct 29 01:17:11.104960 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1703/3244] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:11 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:11.559857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9828ffb2-5eba-4144-8071-a395fb077161 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:11.560962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9828ffb2-5eba-4144-8071-a395fb077161 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:11.575001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9828ffb2-5eba-4144-8071-a395fb077161 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:11.575991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9828ffb2-5eba-4144-8071-a395fb077161 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:11.576669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9828ffb2-5eba-4144-8071-a395fb077161 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:11.577446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9828ffb2-5eba-4144-8071-a395fb077161 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:11.578825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9828ffb2-5eba-4144-8071-a395fb077161 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:11.579255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9828ffb2-5eba-4144-8071-a395fb077161 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:11.658755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5fcde2ba-7a54-4aac-b228-da6a4e083de4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:11.659559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5fcde2ba-7a54-4aac-b228-da6a4e083de4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 11738ed9-de76-4b69-ab44-0844209dde02] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:11.661714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9828ffb2-5eba-4144-8071-a395fb077161 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:11.671443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5fcde2ba-7a54-4aac-b228-da6a4e083de4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:11.672360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5fcde2ba-7a54-4aac-b228-da6a4e083de4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:11.672570 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9828ffb2-5eba-4144-8071-a395fb077161 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1309 microversion: 2.1 time: 0.118062 Oct 29 01:17:11.672983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5fcde2ba-7a54-4aac-b228-da6a4e083de4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:11.673539 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1542/3245] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:11 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1309 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:11.673869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5fcde2ba-7a54-4aac-b228-da6a4e083de4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:11.674413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5fcde2ba-7a54-4aac-b228-da6a4e083de4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:11.674849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5fcde2ba-7a54-4aac-b228-da6a4e083de4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:11.785734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5fcde2ba-7a54-4aac-b228-da6a4e083de4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:11.797740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5fcde2ba-7a54-4aac-b228-da6a4e083de4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:11.800527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5fcde2ba-7a54-4aac-b228-da6a4e083de4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:11.802040 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5fcde2ba-7a54-4aac-b228-da6a4e083de4 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/11738ed9-de76-4b69-ab44-0844209dde02" status: 200 len: 1362 microversion: 2.47 time: 0.150664 Oct 29 01:17:11.823227 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1704/3246] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:11 2022] GET /compute/v2.1/servers/11738ed9-de76-4b69-ab44-0844209dde02 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:17:12.046771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-42c5312d-be46-403b-afbc-f01b43162289 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:12.048860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-42c5312d-be46-403b-afbc-f01b43162289 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:12.055143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42c5312d-be46-403b-afbc-f01b43162289 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:12.056102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42c5312d-be46-403b-afbc-f01b43162289 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:12.056775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42c5312d-be46-403b-afbc-f01b43162289 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:12.058618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42c5312d-be46-403b-afbc-f01b43162289 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:12.059357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42c5312d-be46-403b-afbc-f01b43162289 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:12.060066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42c5312d-be46-403b-afbc-f01b43162289 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:12.124329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e0107f62-ce00-4d14-9c71-1eae42b08982 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96cfbb80>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:12.195933 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e0107f62-ce00-4d14-9c71-1eae42b08982 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.075764 Oct 29 01:17:12.198921 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1705/3247] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:12 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:12.206626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9460bb3c-5abf-437c-bd08-e5b08ccc4d8e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:12.209670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9460bb3c-5abf-437c-bd08-e5b08ccc4d8e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:12.213764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9460bb3c-5abf-437c-bd08-e5b08ccc4d8e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:12.215020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9460bb3c-5abf-437c-bd08-e5b08ccc4d8e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:12.215738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9460bb3c-5abf-437c-bd08-e5b08ccc4d8e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:12.216660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9460bb3c-5abf-437c-bd08-e5b08ccc4d8e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:12.217328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9460bb3c-5abf-437c-bd08-e5b08ccc4d8e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:12.217947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9460bb3c-5abf-437c-bd08-e5b08ccc4d8e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:12.250877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-42c5312d-be46-403b-afbc-f01b43162289 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:12.267492 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-42c5312d-be46-403b-afbc-f01b43162289 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1333 microversion: 2.1 time: 0.220891 Oct 29 01:17:12.267736 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1543/3248] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:12 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1333 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:12.330289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9460bb3c-5abf-437c-bd08-e5b08ccc4d8e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:12.341089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9460bb3c-5abf-437c-bd08-e5b08ccc4d8e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:12.343587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9460bb3c-5abf-437c-bd08-e5b08ccc4d8e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:12.358268 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9460bb3c-5abf-437c-bd08-e5b08ccc4d8e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1508 microversion: 2.91 time: 0.157829 Oct 29 01:17:12.359144 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1706/3249] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:12 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:12.670286 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5e7c1165-72db-4c72-9ea5-6c2a36f6798c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-720620120", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e62dec30-5f3b-401e-84a3-a4ce3948e7e7"}], "security_groups": [{"name": "tempest-securitygroup--821545655"}], "key_name": "tempest-keypair-680022167", "user_data": "}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:12.680209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:12.695918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2e259df7-937f-494a-a802-c7cfb4de4c64 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:12.700107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2e259df7-937f-494a-a802-c7cfb4de4c64 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:12.719554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:12.726775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e259df7-937f-494a-a802-c7cfb4de4c64 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:12.729955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e259df7-937f-494a-a802-c7cfb4de4c64 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:12.730735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e259df7-937f-494a-a802-c7cfb4de4c64 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:12.732904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e259df7-937f-494a-a802-c7cfb4de4c64 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:12.735407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e259df7-937f-494a-a802-c7cfb4de4c64 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:12.737715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e259df7-937f-494a-a802-c7cfb4de4c64 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:12.806020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e259df7-937f-494a-a802-c7cfb4de4c64 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:12.807662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e259df7-937f-494a-a802-c7cfb4de4c64 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:12.808758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e259df7-937f-494a-a802-c7cfb4de4c64 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:12.810401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-2e259df7-937f-494a-a802-c7cfb4de4c64 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lazy-loading 'fault' on Instance uuid 6135c50e-cec0-4078-b9ef-bfabb3d7a52e {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:17:12.873503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2e259df7-937f-494a-a802-c7cfb4de4c64 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89f11ebd96141a5afe08dad79b0b20c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328d1dd53c6a4bc2b14376dd1a1cecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:12.884373 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2e259df7-937f-494a-a802-c7cfb4de4c64 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 200 len: 1314 microversion: 2.1 time: 0.191818 Oct 29 01:17:12.885423 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1707/3250] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:12 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:12.890906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5e14b406-a7ad-4ef2-9113-06fa0ddc1a6b tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:12.892346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5e14b406-a7ad-4ef2-9113-06fa0ddc1a6b tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 11738ed9-de76-4b69-ab44-0844209dde02] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:12.899190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e14b406-a7ad-4ef2-9113-06fa0ddc1a6b tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:12.899952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e14b406-a7ad-4ef2-9113-06fa0ddc1a6b tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:12.900765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e14b406-a7ad-4ef2-9113-06fa0ddc1a6b tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:12.902856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e14b406-a7ad-4ef2-9113-06fa0ddc1a6b tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:12.903543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e14b406-a7ad-4ef2-9113-06fa0ddc1a6b tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:12.904168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e14b406-a7ad-4ef2-9113-06fa0ddc1a6b tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:12.929705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-5e7c1165-72db-4c72-9ea5-6c2a36f6798c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] validate_networks() for [('e62dec30-5f3b-401e-84a3-a4ce3948e7e7', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:17:12.996894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5e14b406-a7ad-4ef2-9113-06fa0ddc1a6b tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:13.009219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5e14b406-a7ad-4ef2-9113-06fa0ddc1a6b tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:13.014971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5e14b406-a7ad-4ef2-9113-06fa0ddc1a6b tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:13.014971 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5e14b406-a7ad-4ef2-9113-06fa0ddc1a6b tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/11738ed9-de76-4b69-ab44-0844209dde02" status: 200 len: 1362 microversion: 2.47 time: 0.126426 Oct 29 01:17:13.014971 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1708/3251] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:12 2022] GET /compute/v2.1/servers/11738ed9-de76-4b69-ab44-0844209dde02 => generated 1362 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:13.213783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-abb80d25-a8d1-4152-8f50-eea17d4407e8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96e930d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:13.284886 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-abb80d25-a8d1-4152-8f50-eea17d4407e8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.076772 Oct 29 01:17:13.286413 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1709/3252] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:13 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:13.291275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e61d0b6d-3014-4087-8455-f0a9078b7d3d tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:13.292236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e61d0b6d-3014-4087-8455-f0a9078b7d3d tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:13.300772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e61d0b6d-3014-4087-8455-f0a9078b7d3d tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:13.301820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e61d0b6d-3014-4087-8455-f0a9078b7d3d tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:13.308286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e61d0b6d-3014-4087-8455-f0a9078b7d3d tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:13.308286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e61d0b6d-3014-4087-8455-f0a9078b7d3d tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:13.308286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e61d0b6d-3014-4087-8455-f0a9078b7d3d tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:13.308286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e61d0b6d-3014-4087-8455-f0a9078b7d3d tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:13.699864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e61d0b6d-3014-4087-8455-f0a9078b7d3d tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:13.707686 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e61d0b6d-3014-4087-8455-f0a9078b7d3d tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1333 microversion: 2.1 time: 0.419988 Oct 29 01:17:13.708275 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1710/3253] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:13 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1333 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:13.712783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-72dcba57-10a5-4aae-8649-58d0ff8743ca tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:13.716402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-72dcba57-10a5-4aae-8649-58d0ff8743ca tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:13.720154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72dcba57-10a5-4aae-8649-58d0ff8743ca tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:13.720636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72dcba57-10a5-4aae-8649-58d0ff8743ca tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:13.721069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72dcba57-10a5-4aae-8649-58d0ff8743ca tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:13.721969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72dcba57-10a5-4aae-8649-58d0ff8743ca tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:13.722423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72dcba57-10a5-4aae-8649-58d0ff8743ca tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:13.722844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72dcba57-10a5-4aae-8649-58d0ff8743ca tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:13.755445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-5e7c1165-72db-4c72-9ea5-6c2a36f6798c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:17:13.756726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-5e7c1165-72db-4c72-9ea5-6c2a36f6798c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:17:13.757340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-5e7c1165-72db-4c72-9ea5-6c2a36f6798c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:17:13.758270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-5e7c1165-72db-4c72-9ea5-6c2a36f6798c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:17:13.758852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-5e7c1165-72db-4c72-9ea5-6c2a36f6798c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:17:13.779170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e7c1165-72db-4c72-9ea5-6c2a36f6798c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:13.779681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e7c1165-72db-4c72-9ea5-6c2a36f6798c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:13.780318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e7c1165-72db-4c72-9ea5-6c2a36f6798c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:13.781079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e7c1165-72db-4c72-9ea5-6c2a36f6798c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:13.781591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e7c1165-72db-4c72-9ea5-6c2a36f6798c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:13.782026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e7c1165-72db-4c72-9ea5-6c2a36f6798c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:13.808946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-5e7c1165-72db-4c72-9ea5-6c2a36f6798c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Getting quotas for project d45b8f0077804db29ad5864327aa6bbb. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:17:13.816827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-5e7c1165-72db-4c72-9ea5-6c2a36f6798c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Getting quotas for user 7d922c9f49ff4e87b7b1ca2e10766c53 and project d45b8f0077804db29ad5864327aa6bbb. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:17:13.835983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5e7c1165-72db-4c72-9ea5-6c2a36f6798c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:17:13.839776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5e7c1165-72db-4c72-9ea5-6c2a36f6798c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:17:14.048402 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5e7c1165-72db-4c72-9ea5-6c2a36f6798c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.384413 Oct 29 01:17:14.050315 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1544/3254] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:17:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 1387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:17:14.064327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-105ff905-867e-48c5-b2f2-8ddbd9f5b63a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:14.064327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-105ff905-867e-48c5-b2f2-8ddbd9f5b63a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 6135c50e-cec0-4078-b9ef-bfabb3d7a52e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:14.068025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-105ff905-867e-48c5-b2f2-8ddbd9f5b63a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:14.068529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-105ff905-867e-48c5-b2f2-8ddbd9f5b63a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:14.069815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-105ff905-867e-48c5-b2f2-8ddbd9f5b63a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:14.070620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-105ff905-867e-48c5-b2f2-8ddbd9f5b63a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:14.071157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-105ff905-867e-48c5-b2f2-8ddbd9f5b63a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:14.071661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-105ff905-867e-48c5-b2f2-8ddbd9f5b63a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:14.087989 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-105ff905-867e-48c5-b2f2-8ddbd9f5b63a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] HTTP exception thrown: Instance 6135c50e-cec0-4078-b9ef-bfabb3d7a52e could not be found. Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-105ff905-867e-48c5-b2f2-8ddbd9f5b63a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Request method failure captured: Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e HTTP/1.1 Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH6CzaWy1ufa72id6aheZbBREgQ1G2SbUhEpvcj_QTDF--UNn0kMcxBhslM6smsky4izROjyCZSxF91rcQGlVQlVrhfbQfHOyxM9K_r3ikSiecmNSXh8mpJTcen08ouic-cdYaYkhVKjr1CpS6bd1t3acwqY6OPH7aEAkOLl4egaxt8 Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_328d1dd53c6a4bc2b14376dd1a1cecb6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: b89f11ebd96141a5afe08dad79b0b20c Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 6135c50e-cec0-4078-b9ef-bfabb3d7a52e could not be found. Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '6135c50e-cec0-4078-b9ef-bfabb3d7a52e'} Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6135c50e-cec0-4078-b9ef-bfabb3d7a52e could not be found. Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6135c50e-cec0-4078-b9ef-bfabb3d7a52e could not be found. Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.091125 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:14.095974 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.095974 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:14.095974 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:14.095974 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:14.095974 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:14.095974 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:14.095974 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6135c50e-cec0-4078-b9ef-bfabb3d7a52e could not be found. Oct 29 01:17:14.095974 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.097743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-105ff905-867e-48c5-b2f2-8ddbd9f5b63a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Returning 404 to user: Instance 6135c50e-cec0-4078-b9ef-bfabb3d7a52e could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:14.098861 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-105ff905-867e-48c5-b2f2-8ddbd9f5b63a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e" status: 404 len: 111 microversion: 2.1 time: 0.047395 Oct 29 01:17:14.099649 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1545/3255] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:14 2022] GET /compute/v2.1/servers/6135c50e-cec0-4078-b9ef-bfabb3d7a52e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:17:14.106233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7aa27af2-b1c2-47b2-aba7-2b33093ab725 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:14.107247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7aa27af2-b1c2-47b2-aba7-2b33093ab725 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 11738ed9-de76-4b69-ab44-0844209dde02] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:14.114182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7aa27af2-b1c2-47b2-aba7-2b33093ab725 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:14.115033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7aa27af2-b1c2-47b2-aba7-2b33093ab725 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:14.116503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7aa27af2-b1c2-47b2-aba7-2b33093ab725 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:14.117488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7aa27af2-b1c2-47b2-aba7-2b33093ab725 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:14.118172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7aa27af2-b1c2-47b2-aba7-2b33093ab725 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:14.132403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7aa27af2-b1c2-47b2-aba7-2b33093ab725 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:14.182453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-72dcba57-10a5-4aae-8649-58d0ff8743ca tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:14.185101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7aa27af2-b1c2-47b2-aba7-2b33093ab725 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:14.185924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7aa27af2-b1c2-47b2-aba7-2b33093ab725 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:14.190471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7aa27af2-b1c2-47b2-aba7-2b33093ab725 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:14.190471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-7aa27af2-b1c2-47b2-aba7-2b33093ab725 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lazy-loading 'fault' on Instance uuid 11738ed9-de76-4b69-ab44-0844209dde02 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:17:14.195659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-72dcba57-10a5-4aae-8649-58d0ff8743ca tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:14.197115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-72dcba57-10a5-4aae-8649-58d0ff8743ca tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:14.213310 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-72dcba57-10a5-4aae-8649-58d0ff8743ca tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1529 microversion: 2.91 time: 0.503757 Oct 29 01:17:14.214437 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1711/3256] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:13 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1529 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:14.219759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9adae2bf-50b0-4de7-abc4-1b7c4480d752 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:14.223926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9adae2bf-50b0-4de7-abc4-1b7c4480d752 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:14.331171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7aa27af2-b1c2-47b2-aba7-2b33093ab725 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:14.344371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7aa27af2-b1c2-47b2-aba7-2b33093ab725 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:14.346193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7aa27af2-b1c2-47b2-aba7-2b33093ab725 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12935cbb311c44da9dbf2c827e297af8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81eb4814cf6748558e7a3bb61b792f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:14.362474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9adae2bf-50b0-4de7-abc4-1b7c4480d752 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:14.370220 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9adae2bf-50b0-4de7-abc4-1b7c4480d752 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1236 microversion: 2.1 time: 0.153903 Oct 29 01:17:14.384809 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1712/3257] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:14 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1236 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:14.385375 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7aa27af2-b1c2-47b2-aba7-2b33093ab725 tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/11738ed9-de76-4b69-ab44-0844209dde02" status: 200 len: 1367 microversion: 2.47 time: 0.271642 Oct 29 01:17:14.392371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b00d2d58-63e5-4c25-a852-fd9a6a957f4a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '.version_select at 0x7f9d96c49f70>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:14.394143 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1546/3258] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:14 2022] GET /compute/v2.1/servers/11738ed9-de76-4b69-ab44-0844209dde02 => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-b00d2d58-63e5-4c25-a852-fd9a6a957f4a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] HTTP exception thrown: Image not found. Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b00d2d58-63e5-4c25-a852-fd9a6a957f4a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Request method failure captured: Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/images/d926c697-9eb7-493b-ba15-80e5f2762767 HTTP/1.1 Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH6CzaWy1ufa72id6aheZbBREgQ1G2SbUhEpvcj_QTDF--UNn0kMcxBhslM6smsky4izROjyCZSxF91rcQGlVQlVrhfbQfHOyxM9K_r3ikSiecmNSXh8mpJTcen08ouic-cdYaYkhVKjr1CpS6bd1t3acwqY6OPH7aEAkOLl4egaxt8 Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_328d1dd53c6a4bc2b14376dd1a1cecb6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: b89f11ebd96141a5afe08dad79b0b20c Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: exception: Image not found. Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'd926c697-9eb7-493b-ba15-80e5f2762767'} Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d926c697-9eb7-493b-ba15-80e5f2762767 to delete Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 01:17:14.467297 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d926c697-9eb7-493b-ba15-80e5f2762767 could not be found. Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b00d2d58-63e5-4c25-a852-fd9a6a957f4a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Returning 404 to user: Image not found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b00d2d58-63e5-4c25-a852-fd9a6a957f4a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "DELETE /compute/v2.1/images/d926c697-9eb7-493b-ba15-80e5f2762767" status: 404 len: 62 microversion: 2.1 time: 0.096233 Oct 29 01:17:14.473599 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1713/3259] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:14 2022] DELETE /compute/v2.1/images/d926c697-9eb7-493b-ba15-80e5f2762767 => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:17:14.478077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b49bf15-604e-4c79-89fa-b17257e7dc25 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97778940>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:14.560940 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7b49bf15-604e-4c79-89fa-b17257e7dc25 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.088992 Oct 29 01:17:14.561548 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1714/3260] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:14 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:14.575404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-57e43d78-ef36-4b57-ab15-b155b3c469b1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:14.581301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-57e43d78-ef36-4b57-ab15-b155b3c469b1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:14.584915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57e43d78-ef36-4b57-ab15-b155b3c469b1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:14.585675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57e43d78-ef36-4b57-ab15-b155b3c469b1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:14.586324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57e43d78-ef36-4b57-ab15-b155b3c469b1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:14.587287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57e43d78-ef36-4b57-ab15-b155b3c469b1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:14.588168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57e43d78-ef36-4b57-ab15-b155b3c469b1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:14.588796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57e43d78-ef36-4b57-ab15-b155b3c469b1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:14.608164 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-57e43d78-ef36-4b57-ab15-b155b3c469b1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] HTTP exception thrown: Instance 7d34640d-e769-4799-9215-b36526af8817 could not be found. Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-57e43d78-ef36-4b57-ab15-b155b3c469b1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Request method failure captured: Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 HTTP/1.1 Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH6CzaWy1ufa72id6aheZbBREgQ1G2SbUhEpvcj_QTDF--UNn0kMcxBhslM6smsky4izROjyCZSxF91rcQGlVQlVrhfbQfHOyxM9K_r3ikSiecmNSXh8mpJTcen08ouic-cdYaYkhVKjr1CpS6bd1t3acwqY6OPH7aEAkOLl4egaxt8 Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_328d1dd53c6a4bc2b14376dd1a1cecb6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: b89f11ebd96141a5afe08dad79b0b20c Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 7d34640d-e769-4799-9215-b36526af8817 could not be found. Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '7d34640d-e769-4799-9215-b36526af8817'} Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d34640d-e769-4799-9215-b36526af8817 could not be found. Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:17:14.609924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:17:14.615201 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d34640d-e769-4799-9215-b36526af8817 could not be found. Oct 29 01:17:14.615201 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.615201 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:14.615201 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.615201 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:14.615201 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:14.615201 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:14.615201 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:14.615201 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:14.615201 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d34640d-e769-4799-9215-b36526af8817 could not be found. Oct 29 01:17:14.615201 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.615201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-57e43d78-ef36-4b57-ab15-b155b3c469b1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Returning 404 to user: Instance 7d34640d-e769-4799-9215-b36526af8817 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:14.615201 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-57e43d78-ef36-4b57-ab15-b155b3c469b1 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 404 len: 111 microversion: 2.1 time: 0.046481 Oct 29 01:17:14.615201 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1715/3261] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:17:14 2022] DELETE /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:17:14.619247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-ac9fb3df-ce81-45b8-95df-4a25d5c97026 req-edfb60af-b8f3-4bf9-883f-0db2a3ba0ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9692f5b-742e-4f42-ac47-05a1e536ac05", "name": "network-vif-plugged", "status": "completed", "tag": "95874789-ba8d-4fde-af5a-a4ae2d7a894c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:14.632324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ac9fb3df-ce81-45b8-95df-4a25d5c97026 req-edfb60af-b8f3-4bf9-883f-0db2a3ba0ae8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:14.632930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ac9fb3df-ce81-45b8-95df-4a25d5c97026 req-edfb60af-b8f3-4bf9-883f-0db2a3ba0ae8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:14.633581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ac9fb3df-ce81-45b8-95df-4a25d5c97026 req-edfb60af-b8f3-4bf9-883f-0db2a3ba0ae8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:14.653175 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-ac9fb3df-ce81-45b8-95df-4a25d5c97026 req-edfb60af-b8f3-4bf9-883f-0db2a3ba0ae8 service nova] Creating event network-vif-plugged:95874789-ba8d-4fde-af5a-a4ae2d7a894c for instance d9692f5b-742e-4f42-ac47-05a1e536ac05 on n-h2-862964-3 Oct 29 01:17:14.658928 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-ac9fb3df-ce81-45b8-95df-4a25d5c97026 req-edfb60af-b8f3-4bf9-883f-0db2a3ba0ae8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045643 Oct 29 01:17:14.659824 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1716/3262] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:14.661363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-ac9fb3df-ce81-45b8-95df-4a25d5c97026 req-edfb60af-b8f3-4bf9-883f-0db2a3ba0ae8 service nova] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:14.662530 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-ac9fb3df-ce81-45b8-95df-4a25d5c97026 req-edfb60af-b8f3-4bf9-883f-0db2a3ba0ae8 service nova] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001643 Oct 29 01:17:14.663146 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1717/3263] 10.222.0.26 () {56 vars in 886 bytes} [Sat Oct 29 01:17:14 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 29 01:17:14.684251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e0d9f487-ae39-4a13-88e3-9113f52fbc3f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:14.684974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e0d9f487-ae39-4a13-88e3-9113f52fbc3f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: 7d34640d-e769-4799-9215-b36526af8817] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:14.704646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0d9f487-ae39-4a13-88e3-9113f52fbc3f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:14.705148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0d9f487-ae39-4a13-88e3-9113f52fbc3f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:14.707501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0d9f487-ae39-4a13-88e3-9113f52fbc3f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:14.708499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0d9f487-ae39-4a13-88e3-9113f52fbc3f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:14.708977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0d9f487-ae39-4a13-88e3-9113f52fbc3f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:14.710531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0d9f487-ae39-4a13-88e3-9113f52fbc3f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:14.730943 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-e0d9f487-ae39-4a13-88e3-9113f52fbc3f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] HTTP exception thrown: Instance 7d34640d-e769-4799-9215-b36526af8817 could not be found. Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e0d9f487-ae39-4a13-88e3-9113f52fbc3f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Request method failure captured: Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 HTTP/1.1 Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH6CzaWy1ufa72id6aheZbBREgQ1G2SbUhEpvcj_QTDF--UNn0kMcxBhslM6smsky4izROjyCZSxF91rcQGlVQlVrhfbQfHOyxM9K_r3ikSiecmNSXh8mpJTcen08ouic-cdYaYkhVKjr1CpS6bd1t3acwqY6OPH7aEAkOLl4egaxt8 Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_328d1dd53c6a4bc2b14376dd1a1cecb6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: b89f11ebd96141a5afe08dad79b0b20c Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 7d34640d-e769-4799-9215-b36526af8817 could not be found. Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '7d34640d-e769-4799-9215-b36526af8817'} Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d34640d-e769-4799-9215-b36526af8817 could not be found. Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d34640d-e769-4799-9215-b36526af8817 could not be found. Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.732557 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:14.738106 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.738106 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:14.738106 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:14.738106 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:14.738106 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:14.738106 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:14.738106 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d34640d-e769-4799-9215-b36526af8817 could not be found. Oct 29 01:17:14.738106 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:14.738106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e0d9f487-ae39-4a13-88e3-9113f52fbc3f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Returning 404 to user: Instance 7d34640d-e769-4799-9215-b36526af8817 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:14.738106 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e0d9f487-ae39-4a13-88e3-9113f52fbc3f tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817" status: 404 len: 111 microversion: 2.1 time: 0.069819 Oct 29 01:17:14.738106 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1718/3264] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:14 2022] GET /compute/v2.1/servers/7d34640d-e769-4799-9215-b36526af8817 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:17:14.740119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-00d07b28-eac2-4156-a330-a671134d5238 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:14.740925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-00d07b28-eac2-4156-a330-a671134d5238 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:14.748069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00d07b28-eac2-4156-a330-a671134d5238 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:14.748869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00d07b28-eac2-4156-a330-a671134d5238 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:14.749542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00d07b28-eac2-4156-a330-a671134d5238 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:14.750602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00d07b28-eac2-4156-a330-a671134d5238 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:14.751387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00d07b28-eac2-4156-a330-a671134d5238 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:14.751984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00d07b28-eac2-4156-a330-a671134d5238 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:14.772465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-da1fd669-0620-4dd4-8deb-250a924485c7 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:14.774586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-da1fd669-0620-4dd4-8deb-250a924485c7 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:14.787921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-da1fd669-0620-4dd4-8deb-250a924485c7 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:14.791034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-da1fd669-0620-4dd4-8deb-250a924485c7 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:14.791505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-da1fd669-0620-4dd4-8deb-250a924485c7 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:14.792565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-da1fd669-0620-4dd4-8deb-250a924485c7 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:14.795222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-da1fd669-0620-4dd4-8deb-250a924485c7 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:14.797240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-da1fd669-0620-4dd4-8deb-250a924485c7 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:14.928449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-da1fd669-0620-4dd4-8deb-250a924485c7 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lazy-loading 'services' on Instance uuid 6e3a11cb-1999-468d-858f-dd5eb0fc275a {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:17:14.948908 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-da1fd669-0620-4dd4-8deb-250a924485c7 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1934 microversion: 2.91 time: 0.552954 Oct 29 01:17:14.949726 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1547/3265] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:14 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1934 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:14.957263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-275263be-7e77-4f93-841d-65d86c5a604a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '.version_select at 0x7f9d97440dc0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:15.066632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-00d07b28-eac2-4156-a330-a671134d5238 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:15.077672 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-00d07b28-eac2-4156-a330-a671134d5238 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1333 microversion: 2.1 time: 0.340819 Oct 29 01:17:15.078572 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1719/3266] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:14 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1333 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:15.083766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5b044f3d-b9f6-4e17-8169-db08e0a57f16 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:15.084501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5b044f3d-b9f6-4e17-8169-db08e0a57f16 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:15.091530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b044f3d-b9f6-4e17-8169-db08e0a57f16 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:15.092218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b044f3d-b9f6-4e17-8169-db08e0a57f16 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:15.093046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b044f3d-b9f6-4e17-8169-db08e0a57f16 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:15.093934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b044f3d-b9f6-4e17-8169-db08e0a57f16 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:15.094574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b044f3d-b9f6-4e17-8169-db08e0a57f16 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:15.095051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b044f3d-b9f6-4e17-8169-db08e0a57f16 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:15.107916 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-275263be-7e77-4f93-841d-65d86c5a604a tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-79084493" status: 202 len: 0 microversion: 2.1 time: 0.157100 Oct 29 01:17:15.111710 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1548/3267] 10.222.0.26 () {58 vars in 1215 bytes} [Sat Oct 29 01:17:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-79084493 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:17:15.210143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-5b044f3d-b9f6-4e17-8169-db08e0a57f16 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lazy-loading 'services' on Instance uuid 6e3a11cb-1999-468d-858f-dd5eb0fc275a {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:17:15.228863 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5b044f3d-b9f6-4e17-8169-db08e0a57f16 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1934 microversion: 2.91 time: 0.149059 Oct 29 01:17:15.229663 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1720/3268] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:15 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1934 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:15.257417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cea36f00-ded9-43bf-93bb-fc371536a4a8 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:15.262276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cea36f00-ded9-43bf-93bb-fc371536a4a8 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:15.262842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cea36f00-ded9-43bf-93bb-fc371536a4a8 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:15.263385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cea36f00-ded9-43bf-93bb-fc371536a4a8 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:15.264306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cea36f00-ded9-43bf-93bb-fc371536a4a8 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:15.264835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cea36f00-ded9-43bf-93bb-fc371536a4a8 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:15.265458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cea36f00-ded9-43bf-93bb-fc371536a4a8 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:15.273624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:15.280468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:15.294282 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cea36f00-ded9-43bf-93bb-fc371536a4a8 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.040392 Oct 29 01:17:15.294897 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1549/3269] 10.222.0.26 () {60 vars in 1217 bytes} [Sat Oct 29 01:17:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:17:15.308577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3cbeb526-efcd-4cf3-a31e-0549300c5d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:15.309118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3cbeb526-efcd-4cf3-a31e-0549300c5d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:15.315564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3cbeb526-efcd-4cf3-a31e-0549300c5d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:15.316054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3cbeb526-efcd-4cf3-a31e-0549300c5d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:15.316529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3cbeb526-efcd-4cf3-a31e-0549300c5d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:15.317286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3cbeb526-efcd-4cf3-a31e-0549300c5d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:15.317747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3cbeb526-efcd-4cf3-a31e-0549300c5d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:15.318170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3cbeb526-efcd-4cf3-a31e-0549300c5d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:15.322515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:15.342286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-3cbeb526-efcd-4cf3-a31e-0549300c5d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lazy-loading 'flavor' on Instance uuid 6e3a11cb-1999-468d-858f-dd5eb0fc275a {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:17:15.402967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6be972a7-97f0-40fc-a89d-3facdbea2bc6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:15.403716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6be972a7-97f0-40fc-a89d-3facdbea2bc6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:15.478122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6be972a7-97f0-40fc-a89d-3facdbea2bc6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:15.493718 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6be972a7-97f0-40fc-a89d-3facdbea2bc6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1236 microversion: 2.1 time: 0.096894 Oct 29 01:17:15.500002 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1550/3270] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:15 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1236 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:15.522343 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-98ef0c14-ee00-4c2c-a9e2-101c0e43eb1a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:15.524130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-98ef0c14-ee00-4c2c-a9e2-101c0e43eb1a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] [instance: 11738ed9-de76-4b69-ab44-0844209dde02] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:15.539075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98ef0c14-ee00-4c2c-a9e2-101c0e43eb1a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:15.539578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98ef0c14-ee00-4c2c-a9e2-101c0e43eb1a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:15.540023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98ef0c14-ee00-4c2c-a9e2-101c0e43eb1a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:15.540852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98ef0c14-ee00-4c2c-a9e2-101c0e43eb1a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:15.541330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98ef0c14-ee00-4c2c-a9e2-101c0e43eb1a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:15.541825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98ef0c14-ee00-4c2c-a9e2-101c0e43eb1a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:15.558568 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-98ef0c14-ee00-4c2c-a9e2-101c0e43eb1a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] HTTP exception thrown: Instance 11738ed9-de76-4b69-ab44-0844209dde02 could not be found. Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-98ef0c14-ee00-4c2c-a9e2-101c0e43eb1a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Request method failure captured: Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/11738ed9-de76-4b69-ab44-0844209dde02 HTTP/1.1 Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7TTme0BhyqxOvZWhT6QzCbeEnXR6TD4vzbSKwf2TjfWOxKhYpCBVBhIiwJ2TuJRdPFeAB0-BCPFTggf6jZTyeHPF1AdPoP7X6FXc4hFM_vWDcYt21eYQ4k5se-qQlKQoT4rVTkQ9dA1sGVyqZwXszRFiV4BcMoBOA7yfJYyxP2Rgs Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-Openstack-Nova-Api-Version: 2.47 Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 81eb4814cf6748558e7a3bb61b792f0d Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerShowV247Test-423930010 Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81eb4814cf6748558e7a3bb61b792f0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/81eb4814cf6748558e7a3bb61b792f0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81eb4814cf6748558e7a3bb61b792f0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_81eb4814cf6748558e7a3bb61b792f0d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerShowV247Test-423930010 Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 81eb4814cf6748558e7a3bb61b792f0d Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerShowV247Test-423930010 Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerShowV247Test-423930010-project Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 12935cbb311c44da9dbf2c827e297af8 Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerShowV247Test-423930010-project Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 11738ed9-de76-4b69-ab44-0844209dde02 could not be found. Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '11738ed9-de76-4b69-ab44-0844209dde02'} Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11738ed9-de76-4b69-ab44-0844209dde02 could not be found. Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11738ed9-de76-4b69-ab44-0844209dde02 could not be found. Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:15.560292 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:15.569044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:15.569044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:15.569044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:15.569044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:15.569044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:15.569044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11738ed9-de76-4b69-ab44-0844209dde02 could not be found. Oct 29 01:17:15.569044 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:15.569044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-98ef0c14-ee00-4c2c-a9e2-101c0e43eb1a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] Returning 404 to user: Instance 11738ed9-de76-4b69-ab44-0844209dde02 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:15.569044 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-98ef0c14-ee00-4c2c-a9e2-101c0e43eb1a tempest-ServerShowV247Test-423930010 tempest-ServerShowV247Test-423930010-project] 10.222.0.26 "GET /compute/v2.1/servers/11738ed9-de76-4b69-ab44-0844209dde02" status: 404 len: 111 microversion: 2.47 time: 0.060756 Oct 29 01:17:15.569044 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1551/3271] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:15 2022] GET /compute/v2.1/servers/11738ed9-de76-4b69-ab44-0844209dde02 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:17:15.587914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f3d2fcb1-cef4-4388-8909-3dc438203e81 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9ff23a60>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:15.643651 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f3d2fcb1-cef4-4388-8909-3dc438203e81 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.060924 Oct 29 01:17:15.644795 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1552/3272] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:15 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:16.012094 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3cbeb526-efcd-4cf3-a31e-0549300c5d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "POST /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a/action" status: 202 len: 0 microversion: 2.91 time: 0.706792 Oct 29 01:17:16.013555 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1721/3273] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 29 01:17:15 2022] POST /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a/action => generated 0 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:17:16.030405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2b229da4-ed9a-4bb3-a2c3-3e8f106e6358 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:16.037498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2b229da4-ed9a-4bb3-a2c3-3e8f106e6358 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:16.050549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b229da4-ed9a-4bb3-a2c3-3e8f106e6358 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:16.051134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b229da4-ed9a-4bb3-a2c3-3e8f106e6358 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:16.057274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b229da4-ed9a-4bb3-a2c3-3e8f106e6358 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:16.058251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b229da4-ed9a-4bb3-a2c3-3e8f106e6358 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:16.058560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b229da4-ed9a-4bb3-a2c3-3e8f106e6358 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:16.058994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b229da4-ed9a-4bb3-a2c3-3e8f106e6358 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:16.103236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-992c0a92-fa66-467b-a028-b7025cce3481 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:16.104305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-992c0a92-fa66-467b-a028-b7025cce3481 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:16.129364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-992c0a92-fa66-467b-a028-b7025cce3481 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:16.129364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-992c0a92-fa66-467b-a028-b7025cce3481 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:16.129364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-992c0a92-fa66-467b-a028-b7025cce3481 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:16.129364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-992c0a92-fa66-467b-a028-b7025cce3481 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:16.129364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-992c0a92-fa66-467b-a028-b7025cce3481 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:16.129364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-992c0a92-fa66-467b-a028-b7025cce3481 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:16.200020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2b229da4-ed9a-4bb3-a2c3-3e8f106e6358 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:16.209209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2b229da4-ed9a-4bb3-a2c3-3e8f106e6358 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:16.210744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2b229da4-ed9a-4bb3-a2c3-3e8f106e6358 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:16.217401 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2b229da4-ed9a-4bb3-a2c3-3e8f106e6358 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.199780 Oct 29 01:17:16.217963 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1553/3274] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:16 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:16.269296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ebed2cd0-d1e6-4ae8-9403-7c4050827b0c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '.version_select at 0x7f9d97acd310>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:16.295833 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-ebed2cd0-d1e6-4ae8-9403-7c4050827b0c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] HTTP exception thrown: Image not found. Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ebed2cd0-d1e6-4ae8-9403-7c4050827b0c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Request method failure captured: Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/images/cd1aa078-eb67-4031-afe9-08df7b75babe HTTP/1.1 Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH6CzaWy1ufa72id6aheZbBREgQ1G2SbUhEpvcj_QTDF--UNn0kMcxBhslM6smsky4izROjyCZSxF91rcQGlVQlVrhfbQfHOyxM9K_r3ikSiecmNSXh8mpJTcen08ouic-cdYaYkhVKjr1CpS6bd1t3acwqY6OPH7aEAkOLl4egaxt8 Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_328d1dd53c6a4bc2b14376dd1a1cecb6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: b89f11ebd96141a5afe08dad79b0b20c Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: exception: Image not found. Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'cd1aa078-eb67-4031-afe9-08df7b75babe'} Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cd1aa078-eb67-4031-afe9-08df7b75babe to delete Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cd1aa078-eb67-4031-afe9-08df7b75babe could not be found. Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:16.305874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ebed2cd0-d1e6-4ae8-9403-7c4050827b0c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Returning 404 to user: Image not found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ebed2cd0-d1e6-4ae8-9403-7c4050827b0c tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "DELETE /compute/v2.1/images/cd1aa078-eb67-4031-afe9-08df7b75babe" status: 404 len: 62 microversion: 2.1 time: 0.042076 Oct 29 01:17:16.310494 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1554/3275] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:16 2022] DELETE /compute/v2.1/images/cd1aa078-eb67-4031-afe9-08df7b75babe => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 01:17:16.325342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b8806729-0df3-4c10-a441-bb35912a4ef0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:16.328999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b8806729-0df3-4c10-a441-bb35912a4ef0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:16.338377 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8806729-0df3-4c10-a441-bb35912a4ef0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:16.338899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8806729-0df3-4c10-a441-bb35912a4ef0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:16.339540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8806729-0df3-4c10-a441-bb35912a4ef0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:16.340266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8806729-0df3-4c10-a441-bb35912a4ef0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:16.340813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8806729-0df3-4c10-a441-bb35912a4ef0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:16.341259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8806729-0df3-4c10-a441-bb35912a4ef0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:16.360999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-992c0a92-fa66-467b-a028-b7025cce3481 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:16.365711 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-b8806729-0df3-4c10-a441-bb35912a4ef0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] HTTP exception thrown: Instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 could not be found. Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b8806729-0df3-4c10-a441-bb35912a4ef0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Request method failure captured: Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 HTTP/1.1 Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH6CzaWy1ufa72id6aheZbBREgQ1G2SbUhEpvcj_QTDF--UNn0kMcxBhslM6smsky4izROjyCZSxF91rcQGlVQlVrhfbQfHOyxM9K_r3ikSiecmNSXh8mpJTcen08ouic-cdYaYkhVKjr1CpS6bd1t3acwqY6OPH7aEAkOLl4egaxt8 Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_328d1dd53c6a4bc2b14376dd1a1cecb6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: b89f11ebd96141a5afe08dad79b0b20c Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 could not be found. Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'cfc8b0b3-923e-4144-a9ca-aeb9da2897f7'} Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 could not be found. Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:17:16.367284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:17:16.372903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 could not be found. Oct 29 01:17:16.372903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:16.372903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:16.372903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:16.372903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:16.372903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:16.372903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:16.372903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:16.372903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:16.372903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 could not be found. Oct 29 01:17:16.372903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:16.372903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b8806729-0df3-4c10-a441-bb35912a4ef0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Returning 404 to user: Instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:16.372903 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b8806729-0df3-4c10-a441-bb35912a4ef0 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 404 len: 111 microversion: 2.1 time: 0.051829 Oct 29 01:17:16.372903 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1555/3276] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:17:16 2022] DELETE /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:17:16.374038 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-992c0a92-fa66-467b-a028-b7025cce3481 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1333 microversion: 2.1 time: 0.271203 Oct 29 01:17:16.377301 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1722/3277] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:16 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1333 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:16.390984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-223a6d2a-363b-4885-abfa-62a4ff176876 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:16.391666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-223a6d2a-363b-4885-abfa-62a4ff176876 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] [instance: cfc8b0b3-923e-4144-a9ca-aeb9da2897f7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:16.398059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-223a6d2a-363b-4885-abfa-62a4ff176876 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:16.398543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-223a6d2a-363b-4885-abfa-62a4ff176876 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:16.398987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-223a6d2a-363b-4885-abfa-62a4ff176876 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:16.399949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-223a6d2a-363b-4885-abfa-62a4ff176876 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:16.400573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-223a6d2a-363b-4885-abfa-62a4ff176876 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:16.401216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-223a6d2a-363b-4885-abfa-62a4ff176876 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:16.416387 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-223a6d2a-363b-4885-abfa-62a4ff176876 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] HTTP exception thrown: Instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 could not be found. Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-223a6d2a-363b-4885-abfa-62a4ff176876 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Request method failure captured: Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 HTTP/1.1 Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH6CzaWy1ufa72id6aheZbBREgQ1G2SbUhEpvcj_QTDF--UNn0kMcxBhslM6smsky4izROjyCZSxF91rcQGlVQlVrhfbQfHOyxM9K_r3ikSiecmNSXh8mpJTcen08ouic-cdYaYkhVKjr1CpS6bd1t3acwqY6OPH7aEAkOLl4egaxt8 Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/328d1dd53c6a4bc2b14376dd1a1cecb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_328d1dd53c6a4bc2b14376dd1a1cecb6", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 328d1dd53c6a4bc2b14376dd1a1cecb6 Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-261033755 Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: b89f11ebd96141a5afe08dad79b0b20c Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-261033755-project Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 could not be found. Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'cfc8b0b3-923e-4144-a9ca-aeb9da2897f7'} Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 could not be found. Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 could not be found. Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:16.418297 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:16.422551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:16.422551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:16.422551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:16.422551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:16.422551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:16.422551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:16.422551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 could not be found. Oct 29 01:17:16.422551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:16.423831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-223a6d2a-363b-4885-abfa-62a4ff176876 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] Returning 404 to user: Instance cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:16.424703 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-223a6d2a-363b-4885-abfa-62a4ff176876 tempest-ImagesOneServerNegativeTestJSON-261033755 tempest-ImagesOneServerNegativeTestJSON-261033755-project] 10.222.0.26 "GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7" status: 404 len: 111 microversion: 2.1 time: 0.043633 Oct 29 01:17:16.425875 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1556/3278] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:16 2022] GET /compute/v2.1/servers/cfc8b0b3-923e-4144-a9ca-aeb9da2897f7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:17:16.528668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8d31fe47-c8b3-4d8e-bab1-a8d444e8d645 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:16.529595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8d31fe47-c8b3-4d8e-bab1-a8d444e8d645 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:16.542971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d31fe47-c8b3-4d8e-bab1-a8d444e8d645 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:16.542971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d31fe47-c8b3-4d8e-bab1-a8d444e8d645 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:16.542971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d31fe47-c8b3-4d8e-bab1-a8d444e8d645 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:16.542971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d31fe47-c8b3-4d8e-bab1-a8d444e8d645 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:16.544133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d31fe47-c8b3-4d8e-bab1-a8d444e8d645 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:16.544540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d31fe47-c8b3-4d8e-bab1-a8d444e8d645 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:16.619338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8d31fe47-c8b3-4d8e-bab1-a8d444e8d645 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:16.627843 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8d31fe47-c8b3-4d8e-bab1-a8d444e8d645 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1232 microversion: 2.1 time: 0.104149 Oct 29 01:17:16.628836 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1723/3279] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:16 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1232 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:16.662125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3d8d2d9f-92e2-47cc-a6d0-70d6089344c8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9fe3eb80>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:16.732084 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3d8d2d9f-92e2-47cc-a6d0-70d6089344c8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.075691 Oct 29 01:17:16.732659 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1557/3280] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:16 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:17.248650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0c89087a-70b5-4a43-b73a-772c8ba3f88f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:17.251002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0c89087a-70b5-4a43-b73a-772c8ba3f88f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:17.262191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c89087a-70b5-4a43-b73a-772c8ba3f88f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:17.262949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c89087a-70b5-4a43-b73a-772c8ba3f88f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:17.263556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c89087a-70b5-4a43-b73a-772c8ba3f88f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:17.264464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c89087a-70b5-4a43-b73a-772c8ba3f88f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:17.265477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c89087a-70b5-4a43-b73a-772c8ba3f88f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:17.266728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c89087a-70b5-4a43-b73a-772c8ba3f88f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:17.399363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a10fb1cc-04fe-4ecc-899f-5ded0fcad5d0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:17.403160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a10fb1cc-04fe-4ecc-899f-5ded0fcad5d0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:17.409012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0c89087a-70b5-4a43-b73a-772c8ba3f88f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:17.423806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0c89087a-70b5-4a43-b73a-772c8ba3f88f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:17.428393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0c89087a-70b5-4a43-b73a-772c8ba3f88f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:17.431481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a10fb1cc-04fe-4ecc-899f-5ded0fcad5d0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:17.431963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a10fb1cc-04fe-4ecc-899f-5ded0fcad5d0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:17.432482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a10fb1cc-04fe-4ecc-899f-5ded0fcad5d0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:17.436140 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0c89087a-70b5-4a43-b73a-772c8ba3f88f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.193210 Oct 29 01:17:17.436981 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1724/3281] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:17 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:17.454581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a10fb1cc-04fe-4ecc-899f-5ded0fcad5d0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:17.455536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a10fb1cc-04fe-4ecc-899f-5ded0fcad5d0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:17.456543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a10fb1cc-04fe-4ecc-899f-5ded0fcad5d0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:17.665319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8cca0de9-8d1b-4e1c-bfb6-634474ea4397 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:17.666220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8cca0de9-8d1b-4e1c-bfb6-634474ea4397 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:17.695873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cca0de9-8d1b-4e1c-bfb6-634474ea4397 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:17.697510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cca0de9-8d1b-4e1c-bfb6-634474ea4397 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:17.699546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cca0de9-8d1b-4e1c-bfb6-634474ea4397 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:17.703511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cca0de9-8d1b-4e1c-bfb6-634474ea4397 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:17.705009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cca0de9-8d1b-4e1c-bfb6-634474ea4397 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:17.707273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cca0de9-8d1b-4e1c-bfb6-634474ea4397 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:17.931549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8cca0de9-8d1b-4e1c-bfb6-634474ea4397 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:17.943643 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8cca0de9-8d1b-4e1c-bfb6-634474ea4397 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1288 microversion: 2.1 time: 0.283583 Oct 29 01:17:17.944275 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1725/3282] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:17 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1288 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:17.974825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a10fb1cc-04fe-4ecc-899f-5ded0fcad5d0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:17.982366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-db391f31-8ba8-4fbd-8849-51bd6fb976fd tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96c41b80>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:17.987525 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a10fb1cc-04fe-4ecc-899f-5ded0fcad5d0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1333 microversion: 2.1 time: 0.595330 Oct 29 01:17:17.988176 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1558/3283] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:17 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1333 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:18.096988 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-db391f31-8ba8-4fbd-8849-51bd6fb976fd tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.130892 Oct 29 01:17:18.097367 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1726/3284] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:17 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:18.466980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-06a9e35d-a351-47b2-83b4-a5702856dd54 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:18.470028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-06a9e35d-a351-47b2-83b4-a5702856dd54 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:18.486216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06a9e35d-a351-47b2-83b4-a5702856dd54 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:18.487081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06a9e35d-a351-47b2-83b4-a5702856dd54 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:18.487783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06a9e35d-a351-47b2-83b4-a5702856dd54 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:18.489407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06a9e35d-a351-47b2-83b4-a5702856dd54 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:18.490334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06a9e35d-a351-47b2-83b4-a5702856dd54 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:18.490995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06a9e35d-a351-47b2-83b4-a5702856dd54 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:18.546769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e760f9a7-843b-41dd-b87d-c4a1edcb5d40 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] Action: 'create', calling method: .version_select at 0x7f9d97acd9d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1896282546", "metadata": {"Type": "work"}}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e760f9a7-843b-41dd-b87d-c4a1edcb5d40 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] Request method failure captured: Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 122 Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH8drkd5UrTFq5fpjNZSKLmn8FW36_pbNcyff6dwzO5lIOWW_MxcHigpfcAkZiSAKSXpGei7ZU8V3EEyC1TaFma_RbpFSlmWE2o90MzFD_yeEXKzek3q87s763ib1e5j8umwsD0gdWS8d9nEvvyWbDdix0Cr2Z_SDKPlOqEXseYcCJQ Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 693cf2c9184640568ffb9217ab061de3 Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-VolumesNegativeTest-606797290 Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/693cf2c9184640568ffb9217ab061de3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/693cf2c9184640568ffb9217ab061de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/693cf2c9184640568ffb9217ab061de3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_693cf2c9184640568ffb9217ab061de3", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-VolumesNegativeTest-606797290 Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 693cf2c9184640568ffb9217ab061de3 Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-VolumesNegativeTest-606797290 Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-VolumesNegativeTest-606797290-project Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 1b4be7c1a1244fdb9da91902e366d2e6 Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-VolumesNegativeTest-606797290-project Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1896282546", "metadata": {"Type": "work"}}} Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1896282546', 'metadata': {'Type': 'work'}}}} Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi '#$%' Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:17:18.552417 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:17:18.558931 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 29 01:17:18.558931 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.558931 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:18.558931 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.558931 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.558931 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:18.558931 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:18.558931 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:17:18.558931 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:17:18.558931 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 29 01:17:18.558931 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.558931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e760f9a7-843b-41dd-b87d-c4a1edcb5d40 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:18.558931 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e760f9a7-843b-41dd-b87d-c4a1edcb5d40 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.561871 Oct 29 01:17:18.558931 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1559/3285] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 29 01:17:17 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 563 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:17:18.578795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c2f3c8a-65c3-4c92-b3f2-76c8d1427a40 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] Action: 'create', calling method: .version_select at 0x7f9d9fd3f430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-322053414", "metadata": {"Type": "work"}}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c2f3c8a-65c3-4c92-b3f2-76c8d1427a40 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] Request method failure captured: Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 119 Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH8drkd5UrTFq5fpjNZSKLmn8FW36_pbNcyff6dwzO5lIOWW_MxcHigpfcAkZiSAKSXpGei7ZU8V3EEyC1TaFma_RbpFSlmWE2o90MzFD_yeEXKzek3q87s763ib1e5j8umwsD0gdWS8d9nEvvyWbDdix0Cr2Z_SDKPlOqEXseYcCJQ Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 693cf2c9184640568ffb9217ab061de3 Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-VolumesNegativeTest-606797290 Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/693cf2c9184640568ffb9217ab061de3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/693cf2c9184640568ffb9217ab061de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/693cf2c9184640568ffb9217ab061de3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_693cf2c9184640568ffb9217ab061de3", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-VolumesNegativeTest-606797290 Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 693cf2c9184640568ffb9217ab061de3 Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-VolumesNegativeTest-606797290 Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-VolumesNegativeTest-606797290-project Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 1b4be7c1a1244fdb9da91902e366d2e6 Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-VolumesNegativeTest-606797290-project Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-322053414", "metadata": {"Type": "work"}}} Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-322053414', 'metadata': {'Type': 'work'}}}} Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi '0' Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:17:18.594549 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:17:18.600113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 29 01:17:18.600113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.600113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:18.600113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.600113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.600113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:18.600113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:18.600113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:17:18.600113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:17:18.600113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 29 01:17:18.600113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.600113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c2f3c8a-65c3-4c92-b3f2-76c8d1427a40 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:18.600113 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9c2f3c8a-65c3-4c92-b3f2-76c8d1427a40 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.033271 Oct 29 01:17:18.600113 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1560/3286] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 29 01:17:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:17:18.613520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-164b9d81-8a14-486a-b0a3-a593dba5df53 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] Action: 'create', calling method: .version_select at 0x7f9d9747fe50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1468383857", "metadata": {"Type": "work"}}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:18.627702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-06a9e35d-a351-47b2-83b4-a5702856dd54 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-164b9d81-8a14-486a-b0a3-a593dba5df53 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] Request method failure captured: Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 119 Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH8drkd5UrTFq5fpjNZSKLmn8FW36_pbNcyff6dwzO5lIOWW_MxcHigpfcAkZiSAKSXpGei7ZU8V3EEyC1TaFma_RbpFSlmWE2o90MzFD_yeEXKzek3q87s763ib1e5j8umwsD0gdWS8d9nEvvyWbDdix0Cr2Z_SDKPlOqEXseYcCJQ Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 693cf2c9184640568ffb9217ab061de3 Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-VolumesNegativeTest-606797290 Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/693cf2c9184640568ffb9217ab061de3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/693cf2c9184640568ffb9217ab061de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/693cf2c9184640568ffb9217ab061de3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_693cf2c9184640568ffb9217ab061de3", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-VolumesNegativeTest-606797290 Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 693cf2c9184640568ffb9217ab061de3 Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-VolumesNegativeTest-606797290 Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-VolumesNegativeTest-606797290-project Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 1b4be7c1a1244fdb9da91902e366d2e6 Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-VolumesNegativeTest-606797290-project Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1468383857", "metadata": {"Type": "work"}}} Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1468383857', 'metadata': {'Type': 'work'}}}} Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi '' Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:17:18.630221 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:17:18.634352 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 29 01:17:18.634352 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.634352 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:18.634352 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.634352 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.634352 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:18.634352 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:18.634352 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:17:18.634352 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:17:18.634352 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 29 01:17:18.634352 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.640163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-164b9d81-8a14-486a-b0a3-a593dba5df53 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:18.640778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-06a9e35d-a351-47b2-83b4-a5702856dd54 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:18.642471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-06a9e35d-a351-47b2-83b4-a5702856dd54 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:18.643374 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-164b9d81-8a14-486a-b0a3-a593dba5df53 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.038609 Oct 29 01:17:18.645306 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1561/3287] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 29 01:17:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:17:18.648662 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-06a9e35d-a351-47b2-83b4-a5702856dd54 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.187757 Oct 29 01:17:18.650456 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1727/3288] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:18 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:18.669865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b5d5e1b2-ced3-4c7a-8c9b-2140507f9b83 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] Calling method '.version_select at 0x7f9d9fe33f70>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:18.714985 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-b5d5e1b2-ced3-4c7a-8c9b-2140507f9b83 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] HTTP exception thrown: Volume tempest-invalid-1478275700 could not be found. Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b5d5e1b2-ced3-4c7a-8c9b-2140507f9b83 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] Request method failure captured: Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1478275700 HTTP/1.1 Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH8drkd5UrTFq5fpjNZSKLmn8FW36_pbNcyff6dwzO5lIOWW_MxcHigpfcAkZiSAKSXpGei7ZU8V3EEyC1TaFma_RbpFSlmWE2o90MzFD_yeEXKzek3q87s763ib1e5j8umwsD0gdWS8d9nEvvyWbDdix0Cr2Z_SDKPlOqEXseYcCJQ Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 693cf2c9184640568ffb9217ab061de3 Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-VolumesNegativeTest-606797290 Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/693cf2c9184640568ffb9217ab061de3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/693cf2c9184640568ffb9217ab061de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/693cf2c9184640568ffb9217ab061de3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_693cf2c9184640568ffb9217ab061de3", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-VolumesNegativeTest-606797290 Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 693cf2c9184640568ffb9217ab061de3 Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-VolumesNegativeTest-606797290 Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-VolumesNegativeTest-606797290-project Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 1b4be7c1a1244fdb9da91902e366d2e6 Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-VolumesNegativeTest-606797290-project Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: exception: Volume tempest-invalid-1478275700 could not be found. Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'tempest-invalid-1478275700'} Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1478275700 could not be found. (HTTP 404) (Request-ID: req-8f04a89f-b9ec-4453-9eb3-326f0c9236c0) Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 01:17:18.754009 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1478275700 could not be found. Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1478275700 could not be found. Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1478275700 could not be found. Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.760260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b5d5e1b2-ced3-4c7a-8c9b-2140507f9b83 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] Returning 404 to user: Volume tempest-invalid-1478275700 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:18.771480 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b5d5e1b2-ced3-4c7a-8c9b-2140507f9b83 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1478275700" status: 404 len: 99 microversion: 2.1 time: 0.109527 Oct 29 01:17:18.779119 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1562/3289] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 29 01:17:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1478275700 => generated 99 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:17:18.783131 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8587b9a1-a383-4778-947f-65bb3afea28d tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004959 Oct 29 01:17:18.784292 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1728/3290] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Oct 29 01:17:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 01:17:18.794567 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6eff4798-74c2-4d7e-af6e-5af0275e8faa tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005183 Oct 29 01:17:18.808523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e2dc5d1-8977-4cdd-a895-4d21d56757c7 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] Calling method '.version_select at 0x7f9d96c41b80>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:18.810804 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1563/3291] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:17:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 01:17:18.871745 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-8e2dc5d1-8977-4cdd-a895-4d21d56757c7 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] HTTP exception thrown: Volume c2c373fb-dec8-4602-aba6-aed83e86eadb could not be found. Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e2dc5d1-8977-4cdd-a895-4d21d56757c7 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] Request method failure captured: Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/os-volumes/c2c373fb-dec8-4602-aba6-aed83e86eadb HTTP/1.1 Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8drkd5UrTFq5fpjNZSKLmn8FW36_pbNcyff6dwzO5lIOWW_MxcHigpfcAkZiSAKSXpGei7ZU8V3EEyC1TaFma_RbpFSlmWE2o90MzFD_yeEXKzek3q87s763ib1e5j8umwsD0gdWS8d9nEvvyWbDdix0Cr2Z_SDKPlOqEXseYcCJQ Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 693cf2c9184640568ffb9217ab061de3 Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-VolumesNegativeTest-606797290 Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/693cf2c9184640568ffb9217ab061de3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/693cf2c9184640568ffb9217ab061de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/693cf2c9184640568ffb9217ab061de3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_693cf2c9184640568ffb9217ab061de3", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-VolumesNegativeTest-606797290 Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 693cf2c9184640568ffb9217ab061de3 Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-VolumesNegativeTest-606797290 Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-VolumesNegativeTest-606797290-project Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 1b4be7c1a1244fdb9da91902e366d2e6 Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-VolumesNegativeTest-606797290-project Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: exception: Volume c2c373fb-dec8-4602-aba6-aed83e86eadb could not be found. Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'c2c373fb-dec8-4602-aba6-aed83e86eadb'} Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c2c373fb-dec8-4602-aba6-aed83e86eadb could not be found. (HTTP 404) (Request-ID: req-622df82b-16ba-4657-85e9-6de9337ae228) Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 01:17:18.875499 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c2c373fb-dec8-4602-aba6-aed83e86eadb could not be found. Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c2c373fb-dec8-4602-aba6-aed83e86eadb could not be found. Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c2c373fb-dec8-4602-aba6-aed83e86eadb could not be found. Oct 29 01:17:18.881669 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.885596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e2dc5d1-8977-4cdd-a895-4d21d56757c7 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] Returning 404 to user: Volume c2c373fb-dec8-4602-aba6-aed83e86eadb could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:18.886797 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8e2dc5d1-8977-4cdd-a895-4d21d56757c7 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/c2c373fb-dec8-4602-aba6-aed83e86eadb" status: 404 len: 109 microversion: 2.1 time: 0.085388 Oct 29 01:17:18.887527 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1729/3292] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 29 01:17:18 2022] DELETE /compute/v2.1/os-volumes/c2c373fb-dec8-4602-aba6-aed83e86eadb => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:17:18.897558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a435aff1-5ba0-4c47-ab2c-ea6dfc3a46b9 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] Calling method '.version_select at 0x7f9d9fd3faf0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:18.939571 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-a435aff1-5ba0-4c47-ab2c-ea6dfc3a46b9 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] HTTP exception thrown: Volume 0bacfff7-ce52-40f6-ba16-f2ed480eb9f0 could not be found. Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a435aff1-5ba0-4c47-ab2c-ea6dfc3a46b9 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] Request method failure captured: Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-volumes/0bacfff7-ce52-40f6-ba16-f2ed480eb9f0 HTTP/1.1 Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH8drkd5UrTFq5fpjNZSKLmn8FW36_pbNcyff6dwzO5lIOWW_MxcHigpfcAkZiSAKSXpGei7ZU8V3EEyC1TaFma_RbpFSlmWE2o90MzFD_yeEXKzek3q87s763ib1e5j8umwsD0gdWS8d9nEvvyWbDdix0Cr2Z_SDKPlOqEXseYcCJQ Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 693cf2c9184640568ffb9217ab061de3 Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-VolumesNegativeTest-606797290 Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/693cf2c9184640568ffb9217ab061de3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/693cf2c9184640568ffb9217ab061de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/693cf2c9184640568ffb9217ab061de3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_693cf2c9184640568ffb9217ab061de3", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-VolumesNegativeTest-606797290 Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 693cf2c9184640568ffb9217ab061de3 Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-VolumesNegativeTest-606797290 Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-VolumesNegativeTest-606797290-project Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 1b4be7c1a1244fdb9da91902e366d2e6 Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-VolumesNegativeTest-606797290-project Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: exception: Volume 0bacfff7-ce52-40f6-ba16-f2ed480eb9f0 could not be found. Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '0bacfff7-ce52-40f6-ba16-f2ed480eb9f0'} Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0bacfff7-ce52-40f6-ba16-f2ed480eb9f0 could not be found. (HTTP 404) (Request-ID: req-dfb28fc5-c84e-40d0-ac26-b026d49390f3) Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 01:17:18.942555 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0bacfff7-ce52-40f6-ba16-f2ed480eb9f0 could not be found. Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0bacfff7-ce52-40f6-ba16-f2ed480eb9f0 could not be found. Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0bacfff7-ce52-40f6-ba16-f2ed480eb9f0 could not be found. Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a435aff1-5ba0-4c47-ab2c-ea6dfc3a46b9 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] Returning 404 to user: Volume 0bacfff7-ce52-40f6-ba16-f2ed480eb9f0 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a435aff1-5ba0-4c47-ab2c-ea6dfc3a46b9 tempest-VolumesNegativeTest-606797290 tempest-VolumesNegativeTest-606797290-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/0bacfff7-ce52-40f6-ba16-f2ed480eb9f0" status: 404 len: 109 microversion: 2.1 time: 0.051118 Oct 29 01:17:18.952362 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1564/3293] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:17:18 2022] GET /compute/v2.1/os-volumes/0bacfff7-ce52-40f6-ba16-f2ed480eb9f0 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:17:18.966930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f9052bcc-df16-45c4-9c60-21f4e8e773cf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:18.967563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f9052bcc-df16-45c4-9c60-21f4e8e773cf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:18.976894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9052bcc-df16-45c4-9c60-21f4e8e773cf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:18.977613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9052bcc-df16-45c4-9c60-21f4e8e773cf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:18.978245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9052bcc-df16-45c4-9c60-21f4e8e773cf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:18.979106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9052bcc-df16-45c4-9c60-21f4e8e773cf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:18.981893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9052bcc-df16-45c4-9c60-21f4e8e773cf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:18.982516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9052bcc-df16-45c4-9c60-21f4e8e773cf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:19.017596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aad659b3-2781-4099-9ab2-a2343a92e64f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:19.019377 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aad659b3-2781-4099-9ab2-a2343a92e64f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:19.034380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aad659b3-2781-4099-9ab2-a2343a92e64f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:19.035165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aad659b3-2781-4099-9ab2-a2343a92e64f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:19.037436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aad659b3-2781-4099-9ab2-a2343a92e64f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:19.038323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aad659b3-2781-4099-9ab2-a2343a92e64f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:19.042340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aad659b3-2781-4099-9ab2-a2343a92e64f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:19.043290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aad659b3-2781-4099-9ab2-a2343a92e64f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:19.173595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f9052bcc-df16-45c4-9c60-21f4e8e773cf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:19.197011 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f9052bcc-df16-45c4-9c60-21f4e8e773cf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1306 microversion: 2.1 time: 0.234332 Oct 29 01:17:19.207209 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1730/3294] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:18 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1306 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:19.226242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7a543aaf-e388-4ef9-be45-60bb3d566322 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96c41e50>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:19.331347 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7a543aaf-e388-4ef9-be45-60bb3d566322 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.122857 Oct 29 01:17:19.332140 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1731/3295] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:19 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:19.426293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aad659b3-2781-4099-9ab2-a2343a92e64f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:19.442304 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aad659b3-2781-4099-9ab2-a2343a92e64f tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1333 microversion: 2.1 time: 0.432335 Oct 29 01:17:19.444484 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1565/3296] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:19 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1333 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:19.684368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-52336d26-4076-45ba-940c-1a003342e51e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:19.684983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-52336d26-4076-45ba-940c-1a003342e51e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:19.707120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52336d26-4076-45ba-940c-1a003342e51e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:19.707615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52336d26-4076-45ba-940c-1a003342e51e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:19.708053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52336d26-4076-45ba-940c-1a003342e51e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:19.708767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52336d26-4076-45ba-940c-1a003342e51e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:19.709246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52336d26-4076-45ba-940c-1a003342e51e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:19.709677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52336d26-4076-45ba-940c-1a003342e51e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:20.115228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-52336d26-4076-45ba-940c-1a003342e51e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:20.133460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-52336d26-4076-45ba-940c-1a003342e51e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:20.133991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-52336d26-4076-45ba-940c-1a003342e51e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:20.143420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=98,nova_api:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:20.146940 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-52336d26-4076-45ba-940c-1a003342e51e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.468297 Oct 29 01:17:20.149400 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1732/3297] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:19 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:20.234833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dbf5dcf0-309d-4c94-b82f-03802191c682 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:20.235897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dbf5dcf0-309d-4c94-b82f-03802191c682 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:20.246549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbf5dcf0-309d-4c94-b82f-03802191c682 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:20.248228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbf5dcf0-309d-4c94-b82f-03802191c682 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:20.254924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbf5dcf0-309d-4c94-b82f-03802191c682 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:20.256051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbf5dcf0-309d-4c94-b82f-03802191c682 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:20.256628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbf5dcf0-309d-4c94-b82f-03802191c682 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:20.258981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbf5dcf0-309d-4c94-b82f-03802191c682 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:20.347843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-207f159a-9dbc-4207-a4d2-c95d1ccd6a79 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96c2eee0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:20.422092 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-207f159a-9dbc-4207-a4d2-c95d1ccd6a79 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.076398 Oct 29 01:17:20.422701 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1733/3298] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:20 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:20.470658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a43f0617-9ad2-4a3c-8841-fdd89ed6ee64 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:20.471343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a43f0617-9ad2-4a3c-8841-fdd89ed6ee64 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:20.484527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a43f0617-9ad2-4a3c-8841-fdd89ed6ee64 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:20.485020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a43f0617-9ad2-4a3c-8841-fdd89ed6ee64 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:20.490294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a43f0617-9ad2-4a3c-8841-fdd89ed6ee64 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:20.491111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a43f0617-9ad2-4a3c-8841-fdd89ed6ee64 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:20.491593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a43f0617-9ad2-4a3c-8841-fdd89ed6ee64 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:20.492028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a43f0617-9ad2-4a3c-8841-fdd89ed6ee64 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:20.674524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-dbf5dcf0-309d-4c94-b82f-03802191c682 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:20.691046 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dbf5dcf0-309d-4c94-b82f-03802191c682 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1294 microversion: 2.1 time: 0.464347 Oct 29 01:17:20.691721 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1566/3299] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:20 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1294 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:20.956700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a43f0617-9ad2-4a3c-8841-fdd89ed6ee64 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:20.967903 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a43f0617-9ad2-4a3c-8841-fdd89ed6ee64 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1333 microversion: 2.1 time: 0.501259 Oct 29 01:17:20.969924 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1734/3300] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:20 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1333 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:21.180891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2bb822a9-83a1-4dd7-ab82-37502229ea56 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:21.181551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2bb822a9-83a1-4dd7-ab82-37502229ea56 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:21.195646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2bb822a9-83a1-4dd7-ab82-37502229ea56 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:21.197866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2bb822a9-83a1-4dd7-ab82-37502229ea56 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:21.197866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2bb822a9-83a1-4dd7-ab82-37502229ea56 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:21.197866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2bb822a9-83a1-4dd7-ab82-37502229ea56 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:21.201702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2bb822a9-83a1-4dd7-ab82-37502229ea56 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:21.202556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2bb822a9-83a1-4dd7-ab82-37502229ea56 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:21.439600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dc2f6059-7861-4790-8fb1-3e0f7bbbc3fa tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96c41d30>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:21.529460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2bb822a9-83a1-4dd7-ab82-37502229ea56 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:21.542179 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dc2f6059-7861-4790-8fb1-3e0f7bbbc3fa tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.105510 Oct 29 01:17:21.544787 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1735/3301] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:21 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:21.547661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2bb822a9-83a1-4dd7-ab82-37502229ea56 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:21.549908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2bb822a9-83a1-4dd7-ab82-37502229ea56 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:21.562330 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2bb822a9-83a1-4dd7-ab82-37502229ea56 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.385296 Oct 29 01:17:21.584323 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1567/3302] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:21 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:21.716296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ac6b4739-6836-4e27-8280-64faa909d20c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:21.717065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ac6b4739-6836-4e27-8280-64faa909d20c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:21.733272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac6b4739-6836-4e27-8280-64faa909d20c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:21.735489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac6b4739-6836-4e27-8280-64faa909d20c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:21.736916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac6b4739-6836-4e27-8280-64faa909d20c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:21.749213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac6b4739-6836-4e27-8280-64faa909d20c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:21.749719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac6b4739-6836-4e27-8280-64faa909d20c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:21.752020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac6b4739-6836-4e27-8280-64faa909d20c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:21.999157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4d7e2574-7a3c-4c8f-ba25-df306e9761e3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:22.001490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4d7e2574-7a3c-4c8f-ba25-df306e9761e3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:22.016439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d7e2574-7a3c-4c8f-ba25-df306e9761e3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:22.017854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d7e2574-7a3c-4c8f-ba25-df306e9761e3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:22.020361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d7e2574-7a3c-4c8f-ba25-df306e9761e3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:22.023724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d7e2574-7a3c-4c8f-ba25-df306e9761e3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:22.034016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d7e2574-7a3c-4c8f-ba25-df306e9761e3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:22.034502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d7e2574-7a3c-4c8f-ba25-df306e9761e3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:22.201353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ac6b4739-6836-4e27-8280-64faa909d20c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:22.217960 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ac6b4739-6836-4e27-8280-64faa909d20c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1361 microversion: 2.1 time: 0.507077 Oct 29 01:17:22.222048 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1736/3303] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:21 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1361 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:22.320438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4d7e2574-7a3c-4c8f-ba25-df306e9761e3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:22.336569 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4d7e2574-7a3c-4c8f-ba25-df306e9761e3 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1333 microversion: 2.1 time: 0.344210 Oct 29 01:17:22.337856 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1568/3304] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:21 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1333 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:22.560942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9fac1317-a65f-45c9-85bd-c7a94816fc5f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96c41d30>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:22.605032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a6f58a31-83d7-4319-9416-ae9b220250d4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:22.606411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a6f58a31-83d7-4319-9416-ae9b220250d4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:22.631374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6f58a31-83d7-4319-9416-ae9b220250d4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:22.631374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6f58a31-83d7-4319-9416-ae9b220250d4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:22.631374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6f58a31-83d7-4319-9416-ae9b220250d4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:22.631374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6f58a31-83d7-4319-9416-ae9b220250d4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:22.631374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6f58a31-83d7-4319-9416-ae9b220250d4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:22.631374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6f58a31-83d7-4319-9416-ae9b220250d4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:22.638027 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9fac1317-a65f-45c9-85bd-c7a94816fc5f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.082716 Oct 29 01:17:22.639703 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1737/3305] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:22 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:22.751446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a6f58a31-83d7-4319-9416-ae9b220250d4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:22.762094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a6f58a31-83d7-4319-9416-ae9b220250d4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:22.763564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a6f58a31-83d7-4319-9416-ae9b220250d4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:22.771417 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a6f58a31-83d7-4319-9416-ae9b220250d4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.177780 Oct 29 01:17:22.772363 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1569/3306] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:22 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:23.244882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f3e4b67e-c7ef-4a21-829b-d07dd68c0e75 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:23.245915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f3e4b67e-c7ef-4a21-829b-d07dd68c0e75 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:23.253353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3e4b67e-c7ef-4a21-829b-d07dd68c0e75 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:23.253887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3e4b67e-c7ef-4a21-829b-d07dd68c0e75 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:23.254338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3e4b67e-c7ef-4a21-829b-d07dd68c0e75 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:23.255074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3e4b67e-c7ef-4a21-829b-d07dd68c0e75 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:23.255550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3e4b67e-c7ef-4a21-829b-d07dd68c0e75 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:23.256001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3e4b67e-c7ef-4a21-829b-d07dd68c0e75 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:23.360583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-10626981-6b0c-413a-b924-c9cbd5a07cb0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:23.362664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-10626981-6b0c-413a-b924-c9cbd5a07cb0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:23.377804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10626981-6b0c-413a-b924-c9cbd5a07cb0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:23.378927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10626981-6b0c-413a-b924-c9cbd5a07cb0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:23.379716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10626981-6b0c-413a-b924-c9cbd5a07cb0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:23.381422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10626981-6b0c-413a-b924-c9cbd5a07cb0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:23.382008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10626981-6b0c-413a-b924-c9cbd5a07cb0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:23.382540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10626981-6b0c-413a-b924-c9cbd5a07cb0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:23.436533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f3e4b67e-c7ef-4a21-829b-d07dd68c0e75 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:23.449652 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f3e4b67e-c7ef-4a21-829b-d07dd68c0e75 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1361 microversion: 2.1 time: 0.207391 Oct 29 01:17:23.461313 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1738/3307] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:23 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:23.558471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-10f1cea0-aa59-4623-80dc-1683c7f3ffe4 req-ad2065d5-d769-483b-9053-febba36e3521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7341065-fb16-4c56-9924-fe9a56d7a7b3", "tag": "abf3212e-ab37-4f92-9f15-e2695f580a30"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:23.569964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-10f1cea0-aa59-4623-80dc-1683c7f3ffe4 req-ad2065d5-d769-483b-9053-febba36e3521 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:23.569964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-10f1cea0-aa59-4623-80dc-1683c7f3ffe4 req-ad2065d5-d769-483b-9053-febba36e3521 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:23.570262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-10f1cea0-aa59-4623-80dc-1683c7f3ffe4 req-ad2065d5-d769-483b-9053-febba36e3521 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:23.583658 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-10f1cea0-aa59-4623-80dc-1683c7f3ffe4 req-ad2065d5-d769-483b-9053-febba36e3521 service nova] Creating event network-changed:abf3212e-ab37-4f92-9f15-e2695f580a30 for instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 on n-h2-862964-3 Oct 29 01:17:23.591241 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-10f1cea0-aa59-4623-80dc-1683c7f3ffe4 req-ad2065d5-d769-483b-9053-febba36e3521 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034932 Oct 29 01:17:23.594044 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1739/3308] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:23.662061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2bd2d7f3-bdb5-4578-8200-d7acb1643266 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96c410d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:23.733127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-10626981-6b0c-413a-b924-c9cbd5a07cb0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:23.741465 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-10626981-6b0c-413a-b924-c9cbd5a07cb0 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1333 microversion: 2.1 time: 0.384748 Oct 29 01:17:23.753714 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2bd2d7f3-bdb5-4578-8200-d7acb1643266 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.092898 Oct 29 01:17:23.756490 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1740/3309] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:23 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:23.764018 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1570/3310] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:23 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1333 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:23.812965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1ed99731-a1e2-4e27-9157-a924f1711456 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:23.813746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1ed99731-a1e2-4e27-9157-a924f1711456 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:23.835271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ed99731-a1e2-4e27-9157-a924f1711456 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:23.836040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ed99731-a1e2-4e27-9157-a924f1711456 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:23.839741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ed99731-a1e2-4e27-9157-a924f1711456 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:23.841710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ed99731-a1e2-4e27-9157-a924f1711456 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:23.843942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ed99731-a1e2-4e27-9157-a924f1711456 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:23.846764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ed99731-a1e2-4e27-9157-a924f1711456 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:23.989408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ed99731-a1e2-4e27-9157-a924f1711456 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:24.002085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ed99731-a1e2-4e27-9157-a924f1711456 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:24.007988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ed99731-a1e2-4e27-9157-a924f1711456 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:24.022522 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1ed99731-a1e2-4e27-9157-a924f1711456 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.217583 Oct 29 01:17:24.023660 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1741/3311] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:23 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:24.561295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f87758a8-9ab1-4ed3-bf01-54d5442e5930 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:24.563860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f87758a8-9ab1-4ed3-bf01-54d5442e5930 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:24.569098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f87758a8-9ab1-4ed3-bf01-54d5442e5930 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:24.569987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f87758a8-9ab1-4ed3-bf01-54d5442e5930 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:24.570648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f87758a8-9ab1-4ed3-bf01-54d5442e5930 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:24.571591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f87758a8-9ab1-4ed3-bf01-54d5442e5930 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:24.572699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f87758a8-9ab1-4ed3-bf01-54d5442e5930 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:24.574716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f87758a8-9ab1-4ed3-bf01-54d5442e5930 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:24.763076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1968169f-38ba-487c-b21f-2bc8452492f2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96c2e040>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:24.775370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=16 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:24.846386 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1968169f-38ba-487c-b21f-2bc8452492f2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.087650 Oct 29 01:17:24.855602 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1742/3312] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:24 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:24.860726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-be4d7b3a-3137-4bd5-8fd6-a9b17b2365b1 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:24.861884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-be4d7b3a-3137-4bd5-8fd6-a9b17b2365b1 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:24.869092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be4d7b3a-3137-4bd5-8fd6-a9b17b2365b1 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:24.869928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be4d7b3a-3137-4bd5-8fd6-a9b17b2365b1 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:24.871141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be4d7b3a-3137-4bd5-8fd6-a9b17b2365b1 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:24.872153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be4d7b3a-3137-4bd5-8fd6-a9b17b2365b1 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:24.872837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be4d7b3a-3137-4bd5-8fd6-a9b17b2365b1 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:24.873489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be4d7b3a-3137-4bd5-8fd6-a9b17b2365b1 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:25.273926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:25.349176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f87758a8-9ab1-4ed3-bf01-54d5442e5930 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:25.360531 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f87758a8-9ab1-4ed3-bf01-54d5442e5930 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1361 microversion: 2.1 time: 0.804667 Oct 29 01:17:25.362146 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1571/3313] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:24 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1361 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:25.378467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-0970bfe5-1169-4f3f-899a-1685b31feadc req-b840492a-6d66-4b57-8218-8bdecaf12d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6048315f-8aea-4750-95b0-669ad146085f", "name": "network-vif-plugged", "status": "completed", "tag": "21841ba3-8287-44aa-b879-22f03c697604"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:25.393326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-0970bfe5-1169-4f3f-899a-1685b31feadc req-b840492a-6d66-4b57-8218-8bdecaf12d31 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:25.394136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-0970bfe5-1169-4f3f-899a-1685b31feadc req-b840492a-6d66-4b57-8218-8bdecaf12d31 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:25.394759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-0970bfe5-1169-4f3f-899a-1685b31feadc req-b840492a-6d66-4b57-8218-8bdecaf12d31 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:25.411398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-be4d7b3a-3137-4bd5-8fd6-a9b17b2365b1 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:25.414941 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-be4d7b3a-3137-4bd5-8fd6-a9b17b2365b1 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1333 microversion: 2.1 time: 0.557828 Oct 29 01:17:25.415528 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1743/3314] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:24 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1333 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:25.437403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-070e4075-098d-464e-894f-63651150fab9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:25.439146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-070e4075-098d-464e-894f-63651150fab9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:25.442554 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-0970bfe5-1169-4f3f-899a-1685b31feadc req-b840492a-6d66-4b57-8218-8bdecaf12d31 service nova] Creating event network-vif-plugged:21841ba3-8287-44aa-b879-22f03c697604 for instance 6048315f-8aea-4750-95b0-669ad146085f on n-h1-862964-3 Oct 29 01:17:25.455830 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-0970bfe5-1169-4f3f-899a-1685b31feadc req-b840492a-6d66-4b57-8218-8bdecaf12d31 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091924 Oct 29 01:17:25.457037 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1572/3315] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:25.461345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-070e4075-098d-464e-894f-63651150fab9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:25.462371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-070e4075-098d-464e-894f-63651150fab9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:25.463107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-070e4075-098d-464e-894f-63651150fab9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:25.464435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-070e4075-098d-464e-894f-63651150fab9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:25.464947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-070e4075-098d-464e-894f-63651150fab9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:25.486158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-070e4075-098d-464e-894f-63651150fab9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:25.687739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-070e4075-098d-464e-894f-63651150fab9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:25.706444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-070e4075-098d-464e-894f-63651150fab9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:25.708231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-070e4075-098d-464e-894f-63651150fab9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:25.718384 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-070e4075-098d-464e-894f-63651150fab9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.301042 Oct 29 01:17:25.719770 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1744/3316] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:25 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:25.863148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ee529e0a-fe61-410e-b1c4-61c278d0a4ea tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97ac1670>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:25.875550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:25.949742 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ee529e0a-fe61-410e-b1c4-61c278d0a4ea tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.091071 Oct 29 01:17:25.952338 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1573/3317] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:25 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:26.388469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d44be699-5f92-431d-bee6-bf8fdd9a7b05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:26.390402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d44be699-5f92-431d-bee6-bf8fdd9a7b05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:26.402515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d44be699-5f92-431d-bee6-bf8fdd9a7b05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:26.405229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d44be699-5f92-431d-bee6-bf8fdd9a7b05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:26.408205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d44be699-5f92-431d-bee6-bf8fdd9a7b05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:26.411032 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d44be699-5f92-431d-bee6-bf8fdd9a7b05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:26.411786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d44be699-5f92-431d-bee6-bf8fdd9a7b05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:26.414079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d44be699-5f92-431d-bee6-bf8fdd9a7b05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:26.443683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4e2c4e04-9cf1-437e-8491-c454364ac07c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:26.446053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4e2c4e04-9cf1-437e-8491-c454364ac07c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:26.454545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e2c4e04-9cf1-437e-8491-c454364ac07c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:26.465762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e2c4e04-9cf1-437e-8491-c454364ac07c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:26.466639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e2c4e04-9cf1-437e-8491-c454364ac07c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:26.470921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e2c4e04-9cf1-437e-8491-c454364ac07c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:26.472799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e2c4e04-9cf1-437e-8491-c454364ac07c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:26.472799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e2c4e04-9cf1-437e-8491-c454364ac07c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:26.514177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:26.992690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d44be699-5f92-431d-bee6-bf8fdd9a7b05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:27.001395 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d44be699-5f92-431d-bee6-bf8fdd9a7b05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1361 microversion: 2.1 time: 0.617712 Oct 29 01:17:27.005056 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1745/3318] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:26 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1361 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:27.016236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c6f9d5c2-518c-4c7c-b24b-3ee05d266f3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:27.017812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c6f9d5c2-518c-4c7c-b24b-3ee05d266f3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:27.037026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6f9d5c2-518c-4c7c-b24b-3ee05d266f3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:27.039579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6f9d5c2-518c-4c7c-b24b-3ee05d266f3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:27.041025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6f9d5c2-518c-4c7c-b24b-3ee05d266f3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:27.044261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6f9d5c2-518c-4c7c-b24b-3ee05d266f3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:27.045714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6f9d5c2-518c-4c7c-b24b-3ee05d266f3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:27.046215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6f9d5c2-518c-4c7c-b24b-3ee05d266f3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:27.518488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4e2c4e04-9cf1-437e-8491-c454364ac07c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:27.532520 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4e2c4e04-9cf1-437e-8491-c454364ac07c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1333 microversion: 2.1 time: 1.089503 Oct 29 01:17:27.532520 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1574/3319] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:26 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1333 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:27.540099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b670771c-d928-40eb-b0e9-4414b7324579 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97c54dc0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:27.598095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c6f9d5c2-518c-4c7c-b24b-3ee05d266f3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:27.615616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c6f9d5c2-518c-4c7c-b24b-3ee05d266f3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:27.627353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c6f9d5c2-518c-4c7c-b24b-3ee05d266f3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:27.649042 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c6f9d5c2-518c-4c7c-b24b-3ee05d266f3c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.642564 Oct 29 01:17:27.651468 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1746/3320] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:27 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:27.679347 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b670771c-d928-40eb-b0e9-4414b7324579 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.146114 Oct 29 01:17:27.685282 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1575/3321] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:27 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:27.695373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-78ff6751-1350-460b-a156-34d51ae16366 req-83bc44b1-4404-4c74-b1c1-f58ad6eb54a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6048315f-8aea-4750-95b0-669ad146085f", "name": "network-vif-plugged", "status": "completed", "tag": "e2d8f50f-d52b-4eae-b9d6-9a3aab2c7149"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:27.749630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-78ff6751-1350-460b-a156-34d51ae16366 req-83bc44b1-4404-4c74-b1c1-f58ad6eb54a6 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:27.753538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-78ff6751-1350-460b-a156-34d51ae16366 req-83bc44b1-4404-4c74-b1c1-f58ad6eb54a6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:27.754339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-78ff6751-1350-460b-a156-34d51ae16366 req-83bc44b1-4404-4c74-b1c1-f58ad6eb54a6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:27.787172 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-78ff6751-1350-460b-a156-34d51ae16366 req-83bc44b1-4404-4c74-b1c1-f58ad6eb54a6 service nova] Creating event network-vif-plugged:e2d8f50f-d52b-4eae-b9d6-9a3aab2c7149 for instance 6048315f-8aea-4750-95b0-669ad146085f on n-h1-862964-3 Oct 29 01:17:27.812746 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-78ff6751-1350-460b-a156-34d51ae16366 req-83bc44b1-4404-4c74-b1c1-f58ad6eb54a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155356 Oct 29 01:17:27.818939 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1747/3322] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:28.028328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d647354d-0cc4-4373-bc7e-6744842638c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:28.028946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d647354d-0cc4-4373-bc7e-6744842638c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:28.052865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d647354d-0cc4-4373-bc7e-6744842638c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:28.053384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d647354d-0cc4-4373-bc7e-6744842638c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:28.053821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d647354d-0cc4-4373-bc7e-6744842638c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:28.054533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d647354d-0cc4-4373-bc7e-6744842638c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:28.054990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d647354d-0cc4-4373-bc7e-6744842638c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:28.055419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d647354d-0cc4-4373-bc7e-6744842638c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:28.393091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d647354d-0cc4-4373-bc7e-6744842638c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:28.411127 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d647354d-0cc4-4373-bc7e-6744842638c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1361 microversion: 2.1 time: 0.386178 Oct 29 01:17:28.439220 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1576/3323] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:28 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1361 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:28.561632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-71cfd82c-c094-4a71-9911-733b54a1a11e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:28.562346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-71cfd82c-c094-4a71-9911-733b54a1a11e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:28.580053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71cfd82c-c094-4a71-9911-733b54a1a11e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:28.584128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71cfd82c-c094-4a71-9911-733b54a1a11e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:28.584128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71cfd82c-c094-4a71-9911-733b54a1a11e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:28.584128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71cfd82c-c094-4a71-9911-733b54a1a11e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:28.584128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71cfd82c-c094-4a71-9911-733b54a1a11e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:28.584128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71cfd82c-c094-4a71-9911-733b54a1a11e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:28.692308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a80f960e-5ec7-485d-a5a9-a42a8612037f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:28.696172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a80f960e-5ec7-485d-a5a9-a42a8612037f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:28.707565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a80f960e-5ec7-485d-a5a9-a42a8612037f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:28.709099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a80f960e-5ec7-485d-a5a9-a42a8612037f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:28.711219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a80f960e-5ec7-485d-a5a9-a42a8612037f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:28.712136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a80f960e-5ec7-485d-a5a9-a42a8612037f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:28.713495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a80f960e-5ec7-485d-a5a9-a42a8612037f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:28.719266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a80f960e-5ec7-485d-a5a9-a42a8612037f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:28.886950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a80f960e-5ec7-485d-a5a9-a42a8612037f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:28.898067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a80f960e-5ec7-485d-a5a9-a42a8612037f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:28.900536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a80f960e-5ec7-485d-a5a9-a42a8612037f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:28.930194 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a80f960e-5ec7-485d-a5a9-a42a8612037f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.242667 Oct 29 01:17:28.946048 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1577/3324] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:28 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:28.964278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0b65c2e9-4db5-43ee-ab6b-d58ab47da9a5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97c54e50>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:29.011580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-71cfd82c-c094-4a71-9911-733b54a1a11e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:29.024461 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0b65c2e9-4db5-43ee-ab6b-d58ab47da9a5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.077127 Oct 29 01:17:29.028968 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-71cfd82c-c094-4a71-9911-733b54a1a11e tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1333 microversion: 2.1 time: 0.467894 Oct 29 01:17:29.029222 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1578/3325] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:28 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:29.029337 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1748/3326] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:28 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1333 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:29.264367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eaf211d6-92a5-4c78-b8f6-61d8e9b9a8c7 tempest-AbsoluteLimitsTestJSON-501167804 tempest-AbsoluteLimitsTestJSON-501167804-project] Calling method '.version_select at 0x7f9d9ff23af0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:29.300010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eaf211d6-92a5-4c78-b8f6-61d8e9b9a8c7 tempest-AbsoluteLimitsTestJSON-501167804 tempest-AbsoluteLimitsTestJSON-501167804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:29.300416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eaf211d6-92a5-4c78-b8f6-61d8e9b9a8c7 tempest-AbsoluteLimitsTestJSON-501167804 tempest-AbsoluteLimitsTestJSON-501167804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:29.300861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eaf211d6-92a5-4c78-b8f6-61d8e9b9a8c7 tempest-AbsoluteLimitsTestJSON-501167804 tempest-AbsoluteLimitsTestJSON-501167804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:29.301642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eaf211d6-92a5-4c78-b8f6-61d8e9b9a8c7 tempest-AbsoluteLimitsTestJSON-501167804 tempest-AbsoluteLimitsTestJSON-501167804-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:29.302101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eaf211d6-92a5-4c78-b8f6-61d8e9b9a8c7 tempest-AbsoluteLimitsTestJSON-501167804 tempest-AbsoluteLimitsTestJSON-501167804-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:29.302528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eaf211d6-92a5-4c78-b8f6-61d8e9b9a8c7 tempest-AbsoluteLimitsTestJSON-501167804 tempest-AbsoluteLimitsTestJSON-501167804-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:29.365619 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-eaf211d6-92a5-4c78-b8f6-61d8e9b9a8c7 tempest-AbsoluteLimitsTestJSON-501167804 tempest-AbsoluteLimitsTestJSON-501167804-project] 10.222.0.26 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.338379 Oct 29 01:17:29.367846 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1579/3327] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 29 01:17:29 2022] GET /compute/v2.1/limits => generated 511 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:29.436476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e31f8050-ecd2-405b-9bef-f4ca6c3abaa3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:29.437513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e31f8050-ecd2-405b-9bef-f4ca6c3abaa3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:29.451068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e31f8050-ecd2-405b-9bef-f4ca6c3abaa3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:29.454905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e31f8050-ecd2-405b-9bef-f4ca6c3abaa3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:29.456197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e31f8050-ecd2-405b-9bef-f4ca6c3abaa3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:29.458557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e31f8050-ecd2-405b-9bef-f4ca6c3abaa3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:29.462181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e31f8050-ecd2-405b-9bef-f4ca6c3abaa3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:29.464197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e31f8050-ecd2-405b-9bef-f4ca6c3abaa3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:29.816161 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e31f8050-ecd2-405b-9bef-f4ca6c3abaa3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:29.839060 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e31f8050-ecd2-405b-9bef-f4ca6c3abaa3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1361 microversion: 2.1 time: 0.402201 Oct 29 01:17:29.851122 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1749/3328] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:29 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1361 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:29.966661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-90dfa20b-14f6-4e44-8713-f34f3ea881e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:29.967274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-90dfa20b-14f6-4e44-8713-f34f3ea881e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:29.985456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90dfa20b-14f6-4e44-8713-f34f3ea881e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:29.986251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90dfa20b-14f6-4e44-8713-f34f3ea881e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:29.986705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90dfa20b-14f6-4e44-8713-f34f3ea881e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:29.987460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90dfa20b-14f6-4e44-8713-f34f3ea881e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:29.987920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90dfa20b-14f6-4e44-8713-f34f3ea881e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:29.988350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90dfa20b-14f6-4e44-8713-f34f3ea881e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:30.053225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eadbd1b2-f7f2-471c-bc81-63ce3f24d2ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96bf6160>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:30.228439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-90dfa20b-14f6-4e44-8713-f34f3ea881e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:30.228683 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eadbd1b2-f7f2-471c-bc81-63ce3f24d2ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.096230 Oct 29 01:17:30.229731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-90dfa20b-14f6-4e44-8713-f34f3ea881e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:30.229731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-90dfa20b-14f6-4e44-8713-f34f3ea881e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:30.230320 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1750/3329] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:30 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:30.230850 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-90dfa20b-14f6-4e44-8713-f34f3ea881e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.196786 Oct 29 01:17:30.230945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c96ad42a-98dd-411f-836c-65cb93ef4422 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:30.230945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c96ad42a-98dd-411f-836c-65cb93ef4422 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:30.231114 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1580/3330] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:29 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:30.231212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c96ad42a-98dd-411f-836c-65cb93ef4422 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:30.231212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c96ad42a-98dd-411f-836c-65cb93ef4422 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:30.231212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c96ad42a-98dd-411f-836c-65cb93ef4422 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:30.231212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c96ad42a-98dd-411f-836c-65cb93ef4422 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:30.231212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c96ad42a-98dd-411f-836c-65cb93ef4422 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:30.231212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c96ad42a-98dd-411f-836c-65cb93ef4422 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:30.340705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c96ad42a-98dd-411f-836c-65cb93ef4422 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:30.349692 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c96ad42a-98dd-411f-836c-65cb93ef4422 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1669 microversion: 2.1 time: 0.192039 Oct 29 01:17:30.350764 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1751/3331] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:30 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1669 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:30.374070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-173b4038-4c1f-4521-b811-18168432f6b7 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:30.374597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-173b4038-4c1f-4521-b811-18168432f6b7 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:30.380773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-173b4038-4c1f-4521-b811-18168432f6b7 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:30.381302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-173b4038-4c1f-4521-b811-18168432f6b7 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:30.381743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-173b4038-4c1f-4521-b811-18168432f6b7 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:30.382449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-173b4038-4c1f-4521-b811-18168432f6b7 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:30.382915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-173b4038-4c1f-4521-b811-18168432f6b7 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:30.383347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-173b4038-4c1f-4521-b811-18168432f6b7 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:30.410960 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-173b4038-4c1f-4521-b811-18168432f6b7 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f/ips" status: 200 len: 180 microversion: 2.1 time: 0.040880 Oct 29 01:17:30.411389 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1581/3332] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 29 01:17:30 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f/ips => generated 180 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:30.426342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-00858e55-43e2-4b82-9e79-6bbe69f9cf63 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:30.426941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-00858e55-43e2-4b82-9e79-6bbe69f9cf63 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:30.459719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00858e55-43e2-4b82-9e79-6bbe69f9cf63 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:30.459719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00858e55-43e2-4b82-9e79-6bbe69f9cf63 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:30.459719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00858e55-43e2-4b82-9e79-6bbe69f9cf63 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:30.459719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00858e55-43e2-4b82-9e79-6bbe69f9cf63 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:30.459719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00858e55-43e2-4b82-9e79-6bbe69f9cf63 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:30.459719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00858e55-43e2-4b82-9e79-6bbe69f9cf63 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:30.494098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-00858e55-43e2-4b82-9e79-6bbe69f9cf63 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:17:30.860561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dbc916b3-3e8b-4c7d-a080-82399232ffcc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:30.863874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dbc916b3-3e8b-4c7d-a080-82399232ffcc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:30.873934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbc916b3-3e8b-4c7d-a080-82399232ffcc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:30.876878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbc916b3-3e8b-4c7d-a080-82399232ffcc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:30.877389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbc916b3-3e8b-4c7d-a080-82399232ffcc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:30.882380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbc916b3-3e8b-4c7d-a080-82399232ffcc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:30.882989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbc916b3-3e8b-4c7d-a080-82399232ffcc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:30.883443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbc916b3-3e8b-4c7d-a080-82399232ffcc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:30.978056 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-00858e55-43e2-4b82-9e79-6bbe69f9cf63 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 204 len: 0 microversion: 2.1 time: 0.557269 Oct 29 01:17:30.981820 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1752/3333] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:17:30 2022] DELETE /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:17:30.988771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-76aeb037-3c1c-49fe-b561-231c1b470918 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:30.989789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-76aeb037-3c1c-49fe-b561-231c1b470918 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:31.016476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76aeb037-3c1c-49fe-b561-231c1b470918 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:31.016968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76aeb037-3c1c-49fe-b561-231c1b470918 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:31.017434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76aeb037-3c1c-49fe-b561-231c1b470918 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:31.018141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76aeb037-3c1c-49fe-b561-231c1b470918 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:31.018594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76aeb037-3c1c-49fe-b561-231c1b470918 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:31.019015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76aeb037-3c1c-49fe-b561-231c1b470918 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:31.258776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-dbc916b3-3e8b-4c7d-a080-82399232ffcc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:31.290487 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dbc916b3-3e8b-4c7d-a080-82399232ffcc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1361 microversion: 2.1 time: 0.421531 Oct 29 01:17:31.293592 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1582/3334] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:30 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1361 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:31.307823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-76aeb037-3c1c-49fe-b561-231c1b470918 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:31.316492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c534dc1a-7711-44fe-a5f0-25d7022b0ff2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9747fe50>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:31.330579 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-76aeb037-3c1c-49fe-b561-231c1b470918 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1675 microversion: 2.1 time: 0.346129 Oct 29 01:17:31.331302 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1753/3335] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:30 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1675 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:31.348468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5f59c56b-a2b7-40eb-86e8-6c1fa6084267 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:31.349423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5f59c56b-a2b7-40eb-86e8-6c1fa6084267 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:31.357775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f59c56b-a2b7-40eb-86e8-6c1fa6084267 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:31.360039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f59c56b-a2b7-40eb-86e8-6c1fa6084267 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:31.362344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f59c56b-a2b7-40eb-86e8-6c1fa6084267 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:31.363319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f59c56b-a2b7-40eb-86e8-6c1fa6084267 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:31.367742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f59c56b-a2b7-40eb-86e8-6c1fa6084267 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:31.368561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f59c56b-a2b7-40eb-86e8-6c1fa6084267 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:31.418172 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c534dc1a-7711-44fe-a5f0-25d7022b0ff2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.123441 Oct 29 01:17:31.418917 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1583/3336] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:31 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:31.508038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5f59c56b-a2b7-40eb-86e8-6c1fa6084267 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:31.522224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5f59c56b-a2b7-40eb-86e8-6c1fa6084267 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:31.524692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5f59c56b-a2b7-40eb-86e8-6c1fa6084267 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:31.531544 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5f59c56b-a2b7-40eb-86e8-6c1fa6084267 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.199055 Oct 29 01:17:31.532755 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1754/3337] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:31 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:32.321254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e5e57726-cf53-445e-843d-cd67c75d8c46 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:32.323865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e5e57726-cf53-445e-843d-cd67c75d8c46 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:32.335375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e5e57726-cf53-445e-843d-cd67c75d8c46 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:32.337460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e5e57726-cf53-445e-843d-cd67c75d8c46 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:32.343387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e5e57726-cf53-445e-843d-cd67c75d8c46 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:32.344181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e5e57726-cf53-445e-843d-cd67c75d8c46 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:32.344834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e5e57726-cf53-445e-843d-cd67c75d8c46 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:32.345502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e5e57726-cf53-445e-843d-cd67c75d8c46 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:32.349292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:32.365202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d9f459f0-44f1-4863-a89d-f9569535d34c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:32.367197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d9f459f0-44f1-4863-a89d-f9569535d34c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:32.380792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9f459f0-44f1-4863-a89d-f9569535d34c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:32.384302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9f459f0-44f1-4863-a89d-f9569535d34c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:32.386949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9f459f0-44f1-4863-a89d-f9569535d34c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:32.388642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9f459f0-44f1-4863-a89d-f9569535d34c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:32.390777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9f459f0-44f1-4863-a89d-f9569535d34c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:32.392649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9f459f0-44f1-4863-a89d-f9569535d34c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:33.081891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d9f459f0-44f1-4863-a89d-f9569535d34c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:33.097319 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d9f459f0-44f1-4863-a89d-f9569535d34c tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1675 microversion: 2.1 time: 0.736622 Oct 29 01:17:33.100893 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1755/3338] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:32 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1675 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:33.113090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e5e57726-cf53-445e-843d-cd67c75d8c46 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:33.128965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bc1ca46a-64b0-4037-84ad-23068caa4501 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96ba0ca0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:33.132531 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e5e57726-cf53-445e-843d-cd67c75d8c46 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1361 microversion: 2.1 time: 0.817272 Oct 29 01:17:33.156600 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1584/3339] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:32 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1361 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:33.181568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0afef078-bdbb-41cc-8a7b-d11f4d963bea tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:33.189051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0afef078-bdbb-41cc-8a7b-d11f4d963bea tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:33.209327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0afef078-bdbb-41cc-8a7b-d11f4d963bea tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:33.210106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0afef078-bdbb-41cc-8a7b-d11f4d963bea tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:33.212081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0afef078-bdbb-41cc-8a7b-d11f4d963bea tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:33.212997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0afef078-bdbb-41cc-8a7b-d11f4d963bea tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:33.216511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0afef078-bdbb-41cc-8a7b-d11f4d963bea tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:33.217618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0afef078-bdbb-41cc-8a7b-d11f4d963bea tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:33.229026 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bc1ca46a-64b0-4037-84ad-23068caa4501 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.126711 Oct 29 01:17:33.230502 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1756/3340] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:33 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:33.858187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0afef078-bdbb-41cc-8a7b-d11f4d963bea tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:33.872276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0afef078-bdbb-41cc-8a7b-d11f4d963bea tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:33.874218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0afef078-bdbb-41cc-8a7b-d11f4d963bea tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:33.883032 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0afef078-bdbb-41cc-8a7b-d11f4d963bea tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.724310 Oct 29 01:17:33.898011 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1585/3341] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:33 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:33.902930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-ce1ea7b0-086e-4580-bfaa-c5db87ead015 req-7dac32e0-855e-4da5-8d96-4c10c91a372d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7341065-fb16-4c56-9924-fe9a56d7a7b3", "name": "network-vif-plugged", "status": "completed", "tag": "abf3212e-ab37-4f92-9f15-e2695f580a30"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:33.949975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ce1ea7b0-086e-4580-bfaa-c5db87ead015 req-7dac32e0-855e-4da5-8d96-4c10c91a372d service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:33.956956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ce1ea7b0-086e-4580-bfaa-c5db87ead015 req-7dac32e0-855e-4da5-8d96-4c10c91a372d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:33.957855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ce1ea7b0-086e-4580-bfaa-c5db87ead015 req-7dac32e0-855e-4da5-8d96-4c10c91a372d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:33.988427 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-ce1ea7b0-086e-4580-bfaa-c5db87ead015 req-7dac32e0-855e-4da5-8d96-4c10c91a372d service nova] Creating event network-vif-plugged:abf3212e-ab37-4f92-9f15-e2695f580a30 for instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 on n-h2-862964-3 Oct 29 01:17:34.005294 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-ce1ea7b0-086e-4580-bfaa-c5db87ead015 req-7dac32e0-855e-4da5-8d96-4c10c91a372d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115316 Oct 29 01:17:34.008450 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1586/3342] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:34.075434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-6c72ff69-8f54-40de-b856-5ac730b9fe85 req-551019bb-d61d-43f2-adea-6916dcf4c64b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6048315f-8aea-4750-95b0-669ad146085f", "name": "network-vif-deleted", "tag": "e2d8f50f-d52b-4eae-b9d6-9a3aab2c7149"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:34.109950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6c72ff69-8f54-40de-b856-5ac730b9fe85 req-551019bb-d61d-43f2-adea-6916dcf4c64b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:34.110451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6c72ff69-8f54-40de-b856-5ac730b9fe85 req-551019bb-d61d-43f2-adea-6916dcf4c64b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:34.110931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6c72ff69-8f54-40de-b856-5ac730b9fe85 req-551019bb-d61d-43f2-adea-6916dcf4c64b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:34.141845 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-6c72ff69-8f54-40de-b856-5ac730b9fe85 req-551019bb-d61d-43f2-adea-6916dcf4c64b service nova] Creating event network-vif-deleted:e2d8f50f-d52b-4eae-b9d6-9a3aab2c7149 for instance 6048315f-8aea-4750-95b0-669ad146085f on n-h1-862964-3 Oct 29 01:17:34.154518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-458168ff-a3da-4ebe-8260-fcd385b53125 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1341998318", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "b5b62219-8a2f-42eb-b795-dd5a026e1972"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:34.179817 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-6c72ff69-8f54-40de-b856-5ac730b9fe85 req-551019bb-d61d-43f2-adea-6916dcf4c64b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104939 Oct 29 01:17:34.184100 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1587/3343] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 29 01:17:34.225851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f685ce2a-c66d-44e5-a323-ad443a576a02 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:34.226581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f685ce2a-c66d-44e5-a323-ad443a576a02 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:34.261857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f685ce2a-c66d-44e5-a323-ad443a576a02 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:34.271850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f685ce2a-c66d-44e5-a323-ad443a576a02 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:34.277383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f685ce2a-c66d-44e5-a323-ad443a576a02 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:34.281982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f685ce2a-c66d-44e5-a323-ad443a576a02 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:34.284178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f685ce2a-c66d-44e5-a323-ad443a576a02 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:34.284636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f685ce2a-c66d-44e5-a323-ad443a576a02 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:34.352323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-458168ff-a3da-4ebe-8260-fcd385b53125 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] validate_networks() for [('b5b62219-8a2f-42eb-b795-dd5a026e1972', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:17:35.546182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f685ce2a-c66d-44e5-a323-ad443a576a02 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:35.557323 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f685ce2a-c66d-44e5-a323-ad443a576a02 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1496 microversion: 2.1 time: 1.354783 Oct 29 01:17:35.563455 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1588/3344] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:34 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1496 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:35.575088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9d3967e6-5eb3-4af8-bada-d0bc35c8bd08 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:35.575889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9d3967e6-5eb3-4af8-bada-d0bc35c8bd08 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:35.591760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d3967e6-5eb3-4af8-bada-d0bc35c8bd08 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:35.593934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d3967e6-5eb3-4af8-bada-d0bc35c8bd08 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:35.594838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d3967e6-5eb3-4af8-bada-d0bc35c8bd08 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:35.636002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d3967e6-5eb3-4af8-bada-d0bc35c8bd08 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:35.636002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d3967e6-5eb3-4af8-bada-d0bc35c8bd08 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:35.636002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d3967e6-5eb3-4af8-bada-d0bc35c8bd08 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:36.309931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9d3967e6-5eb3-4af8-bada-d0bc35c8bd08 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:36.318528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-458168ff-a3da-4ebe-8260-fcd385b53125 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:17:36.319065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-458168ff-a3da-4ebe-8260-fcd385b53125 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:17:36.319408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-458168ff-a3da-4ebe-8260-fcd385b53125 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:17:36.320138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-458168ff-a3da-4ebe-8260-fcd385b53125 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:17:36.320748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-458168ff-a3da-4ebe-8260-fcd385b53125 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:17:36.344499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-458168ff-a3da-4ebe-8260-fcd385b53125 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:36.344499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-458168ff-a3da-4ebe-8260-fcd385b53125 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:36.344499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-458168ff-a3da-4ebe-8260-fcd385b53125 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:36.347708 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9d3967e6-5eb3-4af8-bada-d0bc35c8bd08 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1361 microversion: 2.1 time: 0.779181 Oct 29 01:17:36.348462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-458168ff-a3da-4ebe-8260-fcd385b53125 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:36.350161 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1589/3345] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:35 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1361 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:36.350479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-458168ff-a3da-4ebe-8260-fcd385b53125 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:36.351232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-458168ff-a3da-4ebe-8260-fcd385b53125 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:36.378565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-09e4c35d-a7f9-4115-ab73-bb214ad26eaa tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97219dc0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:36.410208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-458168ff-a3da-4ebe-8260-fcd385b53125 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Getting quotas for project 6dc302f307494a61836f3afb38dccae9. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:17:36.434851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-458168ff-a3da-4ebe-8260-fcd385b53125 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Getting quotas for user 6cb8fe33c5d64047ada50f44e01e4faa and project 6dc302f307494a61836f3afb38dccae9. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:17:36.453106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-458168ff-a3da-4ebe-8260-fcd385b53125 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:17:36.454417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-458168ff-a3da-4ebe-8260-fcd385b53125 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:17:36.485083 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-09e4c35d-a7f9-4115-ab73-bb214ad26eaa tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.133703 Oct 29 01:17:36.488783 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1590/3346] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:36 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:36.502256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d00a4bd1-4e9f-48c0-a5b4-30f8a73a431e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:36.505040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d00a4bd1-4e9f-48c0-a5b4-30f8a73a431e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:36.538351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d00a4bd1-4e9f-48c0-a5b4-30f8a73a431e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:36.551060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d00a4bd1-4e9f-48c0-a5b4-30f8a73a431e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:36.552257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d00a4bd1-4e9f-48c0-a5b4-30f8a73a431e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:36.554010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d00a4bd1-4e9f-48c0-a5b4-30f8a73a431e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:36.561894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d00a4bd1-4e9f-48c0-a5b4-30f8a73a431e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:36.563997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d00a4bd1-4e9f-48c0-a5b4-30f8a73a431e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:36.730521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d00a4bd1-4e9f-48c0-a5b4-30f8a73a431e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:36.748872 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-458168ff-a3da-4ebe-8260-fcd385b53125 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.514942 Oct 29 01:17:36.749697 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1757/3347] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:17:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:17:36.763669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-103271c2-f219-4263-b7b0-e898b86b975c req-92dbc426-fd57-427c-a24f-6b19d217828a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6048315f-8aea-4750-95b0-669ad146085f", "name": "network-vif-deleted", "tag": "21841ba3-8287-44aa-b879-22f03c697604"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:36.784373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d00a4bd1-4e9f-48c0-a5b4-30f8a73a431e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:36.794002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d00a4bd1-4e9f-48c0-a5b4-30f8a73a431e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:36.799049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-103271c2-f219-4263-b7b0-e898b86b975c req-92dbc426-fd57-427c-a24f-6b19d217828a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:36.801899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-103271c2-f219-4263-b7b0-e898b86b975c req-92dbc426-fd57-427c-a24f-6b19d217828a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:36.803276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-103271c2-f219-4263-b7b0-e898b86b975c req-92dbc426-fd57-427c-a24f-6b19d217828a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:36.840567 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-103271c2-f219-4263-b7b0-e898b86b975c req-92dbc426-fd57-427c-a24f-6b19d217828a service nova] Creating event network-vif-deleted:21841ba3-8287-44aa-b879-22f03c697604 for instance 6048315f-8aea-4750-95b0-669ad146085f on n-h1-862964-3 Oct 29 01:17:36.856291 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d00a4bd1-4e9f-48c0-a5b4-30f8a73a431e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.365839 Oct 29 01:17:36.856908 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-103271c2-f219-4263-b7b0-e898b86b975c req-92dbc426-fd57-427c-a24f-6b19d217828a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100978 Oct 29 01:17:36.857838 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1758/3348] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:36.878885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-689b72c7-ddb6-4c4f-9524-3a8ceae563bd tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:36.882208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-689b72c7-ddb6-4c4f-9524-3a8ceae563bd tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:36.886646 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1591/3349] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:36 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:36.899114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-689b72c7-ddb6-4c4f-9524-3a8ceae563bd tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:36.900125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-21afb91c-2c38-4681-91fa-0f4cde283b75 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:36.902700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-21afb91c-2c38-4681-91fa-0f4cde283b75 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:36.903018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-689b72c7-ddb6-4c4f-9524-3a8ceae563bd tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:36.903729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-689b72c7-ddb6-4c4f-9524-3a8ceae563bd tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:36.906319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-689b72c7-ddb6-4c4f-9524-3a8ceae563bd tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:36.907411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-689b72c7-ddb6-4c4f-9524-3a8ceae563bd tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:36.912679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-689b72c7-ddb6-4c4f-9524-3a8ceae563bd tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:37.042680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-21afb91c-2c38-4681-91fa-0f4cde283b75 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:37.054278 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-21afb91c-2c38-4681-91fa-0f4cde283b75 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1193 microversion: 2.1 time: 0.165094 Oct 29 01:17:37.055443 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1592/3350] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:36 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1193 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:37.140251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-689b72c7-ddb6-4c4f-9524-3a8ceae563bd tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:37.151060 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-689b72c7-ddb6-4c4f-9524-3a8ceae563bd tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1297 microversion: 2.1 time: 0.291082 Oct 29 01:17:37.172199 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1759/3351] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:36 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1297 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:37.375014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b53eaab7-6f09-4a46-8aed-22267a3ff63f tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:37.377912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b53eaab7-6f09-4a46-8aed-22267a3ff63f tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:37.393612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b53eaab7-6f09-4a46-8aed-22267a3ff63f tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:37.397053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b53eaab7-6f09-4a46-8aed-22267a3ff63f tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:37.397848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b53eaab7-6f09-4a46-8aed-22267a3ff63f tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:37.398914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b53eaab7-6f09-4a46-8aed-22267a3ff63f tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:37.399604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b53eaab7-6f09-4a46-8aed-22267a3ff63f tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:37.403357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b53eaab7-6f09-4a46-8aed-22267a3ff63f tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:37.503826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-14901a08-5767-4f85-b85d-55e9fda7a5b5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96b844c0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:37.591196 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-14901a08-5767-4f85-b85d-55e9fda7a5b5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.091014 Oct 29 01:17:37.607688 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1760/3352] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:37 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:37.738297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b53eaab7-6f09-4a46-8aed-22267a3ff63f tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:37.749629 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b53eaab7-6f09-4a46-8aed-22267a3ff63f tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1546 microversion: 2.1 time: 0.380264 Oct 29 01:17:37.750984 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1593/3353] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:37 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1546 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:37.782916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-09f8bec7-e8e0-40d5-a43f-801ebf9dd169 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:37.785351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-09f8bec7-e8e0-40d5-a43f-801ebf9dd169 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:37.810652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09f8bec7-e8e0-40d5-a43f-801ebf9dd169 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:37.811153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09f8bec7-e8e0-40d5-a43f-801ebf9dd169 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:37.811630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09f8bec7-e8e0-40d5-a43f-801ebf9dd169 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:37.812351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09f8bec7-e8e0-40d5-a43f-801ebf9dd169 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:37.812813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09f8bec7-e8e0-40d5-a43f-801ebf9dd169 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:37.813268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09f8bec7-e8e0-40d5-a43f-801ebf9dd169 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:37.893797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-573a9131-e0bf-434c-b19b-5500a525eda9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:37.894467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-573a9131-e0bf-434c-b19b-5500a525eda9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:37.903952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-573a9131-e0bf-434c-b19b-5500a525eda9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:37.904814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-573a9131-e0bf-434c-b19b-5500a525eda9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:37.907717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-573a9131-e0bf-434c-b19b-5500a525eda9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:37.908663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-573a9131-e0bf-434c-b19b-5500a525eda9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:37.909139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-573a9131-e0bf-434c-b19b-5500a525eda9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:37.909592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-573a9131-e0bf-434c-b19b-5500a525eda9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:37.937597 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-09f8bec7-e8e0-40d5-a43f-801ebf9dd169 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.164928 Oct 29 01:17:38.027468 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1761/3354] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:17:37 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3/os-interface => generated 285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:38.027570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-573a9131-e0bf-434c-b19b-5500a525eda9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:38.027570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-573a9131-e0bf-434c-b19b-5500a525eda9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:38.027570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-573a9131-e0bf-434c-b19b-5500a525eda9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:38.027570 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-573a9131-e0bf-434c-b19b-5500a525eda9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.109893 Oct 29 01:17:38.027570 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1594/3355] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:37 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:17:38.081357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-db8f5ec7-09a6-4ce1-9a94-4e1adccf4bef tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:38.081902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-db8f5ec7-09a6-4ce1-9a94-4e1adccf4bef tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:38.161309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-db8f5ec7-09a6-4ce1-9a94-4e1adccf4bef tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:38.180236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2ce50a1c-b9ad-4337-9fc0-de635cf39827 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:38.180730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2ce50a1c-b9ad-4337-9fc0-de635cf39827 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:38.210086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2ce50a1c-b9ad-4337-9fc0-de635cf39827 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:38.210529 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-db8f5ec7-09a6-4ce1-9a94-4e1adccf4bef tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1193 microversion: 2.1 time: 0.131778 Oct 29 01:17:38.214378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2ce50a1c-b9ad-4337-9fc0-de635cf39827 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:38.215495 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1762/3356] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:38 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1193 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:38.237681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2ce50a1c-b9ad-4337-9fc0-de635cf39827 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:38.254755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2ce50a1c-b9ad-4337-9fc0-de635cf39827 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:38.258265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2ce50a1c-b9ad-4337-9fc0-de635cf39827 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:38.262174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2ce50a1c-b9ad-4337-9fc0-de635cf39827 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:38.339739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2ce50a1c-b9ad-4337-9fc0-de635cf39827 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:38.347150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2ce50a1c-b9ad-4337-9fc0-de635cf39827 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:38.349712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2ce50a1c-b9ad-4337-9fc0-de635cf39827 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:38.351096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-2ce50a1c-b9ad-4337-9fc0-de635cf39827 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lazy-loading 'fault' on Instance uuid 6048315f-8aea-4750-95b0-669ad146085f {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:17:38.438144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2ce50a1c-b9ad-4337-9fc0-de635cf39827 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb4c4f2d60f4affbf6162bd6481f3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677550341e2d495eb0ff2e343c286caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:38.451888 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2ce50a1c-b9ad-4337-9fc0-de635cf39827 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 200 len: 1302 microversion: 2.1 time: 0.276100 Oct 29 01:17:38.453216 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1595/3357] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:38 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 1302 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:38.612991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2be39c96-c4e4-46aa-8ae7-ab23a193c3da tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96bb8ee0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:38.678669 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2be39c96-c4e4-46aa-8ae7-ab23a193c3da tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.074739 Oct 29 01:17:38.687152 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1763/3358] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:38 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:39.054276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-28ee5811-1277-44fc-bbc6-4baa37d2bc80 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:39.055591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-28ee5811-1277-44fc-bbc6-4baa37d2bc80 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:39.069009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28ee5811-1277-44fc-bbc6-4baa37d2bc80 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:39.071070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28ee5811-1277-44fc-bbc6-4baa37d2bc80 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:39.073919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28ee5811-1277-44fc-bbc6-4baa37d2bc80 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:39.074922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28ee5811-1277-44fc-bbc6-4baa37d2bc80 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:39.075555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28ee5811-1277-44fc-bbc6-4baa37d2bc80 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:39.076768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28ee5811-1277-44fc-bbc6-4baa37d2bc80 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:39.241094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ca6bfb27-c9c9-4006-82cd-c8caa2f52aed tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:39.241805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ca6bfb27-c9c9-4006-82cd-c8caa2f52aed tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:39.252461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca6bfb27-c9c9-4006-82cd-c8caa2f52aed tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:39.257957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca6bfb27-c9c9-4006-82cd-c8caa2f52aed tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:39.261452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca6bfb27-c9c9-4006-82cd-c8caa2f52aed tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:39.262383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca6bfb27-c9c9-4006-82cd-c8caa2f52aed tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:39.264648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca6bfb27-c9c9-4006-82cd-c8caa2f52aed tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:39.265281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca6bfb27-c9c9-4006-82cd-c8caa2f52aed tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:39.271656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-28ee5811-1277-44fc-bbc6-4baa37d2bc80 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:39.286433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-28ee5811-1277-44fc-bbc6-4baa37d2bc80 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:39.287984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-28ee5811-1277-44fc-bbc6-4baa37d2bc80 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:39.309872 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-28ee5811-1277-44fc-bbc6-4baa37d2bc80 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.259551 Oct 29 01:17:39.317764 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1596/3359] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:39 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:17:39.385893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ca6bfb27-c9c9-4006-82cd-c8caa2f52aed tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:39.396303 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ca6bfb27-c9c9-4006-82cd-c8caa2f52aed tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1197 microversion: 2.1 time: 0.160213 Oct 29 01:17:39.398069 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1764/3360] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:39 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:39.478024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ab3b2ac1-7d8d-4613-a84b-985b20699419 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:39.479177 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ab3b2ac1-7d8d-4613-a84b-985b20699419 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:39.488390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:39.498678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab3b2ac1-7d8d-4613-a84b-985b20699419 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:39.499562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab3b2ac1-7d8d-4613-a84b-985b20699419 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:39.503750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab3b2ac1-7d8d-4613-a84b-985b20699419 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:39.503750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab3b2ac1-7d8d-4613-a84b-985b20699419 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:39.503750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab3b2ac1-7d8d-4613-a84b-985b20699419 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:39.503750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab3b2ac1-7d8d-4613-a84b-985b20699419 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:39.555818 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-ab3b2ac1-7d8d-4613-a84b-985b20699419 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] HTTP exception thrown: Instance 6048315f-8aea-4750-95b0-669ad146085f could not be found. Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ab3b2ac1-7d8d-4613-a84b-985b20699419 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Request method failure captured: Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f HTTP/1.1 Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7I4HOyzycOoRJE1MrmYWPYKdvgOgA_mj7I6jvMAXMxyNsmk1ITdG8ol9j2K6AZgXRkk7nDMoUWX-ee1qpaAwK34VqxNX_wM6_i6Aa29pAt0Y29sew1zKSBO3EKWU0O9YcjyZ6YAVsqWXJBiEKrRuXIPFMnB5bd_LjRA_2qw4we144 Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 677550341e2d495eb0ff2e343c286caa Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersTestMultiNic-153387240 Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/677550341e2d495eb0ff2e343c286caa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/677550341e2d495eb0ff2e343c286caa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/677550341e2d495eb0ff2e343c286caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_677550341e2d495eb0ff2e343c286caa", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersTestMultiNic-153387240 Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 677550341e2d495eb0ff2e343c286caa Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersTestMultiNic-153387240 Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersTestMultiNic-153387240-project Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 2eb4c4f2d60f4affbf6162bd6481f3a3 Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersTestMultiNic-153387240-project Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 6048315f-8aea-4750-95b0-669ad146085f could not be found. Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '6048315f-8aea-4750-95b0-669ad146085f'} Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6048315f-8aea-4750-95b0-669ad146085f could not be found. Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6048315f-8aea-4750-95b0-669ad146085f could not be found. Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:39.557893 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:39.562406 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:39.562406 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:39.562406 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:39.562406 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:39.562406 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:39.562406 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6048315f-8aea-4750-95b0-669ad146085f could not be found. Oct 29 01:17:39.562406 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:39.564184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ab3b2ac1-7d8d-4613-a84b-985b20699419 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Returning 404 to user: Instance 6048315f-8aea-4750-95b0-669ad146085f could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:39.565368 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ab3b2ac1-7d8d-4613-a84b-985b20699419 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 404 len: 111 microversion: 2.1 time: 0.091614 Oct 29 01:17:39.579851 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1597/3361] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:39 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:17:39.694984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5b2f4134-269a-4a81-be0e-0797dd1a1cbd tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96c2e820>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:39.790311 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5b2f4134-269a-4a81-be0e-0797dd1a1cbd tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1413 microversion: 2.1 time: 0.099086 Oct 29 01:17:39.791340 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1765/3362] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:39 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1413 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:40.342435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-01812396-d7ba-4288-b159-13f13892931b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:40.343052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-01812396-d7ba-4288-b159-13f13892931b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:40.358553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:40.363616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01812396-d7ba-4288-b159-13f13892931b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:40.363616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01812396-d7ba-4288-b159-13f13892931b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:40.363616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01812396-d7ba-4288-b159-13f13892931b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:40.363616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01812396-d7ba-4288-b159-13f13892931b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:40.363616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01812396-d7ba-4288-b159-13f13892931b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:40.363616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01812396-d7ba-4288-b159-13f13892931b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:40.427156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b974c0e3-3f84-4ca6-b44e-35aab5cff6f3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:40.427787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b974c0e3-3f84-4ca6-b44e-35aab5cff6f3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:40.442518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b974c0e3-3f84-4ca6-b44e-35aab5cff6f3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:40.443025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b974c0e3-3f84-4ca6-b44e-35aab5cff6f3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:40.443466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b974c0e3-3f84-4ca6-b44e-35aab5cff6f3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:40.444194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b974c0e3-3f84-4ca6-b44e-35aab5cff6f3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:40.444647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b974c0e3-3f84-4ca6-b44e-35aab5cff6f3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:40.445071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b974c0e3-3f84-4ca6-b44e-35aab5cff6f3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:40.543454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-01812396-d7ba-4288-b159-13f13892931b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:40.560176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-01812396-d7ba-4288-b159-13f13892931b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:40.563976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-01812396-d7ba-4288-b159-13f13892931b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:40.581698 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-01812396-d7ba-4288-b159-13f13892931b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.243310 Oct 29 01:17:40.582631 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1598/3363] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:40 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:40.743479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b974c0e3-3f84-4ca6-b44e-35aab5cff6f3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:40.758381 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b974c0e3-3f84-4ca6-b44e-35aab5cff6f3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1245 microversion: 2.1 time: 0.335941 Oct 29 01:17:40.761679 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1766/3364] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:40 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1245 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:40.819765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-37336e6f-350f-467a-92b2-7ed7307080b6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9fe63af0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:40.956377 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-37336e6f-350f-467a-92b2-7ed7307080b6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1422 microversion: 2.1 time: 0.150887 Oct 29 01:17:40.957272 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1599/3365] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:40 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1422 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:40.979366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-228fd915-1d8e-4886-83ac-2041b4767722 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96bb8ee0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:41.072197 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-228fd915-1d8e-4886-83ac-2041b4767722 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 200 len: 1422 microversion: 2.1 time: 0.103464 Oct 29 01:17:41.074851 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1767/3366] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:17:40 2022] GET /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 1422 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:41.092859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-11041278-f1fd-4200-be52-7c74a2e3b0de tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9ff23dc0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:41.396897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-75fbc0c3-8177-4195-9c8d-c4592bac2e8b req-a5c965a7-7fde-4d3f-8cc0-10ef3cbcd198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7341065-fb16-4c56-9924-fe9a56d7a7b3", "tag": "abf3212e-ab37-4f92-9f15-e2695f580a30"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:41.444253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-75fbc0c3-8177-4195-9c8d-c4592bac2e8b req-a5c965a7-7fde-4d3f-8cc0-10ef3cbcd198 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:41.446961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-75fbc0c3-8177-4195-9c8d-c4592bac2e8b req-a5c965a7-7fde-4d3f-8cc0-10ef3cbcd198 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:41.448547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-75fbc0c3-8177-4195-9c8d-c4592bac2e8b req-a5c965a7-7fde-4d3f-8cc0-10ef3cbcd198 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:41.485194 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-75fbc0c3-8177-4195-9c8d-c4592bac2e8b req-a5c965a7-7fde-4d3f-8cc0-10ef3cbcd198 service nova] Creating event network-changed:abf3212e-ab37-4f92-9f15-e2695f580a30 for instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 on n-h2-862964-3 Oct 29 01:17:41.511029 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-75fbc0c3-8177-4195-9c8d-c4592bac2e8b req-a5c965a7-7fde-4d3f-8cc0-10ef3cbcd198 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116352 Oct 29 01:17:41.513367 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1768/3367] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:41.618388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-09e5bb23-22ff-4c12-ab36-01e628db3c7c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:41.619477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-09e5bb23-22ff-4c12-ab36-01e628db3c7c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:41.627423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09e5bb23-22ff-4c12-ab36-01e628db3c7c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:41.627923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09e5bb23-22ff-4c12-ab36-01e628db3c7c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:41.628792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09e5bb23-22ff-4c12-ab36-01e628db3c7c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:41.629687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09e5bb23-22ff-4c12-ab36-01e628db3c7c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:41.630155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09e5bb23-22ff-4c12-ab36-01e628db3c7c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:41.630587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09e5bb23-22ff-4c12-ab36-01e628db3c7c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:41.754746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-09e5bb23-22ff-4c12-ab36-01e628db3c7c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:41.770960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-09e5bb23-22ff-4c12-ab36-01e628db3c7c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:41.774406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-09e5bb23-22ff-4c12-ab36-01e628db3c7c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:41.784470 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-09e5bb23-22ff-4c12-ab36-01e628db3c7c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.172302 Oct 29 01:17:41.785816 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1769/3368] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:41 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:17:41.793062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dff85ead-b5cd-4913-afea-87d113c71bfd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:41.794547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dff85ead-b5cd-4913-afea-87d113c71bfd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:41.803891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dff85ead-b5cd-4913-afea-87d113c71bfd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:41.805391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dff85ead-b5cd-4913-afea-87d113c71bfd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:41.806029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dff85ead-b5cd-4913-afea-87d113c71bfd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:41.807865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dff85ead-b5cd-4913-afea-87d113c71bfd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:41.808687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dff85ead-b5cd-4913-afea-87d113c71bfd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:41.809708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dff85ead-b5cd-4913-afea-87d113c71bfd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:41.838120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:42.001142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dff85ead-b5cd-4913-afea-87d113c71bfd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:42.019418 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dff85ead-b5cd-4913-afea-87d113c71bfd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1253 microversion: 2.1 time: 0.231630 Oct 29 01:17:42.020748 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1770/3369] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:41 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1253 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:42.814695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1ee7191e-8dcb-4620-a0a0-d832ddfe592b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:42.815353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1ee7191e-8dcb-4620-a0a0-d832ddfe592b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:42.824698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ee7191e-8dcb-4620-a0a0-d832ddfe592b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:42.825253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ee7191e-8dcb-4620-a0a0-d832ddfe592b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:42.825803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ee7191e-8dcb-4620-a0a0-d832ddfe592b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:42.826361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ee7191e-8dcb-4620-a0a0-d832ddfe592b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:42.826809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ee7191e-8dcb-4620-a0a0-d832ddfe592b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:42.827219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ee7191e-8dcb-4620-a0a0-d832ddfe592b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:42.956166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ee7191e-8dcb-4620-a0a0-d832ddfe592b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:42.974048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ee7191e-8dcb-4620-a0a0-d832ddfe592b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:42.976689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ee7191e-8dcb-4620-a0a0-d832ddfe592b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:42.988599 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1ee7191e-8dcb-4620-a0a0-d832ddfe592b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.177973 Oct 29 01:17:43.018807 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1771/3370] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:42 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:17:43.037913 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-11041278-f1fd-4200-be52-7c74a2e3b0de tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 204 len: 0 microversion: 2.1 time: 1.953308 Oct 29 01:17:43.039006 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1600/3371] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:41 2022] DELETE /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 0 bytes in 1955 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:17:43.047756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e2f19c76-049a-4657-b4f5-2a5a844c4803 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:43.052147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e2f19c76-049a-4657-b4f5-2a5a844c4803 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:43.052283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-38385a5a-397f-47f5-a366-118db1d821e4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:43.052283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-38385a5a-397f-47f5-a366-118db1d821e4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:43.063114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2f19c76-049a-4657-b4f5-2a5a844c4803 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:43.063987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2f19c76-049a-4657-b4f5-2a5a844c4803 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:43.064660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2f19c76-049a-4657-b4f5-2a5a844c4803 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:43.065623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2f19c76-049a-4657-b4f5-2a5a844c4803 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:43.066312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2f19c76-049a-4657-b4f5-2a5a844c4803 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:43.068359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2f19c76-049a-4657-b4f5-2a5a844c4803 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:43.070132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38385a5a-397f-47f5-a366-118db1d821e4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:43.070627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38385a5a-397f-47f5-a366-118db1d821e4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:43.074534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38385a5a-397f-47f5-a366-118db1d821e4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:43.077374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38385a5a-397f-47f5-a366-118db1d821e4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:43.078058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38385a5a-397f-47f5-a366-118db1d821e4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:43.079218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38385a5a-397f-47f5-a366-118db1d821e4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:43.129430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e2f19c76-049a-4657-b4f5-2a5a844c4803 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:17:43.389840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-38385a5a-397f-47f5-a366-118db1d821e4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:43.431824 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-38385a5a-397f-47f5-a366-118db1d821e4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1293 microversion: 2.1 time: 0.386847 Oct 29 01:17:43.435546 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1772/3372] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:43 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1293 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:43.699038 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e2f19c76-049a-4657-b4f5-2a5a844c4803 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 204 len: 0 microversion: 2.1 time: 0.654410 Oct 29 01:17:43.700077 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1601/3373] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:17:43 2022] DELETE /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:17:43.862038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-da1a0484-e184-4052-8bcd-55e9987fcd06 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-890548323", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "417ddcf9-7930-440b-995d-5ce0b1f48a9f"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:43.951808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-da1a0484-e184-4052-8bcd-55e9987fcd06 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] validate_networks() for [('417ddcf9-7930-440b-995d-5ce0b1f48a9f', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:17:44.025246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ab17ea03-bc99-4514-9fdd-54b986d550f8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:44.027465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ab17ea03-bc99-4514-9fdd-54b986d550f8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:44.041890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab17ea03-bc99-4514-9fdd-54b986d550f8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:44.043136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab17ea03-bc99-4514-9fdd-54b986d550f8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:44.044483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab17ea03-bc99-4514-9fdd-54b986d550f8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:44.045744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab17ea03-bc99-4514-9fdd-54b986d550f8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:44.046628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab17ea03-bc99-4514-9fdd-54b986d550f8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:44.047311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab17ea03-bc99-4514-9fdd-54b986d550f8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:44.582044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ab17ea03-bc99-4514-9fdd-54b986d550f8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:44.590819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ab17ea03-bc99-4514-9fdd-54b986d550f8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:44.598232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ab17ea03-bc99-4514-9fdd-54b986d550f8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:44.610607 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ab17ea03-bc99-4514-9fdd-54b986d550f8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1556 microversion: 2.91 time: 0.589712 Oct 29 01:17:44.622427 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1602/3374] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:44 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1556 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:17:44.622427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4b458855-d6a8-4472-b142-e8e22341b744 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:44.622427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4b458855-d6a8-4472-b142-e8e22341b744 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:44.642832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b458855-d6a8-4472-b142-e8e22341b744 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:44.643332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b458855-d6a8-4472-b142-e8e22341b744 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:44.643941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b458855-d6a8-4472-b142-e8e22341b744 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:44.644736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b458855-d6a8-4472-b142-e8e22341b744 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:44.645144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b458855-d6a8-4472-b142-e8e22341b744 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:44.645605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b458855-d6a8-4472-b142-e8e22341b744 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:44.937365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4b458855-d6a8-4472-b142-e8e22341b744 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:44.947317 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4b458855-d6a8-4472-b142-e8e22341b744 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1293 microversion: 2.1 time: 0.328761 Oct 29 01:17:44.969245 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1603/3375] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:44 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1293 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:45.027496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-f86a4ac4-9718-44b2-92d5-281854599ac5 req-882742ac-5cae-47bb-b813-5482c02d63ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9692f5b-742e-4f42-ac47-05a1e536ac05", "name": "network-vif-unplugged", "status": "completed", "tag": "95874789-ba8d-4fde-af5a-a4ae2d7a894c"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:45.045032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f86a4ac4-9718-44b2-92d5-281854599ac5 req-882742ac-5cae-47bb-b813-5482c02d63ed service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:45.046191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f86a4ac4-9718-44b2-92d5-281854599ac5 req-882742ac-5cae-47bb-b813-5482c02d63ed service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:45.046323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f86a4ac4-9718-44b2-92d5-281854599ac5 req-882742ac-5cae-47bb-b813-5482c02d63ed service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:45.087177 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f86a4ac4-9718-44b2-92d5-281854599ac5 req-882742ac-5cae-47bb-b813-5482c02d63ed service nova] Creating event network-vif-unplugged:95874789-ba8d-4fde-af5a-a4ae2d7a894c for instance d9692f5b-742e-4f42-ac47-05a1e536ac05 on n-h2-862964-3 Oct 29 01:17:45.102357 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-f86a4ac4-9718-44b2-92d5-281854599ac5 req-882742ac-5cae-47bb-b813-5482c02d63ed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074999 Oct 29 01:17:45.102357 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1604/3376] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:45.114631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fb07a733-4bf2-4e86-9cd7-0b7c5cbc45ad tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:45.115300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fb07a733-4bf2-4e86-9cd7-0b7c5cbc45ad tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:45.127565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb07a733-4bf2-4e86-9cd7-0b7c5cbc45ad tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:45.128588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb07a733-4bf2-4e86-9cd7-0b7c5cbc45ad tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:45.129756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb07a733-4bf2-4e86-9cd7-0b7c5cbc45ad tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:45.131173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb07a733-4bf2-4e86-9cd7-0b7c5cbc45ad tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:45.132308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb07a733-4bf2-4e86-9cd7-0b7c5cbc45ad tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:45.133275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb07a733-4bf2-4e86-9cd7-0b7c5cbc45ad tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:45.170597 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-fb07a733-4bf2-4e86-9cd7-0b7c5cbc45ad tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] HTTP exception thrown: Instance 6048315f-8aea-4750-95b0-669ad146085f could not be found. Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fb07a733-4bf2-4e86-9cd7-0b7c5cbc45ad tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Request method failure captured: Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f HTTP/1.1 Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7I4HOyzycOoRJE1MrmYWPYKdvgOgA_mj7I6jvMAXMxyNsmk1ITdG8ol9j2K6AZgXRkk7nDMoUWX-ee1qpaAwK34VqxNX_wM6_i6Aa29pAt0Y29sew1zKSBO3EKWU0O9YcjyZ6YAVsqWXJBiEKrRuXIPFMnB5bd_LjRA_2qw4we144 Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 677550341e2d495eb0ff2e343c286caa Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersTestMultiNic-153387240 Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/677550341e2d495eb0ff2e343c286caa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/677550341e2d495eb0ff2e343c286caa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/677550341e2d495eb0ff2e343c286caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_677550341e2d495eb0ff2e343c286caa", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersTestMultiNic-153387240 Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 677550341e2d495eb0ff2e343c286caa Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersTestMultiNic-153387240 Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersTestMultiNic-153387240-project Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 2eb4c4f2d60f4affbf6162bd6481f3a3 Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersTestMultiNic-153387240-project Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 6048315f-8aea-4750-95b0-669ad146085f could not be found. Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '6048315f-8aea-4750-95b0-669ad146085f'} Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6048315f-8aea-4750-95b0-669ad146085f could not be found. Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:17:45.172980 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:17:45.176988 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6048315f-8aea-4750-95b0-669ad146085f could not be found. Oct 29 01:17:45.176988 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.176988 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:45.176988 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.176988 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:45.176988 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:45.176988 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:45.176988 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:45.176988 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:45.176988 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6048315f-8aea-4750-95b0-669ad146085f could not be found. Oct 29 01:17:45.176988 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.189503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-da1a0484-e184-4052-8bcd-55e9987fcd06 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:17:45.190682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-da1a0484-e184-4052-8bcd-55e9987fcd06 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:17:45.191428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-da1a0484-e184-4052-8bcd-55e9987fcd06 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:17:45.192063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-da1a0484-e184-4052-8bcd-55e9987fcd06 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:17:45.192705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-da1a0484-e184-4052-8bcd-55e9987fcd06 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:17:45.202350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fb07a733-4bf2-4e86-9cd7-0b7c5cbc45ad tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Returning 404 to user: Instance 6048315f-8aea-4750-95b0-669ad146085f could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:45.203795 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fb07a733-4bf2-4e86-9cd7-0b7c5cbc45ad tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 404 len: 111 microversion: 2.1 time: 0.093621 Oct 29 01:17:45.210716 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1605/3377] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:17:45 2022] DELETE /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:17:45.219546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a1920ba9-177c-4741-b6e8-adcd1d09e707 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:45.222850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da1a0484-e184-4052-8bcd-55e9987fcd06 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:45.224314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da1a0484-e184-4052-8bcd-55e9987fcd06 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:45.226982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da1a0484-e184-4052-8bcd-55e9987fcd06 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:45.228536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da1a0484-e184-4052-8bcd-55e9987fcd06 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:45.238076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da1a0484-e184-4052-8bcd-55e9987fcd06 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:45.238076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da1a0484-e184-4052-8bcd-55e9987fcd06 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:45.238311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a1920ba9-177c-4741-b6e8-adcd1d09e707 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: 6048315f-8aea-4750-95b0-669ad146085f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:45.250818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1920ba9-177c-4741-b6e8-adcd1d09e707 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:45.251359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1920ba9-177c-4741-b6e8-adcd1d09e707 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:45.253394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1920ba9-177c-4741-b6e8-adcd1d09e707 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:45.256232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1920ba9-177c-4741-b6e8-adcd1d09e707 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:45.256730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1920ba9-177c-4741-b6e8-adcd1d09e707 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:45.259547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1920ba9-177c-4741-b6e8-adcd1d09e707 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:45.275121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:45.281977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-da1a0484-e184-4052-8bcd-55e9987fcd06 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Getting quotas for project b284e70790cf43e2b474559bb3e20faf. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:17:45.287794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:45.289475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-da1a0484-e184-4052-8bcd-55e9987fcd06 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Getting quotas for user a35b358af11846f78debaf9e422a9558 and project b284e70790cf43e2b474559bb3e20faf. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:17:45.306479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-da1a0484-e184-4052-8bcd-55e9987fcd06 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:17:45.310287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-da1a0484-e184-4052-8bcd-55e9987fcd06 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:17:45.313402 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-a1920ba9-177c-4741-b6e8-adcd1d09e707 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] HTTP exception thrown: Instance 6048315f-8aea-4750-95b0-669ad146085f could not be found. Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a1920ba9-177c-4741-b6e8-adcd1d09e707 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Request method failure captured: Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f HTTP/1.1 Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7I4HOyzycOoRJE1MrmYWPYKdvgOgA_mj7I6jvMAXMxyNsmk1ITdG8ol9j2K6AZgXRkk7nDMoUWX-ee1qpaAwK34VqxNX_wM6_i6Aa29pAt0Y29sew1zKSBO3EKWU0O9YcjyZ6YAVsqWXJBiEKrRuXIPFMnB5bd_LjRA_2qw4we144 Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 677550341e2d495eb0ff2e343c286caa Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersTestMultiNic-153387240 Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/677550341e2d495eb0ff2e343c286caa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/677550341e2d495eb0ff2e343c286caa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/677550341e2d495eb0ff2e343c286caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_677550341e2d495eb0ff2e343c286caa", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersTestMultiNic-153387240 Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 677550341e2d495eb0ff2e343c286caa Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersTestMultiNic-153387240 Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersTestMultiNic-153387240-project Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 2eb4c4f2d60f4affbf6162bd6481f3a3 Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersTestMultiNic-153387240-project Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 6048315f-8aea-4750-95b0-669ad146085f could not be found. Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '6048315f-8aea-4750-95b0-669ad146085f'} Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6048315f-8aea-4750-95b0-669ad146085f could not be found. Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6048315f-8aea-4750-95b0-669ad146085f could not be found. Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:45.316083 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.330884 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:45.330884 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:45.330884 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:45.330884 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:45.330884 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:45.330884 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6048315f-8aea-4750-95b0-669ad146085f could not be found. Oct 29 01:17:45.330884 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.330884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a1920ba9-177c-4741-b6e8-adcd1d09e707 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Returning 404 to user: Instance 6048315f-8aea-4750-95b0-669ad146085f could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:45.330884 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a1920ba9-177c-4741-b6e8-adcd1d09e707 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f" status: 404 len: 111 microversion: 2.1 time: 0.113979 Oct 29 01:17:45.330884 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1606/3378] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:45 2022] GET /compute/v2.1/servers/6048315f-8aea-4750-95b0-669ad146085f => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:17:45.350159 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e1380962-2266-449d-8afd-4c4d298c3e89 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:45.357823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e1380962-2266-449d-8afd-4c4d298c3e89 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:45.382653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1380962-2266-449d-8afd-4c4d298c3e89 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:45.385991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1380962-2266-449d-8afd-4c4d298c3e89 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:45.387283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1380962-2266-449d-8afd-4c4d298c3e89 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:45.388893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1380962-2266-449d-8afd-4c4d298c3e89 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:45.390753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1380962-2266-449d-8afd-4c4d298c3e89 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:45.391461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1380962-2266-449d-8afd-4c4d298c3e89 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:45.409131 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-e1380962-2266-449d-8afd-4c4d298c3e89 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] HTTP exception thrown: Instance b6448587-2777-40b9-a6c5-514e56ac388d could not be found. Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e1380962-2266-449d-8afd-4c4d298c3e89 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Request method failure captured: Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d HTTP/1.1 Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7I4HOyzycOoRJE1MrmYWPYKdvgOgA_mj7I6jvMAXMxyNsmk1ITdG8ol9j2K6AZgXRkk7nDMoUWX-ee1qpaAwK34VqxNX_wM6_i6Aa29pAt0Y29sew1zKSBO3EKWU0O9YcjyZ6YAVsqWXJBiEKrRuXIPFMnB5bd_LjRA_2qw4we144 Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 677550341e2d495eb0ff2e343c286caa Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersTestMultiNic-153387240 Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/677550341e2d495eb0ff2e343c286caa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/677550341e2d495eb0ff2e343c286caa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/677550341e2d495eb0ff2e343c286caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_677550341e2d495eb0ff2e343c286caa", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersTestMultiNic-153387240 Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 677550341e2d495eb0ff2e343c286caa Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersTestMultiNic-153387240 Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersTestMultiNic-153387240-project Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 2eb4c4f2d60f4affbf6162bd6481f3a3 Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersTestMultiNic-153387240-project Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance b6448587-2777-40b9-a6c5-514e56ac388d could not be found. Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'b6448587-2777-40b9-a6c5-514e56ac388d'} Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6448587-2777-40b9-a6c5-514e56ac388d could not be found. Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:17:45.411244 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:17:45.415183 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6448587-2777-40b9-a6c5-514e56ac388d could not be found. Oct 29 01:17:45.415183 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.415183 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:45.415183 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.415183 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:45.415183 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:45.415183 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:45.415183 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:45.415183 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:45.415183 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6448587-2777-40b9-a6c5-514e56ac388d could not be found. Oct 29 01:17:45.415183 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.418672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e1380962-2266-449d-8afd-4c4d298c3e89 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Returning 404 to user: Instance b6448587-2777-40b9-a6c5-514e56ac388d could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:45.419902 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e1380962-2266-449d-8afd-4c4d298c3e89 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 404 len: 111 microversion: 2.1 time: 0.087651 Oct 29 01:17:45.421645 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1607/3379] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:17:45 2022] DELETE /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:17:45.437500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6890864e-6d57-4a6c-8a06-f74430fe5674 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:45.438488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6890864e-6d57-4a6c-8a06-f74430fe5674 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] [instance: b6448587-2777-40b9-a6c5-514e56ac388d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:45.445492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6890864e-6d57-4a6c-8a06-f74430fe5674 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:45.446299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6890864e-6d57-4a6c-8a06-f74430fe5674 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:45.446955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6890864e-6d57-4a6c-8a06-f74430fe5674 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:45.448411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6890864e-6d57-4a6c-8a06-f74430fe5674 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:45.449082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6890864e-6d57-4a6c-8a06-f74430fe5674 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:45.449753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6890864e-6d57-4a6c-8a06-f74430fe5674 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:45.500742 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-6890864e-6d57-4a6c-8a06-f74430fe5674 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] HTTP exception thrown: Instance b6448587-2777-40b9-a6c5-514e56ac388d could not be found. Oct 29 01:17:45.501065 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-da1a0484-e184-4052-8bcd-55e9987fcd06 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.637406 Oct 29 01:17:45.505531 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1773/3380] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:17:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6890864e-6d57-4a6c-8a06-f74430fe5674 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Request method failure captured: Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d HTTP/1.1 Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7I4HOyzycOoRJE1MrmYWPYKdvgOgA_mj7I6jvMAXMxyNsmk1ITdG8ol9j2K6AZgXRkk7nDMoUWX-ee1qpaAwK34VqxNX_wM6_i6Aa29pAt0Y29sew1zKSBO3EKWU0O9YcjyZ6YAVsqWXJBiEKrRuXIPFMnB5bd_LjRA_2qw4we144 Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 677550341e2d495eb0ff2e343c286caa Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersTestMultiNic-153387240 Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/677550341e2d495eb0ff2e343c286caa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/677550341e2d495eb0ff2e343c286caa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/677550341e2d495eb0ff2e343c286caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_677550341e2d495eb0ff2e343c286caa", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersTestMultiNic-153387240 Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 677550341e2d495eb0ff2e343c286caa Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersTestMultiNic-153387240 Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersTestMultiNic-153387240-project Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 2eb4c4f2d60f4affbf6162bd6481f3a3 Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersTestMultiNic-153387240-project Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance b6448587-2777-40b9-a6c5-514e56ac388d could not be found. Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'b6448587-2777-40b9-a6c5-514e56ac388d'} Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6448587-2777-40b9-a6c5-514e56ac388d could not be found. Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6448587-2777-40b9-a6c5-514e56ac388d could not be found. Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:45.507620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.512334 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:45.512334 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:45.512334 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:45.512334 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:45.512334 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:45.512334 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6448587-2777-40b9-a6c5-514e56ac388d could not be found. Oct 29 01:17:45.512334 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:45.515653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6890864e-6d57-4a6c-8a06-f74430fe5674 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] Returning 404 to user: Instance b6448587-2777-40b9-a6c5-514e56ac388d could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:45.519392 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6890864e-6d57-4a6c-8a06-f74430fe5674 tempest-ServersTestMultiNic-153387240 tempest-ServersTestMultiNic-153387240-project] 10.222.0.26 "GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d" status: 404 len: 111 microversion: 2.1 time: 0.092953 Oct 29 01:17:45.520052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bfbe084a-d8e1-46be-ad48-5c70c6c36c91 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:45.522828 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1608/3381] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:45 2022] GET /compute/v2.1/servers/b6448587-2777-40b9-a6c5-514e56ac388d => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:17:45.522981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bfbe084a-d8e1-46be-ad48-5c70c6c36c91 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:45.646733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9716d8e7-177b-462f-b430-b5fad1ba7f73 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:45.647712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9716d8e7-177b-462f-b430-b5fad1ba7f73 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:45.660041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9716d8e7-177b-462f-b430-b5fad1ba7f73 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:45.664005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9716d8e7-177b-462f-b430-b5fad1ba7f73 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:45.664521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9716d8e7-177b-462f-b430-b5fad1ba7f73 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:45.665371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9716d8e7-177b-462f-b430-b5fad1ba7f73 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:45.668632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9716d8e7-177b-462f-b430-b5fad1ba7f73 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:45.669241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9716d8e7-177b-462f-b430-b5fad1ba7f73 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:45.711960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bfbe084a-d8e1-46be-ad48-5c70c6c36c91 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:45.720236 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bfbe084a-d8e1-46be-ad48-5c70c6c36c91 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1207 microversion: 2.1 time: 0.209265 Oct 29 01:17:45.720831 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1774/3382] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:45 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1207 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:45.895232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9716d8e7-177b-462f-b430-b5fad1ba7f73 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:45.912408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9716d8e7-177b-462f-b430-b5fad1ba7f73 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:45.915862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9716d8e7-177b-462f-b430-b5fad1ba7f73 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:45.933889 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9716d8e7-177b-462f-b430-b5fad1ba7f73 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1556 microversion: 2.91 time: 0.291595 Oct 29 01:17:45.936102 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1609/3383] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:45 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1556 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:45.982759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cab02e36-2bc1-4746-a14e-e554328dedde tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:45.986798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cab02e36-2bc1-4746-a14e-e554328dedde tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:45.994012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cab02e36-2bc1-4746-a14e-e554328dedde tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:45.995201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cab02e36-2bc1-4746-a14e-e554328dedde tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:45.996011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cab02e36-2bc1-4746-a14e-e554328dedde tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:45.996970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cab02e36-2bc1-4746-a14e-e554328dedde tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:45.998032 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cab02e36-2bc1-4746-a14e-e554328dedde tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:45.998729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cab02e36-2bc1-4746-a14e-e554328dedde tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:46.340233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cab02e36-2bc1-4746-a14e-e554328dedde tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:46.349544 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cab02e36-2bc1-4746-a14e-e554328dedde tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1293 microversion: 2.1 time: 0.379508 Oct 29 01:17:46.358400 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1775/3384] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:45 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1293 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:46.438179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-23893f09-8b03-4a14-9a9d-0b5ac5d945a0 req-0a29a96f-d66d-4f3f-9165-49f6b59457c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0741da1d-27c3-4b27-85b9-37d645e7ff26", "tag": "863c5fe7-60c8-40c2-a9d5-f487d712cacf"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:46.451517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-23893f09-8b03-4a14-9a9d-0b5ac5d945a0 req-0a29a96f-d66d-4f3f-9165-49f6b59457c6 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:46.452143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-23893f09-8b03-4a14-9a9d-0b5ac5d945a0 req-0a29a96f-d66d-4f3f-9165-49f6b59457c6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:46.452806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-23893f09-8b03-4a14-9a9d-0b5ac5d945a0 req-0a29a96f-d66d-4f3f-9165-49f6b59457c6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:46.467132 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-23893f09-8b03-4a14-9a9d-0b5ac5d945a0 req-0a29a96f-d66d-4f3f-9165-49f6b59457c6 service nova] Creating event network-changed:863c5fe7-60c8-40c2-a9d5-f487d712cacf for instance 0741da1d-27c3-4b27-85b9-37d645e7ff26 on n-h1-862964-3 Oct 29 01:17:46.491248 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-23893f09-8b03-4a14-9a9d-0b5ac5d945a0 req-0a29a96f-d66d-4f3f-9165-49f6b59457c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056861 Oct 29 01:17:46.492580 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1610/3385] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:46.747675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e44e7536-71ab-41ba-9b9e-7d778f555a1f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:46.749610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e44e7536-71ab-41ba-9b9e-7d778f555a1f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:46.866874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e44e7536-71ab-41ba-9b9e-7d778f555a1f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:46.878787 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e44e7536-71ab-41ba-9b9e-7d778f555a1f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1207 microversion: 2.1 time: 0.136084 Oct 29 01:17:46.881562 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1776/3386] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:46 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1207 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:46.971031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e0ca5200-c9a4-4f0c-8763-55ac5053b069 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:46.971814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e0ca5200-c9a4-4f0c-8763-55ac5053b069 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:46.982962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0ca5200-c9a4-4f0c-8763-55ac5053b069 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:46.983976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0ca5200-c9a4-4f0c-8763-55ac5053b069 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:46.984650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0ca5200-c9a4-4f0c-8763-55ac5053b069 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:46.985768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0ca5200-c9a4-4f0c-8763-55ac5053b069 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:46.986583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0ca5200-c9a4-4f0c-8763-55ac5053b069 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:46.987265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0ca5200-c9a4-4f0c-8763-55ac5053b069 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:47.054747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:47.114920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e0ca5200-c9a4-4f0c-8763-55ac5053b069 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:47.130380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e0ca5200-c9a4-4f0c-8763-55ac5053b069 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:47.132303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e0ca5200-c9a4-4f0c-8763-55ac5053b069 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:47.156416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-53733cc5-16b0-4d2f-86d1-edaa4a4f19ea req-c3eb1e7a-1b06-450e-b142-44c34fb069ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9692f5b-742e-4f42-ac47-05a1e536ac05", "name": "network-vif-deleted", "tag": "95874789-ba8d-4fde-af5a-a4ae2d7a894c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:47.178476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-53733cc5-16b0-4d2f-86d1-edaa4a4f19ea req-c3eb1e7a-1b06-450e-b142-44c34fb069ae service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:47.181533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-53733cc5-16b0-4d2f-86d1-edaa4a4f19ea req-c3eb1e7a-1b06-450e-b142-44c34fb069ae service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:47.183052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-53733cc5-16b0-4d2f-86d1-edaa4a4f19ea req-c3eb1e7a-1b06-450e-b142-44c34fb069ae service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:47.194901 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e0ca5200-c9a4-4f0c-8763-55ac5053b069 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1556 microversion: 2.91 time: 0.228189 Oct 29 01:17:47.211929 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-53733cc5-16b0-4d2f-86d1-edaa4a4f19ea req-c3eb1e7a-1b06-450e-b142-44c34fb069ae service nova] Creating event network-vif-deleted:95874789-ba8d-4fde-af5a-a4ae2d7a894c for instance d9692f5b-742e-4f42-ac47-05a1e536ac05 on n-h2-862964-3 Oct 29 01:17:47.226870 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-53733cc5-16b0-4d2f-86d1-edaa4a4f19ea req-c3eb1e7a-1b06-450e-b142-44c34fb069ae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074025 Oct 29 01:17:47.227741 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1777/3387] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:47.240288 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1611/3388] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:46 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1556 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:17:47.378191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6dbdf68b-f243-42fb-9b07-558b30e66d0e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:47.378958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6dbdf68b-f243-42fb-9b07-558b30e66d0e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:47.387116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dbdf68b-f243-42fb-9b07-558b30e66d0e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:47.387623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dbdf68b-f243-42fb-9b07-558b30e66d0e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:47.388068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dbdf68b-f243-42fb-9b07-558b30e66d0e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:47.390021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dbdf68b-f243-42fb-9b07-558b30e66d0e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:47.392661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dbdf68b-f243-42fb-9b07-558b30e66d0e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:47.393113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dbdf68b-f243-42fb-9b07-558b30e66d0e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:47.910823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c03aa660-089e-4e2e-889f-581f461b5f55 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:47.910823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c03aa660-089e-4e2e-889f-581f461b5f55 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:47.921144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c03aa660-089e-4e2e-889f-581f461b5f55 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:47.921666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c03aa660-089e-4e2e-889f-581f461b5f55 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:47.922332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c03aa660-089e-4e2e-889f-581f461b5f55 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:47.923359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c03aa660-089e-4e2e-889f-581f461b5f55 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:47.923827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c03aa660-089e-4e2e-889f-581f461b5f55 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:47.924226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c03aa660-089e-4e2e-889f-581f461b5f55 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:48.022110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6dbdf68b-f243-42fb-9b07-558b30e66d0e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:48.038635 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6dbdf68b-f243-42fb-9b07-558b30e66d0e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1293 microversion: 2.1 time: 0.665247 Oct 29 01:17:48.046152 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1778/3389] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:47 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1293 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:48.143595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c03aa660-089e-4e2e-889f-581f461b5f55 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:48.156289 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c03aa660-089e-4e2e-889f-581f461b5f55 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1259 microversion: 2.1 time: 0.253593 Oct 29 01:17:48.174233 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1612/3390] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:47 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1259 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:48.240179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3d667eeb-b5b2-4bd1-aec2-d55659ab3506 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:48.240910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3d667eeb-b5b2-4bd1-aec2-d55659ab3506 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:48.251010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d667eeb-b5b2-4bd1-aec2-d55659ab3506 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:48.252217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d667eeb-b5b2-4bd1-aec2-d55659ab3506 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:48.252903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d667eeb-b5b2-4bd1-aec2-d55659ab3506 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:48.253884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d667eeb-b5b2-4bd1-aec2-d55659ab3506 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:48.254795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d667eeb-b5b2-4bd1-aec2-d55659ab3506 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:48.255555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d667eeb-b5b2-4bd1-aec2-d55659ab3506 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:48.362553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3d667eeb-b5b2-4bd1-aec2-d55659ab3506 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:48.371398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3d667eeb-b5b2-4bd1-aec2-d55659ab3506 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:48.372948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3d667eeb-b5b2-4bd1-aec2-d55659ab3506 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:48.378649 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3d667eeb-b5b2-4bd1-aec2-d55659ab3506 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.147303 Oct 29 01:17:48.379879 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1779/3391] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:48 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:17:48.432099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-37099472-a728-4102-b6ff-471650658a2f tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Action: 'create', calling method: .version_select at 0x7f9d97c52d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1385223140", "description": "tempest-description-1404880083"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:49.072383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9f0ba6d2-b9e5-47d8-8dbb-97342794d6d4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:49.074476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9f0ba6d2-b9e5-47d8-8dbb-97342794d6d4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:49.084731 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-37099472-a728-4102-b6ff-471650658a2f tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.822677 Oct 29 01:17:49.086403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f0ba6d2-b9e5-47d8-8dbb-97342794d6d4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:49.087109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f0ba6d2-b9e5-47d8-8dbb-97342794d6d4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:49.087725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f0ba6d2-b9e5-47d8-8dbb-97342794d6d4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:49.089817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f0ba6d2-b9e5-47d8-8dbb-97342794d6d4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:49.094827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f0ba6d2-b9e5-47d8-8dbb-97342794d6d4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:49.094827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f0ba6d2-b9e5-47d8-8dbb-97342794d6d4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:49.095257 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1613/3392] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:17:48 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:49.105381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f1fb7e4e-f6a9-4b29-9cc4-8d541cfed4af tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Action: 'create', calling method: .version_select at 0x7f9d9fe63550>, body: {"security_group_rule": {"parent_group_id": "4a703016-8375-408d-b322-8a680b11d690", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:49.333800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9f0ba6d2-b9e5-47d8-8dbb-97342794d6d4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:49.346244 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9f0ba6d2-b9e5-47d8-8dbb-97342794d6d4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1293 microversion: 2.1 time: 0.276831 Oct 29 01:17:49.362445 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1780/3393] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:49 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1293 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:49.378909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4bde225e-d2f3-4d98-b754-166bc1309347 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:49.380493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4bde225e-d2f3-4d98-b754-166bc1309347 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:49.395663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bde225e-d2f3-4d98-b754-166bc1309347 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:49.396778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bde225e-d2f3-4d98-b754-166bc1309347 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:49.397542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bde225e-d2f3-4d98-b754-166bc1309347 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:49.398489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bde225e-d2f3-4d98-b754-166bc1309347 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:49.399180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bde225e-d2f3-4d98-b754-166bc1309347 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:49.399881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bde225e-d2f3-4d98-b754-166bc1309347 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:49.594514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4bde225e-d2f3-4d98-b754-166bc1309347 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:49.609350 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4bde225e-d2f3-4d98-b754-166bc1309347 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1259 microversion: 2.1 time: 0.242965 Oct 29 01:17:49.615493 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1781/3394] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:49 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1259 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:49.642841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b7c24226-0617-4228-9476-f0a34f520f22 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:49.643796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b7c24226-0617-4228-9476-f0a34f520f22 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:49.658437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7c24226-0617-4228-9476-f0a34f520f22 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:49.664279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7c24226-0617-4228-9476-f0a34f520f22 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:49.672436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7c24226-0617-4228-9476-f0a34f520f22 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:49.674674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7c24226-0617-4228-9476-f0a34f520f22 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:49.676312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7c24226-0617-4228-9476-f0a34f520f22 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:49.676913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7c24226-0617-4228-9476-f0a34f520f22 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:49.850393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b7c24226-0617-4228-9476-f0a34f520f22 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:49.863831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b7c24226-0617-4228-9476-f0a34f520f22 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:49.874907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b7c24226-0617-4228-9476-f0a34f520f22 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:49.875387 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f1fb7e4e-f6a9-4b29-9cc4-8d541cfed4af tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.778056 Oct 29 01:17:49.883646 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1614/3395] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 29 01:17:49 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:49.890372 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b7c24226-0617-4228-9476-f0a34f520f22 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.264441 Oct 29 01:17:49.890878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-739e08c0-9279-48fc-af88-05351c554a6f tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Action: 'create', calling method: .version_select at 0x7f9d972198b0>, body: {"security_group_rule": {"parent_group_id": "4a703016-8375-408d-b322-8a680b11d690", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:49.893521 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1782/3396] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:49 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:50.007948 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-739e08c0-9279-48fc-af88-05351c554a6f tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] HTTP exception thrown: This rule already exists in group 4a703016-8375-408d-b322-8a680b11d690 Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-739e08c0-9279-48fc-af88-05351c554a6f tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Request method failure captured: Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 138 Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH88pwDsKG8rD7bGd_vVMRrnWF5gozktzeUFIpe2d0xbIg4VWTyVV6p9kDx_L5UKLAsMoJG6NVfySzykD_VcCVC9vkgik3ZvOT9XjHaRoH2re2w3ZY5eV67Ow2aF546KfitGYx2TgqXAWhwzTwhmG-FdL0EZKYA-av-v8iZVmZX-Orw Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 11262954ed214ba496b307ebcb8d8527 Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_11262954ed214ba496b307ebcb8d8527", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 11262954ed214ba496b307ebcb8d8527 Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 3421548f9395456ab7ed1c1aac6476bc Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: {"security_group_rule": {"parent_group_id": "4a703016-8375-408d-b322-8a680b11d690", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: exception: This rule already exists in group 4a703016-8375-408d-b322-8a680b11d690 Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4a703016-8375-408d-b322-8a680b11d690', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 4a703016-8375-408d-b322-8a680b11d690 Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 4a703016-8375-408d-b322-8a680b11d690 Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:50.011106 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:50.019785 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:50.019785 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:50.019785 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 4a703016-8375-408d-b322-8a680b11d690 Oct 29 01:17:50.019785 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:50.019785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-739e08c0-9279-48fc-af88-05351c554a6f tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Returning 400 to user: This rule already exists in group 4a703016-8375-408d-b322-8a680b11d690 {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:50.019785 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-739e08c0-9279-48fc-af88-05351c554a6f tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.127572 Oct 29 01:17:50.019785 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1615/3397] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 29 01:17:49 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:17:50.022547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eb138eae-39ae-4f39-aed8-7b44569e316c tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Calling method '.version_select at 0x7f9d96b84a60>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:50.375913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-863bcf22-0900-42ac-9d23-c6d918765229 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:50.376768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-863bcf22-0900-42ac-9d23-c6d918765229 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:50.394698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-863bcf22-0900-42ac-9d23-c6d918765229 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:50.395958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-863bcf22-0900-42ac-9d23-c6d918765229 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:50.398810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-863bcf22-0900-42ac-9d23-c6d918765229 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:50.399855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-863bcf22-0900-42ac-9d23-c6d918765229 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:50.400749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-863bcf22-0900-42ac-9d23-c6d918765229 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:50.407028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-863bcf22-0900-42ac-9d23-c6d918765229 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:50.554797 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eb138eae-39ae-4f39-aed8-7b44569e316c tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-group-rules/76ea6eeb-ee11-4496-b646-8d8280b79631" status: 202 len: 0 microversion: 2.1 time: 0.536693 Oct 29 01:17:50.555411 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1783/3398] 10.222.0.26 () {58 vars in 1287 bytes} [Sat Oct 29 01:17:50 2022] DELETE /compute/v2.1/os-security-group-rules/76ea6eeb-ee11-4496-b646-8d8280b79631 => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:17:50.567087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-75e225ea-167d-4ebb-9571-b5759264aabf tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Action: 'create', calling method: .version_select at 0x7f9d96b46700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1895105250", "description": "tempest-description-1420279588"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:51.524016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-863bcf22-0900-42ac-9d23-c6d918765229 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:51.551280 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-863bcf22-0900-42ac-9d23-c6d918765229 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1293 microversion: 2.1 time: 1.179509 Oct 29 01:17:51.552720 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1616/3399] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:50 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1293 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:51.559169 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-80a07581-ad28-4168-9cb7-6578760fa638 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:51.561979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-80a07581-ad28-4168-9cb7-6578760fa638 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:51.570194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80a07581-ad28-4168-9cb7-6578760fa638 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:51.571120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80a07581-ad28-4168-9cb7-6578760fa638 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:51.571781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80a07581-ad28-4168-9cb7-6578760fa638 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:51.574125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80a07581-ad28-4168-9cb7-6578760fa638 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:51.575026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80a07581-ad28-4168-9cb7-6578760fa638 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:51.575726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80a07581-ad28-4168-9cb7-6578760fa638 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:51.833026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-80a07581-ad28-4168-9cb7-6578760fa638 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:51.848209 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-80a07581-ad28-4168-9cb7-6578760fa638 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1265 microversion: 2.1 time: 0.293619 Oct 29 01:17:51.852111 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1617/3400] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:51 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:51.875170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2e9e8a7d-5806-4b7b-bb0b-368493359e6d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:51.876219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2e9e8a7d-5806-4b7b-bb0b-368493359e6d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:51.900388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e9e8a7d-5806-4b7b-bb0b-368493359e6d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:51.910018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e9e8a7d-5806-4b7b-bb0b-368493359e6d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:51.910619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e9e8a7d-5806-4b7b-bb0b-368493359e6d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:51.911490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e9e8a7d-5806-4b7b-bb0b-368493359e6d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:51.912249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e9e8a7d-5806-4b7b-bb0b-368493359e6d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:51.912693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e9e8a7d-5806-4b7b-bb0b-368493359e6d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:52.108286 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2e9e8a7d-5806-4b7b-bb0b-368493359e6d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:52.128586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2e9e8a7d-5806-4b7b-bb0b-368493359e6d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:52.130649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2e9e8a7d-5806-4b7b-bb0b-368493359e6d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:52.141284 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2e9e8a7d-5806-4b7b-bb0b-368493359e6d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.281802 Oct 29 01:17:52.141284 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1618/3401] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:51 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:52.251662 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-75e225ea-167d-4ebb-9571-b5759264aabf tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.690149 Oct 29 01:17:52.252885 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1784/3402] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:17:50 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:52.270107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aaa82969-4faa-47b6-8bcf-c743e0f39e95 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Action: 'create', calling method: .version_select at 0x7f9d9ff23790>, body: {"security_group_rule": {"parent_group_id": "6cb957a1-e5f2-494d-8bea-78917bf039ac", "ip_protocol": "tcp", "from_port": 1632283663, "to_port": 22}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:52.359426 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-aaa82969-4faa-47b6-8bcf-c743e0f39e95 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] HTTP exception thrown: Invalid port range 1632283663:22. Former value cannot be greater than the later Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aaa82969-4faa-47b6-8bcf-c743e0f39e95 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Request method failure captured: Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 146 Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH88pwDsKG8rD7bGd_vVMRrnWF5gozktzeUFIpe2d0xbIg4VWTyVV6p9kDx_L5UKLAsMoJG6NVfySzykD_VcCVC9vkgik3ZvOT9XjHaRoH2re2w3ZY5eV67Ow2aF546KfitGYx2TgqXAWhwzTwhmG-FdL0EZKYA-av-v8iZVmZX-Orw Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 11262954ed214ba496b307ebcb8d8527 Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_11262954ed214ba496b307ebcb8d8527", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 11262954ed214ba496b307ebcb8d8527 Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 3421548f9395456ab7ed1c1aac6476bc Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: {"security_group_rule": {"parent_group_id": "6cb957a1-e5f2-494d-8bea-78917bf039ac", "ip_protocol": "tcp", "from_port": 1632283663, "to_port": 22}} Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid port range 1632283663:22. Former value cannot be greater than the later Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6cb957a1-e5f2-494d-8bea-78917bf039ac', 'ip_protocol': 'tcp', 'from_port': 1632283663, 'to_port': 22}}} Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1632283663:22. Former value cannot be greater than the later Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1632283663:22. Former value cannot be greater than the later Oct 29 01:17:52.361495 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:52.366434 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:52.366434 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:52.366434 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:52.366434 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:52.366434 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:52.366434 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:52.366434 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:52.366434 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1632283663:22. Former value cannot be greater than the later Oct 29 01:17:52.366434 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:52.369019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aaa82969-4faa-47b6-8bcf-c743e0f39e95 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Returning 400 to user: Invalid port range 1632283663:22. Former value cannot be greater than the later {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:52.370790 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aaa82969-4faa-47b6-8bcf-c743e0f39e95 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.105156 Oct 29 01:17:52.385475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80027210-e213-44cd-be50-2e963c1715a1 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Action: 'create', calling method: .version_select at 0x7f9d96b459d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1187792669", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:52.386628 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1619/3403] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 29 01:17:52 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:17:52.389058 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-80027210-e213-44cd-be50-2e963c1715a1 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] HTTP exception thrown: Security group id should be uuid Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80027210-e213-44cd-be50-2e963c1715a1 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Request method failure captured: Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 131 Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH88pwDsKG8rD7bGd_vVMRrnWF5gozktzeUFIpe2d0xbIg4VWTyVV6p9kDx_L5UKLAsMoJG6NVfySzykD_VcCVC9vkgik3ZvOT9XjHaRoH2re2w3ZY5eV67Ow2aF546KfitGYx2TgqXAWhwzTwhmG-FdL0EZKYA-av-v8iZVmZX-Orw Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 11262954ed214ba496b307ebcb8d8527 Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_11262954ed214ba496b307ebcb8d8527", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 11262954ed214ba496b307ebcb8d8527 Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 3421548f9395456ab7ed1c1aac6476bc Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1187792669", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: exception: Security group id should be uuid Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1187792669', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:52.390803 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:52.396235 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 29 01:17:52.396235 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:52.396235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80027210-e213-44cd-be50-2e963c1715a1 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Returning 400 to user: Security group id should be uuid {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:52.396478 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-80027210-e213-44cd-be50-2e963c1715a1 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.016423 Oct 29 01:17:52.415701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d8f2b02-db52-4ff1-b497-5f7f32ea4fde tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Action: 'create', calling method: .version_select at 0x7f9d9fe63d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-952696962", "description": "tempest-description-1033346539"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:52.418731 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1785/3404] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 29 01:17:52 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 01:17:52.581293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8cbd2040-6b40-4ed2-a551-010964abe703 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:52.582186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8cbd2040-6b40-4ed2-a551-010964abe703 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:52.595673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cbd2040-6b40-4ed2-a551-010964abe703 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:52.598664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cbd2040-6b40-4ed2-a551-010964abe703 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:52.600165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cbd2040-6b40-4ed2-a551-010964abe703 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:52.601960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cbd2040-6b40-4ed2-a551-010964abe703 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:52.606482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cbd2040-6b40-4ed2-a551-010964abe703 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:52.607774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cbd2040-6b40-4ed2-a551-010964abe703 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:53.114306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8cbd2040-6b40-4ed2-a551-010964abe703 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:53.134112 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8cbd2040-6b40-4ed2-a551-010964abe703 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1293 microversion: 2.1 time: 0.557241 Oct 29 01:17:53.135462 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1786/3405] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:52 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1293 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:53.154878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-df85b042-b6c0-41f2-8a87-5b2c9bbc8288 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:53.155770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-df85b042-b6c0-41f2-8a87-5b2c9bbc8288 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:53.165262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df85b042-b6c0-41f2-8a87-5b2c9bbc8288 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:53.170869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df85b042-b6c0-41f2-8a87-5b2c9bbc8288 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:53.171326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df85b042-b6c0-41f2-8a87-5b2c9bbc8288 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:53.172058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df85b042-b6c0-41f2-8a87-5b2c9bbc8288 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:53.172516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df85b042-b6c0-41f2-8a87-5b2c9bbc8288 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:53.172939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df85b042-b6c0-41f2-8a87-5b2c9bbc8288 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:53.949889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-df85b042-b6c0-41f2-8a87-5b2c9bbc8288 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:53.960619 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-df85b042-b6c0-41f2-8a87-5b2c9bbc8288 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1307 microversion: 2.1 time: 0.823882 Oct 29 01:17:53.965317 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1787/3406] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:53 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1307 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:53.976100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d1671f18-94d3-4807-a6de-3f574866004d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:53.977619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d1671f18-94d3-4807-a6de-3f574866004d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:53.995382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1671f18-94d3-4807-a6de-3f574866004d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:53.998327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1671f18-94d3-4807-a6de-3f574866004d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:54.001903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1671f18-94d3-4807-a6de-3f574866004d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:54.002948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1671f18-94d3-4807-a6de-3f574866004d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:54.006471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1671f18-94d3-4807-a6de-3f574866004d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:54.006914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1671f18-94d3-4807-a6de-3f574866004d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:54.173654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d1671f18-94d3-4807-a6de-3f574866004d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:54.184450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d1671f18-94d3-4807-a6de-3f574866004d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:54.199603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d1671f18-94d3-4807-a6de-3f574866004d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:54.222433 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d1671f18-94d3-4807-a6de-3f574866004d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.255851 Oct 29 01:17:54.229046 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1788/3407] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:53 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:54.246269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4720e939-0cf1-42dd-89ee-217e323ca74f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:54.253362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4720e939-0cf1-42dd-89ee-217e323ca74f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:54.254109 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7d8f2b02-db52-4ff1-b497-5f7f32ea4fde tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.848865 Oct 29 01:17:54.255237 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1620/3408] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:17:52 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:54.269703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a1d87851-80c8-44bc-8a44-b3604027fdd3 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Action: 'create', calling method: .version_select at 0x7f9d97b7b820>, body: {"security_group_rule": {"parent_group_id": "ca176840-2438-42c5-bcad-4db23a17aa0c", "ip_protocol": "tempest-999-638793385", "from_port": 22, "to_port": 22}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:54.286296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4720e939-0cf1-42dd-89ee-217e323ca74f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:54.292315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4720e939-0cf1-42dd-89ee-217e323ca74f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:54.296023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4720e939-0cf1-42dd-89ee-217e323ca74f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:54.296921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4720e939-0cf1-42dd-89ee-217e323ca74f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:54.299957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4720e939-0cf1-42dd-89ee-217e323ca74f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:54.303616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4720e939-0cf1-42dd-89ee-217e323ca74f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:54.453026 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-a1d87851-80c8-44bc-8a44-b3604027fdd3 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] HTTP exception thrown: Invalid IP protocol tempest-999-638793385. Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a1d87851-80c8-44bc-8a44-b3604027fdd3 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Request method failure captured: Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 156 Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH88pwDsKG8rD7bGd_vVMRrnWF5gozktzeUFIpe2d0xbIg4VWTyVV6p9kDx_L5UKLAsMoJG6NVfySzykD_VcCVC9vkgik3ZvOT9XjHaRoH2re2w3ZY5eV67Ow2aF546KfitGYx2TgqXAWhwzTwhmG-FdL0EZKYA-av-v8iZVmZX-Orw Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 11262954ed214ba496b307ebcb8d8527 Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_11262954ed214ba496b307ebcb8d8527", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 11262954ed214ba496b307ebcb8d8527 Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 3421548f9395456ab7ed1c1aac6476bc Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: {"security_group_rule": {"parent_group_id": "ca176840-2438-42c5-bcad-4db23a17aa0c", "ip_protocol": "tempest-999-638793385", "from_port": 22, "to_port": 22}} Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid IP protocol tempest-999-638793385. Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ca176840-2438-42c5-bcad-4db23a17aa0c', 'ip_protocol': 'tempest-999-638793385', 'from_port': 22, 'to_port': 22}}} Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-638793385. Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-638793385. Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:54.454828 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:54.459931 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:54.459931 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:54.459931 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:54.459931 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:54.459931 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:54.459931 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:54.459931 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-638793385. Oct 29 01:17:54.459931 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:17:54.461704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a1d87851-80c8-44bc-8a44-b3604027fdd3 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Returning 400 to user: Invalid IP protocol tempest-999-638793385. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:54.462735 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a1d87851-80c8-44bc-8a44-b3604027fdd3 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.198071 Oct 29 01:17:54.464826 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1621/3409] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 29 01:17:54 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 29 01:17:54.475460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cddca4e1-064e-4d09-b8e4-fa3d0833cade tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Action: 'create', calling method: .version_select at 0x7f9d9db53a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1215472686", "description": "tempest-description-1230239815"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:54.967514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4720e939-0cf1-42dd-89ee-217e323ca74f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:55.003697 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4720e939-0cf1-42dd-89ee-217e323ca74f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1293 microversion: 2.1 time: 0.765339 Oct 29 01:17:55.018372 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1789/3410] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:54 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1293 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:55.022743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6213d8de-0e43-4751-8e7c-b36f719fcd5a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:55.023596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6213d8de-0e43-4751-8e7c-b36f719fcd5a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:55.049125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6213d8de-0e43-4751-8e7c-b36f719fcd5a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:55.049775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6213d8de-0e43-4751-8e7c-b36f719fcd5a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:55.050311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6213d8de-0e43-4751-8e7c-b36f719fcd5a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:55.051109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6213d8de-0e43-4751-8e7c-b36f719fcd5a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:55.051805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6213d8de-0e43-4751-8e7c-b36f719fcd5a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:55.052342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6213d8de-0e43-4751-8e7c-b36f719fcd5a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:55.263659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:55.355567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6213d8de-0e43-4751-8e7c-b36f719fcd5a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:55.366407 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6213d8de-0e43-4751-8e7c-b36f719fcd5a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1307 microversion: 2.1 time: 0.356957 Oct 29 01:17:55.367151 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1790/3411] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:55 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1307 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:55.372782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4d5ec2ab-b4dc-469a-910f-b179e88f4b30 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:55.373731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4d5ec2ab-b4dc-469a-910f-b179e88f4b30 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:55.380943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d5ec2ab-b4dc-469a-910f-b179e88f4b30 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:55.386808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d5ec2ab-b4dc-469a-910f-b179e88f4b30 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:55.387513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d5ec2ab-b4dc-469a-910f-b179e88f4b30 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:55.388717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d5ec2ab-b4dc-469a-910f-b179e88f4b30 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:55.389419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d5ec2ab-b4dc-469a-910f-b179e88f4b30 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:55.390037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d5ec2ab-b4dc-469a-910f-b179e88f4b30 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:55.570156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4d5ec2ab-b4dc-469a-910f-b179e88f4b30 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:55.593614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4d5ec2ab-b4dc-469a-910f-b179e88f4b30 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:55.601086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4d5ec2ab-b4dc-469a-910f-b179e88f4b30 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:55.627259 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4d5ec2ab-b4dc-469a-910f-b179e88f4b30 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.249748 Oct 29 01:17:55.628859 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1791/3412] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:55 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:55.711098 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cddca4e1-064e-4d09-b8e4-fa3d0833cade tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.239737 Oct 29 01:17:55.711800 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1622/3413] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:17:54 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:17:55.725328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-19d284d1-b9a0-4b8d-b51a-eca593da1044 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Action: 'create', calling method: .version_select at 0x7f9d96b84430>, body: {"security_group_rule": {"parent_group_id": "f1677bfa-89d5-4b1a-b3d5-fb80f35bc1df", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:55.856634 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-19d284d1-b9a0-4b8d-b51a-eca593da1044 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-19d284d1-b9a0-4b8d-b51a-eca593da1044 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Request method failure captured: Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 138 Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH88pwDsKG8rD7bGd_vVMRrnWF5gozktzeUFIpe2d0xbIg4VWTyVV6p9kDx_L5UKLAsMoJG6NVfySzykD_VcCVC9vkgik3ZvOT9XjHaRoH2re2w3ZY5eV67Ow2aF546KfitGYx2TgqXAWhwzTwhmG-FdL0EZKYA-av-v8iZVmZX-Orw Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 11262954ed214ba496b307ebcb8d8527 Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_11262954ed214ba496b307ebcb8d8527", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 11262954ed214ba496b307ebcb8d8527 Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 3421548f9395456ab7ed1c1aac6476bc Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: {"security_group_rule": {"parent_group_id": "f1677bfa-89d5-4b1a-b3d5-fb80f35bc1df", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f1677bfa-89d5-4b1a-b3d5-fb80f35bc1df', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 01:17:55.859932 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:55.864242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:55.864242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:55.864242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:55.864242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:55.864242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:55.864242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:55.864242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:55.864242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 01:17:55.864242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:55.866740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-19d284d1-b9a0-4b8d-b51a-eca593da1044 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:55.868398 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-19d284d1-b9a0-4b8d-b51a-eca593da1044 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.146651 Oct 29 01:17:55.875896 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1792/3414] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 29 01:17:55 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:17:55.880968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-38432659-30b1-4366-840c-bbb8f820d6a0 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Action: 'create', calling method: .version_select at 0x7f9d97a09940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1184285969", "description": "tempest-description-812600410"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:56.029730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cef10f0b-a77b-4729-bb59-66c3b895d851 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:56.034410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cef10f0b-a77b-4729-bb59-66c3b895d851 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:56.039392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cef10f0b-a77b-4729-bb59-66c3b895d851 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:56.042191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cef10f0b-a77b-4729-bb59-66c3b895d851 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:56.043054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cef10f0b-a77b-4729-bb59-66c3b895d851 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:56.044045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cef10f0b-a77b-4729-bb59-66c3b895d851 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:56.044733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cef10f0b-a77b-4729-bb59-66c3b895d851 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:56.045679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cef10f0b-a77b-4729-bb59-66c3b895d851 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:56.469340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cef10f0b-a77b-4729-bb59-66c3b895d851 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:56.482972 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cef10f0b-a77b-4729-bb59-66c3b895d851 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1293 microversion: 2.1 time: 0.456724 Oct 29 01:17:56.484691 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1793/3415] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:56 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1293 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:56.522617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-cd299057-41f2-4771-91ac-1d4355380357 req-51af0c15-3b0e-4832-a58c-d81430627620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60e5221e-08a3-4b98-a068-1963700c814e", "tag": "87ed97e9-c5bc-4a10-91d0-5c4cb8c6d5d6"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:56.545068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cd299057-41f2-4771-91ac-1d4355380357 req-51af0c15-3b0e-4832-a58c-d81430627620 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:56.545919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cd299057-41f2-4771-91ac-1d4355380357 req-51af0c15-3b0e-4832-a58c-d81430627620 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:56.548137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cd299057-41f2-4771-91ac-1d4355380357 req-51af0c15-3b0e-4832-a58c-d81430627620 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:56.573758 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-cd299057-41f2-4771-91ac-1d4355380357 req-51af0c15-3b0e-4832-a58c-d81430627620 service nova] Creating event network-changed:87ed97e9-c5bc-4a10-91d0-5c4cb8c6d5d6 for instance 60e5221e-08a3-4b98-a068-1963700c814e on n-h1-862964-3 Oct 29 01:17:56.579779 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-cd299057-41f2-4771-91ac-1d4355380357 req-51af0c15-3b0e-4832-a58c-d81430627620 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092462 Oct 29 01:17:56.587427 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1794/3416] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:56.587427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-d917993e-bde1-4982-8c12-4396b5fb4128 req-f44f6efa-a00a-4fc5-9c51-c7b3999bef13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0741da1d-27c3-4b27-85b9-37d645e7ff26", "name": "network-vif-plugged", "status": "completed", "tag": "863c5fe7-60c8-40c2-a9d5-f487d712cacf"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:56.599958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d917993e-bde1-4982-8c12-4396b5fb4128 req-f44f6efa-a00a-4fc5-9c51-c7b3999bef13 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:56.600662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d917993e-bde1-4982-8c12-4396b5fb4128 req-f44f6efa-a00a-4fc5-9c51-c7b3999bef13 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:56.601315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d917993e-bde1-4982-8c12-4396b5fb4128 req-f44f6efa-a00a-4fc5-9c51-c7b3999bef13 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:56.601454 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-38432659-30b1-4366-840c-bbb8f820d6a0 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.724336 Oct 29 01:17:56.602102 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1623/3417] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 29 01:17:55 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:56.609092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-036feb71-8787-4006-a4e2-c94c2cb5b66b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:56.615707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-036feb71-8787-4006-a4e2-c94c2cb5b66b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:56.615852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:56.626491 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-d917993e-bde1-4982-8c12-4396b5fb4128 req-f44f6efa-a00a-4fc5-9c51-c7b3999bef13 service nova] Creating event network-vif-plugged:863c5fe7-60c8-40c2-a9d5-f487d712cacf for instance 0741da1d-27c3-4b27-85b9-37d645e7ff26 on n-h1-862964-3 Oct 29 01:17:56.630019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-036feb71-8787-4006-a4e2-c94c2cb5b66b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:56.631713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-036feb71-8787-4006-a4e2-c94c2cb5b66b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:56.633013 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-d917993e-bde1-4982-8c12-4396b5fb4128 req-f44f6efa-a00a-4fc5-9c51-c7b3999bef13 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050816 Oct 29 01:17:56.634155 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1795/3418] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:17:56.639991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-036feb71-8787-4006-a4e2-c94c2cb5b66b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:56.642132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-47946184-f6c1-4f8d-be74-3ac6ade0fd51 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Action: 'create', calling method: .version_select at 0x7f9d96b84700>, body: {"security_group_rule": {"parent_group_id": "b70d2f7d-af15-4052-a286-a9b4c9b943b8", "ip_protocol": "tcp", "from_port": 22, "to_port": 2085937155}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:56.646288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-036feb71-8787-4006-a4e2-c94c2cb5b66b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:56.647846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-036feb71-8787-4006-a4e2-c94c2cb5b66b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:56.648306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-036feb71-8787-4006-a4e2-c94c2cb5b66b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:56.876966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=18 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:17:56.990415 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-47946184-f6c1-4f8d-be74-3ac6ade0fd51 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] HTTP exception thrown: Invalid port range 22:2085937155. Valid TCP ports should be between 1-65535 Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-47946184-f6c1-4f8d-be74-3ac6ade0fd51 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Request method failure captured: Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 146 Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH88pwDsKG8rD7bGd_vVMRrnWF5gozktzeUFIpe2d0xbIg4VWTyVV6p9kDx_L5UKLAsMoJG6NVfySzykD_VcCVC9vkgik3ZvOT9XjHaRoH2re2w3ZY5eV67Ow2aF546KfitGYx2TgqXAWhwzTwhmG-FdL0EZKYA-av-v8iZVmZX-Orw Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 11262954ed214ba496b307ebcb8d8527 Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_11262954ed214ba496b307ebcb8d8527", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 11262954ed214ba496b307ebcb8d8527 Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 3421548f9395456ab7ed1c1aac6476bc Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: {"security_group_rule": {"parent_group_id": "b70d2f7d-af15-4052-a286-a9b4c9b943b8", "ip_protocol": "tcp", "from_port": 22, "to_port": 2085937155}} Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: exception: Invalid port range 22:2085937155. Valid TCP ports should be between 1-65535 Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b70d2f7d-af15-4052-a286-a9b4c9b943b8', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 2085937155}}} Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:2085937155. Valid TCP ports should be between 1-65535 Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:2085937155. Valid TCP ports should be between 1-65535 Oct 29 01:17:56.992980 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:56.997731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:56.997731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:56.997731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:56.997731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:56.997731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:56.997731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:56.997731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:56.997731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:2085937155. Valid TCP ports should be between 1-65535 Oct 29 01:17:56.997731 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:57.000621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-47946184-f6c1-4f8d-be74-3ac6ade0fd51 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Returning 400 to user: Invalid port range 22:2085937155. Valid TCP ports should be between 1-65535 {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:57.001891 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-47946184-f6c1-4f8d-be74-3ac6ade0fd51 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.365617 Oct 29 01:17:57.002641 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1796/3419] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 29 01:17:56 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 368 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:17:57.017073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-92d94551-8aa9-4cb8-84d6-e07d77bce0c6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:57.017073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-92d94551-8aa9-4cb8-84d6-e07d77bce0c6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:57.045864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92d94551-8aa9-4cb8-84d6-e07d77bce0c6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:57.045864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92d94551-8aa9-4cb8-84d6-e07d77bce0c6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:57.049070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92d94551-8aa9-4cb8-84d6-e07d77bce0c6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:57.050291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92d94551-8aa9-4cb8-84d6-e07d77bce0c6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:57.050785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92d94551-8aa9-4cb8-84d6-e07d77bce0c6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:57.051227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92d94551-8aa9-4cb8-84d6-e07d77bce0c6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:57.227568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-92d94551-8aa9-4cb8-84d6-e07d77bce0c6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:57.240272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-92d94551-8aa9-4cb8-84d6-e07d77bce0c6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:57.242074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-92d94551-8aa9-4cb8-84d6-e07d77bce0c6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:57.248892 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-92d94551-8aa9-4cb8-84d6-e07d77bce0c6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.245023 Oct 29 01:17:57.249553 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1797/3420] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:57 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:57.254618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-92302ef9-52cf-45f1-9716-88b075802ac3 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Action: 'create', calling method: .version_select at 0x7f9d96bf68b0>, body: {"security_group_rule": {"parent_group_id": "17a27e65-2fd8-427c-a602-cd97c0ade8d7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:17:57.269438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-036feb71-8787-4006-a4e2-c94c2cb5b66b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:57.285777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG neutronclient.v2_0.client [None req-92302ef9-52cf-45f1-9716-88b075802ac3 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 17a27e65-2fd8-427c-a602-cd97c0ade8d7 does not exist", "detail": ""}} {{(pid=121099) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:17:57.286451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.security_group_api [None req-92302ef9-52cf-45f1-9716-88b075802ac3 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Neutron security group 17a27e65-2fd8-427c-a602-cd97c0ade8d7 not found {{(pid=121099) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 01:17:57.286987 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-92302ef9-52cf-45f1-9716-88b075802ac3 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] HTTP exception thrown: Security group 17a27e65-2fd8-427c-a602-cd97c0ade8d7 does not exist Oct 29 01:17:57.286987 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-a921c1df-72b1-4ab2-abfe-8874bc4921a8'] Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-92302ef9-52cf-45f1-9716-88b075802ac3 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Request method failure captured: Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 138 Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH88pwDsKG8rD7bGd_vVMRrnWF5gozktzeUFIpe2d0xbIg4VWTyVV6p9kDx_L5UKLAsMoJG6NVfySzykD_VcCVC9vkgik3ZvOT9XjHaRoH2re2w3ZY5eV67Ow2aF546KfitGYx2TgqXAWhwzTwhmG-FdL0EZKYA-av-v8iZVmZX-Orw Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 11262954ed214ba496b307ebcb8d8527 Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_11262954ed214ba496b307ebcb8d8527", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 11262954ed214ba496b307ebcb8d8527 Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 3421548f9395456ab7ed1c1aac6476bc Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: {"security_group_rule": {"parent_group_id": "17a27e65-2fd8-427c-a602-cd97c0ade8d7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: exception: Security group 17a27e65-2fd8-427c-a602-cd97c0ade8d7 does not exist Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-a921c1df-72b1-4ab2-abfe-8874bc4921a8'] Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'security_group_rule': {'parent_group_id': '17a27e65-2fd8-427c-a602-cd97c0ade8d7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:17:57.289065 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 17a27e65-2fd8-427c-a602-cd97c0ade8d7 does not exist Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a921c1df-72b1-4ab2-abfe-8874bc4921a8'] Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 17a27e65-2fd8-427c-a602-cd97c0ade8d7 does not exist Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a921c1df-72b1-4ab2-abfe-8874bc4921a8'] Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 17a27e65-2fd8-427c-a602-cd97c0ade8d7 does not exist Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a921c1df-72b1-4ab2-abfe-8874bc4921a8'] Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 17a27e65-2fd8-427c-a602-cd97c0ade8d7 does not exist Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a921c1df-72b1-4ab2-abfe-8874bc4921a8'] Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-92302ef9-52cf-45f1-9716-88b075802ac3 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Returning 404 to user: Security group 17a27e65-2fd8-427c-a602-cd97c0ade8d7 does not exist Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-a921c1df-72b1-4ab2-abfe-8874bc4921a8'] {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-92302ef9-52cf-45f1-9716-88b075802ac3 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.040049 Oct 29 01:17:57.296882 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1798/3421] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 29 01:17:57 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:17:57.300060 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-036feb71-8787-4006-a4e2-c94c2cb5b66b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1307 microversion: 2.1 time: 0.689697 Oct 29 01:17:57.300060 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1624/3422] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:56 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1307 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:57.302949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8ade80a5-6ad4-40fb-ae74-22b6eaf2e2a8 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Calling method '.version_select at 0x7f9d96bb8310>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:57.343427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG neutronclient.v2_0.client [None req-8ade80a5-6ad4-40fb-ae74-22b6eaf2e2a8 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule c362aa49-551c-4aaa-87a8-be78681b221a does not exist", "detail": ""}} {{(pid=121099) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:17:57.344024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.security_group_api [None req-8ade80a5-6ad4-40fb-ae74-22b6eaf2e2a8 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Neutron security group rule c362aa49-551c-4aaa-87a8-be78681b221a not found {{(pid=121099) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 29 01:17:57.344550 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-8ade80a5-6ad4-40fb-ae74-22b6eaf2e2a8 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] HTTP exception thrown: Security group rule c362aa49-551c-4aaa-87a8-be78681b221a does not exist Oct 29 01:17:57.344550 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-670bc343-38b3-4fdb-9a6e-b79c89ecd8c1'] Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8ade80a5-6ad4-40fb-ae74-22b6eaf2e2a8 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Request method failure captured: Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/os-security-group-rules/c362aa49-551c-4aaa-87a8-be78681b221a HTTP/1.1 Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH88pwDsKG8rD7bGd_vVMRrnWF5gozktzeUFIpe2d0xbIg4VWTyVV6p9kDx_L5UKLAsMoJG6NVfySzykD_VcCVC9vkgik3ZvOT9XjHaRoH2re2w3ZY5eV67Ow2aF546KfitGYx2TgqXAWhwzTwhmG-FdL0EZKYA-av-v8iZVmZX-Orw Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 11262954ed214ba496b307ebcb8d8527 Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11262954ed214ba496b307ebcb8d8527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_11262954ed214ba496b307ebcb8d8527", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 11262954ed214ba496b307ebcb8d8527 Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880 Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 3421548f9395456ab7ed1c1aac6476bc Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: exception: Security group rule c362aa49-551c-4aaa-87a8-be78681b221a does not exist Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-670bc343-38b3-4fdb-9a6e-b79c89ecd8c1'] Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'c362aa49-551c-4aaa-87a8-be78681b221a'} Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:17:57.347591 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule c362aa49-551c-4aaa-87a8-be78681b221a does not exist Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-670bc343-38b3-4fdb-9a6e-b79c89ecd8c1'] Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule c362aa49-551c-4aaa-87a8-be78681b221a does not exist Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-670bc343-38b3-4fdb-9a6e-b79c89ecd8c1'] Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule c362aa49-551c-4aaa-87a8-be78681b221a does not exist Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-670bc343-38b3-4fdb-9a6e-b79c89ecd8c1'] Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule c362aa49-551c-4aaa-87a8-be78681b221a does not exist Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-670bc343-38b3-4fdb-9a6e-b79c89ecd8c1'] Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8ade80a5-6ad4-40fb-ae74-22b6eaf2e2a8 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Returning 404 to user: Security group rule c362aa49-551c-4aaa-87a8-be78681b221a does not exist Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: Neutron server returns request_ids: ['req-670bc343-38b3-4fdb-9a6e-b79c89ecd8c1'] {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8ade80a5-6ad4-40fb-ae74-22b6eaf2e2a8 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-group-rules/c362aa49-551c-4aaa-87a8-be78681b221a" status: 404 len: 199 microversion: 2.1 time: 0.051476 Oct 29 01:17:57.352188 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1799/3423] 10.222.0.26 () {58 vars in 1287 bytes} [Sat Oct 29 01:17:57 2022] DELETE /compute/v2.1/os-security-group-rules/c362aa49-551c-4aaa-87a8-be78681b221a => generated 199 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:17:57.364775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-62cbf06f-51d7-49f0-9061-c4ca33faee19 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Calling method '.version_select at 0x7f9d97bb8820>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:57.518012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0779b5e8-3558-4502-9419-b485a2378e5f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:57.518625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0779b5e8-3558-4502-9419-b485a2378e5f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:57.530598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0779b5e8-3558-4502-9419-b485a2378e5f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:57.531364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0779b5e8-3558-4502-9419-b485a2378e5f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:57.532410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0779b5e8-3558-4502-9419-b485a2378e5f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:57.533344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0779b5e8-3558-4502-9419-b485a2378e5f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:57.534092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0779b5e8-3558-4502-9419-b485a2378e5f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:57.535038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0779b5e8-3558-4502-9419-b485a2378e5f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:57.786455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0779b5e8-3558-4502-9419-b485a2378e5f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:57.795721 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0779b5e8-3558-4502-9419-b485a2378e5f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1293 microversion: 2.1 time: 0.285726 Oct 29 01:17:57.796317 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1800/3424] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:57 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1293 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:17:57.911458 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-62cbf06f-51d7-49f0-9061-c4ca33faee19 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/b70d2f7d-af15-4052-a286-a9b4c9b943b8" status: 202 len: 0 microversion: 2.1 time: 0.555019 Oct 29 01:17:57.912142 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1625/3425] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:17:57 2022] DELETE /compute/v2.1/os-security-groups/b70d2f7d-af15-4052-a286-a9b4c9b943b8 => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:17:57.922356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-226d6147-c049-4a20-a492-559d0c394a71 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Calling method '.version_select at 0x7f9d96c2e820>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:58.289855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-37803c16-ebd8-4120-ba31-a76c0cc1c91e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:58.291142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-37803c16-ebd8-4120-ba31-a76c0cc1c91e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:58.298862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37803c16-ebd8-4120-ba31-a76c0cc1c91e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:58.299989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37803c16-ebd8-4120-ba31-a76c0cc1c91e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:58.300597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37803c16-ebd8-4120-ba31-a76c0cc1c91e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:58.301665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37803c16-ebd8-4120-ba31-a76c0cc1c91e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:58.302330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37803c16-ebd8-4120-ba31-a76c0cc1c91e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:58.302770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37803c16-ebd8-4120-ba31-a76c0cc1c91e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:58.413252 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-226d6147-c049-4a20-a492-559d0c394a71 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/f1677bfa-89d5-4b1a-b3d5-fb80f35bc1df" status: 202 len: 0 microversion: 2.1 time: 0.496727 Oct 29 01:17:58.418749 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1801/3426] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:17:57 2022] DELETE /compute/v2.1/os-security-groups/f1677bfa-89d5-4b1a-b3d5-fb80f35bc1df => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:17:58.424744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3e4a00fb-ee30-4b1d-a370-db689eb066cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:58.425394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3e4a00fb-ee30-4b1d-a370-db689eb066cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:58.430068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-37803c16-ebd8-4120-ba31-a76c0cc1c91e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:58.439690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4a00fb-ee30-4b1d-a370-db689eb066cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:58.442805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4a00fb-ee30-4b1d-a370-db689eb066cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:58.443426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4a00fb-ee30-4b1d-a370-db689eb066cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:58.444321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4a00fb-ee30-4b1d-a370-db689eb066cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:58.445697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4a00fb-ee30-4b1d-a370-db689eb066cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:58.447598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4a00fb-ee30-4b1d-a370-db689eb066cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:58.451913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-37803c16-ebd8-4120-ba31-a76c0cc1c91e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:58.455407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-37803c16-ebd8-4120-ba31-a76c0cc1c91e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:58.471356 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-37803c16-ebd8-4120-ba31-a76c0cc1c91e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.186070 Oct 29 01:17:58.499669 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1626/3427] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:58 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:17:58.518595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7503b3f0-ae17-443e-b3f1-d757fd2b8028 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Calling method '.version_select at 0x7f9d97b7b280>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:58.857683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3e4a00fb-ee30-4b1d-a370-db689eb066cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:58.871869 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3e4a00fb-ee30-4b1d-a370-db689eb066cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1307 microversion: 2.1 time: 0.451478 Oct 29 01:17:58.873114 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1802/3428] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:58 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1307 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:58.878079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd177e3f-5322-4ac2-b2ee-23232198adb5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:58.878907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bd177e3f-5322-4ac2-b2ee-23232198adb5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:58.886860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd177e3f-5322-4ac2-b2ee-23232198adb5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:58.887635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd177e3f-5322-4ac2-b2ee-23232198adb5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:58.888280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd177e3f-5322-4ac2-b2ee-23232198adb5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:58.889345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd177e3f-5322-4ac2-b2ee-23232198adb5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:58.893056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd177e3f-5322-4ac2-b2ee-23232198adb5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:58.893056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd177e3f-5322-4ac2-b2ee-23232198adb5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:59.155598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bd177e3f-5322-4ac2-b2ee-23232198adb5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:59.165994 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bd177e3f-5322-4ac2-b2ee-23232198adb5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1293 microversion: 2.1 time: 0.291672 Oct 29 01:17:59.167568 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1803/3429] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:58 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1293 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:17:59.211234 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7503b3f0-ae17-443e-b3f1-d757fd2b8028 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/ca176840-2438-42c5-bcad-4db23a17aa0c" status: 202 len: 0 microversion: 2.1 time: 0.710140 Oct 29 01:17:59.211965 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1627/3430] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:17:58 2022] DELETE /compute/v2.1/os-security-groups/ca176840-2438-42c5-bcad-4db23a17aa0c => generated 0 bytes in 712 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:17:59.220937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-58b5c322-4545-4ef0-bf24-ec74e160b4cf tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Calling method '.version_select at 0x7f9d96b52f70>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:59.524671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f946db83-45b9-4e68-922f-7f9cab4e7dbd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:59.525645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f946db83-45b9-4e68-922f-7f9cab4e7dbd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:59.535510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f946db83-45b9-4e68-922f-7f9cab4e7dbd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:59.536351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f946db83-45b9-4e68-922f-7f9cab4e7dbd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:59.537045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f946db83-45b9-4e68-922f-7f9cab4e7dbd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:59.538502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f946db83-45b9-4e68-922f-7f9cab4e7dbd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:59.539817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f946db83-45b9-4e68-922f-7f9cab4e7dbd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:59.540486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f946db83-45b9-4e68-922f-7f9cab4e7dbd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:59.630396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f946db83-45b9-4e68-922f-7f9cab4e7dbd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:59.641702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f946db83-45b9-4e68-922f-7f9cab4e7dbd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:59.643426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f946db83-45b9-4e68-922f-7f9cab4e7dbd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:17:59.649861 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f946db83-45b9-4e68-922f-7f9cab4e7dbd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.131807 Oct 29 01:17:59.650522 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1628/3431] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:17:59 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:17:59.668379 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-58b5c322-4545-4ef0-bf24-ec74e160b4cf tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/6cb957a1-e5f2-494d-8bea-78917bf039ac" status: 202 len: 0 microversion: 2.1 time: 0.451423 Oct 29 01:17:59.672312 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1804/3432] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:17:59 2022] DELETE /compute/v2.1/os-security-groups/6cb957a1-e5f2-494d-8bea-78917bf039ac => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:17:59.681329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e533001a-3eec-481f-a0d9-b4e06c317bd7 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] Calling method '.version_select at 0x7f9d97d1c040>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:59.901078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d40550a0-e0bc-4a28-97ff-07b82ddb8fe4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:17:59.902565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d40550a0-e0bc-4a28-97ff-07b82ddb8fe4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:17:59.910754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d40550a0-e0bc-4a28-97ff-07b82ddb8fe4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:59.911569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d40550a0-e0bc-4a28-97ff-07b82ddb8fe4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:59.912460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d40550a0-e0bc-4a28-97ff-07b82ddb8fe4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:17:59.915502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d40550a0-e0bc-4a28-97ff-07b82ddb8fe4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:17:59.915502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d40550a0-e0bc-4a28-97ff-07b82ddb8fe4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:17:59.915502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d40550a0-e0bc-4a28-97ff-07b82ddb8fe4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:00.134431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d40550a0-e0bc-4a28-97ff-07b82ddb8fe4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:00.147754 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d40550a0-e0bc-4a28-97ff-07b82ddb8fe4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1307 microversion: 2.1 time: 0.251391 Oct 29 01:18:00.148560 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1805/3433] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:17:59 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1307 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:00.153622 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e533001a-3eec-481f-a0d9-b4e06c317bd7 tempest-SecurityGroupRulesNegativeTestJSON-1892308880 tempest-SecurityGroupRulesNegativeTestJSON-1892308880-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/4a703016-8375-408d-b322-8a680b11d690" status: 202 len: 0 microversion: 2.1 time: 0.477290 Oct 29 01:18:00.154961 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1629/3434] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 29 01:17:59 2022] DELETE /compute/v2.1/os-security-groups/4a703016-8375-408d-b322-8a680b11d690 => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:18:00.191535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2c919354-437e-46eb-bd41-56d6af69d8eb tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:00.192261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2c919354-437e-46eb-bd41-56d6af69d8eb tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:00.211888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c919354-437e-46eb-bd41-56d6af69d8eb tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:00.214142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c919354-437e-46eb-bd41-56d6af69d8eb tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:00.216569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c919354-437e-46eb-bd41-56d6af69d8eb tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:00.217557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c919354-437e-46eb-bd41-56d6af69d8eb tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:00.219139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c919354-437e-46eb-bd41-56d6af69d8eb tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:00.222712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c919354-437e-46eb-bd41-56d6af69d8eb tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:00.708722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-37a52d20-aa70-46d1-97ab-244f0c979a84 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:00.710086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-37a52d20-aa70-46d1-97ab-244f0c979a84 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:00.732043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37a52d20-aa70-46d1-97ab-244f0c979a84 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:00.741817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37a52d20-aa70-46d1-97ab-244f0c979a84 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:00.747423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37a52d20-aa70-46d1-97ab-244f0c979a84 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:00.747968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37a52d20-aa70-46d1-97ab-244f0c979a84 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:00.748455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37a52d20-aa70-46d1-97ab-244f0c979a84 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:00.748896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37a52d20-aa70-46d1-97ab-244f0c979a84 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:00.829130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2c919354-437e-46eb-bd41-56d6af69d8eb tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:00.838528 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2c919354-437e-46eb-bd41-56d6af69d8eb tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1293 microversion: 2.1 time: 0.650262 Oct 29 01:18:00.859723 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1806/3435] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:00 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1293 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:00.972285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-37a52d20-aa70-46d1-97ab-244f0c979a84 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:00.992080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-37a52d20-aa70-46d1-97ab-244f0c979a84 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:00.998455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-37a52d20-aa70-46d1-97ab-244f0c979a84 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:01.016177 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-37a52d20-aa70-46d1-97ab-244f0c979a84 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.335860 Oct 29 01:18:01.017481 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1630/3436] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:00 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:01.172467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fa25365e-a202-4858-9da5-3a1338c925e6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:01.178596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fa25365e-a202-4858-9da5-3a1338c925e6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:01.192271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa25365e-a202-4858-9da5-3a1338c925e6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:01.193205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa25365e-a202-4858-9da5-3a1338c925e6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:01.194050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa25365e-a202-4858-9da5-3a1338c925e6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:01.196570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa25365e-a202-4858-9da5-3a1338c925e6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:01.202433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa25365e-a202-4858-9da5-3a1338c925e6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:01.204305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa25365e-a202-4858-9da5-3a1338c925e6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:01.867550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5bae9469-62dc-4fec-830b-4b309d7e4523 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:01.868771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5bae9469-62dc-4fec-830b-4b309d7e4523 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:01.879739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bae9469-62dc-4fec-830b-4b309d7e4523 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:01.882600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bae9469-62dc-4fec-830b-4b309d7e4523 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:01.886246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bae9469-62dc-4fec-830b-4b309d7e4523 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:01.887389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bae9469-62dc-4fec-830b-4b309d7e4523 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:01.888064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bae9469-62dc-4fec-830b-4b309d7e4523 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:01.888711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bae9469-62dc-4fec-830b-4b309d7e4523 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:02.272568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fa25365e-a202-4858-9da5-3a1338c925e6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:02.283619 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fa25365e-a202-4858-9da5-3a1338c925e6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1307 microversion: 2.1 time: 1.116189 Oct 29 01:18:02.288178 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1807/3437] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:01 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1307 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:02.296803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3613be39-0a50-482f-87e7-e75ce90717fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:02.301832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3613be39-0a50-482f-87e7-e75ce90717fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:02.314435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3613be39-0a50-482f-87e7-e75ce90717fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:02.315321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3613be39-0a50-482f-87e7-e75ce90717fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:02.316018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3613be39-0a50-482f-87e7-e75ce90717fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:02.316964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3613be39-0a50-482f-87e7-e75ce90717fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:02.318093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3613be39-0a50-482f-87e7-e75ce90717fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:02.325327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3613be39-0a50-482f-87e7-e75ce90717fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:02.404270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5bae9469-62dc-4fec-830b-4b309d7e4523 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:02.431901 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5bae9469-62dc-4fec-830b-4b309d7e4523 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1474 microversion: 2.1 time: 0.568787 Oct 29 01:18:02.433029 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1631/3438] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:01 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1474 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:02.713735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3613be39-0a50-482f-87e7-e75ce90717fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:02.732294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3613be39-0a50-482f-87e7-e75ce90717fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:02.776112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3613be39-0a50-482f-87e7-e75ce90717fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:02.776112 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3613be39-0a50-482f-87e7-e75ce90717fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.462999 Oct 29 01:18:02.776112 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1808/3439] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:02 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:02.776876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e739bc73-7895-4bc9-a463-0004321d12ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1063222775", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:02.912023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-e739bc73-7895-4bc9-a463-0004321d12ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] validate_networks() for [('b5b62219-8a2f-42eb-b795-dd5a026e1972', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:18:03.309743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ad3322bc-289f-43ac-910d-f60bf5de2ce5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:03.311854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ad3322bc-289f-43ac-910d-f60bf5de2ce5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:03.334802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad3322bc-289f-43ac-910d-f60bf5de2ce5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:03.339942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad3322bc-289f-43ac-910d-f60bf5de2ce5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:03.340745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad3322bc-289f-43ac-910d-f60bf5de2ce5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:03.341968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad3322bc-289f-43ac-910d-f60bf5de2ce5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:03.342882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad3322bc-289f-43ac-910d-f60bf5de2ce5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:03.343708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad3322bc-289f-43ac-910d-f60bf5de2ce5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:04.352627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ad3322bc-289f-43ac-910d-f60bf5de2ce5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:04.380794 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ad3322bc-289f-43ac-910d-f60bf5de2ce5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1307 microversion: 2.1 time: 1.071601 Oct 29 01:18:04.382915 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1809/3440] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:03 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1307 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:04.404094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3236986a-aa2d-429d-ada3-73f6f7db6607 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:04.409523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3236986a-aa2d-429d-ada3-73f6f7db6607 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:04.425789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3236986a-aa2d-429d-ada3-73f6f7db6607 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:04.426602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3236986a-aa2d-429d-ada3-73f6f7db6607 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:04.427230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3236986a-aa2d-429d-ada3-73f6f7db6607 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:04.428118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3236986a-aa2d-429d-ada3-73f6f7db6607 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:04.428737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3236986a-aa2d-429d-ada3-73f6f7db6607 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:04.430448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3236986a-aa2d-429d-ada3-73f6f7db6607 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:04.516731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e739bc73-7895-4bc9-a463-0004321d12ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:18:04.517302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e739bc73-7895-4bc9-a463-0004321d12ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:18:04.517781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e739bc73-7895-4bc9-a463-0004321d12ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:18:04.518200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e739bc73-7895-4bc9-a463-0004321d12ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:18:04.518619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e739bc73-7895-4bc9-a463-0004321d12ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:18:04.551789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e739bc73-7895-4bc9-a463-0004321d12ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:04.552498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e739bc73-7895-4bc9-a463-0004321d12ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:04.553104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e739bc73-7895-4bc9-a463-0004321d12ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:04.554043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e739bc73-7895-4bc9-a463-0004321d12ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:04.556166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e739bc73-7895-4bc9-a463-0004321d12ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:04.557636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e739bc73-7895-4bc9-a463-0004321d12ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:04.604043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-e739bc73-7895-4bc9-a463-0004321d12ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Getting quotas for project 6dc302f307494a61836f3afb38dccae9. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:18:04.616405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-e739bc73-7895-4bc9-a463-0004321d12ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Getting quotas for user 6cb8fe33c5d64047ada50f44e01e4faa and project 6dc302f307494a61836f3afb38dccae9. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:18:04.638191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e739bc73-7895-4bc9-a463-0004321d12ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:18:04.641927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e739bc73-7895-4bc9-a463-0004321d12ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: d13a57fc-6ec4-4836-bba7-fc3735ed5207] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:18:04.645777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3236986a-aa2d-429d-ada3-73f6f7db6607 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:04.659820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3236986a-aa2d-429d-ada3-73f6f7db6607 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:04.664669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3236986a-aa2d-429d-ada3-73f6f7db6607 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:04.692693 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3236986a-aa2d-429d-ada3-73f6f7db6607 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.297543 Oct 29 01:18:04.693479 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1810/3441] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:04 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:04.851065 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e739bc73-7895-4bc9-a463-0004321d12ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.086895 Oct 29 01:18:04.854805 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1632/3442] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:18:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:18:04.863995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1867dde8-c50f-4f6c-a362-62a93ddff9ca tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:04.864287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-38d14cc7-3aa1-4533-8fcd-612dde5ecaab req-c7dfad09-0309-4373-bbc3-9ed8e9e072ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e5221e-08a3-4b98-a068-1963700c814e", "name": "network-vif-plugged", "status": "completed", "tag": "87ed97e9-c5bc-4a10-91d0-5c4cb8c6d5d6"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:04.864933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1867dde8-c50f-4f6c-a362-62a93ddff9ca tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: d13a57fc-6ec4-4836-bba7-fc3735ed5207] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:04.899146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-38d14cc7-3aa1-4533-8fcd-612dde5ecaab req-c7dfad09-0309-4373-bbc3-9ed8e9e072ed service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:04.899146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-38d14cc7-3aa1-4533-8fcd-612dde5ecaab req-c7dfad09-0309-4373-bbc3-9ed8e9e072ed service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:04.899146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-38d14cc7-3aa1-4533-8fcd-612dde5ecaab req-c7dfad09-0309-4373-bbc3-9ed8e9e072ed service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:04.908825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1867dde8-c50f-4f6c-a362-62a93ddff9ca tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: d13a57fc-6ec4-4836-bba7-fc3735ed5207] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:18:04.959378 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-38d14cc7-3aa1-4533-8fcd-612dde5ecaab req-c7dfad09-0309-4373-bbc3-9ed8e9e072ed service nova] Creating event network-vif-plugged:87ed97e9-c5bc-4a10-91d0-5c4cb8c6d5d6 for instance 60e5221e-08a3-4b98-a068-1963700c814e on n-h1-862964-3 Oct 29 01:18:04.979789 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-38d14cc7-3aa1-4533-8fcd-612dde5ecaab req-c7dfad09-0309-4373-bbc3-9ed8e9e072ed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120047 Oct 29 01:18:04.981089 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1811/3443] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:05.409787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7a2ff9d7-f2b4-4fe0-81f9-ed6f01aa85a3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:05.411330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7a2ff9d7-f2b4-4fe0-81f9-ed6f01aa85a3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:05.437303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a2ff9d7-f2b4-4fe0-81f9-ed6f01aa85a3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:05.438372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a2ff9d7-f2b4-4fe0-81f9-ed6f01aa85a3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:05.443675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a2ff9d7-f2b4-4fe0-81f9-ed6f01aa85a3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:05.447422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a2ff9d7-f2b4-4fe0-81f9-ed6f01aa85a3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:05.454766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a2ff9d7-f2b4-4fe0-81f9-ed6f01aa85a3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:05.455922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a2ff9d7-f2b4-4fe0-81f9-ed6f01aa85a3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:05.762830 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1867dde8-c50f-4f6c-a362-62a93ddff9ca tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d13a57fc-6ec4-4836-bba7-fc3735ed5207" status: 204 len: 0 microversion: 2.1 time: 0.901566 Oct 29 01:18:05.765582 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1633/3444] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:18:04 2022] DELETE /compute/v2.1/servers/d13a57fc-6ec4-4836-bba7-fc3735ed5207 => generated 0 bytes in 906 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:18:05.771350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-16455c1b-0cb3-4160-9b8a-e91b68990d58 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:05.772231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-16455c1b-0cb3-4160-9b8a-e91b68990d58 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:05.784950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16455c1b-0cb3-4160-9b8a-e91b68990d58 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:05.786301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16455c1b-0cb3-4160-9b8a-e91b68990d58 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:05.787020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16455c1b-0cb3-4160-9b8a-e91b68990d58 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:05.790808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16455c1b-0cb3-4160-9b8a-e91b68990d58 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:05.793897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16455c1b-0cb3-4160-9b8a-e91b68990d58 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:05.796277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16455c1b-0cb3-4160-9b8a-e91b68990d58 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:06.231561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-16455c1b-0cb3-4160-9b8a-e91b68990d58 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:06.251486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-16455c1b-0cb3-4160-9b8a-e91b68990d58 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:06.262458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-16455c1b-0cb3-4160-9b8a-e91b68990d58 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:06.303054 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-16455c1b-0cb3-4160-9b8a-e91b68990d58 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.535986 Oct 29 01:18:06.311021 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1634/3445] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:05 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:06.316123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-355b6465-330e-4664-92e9-c520809e83b2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:06.316742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-355b6465-330e-4664-92e9-c520809e83b2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: d13a57fc-6ec4-4836-bba7-fc3735ed5207] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:06.345125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:18:06.367718 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-355b6465-330e-4664-92e9-c520809e83b2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance d13a57fc-6ec4-4836-bba7-fc3735ed5207 could not be found. Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-355b6465-330e-4664-92e9-c520809e83b2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/d13a57fc-6ec4-4836-bba7-fc3735ed5207 HTTP/1.1 Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance d13a57fc-6ec4-4836-bba7-fc3735ed5207 could not be found. Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'd13a57fc-6ec4-4836-bba7-fc3735ed5207'} Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13a57fc-6ec4-4836-bba7-fc3735ed5207 could not be found. Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13a57fc-6ec4-4836-bba7-fc3735ed5207 could not be found. Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:18:06.376430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:18:06.381852 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:18:06.381852 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:18:06.381852 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:18:06.381852 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13a57fc-6ec4-4836-bba7-fc3735ed5207 could not be found. Oct 29 01:18:06.381852 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:18:06.387962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-355b6465-330e-4664-92e9-c520809e83b2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance d13a57fc-6ec4-4836-bba7-fc3735ed5207 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:18:06.390423 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-355b6465-330e-4664-92e9-c520809e83b2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/d13a57fc-6ec4-4836-bba7-fc3735ed5207" status: 404 len: 111 microversion: 2.1 time: 0.078292 Oct 29 01:18:06.392555 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1635/3446] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:06 2022] GET /compute/v2.1/servers/d13a57fc-6ec4-4836-bba7-fc3735ed5207 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:18:06.422213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7a2ff9d7-f2b4-4fe0-81f9-ed6f01aa85a3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:06.437958 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7a2ff9d7-f2b4-4fe0-81f9-ed6f01aa85a3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1307 microversion: 2.1 time: 1.031836 Oct 29 01:18:06.439276 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1812/3447] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:05 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1307 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:06.961985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-901b5a3c-e6e3-479d-80a7-6ce0a48f8e3e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1600757984", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "b5b62219-8a2f-42eb-b795-dd5a026e1972"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:07.177999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-901b5a3c-e6e3-479d-80a7-6ce0a48f8e3e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] validate_networks() for [('b5b62219-8a2f-42eb-b795-dd5a026e1972', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:18:07.335561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4800231c-ec76-41e0-8d11-c81743888aad tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:07.336889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4800231c-ec76-41e0-8d11-c81743888aad tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:07.350478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4800231c-ec76-41e0-8d11-c81743888aad tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:07.352569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4800231c-ec76-41e0-8d11-c81743888aad tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:07.373262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4800231c-ec76-41e0-8d11-c81743888aad tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:07.375423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4800231c-ec76-41e0-8d11-c81743888aad tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:07.378153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4800231c-ec76-41e0-8d11-c81743888aad tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:07.381681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4800231c-ec76-41e0-8d11-c81743888aad tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:07.688268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4800231c-ec76-41e0-8d11-c81743888aad tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:07.721006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4800231c-ec76-41e0-8d11-c81743888aad tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:07.728450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4800231c-ec76-41e0-8d11-c81743888aad tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:07.740304 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4800231c-ec76-41e0-8d11-c81743888aad tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.410095 Oct 29 01:18:07.754068 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1813/3448] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:07 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:07.789526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-adf4b52e-a50f-4b2f-9fc1-119184f63054 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:07.790451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-adf4b52e-a50f-4b2f-9fc1-119184f63054 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:07.810185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adf4b52e-a50f-4b2f-9fc1-119184f63054 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:07.812672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adf4b52e-a50f-4b2f-9fc1-119184f63054 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:07.816992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adf4b52e-a50f-4b2f-9fc1-119184f63054 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:07.823007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adf4b52e-a50f-4b2f-9fc1-119184f63054 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:07.823007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adf4b52e-a50f-4b2f-9fc1-119184f63054 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:07.823007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adf4b52e-a50f-4b2f-9fc1-119184f63054 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:08.375071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-adf4b52e-a50f-4b2f-9fc1-119184f63054 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:08.384359 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-adf4b52e-a50f-4b2f-9fc1-119184f63054 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1487 microversion: 2.1 time: 0.628966 Oct 29 01:18:08.401045 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1814/3449] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:07 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1487 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:08.428340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-34b40791-b4bc-48f6-a671-5fb939909839 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:08.453682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-34b40791-b4bc-48f6-a671-5fb939909839 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:08.454502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-34b40791-b4bc-48f6-a671-5fb939909839 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:08.455118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-34b40791-b4bc-48f6-a671-5fb939909839 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:08.644514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-34b40791-b4bc-48f6-a671-5fb939909839 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Going to try to stop instance {{(pid=121099) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 01:18:08.876672 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-34b40791-b4bc-48f6-a671-5fb939909839 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "POST /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e/action" status: 202 len: 0 microversion: 2.1 time: 0.452365 Oct 29 01:18:08.879268 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1815/3450] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:18:08 2022] POST /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:18:08.912187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a6cae236-a613-41a9-9b0e-28692ba1973d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:08.914186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a6cae236-a613-41a9-9b0e-28692ba1973d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:08.929415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6cae236-a613-41a9-9b0e-28692ba1973d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:08.930199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6cae236-a613-41a9-9b0e-28692ba1973d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:08.930884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6cae236-a613-41a9-9b0e-28692ba1973d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:08.933234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6cae236-a613-41a9-9b0e-28692ba1973d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:08.933899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6cae236-a613-41a9-9b0e-28692ba1973d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:08.934506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6cae236-a613-41a9-9b0e-28692ba1973d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:09.042953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-901b5a3c-e6e3-479d-80a7-6ce0a48f8e3e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:18:09.044655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-901b5a3c-e6e3-479d-80a7-6ce0a48f8e3e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:18:09.045457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-901b5a3c-e6e3-479d-80a7-6ce0a48f8e3e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:18:09.046379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-901b5a3c-e6e3-479d-80a7-6ce0a48f8e3e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:18:09.047202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-901b5a3c-e6e3-479d-80a7-6ce0a48f8e3e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:18:09.071715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-901b5a3c-e6e3-479d-80a7-6ce0a48f8e3e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:09.073918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-901b5a3c-e6e3-479d-80a7-6ce0a48f8e3e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:09.074476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-901b5a3c-e6e3-479d-80a7-6ce0a48f8e3e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:09.081349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-901b5a3c-e6e3-479d-80a7-6ce0a48f8e3e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:09.086569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-901b5a3c-e6e3-479d-80a7-6ce0a48f8e3e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:09.086569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-901b5a3c-e6e3-479d-80a7-6ce0a48f8e3e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:09.102956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a6cae236-a613-41a9-9b0e-28692ba1973d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:09.123113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a6cae236-a613-41a9-9b0e-28692ba1973d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:09.128192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a6cae236-a613-41a9-9b0e-28692ba1973d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:09.136096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-901b5a3c-e6e3-479d-80a7-6ce0a48f8e3e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Getting quotas for project 6dc302f307494a61836f3afb38dccae9. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:18:09.160720 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a6cae236-a613-41a9-9b0e-28692ba1973d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.279596 Oct 29 01:18:09.163313 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1816/3451] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:08 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:09.180791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a1e1e4d9-37f5-4068-941a-674b6be68db3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:09.185716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a1e1e4d9-37f5-4068-941a-674b6be68db3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:09.198204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:18:09.200774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1e1e4d9-37f5-4068-941a-674b6be68db3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:09.201564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1e1e4d9-37f5-4068-941a-674b6be68db3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:09.202014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1e1e4d9-37f5-4068-941a-674b6be68db3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:09.202857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1e1e4d9-37f5-4068-941a-674b6be68db3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:09.203473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1e1e4d9-37f5-4068-941a-674b6be68db3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:09.204057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a1e1e4d9-37f5-4068-941a-674b6be68db3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:09.204850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-901b5a3c-e6e3-479d-80a7-6ce0a48f8e3e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Getting quotas for user 6cb8fe33c5d64047ada50f44e01e4faa and project 6dc302f307494a61836f3afb38dccae9. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:18:09.209071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:18:09.256639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-901b5a3c-e6e3-479d-80a7-6ce0a48f8e3e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:18:09.260991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-901b5a3c-e6e3-479d-80a7-6ce0a48f8e3e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:18:09.479827 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-901b5a3c-e6e3-479d-80a7-6ce0a48f8e3e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.533047 Oct 29 01:18:09.482303 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1636/3452] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:18:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:18:09.500788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e52df908-152f-4266-a485-b36a3de36e0a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:09.501997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e52df908-152f-4266-a485-b36a3de36e0a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:09.553125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a1e1e4d9-37f5-4068-941a-674b6be68db3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:09.574851 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a1e1e4d9-37f5-4068-941a-674b6be68db3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1497 microversion: 2.1 time: 0.407233 Oct 29 01:18:09.576555 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1817/3453] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:09 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1497 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:10.201137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-97d233d0-5a65-410b-bf18-ac49c55e7a2c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:10.202127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-97d233d0-5a65-410b-bf18-ac49c55e7a2c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:10.232919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97d233d0-5a65-410b-bf18-ac49c55e7a2c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:10.233955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97d233d0-5a65-410b-bf18-ac49c55e7a2c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:10.238324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97d233d0-5a65-410b-bf18-ac49c55e7a2c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:10.242781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97d233d0-5a65-410b-bf18-ac49c55e7a2c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:10.250001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97d233d0-5a65-410b-bf18-ac49c55e7a2c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:10.250715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97d233d0-5a65-410b-bf18-ac49c55e7a2c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:10.339660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e52df908-152f-4266-a485-b36a3de36e0a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:10.352021 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e52df908-152f-4266-a485-b36a3de36e0a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 200 len: 1221 microversion: 2.1 time: 0.862680 Oct 29 01:18:10.359725 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1637/3454] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:09 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 1221 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:10.501629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-97d233d0-5a65-410b-bf18-ac49c55e7a2c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:10.522207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-97d233d0-5a65-410b-bf18-ac49c55e7a2c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:10.524151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-97d233d0-5a65-410b-bf18-ac49c55e7a2c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:10.541707 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-97d233d0-5a65-410b-bf18-ac49c55e7a2c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.347107 Oct 29 01:18:10.543146 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1818/3455] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:10 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:10.601086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-76fa6ce0-502b-42ed-8f09-6e7bc20de29d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:10.602079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-76fa6ce0-502b-42ed-8f09-6e7bc20de29d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:10.617625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76fa6ce0-502b-42ed-8f09-6e7bc20de29d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:10.618496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76fa6ce0-502b-42ed-8f09-6e7bc20de29d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:10.621207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76fa6ce0-502b-42ed-8f09-6e7bc20de29d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:10.623441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76fa6ce0-502b-42ed-8f09-6e7bc20de29d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:10.626876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76fa6ce0-502b-42ed-8f09-6e7bc20de29d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:10.628939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76fa6ce0-502b-42ed-8f09-6e7bc20de29d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:10.974489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-76fa6ce0-502b-42ed-8f09-6e7bc20de29d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:10.986524 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-76fa6ce0-502b-42ed-8f09-6e7bc20de29d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1497 microversion: 2.1 time: 0.389333 Oct 29 01:18:10.988682 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1819/3456] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:10 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1497 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:11.385271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb2433a2-5619-4336-af55-3fb86e1af5b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:11.386071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bb2433a2-5619-4336-af55-3fb86e1af5b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:11.392363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d8fc1ff9-398c-4b80-be16-9a066029d984 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-693431506", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "fd322bf4-74b2-4720-9629-fa9ea0bd49db"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:11.402694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb2433a2-5619-4336-af55-3fb86e1af5b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:11.407553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb2433a2-5619-4336-af55-3fb86e1af5b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:11.411243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb2433a2-5619-4336-af55-3fb86e1af5b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:11.417483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb2433a2-5619-4336-af55-3fb86e1af5b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:11.420357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb2433a2-5619-4336-af55-3fb86e1af5b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:11.421496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb2433a2-5619-4336-af55-3fb86e1af5b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:11.573658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-d8fc1ff9-398c-4b80-be16-9a066029d984 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] validate_networks() for [('fd322bf4-74b2-4720-9629-fa9ea0bd49db', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:18:11.609980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bb2433a2-5619-4336-af55-3fb86e1af5b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:11.623431 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bb2433a2-5619-4336-af55-3fb86e1af5b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 200 len: 1225 microversion: 2.1 time: 0.243198 Oct 29 01:18:11.638882 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1820/3457] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:11 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 1225 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:11.660242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8b4e5ba7-7370-4e23-91a1-329f5c188566 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:11.661400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8b4e5ba7-7370-4e23-91a1-329f5c188566 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:11.677709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b4e5ba7-7370-4e23-91a1-329f5c188566 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:11.681797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b4e5ba7-7370-4e23-91a1-329f5c188566 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:11.682739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b4e5ba7-7370-4e23-91a1-329f5c188566 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:11.687773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b4e5ba7-7370-4e23-91a1-329f5c188566 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:11.688692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b4e5ba7-7370-4e23-91a1-329f5c188566 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:11.690954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b4e5ba7-7370-4e23-91a1-329f5c188566 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:11.888203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8b4e5ba7-7370-4e23-91a1-329f5c188566 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:11.906947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8b4e5ba7-7370-4e23-91a1-329f5c188566 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:11.908961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8b4e5ba7-7370-4e23-91a1-329f5c188566 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:11.919098 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8b4e5ba7-7370-4e23-91a1-329f5c188566 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.272316 Oct 29 01:18:11.932446 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1821/3458] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:11 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:12.016576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3f6cb8d5-256f-41be-9ead-917dbeef4187 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:12.017218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3f6cb8d5-256f-41be-9ead-917dbeef4187 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:12.023174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f6cb8d5-256f-41be-9ead-917dbeef4187 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:12.023659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f6cb8d5-256f-41be-9ead-917dbeef4187 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:12.024091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f6cb8d5-256f-41be-9ead-917dbeef4187 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:12.025016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f6cb8d5-256f-41be-9ead-917dbeef4187 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:12.025402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f6cb8d5-256f-41be-9ead-917dbeef4187 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:12.025973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f6cb8d5-256f-41be-9ead-917dbeef4187 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:12.259411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3f6cb8d5-256f-41be-9ead-917dbeef4187 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:12.268684 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3f6cb8d5-256f-41be-9ead-917dbeef4187 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1497 microversion: 2.1 time: 0.255806 Oct 29 01:18:12.289746 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1822/3459] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:12 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1497 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:12.402737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d8fc1ff9-398c-4b80-be16-9a066029d984 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:18:12.402737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d8fc1ff9-398c-4b80-be16-9a066029d984 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:18:12.402737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d8fc1ff9-398c-4b80-be16-9a066029d984 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:18:12.402737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d8fc1ff9-398c-4b80-be16-9a066029d984 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:18:12.403771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d8fc1ff9-398c-4b80-be16-9a066029d984 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:18:12.413629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8fc1ff9-398c-4b80-be16-9a066029d984 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:12.414395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8fc1ff9-398c-4b80-be16-9a066029d984 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:12.415069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8fc1ff9-398c-4b80-be16-9a066029d984 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:12.416655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8fc1ff9-398c-4b80-be16-9a066029d984 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:12.417365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8fc1ff9-398c-4b80-be16-9a066029d984 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:12.417700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8fc1ff9-398c-4b80-be16-9a066029d984 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:12.441041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-d8fc1ff9-398c-4b80-be16-9a066029d984 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Getting quotas for project 125dd75e927e40aab0cab8010084f381. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:18:12.465560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-d8fc1ff9-398c-4b80-be16-9a066029d984 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Getting quotas for user afa7e964bc36460687fe8d2152b753b5 and project 125dd75e927e40aab0cab8010084f381. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:18:12.484782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d8fc1ff9-398c-4b80-be16-9a066029d984 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:18:12.487304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d8fc1ff9-398c-4b80-be16-9a066029d984 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:18:12.653093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-af35698c-8634-4e76-94fe-c9560587fb30 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:12.653742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-af35698c-8634-4e76-94fe-c9560587fb30 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:12.671635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af35698c-8634-4e76-94fe-c9560587fb30 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:12.672337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af35698c-8634-4e76-94fe-c9560587fb30 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:12.672948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af35698c-8634-4e76-94fe-c9560587fb30 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:12.673860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af35698c-8634-4e76-94fe-c9560587fb30 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:12.674476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af35698c-8634-4e76-94fe-c9560587fb30 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:12.675080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af35698c-8634-4e76-94fe-c9560587fb30 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:12.730510 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d8fc1ff9-398c-4b80-be16-9a066029d984 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.185210 Oct 29 01:18:12.731645 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1638/3460] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:18:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:18:12.745403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5698ddab-2805-4249-a0fa-da6fd79a86cf tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:12.746364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5698ddab-2805-4249-a0fa-da6fd79a86cf tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:12.839583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-af35698c-8634-4e76-94fe-c9560587fb30 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:12.859383 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-af35698c-8634-4e76-94fe-c9560587fb30 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 200 len: 1273 microversion: 2.1 time: 0.208808 Oct 29 01:18:12.860591 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1823/3461] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:12 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:12.893423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5698ddab-2805-4249-a0fa-da6fd79a86cf tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:12.903549 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5698ddab-2805-4249-a0fa-da6fd79a86cf tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1224 microversion: 2.1 time: 0.163348 Oct 29 01:18:12.905577 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1639/3462] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:12 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1224 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:12.954759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6c861c32-c983-4878-8aff-2ce08543bbd6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:12.955537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6c861c32-c983-4878-8aff-2ce08543bbd6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:12.965388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c861c32-c983-4878-8aff-2ce08543bbd6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:12.967447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c861c32-c983-4878-8aff-2ce08543bbd6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:12.968149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c861c32-c983-4878-8aff-2ce08543bbd6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:12.969772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c861c32-c983-4878-8aff-2ce08543bbd6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:12.972902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c861c32-c983-4878-8aff-2ce08543bbd6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:12.973627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c861c32-c983-4878-8aff-2ce08543bbd6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:13.096854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6c861c32-c983-4878-8aff-2ce08543bbd6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:13.109027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6c861c32-c983-4878-8aff-2ce08543bbd6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:13.113373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6c861c32-c983-4878-8aff-2ce08543bbd6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:13.124815 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6c861c32-c983-4878-8aff-2ce08543bbd6 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.174057 Oct 29 01:18:13.125851 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1824/3463] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:12 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:13.302797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5dc6f7a3-d8f0-40cf-9b84-1be742d6bec7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:13.307329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5dc6f7a3-d8f0-40cf-9b84-1be742d6bec7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:13.324044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5dc6f7a3-d8f0-40cf-9b84-1be742d6bec7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:13.324353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5dc6f7a3-d8f0-40cf-9b84-1be742d6bec7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:13.324890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5dc6f7a3-d8f0-40cf-9b84-1be742d6bec7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:13.338007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5dc6f7a3-d8f0-40cf-9b84-1be742d6bec7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:13.338007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5dc6f7a3-d8f0-40cf-9b84-1be742d6bec7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:13.338907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5dc6f7a3-d8f0-40cf-9b84-1be742d6bec7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:13.652052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5dc6f7a3-d8f0-40cf-9b84-1be742d6bec7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:13.662192 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5dc6f7a3-d8f0-40cf-9b84-1be742d6bec7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1497 microversion: 2.1 time: 0.363774 Oct 29 01:18:13.663388 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1640/3464] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:13 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1497 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:13.894714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5f908ea8-6f7b-432c-85ba-2da0eb8c13c0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:13.896178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5f908ea8-6f7b-432c-85ba-2da0eb8c13c0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:13.905640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f908ea8-6f7b-432c-85ba-2da0eb8c13c0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:13.906428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f908ea8-6f7b-432c-85ba-2da0eb8c13c0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:13.907066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f908ea8-6f7b-432c-85ba-2da0eb8c13c0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:13.908255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f908ea8-6f7b-432c-85ba-2da0eb8c13c0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:13.909023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f908ea8-6f7b-432c-85ba-2da0eb8c13c0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:13.909633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f908ea8-6f7b-432c-85ba-2da0eb8c13c0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:13.933217 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5d189c52-0f07-4daf-9ce0-52dafa60f85d tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:13.935443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5d189c52-0f07-4daf-9ce0-52dafa60f85d tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:14.130898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5f908ea8-6f7b-432c-85ba-2da0eb8c13c0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:14.132682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5d189c52-0f07-4daf-9ce0-52dafa60f85d tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:14.141765 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5f908ea8-6f7b-432c-85ba-2da0eb8c13c0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 200 len: 1281 microversion: 2.1 time: 0.259759 Oct 29 01:18:14.143362 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1825/3465] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:13 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 1281 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:14.149819 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5d189c52-0f07-4daf-9ce0-52dafa60f85d tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1224 microversion: 2.1 time: 0.220616 Oct 29 01:18:14.154193 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1641/3466] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:13 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1224 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:14.170541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-90f776ac-25af-458c-b749-4eba8a659272 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:14.171469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-90f776ac-25af-458c-b749-4eba8a659272 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:14.178643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90f776ac-25af-458c-b749-4eba8a659272 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:14.179339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90f776ac-25af-458c-b749-4eba8a659272 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:14.180193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90f776ac-25af-458c-b749-4eba8a659272 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:14.180701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90f776ac-25af-458c-b749-4eba8a659272 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:14.181215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90f776ac-25af-458c-b749-4eba8a659272 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:14.181682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90f776ac-25af-458c-b749-4eba8a659272 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:14.661868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-90f776ac-25af-458c-b749-4eba8a659272 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:14.662088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c186a851-e39d-44cc-877e-08306ce2a7d9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:14.662088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c186a851-e39d-44cc-877e-08306ce2a7d9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:14.668246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-90f776ac-25af-458c-b749-4eba8a659272 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:14.670443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-90f776ac-25af-458c-b749-4eba8a659272 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:14.675086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c186a851-e39d-44cc-877e-08306ce2a7d9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:14.675795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c186a851-e39d-44cc-877e-08306ce2a7d9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:14.676224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c186a851-e39d-44cc-877e-08306ce2a7d9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:14.676632 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-90f776ac-25af-458c-b749-4eba8a659272 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.511711 Oct 29 01:18:14.677016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c186a851-e39d-44cc-877e-08306ce2a7d9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:14.677227 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1826/3467] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:14 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:14.686340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c186a851-e39d-44cc-877e-08306ce2a7d9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:14.686340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c186a851-e39d-44cc-877e-08306ce2a7d9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:14.695379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cb6039e3-b519-4f1a-82ac-35e6d1e4e69f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:14.696649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cb6039e3-b519-4f1a-82ac-35e6d1e4e69f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:14.704721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb6039e3-b519-4f1a-82ac-35e6d1e4e69f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:14.705698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb6039e3-b519-4f1a-82ac-35e6d1e4e69f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:14.706928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb6039e3-b519-4f1a-82ac-35e6d1e4e69f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:14.708095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb6039e3-b519-4f1a-82ac-35e6d1e4e69f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:14.708867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb6039e3-b519-4f1a-82ac-35e6d1e4e69f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:14.710051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb6039e3-b519-4f1a-82ac-35e6d1e4e69f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:15.100135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c186a851-e39d-44cc-877e-08306ce2a7d9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:15.122413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c186a851-e39d-44cc-877e-08306ce2a7d9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:15.128613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c186a851-e39d-44cc-877e-08306ce2a7d9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:15.136271 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c186a851-e39d-44cc-877e-08306ce2a7d9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 2954 microversion: 2.42 time: 0.483898 Oct 29 01:18:15.145635 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1642/3468] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:14 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 2954 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:15.173607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1a257f7d-eebb-4542-b611-3382c5c74e89 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:15.174568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1a257f7d-eebb-4542-b611-3382c5c74e89 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:15.199646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a257f7d-eebb-4542-b611-3382c5c74e89 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:15.207383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a257f7d-eebb-4542-b611-3382c5c74e89 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:15.208414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a257f7d-eebb-4542-b611-3382c5c74e89 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:15.209701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a257f7d-eebb-4542-b611-3382c5c74e89 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:15.213522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a257f7d-eebb-4542-b611-3382c5c74e89 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:15.213522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a257f7d-eebb-4542-b611-3382c5c74e89 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:15.270532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:18:15.274369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cb6039e3-b519-4f1a-82ac-35e6d1e4e69f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:15.295903 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cb6039e3-b519-4f1a-82ac-35e6d1e4e69f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1497 microversion: 2.1 time: 0.607024 Oct 29 01:18:15.303385 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1827/3469] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:14 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1497 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:15.316386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d9d993a1-8bf9-413b-b879-1de24cc44453 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:15.321396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d9d993a1-8bf9-413b-b879-1de24cc44453 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:15.329489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9d993a1-8bf9-413b-b879-1de24cc44453 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:15.330285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9d993a1-8bf9-413b-b879-1de24cc44453 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:15.331099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9d993a1-8bf9-413b-b879-1de24cc44453 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:15.332843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9d993a1-8bf9-413b-b879-1de24cc44453 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:15.333523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9d993a1-8bf9-413b-b879-1de24cc44453 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:15.334157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9d993a1-8bf9-413b-b879-1de24cc44453 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:15.529914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d9d993a1-8bf9-413b-b879-1de24cc44453 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:15.546864 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d9d993a1-8bf9-413b-b879-1de24cc44453 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1228 microversion: 2.1 time: 0.237406 Oct 29 01:18:15.561413 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1828/3470] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:15 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1228 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:15.579843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e13ab372-f3f6-4e48-aa09-336adae485e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:15.581406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e13ab372-f3f6-4e48-aa09-336adae485e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:15.598255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e13ab372-f3f6-4e48-aa09-336adae485e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:15.598863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e13ab372-f3f6-4e48-aa09-336adae485e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:15.599471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e13ab372-f3f6-4e48-aa09-336adae485e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:15.601208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e13ab372-f3f6-4e48-aa09-336adae485e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:15.603883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e13ab372-f3f6-4e48-aa09-336adae485e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:15.604729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e13ab372-f3f6-4e48-aa09-336adae485e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:15.756018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1a257f7d-eebb-4542-b611-3382c5c74e89 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:15.770176 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1a257f7d-eebb-4542-b611-3382c5c74e89 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 200 len: 1321 microversion: 2.1 time: 0.599329 Oct 29 01:18:15.772189 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1643/3471] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:15 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 1321 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:15.785569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3e4df042-21bc-4d2a-bd3f-0b683e5445e7 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:15.790823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3e4df042-21bc-4d2a-bd3f-0b683e5445e7 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:15.808232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e4df042-21bc-4d2a-bd3f-0b683e5445e7 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:15.808808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e4df042-21bc-4d2a-bd3f-0b683e5445e7 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:15.809294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e4df042-21bc-4d2a-bd3f-0b683e5445e7 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:15.810386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e4df042-21bc-4d2a-bd3f-0b683e5445e7 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:15.811054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e4df042-21bc-4d2a-bd3f-0b683e5445e7 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:15.811628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e4df042-21bc-4d2a-bd3f-0b683e5445e7 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:15.972692 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e13ab372-f3f6-4e48-aa09-336adae485e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.407504 Oct 29 01:18:15.973744 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1829/3472] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Oct 29 01:18:15 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635/os-interface => generated 1831 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:16.018378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3e4df042-21bc-4d2a-bd3f-0b683e5445e7 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:16.029005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3e4df042-21bc-4d2a-bd3f-0b683e5445e7 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:16.030768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3e4df042-21bc-4d2a-bd3f-0b683e5445e7 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:16.036384 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3e4df042-21bc-4d2a-bd3f-0b683e5445e7 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1533 microversion: 2.91 time: 0.262771 Oct 29 01:18:16.040208 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1644/3473] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:15 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1533 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:16.327742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c97ce617-65ff-4be1-9505-587a7f0d0e95 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:16.328368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c97ce617-65ff-4be1-9505-587a7f0d0e95 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:16.335305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c97ce617-65ff-4be1-9505-587a7f0d0e95 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:16.335848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c97ce617-65ff-4be1-9505-587a7f0d0e95 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:16.336297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c97ce617-65ff-4be1-9505-587a7f0d0e95 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:16.336998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c97ce617-65ff-4be1-9505-587a7f0d0e95 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:16.337493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c97ce617-65ff-4be1-9505-587a7f0d0e95 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:16.338013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c97ce617-65ff-4be1-9505-587a7f0d0e95 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:16.498325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c97ce617-65ff-4be1-9505-587a7f0d0e95 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:16.506946 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c97ce617-65ff-4be1-9505-587a7f0d0e95 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1497 microversion: 2.1 time: 0.183425 Oct 29 01:18:16.511600 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1830/3474] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:16 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:16.576573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ad379cd5-a33b-4395-99f1-5b0a64326a41 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:16.578739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ad379cd5-a33b-4395-99f1-5b0a64326a41 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:16.590258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad379cd5-a33b-4395-99f1-5b0a64326a41 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:16.591538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad379cd5-a33b-4395-99f1-5b0a64326a41 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:16.591721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad379cd5-a33b-4395-99f1-5b0a64326a41 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:16.592947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad379cd5-a33b-4395-99f1-5b0a64326a41 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:16.593745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad379cd5-a33b-4395-99f1-5b0a64326a41 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:16.594371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad379cd5-a33b-4395-99f1-5b0a64326a41 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:16.675770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ad379cd5-a33b-4395-99f1-5b0a64326a41 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:16.693325 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ad379cd5-a33b-4395-99f1-5b0a64326a41 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1276 microversion: 2.1 time: 0.121236 Oct 29 01:18:16.693926 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1645/3475] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:16 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1276 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:16.800455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-70915d3d-7bc9-4ff9-82f5-a592bed04e7e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:16.801086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-70915d3d-7bc9-4ff9-82f5-a592bed04e7e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:16.813751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70915d3d-7bc9-4ff9-82f5-a592bed04e7e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:16.814329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70915d3d-7bc9-4ff9-82f5-a592bed04e7e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:16.815112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70915d3d-7bc9-4ff9-82f5-a592bed04e7e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:16.815943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70915d3d-7bc9-4ff9-82f5-a592bed04e7e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:16.816165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70915d3d-7bc9-4ff9-82f5-a592bed04e7e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:16.816773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70915d3d-7bc9-4ff9-82f5-a592bed04e7e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:16.873814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-555e8f3b-1168-4dde-a6e7-932a0fd88638 req-af743cb7-70c3-4e7f-b0c2-13f7473b80e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2093a86c-3a1a-47ca-825e-1ff9f28dc3b5", "tag": "0ae1e3d7-0c43-499b-8e56-f9e463f692d3"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:16.884000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-555e8f3b-1168-4dde-a6e7-932a0fd88638 req-af743cb7-70c3-4e7f-b0c2-13f7473b80e1 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:16.885051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-555e8f3b-1168-4dde-a6e7-932a0fd88638 req-af743cb7-70c3-4e7f-b0c2-13f7473b80e1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:16.885515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-555e8f3b-1168-4dde-a6e7-932a0fd88638 req-af743cb7-70c3-4e7f-b0c2-13f7473b80e1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:16.899777 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-555e8f3b-1168-4dde-a6e7-932a0fd88638 req-af743cb7-70c3-4e7f-b0c2-13f7473b80e1 service nova] Creating event network-changed:0ae1e3d7-0c43-499b-8e56-f9e463f692d3 for instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 on n-h2-862964-3 Oct 29 01:18:16.909803 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-555e8f3b-1168-4dde-a6e7-932a0fd88638 req-af743cb7-70c3-4e7f-b0c2-13f7473b80e1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040162 Oct 29 01:18:16.910581 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1646/3476] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:17.055200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-70915d3d-7bc9-4ff9-82f5-a592bed04e7e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:17.066613 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-70915d3d-7bc9-4ff9-82f5-a592bed04e7e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 200 len: 1321 microversion: 2.1 time: 0.270882 Oct 29 01:18:17.070834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4407660a-396f-4546-bd8e-dce8e3e28afc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:17.071793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4407660a-396f-4546-bd8e-dce8e3e28afc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:17.077693 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1831/3477] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:16 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:17.082120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4407660a-396f-4546-bd8e-dce8e3e28afc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:17.082859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4407660a-396f-4546-bd8e-dce8e3e28afc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:17.083691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4407660a-396f-4546-bd8e-dce8e3e28afc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:17.084731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4407660a-396f-4546-bd8e-dce8e3e28afc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:17.085440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4407660a-396f-4546-bd8e-dce8e3e28afc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:17.086064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4407660a-396f-4546-bd8e-dce8e3e28afc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:17.187841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4407660a-396f-4546-bd8e-dce8e3e28afc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:17.197931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4407660a-396f-4546-bd8e-dce8e3e28afc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:17.199806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4407660a-396f-4546-bd8e-dce8e3e28afc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:17.205358 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4407660a-396f-4546-bd8e-dce8e3e28afc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1533 microversion: 2.91 time: 0.140516 Oct 29 01:18:17.206237 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1647/3478] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:17 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1533 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:17.532538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f5db8dc-d094-4f9a-981e-51fa5012768e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:17.533887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1f5db8dc-d094-4f9a-981e-51fa5012768e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:17.541141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f5db8dc-d094-4f9a-981e-51fa5012768e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:17.541983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f5db8dc-d094-4f9a-981e-51fa5012768e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:17.542739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f5db8dc-d094-4f9a-981e-51fa5012768e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:17.543461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f5db8dc-d094-4f9a-981e-51fa5012768e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:17.543929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f5db8dc-d094-4f9a-981e-51fa5012768e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:17.544499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f5db8dc-d094-4f9a-981e-51fa5012768e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:17.718093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-10c7b134-0428-4678-837b-28eb189ffd3a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:17.718719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-10c7b134-0428-4678-837b-28eb189ffd3a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:17.726910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10c7b134-0428-4678-837b-28eb189ffd3a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:17.727644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10c7b134-0428-4678-837b-28eb189ffd3a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:17.730397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10c7b134-0428-4678-837b-28eb189ffd3a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:17.730397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10c7b134-0428-4678-837b-28eb189ffd3a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:17.730397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10c7b134-0428-4678-837b-28eb189ffd3a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:17.730397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10c7b134-0428-4678-837b-28eb189ffd3a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:17.831602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1f5db8dc-d094-4f9a-981e-51fa5012768e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:17.863292 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1f5db8dc-d094-4f9a-981e-51fa5012768e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1497 microversion: 2.1 time: 0.336287 Oct 29 01:18:17.863974 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1832/3479] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:17 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1497 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:17.894340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-10c7b134-0428-4678-837b-28eb189ffd3a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:17.915323 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-10c7b134-0428-4678-837b-28eb189ffd3a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1276 microversion: 2.1 time: 0.201094 Oct 29 01:18:17.926120 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1648/3480] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:17 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1276 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:18.094522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0d3f3e38-312e-4e3f-86ea-a72fb95ecc4e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:18.095276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0d3f3e38-312e-4e3f-86ea-a72fb95ecc4e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:18.104931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d3f3e38-312e-4e3f-86ea-a72fb95ecc4e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:18.105459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d3f3e38-312e-4e3f-86ea-a72fb95ecc4e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:18.112609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d3f3e38-312e-4e3f-86ea-a72fb95ecc4e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:18.116734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d3f3e38-312e-4e3f-86ea-a72fb95ecc4e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:18.116734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d3f3e38-312e-4e3f-86ea-a72fb95ecc4e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:18.116734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d3f3e38-312e-4e3f-86ea-a72fb95ecc4e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:18.235657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-306ca2fe-3e95-4fb4-9afa-5c1cb2f4a90e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:18.236586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-306ca2fe-3e95-4fb4-9afa-5c1cb2f4a90e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:18.248919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-306ca2fe-3e95-4fb4-9afa-5c1cb2f4a90e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:18.249880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-306ca2fe-3e95-4fb4-9afa-5c1cb2f4a90e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:18.250924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-306ca2fe-3e95-4fb4-9afa-5c1cb2f4a90e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:18.251940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-306ca2fe-3e95-4fb4-9afa-5c1cb2f4a90e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:18.255485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-306ca2fe-3e95-4fb4-9afa-5c1cb2f4a90e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:18.257090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-306ca2fe-3e95-4fb4-9afa-5c1cb2f4a90e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:18.368583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-306ca2fe-3e95-4fb4-9afa-5c1cb2f4a90e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:18.387302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-306ca2fe-3e95-4fb4-9afa-5c1cb2f4a90e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:18.391146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-306ca2fe-3e95-4fb4-9afa-5c1cb2f4a90e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:18.407666 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-306ca2fe-3e95-4fb4-9afa-5c1cb2f4a90e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1536 microversion: 2.91 time: 0.175923 Oct 29 01:18:18.408744 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1649/3481] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:18 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1536 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:18.448331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c6cae638-cddb-4f8a-9163-6e519f69ba91 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-862964-3"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:18.452793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0d3f3e38-312e-4e3f-86ea-a72fb95ecc4e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:18.458109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c6cae638-cddb-4f8a-9163-6e519f69ba91 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:18.469097 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0d3f3e38-312e-4e3f-86ea-a72fb95ecc4e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 200 len: 1321 microversion: 2.1 time: 0.377226 Oct 29 01:18:18.474340 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1833/3482] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:18 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:18.483739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6cae638-cddb-4f8a-9163-6e519f69ba91 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:18.484362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6cae638-cddb-4f8a-9163-6e519f69ba91 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:18.488014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6cae638-cddb-4f8a-9163-6e519f69ba91 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:18.489543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6cae638-cddb-4f8a-9163-6e519f69ba91 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:18.490392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6cae638-cddb-4f8a-9163-6e519f69ba91 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:18.491052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6cae638-cddb-4f8a-9163-6e519f69ba91 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:18.623431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c6cae638-cddb-4f8a-9163-6e519f69ba91 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-862964-3". {{(pid=121100) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 01:18:18.890672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eaff0fc2-6a04-420c-af96-a6aeb8596dae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:18.892000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eaff0fc2-6a04-420c-af96-a6aeb8596dae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:18.901665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eaff0fc2-6a04-420c-af96-a6aeb8596dae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:18.904757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eaff0fc2-6a04-420c-af96-a6aeb8596dae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:18.905264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eaff0fc2-6a04-420c-af96-a6aeb8596dae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:18.905996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eaff0fc2-6a04-420c-af96-a6aeb8596dae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:18.906482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eaff0fc2-6a04-420c-af96-a6aeb8596dae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:18.906914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eaff0fc2-6a04-420c-af96-a6aeb8596dae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:18.919087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:18:19.178185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eaff0fc2-6a04-420c-af96-a6aeb8596dae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:19.195979 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c6cae638-cddb-4f8a-9163-6e519f69ba91 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a/action" status: 202 len: 0 microversion: 2.91 time: 0.751434 Oct 29 01:18:19.200610 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1650/3483] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 29 01:18:18 2022] POST /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a/action => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:18:19.201230 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eaff0fc2-6a04-420c-af96-a6aeb8596dae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1497 microversion: 2.1 time: 0.312544 Oct 29 01:18:19.203759 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1834/3484] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:18 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1497 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:19.207559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-58452cc9-9695-456e-9ef9-692bfb208fbd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:19.210259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-58452cc9-9695-456e-9ef9-692bfb208fbd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:19.211536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b7040f25-0a93-42cc-b80a-bc32bfcc6ad8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:19.212224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b7040f25-0a93-42cc-b80a-bc32bfcc6ad8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:19.219181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7040f25-0a93-42cc-b80a-bc32bfcc6ad8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:19.219880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7040f25-0a93-42cc-b80a-bc32bfcc6ad8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:19.220353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58452cc9-9695-456e-9ef9-692bfb208fbd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:19.220567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7040f25-0a93-42cc-b80a-bc32bfcc6ad8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:19.221291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58452cc9-9695-456e-9ef9-692bfb208fbd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:19.221632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7040f25-0a93-42cc-b80a-bc32bfcc6ad8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:19.222356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58452cc9-9695-456e-9ef9-692bfb208fbd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:19.223297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58452cc9-9695-456e-9ef9-692bfb208fbd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:19.224134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58452cc9-9695-456e-9ef9-692bfb208fbd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:19.225986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58452cc9-9695-456e-9ef9-692bfb208fbd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:19.247715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7040f25-0a93-42cc-b80a-bc32bfcc6ad8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:19.248197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7040f25-0a93-42cc-b80a-bc32bfcc6ad8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:19.392264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b7040f25-0a93-42cc-b80a-bc32bfcc6ad8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:19.395445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-58452cc9-9695-456e-9ef9-692bfb208fbd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:19.405395 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-58452cc9-9695-456e-9ef9-692bfb208fbd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1282 microversion: 2.1 time: 0.202946 Oct 29 01:18:19.405990 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1651/3485] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:19 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1282 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:19.408467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b7040f25-0a93-42cc-b80a-bc32bfcc6ad8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:19.411406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b7040f25-0a93-42cc-b80a-bc32bfcc6ad8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:19.418801 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b7040f25-0a93-42cc-b80a-bc32bfcc6ad8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1544 microversion: 2.91 time: 0.213949 Oct 29 01:18:19.452046 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1835/3486] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:19 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1544 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:19.499366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e0d0dae-d090-4583-812e-ed2478ee2b36 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:19.500306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7e0d0dae-d090-4583-812e-ed2478ee2b36 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:19.516449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e0d0dae-d090-4583-812e-ed2478ee2b36 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:19.518579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e0d0dae-d090-4583-812e-ed2478ee2b36 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:19.518579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e0d0dae-d090-4583-812e-ed2478ee2b36 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:19.529794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e0d0dae-d090-4583-812e-ed2478ee2b36 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:19.530575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e0d0dae-d090-4583-812e-ed2478ee2b36 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:19.531193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e0d0dae-d090-4583-812e-ed2478ee2b36 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:19.904374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7e0d0dae-d090-4583-812e-ed2478ee2b36 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:19.914835 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e0d0dae-d090-4583-812e-ed2478ee2b36 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 200 len: 1321 microversion: 2.1 time: 0.420704 Oct 29 01:18:19.925734 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1652/3487] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:19 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 1321 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:20.236456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-234daedc-bff5-416b-97a8-6d554fad280c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:20.238030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-234daedc-bff5-416b-97a8-6d554fad280c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:20.249871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-234daedc-bff5-416b-97a8-6d554fad280c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:20.250440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-234daedc-bff5-416b-97a8-6d554fad280c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:20.250879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-234daedc-bff5-416b-97a8-6d554fad280c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:20.251585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-234daedc-bff5-416b-97a8-6d554fad280c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:20.252036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-234daedc-bff5-416b-97a8-6d554fad280c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:20.252490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-234daedc-bff5-416b-97a8-6d554fad280c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:20.433857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ea961cd0-62a3-4891-9157-273a47affd2a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:20.436755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ea961cd0-62a3-4891-9157-273a47affd2a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:20.442869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea961cd0-62a3-4891-9157-273a47affd2a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:20.448114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea961cd0-62a3-4891-9157-273a47affd2a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:20.448664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea961cd0-62a3-4891-9157-273a47affd2a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:20.449540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea961cd0-62a3-4891-9157-273a47affd2a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:20.452776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea961cd0-62a3-4891-9157-273a47affd2a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:20.454031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea961cd0-62a3-4891-9157-273a47affd2a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:20.628749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-234daedc-bff5-416b-97a8-6d554fad280c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:20.641097 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-234daedc-bff5-416b-97a8-6d554fad280c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1497 microversion: 2.1 time: 0.409541 Oct 29 01:18:20.654680 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1836/3488] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:20 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1497 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:20.655057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-411ccf5c-051a-4737-80b7-29babf7c8693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:20.655721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-411ccf5c-051a-4737-80b7-29babf7c8693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:20.674129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-411ccf5c-051a-4737-80b7-29babf7c8693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:20.677679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-411ccf5c-051a-4737-80b7-29babf7c8693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:20.678139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-411ccf5c-051a-4737-80b7-29babf7c8693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:20.678884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-411ccf5c-051a-4737-80b7-29babf7c8693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:20.679339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-411ccf5c-051a-4737-80b7-29babf7c8693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:20.679757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-411ccf5c-051a-4737-80b7-29babf7c8693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:20.808455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-411ccf5c-051a-4737-80b7-29babf7c8693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:20.819651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ea961cd0-62a3-4891-9157-273a47affd2a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:20.840624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-411ccf5c-051a-4737-80b7-29babf7c8693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:20.840834 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ea961cd0-62a3-4891-9157-273a47affd2a tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1324 microversion: 2.1 time: 0.406106 Oct 29 01:18:20.840834 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1653/3489] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:20 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1324 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:20.843936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-411ccf5c-051a-4737-80b7-29babf7c8693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:20.860601 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-411ccf5c-051a-4737-80b7-29babf7c8693 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1484 microversion: 2.91 time: 0.218022 Oct 29 01:18:20.861692 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1837/3490] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:20 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1484 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:20.940388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-26e0d1d2-6baa-4ef4-a63c-bc862520e7cc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:20.941324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-26e0d1d2-6baa-4ef4-a63c-bc862520e7cc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:20.947616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26e0d1d2-6baa-4ef4-a63c-bc862520e7cc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:20.948362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26e0d1d2-6baa-4ef4-a63c-bc862520e7cc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:20.948876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26e0d1d2-6baa-4ef4-a63c-bc862520e7cc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:20.949698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26e0d1d2-6baa-4ef4-a63c-bc862520e7cc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:20.950231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26e0d1d2-6baa-4ef4-a63c-bc862520e7cc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:20.950743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26e0d1d2-6baa-4ef4-a63c-bc862520e7cc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:21.279892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-26e0d1d2-6baa-4ef4-a63c-bc862520e7cc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:21.293254 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-26e0d1d2-6baa-4ef4-a63c-bc862520e7cc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 200 len: 1321 microversion: 2.1 time: 0.352806 Oct 29 01:18:21.308793 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1654/3491] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:20 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:21.651380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-891a861c-1221-47fe-9187-72804fd5b5d4 req-66ee5cd1-b84e-45f4-ab09-b07b3079816b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "727389a1-d4a2-447b-a975-3b353fd2fe82", "tag": "c1a9cc44-f977-4169-baad-e23bbdfed697"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:21.670117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-276414e4-f4d6-4c4d-9d19-6abef5e04fe6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:21.673225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-276414e4-f4d6-4c4d-9d19-6abef5e04fe6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:21.673456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-891a861c-1221-47fe-9187-72804fd5b5d4 req-66ee5cd1-b84e-45f4-ab09-b07b3079816b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:21.674660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-891a861c-1221-47fe-9187-72804fd5b5d4 req-66ee5cd1-b84e-45f4-ab09-b07b3079816b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:21.675615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-891a861c-1221-47fe-9187-72804fd5b5d4 req-66ee5cd1-b84e-45f4-ab09-b07b3079816b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:21.684856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-276414e4-f4d6-4c4d-9d19-6abef5e04fe6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:21.685493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-276414e4-f4d6-4c4d-9d19-6abef5e04fe6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:21.685948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-276414e4-f4d6-4c4d-9d19-6abef5e04fe6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:21.693200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-276414e4-f4d6-4c4d-9d19-6abef5e04fe6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:21.693707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-276414e4-f4d6-4c4d-9d19-6abef5e04fe6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:21.696413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-276414e4-f4d6-4c4d-9d19-6abef5e04fe6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:21.706594 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-891a861c-1221-47fe-9187-72804fd5b5d4 req-66ee5cd1-b84e-45f4-ab09-b07b3079816b service nova] Creating event network-changed:c1a9cc44-f977-4169-baad-e23bbdfed697 for instance 727389a1-d4a2-447b-a975-3b353fd2fe82 on n-h1-862964-3 Oct 29 01:18:21.717603 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-891a861c-1221-47fe-9187-72804fd5b5d4 req-66ee5cd1-b84e-45f4-ab09-b07b3079816b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071747 Oct 29 01:18:21.721523 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1838/3492] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:21.864320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3e303fc3-5e6b-4749-8acc-af12019320bd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:21.865106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3e303fc3-5e6b-4749-8acc-af12019320bd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:21.873524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e303fc3-5e6b-4749-8acc-af12019320bd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:21.874046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e303fc3-5e6b-4749-8acc-af12019320bd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:21.874491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e303fc3-5e6b-4749-8acc-af12019320bd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:21.875191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e303fc3-5e6b-4749-8acc-af12019320bd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:21.875652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e303fc3-5e6b-4749-8acc-af12019320bd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:21.876082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e303fc3-5e6b-4749-8acc-af12019320bd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:21.901647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-276414e4-f4d6-4c4d-9d19-6abef5e04fe6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:21.926855 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-276414e4-f4d6-4c4d-9d19-6abef5e04fe6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1497 microversion: 2.1 time: 0.262759 Oct 29 01:18:21.928733 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1655/3493] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:21 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1497 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:21.935938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8a88c405-04a6-4959-b7b1-8b0cd66c624f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:21.936864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8a88c405-04a6-4959-b7b1-8b0cd66c624f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:21.945431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a88c405-04a6-4959-b7b1-8b0cd66c624f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:21.947413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a88c405-04a6-4959-b7b1-8b0cd66c624f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:21.949786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a88c405-04a6-4959-b7b1-8b0cd66c624f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:21.956492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a88c405-04a6-4959-b7b1-8b0cd66c624f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:21.961141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a88c405-04a6-4959-b7b1-8b0cd66c624f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:21.963611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a88c405-04a6-4959-b7b1-8b0cd66c624f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:22.107627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8a88c405-04a6-4959-b7b1-8b0cd66c624f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:22.123093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8a88c405-04a6-4959-b7b1-8b0cd66c624f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:22.141482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8a88c405-04a6-4959-b7b1-8b0cd66c624f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:22.158772 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8a88c405-04a6-4959-b7b1-8b0cd66c624f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1486 microversion: 2.91 time: 0.228503 Oct 29 01:18:22.175045 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1656/3494] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:21 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1486 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:22.322911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e4edfbb3-dbe6-46f2-bec4-631b6d71c730 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:22.323818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e4edfbb3-dbe6-46f2-bec4-631b6d71c730 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:22.340777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4edfbb3-dbe6-46f2-bec4-631b6d71c730 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:22.341467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4edfbb3-dbe6-46f2-bec4-631b6d71c730 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:22.342132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4edfbb3-dbe6-46f2-bec4-631b6d71c730 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:22.343779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4edfbb3-dbe6-46f2-bec4-631b6d71c730 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:22.345653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4edfbb3-dbe6-46f2-bec4-631b6d71c730 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:22.346221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4edfbb3-dbe6-46f2-bec4-631b6d71c730 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:22.433379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:18:22.808214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3e303fc3-5e6b-4749-8acc-af12019320bd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:22.820677 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3e303fc3-5e6b-4749-8acc-af12019320bd tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1324 microversion: 2.1 time: 0.961933 Oct 29 01:18:22.825358 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1839/3495] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:21 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1324 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:22.954175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-476da068-8bb1-4541-b41e-3c98d2d3ded6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:22.954926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-476da068-8bb1-4541-b41e-3c98d2d3ded6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:22.964665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-476da068-8bb1-4541-b41e-3c98d2d3ded6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:22.970445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-476da068-8bb1-4541-b41e-3c98d2d3ded6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:22.971134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-476da068-8bb1-4541-b41e-3c98d2d3ded6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:22.972425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-476da068-8bb1-4541-b41e-3c98d2d3ded6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:22.973049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-476da068-8bb1-4541-b41e-3c98d2d3ded6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:22.974337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-476da068-8bb1-4541-b41e-3c98d2d3ded6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:23.142567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e4edfbb3-dbe6-46f2-bec4-631b6d71c730 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:23.156843 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e4edfbb3-dbe6-46f2-bec4-631b6d71c730 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 200 len: 1321 microversion: 2.1 time: 0.840810 Oct 29 01:18:23.158233 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1657/3496] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:22 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 1321 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:23.196339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-76234707-7332-499c-bc55-4c055d163555 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:23.198816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-76234707-7332-499c-bc55-4c055d163555 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:23.219317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76234707-7332-499c-bc55-4c055d163555 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:23.221872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76234707-7332-499c-bc55-4c055d163555 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:23.223003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76234707-7332-499c-bc55-4c055d163555 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:23.226588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76234707-7332-499c-bc55-4c055d163555 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:23.227310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76234707-7332-499c-bc55-4c055d163555 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:23.229503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76234707-7332-499c-bc55-4c055d163555 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:23.426753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-76234707-7332-499c-bc55-4c055d163555 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:23.441001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-76234707-7332-499c-bc55-4c055d163555 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:23.442571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-76234707-7332-499c-bc55-4c055d163555 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:23.453953 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-76234707-7332-499c-bc55-4c055d163555 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.265267 Oct 29 01:18:23.455498 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1658/3497] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:23 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:18:23.572295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-476da068-8bb1-4541-b41e-3c98d2d3ded6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:23.595874 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-476da068-8bb1-4541-b41e-3c98d2d3ded6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1497 microversion: 2.1 time: 0.645705 Oct 29 01:18:23.596475 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1840/3498] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:22 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1497 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:23.860646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3527f025-d9c9-42b4-98b6-0b91e8a98bfa tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:23.865528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3527f025-d9c9-42b4-98b6-0b91e8a98bfa tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:23.895625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3527f025-d9c9-42b4-98b6-0b91e8a98bfa tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:23.895923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3527f025-d9c9-42b4-98b6-0b91e8a98bfa tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:23.897660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3527f025-d9c9-42b4-98b6-0b91e8a98bfa tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:23.900666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3527f025-d9c9-42b4-98b6-0b91e8a98bfa tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:23.902909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3527f025-d9c9-42b4-98b6-0b91e8a98bfa tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:23.904176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3527f025-d9c9-42b4-98b6-0b91e8a98bfa tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:23.946217 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:18:24.139781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=26 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:18:24.183182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5be3ba8c-b5b7-4642-9ae9-ccbba71a3b20 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:24.184019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5be3ba8c-b5b7-4642-9ae9-ccbba71a3b20 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:24.193701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5be3ba8c-b5b7-4642-9ae9-ccbba71a3b20 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:24.194493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5be3ba8c-b5b7-4642-9ae9-ccbba71a3b20 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:24.195180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5be3ba8c-b5b7-4642-9ae9-ccbba71a3b20 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:24.197806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5be3ba8c-b5b7-4642-9ae9-ccbba71a3b20 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:24.198726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5be3ba8c-b5b7-4642-9ae9-ccbba71a3b20 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:24.199385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5be3ba8c-b5b7-4642-9ae9-ccbba71a3b20 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:24.315872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3527f025-d9c9-42b4-98b6-0b91e8a98bfa tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:24.375153 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3527f025-d9c9-42b4-98b6-0b91e8a98bfa tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1324 microversion: 2.1 time: 0.531248 Oct 29 01:18:24.402999 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1659/3499] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:23 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1324 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:24.488484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cba36494-0691-4125-92cb-4c156c4bae5e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:24.489501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cba36494-0691-4125-92cb-4c156c4bae5e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:24.507922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cba36494-0691-4125-92cb-4c156c4bae5e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:24.510462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cba36494-0691-4125-92cb-4c156c4bae5e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:24.516555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cba36494-0691-4125-92cb-4c156c4bae5e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:24.517828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cba36494-0691-4125-92cb-4c156c4bae5e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:24.518794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cba36494-0691-4125-92cb-4c156c4bae5e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:24.526346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cba36494-0691-4125-92cb-4c156c4bae5e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:24.580800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5be3ba8c-b5b7-4642-9ae9-ccbba71a3b20 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:24.595917 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5be3ba8c-b5b7-4642-9ae9-ccbba71a3b20 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 200 len: 1321 microversion: 2.1 time: 0.415905 Oct 29 01:18:24.606367 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1841/3500] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:24 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 1321 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:24.621181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-250038ff-aa9c-4035-9a7a-bae88679c62f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:24.622083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-250038ff-aa9c-4035-9a7a-bae88679c62f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:24.633973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-250038ff-aa9c-4035-9a7a-bae88679c62f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:24.640483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-250038ff-aa9c-4035-9a7a-bae88679c62f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:24.640483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-250038ff-aa9c-4035-9a7a-bae88679c62f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:24.640483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-250038ff-aa9c-4035-9a7a-bae88679c62f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:24.641968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-250038ff-aa9c-4035-9a7a-bae88679c62f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:24.642595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-250038ff-aa9c-4035-9a7a-bae88679c62f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:24.734646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cba36494-0691-4125-92cb-4c156c4bae5e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:24.756985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cba36494-0691-4125-92cb-4c156c4bae5e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:24.763769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cba36494-0691-4125-92cb-4c156c4bae5e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:24.775669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:18:24.780848 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cba36494-0691-4125-92cb-4c156c4bae5e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.296248 Oct 29 01:18:24.783704 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1660/3501] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:24 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:24.919047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-250038ff-aa9c-4035-9a7a-bae88679c62f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:24.929238 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-250038ff-aa9c-4035-9a7a-bae88679c62f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1497 microversion: 2.1 time: 0.312758 Oct 29 01:18:24.933268 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1842/3502] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:24 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1497 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:25.409635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b508b903-b7e1-4923-83c6-d2a1798bd13e tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:25.411105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b508b903-b7e1-4923-83c6-d2a1798bd13e tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:25.420062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b508b903-b7e1-4923-83c6-d2a1798bd13e tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:25.423843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b508b903-b7e1-4923-83c6-d2a1798bd13e tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:25.424485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b508b903-b7e1-4923-83c6-d2a1798bd13e tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:25.425513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b508b903-b7e1-4923-83c6-d2a1798bd13e tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:25.426893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b508b903-b7e1-4923-83c6-d2a1798bd13e tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:25.431053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b508b903-b7e1-4923-83c6-d2a1798bd13e tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:25.633277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ee1730f0-0096-4670-9bc3-486d0e0d5763 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:25.635470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ee1730f0-0096-4670-9bc3-486d0e0d5763 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:25.650723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee1730f0-0096-4670-9bc3-486d0e0d5763 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:25.654692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee1730f0-0096-4670-9bc3-486d0e0d5763 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:25.658202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee1730f0-0096-4670-9bc3-486d0e0d5763 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:25.658202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee1730f0-0096-4670-9bc3-486d0e0d5763 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:25.659598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee1730f0-0096-4670-9bc3-486d0e0d5763 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:25.660899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ee1730f0-0096-4670-9bc3-486d0e0d5763 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:25.681465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b508b903-b7e1-4923-83c6-d2a1798bd13e tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:25.691143 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b508b903-b7e1-4923-83c6-d2a1798bd13e tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1324 microversion: 2.1 time: 0.290663 Oct 29 01:18:25.691851 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1661/3503] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:25 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1324 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:25.812013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6567e8fb-cc3a-48a2-b473-ce5504512361 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:25.812625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6567e8fb-cc3a-48a2-b473-ce5504512361 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:25.819815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6567e8fb-cc3a-48a2-b473-ce5504512361 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:25.820428 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6567e8fb-cc3a-48a2-b473-ce5504512361 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:25.820936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6567e8fb-cc3a-48a2-b473-ce5504512361 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:25.821739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6567e8fb-cc3a-48a2-b473-ce5504512361 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:25.822197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6567e8fb-cc3a-48a2-b473-ce5504512361 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:25.822805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6567e8fb-cc3a-48a2-b473-ce5504512361 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:25.928834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6567e8fb-cc3a-48a2-b473-ce5504512361 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:25.938395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6567e8fb-cc3a-48a2-b473-ce5504512361 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:25.941932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6567e8fb-cc3a-48a2-b473-ce5504512361 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:25.945164 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6567e8fb-cc3a-48a2-b473-ce5504512361 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.137098 Oct 29 01:18:25.945773 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1662/3504] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:25 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:25.950801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-f9ae4a6c-a195-4fc5-92bd-7d6e0aee5ba6 req-f55c16e5-0c70-4618-9e72-a09cf6ac993c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2093a86c-3a1a-47ca-825e-1ff9f28dc3b5", "name": "network-vif-plugged", "status": "completed", "tag": "0ae1e3d7-0c43-499b-8e56-f9e463f692d3"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:25.960958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f9ae4a6c-a195-4fc5-92bd-7d6e0aee5ba6 req-f55c16e5-0c70-4618-9e72-a09cf6ac993c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:25.961496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f9ae4a6c-a195-4fc5-92bd-7d6e0aee5ba6 req-f55c16e5-0c70-4618-9e72-a09cf6ac993c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:25.961930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f9ae4a6c-a195-4fc5-92bd-7d6e0aee5ba6 req-f55c16e5-0c70-4618-9e72-a09cf6ac993c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:25.974104 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f9ae4a6c-a195-4fc5-92bd-7d6e0aee5ba6 req-f55c16e5-0c70-4618-9e72-a09cf6ac993c service nova] Creating event network-vif-plugged:0ae1e3d7-0c43-499b-8e56-f9e463f692d3 for instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 on n-h2-862964-3 Oct 29 01:18:25.979966 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-f9ae4a6c-a195-4fc5-92bd-7d6e0aee5ba6 req-f55c16e5-0c70-4618-9e72-a09cf6ac993c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032852 Oct 29 01:18:25.980517 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1663/3505] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:25.984354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ee1730f0-0096-4670-9bc3-486d0e0d5763 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:25.985668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-66b59134-4fa1-4532-909b-42a3d7f078ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:25.986446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-66b59134-4fa1-4532-909b-42a3d7f078ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:25.992877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66b59134-4fa1-4532-909b-42a3d7f078ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:25.998554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66b59134-4fa1-4532-909b-42a3d7f078ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:25.998554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66b59134-4fa1-4532-909b-42a3d7f078ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:25.998554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66b59134-4fa1-4532-909b-42a3d7f078ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:25.998554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66b59134-4fa1-4532-909b-42a3d7f078ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:25.998554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66b59134-4fa1-4532-909b-42a3d7f078ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:26.005830 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ee1730f0-0096-4670-9bc3-486d0e0d5763 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 200 len: 1321 microversion: 2.1 time: 0.379995 Oct 29 01:18:26.017710 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1843/3506] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:25 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 1321 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:26.298196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-66b59134-4fa1-4532-909b-42a3d7f078ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:26.309207 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-66b59134-4fa1-4532-909b-42a3d7f078ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1497 microversion: 2.1 time: 0.327120 Oct 29 01:18:26.311158 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1664/3507] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:25 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1497 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:26.721515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0ec98d85-f14d-46a4-a2a6-18206f4e7432 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:26.722133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0ec98d85-f14d-46a4-a2a6-18206f4e7432 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:26.733717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ec98d85-f14d-46a4-a2a6-18206f4e7432 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:26.735746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ec98d85-f14d-46a4-a2a6-18206f4e7432 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:26.735746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ec98d85-f14d-46a4-a2a6-18206f4e7432 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:26.736146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ec98d85-f14d-46a4-a2a6-18206f4e7432 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:26.736621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ec98d85-f14d-46a4-a2a6-18206f4e7432 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:26.737056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ec98d85-f14d-46a4-a2a6-18206f4e7432 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:26.934683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0ec98d85-f14d-46a4-a2a6-18206f4e7432 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:26.944855 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0ec98d85-f14d-46a4-a2a6-18206f4e7432 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1324 microversion: 2.1 time: 0.229174 Oct 29 01:18:26.958460 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1844/3508] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:26 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1324 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:26.979005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4c096a81-bb54-4075-9877-22a97e7d076c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:26.979698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4c096a81-bb54-4075-9877-22a97e7d076c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:26.997631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c096a81-bb54-4075-9877-22a97e7d076c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:26.999905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c096a81-bb54-4075-9877-22a97e7d076c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:27.000370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c096a81-bb54-4075-9877-22a97e7d076c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:27.002272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c096a81-bb54-4075-9877-22a97e7d076c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:27.004833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c096a81-bb54-4075-9877-22a97e7d076c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:27.005706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c096a81-bb54-4075-9877-22a97e7d076c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:27.027883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-227f2a52-1e38-4a15-a684-ed7683cb5422 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:27.028607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-227f2a52-1e38-4a15-a684-ed7683cb5422 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:27.037542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-227f2a52-1e38-4a15-a684-ed7683cb5422 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:27.040320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-227f2a52-1e38-4a15-a684-ed7683cb5422 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:27.041935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-227f2a52-1e38-4a15-a684-ed7683cb5422 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:27.044476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-227f2a52-1e38-4a15-a684-ed7683cb5422 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:27.045144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-227f2a52-1e38-4a15-a684-ed7683cb5422 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:27.048334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-227f2a52-1e38-4a15-a684-ed7683cb5422 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:27.227299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4c096a81-bb54-4075-9877-22a97e7d076c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:27.236384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4c096a81-bb54-4075-9877-22a97e7d076c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:27.238580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4c096a81-bb54-4075-9877-22a97e7d076c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:27.260603 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4c096a81-bb54-4075-9877-22a97e7d076c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.288150 Oct 29 01:18:27.262258 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1665/3509] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:26 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:27.338914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3801b43f-9c75-4e37-b220-c72b99067990 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:27.339582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3801b43f-9c75-4e37-b220-c72b99067990 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:27.364883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3801b43f-9c75-4e37-b220-c72b99067990 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:27.365416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3801b43f-9c75-4e37-b220-c72b99067990 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:27.367369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3801b43f-9c75-4e37-b220-c72b99067990 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:27.373874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3801b43f-9c75-4e37-b220-c72b99067990 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:27.374380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3801b43f-9c75-4e37-b220-c72b99067990 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:27.374833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3801b43f-9c75-4e37-b220-c72b99067990 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:27.407960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-227f2a52-1e38-4a15-a684-ed7683cb5422 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:27.417802 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-227f2a52-1e38-4a15-a684-ed7683cb5422 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 200 len: 1321 microversion: 2.1 time: 0.393751 Oct 29 01:18:27.423188 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1845/3510] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:27 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:27.703464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3801b43f-9c75-4e37-b220-c72b99067990 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:27.717541 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3801b43f-9c75-4e37-b220-c72b99067990 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1497 microversion: 2.1 time: 0.382446 Oct 29 01:18:27.721243 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1666/3511] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:27 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1497 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:27.971330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd7c5ffa-7249-4fc8-88c4-54d649baf669 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:27.972072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bd7c5ffa-7249-4fc8-88c4-54d649baf669 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:27.981278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd7c5ffa-7249-4fc8-88c4-54d649baf669 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:27.982200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd7c5ffa-7249-4fc8-88c4-54d649baf669 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:27.982891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd7c5ffa-7249-4fc8-88c4-54d649baf669 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:27.983883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd7c5ffa-7249-4fc8-88c4-54d649baf669 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:27.984608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd7c5ffa-7249-4fc8-88c4-54d649baf669 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:27.985404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd7c5ffa-7249-4fc8-88c4-54d649baf669 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:28.244705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bd7c5ffa-7249-4fc8-88c4-54d649baf669 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:28.261612 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bd7c5ffa-7249-4fc8-88c4-54d649baf669 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1324 microversion: 2.1 time: 0.287339 Oct 29 01:18:28.261612 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1846/3512] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:27 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:28.293636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-68e6b3d4-e674-4054-9b1c-3351d0e2b000 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:28.294912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-68e6b3d4-e674-4054-9b1c-3351d0e2b000 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:28.305912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68e6b3d4-e674-4054-9b1c-3351d0e2b000 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:28.305912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68e6b3d4-e674-4054-9b1c-3351d0e2b000 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:28.306718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68e6b3d4-e674-4054-9b1c-3351d0e2b000 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:28.307774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68e6b3d4-e674-4054-9b1c-3351d0e2b000 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:28.308401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68e6b3d4-e674-4054-9b1c-3351d0e2b000 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:28.308987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68e6b3d4-e674-4054-9b1c-3351d0e2b000 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:28.430834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-68e6b3d4-e674-4054-9b1c-3351d0e2b000 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:28.442280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-68e6b3d4-e674-4054-9b1c-3351d0e2b000 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:28.444002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-68e6b3d4-e674-4054-9b1c-3351d0e2b000 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:28.454423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bf3ddc9c-c97e-4cc8-a299-3166b1a0ff1b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:28.454423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bf3ddc9c-c97e-4cc8-a299-3166b1a0ff1b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:28.463959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf3ddc9c-c97e-4cc8-a299-3166b1a0ff1b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:28.465319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf3ddc9c-c97e-4cc8-a299-3166b1a0ff1b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:28.468497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf3ddc9c-c97e-4cc8-a299-3166b1a0ff1b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:28.469450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf3ddc9c-c97e-4cc8-a299-3166b1a0ff1b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:28.470831 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-68e6b3d4-e674-4054-9b1c-3351d0e2b000 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.180695 Oct 29 01:18:28.471295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf3ddc9c-c97e-4cc8-a299-3166b1a0ff1b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:28.472684 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1667/3513] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:28 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:28.473295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf3ddc9c-c97e-4cc8-a299-3166b1a0ff1b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:28.747223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-22441e6f-a00f-4d37-81c0-fdcfa6c07a3b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:28.748005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-22441e6f-a00f-4d37-81c0-fdcfa6c07a3b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:28.760422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bf3ddc9c-c97e-4cc8-a299-3166b1a0ff1b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:28.765124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22441e6f-a00f-4d37-81c0-fdcfa6c07a3b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:28.766699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22441e6f-a00f-4d37-81c0-fdcfa6c07a3b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:28.768211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22441e6f-a00f-4d37-81c0-fdcfa6c07a3b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:28.771329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22441e6f-a00f-4d37-81c0-fdcfa6c07a3b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:28.772288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22441e6f-a00f-4d37-81c0-fdcfa6c07a3b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:28.772950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22441e6f-a00f-4d37-81c0-fdcfa6c07a3b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:28.779813 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bf3ddc9c-c97e-4cc8-a299-3166b1a0ff1b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 200 len: 1502 microversion: 2.1 time: 0.333038 Oct 29 01:18:28.791592 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1847/3514] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:28 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 1502 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:28.810894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4dfeb37b-af73-40b1-af84-73b643cbe588 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:28.814567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4dfeb37b-af73-40b1-af84-73b643cbe588 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:28.837005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4dfeb37b-af73-40b1-af84-73b643cbe588 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:28.842448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4dfeb37b-af73-40b1-af84-73b643cbe588 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:28.842448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4dfeb37b-af73-40b1-af84-73b643cbe588 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:28.842448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4dfeb37b-af73-40b1-af84-73b643cbe588 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:28.842448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4dfeb37b-af73-40b1-af84-73b643cbe588 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:28.844571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4dfeb37b-af73-40b1-af84-73b643cbe588 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:30.068201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4dfeb37b-af73-40b1-af84-73b643cbe588 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:30.079212 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4dfeb37b-af73-40b1-af84-73b643cbe588 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 200 len: 1502 microversion: 2.1 time: 1.273918 Oct 29 01:18:30.094097 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1848/3515] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:28 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 1502 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:30.109324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4f9db380-ba00-4f68-96d5-2398a6b62ada tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:30.110554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4f9db380-ba00-4f68-96d5-2398a6b62ada tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:30.118527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f9db380-ba00-4f68-96d5-2398a6b62ada tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:30.119878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f9db380-ba00-4f68-96d5-2398a6b62ada tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:30.120692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f9db380-ba00-4f68-96d5-2398a6b62ada tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:30.121893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f9db380-ba00-4f68-96d5-2398a6b62ada tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:30.122756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f9db380-ba00-4f68-96d5-2398a6b62ada tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:30.123424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f9db380-ba00-4f68-96d5-2398a6b62ada tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:30.206274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-22441e6f-a00f-4d37-81c0-fdcfa6c07a3b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:30.219174 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-22441e6f-a00f-4d37-81c0-fdcfa6c07a3b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1497 microversion: 2.1 time: 1.477699 Oct 29 01:18:30.220639 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1668/3516] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:28 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1497 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:30.241310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2cbfada0-c899-480b-ae6f-6e24ded892a4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:30.242495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2cbfada0-c899-480b-ae6f-6e24ded892a4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:30.253941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cbfada0-c899-480b-ae6f-6e24ded892a4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:30.254588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cbfada0-c899-480b-ae6f-6e24ded892a4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:30.258869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cbfada0-c899-480b-ae6f-6e24ded892a4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:30.260441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cbfada0-c899-480b-ae6f-6e24ded892a4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:30.261179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cbfada0-c899-480b-ae6f-6e24ded892a4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:30.261885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cbfada0-c899-480b-ae6f-6e24ded892a4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:30.503820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2cbfada0-c899-480b-ae6f-6e24ded892a4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:30.518333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2cbfada0-c899-480b-ae6f-6e24ded892a4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:30.521084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2cbfada0-c899-480b-ae6f-6e24ded892a4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:30.542094 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2cbfada0-c899-480b-ae6f-6e24ded892a4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.319633 Oct 29 01:18:30.543291 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1669/3517] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:30 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:30.548643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d37417f4-bc6e-4099-8321-8279881ebdea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:30.549569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d37417f4-bc6e-4099-8321-8279881ebdea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:30.564481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d37417f4-bc6e-4099-8321-8279881ebdea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:30.565354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d37417f4-bc6e-4099-8321-8279881ebdea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:30.566180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d37417f4-bc6e-4099-8321-8279881ebdea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:30.567138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d37417f4-bc6e-4099-8321-8279881ebdea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:30.567840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d37417f4-bc6e-4099-8321-8279881ebdea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:30.568492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d37417f4-bc6e-4099-8321-8279881ebdea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:30.646904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4f9db380-ba00-4f68-96d5-2398a6b62ada tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:30.660744 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4f9db380-ba00-4f68-96d5-2398a6b62ada tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1324 microversion: 2.1 time: 0.562737 Oct 29 01:18:30.662828 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1849/3518] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:30 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1324 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:30.678019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-7aaab626-4582-4aad-bb94-5ea4ff411c2b req-7c238573-40a6-4cc3-bbc1-5be7e5ef6aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "727389a1-d4a2-447b-a975-3b353fd2fe82", "name": "network-vif-plugged", "status": "completed", "tag": "c1a9cc44-f977-4169-baad-e23bbdfed697"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:30.691660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d37417f4-bc6e-4099-8321-8279881ebdea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:18:30.708183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7aaab626-4582-4aad-bb94-5ea4ff411c2b req-7c238573-40a6-4cc3-bbc1-5be7e5ef6aec service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:30.710394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7aaab626-4582-4aad-bb94-5ea4ff411c2b req-7c238573-40a6-4cc3-bbc1-5be7e5ef6aec service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:30.711090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7aaab626-4582-4aad-bb94-5ea4ff411c2b req-7c238573-40a6-4cc3-bbc1-5be7e5ef6aec service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:30.730473 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-7aaab626-4582-4aad-bb94-5ea4ff411c2b req-7c238573-40a6-4cc3-bbc1-5be7e5ef6aec service nova] Creating event network-vif-plugged:c1a9cc44-f977-4169-baad-e23bbdfed697 for instance 727389a1-d4a2-447b-a975-3b353fd2fe82 on n-h1-862964-3 Oct 29 01:18:30.736769 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-7aaab626-4582-4aad-bb94-5ea4ff411c2b req-7c238573-40a6-4cc3-bbc1-5be7e5ef6aec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067851 Oct 29 01:18:30.738159 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1850/3519] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:31.184060 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d37417f4-bc6e-4099-8321-8279881ebdea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 204 len: 0 microversion: 2.1 time: 0.639240 Oct 29 01:18:31.185425 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1670/3520] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:18:30 2022] DELETE /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:18:31.203213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fb1c93bf-487c-4786-9392-120fae73db7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:31.204126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fb1c93bf-487c-4786-9392-120fae73db7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:31.232725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb1c93bf-487c-4786-9392-120fae73db7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:31.233372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb1c93bf-487c-4786-9392-120fae73db7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:31.233968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb1c93bf-487c-4786-9392-120fae73db7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:31.234912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb1c93bf-487c-4786-9392-120fae73db7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:31.235905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb1c93bf-487c-4786-9392-120fae73db7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:31.240105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb1c93bf-487c-4786-9392-120fae73db7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:31.247578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9cf3a2a9-c9ec-4121-9a6d-53bdd2fd8658 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:31.249051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9cf3a2a9-c9ec-4121-9a6d-53bdd2fd8658 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:31.275989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9cf3a2a9-c9ec-4121-9a6d-53bdd2fd8658 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:31.276509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9cf3a2a9-c9ec-4121-9a6d-53bdd2fd8658 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:31.281383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9cf3a2a9-c9ec-4121-9a6d-53bdd2fd8658 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:31.282419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9cf3a2a9-c9ec-4121-9a6d-53bdd2fd8658 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:31.282904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9cf3a2a9-c9ec-4121-9a6d-53bdd2fd8658 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:31.283497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9cf3a2a9-c9ec-4121-9a6d-53bdd2fd8658 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:31.742146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fb1c93bf-487c-4786-9392-120fae73db7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:31.750873 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fb1c93bf-487c-4786-9392-120fae73db7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 200 len: 1508 microversion: 2.1 time: 0.560611 Oct 29 01:18:31.751550 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1851/3521] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:31 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 1508 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:31.757021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a0723d37-3c38-4e6e-8ffd-6b174b42343f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:31.757918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a0723d37-3c38-4e6e-8ffd-6b174b42343f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:31.770161 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0723d37-3c38-4e6e-8ffd-6b174b42343f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:31.770982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0723d37-3c38-4e6e-8ffd-6b174b42343f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:31.771550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0723d37-3c38-4e6e-8ffd-6b174b42343f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:31.772411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0723d37-3c38-4e6e-8ffd-6b174b42343f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:31.772558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9cf3a2a9-c9ec-4121-9a6d-53bdd2fd8658 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:31.773070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0723d37-3c38-4e6e-8ffd-6b174b42343f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:31.773634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0723d37-3c38-4e6e-8ffd-6b174b42343f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:31.784538 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9cf3a2a9-c9ec-4121-9a6d-53bdd2fd8658 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1497 microversion: 2.1 time: 0.545033 Oct 29 01:18:31.785222 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1671/3522] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:31 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1497 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:31.790009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:18:31.802240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9d53d831-c359-4477-ab76-e5a25def1381 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:31.803261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9d53d831-c359-4477-ab76-e5a25def1381 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:31.817219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d53d831-c359-4477-ab76-e5a25def1381 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:31.820333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d53d831-c359-4477-ab76-e5a25def1381 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:31.821039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d53d831-c359-4477-ab76-e5a25def1381 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:31.822831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d53d831-c359-4477-ab76-e5a25def1381 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:31.826627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d53d831-c359-4477-ab76-e5a25def1381 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:31.827412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d53d831-c359-4477-ab76-e5a25def1381 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:31.970671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a0723d37-3c38-4e6e-8ffd-6b174b42343f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:31.983021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a0723d37-3c38-4e6e-8ffd-6b174b42343f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:31.985398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a0723d37-3c38-4e6e-8ffd-6b174b42343f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:31.999938 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a0723d37-3c38-4e6e-8ffd-6b174b42343f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.243438 Oct 29 01:18:31.999938 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1852/3523] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:31 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:32.160539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9d53d831-c359-4477-ab76-e5a25def1381 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:32.176985 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9d53d831-c359-4477-ab76-e5a25def1381 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1324 microversion: 2.1 time: 0.384904 Oct 29 01:18:32.181469 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1672/3524] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:31 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1324 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:32.785559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b70a9dfb-183e-4de2-b39d-59d1d0a67091 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:32.785559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b70a9dfb-183e-4de2-b39d-59d1d0a67091 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:32.806529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b70a9dfb-183e-4de2-b39d-59d1d0a67091 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:32.808139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b70a9dfb-183e-4de2-b39d-59d1d0a67091 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:32.810950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b70a9dfb-183e-4de2-b39d-59d1d0a67091 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:32.814322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d182c3fa-9930-4774-ac84-12d61a6aa470 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:32.814322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d182c3fa-9930-4774-ac84-12d61a6aa470 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:32.814862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b70a9dfb-183e-4de2-b39d-59d1d0a67091 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:32.814862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b70a9dfb-183e-4de2-b39d-59d1d0a67091 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:32.817750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b70a9dfb-183e-4de2-b39d-59d1d0a67091 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:32.836047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d182c3fa-9930-4774-ac84-12d61a6aa470 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:32.838923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d182c3fa-9930-4774-ac84-12d61a6aa470 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:32.839725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d182c3fa-9930-4774-ac84-12d61a6aa470 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:32.841016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d182c3fa-9930-4774-ac84-12d61a6aa470 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:32.843022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d182c3fa-9930-4774-ac84-12d61a6aa470 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:32.854094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d182c3fa-9930-4774-ac84-12d61a6aa470 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:33.293510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d182c3fa-9930-4774-ac84-12d61a6aa470 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:33.316458 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d182c3fa-9930-4774-ac84-12d61a6aa470 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1497 microversion: 2.1 time: 0.507603 Oct 29 01:18:33.327718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b70a9dfb-183e-4de2-b39d-59d1d0a67091 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:33.329399 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1673/3525] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:32 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1497 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:33.336626 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b70a9dfb-183e-4de2-b39d-59d1d0a67091 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 200 len: 1508 microversion: 2.1 time: 0.562134 Oct 29 01:18:33.339836 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1853/3526] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:32 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 1508 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:33.355692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-50c40eac-7e29-4fe9-935d-51017db5798c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:33.355692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-50c40eac-7e29-4fe9-935d-51017db5798c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:33.360476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50c40eac-7e29-4fe9-935d-51017db5798c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:33.361479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50c40eac-7e29-4fe9-935d-51017db5798c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:33.362174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50c40eac-7e29-4fe9-935d-51017db5798c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:33.363184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50c40eac-7e29-4fe9-935d-51017db5798c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:33.363929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50c40eac-7e29-4fe9-935d-51017db5798c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:33.365797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50c40eac-7e29-4fe9-935d-51017db5798c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:33.396408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-602e3d88-589d-4d30-a47f-1481464644c3 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:33.401602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-602e3d88-589d-4d30-a47f-1481464644c3 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:33.458109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-602e3d88-589d-4d30-a47f-1481464644c3 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:33.459979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-602e3d88-589d-4d30-a47f-1481464644c3 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:33.464183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-602e3d88-589d-4d30-a47f-1481464644c3 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:33.468224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-602e3d88-589d-4d30-a47f-1481464644c3 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:33.471344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-602e3d88-589d-4d30-a47f-1481464644c3 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:33.475243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-602e3d88-589d-4d30-a47f-1481464644c3 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:33.696307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-50c40eac-7e29-4fe9-935d-51017db5798c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:33.710936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-50c40eac-7e29-4fe9-935d-51017db5798c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:33.715328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-50c40eac-7e29-4fe9-935d-51017db5798c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:33.734863 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-50c40eac-7e29-4fe9-935d-51017db5798c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.404004 Oct 29 01:18:33.735649 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1674/3527] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:33 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:34.144278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-602e3d88-589d-4d30-a47f-1481464644c3 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:34.164449 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-602e3d88-589d-4d30-a47f-1481464644c3 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1324 microversion: 2.1 time: 0.798310 Oct 29 01:18:34.166184 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1854/3528] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:33 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1324 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:34.344246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9b59ab38-d254-42e1-b447-a28c3bd1b055 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:34.344960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9b59ab38-d254-42e1-b447-a28c3bd1b055 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:34.360031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b59ab38-d254-42e1-b447-a28c3bd1b055 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:34.360540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b59ab38-d254-42e1-b447-a28c3bd1b055 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:34.361221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b59ab38-d254-42e1-b447-a28c3bd1b055 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:34.362133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b59ab38-d254-42e1-b447-a28c3bd1b055 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:34.364594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b59ab38-d254-42e1-b447-a28c3bd1b055 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:34.365305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b59ab38-d254-42e1-b447-a28c3bd1b055 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:34.376565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-710b68d7-4e54-4d7c-a57f-2c10904fbb5b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:34.377498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-710b68d7-4e54-4d7c-a57f-2c10904fbb5b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:34.393278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-710b68d7-4e54-4d7c-a57f-2c10904fbb5b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:34.395231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-710b68d7-4e54-4d7c-a57f-2c10904fbb5b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:34.396869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-710b68d7-4e54-4d7c-a57f-2c10904fbb5b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:34.402905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-710b68d7-4e54-4d7c-a57f-2c10904fbb5b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:34.405316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:18:34.405804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-710b68d7-4e54-4d7c-a57f-2c10904fbb5b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:34.408178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-710b68d7-4e54-4d7c-a57f-2c10904fbb5b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:34.714301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-710b68d7-4e54-4d7c-a57f-2c10904fbb5b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:34.740547 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-710b68d7-4e54-4d7c-a57f-2c10904fbb5b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 200 len: 1466 microversion: 2.1 time: 0.369874 Oct 29 01:18:34.750340 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1855/3529] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:34 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 1466 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:34.770571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2c81ba62-ae28-4469-8b01-d21d7644ce98 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:34.772144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2c81ba62-ae28-4469-8b01-d21d7644ce98 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:34.798355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c81ba62-ae28-4469-8b01-d21d7644ce98 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:34.799671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c81ba62-ae28-4469-8b01-d21d7644ce98 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:34.800214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c81ba62-ae28-4469-8b01-d21d7644ce98 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:34.804732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c81ba62-ae28-4469-8b01-d21d7644ce98 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:34.810618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c81ba62-ae28-4469-8b01-d21d7644ce98 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:34.811324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c81ba62-ae28-4469-8b01-d21d7644ce98 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:35.099804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9b59ab38-d254-42e1-b447-a28c3bd1b055 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:35.110570 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9b59ab38-d254-42e1-b447-a28c3bd1b055 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1497 microversion: 2.1 time: 0.770684 Oct 29 01:18:35.115878 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1675/3530] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:34 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1497 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:35.131281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-71918bf4-b2ad-4890-ac0d-3cfd97c6640d req-c199af34-a3c8-42a6-a70c-7fb3b240eaad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2093a86c-3a1a-47ca-825e-1ff9f28dc3b5", "name": "network-vif-deleted", "tag": "0ae1e3d7-0c43-499b-8e56-f9e463f692d3"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:35.175937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-71918bf4-b2ad-4890-ac0d-3cfd97c6640d req-c199af34-a3c8-42a6-a70c-7fb3b240eaad service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:35.176423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-71918bf4-b2ad-4890-ac0d-3cfd97c6640d req-c199af34-a3c8-42a6-a70c-7fb3b240eaad service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:35.176879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-71918bf4-b2ad-4890-ac0d-3cfd97c6640d req-c199af34-a3c8-42a6-a70c-7fb3b240eaad service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:35.216718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2c81ba62-ae28-4469-8b01-d21d7644ce98 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:35.223311 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-71918bf4-b2ad-4890-ac0d-3cfd97c6640d req-c199af34-a3c8-42a6-a70c-7fb3b240eaad service nova] Creating event network-vif-deleted:0ae1e3d7-0c43-499b-8e56-f9e463f692d3 for instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 on n-h2-862964-3 Oct 29 01:18:35.238595 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-71918bf4-b2ad-4890-ac0d-3cfd97c6640d req-c199af34-a3c8-42a6-a70c-7fb3b240eaad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118605 Oct 29 01:18:35.242368 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1676/3531] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:35.246073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2c81ba62-ae28-4469-8b01-d21d7644ce98 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:35.247732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2c81ba62-ae28-4469-8b01-d21d7644ce98 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:35.257144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fcdae6ab-59d3-42ff-94e5-b776ecb19ed2 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:35.261140 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fcdae6ab-59d3-42ff-94e5-b776ecb19ed2 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:35.274229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcdae6ab-59d3-42ff-94e5-b776ecb19ed2 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:35.281092 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2c81ba62-ae28-4469-8b01-d21d7644ce98 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.510891 Oct 29 01:18:35.283724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcdae6ab-59d3-42ff-94e5-b776ecb19ed2 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:35.285985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcdae6ab-59d3-42ff-94e5-b776ecb19ed2 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:35.287834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcdae6ab-59d3-42ff-94e5-b776ecb19ed2 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:35.289254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcdae6ab-59d3-42ff-94e5-b776ecb19ed2 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:35.289558 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1856/3532] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:34 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:35.291644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcdae6ab-59d3-42ff-94e5-b776ecb19ed2 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:35.606798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fcdae6ab-59d3-42ff-94e5-b776ecb19ed2 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:35.618532 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fcdae6ab-59d3-42ff-94e5-b776ecb19ed2 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1521 microversion: 2.1 time: 0.373545 Oct 29 01:18:35.621434 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1677/3533] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:35 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:35.649389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9982602f-5090-4cdb-b5e2-e1c8430c38a8 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:35.649389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9982602f-5090-4cdb-b5e2-e1c8430c38a8 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:35.670304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9982602f-5090-4cdb-b5e2-e1c8430c38a8 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:35.675462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9982602f-5090-4cdb-b5e2-e1c8430c38a8 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:35.678156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9982602f-5090-4cdb-b5e2-e1c8430c38a8 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:35.678156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9982602f-5090-4cdb-b5e2-e1c8430c38a8 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:35.678156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9982602f-5090-4cdb-b5e2-e1c8430c38a8 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:35.680179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9982602f-5090-4cdb-b5e2-e1c8430c38a8 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:35.760733 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-9982602f-5090-4cdb-b5e2-e1c8430c38a8 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] HTTP exception thrown: Action 999 not found Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9982602f-5090-4cdb-b5e2-e1c8430c38a8 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Request method failure captured: Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82/os-instance-actions/999 HTTP/1.1 Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH9SLC5hvs0LvLAfQuyGJSwsk7eiVKQtbUhWqrd-196JS3seEgrN3E5E6DdShaTyc3vOl1MMHxLzFsKPihK5TsbUEF6wByCTtGbD6tbwO7ZGs-so-EAouLBCqvQYEkmS05iym3AKtWMEURSWCVM0MvNdbj56HLeytwkrUO--sxeRXMw Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 125dd75e927e40aab0cab8010084f381 Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2058838654 Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/125dd75e927e40aab0cab8010084f381"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/125dd75e927e40aab0cab8010084f381"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/125dd75e927e40aab0cab8010084f381"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_125dd75e927e40aab0cab8010084f381", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2058838654 Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 125dd75e927e40aab0cab8010084f381 Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2058838654 Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-InstanceActionsNegativeTestJSON-2058838654-project Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: afa7e964bc36460687fe8d2152b753b5 Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2058838654-project Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: exception: Action 999 not found Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'server_id': '727389a1-d4a2-447b-a975-3b353fd2fe82', 'id': '999'} Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 29 01:18:35.774553 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:18:35.781800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9982602f-5090-4cdb-b5e2-e1c8430c38a8 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Returning 404 to user: Action 999 not found {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:18:35.781800 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9982602f-5090-4cdb-b5e2-e1c8430c38a8 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.134303 Oct 29 01:18:35.788195 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1857/3534] 10.222.0.26 () {58 vars in 1308 bytes} [Sat Oct 29 01:18:35 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82/os-instance-actions/999 => generated 66 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:18:35.791919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-59343010-a1f2-4500-a397-b253c4ccea61 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:35.793208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-59343010-a1f2-4500-a397-b253c4ccea61 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:35.799697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c6c00efa-9338-42b4-8a8a-7fadfb37ffab tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '.version_select at 0x7f9d9fda5c10>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:35.800688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c6c00efa-9338-42b4-8a8a-7fadfb37ffab tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 8b660d26-724c-4fb6-be4b-313c9ffc3501] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:35.807393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59343010-a1f2-4500-a397-b253c4ccea61 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:35.808243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59343010-a1f2-4500-a397-b253c4ccea61 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:35.809419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59343010-a1f2-4500-a397-b253c4ccea61 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:35.810578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59343010-a1f2-4500-a397-b253c4ccea61 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:35.811427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59343010-a1f2-4500-a397-b253c4ccea61 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:35.812200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59343010-a1f2-4500-a397-b253c4ccea61 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:35.827926 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-c6c00efa-9338-42b4-8a8a-7fadfb37ffab tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] HTTP exception thrown: Instance 8b660d26-724c-4fb6-be4b-313c9ffc3501 could not be found. Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c6c00efa-9338-42b4-8a8a-7fadfb37ffab tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Request method failure captured: Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/8b660d26-724c-4fb6-be4b-313c9ffc3501/os-instance-actions HTTP/1.1 Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH9SLC5hvs0LvLAfQuyGJSwsk7eiVKQtbUhWqrd-196JS3seEgrN3E5E6DdShaTyc3vOl1MMHxLzFsKPihK5TsbUEF6wByCTtGbD6tbwO7ZGs-so-EAouLBCqvQYEkmS05iym3AKtWMEURSWCVM0MvNdbj56HLeytwkrUO--sxeRXMw Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 125dd75e927e40aab0cab8010084f381 Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2058838654 Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/125dd75e927e40aab0cab8010084f381"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/125dd75e927e40aab0cab8010084f381"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/125dd75e927e40aab0cab8010084f381"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_125dd75e927e40aab0cab8010084f381", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2058838654 Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 125dd75e927e40aab0cab8010084f381 Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2058838654 Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-InstanceActionsNegativeTestJSON-2058838654-project Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: afa7e964bc36460687fe8d2152b753b5 Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2058838654-project Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 8b660d26-724c-4fb6-be4b-313c9ffc3501 could not be found. Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'server_id': '8b660d26-724c-4fb6-be4b-313c9ffc3501'} Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b660d26-724c-4fb6-be4b-313c9ffc3501 could not be found. Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:18:35.838307 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:18:35.852598 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b660d26-724c-4fb6-be4b-313c9ffc3501 could not be found. Oct 29 01:18:35.852598 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:18:35.852598 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:18:35.852598 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:18:35.852598 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:18:35.852598 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:18:35.852598 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:18:35.852598 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:18:35.852598 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:18:35.852598 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b660d26-724c-4fb6-be4b-313c9ffc3501 could not be found. Oct 29 01:18:35.852598 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:18:35.852598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c6c00efa-9338-42b4-8a8a-7fadfb37ffab tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Returning 404 to user: Instance 8b660d26-724c-4fb6-be4b-313c9ffc3501 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:18:35.852598 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c6c00efa-9338-42b4-8a8a-7fadfb37ffab tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/8b660d26-724c-4fb6-be4b-313c9ffc3501/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.050540 Oct 29 01:18:35.852598 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1858/3535] 10.222.0.26 () {58 vars in 1296 bytes} [Sat Oct 29 01:18:35 2022] GET /compute/v2.1/servers/8b660d26-724c-4fb6-be4b-313c9ffc3501/os-instance-actions => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:18:35.861416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-66a410a7-05c7-4fb7-b79c-b71f15ecaea9 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:35.863432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-66a410a7-05c7-4fb7-b79c-b71f15ecaea9 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:35.875236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:18:35.877828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66a410a7-05c7-4fb7-b79c-b71f15ecaea9 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:35.878586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66a410a7-05c7-4fb7-b79c-b71f15ecaea9 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:35.879989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66a410a7-05c7-4fb7-b79c-b71f15ecaea9 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:35.881201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66a410a7-05c7-4fb7-b79c-b71f15ecaea9 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:35.882044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66a410a7-05c7-4fb7-b79c-b71f15ecaea9 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:35.883069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66a410a7-05c7-4fb7-b79c-b71f15ecaea9 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:35.905046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59343010-a1f2-4500-a397-b253c4ccea61 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:35.907197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59343010-a1f2-4500-a397-b253c4ccea61 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:35.907813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59343010-a1f2-4500-a397-b253c4ccea61 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:35.910936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-59343010-a1f2-4500-a397-b253c4ccea61 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lazy-loading 'fault' on Instance uuid 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:18:35.919782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-66a410a7-05c7-4fb7-b79c-b71f15ecaea9 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:18:35.988848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-59343010-a1f2-4500-a397-b253c4ccea61 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:36.000951 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-59343010-a1f2-4500-a397-b253c4ccea61 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 200 len: 1311 microversion: 2.1 time: 0.233712 Oct 29 01:18:36.020847 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1678/3536] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:35 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 1311 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:36.142856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0577ade3-e168-482b-a43c-6a45064801db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:36.144584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0577ade3-e168-482b-a43c-6a45064801db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:36.152937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0577ade3-e168-482b-a43c-6a45064801db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:36.153835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0577ade3-e168-482b-a43c-6a45064801db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:36.154489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0577ade3-e168-482b-a43c-6a45064801db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:36.155295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0577ade3-e168-482b-a43c-6a45064801db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:36.155991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0577ade3-e168-482b-a43c-6a45064801db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:36.156586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0577ade3-e168-482b-a43c-6a45064801db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:36.310073 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-66a410a7-05c7-4fb7-b79c-b71f15ecaea9 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "DELETE /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 204 len: 0 microversion: 2.1 time: 0.461743 Oct 29 01:18:36.311132 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1859/3537] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:18:35 2022] DELETE /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:18:36.320251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-073581e5-7fc3-45d0-a22f-abd89bf8375e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:36.323630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-073581e5-7fc3-45d0-a22f-abd89bf8375e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:36.337651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-073581e5-7fc3-45d0-a22f-abd89bf8375e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:36.338331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-073581e5-7fc3-45d0-a22f-abd89bf8375e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:36.338836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-073581e5-7fc3-45d0-a22f-abd89bf8375e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:36.339484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-073581e5-7fc3-45d0-a22f-abd89bf8375e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:36.343176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-073581e5-7fc3-45d0-a22f-abd89bf8375e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:36.344461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-073581e5-7fc3-45d0-a22f-abd89bf8375e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:36.453662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0577ade3-e168-482b-a43c-6a45064801db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:36.465017 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0577ade3-e168-482b-a43c-6a45064801db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 200 len: 1474 microversion: 2.1 time: 0.326419 Oct 29 01:18:36.470102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-073581e5-7fc3-45d0-a22f-abd89bf8375e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:36.475631 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1679/3538] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:36 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 1474 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:36.486288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2d8cce6a-0e7f-4daa-b1c2-2336fff0c360 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:36.486864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2d8cce6a-0e7f-4daa-b1c2-2336fff0c360 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:36.490801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-073581e5-7fc3-45d0-a22f-abd89bf8375e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:36.494458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-073581e5-7fc3-45d0-a22f-abd89bf8375e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:36.508881 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-073581e5-7fc3-45d0-a22f-abd89bf8375e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.196501 Oct 29 01:18:36.510725 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1860/3539] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:36 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:36.516466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a568a878-4de6-463c-b1f1-162d5acb8406 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1442338147"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:36.528523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a568a878-4de6-463c-b1f1-162d5acb8406 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:36.545021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a568a878-4de6-463c-b1f1-162d5acb8406 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:36.545729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a568a878-4de6-463c-b1f1-162d5acb8406 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:36.546618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a568a878-4de6-463c-b1f1-162d5acb8406 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:36.547543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a568a878-4de6-463c-b1f1-162d5acb8406 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:36.548364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a568a878-4de6-463c-b1f1-162d5acb8406 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:36.548948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a568a878-4de6-463c-b1f1-162d5acb8406 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:36.555174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d8cce6a-0e7f-4daa-b1c2-2336fff0c360 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:36.557312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d8cce6a-0e7f-4daa-b1c2-2336fff0c360 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:36.559111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d8cce6a-0e7f-4daa-b1c2-2336fff0c360 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:36.559877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d8cce6a-0e7f-4daa-b1c2-2336fff0c360 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:36.560364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d8cce6a-0e7f-4daa-b1c2-2336fff0c360 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:36.560792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d8cce6a-0e7f-4daa-b1c2-2336fff0c360 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:36.805849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2d8cce6a-0e7f-4daa-b1c2-2336fff0c360 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:36.818859 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2d8cce6a-0e7f-4daa-b1c2-2336fff0c360 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1527 microversion: 2.1 time: 0.341347 Oct 29 01:18:36.819957 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1680/3540] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:36 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1527 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:37.032579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0c8750fc-adb8-4e77-bfc7-fc358e743dd2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:37.033491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0c8750fc-adb8-4e77-bfc7-fc358e743dd2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:37.041313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c8750fc-adb8-4e77-bfc7-fc358e743dd2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:37.042148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c8750fc-adb8-4e77-bfc7-fc358e743dd2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:37.042886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c8750fc-adb8-4e77-bfc7-fc358e743dd2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:37.044033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c8750fc-adb8-4e77-bfc7-fc358e743dd2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:37.045341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c8750fc-adb8-4e77-bfc7-fc358e743dd2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:37.046262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c8750fc-adb8-4e77-bfc7-fc358e743dd2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:37.065231 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-0c8750fc-adb8-4e77-bfc7-fc358e743dd2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 could not be found. Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0c8750fc-adb8-4e77-bfc7-fc358e743dd2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 HTTP/1.1 Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 could not be found. Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '2093a86c-3a1a-47ca-825e-1ff9f28dc3b5'} Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 could not be found. Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 could not be found. Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:18:37.067205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:18:37.073201 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:18:37.073201 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:18:37.073201 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:18:37.073201 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:18:37.073201 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:18:37.073201 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 could not be found. Oct 29 01:18:37.073201 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:18:37.073201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0c8750fc-adb8-4e77-bfc7-fc358e743dd2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:18:37.074405 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0c8750fc-adb8-4e77-bfc7-fc358e743dd2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 404 len: 111 microversion: 2.1 time: 0.050752 Oct 29 01:18:37.075056 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1681/3541] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:37 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:18:37.088992 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a568a878-4de6-463c-b1f1-162d5acb8406 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "POST /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e/action" status: 202 len: 0 microversion: 2.1 time: 0.576084 Oct 29 01:18:37.090425 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1861/3542] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:18:36 2022] POST /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 01:18:37.094086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ac35dc6c-61be-4b74-a4de-242ed18a1adc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Action: 'create', calling method: .version_select at 0x7f9d97c9cca0>, body: {"keypair": {"name": "tempest-key-1002218656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwrAIn9vT1Fcw9DTVvZbi2P9wPqtkvhdgXDgwESVKvJUNAbcXg8Mk02vXnJ+nDc/NNy23QygLTRaTaO+KX/Kze7oBZMYoflhSpuVjLn6YnDqIxZnTvImkmPuskD0HVcVA=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:37.103446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8cc23135-4a3c-4ff5-83e6-e4c48bf04c74 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9fdd20d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:37.111039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-ac35dc6c-61be-4b74-a4de-242ed18a1adc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Getting quotas for project 6dc302f307494a61836f3afb38dccae9. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:18:37.116994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-ac35dc6c-61be-4b74-a4de-242ed18a1adc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Getting quotas for user 6cb8fe33c5d64047ada50f44e01e4faa and project 6dc302f307494a61836f3afb38dccae9. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:18:37.158924 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8cc23135-4a3c-4ff5-83e6-e4c48bf04c74 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 200 len: 1414 microversion: 2.1 time: 0.060922 Oct 29 01:18:37.161185 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1862/3543] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:18:37 2022] GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 1414 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:37.215088 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ac35dc6c-61be-4b74-a4de-242ed18a1adc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.123529 Oct 29 01:18:37.222554 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1682/3544] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:18:37 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:18:37.227043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e5b0a49e-1c3d-4e03-ac10-44fec4351d95 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '.version_select at 0x7f9d96bf6dc0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:37.231741 n-d-862964-3 devstack@n-api.service[121099]: WARNING oslo_db.sqlalchemy.utils [None req-e5b0a49e-1c3d-4e03-ac10-44fec4351d95 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 01:18:37.239184 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e5b0a49e-1c3d-4e03-ac10-44fec4351d95 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.016163 Oct 29 01:18:37.239755 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1863/3545] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:18:37 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:18:37.367826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f90996bb-2901-445b-99c4-f9ce84f0bad6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-456095270", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "key_name": "tempest-key-1002218656", "networks": [{"uuid": "b5b62219-8a2f-42eb-b795-dd5a026e1972"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:37.454949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-f90996bb-2901-445b-99c4-f9ce84f0bad6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] validate_networks() for [('b5b62219-8a2f-42eb-b795-dd5a026e1972', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:18:37.543579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4694b379-ec05-47f2-8950-f67be177c726 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:37.544166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4694b379-ec05-47f2-8950-f67be177c726 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:37.557678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4694b379-ec05-47f2-8950-f67be177c726 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:37.558345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4694b379-ec05-47f2-8950-f67be177c726 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:37.558795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4694b379-ec05-47f2-8950-f67be177c726 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:37.559570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4694b379-ec05-47f2-8950-f67be177c726 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:37.560221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4694b379-ec05-47f2-8950-f67be177c726 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:37.560852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4694b379-ec05-47f2-8950-f67be177c726 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:37.744369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4694b379-ec05-47f2-8950-f67be177c726 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:37.759827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4694b379-ec05-47f2-8950-f67be177c726 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:37.764003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4694b379-ec05-47f2-8950-f67be177c726 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:37.780526 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4694b379-ec05-47f2-8950-f67be177c726 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.239163 Oct 29 01:18:37.782057 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1864/3546] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:37 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:18:37.845781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d7537ab3-2a8d-4269-9b88-9603754d1d39 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:37.846554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d7537ab3-2a8d-4269-9b88-9603754d1d39 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:37.861564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7537ab3-2a8d-4269-9b88-9603754d1d39 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:37.861564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7537ab3-2a8d-4269-9b88-9603754d1d39 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:37.869451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7537ab3-2a8d-4269-9b88-9603754d1d39 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:37.872928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7537ab3-2a8d-4269-9b88-9603754d1d39 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:37.874839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7537ab3-2a8d-4269-9b88-9603754d1d39 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:37.889875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7537ab3-2a8d-4269-9b88-9603754d1d39 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:38.269142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d7537ab3-2a8d-4269-9b88-9603754d1d39 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:38.284501 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d7537ab3-2a8d-4269-9b88-9603754d1d39 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1527 microversion: 2.1 time: 0.443068 Oct 29 01:18:38.306451 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1865/3547] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:37 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1527 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:38.317236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c43caddc-83c2-4deb-917b-92c5a04d213a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9fd93670>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:38.391975 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c43caddc-83c2-4deb-917b-92c5a04d213a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 200 len: 1414 microversion: 2.1 time: 0.083888 Oct 29 01:18:38.392967 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1866/3548] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:18:38 2022] GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:38.501598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f90996bb-2901-445b-99c4-f9ce84f0bad6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:18:38.502695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f90996bb-2901-445b-99c4-f9ce84f0bad6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:18:38.504507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f90996bb-2901-445b-99c4-f9ce84f0bad6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:18:38.507909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f90996bb-2901-445b-99c4-f9ce84f0bad6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:18:38.508535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f90996bb-2901-445b-99c4-f9ce84f0bad6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:18:38.549256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f90996bb-2901-445b-99c4-f9ce84f0bad6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:38.551354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f90996bb-2901-445b-99c4-f9ce84f0bad6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:38.552733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f90996bb-2901-445b-99c4-f9ce84f0bad6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:38.561707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f90996bb-2901-445b-99c4-f9ce84f0bad6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:38.561707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f90996bb-2901-445b-99c4-f9ce84f0bad6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:38.561707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f90996bb-2901-445b-99c4-f9ce84f0bad6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:38.600219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-f90996bb-2901-445b-99c4-f9ce84f0bad6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Getting quotas for project 6dc302f307494a61836f3afb38dccae9. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:18:38.607382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-f90996bb-2901-445b-99c4-f9ce84f0bad6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Getting quotas for user 6cb8fe33c5d64047ada50f44e01e4faa and project 6dc302f307494a61836f3afb38dccae9. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:18:38.625274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f90996bb-2901-445b-99c4-f9ce84f0bad6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:18:38.627949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f90996bb-2901-445b-99c4-f9ce84f0bad6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:18:38.803297 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f90996bb-2901-445b-99c4-f9ce84f0bad6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.444308 Oct 29 01:18:38.817006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b1aba438-5234-4ca2-b584-7c99b3d5b151 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:38.818334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b1aba438-5234-4ca2-b584-7c99b3d5b151 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:38.827190 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1683/3549] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:18:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:18:38.832180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1aba438-5234-4ca2-b584-7c99b3d5b151 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:38.836489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1aba438-5234-4ca2-b584-7c99b3d5b151 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:38.838709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1aba438-5234-4ca2-b584-7c99b3d5b151 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:38.840851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1aba438-5234-4ca2-b584-7c99b3d5b151 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:38.843564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1aba438-5234-4ca2-b584-7c99b3d5b151 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:38.844633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-67186570-2f67-4296-859e-fde08792cf69 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:38.845400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1aba438-5234-4ca2-b584-7c99b3d5b151 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:38.853066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-67186570-2f67-4296-859e-fde08792cf69 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:38.982073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-67186570-2f67-4296-859e-fde08792cf69 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:38.997652 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-67186570-2f67-4296-859e-fde08792cf69 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 200 len: 1228 microversion: 2.1 time: 0.161814 Oct 29 01:18:39.004196 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1684/3550] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:38 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 1228 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:39.052411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b1aba438-5234-4ca2-b584-7c99b3d5b151 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:39.064322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b1aba438-5234-4ca2-b584-7c99b3d5b151 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:39.071004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b1aba438-5234-4ca2-b584-7c99b3d5b151 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:39.077813 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b1aba438-5234-4ca2-b584-7c99b3d5b151 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.264854 Oct 29 01:18:39.078707 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1867/3551] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:38 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:39.315796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ea35bdd5-20b2-4828-98a6-f2f44a2ad3a1 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:39.318905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ea35bdd5-20b2-4828-98a6-f2f44a2ad3a1 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:39.324448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea35bdd5-20b2-4828-98a6-f2f44a2ad3a1 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:39.329772 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea35bdd5-20b2-4828-98a6-f2f44a2ad3a1 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:39.330599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea35bdd5-20b2-4828-98a6-f2f44a2ad3a1 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:39.331593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea35bdd5-20b2-4828-98a6-f2f44a2ad3a1 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:39.344348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea35bdd5-20b2-4828-98a6-f2f44a2ad3a1 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:39.345359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea35bdd5-20b2-4828-98a6-f2f44a2ad3a1 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:39.443859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c54791d9-17c6-424b-9c78-de698f8827cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9fd48e50>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:39.571621 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c54791d9-17c6-424b-9c78-de698f8827cf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 200 len: 1414 microversion: 2.1 time: 0.151357 Oct 29 01:18:39.572531 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1868/3552] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:18:39 2022] GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 1414 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:39.825940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ea35bdd5-20b2-4828-98a6-f2f44a2ad3a1 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:39.837962 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ea35bdd5-20b2-4828-98a6-f2f44a2ad3a1 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1527 microversion: 2.1 time: 0.529101 Oct 29 01:18:39.858688 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1685/3553] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:39 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1527 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:40.030870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0ac0b63e-2257-42cd-83f7-764949c58f40 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:40.030870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0ac0b63e-2257-42cd-83f7-764949c58f40 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:40.113914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1c5939f3-fe74-48af-b1ef-f2ceb86b735c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:40.114998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1c5939f3-fe74-48af-b1ef-f2ceb86b735c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:40.127593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c5939f3-fe74-48af-b1ef-f2ceb86b735c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:40.128500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c5939f3-fe74-48af-b1ef-f2ceb86b735c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:40.132032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c5939f3-fe74-48af-b1ef-f2ceb86b735c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:40.135494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c5939f3-fe74-48af-b1ef-f2ceb86b735c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:40.135965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0ac0b63e-2257-42cd-83f7-764949c58f40 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:40.136498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c5939f3-fe74-48af-b1ef-f2ceb86b735c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:40.137122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c5939f3-fe74-48af-b1ef-f2ceb86b735c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:40.145025 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0ac0b63e-2257-42cd-83f7-764949c58f40 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 200 len: 1228 microversion: 2.1 time: 0.123091 Oct 29 01:18:40.146137 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1869/3554] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:40 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 1228 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:40.591586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e8a27328-28a4-49d6-91a6-4561168df188 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9fd48f70>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:40.642155 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e8a27328-28a4-49d6-91a6-4561168df188 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 200 len: 1414 microversion: 2.1 time: 0.056339 Oct 29 01:18:40.642821 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1870/3555] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:18:40 2022] GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 1414 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:40.850465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1c5939f3-fe74-48af-b1ef-f2ceb86b735c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:40.862402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1c5939f3-fe74-48af-b1ef-f2ceb86b735c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:40.862765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5f293041-5f4d-4792-be94-a5b56e9af220 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:40.863472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5f293041-5f4d-4792-be94-a5b56e9af220 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:40.864525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1c5939f3-fe74-48af-b1ef-f2ceb86b735c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:40.870176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:18:40.870969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f293041-5f4d-4792-be94-a5b56e9af220 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:40.871518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f293041-5f4d-4792-be94-a5b56e9af220 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:40.872019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f293041-5f4d-4792-be94-a5b56e9af220 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:40.872945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f293041-5f4d-4792-be94-a5b56e9af220 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:40.873390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f293041-5f4d-4792-be94-a5b56e9af220 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:40.873961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f293041-5f4d-4792-be94-a5b56e9af220 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:40.875206 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1c5939f3-fe74-48af-b1ef-f2ceb86b735c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.766918 Oct 29 01:18:40.875993 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1686/3556] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:40 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:18:41.173637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-027e4688-f1c3-46a1-b2f5-e0ed1cf25c09 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:41.174665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-027e4688-f1c3-46a1-b2f5-e0ed1cf25c09 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:41.365464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5f293041-5f4d-4792-be94-a5b56e9af220 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:41.374385 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5f293041-5f4d-4792-be94-a5b56e9af220 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1485 microversion: 2.1 time: 0.515791 Oct 29 01:18:41.374979 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1871/3557] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:40 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1485 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:41.439436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-027e4688-f1c3-46a1-b2f5-e0ed1cf25c09 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:41.444222 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-027e4688-f1c3-46a1-b2f5-e0ed1cf25c09 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 200 len: 1228 microversion: 2.1 time: 0.275784 Oct 29 01:18:41.445284 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1687/3558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:41 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 1228 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:41.512026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-0486e8b2-04fb-4c35-befe-accbc40ffb19 req-cc957e77-8a63-4758-8a05-d6cfedc8919f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "727389a1-d4a2-447b-a975-3b353fd2fe82", "name": "network-vif-deleted", "tag": "c1a9cc44-f977-4169-baad-e23bbdfed697"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:41.555047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-0486e8b2-04fb-4c35-befe-accbc40ffb19 req-cc957e77-8a63-4758-8a05-d6cfedc8919f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:41.557839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-0486e8b2-04fb-4c35-befe-accbc40ffb19 req-cc957e77-8a63-4758-8a05-d6cfedc8919f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:41.558355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-0486e8b2-04fb-4c35-befe-accbc40ffb19 req-cc957e77-8a63-4758-8a05-d6cfedc8919f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:41.587003 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-0486e8b2-04fb-4c35-befe-accbc40ffb19 req-cc957e77-8a63-4758-8a05-d6cfedc8919f service nova] Creating event network-vif-deleted:c1a9cc44-f977-4169-baad-e23bbdfed697 for instance 727389a1-d4a2-447b-a975-3b353fd2fe82 on n-h1-862964-3 Oct 29 01:18:41.601051 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-0486e8b2-04fb-4c35-befe-accbc40ffb19 req-cc957e77-8a63-4758-8a05-d6cfedc8919f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097876 Oct 29 01:18:41.608579 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1872/3559] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:41.662706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a44fbac6-0e8e-4bee-8003-5e2e17970847 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9722bc10>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:41.725739 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a44fbac6-0e8e-4bee-8003-5e2e17970847 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 200 len: 1414 microversion: 2.1 time: 0.063222 Oct 29 01:18:41.726778 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1688/3560] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:18:41 2022] GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 1414 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:41.903399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-697752a5-1c7b-4797-8f85-b4815729c379 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:41.904092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-697752a5-1c7b-4797-8f85-b4815729c379 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:41.910327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-697752a5-1c7b-4797-8f85-b4815729c379 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:41.910810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-697752a5-1c7b-4797-8f85-b4815729c379 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:41.911244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-697752a5-1c7b-4797-8f85-b4815729c379 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:41.911941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-697752a5-1c7b-4797-8f85-b4815729c379 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:41.912602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-697752a5-1c7b-4797-8f85-b4815729c379 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:41.913239 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-697752a5-1c7b-4797-8f85-b4815729c379 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:41.937425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:18:41.987536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-697752a5-1c7b-4797-8f85-b4815729c379 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:41.996132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-697752a5-1c7b-4797-8f85-b4815729c379 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:41.997601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-697752a5-1c7b-4797-8f85-b4815729c379 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:42.003825 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-697752a5-1c7b-4797-8f85-b4815729c379 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.105165 Oct 29 01:18:42.005227 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1873/3561] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:41 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:42.399325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e0edbf45-3e41-429d-acc2-fb618a649407 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:42.402514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e0edbf45-3e41-429d-acc2-fb618a649407 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:42.411961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0edbf45-3e41-429d-acc2-fb618a649407 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:42.412448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0edbf45-3e41-429d-acc2-fb618a649407 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:42.413099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0edbf45-3e41-429d-acc2-fb618a649407 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:42.414018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0edbf45-3e41-429d-acc2-fb618a649407 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:42.414786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0edbf45-3e41-429d-acc2-fb618a649407 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:42.416363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0edbf45-3e41-429d-acc2-fb618a649407 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:42.470261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eb81cee6-5249-436b-82b5-35e1c37c59f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:42.472251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eb81cee6-5249-436b-82b5-35e1c37c59f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:42.483022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb81cee6-5249-436b-82b5-35e1c37c59f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:42.483934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb81cee6-5249-436b-82b5-35e1c37c59f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:42.484616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb81cee6-5249-436b-82b5-35e1c37c59f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:42.486133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb81cee6-5249-436b-82b5-35e1c37c59f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:42.486971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb81cee6-5249-436b-82b5-35e1c37c59f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:42.487620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb81cee6-5249-436b-82b5-35e1c37c59f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:42.537295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e0edbf45-3e41-429d-acc2-fb618a649407 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:42.549257 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e0edbf45-3e41-429d-acc2-fb618a649407 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1485 microversion: 2.1 time: 0.154527 Oct 29 01:18:42.550201 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1689/3562] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:42 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1485 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:42.590072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eb81cee6-5249-436b-82b5-35e1c37c59f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:42.601137 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eb81cee6-5249-436b-82b5-35e1c37c59f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 200 len: 1280 microversion: 2.1 time: 0.136262 Oct 29 01:18:42.602383 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1874/3563] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:42 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 1280 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:42.742049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-baf027fc-d6d8-4816-8d3b-e90c39d0bb8f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97dd1550>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:42.795747 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-baf027fc-d6d8-4816-8d3b-e90c39d0bb8f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 200 len: 1414 microversion: 2.1 time: 0.057535 Oct 29 01:18:42.798437 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1690/3564] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:18:42 2022] GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 1414 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:43.034532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8fca263b-66f1-4f4a-b2dc-04e8438251de tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:43.035493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8fca263b-66f1-4f4a-b2dc-04e8438251de tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:43.059629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8fca263b-66f1-4f4a-b2dc-04e8438251de tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:43.062009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8fca263b-66f1-4f4a-b2dc-04e8438251de tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:43.066740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8fca263b-66f1-4f4a-b2dc-04e8438251de tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:43.066740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8fca263b-66f1-4f4a-b2dc-04e8438251de tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:43.066740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8fca263b-66f1-4f4a-b2dc-04e8438251de tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:43.066740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8fca263b-66f1-4f4a-b2dc-04e8438251de tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:43.205902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8fca263b-66f1-4f4a-b2dc-04e8438251de tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:43.216179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8fca263b-66f1-4f4a-b2dc-04e8438251de tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:43.218267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8fca263b-66f1-4f4a-b2dc-04e8438251de tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:43.224761 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8fca263b-66f1-4f4a-b2dc-04e8438251de tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.194172 Oct 29 01:18:43.226140 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1875/3565] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:43 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:43.576801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-518a9563-912e-4543-ab4b-2a0b4936f519 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:43.577827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-518a9563-912e-4543-ab4b-2a0b4936f519 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:43.600879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-518a9563-912e-4543-ab4b-2a0b4936f519 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:43.601415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-518a9563-912e-4543-ab4b-2a0b4936f519 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:43.601856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-518a9563-912e-4543-ab4b-2a0b4936f519 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:43.602583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-518a9563-912e-4543-ab4b-2a0b4936f519 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:43.603661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-518a9563-912e-4543-ab4b-2a0b4936f519 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:43.604148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-518a9563-912e-4543-ab4b-2a0b4936f519 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:43.637311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-df2d1512-e794-48ab-b333-92f06ed538a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:43.637880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-df2d1512-e794-48ab-b333-92f06ed538a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:43.652254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df2d1512-e794-48ab-b333-92f06ed538a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:43.659695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df2d1512-e794-48ab-b333-92f06ed538a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:43.660246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df2d1512-e794-48ab-b333-92f06ed538a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:43.662587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df2d1512-e794-48ab-b333-92f06ed538a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:43.664489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df2d1512-e794-48ab-b333-92f06ed538a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:43.664945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df2d1512-e794-48ab-b333-92f06ed538a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:43.713700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-518a9563-912e-4543-ab4b-2a0b4936f519 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:43.714198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-518a9563-912e-4543-ab4b-2a0b4936f519 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:43.714640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-518a9563-912e-4543-ab4b-2a0b4936f519 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:43.715103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-518a9563-912e-4543-ab4b-2a0b4936f519 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lazy-loading 'fault' on Instance uuid 727389a1-d4a2-447b-a975-3b353fd2fe82 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:18:43.790087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-518a9563-912e-4543-ab4b-2a0b4936f519 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:43.804529 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-518a9563-912e-4543-ab4b-2a0b4936f519 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1314 microversion: 2.1 time: 0.234823 Oct 29 01:18:43.806906 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1691/3566] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:43 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:43.823115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6663173b-5077-464e-ae55-db046bce532e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97cae940>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:43.833019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-df2d1512-e794-48ab-b333-92f06ed538a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:43.851980 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-df2d1512-e794-48ab-b333-92f06ed538a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 200 len: 1286 microversion: 2.1 time: 0.222266 Oct 29 01:18:43.852586 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1876/3567] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:43 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 1286 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:43.907575 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6663173b-5077-464e-ae55-db046bce532e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 200 len: 1414 microversion: 2.1 time: 0.089590 Oct 29 01:18:43.910571 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1692/3568] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:18:43 2022] GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:44.259457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-96c5c10e-759c-47fe-9e6b-b74a6be04ad5 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:44.260050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-96c5c10e-759c-47fe-9e6b-b74a6be04ad5 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:44.272631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96c5c10e-759c-47fe-9e6b-b74a6be04ad5 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:44.273250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96c5c10e-759c-47fe-9e6b-b74a6be04ad5 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:44.277837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96c5c10e-759c-47fe-9e6b-b74a6be04ad5 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:44.277837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96c5c10e-759c-47fe-9e6b-b74a6be04ad5 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:44.278334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96c5c10e-759c-47fe-9e6b-b74a6be04ad5 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:44.278779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96c5c10e-759c-47fe-9e6b-b74a6be04ad5 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:44.418436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-96c5c10e-759c-47fe-9e6b-b74a6be04ad5 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:44.429810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-96c5c10e-759c-47fe-9e6b-b74a6be04ad5 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:44.431405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-96c5c10e-759c-47fe-9e6b-b74a6be04ad5 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:44.437251 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-96c5c10e-759c-47fe-9e6b-b74a6be04ad5 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.181747 Oct 29 01:18:44.476748 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1877/3569] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:44 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:44.553020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-94847aef-485e-4b41-95b6-ed4a36b2de2f req-3a5ea675-1141-4825-ad94-b0b27aa36a86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e5221e-08a3-4b98-a068-1963700c814e", "name": "network-vif-plugged", "status": "completed", "tag": "87ed97e9-c5bc-4a10-91d0-5c4cb8c6d5d6"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:44.579320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-94847aef-485e-4b41-95b6-ed4a36b2de2f req-3a5ea675-1141-4825-ad94-b0b27aa36a86 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:44.581948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-94847aef-485e-4b41-95b6-ed4a36b2de2f req-3a5ea675-1141-4825-ad94-b0b27aa36a86 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:44.582589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-94847aef-485e-4b41-95b6-ed4a36b2de2f req-3a5ea675-1141-4825-ad94-b0b27aa36a86 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:44.607625 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-94847aef-485e-4b41-95b6-ed4a36b2de2f req-3a5ea675-1141-4825-ad94-b0b27aa36a86 service nova] Creating event network-vif-plugged:87ed97e9-c5bc-4a10-91d0-5c4cb8c6d5d6 for instance 60e5221e-08a3-4b98-a068-1963700c814e on n-h1-862964-3 Oct 29 01:18:44.620732 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-94847aef-485e-4b41-95b6-ed4a36b2de2f req-3a5ea675-1141-4825-ad94-b0b27aa36a86 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069355 Oct 29 01:18:44.620732 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1693/3570] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:44.847249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-88195d8e-0579-4400-8beb-3209aa7d2941 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:44.847866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-88195d8e-0579-4400-8beb-3209aa7d2941 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:44.855241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88195d8e-0579-4400-8beb-3209aa7d2941 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:44.861104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88195d8e-0579-4400-8beb-3209aa7d2941 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:44.864558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88195d8e-0579-4400-8beb-3209aa7d2941 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:44.864558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88195d8e-0579-4400-8beb-3209aa7d2941 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:44.864558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88195d8e-0579-4400-8beb-3209aa7d2941 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:44.864558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88195d8e-0579-4400-8beb-3209aa7d2941 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:44.881091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6968f218-87f5-45a9-b268-40aa4996e98c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:44.882456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6968f218-87f5-45a9-b268-40aa4996e98c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:44.895603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6968f218-87f5-45a9-b268-40aa4996e98c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:44.899319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6968f218-87f5-45a9-b268-40aa4996e98c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:44.901028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6968f218-87f5-45a9-b268-40aa4996e98c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:44.902997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6968f218-87f5-45a9-b268-40aa4996e98c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:44.907356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6968f218-87f5-45a9-b268-40aa4996e98c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:44.911766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6968f218-87f5-45a9-b268-40aa4996e98c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:44.975839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88195d8e-0579-4400-8beb-3209aa7d2941 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:44.976335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88195d8e-0579-4400-8beb-3209aa7d2941 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:44.976776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88195d8e-0579-4400-8beb-3209aa7d2941 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:44.977259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-88195d8e-0579-4400-8beb-3209aa7d2941 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lazy-loading 'fault' on Instance uuid 727389a1-d4a2-447b-a975-3b353fd2fe82 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:18:45.081053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-88195d8e-0579-4400-8beb-3209aa7d2941 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:45.097004 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-88195d8e-0579-4400-8beb-3209aa7d2941 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1314 microversion: 2.1 time: 0.254074 Oct 29 01:18:45.106046 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1878/3571] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:44 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:45.115148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3a29d071-f944-4046-af99-1799771cdebb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9fd66280>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:45.197433 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3a29d071-f944-4046-af99-1799771cdebb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 200 len: 1414 microversion: 2.1 time: 0.081649 Oct 29 01:18:45.197674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6968f218-87f5-45a9-b268-40aa4996e98c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:45.197865 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1879/3572] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:18:45 2022] GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 1414 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:45.200885 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6968f218-87f5-45a9-b268-40aa4996e98c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 200 len: 1328 microversion: 2.1 time: 0.325185 Oct 29 01:18:45.203115 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1694/3573] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:44 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 1328 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:45.469615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5a10c6c7-d301-45de-83e5-0188e5a8da08 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:45.470513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5a10c6c7-d301-45de-83e5-0188e5a8da08 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:45.484416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a10c6c7-d301-45de-83e5-0188e5a8da08 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:45.485648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a10c6c7-d301-45de-83e5-0188e5a8da08 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:45.486095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a10c6c7-d301-45de-83e5-0188e5a8da08 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:45.487577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a10c6c7-d301-45de-83e5-0188e5a8da08 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:45.488039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a10c6c7-d301-45de-83e5-0188e5a8da08 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:45.488473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a10c6c7-d301-45de-83e5-0188e5a8da08 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:45.565285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5a10c6c7-d301-45de-83e5-0188e5a8da08 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:45.574401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5a10c6c7-d301-45de-83e5-0188e5a8da08 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:45.576209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5a10c6c7-d301-45de-83e5-0188e5a8da08 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:45.581936 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5a10c6c7-d301-45de-83e5-0188e5a8da08 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.116640 Oct 29 01:18:45.593840 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1880/3574] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:45 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:45.645015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-dbf86b66-bb21-44ad-977d-c7755e32bd85 req-12b7fa86-7394-465a-aed0-dd1911529eed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38d86ca7-7755-4635-a7dc-5764fec864d0", "tag": "e2c060e8-a704-480a-b2c3-71e2da5c0c5d"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:45.660460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-dbf86b66-bb21-44ad-977d-c7755e32bd85 req-12b7fa86-7394-465a-aed0-dd1911529eed service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:45.660930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-dbf86b66-bb21-44ad-977d-c7755e32bd85 req-12b7fa86-7394-465a-aed0-dd1911529eed service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:45.663656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-dbf86b66-bb21-44ad-977d-c7755e32bd85 req-12b7fa86-7394-465a-aed0-dd1911529eed service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:45.678164 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-dbf86b66-bb21-44ad-977d-c7755e32bd85 req-12b7fa86-7394-465a-aed0-dd1911529eed service nova] Creating event network-changed:e2c060e8-a704-480a-b2c3-71e2da5c0c5d for instance 38d86ca7-7755-4635-a7dc-5764fec864d0 on n-h2-862964-3 Oct 29 01:18:45.684126 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-dbf86b66-bb21-44ad-977d-c7755e32bd85 req-12b7fa86-7394-465a-aed0-dd1911529eed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043139 Oct 29 01:18:45.685083 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1695/3575] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:18:46.130628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a56aad45-433a-4346-b990-7eadf044d7f4 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:46.132257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a56aad45-433a-4346-b990-7eadf044d7f4 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:46.141182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a56aad45-433a-4346-b990-7eadf044d7f4 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:46.141913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a56aad45-433a-4346-b990-7eadf044d7f4 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:46.142527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a56aad45-433a-4346-b990-7eadf044d7f4 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:46.143427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a56aad45-433a-4346-b990-7eadf044d7f4 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:46.144055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a56aad45-433a-4346-b990-7eadf044d7f4 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:46.144645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a56aad45-433a-4346-b990-7eadf044d7f4 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:46.182735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a56aad45-433a-4346-b990-7eadf044d7f4 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:46.183616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a56aad45-433a-4346-b990-7eadf044d7f4 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:46.184302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a56aad45-433a-4346-b990-7eadf044d7f4 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:46.184823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-a56aad45-433a-4346-b990-7eadf044d7f4 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lazy-loading 'fault' on Instance uuid 727389a1-d4a2-447b-a975-3b353fd2fe82 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:18:46.214986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cce7e020-efbc-4800-838f-79ff01a7a3bd tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97e5fee0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:46.233907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a56aad45-433a-4346-b990-7eadf044d7f4 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa7e964bc36460687fe8d2152b753b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125dd75e927e40aab0cab8010084f381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:46.245656 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a56aad45-433a-4346-b990-7eadf044d7f4 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 200 len: 1314 microversion: 2.1 time: 0.119651 Oct 29 01:18:46.248063 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1881/3576] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:46 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 1314 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:46.265936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d278eb74-bde0-40b3-a4bc-d7420c41902d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:46.266550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d278eb74-bde0-40b3-a4bc-d7420c41902d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:46.280308 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cce7e020-efbc-4800-838f-79ff01a7a3bd tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 200 len: 1414 microversion: 2.1 time: 0.072802 Oct 29 01:18:46.280898 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1696/3577] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:18:46 2022] GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 1414 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:46.281318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d278eb74-bde0-40b3-a4bc-d7420c41902d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:46.282027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d278eb74-bde0-40b3-a4bc-d7420c41902d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:46.282656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d278eb74-bde0-40b3-a4bc-d7420c41902d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:46.283399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d278eb74-bde0-40b3-a4bc-d7420c41902d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:46.283873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d278eb74-bde0-40b3-a4bc-d7420c41902d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:46.284298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d278eb74-bde0-40b3-a4bc-d7420c41902d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:46.458183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d278eb74-bde0-40b3-a4bc-d7420c41902d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:46.481755 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d278eb74-bde0-40b3-a4bc-d7420c41902d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 200 len: 1328 microversion: 2.1 time: 0.231120 Oct 29 01:18:46.482652 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1882/3578] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:46 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 1328 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:46.611982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-36787cdb-37d0-47af-a1fb-e75814c1e20c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:46.613125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-36787cdb-37d0-47af-a1fb-e75814c1e20c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:46.621601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36787cdb-37d0-47af-a1fb-e75814c1e20c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:46.623253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36787cdb-37d0-47af-a1fb-e75814c1e20c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:46.623946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36787cdb-37d0-47af-a1fb-e75814c1e20c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:46.624896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36787cdb-37d0-47af-a1fb-e75814c1e20c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:46.625598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36787cdb-37d0-47af-a1fb-e75814c1e20c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:46.626731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36787cdb-37d0-47af-a1fb-e75814c1e20c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:46.707766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-36787cdb-37d0-47af-a1fb-e75814c1e20c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:46.718035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-36787cdb-37d0-47af-a1fb-e75814c1e20c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:46.719768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-36787cdb-37d0-47af-a1fb-e75814c1e20c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:46.727209 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-36787cdb-37d0-47af-a1fb-e75814c1e20c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.119493 Oct 29 01:18:46.738896 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1697/3579] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:46 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:47.271321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ef749669-fd63-484d-a62d-905179ce5860 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:47.271913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ef749669-fd63-484d-a62d-905179ce5860 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] [instance: 727389a1-d4a2-447b-a975-3b353fd2fe82] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:47.279509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef749669-fd63-484d-a62d-905179ce5860 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:47.280256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef749669-fd63-484d-a62d-905179ce5860 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:47.281013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef749669-fd63-484d-a62d-905179ce5860 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:47.281728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef749669-fd63-484d-a62d-905179ce5860 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:47.282189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef749669-fd63-484d-a62d-905179ce5860 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:47.284949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef749669-fd63-484d-a62d-905179ce5860 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:47.297066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-af0e1f22-f16d-4c0e-ade9-6a29381e0e67 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9c1c0700>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:47.298967 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-ef749669-fd63-484d-a62d-905179ce5860 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] HTTP exception thrown: Instance 727389a1-d4a2-447b-a975-3b353fd2fe82 could not be found. Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ef749669-fd63-484d-a62d-905179ce5860 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Request method failure captured: Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 HTTP/1.1 Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH9SLC5hvs0LvLAfQuyGJSwsk7eiVKQtbUhWqrd-196JS3seEgrN3E5E6DdShaTyc3vOl1MMHxLzFsKPihK5TsbUEF6wByCTtGbD6tbwO7ZGs-so-EAouLBCqvQYEkmS05iym3AKtWMEURSWCVM0MvNdbj56HLeytwkrUO--sxeRXMw Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 125dd75e927e40aab0cab8010084f381 Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2058838654 Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/125dd75e927e40aab0cab8010084f381"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/125dd75e927e40aab0cab8010084f381"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/125dd75e927e40aab0cab8010084f381"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_125dd75e927e40aab0cab8010084f381", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2058838654 Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 125dd75e927e40aab0cab8010084f381 Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2058838654 Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-InstanceActionsNegativeTestJSON-2058838654-project Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: afa7e964bc36460687fe8d2152b753b5 Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2058838654-project Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 727389a1-d4a2-447b-a975-3b353fd2fe82 could not be found. Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '727389a1-d4a2-447b-a975-3b353fd2fe82'} Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 727389a1-d4a2-447b-a975-3b353fd2fe82 could not be found. Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 727389a1-d4a2-447b-a975-3b353fd2fe82 could not be found. Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:18:47.300868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:18:47.309219 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:18:47.309219 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:18:47.309219 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:18:47.309219 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:18:47.309219 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:18:47.309219 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:18:47.309219 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 727389a1-d4a2-447b-a975-3b353fd2fe82 could not be found. Oct 29 01:18:47.309219 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:18:47.309219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ef749669-fd63-484d-a62d-905179ce5860 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] Returning 404 to user: Instance 727389a1-d4a2-447b-a975-3b353fd2fe82 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:18:47.309219 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ef749669-fd63-484d-a62d-905179ce5860 tempest-InstanceActionsNegativeTestJSON-2058838654 tempest-InstanceActionsNegativeTestJSON-2058838654-project] 10.222.0.26 "GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82" status: 404 len: 111 microversion: 2.1 time: 0.035371 Oct 29 01:18:47.309219 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1883/3580] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:47 2022] GET /compute/v2.1/servers/727389a1-d4a2-447b-a975-3b353fd2fe82 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:18:47.346291 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-af0e1f22-f16d-4c0e-ade9-6a29381e0e67 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 200 len: 1414 microversion: 2.1 time: 0.053204 Oct 29 01:18:47.346864 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1698/3581] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:18:47 2022] GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 1414 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:47.508236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-207c97ac-2382-4813-b56a-e4a6aea93d97 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:47.509813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-207c97ac-2382-4813-b56a-e4a6aea93d97 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:47.519131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-207c97ac-2382-4813-b56a-e4a6aea93d97 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:47.525528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-207c97ac-2382-4813-b56a-e4a6aea93d97 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:47.525528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-207c97ac-2382-4813-b56a-e4a6aea93d97 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:47.525528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-207c97ac-2382-4813-b56a-e4a6aea93d97 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:47.525528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-207c97ac-2382-4813-b56a-e4a6aea93d97 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:47.525528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-207c97ac-2382-4813-b56a-e4a6aea93d97 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:47.693633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-207c97ac-2382-4813-b56a-e4a6aea93d97 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:47.704144 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-207c97ac-2382-4813-b56a-e4a6aea93d97 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 200 len: 1328 microversion: 2.1 time: 0.199994 Oct 29 01:18:47.717523 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1884/3582] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:47 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 1328 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:47.757634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e1ece0a6-2df2-49b1-86ce-3f6276997577 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:47.758256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e1ece0a6-2df2-49b1-86ce-3f6276997577 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:47.772889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1ece0a6-2df2-49b1-86ce-3f6276997577 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:47.773426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1ece0a6-2df2-49b1-86ce-3f6276997577 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:47.773878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1ece0a6-2df2-49b1-86ce-3f6276997577 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:47.775128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1ece0a6-2df2-49b1-86ce-3f6276997577 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:47.777293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1ece0a6-2df2-49b1-86ce-3f6276997577 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:47.777936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1ece0a6-2df2-49b1-86ce-3f6276997577 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:47.851406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e1ece0a6-2df2-49b1-86ce-3f6276997577 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:47.861547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e1ece0a6-2df2-49b1-86ce-3f6276997577 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:47.862995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e1ece0a6-2df2-49b1-86ce-3f6276997577 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:47.868421 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e1ece0a6-2df2-49b1-86ce-3f6276997577 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.114592 Oct 29 01:18:47.869585 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1699/3583] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:47 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:48.368269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0e6e75de-fd81-494d-8885-6666878d5f55 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9fefbe50>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:48.732108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d72af187-1e77-4c3c-b801-c288dff47afd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:48.732737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d72af187-1e77-4c3c-b801-c288dff47afd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:48.735332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:18:48.744898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d72af187-1e77-4c3c-b801-c288dff47afd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:48.752024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d72af187-1e77-4c3c-b801-c288dff47afd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:48.752848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d72af187-1e77-4c3c-b801-c288dff47afd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:48.754691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d72af187-1e77-4c3c-b801-c288dff47afd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:48.757439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d72af187-1e77-4c3c-b801-c288dff47afd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:48.759494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d72af187-1e77-4c3c-b801-c288dff47afd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:49.023916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d72af187-1e77-4c3c-b801-c288dff47afd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:49.040573 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d72af187-1e77-4c3c-b801-c288dff47afd tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 200 len: 1328 microversion: 2.1 time: 0.315660 Oct 29 01:18:49.041921 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1700/3584] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:48 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 1328 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:49.049039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f8299302-f399-42be-977b-9b6889c056ae tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:49.049892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f8299302-f399-42be-977b-9b6889c056ae tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:49.062064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8299302-f399-42be-977b-9b6889c056ae tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:49.062566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8299302-f399-42be-977b-9b6889c056ae tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:49.063013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8299302-f399-42be-977b-9b6889c056ae tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:49.063864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8299302-f399-42be-977b-9b6889c056ae tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:49.064381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8299302-f399-42be-977b-9b6889c056ae tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:49.064864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8299302-f399-42be-977b-9b6889c056ae tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:49.163706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f8299302-f399-42be-977b-9b6889c056ae tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:49.176450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f8299302-f399-42be-977b-9b6889c056ae tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:49.178857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f8299302-f399-42be-977b-9b6889c056ae tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:49.189334 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f8299302-f399-42be-977b-9b6889c056ae tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.145995 Oct 29 01:18:49.190245 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1701/3585] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:49 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:50.071740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f2970855-9634-4ef2-95cc-2d997fecf214 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:50.072715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f2970855-9634-4ef2-95cc-2d997fecf214 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:50.086542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2970855-9634-4ef2-95cc-2d997fecf214 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:50.089263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2970855-9634-4ef2-95cc-2d997fecf214 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:50.090616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2970855-9634-4ef2-95cc-2d997fecf214 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:50.093600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2970855-9634-4ef2-95cc-2d997fecf214 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:50.095419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2970855-9634-4ef2-95cc-2d997fecf214 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:50.095949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2970855-9634-4ef2-95cc-2d997fecf214 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:50.138268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:18:50.140881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:18:50.393185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f2970855-9634-4ef2-95cc-2d997fecf214 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:50.404444 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f2970855-9634-4ef2-95cc-2d997fecf214 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 200 len: 1328 microversion: 2.1 time: 0.341874 Oct 29 01:18:50.405675 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1702/3586] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:50 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 1328 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:50.411034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-97ddc264-85b3-4b59-95ab-c83e552253b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:50.414973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-97ddc264-85b3-4b59-95ab-c83e552253b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:50.418851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97ddc264-85b3-4b59-95ab-c83e552253b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:50.419568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97ddc264-85b3-4b59-95ab-c83e552253b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:50.420504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97ddc264-85b3-4b59-95ab-c83e552253b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:50.421513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97ddc264-85b3-4b59-95ab-c83e552253b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:50.421978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97ddc264-85b3-4b59-95ab-c83e552253b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:50.422410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97ddc264-85b3-4b59-95ab-c83e552253b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:50.507359 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0e6e75de-fd81-494d-8885-6666878d5f55 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 200 len: 1414 microversion: 2.1 time: 2.148430 Oct 29 01:18:50.515076 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1885/3587] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:18:48 2022] GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 1414 bytes in 2157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:50.557137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-97ddc264-85b3-4b59-95ab-c83e552253b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:50.576946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-97ddc264-85b3-4b59-95ab-c83e552253b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:50.581719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-97ddc264-85b3-4b59-95ab-c83e552253b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:50.590976 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-97ddc264-85b3-4b59-95ab-c83e552253b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.184248 Oct 29 01:18:50.629411 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1703/3588] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:50 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:51.428347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-10ee3c7a-7622-496c-a83d-84ebe48de79b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:51.429264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-10ee3c7a-7622-496c-a83d-84ebe48de79b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:51.457249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10ee3c7a-7622-496c-a83d-84ebe48de79b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:51.457950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10ee3c7a-7622-496c-a83d-84ebe48de79b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:51.458605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10ee3c7a-7622-496c-a83d-84ebe48de79b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:51.461727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10ee3c7a-7622-496c-a83d-84ebe48de79b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:51.462595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10ee3c7a-7622-496c-a83d-84ebe48de79b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:51.465295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10ee3c7a-7622-496c-a83d-84ebe48de79b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:51.548837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-18393396-112d-42da-a237-c36dbef7b7f1 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9fd3fee0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:51.560002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=14 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:18:51.877356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-10ee3c7a-7622-496c-a83d-84ebe48de79b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:51.897501 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-10ee3c7a-7622-496c-a83d-84ebe48de79b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 200 len: 1328 microversion: 2.1 time: 0.463553 Oct 29 01:18:51.898372 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1886/3589] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:51 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 1328 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:18:51.916263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2f7c987f-bd6a-4fd9-853b-fa9831a22fbf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:51.922587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2f7c987f-bd6a-4fd9-853b-fa9831a22fbf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:51.941708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f7c987f-bd6a-4fd9-853b-fa9831a22fbf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:51.942225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f7c987f-bd6a-4fd9-853b-fa9831a22fbf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:51.942673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f7c987f-bd6a-4fd9-853b-fa9831a22fbf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:51.943404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f7c987f-bd6a-4fd9-853b-fa9831a22fbf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:51.954186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f7c987f-bd6a-4fd9-853b-fa9831a22fbf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:51.954928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f7c987f-bd6a-4fd9-853b-fa9831a22fbf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:52.126302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f7c987f-bd6a-4fd9-853b-fa9831a22fbf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:52.151912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f7c987f-bd6a-4fd9-853b-fa9831a22fbf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:52.154422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f7c987f-bd6a-4fd9-853b-fa9831a22fbf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:18:52.161290 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2f7c987f-bd6a-4fd9-853b-fa9831a22fbf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1529 microversion: 2.91 time: 0.260998 Oct 29 01:18:52.162331 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1887/3590] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:51 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1529 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:18:52.202171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-95e52d93-11c3-4bb9-9253-93b800f30f79 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:52.203393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-95e52d93-11c3-4bb9-9253-93b800f30f79 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:52.214609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95e52d93-11c3-4bb9-9253-93b800f30f79 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:52.214609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95e52d93-11c3-4bb9-9253-93b800f30f79 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:52.214609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95e52d93-11c3-4bb9-9253-93b800f30f79 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:52.215199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95e52d93-11c3-4bb9-9253-93b800f30f79 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:52.215824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95e52d93-11c3-4bb9-9253-93b800f30f79 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:52.216992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95e52d93-11c3-4bb9-9253-93b800f30f79 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:52.343705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-95e52d93-11c3-4bb9-9253-93b800f30f79 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lazy-loading 'services' on Instance uuid 6e3a11cb-1999-468d-858f-dd5eb0fc275a {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:18:52.372780 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-95e52d93-11c3-4bb9-9253-93b800f30f79 tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1934 microversion: 2.91 time: 0.177411 Oct 29 01:18:52.373976 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1888/3591] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:18:52 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1934 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:18:52.419471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4d3e1b06-bc8c-4ea3-88eb-551f5abb8fa0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:52.420151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4d3e1b06-bc8c-4ea3-88eb-551f5abb8fa0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:52.435550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d3e1b06-bc8c-4ea3-88eb-551f5abb8fa0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:52.436200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d3e1b06-bc8c-4ea3-88eb-551f5abb8fa0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:52.436485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d3e1b06-bc8c-4ea3-88eb-551f5abb8fa0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:52.442134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d3e1b06-bc8c-4ea3-88eb-551f5abb8fa0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:52.447616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d3e1b06-bc8c-4ea3-88eb-551f5abb8fa0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:52.450508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d3e1b06-bc8c-4ea3-88eb-551f5abb8fa0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:52.501731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-4d3e1b06-bc8c-4ea3-88eb-551f5abb8fa0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lazy-loading 'flavor' on Instance uuid 6e3a11cb-1999-468d-858f-dd5eb0fc275a {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:18:52.946161 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:18:59.716953 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-18393396-112d-42da-a237-c36dbef7b7f1 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 200 len: 1414 microversion: 2.1 time: 8.190518 Oct 29 01:18:59.719028 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1704/3592] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:18:51 2022] GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 1414 bytes in 8194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:18:59.724899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-9961e8c7-2692-4f49-b4d1-f005d4e32bfa req-5e6eb446-f889-4555-a70c-3026d6d49211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d86ca7-7755-4635-a7dc-5764fec864d0", "name": "network-vif-plugged", "status": "completed", "tag": "e2c060e8-a704-480a-b2c3-71e2da5c0c5d"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:18:59.736662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9961e8c7-2692-4f49-b4d1-f005d4e32bfa req-5e6eb446-f889-4555-a70c-3026d6d49211 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:59.737514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9961e8c7-2692-4f49-b4d1-f005d4e32bfa req-5e6eb446-f889-4555-a70c-3026d6d49211 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:59.738446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9961e8c7-2692-4f49-b4d1-f005d4e32bfa req-5e6eb446-f889-4555-a70c-3026d6d49211 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:59.756150 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-9961e8c7-2692-4f49-b4d1-f005d4e32bfa req-5e6eb446-f889-4555-a70c-3026d6d49211 service nova] Creating event network-vif-plugged:e2c060e8-a704-480a-b2c3-71e2da5c0c5d for instance 38d86ca7-7755-4635-a7dc-5764fec864d0 on n-h2-862964-3 Oct 29 01:18:59.762658 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-9961e8c7-2692-4f49-b4d1-f005d4e32bfa req-5e6eb446-f889-4555-a70c-3026d6d49211 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041814 Oct 29 01:18:59.763930 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1705/3593] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:18:59.772838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ce176295-31c0-4dbd-949c-d3b470eef603 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:18:59.774915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ce176295-31c0-4dbd-949c-d3b470eef603 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:18:59.782770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce176295-31c0-4dbd-949c-d3b470eef603 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:59.783630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce176295-31c0-4dbd-949c-d3b470eef603 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:59.784351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce176295-31c0-4dbd-949c-d3b470eef603 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:59.785311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce176295-31c0-4dbd-949c-d3b470eef603 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:18:59.785969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce176295-31c0-4dbd-949c-d3b470eef603 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:18:59.786687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce176295-31c0-4dbd-949c-d3b470eef603 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:18:59.971209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ce176295-31c0-4dbd-949c-d3b470eef603 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:00.176820 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ce176295-31c0-4dbd-949c-d3b470eef603 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 200 len: 1328 microversion: 2.1 time: 0.214529 Oct 29 01:19:00.176820 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1706/3594] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:18:59 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 1328 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:00.176820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-24ea9676-c812-447c-a9b7-c626ef197f2a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:00.176820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-24ea9676-c812-447c-a9b7-c626ef197f2a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:00.176820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24ea9676-c812-447c-a9b7-c626ef197f2a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:00.176820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24ea9676-c812-447c-a9b7-c626ef197f2a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:00.176820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24ea9676-c812-447c-a9b7-c626ef197f2a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:00.176820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24ea9676-c812-447c-a9b7-c626ef197f2a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:00.176820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24ea9676-c812-447c-a9b7-c626ef197f2a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:00.176820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24ea9676-c812-447c-a9b7-c626ef197f2a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:00.176820 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-24ea9676-c812-447c-a9b7-c626ef197f2a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3/ips" status: 200 len: 145 microversion: 2.1 time: 0.066195 Oct 29 01:19:00.176820 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1707/3595] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 29 01:18:59 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3/ips => generated 145 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:00.302766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6e18500a-324b-4562-9d2c-29e7570f5792 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-610906162", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": "none"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:00.343221 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4d3e1b06-bc8c-4ea3-88eb-551f5abb8fa0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "POST /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a/action" status: 202 len: 0 microversion: 2.91 time: 7.938040 Oct 29 01:19:00.344460 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1889/3596] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 29 01:18:52 2022] POST /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a/action => generated 0 bytes in 7940 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:19:00.357994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f759ce5c-131a-4189-ba9f-68db6c6417fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:00.359183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f759ce5c-131a-4189-ba9f-68db6c6417fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:00.366513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f759ce5c-131a-4189-ba9f-68db6c6417fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:00.367328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f759ce5c-131a-4189-ba9f-68db6c6417fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:00.370027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f759ce5c-131a-4189-ba9f-68db6c6417fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:00.370027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f759ce5c-131a-4189-ba9f-68db6c6417fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:00.370425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f759ce5c-131a-4189-ba9f-68db6c6417fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:00.371102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f759ce5c-131a-4189-ba9f-68db6c6417fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:00.467711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f759ce5c-131a-4189-ba9f-68db6c6417fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:00.486691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f759ce5c-131a-4189-ba9f-68db6c6417fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:00.491067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f759ce5c-131a-4189-ba9f-68db6c6417fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:00.500241 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f759ce5c-131a-4189-ba9f-68db6c6417fc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.149848 Oct 29 01:19:00.501488 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1890/3597] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:00 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:00.711292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-6e18500a-324b-4562-9d2c-29e7570f5792 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:19:00.713216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-6e18500a-324b-4562-9d2c-29e7570f5792 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:19:00.714068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-6e18500a-324b-4562-9d2c-29e7570f5792 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:19:00.714761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-6e18500a-324b-4562-9d2c-29e7570f5792 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:19:00.715432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-6e18500a-324b-4562-9d2c-29e7570f5792 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:19:00.732227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e18500a-324b-4562-9d2c-29e7570f5792 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:00.733679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aa8eed11-1164-4334-9b13-9d3a6515b567 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9fe61670>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:00.733826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e18500a-324b-4562-9d2c-29e7570f5792 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:00.734679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e18500a-324b-4562-9d2c-29e7570f5792 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:00.735689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e18500a-324b-4562-9d2c-29e7570f5792 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:00.736988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e18500a-324b-4562-9d2c-29e7570f5792 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:00.737913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e18500a-324b-4562-9d2c-29e7570f5792 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:00.766038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-6e18500a-324b-4562-9d2c-29e7570f5792 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Getting quotas for project ce34f5642ee1421794b33c617b98b8fc. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:19:00.773640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-6e18500a-324b-4562-9d2c-29e7570f5792 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Getting quotas for user c6953aa583464efdaa5e473f7295b934 and project ce34f5642ee1421794b33c617b98b8fc. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:19:00.795841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6e18500a-324b-4562-9d2c-29e7570f5792 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:19:00.798726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6e18500a-324b-4562-9d2c-29e7570f5792 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:19:00.944323 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6e18500a-324b-4562-9d2c-29e7570f5792 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.891555 Oct 29 01:19:00.945724 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1708/3598] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 29 01:19:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 01:19:00.955236 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aa8eed11-1164-4334-9b13-9d3a6515b567 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 200 len: 1414 microversion: 2.1 time: 0.225329 Oct 29 01:19:00.955834 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1891/3599] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:00 2022] GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 1414 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:00.962953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-567161da-aa72-43b4-bd20-2148e45209a6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:00.963820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-567161da-aa72-43b4-bd20-2148e45209a6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:01.061488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-567161da-aa72-43b4-bd20-2148e45209a6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:01.075207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-567161da-aa72-43b4-bd20-2148e45209a6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:01.089504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-567161da-aa72-43b4-bd20-2148e45209a6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:01.089504 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-567161da-aa72-43b4-bd20-2148e45209a6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1277 microversion: 2.57 time: 0.126208 Oct 29 01:19:01.089504 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1709/3600] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:00 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1277 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:01.210603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4db29075-b364-429b-9255-f7cd99a616e6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:01.210603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4db29075-b364-429b-9255-f7cd99a616e6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:01.229470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4db29075-b364-429b-9255-f7cd99a616e6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:01.234661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4db29075-b364-429b-9255-f7cd99a616e6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:01.240789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4db29075-b364-429b-9255-f7cd99a616e6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:01.240789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4db29075-b364-429b-9255-f7cd99a616e6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:01.240789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4db29075-b364-429b-9255-f7cd99a616e6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:01.240789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4db29075-b364-429b-9255-f7cd99a616e6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:01.465777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4db29075-b364-429b-9255-f7cd99a616e6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:01.476370 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4db29075-b364-429b-9255-f7cd99a616e6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 200 len: 1328 microversion: 2.1 time: 0.283129 Oct 29 01:19:01.478833 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1892/3601] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:01 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 1328 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:01.538824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-15613101-2d33-477f-aba1-957f09be315a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:01.539587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-15613101-2d33-477f-aba1-957f09be315a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:01.548094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15613101-2d33-477f-aba1-957f09be315a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:01.548588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15613101-2d33-477f-aba1-957f09be315a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:01.549032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15613101-2d33-477f-aba1-957f09be315a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:01.549857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15613101-2d33-477f-aba1-957f09be315a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:01.550300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15613101-2d33-477f-aba1-957f09be315a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:01.550757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15613101-2d33-477f-aba1-957f09be315a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:01.652978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-15613101-2d33-477f-aba1-957f09be315a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:01.664909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-15613101-2d33-477f-aba1-957f09be315a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:01.666758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-15613101-2d33-477f-aba1-957f09be315a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:01.692781 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-15613101-2d33-477f-aba1-957f09be315a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.157699 Oct 29 01:19:01.695597 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1710/3602] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:01 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:01.975269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2f483ce5-fafe-435e-9c48-6034b3b0d4fc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9716a8b0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:02.062757 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2f483ce5-fafe-435e-9c48-6034b3b0d4fc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 200 len: 1414 microversion: 2.1 time: 0.091499 Oct 29 01:19:02.066648 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1893/3603] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:01 2022] GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:02.115964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-57e2dca4-ae66-49db-8174-c3fd9c2b0c53 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:02.116579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-57e2dca4-ae66-49db-8174-c3fd9c2b0c53 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:02.203736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-57e2dca4-ae66-49db-8174-c3fd9c2b0c53 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:02.218984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-57e2dca4-ae66-49db-8174-c3fd9c2b0c53 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:02.221481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-57e2dca4-ae66-49db-8174-c3fd9c2b0c53 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:02.224395 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-57e2dca4-ae66-49db-8174-c3fd9c2b0c53 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1277 microversion: 2.57 time: 0.115215 Oct 29 01:19:02.250068 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1711/3604] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:02 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1277 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:02.518017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d48b2ee6-d255-4fc0-8044-36c05f801d4a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:02.519655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d48b2ee6-d255-4fc0-8044-36c05f801d4a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:02.537767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d48b2ee6-d255-4fc0-8044-36c05f801d4a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:02.543020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d48b2ee6-d255-4fc0-8044-36c05f801d4a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:02.543674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d48b2ee6-d255-4fc0-8044-36c05f801d4a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:02.544688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d48b2ee6-d255-4fc0-8044-36c05f801d4a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:02.545409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d48b2ee6-d255-4fc0-8044-36c05f801d4a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:02.546472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d48b2ee6-d255-4fc0-8044-36c05f801d4a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:02.731557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b38a0e89-3452-4edf-a58f-82a587394f0f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:02.732283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b38a0e89-3452-4edf-a58f-82a587394f0f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:02.747378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b38a0e89-3452-4edf-a58f-82a587394f0f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:02.748152 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b38a0e89-3452-4edf-a58f-82a587394f0f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:02.748768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b38a0e89-3452-4edf-a58f-82a587394f0f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:02.749739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b38a0e89-3452-4edf-a58f-82a587394f0f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:02.751737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b38a0e89-3452-4edf-a58f-82a587394f0f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:02.759108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b38a0e89-3452-4edf-a58f-82a587394f0f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:02.928788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d48b2ee6-d255-4fc0-8044-36c05f801d4a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:02.973058 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b38a0e89-3452-4edf-a58f-82a587394f0f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:02.984715 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d48b2ee6-d255-4fc0-8044-36c05f801d4a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 200 len: 1509 microversion: 2.1 time: 0.481313 Oct 29 01:19:02.992387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b38a0e89-3452-4edf-a58f-82a587394f0f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:03.004022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b38a0e89-3452-4edf-a58f-82a587394f0f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:03.014790 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b38a0e89-3452-4edf-a58f-82a587394f0f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.292257 Oct 29 01:19:03.036774 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1894/3606] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:02 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 1509 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:03.049191 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1712/3606] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:02 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:03.103067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f362d22a-cf96-48e7-ab78-9d3c256bb495 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97c9cca0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:03.128276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-abfe9730-ccfe-4433-a487-4b0aaf714a40 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:03.135978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-abfe9730-ccfe-4433-a487-4b0aaf714a40 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:03.179378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abfe9730-ccfe-4433-a487-4b0aaf714a40 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:03.180041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abfe9730-ccfe-4433-a487-4b0aaf714a40 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:03.181488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abfe9730-ccfe-4433-a487-4b0aaf714a40 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:03.190864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abfe9730-ccfe-4433-a487-4b0aaf714a40 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:03.193045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abfe9730-ccfe-4433-a487-4b0aaf714a40 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:03.193656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abfe9730-ccfe-4433-a487-4b0aaf714a40 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:03.202835 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f362d22a-cf96-48e7-ab78-9d3c256bb495 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 200 len: 1414 microversion: 2.1 time: 0.095119 Oct 29 01:19:03.376775 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1713/3607] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:03 2022] GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:03.376775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-76fcac63-f514-4098-9ffc-27019e10351f tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:03.376775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-76fcac63-f514-4098-9ffc-27019e10351f tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:03.376775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76fcac63-f514-4098-9ffc-27019e10351f tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:03.376775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76fcac63-f514-4098-9ffc-27019e10351f tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:03.376775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76fcac63-f514-4098-9ffc-27019e10351f tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:03.376775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76fcac63-f514-4098-9ffc-27019e10351f tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:03.376775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76fcac63-f514-4098-9ffc-27019e10351f tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:03.376775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76fcac63-f514-4098-9ffc-27019e10351f tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:03.406026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-76fcac63-f514-4098-9ffc-27019e10351f tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:03.417898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-76fcac63-f514-4098-9ffc-27019e10351f tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:03.423175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-76fcac63-f514-4098-9ffc-27019e10351f tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:03.424971 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-76fcac63-f514-4098-9ffc-27019e10351f tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1281 microversion: 2.57 time: 0.174149 Oct 29 01:19:03.426748 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1714/3608] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:03 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1281 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:03.491470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-abfe9730-ccfe-4433-a487-4b0aaf714a40 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:03.502485 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-abfe9730-ccfe-4433-a487-4b0aaf714a40 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 200 len: 1509 microversion: 2.1 time: 0.442499 Oct 29 01:19:03.504548 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1895/3609] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:03 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 1509 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:03.544603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b8a6dfbb-158b-4058-befc-fd49030742e7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:03.545664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b8a6dfbb-158b-4058-befc-fd49030742e7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:03.557246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8a6dfbb-158b-4058-befc-fd49030742e7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:03.557735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8a6dfbb-158b-4058-befc-fd49030742e7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:03.558378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8a6dfbb-158b-4058-befc-fd49030742e7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:03.559270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8a6dfbb-158b-4058-befc-fd49030742e7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:03.559894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8a6dfbb-158b-4058-befc-fd49030742e7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:03.560484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8a6dfbb-158b-4058-befc-fd49030742e7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:03.646500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b8a6dfbb-158b-4058-befc-fd49030742e7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:19:04.094433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-418a08f1-9d34-427b-8153-98e0ff36df1e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:04.098052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-418a08f1-9d34-427b-8153-98e0ff36df1e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:04.106410 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b8a6dfbb-158b-4058-befc-fd49030742e7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 204 len: 0 microversion: 2.1 time: 0.569796 Oct 29 01:19:04.110564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-418a08f1-9d34-427b-8153-98e0ff36df1e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:04.110709 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1715/3610] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:19:03 2022] DELETE /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:19:04.110826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-418a08f1-9d34-427b-8153-98e0ff36df1e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:04.110826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-418a08f1-9d34-427b-8153-98e0ff36df1e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:04.110826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-418a08f1-9d34-427b-8153-98e0ff36df1e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:04.110826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-418a08f1-9d34-427b-8153-98e0ff36df1e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:04.110826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-418a08f1-9d34-427b-8153-98e0ff36df1e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:04.119659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5475cc23-6755-4d07-8f6e-e5d1e834f189 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:04.123102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5475cc23-6755-4d07-8f6e-e5d1e834f189 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:04.133467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5475cc23-6755-4d07-8f6e-e5d1e834f189 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:04.133467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5475cc23-6755-4d07-8f6e-e5d1e834f189 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:04.133467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5475cc23-6755-4d07-8f6e-e5d1e834f189 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:04.133467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5475cc23-6755-4d07-8f6e-e5d1e834f189 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:04.133467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5475cc23-6755-4d07-8f6e-e5d1e834f189 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:04.133467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5475cc23-6755-4d07-8f6e-e5d1e834f189 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:04.306821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-418a08f1-9d34-427b-8153-98e0ff36df1e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:04.328631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-418a08f1-9d34-427b-8153-98e0ff36df1e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:04.330173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-418a08f1-9d34-427b-8153-98e0ff36df1e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:04.355538 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-418a08f1-9d34-427b-8153-98e0ff36df1e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.264911 Oct 29 01:19:04.358952 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1896/3611] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:04 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:04.388745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5cd5590e-0a2d-448d-87ae-28bea505cd55 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9fdc73a0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:04.426424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5475cc23-6755-4d07-8f6e-e5d1e834f189 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:04.437385 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5475cc23-6755-4d07-8f6e-e5d1e834f189 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 200 len: 1515 microversion: 2.1 time: 0.325247 Oct 29 01:19:04.447832 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1716/3612] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:04 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 1515 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:04.463091 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5cd5590e-0a2d-448d-87ae-28bea505cd55 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 200 len: 1414 microversion: 2.1 time: 0.078099 Oct 29 01:19:04.465510 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1897/3613] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:04 2022] GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 1414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:04.467327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a4a21578-0c1e-486a-9b42-ae4b67061ec4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:04.468412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a4a21578-0c1e-486a-9b42-ae4b67061ec4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:04.475997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4a21578-0c1e-486a-9b42-ae4b67061ec4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:04.476641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4a21578-0c1e-486a-9b42-ae4b67061ec4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:04.477089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4a21578-0c1e-486a-9b42-ae4b67061ec4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:04.478818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4a21578-0c1e-486a-9b42-ae4b67061ec4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:04.479297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4a21578-0c1e-486a-9b42-ae4b67061ec4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:04.479731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4a21578-0c1e-486a-9b42-ae4b67061ec4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:04.573492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a4a21578-0c1e-486a-9b42-ae4b67061ec4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:04.581809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a4a21578-0c1e-486a-9b42-ae4b67061ec4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:04.583323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a4a21578-0c1e-486a-9b42-ae4b67061ec4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:04.584456 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a4a21578-0c1e-486a-9b42-ae4b67061ec4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1329 microversion: 2.57 time: 0.131093 Oct 29 01:19:04.585031 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1717/3614] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:04 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1329 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:05.049692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b81145e5-8398-435b-9a14-46b13608ac53 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97f17705-1bd1-43ad-a5f1-ac06d3399f80"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:05.053057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b81145e5-8398-435b-9a14-46b13608ac53 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:05.059500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b81145e5-8398-435b-9a14-46b13608ac53 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:05.060090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b81145e5-8398-435b-9a14-46b13608ac53 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:05.060609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b81145e5-8398-435b-9a14-46b13608ac53 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:05.061412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b81145e5-8398-435b-9a14-46b13608ac53 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:05.062104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b81145e5-8398-435b-9a14-46b13608ac53 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:05.062615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b81145e5-8398-435b-9a14-46b13608ac53 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:05.387769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9a9e9cee-566d-4fb6-bded-acbf115fdf03 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:05.388491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9a9e9cee-566d-4fb6-bded-acbf115fdf03 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:05.395754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a9e9cee-566d-4fb6-bded-acbf115fdf03 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:05.396372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a9e9cee-566d-4fb6-bded-acbf115fdf03 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:05.396913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a9e9cee-566d-4fb6-bded-acbf115fdf03 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:05.397771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a9e9cee-566d-4fb6-bded-acbf115fdf03 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:05.398579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a9e9cee-566d-4fb6-bded-acbf115fdf03 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:05.399321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a9e9cee-566d-4fb6-bded-acbf115fdf03 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:05.485341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9a9e9cee-566d-4fb6-bded-acbf115fdf03 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:05.495705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9a9e9cee-566d-4fb6-bded-acbf115fdf03 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:05.497195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9a9e9cee-566d-4fb6-bded-acbf115fdf03 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:05.502520 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9a9e9cee-566d-4fb6-bded-acbf115fdf03 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.119716 Oct 29 01:19:05.503121 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1718/3615] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:05 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:05.508202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-19e64265-71d3-4a38-9e69-7365466ec949 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:05.508202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-19e64265-71d3-4a38-9e69-7365466ec949 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:05.514961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19e64265-71d3-4a38-9e69-7365466ec949 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:05.515671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19e64265-71d3-4a38-9e69-7365466ec949 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:05.516313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19e64265-71d3-4a38-9e69-7365466ec949 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:05.517276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19e64265-71d3-4a38-9e69-7365466ec949 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:05.517901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19e64265-71d3-4a38-9e69-7365466ec949 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:05.518501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19e64265-71d3-4a38-9e69-7365466ec949 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:05.712427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-19e64265-71d3-4a38-9e69-7365466ec949 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:05.720819 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-19e64265-71d3-4a38-9e69-7365466ec949 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 200 len: 1515 microversion: 2.1 time: 0.216662 Oct 29 01:19:05.721647 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1719/3616] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:05 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 1515 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:05.726354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c5a23b3d-523b-4d43-a3aa-67ced941fc52 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97a9e160>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:05.784578 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c5a23b3d-523b-4d43-a3aa-67ced941fc52 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 200 len: 1423 microversion: 2.1 time: 0.062068 Oct 29 01:19:05.785412 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1720/3617] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:05 2022] GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 1423 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:05.790483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fa2a7b23-f948-4ae0-9792-93a53b3bdb8c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:05.791311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fa2a7b23-f948-4ae0-9792-93a53b3bdb8c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:05.809600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa2a7b23-f948-4ae0-9792-93a53b3bdb8c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:05.812299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa2a7b23-f948-4ae0-9792-93a53b3bdb8c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:05.812299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa2a7b23-f948-4ae0-9792-93a53b3bdb8c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:05.812299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa2a7b23-f948-4ae0-9792-93a53b3bdb8c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:05.812299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa2a7b23-f948-4ae0-9792-93a53b3bdb8c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:05.813331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa2a7b23-f948-4ae0-9792-93a53b3bdb8c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:05.909320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fa2a7b23-f948-4ae0-9792-93a53b3bdb8c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:05.932716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fa2a7b23-f948-4ae0-9792-93a53b3bdb8c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:05.934711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fa2a7b23-f948-4ae0-9792-93a53b3bdb8c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:05.936104 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fa2a7b23-f948-4ae0-9792-93a53b3bdb8c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1335 microversion: 2.57 time: 0.149937 Oct 29 01:19:05.937753 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1721/3618] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:05 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1335 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:05.949285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d69674d6-4242-4c9c-a27b-cff2a382751a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97c67e50>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:06.015480 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d69674d6-4242-4c9c-a27b-cff2a382751a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 200 len: 1423 microversion: 2.1 time: 0.075297 Oct 29 01:19:06.015480 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1722/3619] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:05 2022] GET /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 1423 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:06.033112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a935fb70-2fc7-406d-bbf6-0712a25d3235 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97f09dc0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:06.073175 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b81145e5-8398-435b-9a14-46b13608ac53 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "POST /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.024152 Oct 29 01:19:06.073175 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1898/3620] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 29 01:19:05 2022] POST /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3/os-volume_attachments => generated 194 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:06.427354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4c560ef9-dde6-420f-bf09-62774fbeb899 req-e648934c-a044-49eb-b236-766e1d548179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d86ca7-7755-4635-a7dc-5764fec864d0", "name": "network-vif-deleted", "tag": "e2c060e8-a704-480a-b2c3-71e2da5c0c5d"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:06.463452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4c560ef9-dde6-420f-bf09-62774fbeb899 req-e648934c-a044-49eb-b236-766e1d548179 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:06.463959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4c560ef9-dde6-420f-bf09-62774fbeb899 req-e648934c-a044-49eb-b236-766e1d548179 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:06.464406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4c560ef9-dde6-420f-bf09-62774fbeb899 req-e648934c-a044-49eb-b236-766e1d548179 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:06.504842 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4c560ef9-dde6-420f-bf09-62774fbeb899 req-e648934c-a044-49eb-b236-766e1d548179 service nova] Creating event network-vif-deleted:e2c060e8-a704-480a-b2c3-71e2da5c0c5d for instance 38d86ca7-7755-4635-a7dc-5764fec864d0 on n-h2-862964-3 Oct 29 01:19:06.532111 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4c560ef9-dde6-420f-bf09-62774fbeb899 req-e648934c-a044-49eb-b236-766e1d548179 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109252 Oct 29 01:19:06.533502 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1899/3621] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:06.544179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9dad58bf-9568-4f16-9908-d9b59cc44a6c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:06.544179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9dad58bf-9568-4f16-9908-d9b59cc44a6c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:06.560200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:06.564967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9dad58bf-9568-4f16-9908-d9b59cc44a6c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:06.573267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9dad58bf-9568-4f16-9908-d9b59cc44a6c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:06.573267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9dad58bf-9568-4f16-9908-d9b59cc44a6c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:06.573267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9dad58bf-9568-4f16-9908-d9b59cc44a6c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:06.574353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9dad58bf-9568-4f16-9908-d9b59cc44a6c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:06.574900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9dad58bf-9568-4f16-9908-d9b59cc44a6c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:07.163822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9dad58bf-9568-4f16-9908-d9b59cc44a6c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:07.202634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9dad58bf-9568-4f16-9908-d9b59cc44a6c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:07.204436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9dad58bf-9568-4f16-9908-d9b59cc44a6c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:07.210597 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9dad58bf-9568-4f16-9908-d9b59cc44a6c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.675324 Oct 29 01:19:07.227310 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1900/3622] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:06 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:07.235182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f520b87-3bb0-4ef8-9dad-6e4a9deb42fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:07.235666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1f520b87-3bb0-4ef8-9dad-6e4a9deb42fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:07.242696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f520b87-3bb0-4ef8-9dad-6e4a9deb42fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:07.243437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f520b87-3bb0-4ef8-9dad-6e4a9deb42fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:07.244070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f520b87-3bb0-4ef8-9dad-6e4a9deb42fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:07.245093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f520b87-3bb0-4ef8-9dad-6e4a9deb42fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:07.245785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f520b87-3bb0-4ef8-9dad-6e4a9deb42fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:07.246554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f520b87-3bb0-4ef8-9dad-6e4a9deb42fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:07.281252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f520b87-3bb0-4ef8-9dad-6e4a9deb42fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:07.281737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f520b87-3bb0-4ef8-9dad-6e4a9deb42fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:07.282180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f520b87-3bb0-4ef8-9dad-6e4a9deb42fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:07.282675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-1f520b87-3bb0-4ef8-9dad-6e4a9deb42fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lazy-loading 'fault' on Instance uuid 38d86ca7-7755-4635-a7dc-5764fec864d0 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:19:07.340099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1f520b87-3bb0-4ef8-9dad-6e4a9deb42fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:07.351671 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1f520b87-3bb0-4ef8-9dad-6e4a9deb42fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 200 len: 1318 microversion: 2.1 time: 0.121921 Oct 29 01:19:07.354023 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1901/3623] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:07 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 1318 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:07.392430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d2242a10-120e-4504-9c9e-2f7cfd56612d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:07.393490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d2242a10-120e-4504-9c9e-2f7cfd56612d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:07.420571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2242a10-120e-4504-9c9e-2f7cfd56612d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:07.421078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2242a10-120e-4504-9c9e-2f7cfd56612d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:07.421825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2242a10-120e-4504-9c9e-2f7cfd56612d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:07.422547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2242a10-120e-4504-9c9e-2f7cfd56612d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:07.423010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2242a10-120e-4504-9c9e-2f7cfd56612d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:07.423443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2242a10-120e-4504-9c9e-2f7cfd56612d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:07.525973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d2242a10-120e-4504-9c9e-2f7cfd56612d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:07.539145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d2242a10-120e-4504-9c9e-2f7cfd56612d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:07.540966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d2242a10-120e-4504-9c9e-2f7cfd56612d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:07.542571 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d2242a10-120e-4504-9c9e-2f7cfd56612d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1335 microversion: 2.57 time: 0.186865 Oct 29 01:19:07.543224 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1902/3624] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:07 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1335 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:07.852795 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a935fb70-2fc7-406d-bbf6-0712a25d3235 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 204 len: 0 microversion: 2.1 time: 1.826421 Oct 29 01:19:07.855230 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1723/3625] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:06 2022] DELETE /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 0 bytes in 1830 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:19:07.885172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-853f8872-0cd7-4a23-9437-b7b39bfe9063 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:07.886048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-853f8872-0cd7-4a23-9437-b7b39bfe9063 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:07.892553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-853f8872-0cd7-4a23-9437-b7b39bfe9063 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:07.893381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-853f8872-0cd7-4a23-9437-b7b39bfe9063 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:07.894080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-853f8872-0cd7-4a23-9437-b7b39bfe9063 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:07.895043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-853f8872-0cd7-4a23-9437-b7b39bfe9063 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:07.895689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-853f8872-0cd7-4a23-9437-b7b39bfe9063 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:07.896305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-853f8872-0cd7-4a23-9437-b7b39bfe9063 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:07.924416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-853f8872-0cd7-4a23-9437-b7b39bfe9063 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:19:08.240659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1920458d-ebb9-4970-ba3d-6e289c0352e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:08.241295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1920458d-ebb9-4970-ba3d-6e289c0352e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:08.248602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1920458d-ebb9-4970-ba3d-6e289c0352e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:08.249113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1920458d-ebb9-4970-ba3d-6e289c0352e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:08.249560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1920458d-ebb9-4970-ba3d-6e289c0352e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:08.250592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1920458d-ebb9-4970-ba3d-6e289c0352e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:08.251063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1920458d-ebb9-4970-ba3d-6e289c0352e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:08.251493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1920458d-ebb9-4970-ba3d-6e289c0352e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:08.411192 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-853f8872-0cd7-4a23-9437-b7b39bfe9063 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 204 len: 0 microversion: 2.1 time: 0.530353 Oct 29 01:19:08.416427 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1903/3626] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:19:07 2022] DELETE /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:19:08.423266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b2e0d65-826e-4c0f-9e6c-4eff58bf3cc6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:08.427328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7b2e0d65-826e-4c0f-9e6c-4eff58bf3cc6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:08.449452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b2e0d65-826e-4c0f-9e6c-4eff58bf3cc6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:08.450194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b2e0d65-826e-4c0f-9e6c-4eff58bf3cc6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:08.450823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b2e0d65-826e-4c0f-9e6c-4eff58bf3cc6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:08.452034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b2e0d65-826e-4c0f-9e6c-4eff58bf3cc6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:08.452703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b2e0d65-826e-4c0f-9e6c-4eff58bf3cc6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:08.454293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b2e0d65-826e-4c0f-9e6c-4eff58bf3cc6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:08.475170 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-7b2e0d65-826e-4c0f-9e6c-4eff58bf3cc6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance 38d86ca7-7755-4635-a7dc-5764fec864d0 could not be found. Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b2e0d65-826e-4c0f-9e6c-4eff58bf3cc6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 HTTP/1.1 Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 38d86ca7-7755-4635-a7dc-5764fec864d0 could not be found. Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '38d86ca7-7755-4635-a7dc-5764fec864d0'} Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d86ca7-7755-4635-a7dc-5764fec864d0 could not be found. Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d86ca7-7755-4635-a7dc-5764fec864d0 could not be found. Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:19:08.475923 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:19:08.481622 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:19:08.481622 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:19:08.481622 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:19:08.481622 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:19:08.481622 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:19:08.481622 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d86ca7-7755-4635-a7dc-5764fec864d0 could not be found. Oct 29 01:19:08.481622 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:19:08.481622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b2e0d65-826e-4c0f-9e6c-4eff58bf3cc6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance 38d86ca7-7755-4635-a7dc-5764fec864d0 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:19:08.481622 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7b2e0d65-826e-4c0f-9e6c-4eff58bf3cc6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 404 len: 111 microversion: 2.1 time: 0.062861 Oct 29 01:19:08.482706 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1904/3627] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:08 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:19:08.490591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-483c939b-0a9a-455a-94bf-a5c343697456 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '.version_select at 0x7f9d9fd48b80>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:08.575041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1920458d-ebb9-4970-ba3d-6e289c0352e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:08.584415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1920458d-ebb9-4970-ba3d-6e289c0352e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:08.585835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1920458d-ebb9-4970-ba3d-6e289c0352e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:08.587898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:08.590095 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-483c939b-0a9a-455a-94bf-a5c343697456 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-key-1002218656" status: 202 len: 0 microversion: 2.1 time: 0.103305 Oct 29 01:19:08.607373 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1905/3628] 10.222.0.26 () {58 vars in 1209 bytes} [Sat Oct 29 01:19:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1002218656 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:19:08.607725 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1920458d-ebb9-4970-ba3d-6e289c0352e9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.355494 Oct 29 01:19:08.607725 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1724/3629] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:08 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:08.607725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d2ccc82d-96cd-4914-bcb1-e0356faae976 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1509543437", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "417ddcf9-7930-440b-995d-5ce0b1f48a9f"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:08.616639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6706b82f-8fdd-4911-a2f9-99656d449eb7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:08.617454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6706b82f-8fdd-4911-a2f9-99656d449eb7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:08.634577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6706b82f-8fdd-4911-a2f9-99656d449eb7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:08.641377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6706b82f-8fdd-4911-a2f9-99656d449eb7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:08.641377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6706b82f-8fdd-4911-a2f9-99656d449eb7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:08.641377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6706b82f-8fdd-4911-a2f9-99656d449eb7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:08.641377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6706b82f-8fdd-4911-a2f9-99656d449eb7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:08.641377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6706b82f-8fdd-4911-a2f9-99656d449eb7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:08.693449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-d2ccc82d-96cd-4914-bcb1-e0356faae976 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] validate_networks() for [('417ddcf9-7930-440b-995d-5ce0b1f48a9f', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:19:08.729373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6706b82f-8fdd-4911-a2f9-99656d449eb7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:08.739554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6706b82f-8fdd-4911-a2f9-99656d449eb7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:08.741202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6706b82f-8fdd-4911-a2f9-99656d449eb7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:08.742572 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6706b82f-8fdd-4911-a2f9-99656d449eb7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1335 microversion: 2.57 time: 0.149571 Oct 29 01:19:08.743740 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1906/3630] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:08 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1335 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:08.752371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-940592a0-a121-4992-835c-3c00cf3b7d17 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1854404492", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "b5b62219-8a2f-42eb-b795-dd5a026e1972"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:08.830137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-940592a0-a121-4992-835c-3c00cf3b7d17 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] validate_networks() for [('b5b62219-8a2f-42eb-b795-dd5a026e1972', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:19:09.459017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d2ccc82d-96cd-4914-bcb1-e0356faae976 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:19:09.461190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d2ccc82d-96cd-4914-bcb1-e0356faae976 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:19:09.462196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d2ccc82d-96cd-4914-bcb1-e0356faae976 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:19:09.462610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d2ccc82d-96cd-4914-bcb1-e0356faae976 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:19:09.463029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-d2ccc82d-96cd-4914-bcb1-e0356faae976 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:19:09.465505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-940592a0-a121-4992-835c-3c00cf3b7d17 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:19:09.466026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-940592a0-a121-4992-835c-3c00cf3b7d17 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:19:09.466745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-940592a0-a121-4992-835c-3c00cf3b7d17 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:19:09.467231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-940592a0-a121-4992-835c-3c00cf3b7d17 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:19:09.467694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-940592a0-a121-4992-835c-3c00cf3b7d17 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:19:09.474396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2ccc82d-96cd-4914-bcb1-e0356faae976 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:09.475186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2ccc82d-96cd-4914-bcb1-e0356faae976 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:09.475626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2ccc82d-96cd-4914-bcb1-e0356faae976 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:09.476362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2ccc82d-96cd-4914-bcb1-e0356faae976 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:09.477458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2ccc82d-96cd-4914-bcb1-e0356faae976 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:09.478183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2ccc82d-96cd-4914-bcb1-e0356faae976 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:09.478337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-940592a0-a121-4992-835c-3c00cf3b7d17 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:09.478749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-940592a0-a121-4992-835c-3c00cf3b7d17 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:09.479184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-940592a0-a121-4992-835c-3c00cf3b7d17 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:09.480178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-940592a0-a121-4992-835c-3c00cf3b7d17 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:09.481012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-940592a0-a121-4992-835c-3c00cf3b7d17 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:09.481659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-940592a0-a121-4992-835c-3c00cf3b7d17 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:09.498677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-d2ccc82d-96cd-4914-bcb1-e0356faae976 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Getting quotas for project b284e70790cf43e2b474559bb3e20faf. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:19:09.501266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-940592a0-a121-4992-835c-3c00cf3b7d17 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Getting quotas for project 6dc302f307494a61836f3afb38dccae9. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:19:09.504792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-d2ccc82d-96cd-4914-bcb1-e0356faae976 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Getting quotas for user a35b358af11846f78debaf9e422a9558 and project b284e70790cf43e2b474559bb3e20faf. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:19:09.506900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-940592a0-a121-4992-835c-3c00cf3b7d17 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Getting quotas for user 6cb8fe33c5d64047ada50f44e01e4faa and project 6dc302f307494a61836f3afb38dccae9. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:19:09.521824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d2ccc82d-96cd-4914-bcb1-e0356faae976 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:19:09.523818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-940592a0-a121-4992-835c-3c00cf3b7d17 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:19:09.524669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d2ccc82d-96cd-4914-bcb1-e0356faae976 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:19:09.526386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-940592a0-a121-4992-835c-3c00cf3b7d17 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:19:09.673496 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d2ccc82d-96cd-4914-bcb1-e0356faae976 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.079693 Oct 29 01:19:09.680624 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1725/3631] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:19:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:19:09.733019 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-940592a0-a121-4992-835c-3c00cf3b7d17 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.987954 Oct 29 01:19:09.733912 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1907/3632] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:19:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:19:09.751136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3b911d96-ad4a-420b-b978-6cda7981aeaf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:09.751754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3b911d96-ad4a-420b-b978-6cda7981aeaf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:09.762545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b911d96-ad4a-420b-b978-6cda7981aeaf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:09.763032 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b911d96-ad4a-420b-b978-6cda7981aeaf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:09.764095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b911d96-ad4a-420b-b978-6cda7981aeaf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:09.764822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b911d96-ad4a-420b-b978-6cda7981aeaf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:09.767285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b911d96-ad4a-420b-b978-6cda7981aeaf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:09.767946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b911d96-ad4a-420b-b978-6cda7981aeaf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:09.776811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-719c0d8b-a2b5-420b-8283-dd4438a72630 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761-project-admin] Calling method '.version_select at 0x7f9d97e34040>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:09.779102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-719c0d8b-a2b5-420b-8283-dd4438a72630 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:09.782050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-719c0d8b-a2b5-420b-8283-dd4438a72630 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:09.782747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-719c0d8b-a2b5-420b-8283-dd4438a72630 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:09.807402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-719c0d8b-a2b5-420b-8283-dd4438a72630 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:09.808283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-719c0d8b-a2b5-420b-8283-dd4438a72630 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:09.808856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-719c0d8b-a2b5-420b-8283-dd4438a72630 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:09.825924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-719c0d8b-a2b5-420b-8283-dd4438a72630 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:09.826865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-719c0d8b-a2b5-420b-8283-dd4438a72630 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:09.827632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-719c0d8b-a2b5-420b-8283-dd4438a72630 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:09.830180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:09.840581 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-719c0d8b-a2b5-420b-8283-dd4438a72630 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159049761-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.158535 Oct 29 01:19:09.841462 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1726/3633] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:19:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:09.873571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-306e86b2-62e0-46c3-84d8-193ea7893dcd tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:09.877098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-306e86b2-62e0-46c3-84d8-193ea7893dcd tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:09.913932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3b911d96-ad4a-420b-b978-6cda7981aeaf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:09.922120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3b911d96-ad4a-420b-b978-6cda7981aeaf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:09.928430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3b911d96-ad4a-420b-b978-6cda7981aeaf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:09.936176 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3b911d96-ad4a-420b-b978-6cda7981aeaf tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.201138 Oct 29 01:19:09.937094 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1908/3634] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:09 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:09.941833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f2f52041-549d-4d11-beb3-9924d809fd48 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:09.942697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f2f52041-549d-4d11-beb3-9924d809fd48 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:10.001511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-306e86b2-62e0-46c3-84d8-193ea7893dcd tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:10.018546 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-306e86b2-62e0-46c3-84d8-193ea7893dcd tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 200 len: 1208 microversion: 2.1 time: 0.172253 Oct 29 01:19:10.020618 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1727/3635] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:09 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 1208 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:10.038085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-89021969-a96d-4d71-af1e-a132dd0db3a0 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:10.038856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-89021969-a96d-4d71-af1e-a132dd0db3a0 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:10.049487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89021969-a96d-4d71-af1e-a132dd0db3a0 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:10.049988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89021969-a96d-4d71-af1e-a132dd0db3a0 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:10.052580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89021969-a96d-4d71-af1e-a132dd0db3a0 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:10.052580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89021969-a96d-4d71-af1e-a132dd0db3a0 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:10.052884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89021969-a96d-4d71-af1e-a132dd0db3a0 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:10.053089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89021969-a96d-4d71-af1e-a132dd0db3a0 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:10.072581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f2f52041-549d-4d11-beb3-9924d809fd48 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:10.083203 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f2f52041-549d-4d11-beb3-9924d809fd48 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 200 len: 1209 microversion: 2.1 time: 0.142708 Oct 29 01:19:10.084203 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1909/3636] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:09 2022] GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 1209 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:10.144257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-89021969-a96d-4d71-af1e-a132dd0db3a0 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:10.159920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-89021969-a96d-4d71-af1e-a132dd0db3a0 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:10.161767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-89021969-a96d-4d71-af1e-a132dd0db3a0 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:10.164055 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-89021969-a96d-4d71-af1e-a132dd0db3a0 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1335 microversion: 2.57 time: 0.131414 Oct 29 01:19:10.164760 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1728/3637] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:10 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1335 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:10.286078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-84c6dc19-d873-43b8-a326-7091962dd479 req-d739e830-89ea-4a27-872f-afea23e903f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e5221e-08a3-4b98-a068-1963700c814e", "name": "network-vif-unplugged", "status": "completed", "tag": "87ed97e9-c5bc-4a10-91d0-5c4cb8c6d5d6"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:10.298347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-84c6dc19-d873-43b8-a326-7091962dd479 req-d739e830-89ea-4a27-872f-afea23e903f4 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:10.298951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-84c6dc19-d873-43b8-a326-7091962dd479 req-d739e830-89ea-4a27-872f-afea23e903f4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:10.299457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-84c6dc19-d873-43b8-a326-7091962dd479 req-d739e830-89ea-4a27-872f-afea23e903f4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:10.305945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:10.322664 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-84c6dc19-d873-43b8-a326-7091962dd479 req-d739e830-89ea-4a27-872f-afea23e903f4 service nova] Creating event network-vif-unplugged:87ed97e9-c5bc-4a10-91d0-5c4cb8c6d5d6 for instance 60e5221e-08a3-4b98-a068-1963700c814e on n-h1-862964-3 Oct 29 01:19:10.345282 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-84c6dc19-d873-43b8-a326-7091962dd479 req-d739e830-89ea-4a27-872f-afea23e903f4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064392 Oct 29 01:19:10.346011 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1910/3638] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:10.964383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c529b5d4-cc3c-4013-9501-911727e0f667 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:10.965015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c529b5d4-cc3c-4013-9501-911727e0f667 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:10.972216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c529b5d4-cc3c-4013-9501-911727e0f667 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:10.972716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c529b5d4-cc3c-4013-9501-911727e0f667 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:10.973184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c529b5d4-cc3c-4013-9501-911727e0f667 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:10.973877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c529b5d4-cc3c-4013-9501-911727e0f667 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:10.974334 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c529b5d4-cc3c-4013-9501-911727e0f667 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:10.974826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c529b5d4-cc3c-4013-9501-911727e0f667 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:11.047691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-320f4e34-9958-4453-94a2-3b62535eabd3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:11.048414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-320f4e34-9958-4453-94a2-3b62535eabd3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:11.067706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-320f4e34-9958-4453-94a2-3b62535eabd3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:11.068557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-320f4e34-9958-4453-94a2-3b62535eabd3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:11.077990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-320f4e34-9958-4453-94a2-3b62535eabd3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:11.077990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-320f4e34-9958-4453-94a2-3b62535eabd3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:11.077990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-320f4e34-9958-4453-94a2-3b62535eabd3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:11.077990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-320f4e34-9958-4453-94a2-3b62535eabd3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:11.214355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c529b5d4-cc3c-4013-9501-911727e0f667 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:11.232866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c529b5d4-cc3c-4013-9501-911727e0f667 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:11.239698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c529b5d4-cc3c-4013-9501-911727e0f667 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:11.251062 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c529b5d4-cc3c-4013-9501-911727e0f667 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.290573 Oct 29 01:19:11.252427 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1729/3639] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:10 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:11.258986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d0ee1dd7-90b1-4726-ae0c-3e3a0a06e293 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:11.259832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d0ee1dd7-90b1-4726-ae0c-3e3a0a06e293 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:11.267680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d0ee1dd7-90b1-4726-ae0c-3e3a0a06e293 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:11.268427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d0ee1dd7-90b1-4726-ae0c-3e3a0a06e293 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:11.269090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d0ee1dd7-90b1-4726-ae0c-3e3a0a06e293 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:11.270988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d0ee1dd7-90b1-4726-ae0c-3e3a0a06e293 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:11.271783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d0ee1dd7-90b1-4726-ae0c-3e3a0a06e293 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:11.272540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d0ee1dd7-90b1-4726-ae0c-3e3a0a06e293 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:11.278118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-320f4e34-9958-4453-94a2-3b62535eabd3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:11.290516 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-320f4e34-9958-4453-94a2-3b62535eabd3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 200 len: 1212 microversion: 2.1 time: 0.244452 Oct 29 01:19:11.293487 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1911/3640] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:11 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 1212 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:11.306978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-af1c67ff-13b0-4b11-8691-e3d0f19c95f5 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:11.309713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-af1c67ff-13b0-4b11-8691-e3d0f19c95f5 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:11.326918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af1c67ff-13b0-4b11-8691-e3d0f19c95f5 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:11.326918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af1c67ff-13b0-4b11-8691-e3d0f19c95f5 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:11.326918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af1c67ff-13b0-4b11-8691-e3d0f19c95f5 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:11.326918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af1c67ff-13b0-4b11-8691-e3d0f19c95f5 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:11.326918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af1c67ff-13b0-4b11-8691-e3d0f19c95f5 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:11.326918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af1c67ff-13b0-4b11-8691-e3d0f19c95f5 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:11.388587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d0ee1dd7-90b1-4726-ae0c-3e3a0a06e293 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:11.420723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-af1c67ff-13b0-4b11-8691-e3d0f19c95f5 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:11.429818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-af1c67ff-13b0-4b11-8691-e3d0f19c95f5 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:11.431973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-af1c67ff-13b0-4b11-8691-e3d0f19c95f5 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:11.433149 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-af1c67ff-13b0-4b11-8691-e3d0f19c95f5 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1335 microversion: 2.57 time: 0.136763 Oct 29 01:19:11.433736 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1912/3641] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:11 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1335 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:11.445485 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d0ee1dd7-90b1-4726-ae0c-3e3a0a06e293 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 200 len: 1213 microversion: 2.1 time: 0.179821 Oct 29 01:19:11.445485 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1730/3642] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:11 2022] GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 1213 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:12.288975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-297de036-3fce-400b-8fda-3da1461b5f76 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:12.290304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-297de036-3fce-400b-8fda-3da1461b5f76 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:12.303077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-a6b9b5af-7f1e-4903-b0c8-ef5bb838961f req-8dce98dc-8956-4776-8681-329f577b1a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e5221e-08a3-4b98-a068-1963700c814e", "name": "network-vif-deleted", "tag": "87ed97e9-c5bc-4a10-91d0-5c4cb8c6d5d6"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:12.308388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-297de036-3fce-400b-8fda-3da1461b5f76 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:12.310709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-297de036-3fce-400b-8fda-3da1461b5f76 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:12.312069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-297de036-3fce-400b-8fda-3da1461b5f76 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:12.314730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-297de036-3fce-400b-8fda-3da1461b5f76 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:12.315235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-297de036-3fce-400b-8fda-3da1461b5f76 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:12.315906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-297de036-3fce-400b-8fda-3da1461b5f76 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:12.322131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a6b9b5af-7f1e-4903-b0c8-ef5bb838961f req-8dce98dc-8956-4776-8681-329f577b1a6e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:12.322890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a6b9b5af-7f1e-4903-b0c8-ef5bb838961f req-8dce98dc-8956-4776-8681-329f577b1a6e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:12.331837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a6b9b5af-7f1e-4903-b0c8-ef5bb838961f req-8dce98dc-8956-4776-8681-329f577b1a6e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:12.360244 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-a6b9b5af-7f1e-4903-b0c8-ef5bb838961f req-8dce98dc-8956-4776-8681-329f577b1a6e service nova] Creating event network-vif-deleted:87ed97e9-c5bc-4a10-91d0-5c4cb8c6d5d6 for instance 60e5221e-08a3-4b98-a068-1963700c814e on n-h1-862964-3 Oct 29 01:19:12.384018 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-a6b9b5af-7f1e-4903-b0c8-ef5bb838961f req-8dce98dc-8956-4776-8681-329f577b1a6e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082848 Oct 29 01:19:12.384733 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1731/3643] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:12.405380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4fb92ead-a737-4054-967b-580fba3c5194 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:12.406151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4fb92ead-a737-4054-967b-580fba3c5194 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:12.422799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fb92ead-a737-4054-967b-580fba3c5194 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:12.423331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fb92ead-a737-4054-967b-580fba3c5194 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:12.423807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fb92ead-a737-4054-967b-580fba3c5194 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:12.429615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fb92ead-a737-4054-967b-580fba3c5194 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:12.431322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fb92ead-a737-4054-967b-580fba3c5194 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:12.431971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fb92ead-a737-4054-967b-580fba3c5194 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:12.482603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-297de036-3fce-400b-8fda-3da1461b5f76 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:12.491766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-297de036-3fce-400b-8fda-3da1461b5f76 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:12.495820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-297de036-3fce-400b-8fda-3da1461b5f76 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:12.504686 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-297de036-3fce-400b-8fda-3da1461b5f76 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.225192 Oct 29 01:19:12.505570 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1913/3644] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:12 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:12.518427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7dc9215d-684f-4a79-91ac-8c58280af4d1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:12.518427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7dc9215d-684f-4a79-91ac-8c58280af4d1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:12.521984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc9215d-684f-4a79-91ac-8c58280af4d1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:12.522655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc9215d-684f-4a79-91ac-8c58280af4d1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:12.523242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc9215d-684f-4a79-91ac-8c58280af4d1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:12.528510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc9215d-684f-4a79-91ac-8c58280af4d1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:12.529412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc9215d-684f-4a79-91ac-8c58280af4d1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:12.530038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc9215d-684f-4a79-91ac-8c58280af4d1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:12.538027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4fb92ead-a737-4054-967b-580fba3c5194 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:12.570692 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4fb92ead-a737-4054-967b-580fba3c5194 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 200 len: 1204 microversion: 2.1 time: 0.183420 Oct 29 01:19:12.574962 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1732/3645] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:12 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 1204 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:12.591934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-74ed8642-4b0e-40bb-bb56-b188dc60b692 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:12.595156 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-74ed8642-4b0e-40bb-bb56-b188dc60b692 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:12.610927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-74ed8642-4b0e-40bb-bb56-b188dc60b692 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:12.612193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-74ed8642-4b0e-40bb-bb56-b188dc60b692 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:12.613191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-74ed8642-4b0e-40bb-bb56-b188dc60b692 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:12.614472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-74ed8642-4b0e-40bb-bb56-b188dc60b692 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:12.615147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-74ed8642-4b0e-40bb-bb56-b188dc60b692 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:12.615761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-74ed8642-4b0e-40bb-bb56-b188dc60b692 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:12.658348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7dc9215d-684f-4a79-91ac-8c58280af4d1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:12.675148 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7dc9215d-684f-4a79-91ac-8c58280af4d1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 200 len: 1261 microversion: 2.1 time: 0.167447 Oct 29 01:19:12.675923 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1914/3646] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:12 2022] GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:12.724136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-74ed8642-4b0e-40bb-bb56-b188dc60b692 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:12.747001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-74ed8642-4b0e-40bb-bb56-b188dc60b692 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:12.751798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-74ed8642-4b0e-40bb-bb56-b188dc60b692 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:12.755011 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-74ed8642-4b0e-40bb-bb56-b188dc60b692 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1356 microversion: 2.57 time: 0.178836 Oct 29 01:19:12.755801 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1733/3647] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:12 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1356 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:12.780922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:12.784317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:12.791329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:12.791830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:12.792536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:12.793456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:12.793922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:12.794351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:12.901896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:19:12.902472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:19:12.903193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:19:12.913670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:19:12.915490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:19:13.165145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:13.172520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:13.172883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:13.173233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:13.174013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:13.174478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:13.174909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:13.207909 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dcba4026-7dcc-4f0d-ab12-171a82e3d276 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "POST /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37/action" status: 202 len: 1137 microversion: 2.57 time: 0.431146 Oct 29 01:19:13.217450 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1915/3648] 10.222.0.26 () {62 vars in 1320 bytes} [Sat Oct 29 01:19:12 2022] POST /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37/action => generated 1137 bytes in 441 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 29 01:19:13.233134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6d0f3ed5-1239-48cd-acc9-dcf9d1a9f3d1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:13.233786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6d0f3ed5-1239-48cd-acc9-dcf9d1a9f3d1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:13.240074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d0f3ed5-1239-48cd-acc9-dcf9d1a9f3d1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:13.240567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d0f3ed5-1239-48cd-acc9-dcf9d1a9f3d1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:13.241034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d0f3ed5-1239-48cd-acc9-dcf9d1a9f3d1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:13.241967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d0f3ed5-1239-48cd-acc9-dcf9d1a9f3d1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:13.242489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d0f3ed5-1239-48cd-acc9-dcf9d1a9f3d1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:13.248520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d0f3ed5-1239-48cd-acc9-dcf9d1a9f3d1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:13.317753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6d0f3ed5-1239-48cd-acc9-dcf9d1a9f3d1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:13.330344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6d0f3ed5-1239-48cd-acc9-dcf9d1a9f3d1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:13.332332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6d0f3ed5-1239-48cd-acc9-dcf9d1a9f3d1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:13.333780 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6d0f3ed5-1239-48cd-acc9-dcf9d1a9f3d1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.105649 Oct 29 01:19:13.334841 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1734/3649] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:13 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:13.539195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b6f55b7f-3b37-467e-b425-a4b31f90c4f9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:13.547550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b6f55b7f-3b37-467e-b425-a4b31f90c4f9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:13.552265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6f55b7f-3b37-467e-b425-a4b31f90c4f9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:13.552793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6f55b7f-3b37-467e-b425-a4b31f90c4f9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:13.553941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6f55b7f-3b37-467e-b425-a4b31f90c4f9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:13.554748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6f55b7f-3b37-467e-b425-a4b31f90c4f9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:13.556168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6f55b7f-3b37-467e-b425-a4b31f90c4f9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:13.556799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6f55b7f-3b37-467e-b425-a4b31f90c4f9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:13.600507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bd865bc4-fbb3-4925-8691-649a07466556 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:13.601327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bd865bc4-fbb3-4925-8691-649a07466556 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:13.611584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd865bc4-fbb3-4925-8691-649a07466556 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:13.613448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd865bc4-fbb3-4925-8691-649a07466556 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:13.613967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd865bc4-fbb3-4925-8691-649a07466556 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:13.614928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd865bc4-fbb3-4925-8691-649a07466556 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:13.615401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd865bc4-fbb3-4925-8691-649a07466556 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:13.615837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd865bc4-fbb3-4925-8691-649a07466556 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:13.664316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b6f55b7f-3b37-467e-b425-a4b31f90c4f9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:13.676865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b6f55b7f-3b37-467e-b425-a4b31f90c4f9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:13.679205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b6f55b7f-3b37-467e-b425-a4b31f90c4f9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:13.685874 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b6f55b7f-3b37-467e-b425-a4b31f90c4f9 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.150513 Oct 29 01:19:13.702769 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1916/3650] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:13 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:13.714687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8bd8d608-71a7-48ea-ae79-88054adbcb43 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:13.715647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8bd8d608-71a7-48ea-ae79-88054adbcb43 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:13.723343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8bd8d608-71a7-48ea-ae79-88054adbcb43 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:13.724361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8bd8d608-71a7-48ea-ae79-88054adbcb43 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:13.725045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8bd8d608-71a7-48ea-ae79-88054adbcb43 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:13.726123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8bd8d608-71a7-48ea-ae79-88054adbcb43 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:13.726811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8bd8d608-71a7-48ea-ae79-88054adbcb43 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:13.728046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8bd8d608-71a7-48ea-ae79-88054adbcb43 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:13.739266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bd865bc4-fbb3-4925-8691-649a07466556 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:13.747423 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bd865bc4-fbb3-4925-8691-649a07466556 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 200 len: 1260 microversion: 2.1 time: 0.151470 Oct 29 01:19:13.748102 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1735/3651] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:13 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:14.329325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8bd8d608-71a7-48ea-ae79-88054adbcb43 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:14.343639 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8bd8d608-71a7-48ea-ae79-88054adbcb43 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 200 len: 1309 microversion: 2.1 time: 0.639468 Oct 29 01:19:14.344461 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1917/3652] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:13 2022] GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 1309 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:14.368664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ea538b2b-e9db-4c28-b4f5-4c2dc59b78c3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:14.369500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ea538b2b-e9db-4c28-b4f5-4c2dc59b78c3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:14.384634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea538b2b-e9db-4c28-b4f5-4c2dc59b78c3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:14.385987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea538b2b-e9db-4c28-b4f5-4c2dc59b78c3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:14.387898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea538b2b-e9db-4c28-b4f5-4c2dc59b78c3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:14.388884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea538b2b-e9db-4c28-b4f5-4c2dc59b78c3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:14.390125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea538b2b-e9db-4c28-b4f5-4c2dc59b78c3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:14.391736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea538b2b-e9db-4c28-b4f5-4c2dc59b78c3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:14.612506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ea538b2b-e9db-4c28-b4f5-4c2dc59b78c3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:14.630285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ea538b2b-e9db-4c28-b4f5-4c2dc59b78c3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:14.631919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ea538b2b-e9db-4c28-b4f5-4c2dc59b78c3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:14.633964 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ea538b2b-e9db-4c28-b4f5-4c2dc59b78c3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.276190 Oct 29 01:19:14.634768 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1736/3653] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:14 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:14.718297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fdef2d29-3f22-43ae-adf1-d69862d02343 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:14.718909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fdef2d29-3f22-43ae-adf1-d69862d02343 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:14.725957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fdef2d29-3f22-43ae-adf1-d69862d02343 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:14.726516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fdef2d29-3f22-43ae-adf1-d69862d02343 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:14.726982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fdef2d29-3f22-43ae-adf1-d69862d02343 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:14.728210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fdef2d29-3f22-43ae-adf1-d69862d02343 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:14.729022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fdef2d29-3f22-43ae-adf1-d69862d02343 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:14.729472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fdef2d29-3f22-43ae-adf1-d69862d02343 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:14.771801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-560469bf-d4c1-4435-860f-321cbacd38b2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:14.772697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-560469bf-d4c1-4435-860f-321cbacd38b2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:14.781624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-560469bf-d4c1-4435-860f-321cbacd38b2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:14.782407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-560469bf-d4c1-4435-860f-321cbacd38b2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:14.782843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-560469bf-d4c1-4435-860f-321cbacd38b2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:14.783860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-560469bf-d4c1-4435-860f-321cbacd38b2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:14.784559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-560469bf-d4c1-4435-860f-321cbacd38b2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:14.785464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-560469bf-d4c1-4435-860f-321cbacd38b2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:14.836051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fdef2d29-3f22-43ae-adf1-d69862d02343 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:14.852745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fdef2d29-3f22-43ae-adf1-d69862d02343 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:14.854489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fdef2d29-3f22-43ae-adf1-d69862d02343 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:14.864842 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fdef2d29-3f22-43ae-adf1-d69862d02343 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.147481 Oct 29 01:19:14.865546 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1918/3654] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:14 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:14.923976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-560469bf-d4c1-4435-860f-321cbacd38b2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:14.932996 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-560469bf-d4c1-4435-860f-321cbacd38b2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 200 len: 1266 microversion: 2.1 time: 0.165971 Oct 29 01:19:14.933758 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1737/3655] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:14 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:15.074480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-b7d4ac29-68ed-4c5d-b15e-bc4790e1d267 req-876dcad6-dcf8-49ab-9f3c-0626045373b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efedae7c-2224-41e7-8493-0bcb9dc4535c", "tag": "86eb1942-90d8-44e3-a515-27c49c919b9b"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:15.084063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b7d4ac29-68ed-4c5d-b15e-bc4790e1d267 req-876dcad6-dcf8-49ab-9f3c-0626045373b1 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:15.084540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b7d4ac29-68ed-4c5d-b15e-bc4790e1d267 req-876dcad6-dcf8-49ab-9f3c-0626045373b1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:15.084975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b7d4ac29-68ed-4c5d-b15e-bc4790e1d267 req-876dcad6-dcf8-49ab-9f3c-0626045373b1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:15.102331 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-b7d4ac29-68ed-4c5d-b15e-bc4790e1d267 req-876dcad6-dcf8-49ab-9f3c-0626045373b1 service nova] Creating event network-changed:86eb1942-90d8-44e3-a515-27c49c919b9b for instance efedae7c-2224-41e7-8493-0bcb9dc4535c on n-h2-862964-3 Oct 29 01:19:15.108113 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-b7d4ac29-68ed-4c5d-b15e-bc4790e1d267 req-876dcad6-dcf8-49ab-9f3c-0626045373b1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038841 Oct 29 01:19:15.109246 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1919/3656] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:15.368812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-efa84db5-41a9-4a96-bd88-dba061b0998d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:15.369525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-efa84db5-41a9-4a96-bd88-dba061b0998d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:15.378178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-efa84db5-41a9-4a96-bd88-dba061b0998d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:15.378883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-efa84db5-41a9-4a96-bd88-dba061b0998d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:15.379497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-efa84db5-41a9-4a96-bd88-dba061b0998d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:15.380606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-efa84db5-41a9-4a96-bd88-dba061b0998d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:15.382733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-efa84db5-41a9-4a96-bd88-dba061b0998d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:15.383434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-efa84db5-41a9-4a96-bd88-dba061b0998d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:15.608835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-efa84db5-41a9-4a96-bd88-dba061b0998d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:15.619283 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-efa84db5-41a9-4a96-bd88-dba061b0998d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 200 len: 1309 microversion: 2.1 time: 0.256031 Oct 29 01:19:15.620555 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1738/3657] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:15 2022] GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 1309 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:15.660595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e5ef2691-d67a-44bd-baa3-b57670a3e1e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:15.661452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e5ef2691-d67a-44bd-baa3-b57670a3e1e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:15.668175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5ef2691-d67a-44bd-baa3-b57670a3e1e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:15.668907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5ef2691-d67a-44bd-baa3-b57670a3e1e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:15.669577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5ef2691-d67a-44bd-baa3-b57670a3e1e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:15.670456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5ef2691-d67a-44bd-baa3-b57670a3e1e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:15.671082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5ef2691-d67a-44bd-baa3-b57670a3e1e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:15.671960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5ef2691-d67a-44bd-baa3-b57670a3e1e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:15.782942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e5ef2691-d67a-44bd-baa3-b57670a3e1e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:15.794189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e5ef2691-d67a-44bd-baa3-b57670a3e1e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:15.798250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e5ef2691-d67a-44bd-baa3-b57670a3e1e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:15.798250 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e5ef2691-d67a-44bd-baa3-b57670a3e1e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.141159 Oct 29 01:19:15.798850 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1920/3658] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:15 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:15.896044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1092af2b-ad22-419a-bfb1-b4d6665bdcbc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:15.897030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1092af2b-ad22-419a-bfb1-b4d6665bdcbc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:15.913808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1092af2b-ad22-419a-bfb1-b4d6665bdcbc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:15.913808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1092af2b-ad22-419a-bfb1-b4d6665bdcbc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:15.913808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1092af2b-ad22-419a-bfb1-b4d6665bdcbc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:15.913808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1092af2b-ad22-419a-bfb1-b4d6665bdcbc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:15.913808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1092af2b-ad22-419a-bfb1-b4d6665bdcbc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:15.913808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1092af2b-ad22-419a-bfb1-b4d6665bdcbc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:15.956903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a42eb09d-74f2-4dca-b2cc-98ad2553bec3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:15.957821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a42eb09d-74f2-4dca-b2cc-98ad2553bec3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:15.966323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a42eb09d-74f2-4dca-b2cc-98ad2553bec3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:15.966822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a42eb09d-74f2-4dca-b2cc-98ad2553bec3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:15.967265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a42eb09d-74f2-4dca-b2cc-98ad2553bec3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:15.967978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a42eb09d-74f2-4dca-b2cc-98ad2553bec3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:15.968441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a42eb09d-74f2-4dca-b2cc-98ad2553bec3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:15.970590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a42eb09d-74f2-4dca-b2cc-98ad2553bec3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:16.289243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1092af2b-ad22-419a-bfb1-b4d6665bdcbc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:16.301400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1092af2b-ad22-419a-bfb1-b4d6665bdcbc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:16.304445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1092af2b-ad22-419a-bfb1-b4d6665bdcbc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:16.317761 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1092af2b-ad22-419a-bfb1-b4d6665bdcbc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.428251 Oct 29 01:19:16.319290 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1739/3659] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:15 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:16.507121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a42eb09d-74f2-4dca-b2cc-98ad2553bec3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:16.518723 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a42eb09d-74f2-4dca-b2cc-98ad2553bec3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 200 len: 1308 microversion: 2.1 time: 0.564622 Oct 29 01:19:16.519667 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1921/3660] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:15 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 1308 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:16.645563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cf5865c8-94da-4f64-8b86-da79d6deee9e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:16.646804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cf5865c8-94da-4f64-8b86-da79d6deee9e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:16.655938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf5865c8-94da-4f64-8b86-da79d6deee9e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:16.656751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf5865c8-94da-4f64-8b86-da79d6deee9e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:16.657484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf5865c8-94da-4f64-8b86-da79d6deee9e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:16.658445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf5865c8-94da-4f64-8b86-da79d6deee9e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:16.659125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf5865c8-94da-4f64-8b86-da79d6deee9e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:16.659771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf5865c8-94da-4f64-8b86-da79d6deee9e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:16.833201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-de2bc976-3b3b-48b5-a81f-24d83223bddc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:16.835213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-de2bc976-3b3b-48b5-a81f-24d83223bddc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:16.844606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de2bc976-3b3b-48b5-a81f-24d83223bddc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:16.845753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de2bc976-3b3b-48b5-a81f-24d83223bddc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:16.847090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de2bc976-3b3b-48b5-a81f-24d83223bddc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:16.850750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de2bc976-3b3b-48b5-a81f-24d83223bddc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:16.850750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de2bc976-3b3b-48b5-a81f-24d83223bddc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:16.850750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de2bc976-3b3b-48b5-a81f-24d83223bddc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:16.983321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-de2bc976-3b3b-48b5-a81f-24d83223bddc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:17.004669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-de2bc976-3b3b-48b5-a81f-24d83223bddc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:17.011489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-de2bc976-3b3b-48b5-a81f-24d83223bddc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:17.013197 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-de2bc976-3b3b-48b5-a81f-24d83223bddc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.193281 Oct 29 01:19:17.015195 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1922/3661] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:16 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:17.094666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cf5865c8-94da-4f64-8b86-da79d6deee9e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:17.110437 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cf5865c8-94da-4f64-8b86-da79d6deee9e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 200 len: 1309 microversion: 2.1 time: 0.468688 Oct 29 01:19:17.111799 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1740/3662] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:16 2022] GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 1309 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:17.349562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ae235057-0ef4-437f-9066-8eb60fef98a3 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:17.350185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ae235057-0ef4-437f-9066-8eb60fef98a3 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:17.359471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae235057-0ef4-437f-9066-8eb60fef98a3 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:17.359471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae235057-0ef4-437f-9066-8eb60fef98a3 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:17.359471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae235057-0ef4-437f-9066-8eb60fef98a3 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:17.360759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae235057-0ef4-437f-9066-8eb60fef98a3 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:17.361255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae235057-0ef4-437f-9066-8eb60fef98a3 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:17.361693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae235057-0ef4-437f-9066-8eb60fef98a3 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:17.443790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ae235057-0ef4-437f-9066-8eb60fef98a3 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:17.454072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ae235057-0ef4-437f-9066-8eb60fef98a3 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:17.455567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ae235057-0ef4-437f-9066-8eb60fef98a3 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:17.462501 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ae235057-0ef4-437f-9066-8eb60fef98a3 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.115909 Oct 29 01:19:17.473193 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1923/3663] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:17 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:17.545637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b73bb356-987f-44fa-97af-a6d5b0d52e40 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:17.547214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b73bb356-987f-44fa-97af-a6d5b0d52e40 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:17.549411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-9dbe1274-e2d0-4e3d-a5ce-c8c3ddb0582a req-0770241a-c549-4e4c-87ed-30135f8ee3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "277b318c-bc53-4c0d-997b-8c96d92ce41b", "tag": "260d45a4-8311-4a41-a480-de2b98950b06"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:17.553926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b73bb356-987f-44fa-97af-a6d5b0d52e40 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:17.554517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b73bb356-987f-44fa-97af-a6d5b0d52e40 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:17.555059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b73bb356-987f-44fa-97af-a6d5b0d52e40 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:17.555903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b73bb356-987f-44fa-97af-a6d5b0d52e40 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:17.556562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b73bb356-987f-44fa-97af-a6d5b0d52e40 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:17.557435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b73bb356-987f-44fa-97af-a6d5b0d52e40 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:17.559280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9dbe1274-e2d0-4e3d-a5ce-c8c3ddb0582a req-0770241a-c549-4e4c-87ed-30135f8ee3a4 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:17.559764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9dbe1274-e2d0-4e3d-a5ce-c8c3ddb0582a req-0770241a-c549-4e4c-87ed-30135f8ee3a4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:17.565947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9dbe1274-e2d0-4e3d-a5ce-c8c3ddb0582a req-0770241a-c549-4e4c-87ed-30135f8ee3a4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:17.578358 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-9dbe1274-e2d0-4e3d-a5ce-c8c3ddb0582a req-0770241a-c549-4e4c-87ed-30135f8ee3a4 service nova] Creating event network-changed:260d45a4-8311-4a41-a480-de2b98950b06 for instance 277b318c-bc53-4c0d-997b-8c96d92ce41b on n-h2-862964-3 Oct 29 01:19:17.583504 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-9dbe1274-e2d0-4e3d-a5ce-c8c3ddb0582a req-0770241a-c549-4e4c-87ed-30135f8ee3a4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038168 Oct 29 01:19:17.584310 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1924/3664] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:19:17.696499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b73bb356-987f-44fa-97af-a6d5b0d52e40 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:17.704094 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b73bb356-987f-44fa-97af-a6d5b0d52e40 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 200 len: 1308 microversion: 2.1 time: 0.164687 Oct 29 01:19:17.704682 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1741/3665] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:17 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 1308 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:18.047154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-499d7854-ea43-4426-81b2-04cde25de8ee tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:18.047841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-499d7854-ea43-4426-81b2-04cde25de8ee tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:18.055508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-499d7854-ea43-4426-81b2-04cde25de8ee tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:18.055508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-499d7854-ea43-4426-81b2-04cde25de8ee tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:18.055508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-499d7854-ea43-4426-81b2-04cde25de8ee tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:18.056017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-499d7854-ea43-4426-81b2-04cde25de8ee tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:18.056518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-499d7854-ea43-4426-81b2-04cde25de8ee tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:18.056942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-499d7854-ea43-4426-81b2-04cde25de8ee tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:18.134030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-499d7854-ea43-4426-81b2-04cde25de8ee tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:18.141500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-499d7854-ea43-4426-81b2-04cde25de8ee tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:18.142781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7947686f-de18-4d78-8852-999ec097151c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:18.142957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-499d7854-ea43-4426-81b2-04cde25de8ee tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:18.143399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7947686f-de18-4d78-8852-999ec097151c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:18.144146 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-499d7854-ea43-4426-81b2-04cde25de8ee tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.102396 Oct 29 01:19:18.145013 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1925/3666] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:18 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:18.149693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7947686f-de18-4d78-8852-999ec097151c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:18.150175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7947686f-de18-4d78-8852-999ec097151c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:18.150613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7947686f-de18-4d78-8852-999ec097151c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:18.151317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7947686f-de18-4d78-8852-999ec097151c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:18.152330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7947686f-de18-4d78-8852-999ec097151c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:18.152767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7947686f-de18-4d78-8852-999ec097151c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:18.288587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7947686f-de18-4d78-8852-999ec097151c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:18.297065 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7947686f-de18-4d78-8852-999ec097151c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 200 len: 1309 microversion: 2.1 time: 0.159424 Oct 29 01:19:18.297689 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1742/3667] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:18 2022] GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 1309 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:18.494693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-91da32b5-0861-478a-b71d-c7741cdd49c2 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:18.495424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-91da32b5-0861-478a-b71d-c7741cdd49c2 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:18.502940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91da32b5-0861-478a-b71d-c7741cdd49c2 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:18.503673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91da32b5-0861-478a-b71d-c7741cdd49c2 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:18.504326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91da32b5-0861-478a-b71d-c7741cdd49c2 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:18.505034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91da32b5-0861-478a-b71d-c7741cdd49c2 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:18.505708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91da32b5-0861-478a-b71d-c7741cdd49c2 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:18.506299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-91da32b5-0861-478a-b71d-c7741cdd49c2 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:18.583905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-91da32b5-0861-478a-b71d-c7741cdd49c2 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:18.592397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:18.595270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-91da32b5-0861-478a-b71d-c7741cdd49c2 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:18.596996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-91da32b5-0861-478a-b71d-c7741cdd49c2 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:18.603652 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-91da32b5-0861-478a-b71d-c7741cdd49c2 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.115057 Oct 29 01:19:18.604185 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1926/3668] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:18 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:18.726603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b73b3dc4-aae6-4078-b94f-36f27afdd31e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:18.728310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b73b3dc4-aae6-4078-b94f-36f27afdd31e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:18.735132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b73b3dc4-aae6-4078-b94f-36f27afdd31e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:18.735610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b73b3dc4-aae6-4078-b94f-36f27afdd31e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:18.736042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b73b3dc4-aae6-4078-b94f-36f27afdd31e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:18.736723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b73b3dc4-aae6-4078-b94f-36f27afdd31e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:18.737199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b73b3dc4-aae6-4078-b94f-36f27afdd31e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:18.737622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b73b3dc4-aae6-4078-b94f-36f27afdd31e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:18.938384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b73b3dc4-aae6-4078-b94f-36f27afdd31e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:18.948584 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b73b3dc4-aae6-4078-b94f-36f27afdd31e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 200 len: 1308 microversion: 2.1 time: 0.225872 Oct 29 01:19:18.951970 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1743/3669] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:18 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:19.174229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2ad9e154-5999-425b-976b-d7524aeb67e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:19.175642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2ad9e154-5999-425b-976b-d7524aeb67e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:19.185337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ad9e154-5999-425b-976b-d7524aeb67e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:19.185892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ad9e154-5999-425b-976b-d7524aeb67e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:19.186560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ad9e154-5999-425b-976b-d7524aeb67e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:19.187686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ad9e154-5999-425b-976b-d7524aeb67e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:19.188338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ad9e154-5999-425b-976b-d7524aeb67e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:19.190272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ad9e154-5999-425b-976b-d7524aeb67e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:19.300119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2ad9e154-5999-425b-976b-d7524aeb67e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:19.300119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2ad9e154-5999-425b-976b-d7524aeb67e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:19.300714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2ad9e154-5999-425b-976b-d7524aeb67e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:19.301751 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2ad9e154-5999-425b-976b-d7524aeb67e6 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.134748 Oct 29 01:19:19.302320 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1927/3670] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:19 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:19.326693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a80f3d41-f8e1-4ec9-8234-e7be93430fb6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:19.326916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a80f3d41-f8e1-4ec9-8234-e7be93430fb6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:19.338110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a80f3d41-f8e1-4ec9-8234-e7be93430fb6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:19.338694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a80f3d41-f8e1-4ec9-8234-e7be93430fb6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:19.339254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a80f3d41-f8e1-4ec9-8234-e7be93430fb6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:19.340210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a80f3d41-f8e1-4ec9-8234-e7be93430fb6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:19.340867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a80f3d41-f8e1-4ec9-8234-e7be93430fb6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:19.341586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a80f3d41-f8e1-4ec9-8234-e7be93430fb6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:19.488517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a80f3d41-f8e1-4ec9-8234-e7be93430fb6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:19.490933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:19.497757 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a80f3d41-f8e1-4ec9-8234-e7be93430fb6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 200 len: 1309 microversion: 2.1 time: 0.179430 Oct 29 01:19:19.498458 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1744/3671] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:19 2022] GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 1309 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:19.631136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0460abae-12f2-46d7-9fcf-6870d31264ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:19.631546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0460abae-12f2-46d7-9fcf-6870d31264ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:19.634783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:19.635471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:19.640346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0460abae-12f2-46d7-9fcf-6870d31264ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:19.640840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0460abae-12f2-46d7-9fcf-6870d31264ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:19.641311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0460abae-12f2-46d7-9fcf-6870d31264ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:19.642022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0460abae-12f2-46d7-9fcf-6870d31264ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:19.642483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0460abae-12f2-46d7-9fcf-6870d31264ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:19.642912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0460abae-12f2-46d7-9fcf-6870d31264ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:19.786893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0460abae-12f2-46d7-9fcf-6870d31264ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:19.796088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0460abae-12f2-46d7-9fcf-6870d31264ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:19.797873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0460abae-12f2-46d7-9fcf-6870d31264ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:19.802958 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0460abae-12f2-46d7-9fcf-6870d31264ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.176133 Oct 29 01:19:19.803567 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1928/3672] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:19 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:19.972592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b1d57a55-e61d-46b5-9341-18e2b2530fef tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:19.974739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b1d57a55-e61d-46b5-9341-18e2b2530fef tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:19.994604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1d57a55-e61d-46b5-9341-18e2b2530fef tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:19.998906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1d57a55-e61d-46b5-9341-18e2b2530fef tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:20.000386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1d57a55-e61d-46b5-9341-18e2b2530fef tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:20.004963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1d57a55-e61d-46b5-9341-18e2b2530fef tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:20.006002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1d57a55-e61d-46b5-9341-18e2b2530fef tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:20.006684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1d57a55-e61d-46b5-9341-18e2b2530fef tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:20.016821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=18 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:20.020227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:20.185116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b1d57a55-e61d-46b5-9341-18e2b2530fef tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:20.192934 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b1d57a55-e61d-46b5-9341-18e2b2530fef tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 200 len: 1308 microversion: 2.1 time: 0.225053 Oct 29 01:19:20.193705 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1745/3673] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:19 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 1308 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:20.333472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e5927490-5635-456a-8ead-77635fcdd17b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:20.335503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e5927490-5635-456a-8ead-77635fcdd17b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:20.338899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=8 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:20.351678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5927490-5635-456a-8ead-77635fcdd17b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:20.352217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5927490-5635-456a-8ead-77635fcdd17b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:20.352828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5927490-5635-456a-8ead-77635fcdd17b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:20.353444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5927490-5635-456a-8ead-77635fcdd17b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:20.353988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5927490-5635-456a-8ead-77635fcdd17b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:20.354327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5927490-5635-456a-8ead-77635fcdd17b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:20.413888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e6f789ab-2252-45e3-9c24-9f56992c59cc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:20.420757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e6f789ab-2252-45e3-9c24-9f56992c59cc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:20.421350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e6f789ab-2252-45e3-9c24-9f56992c59cc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:20.422545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e6f789ab-2252-45e3-9c24-9f56992c59cc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:20.441134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e5927490-5635-456a-8ead-77635fcdd17b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:20.449890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e6f789ab-2252-45e3-9c24-9f56992c59cc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Going to try to stop instance {{(pid=121100) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 01:19:20.452481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e5927490-5635-456a-8ead-77635fcdd17b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:20.455090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e5927490-5635-456a-8ead-77635fcdd17b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:20.456340 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e5927490-5635-456a-8ead-77635fcdd17b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.128277 Oct 29 01:19:20.457304 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1929/3674] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:20 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:20.526112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b6a35b17-7f3e-4735-84a7-b2660787202f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:20.526760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b6a35b17-7f3e-4735-84a7-b2660787202f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:20.533408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6a35b17-7f3e-4735-84a7-b2660787202f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:20.534279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6a35b17-7f3e-4735-84a7-b2660787202f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:20.534880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6a35b17-7f3e-4735-84a7-b2660787202f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:20.536837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6a35b17-7f3e-4735-84a7-b2660787202f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:20.537498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6a35b17-7f3e-4735-84a7-b2660787202f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:20.538108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6a35b17-7f3e-4735-84a7-b2660787202f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:20.670848 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e6f789ab-2252-45e3-9c24-9f56992c59cc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "POST /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3/action" status: 202 len: 0 microversion: 2.1 time: 0.261767 Oct 29 01:19:20.671731 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1746/3675] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:19:20 2022] POST /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:19:20.680846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5c97b86f-719e-4b6b-955f-b22d8ddf331b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:20.681674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5c97b86f-719e-4b6b-955f-b22d8ddf331b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:20.689080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c97b86f-719e-4b6b-955f-b22d8ddf331b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:20.689638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c97b86f-719e-4b6b-955f-b22d8ddf331b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:20.690077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c97b86f-719e-4b6b-955f-b22d8ddf331b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:20.690843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c97b86f-719e-4b6b-955f-b22d8ddf331b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:20.691474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c97b86f-719e-4b6b-955f-b22d8ddf331b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:20.692087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c97b86f-719e-4b6b-955f-b22d8ddf331b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:20.777182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b6a35b17-7f3e-4735-84a7-b2660787202f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:20.792909 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b6a35b17-7f3e-4735-84a7-b2660787202f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 200 len: 1309 microversion: 2.1 time: 0.272399 Oct 29 01:19:20.812117 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1930/3676] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:20 2022] GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 1309 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:20.833663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-019b9be7-0fd0-4d0e-a03b-8d9d9ff5fdec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:20.834077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-019b9be7-0fd0-4d0e-a03b-8d9d9ff5fdec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:20.842535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-019b9be7-0fd0-4d0e-a03b-8d9d9ff5fdec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:20.843101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-019b9be7-0fd0-4d0e-a03b-8d9d9ff5fdec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:20.850968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-019b9be7-0fd0-4d0e-a03b-8d9d9ff5fdec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:20.850968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-019b9be7-0fd0-4d0e-a03b-8d9d9ff5fdec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:20.850968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-019b9be7-0fd0-4d0e-a03b-8d9d9ff5fdec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:20.850968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-019b9be7-0fd0-4d0e-a03b-8d9d9ff5fdec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:20.936884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-019b9be7-0fd0-4d0e-a03b-8d9d9ff5fdec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:20.945211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-019b9be7-0fd0-4d0e-a03b-8d9d9ff5fdec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:20.947205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-019b9be7-0fd0-4d0e-a03b-8d9d9ff5fdec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:20.952455 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-019b9be7-0fd0-4d0e-a03b-8d9d9ff5fdec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.124297 Oct 29 01:19:20.952599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5c97b86f-719e-4b6b-955f-b22d8ddf331b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:20.953081 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1931/3677] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:20 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:20.962006 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5c97b86f-719e-4b6b-955f-b22d8ddf331b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.285325 Oct 29 01:19:20.962758 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1747/3678] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:20 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:21.218390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-43d75591-b035-4ee8-ab73-7c3d35eabaf2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:21.218919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-43d75591-b035-4ee8-ab73-7c3d35eabaf2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:21.224838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43d75591-b035-4ee8-ab73-7c3d35eabaf2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:21.225453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43d75591-b035-4ee8-ab73-7c3d35eabaf2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:21.225892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43d75591-b035-4ee8-ab73-7c3d35eabaf2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:21.231438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43d75591-b035-4ee8-ab73-7c3d35eabaf2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:21.231438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43d75591-b035-4ee8-ab73-7c3d35eabaf2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:21.231438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43d75591-b035-4ee8-ab73-7c3d35eabaf2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:21.377070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-43d75591-b035-4ee8-ab73-7c3d35eabaf2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:21.386014 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-43d75591-b035-4ee8-ab73-7c3d35eabaf2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 200 len: 1308 microversion: 2.1 time: 0.171630 Oct 29 01:19:21.386586 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1932/3679] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:21 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 1308 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:21.484553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-54192bc9-1e99-4149-8ea7-0b74a3eeec64 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:21.485326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-54192bc9-1e99-4149-8ea7-0b74a3eeec64 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:21.493316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54192bc9-1e99-4149-8ea7-0b74a3eeec64 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:21.494059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54192bc9-1e99-4149-8ea7-0b74a3eeec64 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:21.494500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54192bc9-1e99-4149-8ea7-0b74a3eeec64 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:21.495205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54192bc9-1e99-4149-8ea7-0b74a3eeec64 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:21.495691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54192bc9-1e99-4149-8ea7-0b74a3eeec64 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:21.496118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54192bc9-1e99-4149-8ea7-0b74a3eeec64 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:21.576545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-54192bc9-1e99-4149-8ea7-0b74a3eeec64 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:21.587309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-54192bc9-1e99-4149-8ea7-0b74a3eeec64 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:21.589147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-54192bc9-1e99-4149-8ea7-0b74a3eeec64 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:21.599176 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-54192bc9-1e99-4149-8ea7-0b74a3eeec64 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.118695 Oct 29 01:19:21.600215 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1748/3680] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:21 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:21.819689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9a64d102-8c34-4149-ba3c-4788193804a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:21.820303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9a64d102-8c34-4149-ba3c-4788193804a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:21.826504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a64d102-8c34-4149-ba3c-4788193804a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:21.826985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a64d102-8c34-4149-ba3c-4788193804a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:21.827449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a64d102-8c34-4149-ba3c-4788193804a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:21.828138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a64d102-8c34-4149-ba3c-4788193804a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:21.828716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a64d102-8c34-4149-ba3c-4788193804a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:21.829143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a64d102-8c34-4149-ba3c-4788193804a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:21.981960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4391ecc9-0a22-40b8-b57b-139000ea9137 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:21.982992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4391ecc9-0a22-40b8-b57b-139000ea9137 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:21.995982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4391ecc9-0a22-40b8-b57b-139000ea9137 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:21.996747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4391ecc9-0a22-40b8-b57b-139000ea9137 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:21.998737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9a64d102-8c34-4149-ba3c-4788193804a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:21.999402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4391ecc9-0a22-40b8-b57b-139000ea9137 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:22.004123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4391ecc9-0a22-40b8-b57b-139000ea9137 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:22.004123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4391ecc9-0a22-40b8-b57b-139000ea9137 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:22.004123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4391ecc9-0a22-40b8-b57b-139000ea9137 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:22.012311 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9a64d102-8c34-4149-ba3c-4788193804a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 200 len: 1309 microversion: 2.1 time: 0.195554 Oct 29 01:19:22.012950 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1933/3681] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:21 2022] GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 1309 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:22.038241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4c0b1b2f-9c02-4d40-b7fe-31aaf3315130 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:22.038923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4c0b1b2f-9c02-4d40-b7fe-31aaf3315130 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:22.046662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c0b1b2f-9c02-4d40-b7fe-31aaf3315130 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:22.047172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c0b1b2f-9c02-4d40-b7fe-31aaf3315130 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:22.047686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c0b1b2f-9c02-4d40-b7fe-31aaf3315130 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:22.048396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c0b1b2f-9c02-4d40-b7fe-31aaf3315130 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:22.049043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c0b1b2f-9c02-4d40-b7fe-31aaf3315130 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:22.049664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c0b1b2f-9c02-4d40-b7fe-31aaf3315130 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:22.093638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4391ecc9-0a22-40b8-b57b-139000ea9137 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:22.105005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4391ecc9-0a22-40b8-b57b-139000ea9137 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:22.105005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4391ecc9-0a22-40b8-b57b-139000ea9137 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:22.110443 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4391ecc9-0a22-40b8-b57b-139000ea9137 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.132928 Oct 29 01:19:22.111399 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1749/3682] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:21 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:22.197758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4c0b1b2f-9c02-4d40-b7fe-31aaf3315130 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:22.206127 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4c0b1b2f-9c02-4d40-b7fe-31aaf3315130 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.176999 Oct 29 01:19:22.206712 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1934/3683] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:22 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:22.410660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2b0a02d7-6178-4c9d-bdb4-a26202d17279 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:22.411380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2b0a02d7-6178-4c9d-bdb4-a26202d17279 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:22.419892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b0a02d7-6178-4c9d-bdb4-a26202d17279 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:22.420490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b0a02d7-6178-4c9d-bdb4-a26202d17279 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:22.420997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b0a02d7-6178-4c9d-bdb4-a26202d17279 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:22.422060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b0a02d7-6178-4c9d-bdb4-a26202d17279 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:22.428246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b0a02d7-6178-4c9d-bdb4-a26202d17279 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:22.430061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b0a02d7-6178-4c9d-bdb4-a26202d17279 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:22.573739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2b0a02d7-6178-4c9d-bdb4-a26202d17279 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:22.581669 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2b0a02d7-6178-4c9d-bdb4-a26202d17279 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 200 len: 1308 microversion: 2.1 time: 0.175201 Oct 29 01:19:22.582231 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1750/3684] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:22 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:22.627976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c24af621-ad11-4fe6-9e82-311e8710a838 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:22.632554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c24af621-ad11-4fe6-9e82-311e8710a838 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:22.640530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c24af621-ad11-4fe6-9e82-311e8710a838 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:22.643417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c24af621-ad11-4fe6-9e82-311e8710a838 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:22.644020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c24af621-ad11-4fe6-9e82-311e8710a838 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:22.647868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c24af621-ad11-4fe6-9e82-311e8710a838 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:22.648481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c24af621-ad11-4fe6-9e82-311e8710a838 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:22.649040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c24af621-ad11-4fe6-9e82-311e8710a838 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:22.738969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c24af621-ad11-4fe6-9e82-311e8710a838 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:22.749499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c24af621-ad11-4fe6-9e82-311e8710a838 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:22.750953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c24af621-ad11-4fe6-9e82-311e8710a838 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:22.752194 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c24af621-ad11-4fe6-9e82-311e8710a838 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.128196 Oct 29 01:19:22.752771 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1935/3685] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:22 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:22.988327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-30fa9ba5-1152-4d29-be3e-052f87872b18 req-fff08f81-289a-4411-984d-31290ff17f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efedae7c-2224-41e7-8493-0bcb9dc4535c", "name": "network-vif-plugged", "status": "completed", "tag": "86eb1942-90d8-44e3-a515-27c49c919b9b"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:23.000373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-30fa9ba5-1152-4d29-be3e-052f87872b18 req-fff08f81-289a-4411-984d-31290ff17f50 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:23.000950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-30fa9ba5-1152-4d29-be3e-052f87872b18 req-fff08f81-289a-4411-984d-31290ff17f50 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:23.001623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-30fa9ba5-1152-4d29-be3e-052f87872b18 req-fff08f81-289a-4411-984d-31290ff17f50 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:23.014658 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-30fa9ba5-1152-4d29-be3e-052f87872b18 req-fff08f81-289a-4411-984d-31290ff17f50 service nova] Creating event network-vif-plugged:86eb1942-90d8-44e3-a515-27c49c919b9b for instance efedae7c-2224-41e7-8493-0bcb9dc4535c on n-h2-862964-3 Oct 29 01:19:23.019899 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-30fa9ba5-1152-4d29-be3e-052f87872b18 req-fff08f81-289a-4411-984d-31290ff17f50 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035745 Oct 29 01:19:23.020642 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1751/3686] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:23.037468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fcf5e7d1-ed17-404e-bc34-180e3a742646 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:23.039113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fcf5e7d1-ed17-404e-bc34-180e3a742646 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:23.049334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fcf5e7d1-ed17-404e-bc34-180e3a742646 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:23.050217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fcf5e7d1-ed17-404e-bc34-180e3a742646 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:23.050917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fcf5e7d1-ed17-404e-bc34-180e3a742646 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:23.051932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fcf5e7d1-ed17-404e-bc34-180e3a742646 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:23.053361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fcf5e7d1-ed17-404e-bc34-180e3a742646 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:23.054602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fcf5e7d1-ed17-404e-bc34-180e3a742646 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:23.141609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7db9f595-0b25-4a3e-a451-d0be2029ab0c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:23.142577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7db9f595-0b25-4a3e-a451-d0be2029ab0c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:23.150929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db9f595-0b25-4a3e-a451-d0be2029ab0c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:23.151645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db9f595-0b25-4a3e-a451-d0be2029ab0c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:23.152082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db9f595-0b25-4a3e-a451-d0be2029ab0c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:23.152790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db9f595-0b25-4a3e-a451-d0be2029ab0c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:23.153473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db9f595-0b25-4a3e-a451-d0be2029ab0c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:23.154059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db9f595-0b25-4a3e-a451-d0be2029ab0c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:23.275755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7db9f595-0b25-4a3e-a451-d0be2029ab0c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:23.294445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fcf5e7d1-ed17-404e-bc34-180e3a742646 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:23.303672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7db9f595-0b25-4a3e-a451-d0be2029ab0c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:23.306323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7db9f595-0b25-4a3e-a451-d0be2029ab0c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:23.307408 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fcf5e7d1-ed17-404e-bc34-180e3a742646 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 200 len: 1309 microversion: 2.1 time: 0.271763 Oct 29 01:19:23.321216 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1936/3687] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:23 2022] GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 1309 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:23.321216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0f2b88f6-594c-414c-833b-9cdef0e159a2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:23.321216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0f2b88f6-594c-414c-833b-9cdef0e159a2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:23.325821 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7db9f595-0b25-4a3e-a451-d0be2029ab0c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1556 microversion: 2.91 time: 0.187631 Oct 29 01:19:23.329524 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1752/3688] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:23 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1556 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:23.335760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f2b88f6-594c-414c-833b-9cdef0e159a2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:23.337967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f2b88f6-594c-414c-833b-9cdef0e159a2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:23.337967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f2b88f6-594c-414c-833b-9cdef0e159a2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:23.338696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f2b88f6-594c-414c-833b-9cdef0e159a2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:23.339259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f2b88f6-594c-414c-833b-9cdef0e159a2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:23.339780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f2b88f6-594c-414c-833b-9cdef0e159a2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:23.481660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0f2b88f6-594c-414c-833b-9cdef0e159a2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:23.490019 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0f2b88f6-594c-414c-833b-9cdef0e159a2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.179829 Oct 29 01:19:23.490593 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1937/3689] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:23 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:23.606592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-928e089d-8ddd-4931-a24c-8a7a572f6127 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:23.607925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-928e089d-8ddd-4931-a24c-8a7a572f6127 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:23.621996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-928e089d-8ddd-4931-a24c-8a7a572f6127 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:23.622933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-928e089d-8ddd-4931-a24c-8a7a572f6127 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:23.624872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-928e089d-8ddd-4931-a24c-8a7a572f6127 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:23.626145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-928e089d-8ddd-4931-a24c-8a7a572f6127 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:23.627236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-928e089d-8ddd-4931-a24c-8a7a572f6127 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:23.628212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-928e089d-8ddd-4931-a24c-8a7a572f6127 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:23.778837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b2bb10f0-363b-47e3-9c0c-99f86071d783 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:23.779458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b2bb10f0-363b-47e3-9c0c-99f86071d783 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:23.793295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b2bb10f0-363b-47e3-9c0c-99f86071d783 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:23.794026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b2bb10f0-363b-47e3-9c0c-99f86071d783 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:23.794640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b2bb10f0-363b-47e3-9c0c-99f86071d783 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:23.795519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b2bb10f0-363b-47e3-9c0c-99f86071d783 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:23.797804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b2bb10f0-363b-47e3-9c0c-99f86071d783 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:23.797804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b2bb10f0-363b-47e3-9c0c-99f86071d783 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:23.905281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b2bb10f0-363b-47e3-9c0c-99f86071d783 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:23.917331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-928e089d-8ddd-4931-a24c-8a7a572f6127 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:23.924534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b2bb10f0-363b-47e3-9c0c-99f86071d783 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:23.928227 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-928e089d-8ddd-4931-a24c-8a7a572f6127 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 200 len: 1308 microversion: 2.1 time: 0.326639 Oct 29 01:19:23.937436 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1753/3690] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:23 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 1308 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:23.937544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b2bb10f0-363b-47e3-9c0c-99f86071d783 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:23.937544 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b2bb10f0-363b-47e3-9c0c-99f86071d783 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.159348 Oct 29 01:19:23.937544 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1938/3691] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:23 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:24.332630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aa122a95-dddf-4b10-8d56-5caffdee70c8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:24.333406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aa122a95-dddf-4b10-8d56-5caffdee70c8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:24.340745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa122a95-dddf-4b10-8d56-5caffdee70c8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:24.343573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa122a95-dddf-4b10-8d56-5caffdee70c8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:24.344196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa122a95-dddf-4b10-8d56-5caffdee70c8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:24.345174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa122a95-dddf-4b10-8d56-5caffdee70c8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:24.345793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa122a95-dddf-4b10-8d56-5caffdee70c8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:24.346402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa122a95-dddf-4b10-8d56-5caffdee70c8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:24.358277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-89d3652b-a76a-411c-9ace-b83d44fa524c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:24.359381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-89d3652b-a76a-411c-9ace-b83d44fa524c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:24.377219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89d3652b-a76a-411c-9ace-b83d44fa524c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:24.378256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89d3652b-a76a-411c-9ace-b83d44fa524c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:24.378944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89d3652b-a76a-411c-9ace-b83d44fa524c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:24.379904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89d3652b-a76a-411c-9ace-b83d44fa524c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:24.380444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89d3652b-a76a-411c-9ace-b83d44fa524c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:24.380945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89d3652b-a76a-411c-9ace-b83d44fa524c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:24.509308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-89d3652b-a76a-411c-9ace-b83d44fa524c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:24.526427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-89d3652b-a76a-411c-9ace-b83d44fa524c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:24.528662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-89d3652b-a76a-411c-9ace-b83d44fa524c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:24.541131 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-89d3652b-a76a-411c-9ace-b83d44fa524c tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1556 microversion: 2.91 time: 0.186682 Oct 29 01:19:24.541826 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1939/3692] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:24 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1556 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:24.547375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4b8ff3fd-9946-45ba-a022-12ed8939bc18 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:24.548243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4b8ff3fd-9946-45ba-a022-12ed8939bc18 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:24.578375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b8ff3fd-9946-45ba-a022-12ed8939bc18 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:24.579381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b8ff3fd-9946-45ba-a022-12ed8939bc18 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:24.580023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b8ff3fd-9946-45ba-a022-12ed8939bc18 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:24.580861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b8ff3fd-9946-45ba-a022-12ed8939bc18 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:24.581360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b8ff3fd-9946-45ba-a022-12ed8939bc18 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:24.582147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b8ff3fd-9946-45ba-a022-12ed8939bc18 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:24.627560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aa122a95-dddf-4b10-8d56-5caffdee70c8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:24.636614 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aa122a95-dddf-4b10-8d56-5caffdee70c8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 200 len: 1309 microversion: 2.1 time: 0.308380 Oct 29 01:19:24.637546 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1754/3693] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:24 2022] GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 1309 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:24.807943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4b8ff3fd-9946-45ba-a022-12ed8939bc18 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:24.819857 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4b8ff3fd-9946-45ba-a022-12ed8939bc18 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.276728 Oct 29 01:19:24.821323 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1940/3694] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:24 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:24.964438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ece99cd7-af19-45dd-90da-2bc6983bb64d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:24.964687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-23226ff5-01af-471c-aaef-43e3e3974f54 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:24.970927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-23226ff5-01af-471c-aaef-43e3e3974f54 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:24.971531 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ece99cd7-af19-45dd-90da-2bc6983bb64d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:24.989666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23226ff5-01af-471c-aaef-43e3e3974f54 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:24.990647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ece99cd7-af19-45dd-90da-2bc6983bb64d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:24.992955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23226ff5-01af-471c-aaef-43e3e3974f54 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:24.993510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ece99cd7-af19-45dd-90da-2bc6983bb64d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:24.994187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ece99cd7-af19-45dd-90da-2bc6983bb64d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:24.995162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23226ff5-01af-471c-aaef-43e3e3974f54 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:24.996682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ece99cd7-af19-45dd-90da-2bc6983bb64d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:24.998313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ece99cd7-af19-45dd-90da-2bc6983bb64d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:24.998613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23226ff5-01af-471c-aaef-43e3e3974f54 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:24.999535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23226ff5-01af-471c-aaef-43e3e3974f54 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:25.000526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ece99cd7-af19-45dd-90da-2bc6983bb64d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:25.002395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23226ff5-01af-471c-aaef-43e3e3974f54 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:25.283592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-23226ff5-01af-471c-aaef-43e3e3974f54 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:25.299692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-23226ff5-01af-471c-aaef-43e3e3974f54 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:25.302256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-23226ff5-01af-471c-aaef-43e3e3974f54 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:25.306181 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-23226ff5-01af-471c-aaef-43e3e3974f54 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.350042 Oct 29 01:19:25.307088 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1941/3695] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:24 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:25.514736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ece99cd7-af19-45dd-90da-2bc6983bb64d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:25.529387 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ece99cd7-af19-45dd-90da-2bc6983bb64d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 200 len: 1308 microversion: 2.1 time: 0.577602 Oct 29 01:19:25.530434 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1755/3696] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:24 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 1308 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:25.587300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb905740-4e14-4d8a-a06f-a9eedbe593b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:25.588151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bb905740-4e14-4d8a-a06f-a9eedbe593b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:25.602869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb905740-4e14-4d8a-a06f-a9eedbe593b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:25.606339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb905740-4e14-4d8a-a06f-a9eedbe593b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:25.607070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb905740-4e14-4d8a-a06f-a9eedbe593b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:25.608864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb905740-4e14-4d8a-a06f-a9eedbe593b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:25.609554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb905740-4e14-4d8a-a06f-a9eedbe593b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:25.611272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb905740-4e14-4d8a-a06f-a9eedbe593b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:25.661926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fde2d6ec-982d-49ce-82b2-3a21edf8a838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:25.662549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fde2d6ec-982d-49ce-82b2-3a21edf8a838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:25.686869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fde2d6ec-982d-49ce-82b2-3a21edf8a838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:25.687289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fde2d6ec-982d-49ce-82b2-3a21edf8a838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:25.687728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fde2d6ec-982d-49ce-82b2-3a21edf8a838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:25.688460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fde2d6ec-982d-49ce-82b2-3a21edf8a838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:25.688941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fde2d6ec-982d-49ce-82b2-3a21edf8a838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:25.689378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fde2d6ec-982d-49ce-82b2-3a21edf8a838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:25.804370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bb905740-4e14-4d8a-a06f-a9eedbe593b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:25.817878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bb905740-4e14-4d8a-a06f-a9eedbe593b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:25.820968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bb905740-4e14-4d8a-a06f-a9eedbe593b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:25.829671 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bb905740-4e14-4d8a-a06f-a9eedbe593b4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1556 microversion: 2.91 time: 0.256727 Oct 29 01:19:25.831234 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1942/3697] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:25 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1556 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:25.854234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-65f10299-3a07-44a1-bde5-e6347b1c54af tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:25.855168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-65f10299-3a07-44a1-bde5-e6347b1c54af tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:25.864659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65f10299-3a07-44a1-bde5-e6347b1c54af tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:25.865573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65f10299-3a07-44a1-bde5-e6347b1c54af tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:25.866904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65f10299-3a07-44a1-bde5-e6347b1c54af tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:25.868172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65f10299-3a07-44a1-bde5-e6347b1c54af tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:25.868820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65f10299-3a07-44a1-bde5-e6347b1c54af tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:25.869452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-65f10299-3a07-44a1-bde5-e6347b1c54af tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:25.909994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:26.052162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fde2d6ec-982d-49ce-82b2-3a21edf8a838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:26.069087 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fde2d6ec-982d-49ce-82b2-3a21edf8a838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 200 len: 1489 microversion: 2.1 time: 0.408976 Oct 29 01:19:26.069087 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1756/3698] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:25 2022] GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 1489 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:26.134683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-65f10299-3a07-44a1-bde5-e6347b1c54af tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:26.150330 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-65f10299-3a07-44a1-bde5-e6347b1c54af tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.304132 Oct 29 01:19:26.160767 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1943/3699] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:25 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:26.225961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e4af6269-0d78-46ba-ba18-90c751de45e8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1854404492", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "b5b62219-8a2f-42eb-b795-dd5a026e1972"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:26.324283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-e4af6269-0d78-46ba-ba18-90c751de45e8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] validate_networks() for [('b5b62219-8a2f-42eb-b795-dd5a026e1972', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:19:26.337006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3ded6c36-c3f8-410d-987b-353c0f301cfe tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:26.337886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3ded6c36-c3f8-410d-987b-353c0f301cfe tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:26.349583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ded6c36-c3f8-410d-987b-353c0f301cfe tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:26.350242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ded6c36-c3f8-410d-987b-353c0f301cfe tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:26.350943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ded6c36-c3f8-410d-987b-353c0f301cfe tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:26.353447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ded6c36-c3f8-410d-987b-353c0f301cfe tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:26.354135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ded6c36-c3f8-410d-987b-353c0f301cfe tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:26.354651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ded6c36-c3f8-410d-987b-353c0f301cfe tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:26.827962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3ded6c36-c3f8-410d-987b-353c0f301cfe tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:26.849763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3ded6c36-c3f8-410d-987b-353c0f301cfe tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:26.851600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3ded6c36-c3f8-410d-987b-353c0f301cfe tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:26.854137 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3ded6c36-c3f8-410d-987b-353c0f301cfe tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.521849 Oct 29 01:19:26.866100 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1944/3700] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:26 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:26.866100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-11e300f2-d2f2-4481-b01e-f9a939ba87ff tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:26.871580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-11e300f2-d2f2-4481-b01e-f9a939ba87ff tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:26.876159 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11e300f2-d2f2-4481-b01e-f9a939ba87ff tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:26.877113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11e300f2-d2f2-4481-b01e-f9a939ba87ff tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:26.877955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11e300f2-d2f2-4481-b01e-f9a939ba87ff tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:26.879010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11e300f2-d2f2-4481-b01e-f9a939ba87ff tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:26.879477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11e300f2-d2f2-4481-b01e-f9a939ba87ff tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:26.880228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11e300f2-d2f2-4481-b01e-f9a939ba87ff tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:27.252959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-11e300f2-d2f2-4481-b01e-f9a939ba87ff tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:27.268953 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-11e300f2-d2f2-4481-b01e-f9a939ba87ff tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 200 len: 1308 microversion: 2.1 time: 0.410645 Oct 29 01:19:27.269673 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1945/3701] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:26 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 1308 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:27.275690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c6b4a313-ee6c-4d15-9e2c-ac99cb4ad179 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Action: 'create', calling method: .version_select at 0x7f9d979cf820>, body: {"keypair": {"name": "tempest-keypair-1235386955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7eyo/3OuR9com33NCY5uf7R/r193CpjBqXQvyOR6T6pgxlmrOy2XstIMXZpt+lsLblRWmrUqgEBJ5uVFXlRrOKjrRUHlYBbgVxWutRqpzP1ZBCpJS2PUFgWZ7LVcVBrQ=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:27.294812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-c6b4a313-ee6c-4d15-9e2c-ac99cb4ad179 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Getting quotas for project c226e05b4c2943a28fac5c95f02c8e68. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:19:27.300954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-c6b4a313-ee6c-4d15-9e2c-ac99cb4ad179 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Getting quotas for user 34417a5511824b5aa82ce131f6a1324c and project c226e05b4c2943a28fac5c95f02c8e68. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:19:27.436138 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c6b4a313-ee6c-4d15-9e2c-ac99cb4ad179 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.156375 Oct 29 01:19:27.436138 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1946/3702] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 29 01:19:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 01:19:27.436138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-897987e2-0f1f-446d-8081-63818727f3ef tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:27.436138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-897987e2-0f1f-446d-8081-63818727f3ef tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:27.450852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-897987e2-0f1f-446d-8081-63818727f3ef tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:27.453416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-897987e2-0f1f-446d-8081-63818727f3ef tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:27.454000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-897987e2-0f1f-446d-8081-63818727f3ef tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:27.457468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-897987e2-0f1f-446d-8081-63818727f3ef tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:27.457468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-897987e2-0f1f-446d-8081-63818727f3ef tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:27.457468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-897987e2-0f1f-446d-8081-63818727f3ef tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:27.529903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e4af6269-0d78-46ba-ba18-90c751de45e8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:19:27.531023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e4af6269-0d78-46ba-ba18-90c751de45e8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:19:27.531721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e4af6269-0d78-46ba-ba18-90c751de45e8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:19:27.535040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e4af6269-0d78-46ba-ba18-90c751de45e8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:19:27.535702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e4af6269-0d78-46ba-ba18-90c751de45e8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:19:27.550680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4af6269-0d78-46ba-ba18-90c751de45e8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:27.551303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4af6269-0d78-46ba-ba18-90c751de45e8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:27.551803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4af6269-0d78-46ba-ba18-90c751de45e8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:27.552836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4af6269-0d78-46ba-ba18-90c751de45e8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:27.553547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4af6269-0d78-46ba-ba18-90c751de45e8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:27.554192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4af6269-0d78-46ba-ba18-90c751de45e8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:27.577050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-e4af6269-0d78-46ba-ba18-90c751de45e8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Getting quotas for project 6dc302f307494a61836f3afb38dccae9. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:19:27.584552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-e4af6269-0d78-46ba-ba18-90c751de45e8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Getting quotas for user 6cb8fe33c5d64047ada50f44e01e4faa and project 6dc302f307494a61836f3afb38dccae9. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:19:27.588117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:27.592736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-897987e2-0f1f-446d-8081-63818727f3ef tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:27.605677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e4af6269-0d78-46ba-ba18-90c751de45e8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:19:27.609044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e4af6269-0d78-46ba-ba18-90c751de45e8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:19:27.619560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-897987e2-0f1f-446d-8081-63818727f3ef tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:27.621475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-897987e2-0f1f-446d-8081-63818727f3ef tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:27.629882 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-897987e2-0f1f-446d-8081-63818727f3ef tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1556 microversion: 2.91 time: 0.200957 Oct 29 01:19:27.630909 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1947/3703] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:27 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1556 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:27.637636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-89748862-4f07-4f52-88c3-a015ea70c1c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:27.651447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-89748862-4f07-4f52-88c3-a015ea70c1c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:27.651447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89748862-4f07-4f52-88c3-a015ea70c1c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:27.651447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89748862-4f07-4f52-88c3-a015ea70c1c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:27.651447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89748862-4f07-4f52-88c3-a015ea70c1c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:27.658602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89748862-4f07-4f52-88c3-a015ea70c1c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:27.659463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89748862-4f07-4f52-88c3-a015ea70c1c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:27.660144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89748862-4f07-4f52-88c3-a015ea70c1c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:27.818074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-89748862-4f07-4f52-88c3-a015ea70c1c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:27.828674 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-89748862-4f07-4f52-88c3-a015ea70c1c9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.196270 Oct 29 01:19:27.829622 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1948/3704] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:27 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:27.834362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-9ef888ac-eabb-4769-9a91-5bee18a3cdbd req-77bb03e6-cf7f-4288-8feb-dee97c0e123f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277b318c-bc53-4c0d-997b-8c96d92ce41b", "name": "network-vif-plugged", "status": "completed", "tag": "260d45a4-8311-4a41-a480-de2b98950b06"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:27.842692 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e4af6269-0d78-46ba-ba18-90c751de45e8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.620974 Oct 29 01:19:27.847156 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1757/3705] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:19:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:19:27.860594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3a029dfa-e717-4736-ade6-d55266c1c655 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:27.861249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3a029dfa-e717-4736-ade6-d55266c1c655 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:27.862724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9ef888ac-eabb-4769-9a91-5bee18a3cdbd req-77bb03e6-cf7f-4288-8feb-dee97c0e123f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:27.863233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9ef888ac-eabb-4769-9a91-5bee18a3cdbd req-77bb03e6-cf7f-4288-8feb-dee97c0e123f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:27.863720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9ef888ac-eabb-4769-9a91-5bee18a3cdbd req-77bb03e6-cf7f-4288-8feb-dee97c0e123f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:27.883609 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-9ef888ac-eabb-4769-9a91-5bee18a3cdbd req-77bb03e6-cf7f-4288-8feb-dee97c0e123f service nova] Creating event network-vif-plugged:260d45a4-8311-4a41-a480-de2b98950b06 for instance 277b318c-bc53-4c0d-997b-8c96d92ce41b on n-h2-862964-3 Oct 29 01:19:27.890279 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-9ef888ac-eabb-4769-9a91-5bee18a3cdbd req-77bb03e6-cf7f-4288-8feb-dee97c0e123f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059317 Oct 29 01:19:27.891148 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1949/3706] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:27.915643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3d8cf2bc-d31f-455f-9756-cb06e5b83922 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:27.923187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3d8cf2bc-d31f-455f-9756-cb06e5b83922 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:27.955249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d8cf2bc-d31f-455f-9756-cb06e5b83922 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:27.955776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d8cf2bc-d31f-455f-9756-cb06e5b83922 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:27.956225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d8cf2bc-d31f-455f-9756-cb06e5b83922 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:27.956971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d8cf2bc-d31f-455f-9756-cb06e5b83922 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:27.958327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d8cf2bc-d31f-455f-9756-cb06e5b83922 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:27.961887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d8cf2bc-d31f-455f-9756-cb06e5b83922 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:27.988787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3a029dfa-e717-4736-ade6-d55266c1c655 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:28.025718 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3a029dfa-e717-4736-ade6-d55266c1c655 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1209 microversion: 2.1 time: 0.147582 Oct 29 01:19:28.025718 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1758/3707] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:27 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1209 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:28.125429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3d8cf2bc-d31f-455f-9756-cb06e5b83922 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:28.134777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3d8cf2bc-d31f-455f-9756-cb06e5b83922 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:28.136224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3d8cf2bc-d31f-455f-9756-cb06e5b83922 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:28.137437 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3d8cf2bc-d31f-455f-9756-cb06e5b83922 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.245040 Oct 29 01:19:28.138004 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1950/3708] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:27 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:28.295880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bb418f1e-95f1-493a-88fc-406a92491869 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:28.296802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bb418f1e-95f1-493a-88fc-406a92491869 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:28.308005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb418f1e-95f1-493a-88fc-406a92491869 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:28.309041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb418f1e-95f1-493a-88fc-406a92491869 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:28.309659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb418f1e-95f1-493a-88fc-406a92491869 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:28.310808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb418f1e-95f1-493a-88fc-406a92491869 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:28.311832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb418f1e-95f1-493a-88fc-406a92491869 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:28.312758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb418f1e-95f1-493a-88fc-406a92491869 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:28.491916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bb418f1e-95f1-493a-88fc-406a92491869 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:28.500528 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bb418f1e-95f1-493a-88fc-406a92491869 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 200 len: 1308 microversion: 2.1 time: 0.210920 Oct 29 01:19:28.501123 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1759/3709] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:28 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 1308 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:28.665518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-52792c25-ce31-46fc-8a3b-d1f007f6d403 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:28.666505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-52792c25-ce31-46fc-8a3b-d1f007f6d403 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:28.675877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52792c25-ce31-46fc-8a3b-d1f007f6d403 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:28.678359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52792c25-ce31-46fc-8a3b-d1f007f6d403 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:28.678359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52792c25-ce31-46fc-8a3b-d1f007f6d403 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:28.678359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52792c25-ce31-46fc-8a3b-d1f007f6d403 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:28.678954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52792c25-ce31-46fc-8a3b-d1f007f6d403 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:28.679608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-52792c25-ce31-46fc-8a3b-d1f007f6d403 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:28.855053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-295d7318-5ce7-49a7-8f79-6a17b4f19788 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:28.856353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-295d7318-5ce7-49a7-8f79-6a17b4f19788 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:28.863532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-295d7318-5ce7-49a7-8f79-6a17b4f19788 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:28.864019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-295d7318-5ce7-49a7-8f79-6a17b4f19788 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:28.864475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-295d7318-5ce7-49a7-8f79-6a17b4f19788 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:28.865182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-295d7318-5ce7-49a7-8f79-6a17b4f19788 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:28.865633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-295d7318-5ce7-49a7-8f79-6a17b4f19788 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:28.866055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-295d7318-5ce7-49a7-8f79-6a17b4f19788 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:28.896003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-52792c25-ce31-46fc-8a3b-d1f007f6d403 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:28.915399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-52792c25-ce31-46fc-8a3b-d1f007f6d403 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:28.916998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-52792c25-ce31-46fc-8a3b-d1f007f6d403 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:28.926944 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-52792c25-ce31-46fc-8a3b-d1f007f6d403 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.265893 Oct 29 01:19:28.928099 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1951/3710] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:28 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:29.034743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-24a3f665-0bc6-432b-8037-b1e903b84a87 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:29.034873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-24a3f665-0bc6-432b-8037-b1e903b84a87 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:29.117046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-24a3f665-0bc6-432b-8037-b1e903b84a87 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:29.136043 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-24a3f665-0bc6-432b-8037-b1e903b84a87 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1209 microversion: 2.1 time: 0.106739 Oct 29 01:19:29.151499 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1952/3711] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:29 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1209 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:29.168393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-71d65e3f-91c3-41ac-9d4d-0133c1fe1caa tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:29.170033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-71d65e3f-91c3-41ac-9d4d-0133c1fe1caa tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:29.175664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-295d7318-5ce7-49a7-8f79-6a17b4f19788 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:29.179545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71d65e3f-91c3-41ac-9d4d-0133c1fe1caa tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:29.180271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71d65e3f-91c3-41ac-9d4d-0133c1fe1caa tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:29.181730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71d65e3f-91c3-41ac-9d4d-0133c1fe1caa tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:29.182912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71d65e3f-91c3-41ac-9d4d-0133c1fe1caa tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:29.183530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71d65e3f-91c3-41ac-9d4d-0133c1fe1caa tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:29.184151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71d65e3f-91c3-41ac-9d4d-0133c1fe1caa tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:29.189697 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-295d7318-5ce7-49a7-8f79-6a17b4f19788 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.340410 Oct 29 01:19:29.219871 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1760/3712] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:28 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:29.280251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-71d65e3f-91c3-41ac-9d4d-0133c1fe1caa tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:29.290547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-71d65e3f-91c3-41ac-9d4d-0133c1fe1caa tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:29.292087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-71d65e3f-91c3-41ac-9d4d-0133c1fe1caa tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:29.293394 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-71d65e3f-91c3-41ac-9d4d-0133c1fe1caa tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.130835 Oct 29 01:19:29.295417 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1953/3713] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:29 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:29.529740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6961b092-5972-4d5a-920f-e277ba39932c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:29.532733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6961b092-5972-4d5a-920f-e277ba39932c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:29.550261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6961b092-5972-4d5a-920f-e277ba39932c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:29.551428 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6961b092-5972-4d5a-920f-e277ba39932c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:29.552055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6961b092-5972-4d5a-920f-e277ba39932c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:29.552930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6961b092-5972-4d5a-920f-e277ba39932c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:29.553484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6961b092-5972-4d5a-920f-e277ba39932c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:29.553857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6961b092-5972-4d5a-920f-e277ba39932c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:29.862514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6961b092-5972-4d5a-920f-e277ba39932c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:29.889494 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6961b092-5972-4d5a-920f-e277ba39932c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 200 len: 1308 microversion: 2.1 time: 0.355184 Oct 29 01:19:29.890277 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1761/3714] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:29 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 1308 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:29.957090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-02410991-709a-43e8-a2db-23519420290a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:29.957740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-02410991-709a-43e8-a2db-23519420290a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:29.967462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02410991-709a-43e8-a2db-23519420290a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:29.969799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02410991-709a-43e8-a2db-23519420290a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:29.971540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02410991-709a-43e8-a2db-23519420290a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:29.972453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02410991-709a-43e8-a2db-23519420290a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:29.975606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02410991-709a-43e8-a2db-23519420290a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:29.976204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-02410991-709a-43e8-a2db-23519420290a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:30.111574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-02410991-709a-43e8-a2db-23519420290a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:30.122975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-02410991-709a-43e8-a2db-23519420290a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:30.124891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-02410991-709a-43e8-a2db-23519420290a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:30.133816 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-02410991-709a-43e8-a2db-23519420290a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.179762 Oct 29 01:19:30.137429 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1954/3715] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:29 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:30.165967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1a3323e0-6a32-4acd-b6d8-e404247b22d8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:30.166600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1a3323e0-6a32-4acd-b6d8-e404247b22d8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:30.174545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a3323e0-6a32-4acd-b6d8-e404247b22d8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:30.175113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a3323e0-6a32-4acd-b6d8-e404247b22d8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:30.175538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a3323e0-6a32-4acd-b6d8-e404247b22d8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:30.182976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a3323e0-6a32-4acd-b6d8-e404247b22d8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:30.183464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a3323e0-6a32-4acd-b6d8-e404247b22d8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:30.183905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a3323e0-6a32-4acd-b6d8-e404247b22d8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:30.226454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-76429509-18dd-4c7c-909b-06a4e90f857a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:30.227906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-76429509-18dd-4c7c-909b-06a4e90f857a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:30.236012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76429509-18dd-4c7c-909b-06a4e90f857a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:30.236723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76429509-18dd-4c7c-909b-06a4e90f857a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:30.237503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76429509-18dd-4c7c-909b-06a4e90f857a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:30.238386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76429509-18dd-4c7c-909b-06a4e90f857a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:30.238996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76429509-18dd-4c7c-909b-06a4e90f857a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:30.239591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76429509-18dd-4c7c-909b-06a4e90f857a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:30.273101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1a3323e0-6a32-4acd-b6d8-e404247b22d8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:30.282624 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1a3323e0-6a32-4acd-b6d8-e404247b22d8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1213 microversion: 2.1 time: 0.121908 Oct 29 01:19:30.283740 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1762/3716] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:30 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1213 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:30.323842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e634e80c-75d2-466d-adb0-252466876fbc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:30.324494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e634e80c-75d2-466d-adb0-252466876fbc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:30.333222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e634e80c-75d2-466d-adb0-252466876fbc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:30.335596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e634e80c-75d2-466d-adb0-252466876fbc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:30.336251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e634e80c-75d2-466d-adb0-252466876fbc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:30.337494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e634e80c-75d2-466d-adb0-252466876fbc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:30.338207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e634e80c-75d2-466d-adb0-252466876fbc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:30.338932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e634e80c-75d2-466d-adb0-252466876fbc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:30.342449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:30.499342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e634e80c-75d2-466d-adb0-252466876fbc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:30.556167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e634e80c-75d2-466d-adb0-252466876fbc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:30.559615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e634e80c-75d2-466d-adb0-252466876fbc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:30.561371 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e634e80c-75d2-466d-adb0-252466876fbc tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.242549 Oct 29 01:19:30.562429 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1763/3717] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:30 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:30.572534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-76429509-18dd-4c7c-909b-06a4e90f857a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:30.585430 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-76429509-18dd-4c7c-909b-06a4e90f857a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.362800 Oct 29 01:19:30.598154 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1955/3718] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:30 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:30.915545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5af219d6-6939-4c44-9da2-1fd55d268ed3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:30.919719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5af219d6-6939-4c44-9da2-1fd55d268ed3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:30.932328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5af219d6-6939-4c44-9da2-1fd55d268ed3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:30.933482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5af219d6-6939-4c44-9da2-1fd55d268ed3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:30.934448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5af219d6-6939-4c44-9da2-1fd55d268ed3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:30.935414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5af219d6-6939-4c44-9da2-1fd55d268ed3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:30.936708 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5af219d6-6939-4c44-9da2-1fd55d268ed3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:30.937478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5af219d6-6939-4c44-9da2-1fd55d268ed3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:31.169494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-619277ef-862e-428b-8893-99f9b9ee21e4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:31.170122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-619277ef-862e-428b-8893-99f9b9ee21e4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:31.177401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-619277ef-862e-428b-8893-99f9b9ee21e4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:31.178222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-619277ef-862e-428b-8893-99f9b9ee21e4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:31.178888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-619277ef-862e-428b-8893-99f9b9ee21e4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:31.179903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-619277ef-862e-428b-8893-99f9b9ee21e4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:31.180715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-619277ef-862e-428b-8893-99f9b9ee21e4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:31.181264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-619277ef-862e-428b-8893-99f9b9ee21e4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:31.217748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5af219d6-6939-4c44-9da2-1fd55d268ed3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:31.228442 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5af219d6-6939-4c44-9da2-1fd55d268ed3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 200 len: 1488 microversion: 2.1 time: 0.317267 Oct 29 01:19:31.240562 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1764/3719] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:30 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 1488 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:31.254968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ebf97e6c-6213-4018-8b7e-49008244072f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:31.255502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ebf97e6c-6213-4018-8b7e-49008244072f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:31.264712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ebf97e6c-6213-4018-8b7e-49008244072f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:31.265241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ebf97e6c-6213-4018-8b7e-49008244072f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:31.265898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ebf97e6c-6213-4018-8b7e-49008244072f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:31.266792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ebf97e6c-6213-4018-8b7e-49008244072f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:31.267414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ebf97e6c-6213-4018-8b7e-49008244072f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:31.267999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ebf97e6c-6213-4018-8b7e-49008244072f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:31.310803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-ebf97e6c-6213-4018-8b7e-49008244072f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lazy-loading 'flavor' on Instance uuid 277b318c-bc53-4c0d-997b-8c96d92ce41b {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:19:31.319631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-619277ef-862e-428b-8893-99f9b9ee21e4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:31.329081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-619277ef-862e-428b-8893-99f9b9ee21e4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:31.337655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-619277ef-862e-428b-8893-99f9b9ee21e4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:31.343597 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-619277ef-862e-428b-8893-99f9b9ee21e4 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.177939 Oct 29 01:19:31.354507 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1956/3720] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:31 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:31.372260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9a04e1e4-9310-4ca0-b244-f50cfd3c8372 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:31.373198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9a04e1e4-9310-4ca0-b244-f50cfd3c8372 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:31.379510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a04e1e4-9310-4ca0-b244-f50cfd3c8372 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:31.380273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a04e1e4-9310-4ca0-b244-f50cfd3c8372 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:31.380888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a04e1e4-9310-4ca0-b244-f50cfd3c8372 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:31.385381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a04e1e4-9310-4ca0-b244-f50cfd3c8372 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:31.385381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a04e1e4-9310-4ca0-b244-f50cfd3c8372 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:31.385381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a04e1e4-9310-4ca0-b244-f50cfd3c8372 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:31.523900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9a04e1e4-9310-4ca0-b244-f50cfd3c8372 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:31.548576 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9a04e1e4-9310-4ca0-b244-f50cfd3c8372 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1261 microversion: 2.1 time: 0.192698 Oct 29 01:19:31.550083 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1957/3721] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:31 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1261 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:31.592838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c4a804c9-4fa3-4337-85ef-dc0f23b78e34 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:31.593902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c4a804c9-4fa3-4337-85ef-dc0f23b78e34 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:31.602458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4a804c9-4fa3-4337-85ef-dc0f23b78e34 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:31.603341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4a804c9-4fa3-4337-85ef-dc0f23b78e34 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:31.603984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4a804c9-4fa3-4337-85ef-dc0f23b78e34 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:31.604989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4a804c9-4fa3-4337-85ef-dc0f23b78e34 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:31.606204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4a804c9-4fa3-4337-85ef-dc0f23b78e34 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:31.614000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4a804c9-4fa3-4337-85ef-dc0f23b78e34 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:31.752174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c4a804c9-4fa3-4337-85ef-dc0f23b78e34 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:31.763199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c4a804c9-4fa3-4337-85ef-dc0f23b78e34 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:31.765460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c4a804c9-4fa3-4337-85ef-dc0f23b78e34 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:31.768887 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c4a804c9-4fa3-4337-85ef-dc0f23b78e34 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.181235 Oct 29 01:19:31.770596 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1958/3722] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:31 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:31.779231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9bd4f23b-a0b9-46ef-b248-1b1d6651576d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:31.780414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9bd4f23b-a0b9-46ef-b248-1b1d6651576d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:31.787550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bd4f23b-a0b9-46ef-b248-1b1d6651576d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:31.788454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bd4f23b-a0b9-46ef-b248-1b1d6651576d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:31.791453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bd4f23b-a0b9-46ef-b248-1b1d6651576d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:31.793940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bd4f23b-a0b9-46ef-b248-1b1d6651576d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:31.794637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bd4f23b-a0b9-46ef-b248-1b1d6651576d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:31.795096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bd4f23b-a0b9-46ef-b248-1b1d6651576d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:31.795506 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ebf97e6c-6213-4018-8b7e-49008244072f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "POST /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b/action" status: 202 len: 0 microversion: 2.1 time: 0.544239 Oct 29 01:19:31.799272 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1765/3723] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:19:31 2022] POST /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:19:31.807818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-44205265-2201-4dfa-8d40-056e2dd61b3f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:31.818113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-44205265-2201-4dfa-8d40-056e2dd61b3f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:31.845533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44205265-2201-4dfa-8d40-056e2dd61b3f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:31.853972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44205265-2201-4dfa-8d40-056e2dd61b3f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:31.854525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44205265-2201-4dfa-8d40-056e2dd61b3f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:31.855280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44205265-2201-4dfa-8d40-056e2dd61b3f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:31.855915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44205265-2201-4dfa-8d40-056e2dd61b3f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:31.856349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44205265-2201-4dfa-8d40-056e2dd61b3f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:32.097351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9bd4f23b-a0b9-46ef-b248-1b1d6651576d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:32.112668 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9bd4f23b-a0b9-46ef-b248-1b1d6651576d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.340630 Oct 29 01:19:32.113477 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1959/3724] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:31 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:32.122506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5ca2d589-feb8-46ec-a2de-41d5b73a443b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1886422729", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "80155129-7449-4e19-8927-e5381ba9fa19"}, {"port": "8de02bf9-2ec5-459d-8aff-bdd6efe86054", "tag": "port-1"}, {"port": "a02ac232-fcfa-478c-bfaf-1c208f69ee7a", "tag": "port-2"}, {"uuid": "f1905451-15b1-4482-b25e-9186c8413c77", "tag": "net-1"}, {"uuid": "f1905451-15b1-4482-b25e-9186c8413c77"}, {"uuid": "918cef1d-1196-4be7-9611-45e42e7796b3", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "918cef1d-1196-4be7-9611-45e42e7796b3", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "40caea15-6a8c-4f71-8f35-6429110762bc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "169db1c9-4021-4830-aa64-a6df65000fd5", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "5b186514-963b-4cb8-9789-b7d714117b60", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1206108198"}], "key_name": "tempest-keypair-1235386955", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:32.202269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-44205265-2201-4dfa-8d40-056e2dd61b3f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:32.227907 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-44205265-2201-4dfa-8d40-056e2dd61b3f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 200 len: 1496 microversion: 2.1 time: 0.411025 Oct 29 01:19:32.227907 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1766/3725] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:31 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 1496 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:32.355085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-5ca2d589-feb8-46ec-a2de-41d5b73a443b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] validate_networks() for [('80155129-7449-4e19-8927-e5381ba9fa19', None, None, None, None, None), (None, None, '8de02bf9-2ec5-459d-8aff-bdd6efe86054', None, None, None), (None, None, 'a02ac232-fcfa-478c-bfaf-1c208f69ee7a', None, None, None), ('f1905451-15b1-4482-b25e-9186c8413c77', None, None, None, None, None), ('f1905451-15b1-4482-b25e-9186c8413c77', None, None, None, None, None), ('918cef1d-1196-4be7-9611-45e42e7796b3', '10.2.2.100', None, None, None, None), ('918cef1d-1196-4be7-9611-45e42e7796b3', '10.2.2.200', None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:19:32.374570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-26e348c1-c2c8-44de-b18c-8fa499874312 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:32.375177 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-26e348c1-c2c8-44de-b18c-8fa499874312 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:32.386513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26e348c1-c2c8-44de-b18c-8fa499874312 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:32.392391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26e348c1-c2c8-44de-b18c-8fa499874312 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:32.392391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26e348c1-c2c8-44de-b18c-8fa499874312 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:32.392391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26e348c1-c2c8-44de-b18c-8fa499874312 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:32.392391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26e348c1-c2c8-44de-b18c-8fa499874312 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:32.392391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26e348c1-c2c8-44de-b18c-8fa499874312 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:32.501494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-26e348c1-c2c8-44de-b18c-8fa499874312 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:32.512419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-26e348c1-c2c8-44de-b18c-8fa499874312 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:32.514344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-26e348c1-c2c8-44de-b18c-8fa499874312 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:32.520520 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-26e348c1-c2c8-44de-b18c-8fa499874312 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.150027 Oct 29 01:19:32.521533 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1767/3726] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:32 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:32.575754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3a61a299-df86-4a9e-a5f8-709dc4699e78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:32.576417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3a61a299-df86-4a9e-a5f8-709dc4699e78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:32.589932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a61a299-df86-4a9e-a5f8-709dc4699e78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:32.592931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a61a299-df86-4a9e-a5f8-709dc4699e78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:32.592931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a61a299-df86-4a9e-a5f8-709dc4699e78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:32.592931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a61a299-df86-4a9e-a5f8-709dc4699e78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:32.592931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a61a299-df86-4a9e-a5f8-709dc4699e78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:32.592931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a61a299-df86-4a9e-a5f8-709dc4699e78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:33.293618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3a61a299-df86-4a9e-a5f8-709dc4699e78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:33.309806 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3a61a299-df86-4a9e-a5f8-709dc4699e78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1267 microversion: 2.1 time: 0.738473 Oct 29 01:19:33.316812 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1768/3727] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:32 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1267 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:33.320030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c1861b7f-09d5-4fbd-b17c-89ee9ff97bc7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:33.322267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c1861b7f-09d5-4fbd-b17c-89ee9ff97bc7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:33.329919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1861b7f-09d5-4fbd-b17c-89ee9ff97bc7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:33.330945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1861b7f-09d5-4fbd-b17c-89ee9ff97bc7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:33.331617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1861b7f-09d5-4fbd-b17c-89ee9ff97bc7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:33.332931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1861b7f-09d5-4fbd-b17c-89ee9ff97bc7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:33.333991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1861b7f-09d5-4fbd-b17c-89ee9ff97bc7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:33.334531 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1861b7f-09d5-4fbd-b17c-89ee9ff97bc7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:33.604171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c1861b7f-09d5-4fbd-b17c-89ee9ff97bc7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:33.625504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c1861b7f-09d5-4fbd-b17c-89ee9ff97bc7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:33.628434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c1861b7f-09d5-4fbd-b17c-89ee9ff97bc7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:33.629995 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c1861b7f-09d5-4fbd-b17c-89ee9ff97bc7 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.314296 Oct 29 01:19:33.631869 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1769/3728] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:33 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:33.638238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c63cb1a8-bac7-4f34-ac7e-af5cd332e541 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:33.639038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c63cb1a8-bac7-4f34-ac7e-af5cd332e541 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:33.645742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c63cb1a8-bac7-4f34-ac7e-af5cd332e541 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:33.646539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c63cb1a8-bac7-4f34-ac7e-af5cd332e541 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:33.647324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c63cb1a8-bac7-4f34-ac7e-af5cd332e541 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:33.648329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c63cb1a8-bac7-4f34-ac7e-af5cd332e541 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:33.649734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c63cb1a8-bac7-4f34-ac7e-af5cd332e541 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:33.650328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c63cb1a8-bac7-4f34-ac7e-af5cd332e541 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:34.224254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c63cb1a8-bac7-4f34-ac7e-af5cd332e541 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:34.239041 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c63cb1a8-bac7-4f34-ac7e-af5cd332e541 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.605978 Oct 29 01:19:34.241954 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1770/3729] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:33 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:34.250902 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bec2ddc3-fa25-4baa-9448-ae9ed8324613 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:34.251672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bec2ddc3-fa25-4baa-9448-ae9ed8324613 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:34.264113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bec2ddc3-fa25-4baa-9448-ae9ed8324613 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:34.264763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bec2ddc3-fa25-4baa-9448-ae9ed8324613 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:34.267346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bec2ddc3-fa25-4baa-9448-ae9ed8324613 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:34.269850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bec2ddc3-fa25-4baa-9448-ae9ed8324613 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:34.271978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bec2ddc3-fa25-4baa-9448-ae9ed8324613 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:34.274981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bec2ddc3-fa25-4baa-9448-ae9ed8324613 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:34.553061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bec2ddc3-fa25-4baa-9448-ae9ed8324613 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:34.565891 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bec2ddc3-fa25-4baa-9448-ae9ed8324613 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 200 len: 1479 microversion: 2.1 time: 0.324218 Oct 29 01:19:34.571779 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1771/3730] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:34 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 1479 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:34.588987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1b544022-e94b-40dd-a099-f55190599883 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:34.590680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1b544022-e94b-40dd-a099-f55190599883 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:34.606416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b544022-e94b-40dd-a099-f55190599883 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:34.608095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b544022-e94b-40dd-a099-f55190599883 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:34.608602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b544022-e94b-40dd-a099-f55190599883 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:34.609422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b544022-e94b-40dd-a099-f55190599883 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:34.609914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b544022-e94b-40dd-a099-f55190599883 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:34.610368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b544022-e94b-40dd-a099-f55190599883 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:34.767309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1b544022-e94b-40dd-a099-f55190599883 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:34.767309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1b544022-e94b-40dd-a099-f55190599883 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:34.767309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1b544022-e94b-40dd-a099-f55190599883 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:34.767309 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1b544022-e94b-40dd-a099-f55190599883 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.193574 Oct 29 01:19:34.767791 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1772/3731] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:34 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:34.773413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6b72084b-85d7-41d1-8546-b36c6e505300 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:34.774768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6b72084b-85d7-41d1-8546-b36c6e505300 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:34.781419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b72084b-85d7-41d1-8546-b36c6e505300 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:34.781908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b72084b-85d7-41d1-8546-b36c6e505300 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:34.782335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b72084b-85d7-41d1-8546-b36c6e505300 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:34.783137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b72084b-85d7-41d1-8546-b36c6e505300 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:34.783489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b72084b-85d7-41d1-8546-b36c6e505300 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:34.783914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b72084b-85d7-41d1-8546-b36c6e505300 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:35.123898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6b72084b-85d7-41d1-8546-b36c6e505300 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:35.136223 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6b72084b-85d7-41d1-8546-b36c6e505300 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1309 microversion: 2.1 time: 0.367109 Oct 29 01:19:35.137031 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1773/3732] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:34 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1309 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:35.156948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-48183566-e49d-4838-ab84-566e17acc45d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-478920869"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:35.159728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-48183566-e49d-4838-ab84-566e17acc45d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:35.166925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48183566-e49d-4838-ab84-566e17acc45d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:35.172158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48183566-e49d-4838-ab84-566e17acc45d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:35.172158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48183566-e49d-4838-ab84-566e17acc45d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:35.172158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48183566-e49d-4838-ab84-566e17acc45d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:35.172158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48183566-e49d-4838-ab84-566e17acc45d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:35.172158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48183566-e49d-4838-ab84-566e17acc45d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:35.809278 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-48183566-e49d-4838-ab84-566e17acc45d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "POST /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b/action" status: 202 len: 0 microversion: 2.1 time: 0.662041 Oct 29 01:19:35.814014 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1774/3733] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:19:35 2022] POST /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b/action => generated 0 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 01:19:35.840548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d2729f3-024a-4bd5-b0b7-ab6a8c67b27d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:35.841408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7d2729f3-024a-4bd5-b0b7-ab6a8c67b27d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:35.857629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d2729f3-024a-4bd5-b0b7-ab6a8c67b27d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:35.857629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d2729f3-024a-4bd5-b0b7-ab6a8c67b27d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:35.857629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d2729f3-024a-4bd5-b0b7-ab6a8c67b27d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:35.857629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d2729f3-024a-4bd5-b0b7-ab6a8c67b27d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:35.857629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d2729f3-024a-4bd5-b0b7-ab6a8c67b27d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:35.857629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d2729f3-024a-4bd5-b0b7-ab6a8c67b27d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:36.032265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7d2729f3-024a-4bd5-b0b7-ab6a8c67b27d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:36.048699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7d2729f3-024a-4bd5-b0b7-ab6a8c67b27d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:36.050962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7d2729f3-024a-4bd5-b0b7-ab6a8c67b27d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:36.052948 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7d2729f3-024a-4bd5-b0b7-ab6a8c67b27d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.230285 Oct 29 01:19:36.069726 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1775/3734] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:35 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:36.080540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b3b304a1-bbd5-4f48-ae77-8d3e1a6a9307 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:36.084399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b3b304a1-bbd5-4f48-ae77-8d3e1a6a9307 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:36.098849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b3b304a1-bbd5-4f48-ae77-8d3e1a6a9307 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:36.111641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b3b304a1-bbd5-4f48-ae77-8d3e1a6a9307 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:36.112463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b3b304a1-bbd5-4f48-ae77-8d3e1a6a9307 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:36.113740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b3b304a1-bbd5-4f48-ae77-8d3e1a6a9307 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:36.114312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b3b304a1-bbd5-4f48-ae77-8d3e1a6a9307 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:36.114844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b3b304a1-bbd5-4f48-ae77-8d3e1a6a9307 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:36.408200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b3b304a1-bbd5-4f48-ae77-8d3e1a6a9307 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:36.416945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:36.428203 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b3b304a1-bbd5-4f48-ae77-8d3e1a6a9307 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.356738 Oct 29 01:19:36.429925 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1776/3735] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:36 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:36.449223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-41632541-e30e-451f-a0a6-4e6370b6104f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:36.450188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-41632541-e30e-451f-a0a6-4e6370b6104f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:36.459770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41632541-e30e-451f-a0a6-4e6370b6104f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:36.460299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41632541-e30e-451f-a0a6-4e6370b6104f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:36.460733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41632541-e30e-451f-a0a6-4e6370b6104f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:36.463660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41632541-e30e-451f-a0a6-4e6370b6104f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:36.464323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41632541-e30e-451f-a0a6-4e6370b6104f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:36.464919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41632541-e30e-451f-a0a6-4e6370b6104f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:36.657557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-41632541-e30e-451f-a0a6-4e6370b6104f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:36.668396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-41632541-e30e-451f-a0a6-4e6370b6104f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:36.675668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-41632541-e30e-451f-a0a6-4e6370b6104f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:36.687815 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-41632541-e30e-451f-a0a6-4e6370b6104f tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.256018 Oct 29 01:19:36.705384 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1777/3736] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:36 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:36.711763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-94e9fd14-892a-4481-8251-b0d65089c03a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9ff8cdc0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:36.802698 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-94e9fd14-892a-4481-8251-b0d65089c03a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 200 len: 1439 microversion: 2.1 time: 0.101195 Oct 29 01:19:36.804556 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1778/3737] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:36 2022] GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 1439 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:36.811609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-49073c55-3328-4ccd-87c3-ea8688f944e2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:36.812991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-49073c55-3328-4ccd-87c3-ea8688f944e2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:36.823778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49073c55-3328-4ccd-87c3-ea8688f944e2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:36.824891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49073c55-3328-4ccd-87c3-ea8688f944e2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:36.825888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49073c55-3328-4ccd-87c3-ea8688f944e2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:36.827483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49073c55-3328-4ccd-87c3-ea8688f944e2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:36.828163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49073c55-3328-4ccd-87c3-ea8688f944e2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:36.828900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49073c55-3328-4ccd-87c3-ea8688f944e2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:37.186305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-49073c55-3328-4ccd-87c3-ea8688f944e2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:37.198516 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-49073c55-3328-4ccd-87c3-ea8688f944e2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1309 microversion: 2.1 time: 0.392264 Oct 29 01:19:37.199817 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1779/3738] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:36 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1309 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:37.205465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-b09de72f-5034-4afc-b8c8-601550f69157 req-e8210fab-0097-4657-aaf6-53f153decd58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d014296-4cd2-4a65-89e1-fba4193cae7c", "tag": "0b5217fb-8ffe-43df-9b91-470df8435002"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:37.216243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b09de72f-5034-4afc-b8c8-601550f69157 req-e8210fab-0097-4657-aaf6-53f153decd58 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:37.217135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b09de72f-5034-4afc-b8c8-601550f69157 req-e8210fab-0097-4657-aaf6-53f153decd58 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:37.217774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b09de72f-5034-4afc-b8c8-601550f69157 req-e8210fab-0097-4657-aaf6-53f153decd58 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:37.235639 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-b09de72f-5034-4afc-b8c8-601550f69157 req-e8210fab-0097-4657-aaf6-53f153decd58 service nova] Creating event network-changed:0b5217fb-8ffe-43df-9b91-470df8435002 for instance 2d014296-4cd2-4a65-89e1-fba4193cae7c on n-h1-862964-3 Oct 29 01:19:37.241606 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-b09de72f-5034-4afc-b8c8-601550f69157 req-e8210fab-0097-4657-aaf6-53f153decd58 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040087 Oct 29 01:19:37.244508 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1780/3739] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:37.251830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9f85face-366d-4690-a8a2-92df036df60e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:37.253629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9f85face-366d-4690-a8a2-92df036df60e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:37.263407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f85face-366d-4690-a8a2-92df036df60e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:37.265926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f85face-366d-4690-a8a2-92df036df60e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:37.266911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f85face-366d-4690-a8a2-92df036df60e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:37.267861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f85face-366d-4690-a8a2-92df036df60e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:37.268762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f85face-366d-4690-a8a2-92df036df60e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:37.269399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f85face-366d-4690-a8a2-92df036df60e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:37.413748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9f85face-366d-4690-a8a2-92df036df60e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:37.425046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9f85face-366d-4690-a8a2-92df036df60e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:37.426533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9f85face-366d-4690-a8a2-92df036df60e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:37.427719 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9f85face-366d-4690-a8a2-92df036df60e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.181577 Oct 29 01:19:37.428479 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1781/3740] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:37 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:37.457447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7a011aa7-710f-4156-a124-a46e29f5e2d6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:37.458064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7a011aa7-710f-4156-a124-a46e29f5e2d6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:37.464547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a011aa7-710f-4156-a124-a46e29f5e2d6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:37.465035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a011aa7-710f-4156-a124-a46e29f5e2d6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:37.465503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a011aa7-710f-4156-a124-a46e29f5e2d6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:37.466200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a011aa7-710f-4156-a124-a46e29f5e2d6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:37.466655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a011aa7-710f-4156-a124-a46e29f5e2d6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:37.467085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a011aa7-710f-4156-a124-a46e29f5e2d6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:37.566067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:37.691263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7a011aa7-710f-4156-a124-a46e29f5e2d6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:37.700279 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7a011aa7-710f-4156-a124-a46e29f5e2d6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.246712 Oct 29 01:19:37.702486 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1782/3741] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:37 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:37.723985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6899b1f7-0e3c-4225-adf6-05a5fd8ca024 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:37.724605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6899b1f7-0e3c-4225-adf6-05a5fd8ca024 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:37.731672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6899b1f7-0e3c-4225-adf6-05a5fd8ca024 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:37.732166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6899b1f7-0e3c-4225-adf6-05a5fd8ca024 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:37.732605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6899b1f7-0e3c-4225-adf6-05a5fd8ca024 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:37.733351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6899b1f7-0e3c-4225-adf6-05a5fd8ca024 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:37.733810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6899b1f7-0e3c-4225-adf6-05a5fd8ca024 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:37.734264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6899b1f7-0e3c-4225-adf6-05a5fd8ca024 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:37.738971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5ca2d589-feb8-46ec-a2de-41d5b73a443b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:19:37.739458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5ca2d589-feb8-46ec-a2de-41d5b73a443b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:19:37.739849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5ca2d589-feb8-46ec-a2de-41d5b73a443b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:19:37.740253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5ca2d589-feb8-46ec-a2de-41d5b73a443b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:19:37.740661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5ca2d589-feb8-46ec-a2de-41d5b73a443b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:19:37.752791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ca2d589-feb8-46ec-a2de-41d5b73a443b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:37.753315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ca2d589-feb8-46ec-a2de-41d5b73a443b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:37.753761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ca2d589-feb8-46ec-a2de-41d5b73a443b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:37.754488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ca2d589-feb8-46ec-a2de-41d5b73a443b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:37.755156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ca2d589-feb8-46ec-a2de-41d5b73a443b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:37.755583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ca2d589-feb8-46ec-a2de-41d5b73a443b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:37.775932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-5ca2d589-feb8-46ec-a2de-41d5b73a443b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Getting quotas for project c226e05b4c2943a28fac5c95f02c8e68. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:19:37.778703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:37.785257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-5ca2d589-feb8-46ec-a2de-41d5b73a443b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Getting quotas for user 34417a5511824b5aa82ce131f6a1324c and project c226e05b4c2943a28fac5c95f02c8e68. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:19:37.833603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6899b1f7-0e3c-4225-adf6-05a5fd8ca024 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:37.849561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6899b1f7-0e3c-4225-adf6-05a5fd8ca024 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:37.849561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6899b1f7-0e3c-4225-adf6-05a5fd8ca024 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:37.856331 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6899b1f7-0e3c-4225-adf6-05a5fd8ca024 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.136266 Oct 29 01:19:37.868422 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1783/3742] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:37 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:37.868422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-70897fae-8c42-4b61-918a-df99203493c7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9ff7c160>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:37.935293 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-70897fae-8c42-4b61-918a-df99203493c7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 200 len: 1439 microversion: 2.1 time: 0.077239 Oct 29 01:19:37.941346 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1784/3743] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:37 2022] GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 1439 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:38.047567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5ca2d589-feb8-46ec-a2de-41d5b73a443b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:19:38.055456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5ca2d589-feb8-46ec-a2de-41d5b73a443b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='40caea15-6a8c-4f71-8f35-6429110762bc',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='169db1c9-4021-4830-aa64-a6df65000fd5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5b186514-963b-4cb8-9789-b7d714117b60',volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:19:38.221655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:38.225804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e8476009-d5a6-4dfd-b595-dd6350a1863d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:38.226655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e8476009-d5a6-4dfd-b595-dd6350a1863d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:38.233225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8476009-d5a6-4dfd-b595-dd6350a1863d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:38.233952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8476009-d5a6-4dfd-b595-dd6350a1863d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:38.234572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8476009-d5a6-4dfd-b595-dd6350a1863d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:38.235582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8476009-d5a6-4dfd-b595-dd6350a1863d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:38.236218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8476009-d5a6-4dfd-b595-dd6350a1863d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:38.236648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8476009-d5a6-4dfd-b595-dd6350a1863d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:38.428239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e8476009-d5a6-4dfd-b595-dd6350a1863d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:38.440672 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e8476009-d5a6-4dfd-b595-dd6350a1863d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1309 microversion: 2.1 time: 0.219731 Oct 29 01:19:38.457986 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1785/3744] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:38 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1309 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:38.468502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6c96c02b-6014-4577-a71c-afb970a520c1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:38.469192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6c96c02b-6014-4577-a71c-afb970a520c1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:38.475388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6c96c02b-6014-4577-a71c-afb970a520c1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:38.475872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6c96c02b-6014-4577-a71c-afb970a520c1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:38.476310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6c96c02b-6014-4577-a71c-afb970a520c1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:38.477201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6c96c02b-6014-4577-a71c-afb970a520c1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:38.478589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6c96c02b-6014-4577-a71c-afb970a520c1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:38.479024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6c96c02b-6014-4577-a71c-afb970a520c1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:38.584214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6c96c02b-6014-4577-a71c-afb970a520c1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:38.595675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6c96c02b-6014-4577-a71c-afb970a520c1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:38.597612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6c96c02b-6014-4577-a71c-afb970a520c1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:38.599288 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6c96c02b-6014-4577-a71c-afb970a520c1 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.140018 Oct 29 01:19:38.600028 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1786/3745] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:38 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:38.738652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dcfc10f7-4f95-43bc-8fd4-3c42371f9c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:38.739279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dcfc10f7-4f95-43bc-8fd4-3c42371f9c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:38.747517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dcfc10f7-4f95-43bc-8fd4-3c42371f9c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:38.748011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dcfc10f7-4f95-43bc-8fd4-3c42371f9c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:38.759191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dcfc10f7-4f95-43bc-8fd4-3c42371f9c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:38.759534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dcfc10f7-4f95-43bc-8fd4-3c42371f9c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:38.763777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dcfc10f7-4f95-43bc-8fd4-3c42371f9c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:38.764262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dcfc10f7-4f95-43bc-8fd4-3c42371f9c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:38.951715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-dcfc10f7-4f95-43bc-8fd4-3c42371f9c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:38.961894 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dcfc10f7-4f95-43bc-8fd4-3c42371f9c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.241496 Oct 29 01:19:38.963792 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1787/3746] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:38 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:38.968701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4844b2e9-345b-454b-a929-d5240b8073ac tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:38.970220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4844b2e9-345b-454b-a929-d5240b8073ac tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:38.978079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4844b2e9-345b-454b-a929-d5240b8073ac tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:38.978563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4844b2e9-345b-454b-a929-d5240b8073ac tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:38.979019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4844b2e9-345b-454b-a929-d5240b8073ac tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:38.979847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4844b2e9-345b-454b-a929-d5240b8073ac tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:38.980405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4844b2e9-345b-454b-a929-d5240b8073ac tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:38.980838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4844b2e9-345b-454b-a929-d5240b8073ac tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:39.077484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4844b2e9-345b-454b-a929-d5240b8073ac tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:39.094558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4844b2e9-345b-454b-a929-d5240b8073ac tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:39.096112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4844b2e9-345b-454b-a929-d5240b8073ac tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:39.101782 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4844b2e9-345b-454b-a929-d5240b8073ac tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.136953 Oct 29 01:19:39.102817 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1788/3747] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:38 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:39.107404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f8c7569d-8d11-4cc3-bfdf-377b8c8f45d2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97f56ee0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:39.165185 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f8c7569d-8d11-4cc3-bfdf-377b8c8f45d2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 200 len: 1439 microversion: 2.1 time: 0.061192 Oct 29 01:19:39.165993 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1789/3748] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:39 2022] GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 1439 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:39.471527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6fb7f06b-e6f2-4938-949b-3ce676a8073e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:39.472478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6fb7f06b-e6f2-4938-949b-3ce676a8073e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:39.498249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6fb7f06b-e6f2-4938-949b-3ce676a8073e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:39.500796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6fb7f06b-e6f2-4938-949b-3ce676a8073e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:39.501474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6fb7f06b-e6f2-4938-949b-3ce676a8073e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:39.502474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6fb7f06b-e6f2-4938-949b-3ce676a8073e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:39.512612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6fb7f06b-e6f2-4938-949b-3ce676a8073e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:39.513344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6fb7f06b-e6f2-4938-949b-3ce676a8073e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:39.714536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6fb7f06b-e6f2-4938-949b-3ce676a8073e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:39.729344 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6fb7f06b-e6f2-4938-949b-3ce676a8073e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1309 microversion: 2.1 time: 0.262541 Oct 29 01:19:39.729900 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5ca2d589-feb8-46ec-a2de-41d5b73a443b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 7.610828 Oct 29 01:19:39.736337 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1960/3749] 10.222.0.26 () {62 vars in 1189 bytes} [Sat Oct 29 01:19:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 7616 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 01:19:39.737873 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1790/3750] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:39 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1309 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:39.743108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3522b58f-0c46-4cbf-8bd7-425e8d473d4d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:39.744051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3522b58f-0c46-4cbf-8bd7-425e8d473d4d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:39.744937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-537a4490-5fd3-43b0-a235-a510cbebbc5e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:39.745683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-537a4490-5fd3-43b0-a235-a510cbebbc5e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:39.760447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3522b58f-0c46-4cbf-8bd7-425e8d473d4d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:39.763529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3522b58f-0c46-4cbf-8bd7-425e8d473d4d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:39.764331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3522b58f-0c46-4cbf-8bd7-425e8d473d4d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:39.778583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3522b58f-0c46-4cbf-8bd7-425e8d473d4d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:39.779522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3522b58f-0c46-4cbf-8bd7-425e8d473d4d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:39.781916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3522b58f-0c46-4cbf-8bd7-425e8d473d4d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:39.900942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-537a4490-5fd3-43b0-a235-a510cbebbc5e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:39.910495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-537a4490-5fd3-43b0-a235-a510cbebbc5e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:39.912513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-537a4490-5fd3-43b0-a235-a510cbebbc5e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:39.914655 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-537a4490-5fd3-43b0-a235-a510cbebbc5e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1286 microversion: 2.32 time: 0.174671 Oct 29 01:19:39.929339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3522b58f-0c46-4cbf-8bd7-425e8d473d4d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:39.931660 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1791/3751] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:39 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1286 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:39.939348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3522b58f-0c46-4cbf-8bd7-425e8d473d4d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:39.947566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3522b58f-0c46-4cbf-8bd7-425e8d473d4d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:39.948851 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3522b58f-0c46-4cbf-8bd7-425e8d473d4d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.217743 Oct 29 01:19:39.953065 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1961/3752] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:39 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:39.988120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aef480f6-461e-4267-a3fc-028bbdcbd7b3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:39.989423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aef480f6-461e-4267-a3fc-028bbdcbd7b3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:40.004613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aef480f6-461e-4267-a3fc-028bbdcbd7b3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:40.006409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aef480f6-461e-4267-a3fc-028bbdcbd7b3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:40.007057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aef480f6-461e-4267-a3fc-028bbdcbd7b3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:40.010605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aef480f6-461e-4267-a3fc-028bbdcbd7b3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:40.011932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aef480f6-461e-4267-a3fc-028bbdcbd7b3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:40.012984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aef480f6-461e-4267-a3fc-028bbdcbd7b3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:40.136613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d66c339a-cfaf-4ee3-a1d1-20a003277f61 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:40.137263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d66c339a-cfaf-4ee3-a1d1-20a003277f61 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:40.155021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d66c339a-cfaf-4ee3-a1d1-20a003277f61 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:40.155540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d66c339a-cfaf-4ee3-a1d1-20a003277f61 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:40.155992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d66c339a-cfaf-4ee3-a1d1-20a003277f61 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:40.156731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d66c339a-cfaf-4ee3-a1d1-20a003277f61 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:40.157218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d66c339a-cfaf-4ee3-a1d1-20a003277f61 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:40.161206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d66c339a-cfaf-4ee3-a1d1-20a003277f61 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:40.640102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d66c339a-cfaf-4ee3-a1d1-20a003277f61 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:40.650506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d66c339a-cfaf-4ee3-a1d1-20a003277f61 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:40.654371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d66c339a-cfaf-4ee3-a1d1-20a003277f61 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:40.669781 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d66c339a-cfaf-4ee3-a1d1-20a003277f61 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.537834 Oct 29 01:19:40.670191 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1962/3753] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:40 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:40.677555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f26fcc2c-82ea-4d29-99ed-368bdfd00e16 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9770d040>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:40.764764 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f26fcc2c-82ea-4d29-99ed-368bdfd00e16 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 200 len: 1439 microversion: 2.1 time: 0.093332 Oct 29 01:19:40.779005 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1963/3754] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:40 2022] GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 1439 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:40.785330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-121de18d-8f65-4a7e-ad78-7b2e5dba5b7b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:40.787015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-121de18d-8f65-4a7e-ad78-7b2e5dba5b7b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:40.797486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-121de18d-8f65-4a7e-ad78-7b2e5dba5b7b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:40.798574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-121de18d-8f65-4a7e-ad78-7b2e5dba5b7b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:40.799804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-121de18d-8f65-4a7e-ad78-7b2e5dba5b7b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:40.800895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-121de18d-8f65-4a7e-ad78-7b2e5dba5b7b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:40.801673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-121de18d-8f65-4a7e-ad78-7b2e5dba5b7b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:40.802362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-121de18d-8f65-4a7e-ad78-7b2e5dba5b7b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:40.843536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:40.876285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aef480f6-461e-4267-a3fc-028bbdcbd7b3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:40.888084 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aef480f6-461e-4267-a3fc-028bbdcbd7b3 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.904149 Oct 29 01:19:40.905837 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1792/3755] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:39 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:40.944983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3e1ab686-5a0e-40db-93c0-b419ab30b96b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:40.945683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3e1ab686-5a0e-40db-93c0-b419ab30b96b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:41.067408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3e1ab686-5a0e-40db-93c0-b419ab30b96b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:41.081767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3e1ab686-5a0e-40db-93c0-b419ab30b96b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:41.081767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3e1ab686-5a0e-40db-93c0-b419ab30b96b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:41.081767 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3e1ab686-5a0e-40db-93c0-b419ab30b96b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1286 microversion: 2.32 time: 0.137802 Oct 29 01:19:41.081767 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1793/3756] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:40 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1286 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:41.083525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e126ea63-9922-43c7-9ca3-63c2cbb2d29c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:41.084313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e126ea63-9922-43c7-9ca3-63c2cbb2d29c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:41.093024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e126ea63-9922-43c7-9ca3-63c2cbb2d29c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:41.093785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e126ea63-9922-43c7-9ca3-63c2cbb2d29c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:41.094418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e126ea63-9922-43c7-9ca3-63c2cbb2d29c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:41.095304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e126ea63-9922-43c7-9ca3-63c2cbb2d29c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:41.095918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e126ea63-9922-43c7-9ca3-63c2cbb2d29c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:41.096494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e126ea63-9922-43c7-9ca3-63c2cbb2d29c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:41.323506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e126ea63-9922-43c7-9ca3-63c2cbb2d29c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:41.351163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e126ea63-9922-43c7-9ca3-63c2cbb2d29c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:41.356194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e126ea63-9922-43c7-9ca3-63c2cbb2d29c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:41.370046 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e126ea63-9922-43c7-9ca3-63c2cbb2d29c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1365 microversion: 2.57 time: 0.290151 Oct 29 01:19:41.372743 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1794/3757] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:41 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1365 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:41.402126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-121de18d-8f65-4a7e-ad78-7b2e5dba5b7b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:41.411372 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-121de18d-8f65-4a7e-ad78-7b2e5dba5b7b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1309 microversion: 2.1 time: 0.630563 Oct 29 01:19:41.417043 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1964/3758] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:40 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1309 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:41.711413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d72039af-c50a-4007-a97e-5c92fdc7aa01 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:41.714569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d72039af-c50a-4007-a97e-5c92fdc7aa01 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:41.720641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d72039af-c50a-4007-a97e-5c92fdc7aa01 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:41.721574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d72039af-c50a-4007-a97e-5c92fdc7aa01 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:41.722194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d72039af-c50a-4007-a97e-5c92fdc7aa01 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:41.723287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d72039af-c50a-4007-a97e-5c92fdc7aa01 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:41.725551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d72039af-c50a-4007-a97e-5c92fdc7aa01 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:41.726222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d72039af-c50a-4007-a97e-5c92fdc7aa01 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:41.784213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-66c2e68c-e7c4-446b-8ca7-b5409bcca3e7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97773ee0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:41.869039 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-66c2e68c-e7c4-446b-8ca7-b5409bcca3e7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 200 len: 1439 microversion: 2.1 time: 0.089869 Oct 29 01:19:41.871700 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1965/3759] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:41 2022] GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 1439 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:41.913379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6131773b-d15e-44e6-b3c7-b5efed350761 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:41.915474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6131773b-d15e-44e6-b3c7-b5efed350761 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:41.923993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6131773b-d15e-44e6-b3c7-b5efed350761 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:41.924869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6131773b-d15e-44e6-b3c7-b5efed350761 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:41.925585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6131773b-d15e-44e6-b3c7-b5efed350761 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:41.926747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6131773b-d15e-44e6-b3c7-b5efed350761 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:41.927383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6131773b-d15e-44e6-b3c7-b5efed350761 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:41.928647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6131773b-d15e-44e6-b3c7-b5efed350761 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:42.049074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d72039af-c50a-4007-a97e-5c92fdc7aa01 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:42.059999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d72039af-c50a-4007-a97e-5c92fdc7aa01 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:42.062055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d72039af-c50a-4007-a97e-5c92fdc7aa01 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:42.071801 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d72039af-c50a-4007-a97e-5c92fdc7aa01 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.370007 Oct 29 01:19:42.097928 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1795/3760] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:41 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:42.204477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-9f18076b-83e1-477c-b215-798bb172da01 req-da6a8dd3-8c7a-4c98-8f9c-358bdeac1174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277b318c-bc53-4c0d-997b-8c96d92ce41b", "name": "network-vif-plugged", "status": "completed", "tag": "260d45a4-8311-4a41-a480-de2b98950b06"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:42.220268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9f18076b-83e1-477c-b215-798bb172da01 req-da6a8dd3-8c7a-4c98-8f9c-358bdeac1174 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:42.221131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9f18076b-83e1-477c-b215-798bb172da01 req-da6a8dd3-8c7a-4c98-8f9c-358bdeac1174 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:42.221878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9f18076b-83e1-477c-b215-798bb172da01 req-da6a8dd3-8c7a-4c98-8f9c-358bdeac1174 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:42.235853 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-9f18076b-83e1-477c-b215-798bb172da01 req-da6a8dd3-8c7a-4c98-8f9c-358bdeac1174 service nova] Creating event network-vif-plugged:260d45a4-8311-4a41-a480-de2b98950b06 for instance 277b318c-bc53-4c0d-997b-8c96d92ce41b on n-h2-862964-3 Oct 29 01:19:42.246600 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-9f18076b-83e1-477c-b215-798bb172da01 req-da6a8dd3-8c7a-4c98-8f9c-358bdeac1174 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143691 Oct 29 01:19:42.254177 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1796/3761] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:42.256118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-09261e8e-8139-4cee-9e55-4a6864684708 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:42.257090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-09261e8e-8139-4cee-9e55-4a6864684708 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:42.266815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-09261e8e-8139-4cee-9e55-4a6864684708 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:42.267654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-09261e8e-8139-4cee-9e55-4a6864684708 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:42.268478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-09261e8e-8139-4cee-9e55-4a6864684708 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:42.269369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-09261e8e-8139-4cee-9e55-4a6864684708 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:42.270164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-09261e8e-8139-4cee-9e55-4a6864684708 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:42.271165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-09261e8e-8139-4cee-9e55-4a6864684708 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:42.412909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-09261e8e-8139-4cee-9e55-4a6864684708 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:42.425619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-09261e8e-8139-4cee-9e55-4a6864684708 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:42.427473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-09261e8e-8139-4cee-9e55-4a6864684708 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:42.428784 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-09261e8e-8139-4cee-9e55-4a6864684708 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1528 microversion: 2.32 time: 0.177978 Oct 29 01:19:42.429516 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1797/3762] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:42 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1528 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:42.436407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8edc08d1-a16c-4d93-b363-811583ce301b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:42.436407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8edc08d1-a16c-4d93-b363-811583ce301b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:42.442634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:42.444179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8edc08d1-a16c-4d93-b363-811583ce301b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:42.444879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8edc08d1-a16c-4d93-b363-811583ce301b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:42.445611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8edc08d1-a16c-4d93-b363-811583ce301b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:42.446622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8edc08d1-a16c-4d93-b363-811583ce301b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:42.447236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8edc08d1-a16c-4d93-b363-811583ce301b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:42.447735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8edc08d1-a16c-4d93-b363-811583ce301b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:42.562224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6131773b-d15e-44e6-b3c7-b5efed350761 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:42.562224 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6131773b-d15e-44e6-b3c7-b5efed350761 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.577297 Oct 29 01:19:42.562224 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1966/3763] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:41 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:42.562224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-acf2d5eb-1eb7-45b0-8ee5-7a9a7c0a71bc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:42.562224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-acf2d5eb-1eb7-45b0-8ee5-7a9a7c0a71bc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:42.562224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-acf2d5eb-1eb7-45b0-8ee5-7a9a7c0a71bc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:42.562224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-acf2d5eb-1eb7-45b0-8ee5-7a9a7c0a71bc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:42.562224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-acf2d5eb-1eb7-45b0-8ee5-7a9a7c0a71bc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:42.562224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-acf2d5eb-1eb7-45b0-8ee5-7a9a7c0a71bc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:42.562224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-acf2d5eb-1eb7-45b0-8ee5-7a9a7c0a71bc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:42.562224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-acf2d5eb-1eb7-45b0-8ee5-7a9a7c0a71bc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:42.652683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8edc08d1-a16c-4d93-b363-811583ce301b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:42.664522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8edc08d1-a16c-4d93-b363-811583ce301b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:42.666240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8edc08d1-a16c-4d93-b363-811583ce301b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:42.667452 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8edc08d1-a16c-4d93-b363-811583ce301b tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1371 microversion: 2.57 time: 0.236742 Oct 29 01:19:42.668043 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1798/3764] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:42 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:42.810503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-acf2d5eb-1eb7-45b0-8ee5-7a9a7c0a71bc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:42.819897 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-acf2d5eb-1eb7-45b0-8ee5-7a9a7c0a71bc tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1309 microversion: 2.1 time: 0.329160 Oct 29 01:19:42.821142 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1967/3765] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:42 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1309 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:42.886736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-17118c45-3fdc-4261-aa31-e7d72a8fde3d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97f56700>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:42.937768 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-17118c45-3fdc-4261-aa31-e7d72a8fde3d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 200 len: 1439 microversion: 2.1 time: 0.056079 Oct 29 01:19:42.938388 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1799/3766] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:42 2022] GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 1439 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:43.105374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-90c0c24a-9e66-44be-b204-1272852c528e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:43.106309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-90c0c24a-9e66-44be-b204-1272852c528e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:43.121488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90c0c24a-9e66-44be-b204-1272852c528e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:43.122505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90c0c24a-9e66-44be-b204-1272852c528e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:43.123273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90c0c24a-9e66-44be-b204-1272852c528e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:43.124216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90c0c24a-9e66-44be-b204-1272852c528e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:43.128611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90c0c24a-9e66-44be-b204-1272852c528e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:43.129370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90c0c24a-9e66-44be-b204-1272852c528e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:43.277904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-90c0c24a-9e66-44be-b204-1272852c528e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:43.293869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-90c0c24a-9e66-44be-b204-1272852c528e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:43.302747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-90c0c24a-9e66-44be-b204-1272852c528e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:43.318924 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-90c0c24a-9e66-44be-b204-1272852c528e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.218627 Oct 29 01:19:43.334125 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1968/3767] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:43 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:43.456195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f5e6a824-255d-4eb1-bdf3-eece11e967bc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:43.456966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f5e6a824-255d-4eb1-bdf3-eece11e967bc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:43.465830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5e6a824-255d-4eb1-bdf3-eece11e967bc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:43.466447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5e6a824-255d-4eb1-bdf3-eece11e967bc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:43.467073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5e6a824-255d-4eb1-bdf3-eece11e967bc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:43.467974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5e6a824-255d-4eb1-bdf3-eece11e967bc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:43.468824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5e6a824-255d-4eb1-bdf3-eece11e967bc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:43.469499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5e6a824-255d-4eb1-bdf3-eece11e967bc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:43.515479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0ae28999-930c-4255-9982-7159330d2961 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:43.516286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0ae28999-930c-4255-9982-7159330d2961 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:43.533278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ae28999-930c-4255-9982-7159330d2961 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:43.534285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ae28999-930c-4255-9982-7159330d2961 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:43.537018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ae28999-930c-4255-9982-7159330d2961 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:43.538052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ae28999-930c-4255-9982-7159330d2961 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:43.538742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ae28999-930c-4255-9982-7159330d2961 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:43.541677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ae28999-930c-4255-9982-7159330d2961 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:43.666556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f5e6a824-255d-4eb1-bdf3-eece11e967bc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:43.671466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:43.683199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f5e6a824-255d-4eb1-bdf3-eece11e967bc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:43.693473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f5e6a824-255d-4eb1-bdf3-eece11e967bc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:43.697924 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f5e6a824-255d-4eb1-bdf3-eece11e967bc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1520 microversion: 2.32 time: 0.242898 Oct 29 01:19:43.697924 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1800/3768] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:43 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:43.717463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4225a9f4-195b-4598-a13d-52fafc12f844 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:43.718478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4225a9f4-195b-4598-a13d-52fafc12f844 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:43.729526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4225a9f4-195b-4598-a13d-52fafc12f844 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:43.730366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4225a9f4-195b-4598-a13d-52fafc12f844 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:43.731183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4225a9f4-195b-4598-a13d-52fafc12f844 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:43.732160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4225a9f4-195b-4598-a13d-52fafc12f844 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:43.738060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4225a9f4-195b-4598-a13d-52fafc12f844 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:43.738990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4225a9f4-195b-4598-a13d-52fafc12f844 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:43.889965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4225a9f4-195b-4598-a13d-52fafc12f844 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:43.900875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4225a9f4-195b-4598-a13d-52fafc12f844 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:43.915249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4225a9f4-195b-4598-a13d-52fafc12f844 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:43.916648 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4225a9f4-195b-4598-a13d-52fafc12f844 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1371 microversion: 2.57 time: 0.218705 Oct 29 01:19:43.917561 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1801/3769] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:43 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:43.938734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-31d9caaa-a54d-40f4-8512-c378b5614838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:43.939613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-31d9caaa-a54d-40f4-8512-c378b5614838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:43.947140 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31d9caaa-a54d-40f4-8512-c378b5614838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:43.947889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31d9caaa-a54d-40f4-8512-c378b5614838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:43.948489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31d9caaa-a54d-40f4-8512-c378b5614838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:43.949599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31d9caaa-a54d-40f4-8512-c378b5614838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:43.950227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31d9caaa-a54d-40f4-8512-c378b5614838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:43.950825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31d9caaa-a54d-40f4-8512-c378b5614838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:44.053571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0ae28999-930c-4255-9982-7159330d2961 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:44.065705 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0ae28999-930c-4255-9982-7159330d2961 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.554346 Oct 29 01:19:44.066298 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1969/3770] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:43 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:44.089727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b602a655-a87d-4807-b780-1e7a10a17b85 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d978fa160>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:44.266769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-31d9caaa-a54d-40f4-8512-c378b5614838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:44.281195 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-31d9caaa-a54d-40f4-8512-c378b5614838 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1309 microversion: 2.1 time: 0.362374 Oct 29 01:19:44.282013 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1802/3771] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:43 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1309 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:44.287118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-87fbd808-9800-4701-bd63-c4a45804b82e req-a27c97f2-57e5-4703-8862-5cae3a249a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d014296-4cd2-4a65-89e1-fba4193cae7c", "name": "network-vif-plugged", "status": "completed", "tag": "0b5217fb-8ffe-43df-9b91-470df8435002"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:44.296552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-87fbd808-9800-4701-bd63-c4a45804b82e req-a27c97f2-57e5-4703-8862-5cae3a249a2b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:44.297308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-87fbd808-9800-4701-bd63-c4a45804b82e req-a27c97f2-57e5-4703-8862-5cae3a249a2b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:44.297749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-87fbd808-9800-4701-bd63-c4a45804b82e req-a27c97f2-57e5-4703-8862-5cae3a249a2b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:44.309781 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-87fbd808-9800-4701-bd63-c4a45804b82e req-a27c97f2-57e5-4703-8862-5cae3a249a2b service nova] Creating event network-vif-plugged:0b5217fb-8ffe-43df-9b91-470df8435002 for instance 2d014296-4cd2-4a65-89e1-fba4193cae7c on n-h1-862964-3 Oct 29 01:19:44.314628 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-87fbd808-9800-4701-bd63-c4a45804b82e req-a27c97f2-57e5-4703-8862-5cae3a249a2b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031161 Oct 29 01:19:44.315219 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1803/3772] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:44.356445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-766a00fa-9269-4afc-9db7-0943a3c637ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:44.357169 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-766a00fa-9269-4afc-9db7-0943a3c637ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:44.363644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-766a00fa-9269-4afc-9db7-0943a3c637ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:44.364137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-766a00fa-9269-4afc-9db7-0943a3c637ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:44.366008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-766a00fa-9269-4afc-9db7-0943a3c637ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:44.366008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-766a00fa-9269-4afc-9db7-0943a3c637ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:44.366008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-766a00fa-9269-4afc-9db7-0943a3c637ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:44.366355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-766a00fa-9269-4afc-9db7-0943a3c637ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:44.839387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-766a00fa-9269-4afc-9db7-0943a3c637ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:44.872481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-766a00fa-9269-4afc-9db7-0943a3c637ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:44.874042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-766a00fa-9269-4afc-9db7-0943a3c637ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:44.883033 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-766a00fa-9269-4afc-9db7-0943a3c637ed tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1551 microversion: 2.91 time: 0.530684 Oct 29 01:19:44.895718 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b602a655-a87d-4807-b780-1e7a10a17b85 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 200 len: 1439 microversion: 2.1 time: 0.819819 Oct 29 01:19:44.896669 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1804/3773] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:44 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1551 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:44.896991 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1970/3774] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:44 2022] GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 1439 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:44.913666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6d5daa5a-6a21-4bbb-9b58-c73bf5e94b8f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:44.915311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6d5daa5a-6a21-4bbb-9b58-c73bf5e94b8f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:44.923743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d5daa5a-6a21-4bbb-9b58-c73bf5e94b8f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:44.924536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d5daa5a-6a21-4bbb-9b58-c73bf5e94b8f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:44.925479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d5daa5a-6a21-4bbb-9b58-c73bf5e94b8f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:44.926413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d5daa5a-6a21-4bbb-9b58-c73bf5e94b8f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:44.927047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d5daa5a-6a21-4bbb-9b58-c73bf5e94b8f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:44.927672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d5daa5a-6a21-4bbb-9b58-c73bf5e94b8f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:44.944801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3078ab0d-903b-45bd-a512-e56875e9c7d9 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:44.946464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3078ab0d-903b-45bd-a512-e56875e9c7d9 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:44.959291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3078ab0d-903b-45bd-a512-e56875e9c7d9 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:44.962275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3078ab0d-903b-45bd-a512-e56875e9c7d9 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:44.962275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3078ab0d-903b-45bd-a512-e56875e9c7d9 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:44.962275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3078ab0d-903b-45bd-a512-e56875e9c7d9 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:44.966591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3078ab0d-903b-45bd-a512-e56875e9c7d9 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:44.967373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3078ab0d-903b-45bd-a512-e56875e9c7d9 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:45.064704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6d5daa5a-6a21-4bbb-9b58-c73bf5e94b8f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:45.082560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3078ab0d-903b-45bd-a512-e56875e9c7d9 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:45.084652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6d5daa5a-6a21-4bbb-9b58-c73bf5e94b8f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:45.087658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6d5daa5a-6a21-4bbb-9b58-c73bf5e94b8f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:45.090885 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6d5daa5a-6a21-4bbb-9b58-c73bf5e94b8f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1584 microversion: 2.32 time: 0.188486 Oct 29 01:19:45.091940 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1805/3775] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:44 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1584 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:45.097603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3078ab0d-903b-45bd-a512-e56875e9c7d9 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:45.105417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3078ab0d-903b-45bd-a512-e56875e9c7d9 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:45.105417 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3078ab0d-903b-45bd-a512-e56875e9c7d9 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1371 microversion: 2.57 time: 0.160473 Oct 29 01:19:45.107593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b4cbd9de-908c-4dbb-8aab-ff13e4fca04d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:45.108397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b4cbd9de-908c-4dbb-8aab-ff13e4fca04d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:45.109707 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1971/3776] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:44 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:45.125360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4cbd9de-908c-4dbb-8aab-ff13e4fca04d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:45.127861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4cbd9de-908c-4dbb-8aab-ff13e4fca04d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:45.129005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4cbd9de-908c-4dbb-8aab-ff13e4fca04d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:45.130384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4cbd9de-908c-4dbb-8aab-ff13e4fca04d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:45.134086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4cbd9de-908c-4dbb-8aab-ff13e4fca04d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:45.134984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4cbd9de-908c-4dbb-8aab-ff13e4fca04d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:45.310688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-97d4aac1-45ef-4166-aeef-437bec141c2e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:45.311616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-97d4aac1-45ef-4166-aeef-437bec141c2e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:45.324528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97d4aac1-45ef-4166-aeef-437bec141c2e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:45.337479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97d4aac1-45ef-4166-aeef-437bec141c2e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:45.337921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97d4aac1-45ef-4166-aeef-437bec141c2e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:45.342148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97d4aac1-45ef-4166-aeef-437bec141c2e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:45.342645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97d4aac1-45ef-4166-aeef-437bec141c2e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:45.343209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97d4aac1-45ef-4166-aeef-437bec141c2e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:45.552526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b4cbd9de-908c-4dbb-8aab-ff13e4fca04d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:45.571658 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b4cbd9de-908c-4dbb-8aab-ff13e4fca04d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.475880 Oct 29 01:19:45.572333 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1806/3777] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:45 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:45.761094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-97d4aac1-45ef-4166-aeef-437bec141c2e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:45.771567 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-97d4aac1-45ef-4166-aeef-437bec141c2e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1309 microversion: 2.1 time: 0.464955 Oct 29 01:19:45.773542 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1972/3778] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:45 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1309 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:45.920627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4b74664c-4e90-4757-8c27-f245b52f6e5e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9ffa09d0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:45.921491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb05238b-bcd2-4716-b4e7-977488e3bd6b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:45.923701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bb05238b-bcd2-4716-b4e7-977488e3bd6b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:45.947991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb05238b-bcd2-4716-b4e7-977488e3bd6b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:45.949429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb05238b-bcd2-4716-b4e7-977488e3bd6b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:45.950952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb05238b-bcd2-4716-b4e7-977488e3bd6b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:45.952078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb05238b-bcd2-4716-b4e7-977488e3bd6b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:45.952557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb05238b-bcd2-4716-b4e7-977488e3bd6b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:45.952996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb05238b-bcd2-4716-b4e7-977488e3bd6b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:46.009423 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4b74664c-4e90-4757-8c27-f245b52f6e5e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 200 len: 1439 microversion: 2.1 time: 0.101188 Oct 29 01:19:46.017376 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1807/3779] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:45 2022] GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 1439 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:46.082414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bb05238b-bcd2-4716-b4e7-977488e3bd6b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:46.116289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bb05238b-bcd2-4716-b4e7-977488e3bd6b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:46.120635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bb05238b-bcd2-4716-b4e7-977488e3bd6b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:46.126559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a1f96e2a-4fc7-4fd1-ac39-e75c96033bbc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:46.127397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a1f96e2a-4fc7-4fd1-ac39-e75c96033bbc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:46.151547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1f96e2a-4fc7-4fd1-ac39-e75c96033bbc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:46.153833 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bb05238b-bcd2-4716-b4e7-977488e3bd6b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1533 microversion: 2.91 time: 0.240383 Oct 29 01:19:46.154870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1f96e2a-4fc7-4fd1-ac39-e75c96033bbc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:46.158785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1f96e2a-4fc7-4fd1-ac39-e75c96033bbc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:46.162359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1f96e2a-4fc7-4fd1-ac39-e75c96033bbc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:46.162359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1f96e2a-4fc7-4fd1-ac39-e75c96033bbc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:46.162359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1f96e2a-4fc7-4fd1-ac39-e75c96033bbc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:46.162722 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1973/3780] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:45 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1533 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:46.170780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9788af89-174f-4c9d-a79e-0c0ef944de8e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:46.176636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9788af89-174f-4c9d-a79e-0c0ef944de8e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:46.202260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9788af89-174f-4c9d-a79e-0c0ef944de8e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:46.205380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9788af89-174f-4c9d-a79e-0c0ef944de8e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:46.207758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9788af89-174f-4c9d-a79e-0c0ef944de8e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:46.213261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9788af89-174f-4c9d-a79e-0c0ef944de8e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:46.217323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9788af89-174f-4c9d-a79e-0c0ef944de8e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:46.217972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9788af89-174f-4c9d-a79e-0c0ef944de8e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:46.328114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a1f96e2a-4fc7-4fd1-ac39-e75c96033bbc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:46.345634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a1f96e2a-4fc7-4fd1-ac39-e75c96033bbc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:46.347101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a1f96e2a-4fc7-4fd1-ac39-e75c96033bbc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:46.348285 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a1f96e2a-4fc7-4fd1-ac39-e75c96033bbc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1594 microversion: 2.32 time: 0.226264 Oct 29 01:19:46.349995 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1808/3781] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:46 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1594 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:46.384990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9788af89-174f-4c9d-a79e-0c0ef944de8e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:46.401607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9788af89-174f-4c9d-a79e-0c0ef944de8e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:46.403740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9788af89-174f-4c9d-a79e-0c0ef944de8e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:46.406265 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9788af89-174f-4c9d-a79e-0c0ef944de8e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1371 microversion: 2.57 time: 0.242269 Oct 29 01:19:46.408503 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1974/3782] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:46 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:46.599982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-296075ef-435e-48df-acfa-de8c43e93fe9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:46.600603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-296075ef-435e-48df-acfa-de8c43e93fe9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:46.610096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-296075ef-435e-48df-acfa-de8c43e93fe9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:46.610856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-296075ef-435e-48df-acfa-de8c43e93fe9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:46.611472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-296075ef-435e-48df-acfa-de8c43e93fe9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:46.612405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-296075ef-435e-48df-acfa-de8c43e93fe9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:46.613279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-296075ef-435e-48df-acfa-de8c43e93fe9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:46.613932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-296075ef-435e-48df-acfa-de8c43e93fe9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:46.794872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d2e561d8-d8c3-4b12-bc20-0560b5edecf4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:46.795794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d2e561d8-d8c3-4b12-bc20-0560b5edecf4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:46.816136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2e561d8-d8c3-4b12-bc20-0560b5edecf4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:46.821007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2e561d8-d8c3-4b12-bc20-0560b5edecf4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:46.821305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2e561d8-d8c3-4b12-bc20-0560b5edecf4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:46.822060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2e561d8-d8c3-4b12-bc20-0560b5edecf4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:46.822697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2e561d8-d8c3-4b12-bc20-0560b5edecf4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:46.824198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2e561d8-d8c3-4b12-bc20-0560b5edecf4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:47.038794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-296075ef-435e-48df-acfa-de8c43e93fe9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:47.058231 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-296075ef-435e-48df-acfa-de8c43e93fe9 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.462004 Oct 29 01:19:47.081940 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1809/3783] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:46 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:47.095856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-276c04c4-999c-40c7-9cc6-cfee49af4ec2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97a03dc0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:47.200876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d2e561d8-d8c3-4b12-bc20-0560b5edecf4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:47.209212 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d2e561d8-d8c3-4b12-bc20-0560b5edecf4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1309 microversion: 2.1 time: 0.418751 Oct 29 01:19:47.218894 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-276c04c4-999c-40c7-9cc6-cfee49af4ec2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 200 len: 1439 microversion: 2.1 time: 0.109177 Oct 29 01:19:47.218894 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1810/3784] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:47 2022] GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 1439 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:47.219159 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1975/3785] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:46 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1309 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:47.229692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-71970765-ef21-42a6-9ca0-4532bf9c5561 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:47.230463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-71970765-ef21-42a6-9ca0-4532bf9c5561 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:47.246894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71970765-ef21-42a6-9ca0-4532bf9c5561 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:47.247733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71970765-ef21-42a6-9ca0-4532bf9c5561 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:47.248394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71970765-ef21-42a6-9ca0-4532bf9c5561 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:47.249406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71970765-ef21-42a6-9ca0-4532bf9c5561 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:47.250089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71970765-ef21-42a6-9ca0-4532bf9c5561 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:47.255821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71970765-ef21-42a6-9ca0-4532bf9c5561 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:47.374743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-71970765-ef21-42a6-9ca0-4532bf9c5561 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:47.380177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2f3c970d-cba0-41da-a3d4-3086f30af57c tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:47.384013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2f3c970d-cba0-41da-a3d4-3086f30af57c tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:47.400859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-71970765-ef21-42a6-9ca0-4532bf9c5561 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:47.406996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f3c970d-cba0-41da-a3d4-3086f30af57c tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:47.409087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-71970765-ef21-42a6-9ca0-4532bf9c5561 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:47.409943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f3c970d-cba0-41da-a3d4-3086f30af57c tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:47.410600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f3c970d-cba0-41da-a3d4-3086f30af57c tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:47.416700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f3c970d-cba0-41da-a3d4-3086f30af57c tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:47.417549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f3c970d-cba0-41da-a3d4-3086f30af57c tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:47.419664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f3c970d-cba0-41da-a3d4-3086f30af57c tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:47.425537 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-71970765-ef21-42a6-9ca0-4532bf9c5561 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1533 microversion: 2.91 time: 0.213362 Oct 29 01:19:47.446753 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1811/3786] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:47 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1533 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:47.464344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-98cc62eb-29d5-4b87-9b4b-67992910b19d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:47.468222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-98cc62eb-29d5-4b87-9b4b-67992910b19d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:47.487466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98cc62eb-29d5-4b87-9b4b-67992910b19d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:47.498961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98cc62eb-29d5-4b87-9b4b-67992910b19d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:47.506604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98cc62eb-29d5-4b87-9b4b-67992910b19d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:47.508290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98cc62eb-29d5-4b87-9b4b-67992910b19d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:47.508992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98cc62eb-29d5-4b87-9b4b-67992910b19d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:47.510189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98cc62eb-29d5-4b87-9b4b-67992910b19d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:47.659138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-98cc62eb-29d5-4b87-9b4b-67992910b19d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:47.685853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-98cc62eb-29d5-4b87-9b4b-67992910b19d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:47.685853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-98cc62eb-29d5-4b87-9b4b-67992910b19d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:47.685853 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-98cc62eb-29d5-4b87-9b4b-67992910b19d tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1356 microversion: 2.57 time: 0.229363 Oct 29 01:19:47.685853 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1812/3787] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:47 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1356 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:47.717480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-51b26880-2c26-4f8f-9342-5d4c56066105 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:47.718128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-51b26880-2c26-4f8f-9342-5d4c56066105 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:47.731420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51b26880-2c26-4f8f-9342-5d4c56066105 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:47.732008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51b26880-2c26-4f8f-9342-5d4c56066105 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:47.732558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51b26880-2c26-4f8f-9342-5d4c56066105 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:47.733421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51b26880-2c26-4f8f-9342-5d4c56066105 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:47.735316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51b26880-2c26-4f8f-9342-5d4c56066105 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:47.743521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51b26880-2c26-4f8f-9342-5d4c56066105 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:47.767891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:47.789681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-51b26880-2c26-4f8f-9342-5d4c56066105 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:19:47.796441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=12 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:47.986322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f3c970d-cba0-41da-a3d4-3086f30af57c tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:48.000805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f3c970d-cba0-41da-a3d4-3086f30af57c tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:48.006966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f3c970d-cba0-41da-a3d4-3086f30af57c tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:48.010545 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2f3c970d-cba0-41da-a3d4-3086f30af57c tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1662 microversion: 2.32 time: 0.634238 Oct 29 01:19:48.014018 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1976/3788] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:47 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1662 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:48.096057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c3f1ceb1-4d73-4d00-b6ed-20872fecdb05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:48.097494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c3f1ceb1-4d73-4d00-b6ed-20872fecdb05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:48.115186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3f1ceb1-4d73-4d00-b6ed-20872fecdb05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:48.116119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3f1ceb1-4d73-4d00-b6ed-20872fecdb05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:48.118359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3f1ceb1-4d73-4d00-b6ed-20872fecdb05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:48.119404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3f1ceb1-4d73-4d00-b6ed-20872fecdb05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:48.120262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3f1ceb1-4d73-4d00-b6ed-20872fecdb05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:48.122338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3f1ceb1-4d73-4d00-b6ed-20872fecdb05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:48.245643 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-51b26880-2c26-4f8f-9342-5d4c56066105 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 204 len: 0 microversion: 2.57 time: 0.532163 Oct 29 01:19:48.246295 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1813/3789] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:19:47 2022] DELETE /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 29 01:19:48.252682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b8d60071-3578-4549-865a-120f47a49671 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9ffa09d0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:48.334212 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b8d60071-3578-4549-865a-120f47a49671 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 200 len: 1439 microversion: 2.1 time: 0.086398 Oct 29 01:19:48.334953 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1814/3790] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:48 2022] GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 1439 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:48.346040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fb1ec565-8f87-4f36-b113-1fc26e9c7c07 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:48.346892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fb1ec565-8f87-4f36-b113-1fc26e9c7c07 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:48.363862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb1ec565-8f87-4f36-b113-1fc26e9c7c07 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:48.364366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb1ec565-8f87-4f36-b113-1fc26e9c7c07 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:48.364835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb1ec565-8f87-4f36-b113-1fc26e9c7c07 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:48.365574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb1ec565-8f87-4f36-b113-1fc26e9c7c07 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:48.366047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb1ec565-8f87-4f36-b113-1fc26e9c7c07 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:48.366474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb1ec565-8f87-4f36-b113-1fc26e9c7c07 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:48.712268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c3f1ceb1-4d73-4d00-b6ed-20872fecdb05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:48.721018 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c3f1ceb1-4d73-4d00-b6ed-20872fecdb05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.628922 Oct 29 01:19:48.733671 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1977/3791] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:48 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:48.755109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-de9e9e45-07c3-4d90-be7b-073e32f3200c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:48.757027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-de9e9e45-07c3-4d90-be7b-073e32f3200c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:48.762850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de9e9e45-07c3-4d90-be7b-073e32f3200c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:48.763348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de9e9e45-07c3-4d90-be7b-073e32f3200c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:48.763792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de9e9e45-07c3-4d90-be7b-073e32f3200c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:48.764509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de9e9e45-07c3-4d90-be7b-073e32f3200c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:48.764968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de9e9e45-07c3-4d90-be7b-073e32f3200c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:48.774121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de9e9e45-07c3-4d90-be7b-073e32f3200c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:48.871591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fb1ec565-8f87-4f36-b113-1fc26e9c7c07 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:48.886650 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fb1ec565-8f87-4f36-b113-1fc26e9c7c07 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1489 microversion: 2.1 time: 0.550507 Oct 29 01:19:48.887633 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1815/3792] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:48 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1489 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:48.897006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e3f81d6f-7b49-469d-9b1c-5a934d8d82b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:48.900514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e3f81d6f-7b49-469d-9b1c-5a934d8d82b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:48.910279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3f81d6f-7b49-469d-9b1c-5a934d8d82b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:48.910769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3f81d6f-7b49-469d-9b1c-5a934d8d82b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:48.911219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3f81d6f-7b49-469d-9b1c-5a934d8d82b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:48.911938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3f81d6f-7b49-469d-9b1c-5a934d8d82b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:48.912404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3f81d6f-7b49-469d-9b1c-5a934d8d82b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:48.912835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3f81d6f-7b49-469d-9b1c-5a934d8d82b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:49.081662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-de9e9e45-07c3-4d90-be7b-073e32f3200c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:49.090680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-de9e9e45-07c3-4d90-be7b-073e32f3200c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:49.103436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-de9e9e45-07c3-4d90-be7b-073e32f3200c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:49.105119 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-de9e9e45-07c3-4d90-be7b-073e32f3200c tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1362 microversion: 2.57 time: 0.370250 Oct 29 01:19:49.106029 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1978/3793] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:48 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:49.111203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e358d1b6-1cb6-48be-913d-938b86501765 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:49.118291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e358d1b6-1cb6-48be-913d-938b86501765 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:49.126965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e358d1b6-1cb6-48be-913d-938b86501765 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:49.127732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e358d1b6-1cb6-48be-913d-938b86501765 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:49.135668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e358d1b6-1cb6-48be-913d-938b86501765 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:49.136439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e358d1b6-1cb6-48be-913d-938b86501765 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:49.136933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e358d1b6-1cb6-48be-913d-938b86501765 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:49.137404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e358d1b6-1cb6-48be-913d-938b86501765 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:49.166767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e3f81d6f-7b49-469d-9b1c-5a934d8d82b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:49.176358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e3f81d6f-7b49-469d-9b1c-5a934d8d82b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:49.189185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e3f81d6f-7b49-469d-9b1c-5a934d8d82b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:49.211824 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e3f81d6f-7b49-469d-9b1c-5a934d8d82b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1533 microversion: 2.91 time: 0.323008 Oct 29 01:19:49.212426 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1816/3794] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:48 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1533 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:49.222223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5031f101-2d35-4748-959e-558d70ed9c60 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:49.231413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5031f101-2d35-4748-959e-558d70ed9c60 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:49.238143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5031f101-2d35-4748-959e-558d70ed9c60 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:49.238877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5031f101-2d35-4748-959e-558d70ed9c60 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:49.239484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5031f101-2d35-4748-959e-558d70ed9c60 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:49.240342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5031f101-2d35-4748-959e-558d70ed9c60 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:49.241745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5031f101-2d35-4748-959e-558d70ed9c60 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:49.253915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5031f101-2d35-4748-959e-558d70ed9c60 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:49.512097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e358d1b6-1cb6-48be-913d-938b86501765 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:49.524253 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e358d1b6-1cb6-48be-913d-938b86501765 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 200 len: 1489 microversion: 2.1 time: 0.416206 Oct 29 01:19:49.527970 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1979/3795] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:49 2022] GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 1489 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:49.532109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5031f101-2d35-4748-959e-558d70ed9c60 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:49.537111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b8a59037-026e-476e-b74e-f75b99972f21 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9779c8b0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:49.569030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5031f101-2d35-4748-959e-558d70ed9c60 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:49.586566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5031f101-2d35-4748-959e-558d70ed9c60 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:49.590759 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5031f101-2d35-4748-959e-558d70ed9c60 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1709 microversion: 2.32 time: 0.372221 Oct 29 01:19:49.591511 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1817/3796] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:49 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1709 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:49.598468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-46c70ae9-8575-4a49-982c-26d502988c9f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:49.599297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-46c70ae9-8575-4a49-982c-26d502988c9f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:49.606472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-46c70ae9-8575-4a49-982c-26d502988c9f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:49.615625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-46c70ae9-8575-4a49-982c-26d502988c9f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:49.615625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-46c70ae9-8575-4a49-982c-26d502988c9f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:49.615625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-46c70ae9-8575-4a49-982c-26d502988c9f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:49.615625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-46c70ae9-8575-4a49-982c-26d502988c9f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:49.615625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-46c70ae9-8575-4a49-982c-26d502988c9f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:49.616122 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b8a59037-026e-476e-b74e-f75b99972f21 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 200 len: 1439 microversion: 2.1 time: 0.081163 Oct 29 01:19:49.616122 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1980/3797] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:49 2022] GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 1439 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:49.749347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5da4ad54-524c-4f80-92da-3550bbe616d7 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:49.750719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5da4ad54-524c-4f80-92da-3550bbe616d7 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:49.759676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5da4ad54-524c-4f80-92da-3550bbe616d7 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:49.763039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5da4ad54-524c-4f80-92da-3550bbe616d7 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:49.763735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5da4ad54-524c-4f80-92da-3550bbe616d7 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:49.765997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5da4ad54-524c-4f80-92da-3550bbe616d7 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:49.770456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5da4ad54-524c-4f80-92da-3550bbe616d7 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:49.770456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5da4ad54-524c-4f80-92da-3550bbe616d7 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:49.940008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-46c70ae9-8575-4a49-982c-26d502988c9f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:49.952427 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-46c70ae9-8575-4a49-982c-26d502988c9f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1489 microversion: 2.1 time: 0.358137 Oct 29 01:19:49.954831 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1818/3798] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:49 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1489 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:49.983224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9d8eb41a-5750-4c9c-b494-6fb21da1cddf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:49.983989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9d8eb41a-5750-4c9c-b494-6fb21da1cddf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:50.004068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d8eb41a-5750-4c9c-b494-6fb21da1cddf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:50.004068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d8eb41a-5750-4c9c-b494-6fb21da1cddf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:50.004068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d8eb41a-5750-4c9c-b494-6fb21da1cddf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:50.004068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d8eb41a-5750-4c9c-b494-6fb21da1cddf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:50.004068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d8eb41a-5750-4c9c-b494-6fb21da1cddf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:50.009771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d8eb41a-5750-4c9c-b494-6fb21da1cddf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:50.052902 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:50.062945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9d8eb41a-5750-4c9c-b494-6fb21da1cddf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:19:50.167896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5da4ad54-524c-4f80-92da-3550bbe616d7 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:50.179415 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5da4ad54-524c-4f80-92da-3550bbe616d7 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.432343 Oct 29 01:19:50.182776 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1981/3799] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:49 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:50.207349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2750895b-7739-4db0-b83b-09e6473fe31e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:50.207982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2750895b-7739-4db0-b83b-09e6473fe31e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:50.234082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2750895b-7739-4db0-b83b-09e6473fe31e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:50.235067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2750895b-7739-4db0-b83b-09e6473fe31e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:50.245307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2750895b-7739-4db0-b83b-09e6473fe31e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:50.249650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2750895b-7739-4db0-b83b-09e6473fe31e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:50.250449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2750895b-7739-4db0-b83b-09e6473fe31e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:50.252449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2750895b-7739-4db0-b83b-09e6473fe31e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:50.403739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2750895b-7739-4db0-b83b-09e6473fe31e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:50.424695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2750895b-7739-4db0-b83b-09e6473fe31e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:50.427648 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9d8eb41a-5750-4c9c-b494-6fb21da1cddf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 204 len: 0 microversion: 2.1 time: 0.449728 Oct 29 01:19:50.432674 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1819/3800] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:19:49 2022] DELETE /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:19:50.436830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-461cd05c-e1a1-4cc5-b3e3-f0c77232604e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:50.437647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-461cd05c-e1a1-4cc5-b3e3-f0c77232604e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:50.440912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2750895b-7739-4db0-b83b-09e6473fe31e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:50.449397 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2750895b-7739-4db0-b83b-09e6473fe31e tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1362 microversion: 2.57 time: 0.263316 Oct 29 01:19:50.461663 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1982/3801] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:50 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:50.471025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-461cd05c-e1a1-4cc5-b3e3-f0c77232604e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:50.473243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-461cd05c-e1a1-4cc5-b3e3-f0c77232604e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:50.473911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-461cd05c-e1a1-4cc5-b3e3-f0c77232604e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:50.475372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-461cd05c-e1a1-4cc5-b3e3-f0c77232604e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:50.475790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4bdb6fdc-8f6e-4ad7-a47b-24f3c9006e72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:50.476779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4bdb6fdc-8f6e-4ad7-a47b-24f3c9006e72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:50.478130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-461cd05c-e1a1-4cc5-b3e3-f0c77232604e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:50.480757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-461cd05c-e1a1-4cc5-b3e3-f0c77232604e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:50.485189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bdb6fdc-8f6e-4ad7-a47b-24f3c9006e72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:50.486046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bdb6fdc-8f6e-4ad7-a47b-24f3c9006e72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:50.486746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bdb6fdc-8f6e-4ad7-a47b-24f3c9006e72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:50.487733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bdb6fdc-8f6e-4ad7-a47b-24f3c9006e72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:50.488446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bdb6fdc-8f6e-4ad7-a47b-24f3c9006e72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:50.489100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bdb6fdc-8f6e-4ad7-a47b-24f3c9006e72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:50.677595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-461cd05c-e1a1-4cc5-b3e3-f0c77232604e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:50.693776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-461cd05c-e1a1-4cc5-b3e3-f0c77232604e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:50.696688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-461cd05c-e1a1-4cc5-b3e3-f0c77232604e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:50.713292 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-461cd05c-e1a1-4cc5-b3e3-f0c77232604e tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1533 microversion: 2.91 time: 0.282123 Oct 29 01:19:50.713909 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1820/3802] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:50 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1533 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:50.718764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b77e6d27-77ff-47f8-941d-7ca2740b18c4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:50.719375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b77e6d27-77ff-47f8-941d-7ca2740b18c4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:50.735647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b77e6d27-77ff-47f8-941d-7ca2740b18c4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:50.735647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b77e6d27-77ff-47f8-941d-7ca2740b18c4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:50.771985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b77e6d27-77ff-47f8-941d-7ca2740b18c4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:50.771985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b77e6d27-77ff-47f8-941d-7ca2740b18c4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:50.771985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b77e6d27-77ff-47f8-941d-7ca2740b18c4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:50.771985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b77e6d27-77ff-47f8-941d-7ca2740b18c4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:50.819629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4bdb6fdc-8f6e-4ad7-a47b-24f3c9006e72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:50.834976 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4bdb6fdc-8f6e-4ad7-a47b-24f3c9006e72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1495 microversion: 2.1 time: 0.371249 Oct 29 01:19:50.841093 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1983/3803] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:50 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1495 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:50.860551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ac1abdd0-f287-48d4-bd31-aff7609c5c29 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97769ee0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:50.931843 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ac1abdd0-f287-48d4-bd31-aff7609c5c29 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 200 len: 1439 microversion: 2.1 time: 0.082355 Oct 29 01:19:50.933896 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1984/3804] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:50 2022] GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 1439 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:50.988634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b77e6d27-77ff-47f8-941d-7ca2740b18c4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:51.000287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b77e6d27-77ff-47f8-941d-7ca2740b18c4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:51.002169 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b77e6d27-77ff-47f8-941d-7ca2740b18c4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:51.003387 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b77e6d27-77ff-47f8-941d-7ca2740b18c4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1756 microversion: 2.32 time: 0.288501 Oct 29 01:19:51.003999 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1821/3805] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:50 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1756 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:51.227976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0a2b653a-197a-4473-8e0d-300334ab94ee tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:51.228556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0a2b653a-197a-4473-8e0d-300334ab94ee tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:51.238835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a2b653a-197a-4473-8e0d-300334ab94ee tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:51.239611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a2b653a-197a-4473-8e0d-300334ab94ee tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:51.240054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a2b653a-197a-4473-8e0d-300334ab94ee tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:51.240960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a2b653a-197a-4473-8e0d-300334ab94ee tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:51.241567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a2b653a-197a-4473-8e0d-300334ab94ee tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:51.242559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a2b653a-197a-4473-8e0d-300334ab94ee tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:51.248197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:51.480747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d7afc2e1-9ede-4f7c-bca8-53ccb2474066 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:51.481344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d7afc2e1-9ede-4f7c-bca8-53ccb2474066 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:51.496798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:51.498510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7afc2e1-9ede-4f7c-bca8-53ccb2474066 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:51.499017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7afc2e1-9ede-4f7c-bca8-53ccb2474066 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:51.499668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7afc2e1-9ede-4f7c-bca8-53ccb2474066 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:51.500924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7afc2e1-9ede-4f7c-bca8-53ccb2474066 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:51.501609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7afc2e1-9ede-4f7c-bca8-53ccb2474066 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:51.502321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7afc2e1-9ede-4f7c-bca8-53ccb2474066 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:51.705607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d7afc2e1-9ede-4f7c-bca8-53ccb2474066 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:51.723596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d7afc2e1-9ede-4f7c-bca8-53ccb2474066 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:51.725102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d7afc2e1-9ede-4f7c-bca8-53ccb2474066 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:51.733400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0a2b653a-197a-4473-8e0d-300334ab94ee tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:51.735050 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d7afc2e1-9ede-4f7c-bca8-53ccb2474066 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1362 microversion: 2.57 time: 0.258705 Oct 29 01:19:51.745853 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1822/3806] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:51 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:19:51.770575 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0a2b653a-197a-4473-8e0d-300334ab94ee tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1721 microversion: 2.1 time: 0.562348 Oct 29 01:19:51.774169 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1985/3807] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:51 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1721 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:51.775576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5a0ce0b7-6266-40be-8773-7a91761b7740 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:51.777318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5a0ce0b7-6266-40be-8773-7a91761b7740 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:51.793191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a0ce0b7-6266-40be-8773-7a91761b7740 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:51.794283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a0ce0b7-6266-40be-8773-7a91761b7740 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:51.795115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a0ce0b7-6266-40be-8773-7a91761b7740 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:51.796071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a0ce0b7-6266-40be-8773-7a91761b7740 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:51.796719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a0ce0b7-6266-40be-8773-7a91761b7740 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:51.797614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a0ce0b7-6266-40be-8773-7a91761b7740 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:51.869385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-98991025-1fa7-4f8f-8a85-ecbe4a1b340e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:51.870701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-98991025-1fa7-4f8f-8a85-ecbe4a1b340e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:51.885878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98991025-1fa7-4f8f-8a85-ecbe4a1b340e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:51.886912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98991025-1fa7-4f8f-8a85-ecbe4a1b340e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:51.888914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98991025-1fa7-4f8f-8a85-ecbe4a1b340e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:51.890463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98991025-1fa7-4f8f-8a85-ecbe4a1b340e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:51.892496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98991025-1fa7-4f8f-8a85-ecbe4a1b340e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:51.894477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98991025-1fa7-4f8f-8a85-ecbe4a1b340e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:51.913615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5a0ce0b7-6266-40be-8773-7a91761b7740 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:51.927940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5a0ce0b7-6266-40be-8773-7a91761b7740 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:51.939675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5a0ce0b7-6266-40be-8773-7a91761b7740 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:51.950140 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5a0ce0b7-6266-40be-8773-7a91761b7740 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1533 microversion: 2.91 time: 0.182820 Oct 29 01:19:51.964432 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1823/3808] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:51 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1533 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:51.981433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-71d50ccc-0e7c-4afc-8e95-a1a767c78b6b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9c0421f0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:52.078489 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-71d50ccc-0e7c-4afc-8e95-a1a767c78b6b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 200 len: 1439 microversion: 2.1 time: 0.111253 Oct 29 01:19:52.079539 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1824/3809] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:51 2022] GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 1439 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:52.092604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-98991025-1fa7-4f8f-8a85-ecbe4a1b340e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:52.100562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-69f634c1-de29-4893-b468-593c2466908a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:52.105492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-69f634c1-de29-4893-b468-593c2466908a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:52.107912 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-98991025-1fa7-4f8f-8a85-ecbe4a1b340e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1495 microversion: 2.1 time: 0.243992 Oct 29 01:19:52.123491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69f634c1-de29-4893-b468-593c2466908a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:52.126960 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1986/3810] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:51 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1495 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:19:52.129947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69f634c1-de29-4893-b468-593c2466908a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:52.134229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69f634c1-de29-4893-b468-593c2466908a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:52.134229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69f634c1-de29-4893-b468-593c2466908a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:52.134229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69f634c1-de29-4893-b468-593c2466908a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:52.134229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69f634c1-de29-4893-b468-593c2466908a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:52.332758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-69f634c1-de29-4893-b468-593c2466908a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:52.348228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-69f634c1-de29-4893-b468-593c2466908a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:52.350591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-69f634c1-de29-4893-b468-593c2466908a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:52.357315 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-69f634c1-de29-4893-b468-593c2466908a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1803 microversion: 2.32 time: 0.273631 Oct 29 01:19:52.359471 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1825/3811] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:52 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1803 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:52.775955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1fc22321-8490-4b32-be73-c674b0db50f3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:52.777823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1fc22321-8490-4b32-be73-c674b0db50f3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:52.798810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-31a0a846-76ed-4acc-a272-ff8d65d13b4a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:52.799741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-31a0a846-76ed-4acc-a272-ff8d65d13b4a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:52.812313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fc22321-8490-4b32-be73-c674b0db50f3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:52.812994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fc22321-8490-4b32-be73-c674b0db50f3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:52.814574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fc22321-8490-4b32-be73-c674b0db50f3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:52.816853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31a0a846-76ed-4acc-a272-ff8d65d13b4a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:52.817111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fc22321-8490-4b32-be73-c674b0db50f3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:52.817843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fc22321-8490-4b32-be73-c674b0db50f3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:52.818572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fc22321-8490-4b32-be73-c674b0db50f3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:52.822424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31a0a846-76ed-4acc-a272-ff8d65d13b4a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:52.823149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31a0a846-76ed-4acc-a272-ff8d65d13b4a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:52.823992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31a0a846-76ed-4acc-a272-ff8d65d13b4a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:52.824851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31a0a846-76ed-4acc-a272-ff8d65d13b4a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:52.831370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31a0a846-76ed-4acc-a272-ff8d65d13b4a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:52.901911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fc22321-8490-4b32-be73-c674b0db50f3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:52.902737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fc22321-8490-4b32-be73-c674b0db50f3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:52.903542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fc22321-8490-4b32-be73-c674b0db50f3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:52.904128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-1fc22321-8490-4b32-be73-c674b0db50f3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lazy-loading 'fault' on Instance uuid 0480690b-bdc0-4eae-a8bb-ff5d5257ee37 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:19:52.967604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1fc22321-8490-4b32-be73-c674b0db50f3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:52.979086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1fc22321-8490-4b32-be73-c674b0db50f3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:52.981228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1fc22321-8490-4b32-be73-c674b0db50f3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6953aa583464efdaa5e473f7295b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce34f5642ee1421794b33c617b98b8fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:52.985963 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1fc22321-8490-4b32-be73-c674b0db50f3 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 200 len: 1367 microversion: 2.57 time: 0.222880 Oct 29 01:19:52.985963 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1987/3812] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:52 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:53.011607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a6309abf-d2b2-4b92-a498-eeba17284c20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:53.012233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a6309abf-d2b2-4b92-a498-eeba17284c20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:53.018651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6309abf-d2b2-4b92-a498-eeba17284c20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:53.019145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6309abf-d2b2-4b92-a498-eeba17284c20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:53.019585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6309abf-d2b2-4b92-a498-eeba17284c20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:53.020538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6309abf-d2b2-4b92-a498-eeba17284c20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:53.020754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6309abf-d2b2-4b92-a498-eeba17284c20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:53.021241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a6309abf-d2b2-4b92-a498-eeba17284c20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:53.172580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a6309abf-d2b2-4b92-a498-eeba17284c20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:53.190530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a6309abf-d2b2-4b92-a498-eeba17284c20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:53.191899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a6309abf-d2b2-4b92-a498-eeba17284c20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:53.202918 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a6309abf-d2b2-4b92-a498-eeba17284c20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1536 microversion: 2.91 time: 0.215019 Oct 29 01:19:53.203838 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1988/3813] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:52 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1536 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:53.208599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a3b76d59-401f-472b-8562-3f7ed6ea801c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9715aca0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:53.231751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-31a0a846-76ed-4acc-a272-ff8d65d13b4a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:53.241493 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-31a0a846-76ed-4acc-a272-ff8d65d13b4a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1698 microversion: 2.1 time: 0.447838 Oct 29 01:19:53.244468 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1826/3814] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:52 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1698 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:53.247598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b7d54d77-bc37-456e-b5b1-6d45c0d5f86c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:53.248199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b7d54d77-bc37-456e-b5b1-6d45c0d5f86c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:53.254210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7d54d77-bc37-456e-b5b1-6d45c0d5f86c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:53.254690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7d54d77-bc37-456e-b5b1-6d45c0d5f86c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:53.255128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7d54d77-bc37-456e-b5b1-6d45c0d5f86c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:53.255858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7d54d77-bc37-456e-b5b1-6d45c0d5f86c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:53.256302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7d54d77-bc37-456e-b5b1-6d45c0d5f86c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:53.256931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7d54d77-bc37-456e-b5b1-6d45c0d5f86c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:53.344744 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a3b76d59-401f-472b-8562-3f7ed6ea801c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 200 len: 1439 microversion: 2.1 time: 0.139721 Oct 29 01:19:53.347807 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1989/3815] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:53 2022] GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 1439 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:53.353879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3303b536-531c-4db7-b263-6830132dedfc tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-862964-3"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:53.368152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3303b536-531c-4db7-b263-6830132dedfc tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:53.375976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3303b536-531c-4db7-b263-6830132dedfc tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:53.376725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3303b536-531c-4db7-b263-6830132dedfc tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:53.377368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3303b536-531c-4db7-b263-6830132dedfc tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:53.378273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3303b536-531c-4db7-b263-6830132dedfc tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:53.378886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3303b536-531c-4db7-b263-6830132dedfc tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:53.379475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3303b536-531c-4db7-b263-6830132dedfc tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:53.509296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3303b536-531c-4db7-b263-6830132dedfc tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-862964-3". {{(pid=121099) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 01:19:53.760547 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3303b536-531c-4db7-b263-6830132dedfc tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a/action" status: 202 len: 0 microversion: 2.91 time: 0.411608 Oct 29 01:19:53.762051 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1990/3816] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 29 01:19:53 2022] POST /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:19:53.770080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-94895314-60ab-4b06-8c45-ee8c94188fb0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:53.791281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94895314-60ab-4b06-8c45-ee8c94188fb0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:53.791774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94895314-60ab-4b06-8c45-ee8c94188fb0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:53.792207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-94895314-60ab-4b06-8c45-ee8c94188fb0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:53.851593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-94895314-60ab-4b06-8c45-ee8c94188fb0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Going to try to start instance {{(pid=121099) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 01:19:54.073733 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-94895314-60ab-4b06-8c45-ee8c94188fb0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "POST /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3/action" status: 202 len: 0 microversion: 2.1 time: 0.309023 Oct 29 01:19:54.074459 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1991/3817] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:19:53 2022] POST /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:19:54.109073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dcc3e030-5d63-40d3-9396-541683c3b0ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:54.109823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dcc3e030-5d63-40d3-9396-541683c3b0ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:54.120065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b7d54d77-bc37-456e-b5b1-6d45c0d5f86c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:54.123459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcc3e030-5d63-40d3-9396-541683c3b0ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:54.124021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcc3e030-5d63-40d3-9396-541683c3b0ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:54.126325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcc3e030-5d63-40d3-9396-541683c3b0ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:54.126325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcc3e030-5d63-40d3-9396-541683c3b0ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:54.126325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcc3e030-5d63-40d3-9396-541683c3b0ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:54.126787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcc3e030-5d63-40d3-9396-541683c3b0ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:54.130217 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b7d54d77-bc37-456e-b5b1-6d45c0d5f86c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1495 microversion: 2.1 time: 0.886468 Oct 29 01:19:54.134829 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1827/3818] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:53 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1495 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:54.142678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-86d96083-9602-489a-8128-8872adc6d4a1 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:54.152234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-86d96083-9602-489a-8128-8872adc6d4a1 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:54.168456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86d96083-9602-489a-8128-8872adc6d4a1 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:54.169572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86d96083-9602-489a-8128-8872adc6d4a1 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:54.170495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86d96083-9602-489a-8128-8872adc6d4a1 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:54.171403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86d96083-9602-489a-8128-8872adc6d4a1 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:54.172121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86d96083-9602-489a-8128-8872adc6d4a1 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:54.172738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86d96083-9602-489a-8128-8872adc6d4a1 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:54.950742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-86d96083-9602-489a-8128-8872adc6d4a1 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:55.011025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-86d96083-9602-489a-8128-8872adc6d4a1 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:55.015422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-86d96083-9602-489a-8128-8872adc6d4a1 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:55.044702 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-86d96083-9602-489a-8128-8872adc6d4a1 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1544 microversion: 2.91 time: 0.906727 Oct 29 01:19:55.048615 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1828/3819] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:54 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1544 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:55.057756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dcc3e030-5d63-40d3-9396-541683c3b0ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:55.062219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-61cc73f1-a158-4ccd-a279-fe7819c507c4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:55.064350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-61cc73f1-a158-4ccd-a279-fe7819c507c4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] [instance: 0480690b-bdc0-4eae-a8bb-ff5d5257ee37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:55.076897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61cc73f1-a158-4ccd-a279-fe7819c507c4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:55.079356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61cc73f1-a158-4ccd-a279-fe7819c507c4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:55.084861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61cc73f1-a158-4ccd-a279-fe7819c507c4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:55.087828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61cc73f1-a158-4ccd-a279-fe7819c507c4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:55.093852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61cc73f1-a158-4ccd-a279-fe7819c507c4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:55.093852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61cc73f1-a158-4ccd-a279-fe7819c507c4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:55.094085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dcc3e030-5d63-40d3-9396-541683c3b0ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:55.094085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dcc3e030-5d63-40d3-9396-541683c3b0ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:55.094633 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dcc3e030-5d63-40d3-9396-541683c3b0ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1850 microversion: 2.32 time: 1.004844 Oct 29 01:19:55.095043 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1992/3820] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:54 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1850 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:55.118174 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-61cc73f1-a158-4ccd-a279-fe7819c507c4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] HTTP exception thrown: Instance 0480690b-bdc0-4eae-a8bb-ff5d5257ee37 could not be found. Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-61cc73f1-a158-4ccd-a279-fe7819c507c4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Request method failure captured: Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 HTTP/1.1 Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH9_LL0uffT1eJ5WYJ9CO8mFu0l6UIyBEieozG7Jc9qI1ed_H2LLZs4bdnpG7w8IuOeKQ-mkBAMY9YbI3Mcy4fdZsqJwZKq4qI8jEF76F4gA5E7I68IZZErLSZnohHrgL-mpeLqMjIAya7E3FYHO_oA3UwSOX2Rw3kwQZx3dJXV3txA Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-Openstack-Nova-Api-Version: 2.57 Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: ce34f5642ee1421794b33c617b98b8fc Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerShowV257Test-170631025 Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ce34f5642ee1421794b33c617b98b8fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ce34f5642ee1421794b33c617b98b8fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ce34f5642ee1421794b33c617b98b8fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ce34f5642ee1421794b33c617b98b8fc", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerShowV257Test-170631025 Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: ce34f5642ee1421794b33c617b98b8fc Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerShowV257Test-170631025 Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerShowV257Test-170631025-project Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: c6953aa583464efdaa5e473f7295b934 Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerShowV257Test-170631025-project Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 0480690b-bdc0-4eae-a8bb-ff5d5257ee37 could not be found. Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '0480690b-bdc0-4eae-a8bb-ff5d5257ee37'} Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0480690b-bdc0-4eae-a8bb-ff5d5257ee37 could not be found. Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0480690b-bdc0-4eae-a8bb-ff5d5257ee37 could not be found. Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:19:55.120252 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:19:55.135607 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:19:55.135607 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:19:55.135607 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:19:55.135607 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:19:55.135607 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:19:55.135607 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0480690b-bdc0-4eae-a8bb-ff5d5257ee37 could not be found. Oct 29 01:19:55.135607 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:19:55.135607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-61cc73f1-a158-4ccd-a279-fe7819c507c4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] Returning 404 to user: Instance 0480690b-bdc0-4eae-a8bb-ff5d5257ee37 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:19:55.135607 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-61cc73f1-a158-4ccd-a279-fe7819c507c4 tempest-ServerShowV257Test-170631025 tempest-ServerShowV257Test-170631025-project] 10.222.0.26 "GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37" status: 404 len: 111 microversion: 2.57 time: 0.073179 Oct 29 01:19:55.135607 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1829/3821] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:55 2022] GET /compute/v2.1/servers/0480690b-bdc0-4eae-a8bb-ff5d5257ee37 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:19:55.138086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-505b9201-794f-4d9f-bd49-308a26bb38d2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:55.138086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-505b9201-794f-4d9f-bd49-308a26bb38d2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:55.141302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d541317e-479b-4c13-a7c6-d7b1e55953db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d974af700>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:55.165261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-505b9201-794f-4d9f-bd49-308a26bb38d2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:55.165261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-505b9201-794f-4d9f-bd49-308a26bb38d2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:55.165261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-505b9201-794f-4d9f-bd49-308a26bb38d2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:55.165708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-505b9201-794f-4d9f-bd49-308a26bb38d2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:55.169140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-505b9201-794f-4d9f-bd49-308a26bb38d2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:55.169813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-505b9201-794f-4d9f-bd49-308a26bb38d2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:55.256932 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d541317e-479b-4c13-a7c6-d7b1e55953db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 200 len: 1439 microversion: 2.1 time: 0.131705 Oct 29 01:19:55.260425 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1830/3822] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:55 2022] GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 1439 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:55.456694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-40033d16-cb0d-4a5c-84bf-a5c6b781bc53 req-34dc09b1-1c8c-4e7a-b2ff-0e1cdcdf52a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "tag": "b1d81c50-121c-4e21-adfd-a87f547012cc"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:55.480141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-40033d16-cb0d-4a5c-84bf-a5c6b781bc53 req-34dc09b1-1c8c-4e7a-b2ff-0e1cdcdf52a3 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:55.480665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-40033d16-cb0d-4a5c-84bf-a5c6b781bc53 req-34dc09b1-1c8c-4e7a-b2ff-0e1cdcdf52a3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:55.481119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-40033d16-cb0d-4a5c-84bf-a5c6b781bc53 req-34dc09b1-1c8c-4e7a-b2ff-0e1cdcdf52a3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:55.534672 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-40033d16-cb0d-4a5c-84bf-a5c6b781bc53 req-34dc09b1-1c8c-4e7a-b2ff-0e1cdcdf52a3 service nova] Creating event network-changed:b1d81c50-121c-4e21-adfd-a87f547012cc for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:19:55.546657 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-40033d16-cb0d-4a5c-84bf-a5c6b781bc53 req-34dc09b1-1c8c-4e7a-b2ff-0e1cdcdf52a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.283127 Oct 29 01:19:55.547867 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1831/3823] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:55.563802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0540d285-cda1-4f80-9a75-fcae2cb4c4a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:55.565995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0540d285-cda1-4f80-9a75-fcae2cb4c4a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:55.634882 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0540d285-cda1-4f80-9a75-fcae2cb4c4a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:55.635433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0540d285-cda1-4f80-9a75-fcae2cb4c4a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:55.635890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0540d285-cda1-4f80-9a75-fcae2cb4c4a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:55.636647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0540d285-cda1-4f80-9a75-fcae2cb4c4a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:55.637114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0540d285-cda1-4f80-9a75-fcae2cb4c4a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:55.654657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0540d285-cda1-4f80-9a75-fcae2cb4c4a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:56.099955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0540d285-cda1-4f80-9a75-fcae2cb4c4a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:56.111235 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0540d285-cda1-4f80-9a75-fcae2cb4c4a7 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1453 microversion: 2.1 time: 0.560116 Oct 29 01:19:56.118897 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1832/3824] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:55 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1453 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:56.126670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-bfa24e17-b572-4f20-806c-a2c6810de0a9 req-9c3268fe-1e72-4aac-abe6-cbb8f5fda25b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d014296-4cd2-4a65-89e1-fba4193cae7c", "name": "network-vif-deleted", "tag": "0b5217fb-8ffe-43df-9b91-470df8435002"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:56.147692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-bfa24e17-b572-4f20-806c-a2c6810de0a9 req-9c3268fe-1e72-4aac-abe6-cbb8f5fda25b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:56.149784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-bfa24e17-b572-4f20-806c-a2c6810de0a9 req-9c3268fe-1e72-4aac-abe6-cbb8f5fda25b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:56.150474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-bfa24e17-b572-4f20-806c-a2c6810de0a9 req-9c3268fe-1e72-4aac-abe6-cbb8f5fda25b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:56.164852 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-bfa24e17-b572-4f20-806c-a2c6810de0a9 req-9c3268fe-1e72-4aac-abe6-cbb8f5fda25b service nova] Creating event network-vif-deleted:0b5217fb-8ffe-43df-9b91-470df8435002 for instance 2d014296-4cd2-4a65-89e1-fba4193cae7c on n-h1-862964-3 Oct 29 01:19:56.171464 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-bfa24e17-b572-4f20-806c-a2c6810de0a9 req-9c3268fe-1e72-4aac-abe6-cbb8f5fda25b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049485 Oct 29 01:19:56.174442 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1833/3825] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:56.179900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-deebe69e-37cc-47d6-828e-5bae49011027 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:56.181327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-deebe69e-37cc-47d6-828e-5bae49011027 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:56.208606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-deebe69e-37cc-47d6-828e-5bae49011027 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:56.209866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-deebe69e-37cc-47d6-828e-5bae49011027 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:56.212431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-deebe69e-37cc-47d6-828e-5bae49011027 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:56.214016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-deebe69e-37cc-47d6-828e-5bae49011027 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:56.215307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-deebe69e-37cc-47d6-828e-5bae49011027 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:56.217262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-deebe69e-37cc-47d6-828e-5bae49011027 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:56.231984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-505b9201-794f-4d9f-bd49-308a26bb38d2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:56.258550 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-505b9201-794f-4d9f-bd49-308a26bb38d2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1707 microversion: 2.1 time: 1.152574 Oct 29 01:19:56.258550 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1993/3826] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:55 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1707 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:56.301218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8404b16d-758a-4c40-a26f-d5edf4ddaae3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:56.302249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8404b16d-758a-4c40-a26f-d5edf4ddaae3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:56.324684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8404b16d-758a-4c40-a26f-d5edf4ddaae3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:56.325929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8404b16d-758a-4c40-a26f-d5edf4ddaae3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:56.326474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8404b16d-758a-4c40-a26f-d5edf4ddaae3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:56.327304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8404b16d-758a-4c40-a26f-d5edf4ddaae3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:56.327893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8404b16d-758a-4c40-a26f-d5edf4ddaae3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:56.328426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8404b16d-758a-4c40-a26f-d5edf4ddaae3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:56.456287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-deebe69e-37cc-47d6-828e-5bae49011027 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:56.470889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-deebe69e-37cc-47d6-828e-5bae49011027 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:56.473356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-deebe69e-37cc-47d6-828e-5bae49011027 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:56.490088 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-deebe69e-37cc-47d6-828e-5bae49011027 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1486 microversion: 2.91 time: 0.315811 Oct 29 01:19:56.510496 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1834/3827] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:56 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1486 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:56.527312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-027b47e6-a0dc-4d71-a1a4-041b19f24e83 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9fefac10>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:56.628184 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-027b47e6-a0dc-4d71-a1a4-041b19f24e83 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 200 len: 1439 microversion: 2.1 time: 0.116279 Oct 29 01:19:56.630032 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1835/3828] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:56 2022] GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 1439 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:56.756055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8404b16d-758a-4c40-a26f-d5edf4ddaae3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:56.768779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8404b16d-758a-4c40-a26f-d5edf4ddaae3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:56.784446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8404b16d-758a-4c40-a26f-d5edf4ddaae3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:56.790733 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8404b16d-758a-4c40-a26f-d5edf4ddaae3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1850 microversion: 2.32 time: 0.510245 Oct 29 01:19:56.790733 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1994/3829] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:56 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1850 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:57.146801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2af7f9c2-0b74-46e5-8032-4d4ab578347b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:57.147459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2af7f9c2-0b74-46e5-8032-4d4ab578347b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:57.167810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2af7f9c2-0b74-46e5-8032-4d4ab578347b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:57.168584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2af7f9c2-0b74-46e5-8032-4d4ab578347b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:57.169045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2af7f9c2-0b74-46e5-8032-4d4ab578347b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:57.169862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2af7f9c2-0b74-46e5-8032-4d4ab578347b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:57.170332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2af7f9c2-0b74-46e5-8032-4d4ab578347b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:57.170769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2af7f9c2-0b74-46e5-8032-4d4ab578347b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:57.264845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2af7f9c2-0b74-46e5-8032-4d4ab578347b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:57.265709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2af7f9c2-0b74-46e5-8032-4d4ab578347b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:57.266429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2af7f9c2-0b74-46e5-8032-4d4ab578347b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:57.267646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-2af7f9c2-0b74-46e5-8032-4d4ab578347b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lazy-loading 'fault' on Instance uuid 2d014296-4cd2-4a65-89e1-fba4193cae7c {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:19:57.283584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-984f53b9-34d1-4366-9b09-4768392ba5e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:57.284959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-984f53b9-34d1-4366-9b09-4768392ba5e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:57.314643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-984f53b9-34d1-4366-9b09-4768392ba5e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:57.315445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-984f53b9-34d1-4366-9b09-4768392ba5e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:57.316556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-984f53b9-34d1-4366-9b09-4768392ba5e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:57.317561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-984f53b9-34d1-4366-9b09-4768392ba5e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:57.318264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-984f53b9-34d1-4366-9b09-4768392ba5e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:57.318928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-984f53b9-34d1-4366-9b09-4768392ba5e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:57.429412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2af7f9c2-0b74-46e5-8032-4d4ab578347b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:57.438606 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2af7f9c2-0b74-46e5-8032-4d4ab578347b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 200 len: 1299 microversion: 2.1 time: 0.296018 Oct 29 01:19:57.440930 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1836/3830] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:57 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 1299 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:57.530024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e9180996-37d1-4385-9db6-a7809597868a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:57.530647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e9180996-37d1-4385-9db6-a7809597868a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:57.541663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9180996-37d1-4385-9db6-a7809597868a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:57.542184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9180996-37d1-4385-9db6-a7809597868a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:57.545225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9180996-37d1-4385-9db6-a7809597868a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:57.545977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9180996-37d1-4385-9db6-a7809597868a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:57.547797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9180996-37d1-4385-9db6-a7809597868a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:57.548269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9180996-37d1-4385-9db6-a7809597868a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:57.793068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e9180996-37d1-4385-9db6-a7809597868a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:57.807145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e9180996-37d1-4385-9db6-a7809597868a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:57.808664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e9180996-37d1-4385-9db6-a7809597868a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:57.827152 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e9180996-37d1-4385-9db6-a7809597868a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.301106 Oct 29 01:19:57.833208 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1837/3831] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:57 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:57.843661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3e5fa6ce-38c4-4a59-be7f-6af0a072ab79 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9fd673a0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:58.072804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-984f53b9-34d1-4366-9b09-4768392ba5e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:58.098930 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-984f53b9-34d1-4366-9b09-4768392ba5e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1707 microversion: 2.1 time: 0.822719 Oct 29 01:19:58.102617 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1995/3832] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:57 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1707 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:19:58.121866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-76f3a828-bef2-4a6a-a4bb-cf6f202812ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:58.125578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-76f3a828-bef2-4a6a-a4bb-cf6f202812ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:58.135054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76f3a828-bef2-4a6a-a4bb-cf6f202812ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:58.137249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76f3a828-bef2-4a6a-a4bb-cf6f202812ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:58.138696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76f3a828-bef2-4a6a-a4bb-cf6f202812ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:58.141098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76f3a828-bef2-4a6a-a4bb-cf6f202812ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:58.142616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76f3a828-bef2-4a6a-a4bb-cf6f202812ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:58.143993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76f3a828-bef2-4a6a-a4bb-cf6f202812ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:58.767643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-76f3a828-bef2-4a6a-a4bb-cf6f202812ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:58.775025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-76f3a828-bef2-4a6a-a4bb-cf6f202812ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:58.790517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-76f3a828-bef2-4a6a-a4bb-cf6f202812ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:58.790517 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-76f3a828-bef2-4a6a-a4bb-cf6f202812ab tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1871 microversion: 2.32 time: 0.678022 Oct 29 01:19:58.790517 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1996/3833] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:58 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1871 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:58.794865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-3f0122c7-a1c7-49ad-92a3-2b05b905e3af req-54870c3f-5c7b-4483-b3dc-0f11dd6ebb15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "tag": "8de02bf9-2ec5-459d-8aff-bdd6efe86054"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:19:58.820595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-3f0122c7-a1c7-49ad-92a3-2b05b905e3af req-54870c3f-5c7b-4483-b3dc-0f11dd6ebb15 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:58.825847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-3f0122c7-a1c7-49ad-92a3-2b05b905e3af req-54870c3f-5c7b-4483-b3dc-0f11dd6ebb15 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:58.826297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-3f0122c7-a1c7-49ad-92a3-2b05b905e3af req-54870c3f-5c7b-4483-b3dc-0f11dd6ebb15 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:58.839842 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-3f0122c7-a1c7-49ad-92a3-2b05b905e3af req-54870c3f-5c7b-4483-b3dc-0f11dd6ebb15 service nova] Creating event network-changed:8de02bf9-2ec5-459d-8aff-bdd6efe86054 for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:19:58.847036 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-3f0122c7-a1c7-49ad-92a3-2b05b905e3af req-54870c3f-5c7b-4483-b3dc-0f11dd6ebb15 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055981 Oct 29 01:19:58.848272 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1997/3834] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:19:58.856557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-152f858b-adbd-48d1-91f0-8b884851ee54 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:58.857391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-152f858b-adbd-48d1-91f0-8b884851ee54 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:58.864521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-152f858b-adbd-48d1-91f0-8b884851ee54 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:58.865332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-152f858b-adbd-48d1-91f0-8b884851ee54 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:58.865952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-152f858b-adbd-48d1-91f0-8b884851ee54 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:58.867381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-152f858b-adbd-48d1-91f0-8b884851ee54 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:58.868058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-152f858b-adbd-48d1-91f0-8b884851ee54 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:58.868741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-152f858b-adbd-48d1-91f0-8b884851ee54 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:58.896889 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-152f858b-adbd-48d1-91f0-8b884851ee54 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance 2d014296-4cd2-4a65-89e1-fba4193cae7c could not be found. Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-152f858b-adbd-48d1-91f0-8b884851ee54 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c HTTP/1.1 Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 2d014296-4cd2-4a65-89e1-fba4193cae7c could not be found. Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '2d014296-4cd2-4a65-89e1-fba4193cae7c'} Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d014296-4cd2-4a65-89e1-fba4193cae7c could not be found. Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d014296-4cd2-4a65-89e1-fba4193cae7c could not be found. Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:19:58.900848 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:19:58.906732 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:19:58.906732 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:19:58.906732 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:19:58.906732 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:19:58.906732 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:19:58.906732 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d014296-4cd2-4a65-89e1-fba4193cae7c could not be found. Oct 29 01:19:58.906732 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:19:58.908472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-152f858b-adbd-48d1-91f0-8b884851ee54 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance 2d014296-4cd2-4a65-89e1-fba4193cae7c could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:19:58.909793 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-152f858b-adbd-48d1-91f0-8b884851ee54 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 404 len: 111 microversion: 2.1 time: 0.060168 Oct 29 01:19:58.925857 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1998/3835] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:58 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:19:58.925857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1ae9b3cb-526a-4859-8da4-2529af5c8807 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:58.925857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1ae9b3cb-526a-4859-8da4-2529af5c8807 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:58.930557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ae9b3cb-526a-4859-8da4-2529af5c8807 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:58.930557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ae9b3cb-526a-4859-8da4-2529af5c8807 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:58.930925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ae9b3cb-526a-4859-8da4-2529af5c8807 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:58.942207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ae9b3cb-526a-4859-8da4-2529af5c8807 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:58.942727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ae9b3cb-526a-4859-8da4-2529af5c8807 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:58.945531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ae9b3cb-526a-4859-8da4-2529af5c8807 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:59.255567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ae9b3cb-526a-4859-8da4-2529af5c8807 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:59.280389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ae9b3cb-526a-4859-8da4-2529af5c8807 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:59.282784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ae9b3cb-526a-4859-8da4-2529af5c8807 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:19:59.290193 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1ae9b3cb-526a-4859-8da4-2529af5c8807 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.373887 Oct 29 01:19:59.291405 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 1999/3836] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:19:58 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:19:59.296416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2e45a4f7-ec49-441c-be5f-31e5e43b2dd6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:59.297415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2e45a4f7-ec49-441c-be5f-31e5e43b2dd6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:59.305496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e45a4f7-ec49-441c-be5f-31e5e43b2dd6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:59.306240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e45a4f7-ec49-441c-be5f-31e5e43b2dd6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:59.306870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e45a4f7-ec49-441c-be5f-31e5e43b2dd6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:59.307899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e45a4f7-ec49-441c-be5f-31e5e43b2dd6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:59.309130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e45a4f7-ec49-441c-be5f-31e5e43b2dd6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:59.309759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e45a4f7-ec49-441c-be5f-31e5e43b2dd6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:59.345066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2e45a4f7-ec49-441c-be5f-31e5e43b2dd6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:19:59.378840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:59.874902 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2e45a4f7-ec49-441c-be5f-31e5e43b2dd6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 204 len: 0 microversion: 2.1 time: 0.581831 Oct 29 01:19:59.876592 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2000/3837] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:19:59 2022] DELETE /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:19:59.882893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ce57d2d9-1527-4a4f-a734-82c5a291df39 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:19:59.885200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ce57d2d9-1527-4a4f-a734-82c5a291df39 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:19:59.913098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:19:59.915465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ce57d2d9-1527-4a4f-a734-82c5a291df39 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:59.918309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ce57d2d9-1527-4a4f-a734-82c5a291df39 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:59.919041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ce57d2d9-1527-4a4f-a734-82c5a291df39 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:19:59.920120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ce57d2d9-1527-4a4f-a734-82c5a291df39 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:19:59.923805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ce57d2d9-1527-4a4f-a734-82c5a291df39 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:19:59.926114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ce57d2d9-1527-4a4f-a734-82c5a291df39 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:00.219145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ce57d2d9-1527-4a4f-a734-82c5a291df39 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:00.233828 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ce57d2d9-1527-4a4f-a734-82c5a291df39 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1711 microversion: 2.1 time: 0.355695 Oct 29 01:20:00.254580 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2001/3838] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:19:59 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1711 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:00.265776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fd416276-8555-4e9c-94be-e51768ca383e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:00.266602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fd416276-8555-4e9c-94be-e51768ca383e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:00.309218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd416276-8555-4e9c-94be-e51768ca383e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:00.309764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd416276-8555-4e9c-94be-e51768ca383e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:00.310209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd416276-8555-4e9c-94be-e51768ca383e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:00.315860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd416276-8555-4e9c-94be-e51768ca383e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:00.316423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd416276-8555-4e9c-94be-e51768ca383e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:00.316874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd416276-8555-4e9c-94be-e51768ca383e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:00.722201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fd416276-8555-4e9c-94be-e51768ca383e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:00.733914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fd416276-8555-4e9c-94be-e51768ca383e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:00.735397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fd416276-8555-4e9c-94be-e51768ca383e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:00.736779 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fd416276-8555-4e9c-94be-e51768ca383e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1892 microversion: 2.32 time: 0.482358 Oct 29 01:20:00.754754 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2002/3839] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:00 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1892 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:00.764685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bff3e916-e6aa-40bf-b4a1-c9339df6d39a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:00.765665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bff3e916-e6aa-40bf-b4a1-c9339df6d39a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:00.773617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bff3e916-e6aa-40bf-b4a1-c9339df6d39a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:00.774365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bff3e916-e6aa-40bf-b4a1-c9339df6d39a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:00.774979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bff3e916-e6aa-40bf-b4a1-c9339df6d39a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:00.775926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bff3e916-e6aa-40bf-b4a1-c9339df6d39a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:00.776731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bff3e916-e6aa-40bf-b4a1-c9339df6d39a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:00.778263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bff3e916-e6aa-40bf-b4a1-c9339df6d39a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:01.015431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bff3e916-e6aa-40bf-b4a1-c9339df6d39a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:01.041069 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bff3e916-e6aa-40bf-b4a1-c9339df6d39a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 200 len: 1495 microversion: 2.1 time: 0.283660 Oct 29 01:20:01.046567 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2003/3840] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:00 2022] GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 1495 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:01.063303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-14c33bbd-49b6-423b-9122-285e2b2b65ec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:01.070634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-14c33bbd-49b6-423b-9122-285e2b2b65ec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:01.081956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14c33bbd-49b6-423b-9122-285e2b2b65ec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:01.086303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14c33bbd-49b6-423b-9122-285e2b2b65ec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:01.087058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14c33bbd-49b6-423b-9122-285e2b2b65ec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:01.092449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14c33bbd-49b6-423b-9122-285e2b2b65ec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:01.094853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14c33bbd-49b6-423b-9122-285e2b2b65ec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:01.099114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14c33bbd-49b6-423b-9122-285e2b2b65ec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:01.400539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-14c33bbd-49b6-423b-9122-285e2b2b65ec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:01.420762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-14c33bbd-49b6-423b-9122-285e2b2b65ec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:01.423522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-14c33bbd-49b6-423b-9122-285e2b2b65ec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:01.446975 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-14c33bbd-49b6-423b-9122-285e2b2b65ec tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.395100 Oct 29 01:20:01.450062 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2004/3841] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:01 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:01.470379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-8ff2f3be-85db-496d-8278-cfd7e265d0db req-17012d32-6066-496d-946b-30e44d63a4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "tag": "a02ac232-fcfa-478c-bfaf-1c208f69ee7a"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:01.524040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8ff2f3be-85db-496d-8278-cfd7e265d0db req-17012d32-6066-496d-946b-30e44d63a4b9 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:01.525257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8ff2f3be-85db-496d-8278-cfd7e265d0db req-17012d32-6066-496d-946b-30e44d63a4b9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:01.533613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8ff2f3be-85db-496d-8278-cfd7e265d0db req-17012d32-6066-496d-946b-30e44d63a4b9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:01.576415 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-8ff2f3be-85db-496d-8278-cfd7e265d0db req-17012d32-6066-496d-946b-30e44d63a4b9 service nova] Creating event network-changed:a02ac232-fcfa-478c-bfaf-1c208f69ee7a for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:20:01.581724 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-8ff2f3be-85db-496d-8278-cfd7e265d0db req-17012d32-6066-496d-946b-30e44d63a4b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130053 Oct 29 01:20:01.584002 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2005/3842] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:01.770096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6cee6f20-e27b-431d-8af8-a9afdf54791e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:01.771101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6cee6f20-e27b-431d-8af8-a9afdf54791e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:01.785355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cee6f20-e27b-431d-8af8-a9afdf54791e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:01.786151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cee6f20-e27b-431d-8af8-a9afdf54791e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:01.786762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cee6f20-e27b-431d-8af8-a9afdf54791e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:01.787642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cee6f20-e27b-431d-8af8-a9afdf54791e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:01.792825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cee6f20-e27b-431d-8af8-a9afdf54791e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:01.793582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cee6f20-e27b-431d-8af8-a9afdf54791e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:03.717764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6cee6f20-e27b-431d-8af8-a9afdf54791e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:03.732943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6cee6f20-e27b-431d-8af8-a9afdf54791e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:03.736070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6cee6f20-e27b-431d-8af8-a9afdf54791e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:03.739527 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6cee6f20-e27b-431d-8af8-a9afdf54791e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1892 microversion: 2.32 time: 1.973778 Oct 29 01:20:03.743529 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2006/3843] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:01 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1892 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:20:03.757908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c96c728e-852f-4072-aacd-a09cca1499d2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:03.759013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c96c728e-852f-4072-aacd-a09cca1499d2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:03.792657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c96c728e-852f-4072-aacd-a09cca1499d2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:03.793578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c96c728e-852f-4072-aacd-a09cca1499d2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:03.794293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c96c728e-852f-4072-aacd-a09cca1499d2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:03.795257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c96c728e-852f-4072-aacd-a09cca1499d2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:03.796288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c96c728e-852f-4072-aacd-a09cca1499d2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:03.797322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c96c728e-852f-4072-aacd-a09cca1499d2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:03.974636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c96c728e-852f-4072-aacd-a09cca1499d2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:03.992503 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c96c728e-852f-4072-aacd-a09cca1499d2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 200 len: 1294 microversion: 2.1 time: 0.247431 Oct 29 01:20:03.993876 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2007/3844] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:03 2022] GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 1294 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:03.998817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4e9f68c2-a174-4f86-bc75-7924ec57f644 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:04.004789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4e9f68c2-a174-4f86-bc75-7924ec57f644 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:04.034300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e9f68c2-a174-4f86-bc75-7924ec57f644 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:04.034899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e9f68c2-a174-4f86-bc75-7924ec57f644 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:04.035458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e9f68c2-a174-4f86-bc75-7924ec57f644 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:04.037141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e9f68c2-a174-4f86-bc75-7924ec57f644 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:04.041191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e9f68c2-a174-4f86-bc75-7924ec57f644 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:04.041799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e9f68c2-a174-4f86-bc75-7924ec57f644 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:04.343622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4e9f68c2-a174-4f86-bc75-7924ec57f644 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:04.354153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4e9f68c2-a174-4f86-bc75-7924ec57f644 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:04.355655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4e9f68c2-a174-4f86-bc75-7924ec57f644 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:04.362209 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4e9f68c2-a174-4f86-bc75-7924ec57f644 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.366936 Oct 29 01:20:04.362809 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2008/3845] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:03 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:04.368414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4e9f31d7-96f9-48cc-ad8c-69b04af647d1 req-eed993f6-d641-46d9-bde8-e6b8e340f5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efedae7c-2224-41e7-8493-0bcb9dc4535c", "name": "network-vif-deleted", "tag": "86eb1942-90d8-44e3-a515-27c49c919b9b"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:04.394193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4e9f31d7-96f9-48cc-ad8c-69b04af647d1 req-eed993f6-d641-46d9-bde8-e6b8e340f5d2 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:04.395138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4e9f31d7-96f9-48cc-ad8c-69b04af647d1 req-eed993f6-d641-46d9-bde8-e6b8e340f5d2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:04.395820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4e9f31d7-96f9-48cc-ad8c-69b04af647d1 req-eed993f6-d641-46d9-bde8-e6b8e340f5d2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:04.411936 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4e9f31d7-96f9-48cc-ad8c-69b04af647d1 req-eed993f6-d641-46d9-bde8-e6b8e340f5d2 service nova] Creating event network-vif-deleted:86eb1942-90d8-44e3-a515-27c49c919b9b for instance efedae7c-2224-41e7-8493-0bcb9dc4535c on n-h2-862964-3 Oct 29 01:20:04.418710 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4e9f31d7-96f9-48cc-ad8c-69b04af647d1 req-eed993f6-d641-46d9-bde8-e6b8e340f5d2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054347 Oct 29 01:20:04.424518 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2009/3846] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:04.772873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-06ebddf0-de61-4507-9be9-09619e319de9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:04.775078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-06ebddf0-de61-4507-9be9-09619e319de9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:04.785346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06ebddf0-de61-4507-9be9-09619e319de9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:04.787818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06ebddf0-de61-4507-9be9-09619e319de9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:04.788588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06ebddf0-de61-4507-9be9-09619e319de9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:04.789775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06ebddf0-de61-4507-9be9-09619e319de9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:04.793454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06ebddf0-de61-4507-9be9-09619e319de9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:04.794455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06ebddf0-de61-4507-9be9-09619e319de9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:05.802610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-06ebddf0-de61-4507-9be9-09619e319de9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:05.819368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-06ebddf0-de61-4507-9be9-09619e319de9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:05.825934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-06ebddf0-de61-4507-9be9-09619e319de9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:05.828077 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-06ebddf0-de61-4507-9be9-09619e319de9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1892 microversion: 2.32 time: 1.059922 Oct 29 01:20:05.831432 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2010/3847] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:04 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1892 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:20:05.841778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6290ba22-9f8d-4104-9e76-67aaa18a30c3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:05.846987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6290ba22-9f8d-4104-9e76-67aaa18a30c3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:05.886384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6290ba22-9f8d-4104-9e76-67aaa18a30c3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:05.887168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6290ba22-9f8d-4104-9e76-67aaa18a30c3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:05.888404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6290ba22-9f8d-4104-9e76-67aaa18a30c3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:05.894556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6290ba22-9f8d-4104-9e76-67aaa18a30c3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:05.895279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6290ba22-9f8d-4104-9e76-67aaa18a30c3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:05.895908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6290ba22-9f8d-4104-9e76-67aaa18a30c3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:05.956456 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-6290ba22-9f8d-4104-9e76-67aaa18a30c3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance efedae7c-2224-41e7-8493-0bcb9dc4535c could not be found. Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6290ba22-9f8d-4104-9e76-67aaa18a30c3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c HTTP/1.1 Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance efedae7c-2224-41e7-8493-0bcb9dc4535c could not be found. Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'efedae7c-2224-41e7-8493-0bcb9dc4535c'} Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efedae7c-2224-41e7-8493-0bcb9dc4535c could not be found. Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efedae7c-2224-41e7-8493-0bcb9dc4535c could not be found. Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:20:05.965196 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:20:05.970968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:20:05.970968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:20:05.970968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:20:05.970968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:20:05.970968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:20:05.970968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efedae7c-2224-41e7-8493-0bcb9dc4535c could not be found. Oct 29 01:20:05.970968 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:20:05.973451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6290ba22-9f8d-4104-9e76-67aaa18a30c3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance efedae7c-2224-41e7-8493-0bcb9dc4535c could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:20:05.978553 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6290ba22-9f8d-4104-9e76-67aaa18a30c3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 404 len: 111 microversion: 2.1 time: 0.141868 Oct 29 01:20:05.978553 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2011/3848] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:05 2022] GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:20:05.997780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dfff4305-e431-4f31-ac9b-9a266e8bd4d8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:06.011049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dfff4305-e431-4f31-ac9b-9a266e8bd4d8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:06.030963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dfff4305-e431-4f31-ac9b-9a266e8bd4d8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:06.032257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dfff4305-e431-4f31-ac9b-9a266e8bd4d8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:06.032951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dfff4305-e431-4f31-ac9b-9a266e8bd4d8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:06.033846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dfff4305-e431-4f31-ac9b-9a266e8bd4d8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:06.035218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dfff4305-e431-4f31-ac9b-9a266e8bd4d8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:06.037347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dfff4305-e431-4f31-ac9b-9a266e8bd4d8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:06.316106 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3e5fa6ce-38c4-4a59-be7f-6af0a072ab79 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 200 len: 1448 microversion: 2.1 time: 8.487084 Oct 29 01:20:06.317398 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1838/3849] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:19:57 2022] GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 1448 bytes in 8489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:06.333571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bbbbdb98-d1b8-4d4f-8425-83434ea9657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1226079488", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "b5b62219-8a2f-42eb-b795-dd5a026e1972"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:06.397011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dfff4305-e431-4f31-ac9b-9a266e8bd4d8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:06.406764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dfff4305-e431-4f31-ac9b-9a266e8bd4d8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:06.409062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dfff4305-e431-4f31-ac9b-9a266e8bd4d8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:06.439066 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dfff4305-e431-4f31-ac9b-9a266e8bd4d8 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.446230 Oct 29 01:20:06.439066 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2012/3850] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:05 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:06.439066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2e2694b3-2ead-4044-9cb7-8a2f35668b7b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d977d6ca0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:06.442566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-bbbbdb98-d1b8-4d4f-8425-83434ea9657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] validate_networks() for [('b5b62219-8a2f-42eb-b795-dd5a026e1972', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:20:06.517054 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2e2694b3-2ead-4044-9cb7-8a2f35668b7b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 200 len: 1448 microversion: 2.1 time: 0.089225 Oct 29 01:20:06.519040 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2013/3851] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:20:06 2022] GET /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 1448 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:06.538453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-499f48d1-0b48-4005-b3db-a79fbcfd286c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9770ddc0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:07.798721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:09.188538 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-499f48d1-0b48-4005-b3db-a79fbcfd286c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 204 len: 0 microversion: 2.1 time: 2.656704 Oct 29 01:20:09.190606 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2014/3852] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:06 2022] DELETE /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 0 bytes in 2659 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:20:09.205121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-86b2fd36-ebf4-432b-9e8f-c13c5635fa34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:09.207902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-86b2fd36-ebf4-432b-9e8f-c13c5635fa34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:09.222676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86b2fd36-ebf4-432b-9e8f-c13c5635fa34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:09.233723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86b2fd36-ebf4-432b-9e8f-c13c5635fa34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:09.234521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86b2fd36-ebf4-432b-9e8f-c13c5635fa34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:09.242932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86b2fd36-ebf4-432b-9e8f-c13c5635fa34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:09.244926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86b2fd36-ebf4-432b-9e8f-c13c5635fa34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:09.245627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86b2fd36-ebf4-432b-9e8f-c13c5635fa34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:09.983394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-bbbbdb98-d1b8-4d4f-8425-83434ea9657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:20:09.984642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-bbbbdb98-d1b8-4d4f-8425-83434ea9657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:20:09.985372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-bbbbdb98-d1b8-4d4f-8425-83434ea9657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:20:09.987402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-bbbbdb98-d1b8-4d4f-8425-83434ea9657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:20:09.988273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-bbbbdb98-d1b8-4d4f-8425-83434ea9657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:20:10.018779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-86b2fd36-ebf4-432b-9e8f-c13c5635fa34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:10.033029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbbbdb98-d1b8-4d4f-8425-83434ea9657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:10.041444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbbbdb98-d1b8-4d4f-8425-83434ea9657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:10.042235 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbbbdb98-d1b8-4d4f-8425-83434ea9657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:10.044324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-86b2fd36-ebf4-432b-9e8f-c13c5635fa34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:10.047779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbbbdb98-d1b8-4d4f-8425-83434ea9657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:10.049399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-86b2fd36-ebf4-432b-9e8f-c13c5635fa34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:10.050668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbbbdb98-d1b8-4d4f-8425-83434ea9657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:10.052968 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-86b2fd36-ebf4-432b-9e8f-c13c5635fa34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1892 microversion: 2.32 time: 0.861021 Oct 29 01:20:10.053596 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2015/3853] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:09 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1892 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:10.077045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbbbdb98-d1b8-4d4f-8425-83434ea9657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:10.084611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-edd8841a-f008-4412-857c-4eeb32e7d998 req-c8ea752d-5ed1-4d31-a834-99d2e5038c99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "tag": "46be779f-3615-4867-b33c-2aacb76c8f8d"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:10.113539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-edd8841a-f008-4412-857c-4eeb32e7d998 req-c8ea752d-5ed1-4d31-a834-99d2e5038c99 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:10.114139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-edd8841a-f008-4412-857c-4eeb32e7d998 req-c8ea752d-5ed1-4d31-a834-99d2e5038c99 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:10.134733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-edd8841a-f008-4412-857c-4eeb32e7d998 req-c8ea752d-5ed1-4d31-a834-99d2e5038c99 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:10.144113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:10.156416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-bbbbdb98-d1b8-4d4f-8425-83434ea9657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Getting quotas for project 6dc302f307494a61836f3afb38dccae9. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:20:10.156913 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-edd8841a-f008-4412-857c-4eeb32e7d998 req-c8ea752d-5ed1-4d31-a834-99d2e5038c99 service nova] Creating event network-changed:46be779f-3615-4867-b33c-2aacb76c8f8d for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:20:10.171779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-bbbbdb98-d1b8-4d4f-8425-83434ea9657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Getting quotas for user 6cb8fe33c5d64047ada50f44e01e4faa and project 6dc302f307494a61836f3afb38dccae9. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:20:10.196435 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-edd8841a-f008-4412-857c-4eeb32e7d998 req-c8ea752d-5ed1-4d31-a834-99d2e5038c99 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141232 Oct 29 01:20:10.201489 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2016/3854] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:10.211981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-489b575c-2026-4b14-94e0-4d3825c725fa tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:10.217493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-489b575c-2026-4b14-94e0-4d3825c725fa tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:10.219338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bbbbdb98-d1b8-4d4f-8425-83434ea9657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:20:10.222493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bbbbdb98-d1b8-4d4f-8425-83434ea9657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:20:10.242724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-489b575c-2026-4b14-94e0-4d3825c725fa tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:10.243224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-489b575c-2026-4b14-94e0-4d3825c725fa tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:10.243667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-489b575c-2026-4b14-94e0-4d3825c725fa tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:10.244401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-489b575c-2026-4b14-94e0-4d3825c725fa tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:10.244857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-489b575c-2026-4b14-94e0-4d3825c725fa tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:10.256067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-489b575c-2026-4b14-94e0-4d3825c725fa tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:10.471923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-489b575c-2026-4b14-94e0-4d3825c725fa tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:10.481909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-489b575c-2026-4b14-94e0-4d3825c725fa tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:10.483487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-489b575c-2026-4b14-94e0-4d3825c725fa tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:10.540391 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-489b575c-2026-4b14-94e0-4d3825c725fa tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.330590 Oct 29 01:20:10.554579 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2017/3855] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:10 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:10.590515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f3cdafe5-bca4-4515-8193-201b37082679 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:10.594146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f3cdafe5-bca4-4515-8193-201b37082679 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:10.617789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3cdafe5-bca4-4515-8193-201b37082679 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:10.618817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3cdafe5-bca4-4515-8193-201b37082679 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:10.619510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3cdafe5-bca4-4515-8193-201b37082679 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:10.623725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3cdafe5-bca4-4515-8193-201b37082679 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:10.624502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3cdafe5-bca4-4515-8193-201b37082679 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:10.625142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3cdafe5-bca4-4515-8193-201b37082679 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:10.696426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f3cdafe5-bca4-4515-8193-201b37082679 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:20:10.863609 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bbbbdb98-d1b8-4d4f-8425-83434ea9657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.535686 Oct 29 01:20:10.878540 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1839/3856] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:20:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 4557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:20:10.886989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ac003f8b-fa01-4a6b-8752-3ac85f951af9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:10.896431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ac003f8b-fa01-4a6b-8752-3ac85f951af9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:11.085076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ac003f8b-fa01-4a6b-8752-3ac85f951af9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:11.111629 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ac003f8b-fa01-4a6b-8752-3ac85f951af9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1209 microversion: 2.1 time: 0.230331 Oct 29 01:20:11.112247 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1840/3857] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:10 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1209 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:11.127994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7fca3a0f-fddc-486c-8ebe-0e3047bf2b9a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:11.136361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7fca3a0f-fddc-486c-8ebe-0e3047bf2b9a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:11.141229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7fca3a0f-fddc-486c-8ebe-0e3047bf2b9a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:11.142010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7fca3a0f-fddc-486c-8ebe-0e3047bf2b9a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:11.142639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7fca3a0f-fddc-486c-8ebe-0e3047bf2b9a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:11.144174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7fca3a0f-fddc-486c-8ebe-0e3047bf2b9a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:11.144860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7fca3a0f-fddc-486c-8ebe-0e3047bf2b9a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:11.145387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7fca3a0f-fddc-486c-8ebe-0e3047bf2b9a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:11.161892 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f3cdafe5-bca4-4515-8193-201b37082679 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 204 len: 0 microversion: 2.1 time: 0.593779 Oct 29 01:20:11.162503 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2018/3858] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:20:10 2022] DELETE /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:20:11.434653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-519096f2-c1be-4e9a-8d0c-179ecdb6d119 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1019862443", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "417ddcf9-7930-440b-995d-5ce0b1f48a9f"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:11.523625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-519096f2-c1be-4e9a-8d0c-179ecdb6d119 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] validate_networks() for [('417ddcf9-7930-440b-995d-5ce0b1f48a9f', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:20:11.853555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7fca3a0f-fddc-486c-8ebe-0e3047bf2b9a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:11.895712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7fca3a0f-fddc-486c-8ebe-0e3047bf2b9a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:11.897588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7fca3a0f-fddc-486c-8ebe-0e3047bf2b9a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:11.901811 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7fca3a0f-fddc-486c-8ebe-0e3047bf2b9a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1892 microversion: 2.32 time: 0.785852 Oct 29 01:20:11.904841 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1841/3859] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:11 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1892 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:11.915047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-64735bcb-484a-4e3d-86e3-040573e0813b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:11.917675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-64735bcb-484a-4e3d-86e3-040573e0813b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:11.928530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64735bcb-484a-4e3d-86e3-040573e0813b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:11.929063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64735bcb-484a-4e3d-86e3-040573e0813b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:11.929692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64735bcb-484a-4e3d-86e3-040573e0813b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:11.930476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64735bcb-484a-4e3d-86e3-040573e0813b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:11.930931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64735bcb-484a-4e3d-86e3-040573e0813b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:11.931356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64735bcb-484a-4e3d-86e3-040573e0813b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:12.119162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-64735bcb-484a-4e3d-86e3-040573e0813b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:12.150214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-64735bcb-484a-4e3d-86e3-040573e0813b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:12.164679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-64735bcb-484a-4e3d-86e3-040573e0813b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:12.176761 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-64735bcb-484a-4e3d-86e3-040573e0813b tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.270447 Oct 29 01:20:12.179367 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1842/3860] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:11 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:12.190758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-f45fd7d4-ff64-421d-a779-f18374f78ca9 req-2ff4ba4d-e908-4385-8079-3b2a16ac6afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277b318c-bc53-4c0d-997b-8c96d92ce41b", "name": "network-vif-unplugged", "status": "completed", "tag": "260d45a4-8311-4a41-a480-de2b98950b06"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:12.223629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f45fd7d4-ff64-421d-a779-f18374f78ca9 req-2ff4ba4d-e908-4385-8079-3b2a16ac6afa service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:12.224120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f45fd7d4-ff64-421d-a779-f18374f78ca9 req-2ff4ba4d-e908-4385-8079-3b2a16ac6afa service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:12.239965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f45fd7d4-ff64-421d-a779-f18374f78ca9 req-2ff4ba4d-e908-4385-8079-3b2a16ac6afa service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:12.272054 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f45fd7d4-ff64-421d-a779-f18374f78ca9 req-2ff4ba4d-e908-4385-8079-3b2a16ac6afa service nova] Creating event network-vif-unplugged:260d45a4-8311-4a41-a480-de2b98950b06 for instance 277b318c-bc53-4c0d-997b-8c96d92ce41b on n-h2-862964-3 Oct 29 01:20:12.283350 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-f45fd7d4-ff64-421d-a779-f18374f78ca9 req-2ff4ba4d-e908-4385-8079-3b2a16ac6afa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100505 Oct 29 01:20:12.290176 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1843/3861] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:12.302844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-55660648-8969-4b81-b337-51d3c5e56674 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:12.305231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-55660648-8969-4b81-b337-51d3c5e56674 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:12.431440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-55660648-8969-4b81-b337-51d3c5e56674 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:12.440154 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-55660648-8969-4b81-b337-51d3c5e56674 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1209 microversion: 2.1 time: 0.147795 Oct 29 01:20:12.440644 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1844/3862] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:12 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1209 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:12.449686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-9645e08b-a23c-420a-8ea8-88b4c7240a2b req-b037698e-51ea-47c7-b333-16b29fce1714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "tag": "e3cb24be-1f0b-4f1e-8954-12fc1365bfd4"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:12.476629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9645e08b-a23c-420a-8ea8-88b4c7240a2b req-b037698e-51ea-47c7-b333-16b29fce1714 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:12.476629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9645e08b-a23c-420a-8ea8-88b4c7240a2b req-b037698e-51ea-47c7-b333-16b29fce1714 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:12.476629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9645e08b-a23c-420a-8ea8-88b4c7240a2b req-b037698e-51ea-47c7-b333-16b29fce1714 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:12.501707 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-9645e08b-a23c-420a-8ea8-88b4c7240a2b req-b037698e-51ea-47c7-b333-16b29fce1714 service nova] Creating event network-changed:e3cb24be-1f0b-4f1e-8954-12fc1365bfd4 for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:20:12.504196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-519096f2-c1be-4e9a-8d0c-179ecdb6d119 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:20:12.504688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-519096f2-c1be-4e9a-8d0c-179ecdb6d119 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:20:12.505774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-519096f2-c1be-4e9a-8d0c-179ecdb6d119 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:20:12.506427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-519096f2-c1be-4e9a-8d0c-179ecdb6d119 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:20:12.506849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-519096f2-c1be-4e9a-8d0c-179ecdb6d119 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:20:12.511347 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-9645e08b-a23c-420a-8ea8-88b4c7240a2b req-b037698e-51ea-47c7-b333-16b29fce1714 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065124 Oct 29 01:20:12.512052 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1845/3863] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:12.528160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-519096f2-c1be-4e9a-8d0c-179ecdb6d119 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:12.528655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-519096f2-c1be-4e9a-8d0c-179ecdb6d119 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:12.529090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-519096f2-c1be-4e9a-8d0c-179ecdb6d119 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:12.529855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-519096f2-c1be-4e9a-8d0c-179ecdb6d119 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:12.530312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-519096f2-c1be-4e9a-8d0c-179ecdb6d119 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:12.530814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-519096f2-c1be-4e9a-8d0c-179ecdb6d119 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:12.575320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-519096f2-c1be-4e9a-8d0c-179ecdb6d119 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Getting quotas for project b284e70790cf43e2b474559bb3e20faf. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:20:12.581261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-519096f2-c1be-4e9a-8d0c-179ecdb6d119 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Getting quotas for user a35b358af11846f78debaf9e422a9558 and project b284e70790cf43e2b474559bb3e20faf. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:20:12.597353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-519096f2-c1be-4e9a-8d0c-179ecdb6d119 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:20:12.603628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-519096f2-c1be-4e9a-8d0c-179ecdb6d119 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:20:12.815199 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-519096f2-c1be-4e9a-8d0c-179ecdb6d119 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.386982 Oct 29 01:20:12.823121 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2019/3864] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:20:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:20:12.831483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a1f076a8-8cca-48d4-803f-f502c13cfa44 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:12.832332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a1f076a8-8cca-48d4-803f-f502c13cfa44 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:12.932220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-181f6b20-7cc8-4742-a3b0-ae215b2bb2ac tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:12.933055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-181f6b20-7cc8-4742-a3b0-ae215b2bb2ac tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:12.956523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-181f6b20-7cc8-4742-a3b0-ae215b2bb2ac tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:12.957567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-181f6b20-7cc8-4742-a3b0-ae215b2bb2ac tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:12.962840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-181f6b20-7cc8-4742-a3b0-ae215b2bb2ac tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:12.963704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-181f6b20-7cc8-4742-a3b0-ae215b2bb2ac tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:12.965910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-181f6b20-7cc8-4742-a3b0-ae215b2bb2ac tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:12.970512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-181f6b20-7cc8-4742-a3b0-ae215b2bb2ac tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:12.979533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:13.689733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a1f076a8-8cca-48d4-803f-f502c13cfa44 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:13.696850 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a1f076a8-8cca-48d4-803f-f502c13cfa44 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8" status: 200 len: 1208 microversion: 2.1 time: 0.870942 Oct 29 01:20:13.702109 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1846/3865] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:12 2022] GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 => generated 1208 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:13.711306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c8852ce3-a04a-42cc-8abd-1915d1e68e95 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:13.725258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c8852ce3-a04a-42cc-8abd-1915d1e68e95 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:13.733219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8852ce3-a04a-42cc-8abd-1915d1e68e95 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:13.734228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8852ce3-a04a-42cc-8abd-1915d1e68e95 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:13.734919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8852ce3-a04a-42cc-8abd-1915d1e68e95 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:13.735916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8852ce3-a04a-42cc-8abd-1915d1e68e95 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:13.737726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8852ce3-a04a-42cc-8abd-1915d1e68e95 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:13.741984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8852ce3-a04a-42cc-8abd-1915d1e68e95 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:14.143929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c8852ce3-a04a-42cc-8abd-1915d1e68e95 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:14.153715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c8852ce3-a04a-42cc-8abd-1915d1e68e95 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:14.155193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c8852ce3-a04a-42cc-8abd-1915d1e68e95 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:14.179999 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c8852ce3-a04a-42cc-8abd-1915d1e68e95 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.476462 Oct 29 01:20:14.194173 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1847/3866] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:13 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:14.224153 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-705b0158-bae1-46fc-a478-e821b6379c01 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:14.228030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-705b0158-bae1-46fc-a478-e821b6379c01 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:14.246990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-705b0158-bae1-46fc-a478-e821b6379c01 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:14.252618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-705b0158-bae1-46fc-a478-e821b6379c01 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:14.252618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-705b0158-bae1-46fc-a478-e821b6379c01 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:14.252618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-705b0158-bae1-46fc-a478-e821b6379c01 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:14.252618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-705b0158-bae1-46fc-a478-e821b6379c01 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:14.252618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-705b0158-bae1-46fc-a478-e821b6379c01 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:14.674645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-705b0158-bae1-46fc-a478-e821b6379c01 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:14.705607 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-705b0158-bae1-46fc-a478-e821b6379c01 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1261 microversion: 2.1 time: 0.509516 Oct 29 01:20:14.730791 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1848/3867] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:14 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1261 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:14.743180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-98f78bdf-8b43-4343-9ed8-405de66f171d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:14.756165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-98f78bdf-8b43-4343-9ed8-405de66f171d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:14.768012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98f78bdf-8b43-4343-9ed8-405de66f171d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:14.771219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98f78bdf-8b43-4343-9ed8-405de66f171d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:14.778660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-181f6b20-7cc8-4742-a3b0-ae215b2bb2ac tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:14.782064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98f78bdf-8b43-4343-9ed8-405de66f171d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:14.782836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98f78bdf-8b43-4343-9ed8-405de66f171d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:14.783319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98f78bdf-8b43-4343-9ed8-405de66f171d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:14.783761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98f78bdf-8b43-4343-9ed8-405de66f171d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:14.858637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-181f6b20-7cc8-4742-a3b0-ae215b2bb2ac tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:14.860217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-181f6b20-7cc8-4742-a3b0-ae215b2bb2ac tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:14.883788 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-181f6b20-7cc8-4742-a3b0-ae215b2bb2ac tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1892 microversion: 2.32 time: 1.934075 Oct 29 01:20:14.884485 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2020/3868] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:12 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1892 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:20:15.215230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0fc7790c-e67f-4982-8e53-ee8604cae3a0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:15.215984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0fc7790c-e67f-4982-8e53-ee8604cae3a0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:15.250188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc7790c-e67f-4982-8e53-ee8604cae3a0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:15.251826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc7790c-e67f-4982-8e53-ee8604cae3a0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:15.252391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc7790c-e67f-4982-8e53-ee8604cae3a0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:15.253276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc7790c-e67f-4982-8e53-ee8604cae3a0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:15.253855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc7790c-e67f-4982-8e53-ee8604cae3a0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:15.254394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc7790c-e67f-4982-8e53-ee8604cae3a0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:15.500644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-98f78bdf-8b43-4343-9ed8-405de66f171d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:15.512737 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-98f78bdf-8b43-4343-9ed8-405de66f171d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8" status: 200 len: 1212 microversion: 2.1 time: 0.780733 Oct 29 01:20:15.537666 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1849/3869] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:14 2022] GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 => generated 1212 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:15.729089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-51c17b9e-d039-4fbc-ae40-5f1a404de420 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:15.729893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-51c17b9e-d039-4fbc-ae40-5f1a404de420 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:15.739491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51c17b9e-d039-4fbc-ae40-5f1a404de420 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:15.740003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51c17b9e-d039-4fbc-ae40-5f1a404de420 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:15.740451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51c17b9e-d039-4fbc-ae40-5f1a404de420 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:15.741193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51c17b9e-d039-4fbc-ae40-5f1a404de420 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:15.758477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51c17b9e-d039-4fbc-ae40-5f1a404de420 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:15.759660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51c17b9e-d039-4fbc-ae40-5f1a404de420 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:15.803161 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0fc7790c-e67f-4982-8e53-ee8604cae3a0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:15.818411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0fc7790c-e67f-4982-8e53-ee8604cae3a0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:15.821293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0fc7790c-e67f-4982-8e53-ee8604cae3a0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:15.839952 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0fc7790c-e67f-4982-8e53-ee8604cae3a0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.631693 Oct 29 01:20:15.842455 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2021/3870] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:15 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:15.911883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5d007603-a04c-46ca-867f-bcec5fafee9b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:15.912503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5d007603-a04c-46ca-867f-bcec5fafee9b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:15.923416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d007603-a04c-46ca-867f-bcec5fafee9b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:15.923917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d007603-a04c-46ca-867f-bcec5fafee9b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:15.924364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d007603-a04c-46ca-867f-bcec5fafee9b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:15.925087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d007603-a04c-46ca-867f-bcec5fafee9b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:15.925583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d007603-a04c-46ca-867f-bcec5fafee9b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:15.926021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5d007603-a04c-46ca-867f-bcec5fafee9b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:16.122809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-51c17b9e-d039-4fbc-ae40-5f1a404de420 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:16.138088 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-51c17b9e-d039-4fbc-ae40-5f1a404de420 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1267 microversion: 2.1 time: 0.413881 Oct 29 01:20:16.138980 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1850/3871] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:15 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1267 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:16.547307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7a488f7f-ae8c-4494-8e57-37c5030e90bf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:16.548225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7a488f7f-ae8c-4494-8e57-37c5030e90bf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:16.565040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a488f7f-ae8c-4494-8e57-37c5030e90bf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:16.568429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a488f7f-ae8c-4494-8e57-37c5030e90bf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:16.568429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a488f7f-ae8c-4494-8e57-37c5030e90bf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:16.568429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a488f7f-ae8c-4494-8e57-37c5030e90bf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:16.571639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a488f7f-ae8c-4494-8e57-37c5030e90bf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:16.572127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a488f7f-ae8c-4494-8e57-37c5030e90bf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:16.593806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5d007603-a04c-46ca-867f-bcec5fafee9b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:16.606276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5d007603-a04c-46ca-867f-bcec5fafee9b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:16.607742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5d007603-a04c-46ca-867f-bcec5fafee9b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:16.608928 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5d007603-a04c-46ca-867f-bcec5fafee9b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1892 microversion: 2.32 time: 0.701016 Oct 29 01:20:16.633636 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2022/3872] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:15 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1892 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:20:16.876244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2f725a4e-fbba-4b1f-a999-ef820d9af736 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:16.878699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7a488f7f-ae8c-4494-8e57-37c5030e90bf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:16.879733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2f725a4e-fbba-4b1f-a999-ef820d9af736 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:16.893403 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7a488f7f-ae8c-4494-8e57-37c5030e90bf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8" status: 200 len: 1260 microversion: 2.1 time: 0.347095 Oct 29 01:20:16.909634 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1851/3873] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:16 2022] GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 => generated 1260 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:16.918989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f725a4e-fbba-4b1f-a999-ef820d9af736 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:16.919789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f725a4e-fbba-4b1f-a999-ef820d9af736 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:16.921728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f725a4e-fbba-4b1f-a999-ef820d9af736 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:16.923307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f725a4e-fbba-4b1f-a999-ef820d9af736 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:16.924470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f725a4e-fbba-4b1f-a999-ef820d9af736 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:16.925825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f725a4e-fbba-4b1f-a999-ef820d9af736 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:17.023458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-25ddb7b0-e59d-419e-bf56-f56e69afaf73 req-8190c807-722a-488b-9e55-acdd58ca61cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277b318c-bc53-4c0d-997b-8c96d92ce41b", "name": "network-vif-deleted", "tag": "260d45a4-8311-4a41-a480-de2b98950b06"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:17.041416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-25ddb7b0-e59d-419e-bf56-f56e69afaf73 req-8190c807-722a-488b-9e55-acdd58ca61cb service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:17.044227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-25ddb7b0-e59d-419e-bf56-f56e69afaf73 req-8190c807-722a-488b-9e55-acdd58ca61cb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:17.044671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-25ddb7b0-e59d-419e-bf56-f56e69afaf73 req-8190c807-722a-488b-9e55-acdd58ca61cb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:17.078522 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-25ddb7b0-e59d-419e-bf56-f56e69afaf73 req-8190c807-722a-488b-9e55-acdd58ca61cb service nova] Creating event network-vif-deleted:260d45a4-8311-4a41-a480-de2b98950b06 for instance 277b318c-bc53-4c0d-997b-8c96d92ce41b on n-h2-862964-3 Oct 29 01:20:17.102723 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-25ddb7b0-e59d-419e-bf56-f56e69afaf73 req-8190c807-722a-488b-9e55-acdd58ca61cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082940 Oct 29 01:20:17.108719 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1852/3874] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:20:17.163843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ceb7ee31-b09b-42c5-a332-508ccebd4b76 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:17.164862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ceb7ee31-b09b-42c5-a332-508ccebd4b76 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:17.171841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ceb7ee31-b09b-42c5-a332-508ccebd4b76 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:17.172737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ceb7ee31-b09b-42c5-a332-508ccebd4b76 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:17.173310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ceb7ee31-b09b-42c5-a332-508ccebd4b76 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:17.174128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ceb7ee31-b09b-42c5-a332-508ccebd4b76 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:17.174694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ceb7ee31-b09b-42c5-a332-508ccebd4b76 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:17.175226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ceb7ee31-b09b-42c5-a332-508ccebd4b76 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:17.279141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f725a4e-fbba-4b1f-a999-ef820d9af736 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:17.291923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f725a4e-fbba-4b1f-a999-ef820d9af736 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:17.294696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f725a4e-fbba-4b1f-a999-ef820d9af736 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:17.308580 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2f725a4e-fbba-4b1f-a999-ef820d9af736 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.440162 Oct 29 01:20:17.309937 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2023/3875] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:16 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:17.332995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ceb7ee31-b09b-42c5-a332-508ccebd4b76 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:17.346951 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ceb7ee31-b09b-42c5-a332-508ccebd4b76 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1267 microversion: 2.1 time: 0.186106 Oct 29 01:20:17.348081 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1853/3876] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:17 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:17.658999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4b0ee1e8-7709-45eb-ae92-44f2bd263606 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:17.660279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4b0ee1e8-7709-45eb-ae92-44f2bd263606 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:17.666763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b0ee1e8-7709-45eb-ae92-44f2bd263606 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:17.667262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b0ee1e8-7709-45eb-ae92-44f2bd263606 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:17.667705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b0ee1e8-7709-45eb-ae92-44f2bd263606 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:17.668630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b0ee1e8-7709-45eb-ae92-44f2bd263606 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:17.669292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b0ee1e8-7709-45eb-ae92-44f2bd263606 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:17.669895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b0ee1e8-7709-45eb-ae92-44f2bd263606 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:17.924543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cf6706e5-ae45-40ba-9f88-7e6314d1db87 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:17.925346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cf6706e5-ae45-40ba-9f88-7e6314d1db87 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:17.938567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf6706e5-ae45-40ba-9f88-7e6314d1db87 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:17.940281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf6706e5-ae45-40ba-9f88-7e6314d1db87 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:17.942507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf6706e5-ae45-40ba-9f88-7e6314d1db87 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:17.945026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf6706e5-ae45-40ba-9f88-7e6314d1db87 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:17.945026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf6706e5-ae45-40ba-9f88-7e6314d1db87 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:17.945026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf6706e5-ae45-40ba-9f88-7e6314d1db87 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:18.105801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cf6706e5-ae45-40ba-9f88-7e6314d1db87 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:18.117725 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cf6706e5-ae45-40ba-9f88-7e6314d1db87 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8" status: 200 len: 1266 microversion: 2.1 time: 0.199410 Oct 29 01:20:18.118330 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1854/3877] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:17 2022] GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:18.335890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4b0ee1e8-7709-45eb-ae92-44f2bd263606 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:18.345079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-07fa0695-415f-441f-8a7e-08a446397d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:18.346133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4b0ee1e8-7709-45eb-ae92-44f2bd263606 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:18.346689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-07fa0695-415f-441f-8a7e-08a446397d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:18.347602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4b0ee1e8-7709-45eb-ae92-44f2bd263606 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:18.348796 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4b0ee1e8-7709-45eb-ae92-44f2bd263606 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1892 microversion: 2.32 time: 0.693976 Oct 29 01:20:18.349458 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2024/3878] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:17 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1892 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:18.356459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07fa0695-415f-441f-8a7e-08a446397d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:18.358431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07fa0695-415f-441f-8a7e-08a446397d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:18.359133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07fa0695-415f-441f-8a7e-08a446397d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:18.360073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07fa0695-415f-441f-8a7e-08a446397d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:18.360790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07fa0695-415f-441f-8a7e-08a446397d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:18.361553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07fa0695-415f-441f-8a7e-08a446397d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:18.376380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b663951c-8f55-4e90-b96e-8c474a72994b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:18.377052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b663951c-8f55-4e90-b96e-8c474a72994b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:18.385564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b663951c-8f55-4e90-b96e-8c474a72994b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:18.386364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b663951c-8f55-4e90-b96e-8c474a72994b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:18.387042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b663951c-8f55-4e90-b96e-8c474a72994b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:18.388003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b663951c-8f55-4e90-b96e-8c474a72994b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:18.388628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b663951c-8f55-4e90-b96e-8c474a72994b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:18.389350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b663951c-8f55-4e90-b96e-8c474a72994b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:18.894316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-07fa0695-415f-441f-8a7e-08a446397d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:18.904464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-07fa0695-415f-441f-8a7e-08a446397d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:18.906183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-07fa0695-415f-441f-8a7e-08a446397d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:18.910041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b663951c-8f55-4e90-b96e-8c474a72994b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:18.912534 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-07fa0695-415f-441f-8a7e-08a446397d8d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.573169 Oct 29 01:20:18.926430 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b663951c-8f55-4e90-b96e-8c474a72994b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1267 microversion: 2.1 time: 0.555907 Oct 29 01:20:18.928216 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2025/3879] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:18 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1267 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:18.931142 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1855/3880] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:18 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:19.143813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7a423dd4-2a12-46ed-9e20-a467b41a13d6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:19.144677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7a423dd4-2a12-46ed-9e20-a467b41a13d6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:19.153774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a423dd4-2a12-46ed-9e20-a467b41a13d6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:19.159402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a423dd4-2a12-46ed-9e20-a467b41a13d6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:19.159402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a423dd4-2a12-46ed-9e20-a467b41a13d6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:19.159402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a423dd4-2a12-46ed-9e20-a467b41a13d6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:19.159402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a423dd4-2a12-46ed-9e20-a467b41a13d6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:19.159402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a423dd4-2a12-46ed-9e20-a467b41a13d6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:19.356622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7a423dd4-2a12-46ed-9e20-a467b41a13d6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:19.365636 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7a423dd4-2a12-46ed-9e20-a467b41a13d6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8" status: 200 len: 1266 microversion: 2.1 time: 0.227299 Oct 29 01:20:19.367289 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2026/3881] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:19 2022] GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:19.382056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b06e4e82-8310-4183-a649-2126bb6c888b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:19.382056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b06e4e82-8310-4183-a649-2126bb6c888b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:19.393842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b06e4e82-8310-4183-a649-2126bb6c888b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:19.394216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b06e4e82-8310-4183-a649-2126bb6c888b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:19.394655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b06e4e82-8310-4183-a649-2126bb6c888b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:19.395548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b06e4e82-8310-4183-a649-2126bb6c888b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:19.396010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b06e4e82-8310-4183-a649-2126bb6c888b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:19.396443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b06e4e82-8310-4183-a649-2126bb6c888b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:19.592841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-d660eb53-ad22-4957-b1ff-775694e079f1 req-4bc7465b-1e61-479a-a369-84990d82f92c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "tag": "44b552d3-db18-4618-bee3-f48ae965062f"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:19.611406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d660eb53-ad22-4957-b1ff-775694e079f1 req-4bc7465b-1e61-479a-a369-84990d82f92c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:19.614726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d660eb53-ad22-4957-b1ff-775694e079f1 req-4bc7465b-1e61-479a-a369-84990d82f92c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:19.615442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d660eb53-ad22-4957-b1ff-775694e079f1 req-4bc7465b-1e61-479a-a369-84990d82f92c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:19.631216 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-d660eb53-ad22-4957-b1ff-775694e079f1 req-4bc7465b-1e61-479a-a369-84990d82f92c service nova] Creating event network-changed:44b552d3-db18-4618-bee3-f48ae965062f for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:20:19.637705 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-d660eb53-ad22-4957-b1ff-775694e079f1 req-4bc7465b-1e61-479a-a369-84990d82f92c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048937 Oct 29 01:20:19.638408 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2027/3882] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:19.872541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b06e4e82-8310-4183-a649-2126bb6c888b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:19.889198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b06e4e82-8310-4183-a649-2126bb6c888b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:19.890774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b06e4e82-8310-4183-a649-2126bb6c888b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:19.891966 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b06e4e82-8310-4183-a649-2126bb6c888b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1892 microversion: 2.32 time: 0.515662 Oct 29 01:20:19.892533 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1856/3883] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:19 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1892 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:19.950207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-46042c2c-2375-47f1-90c7-c38cf795a0b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:19.951214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-46042c2c-2375-47f1-90c7-c38cf795a0b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:19.952241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-137c0908-e6a3-4ae7-9936-536f4e1dce5d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:19.952908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-137c0908-e6a3-4ae7-9936-536f4e1dce5d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:19.961658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46042c2c-2375-47f1-90c7-c38cf795a0b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:19.962423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46042c2c-2375-47f1-90c7-c38cf795a0b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:19.964062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-137c0908-e6a3-4ae7-9936-536f4e1dce5d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:19.964555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-137c0908-e6a3-4ae7-9936-536f4e1dce5d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:19.965216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46042c2c-2375-47f1-90c7-c38cf795a0b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:19.966876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46042c2c-2375-47f1-90c7-c38cf795a0b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:19.967071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-137c0908-e6a3-4ae7-9936-536f4e1dce5d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:19.969460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46042c2c-2375-47f1-90c7-c38cf795a0b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:19.970001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-137c0908-e6a3-4ae7-9936-536f4e1dce5d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:19.970492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-137c0908-e6a3-4ae7-9936-536f4e1dce5d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:19.970929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-137c0908-e6a3-4ae7-9936-536f4e1dce5d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:19.971880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46042c2c-2375-47f1-90c7-c38cf795a0b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:20.117805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:20.144320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-46042c2c-2375-47f1-90c7-c38cf795a0b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:20.153309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-46042c2c-2375-47f1-90c7-c38cf795a0b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:20.155100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-46042c2c-2375-47f1-90c7-c38cf795a0b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:20.177316 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-46042c2c-2375-47f1-90c7-c38cf795a0b0 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.220244 Oct 29 01:20:20.177316 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2028/3884] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:19 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:20.390993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7113e3dd-ac34-4456-91b7-e37158d51c9d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:20.391593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7113e3dd-ac34-4456-91b7-e37158d51c9d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:20.408026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7113e3dd-ac34-4456-91b7-e37158d51c9d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:20.408523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7113e3dd-ac34-4456-91b7-e37158d51c9d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:20.408965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7113e3dd-ac34-4456-91b7-e37158d51c9d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:20.409710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7113e3dd-ac34-4456-91b7-e37158d51c9d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:20.410172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7113e3dd-ac34-4456-91b7-e37158d51c9d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:20.410600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7113e3dd-ac34-4456-91b7-e37158d51c9d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:20.586275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-137c0908-e6a3-4ae7-9936-536f4e1dce5d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:20.598965 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-137c0908-e6a3-4ae7-9936-536f4e1dce5d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1309 microversion: 2.1 time: 0.652183 Oct 29 01:20:20.600098 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1857/3885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:19 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1309 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:20.921392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-02aee7ac-a5a3-4f90-b0f2-41df0bfe8676 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:20.922347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-02aee7ac-a5a3-4f90-b0f2-41df0bfe8676 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:20.934664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02aee7ac-a5a3-4f90-b0f2-41df0bfe8676 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:20.938813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02aee7ac-a5a3-4f90-b0f2-41df0bfe8676 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:20.940129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02aee7ac-a5a3-4f90-b0f2-41df0bfe8676 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:20.941610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02aee7ac-a5a3-4f90-b0f2-41df0bfe8676 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:20.945301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02aee7ac-a5a3-4f90-b0f2-41df0bfe8676 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:20.946021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02aee7ac-a5a3-4f90-b0f2-41df0bfe8676 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:21.151016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7113e3dd-ac34-4456-91b7-e37158d51c9d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:21.163972 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7113e3dd-ac34-4456-91b7-e37158d51c9d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8" status: 200 len: 1308 microversion: 2.1 time: 0.776618 Oct 29 01:20:21.166060 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2029/3886] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:20 2022] GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 => generated 1308 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:21.619290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8f886cbc-a3a0-485c-b8c1-a3be2ecd1ab9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:21.626450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8f886cbc-a3a0-485c-b8c1-a3be2ecd1ab9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:21.637083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f886cbc-a3a0-485c-b8c1-a3be2ecd1ab9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:21.637948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f886cbc-a3a0-485c-b8c1-a3be2ecd1ab9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:21.638576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f886cbc-a3a0-485c-b8c1-a3be2ecd1ab9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:21.645134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f886cbc-a3a0-485c-b8c1-a3be2ecd1ab9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:21.646272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f886cbc-a3a0-485c-b8c1-a3be2ecd1ab9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:21.647120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f886cbc-a3a0-485c-b8c1-a3be2ecd1ab9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:21.721728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8f886cbc-a3a0-485c-b8c1-a3be2ecd1ab9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:20:21.819499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-02aee7ac-a5a3-4f90-b0f2-41df0bfe8676 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:21.834530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-02aee7ac-a5a3-4f90-b0f2-41df0bfe8676 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:21.843486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-02aee7ac-a5a3-4f90-b0f2-41df0bfe8676 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:21.846057 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-02aee7ac-a5a3-4f90-b0f2-41df0bfe8676 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1892 microversion: 2.32 time: 0.928983 Oct 29 01:20:21.848872 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1858/3887] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:20 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1892 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:20:21.855547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2588275b-539a-4135-a298-13f54676846d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:21.857101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2588275b-539a-4135-a298-13f54676846d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:21.868127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2588275b-539a-4135-a298-13f54676846d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:21.868967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2588275b-539a-4135-a298-13f54676846d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:21.871806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2588275b-539a-4135-a298-13f54676846d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:21.872861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2588275b-539a-4135-a298-13f54676846d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:21.873614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2588275b-539a-4135-a298-13f54676846d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:21.875893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2588275b-539a-4135-a298-13f54676846d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:22.110876 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8f886cbc-a3a0-485c-b8c1-a3be2ecd1ab9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 204 len: 0 microversion: 2.42 time: 0.941981 Oct 29 01:20:22.114345 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2030/3888] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:20:21 2022] DELETE /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 0 bytes in 947 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:20:22.122522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d82dddba-fe08-491c-a1a9-96f57979a093 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:22.124003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d82dddba-fe08-491c-a1a9-96f57979a093 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:22.131107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d82dddba-fe08-491c-a1a9-96f57979a093 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:22.133148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d82dddba-fe08-491c-a1a9-96f57979a093 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:22.134249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d82dddba-fe08-491c-a1a9-96f57979a093 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:22.135349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d82dddba-fe08-491c-a1a9-96f57979a093 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:22.136184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d82dddba-fe08-491c-a1a9-96f57979a093 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:22.136991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d82dddba-fe08-491c-a1a9-96f57979a093 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:22.497278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2588275b-539a-4135-a298-13f54676846d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:22.531618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2588275b-539a-4135-a298-13f54676846d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:22.533468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2588275b-539a-4135-a298-13f54676846d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:22.539972 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2588275b-539a-4135-a298-13f54676846d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.689665 Oct 29 01:20:22.541138 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1859/3889] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:21 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:22.548223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-65c825fa-e08d-4b3c-bcfd-2460cdd9d76d req-b0b3244b-43b3-4498-abe5-b0f5009896e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "tag": "4ebf9678-ed9a-4016-bd19-cc21fccd57ef"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:22.562510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:22.581992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-65c825fa-e08d-4b3c-bcfd-2460cdd9d76d req-b0b3244b-43b3-4498-abe5-b0f5009896e2 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:22.582473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-65c825fa-e08d-4b3c-bcfd-2460cdd9d76d req-b0b3244b-43b3-4498-abe5-b0f5009896e2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:22.586006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-65c825fa-e08d-4b3c-bcfd-2460cdd9d76d req-b0b3244b-43b3-4498-abe5-b0f5009896e2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:22.590085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:22.599001 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-65c825fa-e08d-4b3c-bcfd-2460cdd9d76d req-b0b3244b-43b3-4498-abe5-b0f5009896e2 service nova] Creating event network-changed:4ebf9678-ed9a-4016-bd19-cc21fccd57ef for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:20:22.615085 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-65c825fa-e08d-4b3c-bcfd-2460cdd9d76d req-b0b3244b-43b3-4498-abe5-b0f5009896e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071903 Oct 29 01:20:22.616100 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1860/3890] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:22.626221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a65da8f1-b0ed-4a7d-97f7-dc486863608e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:22.626965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a65da8f1-b0ed-4a7d-97f7-dc486863608e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:22.640340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a65da8f1-b0ed-4a7d-97f7-dc486863608e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:22.643468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a65da8f1-b0ed-4a7d-97f7-dc486863608e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:22.643468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a65da8f1-b0ed-4a7d-97f7-dc486863608e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:22.643468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a65da8f1-b0ed-4a7d-97f7-dc486863608e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:22.643468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a65da8f1-b0ed-4a7d-97f7-dc486863608e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:22.643468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a65da8f1-b0ed-4a7d-97f7-dc486863608e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:23.084416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d82dddba-fe08-491c-a1a9-96f57979a093 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:23.094740 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d82dddba-fe08-491c-a1a9-96f57979a093 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1309 microversion: 2.1 time: 0.978193 Oct 29 01:20:23.101265 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2031/3891] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:22 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1309 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:23.117109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a0551abb-52a1-4b2b-b68a-9d98dea48260 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:23.123086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a0551abb-52a1-4b2b-b68a-9d98dea48260 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:23.130668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0551abb-52a1-4b2b-b68a-9d98dea48260 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:23.132366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0551abb-52a1-4b2b-b68a-9d98dea48260 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:23.133363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0551abb-52a1-4b2b-b68a-9d98dea48260 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:23.134352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0551abb-52a1-4b2b-b68a-9d98dea48260 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:23.135056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0551abb-52a1-4b2b-b68a-9d98dea48260 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:23.135747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0551abb-52a1-4b2b-b68a-9d98dea48260 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:23.605968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a65da8f1-b0ed-4a7d-97f7-dc486863608e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:23.609702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:23.629565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a65da8f1-b0ed-4a7d-97f7-dc486863608e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:23.631091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a65da8f1-b0ed-4a7d-97f7-dc486863608e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:23.632922 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a65da8f1-b0ed-4a7d-97f7-dc486863608e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 2960 microversion: 2.42 time: 1.014307 Oct 29 01:20:23.633800 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1861/3892] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:22 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 2960 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:23.651752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6516a8f3-a551-4f5d-9216-a3f916e601b5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:23.652661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6516a8f3-a551-4f5d-9216-a3f916e601b5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:23.665199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6516a8f3-a551-4f5d-9216-a3f916e601b5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:23.666033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6516a8f3-a551-4f5d-9216-a3f916e601b5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:23.667230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6516a8f3-a551-4f5d-9216-a3f916e601b5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:23.667400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6516a8f3-a551-4f5d-9216-a3f916e601b5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:23.668030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6516a8f3-a551-4f5d-9216-a3f916e601b5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:23.668651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6516a8f3-a551-4f5d-9216-a3f916e601b5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:23.709830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a0551abb-52a1-4b2b-b68a-9d98dea48260 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:23.719365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=12 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:23.727609 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a0551abb-52a1-4b2b-b68a-9d98dea48260 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8" status: 200 len: 1308 microversion: 2.1 time: 0.608546 Oct 29 01:20:23.728174 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2032/3893] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:23 2022] GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 => generated 1308 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:23.733342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e90d521-30d8-4768-a621-8a67fd58dffd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:23.734201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e90d521-30d8-4768-a621-8a67fd58dffd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:23.754426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:23.762961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e90d521-30d8-4768-a621-8a67fd58dffd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:23.762961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e90d521-30d8-4768-a621-8a67fd58dffd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:23.762961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e90d521-30d8-4768-a621-8a67fd58dffd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:23.762961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e90d521-30d8-4768-a621-8a67fd58dffd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:23.762961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e90d521-30d8-4768-a621-8a67fd58dffd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:23.762961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e90d521-30d8-4768-a621-8a67fd58dffd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:23.986221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8e90d521-30d8-4768-a621-8a67fd58dffd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:23.999621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8e90d521-30d8-4768-a621-8a67fd58dffd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:24.005764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8e90d521-30d8-4768-a621-8a67fd58dffd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:24.015299 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8e90d521-30d8-4768-a621-8a67fd58dffd tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.285826 Oct 29 01:20:24.016992 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2033/3894] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:23 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:24.109691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e21f7811-ffc3-4009-9ea6-fba0e361f484 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1187819553", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:24.166321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6516a8f3-a551-4f5d-9216-a3f916e601b5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:24.186389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6516a8f3-a551-4f5d-9216-a3f916e601b5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:24.189559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6516a8f3-a551-4f5d-9216-a3f916e601b5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:24.190986 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6516a8f3-a551-4f5d-9216-a3f916e601b5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.556056 Oct 29 01:20:24.191725 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1862/3895] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:23 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:24.196198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-e21f7811-ffc3-4009-9ea6-fba0e361f484 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] validate_networks() for [('daf068bd-431d-4e20-b386-6225154844e0', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:20:24.209503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-b87e6196-6bc1-42d0-9e27-96ccfbce9c88 req-152ac653-483f-416a-81f3-ce7d429516b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7", "tag": "a4e47f26-496b-432f-a8b8-bea4884fce92"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:24.236048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b87e6196-6bc1-42d0-9e27-96ccfbce9c88 req-152ac653-483f-416a-81f3-ce7d429516b0 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:24.237197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b87e6196-6bc1-42d0-9e27-96ccfbce9c88 req-152ac653-483f-416a-81f3-ce7d429516b0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:24.237837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b87e6196-6bc1-42d0-9e27-96ccfbce9c88 req-152ac653-483f-416a-81f3-ce7d429516b0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:24.265299 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-b87e6196-6bc1-42d0-9e27-96ccfbce9c88 req-152ac653-483f-416a-81f3-ce7d429516b0 service nova] Creating event network-changed:a4e47f26-496b-432f-a8b8-bea4884fce92 for instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 on n-h1-862964-3 Oct 29 01:20:24.271487 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-b87e6196-6bc1-42d0-9e27-96ccfbce9c88 req-152ac653-483f-416a-81f3-ce7d429516b0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073769 Oct 29 01:20:24.272101 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1863/3896] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:24.278578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-37e3729f-b299-4fda-9228-ecd1e38fc8a2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:24.279687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-37e3729f-b299-4fda-9228-ecd1e38fc8a2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:24.286246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37e3729f-b299-4fda-9228-ecd1e38fc8a2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:24.286980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37e3729f-b299-4fda-9228-ecd1e38fc8a2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:24.287586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37e3729f-b299-4fda-9228-ecd1e38fc8a2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:24.288875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37e3729f-b299-4fda-9228-ecd1e38fc8a2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:24.289701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37e3729f-b299-4fda-9228-ecd1e38fc8a2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:24.290326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37e3729f-b299-4fda-9228-ecd1e38fc8a2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:24.828483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-37e3729f-b299-4fda-9228-ecd1e38fc8a2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:24.839215 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-37e3729f-b299-4fda-9228-ecd1e38fc8a2 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1309 microversion: 2.1 time: 0.564754 Oct 29 01:20:24.840090 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1864/3897] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:24 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1309 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:24.845630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0a8c6dbb-c191-4dd0-a96c-3def855218f1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:24.846468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0a8c6dbb-c191-4dd0-a96c-3def855218f1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:24.863694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a8c6dbb-c191-4dd0-a96c-3def855218f1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:24.864211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a8c6dbb-c191-4dd0-a96c-3def855218f1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:24.864670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a8c6dbb-c191-4dd0-a96c-3def855218f1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:24.865480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a8c6dbb-c191-4dd0-a96c-3def855218f1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:24.865949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a8c6dbb-c191-4dd0-a96c-3def855218f1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:24.866920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a8c6dbb-c191-4dd0-a96c-3def855218f1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:25.608627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0a8c6dbb-c191-4dd0-a96c-3def855218f1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:25.621996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0a8c6dbb-c191-4dd0-a96c-3def855218f1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:25.623885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0a8c6dbb-c191-4dd0-a96c-3def855218f1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:25.625389 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0a8c6dbb-c191-4dd0-a96c-3def855218f1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 2960 microversion: 2.42 time: 0.784099 Oct 29 01:20:25.626139 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1865/3898] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:24 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 2960 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:25.631246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f22defb3-ba73-48d2-bf54-824d0dcb0239 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:25.632194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f22defb3-ba73-48d2-bf54-824d0dcb0239 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:25.642582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f22defb3-ba73-48d2-bf54-824d0dcb0239 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:25.644438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f22defb3-ba73-48d2-bf54-824d0dcb0239 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:25.647236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f22defb3-ba73-48d2-bf54-824d0dcb0239 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:25.648722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f22defb3-ba73-48d2-bf54-824d0dcb0239 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:25.649408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f22defb3-ba73-48d2-bf54-824d0dcb0239 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:25.650233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f22defb3-ba73-48d2-bf54-824d0dcb0239 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:25.835561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e21f7811-ffc3-4009-9ea6-fba0e361f484 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:20:25.836643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e21f7811-ffc3-4009-9ea6-fba0e361f484 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:20:25.837393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e21f7811-ffc3-4009-9ea6-fba0e361f484 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:20:25.838000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e21f7811-ffc3-4009-9ea6-fba0e361f484 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:20:25.838952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e21f7811-ffc3-4009-9ea6-fba0e361f484 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:20:25.852510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e21f7811-ffc3-4009-9ea6-fba0e361f484 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:25.854391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e21f7811-ffc3-4009-9ea6-fba0e361f484 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:25.855359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e21f7811-ffc3-4009-9ea6-fba0e361f484 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:25.856598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e21f7811-ffc3-4009-9ea6-fba0e361f484 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:25.857293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e21f7811-ffc3-4009-9ea6-fba0e361f484 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:25.857906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e21f7811-ffc3-4009-9ea6-fba0e361f484 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:25.886979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-e21f7811-ffc3-4009-9ea6-fba0e361f484 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Getting quotas for project db514c084b19414db61960c65630a76f. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:20:25.894278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-e21f7811-ffc3-4009-9ea6-fba0e361f484 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Getting quotas for user db4f1d9f22ae4b008486032a7f6269a6 and project db514c084b19414db61960c65630a76f. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:20:25.900032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f22defb3-ba73-48d2-bf54-824d0dcb0239 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:25.912888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e21f7811-ffc3-4009-9ea6-fba0e361f484 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:20:25.916497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e21f7811-ffc3-4009-9ea6-fba0e361f484 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:20:25.932884 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f22defb3-ba73-48d2-bf54-824d0dcb0239 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8" status: 200 len: 1308 microversion: 2.1 time: 0.305315 Oct 29 01:20:25.954590 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1866/3899] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:25 2022] GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 => generated 1308 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:25.962466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7c3d9682-1829-41d9-8d28-b98ac381f641 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:25.963148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7c3d9682-1829-41d9-8d28-b98ac381f641 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:25.970517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c3d9682-1829-41d9-8d28-b98ac381f641 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:25.971360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c3d9682-1829-41d9-8d28-b98ac381f641 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:25.972026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c3d9682-1829-41d9-8d28-b98ac381f641 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:25.972914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c3d9682-1829-41d9-8d28-b98ac381f641 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:25.973716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c3d9682-1829-41d9-8d28-b98ac381f641 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:25.975071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c3d9682-1829-41d9-8d28-b98ac381f641 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:26.051700 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e21f7811-ffc3-4009-9ea6-fba0e361f484 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.033302 Oct 29 01:20:26.052372 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2034/3900] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:20:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:20:26.064528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9bbec304-5631-4f74-829d-9570a7b00e9e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:26.065466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9bbec304-5631-4f74-829d-9570a7b00e9e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:26.073317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bbec304-5631-4f74-829d-9570a7b00e9e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:26.074074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bbec304-5631-4f74-829d-9570a7b00e9e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:26.074743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bbec304-5631-4f74-829d-9570a7b00e9e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:26.075741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bbec304-5631-4f74-829d-9570a7b00e9e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:26.077050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bbec304-5631-4f74-829d-9570a7b00e9e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:26.082628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bbec304-5631-4f74-829d-9570a7b00e9e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:26.085532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7c3d9682-1829-41d9-8d28-b98ac381f641 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:26.097075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7c3d9682-1829-41d9-8d28-b98ac381f641 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:26.103383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7c3d9682-1829-41d9-8d28-b98ac381f641 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:26.111170 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7c3d9682-1829-41d9-8d28-b98ac381f641 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.155368 Oct 29 01:20:26.112218 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1867/3901] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:25 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:26.132810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-743a4c63-e656-4133-9a3b-fa091277cfbf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:26.135556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-743a4c63-e656-4133-9a3b-fa091277cfbf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:26.157817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-743a4c63-e656-4133-9a3b-fa091277cfbf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:26.162493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-743a4c63-e656-4133-9a3b-fa091277cfbf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:26.163678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-743a4c63-e656-4133-9a3b-fa091277cfbf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:26.164944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-743a4c63-e656-4133-9a3b-fa091277cfbf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:26.165504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-743a4c63-e656-4133-9a3b-fa091277cfbf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:26.167098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-743a4c63-e656-4133-9a3b-fa091277cfbf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:26.571048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9bbec304-5631-4f74-829d-9570a7b00e9e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:26.581740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-743a4c63-e656-4133-9a3b-fa091277cfbf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:26.589723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9bbec304-5631-4f74-829d-9570a7b00e9e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:26.595543 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-743a4c63-e656-4133-9a3b-fa091277cfbf tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1309 microversion: 2.1 time: 0.480924 Oct 29 01:20:26.595543 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1868/3902] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:26 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1309 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:26.600874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e5d8d3da-f1f1-4b2d-adc0-e64a61706430 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:26.602266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e5d8d3da-f1f1-4b2d-adc0-e64a61706430 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:26.606214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9bbec304-5631-4f74-829d-9570a7b00e9e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:26.611880 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9bbec304-5631-4f74-829d-9570a7b00e9e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.549890 Oct 29 01:20:26.612839 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2035/3903] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:26 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:26.625376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-99a15c01-e9c9-4518-9518-481594fac427 req-14239467-2fbc-4e2e-99ca-1d77a774a972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d0fc606-5d53-4e70-b087-22db406a68f8", "tag": "ee5981f8-c5ba-4a90-afb9-4849d919a97f"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:26.651659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-99a15c01-e9c9-4518-9518-481594fac427 req-14239467-2fbc-4e2e-99ca-1d77a774a972 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:26.652571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-99a15c01-e9c9-4518-9518-481594fac427 req-14239467-2fbc-4e2e-99ca-1d77a774a972 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:26.653327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-99a15c01-e9c9-4518-9518-481594fac427 req-14239467-2fbc-4e2e-99ca-1d77a774a972 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:26.679508 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-99a15c01-e9c9-4518-9518-481594fac427 req-14239467-2fbc-4e2e-99ca-1d77a774a972 service nova] Creating event network-changed:ee5981f8-c5ba-4a90-afb9-4849d919a97f for instance 3d0fc606-5d53-4e70-b087-22db406a68f8 on n-h1-862964-3 Oct 29 01:20:26.688624 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-99a15c01-e9c9-4518-9518-481594fac427 req-14239467-2fbc-4e2e-99ca-1d77a774a972 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073265 Oct 29 01:20:26.690036 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2036/3904] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:26.696324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e5d8d3da-f1f1-4b2d-adc0-e64a61706430 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:26.699922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8903d616-8668-4f79-b97f-1a1f70ae5f5f tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:26.702533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8903d616-8668-4f79-b97f-1a1f70ae5f5f tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:26.706379 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e5d8d3da-f1f1-4b2d-adc0-e64a61706430 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1217 microversion: 2.1 time: 0.108856 Oct 29 01:20:26.707524 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1869/3905] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:26 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:26.712147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8903d616-8668-4f79-b97f-1a1f70ae5f5f tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:26.712873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8903d616-8668-4f79-b97f-1a1f70ae5f5f tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:26.713523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8903d616-8668-4f79-b97f-1a1f70ae5f5f tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:26.714411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8903d616-8668-4f79-b97f-1a1f70ae5f5f tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:26.715047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8903d616-8668-4f79-b97f-1a1f70ae5f5f tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:26.715655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8903d616-8668-4f79-b97f-1a1f70ae5f5f tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:26.747266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:26.966923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bc722691-f15f-429c-838b-cbbda0a3c7f7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:26.968883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bc722691-f15f-429c-838b-cbbda0a3c7f7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:26.976324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc722691-f15f-429c-838b-cbbda0a3c7f7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:26.977072 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc722691-f15f-429c-838b-cbbda0a3c7f7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:26.977744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc722691-f15f-429c-838b-cbbda0a3c7f7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:26.978623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc722691-f15f-429c-838b-cbbda0a3c7f7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:26.979240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc722691-f15f-429c-838b-cbbda0a3c7f7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:26.979874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc722691-f15f-429c-838b-cbbda0a3c7f7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:27.011318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8903d616-8668-4f79-b97f-1a1f70ae5f5f tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:27.023453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8903d616-8668-4f79-b97f-1a1f70ae5f5f tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:27.024964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8903d616-8668-4f79-b97f-1a1f70ae5f5f tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:27.026443 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8903d616-8668-4f79-b97f-1a1f70ae5f5f tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 2960 microversion: 2.42 time: 0.335040 Oct 29 01:20:27.027542 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2037/3906] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:26 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 2960 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:27.140736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ebdaed93-1100-4a88-896f-f34ab4ae086a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:27.141889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ebdaed93-1100-4a88-896f-f34ab4ae086a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:27.158779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebdaed93-1100-4a88-896f-f34ab4ae086a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:27.159286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebdaed93-1100-4a88-896f-f34ab4ae086a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:27.164545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebdaed93-1100-4a88-896f-f34ab4ae086a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:27.166528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebdaed93-1100-4a88-896f-f34ab4ae086a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:27.167330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebdaed93-1100-4a88-896f-f34ab4ae086a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:27.167939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebdaed93-1100-4a88-896f-f34ab4ae086a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:27.203549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bc722691-f15f-429c-838b-cbbda0a3c7f7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:27.229413 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bc722691-f15f-429c-838b-cbbda0a3c7f7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8" status: 200 len: 1308 microversion: 2.1 time: 0.265354 Oct 29 01:20:27.230740 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1870/3907] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:26 2022] GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:27.290516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ebdaed93-1100-4a88-896f-f34ab4ae086a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:27.304894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ebdaed93-1100-4a88-896f-f34ab4ae086a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:27.308584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ebdaed93-1100-4a88-896f-f34ab4ae086a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:27.315112 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ebdaed93-1100-4a88-896f-f34ab4ae086a tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.179467 Oct 29 01:20:27.316138 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2038/3908] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:27 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:27.620888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d8562dc2-417b-49c7-b65d-611a45bcfb3a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:27.621776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d8562dc2-417b-49c7-b65d-611a45bcfb3a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:27.629199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8562dc2-417b-49c7-b65d-611a45bcfb3a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:27.629820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8562dc2-417b-49c7-b65d-611a45bcfb3a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:27.630265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8562dc2-417b-49c7-b65d-611a45bcfb3a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:27.631000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8562dc2-417b-49c7-b65d-611a45bcfb3a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:27.632195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8562dc2-417b-49c7-b65d-611a45bcfb3a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:27.632852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8562dc2-417b-49c7-b65d-611a45bcfb3a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:27.649462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3e4a6e10-edd6-4001-8c88-aeb1934d7e71 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:27.650198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3e4a6e10-edd6-4001-8c88-aeb1934d7e71 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:27.659851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4a6e10-edd6-4001-8c88-aeb1934d7e71 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:27.660693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4a6e10-edd6-4001-8c88-aeb1934d7e71 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:27.661408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4a6e10-edd6-4001-8c88-aeb1934d7e71 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:27.662330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4a6e10-edd6-4001-8c88-aeb1934d7e71 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:27.663031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4a6e10-edd6-4001-8c88-aeb1934d7e71 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:27.663696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e4a6e10-edd6-4001-8c88-aeb1934d7e71 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:28.596688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d8562dc2-417b-49c7-b65d-611a45bcfb3a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:28.597311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3e4a6e10-edd6-4001-8c88-aeb1934d7e71 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:28.605647 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d8562dc2-417b-49c7-b65d-611a45bcfb3a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1309 microversion: 2.1 time: 0.988562 Oct 29 01:20:28.606247 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1871/3909] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:27 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1309 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:28.614067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b245fb77-45ed-4363-8e7e-0e462dd271d4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:28.614684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b245fb77-45ed-4363-8e7e-0e462dd271d4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:28.624009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3e4a6e10-edd6-4001-8c88-aeb1934d7e71 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:28.628663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b245fb77-45ed-4363-8e7e-0e462dd271d4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:28.629236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b245fb77-45ed-4363-8e7e-0e462dd271d4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:28.629872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b245fb77-45ed-4363-8e7e-0e462dd271d4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:28.630577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b245fb77-45ed-4363-8e7e-0e462dd271d4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:28.631027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b245fb77-45ed-4363-8e7e-0e462dd271d4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:28.637201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3e4a6e10-edd6-4001-8c88-aeb1934d7e71 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:28.639255 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3e4a6e10-edd6-4001-8c88-aeb1934d7e71 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.996113 Oct 29 01:20:28.643274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b245fb77-45ed-4363-8e7e-0e462dd271d4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:28.643561 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2039/3910] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:27 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:20:28.653039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a41ef5f4-87c0-446e-97b9-962069aea0c2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:28.653680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a41ef5f4-87c0-446e-97b9-962069aea0c2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:28.671081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a41ef5f4-87c0-446e-97b9-962069aea0c2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:28.671654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a41ef5f4-87c0-446e-97b9-962069aea0c2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:28.671988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a41ef5f4-87c0-446e-97b9-962069aea0c2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:28.672963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a41ef5f4-87c0-446e-97b9-962069aea0c2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:28.673435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a41ef5f4-87c0-446e-97b9-962069aea0c2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:28.680802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a41ef5f4-87c0-446e-97b9-962069aea0c2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:28.785192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b245fb77-45ed-4363-8e7e-0e462dd271d4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:28.796024 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b245fb77-45ed-4363-8e7e-0e462dd271d4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1269 microversion: 2.1 time: 0.188735 Oct 29 01:20:28.821522 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1872/3911] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:28 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1269 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:28.832161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bfe478e8-3480-424f-be34-9b92af28ae44 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:28.832893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bfe478e8-3480-424f-be34-9b92af28ae44 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:28.839593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfe478e8-3480-424f-be34-9b92af28ae44 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:28.840194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfe478e8-3480-424f-be34-9b92af28ae44 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:28.840737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfe478e8-3480-424f-be34-9b92af28ae44 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:28.842340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfe478e8-3480-424f-be34-9b92af28ae44 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:28.843220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfe478e8-3480-424f-be34-9b92af28ae44 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:28.844078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfe478e8-3480-424f-be34-9b92af28ae44 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:29.068084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a41ef5f4-87c0-446e-97b9-962069aea0c2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:29.088755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a41ef5f4-87c0-446e-97b9-962069aea0c2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:29.090695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a41ef5f4-87c0-446e-97b9-962069aea0c2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:29.092235 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a41ef5f4-87c0-446e-97b9-962069aea0c2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 2960 microversion: 2.42 time: 0.447623 Oct 29 01:20:29.093022 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2040/3912] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:28 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 2960 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:29.098644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-13713bcb-6da0-48c0-81b8-120846d65c29 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:29.099526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-13713bcb-6da0-48c0-81b8-120846d65c29 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:29.107851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13713bcb-6da0-48c0-81b8-120846d65c29 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:29.112926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13713bcb-6da0-48c0-81b8-120846d65c29 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:29.112926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13713bcb-6da0-48c0-81b8-120846d65c29 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:29.112926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13713bcb-6da0-48c0-81b8-120846d65c29 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:29.112926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13713bcb-6da0-48c0-81b8-120846d65c29 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:29.112926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13713bcb-6da0-48c0-81b8-120846d65c29 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:29.146487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bfe478e8-3480-424f-be34-9b92af28ae44 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:29.179611 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bfe478e8-3480-424f-be34-9b92af28ae44 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8" status: 200 len: 1308 microversion: 2.1 time: 0.350522 Oct 29 01:20:29.181851 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1873/3913] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:28 2022] GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 => generated 1308 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:29.203149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-13713bcb-6da0-48c0-81b8-120846d65c29 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:29.217294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-13713bcb-6da0-48c0-81b8-120846d65c29 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:29.218886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-13713bcb-6da0-48c0-81b8-120846d65c29 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:29.225823 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-13713bcb-6da0-48c0-81b8-120846d65c29 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1542 microversion: 2.91 time: 0.131468 Oct 29 01:20:29.226831 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2041/3914] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:29 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1542 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:29.634437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4ccf73a1-32d2-4f32-81fe-1675a86462af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:29.635181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4ccf73a1-32d2-4f32-81fe-1675a86462af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:29.654589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ccf73a1-32d2-4f32-81fe-1675a86462af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:29.655193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ccf73a1-32d2-4f32-81fe-1675a86462af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:29.655642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ccf73a1-32d2-4f32-81fe-1675a86462af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:29.656368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ccf73a1-32d2-4f32-81fe-1675a86462af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:29.656831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ccf73a1-32d2-4f32-81fe-1675a86462af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:29.657290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ccf73a1-32d2-4f32-81fe-1675a86462af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:29.671878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80fd5f4d-4225-4a6a-875a-08a9d5075c34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:29.672746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-80fd5f4d-4225-4a6a-875a-08a9d5075c34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:29.694794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80fd5f4d-4225-4a6a-875a-08a9d5075c34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:29.695283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80fd5f4d-4225-4a6a-875a-08a9d5075c34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:29.695845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80fd5f4d-4225-4a6a-875a-08a9d5075c34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:29.696579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80fd5f4d-4225-4a6a-875a-08a9d5075c34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:29.697040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80fd5f4d-4225-4a6a-875a-08a9d5075c34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:29.697501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80fd5f4d-4225-4a6a-875a-08a9d5075c34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:30.089199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4ccf73a1-32d2-4f32-81fe-1675a86462af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:30.102613 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4ccf73a1-32d2-4f32-81fe-1675a86462af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1309 microversion: 2.1 time: 0.472540 Oct 29 01:20:30.103225 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1874/3915] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:29 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1309 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:30.126676 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-2ce057c3-2b22-4595-9a73-ee87551c12d0 req-af23eb0b-c654-44a5-86b7-36e9a4853be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "name": "network-vif-unplugged", "status": "completed", "tag": "d00f19cc-89ea-4719-aa7c-b9d320f81a37"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:30.146664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:30.146664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2ce057c3-2b22-4595-9a73-ee87551c12d0 req-af23eb0b-c654-44a5-86b7-36e9a4853be6 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:30.146664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2ce057c3-2b22-4595-9a73-ee87551c12d0 req-af23eb0b-c654-44a5-86b7-36e9a4853be6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:30.146664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2ce057c3-2b22-4595-9a73-ee87551c12d0 req-af23eb0b-c654-44a5-86b7-36e9a4853be6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:30.169060 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-2ce057c3-2b22-4595-9a73-ee87551c12d0 req-af23eb0b-c654-44a5-86b7-36e9a4853be6 service nova] Creating event network-vif-unplugged:d00f19cc-89ea-4719-aa7c-b9d320f81a37 for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:20:30.178144 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-2ce057c3-2b22-4595-9a73-ee87551c12d0 req-af23eb0b-c654-44a5-86b7-36e9a4853be6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056818 Oct 29 01:20:30.179799 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1875/3916] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:30.186180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8e19f5c4-7f23-4eea-b90e-6df4c7150bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:30.186905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8e19f5c4-7f23-4eea-b90e-6df4c7150bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:30.195240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e19f5c4-7f23-4eea-b90e-6df4c7150bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:30.195748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e19f5c4-7f23-4eea-b90e-6df4c7150bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:30.196197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e19f5c4-7f23-4eea-b90e-6df4c7150bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:30.196918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e19f5c4-7f23-4eea-b90e-6df4c7150bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:30.197409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e19f5c4-7f23-4eea-b90e-6df4c7150bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:30.198686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e19f5c4-7f23-4eea-b90e-6df4c7150bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:30.269947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-80fd5f4d-4225-4a6a-875a-08a9d5075c34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:30.286611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-80fd5f4d-4225-4a6a-875a-08a9d5075c34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:30.288582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-80fd5f4d-4225-4a6a-875a-08a9d5075c34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:30.290407 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-80fd5f4d-4225-4a6a-875a-08a9d5075c34 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.622475 Oct 29 01:20:30.291833 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2042/3917] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:29 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:20:30.314745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3aa8230e-8215-4669-97da-64de49e7db77 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:30.315581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3aa8230e-8215-4669-97da-64de49e7db77 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:30.325388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3aa8230e-8215-4669-97da-64de49e7db77 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:30.325990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3aa8230e-8215-4669-97da-64de49e7db77 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:30.326664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3aa8230e-8215-4669-97da-64de49e7db77 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:30.328044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3aa8230e-8215-4669-97da-64de49e7db77 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:30.328599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3aa8230e-8215-4669-97da-64de49e7db77 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:30.329880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3aa8230e-8215-4669-97da-64de49e7db77 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:30.351179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8e19f5c4-7f23-4eea-b90e-6df4c7150bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:30.373915 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8e19f5c4-7f23-4eea-b90e-6df4c7150bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1275 microversion: 2.1 time: 0.191573 Oct 29 01:20:30.389332 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1876/3918] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:30 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1275 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:30.389332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b9d8f67a-8171-4591-935a-2a1f681f7a50 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:30.390251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b9d8f67a-8171-4591-935a-2a1f681f7a50 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:30.398836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9d8f67a-8171-4591-935a-2a1f681f7a50 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:30.404880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9d8f67a-8171-4591-935a-2a1f681f7a50 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:30.406152 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9d8f67a-8171-4591-935a-2a1f681f7a50 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:30.408329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9d8f67a-8171-4591-935a-2a1f681f7a50 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:30.410483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9d8f67a-8171-4591-935a-2a1f681f7a50 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:30.411167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9d8f67a-8171-4591-935a-2a1f681f7a50 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:31.077443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3aa8230e-8215-4669-97da-64de49e7db77 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:31.093788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3aa8230e-8215-4669-97da-64de49e7db77 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:31.099419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3aa8230e-8215-4669-97da-64de49e7db77 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:31.102081 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3aa8230e-8215-4669-97da-64de49e7db77 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 2918 microversion: 2.42 time: 0.808530 Oct 29 01:20:31.103602 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2043/3919] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:30 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 2918 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:31.122860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-09a5df48-970d-49d6-978a-7b80ec22dc78 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:31.123787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-09a5df48-970d-49d6-978a-7b80ec22dc78 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:31.145458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09a5df48-970d-49d6-978a-7b80ec22dc78 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:31.147048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09a5df48-970d-49d6-978a-7b80ec22dc78 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:31.150683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09a5df48-970d-49d6-978a-7b80ec22dc78 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:31.159212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09a5df48-970d-49d6-978a-7b80ec22dc78 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:31.159212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09a5df48-970d-49d6-978a-7b80ec22dc78 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:31.159212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09a5df48-970d-49d6-978a-7b80ec22dc78 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:31.202642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b9d8f67a-8171-4591-935a-2a1f681f7a50 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:31.215966 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b9d8f67a-8171-4591-935a-2a1f681f7a50 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8" status: 200 len: 1308 microversion: 2.1 time: 0.834303 Oct 29 01:20:31.233583 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1877/3920] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:30 2022] GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 => generated 1308 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:31.243142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3963f79d-948b-4f2f-91c3-99f1e1ba90f5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:31.243926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3963f79d-948b-4f2f-91c3-99f1e1ba90f5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:31.254564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3963f79d-948b-4f2f-91c3-99f1e1ba90f5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:31.255073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3963f79d-948b-4f2f-91c3-99f1e1ba90f5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:31.255523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3963f79d-948b-4f2f-91c3-99f1e1ba90f5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:31.256453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3963f79d-948b-4f2f-91c3-99f1e1ba90f5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:31.258129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3963f79d-948b-4f2f-91c3-99f1e1ba90f5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:31.264826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3963f79d-948b-4f2f-91c3-99f1e1ba90f5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:31.358660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-09a5df48-970d-49d6-978a-7b80ec22dc78 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:31.385447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-09a5df48-970d-49d6-978a-7b80ec22dc78 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:31.394028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-09a5df48-970d-49d6-978a-7b80ec22dc78 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:31.417050 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-09a5df48-970d-49d6-978a-7b80ec22dc78 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1529 microversion: 2.91 time: 0.302800 Oct 29 01:20:31.433331 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2044/3921] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:31 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1529 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:31.458045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-01466a77-c700-4c81-bc3b-6e063a15c885 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:31.459039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-01466a77-c700-4c81-bc3b-6e063a15c885 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:31.473453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01466a77-c700-4c81-bc3b-6e063a15c885 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:31.474301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01466a77-c700-4c81-bc3b-6e063a15c885 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:31.474952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01466a77-c700-4c81-bc3b-6e063a15c885 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:31.476433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01466a77-c700-4c81-bc3b-6e063a15c885 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:31.477079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01466a77-c700-4c81-bc3b-6e063a15c885 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:31.477735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01466a77-c700-4c81-bc3b-6e063a15c885 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:32.581970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3963f79d-948b-4f2f-91c3-99f1e1ba90f5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:32.592296 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3963f79d-948b-4f2f-91c3-99f1e1ba90f5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1309 microversion: 2.1 time: 1.357324 Oct 29 01:20:32.600651 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1878/3922] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:31 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1309 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:32.613562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-68cf5cab-af1f-485d-a909-9f7440329c3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:32.614437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-68cf5cab-af1f-485d-a909-9f7440329c3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:32.626014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68cf5cab-af1f-485d-a909-9f7440329c3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:32.626511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68cf5cab-af1f-485d-a909-9f7440329c3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:32.626948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68cf5cab-af1f-485d-a909-9f7440329c3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:32.627665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68cf5cab-af1f-485d-a909-9f7440329c3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:32.628289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68cf5cab-af1f-485d-a909-9f7440329c3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:32.628717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68cf5cab-af1f-485d-a909-9f7440329c3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:32.701956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-01466a77-c700-4c81-bc3b-6e063a15c885 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:32.714887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-01466a77-c700-4c81-bc3b-6e063a15c885 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:32.716908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-01466a77-c700-4c81-bc3b-6e063a15c885 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:32.719407 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-01466a77-c700-4c81-bc3b-6e063a15c885 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 1.284679 Oct 29 01:20:32.736387 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2045/3923] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:31 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:32.756080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-004466e4-723c-4975-b693-62bb24901abf tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:32.756080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-004466e4-723c-4975-b693-62bb24901abf tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:32.758839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-004466e4-723c-4975-b693-62bb24901abf tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:32.760794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-004466e4-723c-4975-b693-62bb24901abf tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:32.761321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-004466e4-723c-4975-b693-62bb24901abf tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:32.762082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-004466e4-723c-4975-b693-62bb24901abf tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:32.762560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-004466e4-723c-4975-b693-62bb24901abf tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:32.763070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-004466e4-723c-4975-b693-62bb24901abf tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:32.985465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-004466e4-723c-4975-b693-62bb24901abf tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] Lazy-loading 'services' on Instance uuid 6e3a11cb-1999-468d-858f-dd5eb0fc275a {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:20:33.014406 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-004466e4-723c-4975-b693-62bb24901abf tempest-UnshelveToHostMultiNodesTest-103111404 tempest-UnshelveToHostMultiNodesTest-103111404-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1934 microversion: 2.91 time: 0.275654 Oct 29 01:20:33.018112 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2046/3924] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:32 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1934 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:33.027305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-38609a50-34ce-4b6c-8c30-10217037fb1d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:33.028833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-38609a50-34ce-4b6c-8c30-10217037fb1d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:33.040661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38609a50-34ce-4b6c-8c30-10217037fb1d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:33.042789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38609a50-34ce-4b6c-8c30-10217037fb1d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:33.046775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38609a50-34ce-4b6c-8c30-10217037fb1d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:33.046775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38609a50-34ce-4b6c-8c30-10217037fb1d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:33.046775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38609a50-34ce-4b6c-8c30-10217037fb1d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:33.046775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38609a50-34ce-4b6c-8c30-10217037fb1d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:33.227652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-68cf5cab-af1f-485d-a909-9f7440329c3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:33.239437 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-68cf5cab-af1f-485d-a909-9f7440329c3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1317 microversion: 2.1 time: 0.637346 Oct 29 01:20:33.242021 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1879/3925] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:32 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1317 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:33.252072 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-57eae1e5-8105-4af3-bde5-dd5bf552afaa req-60a930f0-7e9c-44fc-bab7-cc1e45dfad86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "name": "network-vif-unplugged", "status": "completed", "tag": "913a07b9-ad16-4d31-879a-a34b9897edf8"}, {"server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "name": "network-vif-unplugged", "status": "completed", "tag": "f39a3550-9b81-4cf3-b84a-f81318c9a9cb"}, {"server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "name": "network-vif-unplugged", "status": "completed", "tag": "e7524267-ec12-4093-8a7b-fe4b7e069f3a"}, {"server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "name": "network-vif-unplugged", "status": "completed", "tag": "1848d527-bac1-41c8-956e-7737379b67ca"}, {"server_uuid": "e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7", "name": "network-vif-plugged", "status": "completed", "tag": "a4e47f26-496b-432f-a8b8-bea4884fce92"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:33.267944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-57eae1e5-8105-4af3-bde5-dd5bf552afaa req-60a930f0-7e9c-44fc-bab7-cc1e45dfad86 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:33.268773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-57eae1e5-8105-4af3-bde5-dd5bf552afaa req-60a930f0-7e9c-44fc-bab7-cc1e45dfad86 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:33.269743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-57eae1e5-8105-4af3-bde5-dd5bf552afaa req-60a930f0-7e9c-44fc-bab7-cc1e45dfad86 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:33.291675 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-57eae1e5-8105-4af3-bde5-dd5bf552afaa req-60a930f0-7e9c-44fc-bab7-cc1e45dfad86 service nova] Creating event network-vif-unplugged:913a07b9-ad16-4d31-879a-a34b9897edf8 for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:20:33.292984 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-57eae1e5-8105-4af3-bde5-dd5bf552afaa req-60a930f0-7e9c-44fc-bab7-cc1e45dfad86 service nova] Creating event network-vif-unplugged:f39a3550-9b81-4cf3-b84a-f81318c9a9cb for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:20:33.293789 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-57eae1e5-8105-4af3-bde5-dd5bf552afaa req-60a930f0-7e9c-44fc-bab7-cc1e45dfad86 service nova] Creating event network-vif-unplugged:e7524267-ec12-4093-8a7b-fe4b7e069f3a for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:20:33.295263 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-57eae1e5-8105-4af3-bde5-dd5bf552afaa req-60a930f0-7e9c-44fc-bab7-cc1e45dfad86 service nova] Creating event network-vif-unplugged:1848d527-bac1-41c8-956e-7737379b67ca for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:20:33.296019 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-57eae1e5-8105-4af3-bde5-dd5bf552afaa req-60a930f0-7e9c-44fc-bab7-cc1e45dfad86 service nova] Creating event network-vif-plugged:a4e47f26-496b-432f-a8b8-bea4884fce92 for instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 on n-h1-862964-3 Oct 29 01:20:33.311668 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-57eae1e5-8105-4af3-bde5-dd5bf552afaa req-60a930f0-7e9c-44fc-bab7-cc1e45dfad86 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 875 microversion: 2.1 time: 0.067236 Oct 29 01:20:33.312286 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1880/3926] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 875 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:33.319814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-97449260-3f85-4a7b-a9be-090b276d4857 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:33.319814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-97449260-3f85-4a7b-a9be-090b276d4857 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:33.328608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97449260-3f85-4a7b-a9be-090b276d4857 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:33.329486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97449260-3f85-4a7b-a9be-090b276d4857 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:33.330136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97449260-3f85-4a7b-a9be-090b276d4857 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:33.331119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97449260-3f85-4a7b-a9be-090b276d4857 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:33.332179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97449260-3f85-4a7b-a9be-090b276d4857 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:33.332836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97449260-3f85-4a7b-a9be-090b276d4857 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:33.356418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:33.645389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-38609a50-34ce-4b6c-8c30-10217037fb1d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:33.655778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-38609a50-34ce-4b6c-8c30-10217037fb1d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:33.673326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-38609a50-34ce-4b6c-8c30-10217037fb1d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:33.673326 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-38609a50-34ce-4b6c-8c30-10217037fb1d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 2918 microversion: 2.42 time: 0.639794 Oct 29 01:20:33.674211 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2047/3927] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:33 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 2918 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:33.687289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-79f50411-8e62-4e50-aad7-9e5adb138a69 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:33.687955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-79f50411-8e62-4e50-aad7-9e5adb138a69 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:33.697836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79f50411-8e62-4e50-aad7-9e5adb138a69 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:33.698381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79f50411-8e62-4e50-aad7-9e5adb138a69 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:33.702938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79f50411-8e62-4e50-aad7-9e5adb138a69 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:33.702938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79f50411-8e62-4e50-aad7-9e5adb138a69 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:33.702938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79f50411-8e62-4e50-aad7-9e5adb138a69 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:33.702938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79f50411-8e62-4e50-aad7-9e5adb138a69 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:33.739865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-79f50411-8e62-4e50-aad7-9e5adb138a69 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:20:33.921531 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-97449260-3f85-4a7b-a9be-090b276d4857 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:33.933036 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-97449260-3f85-4a7b-a9be-090b276d4857 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8" status: 200 len: 1308 microversion: 2.1 time: 0.619224 Oct 29 01:20:33.948811 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1881/3928] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:33 2022] GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 => generated 1308 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:33.954605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8b75db44-c82b-4bff-842e-9997b3e9ca1a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:33.955426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8b75db44-c82b-4bff-842e-9997b3e9ca1a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:33.966028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b75db44-c82b-4bff-842e-9997b3e9ca1a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:33.966028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b75db44-c82b-4bff-842e-9997b3e9ca1a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:33.966028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b75db44-c82b-4bff-842e-9997b3e9ca1a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:33.966028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b75db44-c82b-4bff-842e-9997b3e9ca1a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:33.966028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b75db44-c82b-4bff-842e-9997b3e9ca1a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:33.966028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b75db44-c82b-4bff-842e-9997b3e9ca1a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:34.087340 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-79f50411-8e62-4e50-aad7-9e5adb138a69 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 204 len: 0 microversion: 2.91 time: 0.411662 Oct 29 01:20:34.088367 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2048/3929] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:20:33 2022] DELETE /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:20:34.097578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a2f5f08d-b904-4d6a-9599-9765d5d88101 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:34.098581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a2f5f08d-b904-4d6a-9599-9765d5d88101 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:34.118482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2f5f08d-b904-4d6a-9599-9765d5d88101 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:34.119372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2f5f08d-b904-4d6a-9599-9765d5d88101 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:34.120011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2f5f08d-b904-4d6a-9599-9765d5d88101 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:34.121331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2f5f08d-b904-4d6a-9599-9765d5d88101 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:34.122574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2f5f08d-b904-4d6a-9599-9765d5d88101 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:34.123365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2f5f08d-b904-4d6a-9599-9765d5d88101 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:34.500212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8b75db44-c82b-4bff-842e-9997b3e9ca1a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:34.508305 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8b75db44-c82b-4bff-842e-9997b3e9ca1a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1309 microversion: 2.1 time: 0.558012 Oct 29 01:20:34.508893 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1882/3930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:33 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1309 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:34.516975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-389e1cbd-426f-4a4f-b8bf-dc9749824f19 req-6c4d8eaa-75bf-41f3-8dc3-61c76b68e1ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "name": "network-vif-deleted", "tag": "f39a3550-9b81-4cf3-b84a-f81318c9a9cb"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:34.537227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-389e1cbd-426f-4a4f-b8bf-dc9749824f19 req-6c4d8eaa-75bf-41f3-8dc3-61c76b68e1ac service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:34.537227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-389e1cbd-426f-4a4f-b8bf-dc9749824f19 req-6c4d8eaa-75bf-41f3-8dc3-61c76b68e1ac service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:34.537227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-389e1cbd-426f-4a4f-b8bf-dc9749824f19 req-6c4d8eaa-75bf-41f3-8dc3-61c76b68e1ac service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:34.553338 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-389e1cbd-426f-4a4f-b8bf-dc9749824f19 req-6c4d8eaa-75bf-41f3-8dc3-61c76b68e1ac service nova] Creating event network-vif-deleted:f39a3550-9b81-4cf3-b84a-f81318c9a9cb for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:20:34.566605 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-389e1cbd-426f-4a4f-b8bf-dc9749824f19 req-6c4d8eaa-75bf-41f3-8dc3-61c76b68e1ac service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053476 Oct 29 01:20:34.566605 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1883/3931] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:34.570392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-df839dee-6d03-40a8-a404-0b122d566edc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:34.571525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-df839dee-6d03-40a8-a404-0b122d566edc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:34.579194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df839dee-6d03-40a8-a404-0b122d566edc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:34.579732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df839dee-6d03-40a8-a404-0b122d566edc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:34.580184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df839dee-6d03-40a8-a404-0b122d566edc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:34.581188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df839dee-6d03-40a8-a404-0b122d566edc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:34.581719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df839dee-6d03-40a8-a404-0b122d566edc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:34.582577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df839dee-6d03-40a8-a404-0b122d566edc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:34.632905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a2f5f08d-b904-4d6a-9599-9765d5d88101 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:34.643079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a2f5f08d-b904-4d6a-9599-9765d5d88101 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:34.644638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a2f5f08d-b904-4d6a-9599-9765d5d88101 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:34.645846 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a2f5f08d-b904-4d6a-9599-9765d5d88101 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.556171 Oct 29 01:20:34.646581 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2049/3932] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:34 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:34.652062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-07a1dd92-74f0-45a2-a869-61a1ccc8b18b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:34.652852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-07a1dd92-74f0-45a2-a869-61a1ccc8b18b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:34.659187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07a1dd92-74f0-45a2-a869-61a1ccc8b18b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:34.667756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07a1dd92-74f0-45a2-a869-61a1ccc8b18b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:34.667756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07a1dd92-74f0-45a2-a869-61a1ccc8b18b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:34.667756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07a1dd92-74f0-45a2-a869-61a1ccc8b18b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:34.667756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07a1dd92-74f0-45a2-a869-61a1ccc8b18b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:34.667756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07a1dd92-74f0-45a2-a869-61a1ccc8b18b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:34.710549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-df839dee-6d03-40a8-a404-0b122d566edc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:34.718812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-df839dee-6d03-40a8-a404-0b122d566edc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:34.720282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-df839dee-6d03-40a8-a404-0b122d566edc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:34.725379 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-df839dee-6d03-40a8-a404-0b122d566edc tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.159938 Oct 29 01:20:34.726163 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1884/3933] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:34 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:34.730651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-0e57906e-9f29-47ff-9b03-7fbae828aec9 req-e29d6cfb-279f-45df-a059-3c9ef0984641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63371d26-fe85-4cfa-bdca-c8ad84b81ee6", "tag": "f93b16c7-df1a-462b-be91-442aa008d850"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:34.740114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-0e57906e-9f29-47ff-9b03-7fbae828aec9 req-e29d6cfb-279f-45df-a059-3c9ef0984641 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:34.740590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-0e57906e-9f29-47ff-9b03-7fbae828aec9 req-e29d6cfb-279f-45df-a059-3c9ef0984641 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:34.741642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-0e57906e-9f29-47ff-9b03-7fbae828aec9 req-e29d6cfb-279f-45df-a059-3c9ef0984641 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:34.753197 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-0e57906e-9f29-47ff-9b03-7fbae828aec9 req-e29d6cfb-279f-45df-a059-3c9ef0984641 service nova] Creating event network-changed:f93b16c7-df1a-462b-be91-442aa008d850 for instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 on n-h2-862964-3 Oct 29 01:20:34.758238 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-0e57906e-9f29-47ff-9b03-7fbae828aec9 req-e29d6cfb-279f-45df-a059-3c9ef0984641 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030936 Oct 29 01:20:34.758845 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1885/3934] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:34.763910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a7634028-e327-40df-a34b-f0bea892fecd tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:34.764667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a7634028-e327-40df-a34b-f0bea892fecd tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:34.770843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7634028-e327-40df-a34b-f0bea892fecd tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:34.771330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7634028-e327-40df-a34b-f0bea892fecd tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:34.771851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7634028-e327-40df-a34b-f0bea892fecd tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:34.776605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7634028-e327-40df-a34b-f0bea892fecd tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:34.776605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7634028-e327-40df-a34b-f0bea892fecd tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:34.776605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7634028-e327-40df-a34b-f0bea892fecd tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:35.040617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-07a1dd92-74f0-45a2-a869-61a1ccc8b18b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:35.048756 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-07a1dd92-74f0-45a2-a869-61a1ccc8b18b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1317 microversion: 2.1 time: 0.400259 Oct 29 01:20:35.058047 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2050/3935] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:34 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:35.058047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7313aa51-d1c8-4cd4-9c33-136ec12e60f0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:35.058047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7313aa51-d1c8-4cd4-9c33-136ec12e60f0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:35.062065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7313aa51-d1c8-4cd4-9c33-136ec12e60f0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:35.062699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7313aa51-d1c8-4cd4-9c33-136ec12e60f0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:35.063264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7313aa51-d1c8-4cd4-9c33-136ec12e60f0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:35.064069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7313aa51-d1c8-4cd4-9c33-136ec12e60f0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:35.064919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7313aa51-d1c8-4cd4-9c33-136ec12e60f0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:35.065431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7313aa51-d1c8-4cd4-9c33-136ec12e60f0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:35.171573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a7634028-e327-40df-a34b-f0bea892fecd tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:35.182055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a7634028-e327-40df-a34b-f0bea892fecd tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:35.183650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a7634028-e327-40df-a34b-f0bea892fecd tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:35.185441 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a7634028-e327-40df-a34b-f0bea892fecd tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 2871 microversion: 2.42 time: 0.425480 Oct 29 01:20:35.186117 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1886/3936] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:34 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 2871 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:35.330289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-6516f445-b598-4dc1-b052-9c23bace8277 req-77ba0ddb-0c08-4440-b591-db1bd060eb7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0fc606-5d53-4e70-b087-22db406a68f8", "name": "network-vif-plugged", "status": "completed", "tag": "ee5981f8-c5ba-4a90-afb9-4849d919a97f"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:35.343442 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6516f445-b598-4dc1-b052-9c23bace8277 req-77ba0ddb-0c08-4440-b591-db1bd060eb7d service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:35.344070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6516f445-b598-4dc1-b052-9c23bace8277 req-77ba0ddb-0c08-4440-b591-db1bd060eb7d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:35.344866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6516f445-b598-4dc1-b052-9c23bace8277 req-77ba0ddb-0c08-4440-b591-db1bd060eb7d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:35.358840 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-6516f445-b598-4dc1-b052-9c23bace8277 req-77ba0ddb-0c08-4440-b591-db1bd060eb7d service nova] Creating event network-vif-plugged:ee5981f8-c5ba-4a90-afb9-4849d919a97f for instance 3d0fc606-5d53-4e70-b087-22db406a68f8 on n-h1-862964-3 Oct 29 01:20:35.364319 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-6516f445-b598-4dc1-b052-9c23bace8277 req-77ba0ddb-0c08-4440-b591-db1bd060eb7d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039442 Oct 29 01:20:35.365272 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1887/3937] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:20:35.448315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7313aa51-d1c8-4cd4-9c33-136ec12e60f0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:35.451879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:35.456917 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7313aa51-d1c8-4cd4-9c33-136ec12e60f0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8" status: 200 len: 1308 microversion: 2.1 time: 0.406505 Oct 29 01:20:35.457714 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2051/3938] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:35 2022] GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 => generated 1308 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:35.534086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9cfa4f08-0ecd-4a71-975d-8005e4608735 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:35.535195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9cfa4f08-0ecd-4a71-975d-8005e4608735 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:35.542596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9cfa4f08-0ecd-4a71-975d-8005e4608735 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:35.543327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9cfa4f08-0ecd-4a71-975d-8005e4608735 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:35.544209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9cfa4f08-0ecd-4a71-975d-8005e4608735 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:35.546021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9cfa4f08-0ecd-4a71-975d-8005e4608735 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:35.546852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9cfa4f08-0ecd-4a71-975d-8005e4608735 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:35.547786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9cfa4f08-0ecd-4a71-975d-8005e4608735 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:35.678016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8cb1ea14-4d1b-44de-8b73-b7fe6a7314c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:35.681108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8cb1ea14-4d1b-44de-8b73-b7fe6a7314c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:35.691214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cb1ea14-4d1b-44de-8b73-b7fe6a7314c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:35.692073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cb1ea14-4d1b-44de-8b73-b7fe6a7314c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:35.693078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cb1ea14-4d1b-44de-8b73-b7fe6a7314c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:35.695475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cb1ea14-4d1b-44de-8b73-b7fe6a7314c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:35.696993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cb1ea14-4d1b-44de-8b73-b7fe6a7314c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:35.697850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cb1ea14-4d1b-44de-8b73-b7fe6a7314c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:35.827024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9cfa4f08-0ecd-4a71-975d-8005e4608735 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:35.836055 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9cfa4f08-0ecd-4a71-975d-8005e4608735 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1309 microversion: 2.1 time: 0.306613 Oct 29 01:20:35.852861 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1888/3939] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:35 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1309 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:35.861785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b63646b6-f409-4787-82eb-228294148d36 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:35.862484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b63646b6-f409-4787-82eb-228294148d36 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:35.872636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:35.874425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b63646b6-f409-4787-82eb-228294148d36 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:35.875004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b63646b6-f409-4787-82eb-228294148d36 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:35.875516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b63646b6-f409-4787-82eb-228294148d36 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:35.876383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b63646b6-f409-4787-82eb-228294148d36 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:35.877707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b63646b6-f409-4787-82eb-228294148d36 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:35.878385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b63646b6-f409-4787-82eb-228294148d36 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:35.906769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:35.980598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b63646b6-f409-4787-82eb-228294148d36 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:35.990334 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b63646b6-f409-4787-82eb-228294148d36 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:35.993697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b63646b6-f409-4787-82eb-228294148d36 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:36.000345 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b63646b6-f409-4787-82eb-228294148d36 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.144572 Oct 29 01:20:36.007720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8cb1ea14-4d1b-44de-8b73-b7fe6a7314c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:36.016719 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1889/3940] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:35 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:36.016927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8cb1ea14-4d1b-44de-8b73-b7fe6a7314c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:36.018363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8cb1ea14-4d1b-44de-8b73-b7fe6a7314c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:36.019624 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8cb1ea14-4d1b-44de-8b73-b7fe6a7314c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.348442 Oct 29 01:20:36.020459 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2052/3941] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:35 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:36.078068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ba5a9888-df76-44c2-8578-0f382b3f41fc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:36.078916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ba5a9888-df76-44c2-8578-0f382b3f41fc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:36.088634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba5a9888-df76-44c2-8578-0f382b3f41fc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:36.093706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba5a9888-df76-44c2-8578-0f382b3f41fc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:36.093706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba5a9888-df76-44c2-8578-0f382b3f41fc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:36.093706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba5a9888-df76-44c2-8578-0f382b3f41fc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:36.093706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba5a9888-df76-44c2-8578-0f382b3f41fc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:36.093706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba5a9888-df76-44c2-8578-0f382b3f41fc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:36.220548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0f0dc572-a34e-4fa9-bce6-d05b43152ca6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:36.221206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0f0dc572-a34e-4fa9-bce6-d05b43152ca6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:36.228570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f0dc572-a34e-4fa9-bce6-d05b43152ca6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:36.229064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f0dc572-a34e-4fa9-bce6-d05b43152ca6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:36.229583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f0dc572-a34e-4fa9-bce6-d05b43152ca6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:36.231026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f0dc572-a34e-4fa9-bce6-d05b43152ca6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:36.231491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f0dc572-a34e-4fa9-bce6-d05b43152ca6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:36.232197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f0dc572-a34e-4fa9-bce6-d05b43152ca6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:36.398570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ba5a9888-df76-44c2-8578-0f382b3f41fc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:36.407183 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ba5a9888-df76-44c2-8578-0f382b3f41fc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1317 microversion: 2.1 time: 0.334860 Oct 29 01:20:36.407763 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1890/3942] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:36 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:36.482614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c7972132-ca59-4deb-973a-73f7cfd79566 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:36.483729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c7972132-ca59-4deb-973a-73f7cfd79566 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:36.491736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7972132-ca59-4deb-973a-73f7cfd79566 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:36.492509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7972132-ca59-4deb-973a-73f7cfd79566 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:36.496025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7972132-ca59-4deb-973a-73f7cfd79566 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:36.496025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7972132-ca59-4deb-973a-73f7cfd79566 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:36.496025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7972132-ca59-4deb-973a-73f7cfd79566 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:36.496025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7972132-ca59-4deb-973a-73f7cfd79566 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:36.496409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0f0dc572-a34e-4fa9-bce6-d05b43152ca6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:36.512168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0f0dc572-a34e-4fa9-bce6-d05b43152ca6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:36.514208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0f0dc572-a34e-4fa9-bce6-d05b43152ca6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:36.518663 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0f0dc572-a34e-4fa9-bce6-d05b43152ca6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 2710 microversion: 2.42 time: 0.300071 Oct 29 01:20:36.524136 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2053/3943] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:36 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 2710 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:20:36.584364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-645bef07-63ed-417a-8a77-5fa1895c9c5f req-5baefc83-8b43-4816-8367-83088fc6d383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "name": "network-vif-deleted", "tag": "e7524267-ec12-4093-8a7b-fe4b7e069f3a"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:36.595170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-645bef07-63ed-417a-8a77-5fa1895c9c5f req-5baefc83-8b43-4816-8367-83088fc6d383 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:36.595870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-645bef07-63ed-417a-8a77-5fa1895c9c5f req-5baefc83-8b43-4816-8367-83088fc6d383 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:36.596309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-645bef07-63ed-417a-8a77-5fa1895c9c5f req-5baefc83-8b43-4816-8367-83088fc6d383 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:36.609185 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-645bef07-63ed-417a-8a77-5fa1895c9c5f req-5baefc83-8b43-4816-8367-83088fc6d383 service nova] Creating event network-vif-deleted:e7524267-ec12-4093-8a7b-fe4b7e069f3a for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:20:36.614270 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-645bef07-63ed-417a-8a77-5fa1895c9c5f req-5baefc83-8b43-4816-8367-83088fc6d383 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033655 Oct 29 01:20:36.614880 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2054/3944] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:20:36.701342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:36.722488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c7972132-ca59-4deb-973a-73f7cfd79566 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:36.742172 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c7972132-ca59-4deb-973a-73f7cfd79566 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8" status: 200 len: 1308 microversion: 2.1 time: 0.262636 Oct 29 01:20:36.753843 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1891/3945] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:36 2022] GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 => generated 1308 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:36.860583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-44ac7b29-c660-476d-8abe-1f82de62aff0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:36.861844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-44ac7b29-c660-476d-8abe-1f82de62aff0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:36.869629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44ac7b29-c660-476d-8abe-1f82de62aff0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:36.870344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44ac7b29-c660-476d-8abe-1f82de62aff0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:36.870957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44ac7b29-c660-476d-8abe-1f82de62aff0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:36.872027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44ac7b29-c660-476d-8abe-1f82de62aff0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:36.872665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44ac7b29-c660-476d-8abe-1f82de62aff0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:36.873291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44ac7b29-c660-476d-8abe-1f82de62aff0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:37.030347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3dfc54d9-192c-467a-8011-c3d17907f47d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:37.031259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3dfc54d9-192c-467a-8011-c3d17907f47d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:37.041873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dfc54d9-192c-467a-8011-c3d17907f47d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:37.042764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dfc54d9-192c-467a-8011-c3d17907f47d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:37.048899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dfc54d9-192c-467a-8011-c3d17907f47d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:37.048899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dfc54d9-192c-467a-8011-c3d17907f47d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:37.048899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dfc54d9-192c-467a-8011-c3d17907f47d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:37.048899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3dfc54d9-192c-467a-8011-c3d17907f47d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:37.448897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3dfc54d9-192c-467a-8011-c3d17907f47d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:37.461454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3dfc54d9-192c-467a-8011-c3d17907f47d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:37.463347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3dfc54d9-192c-467a-8011-c3d17907f47d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a43d479af304be49d42098b90bb228d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '067ac836f982469a8701fcafb6fa6917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:37.469756 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3dfc54d9-192c-467a-8011-c3d17907f47d tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 200 len: 1535 microversion: 2.91 time: 0.444455 Oct 29 01:20:37.470909 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1892/3946] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:37 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 1535 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:20:37.486308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-45401d00-3b52-4194-bac7-2d84cb748b11 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:37.487185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-45401d00-3b52-4194-bac7-2d84cb748b11 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:37.493601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45401d00-3b52-4194-bac7-2d84cb748b11 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:37.494453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45401d00-3b52-4194-bac7-2d84cb748b11 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:37.495086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45401d00-3b52-4194-bac7-2d84cb748b11 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:37.496718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45401d00-3b52-4194-bac7-2d84cb748b11 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:37.497396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45401d00-3b52-4194-bac7-2d84cb748b11 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:37.497996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45401d00-3b52-4194-bac7-2d84cb748b11 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:37.640126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-44ac7b29-c660-476d-8abe-1f82de62aff0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:37.667777 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-44ac7b29-c660-476d-8abe-1f82de62aff0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1489 microversion: 2.1 time: 0.811350 Oct 29 01:20:37.669299 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2055/3947] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:36 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1489 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:37.676117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b9b7b414-6c9d-468e-96ba-cd77d2027c11 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:37.676727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b9b7b414-6c9d-468e-96ba-cd77d2027c11 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:37.684644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9b7b414-6c9d-468e-96ba-cd77d2027c11 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:37.685453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9b7b414-6c9d-468e-96ba-cd77d2027c11 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:37.691092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9b7b414-6c9d-468e-96ba-cd77d2027c11 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:37.691092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9b7b414-6c9d-468e-96ba-cd77d2027c11 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:37.691092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9b7b414-6c9d-468e-96ba-cd77d2027c11 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:37.691092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9b7b414-6c9d-468e-96ba-cd77d2027c11 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:37.944407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-45401d00-3b52-4194-bac7-2d84cb748b11 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:37.969297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-45401d00-3b52-4194-bac7-2d84cb748b11 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:37.974348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-45401d00-3b52-4194-bac7-2d84cb748b11 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:37.978208 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-45401d00-3b52-4194-bac7-2d84cb748b11 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.505579 Oct 29 01:20:37.980698 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1893/3948] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:37 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:37.996182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cc17562d-6f72-4020-8748-c73e51cf0c44 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:38.000259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cc17562d-6f72-4020-8748-c73e51cf0c44 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:38.015821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b9b7b414-6c9d-468e-96ba-cd77d2027c11 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:38.026680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc17562d-6f72-4020-8748-c73e51cf0c44 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:38.028044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc17562d-6f72-4020-8748-c73e51cf0c44 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:38.028418 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b9b7b414-6c9d-468e-96ba-cd77d2027c11 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1317 microversion: 2.1 time: 0.357253 Oct 29 01:20:38.029688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc17562d-6f72-4020-8748-c73e51cf0c44 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:38.031359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc17562d-6f72-4020-8748-c73e51cf0c44 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:38.033013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc17562d-6f72-4020-8748-c73e51cf0c44 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:38.034082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc17562d-6f72-4020-8748-c73e51cf0c44 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:38.042778 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2056/3949] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:37 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:38.052906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-32d8f4d9-9fac-46a3-9cc8-1f63a261859f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:38.055652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-32d8f4d9-9fac-46a3-9cc8-1f63a261859f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:38.064005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32d8f4d9-9fac-46a3-9cc8-1f63a261859f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:38.064497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32d8f4d9-9fac-46a3-9cc8-1f63a261859f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:38.064936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32d8f4d9-9fac-46a3-9cc8-1f63a261859f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:38.065671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32d8f4d9-9fac-46a3-9cc8-1f63a261859f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:38.066129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32d8f4d9-9fac-46a3-9cc8-1f63a261859f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:38.066557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32d8f4d9-9fac-46a3-9cc8-1f63a261859f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:38.283893 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-32d8f4d9-9fac-46a3-9cc8-1f63a261859f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "PUT /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1084 microversion: 2.1 time: 0.240097 Oct 29 01:20:38.285452 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2057/3950] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 29 01:20:38 2022] PUT /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1084 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:38.295076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7a0d37fd-536b-4c13-885f-819fa4019560 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:38.296685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7a0d37fd-536b-4c13-885f-819fa4019560 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:38.308460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a0d37fd-536b-4c13-885f-819fa4019560 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:38.309658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a0d37fd-536b-4c13-885f-819fa4019560 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:38.310685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a0d37fd-536b-4c13-885f-819fa4019560 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:38.312229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a0d37fd-536b-4c13-885f-819fa4019560 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:38.313338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a0d37fd-536b-4c13-885f-819fa4019560 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:38.314354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a0d37fd-536b-4c13-885f-819fa4019560 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:38.344312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cc17562d-6f72-4020-8748-c73e51cf0c44 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:38.364740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cc17562d-6f72-4020-8748-c73e51cf0c44 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:38.364740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cc17562d-6f72-4020-8748-c73e51cf0c44 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:38.364740 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cc17562d-6f72-4020-8748-c73e51cf0c44 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 2549 microversion: 2.42 time: 0.381119 Oct 29 01:20:38.364740 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1894/3951] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:37 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 2549 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:38.387136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ca09ad80-765c-438d-9acb-01c568b60b6b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:38.388179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ca09ad80-765c-438d-9acb-01c568b60b6b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:38.396484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca09ad80-765c-438d-9acb-01c568b60b6b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:38.397382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca09ad80-765c-438d-9acb-01c568b60b6b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:38.398845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca09ad80-765c-438d-9acb-01c568b60b6b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:38.399948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca09ad80-765c-438d-9acb-01c568b60b6b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:38.400581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca09ad80-765c-438d-9acb-01c568b60b6b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:38.401195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca09ad80-765c-438d-9acb-01c568b60b6b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:38.563285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7a0d37fd-536b-4c13-885f-819fa4019560 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:38.575168 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7a0d37fd-536b-4c13-885f-819fa4019560 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8" status: 200 len: 1489 microversion: 2.1 time: 0.288005 Oct 29 01:20:38.577672 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2058/3952] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:38 2022] GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 => generated 1489 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:38.595220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ca09ad80-765c-438d-9acb-01c568b60b6b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:38.597463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-86781b0d-e4db-4fc7-b765-1ea4e7702a20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:38.598280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-86781b0d-e4db-4fc7-b765-1ea4e7702a20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] [instance: 6e3a11cb-1999-468d-858f-dd5eb0fc275a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:38.606131 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ca09ad80-765c-438d-9acb-01c568b60b6b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1510 microversion: 2.1 time: 0.222737 Oct 29 01:20:38.607195 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1895/3953] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:38 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1510 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:38.607820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86781b0d-e4db-4fc7-b765-1ea4e7702a20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:38.608484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86781b0d-e4db-4fc7-b765-1ea4e7702a20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:38.609363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86781b0d-e4db-4fc7-b765-1ea4e7702a20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:38.611120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86781b0d-e4db-4fc7-b765-1ea4e7702a20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:38.611752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86781b0d-e4db-4fc7-b765-1ea4e7702a20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:38.612225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-55ae104e-1e86-4b18-89aa-5c29c406a1b8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-400301631"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:38.613114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86781b0d-e4db-4fc7-b765-1ea4e7702a20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:38.614902 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-55ae104e-1e86-4b18-89aa-5c29c406a1b8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:38.626570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55ae104e-1e86-4b18-89aa-5c29c406a1b8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:38.627081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55ae104e-1e86-4b18-89aa-5c29c406a1b8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:38.627526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55ae104e-1e86-4b18-89aa-5c29c406a1b8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:38.628419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55ae104e-1e86-4b18-89aa-5c29c406a1b8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:38.628872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55ae104e-1e86-4b18-89aa-5c29c406a1b8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:38.634961 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-86781b0d-e4db-4fc7-b765-1ea4e7702a20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] HTTP exception thrown: Instance 6e3a11cb-1999-468d-858f-dd5eb0fc275a could not be found. Oct 29 01:20:38.635460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55ae104e-1e86-4b18-89aa-5c29c406a1b8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-86781b0d-e4db-4fc7-b765-1ea4e7702a20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Request method failure captured: Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a HTTP/1.1 Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8Mp93ffHL2i6DTVAlOPQZGQiu6TNQYD_nTnnbxi--CBvivWDim2jzrc95oSTpMqeMOHi5VuT4Hmao1k42af4Ea4w0t-bbuWe86R3wqAC-V8qY0_BapA6SsQBGFa33XjmXKupHjeflH9jl-AfbSLKR7OHdYw5so4RIKPmZLIr8c2UQ Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.91 Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 067ac836f982469a8701fcafb6fa6917 Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-277383388 Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/067ac836f982469a8701fcafb6fa6917"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/067ac836f982469a8701fcafb6fa6917"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/067ac836f982469a8701fcafb6fa6917"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_067ac836f982469a8701fcafb6fa6917", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-277383388 Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 067ac836f982469a8701fcafb6fa6917 Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-277383388 Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-UnshelveToHostMultiNodesTest-277383388-project Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6a43d479af304be49d42098b90bb228d Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-277383388-project Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 6e3a11cb-1999-468d-858f-dd5eb0fc275a could not be found. Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '6e3a11cb-1999-468d-858f-dd5eb0fc275a'} Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e3a11cb-1999-468d-858f-dd5eb0fc275a could not be found. Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e3a11cb-1999-468d-858f-dd5eb0fc275a could not be found. Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:20:38.637799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:20:38.643780 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:20:38.643780 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:20:38.643780 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:20:38.643780 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:20:38.643780 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:20:38.643780 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:20:38.643780 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e3a11cb-1999-468d-858f-dd5eb0fc275a could not be found. Oct 29 01:20:38.643780 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:20:38.643780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-86781b0d-e4db-4fc7-b765-1ea4e7702a20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] Returning 404 to user: Instance 6e3a11cb-1999-468d-858f-dd5eb0fc275a could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:20:38.643780 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-86781b0d-e4db-4fc7-b765-1ea4e7702a20 tempest-UnshelveToHostMultiNodesTest-277383388 tempest-UnshelveToHostMultiNodesTest-277383388-project] 10.222.0.26 "GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a" status: 404 len: 111 microversion: 2.91 time: 0.060350 Oct 29 01:20:38.643780 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2059/3954] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:38 2022] GET /compute/v2.1/servers/6e3a11cb-1999-468d-858f-dd5eb0fc275a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:20:38.650426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7132c2a6-4b1f-489b-bd0c-e50f61aecb78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:38.652837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7132c2a6-4b1f-489b-bd0c-e50f61aecb78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:38.658464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7132c2a6-4b1f-489b-bd0c-e50f61aecb78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:38.658987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7132c2a6-4b1f-489b-bd0c-e50f61aecb78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:38.659576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7132c2a6-4b1f-489b-bd0c-e50f61aecb78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:38.660290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7132c2a6-4b1f-489b-bd0c-e50f61aecb78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:38.660745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7132c2a6-4b1f-489b-bd0c-e50f61aecb78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:38.661180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7132c2a6-4b1f-489b-bd0c-e50f61aecb78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:38.879748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7132c2a6-4b1f-489b-bd0c-e50f61aecb78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:38.888055 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7132c2a6-4b1f-489b-bd0c-e50f61aecb78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1510 microversion: 2.1 time: 0.243812 Oct 29 01:20:38.888829 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2060/3955] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:38 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1510 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:38.893301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-a68e6d0b-53b4-442a-9651-349bf5ec07e2 req-f6f22bfb-176c-47ae-962e-3f377f13cfdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "name": "network-vif-deleted", "tag": "1848d527-bac1-41c8-956e-7737379b67ca"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:38.902910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a68e6d0b-53b4-442a-9651-349bf5ec07e2 req-f6f22bfb-176c-47ae-962e-3f377f13cfdd service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:38.903386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a68e6d0b-53b4-442a-9651-349bf5ec07e2 req-f6f22bfb-176c-47ae-962e-3f377f13cfdd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:38.904020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a68e6d0b-53b4-442a-9651-349bf5ec07e2 req-f6f22bfb-176c-47ae-962e-3f377f13cfdd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:38.916466 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-a68e6d0b-53b4-442a-9651-349bf5ec07e2 req-f6f22bfb-176c-47ae-962e-3f377f13cfdd service nova] Creating event network-vif-deleted:1848d527-bac1-41c8-956e-7737379b67ca for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:20:38.921768 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-a68e6d0b-53b4-442a-9651-349bf5ec07e2 req-f6f22bfb-176c-47ae-962e-3f377f13cfdd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031868 Oct 29 01:20:38.924112 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2061/3956] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:38.928166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-07197dd2-c407-4d09-acea-06222c0c73ef tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:38.929287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-07197dd2-c407-4d09-acea-06222c0c73ef tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:38.935439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07197dd2-c407-4d09-acea-06222c0c73ef tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:38.935911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07197dd2-c407-4d09-acea-06222c0c73ef tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:38.936351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07197dd2-c407-4d09-acea-06222c0c73ef tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:38.937046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07197dd2-c407-4d09-acea-06222c0c73ef tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:38.937529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07197dd2-c407-4d09-acea-06222c0c73ef tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:38.937959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07197dd2-c407-4d09-acea-06222c0c73ef tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:38.965087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-07197dd2-c407-4d09-acea-06222c0c73ef tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:20:39.215510 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-55ae104e-1e86-4b18-89aa-5c29c406a1b8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "POST /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8/action" status: 202 len: 0 microversion: 2.1 time: 0.606739 Oct 29 01:20:39.217335 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1896/3957] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:20:38 2022] POST /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8/action => generated 0 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 01:20:39.222898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9be74225-8d1b-4961-9aab-d2d65c3b9267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:39.223828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9be74225-8d1b-4961-9aab-d2d65c3b9267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:39.231955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9be74225-8d1b-4961-9aab-d2d65c3b9267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:39.232459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9be74225-8d1b-4961-9aab-d2d65c3b9267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:39.233331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9be74225-8d1b-4961-9aab-d2d65c3b9267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:39.234461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9be74225-8d1b-4961-9aab-d2d65c3b9267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:39.234932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9be74225-8d1b-4961-9aab-d2d65c3b9267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:39.235352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9be74225-8d1b-4961-9aab-d2d65c3b9267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:39.321899 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-07197dd2-c407-4d09-acea-06222c0c73ef tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 204 len: 0 microversion: 2.1 time: 0.397749 Oct 29 01:20:39.322937 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2062/3958] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:20:38 2022] DELETE /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:20:39.331406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-591f69e9-cef2-4c21-90ea-70a8988af47f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:39.335215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-591f69e9-cef2-4c21-90ea-70a8988af47f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:39.341584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-591f69e9-cef2-4c21-90ea-70a8988af47f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:39.342077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-591f69e9-cef2-4c21-90ea-70a8988af47f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:39.342518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-591f69e9-cef2-4c21-90ea-70a8988af47f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:39.343227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-591f69e9-cef2-4c21-90ea-70a8988af47f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:39.343863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-591f69e9-cef2-4c21-90ea-70a8988af47f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:39.344301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-591f69e9-cef2-4c21-90ea-70a8988af47f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:39.629875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9be74225-8d1b-4961-9aab-d2d65c3b9267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:39.643648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9be74225-8d1b-4961-9aab-d2d65c3b9267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:39.645679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9be74225-8d1b-4961-9aab-d2d65c3b9267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:39.646919 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9be74225-8d1b-4961-9aab-d2d65c3b9267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.429250 Oct 29 01:20:39.647832 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1897/3959] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:39 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:39.655588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-591f69e9-cef2-4c21-90ea-70a8988af47f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:39.670567 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-591f69e9-cef2-4c21-90ea-70a8988af47f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1317 microversion: 2.1 time: 0.345369 Oct 29 01:20:39.671387 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2063/3960] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:39 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:39.671711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-38b3f701-232d-4de3-b528-d09aeee81e20 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9fd679d0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:39.691299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-66f46f8f-305d-48ff-8a90-efc35c68121b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:39.692903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-66f46f8f-305d-48ff-8a90-efc35c68121b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:39.700649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66f46f8f-305d-48ff-8a90-efc35c68121b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:39.701392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66f46f8f-305d-48ff-8a90-efc35c68121b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:39.702388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66f46f8f-305d-48ff-8a90-efc35c68121b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:39.703200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66f46f8f-305d-48ff-8a90-efc35c68121b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:39.703773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66f46f8f-305d-48ff-8a90-efc35c68121b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:39.704298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66f46f8f-305d-48ff-8a90-efc35c68121b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:39.723956 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-38b3f701-232d-4de3-b528-d09aeee81e20 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.060886 Oct 29 01:20:39.725891 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1898/3961] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:20:39 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:39.740982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3de97b95-e0cd-4890-9f75-013e647aa642 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:39.740982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3de97b95-e0cd-4890-9f75-013e647aa642 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:39.740982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3de97b95-e0cd-4890-9f75-013e647aa642 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:39.740982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3de97b95-e0cd-4890-9f75-013e647aa642 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:39.740982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3de97b95-e0cd-4890-9f75-013e647aa642 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:39.740982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3de97b95-e0cd-4890-9f75-013e647aa642 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:39.740982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3de97b95-e0cd-4890-9f75-013e647aa642 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:39.740982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3de97b95-e0cd-4890-9f75-013e647aa642 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:40.005649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-66f46f8f-305d-48ff-8a90-efc35c68121b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:40.014472 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-66f46f8f-305d-48ff-8a90-efc35c68121b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1516 microversion: 2.1 time: 0.341667 Oct 29 01:20:40.015052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3de97b95-e0cd-4890-9f75-013e647aa642 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:40.018980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:40.026809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3de97b95-e0cd-4890-9f75-013e647aa642 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:40.028396 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2064/3962] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:39 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1516 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:40.028866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3de97b95-e0cd-4890-9f75-013e647aa642 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:40.030354 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3de97b95-e0cd-4890-9f75-013e647aa642 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 2549 microversion: 2.42 time: 0.303056 Oct 29 01:20:40.031103 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1899/3963] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:39 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 2549 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:40.684799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1ac5c0cb-8d66-4e27-93b2-7f7f8df3bbaa tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:40.687918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1ac5c0cb-8d66-4e27-93b2-7f7f8df3bbaa tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:40.700700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:40.705609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ac5c0cb-8d66-4e27-93b2-7f7f8df3bbaa tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:40.706535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-96cd6a54-48ea-4234-a3bb-0be023c35126 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:40.707166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-96cd6a54-48ea-4234-a3bb-0be023c35126 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:40.707315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ac5c0cb-8d66-4e27-93b2-7f7f8df3bbaa tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:40.709935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ac5c0cb-8d66-4e27-93b2-7f7f8df3bbaa tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:40.713507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ac5c0cb-8d66-4e27-93b2-7f7f8df3bbaa tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:40.713507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ac5c0cb-8d66-4e27-93b2-7f7f8df3bbaa tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:40.713507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ac5c0cb-8d66-4e27-93b2-7f7f8df3bbaa tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:40.720295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96cd6a54-48ea-4234-a3bb-0be023c35126 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:40.720781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96cd6a54-48ea-4234-a3bb-0be023c35126 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:40.721266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96cd6a54-48ea-4234-a3bb-0be023c35126 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:40.722077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96cd6a54-48ea-4234-a3bb-0be023c35126 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:40.722805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96cd6a54-48ea-4234-a3bb-0be023c35126 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:40.723206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96cd6a54-48ea-4234-a3bb-0be023c35126 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:41.204073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-96cd6a54-48ea-4234-a3bb-0be023c35126 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:41.215414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ac5c0cb-8d66-4e27-93b2-7f7f8df3bbaa tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:41.222270 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-96cd6a54-48ea-4234-a3bb-0be023c35126 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1317 microversion: 2.1 time: 0.526175 Oct 29 01:20:41.223269 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1900/3964] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:40 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:41.236486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6835af2f-7bd4-4cbc-80e5-d8d74489672b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97198a60>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:41.243254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ac5c0cb-8d66-4e27-93b2-7f7f8df3bbaa tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:41.245790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ac5c0cb-8d66-4e27-93b2-7f7f8df3bbaa tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:41.247454 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1ac5c0cb-8d66-4e27-93b2-7f7f8df3bbaa tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.575278 Oct 29 01:20:41.248456 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2065/3965] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:40 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:41.254019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-df801831-8bb8-4ef2-bf4f-2c5a869bb264 req-6d7588fd-4dae-4f4a-9e80-7cb7654549e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "name": "network-vif-deleted", "tag": "913a07b9-ad16-4d31-879a-a34b9897edf8"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:41.277884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-df801831-8bb8-4ef2-bf4f-2c5a869bb264 req-6d7588fd-4dae-4f4a-9e80-7cb7654549e8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:41.278710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-df801831-8bb8-4ef2-bf4f-2c5a869bb264 req-6d7588fd-4dae-4f4a-9e80-7cb7654549e8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:41.279278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-df801831-8bb8-4ef2-bf4f-2c5a869bb264 req-6d7588fd-4dae-4f4a-9e80-7cb7654549e8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:41.317907 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-df801831-8bb8-4ef2-bf4f-2c5a869bb264 req-6d7588fd-4dae-4f4a-9e80-7cb7654549e8 service nova] Creating event network-vif-deleted:913a07b9-ad16-4d31-879a-a34b9897edf8 for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:20:41.323603 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6835af2f-7bd4-4cbc-80e5-d8d74489672b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.098963 Oct 29 01:20:41.325071 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1901/3966] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:20:41 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:41.326198 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-df801831-8bb8-4ef2-bf4f-2c5a869bb264 req-6d7588fd-4dae-4f4a-9e80-7cb7654549e8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075835 Oct 29 01:20:41.327352 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2066/3967] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:41.332660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eba6be1c-b4f4-4be0-bf82-48067a32ba55 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:41.339619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eba6be1c-b4f4-4be0-bf82-48067a32ba55 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:41.339798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3046c09b-206b-4515-aee0-f070368389f9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:41.339798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3046c09b-206b-4515-aee0-f070368389f9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:41.340843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eba6be1c-b4f4-4be0-bf82-48067a32ba55 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:41.341457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eba6be1c-b4f4-4be0-bf82-48067a32ba55 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:41.341991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eba6be1c-b4f4-4be0-bf82-48067a32ba55 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:41.342817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eba6be1c-b4f4-4be0-bf82-48067a32ba55 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:41.343366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eba6be1c-b4f4-4be0-bf82-48067a32ba55 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:41.343883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eba6be1c-b4f4-4be0-bf82-48067a32ba55 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:41.353013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3046c09b-206b-4515-aee0-f070368389f9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:41.355435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3046c09b-206b-4515-aee0-f070368389f9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:41.357495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3046c09b-206b-4515-aee0-f070368389f9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:41.360202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3046c09b-206b-4515-aee0-f070368389f9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:41.360920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3046c09b-206b-4515-aee0-f070368389f9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:41.362419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3046c09b-206b-4515-aee0-f070368389f9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:41.790967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eba6be1c-b4f4-4be0-bf82-48067a32ba55 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:41.822302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eba6be1c-b4f4-4be0-bf82-48067a32ba55 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:41.826236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eba6be1c-b4f4-4be0-bf82-48067a32ba55 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:41.829906 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eba6be1c-b4f4-4be0-bf82-48067a32ba55 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 2345 microversion: 2.42 time: 0.501112 Oct 29 01:20:41.834798 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2067/3968] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:41 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 2345 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:41.846329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3046c09b-206b-4515-aee0-f070368389f9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:41.861436 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3046c09b-206b-4515-aee0-f070368389f9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1516 microversion: 2.1 time: 0.535099 Oct 29 01:20:41.862719 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1902/3969] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:41 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1516 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:42.247247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-89ddcd16-3703-4b0c-8802-e8e97f603219 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:42.247791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-89ddcd16-3703-4b0c-8802-e8e97f603219 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:42.255263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89ddcd16-3703-4b0c-8802-e8e97f603219 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:42.255756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89ddcd16-3703-4b0c-8802-e8e97f603219 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:42.256215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89ddcd16-3703-4b0c-8802-e8e97f603219 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:42.256959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89ddcd16-3703-4b0c-8802-e8e97f603219 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:42.257468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89ddcd16-3703-4b0c-8802-e8e97f603219 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:42.257900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89ddcd16-3703-4b0c-8802-e8e97f603219 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:42.279801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f9a20b83-aad8-4e30-b040-b548f4561520 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:42.280416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f9a20b83-aad8-4e30-b040-b548f4561520 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:42.286893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9a20b83-aad8-4e30-b040-b548f4561520 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:42.287478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9a20b83-aad8-4e30-b040-b548f4561520 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:42.288128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9a20b83-aad8-4e30-b040-b548f4561520 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:42.289930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9a20b83-aad8-4e30-b040-b548f4561520 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:42.297030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9a20b83-aad8-4e30-b040-b548f4561520 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:42.297030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9a20b83-aad8-4e30-b040-b548f4561520 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:43.040135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f9a20b83-aad8-4e30-b040-b548f4561520 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:43.056624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f9a20b83-aad8-4e30-b040-b548f4561520 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:43.058465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f9a20b83-aad8-4e30-b040-b548f4561520 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:43.062033 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f9a20b83-aad8-4e30-b040-b548f4561520 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.786431 Oct 29 01:20:43.063774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-89ddcd16-3703-4b0c-8802-e8e97f603219 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:43.064751 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1903/3970] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:42 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:20:43.070951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-caeab75a-7de2-40ba-ada0-f387b17ce504 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d971b6550>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:43.099214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:43.136027 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-89ddcd16-3703-4b0c-8802-e8e97f603219 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1317 microversion: 2.1 time: 0.892724 Oct 29 01:20:43.138268 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2068/3971] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:42 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1317 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:43.145281 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-caeab75a-7de2-40ba-ada0-f387b17ce504 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.079131 Oct 29 01:20:43.146135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a2ba5090-97ac-4d39-8566-baa9a1851e17 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:43.147706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a2ba5090-97ac-4d39-8566-baa9a1851e17 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:43.156517 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1904/3972] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:20:43 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:43.160971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2ba5090-97ac-4d39-8566-baa9a1851e17 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:43.164849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2ba5090-97ac-4d39-8566-baa9a1851e17 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:43.164849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2ba5090-97ac-4d39-8566-baa9a1851e17 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:43.164849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2ba5090-97ac-4d39-8566-baa9a1851e17 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:43.164849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2ba5090-97ac-4d39-8566-baa9a1851e17 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:43.168671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2ba5090-97ac-4d39-8566-baa9a1851e17 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:43.175030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c26c5132-8d0a-4579-99f6-dfe4719d5e1c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:43.175661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c26c5132-8d0a-4579-99f6-dfe4719d5e1c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:43.189960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c26c5132-8d0a-4579-99f6-dfe4719d5e1c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:43.190463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c26c5132-8d0a-4579-99f6-dfe4719d5e1c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:43.191099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c26c5132-8d0a-4579-99f6-dfe4719d5e1c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:43.191827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c26c5132-8d0a-4579-99f6-dfe4719d5e1c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:43.192318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c26c5132-8d0a-4579-99f6-dfe4719d5e1c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:43.193298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c26c5132-8d0a-4579-99f6-dfe4719d5e1c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:43.343977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a2ba5090-97ac-4d39-8566-baa9a1851e17 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:43.354574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a2ba5090-97ac-4d39-8566-baa9a1851e17 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:43.356520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a2ba5090-97ac-4d39-8566-baa9a1851e17 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:43.358220 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a2ba5090-97ac-4d39-8566-baa9a1851e17 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 2164 microversion: 2.42 time: 0.217645 Oct 29 01:20:43.358643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c26c5132-8d0a-4579-99f6-dfe4719d5e1c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:43.367328 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c26c5132-8d0a-4579-99f6-dfe4719d5e1c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 200 len: 1474 microversion: 2.1 time: 0.203201 Oct 29 01:20:43.373550 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2069/3973] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:43 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 2164 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:43.386077 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1905/3974] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:43 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 1474 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:43.390940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-146d0af0-d29e-48ec-82e9-404c900f8b0e req-2a4e4bb9-65a3-45d9-a1e0-cf01b2642af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7", "name": "network-vif-deleted", "tag": "a4e47f26-496b-432f-a8b8-bea4884fce92"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:43.402887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-146d0af0-d29e-48ec-82e9-404c900f8b0e req-2a4e4bb9-65a3-45d9-a1e0-cf01b2642af2 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:43.403366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-146d0af0-d29e-48ec-82e9-404c900f8b0e req-2a4e4bb9-65a3-45d9-a1e0-cf01b2642af2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:43.403800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-146d0af0-d29e-48ec-82e9-404c900f8b0e req-2a4e4bb9-65a3-45d9-a1e0-cf01b2642af2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:43.434624 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-146d0af0-d29e-48ec-82e9-404c900f8b0e req-2a4e4bb9-65a3-45d9-a1e0-cf01b2642af2 service nova] Creating event network-vif-deleted:a4e47f26-496b-432f-a8b8-bea4884fce92 for instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 on n-h1-862964-3 Oct 29 01:20:43.439923 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-146d0af0-d29e-48ec-82e9-404c900f8b0e req-2a4e4bb9-65a3-45d9-a1e0-cf01b2642af2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052828 Oct 29 01:20:43.448000 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2070/3975] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:20:44.107314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d45a3d64-f8f1-492a-aac4-23c27833d4d7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:44.109711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d45a3d64-f8f1-492a-aac4-23c27833d4d7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:44.142067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d45a3d64-f8f1-492a-aac4-23c27833d4d7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:44.142875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d45a3d64-f8f1-492a-aac4-23c27833d4d7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:44.145348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d45a3d64-f8f1-492a-aac4-23c27833d4d7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:44.146357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d45a3d64-f8f1-492a-aac4-23c27833d4d7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:44.148301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d45a3d64-f8f1-492a-aac4-23c27833d4d7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:44.149564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d45a3d64-f8f1-492a-aac4-23c27833d4d7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:44.171985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ee12d053-dd44-47f0-972a-a39dd9a4878a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9c761790>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:44.274476 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ee12d053-dd44-47f0-972a-a39dd9a4878a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.114500 Oct 29 01:20:44.276294 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2071/3976] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:20:44 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:44.291732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-548fd264-490e-4451-8748-fe7ba53e62dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:44.294784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-548fd264-490e-4451-8748-fe7ba53e62dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:44.314799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-548fd264-490e-4451-8748-fe7ba53e62dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:44.315530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-548fd264-490e-4451-8748-fe7ba53e62dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:44.315997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-548fd264-490e-4451-8748-fe7ba53e62dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:44.316769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-548fd264-490e-4451-8748-fe7ba53e62dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:44.317269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-548fd264-490e-4451-8748-fe7ba53e62dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:44.321600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-548fd264-490e-4451-8748-fe7ba53e62dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:44.854090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d45a3d64-f8f1-492a-aac4-23c27833d4d7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:44.867670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d45a3d64-f8f1-492a-aac4-23c27833d4d7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:44.869175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d45a3d64-f8f1-492a-aac4-23c27833d4d7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:44.878969 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d45a3d64-f8f1-492a-aac4-23c27833d4d7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.782321 Oct 29 01:20:44.879533 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1906/3977] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:44 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:44.900951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-81e24b3d-d2cf-4b7f-9457-d07dcf50aa14 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:44.904025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-81e24b3d-d2cf-4b7f-9457-d07dcf50aa14 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:44.920612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81e24b3d-d2cf-4b7f-9457-d07dcf50aa14 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:44.921128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81e24b3d-d2cf-4b7f-9457-d07dcf50aa14 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:44.921818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81e24b3d-d2cf-4b7f-9457-d07dcf50aa14 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:44.922823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81e24b3d-d2cf-4b7f-9457-d07dcf50aa14 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:44.930443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81e24b3d-d2cf-4b7f-9457-d07dcf50aa14 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:44.936062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81e24b3d-d2cf-4b7f-9457-d07dcf50aa14 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:44.944440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-548fd264-490e-4451-8748-fe7ba53e62dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:44.956438 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-548fd264-490e-4451-8748-fe7ba53e62dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1317 microversion: 2.1 time: 0.678785 Oct 29 01:20:44.969467 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2072/3978] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:44 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1317 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:44.981434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ba0da361-2179-41a5-9d5b-cf901694dbb9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:44.982212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ba0da361-2179-41a5-9d5b-cf901694dbb9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:45.005495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba0da361-2179-41a5-9d5b-cf901694dbb9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:45.005995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba0da361-2179-41a5-9d5b-cf901694dbb9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:45.007872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba0da361-2179-41a5-9d5b-cf901694dbb9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:45.008694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba0da361-2179-41a5-9d5b-cf901694dbb9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:45.009192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba0da361-2179-41a5-9d5b-cf901694dbb9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:45.009746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba0da361-2179-41a5-9d5b-cf901694dbb9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:45.044823 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-ba0da361-2179-41a5-9d5b-cf901694dbb9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 could not be found. Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ba0da361-2179-41a5-9d5b-cf901694dbb9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 HTTP/1.1 Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 could not be found. Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7'} Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 could not be found. Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 could not be found. Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:20:45.046569 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:20:45.052492 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:20:45.052492 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:20:45.052492 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:20:45.052492 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:20:45.052492 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:20:45.052492 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 could not be found. Oct 29 01:20:45.052492 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:20:45.052492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ba0da361-2179-41a5-9d5b-cf901694dbb9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:20:45.052492 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ba0da361-2179-41a5-9d5b-cf901694dbb9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 404 len: 111 microversion: 2.1 time: 0.087135 Oct 29 01:20:45.057576 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2073/3979] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:44 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:20:45.066314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-2113c941-73f1-4c80-87c4-4b826775c39e req-2307eeb3-7c51-4587-b41a-b1d1a081701f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63371d26-fe85-4cfa-bdca-c8ad84b81ee6", "name": "network-vif-plugged", "status": "completed", "tag": "f93b16c7-df1a-462b-be91-442aa008d850"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:45.092048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2113c941-73f1-4c80-87c4-4b826775c39e req-2307eeb3-7c51-4587-b41a-b1d1a081701f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:45.092546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2113c941-73f1-4c80-87c4-4b826775c39e req-2307eeb3-7c51-4587-b41a-b1d1a081701f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:45.092990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2113c941-73f1-4c80-87c4-4b826775c39e req-2307eeb3-7c51-4587-b41a-b1d1a081701f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:45.123104 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-2113c941-73f1-4c80-87c4-4b826775c39e req-2307eeb3-7c51-4587-b41a-b1d1a081701f service nova] Creating event network-vif-plugged:f93b16c7-df1a-462b-be91-442aa008d850 for instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 on n-h2-862964-3 Oct 29 01:20:45.124165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-81e24b3d-d2cf-4b7f-9457-d07dcf50aa14 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:45.128722 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-2113c941-73f1-4c80-87c4-4b826775c39e req-2307eeb3-7c51-4587-b41a-b1d1a081701f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069713 Oct 29 01:20:45.131952 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2074/3980] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:45.143258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-81e24b3d-d2cf-4b7f-9457-d07dcf50aa14 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:45.152383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-81e24b3d-d2cf-4b7f-9457-d07dcf50aa14 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:45.156298 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-81e24b3d-d2cf-4b7f-9457-d07dcf50aa14 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.272980 Oct 29 01:20:45.157468 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1907/3981] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:44 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:45.294400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-000d4e1b-7e41-4eb5-a6d9-aa4fa2d34cea tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96e93ee0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:45.323268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-abf6dcd3-2a40-4d3f-b9fd-76d5e537ad0f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1538742670", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "b5b62219-8a2f-42eb-b795-dd5a026e1972"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:45.415747 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-000d4e1b-7e41-4eb5-a6d9-aa4fa2d34cea tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.127322 Oct 29 01:20:45.426065 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2075/3982] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:20:45 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:45.446918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-abf6dcd3-2a40-4d3f-b9fd-76d5e537ad0f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] validate_networks() for [('b5b62219-8a2f-42eb-b795-dd5a026e1972', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:20:45.520221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-31cb14e0-c1b0-410c-bf0e-937820618fcb req-8fc53bed-3234-41a6-8271-03dd32538309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3345ee8-a785-4802-a558-b6880b949635", "name": "network-vif-deleted", "tag": "d00f19cc-89ea-4719-aa7c-b9d320f81a37"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:45.542982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-31cb14e0-c1b0-410c-bf0e-937820618fcb req-8fc53bed-3234-41a6-8271-03dd32538309 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:45.545685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-31cb14e0-c1b0-410c-bf0e-937820618fcb req-8fc53bed-3234-41a6-8271-03dd32538309 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:45.546416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-31cb14e0-c1b0-410c-bf0e-937820618fcb req-8fc53bed-3234-41a6-8271-03dd32538309 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:45.576988 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-31cb14e0-c1b0-410c-bf0e-937820618fcb req-8fc53bed-3234-41a6-8271-03dd32538309 service nova] Creating event network-vif-deleted:d00f19cc-89ea-4719-aa7c-b9d320f81a37 for instance b3345ee8-a785-4802-a558-b6880b949635 on n-h2-862964-3 Oct 29 01:20:45.585322 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-31cb14e0-c1b0-410c-bf0e-937820618fcb req-8fc53bed-3234-41a6-8271-03dd32538309 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068605 Oct 29 01:20:45.591407 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2076/3983] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:45.916893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-450f7c8a-1300-4a8f-8221-9cc68f88d0b7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:45.917965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-450f7c8a-1300-4a8f-8221-9cc68f88d0b7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:45.933435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-450f7c8a-1300-4a8f-8221-9cc68f88d0b7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:45.935045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-450f7c8a-1300-4a8f-8221-9cc68f88d0b7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:45.936271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-450f7c8a-1300-4a8f-8221-9cc68f88d0b7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:45.937807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-450f7c8a-1300-4a8f-8221-9cc68f88d0b7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:45.938671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-450f7c8a-1300-4a8f-8221-9cc68f88d0b7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:45.939427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-450f7c8a-1300-4a8f-8221-9cc68f88d0b7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:46.545005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-450f7c8a-1300-4a8f-8221-9cc68f88d0b7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:46.560180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-450f7c8a-1300-4a8f-8221-9cc68f88d0b7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:46.567976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-450f7c8a-1300-4a8f-8221-9cc68f88d0b7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:46.570361 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-450f7c8a-1300-4a8f-8221-9cc68f88d0b7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.664007 Oct 29 01:20:46.572581 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2077/3984] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:45 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:20:46.585039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b1bc06aa-b469-4843-91f4-1a4a70e32fa3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:46.589934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b1bc06aa-b469-4843-91f4-1a4a70e32fa3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:46.599510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1bc06aa-b469-4843-91f4-1a4a70e32fa3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:46.600363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1bc06aa-b469-4843-91f4-1a4a70e32fa3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:46.601030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1bc06aa-b469-4843-91f4-1a4a70e32fa3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:46.602421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1bc06aa-b469-4843-91f4-1a4a70e32fa3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:46.603078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1bc06aa-b469-4843-91f4-1a4a70e32fa3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:46.603706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1bc06aa-b469-4843-91f4-1a4a70e32fa3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:47.136790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b1bc06aa-b469-4843-91f4-1a4a70e32fa3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:47.145342 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b1bc06aa-b469-4843-91f4-1a4a70e32fa3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1317 microversion: 2.1 time: 0.570979 Oct 29 01:20:47.145952 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2078/3985] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:46 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:47.165182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5b08853b-5661-4f60-b999-f7d9f7325b26 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:47.165182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5b08853b-5661-4f60-b999-f7d9f7325b26 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:47.170645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b08853b-5661-4f60-b999-f7d9f7325b26 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:47.171435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b08853b-5661-4f60-b999-f7d9f7325b26 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:47.171988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b08853b-5661-4f60-b999-f7d9f7325b26 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:47.173070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b08853b-5661-4f60-b999-f7d9f7325b26 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:47.173676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b08853b-5661-4f60-b999-f7d9f7325b26 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:47.174248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b08853b-5661-4f60-b999-f7d9f7325b26 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:47.291321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-abf6dcd3-2a40-4d3f-b9fd-76d5e537ad0f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:20:47.292599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-abf6dcd3-2a40-4d3f-b9fd-76d5e537ad0f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:20:47.293496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-abf6dcd3-2a40-4d3f-b9fd-76d5e537ad0f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:20:47.294097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-abf6dcd3-2a40-4d3f-b9fd-76d5e537ad0f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:20:47.294687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-abf6dcd3-2a40-4d3f-b9fd-76d5e537ad0f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:20:47.309434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abf6dcd3-2a40-4d3f-b9fd-76d5e537ad0f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:47.309939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abf6dcd3-2a40-4d3f-b9fd-76d5e537ad0f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:47.310362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abf6dcd3-2a40-4d3f-b9fd-76d5e537ad0f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:47.311607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abf6dcd3-2a40-4d3f-b9fd-76d5e537ad0f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:47.312144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abf6dcd3-2a40-4d3f-b9fd-76d5e537ad0f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:47.312478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abf6dcd3-2a40-4d3f-b9fd-76d5e537ad0f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:47.326554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5b08853b-5661-4f60-b999-f7d9f7325b26 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:47.336952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-abf6dcd3-2a40-4d3f-b9fd-76d5e537ad0f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Getting quotas for project 6dc302f307494a61836f3afb38dccae9. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:20:47.341506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5b08853b-5661-4f60-b999-f7d9f7325b26 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:47.343355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5b08853b-5661-4f60-b999-f7d9f7325b26 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:47.344238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-abf6dcd3-2a40-4d3f-b9fd-76d5e537ad0f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Getting quotas for user 6cb8fe33c5d64047ada50f44e01e4faa and project 6dc302f307494a61836f3afb38dccae9. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:20:47.345275 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5b08853b-5661-4f60-b999-f7d9f7325b26 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.196773 Oct 29 01:20:47.346235 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2079/3986] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:47 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:47.356116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2a08a079-b3bc-49ae-9c9a-67f514424073 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96e93040>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:47.394314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-abf6dcd3-2a40-4d3f-b9fd-76d5e537ad0f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:20:47.403367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-abf6dcd3-2a40-4d3f-b9fd-76d5e537ad0f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:20:47.429101 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2a08a079-b3bc-49ae-9c9a-67f514424073 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.080619 Oct 29 01:20:47.430256 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2080/3987] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:20:47 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:47.566500 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-abf6dcd3-2a40-4d3f-b9fd-76d5e537ad0f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.256159 Oct 29 01:20:47.574847 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1908/3988] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:20:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:20:47.580046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c28b2e3b-e810-472f-99d2-360e428a5e2d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:47.580751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c28b2e3b-e810-472f-99d2-360e428a5e2d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:47.612448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6ff9a08f-664b-4c85-9c03-70fa3c9871ae tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:47.613209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6ff9a08f-664b-4c85-9c03-70fa3c9871ae tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:47.649824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ff9a08f-664b-4c85-9c03-70fa3c9871ae tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:47.651060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ff9a08f-664b-4c85-9c03-70fa3c9871ae tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:47.655445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ff9a08f-664b-4c85-9c03-70fa3c9871ae tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:47.661068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ff9a08f-664b-4c85-9c03-70fa3c9871ae tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:47.661068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ff9a08f-664b-4c85-9c03-70fa3c9871ae tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:47.664509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ff9a08f-664b-4c85-9c03-70fa3c9871ae tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:47.782312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c28b2e3b-e810-472f-99d2-360e428a5e2d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:47.796156 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c28b2e3b-e810-472f-99d2-360e428a5e2d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1209 microversion: 2.1 time: 0.220948 Oct 29 01:20:47.797081 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2081/3989] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:47 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1209 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:48.070481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-a3f83b1c-5406-4ea5-894f-4419d02d62e3 req-d768d68a-d6cd-4283-9957-2d8a2ed6a7df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0fc606-5d53-4e70-b087-22db406a68f8", "name": "network-vif-plugged", "status": "completed", "tag": "ee5981f8-c5ba-4a90-afb9-4849d919a97f"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:48.088651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a3f83b1c-5406-4ea5-894f-4419d02d62e3 req-d768d68a-d6cd-4283-9957-2d8a2ed6a7df service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:48.091109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a3f83b1c-5406-4ea5-894f-4419d02d62e3 req-d768d68a-d6cd-4283-9957-2d8a2ed6a7df service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:48.098159 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a3f83b1c-5406-4ea5-894f-4419d02d62e3 req-d768d68a-d6cd-4283-9957-2d8a2ed6a7df service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:48.120236 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-a3f83b1c-5406-4ea5-894f-4419d02d62e3 req-d768d68a-d6cd-4283-9957-2d8a2ed6a7df service nova] Creating event network-vif-plugged:ee5981f8-c5ba-4a90-afb9-4849d919a97f for instance 3d0fc606-5d53-4e70-b087-22db406a68f8 on n-h1-862964-3 Oct 29 01:20:48.132551 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-a3f83b1c-5406-4ea5-894f-4419d02d62e3 req-d768d68a-d6cd-4283-9957-2d8a2ed6a7df service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065764 Oct 29 01:20:48.139577 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2082/3990] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:20:48.176706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e3ddd752-3bfb-446b-b178-e3ae2f7826ec tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:48.177787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e3ddd752-3bfb-446b-b178-e3ae2f7826ec tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:48.190920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3ddd752-3bfb-446b-b178-e3ae2f7826ec tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:48.191421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3ddd752-3bfb-446b-b178-e3ae2f7826ec tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:48.191865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3ddd752-3bfb-446b-b178-e3ae2f7826ec tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:48.192575 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3ddd752-3bfb-446b-b178-e3ae2f7826ec tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:48.193035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3ddd752-3bfb-446b-b178-e3ae2f7826ec tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:48.196964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3ddd752-3bfb-446b-b178-e3ae2f7826ec tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:48.204241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6ff9a08f-664b-4c85-9c03-70fa3c9871ae tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:48.231143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6ff9a08f-664b-4c85-9c03-70fa3c9871ae tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:48.234834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6ff9a08f-664b-4c85-9c03-70fa3c9871ae tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:48.238904 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6ff9a08f-664b-4c85-9c03-70fa3c9871ae tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.641902 Oct 29 01:20:48.243364 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1909/3991] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:47 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:48.374783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a4ef1709-34fe-445c-8833-47167446b898 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:48.376297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a4ef1709-34fe-445c-8833-47167446b898 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:48.386478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4ef1709-34fe-445c-8833-47167446b898 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:48.392155 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4ef1709-34fe-445c-8833-47167446b898 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:48.394707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4ef1709-34fe-445c-8833-47167446b898 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:48.395705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4ef1709-34fe-445c-8833-47167446b898 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:48.400830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4ef1709-34fe-445c-8833-47167446b898 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:48.401378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4ef1709-34fe-445c-8833-47167446b898 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:48.628287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a4ef1709-34fe-445c-8833-47167446b898 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:48.647932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a4ef1709-34fe-445c-8833-47167446b898 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:48.650255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a4ef1709-34fe-445c-8833-47167446b898 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:48.652127 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a4ef1709-34fe-445c-8833-47167446b898 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.281733 Oct 29 01:20:48.665802 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1910/3992] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:48 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:48.679965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8843c8be-ec7b-4429-ac3f-6fb2282a1abe tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9fefcc10>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:48.763600 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8843c8be-ec7b-4429-ac3f-6fb2282a1abe tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.082274 Oct 29 01:20:48.764571 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1911/3993] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:20:48 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:48.828078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b6ba7abe-8706-4c15-9310-e5afa37b8e83 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:48.833937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b6ba7abe-8706-4c15-9310-e5afa37b8e83 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:48.852896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6ba7abe-8706-4c15-9310-e5afa37b8e83 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:48.856678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6ba7abe-8706-4c15-9310-e5afa37b8e83 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:48.862226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6ba7abe-8706-4c15-9310-e5afa37b8e83 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:48.863360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6ba7abe-8706-4c15-9310-e5afa37b8e83 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:48.865429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6ba7abe-8706-4c15-9310-e5afa37b8e83 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:48.867456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6ba7abe-8706-4c15-9310-e5afa37b8e83 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:48.887508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e3ddd752-3bfb-446b-b178-e3ae2f7826ec tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:48.900651 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e3ddd752-3bfb-446b-b178-e3ae2f7826ec tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.728617 Oct 29 01:20:48.901913 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2083/3994] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:48 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:49.077222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b6ba7abe-8706-4c15-9310-e5afa37b8e83 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:49.085785 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b6ba7abe-8706-4c15-9310-e5afa37b8e83 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1213 microversion: 2.1 time: 0.265848 Oct 29 01:20:49.089795 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1912/3995] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:48 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1213 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:49.186628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-06f13c68-8d82-43ec-8d8d-031696968304 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1659752245", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:20:49.273674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-54816c1e-0d3e-4da1-b7b2-87261ae065c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:49.274294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-54816c1e-0d3e-4da1-b7b2-87261ae065c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:49.293551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54816c1e-0d3e-4da1-b7b2-87261ae065c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:49.300221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54816c1e-0d3e-4da1-b7b2-87261ae065c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:49.300777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54816c1e-0d3e-4da1-b7b2-87261ae065c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:49.301596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54816c1e-0d3e-4da1-b7b2-87261ae065c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:49.309564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54816c1e-0d3e-4da1-b7b2-87261ae065c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:49.310137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54816c1e-0d3e-4da1-b7b2-87261ae065c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:49.337090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-06f13c68-8d82-43ec-8d8d-031696968304 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] validate_networks() for [('daf068bd-431d-4e20-b386-6225154844e0', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:20:49.967872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-54816c1e-0d3e-4da1-b7b2-87261ae065c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:49.978382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-54816c1e-0d3e-4da1-b7b2-87261ae065c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:49.979841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-54816c1e-0d3e-4da1-b7b2-87261ae065c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:49.988388 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-54816c1e-0d3e-4da1-b7b2-87261ae065c3 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.713089 Oct 29 01:20:49.989338 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1913/3996] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:49 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:20:50.000466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-41a82a66-da7a-4b65-8b17-2661d4ea22a8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:50.004493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-41a82a66-da7a-4b65-8b17-2661d4ea22a8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:50.024604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41a82a66-da7a-4b65-8b17-2661d4ea22a8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:50.026420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41a82a66-da7a-4b65-8b17-2661d4ea22a8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:50.027969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41a82a66-da7a-4b65-8b17-2661d4ea22a8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:50.028930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41a82a66-da7a-4b65-8b17-2661d4ea22a8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:50.032971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41a82a66-da7a-4b65-8b17-2661d4ea22a8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:50.033455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41a82a66-da7a-4b65-8b17-2661d4ea22a8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:50.444458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-41a82a66-da7a-4b65-8b17-2661d4ea22a8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:50.455535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-41a82a66-da7a-4b65-8b17-2661d4ea22a8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:50.462488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-41a82a66-da7a-4b65-8b17-2661d4ea22a8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:50.466707 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-41a82a66-da7a-4b65-8b17-2661d4ea22a8 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.476009 Oct 29 01:20:50.479503 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1914/3997] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:49 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:50.489524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6deff3b2-5a19-4c5f-b715-a79dcdd4a353 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d971f0940>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:50.623159 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6deff3b2-5a19-4c5f-b715-a79dcdd4a353 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.147007 Oct 29 01:20:50.623935 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1915/3998] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:20:50 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:50.635799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-914ec0d3-b973-4e70-b525-d01ce4b25e14 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:50.636710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-914ec0d3-b973-4e70-b525-d01ce4b25e14 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:50.649346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-914ec0d3-b973-4e70-b525-d01ce4b25e14 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:50.650223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-914ec0d3-b973-4e70-b525-d01ce4b25e14 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:50.650892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-914ec0d3-b973-4e70-b525-d01ce4b25e14 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:50.651853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-914ec0d3-b973-4e70-b525-d01ce4b25e14 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:50.652542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-914ec0d3-b973-4e70-b525-d01ce4b25e14 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:50.653271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-914ec0d3-b973-4e70-b525-d01ce4b25e14 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:50.885215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-914ec0d3-b973-4e70-b525-d01ce4b25e14 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:50.901758 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-914ec0d3-b973-4e70-b525-d01ce4b25e14 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1261 microversion: 2.1 time: 0.274328 Oct 29 01:20:50.906500 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1916/3999] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:50 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1261 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:51.036878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-df380a71-690d-4ede-b5ae-438ac3df06e8 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:51.037982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-df380a71-690d-4ede-b5ae-438ac3df06e8 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:51.058134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df380a71-690d-4ede-b5ae-438ac3df06e8 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:51.061339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df380a71-690d-4ede-b5ae-438ac3df06e8 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:51.061339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df380a71-690d-4ede-b5ae-438ac3df06e8 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:51.062294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df380a71-690d-4ede-b5ae-438ac3df06e8 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:51.067799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df380a71-690d-4ede-b5ae-438ac3df06e8 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:51.070298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df380a71-690d-4ede-b5ae-438ac3df06e8 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:52.870558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-06f13c68-8d82-43ec-8d8d-031696968304 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:20:52.872448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-06f13c68-8d82-43ec-8d8d-031696968304 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:20:52.873289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-06f13c68-8d82-43ec-8d8d-031696968304 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:20:52.875080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-06f13c68-8d82-43ec-8d8d-031696968304 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:20:52.875694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-06f13c68-8d82-43ec-8d8d-031696968304 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:20:52.903989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06f13c68-8d82-43ec-8d8d-031696968304 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:52.906686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06f13c68-8d82-43ec-8d8d-031696968304 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:52.908898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06f13c68-8d82-43ec-8d8d-031696968304 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:52.913979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06f13c68-8d82-43ec-8d8d-031696968304 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:52.916053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06f13c68-8d82-43ec-8d8d-031696968304 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:52.916624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06f13c68-8d82-43ec-8d8d-031696968304 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:52.943368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-df380a71-690d-4ede-b5ae-438ac3df06e8 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:52.979469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-06f13c68-8d82-43ec-8d8d-031696968304 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Getting quotas for project db514c084b19414db61960c65630a76f. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:20:52.989637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-df380a71-690d-4ede-b5ae-438ac3df06e8 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:52.993997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-df380a71-690d-4ede-b5ae-438ac3df06e8 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:53.000467 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-df380a71-690d-4ede-b5ae-438ac3df06e8 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 1.985498 Oct 29 01:20:53.001778 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1917/4000] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:51 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 1988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:20:53.003128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-06f13c68-8d82-43ec-8d8d-031696968304 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Getting quotas for user db4f1d9f22ae4b008486032a7f6269a6 and project db514c084b19414db61960c65630a76f. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:20:53.015939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c0b0d2b4-18ec-4e9a-a3b7-7f828109acf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:53.019744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c0b0d2b4-18ec-4e9a-a3b7-7f828109acf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:53.037032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0b0d2b4-18ec-4e9a-a3b7-7f828109acf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:53.039010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0b0d2b4-18ec-4e9a-a3b7-7f828109acf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:53.040320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0b0d2b4-18ec-4e9a-a3b7-7f828109acf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:53.042269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0b0d2b4-18ec-4e9a-a3b7-7f828109acf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:53.044214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0b0d2b4-18ec-4e9a-a3b7-7f828109acf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:53.045870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0b0d2b4-18ec-4e9a-a3b7-7f828109acf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:53.055275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-06f13c68-8d82-43ec-8d8d-031696968304 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:20:53.069445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-06f13c68-8d82-43ec-8d8d-031696968304 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:20:53.234564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c0b0d2b4-18ec-4e9a-a3b7-7f828109acf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:53.265585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c0b0d2b4-18ec-4e9a-a3b7-7f828109acf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:53.272856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c0b0d2b4-18ec-4e9a-a3b7-7f828109acf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:53.278359 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c0b0d2b4-18ec-4e9a-a3b7-7f828109acf9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.274644 Oct 29 01:20:53.282840 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1918/4001] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:53 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:53.299309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-084c7d13-4d6c-4229-9c6a-39cfa2316372 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d971893a0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:53.379466 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-06f13c68-8d82-43ec-8d8d-031696968304 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.197083 Oct 29 01:20:53.380382 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-084c7d13-4d6c-4229-9c6a-39cfa2316372 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.097228 Oct 29 01:20:53.383754 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1919/4002] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:20:53 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:53.388643 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2084/4003] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:20:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:20:53.408491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81a0f3d2-7d2b-40ed-b49a-4807d9808a61 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:53.409197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c33c6e86-6ad4-4e1b-b82d-b9a49ef33209 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:53.416192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c33c6e86-6ad4-4e1b-b82d-b9a49ef33209 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:53.418934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-81a0f3d2-7d2b-40ed-b49a-4807d9808a61 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:53.454426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c33c6e86-6ad4-4e1b-b82d-b9a49ef33209 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:53.455044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c33c6e86-6ad4-4e1b-b82d-b9a49ef33209 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:53.464547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c33c6e86-6ad4-4e1b-b82d-b9a49ef33209 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:53.471412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c33c6e86-6ad4-4e1b-b82d-b9a49ef33209 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:53.471412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c33c6e86-6ad4-4e1b-b82d-b9a49ef33209 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:53.471412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c33c6e86-6ad4-4e1b-b82d-b9a49ef33209 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:53.648864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-81a0f3d2-7d2b-40ed-b49a-4807d9808a61 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:53.667982 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-81a0f3d2-7d2b-40ed-b49a-4807d9808a61 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1217 microversion: 2.1 time: 0.272144 Oct 29 01:20:53.669397 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2085/4004] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:53 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1217 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:53.678276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c33c6e86-6ad4-4e1b-b82d-b9a49ef33209 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:53.694793 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c33c6e86-6ad4-4e1b-b82d-b9a49ef33209 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1267 microversion: 2.1 time: 0.308494 Oct 29 01:20:53.702455 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1920/4005] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:53 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1267 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:54.036757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-59a95707-e252-42ab-95b7-e3b86e4b0a4a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:54.038164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-59a95707-e252-42ab-95b7-e3b86e4b0a4a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:54.054485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a95707-e252-42ab-95b7-e3b86e4b0a4a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:54.058941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a95707-e252-42ab-95b7-e3b86e4b0a4a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:54.058941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a95707-e252-42ab-95b7-e3b86e4b0a4a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:54.058941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a95707-e252-42ab-95b7-e3b86e4b0a4a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:54.058941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a95707-e252-42ab-95b7-e3b86e4b0a4a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:54.058941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a95707-e252-42ab-95b7-e3b86e4b0a4a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:54.314115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-160182fe-d2a9-4406-b1fc-c432a3ce7bc9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:54.316225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-160182fe-d2a9-4406-b1fc-c432a3ce7bc9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:54.323176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:54.355460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-160182fe-d2a9-4406-b1fc-c432a3ce7bc9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:54.355709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-160182fe-d2a9-4406-b1fc-c432a3ce7bc9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:54.360100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-160182fe-d2a9-4406-b1fc-c432a3ce7bc9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:54.369070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-160182fe-d2a9-4406-b1fc-c432a3ce7bc9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:54.369888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-160182fe-d2a9-4406-b1fc-c432a3ce7bc9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:54.376665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-160182fe-d2a9-4406-b1fc-c432a3ce7bc9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:55.008478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-160182fe-d2a9-4406-b1fc-c432a3ce7bc9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:55.094074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-160182fe-d2a9-4406-b1fc-c432a3ce7bc9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:55.104459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-160182fe-d2a9-4406-b1fc-c432a3ce7bc9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:55.112372 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-160182fe-d2a9-4406-b1fc-c432a3ce7bc9 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.805488 Oct 29 01:20:55.114902 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1921/4006] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:54 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:55.152621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-501d77a3-3e23-4c7e-90cc-43ac65b70971 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d971409d0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:55.258106 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-501d77a3-3e23-4c7e-90cc-43ac65b70971 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.141328 Oct 29 01:20:55.260068 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1922/4007] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:20:55 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:55.287200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-725374ee-7831-41dc-b05a-26d5a7fdc25a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:55.288540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-725374ee-7831-41dc-b05a-26d5a7fdc25a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:55.304019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-725374ee-7831-41dc-b05a-26d5a7fdc25a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:55.304927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-725374ee-7831-41dc-b05a-26d5a7fdc25a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:55.305642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-725374ee-7831-41dc-b05a-26d5a7fdc25a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:55.308084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-725374ee-7831-41dc-b05a-26d5a7fdc25a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:55.309002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-725374ee-7831-41dc-b05a-26d5a7fdc25a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:55.311608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-725374ee-7831-41dc-b05a-26d5a7fdc25a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:55.317036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-59a95707-e252-42ab-95b7-e3b86e4b0a4a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:55.326291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:55.333798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-59a95707-e252-42ab-95b7-e3b86e4b0a4a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:55.335907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-59a95707-e252-42ab-95b7-e3b86e4b0a4a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:55.337112 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-59a95707-e252-42ab-95b7-e3b86e4b0a4a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 1.308439 Oct 29 01:20:55.348412 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2086/4008] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:54 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:55.353810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e86eb807-96d5-47c4-83b9-38192149ebf5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:55.357040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e86eb807-96d5-47c4-83b9-38192149ebf5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:55.379577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e86eb807-96d5-47c4-83b9-38192149ebf5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:55.383513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e86eb807-96d5-47c4-83b9-38192149ebf5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:55.384155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e86eb807-96d5-47c4-83b9-38192149ebf5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:55.385091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e86eb807-96d5-47c4-83b9-38192149ebf5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:55.387419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e86eb807-96d5-47c4-83b9-38192149ebf5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:55.388051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e86eb807-96d5-47c4-83b9-38192149ebf5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:55.666866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-725374ee-7831-41dc-b05a-26d5a7fdc25a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:55.687382 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-725374ee-7831-41dc-b05a-26d5a7fdc25a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1221 microversion: 2.1 time: 0.425868 Oct 29 01:20:55.690628 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1923/4009] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:55 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1221 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:56.005891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e86eb807-96d5-47c4-83b9-38192149ebf5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:56.019122 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e86eb807-96d5-47c4-83b9-38192149ebf5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1309 microversion: 2.1 time: 0.669209 Oct 29 01:20:56.025273 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2087/4010] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:55 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1309 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:56.148386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6b4dffe4-fa29-4d76-adca-e521469fc9f4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:56.149700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6b4dffe4-fa29-4d76-adca-e521469fc9f4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:56.164825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b4dffe4-fa29-4d76-adca-e521469fc9f4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:56.166232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b4dffe4-fa29-4d76-adca-e521469fc9f4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:56.166937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b4dffe4-fa29-4d76-adca-e521469fc9f4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:56.167915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b4dffe4-fa29-4d76-adca-e521469fc9f4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:56.174629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b4dffe4-fa29-4d76-adca-e521469fc9f4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:56.174629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b4dffe4-fa29-4d76-adca-e521469fc9f4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:56.276284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dd9d7bfc-412c-4def-97fd-dc9b0f51b8bd tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9770db80>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:56.360039 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dd9d7bfc-412c-4def-97fd-dc9b0f51b8bd tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.089824 Oct 29 01:20:56.371228 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2088/4011] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:20:56 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:56.379865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3acd24f2-a4b3-45b3-9893-b766e1308b48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:56.386235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3acd24f2-a4b3-45b3-9893-b766e1308b48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:56.397624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6b4dffe4-fa29-4d76-adca-e521469fc9f4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:56.398980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3acd24f2-a4b3-45b3-9893-b766e1308b48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:56.399586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3acd24f2-a4b3-45b3-9893-b766e1308b48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:56.404129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3acd24f2-a4b3-45b3-9893-b766e1308b48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:56.405366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3acd24f2-a4b3-45b3-9893-b766e1308b48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:56.405655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3acd24f2-a4b3-45b3-9893-b766e1308b48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:56.406205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3acd24f2-a4b3-45b3-9893-b766e1308b48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:56.423977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6b4dffe4-fa29-4d76-adca-e521469fc9f4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:56.431042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6b4dffe4-fa29-4d76-adca-e521469fc9f4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:56.432980 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6b4dffe4-fa29-4d76-adca-e521469fc9f4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.292400 Oct 29 01:20:56.462534 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1924/4012] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:56 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:56.714819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ea5a179a-28bc-4843-951d-5126f072b58e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:56.715641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ea5a179a-28bc-4843-951d-5126f072b58e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:56.730860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea5a179a-28bc-4843-951d-5126f072b58e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:56.731667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea5a179a-28bc-4843-951d-5126f072b58e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:56.732807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea5a179a-28bc-4843-951d-5126f072b58e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:56.733790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea5a179a-28bc-4843-951d-5126f072b58e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:56.736164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea5a179a-28bc-4843-951d-5126f072b58e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:56.739713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ea5a179a-28bc-4843-951d-5126f072b58e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:57.042119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-ea5a179a-28bc-4843-951d-5126f072b58e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lazy-loading 'services' on Instance uuid c7341065-fb16-4c56-9924-fe9a56d7a7b3 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:20:57.319677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:57.377759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:20:57.497370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3acd24f2-a4b3-45b3-9893-b766e1308b48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:57.515291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3acd24f2-a4b3-45b3-9893-b766e1308b48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:57.523022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3acd24f2-a4b3-45b3-9893-b766e1308b48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:57.542056 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3acd24f2-a4b3-45b3-9893-b766e1308b48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 1.166497 Oct 29 01:20:57.555537 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2089/4013] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:56 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:57.567653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-06d068ef-860e-4ffd-836f-18f3914f9353 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:57.574879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-06d068ef-860e-4ffd-836f-18f3914f9353 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:57.582300 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ea5a179a-28bc-4843-951d-5126f072b58e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3/os-volume_attachments/97f17705-1bd1-43ad-a5f1-ac06d3399f80" status: 202 len: 0 microversion: 2.1 time: 0.878782 Oct 29 01:20:57.587835 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1925/4014] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 29 01:20:56 2022] DELETE /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3/os-volume_attachments/97f17705-1bd1-43ad-a5f1-ac06d3399f80 => generated 0 bytes in 886 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:20:57.618130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06d068ef-860e-4ffd-836f-18f3914f9353 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:57.620238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06d068ef-860e-4ffd-836f-18f3914f9353 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:57.621333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06d068ef-860e-4ffd-836f-18f3914f9353 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:57.622422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d01e7199-0b44-4f38-9792-1e25558c1e37 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:57.623446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06d068ef-860e-4ffd-836f-18f3914f9353 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:57.625234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d01e7199-0b44-4f38-9792-1e25558c1e37 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:57.625961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06d068ef-860e-4ffd-836f-18f3914f9353 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:57.626594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06d068ef-860e-4ffd-836f-18f3914f9353 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:57.651335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d01e7199-0b44-4f38-9792-1e25558c1e37 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:57.651898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d01e7199-0b44-4f38-9792-1e25558c1e37 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:57.652351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d01e7199-0b44-4f38-9792-1e25558c1e37 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:57.655921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d01e7199-0b44-4f38-9792-1e25558c1e37 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:57.656393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d01e7199-0b44-4f38-9792-1e25558c1e37 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:57.656836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d01e7199-0b44-4f38-9792-1e25558c1e37 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:58.308644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-06d068ef-860e-4ffd-836f-18f3914f9353 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:58.321962 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-06d068ef-860e-4ffd-836f-18f3914f9353 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1287 microversion: 2.1 time: 0.764866 Oct 29 01:20:58.322575 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2090/4015] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:57 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1287 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:58.334150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-124413bf-84bb-4abb-b903-7e1458f5b8c2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9770d790>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:58.412148 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-124413bf-84bb-4abb-b903-7e1458f5b8c2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.088103 Oct 29 01:20:58.420094 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2091/4016] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:20:58 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:58.428039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d66f4163-b9f6-4616-87de-6b286cee7643 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:58.428689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d66f4163-b9f6-4616-87de-6b286cee7643 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:58.451967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d66f4163-b9f6-4616-87de-6b286cee7643 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:58.454987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d66f4163-b9f6-4616-87de-6b286cee7643 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:58.455575 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d66f4163-b9f6-4616-87de-6b286cee7643 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:58.457445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d66f4163-b9f6-4616-87de-6b286cee7643 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:58.457445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d66f4163-b9f6-4616-87de-6b286cee7643 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:58.457878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d66f4163-b9f6-4616-87de-6b286cee7643 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:58.493803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d01e7199-0b44-4f38-9792-1e25558c1e37 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:58.505924 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d01e7199-0b44-4f38-9792-1e25558c1e37 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1309 microversion: 2.1 time: 0.916331 Oct 29 01:20:58.507171 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1926/4017] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:57 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1309 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:58.576074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-34758ed7-1d97-4b98-b0fa-bf66165c668b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:58.576716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-34758ed7-1d97-4b98-b0fa-bf66165c668b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:58.594913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34758ed7-1d97-4b98-b0fa-bf66165c668b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:58.596501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34758ed7-1d97-4b98-b0fa-bf66165c668b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:58.596501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34758ed7-1d97-4b98-b0fa-bf66165c668b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:58.614130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34758ed7-1d97-4b98-b0fa-bf66165c668b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:58.614645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34758ed7-1d97-4b98-b0fa-bf66165c668b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:58.615097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34758ed7-1d97-4b98-b0fa-bf66165c668b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:58.807721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d66f4163-b9f6-4616-87de-6b286cee7643 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:58.824672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d66f4163-b9f6-4616-87de-6b286cee7643 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:58.828843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d66f4163-b9f6-4616-87de-6b286cee7643 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:58.838735 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d66f4163-b9f6-4616-87de-6b286cee7643 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.424247 Oct 29 01:20:58.840106 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2092/4018] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:58 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:20:59.264479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-34758ed7-1d97-4b98-b0fa-bf66165c668b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:59.283162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-34758ed7-1d97-4b98-b0fa-bf66165c668b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:59.285498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-34758ed7-1d97-4b98-b0fa-bf66165c668b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:59.287027 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-34758ed7-1d97-4b98-b0fa-bf66165c668b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.715282 Oct 29 01:20:59.306185 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1927/4019] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:58 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:20:59.347025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-82e216de-9cae-4838-aef9-5bc4c89f904a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:59.348058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-82e216de-9cae-4838-aef9-5bc4c89f904a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:59.362910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82e216de-9cae-4838-aef9-5bc4c89f904a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:59.363667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82e216de-9cae-4838-aef9-5bc4c89f904a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:59.364187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82e216de-9cae-4838-aef9-5bc4c89f904a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:59.365017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82e216de-9cae-4838-aef9-5bc4c89f904a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:59.366287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82e216de-9cae-4838-aef9-5bc4c89f904a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:59.371602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-82e216de-9cae-4838-aef9-5bc4c89f904a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:59.429677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6e7bcf17-ae94-4acb-a75e-3a07e4f1ded2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d971b1550>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:59.545437 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6e7bcf17-ae94-4acb-a75e-3a07e4f1ded2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.112519 Oct 29 01:20:59.545437 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1928/4020] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:20:59 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:20:59.545437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c9fc96d-efcf-4501-a7fd-26c4e509c016 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:59.545876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9c9fc96d-efcf-4501-a7fd-26c4e509c016 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:59.579241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9fc96d-efcf-4501-a7fd-26c4e509c016 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:59.580080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9fc96d-efcf-4501-a7fd-26c4e509c016 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:59.580732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9fc96d-efcf-4501-a7fd-26c4e509c016 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:59.581792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9fc96d-efcf-4501-a7fd-26c4e509c016 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:59.582801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9fc96d-efcf-4501-a7fd-26c4e509c016 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:59.583660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9fc96d-efcf-4501-a7fd-26c4e509c016 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:59.651204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-82e216de-9cae-4838-aef9-5bc4c89f904a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:20:59.671292 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-82e216de-9cae-4838-aef9-5bc4c89f904a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1275 microversion: 2.1 time: 0.328490 Oct 29 01:20:59.684733 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2093/4021] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:59 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1275 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:20:59.871814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4b227ff2-1760-47c8-b34b-bc94726cb56d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:59.872661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4b227ff2-1760-47c8-b34b-bc94726cb56d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:20:59.888254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b227ff2-1760-47c8-b34b-bc94726cb56d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:59.905997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b227ff2-1760-47c8-b34b-bc94726cb56d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:59.906570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b227ff2-1760-47c8-b34b-bc94726cb56d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:20:59.910068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b227ff2-1760-47c8-b34b-bc94726cb56d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:20:59.910631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b227ff2-1760-47c8-b34b-bc94726cb56d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:20:59.911082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b227ff2-1760-47c8-b34b-bc94726cb56d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:00.188436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4b227ff2-1760-47c8-b34b-bc94726cb56d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:00.200487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4b227ff2-1760-47c8-b34b-bc94726cb56d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:00.200816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4b227ff2-1760-47c8-b34b-bc94726cb56d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:00.212447 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4b227ff2-1760-47c8-b34b-bc94726cb56d tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.347078 Oct 29 01:21:00.213221 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2094/4022] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:20:59 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:21:00.327579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-30b82cec-1550-473f-bf52-55f67a91799b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:00.329582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-30b82cec-1550-473f-bf52-55f67a91799b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:00.344151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30b82cec-1550-473f-bf52-55f67a91799b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:00.345117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30b82cec-1550-473f-bf52-55f67a91799b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:00.345870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30b82cec-1550-473f-bf52-55f67a91799b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:00.348162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30b82cec-1550-473f-bf52-55f67a91799b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:00.348901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30b82cec-1550-473f-bf52-55f67a91799b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:00.350711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30b82cec-1550-473f-bf52-55f67a91799b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:00.716284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9c9fc96d-efcf-4501-a7fd-26c4e509c016 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:00.724721 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9c9fc96d-efcf-4501-a7fd-26c4e509c016 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1309 microversion: 2.1 time: 1.186043 Oct 29 01:21:00.726254 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1929/4023] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:20:59 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1309 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:00.738044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4396084a-0eea-4173-8bbb-9946432489e9 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d971f0790>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:00.815993 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4396084a-0eea-4173-8bbb-9946432489e9 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.088413 Oct 29 01:21:00.816602 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1930/4024] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:21:00 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:00.849199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e62c4efb-29a5-4132-abcd-003238feea05 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:00.850457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e62c4efb-29a5-4132-abcd-003238feea05 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:00.883900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e62c4efb-29a5-4132-abcd-003238feea05 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:00.884108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e62c4efb-29a5-4132-abcd-003238feea05 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:00.884528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e62c4efb-29a5-4132-abcd-003238feea05 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:00.892457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e62c4efb-29a5-4132-abcd-003238feea05 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:00.893173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e62c4efb-29a5-4132-abcd-003238feea05 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:00.894422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e62c4efb-29a5-4132-abcd-003238feea05 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:01.121455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e62c4efb-29a5-4132-abcd-003238feea05 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:01.135697 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e62c4efb-29a5-4132-abcd-003238feea05 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1275 microversion: 2.1 time: 0.313831 Oct 29 01:21:01.139834 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1931/4025] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:00 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1275 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:01.326649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-30b82cec-1550-473f-bf52-55f67a91799b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:01.353198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-30b82cec-1550-473f-bf52-55f67a91799b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:01.361317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-30b82cec-1550-473f-bf52-55f67a91799b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:01.369134 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-30b82cec-1550-473f-bf52-55f67a91799b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 1.048201 Oct 29 01:21:01.371079 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2095/4026] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:00 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:01.376204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c9471bb4-8998-4f7c-81ca-0cfc313a11be tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:01.379604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c9471bb4-8998-4f7c-81ca-0cfc313a11be tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:01.412588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9471bb4-8998-4f7c-81ca-0cfc313a11be tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:01.414675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9471bb4-8998-4f7c-81ca-0cfc313a11be tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:01.416359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9471bb4-8998-4f7c-81ca-0cfc313a11be tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:01.418183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9471bb4-8998-4f7c-81ca-0cfc313a11be tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:01.420043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9471bb4-8998-4f7c-81ca-0cfc313a11be tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:01.421474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9471bb4-8998-4f7c-81ca-0cfc313a11be tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:01.480170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:01.601581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-3dbdc276-2448-40e6-b274-a4e2e60ba135 req-0276267d-68b4-42f4-b9a2-871141fd7c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb8e84ce-a371-428f-945a-e0e252cd1cff", "tag": "b6eb2077-13c3-44f4-864b-998f9c9207d9"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:01.622978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3dbdc276-2448-40e6-b274-a4e2e60ba135 req-0276267d-68b4-42f4-b9a2-871141fd7c49 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:01.624241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c9471bb4-8998-4f7c-81ca-0cfc313a11be tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:01.625148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3dbdc276-2448-40e6-b274-a4e2e60ba135 req-0276267d-68b4-42f4-b9a2-871141fd7c49 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:01.626294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3dbdc276-2448-40e6-b274-a4e2e60ba135 req-0276267d-68b4-42f4-b9a2-871141fd7c49 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:01.643045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c9471bb4-8998-4f7c-81ca-0cfc313a11be tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:01.648412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c9471bb4-8998-4f7c-81ca-0cfc313a11be tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:01.651650 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c9471bb4-8998-4f7c-81ca-0cfc313a11be tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.277942 Oct 29 01:21:01.654084 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2096/4027] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:01 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:01.668122 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-3dbdc276-2448-40e6-b274-a4e2e60ba135 req-0276267d-68b4-42f4-b9a2-871141fd7c49 service nova] Creating event network-changed:b6eb2077-13c3-44f4-864b-998f9c9207d9 for instance cb8e84ce-a371-428f-945a-e0e252cd1cff on n-h1-862964-3 Oct 29 01:21:01.675058 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-3dbdc276-2448-40e6-b274-a4e2e60ba135 req-0276267d-68b4-42f4-b9a2-871141fd7c49 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.533938 Oct 29 01:21:01.676187 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1932/4028] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:01.750126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ef37f2ee-4505-433d-af09-093c84a42ce5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:01.750741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ef37f2ee-4505-433d-af09-093c84a42ce5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:01.775318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef37f2ee-4505-433d-af09-093c84a42ce5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:01.777539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef37f2ee-4505-433d-af09-093c84a42ce5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:01.778571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef37f2ee-4505-433d-af09-093c84a42ce5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:01.779328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef37f2ee-4505-433d-af09-093c84a42ce5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:01.779827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef37f2ee-4505-433d-af09-093c84a42ce5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:01.784184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef37f2ee-4505-433d-af09-093c84a42ce5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:01.836096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-92eb1eb7-9399-47e1-af99-7b3aee2925a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9722bc10>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:01.948056 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-92eb1eb7-9399-47e1-af99-7b3aee2925a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.110903 Oct 29 01:21:01.948774 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1933/4029] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:21:01 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:02.166383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5d8b8202-30fa-4051-8bbb-29c721b90aa8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:02.167156 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5d8b8202-30fa-4051-8bbb-29c721b90aa8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:02.185255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d8b8202-30fa-4051-8bbb-29c721b90aa8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:02.188387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d8b8202-30fa-4051-8bbb-29c721b90aa8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:02.190420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d8b8202-30fa-4051-8bbb-29c721b90aa8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:02.197192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d8b8202-30fa-4051-8bbb-29c721b90aa8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:02.198739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d8b8202-30fa-4051-8bbb-29c721b90aa8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:02.201725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d8b8202-30fa-4051-8bbb-29c721b90aa8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:02.949401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:03.014754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ef37f2ee-4505-433d-af09-093c84a42ce5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:03.028034 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ef37f2ee-4505-433d-af09-093c84a42ce5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1309 microversion: 2.1 time: 1.282104 Oct 29 01:21:03.032027 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2097/4030] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:01 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1309 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:03.044696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cf489ce8-bc0a-46fd-b304-5a88866a71cf tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:03.045359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cf489ce8-bc0a-46fd-b304-5a88866a71cf tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:03.060063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf489ce8-bc0a-46fd-b304-5a88866a71cf tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:03.060680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf489ce8-bc0a-46fd-b304-5a88866a71cf tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:03.060997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf489ce8-bc0a-46fd-b304-5a88866a71cf tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:03.061758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf489ce8-bc0a-46fd-b304-5a88866a71cf tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:03.066962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf489ce8-bc0a-46fd-b304-5a88866a71cf tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:03.067535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf489ce8-bc0a-46fd-b304-5a88866a71cf tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:03.095562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5d8b8202-30fa-4051-8bbb-29c721b90aa8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:03.108973 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5d8b8202-30fa-4051-8bbb-29c721b90aa8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1317 microversion: 2.1 time: 0.945464 Oct 29 01:21:03.142182 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1934/4031] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:02 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1317 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:03.150762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4012fc4a-0c8d-4843-b1e8-6e709fefaf60 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:03.151668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4012fc4a-0c8d-4843-b1e8-6e709fefaf60 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:03.158895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4012fc4a-0c8d-4843-b1e8-6e709fefaf60 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:03.159634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4012fc4a-0c8d-4843-b1e8-6e709fefaf60 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:03.160969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4012fc4a-0c8d-4843-b1e8-6e709fefaf60 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:03.161925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4012fc4a-0c8d-4843-b1e8-6e709fefaf60 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:03.163367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4012fc4a-0c8d-4843-b1e8-6e709fefaf60 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:03.164784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4012fc4a-0c8d-4843-b1e8-6e709fefaf60 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:03.411769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4012fc4a-0c8d-4843-b1e8-6e709fefaf60 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:03.434120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4012fc4a-0c8d-4843-b1e8-6e709fefaf60 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:03.470616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4012fc4a-0c8d-4843-b1e8-6e709fefaf60 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:03.470616 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4012fc4a-0c8d-4843-b1e8-6e709fefaf60 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.294286 Oct 29 01:21:03.470616 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1935/4032] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:03 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:03.470616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4751ddd3-e751-4951-85a2-4ce1b08afaaf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9ff7c4c0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:03.533778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cf489ce8-bc0a-46fd-b304-5a88866a71cf tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:03.548356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cf489ce8-bc0a-46fd-b304-5a88866a71cf tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:03.548875 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4751ddd3-e751-4951-85a2-4ce1b08afaaf tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.088314 Oct 29 01:21:03.555484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cf489ce8-bc0a-46fd-b304-5a88866a71cf tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:03.558013 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1936/4033] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:21:03 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:03.573627 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cf489ce8-bc0a-46fd-b304-5a88866a71cf tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.540253 Oct 29 01:21:03.581215 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2098/4034] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:03 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:04.060309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c4acb2ed-4e3d-4d33-916e-450e4a0b5ae5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:04.060977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c4acb2ed-4e3d-4d33-916e-450e4a0b5ae5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:04.075010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4acb2ed-4e3d-4d33-916e-450e4a0b5ae5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:04.075521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4acb2ed-4e3d-4d33-916e-450e4a0b5ae5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:04.075967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4acb2ed-4e3d-4d33-916e-450e4a0b5ae5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:04.076687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4acb2ed-4e3d-4d33-916e-450e4a0b5ae5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:04.077179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4acb2ed-4e3d-4d33-916e-450e4a0b5ae5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:04.077630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4acb2ed-4e3d-4d33-916e-450e4a0b5ae5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:04.140431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c5c106c6-25ee-4ec7-b9f8-85fe66e79d32 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:04.141271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c5c106c6-25ee-4ec7-b9f8-85fe66e79d32 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:04.148077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=10 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:04.150779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5c106c6-25ee-4ec7-b9f8-85fe66e79d32 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:04.151605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5c106c6-25ee-4ec7-b9f8-85fe66e79d32 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:04.152923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5c106c6-25ee-4ec7-b9f8-85fe66e79d32 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:04.173715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5c106c6-25ee-4ec7-b9f8-85fe66e79d32 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:04.174587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5c106c6-25ee-4ec7-b9f8-85fe66e79d32 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:04.176240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5c106c6-25ee-4ec7-b9f8-85fe66e79d32 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:04.652568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c4acb2ed-4e3d-4d33-916e-450e4a0b5ae5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:04.666137 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c4acb2ed-4e3d-4d33-916e-450e4a0b5ae5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1309 microversion: 2.1 time: 0.610618 Oct 29 01:21:04.670442 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1937/4035] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:04 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1309 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:04.682503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-64efaa1b-eedc-4f04-a9e7-78ef229bdd1e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:04.685808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-64efaa1b-eedc-4f04-a9e7-78ef229bdd1e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:04.700084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64efaa1b-eedc-4f04-a9e7-78ef229bdd1e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:04.701862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64efaa1b-eedc-4f04-a9e7-78ef229bdd1e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:04.703857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64efaa1b-eedc-4f04-a9e7-78ef229bdd1e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:04.704548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64efaa1b-eedc-4f04-a9e7-78ef229bdd1e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:04.705009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64efaa1b-eedc-4f04-a9e7-78ef229bdd1e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:04.717823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64efaa1b-eedc-4f04-a9e7-78ef229bdd1e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:04.738763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c5c106c6-25ee-4ec7-b9f8-85fe66e79d32 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:04.750367 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c5c106c6-25ee-4ec7-b9f8-85fe66e79d32 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1317 microversion: 2.1 time: 0.614341 Oct 29 01:21:04.750959 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2099/4036] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:04 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1317 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:04.780135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5fad14cb-5cfb-45db-b18c-77e111d46282 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96b75a60>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:04.872158 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5fad14cb-5cfb-45db-b18c-77e111d46282 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.095808 Oct 29 01:21:04.882258 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2100/4037] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:21:04 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:04.895021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a7655b26-1df9-45cd-8293-97e7afac2ebb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:04.895906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a7655b26-1df9-45cd-8293-97e7afac2ebb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:04.915075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7655b26-1df9-45cd-8293-97e7afac2ebb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:04.915571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7655b26-1df9-45cd-8293-97e7afac2ebb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:04.916227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7655b26-1df9-45cd-8293-97e7afac2ebb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:04.917174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7655b26-1df9-45cd-8293-97e7afac2ebb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:04.917819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7655b26-1df9-45cd-8293-97e7afac2ebb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:04.918435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7655b26-1df9-45cd-8293-97e7afac2ebb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:04.984705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-64efaa1b-eedc-4f04-a9e7-78ef229bdd1e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:05.007723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-64efaa1b-eedc-4f04-a9e7-78ef229bdd1e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:05.009530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-64efaa1b-eedc-4f04-a9e7-78ef229bdd1e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:05.017408 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-64efaa1b-eedc-4f04-a9e7-78ef229bdd1e tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.345511 Oct 29 01:21:05.018265 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1938/4038] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:04 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:05.702239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a4b52d63-085d-485f-9a06-dece18ab657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:05.703502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a4b52d63-085d-485f-9a06-dece18ab657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:05.713643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4b52d63-085d-485f-9a06-dece18ab657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:05.717900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4b52d63-085d-485f-9a06-dece18ab657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:05.718623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4b52d63-085d-485f-9a06-dece18ab657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:05.719555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4b52d63-085d-485f-9a06-dece18ab657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:05.720179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4b52d63-085d-485f-9a06-dece18ab657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:05.725980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4b52d63-085d-485f-9a06-dece18ab657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:06.777940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a4b52d63-085d-485f-9a06-dece18ab657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:06.789580 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a4b52d63-085d-485f-9a06-dece18ab657d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1309 microversion: 2.1 time: 1.095940 Oct 29 01:21:06.793921 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1939/4039] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:05 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1309 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:06.812707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c93eb9b2-5326-4b36-a947-cca301476169 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:06.812707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c93eb9b2-5326-4b36-a947-cca301476169 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:06.824954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c93eb9b2-5326-4b36-a947-cca301476169 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:06.826940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c93eb9b2-5326-4b36-a947-cca301476169 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:06.828757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c93eb9b2-5326-4b36-a947-cca301476169 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:06.832303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c93eb9b2-5326-4b36-a947-cca301476169 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:06.833674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c93eb9b2-5326-4b36-a947-cca301476169 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:06.835236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c93eb9b2-5326-4b36-a947-cca301476169 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:06.862494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a7655b26-1df9-45cd-8293-97e7afac2ebb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:06.881879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a7655b26-1df9-45cd-8293-97e7afac2ebb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:06.885972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a7655b26-1df9-45cd-8293-97e7afac2ebb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:06.890699 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a7655b26-1df9-45cd-8293-97e7afac2ebb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 2.006099 Oct 29 01:21:06.892699 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2101/4040] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:04 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 2010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:06.908952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-12774cb9-fe9e-49a2-9e49-b317adeab4bb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96eb30d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:06.980333 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-12774cb9-fe9e-49a2-9e49-b317adeab4bb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.081533 Oct 29 01:21:06.981067 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2102/4041] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:21:06 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:06.993971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a78032f4-49d1-4414-8294-c38f8240c2b4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:06.996662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a78032f4-49d1-4414-8294-c38f8240c2b4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:07.013390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a78032f4-49d1-4414-8294-c38f8240c2b4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:07.015192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a78032f4-49d1-4414-8294-c38f8240c2b4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:07.020638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a78032f4-49d1-4414-8294-c38f8240c2b4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:07.023950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a78032f4-49d1-4414-8294-c38f8240c2b4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:07.024586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a78032f4-49d1-4414-8294-c38f8240c2b4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:07.025273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a78032f4-49d1-4414-8294-c38f8240c2b4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:07.469801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a78032f4-49d1-4414-8294-c38f8240c2b4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:07.483366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a78032f4-49d1-4414-8294-c38f8240c2b4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:07.489615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a78032f4-49d1-4414-8294-c38f8240c2b4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:07.493509 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a78032f4-49d1-4414-8294-c38f8240c2b4 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.509256 Oct 29 01:21:07.496382 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2103/4042] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:06 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:07.519871 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c93eb9b2-5326-4b36-a947-cca301476169 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:07.535925 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c93eb9b2-5326-4b36-a947-cca301476169 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1317 microversion: 2.1 time: 0.739579 Oct 29 01:21:07.538445 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1940/4043] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:06 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1317 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:07.821463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0a960724-7249-4d91-b399-31e8c64eef1f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:07.822935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0a960724-7249-4d91-b399-31e8c64eef1f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:07.834931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a960724-7249-4d91-b399-31e8c64eef1f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:07.836920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a960724-7249-4d91-b399-31e8c64eef1f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:07.839951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a960724-7249-4d91-b399-31e8c64eef1f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:07.841980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a960724-7249-4d91-b399-31e8c64eef1f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:07.845326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a960724-7249-4d91-b399-31e8c64eef1f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:07.846062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a960724-7249-4d91-b399-31e8c64eef1f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:07.929804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-953b2f6b-c239-40be-934b-f2c982b27086 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:07.930420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-953b2f6b-c239-40be-934b-f2c982b27086 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:07.946989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-953b2f6b-c239-40be-934b-f2c982b27086 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:07.950481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-953b2f6b-c239-40be-934b-f2c982b27086 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:07.951297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-953b2f6b-c239-40be-934b-f2c982b27086 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:07.952541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-953b2f6b-c239-40be-934b-f2c982b27086 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:07.953210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-953b2f6b-c239-40be-934b-f2c982b27086 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:07.954088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-953b2f6b-c239-40be-934b-f2c982b27086 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:08.720349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0a960724-7249-4d91-b399-31e8c64eef1f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:08.760312 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0a960724-7249-4d91-b399-31e8c64eef1f tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1309 microversion: 2.1 time: 0.943697 Oct 29 01:21:08.774605 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2104/4044] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:07 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1309 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:08.786074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4a93049f-0fe6-47bf-9d6f-c296848214fb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96b759d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:08.880388 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4a93049f-0fe6-47bf-9d6f-c296848214fb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.104047 Oct 29 01:21:08.890511 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2105/4045] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:21:08 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:08.899211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-759233bf-e703-4d3a-ba11-224b9e957d54 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:08.899904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-759233bf-e703-4d3a-ba11-224b9e957d54 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:08.916660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-759233bf-e703-4d3a-ba11-224b9e957d54 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:08.917189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-759233bf-e703-4d3a-ba11-224b9e957d54 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:08.917618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-759233bf-e703-4d3a-ba11-224b9e957d54 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:08.923122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-759233bf-e703-4d3a-ba11-224b9e957d54 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:08.929196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-759233bf-e703-4d3a-ba11-224b9e957d54 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:08.929819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-759233bf-e703-4d3a-ba11-224b9e957d54 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:09.140728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-953b2f6b-c239-40be-934b-f2c982b27086 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:09.162132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-953b2f6b-c239-40be-934b-f2c982b27086 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:09.169537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-953b2f6b-c239-40be-934b-f2c982b27086 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:09.176195 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-953b2f6b-c239-40be-934b-f2c982b27086 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 1.249645 Oct 29 01:21:09.178355 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1941/4046] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:07 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:09.193669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3b43fc15-7122-4dbf-a808-d05dd1fb01d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:09.196913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3b43fc15-7122-4dbf-a808-d05dd1fb01d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:09.215471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b43fc15-7122-4dbf-a808-d05dd1fb01d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:09.218881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b43fc15-7122-4dbf-a808-d05dd1fb01d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:09.220856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b43fc15-7122-4dbf-a808-d05dd1fb01d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:09.223086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b43fc15-7122-4dbf-a808-d05dd1fb01d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:09.227536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b43fc15-7122-4dbf-a808-d05dd1fb01d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:09.228209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b43fc15-7122-4dbf-a808-d05dd1fb01d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:09.368946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-759233bf-e703-4d3a-ba11-224b9e957d54 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:09.388704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-759233bf-e703-4d3a-ba11-224b9e957d54 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:09.391061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-759233bf-e703-4d3a-ba11-224b9e957d54 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:09.392326 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-759233bf-e703-4d3a-ba11-224b9e957d54 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.505301 Oct 29 01:21:09.392909 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2106/4047] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:08 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:09.794410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ef5ea622-f72a-4556-8b61-05de0e248f78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:09.794410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ef5ea622-f72a-4556-8b61-05de0e248f78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:09.801262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef5ea622-f72a-4556-8b61-05de0e248f78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:09.802241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef5ea622-f72a-4556-8b61-05de0e248f78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:09.803970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef5ea622-f72a-4556-8b61-05de0e248f78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:09.805088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef5ea622-f72a-4556-8b61-05de0e248f78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:09.805798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef5ea622-f72a-4556-8b61-05de0e248f78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:09.806617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef5ea622-f72a-4556-8b61-05de0e248f78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:09.836619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3b43fc15-7122-4dbf-a808-d05dd1fb01d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:09.847508 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3b43fc15-7122-4dbf-a808-d05dd1fb01d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1317 microversion: 2.1 time: 0.666925 Oct 29 01:21:09.848121 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1942/4048] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:09 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1317 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:09.899970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aacdcfd5-029c-46b6-835c-e9fb9407d7fe tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d971b2ee0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:09.984579 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aacdcfd5-029c-46b6-835c-e9fb9407d7fe tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.089859 Oct 29 01:21:09.985204 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1943/4049] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:21:09 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:10.158425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ef5ea622-f72a-4556-8b61-05de0e248f78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:10.174994 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ef5ea622-f72a-4556-8b61-05de0e248f78 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1309 microversion: 2.1 time: 0.390681 Oct 29 01:21:10.185188 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2107/4050] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:09 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1309 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:10.204346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-599ab188-324b-4119-b457-2d501be66e1b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:10.205619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-599ab188-324b-4119-b457-2d501be66e1b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:10.219394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-599ab188-324b-4119-b457-2d501be66e1b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:10.225954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-599ab188-324b-4119-b457-2d501be66e1b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:10.226748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-599ab188-324b-4119-b457-2d501be66e1b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:10.227715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-599ab188-324b-4119-b457-2d501be66e1b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:10.228354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-599ab188-324b-4119-b457-2d501be66e1b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:10.229055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-599ab188-324b-4119-b457-2d501be66e1b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:10.426989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bea3795e-8841-431e-a887-7419c2668960 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:10.426989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bea3795e-8841-431e-a887-7419c2668960 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:10.456320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bea3795e-8841-431e-a887-7419c2668960 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:10.457316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bea3795e-8841-431e-a887-7419c2668960 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:10.458362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bea3795e-8841-431e-a887-7419c2668960 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:10.461948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bea3795e-8841-431e-a887-7419c2668960 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:10.465825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bea3795e-8841-431e-a887-7419c2668960 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:10.467000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bea3795e-8841-431e-a887-7419c2668960 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:10.675385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-599ab188-324b-4119-b457-2d501be66e1b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:10.677091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bea3795e-8841-431e-a887-7419c2668960 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:10.681297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:10.695478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-599ab188-324b-4119-b457-2d501be66e1b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:10.697521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bea3795e-8841-431e-a887-7419c2668960 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:10.698250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-599ab188-324b-4119-b457-2d501be66e1b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:10.699240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bea3795e-8841-431e-a887-7419c2668960 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:10.700493 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bea3795e-8841-431e-a887-7419c2668960 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.283131 Oct 29 01:21:10.701884 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-599ab188-324b-4119-b457-2d501be66e1b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.501683 Oct 29 01:21:10.714541 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1944/4051] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:10 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:10.730696 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2108/4052] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:10 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:10.741857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-9ccfe841-3eb8-437b-991e-2ea7cf13ca29 req-3f2e5d7e-9a3d-4292-b018-74d10b67e3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac895d78-7d15-451d-a60f-4e80afb0241a", "tag": "c7a74419-3a70-4ceb-b0db-4fdeeca001b3"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:10.758549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9ccfe841-3eb8-437b-991e-2ea7cf13ca29 req-3f2e5d7e-9a3d-4292-b018-74d10b67e3b8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:10.759956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9ccfe841-3eb8-437b-991e-2ea7cf13ca29 req-3f2e5d7e-9a3d-4292-b018-74d10b67e3b8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:10.760601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9ccfe841-3eb8-437b-991e-2ea7cf13ca29 req-3f2e5d7e-9a3d-4292-b018-74d10b67e3b8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:10.774952 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-9ccfe841-3eb8-437b-991e-2ea7cf13ca29 req-3f2e5d7e-9a3d-4292-b018-74d10b67e3b8 service nova] Creating event network-changed:c7a74419-3a70-4ceb-b0db-4fdeeca001b3 for instance ac895d78-7d15-451d-a60f-4e80afb0241a on n-h1-862964-3 Oct 29 01:21:10.783602 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-9ccfe841-3eb8-437b-991e-2ea7cf13ca29 req-3f2e5d7e-9a3d-4292-b018-74d10b67e3b8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044591 Oct 29 01:21:10.784860 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1945/4053] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:10.874868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-12041633-1085-436d-a0ca-4310d26af21e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:10.878802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-12041633-1085-436d-a0ca-4310d26af21e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:10.894249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12041633-1085-436d-a0ca-4310d26af21e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:10.895000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12041633-1085-436d-a0ca-4310d26af21e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:10.895625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12041633-1085-436d-a0ca-4310d26af21e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:10.897191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12041633-1085-436d-a0ca-4310d26af21e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:10.897882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12041633-1085-436d-a0ca-4310d26af21e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:10.898480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12041633-1085-436d-a0ca-4310d26af21e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:11.000478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4ba06bb2-12b5-4650-946e-2edc526b8bc4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97147160>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:11.098156 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4ba06bb2-12b5-4650-946e-2edc526b8bc4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.101751 Oct 29 01:21:11.107529 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1946/4054] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:21:10 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:11.210388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-99d5a8b0-2b64-41f0-9750-23e0a77707e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:11.211173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-99d5a8b0-2b64-41f0-9750-23e0a77707e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:11.236707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99d5a8b0-2b64-41f0-9750-23e0a77707e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:11.237353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99d5a8b0-2b64-41f0-9750-23e0a77707e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:11.237702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99d5a8b0-2b64-41f0-9750-23e0a77707e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:11.238447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99d5a8b0-2b64-41f0-9750-23e0a77707e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:11.238915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99d5a8b0-2b64-41f0-9750-23e0a77707e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:11.239350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99d5a8b0-2b64-41f0-9750-23e0a77707e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:12.142204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-12041633-1085-436d-a0ca-4310d26af21e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:12.154950 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-12041633-1085-436d-a0ca-4310d26af21e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1317 microversion: 2.1 time: 1.283943 Oct 29 01:21:12.173092 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2109/4055] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:10 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1317 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:12.180537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-99d5a8b0-2b64-41f0-9750-23e0a77707e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:12.183449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-17419214-9259-4d7b-8a4f-68a5a25fa8c6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:12.197936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:12.201449 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-99d5a8b0-2b64-41f0-9750-23e0a77707e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1309 microversion: 2.1 time: 0.989959 Oct 29 01:21:12.201607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17419214-9259-4d7b-8a4f-68a5a25fa8c6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:12.201962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17419214-9259-4d7b-8a4f-68a5a25fa8c6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:12.207185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17419214-9259-4d7b-8a4f-68a5a25fa8c6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:12.219498 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1947/4056] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:11 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1309 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:12.251700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d6383c78-0d9a-45d8-80d7-d22ebdc45ff1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:12.252348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d6383c78-0d9a-45d8-80d7-d22ebdc45ff1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:12.262302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-17419214-9259-4d7b-8a4f-68a5a25fa8c6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Going to try to stop instance {{(pid=121099) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 01:21:12.296222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6383c78-0d9a-45d8-80d7-d22ebdc45ff1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:12.299446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6383c78-0d9a-45d8-80d7-d22ebdc45ff1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:12.302149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6383c78-0d9a-45d8-80d7-d22ebdc45ff1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:12.303121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6383c78-0d9a-45d8-80d7-d22ebdc45ff1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:12.303593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6383c78-0d9a-45d8-80d7-d22ebdc45ff1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:12.309958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6383c78-0d9a-45d8-80d7-d22ebdc45ff1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:12.547625 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-17419214-9259-4d7b-8a4f-68a5a25fa8c6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "POST /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3/action" status: 202 len: 0 microversion: 2.1 time: 0.373087 Oct 29 01:21:12.555602 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2110/4057] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:21:12 2022] POST /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:21:12.570352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-77a8e3b4-b61b-4520-a682-ae0d6d79eecd tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:12.571586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-77a8e3b4-b61b-4520-a682-ae0d6d79eecd tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:12.590933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77a8e3b4-b61b-4520-a682-ae0d6d79eecd tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:12.591988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77a8e3b4-b61b-4520-a682-ae0d6d79eecd tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:12.597940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77a8e3b4-b61b-4520-a682-ae0d6d79eecd tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:12.600096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77a8e3b4-b61b-4520-a682-ae0d6d79eecd tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:12.600762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77a8e3b4-b61b-4520-a682-ae0d6d79eecd tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:12.601397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77a8e3b4-b61b-4520-a682-ae0d6d79eecd tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:12.753564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d6383c78-0d9a-45d8-80d7-d22ebdc45ff1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:12.774290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d6383c78-0d9a-45d8-80d7-d22ebdc45ff1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:12.777476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d6383c78-0d9a-45d8-80d7-d22ebdc45ff1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:12.779298 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d6383c78-0d9a-45d8-80d7-d22ebdc45ff1 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.553220 Oct 29 01:21:12.780507 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1948/4058] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:12 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:12.786771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-e3083a6f-8952-48eb-8b9f-8950fc082684 req-ff7a5b48-2b23-4f22-90fd-6ec0012b0d1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "name": "network-vif-plugged", "status": "completed", "tag": "8de02bf9-2ec5-459d-8aff-bdd6efe86054"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:12.817143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e3083a6f-8952-48eb-8b9f-8950fc082684 req-ff7a5b48-2b23-4f22-90fd-6ec0012b0d1c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:12.818722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e3083a6f-8952-48eb-8b9f-8950fc082684 req-ff7a5b48-2b23-4f22-90fd-6ec0012b0d1c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:12.822096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e3083a6f-8952-48eb-8b9f-8950fc082684 req-ff7a5b48-2b23-4f22-90fd-6ec0012b0d1c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:12.857848 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-e3083a6f-8952-48eb-8b9f-8950fc082684 req-ff7a5b48-2b23-4f22-90fd-6ec0012b0d1c service nova] Creating event network-vif-plugged:8de02bf9-2ec5-459d-8aff-bdd6efe86054 for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:21:12.872976 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-e3083a6f-8952-48eb-8b9f-8950fc082684 req-ff7a5b48-2b23-4f22-90fd-6ec0012b0d1c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090382 Oct 29 01:21:12.877317 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1949/4059] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:12.902565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a7a36613-ace8-4ae2-bfc6-4be72c6e41a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d971f0af0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:13.011482 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a7a36613-ace8-4ae2-bfc6-4be72c6e41a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.132023 Oct 29 01:21:13.012878 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1950/4060] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:21:12 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:13.032586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c3c8fa31-9ca1-4ed7-8dd3-69394d0ce9bb tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:13.033719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c3c8fa31-9ca1-4ed7-8dd3-69394d0ce9bb tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:13.056618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3c8fa31-9ca1-4ed7-8dd3-69394d0ce9bb tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:13.057428 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3c8fa31-9ca1-4ed7-8dd3-69394d0ce9bb tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:13.058759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3c8fa31-9ca1-4ed7-8dd3-69394d0ce9bb tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:13.060618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3c8fa31-9ca1-4ed7-8dd3-69394d0ce9bb tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:13.062919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3c8fa31-9ca1-4ed7-8dd3-69394d0ce9bb tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:13.063607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3c8fa31-9ca1-4ed7-8dd3-69394d0ce9bb tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:13.133703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-77a8e3b4-b61b-4520-a682-ae0d6d79eecd tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:13.153652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-77a8e3b4-b61b-4520-a682-ae0d6d79eecd tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:13.155276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-77a8e3b4-b61b-4520-a682-ae0d6d79eecd tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:13.156501 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-77a8e3b4-b61b-4520-a682-ae0d6d79eecd tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.600865 Oct 29 01:21:13.182986 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2111/4061] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:12 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:13.189688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3fd3a8ad-cb9b-4b81-8be1-781d939428a1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:13.192632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3fd3a8ad-cb9b-4b81-8be1-781d939428a1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:13.212218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3fd3a8ad-cb9b-4b81-8be1-781d939428a1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:13.212218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3fd3a8ad-cb9b-4b81-8be1-781d939428a1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:13.212218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3fd3a8ad-cb9b-4b81-8be1-781d939428a1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:13.218923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3fd3a8ad-cb9b-4b81-8be1-781d939428a1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:13.219827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3fd3a8ad-cb9b-4b81-8be1-781d939428a1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:13.220495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3fd3a8ad-cb9b-4b81-8be1-781d939428a1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:13.695503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c3c8fa31-9ca1-4ed7-8dd3-69394d0ce9bb tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:13.710103 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c3c8fa31-9ca1-4ed7-8dd3-69394d0ce9bb tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1675 microversion: 2.1 time: 0.694021 Oct 29 01:21:13.710701 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1951/4062] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:13 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1675 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:13.735325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2c2ce930-a375-48fa-8fd0-0f7437d414b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:13.742469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2c2ce930-a375-48fa-8fd0-0f7437d414b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:13.756621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c2ce930-a375-48fa-8fd0-0f7437d414b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:13.757208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c2ce930-a375-48fa-8fd0-0f7437d414b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:13.761348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c2ce930-a375-48fa-8fd0-0f7437d414b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:13.762162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c2ce930-a375-48fa-8fd0-0f7437d414b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:13.762645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c2ce930-a375-48fa-8fd0-0f7437d414b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:13.763085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c2ce930-a375-48fa-8fd0-0f7437d414b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:13.893828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3fd3a8ad-cb9b-4b81-8be1-781d939428a1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:13.917496 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3fd3a8ad-cb9b-4b81-8be1-781d939428a1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1317 microversion: 2.1 time: 0.719223 Oct 29 01:21:13.933198 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2112/4063] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:13 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1317 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:13.939367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-12278b37-6aae-456a-8a17-2f908a529819 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:13.940292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-12278b37-6aae-456a-8a17-2f908a529819 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:13.964898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12278b37-6aae-456a-8a17-2f908a529819 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:13.968217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12278b37-6aae-456a-8a17-2f908a529819 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:13.969338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12278b37-6aae-456a-8a17-2f908a529819 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:13.972393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12278b37-6aae-456a-8a17-2f908a529819 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:13.974345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12278b37-6aae-456a-8a17-2f908a529819 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:13.975511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12278b37-6aae-456a-8a17-2f908a529819 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:14.227204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-12278b37-6aae-456a-8a17-2f908a529819 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:14.242677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-12278b37-6aae-456a-8a17-2f908a529819 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:14.244156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-12278b37-6aae-456a-8a17-2f908a529819 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:14.250985 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-12278b37-6aae-456a-8a17-2f908a529819 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.329069 Oct 29 01:21:14.252150 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2113/4064] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:13 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:14.260793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ac76441b-4150-45d0-aede-1a3486dd9342 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96e93ca0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:14.346059 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ac76441b-4150-45d0-aede-1a3486dd9342 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.092354 Oct 29 01:21:14.354521 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2114/4065] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:21:14 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:14.359664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c7579cb7-3ddf-4d58-a63f-7fda803f1f5d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:14.366458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c7579cb7-3ddf-4d58-a63f-7fda803f1f5d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:14.377097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7579cb7-3ddf-4d58-a63f-7fda803f1f5d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:14.403085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7579cb7-3ddf-4d58-a63f-7fda803f1f5d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:14.404385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7579cb7-3ddf-4d58-a63f-7fda803f1f5d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:14.405390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7579cb7-3ddf-4d58-a63f-7fda803f1f5d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:14.406073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7579cb7-3ddf-4d58-a63f-7fda803f1f5d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:14.406729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7579cb7-3ddf-4d58-a63f-7fda803f1f5d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:14.624520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2c2ce930-a375-48fa-8fd0-0f7437d414b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:14.634808 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2c2ce930-a375-48fa-8fd0-0f7437d414b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1309 microversion: 2.1 time: 0.903281 Oct 29 01:21:14.635399 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1952/4066] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:13 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1309 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:14.738055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7ac82277-467f-4a7e-bed2-f7a557eb0d01 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:14.739432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7ac82277-467f-4a7e-bed2-f7a557eb0d01 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:14.751242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ac82277-467f-4a7e-bed2-f7a557eb0d01 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:14.759824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ac82277-467f-4a7e-bed2-f7a557eb0d01 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:14.760543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ac82277-467f-4a7e-bed2-f7a557eb0d01 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:14.761511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ac82277-467f-4a7e-bed2-f7a557eb0d01 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:14.762154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ac82277-467f-4a7e-bed2-f7a557eb0d01 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:14.767567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ac82277-467f-4a7e-bed2-f7a557eb0d01 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:15.159130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c7579cb7-3ddf-4d58-a63f-7fda803f1f5d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:15.182633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c7579cb7-3ddf-4d58-a63f-7fda803f1f5d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:15.186722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c7579cb7-3ddf-4d58-a63f-7fda803f1f5d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:15.187953 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c7579cb7-3ddf-4d58-a63f-7fda803f1f5d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.832219 Oct 29 01:21:15.188533 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2115/4067] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:14 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:15.212010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bc5b5e78-1fd0-46b3-9448-7537b9ab4465 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:15.213180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bc5b5e78-1fd0-46b3-9448-7537b9ab4465 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:15.240479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc5b5e78-1fd0-46b3-9448-7537b9ab4465 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:15.244545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc5b5e78-1fd0-46b3-9448-7537b9ab4465 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:15.245872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc5b5e78-1fd0-46b3-9448-7537b9ab4465 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:15.246888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc5b5e78-1fd0-46b3-9448-7537b9ab4465 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:15.249828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc5b5e78-1fd0-46b3-9448-7537b9ab4465 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:15.253257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc5b5e78-1fd0-46b3-9448-7537b9ab4465 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:15.263098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7ac82277-467f-4a7e-bed2-f7a557eb0d01 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:15.279895 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7ac82277-467f-4a7e-bed2-f7a557eb0d01 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1675 microversion: 2.1 time: 0.540933 Oct 29 01:21:15.280803 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1953/4068] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:14 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1675 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:15.284870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:15.303653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-416be20b-0a7c-4533-979a-5c4e40d124d0 req-9c95f280-96dd-45d8-a1dc-a4a2a5c0cb57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb8e84ce-a371-428f-945a-e0e252cd1cff", "name": "network-vif-plugged", "status": "completed", "tag": "b6eb2077-13c3-44f4-864b-998f9c9207d9"}, {"server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "name": "network-vif-plugged", "status": "completed", "tag": "a02ac232-fcfa-478c-bfaf-1c208f69ee7a"}, {"server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "name": "network-vif-plugged", "status": "completed", "tag": "46be779f-3615-4867-b33c-2aacb76c8f8d"}, {"server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "name": "network-vif-plugged", "status": "completed", "tag": "b1d81c50-121c-4e21-adfd-a87f547012cc"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:15.344193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-416be20b-0a7c-4533-979a-5c4e40d124d0 req-9c95f280-96dd-45d8-a1dc-a4a2a5c0cb57 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:15.347222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-416be20b-0a7c-4533-979a-5c4e40d124d0 req-9c95f280-96dd-45d8-a1dc-a4a2a5c0cb57 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:15.359780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-416be20b-0a7c-4533-979a-5c4e40d124d0 req-9c95f280-96dd-45d8-a1dc-a4a2a5c0cb57 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:15.396306 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-416be20b-0a7c-4533-979a-5c4e40d124d0 req-9c95f280-96dd-45d8-a1dc-a4a2a5c0cb57 service nova] Creating event network-vif-plugged:b6eb2077-13c3-44f4-864b-998f9c9207d9 for instance cb8e84ce-a371-428f-945a-e0e252cd1cff on n-h1-862964-3 Oct 29 01:21:15.397265 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-416be20b-0a7c-4533-979a-5c4e40d124d0 req-9c95f280-96dd-45d8-a1dc-a4a2a5c0cb57 service nova] Creating event network-vif-plugged:a02ac232-fcfa-478c-bfaf-1c208f69ee7a for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:21:15.397976 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-416be20b-0a7c-4533-979a-5c4e40d124d0 req-9c95f280-96dd-45d8-a1dc-a4a2a5c0cb57 service nova] Creating event network-vif-plugged:46be779f-3615-4867-b33c-2aacb76c8f8d for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:21:15.398697 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-416be20b-0a7c-4533-979a-5c4e40d124d0 req-9c95f280-96dd-45d8-a1dc-a4a2a5c0cb57 service nova] Creating event network-vif-plugged:b1d81c50-121c-4e21-adfd-a87f547012cc for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:21:15.423295 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-416be20b-0a7c-4533-979a-5c4e40d124d0 req-9c95f280-96dd-45d8-a1dc-a4a2a5c0cb57 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.139408 Oct 29 01:21:15.431986 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1954/4069] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:15.459372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fa1db223-f385-47a7-a7aa-6a7f78f9172c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:15.461904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fa1db223-f385-47a7-a7aa-6a7f78f9172c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:15.493881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa1db223-f385-47a7-a7aa-6a7f78f9172c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:15.494668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa1db223-f385-47a7-a7aa-6a7f78f9172c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:15.496290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa1db223-f385-47a7-a7aa-6a7f78f9172c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:15.499844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa1db223-f385-47a7-a7aa-6a7f78f9172c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:15.501333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa1db223-f385-47a7-a7aa-6a7f78f9172c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:15.503261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa1db223-f385-47a7-a7aa-6a7f78f9172c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:15.676385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bc5b5e78-1fd0-46b3-9448-7537b9ab4465 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:15.689873 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bc5b5e78-1fd0-46b3-9448-7537b9ab4465 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1317 microversion: 2.1 time: 0.494290 Oct 29 01:21:15.695389 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2116/4070] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:15 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:15.718021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-db4551f5-1c8a-403a-948a-4509732ac38f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9797b040>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:15.751741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fa1db223-f385-47a7-a7aa-6a7f78f9172c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:15.762488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fa1db223-f385-47a7-a7aa-6a7f78f9172c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:15.766823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fa1db223-f385-47a7-a7aa-6a7f78f9172c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:15.774636 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fa1db223-f385-47a7-a7aa-6a7f78f9172c tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.332678 Oct 29 01:21:15.789130 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1955/4071] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:15 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:15.807876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-71240f20-6eb3-4391-a8cf-fae3c7d05050 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:15.809027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-71240f20-6eb3-4391-a8cf-fae3c7d05050 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:15.824736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71240f20-6eb3-4391-a8cf-fae3c7d05050 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:15.824736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71240f20-6eb3-4391-a8cf-fae3c7d05050 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:15.824736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71240f20-6eb3-4391-a8cf-fae3c7d05050 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:15.824736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71240f20-6eb3-4391-a8cf-fae3c7d05050 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:15.824736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71240f20-6eb3-4391-a8cf-fae3c7d05050 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:15.833434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71240f20-6eb3-4391-a8cf-fae3c7d05050 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:15.857556 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-db4551f5-1c8a-403a-948a-4509732ac38f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.154215 Oct 29 01:21:15.858216 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2117/4072] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:21:15 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:16.076184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-71240f20-6eb3-4391-a8cf-fae3c7d05050 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:16.085486 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-71240f20-6eb3-4391-a8cf-fae3c7d05050 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1309 microversion: 2.1 time: 0.294641 Oct 29 01:21:16.086842 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1956/4073] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:15 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1309 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:16.222812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-37b51f1a-2960-4add-a57b-edf3f0d0df49 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:16.223435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-37b51f1a-2960-4add-a57b-edf3f0d0df49 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:16.237975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37b51f1a-2960-4add-a57b-edf3f0d0df49 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:16.238389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37b51f1a-2960-4add-a57b-edf3f0d0df49 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:16.238829 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37b51f1a-2960-4add-a57b-edf3f0d0df49 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:16.239542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37b51f1a-2960-4add-a57b-edf3f0d0df49 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:16.240045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37b51f1a-2960-4add-a57b-edf3f0d0df49 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:16.240550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37b51f1a-2960-4add-a57b-edf3f0d0df49 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:16.326887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ec14d849-e7d2-4cb0-b639-207901723249 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:16.326887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ec14d849-e7d2-4cb0-b639-207901723249 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:16.340053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec14d849-e7d2-4cb0-b639-207901723249 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:16.344585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec14d849-e7d2-4cb0-b639-207901723249 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:16.346729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec14d849-e7d2-4cb0-b639-207901723249 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:16.352130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec14d849-e7d2-4cb0-b639-207901723249 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:16.354644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec14d849-e7d2-4cb0-b639-207901723249 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:16.356874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec14d849-e7d2-4cb0-b639-207901723249 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:16.733279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-37b51f1a-2960-4add-a57b-edf3f0d0df49 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:16.749109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-37b51f1a-2960-4add-a57b-edf3f0d0df49 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:16.750424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-37b51f1a-2960-4add-a57b-edf3f0d0df49 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:16.751606 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-37b51f1a-2960-4add-a57b-edf3f0d0df49 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 0.535280 Oct 29 01:21:16.754234 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2118/4074] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:16 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:16.760306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4b655e5e-8672-40e2-b222-32ec2b7e6c38 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:16.760306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4b655e5e-8672-40e2-b222-32ec2b7e6c38 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:16.761079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ec14d849-e7d2-4cb0-b639-207901723249 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:16.774856 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ec14d849-e7d2-4cb0-b639-207901723249 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1675 microversion: 2.1 time: 0.460613 Oct 29 01:21:16.774856 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1957/4075] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:16 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1675 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:16.777269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b655e5e-8672-40e2-b222-32ec2b7e6c38 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:16.779141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b655e5e-8672-40e2-b222-32ec2b7e6c38 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:16.779884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b655e5e-8672-40e2-b222-32ec2b7e6c38 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:16.782642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b655e5e-8672-40e2-b222-32ec2b7e6c38 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:16.787300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b655e5e-8672-40e2-b222-32ec2b7e6c38 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:16.787300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b655e5e-8672-40e2-b222-32ec2b7e6c38 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:16.810256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6aab60a5-82cd-4482-9434-204a71d6d474 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:16.811132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6aab60a5-82cd-4482-9434-204a71d6d474 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:16.824047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6aab60a5-82cd-4482-9434-204a71d6d474 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:16.824926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6aab60a5-82cd-4482-9434-204a71d6d474 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:16.825565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6aab60a5-82cd-4482-9434-204a71d6d474 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:16.827286 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6aab60a5-82cd-4482-9434-204a71d6d474 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:16.828515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6aab60a5-82cd-4482-9434-204a71d6d474 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:16.829171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6aab60a5-82cd-4482-9434-204a71d6d474 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:17.028434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6aab60a5-82cd-4482-9434-204a71d6d474 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:17.044576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6aab60a5-82cd-4482-9434-204a71d6d474 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:17.050558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6aab60a5-82cd-4482-9434-204a71d6d474 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:17.055492 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6aab60a5-82cd-4482-9434-204a71d6d474 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.247571 Oct 29 01:21:17.069131 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1958/4076] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:16 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:17.075642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e592f5d6-7787-4dfc-87b0-8b2f7f157ef4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9fd77a60>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:17.106839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4b655e5e-8672-40e2-b222-32ec2b7e6c38 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:17.124669 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4b655e5e-8672-40e2-b222-32ec2b7e6c38 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1317 microversion: 2.1 time: 0.369155 Oct 29 01:21:17.126728 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2119/4077] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:16 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:17.133279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8041efcd-e892-49ce-ab40-663799232c3b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:17.133279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8041efcd-e892-49ce-ab40-663799232c3b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:17.141525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8041efcd-e892-49ce-ab40-663799232c3b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:17.142220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8041efcd-e892-49ce-ab40-663799232c3b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:17.142788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8041efcd-e892-49ce-ab40-663799232c3b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:17.143796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8041efcd-e892-49ce-ab40-663799232c3b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:17.144496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8041efcd-e892-49ce-ab40-663799232c3b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:17.145097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8041efcd-e892-49ce-ab40-663799232c3b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:17.238089 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e592f5d6-7787-4dfc-87b0-8b2f7f157ef4 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1413 microversion: 2.1 time: 0.166155 Oct 29 01:21:17.238828 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1959/4078] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:21:17 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1413 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:17.445421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-f767f130-90cb-44c2-9613-a9c129bb821a req-968bd635-f540-4e98-acc5-955d1ca8a1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "name": "network-vif-plugged", "status": "completed", "tag": "4ebf9678-ed9a-4016-bd19-cc21fccd57ef"}, {"server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "name": "network-vif-plugged", "status": "completed", "tag": "e3cb24be-1f0b-4f1e-8954-12fc1365bfd4"}, {"server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "name": "network-vif-plugged", "status": "completed", "tag": "44b552d3-db18-4618-bee3-f48ae965062f"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:17.478227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f767f130-90cb-44c2-9613-a9c129bb821a req-968bd635-f540-4e98-acc5-955d1ca8a1e7 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:17.479163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f767f130-90cb-44c2-9613-a9c129bb821a req-968bd635-f540-4e98-acc5-955d1ca8a1e7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:17.479922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f767f130-90cb-44c2-9613-a9c129bb821a req-968bd635-f540-4e98-acc5-955d1ca8a1e7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:17.530306 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f767f130-90cb-44c2-9613-a9c129bb821a req-968bd635-f540-4e98-acc5-955d1ca8a1e7 service nova] Creating event network-vif-plugged:4ebf9678-ed9a-4016-bd19-cc21fccd57ef for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:21:17.530799 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f767f130-90cb-44c2-9613-a9c129bb821a req-968bd635-f540-4e98-acc5-955d1ca8a1e7 service nova] Creating event network-vif-plugged:e3cb24be-1f0b-4f1e-8954-12fc1365bfd4 for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:21:17.531605 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f767f130-90cb-44c2-9613-a9c129bb821a req-968bd635-f540-4e98-acc5-955d1ca8a1e7 service nova] Creating event network-vif-plugged:44b552d3-db18-4618-bee3-f48ae965062f for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:21:17.548629 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-f767f130-90cb-44c2-9613-a9c129bb821a req-968bd635-f540-4e98-acc5-955d1ca8a1e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.107349 Oct 29 01:21:17.553872 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1960/4079] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:17.638513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8041efcd-e892-49ce-ab40-663799232c3b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:17.659679 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8041efcd-e892-49ce-ab40-663799232c3b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1309 microversion: 2.1 time: 0.531657 Oct 29 01:21:17.665919 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2120/4080] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:17 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1309 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:17.789475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5be21a3c-eed8-4f4e-b20f-da823097c960 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:17.793019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5be21a3c-eed8-4f4e-b20f-da823097c960 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:17.800075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6f7ba795-f4b1-4cf2-b3f0-aa88ad6c5acd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:17.800978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6f7ba795-f4b1-4cf2-b3f0-aa88ad6c5acd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:17.815231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5be21a3c-eed8-4f4e-b20f-da823097c960 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:17.815795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5be21a3c-eed8-4f4e-b20f-da823097c960 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:17.816250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5be21a3c-eed8-4f4e-b20f-da823097c960 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:17.817567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f7ba795-f4b1-4cf2-b3f0-aa88ad6c5acd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:17.820199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5be21a3c-eed8-4f4e-b20f-da823097c960 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:17.820523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f7ba795-f4b1-4cf2-b3f0-aa88ad6c5acd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:17.820739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5be21a3c-eed8-4f4e-b20f-da823097c960 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:17.821198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5be21a3c-eed8-4f4e-b20f-da823097c960 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:17.821433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f7ba795-f4b1-4cf2-b3f0-aa88ad6c5acd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:17.822316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f7ba795-f4b1-4cf2-b3f0-aa88ad6c5acd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:17.829735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f7ba795-f4b1-4cf2-b3f0-aa88ad6c5acd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:17.832408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f7ba795-f4b1-4cf2-b3f0-aa88ad6c5acd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:18.418108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6f7ba795-f4b1-4cf2-b3f0-aa88ad6c5acd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:18.428238 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6f7ba795-f4b1-4cf2-b3f0-aa88ad6c5acd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1675 microversion: 2.1 time: 0.632210 Oct 29 01:21:18.428824 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2121/4081] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:17 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1675 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:18.448953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e43520e6-2025-4248-aa3a-02bee411bff6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:18.450164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e43520e6-2025-4248-aa3a-02bee411bff6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:18.480048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e43520e6-2025-4248-aa3a-02bee411bff6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:18.483927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e43520e6-2025-4248-aa3a-02bee411bff6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:18.484651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e43520e6-2025-4248-aa3a-02bee411bff6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:18.486770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e43520e6-2025-4248-aa3a-02bee411bff6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:18.487260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e43520e6-2025-4248-aa3a-02bee411bff6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:18.487694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e43520e6-2025-4248-aa3a-02bee411bff6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:18.890581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e43520e6-2025-4248-aa3a-02bee411bff6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:18.909342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e43520e6-2025-4248-aa3a-02bee411bff6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:18.914668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e43520e6-2025-4248-aa3a-02bee411bff6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:18.918068 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e43520e6-2025-4248-aa3a-02bee411bff6 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.488067 Oct 29 01:21:18.929874 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2122/4082] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:18 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:18.943794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0c7fe07e-dfe8-4256-9a9b-6eb5e794c3c4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:18.944729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0c7fe07e-dfe8-4256-9a9b-6eb5e794c3c4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:18.951843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c7fe07e-dfe8-4256-9a9b-6eb5e794c3c4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:18.952662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c7fe07e-dfe8-4256-9a9b-6eb5e794c3c4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:18.953367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c7fe07e-dfe8-4256-9a9b-6eb5e794c3c4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:18.954368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c7fe07e-dfe8-4256-9a9b-6eb5e794c3c4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:18.955085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c7fe07e-dfe8-4256-9a9b-6eb5e794c3c4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:18.955833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c7fe07e-dfe8-4256-9a9b-6eb5e794c3c4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:18.956336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5be21a3c-eed8-4f4e-b20f-da823097c960 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:18.986419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5be21a3c-eed8-4f4e-b20f-da823097c960 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:18.991521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5be21a3c-eed8-4f4e-b20f-da823097c960 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:18.992848 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5be21a3c-eed8-4f4e-b20f-da823097c960 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1880 microversion: 2.32 time: 1.208621 Oct 29 01:21:19.020171 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1961/4083] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:17 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1880 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:19.030716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eb60a231-50ad-4448-ac8e-bb637047ab59 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d971400d0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:19.114769 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-eb60a231-50ad-4448-ac8e-bb637047ab59 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1422 microversion: 2.1 time: 0.093374 Oct 29 01:21:19.117332 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1962/4084] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:21:19 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1422 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:19.128128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-61c0c51c-5ffb-42a7-a2be-7d4373e5ebfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:19.128758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-61c0c51c-5ffb-42a7-a2be-7d4373e5ebfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:19.150354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61c0c51c-5ffb-42a7-a2be-7d4373e5ebfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:19.150995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61c0c51c-5ffb-42a7-a2be-7d4373e5ebfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:19.151439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61c0c51c-5ffb-42a7-a2be-7d4373e5ebfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:19.152522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61c0c51c-5ffb-42a7-a2be-7d4373e5ebfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:19.152983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61c0c51c-5ffb-42a7-a2be-7d4373e5ebfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:19.153438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61c0c51c-5ffb-42a7-a2be-7d4373e5ebfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:19.544607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0c7fe07e-dfe8-4256-9a9b-6eb5e794c3c4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:19.560513 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0c7fe07e-dfe8-4256-9a9b-6eb5e794c3c4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1317 microversion: 2.1 time: 0.628953 Oct 29 01:21:19.561659 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2123/4085] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:18 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1317 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:19.574516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8d06746a-df51-4964-bc4b-4f75b04ff7df tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9770d5e0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:19.645990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-61c0c51c-5ffb-42a7-a2be-7d4373e5ebfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:19.668351 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-61c0c51c-5ffb-42a7-a2be-7d4373e5ebfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1309 microversion: 2.1 time: 0.549955 Oct 29 01:21:19.670662 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8d06746a-df51-4964-bc4b-4f75b04ff7df tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 200 len: 1422 microversion: 2.1 time: 0.107651 Oct 29 01:21:19.671572 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1963/4086] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:19 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1309 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:19.683694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-20e75799-0366-4801-aa26-bdb80e4ead1a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:19.684558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-20e75799-0366-4801-aa26-bdb80e4ead1a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:19.697121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20e75799-0366-4801-aa26-bdb80e4ead1a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:19.701141 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2124/4087] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:21:19 2022] GET /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 1422 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:19.704673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20e75799-0366-4801-aa26-bdb80e4ead1a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:19.715141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20e75799-0366-4801-aa26-bdb80e4ead1a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:19.715141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20e75799-0366-4801-aa26-bdb80e4ead1a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:19.715141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20e75799-0366-4801-aa26-bdb80e4ead1a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:19.715141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20e75799-0366-4801-aa26-bdb80e4ead1a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:19.849093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2d07df8e-4820-4fb6-a575-e659686eeded tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Action: 'create', calling method: .version_select at 0x7f9d96c2e9d0>, body: {"keypair": {"name": "tempest-keypair-1996099057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTu6tnvGqJU70PKtNhNYl+2mA6p6ueV5PRPoD1FskHbXjqOTDv1YJTkACkEuQs7PidthFARmrMOnviY5hw3M2ICX3sgwxp4Y4wFbIje6P4A0z7DNccAFISrVDSrAXyjRA=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:19.875437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-2d07df8e-4820-4fb6-a575-e659686eeded tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Getting quotas for project 39133f363c084812920780d4eb6d227b. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:21:19.883468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-2d07df8e-4820-4fb6-a575-e659686eeded tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Getting quotas for user 8d3714617f36472f8e4b1d55887cdefc and project 39133f363c084812920780d4eb6d227b. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:21:19.996656 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2d07df8e-4820-4fb6-a575-e659686eeded tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.292589 Oct 29 01:21:19.997362 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2125/4088] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:21:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:20.002241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d387aed5-88e3-4c9b-8c60-425199e00340 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-543883655", "imageRef": "c7dea790-48ba-4f98-a2aa-990eff60d130", "flavorRef": "452", "networks": [{"uuid": "417ddcf9-7930-440b-995d-5ce0b1f48a9f"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:20.133061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-d387aed5-88e3-4c9b-8c60-425199e00340 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] validate_networks() for [('417ddcf9-7930-440b-995d-5ce0b1f48a9f', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:21:20.248115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-20e75799-0366-4801-aa26-bdb80e4ead1a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:20.275675 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-20e75799-0366-4801-aa26-bdb80e4ead1a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1675 microversion: 2.1 time: 0.598209 Oct 29 01:21:20.276831 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1964/4089] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:19 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1675 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:20.289985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8c22c481-625d-4f37-8bcc-95c4455b2e6b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:20.290899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8c22c481-625d-4f37-8bcc-95c4455b2e6b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:20.306391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c22c481-625d-4f37-8bcc-95c4455b2e6b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:20.307170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c22c481-625d-4f37-8bcc-95c4455b2e6b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:20.307793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c22c481-625d-4f37-8bcc-95c4455b2e6b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:20.309837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c22c481-625d-4f37-8bcc-95c4455b2e6b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:20.310520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c22c481-625d-4f37-8bcc-95c4455b2e6b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:20.311154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c22c481-625d-4f37-8bcc-95c4455b2e6b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:20.534284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8c22c481-625d-4f37-8bcc-95c4455b2e6b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:20.553924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8c22c481-625d-4f37-8bcc-95c4455b2e6b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:20.557403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8c22c481-625d-4f37-8bcc-95c4455b2e6b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b1364600ce14da69e3b735cafac00d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcdbf3d7bd4e48961102aa20056235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:20.564344 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8c22c481-625d-4f37-8bcc-95c4455b2e6b tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 200 len: 1605 microversion: 2.42 time: 0.285127 Oct 29 01:21:20.589266 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1965/4090] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:20 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 1605 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:20.596046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-66a2309d-10e9-4bd6-92fc-e541547dc17d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:20.601078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-66a2309d-10e9-4bd6-92fc-e541547dc17d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:20.610515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66a2309d-10e9-4bd6-92fc-e541547dc17d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:20.611539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66a2309d-10e9-4bd6-92fc-e541547dc17d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:20.625260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66a2309d-10e9-4bd6-92fc-e541547dc17d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:20.625260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66a2309d-10e9-4bd6-92fc-e541547dc17d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:20.625260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66a2309d-10e9-4bd6-92fc-e541547dc17d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:20.625260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66a2309d-10e9-4bd6-92fc-e541547dc17d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:21.415677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-66a2309d-10e9-4bd6-92fc-e541547dc17d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:21.432024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-66a2309d-10e9-4bd6-92fc-e541547dc17d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:21.434157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-66a2309d-10e9-4bd6-92fc-e541547dc17d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:21.436141 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-66a2309d-10e9-4bd6-92fc-e541547dc17d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 2832 microversion: 2.32 time: 0.844345 Oct 29 01:21:21.451953 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1966/4091] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:20 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 2832 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:21.462710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2038cab2-cdca-4f30-846b-bf688f11b2c1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:21.462710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2038cab2-cdca-4f30-846b-bf688f11b2c1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:21.473033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2038cab2-cdca-4f30-846b-bf688f11b2c1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:21.474008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2038cab2-cdca-4f30-846b-bf688f11b2c1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:21.475554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2038cab2-cdca-4f30-846b-bf688f11b2c1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:21.478296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2038cab2-cdca-4f30-846b-bf688f11b2c1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:21.479056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2038cab2-cdca-4f30-846b-bf688f11b2c1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:21.480465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2038cab2-cdca-4f30-846b-bf688f11b2c1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:21.720407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-d387aed5-88e3-4c9b-8c60-425199e00340 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:21:21.725557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-d387aed5-88e3-4c9b-8c60-425199e00340 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:21:21.726957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-d387aed5-88e3-4c9b-8c60-425199e00340 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:21:21.727726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-d387aed5-88e3-4c9b-8c60-425199e00340 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:21:21.728324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-d387aed5-88e3-4c9b-8c60-425199e00340 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:21:21.769895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d387aed5-88e3-4c9b-8c60-425199e00340 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:21.770410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d387aed5-88e3-4c9b-8c60-425199e00340 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:21.770890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d387aed5-88e3-4c9b-8c60-425199e00340 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:21.772205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d387aed5-88e3-4c9b-8c60-425199e00340 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:21.772668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d387aed5-88e3-4c9b-8c60-425199e00340 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:21.773102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d387aed5-88e3-4c9b-8c60-425199e00340 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:21.829626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-d387aed5-88e3-4c9b-8c60-425199e00340 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Getting quotas for project b284e70790cf43e2b474559bb3e20faf. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:21:21.838789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-d387aed5-88e3-4c9b-8c60-425199e00340 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Getting quotas for user a35b358af11846f78debaf9e422a9558 and project b284e70790cf43e2b474559bb3e20faf. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:21:21.856677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d387aed5-88e3-4c9b-8c60-425199e00340 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:21:21.868377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d387aed5-88e3-4c9b-8c60-425199e00340 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7dea790-48ba-4f98-a2aa-990eff60d130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:21:21.973040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2038cab2-cdca-4f30-846b-bf688f11b2c1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:21.987006 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2038cab2-cdca-4f30-846b-bf688f11b2c1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1317 microversion: 2.1 time: 0.539202 Oct 29 01:21:21.987729 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1967/4092] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:21 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1317 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:22.011398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-47c929df-a1b0-42b1-9aba-78d4324efc93 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:22.012311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-47c929df-a1b0-42b1-9aba-78d4324efc93 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:22.019173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47c929df-a1b0-42b1-9aba-78d4324efc93 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:22.019657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47c929df-a1b0-42b1-9aba-78d4324efc93 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:22.020313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47c929df-a1b0-42b1-9aba-78d4324efc93 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:22.021021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47c929df-a1b0-42b1-9aba-78d4324efc93 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:22.037799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47c929df-a1b0-42b1-9aba-78d4324efc93 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:22.038247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47c929df-a1b0-42b1-9aba-78d4324efc93 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:22.045451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:22.047397 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d387aed5-88e3-4c9b-8c60-425199e00340 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.046847 Oct 29 01:21:22.048682 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2126/4093] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:21:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:21:22.059365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ec374996-a545-4a31-93c8-5bcdb325ff04 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:22.062604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ec374996-a545-4a31-93c8-5bcdb325ff04 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:22.074967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec374996-a545-4a31-93c8-5bcdb325ff04 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:22.078720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec374996-a545-4a31-93c8-5bcdb325ff04 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:22.081086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec374996-a545-4a31-93c8-5bcdb325ff04 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:22.081881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec374996-a545-4a31-93c8-5bcdb325ff04 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:22.085306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec374996-a545-4a31-93c8-5bcdb325ff04 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:22.093917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec374996-a545-4a31-93c8-5bcdb325ff04 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:22.479176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-47c929df-a1b0-42b1-9aba-78d4324efc93 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:22.489807 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-47c929df-a1b0-42b1-9aba-78d4324efc93 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1489 microversion: 2.1 time: 0.483086 Oct 29 01:21:22.491228 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1968/4094] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:21 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1489 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:22.501287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-96e94a3b-8618-4d00-b970-628e3219b3a6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:22.502713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-96e94a3b-8618-4d00-b970-628e3219b3a6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:22.512444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96e94a3b-8618-4d00-b970-628e3219b3a6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:22.513855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96e94a3b-8618-4d00-b970-628e3219b3a6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:22.514660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96e94a3b-8618-4d00-b970-628e3219b3a6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:22.516395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96e94a3b-8618-4d00-b970-628e3219b3a6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:22.517106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96e94a3b-8618-4d00-b970-628e3219b3a6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:22.517796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96e94a3b-8618-4d00-b970-628e3219b3a6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:22.565837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ec374996-a545-4a31-93c8-5bcdb325ff04 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:22.586702 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ec374996-a545-4a31-93c8-5bcdb325ff04 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1675 microversion: 2.1 time: 0.536827 Oct 29 01:21:22.589883 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2127/4095] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:22 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1675 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:22.608596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7f9cb540-c80f-434e-932f-a3d7b5aacfea tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:22.616204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7f9cb540-c80f-434e-932f-a3d7b5aacfea tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:22.632866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f9cb540-c80f-434e-932f-a3d7b5aacfea tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:22.633446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f9cb540-c80f-434e-932f-a3d7b5aacfea tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:22.633895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f9cb540-c80f-434e-932f-a3d7b5aacfea tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:22.634617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f9cb540-c80f-434e-932f-a3d7b5aacfea tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:22.635082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f9cb540-c80f-434e-932f-a3d7b5aacfea tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:22.638331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f9cb540-c80f-434e-932f-a3d7b5aacfea tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:22.660575 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-7f9cb540-c80f-434e-932f-a3d7b5aacfea tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] HTTP exception thrown: Instance b3345ee8-a785-4802-a558-b6880b949635 could not be found. Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7f9cb540-c80f-434e-932f-a3d7b5aacfea tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Request method failure captured: Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 HTTP/1.1 Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH4aFhIcs6vMVqlXB9iHvo7_NMbUt-qUjhcZpxeIgf3T4WsmD9UNket0Ov76YFH6ZsQMT69F7X0aZhWxSaVdWiyxe-lPmFE1afOvClCkyXaLu0H3VoYuDHznVbhF1o8F7LZmR9oi7v8ixVK26ux3KbRcUItNgTl64EjoPraSqAs3BIs Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.42 Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: c1fcdbf3d7bd4e48961102aa20056235 Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-842093315 Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1fcdbf3d7bd4e48961102aa20056235"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c1fcdbf3d7bd4e48961102aa20056235"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1fcdbf3d7bd4e48961102aa20056235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c1fcdbf3d7bd4e48961102aa20056235", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-TaggedBootDevicesTest_v242-842093315 Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: c1fcdbf3d7bd4e48961102aa20056235 Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-842093315 Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-TaggedBootDevicesTest_v242-842093315-project Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 4b1364600ce14da69e3b735cafac00d9 Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-TaggedBootDevicesTest_v242-842093315-project Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance b3345ee8-a785-4802-a558-b6880b949635 could not be found. Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'b3345ee8-a785-4802-a558-b6880b949635'} Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3345ee8-a785-4802-a558-b6880b949635 could not be found. Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3345ee8-a785-4802-a558-b6880b949635 could not be found. Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:22.662617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:22.669121 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:22.669121 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:22.669121 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:22.669121 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:22.669121 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:21:22.669121 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:21:22.669121 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3345ee8-a785-4802-a558-b6880b949635 could not be found. Oct 29 01:21:22.669121 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:22.671989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7f9cb540-c80f-434e-932f-a3d7b5aacfea tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Returning 404 to user: Instance b3345ee8-a785-4802-a558-b6880b949635 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:22.673356 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7f9cb540-c80f-434e-932f-a3d7b5aacfea tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 404 len: 111 microversion: 2.42 time: 0.081957 Oct 29 01:21:22.680196 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2128/4096] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:22 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:21:22.686322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-449eb63f-36bd-4353-aeef-9402c281214a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:22.687683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-449eb63f-36bd-4353-aeef-9402c281214a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:22.825466 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-96e94a3b-8618-4d00-b970-628e3219b3a6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.331436 Oct 29 01:21:22.826496 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1969/4097] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Oct 29 01:21:22 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9/os-interface => generated 1830 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:22.831297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-7ba5aec6-c4c7-4413-9f84-00231cbf83e5 req-5076306c-7fad-4fc5-b9e0-b43e764dc759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac895d78-7d15-451d-a60f-4e80afb0241a", "name": "network-vif-plugged", "status": "completed", "tag": "c7a74419-3a70-4ceb-b0db-4fdeeca001b3"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:22.843524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7ba5aec6-c4c7-4413-9f84-00231cbf83e5 req-5076306c-7fad-4fc5-b9e0-b43e764dc759 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:22.844017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7ba5aec6-c4c7-4413-9f84-00231cbf83e5 req-5076306c-7fad-4fc5-b9e0-b43e764dc759 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:22.844447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7ba5aec6-c4c7-4413-9f84-00231cbf83e5 req-5076306c-7fad-4fc5-b9e0-b43e764dc759 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:22.853859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-449eb63f-36bd-4353-aeef-9402c281214a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:22.863481 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-449eb63f-36bd-4353-aeef-9402c281214a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1207 microversion: 2.1 time: 0.181782 Oct 29 01:21:22.877776 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-7ba5aec6-c4c7-4413-9f84-00231cbf83e5 req-5076306c-7fad-4fc5-b9e0-b43e764dc759 service nova] Creating event network-vif-plugged:c7a74419-3a70-4ceb-b0db-4fdeeca001b3 for instance ac895d78-7d15-451d-a60f-4e80afb0241a on n-h1-862964-3 Oct 29 01:21:22.883316 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2129/4098] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:22 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1207 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:22.883968 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-7ba5aec6-c4c7-4413-9f84-00231cbf83e5 req-5076306c-7fad-4fc5-b9e0-b43e764dc759 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056216 Oct 29 01:21:22.884583 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1970/4099] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:22.894556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ceeaf0b5-47cf-41b7-9e04-cd84c2351917 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1069694133"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:22.894556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ceeaf0b5-47cf-41b7-9e04-cd84c2351917 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:22.895269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-63b598d2-3b4a-4028-b744-27acc6206d0a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '.version_select at 0x7f9d97165f70>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:22.908115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ceeaf0b5-47cf-41b7-9e04-cd84c2351917 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:22.909066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ceeaf0b5-47cf-41b7-9e04-cd84c2351917 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:22.910034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ceeaf0b5-47cf-41b7-9e04-cd84c2351917 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:22.911021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ceeaf0b5-47cf-41b7-9e04-cd84c2351917 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:22.911885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ceeaf0b5-47cf-41b7-9e04-cd84c2351917 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:22.913478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ceeaf0b5-47cf-41b7-9e04-cd84c2351917 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:23.013883 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-63b598d2-3b4a-4028-b744-27acc6206d0a tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311749174" status: 204 len: 0 microversion: 2.42 time: 0.114568 Oct 29 01:21:23.013883 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1971/4100] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 29 01:21:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311749174 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:21:23.015702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d3727da3-846a-463e-96e3-9ff4689ab217 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:23.016827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d3727da3-846a-463e-96e3-9ff4689ab217 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:23.035287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3727da3-846a-463e-96e3-9ff4689ab217 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:23.036101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3727da3-846a-463e-96e3-9ff4689ab217 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:23.038251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3727da3-846a-463e-96e3-9ff4689ab217 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:23.039182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3727da3-846a-463e-96e3-9ff4689ab217 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:23.059575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3727da3-846a-463e-96e3-9ff4689ab217 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:23.059575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3727da3-846a-463e-96e3-9ff4689ab217 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:23.086523 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ceeaf0b5-47cf-41b7-9e04-cd84c2351917 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "PUT /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1074 microversion: 2.1 time: 0.200500 Oct 29 01:21:23.089503 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2130/4101] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 29 01:21:22 2022] PUT /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1074 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:23.112111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-db6e0051-c532-490f-886a-863ad82ca56b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:23.113344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-db6e0051-c532-490f-886a-863ad82ca56b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:23.127213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db6e0051-c532-490f-886a-863ad82ca56b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:23.127976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db6e0051-c532-490f-886a-863ad82ca56b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:23.128585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db6e0051-c532-490f-886a-863ad82ca56b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:23.130118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db6e0051-c532-490f-886a-863ad82ca56b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:23.131558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db6e0051-c532-490f-886a-863ad82ca56b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:23.133943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db6e0051-c532-490f-886a-863ad82ca56b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:23.596022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d3727da3-846a-463e-96e3-9ff4689ab217 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:23.608447 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d3727da3-846a-463e-96e3-9ff4689ab217 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1317 microversion: 2.1 time: 0.599312 Oct 29 01:21:23.617851 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1972/4102] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:23 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1317 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:23.617851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ac79273e-c8ac-414f-a9a2-d1b01108625a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-963750850", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "99a92c6d-3381-4497-8269-da902d0c5a11"}], "security_groups": [{"name": "tempest-securitygroup--964573374"}], "key_name": "tempest-keypair-1996099057", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:23.661931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-db6e0051-c532-490f-886a-863ad82ca56b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:23.681555 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-db6e0051-c532-490f-886a-863ad82ca56b tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1500 microversion: 2.1 time: 0.564691 Oct 29 01:21:23.694672 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2131/4103] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:23 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1500 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:23.710423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-17056823-14d1-408d-b739-fcb358fa5a05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:23.711043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-17056823-14d1-408d-b739-fcb358fa5a05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:23.718649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17056823-14d1-408d-b739-fcb358fa5a05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:23.719233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17056823-14d1-408d-b739-fcb358fa5a05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:23.719750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17056823-14d1-408d-b739-fcb358fa5a05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:23.720577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17056823-14d1-408d-b739-fcb358fa5a05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:23.721106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17056823-14d1-408d-b739-fcb358fa5a05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:23.721628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17056823-14d1-408d-b739-fcb358fa5a05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:23.947521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-ac79273e-c8ac-414f-a9a2-d1b01108625a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] validate_networks() for [('99a92c6d-3381-4497-8269-da902d0c5a11', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:21:24.436657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-17056823-14d1-408d-b739-fcb358fa5a05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:24.449510 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-17056823-14d1-408d-b739-fcb358fa5a05 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1652 microversion: 2.1 time: 0.752999 Oct 29 01:21:24.450105 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2132/4104] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:23 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1652 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:24.457705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8f102b50-f110-4903-8b03-42b673b9862a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:24.459721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8f102b50-f110-4903-8b03-42b673b9862a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:24.470974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f102b50-f110-4903-8b03-42b673b9862a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:24.471950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f102b50-f110-4903-8b03-42b673b9862a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:24.472925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f102b50-f110-4903-8b03-42b673b9862a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:24.473930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f102b50-f110-4903-8b03-42b673b9862a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:24.474738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f102b50-f110-4903-8b03-42b673b9862a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:24.475723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f102b50-f110-4903-8b03-42b673b9862a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:24.903669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:25.084594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8f102b50-f110-4903-8b03-42b673b9862a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:25.098320 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8f102b50-f110-4903-8b03-42b673b9862a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1500 microversion: 2.1 time: 0.646854 Oct 29 01:21:25.100806 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2133/4105] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:24 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1500 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:25.109500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e20784f2-ca29-402d-83b4-cdd83e419ad8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:25.110307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e20784f2-ca29-402d-83b4-cdd83e419ad8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:25.118296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e20784f2-ca29-402d-83b4-cdd83e419ad8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:25.119048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e20784f2-ca29-402d-83b4-cdd83e419ad8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:25.119662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e20784f2-ca29-402d-83b4-cdd83e419ad8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:25.120564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e20784f2-ca29-402d-83b4-cdd83e419ad8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:25.121026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e20784f2-ca29-402d-83b4-cdd83e419ad8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:25.121495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e20784f2-ca29-402d-83b4-cdd83e419ad8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:25.259256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e20784f2-ca29-402d-83b4-cdd83e419ad8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:25.268598 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e20784f2-ca29-402d-83b4-cdd83e419ad8 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1259 microversion: 2.1 time: 0.166454 Oct 29 01:21:25.278535 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2134/4106] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:25 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:25.283589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-56a5e39c-3b3e-4798-bf45-e4ec927e575d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:25.301564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56a5e39c-3b3e-4798-bf45-e4ec927e575d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:25.302583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56a5e39c-3b3e-4798-bf45-e4ec927e575d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:25.303263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56a5e39c-3b3e-4798-bf45-e4ec927e575d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:25.329364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-56a5e39c-3b3e-4798-bf45-e4ec927e575d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Going to try to start instance {{(pid=121099) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 01:21:25.564078 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-56a5e39c-3b3e-4798-bf45-e4ec927e575d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "POST /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3/action" status: 202 len: 0 microversion: 2.1 time: 0.284150 Oct 29 01:21:25.564760 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2135/4107] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:21:25 2022] POST /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:21:25.579700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb1a7441-3843-4260-8158-41f7bf94eb3b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:25.580829 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bb1a7441-3843-4260-8158-41f7bf94eb3b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:25.596335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb1a7441-3843-4260-8158-41f7bf94eb3b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:25.598559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb1a7441-3843-4260-8158-41f7bf94eb3b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:25.599832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb1a7441-3843-4260-8158-41f7bf94eb3b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:25.601812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb1a7441-3843-4260-8158-41f7bf94eb3b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:25.602661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb1a7441-3843-4260-8158-41f7bf94eb3b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:25.606653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb1a7441-3843-4260-8158-41f7bf94eb3b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:25.649499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:25.662366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ac79273e-c8ac-414f-a9a2-d1b01108625a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:21:25.662881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ac79273e-c8ac-414f-a9a2-d1b01108625a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:21:25.663361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ac79273e-c8ac-414f-a9a2-d1b01108625a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:21:25.663772 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ac79273e-c8ac-414f-a9a2-d1b01108625a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:21:25.664195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ac79273e-c8ac-414f-a9a2-d1b01108625a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:21:25.687301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac79273e-c8ac-414f-a9a2-d1b01108625a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:25.687928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac79273e-c8ac-414f-a9a2-d1b01108625a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:25.688634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac79273e-c8ac-414f-a9a2-d1b01108625a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:25.690931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac79273e-c8ac-414f-a9a2-d1b01108625a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:25.693782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac79273e-c8ac-414f-a9a2-d1b01108625a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:25.694956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac79273e-c8ac-414f-a9a2-d1b01108625a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:25.790384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-ac79273e-c8ac-414f-a9a2-d1b01108625a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Getting quotas for project 39133f363c084812920780d4eb6d227b. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:21:25.800303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-ac79273e-c8ac-414f-a9a2-d1b01108625a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Getting quotas for user 8d3714617f36472f8e4b1d55887cdefc and project 39133f363c084812920780d4eb6d227b. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:21:25.830913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ac79273e-c8ac-414f-a9a2-d1b01108625a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:21:25.832133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ac79273e-c8ac-414f-a9a2-d1b01108625a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:21:25.842165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bb1a7441-3843-4260-8158-41f7bf94eb3b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:25.850551 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bb1a7441-3843-4260-8158-41f7bf94eb3b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1505 microversion: 2.1 time: 0.284255 Oct 29 01:21:25.854594 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2136/4108] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:25 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1505 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:25.859495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-35034ba1-1b7a-456e-ac83-17f03936745f req-211e6153-6bc1-44ad-9c4d-090c0b0d4c70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "tag": "b1d81c50-121c-4e21-adfd-a87f547012cc"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:25.870424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-35034ba1-1b7a-456e-ac83-17f03936745f req-211e6153-6bc1-44ad-9c4d-090c0b0d4c70 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:25.871186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-35034ba1-1b7a-456e-ac83-17f03936745f req-211e6153-6bc1-44ad-9c4d-090c0b0d4c70 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:25.872023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-35034ba1-1b7a-456e-ac83-17f03936745f req-211e6153-6bc1-44ad-9c4d-090c0b0d4c70 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:25.886029 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-35034ba1-1b7a-456e-ac83-17f03936745f req-211e6153-6bc1-44ad-9c4d-090c0b0d4c70 service nova] Creating event network-changed:b1d81c50-121c-4e21-adfd-a87f547012cc for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:21:25.891767 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-35034ba1-1b7a-456e-ac83-17f03936745f req-211e6153-6bc1-44ad-9c4d-090c0b0d4c70 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035798 Oct 29 01:21:25.892367 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2137/4109] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:25.898761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-17690377-39fc-4594-8fe5-c9401f330be4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:25.905288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17690377-39fc-4594-8fe5-c9401f330be4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:25.905807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17690377-39fc-4594-8fe5-c9401f330be4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:25.908093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17690377-39fc-4594-8fe5-c9401f330be4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:25.930425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-17690377-39fc-4594-8fe5-c9401f330be4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Going to try to stop instance {{(pid=121099) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 01:21:25.999516 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ac79273e-c8ac-414f-a9a2-d1b01108625a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.386614 Oct 29 01:21:26.000291 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1973/4110] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:21:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 2389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:21:26.006240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-60d38717-84ba-46e3-8a71-1398dc2fab25 req-66229ee0-67a4-4798-9c52-310ec228c0c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0fc606-5d53-4e70-b087-22db406a68f8", "name": "network-vif-unplugged", "status": "completed", "tag": "ee5981f8-c5ba-4a90-afb9-4849d919a97f"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:26.019144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-60d38717-84ba-46e3-8a71-1398dc2fab25 req-66229ee0-67a4-4798-9c52-310ec228c0c3 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:26.019946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-60d38717-84ba-46e3-8a71-1398dc2fab25 req-66229ee0-67a4-4798-9c52-310ec228c0c3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:26.020910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-60d38717-84ba-46e3-8a71-1398dc2fab25 req-66229ee0-67a4-4798-9c52-310ec228c0c3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:26.077586 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-60d38717-84ba-46e3-8a71-1398dc2fab25 req-66229ee0-67a4-4798-9c52-310ec228c0c3 service nova] Creating event network-vif-unplugged:ee5981f8-c5ba-4a90-afb9-4849d919a97f for instance 3d0fc606-5d53-4e70-b087-22db406a68f8 on n-h1-862964-3 Oct 29 01:21:26.091274 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-60d38717-84ba-46e3-8a71-1398dc2fab25 req-66229ee0-67a4-4798-9c52-310ec228c0c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089489 Oct 29 01:21:26.096566 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1974/4111] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:26.111084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-87490602-7df4-4913-b01c-9d6f25f8fc49 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:26.111993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-87490602-7df4-4913-b01c-9d6f25f8fc49 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:26.126395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87490602-7df4-4913-b01c-9d6f25f8fc49 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:26.127584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87490602-7df4-4913-b01c-9d6f25f8fc49 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:26.131189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87490602-7df4-4913-b01c-9d6f25f8fc49 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:26.132189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87490602-7df4-4913-b01c-9d6f25f8fc49 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:26.133653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87490602-7df4-4913-b01c-9d6f25f8fc49 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:26.134277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87490602-7df4-4913-b01c-9d6f25f8fc49 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:26.190282 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-17690377-39fc-4594-8fe5-c9401f330be4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "POST /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff/action" status: 202 len: 0 microversion: 2.1 time: 0.296130 Oct 29 01:21:26.195024 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2138/4112] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:21:25 2022] POST /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:21:26.207208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e1755128-a5db-4946-bef1-71af85794780 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:26.207799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e1755128-a5db-4946-bef1-71af85794780 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:26.234296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1755128-a5db-4946-bef1-71af85794780 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:26.235291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1755128-a5db-4946-bef1-71af85794780 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:26.235904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1755128-a5db-4946-bef1-71af85794780 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:26.236807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1755128-a5db-4946-bef1-71af85794780 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:26.238440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1755128-a5db-4946-bef1-71af85794780 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:26.239057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1755128-a5db-4946-bef1-71af85794780 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:26.296250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e1755128-a5db-4946-bef1-71af85794780 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:21:26.673524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-87490602-7df4-4913-b01c-9d6f25f8fc49 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:26.690768 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-87490602-7df4-4913-b01c-9d6f25f8fc49 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1661 microversion: 2.1 time: 0.591046 Oct 29 01:21:26.691513 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1975/4113] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:26 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1661 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:26.703199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-47c5b6ec-a6fa-48d1-bc7d-89fbe3e57bbf tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:26.704247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-47c5b6ec-a6fa-48d1-bc7d-89fbe3e57bbf tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:26.769877 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e1755128-a5db-4946-bef1-71af85794780 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 204 len: 0 microversion: 2.1 time: 0.573255 Oct 29 01:21:26.772172 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2139/4114] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:21:26 2022] DELETE /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:21:26.790771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c6733cf8-ea3e-4a99-ad07-71ec9a0fccfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:26.796421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c6733cf8-ea3e-4a99-ad07-71ec9a0fccfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:26.804694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-47c5b6ec-a6fa-48d1-bc7d-89fbe3e57bbf tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:26.815693 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-47c5b6ec-a6fa-48d1-bc7d-89fbe3e57bbf tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1241 microversion: 2.1 time: 0.118953 Oct 29 01:21:26.817697 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1976/4115] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:26 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1241 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:26.827109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-279fc944-3dbd-4794-9dbc-59fcffaa19de tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:26.832247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-279fc944-3dbd-4794-9dbc-59fcffaa19de tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:26.832399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6733cf8-ea3e-4a99-ad07-71ec9a0fccfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:26.839616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6733cf8-ea3e-4a99-ad07-71ec9a0fccfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:26.840841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-279fc944-3dbd-4794-9dbc-59fcffaa19de tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:26.841659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-279fc944-3dbd-4794-9dbc-59fcffaa19de tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:26.841808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6733cf8-ea3e-4a99-ad07-71ec9a0fccfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:26.842733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-279fc944-3dbd-4794-9dbc-59fcffaa19de tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:26.843673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-279fc944-3dbd-4794-9dbc-59fcffaa19de tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:26.844379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-279fc944-3dbd-4794-9dbc-59fcffaa19de tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:26.844526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6733cf8-ea3e-4a99-ad07-71ec9a0fccfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:26.844904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6733cf8-ea3e-4a99-ad07-71ec9a0fccfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:26.845381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6733cf8-ea3e-4a99-ad07-71ec9a0fccfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:26.845808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-279fc944-3dbd-4794-9dbc-59fcffaa19de tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:27.060388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-279fc944-3dbd-4794-9dbc-59fcffaa19de tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:27.077806 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-279fc944-3dbd-4794-9dbc-59fcffaa19de tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1265 microversion: 2.1 time: 0.257719 Oct 29 01:21:27.085906 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1977/4116] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:26 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:27.093538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ac2d225a-d4bd-4ec1-877a-8cb874a408fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:27.096025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ac2d225a-d4bd-4ec1-877a-8cb874a408fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:27.110791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac2d225a-d4bd-4ec1-877a-8cb874a408fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:27.111651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac2d225a-d4bd-4ec1-877a-8cb874a408fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:27.112283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac2d225a-d4bd-4ec1-877a-8cb874a408fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:27.121668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac2d225a-d4bd-4ec1-877a-8cb874a408fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:27.121668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac2d225a-d4bd-4ec1-877a-8cb874a408fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:27.121668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac2d225a-d4bd-4ec1-877a-8cb874a408fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:27.314370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c6733cf8-ea3e-4a99-ad07-71ec9a0fccfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:27.326634 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c6733cf8-ea3e-4a99-ad07-71ec9a0fccfe tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1510 microversion: 2.1 time: 0.551875 Oct 29 01:21:27.334327 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2140/4117] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:26 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1510 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:27.441530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ac2d225a-d4bd-4ec1-877a-8cb874a408fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:27.454724 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ac2d225a-d4bd-4ec1-877a-8cb874a408fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1511 microversion: 2.1 time: 0.371617 Oct 29 01:21:27.458172 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1978/4118] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:27 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1511 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:27.723894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a726e697-ce0f-4793-89ae-9c063b26aca2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:27.725198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a726e697-ce0f-4793-89ae-9c063b26aca2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:27.736558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a726e697-ce0f-4793-89ae-9c063b26aca2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:27.742577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a726e697-ce0f-4793-89ae-9c063b26aca2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:27.742577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a726e697-ce0f-4793-89ae-9c063b26aca2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:27.742577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a726e697-ce0f-4793-89ae-9c063b26aca2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:27.742577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a726e697-ce0f-4793-89ae-9c063b26aca2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:27.742577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a726e697-ce0f-4793-89ae-9c063b26aca2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:27.841877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9e6a7546-f0f2-4366-9fc3-c7ecfae3ec2a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:27.842680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9e6a7546-f0f2-4366-9fc3-c7ecfae3ec2a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:27.990850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a726e697-ce0f-4793-89ae-9c063b26aca2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:28.030902 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9e6a7546-f0f2-4366-9fc3-c7ecfae3ec2a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:28.039155 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a726e697-ce0f-4793-89ae-9c063b26aca2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1661 microversion: 2.1 time: 0.326916 Oct 29 01:21:28.052057 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9e6a7546-f0f2-4366-9fc3-c7ecfae3ec2a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1241 microversion: 2.1 time: 0.212519 Oct 29 01:21:28.057450 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1979/4119] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:27 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1241 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:28.081061 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2141/4120] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:27 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1661 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:28.111412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4501ea66-0d4b-4531-9a9a-e8111556ff7b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:28.112041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4501ea66-0d4b-4531-9a9a-e8111556ff7b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:28.137576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4501ea66-0d4b-4531-9a9a-e8111556ff7b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:28.138113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4501ea66-0d4b-4531-9a9a-e8111556ff7b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:28.138636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4501ea66-0d4b-4531-9a9a-e8111556ff7b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:28.139661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4501ea66-0d4b-4531-9a9a-e8111556ff7b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:28.140114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4501ea66-0d4b-4531-9a9a-e8111556ff7b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:28.140870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4501ea66-0d4b-4531-9a9a-e8111556ff7b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:28.368664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5fe60934-284d-48f2-9191-6735b4f5ca7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:28.368664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5fe60934-284d-48f2-9191-6735b4f5ca7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:28.373604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5fe60934-284d-48f2-9191-6735b4f5ca7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:28.374837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5fe60934-284d-48f2-9191-6735b4f5ca7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:28.375571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5fe60934-284d-48f2-9191-6735b4f5ca7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:28.376614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5fe60934-284d-48f2-9191-6735b4f5ca7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:28.377344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5fe60934-284d-48f2-9191-6735b4f5ca7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:28.378015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5fe60934-284d-48f2-9191-6735b4f5ca7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:28.409821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4501ea66-0d4b-4531-9a9a-e8111556ff7b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:28.409821 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4501ea66-0d4b-4531-9a9a-e8111556ff7b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1307 microversion: 2.1 time: 0.301305 Oct 29 01:21:28.409821 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1980/4121] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:28 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1307 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:28.497302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-81f9dba0-33d2-4317-bc7b-0e9436c071e5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:28.498204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-81f9dba0-33d2-4317-bc7b-0e9436c071e5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:28.512961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81f9dba0-33d2-4317-bc7b-0e9436c071e5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:28.516898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81f9dba0-33d2-4317-bc7b-0e9436c071e5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:28.516898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81f9dba0-33d2-4317-bc7b-0e9436c071e5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:28.519873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81f9dba0-33d2-4317-bc7b-0e9436c071e5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:28.522149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81f9dba0-33d2-4317-bc7b-0e9436c071e5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:28.525066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81f9dba0-33d2-4317-bc7b-0e9436c071e5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:29.008443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5fe60934-284d-48f2-9191-6735b4f5ca7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:29.035449 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5fe60934-284d-48f2-9191-6735b4f5ca7a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1510 microversion: 2.1 time: 0.681726 Oct 29 01:21:29.051880 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2142/4122] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:28 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1510 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:29.096667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ccd2ff28-cbb2-42c4-b61b-9768976ccd53 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:29.097703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ccd2ff28-cbb2-42c4-b61b-9768976ccd53 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:29.110088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccd2ff28-cbb2-42c4-b61b-9768976ccd53 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:29.111207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccd2ff28-cbb2-42c4-b61b-9768976ccd53 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:29.113847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccd2ff28-cbb2-42c4-b61b-9768976ccd53 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:29.115401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccd2ff28-cbb2-42c4-b61b-9768976ccd53 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:29.116706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccd2ff28-cbb2-42c4-b61b-9768976ccd53 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:29.117551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccd2ff28-cbb2-42c4-b61b-9768976ccd53 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:29.629701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-81f9dba0-33d2-4317-bc7b-0e9436c071e5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:29.643394 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-81f9dba0-33d2-4317-bc7b-0e9436c071e5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1511 microversion: 2.1 time: 1.162089 Oct 29 01:21:29.646484 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1981/4123] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:28 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1511 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:29.669453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2c46c98c-e443-4672-aa22-0b9d2aa087d2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:29.669920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2c46c98c-e443-4672-aa22-0b9d2aa087d2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:29.717243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c46c98c-e443-4672-aa22-0b9d2aa087d2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:29.718048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c46c98c-e443-4672-aa22-0b9d2aa087d2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:29.721590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c46c98c-e443-4672-aa22-0b9d2aa087d2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:29.722362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c46c98c-e443-4672-aa22-0b9d2aa087d2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:29.722899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c46c98c-e443-4672-aa22-0b9d2aa087d2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:29.725608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c46c98c-e443-4672-aa22-0b9d2aa087d2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:29.916641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2c46c98c-e443-4672-aa22-0b9d2aa087d2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:29.930913 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2c46c98c-e443-4672-aa22-0b9d2aa087d2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1293 microversion: 2.1 time: 0.279959 Oct 29 01:21:29.932283 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1982/4124] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:29 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1293 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:29.937454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ccd2ff28-cbb2-42c4-b61b-9768976ccd53 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:29.951445 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ccd2ff28-cbb2-42c4-b61b-9768976ccd53 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1661 microversion: 2.1 time: 0.883684 Oct 29 01:21:29.985462 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2143/4125] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:29 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1661 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:29.986735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9dc1d32d-2906-47db-be1c-5e27fe1f5314 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:29.993308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9dc1d32d-2906-47db-be1c-5e27fe1f5314 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:29.996736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-b888d506-35f6-4915-904f-1d3a28a1f02e req-8d35217c-0bee-4e74-9cd0-55367d901226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac895d78-7d15-451d-a60f-4e80afb0241a", "name": "network-vif-deleted", "tag": "c7a74419-3a70-4ceb-b0db-4fdeeca001b3"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:30.009535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b888d506-35f6-4915-904f-1d3a28a1f02e req-8d35217c-0bee-4e74-9cd0-55367d901226 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:30.014127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dc1d32d-2906-47db-be1c-5e27fe1f5314 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:30.014305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b888d506-35f6-4915-904f-1d3a28a1f02e req-8d35217c-0bee-4e74-9cd0-55367d901226 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:30.014305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b888d506-35f6-4915-904f-1d3a28a1f02e req-8d35217c-0bee-4e74-9cd0-55367d901226 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:30.014519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dc1d32d-2906-47db-be1c-5e27fe1f5314 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:30.014519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dc1d32d-2906-47db-be1c-5e27fe1f5314 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:30.015210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dc1d32d-2906-47db-be1c-5e27fe1f5314 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:30.026596 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-b888d506-35f6-4915-904f-1d3a28a1f02e req-8d35217c-0bee-4e74-9cd0-55367d901226 service nova] Creating event network-vif-deleted:c7a74419-3a70-4ceb-b0db-4fdeeca001b3 for instance ac895d78-7d15-451d-a60f-4e80afb0241a on n-h1-862964-3 Oct 29 01:21:30.029539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dc1d32d-2906-47db-be1c-5e27fe1f5314 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:30.029662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dc1d32d-2906-47db-be1c-5e27fe1f5314 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:30.039321 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-b888d506-35f6-4915-904f-1d3a28a1f02e req-8d35217c-0bee-4e74-9cd0-55367d901226 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054104 Oct 29 01:21:30.046072 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2144/4126] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:30.063275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e0e1d5be-ef1e-400c-9290-afa956372415 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:30.076452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e0e1d5be-ef1e-400c-9290-afa956372415 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:30.085776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0e1d5be-ef1e-400c-9290-afa956372415 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:30.086538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0e1d5be-ef1e-400c-9290-afa956372415 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:30.087172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0e1d5be-ef1e-400c-9290-afa956372415 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:30.088070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0e1d5be-ef1e-400c-9290-afa956372415 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:30.095230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0e1d5be-ef1e-400c-9290-afa956372415 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:30.095939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0e1d5be-ef1e-400c-9290-afa956372415 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:30.435589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9dc1d32d-2906-47db-be1c-5e27fe1f5314 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:30.446567 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9dc1d32d-2906-47db-be1c-5e27fe1f5314 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1307 microversion: 2.1 time: 0.512677 Oct 29 01:21:30.447007 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1983/4127] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:29 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1307 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:30.469146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e0e1d5be-ef1e-400c-9290-afa956372415 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:30.483325 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e0e1d5be-ef1e-400c-9290-afa956372415 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1510 microversion: 2.1 time: 0.424067 Oct 29 01:21:30.485867 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2145/4128] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:30 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1510 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:30.672392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6723ce33-31c4-4485-b3b9-35e543c647f7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:30.673407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6723ce33-31c4-4485-b3b9-35e543c647f7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:30.689807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6723ce33-31c4-4485-b3b9-35e543c647f7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:30.692975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6723ce33-31c4-4485-b3b9-35e543c647f7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:30.692975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6723ce33-31c4-4485-b3b9-35e543c647f7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:30.692975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6723ce33-31c4-4485-b3b9-35e543c647f7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:30.692975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6723ce33-31c4-4485-b3b9-35e543c647f7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:30.694308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6723ce33-31c4-4485-b3b9-35e543c647f7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:30.754591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6723ce33-31c4-4485-b3b9-35e543c647f7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:30.755598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6723ce33-31c4-4485-b3b9-35e543c647f7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:30.756816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6723ce33-31c4-4485-b3b9-35e543c647f7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:30.757546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-6723ce33-31c4-4485-b3b9-35e543c647f7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lazy-loading 'fault' on Instance uuid ac895d78-7d15-451d-a60f-4e80afb0241a {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:21:30.955844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d5cdf7df-2342-4b91-a24c-d49694889dac tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:30.956472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d5cdf7df-2342-4b91-a24c-d49694889dac tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:30.981936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5cdf7df-2342-4b91-a24c-d49694889dac tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:30.982428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5cdf7df-2342-4b91-a24c-d49694889dac tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:30.988815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5cdf7df-2342-4b91-a24c-d49694889dac tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:30.990206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5cdf7df-2342-4b91-a24c-d49694889dac tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:31.002625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5cdf7df-2342-4b91-a24c-d49694889dac tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:31.002625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5cdf7df-2342-4b91-a24c-d49694889dac tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:31.311194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6723ce33-31c4-4485-b3b9-35e543c647f7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:31.330096 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6723ce33-31c4-4485-b3b9-35e543c647f7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 200 len: 1307 microversion: 2.1 time: 0.661800 Oct 29 01:21:31.331310 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1984/4129] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:30 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 1307 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:31.336933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-65e6e6da-7266-412c-9264-afb3c02d8803 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:31.340468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-65e6e6da-7266-412c-9264-afb3c02d8803 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:31.355437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65e6e6da-7266-412c-9264-afb3c02d8803 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:31.356000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65e6e6da-7266-412c-9264-afb3c02d8803 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:31.356508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65e6e6da-7266-412c-9264-afb3c02d8803 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:31.357257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d5cdf7df-2342-4b91-a24c-d49694889dac tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:31.357819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65e6e6da-7266-412c-9264-afb3c02d8803 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:31.357918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65e6e6da-7266-412c-9264-afb3c02d8803 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:31.358372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65e6e6da-7266-412c-9264-afb3c02d8803 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:31.369261 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d5cdf7df-2342-4b91-a24c-d49694889dac tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1301 microversion: 2.1 time: 0.417502 Oct 29 01:21:31.371406 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2146/4130] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:30 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1301 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:31.472202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a4c87f99-9a09-4fd5-a2de-c0ad0df0e0cb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:31.472903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a4c87f99-9a09-4fd5-a2de-c0ad0df0e0cb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:31.494776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:31.499399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4c87f99-9a09-4fd5-a2de-c0ad0df0e0cb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:31.501875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4c87f99-9a09-4fd5-a2de-c0ad0df0e0cb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:31.504582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4c87f99-9a09-4fd5-a2de-c0ad0df0e0cb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:31.508008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4c87f99-9a09-4fd5-a2de-c0ad0df0e0cb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:31.510725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4c87f99-9a09-4fd5-a2de-c0ad0df0e0cb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:31.512645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4c87f99-9a09-4fd5-a2de-c0ad0df0e0cb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:31.580232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-65e6e6da-7266-412c-9264-afb3c02d8803 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:31.631406 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-65e6e6da-7266-412c-9264-afb3c02d8803 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1665 microversion: 2.1 time: 0.293595 Oct 29 01:21:31.634275 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1985/4131] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:31 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1665 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:31.656929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-04a5dbe0-e3e4-4abd-bd93-f9fce2cac383 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:31.659468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-04a5dbe0-e3e4-4abd-bd93-f9fce2cac383 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:31.671852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04a5dbe0-e3e4-4abd-bd93-f9fce2cac383 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:31.673720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04a5dbe0-e3e4-4abd-bd93-f9fce2cac383 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:31.675248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04a5dbe0-e3e4-4abd-bd93-f9fce2cac383 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:31.676275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04a5dbe0-e3e4-4abd-bd93-f9fce2cac383 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:31.676968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04a5dbe0-e3e4-4abd-bd93-f9fce2cac383 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:31.679419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04a5dbe0-e3e4-4abd-bd93-f9fce2cac383 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:31.809354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:31.952974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a4c87f99-9a09-4fd5-a2de-c0ad0df0e0cb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:31.964638 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a4c87f99-9a09-4fd5-a2de-c0ad0df0e0cb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1307 microversion: 2.1 time: 0.497088 Oct 29 01:21:31.969911 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2147/4132] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:31 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1307 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:31.981294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-0cedb91e-bec3-42bd-acc4-cdcdfb4b99c2 req-9c9cdaca-a445-4645-98f6-9bd4b442a44c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "802ee4ce-5a28-416c-a4eb-e0954859bcb2", "tag": "3d866210-67fd-4657-846c-eb8a9102daa8"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:32.003981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-0cedb91e-bec3-42bd-acc4-cdcdfb4b99c2 req-9c9cdaca-a445-4645-98f6-9bd4b442a44c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:32.013231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-0cedb91e-bec3-42bd-acc4-cdcdfb4b99c2 req-9c9cdaca-a445-4645-98f6-9bd4b442a44c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:32.014062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-0cedb91e-bec3-42bd-acc4-cdcdfb4b99c2 req-9c9cdaca-a445-4645-98f6-9bd4b442a44c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:32.049227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-04a5dbe0-e3e4-4abd-bd93-f9fce2cac383 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:32.052990 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-0cedb91e-bec3-42bd-acc4-cdcdfb4b99c2 req-9c9cdaca-a445-4645-98f6-9bd4b442a44c service nova] Creating event network-changed:3d866210-67fd-4657-846c-eb8a9102daa8 for instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 on n-h2-862964-3 Oct 29 01:21:32.058045 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-0cedb91e-bec3-42bd-acc4-cdcdfb4b99c2 req-9c9cdaca-a445-4645-98f6-9bd4b442a44c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085770 Oct 29 01:21:32.059327 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2148/4133] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:32.068057 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-04a5dbe0-e3e4-4abd-bd93-f9fce2cac383 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1510 microversion: 2.1 time: 0.431974 Oct 29 01:21:32.069297 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1986/4134] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:31 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1510 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:32.357093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81b3ab15-d6ac-4898-b7d1-bb2835504acf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:32.357735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-81b3ab15-d6ac-4898-b7d1-bb2835504acf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:32.372164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81b3ab15-d6ac-4898-b7d1-bb2835504acf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:32.372662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81b3ab15-d6ac-4898-b7d1-bb2835504acf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:32.373128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81b3ab15-d6ac-4898-b7d1-bb2835504acf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:32.373906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81b3ab15-d6ac-4898-b7d1-bb2835504acf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:32.374396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81b3ab15-d6ac-4898-b7d1-bb2835504acf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:32.378109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81b3ab15-d6ac-4898-b7d1-bb2835504acf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:32.406409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-12860714-06b0-426d-ac1d-99996183fb2d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:32.407407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-12860714-06b0-426d-ac1d-99996183fb2d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:32.421728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12860714-06b0-426d-ac1d-99996183fb2d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:32.422785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12860714-06b0-426d-ac1d-99996183fb2d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:32.423698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12860714-06b0-426d-ac1d-99996183fb2d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:32.425256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12860714-06b0-426d-ac1d-99996183fb2d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:32.428129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12860714-06b0-426d-ac1d-99996183fb2d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:32.428129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-12860714-06b0-426d-ac1d-99996183fb2d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:32.431948 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-81b3ab15-d6ac-4898-b7d1-bb2835504acf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81b3ab15-d6ac-4898-b7d1-bb2835504acf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a HTTP/1.1 Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'ac895d78-7d15-451d-a60f-4e80afb0241a'} Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:32.437858 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:32.445497 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:32.445497 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:32.445497 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:32.445497 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:21:32.445497 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:21:32.445497 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:21:32.445497 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:32.456804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81b3ab15-d6ac-4898-b7d1-bb2835504acf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:32.460127 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-81b3ab15-d6ac-4898-b7d1-bb2835504acf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 404 len: 111 microversion: 2.1 time: 0.106311 Oct 29 01:21:32.470037 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2149/4135] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:32 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:21:32.481763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c651926a-b393-47d6-ab97-597917c33f8e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:32.487235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c651926a-b393-47d6-ab97-597917c33f8e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:32.502788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c651926a-b393-47d6-ab97-597917c33f8e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:32.504208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c651926a-b393-47d6-ab97-597917c33f8e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:32.506460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c651926a-b393-47d6-ab97-597917c33f8e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:32.508751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c651926a-b393-47d6-ab97-597917c33f8e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:32.517212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c651926a-b393-47d6-ab97-597917c33f8e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:32.520683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c651926a-b393-47d6-ab97-597917c33f8e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:32.620878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-12860714-06b0-426d-ac1d-99996183fb2d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:32.632393 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-12860714-06b0-426d-ac1d-99996183fb2d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1299 microversion: 2.1 time: 0.229392 Oct 29 01:21:32.634994 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1987/4136] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:32 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1299 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:32.862939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=12 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:33.148296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3bee7e11-b8f0-486b-abaf-ec107601a077 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:33.149720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3bee7e11-b8f0-486b-abaf-ec107601a077 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:33.166472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bee7e11-b8f0-486b-abaf-ec107601a077 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:33.167265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bee7e11-b8f0-486b-abaf-ec107601a077 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:33.168613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bee7e11-b8f0-486b-abaf-ec107601a077 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:33.173316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bee7e11-b8f0-486b-abaf-ec107601a077 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:33.174318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bee7e11-b8f0-486b-abaf-ec107601a077 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:33.179248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3bee7e11-b8f0-486b-abaf-ec107601a077 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:33.238872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c651926a-b393-47d6-ab97-597917c33f8e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:33.261340 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c651926a-b393-47d6-ab97-597917c33f8e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.782392 Oct 29 01:21:33.264585 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2150/4137] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:32 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:33.279517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7f5834db-8cdd-46fe-b0ad-c6fae7e792c5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:33.282526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7f5834db-8cdd-46fe-b0ad-c6fae7e792c5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:33.296356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f5834db-8cdd-46fe-b0ad-c6fae7e792c5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:33.296871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f5834db-8cdd-46fe-b0ad-c6fae7e792c5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:33.297353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f5834db-8cdd-46fe-b0ad-c6fae7e792c5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:33.298340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f5834db-8cdd-46fe-b0ad-c6fae7e792c5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:33.298806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f5834db-8cdd-46fe-b0ad-c6fae7e792c5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:33.299241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f5834db-8cdd-46fe-b0ad-c6fae7e792c5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:33.676504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3bee7e11-b8f0-486b-abaf-ec107601a077 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:33.689906 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3bee7e11-b8f0-486b-abaf-ec107601a077 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1307 microversion: 2.1 time: 0.693562 Oct 29 01:21:33.698225 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1988/4138] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:32 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1307 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:33.703667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cfb74a33-cafb-41ab-a296-6b2073c7787d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cfb74a33-cafb-41ab-a296-6b2073c7787d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 163 Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: {"server": {"name": 12345, "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'networks': [{'uuid': 'daf068bd-431d-4e20-b386-6225154844e0'}]}}} Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 12345 Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:21:33.712424 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:21:33.718485 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:21:33.718485 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 29 01:21:33.718485 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:33.718485 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:33.718485 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:33.718485 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:33.718485 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:33.718485 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:33.718485 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:21:33.718485 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:21:33.718485 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 29 01:21:33.718485 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:33.728485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cfb74a33-cafb-41ab-a296-6b2073c7787d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:33.729427 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cfb74a33-cafb-41ab-a296-6b2073c7787d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.029717 Oct 29 01:21:33.730026 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1989/4139] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:21:33 2022] POST /compute/v2.1/servers => generated 127 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:21:33.759304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e9dc7a6b-ab73-4562-8423-4f14dd2f6b13 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:33.760134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e9dc7a6b-ab73-4562-8423-4f14dd2f6b13 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:33.774998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9dc7a6b-ab73-4562-8423-4f14dd2f6b13 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:33.775507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9dc7a6b-ab73-4562-8423-4f14dd2f6b13 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:33.775951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9dc7a6b-ab73-4562-8423-4f14dd2f6b13 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:33.776682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9dc7a6b-ab73-4562-8423-4f14dd2f6b13 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:33.781859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9dc7a6b-ab73-4562-8423-4f14dd2f6b13 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:33.782340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9dc7a6b-ab73-4562-8423-4f14dd2f6b13 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:33.800336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7f5834db-8cdd-46fe-b0ad-c6fae7e792c5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:33.837041 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7f5834db-8cdd-46fe-b0ad-c6fae7e792c5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1510 microversion: 2.1 time: 0.568849 Oct 29 01:21:33.853194 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2151/4140] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:33 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1510 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:33.859444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8ac4e821-d4d0-4f7c-9f51-b4eefcd918f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:33.859444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8ac4e821-d4d0-4f7c-9f51-b4eefcd918f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:33.917049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ac4e821-d4d0-4f7c-9f51-b4eefcd918f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:33.919992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ac4e821-d4d0-4f7c-9f51-b4eefcd918f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:33.921618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ac4e821-d4d0-4f7c-9f51-b4eefcd918f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:33.924800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ac4e821-d4d0-4f7c-9f51-b4eefcd918f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:33.926286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ac4e821-d4d0-4f7c-9f51-b4eefcd918f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:33.928892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ac4e821-d4d0-4f7c-9f51-b4eefcd918f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:34.020873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e9dc7a6b-ab73-4562-8423-4f14dd2f6b13 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:34.029058 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:34.036964 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e9dc7a6b-ab73-4562-8423-4f14dd2f6b13 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1299 microversion: 2.1 time: 0.303550 Oct 29 01:21:34.038118 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1990/4141] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:33 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1299 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:34.497934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8ac4e821-d4d0-4f7c-9f51-b4eefcd918f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:34.507857 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8ac4e821-d4d0-4f7c-9f51-b4eefcd918f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.663689 Oct 29 01:21:34.522881 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2152/4142] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:33 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:34.558928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2ed22163-627f-44c5-a12c-1f5675284112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:34.560150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2ed22163-627f-44c5-a12c-1f5675284112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:34.571661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2ed22163-627f-44c5-a12c-1f5675284112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:34.574268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2ed22163-627f-44c5-a12c-1f5675284112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:34.576998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2ed22163-627f-44c5-a12c-1f5675284112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:34.578019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2ed22163-627f-44c5-a12c-1f5675284112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:34.582599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2ed22163-627f-44c5-a12c-1f5675284112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:34.583489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2ed22163-627f-44c5-a12c-1f5675284112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:34.728015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-33e299c5-d033-4d4f-a8da-d84fdacb8b34 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:34.729056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-33e299c5-d033-4d4f-a8da-d84fdacb8b34 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:34.742321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33e299c5-d033-4d4f-a8da-d84fdacb8b34 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:34.742862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33e299c5-d033-4d4f-a8da-d84fdacb8b34 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:34.755153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33e299c5-d033-4d4f-a8da-d84fdacb8b34 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:34.757002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33e299c5-d033-4d4f-a8da-d84fdacb8b34 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:34.757892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33e299c5-d033-4d4f-a8da-d84fdacb8b34 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:34.758652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33e299c5-d033-4d4f-a8da-d84fdacb8b34 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:34.771787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:35.367867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-33e299c5-d033-4d4f-a8da-d84fdacb8b34 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:35.385323 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-33e299c5-d033-4d4f-a8da-d84fdacb8b34 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1307 microversion: 2.1 time: 0.662246 Oct 29 01:21:35.386588 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2153/4143] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:34 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1307 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:35.391531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a7c31845-0c13-4068-8308-7fa59c2d2f79 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:35.398908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a7c31845-0c13-4068-8308-7fa59c2d2f79 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:35.409080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7c31845-0c13-4068-8308-7fa59c2d2f79 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:35.409635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7c31845-0c13-4068-8308-7fa59c2d2f79 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:35.410025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7c31845-0c13-4068-8308-7fa59c2d2f79 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:35.410750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7c31845-0c13-4068-8308-7fa59c2d2f79 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:35.412745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7c31845-0c13-4068-8308-7fa59c2d2f79 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:35.412745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7c31845-0c13-4068-8308-7fa59c2d2f79 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:35.438763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2ed22163-627f-44c5-a12c-1f5675284112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:35.448796 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2ed22163-627f-44c5-a12c-1f5675284112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.902100 Oct 29 01:21:35.452308 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1991/4144] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:34 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:35.471543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-79690790-f1d8-4029-ae2b-00d388d885c5 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:35.480171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-79690790-f1d8-4029-ae2b-00d388d885c5 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:35.513790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79690790-f1d8-4029-ae2b-00d388d885c5 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:35.514717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79690790-f1d8-4029-ae2b-00d388d885c5 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:35.515407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79690790-f1d8-4029-ae2b-00d388d885c5 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:35.516426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79690790-f1d8-4029-ae2b-00d388d885c5 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:35.518318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79690790-f1d8-4029-ae2b-00d388d885c5 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:35.520665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79690790-f1d8-4029-ae2b-00d388d885c5 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:35.758952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:35.759725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a7c31845-0c13-4068-8308-7fa59c2d2f79 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:35.781037 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a7c31845-0c13-4068-8308-7fa59c2d2f79 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1510 microversion: 2.1 time: 0.392983 Oct 29 01:21:35.784074 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2154/4145] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:35 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1510 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:35.793728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c012b9a5-3b4e-4e13-a902-6fddcb08e827 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:35.795949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c012b9a5-3b4e-4e13-a902-6fddcb08e827 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:35.798207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-79690790-f1d8-4029-ae2b-00d388d885c5 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:35.811177 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-79690790-f1d8-4029-ae2b-00d388d885c5 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1299 microversion: 2.1 time: 0.355999 Oct 29 01:21:35.812049 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1992/4146] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:35 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1299 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:35.819726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c012b9a5-3b4e-4e13-a902-6fddcb08e827 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:35.820710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c012b9a5-3b4e-4e13-a902-6fddcb08e827 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:35.821675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c012b9a5-3b4e-4e13-a902-6fddcb08e827 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:35.822909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c012b9a5-3b4e-4e13-a902-6fddcb08e827 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:35.823644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c012b9a5-3b4e-4e13-a902-6fddcb08e827 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:35.824300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c012b9a5-3b4e-4e13-a902-6fddcb08e827 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:35.844095 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-c012b9a5-3b4e-4e13-a902-6fddcb08e827 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] HTTP exception thrown: Instance b3345ee8-a785-4802-a558-b6880b949635 could not be found. Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c012b9a5-3b4e-4e13-a902-6fddcb08e827 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Request method failure captured: Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 HTTP/1.1 Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH4aFhIcs6vMVqlXB9iHvo7_NMbUt-qUjhcZpxeIgf3T4WsmD9UNket0Ov76YFH6ZsQMT69F7X0aZhWxSaVdWiyxe-lPmFE1afOvClCkyXaLu0H3VoYuDHznVbhF1o8F7LZmR9oi7v8ixVK26ux3KbRcUItNgTl64EjoPraSqAs3BIs Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.42 Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: c1fcdbf3d7bd4e48961102aa20056235 Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-842093315 Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1fcdbf3d7bd4e48961102aa20056235"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c1fcdbf3d7bd4e48961102aa20056235"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1fcdbf3d7bd4e48961102aa20056235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c1fcdbf3d7bd4e48961102aa20056235", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-TaggedBootDevicesTest_v242-842093315 Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: c1fcdbf3d7bd4e48961102aa20056235 Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-842093315 Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-TaggedBootDevicesTest_v242-842093315-project Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 4b1364600ce14da69e3b735cafac00d9 Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-TaggedBootDevicesTest_v242-842093315-project Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance b3345ee8-a785-4802-a558-b6880b949635 could not be found. Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'b3345ee8-a785-4802-a558-b6880b949635'} Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3345ee8-a785-4802-a558-b6880b949635 could not be found. Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:21:35.851643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:21:35.857085 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3345ee8-a785-4802-a558-b6880b949635 could not be found. Oct 29 01:21:35.857085 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:35.857085 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:35.857085 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:35.857085 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:35.857085 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:35.857085 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:35.857085 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:21:35.857085 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:21:35.857085 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3345ee8-a785-4802-a558-b6880b949635 could not be found. Oct 29 01:21:35.857085 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:35.857085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c012b9a5-3b4e-4e13-a902-6fddcb08e827 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Returning 404 to user: Instance b3345ee8-a785-4802-a558-b6880b949635 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:35.857085 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c012b9a5-3b4e-4e13-a902-6fddcb08e827 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 404 len: 111 microversion: 2.42 time: 0.061544 Oct 29 01:21:35.857085 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2155/4147] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:21:35 2022] DELETE /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:21:35.859324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6dd74b21-5fd0-4e88-8801-881c076268e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:35.859324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6dd74b21-5fd0-4e88-8801-881c076268e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] [instance: b3345ee8-a785-4802-a558-b6880b949635] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:35.878099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6dd74b21-5fd0-4e88-8801-881c076268e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:35.878630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6dd74b21-5fd0-4e88-8801-881c076268e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:35.879133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6dd74b21-5fd0-4e88-8801-881c076268e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:35.879922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6dd74b21-5fd0-4e88-8801-881c076268e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:35.880970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6dd74b21-5fd0-4e88-8801-881c076268e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:35.881465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6dd74b21-5fd0-4e88-8801-881c076268e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:35.898016 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-6dd74b21-5fd0-4e88-8801-881c076268e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] HTTP exception thrown: Instance b3345ee8-a785-4802-a558-b6880b949635 could not be found. Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6dd74b21-5fd0-4e88-8801-881c076268e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Request method failure captured: Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 HTTP/1.1 Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH4aFhIcs6vMVqlXB9iHvo7_NMbUt-qUjhcZpxeIgf3T4WsmD9UNket0Ov76YFH6ZsQMT69F7X0aZhWxSaVdWiyxe-lPmFE1afOvClCkyXaLu0H3VoYuDHznVbhF1o8F7LZmR9oi7v8ixVK26ux3KbRcUItNgTl64EjoPraSqAs3BIs Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-Openstack-Nova-Api-Version: 2.42 Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: c1fcdbf3d7bd4e48961102aa20056235 Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-842093315 Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1fcdbf3d7bd4e48961102aa20056235"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c1fcdbf3d7bd4e48961102aa20056235"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1fcdbf3d7bd4e48961102aa20056235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c1fcdbf3d7bd4e48961102aa20056235", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TaggedBootDevicesTest_v242-842093315 Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: c1fcdbf3d7bd4e48961102aa20056235 Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-842093315 Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TaggedBootDevicesTest_v242-842093315-project Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 4b1364600ce14da69e3b735cafac00d9 Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TaggedBootDevicesTest_v242-842093315-project Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance b3345ee8-a785-4802-a558-b6880b949635 could not be found. Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'b3345ee8-a785-4802-a558-b6880b949635'} Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3345ee8-a785-4802-a558-b6880b949635 could not be found. Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3345ee8-a785-4802-a558-b6880b949635 could not be found. Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:35.899599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:35.910697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:35.910697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:35.910697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:35.910697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:35.910697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:21:35.910697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:21:35.910697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3345ee8-a785-4802-a558-b6880b949635 could not be found. Oct 29 01:21:35.910697 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:35.910697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6dd74b21-5fd0-4e88-8801-881c076268e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] Returning 404 to user: Instance b3345ee8-a785-4802-a558-b6880b949635 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:35.910697 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6dd74b21-5fd0-4e88-8801-881c076268e2 tempest-TaggedBootDevicesTest_v242-842093315 tempest-TaggedBootDevicesTest_v242-842093315-project] 10.222.0.26 "GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635" status: 404 len: 111 microversion: 2.42 time: 0.048323 Oct 29 01:21:35.910697 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1993/4148] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:21:35 2022] GET /compute/v2.1/servers/b3345ee8-a785-4802-a558-b6880b949635 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:21:36.408908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cabfcbbe-d6f2-41c7-aaac-35b7eeb8228e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:36.409774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cabfcbbe-d6f2-41c7-aaac-35b7eeb8228e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:36.420255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cabfcbbe-d6f2-41c7-aaac-35b7eeb8228e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:36.420844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cabfcbbe-d6f2-41c7-aaac-35b7eeb8228e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:36.421332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cabfcbbe-d6f2-41c7-aaac-35b7eeb8228e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:36.426391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cabfcbbe-d6f2-41c7-aaac-35b7eeb8228e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:36.428347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cabfcbbe-d6f2-41c7-aaac-35b7eeb8228e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:36.428897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cabfcbbe-d6f2-41c7-aaac-35b7eeb8228e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:36.753905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cabfcbbe-d6f2-41c7-aaac-35b7eeb8228e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:36.753905 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cabfcbbe-d6f2-41c7-aaac-35b7eeb8228e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1307 microversion: 2.1 time: 0.344891 Oct 29 01:21:36.766774 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2156/4149] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:36 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1307 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:36.817045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b90692ed-b5b5-4cb3-8101-06d4979c038c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:36.819096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b90692ed-b5b5-4cb3-8101-06d4979c038c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:36.841971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-361daeff-589f-48f7-8282-bf10f31a6990 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:36.842728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-361daeff-589f-48f7-8282-bf10f31a6990 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:36.852534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b90692ed-b5b5-4cb3-8101-06d4979c038c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:36.853487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b90692ed-b5b5-4cb3-8101-06d4979c038c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:36.853938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b90692ed-b5b5-4cb3-8101-06d4979c038c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:36.854769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b90692ed-b5b5-4cb3-8101-06d4979c038c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:36.855330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b90692ed-b5b5-4cb3-8101-06d4979c038c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:36.855873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b90692ed-b5b5-4cb3-8101-06d4979c038c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:36.877243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-361daeff-589f-48f7-8282-bf10f31a6990 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:36.881276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-361daeff-589f-48f7-8282-bf10f31a6990 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:36.881276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-361daeff-589f-48f7-8282-bf10f31a6990 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:36.881276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-361daeff-589f-48f7-8282-bf10f31a6990 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:36.881276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-361daeff-589f-48f7-8282-bf10f31a6990 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:36.881276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-361daeff-589f-48f7-8282-bf10f31a6990 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:37.234336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-361daeff-589f-48f7-8282-bf10f31a6990 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:37.250901 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-361daeff-589f-48f7-8282-bf10f31a6990 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1366 microversion: 2.1 time: 0.410605 Oct 29 01:21:37.252969 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2157/4150] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:36 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:37.306690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b90692ed-b5b5-4cb3-8101-06d4979c038c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:37.323422 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b90692ed-b5b5-4cb3-8101-06d4979c038c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1510 microversion: 2.1 time: 0.514254 Oct 29 01:21:37.324640 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1994/4151] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:36 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1510 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:37.779172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-232d66f0-0e1c-41b0-9a90-a8f5f6e7981c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:37.780341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-232d66f0-0e1c-41b0-9a90-a8f5f6e7981c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:37.806143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-232d66f0-0e1c-41b0-9a90-a8f5f6e7981c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:37.806714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-232d66f0-0e1c-41b0-9a90-a8f5f6e7981c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:37.807219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-232d66f0-0e1c-41b0-9a90-a8f5f6e7981c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:37.811375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-232d66f0-0e1c-41b0-9a90-a8f5f6e7981c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:37.817287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-232d66f0-0e1c-41b0-9a90-a8f5f6e7981c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:37.818453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-232d66f0-0e1c-41b0-9a90-a8f5f6e7981c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:38.154830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-232d66f0-0e1c-41b0-9a90-a8f5f6e7981c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:38.171668 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-232d66f0-0e1c-41b0-9a90-a8f5f6e7981c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1307 microversion: 2.1 time: 0.396841 Oct 29 01:21:38.173656 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2158/4152] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:37 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1307 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:38.281599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4eafa0e9-e1c8-4936-bccc-b778eafb6fc3 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:38.283016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4eafa0e9-e1c8-4936-bccc-b778eafb6fc3 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:38.286182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=10 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:38.310610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4eafa0e9-e1c8-4936-bccc-b778eafb6fc3 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:38.313488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4eafa0e9-e1c8-4936-bccc-b778eafb6fc3 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:38.313988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4eafa0e9-e1c8-4936-bccc-b778eafb6fc3 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:38.314824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4eafa0e9-e1c8-4936-bccc-b778eafb6fc3 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:38.315330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4eafa0e9-e1c8-4936-bccc-b778eafb6fc3 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:38.315808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4eafa0e9-e1c8-4936-bccc-b778eafb6fc3 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:38.398218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f0b217ae-9045-4f3f-9cf5-6e2ae13249af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:38.404300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f0b217ae-9045-4f3f-9cf5-6e2ae13249af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:38.429453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0b217ae-9045-4f3f-9cf5-6e2ae13249af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:38.433565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0b217ae-9045-4f3f-9cf5-6e2ae13249af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:38.435894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0b217ae-9045-4f3f-9cf5-6e2ae13249af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:38.437613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0b217ae-9045-4f3f-9cf5-6e2ae13249af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:38.438099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0b217ae-9045-4f3f-9cf5-6e2ae13249af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:38.438540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0b217ae-9045-4f3f-9cf5-6e2ae13249af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:39.048261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4eafa0e9-e1c8-4936-bccc-b778eafb6fc3 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:39.069934 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4eafa0e9-e1c8-4936-bccc-b778eafb6fc3 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1366 microversion: 2.1 time: 0.781173 Oct 29 01:21:39.085451 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1995/4153] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:38 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1366 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:39.114342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f0b217ae-9045-4f3f-9cf5-6e2ae13249af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:39.126072 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f0b217ae-9045-4f3f-9cf5-6e2ae13249af tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1510 microversion: 2.1 time: 0.782071 Oct 29 01:21:39.135687 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2159/4154] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:38 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1510 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:39.209444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-a8e349ae-89ab-4a32-b342-ac4d594a4dbb req-000e7ae9-014e-45d3-a372-4f01a1faf39e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "960fd6c4-4418-4490-a15c-5b02d54b2097", "tag": "2f3ceabd-e8e2-4197-8235-3476fd669990"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:39.211499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-122563f5-b319-4941-81bb-e4665dba887f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:39.212501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-122563f5-b319-4941-81bb-e4665dba887f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:39.229568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-122563f5-b319-4941-81bb-e4665dba887f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:39.235260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-122563f5-b319-4941-81bb-e4665dba887f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:39.235260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-122563f5-b319-4941-81bb-e4665dba887f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:39.235260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-122563f5-b319-4941-81bb-e4665dba887f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:39.235260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-122563f5-b319-4941-81bb-e4665dba887f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:39.235260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-122563f5-b319-4941-81bb-e4665dba887f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:39.235771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a8e349ae-89ab-4a32-b342-ac4d594a4dbb req-000e7ae9-014e-45d3-a372-4f01a1faf39e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:39.235771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a8e349ae-89ab-4a32-b342-ac4d594a4dbb req-000e7ae9-014e-45d3-a372-4f01a1faf39e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:39.238121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a8e349ae-89ab-4a32-b342-ac4d594a4dbb req-000e7ae9-014e-45d3-a372-4f01a1faf39e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:39.269635 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-a8e349ae-89ab-4a32-b342-ac4d594a4dbb req-000e7ae9-014e-45d3-a372-4f01a1faf39e service nova] Creating event network-changed:2f3ceabd-e8e2-4197-8235-3476fd669990 for instance 960fd6c4-4418-4490-a15c-5b02d54b2097 on n-h2-862964-3 Oct 29 01:21:39.278527 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-a8e349ae-89ab-4a32-b342-ac4d594a4dbb req-000e7ae9-014e-45d3-a372-4f01a1faf39e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074154 Oct 29 01:21:39.279300 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2160/4155] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:21:39.556510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-122563f5-b319-4941-81bb-e4665dba887f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:39.565539 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-122563f5-b319-4941-81bb-e4665dba887f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1307 microversion: 2.1 time: 0.361408 Oct 29 01:21:39.582976 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1996/4156] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:39 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1307 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:40.096211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-63fd0cf2-4b8f-4f4c-bfba-cf7656151588 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:40.097117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-63fd0cf2-4b8f-4f4c-bfba-cf7656151588 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:40.104156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63fd0cf2-4b8f-4f4c-bfba-cf7656151588 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:40.104634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63fd0cf2-4b8f-4f4c-bfba-cf7656151588 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:40.105064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63fd0cf2-4b8f-4f4c-bfba-cf7656151588 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:40.105784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63fd0cf2-4b8f-4f4c-bfba-cf7656151588 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:40.106241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63fd0cf2-4b8f-4f4c-bfba-cf7656151588 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:40.106655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63fd0cf2-4b8f-4f4c-bfba-cf7656151588 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:40.153524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-01c4d736-5078-4dd2-ad67-567ead3befb0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:40.154811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-01c4d736-5078-4dd2-ad67-567ead3befb0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:40.162486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01c4d736-5078-4dd2-ad67-567ead3befb0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:40.164508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01c4d736-5078-4dd2-ad67-567ead3befb0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:40.165259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01c4d736-5078-4dd2-ad67-567ead3befb0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:40.166806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01c4d736-5078-4dd2-ad67-567ead3befb0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:40.167493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01c4d736-5078-4dd2-ad67-567ead3befb0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:40.168227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01c4d736-5078-4dd2-ad67-567ead3befb0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:40.352378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-63fd0cf2-4b8f-4f4c-bfba-cf7656151588 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:40.354218 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-63fd0cf2-4b8f-4f4c-bfba-cf7656151588 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1366 microversion: 2.1 time: 0.263425 Oct 29 01:21:40.354825 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2161/4157] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:40 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:40.363729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-01c4d736-5078-4dd2-ad67-567ead3befb0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:40.372600 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-01c4d736-5078-4dd2-ad67-567ead3befb0 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1510 microversion: 2.1 time: 0.223642 Oct 29 01:21:40.373200 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1997/4158] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:40 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:40.595933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ab9e9a78-b0ff-40c4-a515-7c11107dac56 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:40.596549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ab9e9a78-b0ff-40c4-a515-7c11107dac56 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:40.605250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab9e9a78-b0ff-40c4-a515-7c11107dac56 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:40.605984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab9e9a78-b0ff-40c4-a515-7c11107dac56 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:40.606628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab9e9a78-b0ff-40c4-a515-7c11107dac56 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:40.607583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab9e9a78-b0ff-40c4-a515-7c11107dac56 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:40.608286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab9e9a78-b0ff-40c4-a515-7c11107dac56 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:40.609260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab9e9a78-b0ff-40c4-a515-7c11107dac56 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:40.773439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-32b6a07a-d322-42ba-9e44-d063a07c7450 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1459646070", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f574f63b-daaa-4741-a5b2-e917cef64bdd", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:40.853210 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-32b6a07a-d322-42ba-9e44-d063a07c7450 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Block Device f574f63b-daaa-4741-a5b2-e917cef64bdd is not bootable. Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-32b6a07a-d322-42ba-9e44-d063a07c7450 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 358 Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1459646070", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f574f63b-daaa-4741-a5b2-e917cef64bdd", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: exception: Block Device f574f63b-daaa-4741-a5b2-e917cef64bdd is not bootable. Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1459646070', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'f574f63b-daaa-4741-a5b2-e917cef64bdd'}], 'networks': [{'uuid': 'daf068bd-431d-4e20-b386-6225154844e0'}]}}} Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device f574f63b-daaa-4741-a5b2-e917cef64bdd is not bootable. Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:40.963289 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:40.968277 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:40.968277 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:40.968277 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:40.968277 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 01:21:40.968277 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 29 01:21:40.968277 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 01:21:40.968277 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device f574f63b-daaa-4741-a5b2-e917cef64bdd is not bootable. Oct 29 01:21:40.968277 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:40.968277 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:40.968277 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:40.968277 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:40.968277 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:40.968277 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:40.968277 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:21:40.968277 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:21:40.968277 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device f574f63b-daaa-4741-a5b2-e917cef64bdd is not bootable. Oct 29 01:21:40.968277 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:40.968277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-32b6a07a-d322-42ba-9e44-d063a07c7450 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 400 to user: Block Device f574f63b-daaa-4741-a5b2-e917cef64bdd is not bootable. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:40.968277 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-32b6a07a-d322-42ba-9e44-d063a07c7450 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.197881 Oct 29 01:21:40.970316 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1998/4159] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:21:40 2022] POST /compute/v2.1/servers => generated 110 bytes in 203 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 01:21:40.976993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fbdcdf52-7d34-47d4-b88f-bf016be7f608 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:40.977715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fbdcdf52-7d34-47d4-b88f-bf016be7f608 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:40.984827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbdcdf52-7d34-47d4-b88f-bf016be7f608 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:40.985372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbdcdf52-7d34-47d4-b88f-bf016be7f608 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:40.985822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbdcdf52-7d34-47d4-b88f-bf016be7f608 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:40.986582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbdcdf52-7d34-47d4-b88f-bf016be7f608 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:40.987244 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbdcdf52-7d34-47d4-b88f-bf016be7f608 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:40.987679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbdcdf52-7d34-47d4-b88f-bf016be7f608 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:41.124534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ab9e9a78-b0ff-40c4-a515-7c11107dac56 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:41.133204 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ab9e9a78-b0ff-40c4-a515-7c11107dac56 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1307 microversion: 2.1 time: 0.541566 Oct 29 01:21:41.133777 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2162/4160] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:40 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1307 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:41.305169 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fbdcdf52-7d34-47d4-b88f-bf016be7f608 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:41.313069 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fbdcdf52-7d34-47d4-b88f-bf016be7f608 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.341782 Oct 29 01:21:41.315422 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 1999/4161] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:40 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:41.341463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b5573f70-a07f-49e5-a000-a80feb5271ad tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:41.345747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b5573f70-a07f-49e5-a000-a80feb5271ad tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:41.348545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5573f70-a07f-49e5-a000-a80feb5271ad tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:41.349181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5573f70-a07f-49e5-a000-a80feb5271ad tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:41.349596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5573f70-a07f-49e5-a000-a80feb5271ad tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:41.350325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5573f70-a07f-49e5-a000-a80feb5271ad tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:41.350854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5573f70-a07f-49e5-a000-a80feb5271ad tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:41.351278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5573f70-a07f-49e5-a000-a80feb5271ad tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:41.377856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-af40197d-21c9-4a5c-876a-86a062485b86 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:41.381327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-af40197d-21c9-4a5c-876a-86a062485b86 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:41.386542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af40197d-21c9-4a5c-876a-86a062485b86 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:41.387083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af40197d-21c9-4a5c-876a-86a062485b86 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:41.387508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af40197d-21c9-4a5c-876a-86a062485b86 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:41.388493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af40197d-21c9-4a5c-876a-86a062485b86 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:41.389172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af40197d-21c9-4a5c-876a-86a062485b86 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:41.391108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-af40197d-21c9-4a5c-876a-86a062485b86 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:41.665923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b5573f70-a07f-49e5-a000-a80feb5271ad tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:41.677496 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b5573f70-a07f-49e5-a000-a80feb5271ad tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.339672 Oct 29 01:21:41.693245 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2163/4162] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:41 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:41.693245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-791776b8-3f7d-4010-8604-ca227c74363a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:41.693245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-791776b8-3f7d-4010-8604-ca227c74363a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:41.693245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-791776b8-3f7d-4010-8604-ca227c74363a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:41.693245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-791776b8-3f7d-4010-8604-ca227c74363a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:41.693245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-791776b8-3f7d-4010-8604-ca227c74363a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:41.693245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-791776b8-3f7d-4010-8604-ca227c74363a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:41.694169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-791776b8-3f7d-4010-8604-ca227c74363a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:41.694667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-791776b8-3f7d-4010-8604-ca227c74363a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:41.731038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-af40197d-21c9-4a5c-876a-86a062485b86 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:41.743303 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-af40197d-21c9-4a5c-876a-86a062485b86 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1366 microversion: 2.1 time: 0.369376 Oct 29 01:21:41.745646 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2000/4163] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:41 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:42.021502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-791776b8-3f7d-4010-8604-ca227c74363a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:42.030083 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-791776b8-3f7d-4010-8604-ca227c74363a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1510 microversion: 2.1 time: 0.350295 Oct 29 01:21:42.031602 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2164/4164] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:41 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1510 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:42.159656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ac359bcf-41d1-4ee1-a8d9-b819e29cdf73 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:42.160280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ac359bcf-41d1-4ee1-a8d9-b819e29cdf73 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:42.167518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac359bcf-41d1-4ee1-a8d9-b819e29cdf73 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:42.168026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac359bcf-41d1-4ee1-a8d9-b819e29cdf73 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:42.168444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac359bcf-41d1-4ee1-a8d9-b819e29cdf73 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:42.169386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac359bcf-41d1-4ee1-a8d9-b819e29cdf73 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:42.169842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac359bcf-41d1-4ee1-a8d9-b819e29cdf73 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:42.170268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac359bcf-41d1-4ee1-a8d9-b819e29cdf73 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:42.520550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ac359bcf-41d1-4ee1-a8d9-b819e29cdf73 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:42.529394 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ac359bcf-41d1-4ee1-a8d9-b819e29cdf73 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1307 microversion: 2.1 time: 0.373438 Oct 29 01:21:42.549191 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2001/4165] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:42 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1307 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:42.768308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-acdd9b91-a2b2-4465-972d-b4d38310d3cd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:42.769626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-acdd9b91-a2b2-4465-972d-b4d38310d3cd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:42.782110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-acdd9b91-a2b2-4465-972d-b4d38310d3cd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:42.787298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-acdd9b91-a2b2-4465-972d-b4d38310d3cd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:42.788056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-acdd9b91-a2b2-4465-972d-b4d38310d3cd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:42.788986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-acdd9b91-a2b2-4465-972d-b4d38310d3cd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:42.789653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-acdd9b91-a2b2-4465-972d-b4d38310d3cd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:42.793258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-acdd9b91-a2b2-4465-972d-b4d38310d3cd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:43.035903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-acdd9b91-a2b2-4465-972d-b4d38310d3cd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:43.055105 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-acdd9b91-a2b2-4465-972d-b4d38310d3cd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1366 microversion: 2.1 time: 0.290457 Oct 29 01:21:43.055631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2eb4ebbf-b5ce-464b-ba8e-3a599efa21ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:43.056245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2eb4ebbf-b5ce-464b-ba8e-3a599efa21ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:43.071395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2eb4ebbf-b5ce-464b-ba8e-3a599efa21ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:43.071395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2eb4ebbf-b5ce-464b-ba8e-3a599efa21ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:43.071395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2eb4ebbf-b5ce-464b-ba8e-3a599efa21ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:43.071395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2eb4ebbf-b5ce-464b-ba8e-3a599efa21ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:43.071395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2eb4ebbf-b5ce-464b-ba8e-3a599efa21ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:43.077512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2eb4ebbf-b5ce-464b-ba8e-3a599efa21ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:43.085785 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2165/4166] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:42 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:43.400581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2eb4ebbf-b5ce-464b-ba8e-3a599efa21ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:43.415869 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2eb4ebbf-b5ce-464b-ba8e-3a599efa21ee tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1510 microversion: 2.1 time: 0.364502 Oct 29 01:21:43.416477 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2002/4167] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:43 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1510 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:43.563269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-443f6d5d-26c6-433a-81d9-b2f391e5e488 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:43.564229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-443f6d5d-26c6-433a-81d9-b2f391e5e488 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:43.576890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-443f6d5d-26c6-433a-81d9-b2f391e5e488 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:43.577734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-443f6d5d-26c6-433a-81d9-b2f391e5e488 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:43.578626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-443f6d5d-26c6-433a-81d9-b2f391e5e488 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:43.580207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-443f6d5d-26c6-433a-81d9-b2f391e5e488 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:43.581059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-443f6d5d-26c6-433a-81d9-b2f391e5e488 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:43.581831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-443f6d5d-26c6-433a-81d9-b2f391e5e488 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:43.863744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-443f6d5d-26c6-433a-81d9-b2f391e5e488 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:43.878674 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-443f6d5d-26c6-433a-81d9-b2f391e5e488 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1307 microversion: 2.1 time: 0.316720 Oct 29 01:21:43.886302 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2166/4168] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:43 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1307 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:44.086211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8ed820fd-c9e7-4cc4-a40a-25aa031f364d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:44.086869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8ed820fd-c9e7-4cc4-a40a-25aa031f364d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:44.108756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8ed820fd-c9e7-4cc4-a40a-25aa031f364d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:44.110417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8ed820fd-c9e7-4cc4-a40a-25aa031f364d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:44.110870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8ed820fd-c9e7-4cc4-a40a-25aa031f364d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:44.111723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8ed820fd-c9e7-4cc4-a40a-25aa031f364d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:44.112137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8ed820fd-c9e7-4cc4-a40a-25aa031f364d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:44.112599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8ed820fd-c9e7-4cc4-a40a-25aa031f364d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:44.387342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8ed820fd-c9e7-4cc4-a40a-25aa031f364d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:44.396327 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8ed820fd-c9e7-4cc4-a40a-25aa031f364d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1366 microversion: 2.1 time: 0.317887 Oct 29 01:21:44.411756 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2003/4169] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:44 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:44.447539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-29cab09e-3f4f-4d5f-9cb4-6a390000b46a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:44.448510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-29cab09e-3f4f-4d5f-9cb4-6a390000b46a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:44.458917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29cab09e-3f4f-4d5f-9cb4-6a390000b46a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:44.459780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29cab09e-3f4f-4d5f-9cb4-6a390000b46a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:44.460709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29cab09e-3f4f-4d5f-9cb4-6a390000b46a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:44.462013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29cab09e-3f4f-4d5f-9cb4-6a390000b46a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:44.463324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29cab09e-3f4f-4d5f-9cb4-6a390000b46a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:44.464194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29cab09e-3f4f-4d5f-9cb4-6a390000b46a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:44.657830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5bd2f80f-a983-4dc9-bce4-1afa183631fb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1452382920", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "destination_type": "local"}, {"source_type": "volume", "uuid": "1d571ed1-0a73-4efe-aa09-7e7822d7001a", "destination_type": "invalid"}], "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5bd2f80f-a983-4dc9-bce4-1afa183631fb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 495 Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1452382920", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "destination_type": "local"}, {"source_type": "volume", "uuid": "1d571ed1-0a73-4efe-aa09-7e7822d7001a", "destination_type": "invalid"}], "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1452382920', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '1d571ed1-0a73-4efe-aa09-7e7822d7001a', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'daf068bd-431d-4e20-b386-6225154844e0'}]}}} Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'invalid' Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:44.670220 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5bd2f80f-a983-4dc9-bce4-1afa183631fb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5bd2f80f-a983-4dc9-bce4-1afa183631fb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.022423 Oct 29 01:21:44.678536 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2004/4170] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:21:44 2022] POST /compute/v2.1/servers => generated 155 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:21:44.694172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-27ecaff7-5abe-4ef4-9476-9ecad3b0912f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:44.694172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-27ecaff7-5abe-4ef4-9476-9ecad3b0912f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:44.710580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27ecaff7-5abe-4ef4-9476-9ecad3b0912f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:44.712314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27ecaff7-5abe-4ef4-9476-9ecad3b0912f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:44.713410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27ecaff7-5abe-4ef4-9476-9ecad3b0912f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:44.714786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27ecaff7-5abe-4ef4-9476-9ecad3b0912f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:44.717826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27ecaff7-5abe-4ef4-9476-9ecad3b0912f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:44.718388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27ecaff7-5abe-4ef4-9476-9ecad3b0912f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:44.752536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-29cab09e-3f4f-4d5f-9cb4-6a390000b46a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:44.767619 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-29cab09e-3f4f-4d5f-9cb4-6a390000b46a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1510 microversion: 2.1 time: 0.326688 Oct 29 01:21:44.769444 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2167/4171] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:44 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1510 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:44.891794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-27ecaff7-5abe-4ef4-9476-9ecad3b0912f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:44.902581 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-27ecaff7-5abe-4ef4-9476-9ecad3b0912f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.223471 Oct 29 01:21:44.903169 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2005/4172] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:44 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:44.904119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c3ab046d-b049-44eb-9cf4-b1b0f72e44a5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:44.904744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c3ab046d-b049-44eb-9cf4-b1b0f72e44a5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:44.913468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3ab046d-b049-44eb-9cf4-b1b0f72e44a5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:44.913953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3ab046d-b049-44eb-9cf4-b1b0f72e44a5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:44.914389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3ab046d-b049-44eb-9cf4-b1b0f72e44a5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:44.918023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3ab046d-b049-44eb-9cf4-b1b0f72e44a5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:44.918762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3ab046d-b049-44eb-9cf4-b1b0f72e44a5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:44.919381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3ab046d-b049-44eb-9cf4-b1b0f72e44a5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:44.929511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-90e2b533-1c65-4d7d-b575-b7abcfc01bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:44.930417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-90e2b533-1c65-4d7d-b575-b7abcfc01bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:44.938455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90e2b533-1c65-4d7d-b575-b7abcfc01bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:44.939260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90e2b533-1c65-4d7d-b575-b7abcfc01bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:44.939894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90e2b533-1c65-4d7d-b575-b7abcfc01bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:44.940807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90e2b533-1c65-4d7d-b575-b7abcfc01bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:44.941504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90e2b533-1c65-4d7d-b575-b7abcfc01bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:44.942117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90e2b533-1c65-4d7d-b575-b7abcfc01bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:45.157018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c3ab046d-b049-44eb-9cf4-b1b0f72e44a5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:45.166466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-90e2b533-1c65-4d7d-b575-b7abcfc01bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:45.167766 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c3ab046d-b049-44eb-9cf4-b1b0f72e44a5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1307 microversion: 2.1 time: 0.266907 Oct 29 01:21:45.179956 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2168/4173] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:44 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1307 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:45.183915 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-90e2b533-1c65-4d7d-b575-b7abcfc01bcb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.260537 Oct 29 01:21:45.185142 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2006/4174] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:44 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:45.260004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-14b7e323-275b-405a-a0d0-cee700d223db tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-34783332", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-14b7e323-275b-405a-a0d0-cee700d223db tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 490 Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-34783332", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-34783332', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'daf068bd-431d-4e20-b386-6225154844e0'}]}}} Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:45.265535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-14b7e323-275b-405a-a0d0-cee700d223db tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:45.269643 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-14b7e323-275b-405a-a0d0-cee700d223db tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.013335 Oct 29 01:21:45.273446 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2169/4175] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:21:45 2022] POST /compute/v2.1/servers => generated 624 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:21:45.279236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-30928bf9-c9fa-4d17-bb31-b5813544f6a2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:45.283346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-30928bf9-c9fa-4d17-bb31-b5813544f6a2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:45.287556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-30928bf9-c9fa-4d17-bb31-b5813544f6a2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:45.287929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-30928bf9-c9fa-4d17-bb31-b5813544f6a2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:45.288367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-30928bf9-c9fa-4d17-bb31-b5813544f6a2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:45.289073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-30928bf9-c9fa-4d17-bb31-b5813544f6a2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:45.289563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-30928bf9-c9fa-4d17-bb31-b5813544f6a2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:45.289986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-30928bf9-c9fa-4d17-bb31-b5813544f6a2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:45.422503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8ed5d03b-95a9-456f-ae33-4eb82a371a33 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:45.423411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8ed5d03b-95a9-456f-ae33-4eb82a371a33 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:45.430935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ed5d03b-95a9-456f-ae33-4eb82a371a33 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:45.431508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ed5d03b-95a9-456f-ae33-4eb82a371a33 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:45.432078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ed5d03b-95a9-456f-ae33-4eb82a371a33 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:45.432861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ed5d03b-95a9-456f-ae33-4eb82a371a33 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:45.433371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ed5d03b-95a9-456f-ae33-4eb82a371a33 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:45.433809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ed5d03b-95a9-456f-ae33-4eb82a371a33 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:45.453637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-30928bf9-c9fa-4d17-bb31-b5813544f6a2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:45.462633 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-30928bf9-c9fa-4d17-bb31-b5813544f6a2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.187536 Oct 29 01:21:45.463236 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2007/4176] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:45 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:45.496289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c2b73670-a885-4799-bf03-c87c3bad24f6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:45.496919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c2b73670-a885-4799-bf03-c87c3bad24f6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:45.503306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c2b73670-a885-4799-bf03-c87c3bad24f6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:45.503800 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c2b73670-a885-4799-bf03-c87c3bad24f6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:45.504236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c2b73670-a885-4799-bf03-c87c3bad24f6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:45.505565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c2b73670-a885-4799-bf03-c87c3bad24f6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:45.506237 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c2b73670-a885-4799-bf03-c87c3bad24f6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:45.507258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c2b73670-a885-4799-bf03-c87c3bad24f6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:45.683304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8ed5d03b-95a9-456f-ae33-4eb82a371a33 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:45.691451 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8ed5d03b-95a9-456f-ae33-4eb82a371a33 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1366 microversion: 2.1 time: 0.272793 Oct 29 01:21:45.702330 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2170/4177] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:45 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:45.717103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c2b73670-a885-4799-bf03-c87c3bad24f6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:45.725608 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c2b73670-a885-4799-bf03-c87c3bad24f6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.238482 Oct 29 01:21:45.726186 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2008/4178] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:45 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:45.792526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3dec8165-44fb-49c3-9d27-5e8a9b78a1e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:45.792955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ce220a20-7c1d-4add-a7ac-cf25c133982f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:45.793147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3dec8165-44fb-49c3-9d27-5e8a9b78a1e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ce220a20-7c1d-4add-a7ac-cf25c133982f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 416 Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'networks': [{'uuid': 'daf068bd-431d-4e20-b386-6225154844e0'}]}}} Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:45.796758 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ce220a20-7c1d-4add-a7ac-cf25c133982f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ce220a20-7c1d-4add-a7ac-cf25c133982f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.009387 Oct 29 01:21:45.805193 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2009/4179] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:21:45 2022] POST /compute/v2.1/servers => generated 619 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:21:45.807896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3dec8165-44fb-49c3-9d27-5e8a9b78a1e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:45.807896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3dec8165-44fb-49c3-9d27-5e8a9b78a1e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:45.807896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3dec8165-44fb-49c3-9d27-5e8a9b78a1e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:45.807896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3dec8165-44fb-49c3-9d27-5e8a9b78a1e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:45.807896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3dec8165-44fb-49c3-9d27-5e8a9b78a1e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:45.807896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3dec8165-44fb-49c3-9d27-5e8a9b78a1e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:45.808541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c55e6d9b-e4d1-4f27-b60e-974c75b663d5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:45.808647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c55e6d9b-e4d1-4f27-b60e-974c75b663d5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:45.816368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c55e6d9b-e4d1-4f27-b60e-974c75b663d5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:45.819284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c55e6d9b-e4d1-4f27-b60e-974c75b663d5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:45.819284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c55e6d9b-e4d1-4f27-b60e-974c75b663d5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:45.819284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c55e6d9b-e4d1-4f27-b60e-974c75b663d5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:45.819284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c55e6d9b-e4d1-4f27-b60e-974c75b663d5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:45.819868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c55e6d9b-e4d1-4f27-b60e-974c75b663d5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:46.040004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3dec8165-44fb-49c3-9d27-5e8a9b78a1e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:46.049246 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3dec8165-44fb-49c3-9d27-5e8a9b78a1e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1510 microversion: 2.1 time: 0.260603 Oct 29 01:21:46.049429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c55e6d9b-e4d1-4f27-b60e-974c75b663d5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:46.052934 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2171/4180] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:45 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1510 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:46.058499 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c55e6d9b-e4d1-4f27-b60e-974c75b663d5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.253953 Oct 29 01:21:46.059731 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2010/4181] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:45 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:46.087703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9e499a6c-cc65-4977-80e4-ece4d6228d16 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:46.088938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9e499a6c-cc65-4977-80e4-ece4d6228d16 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:46.096044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e499a6c-cc65-4977-80e4-ece4d6228d16 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:46.096898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e499a6c-cc65-4977-80e4-ece4d6228d16 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:46.097625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e499a6c-cc65-4977-80e4-ece4d6228d16 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:46.098823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e499a6c-cc65-4977-80e4-ece4d6228d16 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:46.100671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e499a6c-cc65-4977-80e4-ece4d6228d16 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:46.101503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e499a6c-cc65-4977-80e4-ece4d6228d16 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:46.130194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:46.194536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1cc36ad0-a26a-4dba-b3bb-f1c8081a9979 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:46.195161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1cc36ad0-a26a-4dba-b3bb-f1c8081a9979 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:46.205659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cc36ad0-a26a-4dba-b3bb-f1c8081a9979 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:46.206444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cc36ad0-a26a-4dba-b3bb-f1c8081a9979 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:46.207243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cc36ad0-a26a-4dba-b3bb-f1c8081a9979 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:46.211284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cc36ad0-a26a-4dba-b3bb-f1c8081a9979 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:46.211973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cc36ad0-a26a-4dba-b3bb-f1c8081a9979 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:46.212414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cc36ad0-a26a-4dba-b3bb-f1c8081a9979 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:46.218596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:46.292241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9e499a6c-cc65-4977-80e4-ece4d6228d16 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:46.304941 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9e499a6c-cc65-4977-80e4-ece4d6228d16 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.221428 Oct 29 01:21:46.322896 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2172/4182] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:46 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:46.384432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d4bbfccf-b476-4d6d-a086-bc0806b80e16 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1853432072", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": -1, "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:46.406137 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-d4bbfccf-b476-4d6d-a086-bc0806b80e16 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Flavor -1 could not be found. Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d4bbfccf-b476-4d6d-a086-bc0806b80e16 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 206 Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1853432072", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": -1, "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: exception: Flavor -1 could not be found. Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1853432072', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': -1, 'networks': [{'uuid': 'daf068bd-431d-4e20-b386-6225154844e0'}]}}} Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:46.408371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d4bbfccf-b476-4d6d-a086-bc0806b80e16 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d4bbfccf-b476-4d6d-a086-bc0806b80e16 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.031630 Oct 29 01:21:46.416056 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2173/4183] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:21:46 2022] POST /compute/v2.1/servers => generated 73 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 29 01:21:46.428894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-12ce3937-3c52-41b8-a0ce-bc126a815d82 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:46.431024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-12ce3937-3c52-41b8-a0ce-bc126a815d82 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:46.438834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1cc36ad0-a26a-4dba-b3bb-f1c8081a9979 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:46.440060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12ce3937-3c52-41b8-a0ce-bc126a815d82 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:46.440836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12ce3937-3c52-41b8-a0ce-bc126a815d82 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:46.442016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12ce3937-3c52-41b8-a0ce-bc126a815d82 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:46.448709 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1cc36ad0-a26a-4dba-b3bb-f1c8081a9979 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1307 microversion: 2.1 time: 0.260726 Oct 29 01:21:46.458842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12ce3937-3c52-41b8-a0ce-bc126a815d82 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:46.459366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12ce3937-3c52-41b8-a0ce-bc126a815d82 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:46.459706 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2011/4184] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:46 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1307 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:46.461332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12ce3937-3c52-41b8-a0ce-bc126a815d82 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:46.715054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1a14038f-5c8a-478b-bb4f-27c814794235 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:46.715779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1a14038f-5c8a-478b-bb4f-27c814794235 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:46.723357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a14038f-5c8a-478b-bb4f-27c814794235 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:46.732720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a14038f-5c8a-478b-bb4f-27c814794235 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:46.732720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a14038f-5c8a-478b-bb4f-27c814794235 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:46.732720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a14038f-5c8a-478b-bb4f-27c814794235 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:46.732720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a14038f-5c8a-478b-bb4f-27c814794235 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:46.732720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a14038f-5c8a-478b-bb4f-27c814794235 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:46.756419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-12ce3937-3c52-41b8-a0ce-bc126a815d82 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:46.767807 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-12ce3937-3c52-41b8-a0ce-bc126a815d82 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.347993 Oct 29 01:21:46.770357 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2174/4185] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:46 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:46.794625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-657ed582-051e-44cd-8a08-34e5016e9d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:46.795370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-657ed582-051e-44cd-8a08-34e5016e9d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:46.803047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-657ed582-051e-44cd-8a08-34e5016e9d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:46.803763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-657ed582-051e-44cd-8a08-34e5016e9d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:46.804382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-657ed582-051e-44cd-8a08-34e5016e9d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:46.805201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-657ed582-051e-44cd-8a08-34e5016e9d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:46.805790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-657ed582-051e-44cd-8a08-34e5016e9d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:46.806357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-657ed582-051e-44cd-8a08-34e5016e9d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:47.040573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1a14038f-5c8a-478b-bb4f-27c814794235 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:47.049545 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1a14038f-5c8a-478b-bb4f-27c814794235 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1366 microversion: 2.1 time: 0.338397 Oct 29 01:21:47.061826 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2012/4186] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:46 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:47.074973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-97280469-e0e4-4d8d-beba-b3545831297e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:47.088706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-97280469-e0e4-4d8d-beba-b3545831297e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:47.088706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97280469-e0e4-4d8d-beba-b3545831297e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:47.088706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97280469-e0e4-4d8d-beba-b3545831297e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:47.088706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97280469-e0e4-4d8d-beba-b3545831297e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:47.088706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97280469-e0e4-4d8d-beba-b3545831297e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:47.088706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97280469-e0e4-4d8d-beba-b3545831297e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:47.089403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97280469-e0e4-4d8d-beba-b3545831297e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:47.233742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-657ed582-051e-44cd-8a08-34e5016e9d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:47.257856 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-657ed582-051e-44cd-8a08-34e5016e9d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.465606 Oct 29 01:21:47.258506 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2175/4187] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:46 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:47.320014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-97280469-e0e4-4d8d-beba-b3545831297e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:47.330497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6459ffa4-dd80-44b3-9a7a-28815f99a490 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-131892489", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:47.335502 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-97280469-e0e4-4d8d-beba-b3545831297e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1510 microversion: 2.1 time: 0.262211 Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6459ffa4-dd80-44b3-9a7a-28815f99a490 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 172 Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-131892489", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-131892489', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'daf068bd-431d-4e20-b386-6225154844e0'}]}}} Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi -1 Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:21:47.338218 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:21:47.344000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:21:47.344000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:21:47.344000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 29 01:21:47.344000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:47.344000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:47.344000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:47.344000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:47.344000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:47.344000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:47.344000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:21:47.344000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:21:47.344000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 29 01:21:47.344000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:47.345144 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2013/4188] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:47 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1510 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:47.350472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6459ffa4-dd80-44b3-9a7a-28815f99a490 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:47.351774 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6459ffa4-dd80-44b3-9a7a-28815f99a490 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.025296 Oct 29 01:21:47.352948 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2176/4189] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:21:47 2022] POST /compute/v2.1/servers => generated 145 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:21:47.361892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-464c3cee-b5d7-4a87-aba3-ac4553532421 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:47.362780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-464c3cee-b5d7-4a87-aba3-ac4553532421 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:47.373293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-464c3cee-b5d7-4a87-aba3-ac4553532421 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:47.374182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-464c3cee-b5d7-4a87-aba3-ac4553532421 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:47.374810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-464c3cee-b5d7-4a87-aba3-ac4553532421 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:47.375708 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-464c3cee-b5d7-4a87-aba3-ac4553532421 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:47.376395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-464c3cee-b5d7-4a87-aba3-ac4553532421 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:47.377302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-464c3cee-b5d7-4a87-aba3-ac4553532421 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:47.472058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-57328103-9e55-4291-ada5-ca01f340a4d3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:47.472668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-57328103-9e55-4291-ada5-ca01f340a4d3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:47.483112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57328103-9e55-4291-ada5-ca01f340a4d3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:47.483738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57328103-9e55-4291-ada5-ca01f340a4d3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:47.483996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57328103-9e55-4291-ada5-ca01f340a4d3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:47.484906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57328103-9e55-4291-ada5-ca01f340a4d3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:47.485389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57328103-9e55-4291-ada5-ca01f340a4d3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:47.485808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57328103-9e55-4291-ada5-ca01f340a4d3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:47.622937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-464c3cee-b5d7-4a87-aba3-ac4553532421 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:47.638442 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-464c3cee-b5d7-4a87-aba3-ac4553532421 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.280348 Oct 29 01:21:47.640643 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2014/4190] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:47 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:47.670647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-80882627-4535-4958-af33-2e4cc2a2746e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:47.670810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-80882627-4535-4958-af33-2e4cc2a2746e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:47.678871 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80882627-4535-4958-af33-2e4cc2a2746e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:47.679366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80882627-4535-4958-af33-2e4cc2a2746e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:47.679973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80882627-4535-4958-af33-2e4cc2a2746e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:47.681126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80882627-4535-4958-af33-2e4cc2a2746e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:47.681798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80882627-4535-4958-af33-2e4cc2a2746e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:47.682359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80882627-4535-4958-af33-2e4cc2a2746e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:47.713605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-57328103-9e55-4291-ada5-ca01f340a4d3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:47.722665 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-57328103-9e55-4291-ada5-ca01f340a4d3 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1307 microversion: 2.1 time: 0.254362 Oct 29 01:21:47.738253 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2177/4191] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:47 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1307 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:47.905586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-80882627-4535-4958-af33-2e4cc2a2746e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:47.916279 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-80882627-4535-4958-af33-2e4cc2a2746e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.251758 Oct 29 01:21:47.936698 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2015/4192] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:47 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:47.995633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b68e4ea9-53f6-43b0-b0aa-a6176fa12628 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-259888406", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:48.004445 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-b68e4ea9-53f6-43b0-b0aa-a6176fa12628 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b68e4ea9-53f6-43b0-b0aa-a6176fa12628 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 215 Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-259888406", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-259888406', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:48.007954 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:48.013500 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:48.013500 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:48.013500 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:48.013500 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:21:48.013500 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:21:48.013500 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 29 01:21:48.013500 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:48.016246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b68e4ea9-53f6-43b0-b0aa-a6176fa12628 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:48.017328 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b68e4ea9-53f6-43b0-b0aa-a6176fa12628 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.028396 Oct 29 01:21:48.018931 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2178/4193] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:21:47 2022] POST /compute/v2.1/servers => generated 123 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 01:21:48.028983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b314d5d1-1ffa-4432-8b10-cf9d8070e127 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:48.029989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b314d5d1-1ffa-4432-8b10-cf9d8070e127 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:48.036994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:48.039149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b314d5d1-1ffa-4432-8b10-cf9d8070e127 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:48.039956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b314d5d1-1ffa-4432-8b10-cf9d8070e127 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:48.040588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b314d5d1-1ffa-4432-8b10-cf9d8070e127 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:48.041536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b314d5d1-1ffa-4432-8b10-cf9d8070e127 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:48.042338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b314d5d1-1ffa-4432-8b10-cf9d8070e127 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:48.043062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b314d5d1-1ffa-4432-8b10-cf9d8070e127 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:48.077144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-726fcc5e-4fd4-4487-9a04-3519323e058b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:48.077785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-726fcc5e-4fd4-4487-9a04-3519323e058b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:48.092259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-726fcc5e-4fd4-4487-9a04-3519323e058b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:48.092746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-726fcc5e-4fd4-4487-9a04-3519323e058b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:48.093426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-726fcc5e-4fd4-4487-9a04-3519323e058b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:48.106316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-726fcc5e-4fd4-4487-9a04-3519323e058b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:48.107080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-726fcc5e-4fd4-4487-9a04-3519323e058b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:48.107698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-726fcc5e-4fd4-4487-9a04-3519323e058b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:48.324805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b314d5d1-1ffa-4432-8b10-cf9d8070e127 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:48.336518 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b314d5d1-1ffa-4432-8b10-cf9d8070e127 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.312396 Oct 29 01:21:48.345794 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2016/4194] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:48 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:48.352455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-726fcc5e-4fd4-4487-9a04-3519323e058b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:48.362893 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-726fcc5e-4fd4-4487-9a04-3519323e058b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1366 microversion: 2.1 time: 0.289873 Oct 29 01:21:48.365742 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2179/4195] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:48 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:48.372762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e478fe1f-777a-43ac-946e-dca15c86f3d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:48.373422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e478fe1f-777a-43ac-946e-dca15c86f3d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:48.375236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-525c5acc-5706-4046-8b40-64935f4ae3a8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:48.376065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-525c5acc-5706-4046-8b40-64935f4ae3a8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:48.384426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-525c5acc-5706-4046-8b40-64935f4ae3a8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:48.386543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-525c5acc-5706-4046-8b40-64935f4ae3a8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:48.387055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-525c5acc-5706-4046-8b40-64935f4ae3a8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:48.387808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-525c5acc-5706-4046-8b40-64935f4ae3a8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:48.388272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-525c5acc-5706-4046-8b40-64935f4ae3a8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:48.388701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-525c5acc-5706-4046-8b40-64935f4ae3a8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:48.398263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e478fe1f-777a-43ac-946e-dca15c86f3d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:48.398766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e478fe1f-777a-43ac-946e-dca15c86f3d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:48.399216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e478fe1f-777a-43ac-946e-dca15c86f3d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:48.399953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e478fe1f-777a-43ac-946e-dca15c86f3d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:48.400441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e478fe1f-777a-43ac-946e-dca15c86f3d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:48.400857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e478fe1f-777a-43ac-946e-dca15c86f3d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:48.678990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-525c5acc-5706-4046-8b40-64935f4ae3a8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:48.688420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e478fe1f-777a-43ac-946e-dca15c86f3d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:48.690083 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-525c5acc-5706-4046-8b40-64935f4ae3a8 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1510 microversion: 2.1 time: 0.325334 Oct 29 01:21:48.698887 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e478fe1f-777a-43ac-946e-dca15c86f3d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.328931 Oct 29 01:21:48.699694 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2180/4196] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:48 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:48.706288 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2017/4197] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:48 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1510 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:48.754174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-10e76e52-cfb9-44cb-a022-e69462af246c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:48.754540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-10e76e52-cfb9-44cb-a022-e69462af246c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:48.766013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10e76e52-cfb9-44cb-a022-e69462af246c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:48.773015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10e76e52-cfb9-44cb-a022-e69462af246c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:48.773626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10e76e52-cfb9-44cb-a022-e69462af246c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:48.774523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10e76e52-cfb9-44cb-a022-e69462af246c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:48.775075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10e76e52-cfb9-44cb-a022-e69462af246c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:48.775610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-10e76e52-cfb9-44cb-a022-e69462af246c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:48.798829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a3e49292-542c-41df-9201-3cca5100d74e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1136377179", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "key_name": "tempest-key-369932003", "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:48.890416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-a3e49292-542c-41df-9201-3cca5100d74e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] validate_networks() for [('daf068bd-431d-4e20-b386-6225154844e0', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:21:49.359644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-10e76e52-cfb9-44cb-a022-e69462af246c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:49.376117 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-10e76e52-cfb9-44cb-a022-e69462af246c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1307 microversion: 2.1 time: 0.626119 Oct 29 01:21:49.390218 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2181/4198] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:48 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1307 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:49.631735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-333efb09-9347-4642-9fe7-38e5ca517e6b req-f7e7d479-8cd2-4e4b-8eeb-3be6cc8f1cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "960fd6c4-4418-4490-a15c-5b02d54b2097", "name": "network-vif-plugged", "status": "completed", "tag": "2f3ceabd-e8e2-4197-8235-3476fd669990"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:49.631735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-333efb09-9347-4642-9fe7-38e5ca517e6b req-f7e7d479-8cd2-4e4b-8eeb-3be6cc8f1cfc service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:49.631735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-333efb09-9347-4642-9fe7-38e5ca517e6b req-f7e7d479-8cd2-4e4b-8eeb-3be6cc8f1cfc service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:49.631735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-333efb09-9347-4642-9fe7-38e5ca517e6b req-f7e7d479-8cd2-4e4b-8eeb-3be6cc8f1cfc service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:49.631735 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-333efb09-9347-4642-9fe7-38e5ca517e6b req-f7e7d479-8cd2-4e4b-8eeb-3be6cc8f1cfc service nova] Creating event network-vif-plugged:2f3ceabd-e8e2-4197-8235-3476fd669990 for instance 960fd6c4-4418-4490-a15c-5b02d54b2097 on n-h2-862964-3 Oct 29 01:21:49.631735 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-333efb09-9347-4642-9fe7-38e5ca517e6b req-f7e7d479-8cd2-4e4b-8eeb-3be6cc8f1cfc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090931 Oct 29 01:21:49.631735 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2182/4199] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:49.631735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2b9281a1-8f66-4ccf-af76-b1c13e975444 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:49.631735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2b9281a1-8f66-4ccf-af76-b1c13e975444 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:49.631735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b9281a1-8f66-4ccf-af76-b1c13e975444 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:49.631735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b9281a1-8f66-4ccf-af76-b1c13e975444 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:49.631735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b9281a1-8f66-4ccf-af76-b1c13e975444 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:49.631735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b9281a1-8f66-4ccf-af76-b1c13e975444 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:49.635821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b9281a1-8f66-4ccf-af76-b1c13e975444 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:49.635821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b9281a1-8f66-4ccf-af76-b1c13e975444 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-a3e49292-542c-41df-9201-3cca5100d74e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Invalid key_name provided. Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a3e49292-542c-41df-9201-3cca5100d74e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 246 Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1136377179", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "key_name": "tempest-key-369932003", "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid key_name provided. Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1136377179', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'key_name': 'tempest-key-369932003', 'networks': [{'uuid': 'daf068bd-431d-4e20-b386-6225154844e0'}]}}} Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-369932003 not found for user db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:49.637648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a3e49292-542c-41df-9201-3cca5100d74e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 400 to user: Invalid key_name provided. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a3e49292-542c-41df-9201-3cca5100d74e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.775391 Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2018/4200] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:21:48 2022] POST /compute/v2.1/servers => generated 70 bytes in 781 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0371daff-7a81-42d9-be4a-ab4c21fca196 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0371daff-7a81-42d9-be4a-ab4c21fca196 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0371daff-7a81-42d9-be4a-ab4c21fca196 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0371daff-7a81-42d9-be4a-ab4c21fca196 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:49.651462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0371daff-7a81-42d9-be4a-ab4c21fca196 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:49.657354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0371daff-7a81-42d9-be4a-ab4c21fca196 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:49.657354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0371daff-7a81-42d9-be4a-ab4c21fca196 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:49.657354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0371daff-7a81-42d9-be4a-ab4c21fca196 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:49.799569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2b9281a1-8f66-4ccf-af76-b1c13e975444 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:49.811814 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2b9281a1-8f66-4ccf-af76-b1c13e975444 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1366 microversion: 2.1 time: 0.326407 Oct 29 01:21:49.811996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0371daff-7a81-42d9-be4a-ab4c21fca196 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:49.813122 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2183/4201] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:49 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:49.818402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f6c98811-3502-4ba4-b325-cfd7b4e707b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:49.819223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f6c98811-3502-4ba4-b325-cfd7b4e707b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:49.832238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6c98811-3502-4ba4-b325-cfd7b4e707b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:49.834524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6c98811-3502-4ba4-b325-cfd7b4e707b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:49.835162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6c98811-3502-4ba4-b325-cfd7b4e707b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:49.836075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6c98811-3502-4ba4-b325-cfd7b4e707b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:49.836708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6c98811-3502-4ba4-b325-cfd7b4e707b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:49.837366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6c98811-3502-4ba4-b325-cfd7b4e707b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:49.839383 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0371daff-7a81-42d9-be4a-ab4c21fca196 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.263197 Oct 29 01:21:49.839994 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2019/4202] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:49 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:49.866510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-81c726b7-2a80-483c-a29d-b2eca32e7114 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:49.867307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-81c726b7-2a80-483c-a29d-b2eca32e7114 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:49.886718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81c726b7-2a80-483c-a29d-b2eca32e7114 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:49.886718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81c726b7-2a80-483c-a29d-b2eca32e7114 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:49.886718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81c726b7-2a80-483c-a29d-b2eca32e7114 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:49.886718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81c726b7-2a80-483c-a29d-b2eca32e7114 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:49.886718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81c726b7-2a80-483c-a29d-b2eca32e7114 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:49.886718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81c726b7-2a80-483c-a29d-b2eca32e7114 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:50.118900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-81c726b7-2a80-483c-a29d-b2eca32e7114 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:50.122152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f6c98811-3502-4ba4-b325-cfd7b4e707b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:50.127677 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-81c726b7-2a80-483c-a29d-b2eca32e7114 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.265180 Oct 29 01:21:50.128289 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2020/4203] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:49 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:50.130886 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f6c98811-3502-4ba4-b325-cfd7b4e707b3 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1510 microversion: 2.1 time: 0.316489 Oct 29 01:21:50.131474 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2184/4204] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:49 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1510 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:50.193558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-13dd604e-5fe1-4037-a992-c23e725c296b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1505361652", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:50.403780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c52065d1-421b-4411-8d10-368f4c96798d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:50.404637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c52065d1-421b-4411-8d10-368f4c96798d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:50.416219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c52065d1-421b-4411-8d10-368f4c96798d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:50.416969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c52065d1-421b-4411-8d10-368f4c96798d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:50.417632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c52065d1-421b-4411-8d10-368f4c96798d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:50.418791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c52065d1-421b-4411-8d10-368f4c96798d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:50.419709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c52065d1-421b-4411-8d10-368f4c96798d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:50.420145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c52065d1-421b-4411-8d10-368f4c96798d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:50.626775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.security_group_api [None req-13dd604e-5fe1-4037-a992-c23e725c296b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Neutron security group does_not_exist not found {{(pid=121100) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 29 01:21:50.630524 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-13dd604e-5fe1-4037-a992-c23e725c296b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-13dd604e-5fe1-4037-a992-c23e725c296b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 258 Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1505361652", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1505361652', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'daf068bd-431d-4e20-b386-6225154844e0'}]}}} Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 29 01:21:50.651513 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:50.658500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-13dd604e-5fe1-4037-a992-c23e725c296b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:50.668194 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-13dd604e-5fe1-4037-a992-c23e725c296b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.458497 Oct 29 01:21:50.668194 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2021/4205] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:21:50 2022] POST /compute/v2.1/servers => generated 106 bytes in 460 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:21:50.668667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1b6ce713-0762-4d1b-86e3-1ff98537beeb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:50.669714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1b6ce713-0762-4d1b-86e3-1ff98537beeb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:50.682079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b6ce713-0762-4d1b-86e3-1ff98537beeb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:50.686576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b6ce713-0762-4d1b-86e3-1ff98537beeb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:50.686576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b6ce713-0762-4d1b-86e3-1ff98537beeb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:50.687071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b6ce713-0762-4d1b-86e3-1ff98537beeb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:50.687927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b6ce713-0762-4d1b-86e3-1ff98537beeb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:50.688824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b6ce713-0762-4d1b-86e3-1ff98537beeb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:50.720616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c52065d1-421b-4411-8d10-368f4c96798d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:50.733770 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c52065d1-421b-4411-8d10-368f4c96798d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1307 microversion: 2.1 time: 0.334138 Oct 29 01:21:50.749194 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2185/4206] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:50 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1307 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:50.839504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-921384a2-95c6-43d4-863e-0f9e0b806c12 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:50.840528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-921384a2-95c6-43d4-863e-0f9e0b806c12 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:50.885323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-921384a2-95c6-43d4-863e-0f9e0b806c12 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:50.886205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-921384a2-95c6-43d4-863e-0f9e0b806c12 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:50.888635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1b6ce713-0762-4d1b-86e3-1ff98537beeb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:50.890089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-921384a2-95c6-43d4-863e-0f9e0b806c12 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:50.890887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-921384a2-95c6-43d4-863e-0f9e0b806c12 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:50.891374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-921384a2-95c6-43d4-863e-0f9e0b806c12 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:50.891814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-921384a2-95c6-43d4-863e-0f9e0b806c12 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:50.915593 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1b6ce713-0762-4d1b-86e3-1ff98537beeb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.259267 Oct 29 01:21:50.917942 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2022/4207] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:50 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:50.953921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-faa27f8e-663f-4530-917b-9a6fc456eaf1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:50.955020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-faa27f8e-663f-4530-917b-9a6fc456eaf1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:50.965457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faa27f8e-663f-4530-917b-9a6fc456eaf1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:50.968850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faa27f8e-663f-4530-917b-9a6fc456eaf1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:50.968850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faa27f8e-663f-4530-917b-9a6fc456eaf1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:50.968850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faa27f8e-663f-4530-917b-9a6fc456eaf1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:50.968850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faa27f8e-663f-4530-917b-9a6fc456eaf1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:50.970433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faa27f8e-663f-4530-917b-9a6fc456eaf1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:51.464141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-921384a2-95c6-43d4-863e-0f9e0b806c12 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:51.474511 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-921384a2-95c6-43d4-863e-0f9e0b806c12 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1366 microversion: 2.1 time: 0.639244 Oct 29 01:21:51.474871 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2186/4208] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:50 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1366 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:51.524181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-87d36786-90be-4717-b404-49f8523887a4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:51.524872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-87d36786-90be-4717-b404-49f8523887a4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:51.530959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-faa27f8e-663f-4530-917b-9a6fc456eaf1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:51.553342 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-faa27f8e-663f-4530-917b-9a6fc456eaf1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.600900 Oct 29 01:21:51.556346 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2023/4209] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:50 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:51.582534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87d36786-90be-4717-b404-49f8523887a4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:51.582534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87d36786-90be-4717-b404-49f8523887a4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:51.582534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87d36786-90be-4717-b404-49f8523887a4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:51.582534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87d36786-90be-4717-b404-49f8523887a4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:51.589467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-36da9a5f-55e8-4843-8d16-709ff15be166 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:51.590129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87d36786-90be-4717-b404-49f8523887a4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:51.592126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87d36786-90be-4717-b404-49f8523887a4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:51.597619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-36da9a5f-55e8-4843-8d16-709ff15be166 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 11635fa6-5b3f-4815-8721-4812cca16123] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:51.626174 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-36da9a5f-55e8-4843-8d16-709ff15be166 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance 11635fa6-5b3f-4815-8721-4812cca16123 could not be found. Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-36da9a5f-55e8-4843-8d16-709ff15be166 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/11635fa6-5b3f-4815-8721-4812cca16123 HTTP/1.1 Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 11635fa6-5b3f-4815-8721-4812cca16123 could not be found. Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '11635fa6-5b3f-4815-8721-4812cca16123'} Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11635fa6-5b3f-4815-8721-4812cca16123 could not be found. Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11635fa6-5b3f-4815-8721-4812cca16123 could not be found. Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:51.637903 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:51.643685 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:51.643685 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:51.643685 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:51.643685 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:51.643685 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:21:51.643685 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:21:51.643685 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11635fa6-5b3f-4815-8721-4812cca16123 could not be found. Oct 29 01:21:51.643685 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:51.645862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-36da9a5f-55e8-4843-8d16-709ff15be166 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance 11635fa6-5b3f-4815-8721-4812cca16123 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:51.650301 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-36da9a5f-55e8-4843-8d16-709ff15be166 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "DELETE /compute/v2.1/servers/11635fa6-5b3f-4815-8721-4812cca16123" status: 404 len: 111 microversion: 2.1 time: 0.069508 Oct 29 01:21:51.651169 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2024/4210] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:21:51 2022] DELETE /compute/v2.1/servers/11635fa6-5b3f-4815-8721-4812cca16123 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:21:51.669702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6d6ca63e-c4da-428a-a440-33461ec62d52 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:51.678588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6d6ca63e-c4da-428a-a440-33461ec62d52 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:51.699093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d6ca63e-c4da-428a-a440-33461ec62d52 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:51.706038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d6ca63e-c4da-428a-a440-33461ec62d52 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:51.706796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d6ca63e-c4da-428a-a440-33461ec62d52 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:51.707764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d6ca63e-c4da-428a-a440-33461ec62d52 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:51.711354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d6ca63e-c4da-428a-a440-33461ec62d52 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:51.712098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d6ca63e-c4da-428a-a440-33461ec62d52 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:52.148269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-87d36786-90be-4717-b404-49f8523887a4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:52.161915 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-87d36786-90be-4717-b404-49f8523887a4 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1510 microversion: 2.1 time: 0.657947 Oct 29 01:21:52.162924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6d6ca63e-c4da-428a-a440-33461ec62d52 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:52.164324 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2187/4211] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:51 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1510 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:52.173675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f694d9e7-a010-4a3f-aafa-57e4930bce19 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:52.173998 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6d6ca63e-c4da-428a-a440-33461ec62d52 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.516942 Oct 29 01:21:52.174653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f694d9e7-a010-4a3f-aafa-57e4930bce19 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:52.175080 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2025/4212] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:51 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:52.182773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f694d9e7-a010-4a3f-aafa-57e4930bce19 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:52.183659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f694d9e7-a010-4a3f-aafa-57e4930bce19 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:52.184352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f694d9e7-a010-4a3f-aafa-57e4930bce19 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:52.185547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f694d9e7-a010-4a3f-aafa-57e4930bce19 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:52.186302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f694d9e7-a010-4a3f-aafa-57e4930bce19 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:52.186973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f694d9e7-a010-4a3f-aafa-57e4930bce19 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:52.210405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5e1d7ab7-797e-4f82-8e34-4405cdc7317c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:52.211457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5e1d7ab7-797e-4f82-8e34-4405cdc7317c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:52.218795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e1d7ab7-797e-4f82-8e34-4405cdc7317c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:52.219721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e1d7ab7-797e-4f82-8e34-4405cdc7317c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:52.220612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e1d7ab7-797e-4f82-8e34-4405cdc7317c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:52.221687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e1d7ab7-797e-4f82-8e34-4405cdc7317c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:52.222345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e1d7ab7-797e-4f82-8e34-4405cdc7317c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:52.222950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e1d7ab7-797e-4f82-8e34-4405cdc7317c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:52.577135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5e1d7ab7-797e-4f82-8e34-4405cdc7317c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:52.586746 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5e1d7ab7-797e-4f82-8e34-4405cdc7317c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.385607 Oct 29 01:21:52.587330 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2026/4213] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:52 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:52.610902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f694d9e7-a010-4a3f-aafa-57e4930bce19 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:52.612393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ceef52c2-00e2-43ff-9fa2-fbfd43efdf65 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:52.613077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ceef52c2-00e2-43ff-9fa2-fbfd43efdf65 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:52.623582 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f694d9e7-a010-4a3f-aafa-57e4930bce19 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1307 microversion: 2.1 time: 0.456984 Oct 29 01:21:52.623807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ceef52c2-00e2-43ff-9fa2-fbfd43efdf65 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:52.624299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ceef52c2-00e2-43ff-9fa2-fbfd43efdf65 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:52.639570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ceef52c2-00e2-43ff-9fa2-fbfd43efdf65 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:52.639570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ceef52c2-00e2-43ff-9fa2-fbfd43efdf65 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:52.639570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ceef52c2-00e2-43ff-9fa2-fbfd43efdf65 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:52.639570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ceef52c2-00e2-43ff-9fa2-fbfd43efdf65 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:52.641543 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2188/4214] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:52 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1307 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:52.646867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c813fc03-a648-41f7-8c8f-eb35fd855172 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:52.647567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c813fc03-a648-41f7-8c8f-eb35fd855172 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Failed to fetch instance by id 9223372036854775808 {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 01:21:52.648346 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-c813fc03-a648-41f7-8c8f-eb35fd855172 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c813fc03-a648-41f7-8c8f-eb35fd855172 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 9223372036854775808 could not be found. Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '9223372036854775808'} Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:52.650281 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:52.656446 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:52.656446 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:21:52.656446 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:21:52.656446 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 29 01:21:52.656446 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:52.658826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c813fc03-a648-41f7-8c8f-eb35fd855172 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:52.659950 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c813fc03-a648-41f7-8c8f-eb35fd855172 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.018780 Oct 29 01:21:52.669911 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2189/4215] 10.222.0.26 () {58 vars in 1188 bytes} [Sat Oct 29 01:21:52 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:21:52.671276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4e6fa43d-360d-45b2-ae9d-00b715f94626 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:52.672154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4e6fa43d-360d-45b2-ae9d-00b715f94626 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:52.682332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e6fa43d-360d-45b2-ae9d-00b715f94626 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:52.683225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e6fa43d-360d-45b2-ae9d-00b715f94626 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:52.683918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e6fa43d-360d-45b2-ae9d-00b715f94626 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:52.684886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e6fa43d-360d-45b2-ae9d-00b715f94626 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:52.685642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e6fa43d-360d-45b2-ae9d-00b715f94626 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:52.686385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e6fa43d-360d-45b2-ae9d-00b715f94626 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:52.889243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4e6fa43d-360d-45b2-ae9d-00b715f94626 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:52.903756 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4e6fa43d-360d-45b2-ae9d-00b715f94626 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.236853 Oct 29 01:21:52.908637 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2190/4216] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:52 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:52.932480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9a34b240-c1f7-4e23-9b51-697fe6c91049 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:52.934210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9a34b240-c1f7-4e23-9b51-697fe6c91049 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:52.951517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a34b240-c1f7-4e23-9b51-697fe6c91049 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:52.952447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a34b240-c1f7-4e23-9b51-697fe6c91049 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:52.953096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a34b240-c1f7-4e23-9b51-697fe6c91049 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:52.954073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a34b240-c1f7-4e23-9b51-697fe6c91049 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:52.954991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a34b240-c1f7-4e23-9b51-697fe6c91049 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:52.955601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a34b240-c1f7-4e23-9b51-697fe6c91049 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:52.970515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ceef52c2-00e2-43ff-9fa2-fbfd43efdf65 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:52.983226 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ceef52c2-00e2-43ff-9fa2-fbfd43efdf65 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1554 microversion: 2.1 time: 0.386192 Oct 29 01:21:52.984495 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2027/4217] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:52 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1554 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:53.009888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6d229db0-e6ae-4919-8e94-b132f6b9b71f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:53.010808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6d229db0-e6ae-4919-8e94-b132f6b9b71f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:53.019795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d229db0-e6ae-4919-8e94-b132f6b9b71f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:53.021327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d229db0-e6ae-4919-8e94-b132f6b9b71f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:53.022079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d229db0-e6ae-4919-8e94-b132f6b9b71f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:53.023085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d229db0-e6ae-4919-8e94-b132f6b9b71f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:53.023727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d229db0-e6ae-4919-8e94-b132f6b9b71f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:53.024361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d229db0-e6ae-4919-8e94-b132f6b9b71f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:53.149520 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6d229db0-e6ae-4919-8e94-b132f6b9b71f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144619 Oct 29 01:21:53.150342 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2028/4218] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:21:53 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:53.195235 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-094e5257-6c04-488d-94a1-7bc029411b9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:53.196703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-094e5257-6c04-488d-94a1-7bc029411b9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:53.204412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-094e5257-6c04-488d-94a1-7bc029411b9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:53.205278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-094e5257-6c04-488d-94a1-7bc029411b9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:53.205966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-094e5257-6c04-488d-94a1-7bc029411b9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:53.206917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-094e5257-6c04-488d-94a1-7bc029411b9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:53.207575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-094e5257-6c04-488d-94a1-7bc029411b9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:53.209008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-094e5257-6c04-488d-94a1-7bc029411b9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:53.344936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9a34b240-c1f7-4e23-9b51-697fe6c91049 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:53.356738 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9a34b240-c1f7-4e23-9b51-697fe6c91049 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.428800 Oct 29 01:21:53.358290 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2191/4219] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:52 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:53.395194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-70a29b29-be5a-4f12-a41b-3cb9c3c3e7cf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:53.400292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-70a29b29-be5a-4f12-a41b-3cb9c3c3e7cf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Failed to fetch instance by id -1 {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 01:21:53.405067 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-70a29b29-be5a-4f12-a41b-3cb9c3c3e7cf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance -1 could not be found. Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-70a29b29-be5a-4f12-a41b-3cb9c3c3e7cf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance -1 could not be found. Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '-1'} Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:53.408224 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:53.420038 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:21:53.420038 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:21:53.420038 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 29 01:21:53.420038 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:53.443185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-70a29b29-be5a-4f12-a41b-3cb9c3c3e7cf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance -1 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:53.448153 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-70a29b29-be5a-4f12-a41b-3cb9c3c3e7cf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.059817 Oct 29 01:21:53.448153 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2192/4220] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:21:53 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:21:53.459477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-96b45381-a449-4e65-a1a6-54dbd9900be8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:53.460642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-96b45381-a449-4e65-a1a6-54dbd9900be8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:53.478140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96b45381-a449-4e65-a1a6-54dbd9900be8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:53.479009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96b45381-a449-4e65-a1a6-54dbd9900be8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:53.483649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96b45381-a449-4e65-a1a6-54dbd9900be8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:53.483649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96b45381-a449-4e65-a1a6-54dbd9900be8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:53.483649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96b45381-a449-4e65-a1a6-54dbd9900be8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:53.483649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-96b45381-a449-4e65-a1a6-54dbd9900be8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:53.502830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-094e5257-6c04-488d-94a1-7bc029411b9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:53.518581 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-094e5257-6c04-488d-94a1-7bc029411b9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1487 microversion: 2.1 time: 0.327984 Oct 29 01:21:53.524285 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2029/4221] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:53 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1487 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:53.550306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cd19c51f-5976-4c3c-ab8b-2adb8f91b5cb tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2141371827"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:53.554091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cd19c51f-5976-4c3c-ab8b-2adb8f91b5cb tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:53.562246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd19c51f-5976-4c3c-ab8b-2adb8f91b5cb tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:53.563106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd19c51f-5976-4c3c-ab8b-2adb8f91b5cb tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:53.563717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd19c51f-5976-4c3c-ab8b-2adb8f91b5cb tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:53.564626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd19c51f-5976-4c3c-ab8b-2adb8f91b5cb tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:53.565288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd19c51f-5976-4c3c-ab8b-2adb8f91b5cb tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:53.565874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd19c51f-5976-4c3c-ab8b-2adb8f91b5cb tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:53.658454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:53.815949 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cd19c51f-5976-4c3c-ab8b-2adb8f91b5cb tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "PUT /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1060 microversion: 2.1 time: 0.272137 Oct 29 01:21:53.820429 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2030/4222] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 29 01:21:53 2022] PUT /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1060 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:53.828899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-76b2e0fe-1a49-4e41-a5d4-a68ca031c526 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:53.830196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-76b2e0fe-1a49-4e41-a5d4-a68ca031c526 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:53.845351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-96b45381-a449-4e65-a1a6-54dbd9900be8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:53.861147 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-96b45381-a449-4e65-a1a6-54dbd9900be8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.408938 Oct 29 01:21:53.866019 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2193/4223] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:53 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:53.887214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76b2e0fe-1a49-4e41-a5d4-a68ca031c526 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:53.887214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76b2e0fe-1a49-4e41-a5d4-a68ca031c526 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:53.887214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76b2e0fe-1a49-4e41-a5d4-a68ca031c526 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:53.887792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-d041c78b-c940-4a7a-8c3a-a79e057abdbf req-a5c7db46-c123-4b4a-bfb6-dd24e85c80b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802ee4ce-5a28-416c-a4eb-e0954859bcb2", "name": "network-vif-plugged", "status": "completed", "tag": "3d866210-67fd-4657-846c-eb8a9102daa8"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:53.887906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76b2e0fe-1a49-4e41-a5d4-a68ca031c526 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:53.887906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76b2e0fe-1a49-4e41-a5d4-a68ca031c526 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:53.887906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76b2e0fe-1a49-4e41-a5d4-a68ca031c526 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:53.905872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d041c78b-c940-4a7a-8c3a-a79e057abdbf req-a5c7db46-c123-4b4a-bfb6-dd24e85c80b8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:53.906447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d041c78b-c940-4a7a-8c3a-a79e057abdbf req-a5c7db46-c123-4b4a-bfb6-dd24e85c80b8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:53.906998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d041c78b-c940-4a7a-8c3a-a79e057abdbf req-a5c7db46-c123-4b4a-bfb6-dd24e85c80b8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:53.926498 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-d041c78b-c940-4a7a-8c3a-a79e057abdbf req-a5c7db46-c123-4b4a-bfb6-dd24e85c80b8 service nova] Creating event network-vif-plugged:3d866210-67fd-4657-846c-eb8a9102daa8 for instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 on n-h2-862964-3 Oct 29 01:21:53.953066 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-d041c78b-c940-4a7a-8c3a-a79e057abdbf req-a5c7db46-c123-4b4a-bfb6-dd24e85c80b8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076351 Oct 29 01:21:53.956098 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2194/4224] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:53.960188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-be680302-ad70-4e4b-a348-9228212d75ea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:53.960899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-be680302-ad70-4e4b-a348-9228212d75ea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:53.973865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be680302-ad70-4e4b-a348-9228212d75ea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:53.974600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be680302-ad70-4e4b-a348-9228212d75ea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:53.975291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be680302-ad70-4e4b-a348-9228212d75ea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:53.976123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be680302-ad70-4e4b-a348-9228212d75ea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:53.976714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be680302-ad70-4e4b-a348-9228212d75ea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:53.977274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be680302-ad70-4e4b-a348-9228212d75ea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:54.003416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:54.546607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-be680302-ad70-4e4b-a348-9228212d75ea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:54.554977 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-be680302-ad70-4e4b-a348-9228212d75ea tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1487 microversion: 2.1 time: 0.599416 Oct 29 01:21:54.569357 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2195/4225] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:53 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1487 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:54.581086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-db5398b0-f0fa-4434-832f-83707c399290 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:54.581457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-db5398b0-f0fa-4434-832f-83707c399290 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:54.584238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-76b2e0fe-1a49-4e41-a5d4-a68ca031c526 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:54.590620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db5398b0-f0fa-4434-832f-83707c399290 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:54.591609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db5398b0-f0fa-4434-832f-83707c399290 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:54.592835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db5398b0-f0fa-4434-832f-83707c399290 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:54.593805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db5398b0-f0fa-4434-832f-83707c399290 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:54.594576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db5398b0-f0fa-4434-832f-83707c399290 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:54.595116 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-76b2e0fe-1a49-4e41-a5d4-a68ca031c526 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1307 microversion: 2.1 time: 0.772282 Oct 29 01:21:54.596172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db5398b0-f0fa-4434-832f-83707c399290 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:54.599139 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2031/4226] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:53 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1307 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:54.612912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eb4fcffb-d971-4e24-b269-a9fbbd77aaa5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:54.613568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-eb4fcffb-d971-4e24-b269-a9fbbd77aaa5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:54.649842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb4fcffb-d971-4e24-b269-a9fbbd77aaa5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:54.652089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb4fcffb-d971-4e24-b269-a9fbbd77aaa5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:54.653711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb4fcffb-d971-4e24-b269-a9fbbd77aaa5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:54.654700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb4fcffb-d971-4e24-b269-a9fbbd77aaa5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:54.659442 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb4fcffb-d971-4e24-b269-a9fbbd77aaa5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:54.660220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb4fcffb-d971-4e24-b269-a9fbbd77aaa5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:55.060428 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-eb4fcffb-d971-4e24-b269-a9fbbd77aaa5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:55.077430 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-eb4fcffb-d971-4e24-b269-a9fbbd77aaa5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1487 microversion: 2.1 time: 0.466700 Oct 29 01:21:55.077709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-db5398b0-f0fa-4434-832f-83707c399290 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:55.097612 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2032/4227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:54 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1487 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:55.102384 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-db5398b0-f0fa-4434-832f-83707c399290 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.530924 Oct 29 01:21:55.103446 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2196/4228] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:54 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:55.120836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a0c455ed-51df-4117-ba28-a0e627b3aa0a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:55.124740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a0c455ed-51df-4117-ba28-a0e627b3aa0a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:55.131607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-74eb85af-51e6-4cc7-a2c7-7f3e49a9269a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:55.132296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-74eb85af-51e6-4cc7-a2c7-7f3e49a9269a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: e0717d28-de1d-4262-ac8e-72626b531f7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:55.138645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0c455ed-51df-4117-ba28-a0e627b3aa0a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:55.139563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0c455ed-51df-4117-ba28-a0e627b3aa0a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:55.140194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0c455ed-51df-4117-ba28-a0e627b3aa0a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:55.141110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0c455ed-51df-4117-ba28-a0e627b3aa0a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:55.141766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0c455ed-51df-4117-ba28-a0e627b3aa0a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:55.146016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0c455ed-51df-4117-ba28-a0e627b3aa0a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:55.146375 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-74eb85af-51e6-4cc7-a2c7-7f3e49a9269a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance e0717d28-de1d-4262-ac8e-72626b531f7c could not be found. Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-74eb85af-51e6-4cc7-a2c7-7f3e49a9269a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/e0717d28-de1d-4262-ac8e-72626b531f7c/action HTTP/1.1 Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 19 Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: {"forceDelete": {}} Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance e0717d28-de1d-4262-ac8e-72626b531f7c could not be found. Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'e0717d28-de1d-4262-ac8e-72626b531f7c', 'body': {'forceDelete': {}}} Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0717d28-de1d-4262-ac8e-72626b531f7c could not be found. Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0717d28-de1d-4262-ac8e-72626b531f7c could not be found. Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:55.149638 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:55.158466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:21:55.158466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:21:55.158466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0717d28-de1d-4262-ac8e-72626b531f7c could not be found. Oct 29 01:21:55.158466 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:55.161801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-74eb85af-51e6-4cc7-a2c7-7f3e49a9269a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance e0717d28-de1d-4262-ac8e-72626b531f7c could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:55.163138 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-74eb85af-51e6-4cc7-a2c7-7f3e49a9269a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/e0717d28-de1d-4262-ac8e-72626b531f7c/action" status: 404 len: 111 microversion: 2.1 time: 0.037180 Oct 29 01:21:55.164355 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2197/4229] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:21:55 2022] POST /compute/v2.1/servers/e0717d28-de1d-4262-ac8e-72626b531f7c/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:21:55.175429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b9cebeec-fdf0-46b9-9b8d-38e58a3c517e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:55.181056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b9cebeec-fdf0-46b9-9b8d-38e58a3c517e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:55.184594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a0c455ed-51df-4117-ba28-a0e627b3aa0a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:21:55.193124 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9cebeec-fdf0-46b9-9b8d-38e58a3c517e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:55.198158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9cebeec-fdf0-46b9-9b8d-38e58a3c517e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:55.198732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9cebeec-fdf0-46b9-9b8d-38e58a3c517e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:55.199592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9cebeec-fdf0-46b9-9b8d-38e58a3c517e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:55.200261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9cebeec-fdf0-46b9-9b8d-38e58a3c517e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:55.201884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9cebeec-fdf0-46b9-9b8d-38e58a3c517e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:55.693550 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a0c455ed-51df-4117-ba28-a0e627b3aa0a tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 204 len: 0 microversion: 2.1 time: 0.594132 Oct 29 01:21:55.696734 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2033/4230] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:21:55 2022] DELETE /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:21:55.709516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d64a68a3-1c22-4154-8041-7e624b925840 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:55.711051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d64a68a3-1c22-4154-8041-7e624b925840 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:55.737832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d64a68a3-1c22-4154-8041-7e624b925840 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:55.738336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d64a68a3-1c22-4154-8041-7e624b925840 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:55.738777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d64a68a3-1c22-4154-8041-7e624b925840 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:55.740027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d64a68a3-1c22-4154-8041-7e624b925840 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:55.747549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d64a68a3-1c22-4154-8041-7e624b925840 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:55.748103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d64a68a3-1c22-4154-8041-7e624b925840 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:56.092515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b9cebeec-fdf0-46b9-9b8d-38e58a3c517e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:56.119446 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b9cebeec-fdf0-46b9-9b8d-38e58a3c517e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.948055 Oct 29 01:21:56.135530 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2198/4231] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:55 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:56.161529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b805eb99-2f77-42c1-a051-c0e2b4160315 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:56.163484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b805eb99-2f77-42c1-a051-c0e2b4160315 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:56.196142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b805eb99-2f77-42c1-a051-c0e2b4160315 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:56.198315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b805eb99-2f77-42c1-a051-c0e2b4160315 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:56.200205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b805eb99-2f77-42c1-a051-c0e2b4160315 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:56.202007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b805eb99-2f77-42c1-a051-c0e2b4160315 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:56.204836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b805eb99-2f77-42c1-a051-c0e2b4160315 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:56.208728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b805eb99-2f77-42c1-a051-c0e2b4160315 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:56.339052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d64a68a3-1c22-4154-8041-7e624b925840 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:56.350972 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d64a68a3-1c22-4154-8041-7e624b925840 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1307 microversion: 2.1 time: 0.651822 Oct 29 01:21:56.352231 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2034/4232] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:55 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1307 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:56.357436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d321e059-3b94-459b-8b1a-cd497fc7c624 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:56.358243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d321e059-3b94-459b-8b1a-cd497fc7c624 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:56.373650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d321e059-3b94-459b-8b1a-cd497fc7c624 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:56.379190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d321e059-3b94-459b-8b1a-cd497fc7c624 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:56.379190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d321e059-3b94-459b-8b1a-cd497fc7c624 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:56.379190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d321e059-3b94-459b-8b1a-cd497fc7c624 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:56.379190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d321e059-3b94-459b-8b1a-cd497fc7c624 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:56.379190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d321e059-3b94-459b-8b1a-cd497fc7c624 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:56.563657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b805eb99-2f77-42c1-a051-c0e2b4160315 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:56.575358 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b805eb99-2f77-42c1-a051-c0e2b4160315 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1493 microversion: 2.1 time: 0.437927 Oct 29 01:21:56.578032 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2199/4233] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:56 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1493 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:56.584515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-8404f008-4fce-412b-8158-35a1b75bdb67 req-0c1d0a33-24ab-4054-9424-17b3a9f29f9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "960fd6c4-4418-4490-a15c-5b02d54b2097", "tag": "2f3ceabd-e8e2-4197-8235-3476fd669990"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:56.597305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8404f008-4fce-412b-8158-35a1b75bdb67 req-0c1d0a33-24ab-4054-9424-17b3a9f29f9d service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:56.601333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8404f008-4fce-412b-8158-35a1b75bdb67 req-0c1d0a33-24ab-4054-9424-17b3a9f29f9d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:56.601730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d321e059-3b94-459b-8b1a-cd497fc7c624 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:56.601844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8404f008-4fce-412b-8158-35a1b75bdb67 req-0c1d0a33-24ab-4054-9424-17b3a9f29f9d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:56.617097 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-8404f008-4fce-412b-8158-35a1b75bdb67 req-0c1d0a33-24ab-4054-9424-17b3a9f29f9d service nova] Creating event network-changed:2f3ceabd-e8e2-4197-8235-3476fd669990 for instance 960fd6c4-4418-4490-a15c-5b02d54b2097 on n-h2-862964-3 Oct 29 01:21:56.617748 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d321e059-3b94-459b-8b1a-cd497fc7c624 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.264269 Oct 29 01:21:56.618769 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2035/4234] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:56 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:56.628623 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-8404f008-4fce-412b-8158-35a1b75bdb67 req-0c1d0a33-24ab-4054-9424-17b3a9f29f9d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048927 Oct 29 01:21:56.629694 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2200/4235] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:56.644944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-63bea4cf-723b-4788-a7e5-2e0d1f3f2004 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:56.649025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-63bea4cf-723b-4788-a7e5-2e0d1f3f2004 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 5a2042f0-5eb4-4e11-bcd1-803aeb5d32dd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:56.658640 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-63bea4cf-723b-4788-a7e5-2e0d1f3f2004 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance 5a2042f0-5eb4-4e11-bcd1-803aeb5d32dd could not be found. Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-63bea4cf-723b-4788-a7e5-2e0d1f3f2004 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/5a2042f0-5eb4-4e11-bcd1-803aeb5d32dd/action HTTP/1.1 Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 39 Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: {"os-getConsoleOutput": {"length": 10}} Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 5a2042f0-5eb4-4e11-bcd1-803aeb5d32dd could not be found. Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '5a2042f0-5eb4-4e11-bcd1-803aeb5d32dd', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a2042f0-5eb4-4e11-bcd1-803aeb5d32dd could not be found. Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a2042f0-5eb4-4e11-bcd1-803aeb5d32dd could not be found. Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:56.664500 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:56.670897 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:56.670897 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:56.670897 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:21:56.670897 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:21:56.670897 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a2042f0-5eb4-4e11-bcd1-803aeb5d32dd could not be found. Oct 29 01:21:56.670897 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:56.672432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-63bea4cf-723b-4788-a7e5-2e0d1f3f2004 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance 5a2042f0-5eb4-4e11-bcd1-803aeb5d32dd could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:56.675576 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-63bea4cf-723b-4788-a7e5-2e0d1f3f2004 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/5a2042f0-5eb4-4e11-bcd1-803aeb5d32dd/action" status: 404 len: 111 microversion: 2.1 time: 0.034543 Oct 29 01:21:56.675950 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2036/4236] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:21:56 2022] POST /compute/v2.1/servers/5a2042f0-5eb4-4e11-bcd1-803aeb5d32dd/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:21:56.687645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e662b141-3420-441b-aa4d-c10cbb49fd7f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:56.695186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e662b141-3420-441b-aa4d-c10cbb49fd7f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:56.700792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e662b141-3420-441b-aa4d-c10cbb49fd7f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:56.701319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e662b141-3420-441b-aa4d-c10cbb49fd7f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:56.701750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e662b141-3420-441b-aa4d-c10cbb49fd7f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:56.703143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e662b141-3420-441b-aa4d-c10cbb49fd7f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:56.703781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e662b141-3420-441b-aa4d-c10cbb49fd7f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:56.704395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e662b141-3420-441b-aa4d-c10cbb49fd7f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:56.912807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e662b141-3420-441b-aa4d-c10cbb49fd7f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:56.921834 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e662b141-3420-441b-aa4d-c10cbb49fd7f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.240385 Oct 29 01:21:56.923647 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2201/4237] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:56 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:56.950251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b964fdaa-eb59-4df3-82d0-2bb8b7b727b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:56.951813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b964fdaa-eb59-4df3-82d0-2bb8b7b727b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:56.960526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b964fdaa-eb59-4df3-82d0-2bb8b7b727b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:56.961453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b964fdaa-eb59-4df3-82d0-2bb8b7b727b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:56.962332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b964fdaa-eb59-4df3-82d0-2bb8b7b727b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:56.964174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b964fdaa-eb59-4df3-82d0-2bb8b7b727b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:56.964853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b964fdaa-eb59-4df3-82d0-2bb8b7b727b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:56.965496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b964fdaa-eb59-4df3-82d0-2bb8b7b727b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:57.379421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-551c2bb8-e2d1-48f7-bd78-cae2be320031 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:57.386450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-551c2bb8-e2d1-48f7-bd78-cae2be320031 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:57.386450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:21:57.394078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-551c2bb8-e2d1-48f7-bd78-cae2be320031 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:57.396702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-551c2bb8-e2d1-48f7-bd78-cae2be320031 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:57.398947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-551c2bb8-e2d1-48f7-bd78-cae2be320031 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:57.399475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-551c2bb8-e2d1-48f7-bd78-cae2be320031 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:57.401691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-551c2bb8-e2d1-48f7-bd78-cae2be320031 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:57.402153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-551c2bb8-e2d1-48f7-bd78-cae2be320031 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:57.416223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b964fdaa-eb59-4df3-82d0-2bb8b7b727b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:57.428910 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b964fdaa-eb59-4df3-82d0-2bb8b7b727b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.482728 Oct 29 01:21:57.445571 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2037/4238] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:56 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:57.468328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4d7afdea-c835-4997-b838-c460fe34f16f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:57.471381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4d7afdea-c835-4997-b838-c460fe34f16f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 5497c816-6d6f-4cbf-9da1-3cd0cc6acd9b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:57.480695 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-4d7afdea-c835-4997-b838-c460fe34f16f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance 5497c816-6d6f-4cbf-9da1-3cd0cc6acd9b could not be found. Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4d7afdea-c835-4997-b838-c460fe34f16f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/5497c816-6d6f-4cbf-9da1-3cd0cc6acd9b HTTP/1.1 Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 5497c816-6d6f-4cbf-9da1-3cd0cc6acd9b could not be found. Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '5497c816-6d6f-4cbf-9da1-3cd0cc6acd9b'} Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5497c816-6d6f-4cbf-9da1-3cd0cc6acd9b could not be found. Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5497c816-6d6f-4cbf-9da1-3cd0cc6acd9b could not be found. Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:57.487835 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:57.494955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:57.494955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:21:57.494955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:21:57.494955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5497c816-6d6f-4cbf-9da1-3cd0cc6acd9b could not be found. Oct 29 01:21:57.494955 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:57.499250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4d7afdea-c835-4997-b838-c460fe34f16f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance 5497c816-6d6f-4cbf-9da1-3cd0cc6acd9b could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:57.502178 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4d7afdea-c835-4997-b838-c460fe34f16f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/5497c816-6d6f-4cbf-9da1-3cd0cc6acd9b" status: 404 len: 111 microversion: 2.1 time: 0.045542 Oct 29 01:21:57.510424 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2038/4239] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:57 2022] GET /compute/v2.1/servers/5497c816-6d6f-4cbf-9da1-3cd0cc6acd9b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:21:57.515473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-72043411-6df7-474d-9b63-49605e99d3a6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:57.523166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-72043411-6df7-474d-9b63-49605e99d3a6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:57.544675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-72043411-6df7-474d-9b63-49605e99d3a6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:57.549059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-72043411-6df7-474d-9b63-49605e99d3a6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:57.551175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-72043411-6df7-474d-9b63-49605e99d3a6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:57.557613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-72043411-6df7-474d-9b63-49605e99d3a6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:57.558414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-72043411-6df7-474d-9b63-49605e99d3a6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:57.559768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-72043411-6df7-474d-9b63-49605e99d3a6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:57.843005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-551c2bb8-e2d1-48f7-bd78-cae2be320031 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:57.851760 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-551c2bb8-e2d1-48f7-bd78-cae2be320031 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1487 microversion: 2.1 time: 0.476080 Oct 29 01:21:57.856757 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2202/4240] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:57 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1487 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:57.868394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1b2cbce5-8b95-4be8-9e2b-afbeb1fba2ca tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:57.871092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1b2cbce5-8b95-4be8-9e2b-afbeb1fba2ca tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:57.888902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b2cbce5-8b95-4be8-9e2b-afbeb1fba2ca tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:57.889372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b2cbce5-8b95-4be8-9e2b-afbeb1fba2ca tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:57.889972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b2cbce5-8b95-4be8-9e2b-afbeb1fba2ca tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:57.890700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b2cbce5-8b95-4be8-9e2b-afbeb1fba2ca tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:57.891602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b2cbce5-8b95-4be8-9e2b-afbeb1fba2ca tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:57.892041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b2cbce5-8b95-4be8-9e2b-afbeb1fba2ca tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:57.901340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-72043411-6df7-474d-9b63-49605e99d3a6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:57.912445 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-72043411-6df7-474d-9b63-49605e99d3a6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.400724 Oct 29 01:21:57.913051 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2039/4241] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:57 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:57.919497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4f5eaa04-6123-4fcb-92d4-3c58fce3f4d9 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:57.920269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4f5eaa04-6123-4fcb-92d4-3c58fce3f4d9 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:57.944331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f5eaa04-6123-4fcb-92d4-3c58fce3f4d9 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:57.946178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f5eaa04-6123-4fcb-92d4-3c58fce3f4d9 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:57.947426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f5eaa04-6123-4fcb-92d4-3c58fce3f4d9 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:57.949897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f5eaa04-6123-4fcb-92d4-3c58fce3f4d9 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:57.952565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f5eaa04-6123-4fcb-92d4-3c58fce3f4d9 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:57.953694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f5eaa04-6123-4fcb-92d4-3c58fce3f4d9 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:58.025312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4f5eaa04-6123-4fcb-92d4-3c58fce3f4d9 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:21:58.155199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1b2cbce5-8b95-4be8-9e2b-afbeb1fba2ca tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:58.167663 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1b2cbce5-8b95-4be8-9e2b-afbeb1fba2ca tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1493 microversion: 2.1 time: 0.308975 Oct 29 01:21:58.169059 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2203/4242] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:57 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1493 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:58.176233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-22da3ccb-2b8a-4292-86f7-01a7776d25f1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:58.177714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-22da3ccb-2b8a-4292-86f7-01a7776d25f1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:58.184666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22da3ccb-2b8a-4292-86f7-01a7776d25f1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:58.185469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22da3ccb-2b8a-4292-86f7-01a7776d25f1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:58.186097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22da3ccb-2b8a-4292-86f7-01a7776d25f1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:58.186972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22da3ccb-2b8a-4292-86f7-01a7776d25f1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:58.187646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22da3ccb-2b8a-4292-86f7-01a7776d25f1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:58.188388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22da3ccb-2b8a-4292-86f7-01a7776d25f1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:58.415069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-22da3ccb-2b8a-4292-86f7-01a7776d25f1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:58.429039 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-22da3ccb-2b8a-4292-86f7-01a7776d25f1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.258473 Oct 29 01:21:58.437820 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2204/4243] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:58 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:58.471121 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4f5eaa04-6123-4fcb-92d4-3c58fce3f4d9 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 204 len: 0 microversion: 2.1 time: 0.554055 Oct 29 01:21:58.479388 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2040/4244] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:21:57 2022] DELETE /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:21:58.484201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-416b8f84-a668-4c85-860b-c59689da5768 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:58.484817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-416b8f84-a668-4c85-860b-c59689da5768 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:58.502922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-416b8f84-a668-4c85-860b-c59689da5768 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:58.508185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-416b8f84-a668-4c85-860b-c59689da5768 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:58.515120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-416b8f84-a668-4c85-860b-c59689da5768 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:58.516514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-416b8f84-a668-4c85-860b-c59689da5768 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:58.518167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-416b8f84-a668-4c85-860b-c59689da5768 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:58.519376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-416b8f84-a668-4c85-860b-c59689da5768 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:58.556822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-532e7405-0bbb-4b90-970c-9a3e5e7f907d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-273680140", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-532e7405-0bbb-4b90-970c-9a3e5e7f907d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 237 Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-273680140", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-273680140', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'daf068bd-431d-4e20-b386-6225154844e0'}]}}} Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:58.584642 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-532e7405-0bbb-4b90-970c-9a3e5e7f907d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:58.597060 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-532e7405-0bbb-4b90-970c-9a3e5e7f907d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.037941 Oct 29 01:21:58.600632 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2041/4245] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:21:58 2022] POST /compute/v2.1/servers => generated 139 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 01:21:58.609265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f7460c35-ee63-44d7-83ff-77fc52dbac4c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:58.610559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f7460c35-ee63-44d7-83ff-77fc52dbac4c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:58.631742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7460c35-ee63-44d7-83ff-77fc52dbac4c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:58.632516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7460c35-ee63-44d7-83ff-77fc52dbac4c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:58.633994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7460c35-ee63-44d7-83ff-77fc52dbac4c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:58.653109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7460c35-ee63-44d7-83ff-77fc52dbac4c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:58.653706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7460c35-ee63-44d7-83ff-77fc52dbac4c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:58.654937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7460c35-ee63-44d7-83ff-77fc52dbac4c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:58.808343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-416b8f84-a668-4c85-860b-c59689da5768 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:58.820021 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-416b8f84-a668-4c85-860b-c59689da5768 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1493 microversion: 2.1 time: 0.339727 Oct 29 01:21:58.820950 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2205/4246] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:58 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1493 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:58.827930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-e5261cac-536e-4fa1-b128-ddcad4c11b4c req-41ee52cf-a287-4b39-b6b5-7894e1fb5d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb8e84ce-a371-428f-945a-e0e252cd1cff", "name": "network-vif-deleted", "tag": "b6eb2077-13c3-44f4-864b-998f9c9207d9"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:58.847631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e5261cac-536e-4fa1-b128-ddcad4c11b4c req-41ee52cf-a287-4b39-b6b5-7894e1fb5d2a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:58.848337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e5261cac-536e-4fa1-b128-ddcad4c11b4c req-41ee52cf-a287-4b39-b6b5-7894e1fb5d2a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:58.849262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e5261cac-536e-4fa1-b128-ddcad4c11b4c req-41ee52cf-a287-4b39-b6b5-7894e1fb5d2a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:58.879929 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-e5261cac-536e-4fa1-b128-ddcad4c11b4c req-41ee52cf-a287-4b39-b6b5-7894e1fb5d2a service nova] Creating event network-vif-deleted:b6eb2077-13c3-44f4-864b-998f9c9207d9 for instance cb8e84ce-a371-428f-945a-e0e252cd1cff on n-h1-862964-3 Oct 29 01:21:58.892093 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-e5261cac-536e-4fa1-b128-ddcad4c11b4c req-41ee52cf-a287-4b39-b6b5-7894e1fb5d2a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067727 Oct 29 01:21:58.894644 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2206/4247] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:58.934132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f7460c35-ee63-44d7-83ff-77fc52dbac4c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:58.937588 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f7460c35-ee63-44d7-83ff-77fc52dbac4c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.332079 Oct 29 01:21:58.938727 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2042/4248] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:58 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:58.967257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5ba35d8f-4499-4df3-8434-318a7e9a85a5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:58.968020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5ba35d8f-4499-4df3-8434-318a7e9a85a5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:58.978352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ba35d8f-4499-4df3-8434-318a7e9a85a5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:58.978847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ba35d8f-4499-4df3-8434-318a7e9a85a5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:58.979285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ba35d8f-4499-4df3-8434-318a7e9a85a5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:58.982165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ba35d8f-4499-4df3-8434-318a7e9a85a5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:58.982634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ba35d8f-4499-4df3-8434-318a7e9a85a5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:58.983287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ba35d8f-4499-4df3-8434-318a7e9a85a5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:59.150695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5ba35d8f-4499-4df3-8434-318a7e9a85a5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:59.159328 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5ba35d8f-4499-4df3-8434-318a7e9a85a5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.197037 Oct 29 01:21:59.159928 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2207/4249] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:58 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:21:59.196827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9154aaf5-0f12-4b11-be8a-bd315477aa73 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:59.201608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9154aaf5-0f12-4b11-be8a-bd315477aa73 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:59.212081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9154aaf5-0f12-4b11-be8a-bd315477aa73 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:59.215083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9154aaf5-0f12-4b11-be8a-bd315477aa73 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:59.215491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9154aaf5-0f12-4b11-be8a-bd315477aa73 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:59.216233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9154aaf5-0f12-4b11-be8a-bd315477aa73 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:59.219744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9154aaf5-0f12-4b11-be8a-bd315477aa73 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:59.220565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9154aaf5-0f12-4b11-be8a-bd315477aa73 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:59.262272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a21bdd85-b3aa-4858-97ec-828835769ef6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-279254492", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a21bdd85-b3aa-4858-97ec-828835769ef6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 234 Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-279254492", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-279254492', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'daf068bd-431d-4e20-b386-6225154844e0'}]}}} Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:59.276900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a21bdd85-b3aa-4858-97ec-828835769ef6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a21bdd85-b3aa-4858-97ec-828835769ef6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.020503 Oct 29 01:21:59.283519 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2208/4250] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:21:59 2022] POST /compute/v2.1/servers => generated 133 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:21:59.295849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a79da715-223a-4ff9-afe1-7f9d4271abbc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:59.295849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a79da715-223a-4ff9-afe1-7f9d4271abbc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:59.305007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9154aaf5-0f12-4b11-be8a-bd315477aa73 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:59.305820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9154aaf5-0f12-4b11-be8a-bd315477aa73 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:59.306445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9154aaf5-0f12-4b11-be8a-bd315477aa73 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:59.306993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-9154aaf5-0f12-4b11-be8a-bd315477aa73 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lazy-loading 'fault' on Instance uuid cb8e84ce-a371-428f-945a-e0e252cd1cff {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:21:59.322583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a79da715-223a-4ff9-afe1-7f9d4271abbc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:59.325105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a79da715-223a-4ff9-afe1-7f9d4271abbc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:59.325792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a79da715-223a-4ff9-afe1-7f9d4271abbc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:59.326907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a79da715-223a-4ff9-afe1-7f9d4271abbc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:59.327588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a79da715-223a-4ff9-afe1-7f9d4271abbc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:59.327925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a79da715-223a-4ff9-afe1-7f9d4271abbc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:59.400304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9154aaf5-0f12-4b11-be8a-bd315477aa73 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:59.412196 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9154aaf5-0f12-4b11-be8a-bd315477aa73 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 200 len: 1310 microversion: 2.1 time: 0.218698 Oct 29 01:21:59.416740 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2043/4251] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:59 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 1310 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:59.719750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a79da715-223a-4ff9-afe1-7f9d4271abbc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:21:59.752685 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a79da715-223a-4ff9-afe1-7f9d4271abbc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.468788 Oct 29 01:21:59.754569 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2209/4252] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:59 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:59.782922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-808e0e6c-b8b6-409c-997c-ad953ef92a02 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:59.783629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-808e0e6c-b8b6-409c-997c-ad953ef92a02 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:59.811323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-808e0e6c-b8b6-409c-997c-ad953ef92a02 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:59.818663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-808e0e6c-b8b6-409c-997c-ad953ef92a02 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:59.819167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-808e0e6c-b8b6-409c-997c-ad953ef92a02 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:59.819945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-808e0e6c-b8b6-409c-997c-ad953ef92a02 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:59.826525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-808e0e6c-b8b6-409c-997c-ad953ef92a02 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:59.831101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-808e0e6c-b8b6-409c-997c-ad953ef92a02 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:59.847174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d1c2070e-b8da-41b4-82b9-66b719323f67 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:59.847966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d1c2070e-b8da-41b4-82b9-66b719323f67 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:21:59.866798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1c2070e-b8da-41b4-82b9-66b719323f67 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:59.867302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1c2070e-b8da-41b4-82b9-66b719323f67 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:59.871397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1c2070e-b8da-41b4-82b9-66b719323f67 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:21:59.872195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1c2070e-b8da-41b4-82b9-66b719323f67 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:21:59.872674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1c2070e-b8da-41b4-82b9-66b719323f67 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:21:59.873116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1c2070e-b8da-41b4-82b9-66b719323f67 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:00.168627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d1c2070e-b8da-41b4-82b9-66b719323f67 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:00.182843 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d1c2070e-b8da-41b4-82b9-66b719323f67 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1493 microversion: 2.1 time: 0.339290 Oct 29 01:22:00.186110 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2210/4253] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:59 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1493 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:00.321599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-808e0e6c-b8b6-409c-997c-ad953ef92a02 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:00.331780 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-808e0e6c-b8b6-409c-997c-ad953ef92a02 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.553472 Oct 29 01:22:00.332446 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2044/4254] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:21:59 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:00.359612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7990bbc2-5945-49af-952d-1712617ace42 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:00.363290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7990bbc2-5945-49af-952d-1712617ace42 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 7c544d15-5154-4db7-accc-64f89f584c7f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:00.368273 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-7990bbc2-5945-49af-952d-1712617ace42 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance 7c544d15-5154-4db7-accc-64f89f584c7f could not be found. Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7990bbc2-5945-49af-952d-1712617ace42 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/7c544d15-5154-4db7-accc-64f89f584c7f/action HTTP/1.1 Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 13 Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: {"pause": {}} Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 7c544d15-5154-4db7-accc-64f89f584c7f could not be found. Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '7c544d15-5154-4db7-accc-64f89f584c7f', 'body': {'pause': {}}} Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c544d15-5154-4db7-accc-64f89f584c7f could not be found. Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c544d15-5154-4db7-accc-64f89f584c7f could not be found. Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:00.376216 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:00.382642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:00.382642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:00.382642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c544d15-5154-4db7-accc-64f89f584c7f could not be found. Oct 29 01:22:00.382642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.382642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7990bbc2-5945-49af-952d-1712617ace42 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance 7c544d15-5154-4db7-accc-64f89f584c7f could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:00.382642 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7990bbc2-5945-49af-952d-1712617ace42 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/7c544d15-5154-4db7-accc-64f89f584c7f/action" status: 404 len: 111 microversion: 2.1 time: 0.026174 Oct 29 01:22:00.383512 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2211/4255] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:22:00 2022] POST /compute/v2.1/servers/7c544d15-5154-4db7-accc-64f89f584c7f/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:00.392029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3d2c3a75-ff15-4001-8dfe-f324be2e5be2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:00.392923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3d2c3a75-ff15-4001-8dfe-f324be2e5be2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:00.401950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d2c3a75-ff15-4001-8dfe-f324be2e5be2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:00.406532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d2c3a75-ff15-4001-8dfe-f324be2e5be2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:00.412366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d2c3a75-ff15-4001-8dfe-f324be2e5be2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:00.413928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d2c3a75-ff15-4001-8dfe-f324be2e5be2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:00.414512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d2c3a75-ff15-4001-8dfe-f324be2e5be2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:00.415039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d2c3a75-ff15-4001-8dfe-f324be2e5be2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:00.444960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a0f10c59-3276-46e0-9370-a22b78cc753d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:00.445620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a0f10c59-3276-46e0-9370-a22b78cc753d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:00.470503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0f10c59-3276-46e0-9370-a22b78cc753d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:00.471128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0f10c59-3276-46e0-9370-a22b78cc753d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:00.474461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0f10c59-3276-46e0-9370-a22b78cc753d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:00.474461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0f10c59-3276-46e0-9370-a22b78cc753d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:00.474461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0f10c59-3276-46e0-9370-a22b78cc753d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:00.474461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0f10c59-3276-46e0-9370-a22b78cc753d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:00.516501 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-a0f10c59-3276-46e0-9370-a22b78cc753d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance cb8e84ce-a371-428f-945a-e0e252cd1cff could not be found. Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a0f10c59-3276-46e0-9370-a22b78cc753d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff HTTP/1.1 Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance cb8e84ce-a371-428f-945a-e0e252cd1cff could not be found. Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'cb8e84ce-a371-428f-945a-e0e252cd1cff'} Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb8e84ce-a371-428f-945a-e0e252cd1cff could not be found. Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb8e84ce-a371-428f-945a-e0e252cd1cff could not be found. Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:00.519696 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.528075 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.528075 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:00.528075 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:00.528075 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:00.528075 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:00.528075 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb8e84ce-a371-428f-945a-e0e252cd1cff could not be found. Oct 29 01:22:00.528075 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.528075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a0f10c59-3276-46e0-9370-a22b78cc753d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance cb8e84ce-a371-428f-945a-e0e252cd1cff could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:00.528075 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a0f10c59-3276-46e0-9370-a22b78cc753d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 404 len: 111 microversion: 2.1 time: 0.086608 Oct 29 01:22:00.530141 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2212/4256] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:00 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:00.550573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-336c3edf-62f4-408f-bb68-f7b1faa7bc72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:00.552138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-336c3edf-62f4-408f-bb68-f7b1faa7bc72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:00.563648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-336c3edf-62f4-408f-bb68-f7b1faa7bc72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:00.565459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-336c3edf-62f4-408f-bb68-f7b1faa7bc72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:00.566159 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-336c3edf-62f4-408f-bb68-f7b1faa7bc72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:00.569612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-336c3edf-62f4-408f-bb68-f7b1faa7bc72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:00.577752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-336c3edf-62f4-408f-bb68-f7b1faa7bc72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:00.579433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-336c3edf-62f4-408f-bb68-f7b1faa7bc72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:00.615055 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-336c3edf-62f4-408f-bb68-f7b1faa7bc72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance cb8e84ce-a371-428f-945a-e0e252cd1cff could not be found. Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-336c3edf-62f4-408f-bb68-f7b1faa7bc72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff HTTP/1.1 Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance cb8e84ce-a371-428f-945a-e0e252cd1cff could not be found. Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'cb8e84ce-a371-428f-945a-e0e252cd1cff'} Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb8e84ce-a371-428f-945a-e0e252cd1cff could not be found. Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:00.619149 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb8e84ce-a371-428f-945a-e0e252cd1cff could not be found. Oct 29 01:22:00.625332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.625332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:00.625332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.625332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.625332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:00.625332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:00.625332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:00.625332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:00.625332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb8e84ce-a371-428f-945a-e0e252cd1cff could not be found. Oct 29 01:22:00.625332 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.628291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-336c3edf-62f4-408f-bb68-f7b1faa7bc72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance cb8e84ce-a371-428f-945a-e0e252cd1cff could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:00.635360 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-336c3edf-62f4-408f-bb68-f7b1faa7bc72 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 404 len: 111 microversion: 2.1 time: 0.085848 Oct 29 01:22:00.637233 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2213/4257] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:22:00 2022] DELETE /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:22:00.645005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9b2efb90-0486-4005-8f75-da9b299cc734 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:00.646088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9b2efb90-0486-4005-8f75-da9b299cc734 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: cb8e84ce-a371-428f-945a-e0e252cd1cff] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:00.676035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b2efb90-0486-4005-8f75-da9b299cc734 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:00.680720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b2efb90-0486-4005-8f75-da9b299cc734 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:00.681197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b2efb90-0486-4005-8f75-da9b299cc734 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:00.681936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b2efb90-0486-4005-8f75-da9b299cc734 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:00.688864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b2efb90-0486-4005-8f75-da9b299cc734 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:00.694555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b2efb90-0486-4005-8f75-da9b299cc734 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:00.731634 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-9b2efb90-0486-4005-8f75-da9b299cc734 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance cb8e84ce-a371-428f-945a-e0e252cd1cff could not be found. Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9b2efb90-0486-4005-8f75-da9b299cc734 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff HTTP/1.1 Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance cb8e84ce-a371-428f-945a-e0e252cd1cff could not be found. Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'cb8e84ce-a371-428f-945a-e0e252cd1cff'} Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb8e84ce-a371-428f-945a-e0e252cd1cff could not be found. Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb8e84ce-a371-428f-945a-e0e252cd1cff could not be found. Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:00.733292 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.739035 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.739035 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:00.739035 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:00.739035 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:00.739035 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:00.739035 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb8e84ce-a371-428f-945a-e0e252cd1cff could not be found. Oct 29 01:22:00.739035 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.739035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9b2efb90-0486-4005-8f75-da9b299cc734 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance cb8e84ce-a371-428f-945a-e0e252cd1cff could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:00.739035 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9b2efb90-0486-4005-8f75-da9b299cc734 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff" status: 404 len: 111 microversion: 2.1 time: 0.097050 Oct 29 01:22:00.740387 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2214/4258] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:00 2022] GET /compute/v2.1/servers/cb8e84ce-a371-428f-945a-e0e252cd1cff => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:00.753634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bea5a0f9-9cb8-4735-a456-5f7ff27fa301 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:00.754152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bea5a0f9-9cb8-4735-a456-5f7ff27fa301 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:00.774570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bea5a0f9-9cb8-4735-a456-5f7ff27fa301 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:00.774570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bea5a0f9-9cb8-4735-a456-5f7ff27fa301 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:00.774570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bea5a0f9-9cb8-4735-a456-5f7ff27fa301 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:00.775006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bea5a0f9-9cb8-4735-a456-5f7ff27fa301 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:00.775534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bea5a0f9-9cb8-4735-a456-5f7ff27fa301 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:00.779952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bea5a0f9-9cb8-4735-a456-5f7ff27fa301 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:00.816729 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-bea5a0f9-9cb8-4735-a456-5f7ff27fa301 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 could not be found. Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bea5a0f9-9cb8-4735-a456-5f7ff27fa301 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 HTTP/1.1 Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 could not be found. Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7'} Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 could not be found. Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:00.824658 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 could not be found. Oct 29 01:22:00.830174 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.830174 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:00.830174 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.830174 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.830174 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:00.830174 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:00.830174 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:00.830174 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:00.830174 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 could not be found. Oct 29 01:22:00.830174 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.831977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bea5a0f9-9cb8-4735-a456-5f7ff27fa301 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:00.833276 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bea5a0f9-9cb8-4735-a456-5f7ff27fa301 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 404 len: 111 microversion: 2.1 time: 0.089463 Oct 29 01:22:00.834335 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2215/4259] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:22:00 2022] DELETE /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:00.842708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-73e82246-1f11-4d02-b0b6-fd371035196e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:00.843571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-73e82246-1f11-4d02-b0b6-fd371035196e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:00.851339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73e82246-1f11-4d02-b0b6-fd371035196e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:00.852219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73e82246-1f11-4d02-b0b6-fd371035196e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:00.852861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73e82246-1f11-4d02-b0b6-fd371035196e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:00.853840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73e82246-1f11-4d02-b0b6-fd371035196e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:00.854463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73e82246-1f11-4d02-b0b6-fd371035196e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:00.855276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73e82246-1f11-4d02-b0b6-fd371035196e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:00.875420 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-73e82246-1f11-4d02-b0b6-fd371035196e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 could not be found. Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-73e82246-1f11-4d02-b0b6-fd371035196e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 HTTP/1.1 Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 could not be found. Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7'} Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 could not be found. Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 could not be found. Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:00.877945 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.884243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.884243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:00.884243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:00.884243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:00.884243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:00.884243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 could not be found. Oct 29 01:22:00.884243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.886534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-73e82246-1f11-4d02-b0b6-fd371035196e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:00.887949 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-73e82246-1f11-4d02-b0b6-fd371035196e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7" status: 404 len: 111 microversion: 2.1 time: 0.049507 Oct 29 01:22:00.889041 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2216/4260] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:00 2022] GET /compute/v2.1/servers/e58cfcdf-1f7c-4db1-a2b0-6a66a6e4c7c7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:00.899472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a87cedf5-24c1-47d0-800d-3979eaf0104e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:00.900370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a87cedf5-24c1-47d0-800d-3979eaf0104e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:00.908863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a87cedf5-24c1-47d0-800d-3979eaf0104e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:00.910431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a87cedf5-24c1-47d0-800d-3979eaf0104e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:00.911202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a87cedf5-24c1-47d0-800d-3979eaf0104e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:00.912270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a87cedf5-24c1-47d0-800d-3979eaf0104e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:00.912947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a87cedf5-24c1-47d0-800d-3979eaf0104e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:00.913893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a87cedf5-24c1-47d0-800d-3979eaf0104e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:00.935426 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-a87cedf5-24c1-47d0-800d-3979eaf0104e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance 2d014296-4cd2-4a65-89e1-fba4193cae7c could not be found. Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a87cedf5-24c1-47d0-800d-3979eaf0104e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c HTTP/1.1 Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 2d014296-4cd2-4a65-89e1-fba4193cae7c could not be found. Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '2d014296-4cd2-4a65-89e1-fba4193cae7c'} Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d014296-4cd2-4a65-89e1-fba4193cae7c could not be found. Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:00.946695 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d014296-4cd2-4a65-89e1-fba4193cae7c could not be found. Oct 29 01:22:00.951779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.951779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:00.951779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.951779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:00.951779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:00.951779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:00.951779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:00.951779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:00.951779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d014296-4cd2-4a65-89e1-fba4193cae7c could not be found. Oct 29 01:22:00.951779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:00.956910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a87cedf5-24c1-47d0-800d-3979eaf0104e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance 2d014296-4cd2-4a65-89e1-fba4193cae7c could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:00.958700 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a87cedf5-24c1-47d0-800d-3979eaf0104e tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 404 len: 111 microversion: 2.1 time: 0.064499 Oct 29 01:22:00.959674 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2217/4261] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:22:00 2022] DELETE /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:00.969369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ca025bb1-212a-4456-8fa1-6a7481c7c7e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:00.970500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ca025bb1-212a-4456-8fa1-6a7481c7c7e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2d014296-4cd2-4a65-89e1-fba4193cae7c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:00.979245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca025bb1-212a-4456-8fa1-6a7481c7c7e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:00.979995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca025bb1-212a-4456-8fa1-6a7481c7c7e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:00.981041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca025bb1-212a-4456-8fa1-6a7481c7c7e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:00.981959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca025bb1-212a-4456-8fa1-6a7481c7c7e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:00.982586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca025bb1-212a-4456-8fa1-6a7481c7c7e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:00.983180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca025bb1-212a-4456-8fa1-6a7481c7c7e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.031916 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-ca025bb1-212a-4456-8fa1-6a7481c7c7e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance 2d014296-4cd2-4a65-89e1-fba4193cae7c could not be found. Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ca025bb1-212a-4456-8fa1-6a7481c7c7e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c HTTP/1.1 Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 2d014296-4cd2-4a65-89e1-fba4193cae7c could not be found. Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '2d014296-4cd2-4a65-89e1-fba4193cae7c'} Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d014296-4cd2-4a65-89e1-fba4193cae7c could not be found. Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d014296-4cd2-4a65-89e1-fba4193cae7c could not be found. Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:01.038535 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.046026 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.046026 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:01.046026 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:01.046026 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:01.046026 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:01.046026 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d014296-4cd2-4a65-89e1-fba4193cae7c could not be found. Oct 29 01:22:01.046026 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.047588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3d2c3a75-ff15-4001-8dfe-f324be2e5be2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:01.051217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ca025bb1-212a-4456-8fa1-6a7481c7c7e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance 2d014296-4cd2-4a65-89e1-fba4193cae7c could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:01.054060 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3d2c3a75-ff15-4001-8dfe-f324be2e5be2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.665946 Oct 29 01:22:01.054659 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2045/4262] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:00 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:01.057874 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ca025bb1-212a-4456-8fa1-6a7481c7c7e5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c" status: 404 len: 111 microversion: 2.1 time: 0.092440 Oct 29 01:22:01.059227 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2218/4263] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:00 2022] GET /compute/v2.1/servers/2d014296-4cd2-4a65-89e1-fba4193cae7c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:01.072332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-75e9ac06-acd2-4318-ad8f-1ad8e063db9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:01.075664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-75e9ac06-acd2-4318-ad8f-1ad8e063db9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:01.080870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2f755165-08f5-44e0-b6ef-0b3ade7827df tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:01.081547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2f755165-08f5-44e0-b6ef-0b3ade7827df tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:01.104273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e9ac06-acd2-4318-ad8f-1ad8e063db9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.105251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e9ac06-acd2-4318-ad8f-1ad8e063db9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.107544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e9ac06-acd2-4318-ad8f-1ad8e063db9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.107753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f755165-08f5-44e0-b6ef-0b3ade7827df tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.108097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f755165-08f5-44e0-b6ef-0b3ade7827df tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.108545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f755165-08f5-44e0-b6ef-0b3ade7827df tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.109279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f755165-08f5-44e0-b6ef-0b3ade7827df tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.109894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e9ac06-acd2-4318-ad8f-1ad8e063db9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.111500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e9ac06-acd2-4318-ad8f-1ad8e063db9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.111951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e9ac06-acd2-4318-ad8f-1ad8e063db9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.123010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f755165-08f5-44e0-b6ef-0b3ade7827df tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.123010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f755165-08f5-44e0-b6ef-0b3ade7827df tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.143874 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-75e9ac06-acd2-4318-ad8f-1ad8e063db9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance efedae7c-2224-41e7-8493-0bcb9dc4535c could not be found. Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-75e9ac06-acd2-4318-ad8f-1ad8e063db9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c HTTP/1.1 Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance efedae7c-2224-41e7-8493-0bcb9dc4535c could not be found. Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'efedae7c-2224-41e7-8493-0bcb9dc4535c'} Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efedae7c-2224-41e7-8493-0bcb9dc4535c could not be found. Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:01.147681 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efedae7c-2224-41e7-8493-0bcb9dc4535c could not be found. Oct 29 01:22:01.153287 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.153287 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:01.153287 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.153287 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.153287 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:01.153287 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:01.153287 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:01.153287 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:01.153287 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efedae7c-2224-41e7-8493-0bcb9dc4535c could not be found. Oct 29 01:22:01.153287 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.153287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-75e9ac06-acd2-4318-ad8f-1ad8e063db9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance efedae7c-2224-41e7-8493-0bcb9dc4535c could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:01.155456 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-75e9ac06-acd2-4318-ad8f-1ad8e063db9c tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 404 len: 111 microversion: 2.1 time: 0.085333 Oct 29 01:22:01.155456 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2219/4264] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:22:01 2022] DELETE /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:22:01.171652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-54149966-a6aa-4581-97b1-214118c455f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:01.171652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-54149966-a6aa-4581-97b1-214118c455f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: efedae7c-2224-41e7-8493-0bcb9dc4535c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:01.172036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:22:01.173488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54149966-a6aa-4581-97b1-214118c455f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.173989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54149966-a6aa-4581-97b1-214118c455f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.174461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54149966-a6aa-4581-97b1-214118c455f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.175180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54149966-a6aa-4581-97b1-214118c455f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.175714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54149966-a6aa-4581-97b1-214118c455f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.176087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54149966-a6aa-4581-97b1-214118c455f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.195617 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-54149966-a6aa-4581-97b1-214118c455f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance efedae7c-2224-41e7-8493-0bcb9dc4535c could not be found. Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-54149966-a6aa-4581-97b1-214118c455f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c HTTP/1.1 Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance efedae7c-2224-41e7-8493-0bcb9dc4535c could not be found. Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'efedae7c-2224-41e7-8493-0bcb9dc4535c'} Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efedae7c-2224-41e7-8493-0bcb9dc4535c could not be found. Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efedae7c-2224-41e7-8493-0bcb9dc4535c could not be found. Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:01.197380 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.204550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.204550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:01.204550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:01.204550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:01.204550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:01.204550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efedae7c-2224-41e7-8493-0bcb9dc4535c could not be found. Oct 29 01:22:01.204550 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.204550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-54149966-a6aa-4581-97b1-214118c455f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance efedae7c-2224-41e7-8493-0bcb9dc4535c could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:01.204550 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-54149966-a6aa-4581-97b1-214118c455f1 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c" status: 404 len: 111 microversion: 2.1 time: 0.041377 Oct 29 01:22:01.204550 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2220/4265] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:01 2022] GET /compute/v2.1/servers/efedae7c-2224-41e7-8493-0bcb9dc4535c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:22:01.212832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bbfb4877-b0f0-47a2-80ef-1e8d941aaf4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:01.213574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bbfb4877-b0f0-47a2-80ef-1e8d941aaf4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:01.220765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbfb4877-b0f0-47a2-80ef-1e8d941aaf4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.224462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbfb4877-b0f0-47a2-80ef-1e8d941aaf4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.224462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbfb4877-b0f0-47a2-80ef-1e8d941aaf4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.224462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbfb4877-b0f0-47a2-80ef-1e8d941aaf4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.224462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbfb4877-b0f0-47a2-80ef-1e8d941aaf4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.224462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbfb4877-b0f0-47a2-80ef-1e8d941aaf4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.375218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2f755165-08f5-44e0-b6ef-0b3ade7827df tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:01.385065 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2f755165-08f5-44e0-b6ef-0b3ade7827df tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.308001 Oct 29 01:22:01.385683 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2046/4266] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:01 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:01.406739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c8569cc7-d19a-403a-ae66-66627898e6ce tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:01.407369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c8569cc7-d19a-403a-ae66-66627898e6ce tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:01.414720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8569cc7-d19a-403a-ae66-66627898e6ce tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.415272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8569cc7-d19a-403a-ae66-66627898e6ce tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.415861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8569cc7-d19a-403a-ae66-66627898e6ce tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.416633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8569cc7-d19a-403a-ae66-66627898e6ce tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.417450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8569cc7-d19a-403a-ae66-66627898e6ce tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.418255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8569cc7-d19a-403a-ae66-66627898e6ce tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.435746 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-c8569cc7-d19a-403a-ae66-66627898e6ce tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance 38d86ca7-7755-4635-a7dc-5764fec864d0 could not be found. Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c8569cc7-d19a-403a-ae66-66627898e6ce tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 HTTP/1.1 Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 38d86ca7-7755-4635-a7dc-5764fec864d0 could not be found. Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '38d86ca7-7755-4635-a7dc-5764fec864d0'} Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d86ca7-7755-4635-a7dc-5764fec864d0 could not be found. Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:01.437788 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d86ca7-7755-4635-a7dc-5764fec864d0 could not be found. Oct 29 01:22:01.444019 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.444019 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:01.444019 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.444019 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.444019 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:01.444019 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:01.444019 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:01.444019 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:01.444019 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d86ca7-7755-4635-a7dc-5764fec864d0 could not be found. Oct 29 01:22:01.444019 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.445082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bbfb4877-b0f0-47a2-80ef-1e8d941aaf4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:01.448339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c8569cc7-d19a-403a-ae66-66627898e6ce tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance 38d86ca7-7755-4635-a7dc-5764fec864d0 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:01.448339 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c8569cc7-d19a-403a-ae66-66627898e6ce tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 404 len: 111 microversion: 2.1 time: 0.054509 Oct 29 01:22:01.448339 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2047/4267] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:22:01 2022] DELETE /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:01.456475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fad602e6-431a-4bd1-8cb0-c83fc068f9e3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:01.457022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fad602e6-431a-4bd1-8cb0-c83fc068f9e3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:01.457196 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bbfb4877-b0f0-47a2-80ef-1e8d941aaf4a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1493 microversion: 2.1 time: 0.249247 Oct 29 01:22:01.458169 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2221/4268] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:01 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1493 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:01.479218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fad602e6-431a-4bd1-8cb0-c83fc068f9e3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.480767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-16f182a2-580b-4894-9b80-5bab73050ec5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:01.480767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-16f182a2-580b-4894-9b80-5bab73050ec5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 38d86ca7-7755-4635-a7dc-5764fec864d0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:01.480985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fad602e6-431a-4bd1-8cb0-c83fc068f9e3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.480985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fad602e6-431a-4bd1-8cb0-c83fc068f9e3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.481641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fad602e6-431a-4bd1-8cb0-c83fc068f9e3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.482060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fad602e6-431a-4bd1-8cb0-c83fc068f9e3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.482496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fad602e6-431a-4bd1-8cb0-c83fc068f9e3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.491247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16f182a2-580b-4894-9b80-5bab73050ec5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.491854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16f182a2-580b-4894-9b80-5bab73050ec5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.492853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16f182a2-580b-4894-9b80-5bab73050ec5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.493820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16f182a2-580b-4894-9b80-5bab73050ec5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.494537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16f182a2-580b-4894-9b80-5bab73050ec5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.495303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16f182a2-580b-4894-9b80-5bab73050ec5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.504383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:22:01.519858 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-16f182a2-580b-4894-9b80-5bab73050ec5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance 38d86ca7-7755-4635-a7dc-5764fec864d0 could not be found. Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-16f182a2-580b-4894-9b80-5bab73050ec5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 HTTP/1.1 Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 38d86ca7-7755-4635-a7dc-5764fec864d0 could not be found. Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '38d86ca7-7755-4635-a7dc-5764fec864d0'} Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d86ca7-7755-4635-a7dc-5764fec864d0 could not be found. Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d86ca7-7755-4635-a7dc-5764fec864d0 could not be found. Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:01.523146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.538385 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.538385 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:01.538385 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:01.538385 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:01.538385 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:01.538385 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d86ca7-7755-4635-a7dc-5764fec864d0 could not be found. Oct 29 01:22:01.538385 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.538385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-16f182a2-580b-4894-9b80-5bab73050ec5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance 38d86ca7-7755-4635-a7dc-5764fec864d0 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:01.538385 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-16f182a2-580b-4894-9b80-5bab73050ec5 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0" status: 404 len: 111 microversion: 2.1 time: 0.066629 Oct 29 01:22:01.538385 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2222/4269] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:01 2022] GET /compute/v2.1/servers/38d86ca7-7755-4635-a7dc-5764fec864d0 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:01.538385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-33917e4f-31fe-4e9f-bc5f-8ff726a3f61d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:01.538385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-33917e4f-31fe-4e9f-bc5f-8ff726a3f61d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:01.546345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33917e4f-31fe-4e9f-bc5f-8ff726a3f61d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.547006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33917e4f-31fe-4e9f-bc5f-8ff726a3f61d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.548719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33917e4f-31fe-4e9f-bc5f-8ff726a3f61d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.550829 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33917e4f-31fe-4e9f-bc5f-8ff726a3f61d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.552360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33917e4f-31fe-4e9f-bc5f-8ff726a3f61d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.554770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33917e4f-31fe-4e9f-bc5f-8ff726a3f61d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.573244 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-33917e4f-31fe-4e9f-bc5f-8ff726a3f61d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 could not be found. Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-33917e4f-31fe-4e9f-bc5f-8ff726a3f61d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 HTTP/1.1 Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 could not be found. Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '2093a86c-3a1a-47ca-825e-1ff9f28dc3b5'} Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 could not be found. Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:01.575264 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 could not be found. Oct 29 01:22:01.581021 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.581021 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:01.581021 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.581021 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.581021 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:01.581021 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:01.581021 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:01.581021 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:01.581021 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 could not be found. Oct 29 01:22:01.581021 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.591706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-33917e4f-31fe-4e9f-bc5f-8ff726a3f61d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:01.591706 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-33917e4f-31fe-4e9f-bc5f-8ff726a3f61d tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 404 len: 111 microversion: 2.1 time: 0.051414 Oct 29 01:22:01.591706 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2223/4270] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:22:01 2022] DELETE /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:01.609220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-71b11bb0-fe9e-484f-8e68-9a51043c1476 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:01.609704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-71b11bb0-fe9e-484f-8e68-9a51043c1476 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:01.620427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71b11bb0-fe9e-484f-8e68-9a51043c1476 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.620928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71b11bb0-fe9e-484f-8e68-9a51043c1476 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.625393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71b11bb0-fe9e-484f-8e68-9a51043c1476 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.626236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71b11bb0-fe9e-484f-8e68-9a51043c1476 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.626795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71b11bb0-fe9e-484f-8e68-9a51043c1476 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.628910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71b11bb0-fe9e-484f-8e68-9a51043c1476 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.669522 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-71b11bb0-fe9e-484f-8e68-9a51043c1476 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 could not be found. Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-71b11bb0-fe9e-484f-8e68-9a51043c1476 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 HTTP/1.1 Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 could not be found. Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '2093a86c-3a1a-47ca-825e-1ff9f28dc3b5'} Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 could not be found. Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 could not be found. Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:01.671410 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.682112 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.682112 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:01.682112 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:01.682112 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:01.682112 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:01.682112 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 could not be found. Oct 29 01:22:01.682112 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.682112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-71b11bb0-fe9e-484f-8e68-9a51043c1476 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance 2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:01.682112 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-71b11bb0-fe9e-484f-8e68-9a51043c1476 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5" status: 404 len: 111 microversion: 2.1 time: 0.078271 Oct 29 01:22:01.682112 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2224/4271] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:01 2022] GET /compute/v2.1/servers/2093a86c-3a1a-47ca-825e-1ff9f28dc3b5 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:01.684967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-f0b41b0b-215f-4383-8369-048d18376b2c req-869d24a6-54cd-46b1-a97a-52d0001a234f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802ee4ce-5a28-416c-a4eb-e0954859bcb2", "name": "network-vif-deleted", "tag": "3d866210-67fd-4657-846c-eb8a9102daa8"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:01.709750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f0b41b0b-215f-4383-8369-048d18376b2c req-869d24a6-54cd-46b1-a97a-52d0001a234f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.710865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f0b41b0b-215f-4383-8369-048d18376b2c req-869d24a6-54cd-46b1-a97a-52d0001a234f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.711680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f0b41b0b-215f-4383-8369-048d18376b2c req-869d24a6-54cd-46b1-a97a-52d0001a234f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.725823 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-f0b41b0b-215f-4383-8369-048d18376b2c req-869d24a6-54cd-46b1-a97a-52d0001a234f service nova] Creating event network-vif-deleted:3d866210-67fd-4657-846c-eb8a9102daa8 for instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 on n-h2-862964-3 Oct 29 01:22:01.734183 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-f0b41b0b-215f-4383-8369-048d18376b2c req-869d24a6-54cd-46b1-a97a-52d0001a234f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058731 Oct 29 01:22:01.737089 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2225/4272] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:01.749229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c425e2d6-e8ed-491f-a988-278fac35d4b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:01.749783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c425e2d6-e8ed-491f-a988-278fac35d4b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: d13a57fc-6ec4-4836-bba7-fc3735ed5207] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:01.763351 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-c425e2d6-e8ed-491f-a988-278fac35d4b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance d13a57fc-6ec4-4836-bba7-fc3735ed5207 could not be found. Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c425e2d6-e8ed-491f-a988-278fac35d4b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/d13a57fc-6ec4-4836-bba7-fc3735ed5207 HTTP/1.1 Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance d13a57fc-6ec4-4836-bba7-fc3735ed5207 could not be found. Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'd13a57fc-6ec4-4836-bba7-fc3735ed5207'} Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13a57fc-6ec4-4836-bba7-fc3735ed5207 could not be found. Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13a57fc-6ec4-4836-bba7-fc3735ed5207 could not be found. Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:01.765602 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.774075 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.774075 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:01.774075 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:01.774075 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:01.774075 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:01.774075 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13a57fc-6ec4-4836-bba7-fc3735ed5207 could not be found. Oct 29 01:22:01.774075 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.774075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c425e2d6-e8ed-491f-a988-278fac35d4b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance d13a57fc-6ec4-4836-bba7-fc3735ed5207 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:01.774075 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c425e2d6-e8ed-491f-a988-278fac35d4b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d13a57fc-6ec4-4836-bba7-fc3735ed5207" status: 404 len: 111 microversion: 2.1 time: 0.028615 Oct 29 01:22:01.774075 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2226/4273] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:22:01 2022] DELETE /compute/v2.1/servers/d13a57fc-6ec4-4836-bba7-fc3735ed5207 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:01.791213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-728a6a45-3c13-46f9-b4a9-803c403f66b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:01.791213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-728a6a45-3c13-46f9-b4a9-803c403f66b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: d13a57fc-6ec4-4836-bba7-fc3735ed5207] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:01.800107 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-728a6a45-3c13-46f9-b4a9-803c403f66b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance d13a57fc-6ec4-4836-bba7-fc3735ed5207 could not be found. Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-728a6a45-3c13-46f9-b4a9-803c403f66b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/d13a57fc-6ec4-4836-bba7-fc3735ed5207 HTTP/1.1 Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance d13a57fc-6ec4-4836-bba7-fc3735ed5207 could not be found. Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'd13a57fc-6ec4-4836-bba7-fc3735ed5207'} Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13a57fc-6ec4-4836-bba7-fc3735ed5207 could not be found. Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13a57fc-6ec4-4836-bba7-fc3735ed5207 could not be found. Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:01.803136 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:01.809629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:01.809629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:01.809629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:01.809629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13a57fc-6ec4-4836-bba7-fc3735ed5207 could not be found. Oct 29 01:22:01.809629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:01.820222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-728a6a45-3c13-46f9-b4a9-803c403f66b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance d13a57fc-6ec4-4836-bba7-fc3735ed5207 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:01.820222 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-728a6a45-3c13-46f9-b4a9-803c403f66b6 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/d13a57fc-6ec4-4836-bba7-fc3735ed5207" status: 404 len: 111 microversion: 2.1 time: 0.040463 Oct 29 01:22:01.820222 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2227/4274] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:01 2022] GET /compute/v2.1/servers/d13a57fc-6ec4-4836-bba7-fc3735ed5207 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:01.830139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4908f262-55e3-4339-a6eb-3e24d776a7a9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:01.830648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4908f262-55e3-4339-a6eb-3e24d776a7a9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:01.843822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4908f262-55e3-4339-a6eb-3e24d776a7a9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.847698 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fad602e6-431a-4bd1-8cb0-c83fc068f9e3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action" status: 202 len: 0 microversion: 2.1 time: 0.391864 Oct 29 01:22:01.847698 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2048/4275] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:22:01 2022] POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:22:01.847920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4908f262-55e3-4339-a6eb-3e24d776a7a9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.847920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4908f262-55e3-4339-a6eb-3e24d776a7a9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.850170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4908f262-55e3-4339-a6eb-3e24d776a7a9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.850947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4908f262-55e3-4339-a6eb-3e24d776a7a9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.851461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4908f262-55e3-4339-a6eb-3e24d776a7a9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.863221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-28b0e062-a61c-4719-a213-2363f638e48f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:01.864607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-28b0e062-a61c-4719-a213-2363f638e48f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:01.872353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28b0e062-a61c-4719-a213-2363f638e48f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.873074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28b0e062-a61c-4719-a213-2363f638e48f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.873843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28b0e062-a61c-4719-a213-2363f638e48f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.874957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28b0e062-a61c-4719-a213-2363f638e48f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:01.875771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28b0e062-a61c-4719-a213-2363f638e48f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:01.876413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28b0e062-a61c-4719-a213-2363f638e48f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:01.887739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4908f262-55e3-4339-a6eb-3e24d776a7a9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:22:02.071887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-28b0e062-a61c-4719-a213-2363f638e48f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:02.081504 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-28b0e062-a61c-4719-a213-2363f638e48f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1510 microversion: 2.1 time: 0.223400 Oct 29 01:22:02.082404 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2049/4276] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:01 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:02.358785 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4908f262-55e3-4339-a6eb-3e24d776a7a9 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 204 len: 0 microversion: 2.1 time: 0.534094 Oct 29 01:22:02.359426 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2228/4277] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:22:01 2022] DELETE /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:22:02.372466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5bd045eb-bf28-469d-b491-a2855edc0885 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:02.373670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5bd045eb-bf28-469d-b491-a2855edc0885 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:02.386126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bd045eb-bf28-469d-b491-a2855edc0885 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:02.387430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bd045eb-bf28-469d-b491-a2855edc0885 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:02.388071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bd045eb-bf28-469d-b491-a2855edc0885 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:02.388982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bd045eb-bf28-469d-b491-a2855edc0885 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:02.390265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bd045eb-bf28-469d-b491-a2855edc0885 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:02.390998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bd045eb-bf28-469d-b491-a2855edc0885 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:02.481779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e6b078b2-1662-477d-8554-153419606b5e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:02.482785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e6b078b2-1662-477d-8554-153419606b5e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:02.500444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6b078b2-1662-477d-8554-153419606b5e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:02.500444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6b078b2-1662-477d-8554-153419606b5e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:02.500444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6b078b2-1662-477d-8554-153419606b5e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:02.501039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6b078b2-1662-477d-8554-153419606b5e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:02.501728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6b078b2-1662-477d-8554-153419606b5e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:02.502163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6b078b2-1662-477d-8554-153419606b5e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:02.572525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6b078b2-1662-477d-8554-153419606b5e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:02.573217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6b078b2-1662-477d-8554-153419606b5e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:02.575517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6b078b2-1662-477d-8554-153419606b5e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:02.576185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-e6b078b2-1662-477d-8554-153419606b5e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lazy-loading 'fault' on Instance uuid 802ee4ce-5a28-416c-a4eb-e0954859bcb2 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:22:02.648359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e6b078b2-1662-477d-8554-153419606b5e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:02.659904 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e6b078b2-1662-477d-8554-153419606b5e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 200 len: 1297 microversion: 2.1 time: 0.183135 Oct 29 01:22:02.673613 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2229/4278] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:02 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 1297 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:02.674520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5bd045eb-bf28-469d-b491-a2855edc0885 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:02.676043 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5bd045eb-bf28-469d-b491-a2855edc0885 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1480 microversion: 2.1 time: 0.312036 Oct 29 01:22:02.678418 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2050/4279] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:02 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1480 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:03.104191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-27b87e2b-b802-4c0e-bae4-845291e9ddf0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:03.105021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-27b87e2b-b802-4c0e-bae4-845291e9ddf0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:03.113534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27b87e2b-b802-4c0e-bae4-845291e9ddf0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:03.114579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27b87e2b-b802-4c0e-bae4-845291e9ddf0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:03.115902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27b87e2b-b802-4c0e-bae4-845291e9ddf0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:03.116667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27b87e2b-b802-4c0e-bae4-845291e9ddf0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:03.117127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27b87e2b-b802-4c0e-bae4-845291e9ddf0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:03.117578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27b87e2b-b802-4c0e-bae4-845291e9ddf0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:03.347442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-27b87e2b-b802-4c0e-bae4-845291e9ddf0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:03.357605 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-27b87e2b-b802-4c0e-bae4-845291e9ddf0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1490 microversion: 2.1 time: 0.257158 Oct 29 01:22:03.363272 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2230/4280] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:03 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1490 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:03.383119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9aea8852-b4f9-49ac-92f0-429d8b8ab7e7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:03.383673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9aea8852-b4f9-49ac-92f0-429d8b8ab7e7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:03.391318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9aea8852-b4f9-49ac-92f0-429d8b8ab7e7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:03.392941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9aea8852-b4f9-49ac-92f0-429d8b8ab7e7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:03.393618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9aea8852-b4f9-49ac-92f0-429d8b8ab7e7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:03.394575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9aea8852-b4f9-49ac-92f0-429d8b8ab7e7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:03.395770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9aea8852-b4f9-49ac-92f0-429d8b8ab7e7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:03.396439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9aea8852-b4f9-49ac-92f0-429d8b8ab7e7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:03.440264 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-9aea8852-b4f9-49ac-92f0-429d8b8ab7e7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Cannot 'pause' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state paused Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9aea8852-b4f9-49ac-92f0-429d8b8ab7e7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action HTTP/1.1 Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 13 Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: {"pause": {}} Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: exception: Cannot 'pause' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state paused Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '63371d26-fe85-4cfa-bdca-c8ad84b81ee6', 'body': {'pause': {}}} Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 in vm_state paused. Cannot pause while the instance is in this state. Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state paused Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:03.442304 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:03.447274 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:03.447274 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:03.447274 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:03.447274 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state paused Oct 29 01:22:03.447274 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:03.448682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9aea8852-b4f9-49ac-92f0-429d8b8ab7e7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 409 to user: Cannot 'pause' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state paused {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:03.449792 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9aea8852-b4f9-49ac-92f0-429d8b8ab7e7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action" status: 409 len: 143 microversion: 2.1 time: 0.071157 Oct 29 01:22:03.450966 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2051/4281] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:22:03 2022] POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action => generated 143 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:22:03.462246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-90369073-8141-4258-b743-18b299c6fb39 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:03.471147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-90369073-8141-4258-b743-18b299c6fb39 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:03.471147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90369073-8141-4258-b743-18b299c6fb39 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:03.471147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90369073-8141-4258-b743-18b299c6fb39 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:03.471147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90369073-8141-4258-b743-18b299c6fb39 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:03.471653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90369073-8141-4258-b743-18b299c6fb39 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:03.471788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90369073-8141-4258-b743-18b299c6fb39 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:03.472416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90369073-8141-4258-b743-18b299c6fb39 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:03.688279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e8414d07-6daf-4bef-a66a-d50c2a6f9360 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:03.689264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e8414d07-6daf-4bef-a66a-d50c2a6f9360 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:03.701461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8414d07-6daf-4bef-a66a-d50c2a6f9360 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:03.703633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8414d07-6daf-4bef-a66a-d50c2a6f9360 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:03.704328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8414d07-6daf-4bef-a66a-d50c2a6f9360 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:03.705770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8414d07-6daf-4bef-a66a-d50c2a6f9360 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:03.706258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8414d07-6daf-4bef-a66a-d50c2a6f9360 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:03.706698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8414d07-6daf-4bef-a66a-d50c2a6f9360 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:03.721538 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-e8414d07-6daf-4bef-a66a-d50c2a6f9360 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] HTTP exception thrown: Instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 could not be found. Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e8414d07-6daf-4bef-a66a-d50c2a6f9360 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Request method failure captured: Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 HTTP/1.1 Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7v4RP_R_3GJoqhm0bR3qseeRZYksj6k0BjbYweOj3YMmdVxUXCLGKjP8iTyvRfd3NoM4oj8Lqwg6qpFHcH9V44fXUPXPLXNirXiXGUUgBYxuP9h31kZwELGpQK3eELzytEf6s4bV27QVSOmfG6hrQQPzXFvoVA2L-UB8mkqvg9Wng Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b284e70790cf43e2b474559bb3e20faf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: a35b358af11846f78debaf9e422a9558 Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 could not be found. Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '802ee4ce-5a28-416c-a4eb-e0954859bcb2'} Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 could not be found. Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 could not be found. Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:03.723123 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:03.734201 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:03.734201 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:03.734201 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:03.734201 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:03.734201 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 could not be found. Oct 29 01:22:03.734201 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:03.734201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e8414d07-6daf-4bef-a66a-d50c2a6f9360 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Returning 404 to user: Instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:03.734201 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e8414d07-6daf-4bef-a66a-d50c2a6f9360 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 404 len: 111 microversion: 2.1 time: 0.041569 Oct 29 01:22:03.734201 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2052/4282] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:03 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:03.741862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-32c9e174-fb00-4319-b72b-9f2f9827f7fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:03.742489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-32c9e174-fb00-4319-b72b-9f2f9827f7fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:03.750659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32c9e174-fb00-4319-b72b-9f2f9827f7fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:03.752171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32c9e174-fb00-4319-b72b-9f2f9827f7fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:03.752299 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-90369073-8141-4258-b743-18b299c6fb39 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action" status: 202 len: 0 microversion: 2.1 time: 0.293985 Oct 29 01:22:03.752422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32c9e174-fb00-4319-b72b-9f2f9827f7fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:03.752571 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2231/4283] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:22:03 2022] POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:22:03.753695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32c9e174-fb00-4319-b72b-9f2f9827f7fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:03.754349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32c9e174-fb00-4319-b72b-9f2f9827f7fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:03.755304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32c9e174-fb00-4319-b72b-9f2f9827f7fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:03.760845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e63c15cc-ce14-4d60-b44b-97df4a5c76b0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96add040>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:04.027178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-32c9e174-fb00-4319-b72b-9f2f9827f7fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:04.049333 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-32c9e174-fb00-4319-b72b-9f2f9827f7fa tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1480 microversion: 2.1 time: 0.322579 Oct 29 01:22:04.054546 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2053/4284] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:03 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1480 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:04.074517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e37015a-804d-4aaf-9795-496c63549cfc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:04.078326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7e37015a-804d-4aaf-9795-496c63549cfc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:04.088126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e37015a-804d-4aaf-9795-496c63549cfc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:04.088633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e37015a-804d-4aaf-9795-496c63549cfc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:04.089135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e37015a-804d-4aaf-9795-496c63549cfc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:04.106556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e37015a-804d-4aaf-9795-496c63549cfc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:04.110100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e37015a-804d-4aaf-9795-496c63549cfc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:04.112605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e37015a-804d-4aaf-9795-496c63549cfc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:04.659701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7e37015a-804d-4aaf-9795-496c63549cfc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:04.659701 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e37015a-804d-4aaf-9795-496c63549cfc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1497 microversion: 2.1 time: 0.362708 Oct 29 01:22:04.659701 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2054/4285] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:04 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1497 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:05.058821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-c00df36f-101d-4864-ae53-ed3b7f5c7233 req-74f70003-d1b4-40dd-8a26-171a1eff11f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0741da1d-27c3-4b27-85b9-37d645e7ff26", "name": "network-vif-deleted", "tag": "863c5fe7-60c8-40c2-a9d5-f487d712cacf"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:05.071231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c00df36f-101d-4864-ae53-ed3b7f5c7233 req-74f70003-d1b4-40dd-8a26-171a1eff11f9 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:05.071874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c00df36f-101d-4864-ae53-ed3b7f5c7233 req-74f70003-d1b4-40dd-8a26-171a1eff11f9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:05.072741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c00df36f-101d-4864-ae53-ed3b7f5c7233 req-74f70003-d1b4-40dd-8a26-171a1eff11f9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:05.090754 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-c00df36f-101d-4864-ae53-ed3b7f5c7233 req-74f70003-d1b4-40dd-8a26-171a1eff11f9 service nova] Creating event network-vif-deleted:863c5fe7-60c8-40c2-a9d5-f487d712cacf for instance 0741da1d-27c3-4b27-85b9-37d645e7ff26 on n-h1-862964-3 Oct 29 01:22:05.097592 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-c00df36f-101d-4864-ae53-ed3b7f5c7233 req-74f70003-d1b4-40dd-8a26-171a1eff11f9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047565 Oct 29 01:22:05.099428 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2055/4286] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:05.107207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-82314b9d-a43e-4a23-aa06-6f3197627436 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:05.108396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-82314b9d-a43e-4a23-aa06-6f3197627436 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:05.116936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82314b9d-a43e-4a23-aa06-6f3197627436 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:05.117662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82314b9d-a43e-4a23-aa06-6f3197627436 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:05.118246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82314b9d-a43e-4a23-aa06-6f3197627436 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:05.119233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82314b9d-a43e-4a23-aa06-6f3197627436 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:05.119835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82314b9d-a43e-4a23-aa06-6f3197627436 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:05.120404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82314b9d-a43e-4a23-aa06-6f3197627436 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:05.229067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-82314b9d-a43e-4a23-aa06-6f3197627436 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:05.242549 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-82314b9d-a43e-4a23-aa06-6f3197627436 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1438 microversion: 2.1 time: 0.141417 Oct 29 01:22:05.243773 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2056/4287] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:05 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1438 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:05.443558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d3f80eca-2e28-4340-9474-eb129d825ddd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:05.444636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d3f80eca-2e28-4340-9474-eb129d825ddd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:05.452828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3f80eca-2e28-4340-9474-eb129d825ddd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:05.453610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3f80eca-2e28-4340-9474-eb129d825ddd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:05.454256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3f80eca-2e28-4340-9474-eb129d825ddd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:05.455187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3f80eca-2e28-4340-9474-eb129d825ddd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:05.455844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3f80eca-2e28-4340-9474-eb129d825ddd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:05.456468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3f80eca-2e28-4340-9474-eb129d825ddd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:05.584788 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e63c15cc-ce14-4d60-b44b-97df4a5c76b0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 204 len: 0 microversion: 2.1 time: 1.830933 Oct 29 01:22:05.585879 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2232/4288] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:03 2022] DELETE /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 0 bytes in 1833 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:22:05.595291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5c4395ae-2c6a-458e-ae58-942cfe91edb6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:05.597325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5c4395ae-2c6a-458e-ae58-942cfe91edb6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:05.625506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c4395ae-2c6a-458e-ae58-942cfe91edb6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:05.629248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c4395ae-2c6a-458e-ae58-942cfe91edb6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:05.631035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c4395ae-2c6a-458e-ae58-942cfe91edb6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:05.636107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c4395ae-2c6a-458e-ae58-942cfe91edb6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:05.638424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c4395ae-2c6a-458e-ae58-942cfe91edb6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:05.646046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c4395ae-2c6a-458e-ae58-942cfe91edb6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:05.715600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5c4395ae-2c6a-458e-ae58-942cfe91edb6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:22:05.863918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d3f80eca-2e28-4340-9474-eb129d825ddd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:05.872810 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d3f80eca-2e28-4340-9474-eb129d825ddd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.433556 Oct 29 01:22:05.880209 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2057/4289] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:05 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:05.914080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e40892a1-ba3d-4484-849f-281b5e9b43e4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:05.915043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e40892a1-ba3d-4484-849f-281b5e9b43e4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:05.929638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e40892a1-ba3d-4484-849f-281b5e9b43e4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:05.932340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e40892a1-ba3d-4484-849f-281b5e9b43e4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:05.932928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e40892a1-ba3d-4484-849f-281b5e9b43e4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:05.936971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e40892a1-ba3d-4484-849f-281b5e9b43e4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:05.936971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e40892a1-ba3d-4484-849f-281b5e9b43e4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:05.936971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e40892a1-ba3d-4484-849f-281b5e9b43e4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:06.146110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e40892a1-ba3d-4484-849f-281b5e9b43e4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:06.151560 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5c4395ae-2c6a-458e-ae58-942cfe91edb6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8" status: 204 len: 0 microversion: 2.1 time: 0.558989 Oct 29 01:22:06.152705 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2233/4290] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:22:05 2022] DELETE /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:22:06.158089 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e40892a1-ba3d-4484-849f-281b5e9b43e4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.256299 Oct 29 01:22:06.158875 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2058/4291] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:05 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:06.194849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b252864-d3c2-4f7f-905d-4e5045f45ab7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:06.197369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7b252864-d3c2-4f7f-905d-4e5045f45ab7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:06.218843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b252864-d3c2-4f7f-905d-4e5045f45ab7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:06.224915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b252864-d3c2-4f7f-905d-4e5045f45ab7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:06.225482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b252864-d3c2-4f7f-905d-4e5045f45ab7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:06.229881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b252864-d3c2-4f7f-905d-4e5045f45ab7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:06.230728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b252864-d3c2-4f7f-905d-4e5045f45ab7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:06.232759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b252864-d3c2-4f7f-905d-4e5045f45ab7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:06.267203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d81bc7ff-df90-4a7b-bc09-f26b6d020258 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:06.268087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d81bc7ff-df90-4a7b-bc09-f26b6d020258 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:06.281664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:22:06.328111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d81bc7ff-df90-4a7b-bc09-f26b6d020258 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:06.328868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d81bc7ff-df90-4a7b-bc09-f26b6d020258 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:06.330773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d81bc7ff-df90-4a7b-bc09-f26b6d020258 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:06.331779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d81bc7ff-df90-4a7b-bc09-f26b6d020258 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:06.333859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d81bc7ff-df90-4a7b-bc09-f26b6d020258 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:06.335026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d81bc7ff-df90-4a7b-bc09-f26b6d020258 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:06.340784 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-7b252864-d3c2-4f7f-905d-4e5045f45ab7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b252864-d3c2-4f7f-905d-4e5045f45ab7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a/action HTTP/1.1 Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 28 Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: {"reboot": {"type": "SOFT"}} Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'ac895d78-7d15-451d-a60f-4e80afb0241a', 'body': {'reboot': {'type': 'SOFT'}}} Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:06.345914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:06.354976 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:22:06.354976 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:06.354976 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:06.354976 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:06.354976 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:06.354976 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:06.354976 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:06.354976 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:06.354976 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:06.354976 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:22:06.354976 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:06.354976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b252864-d3c2-4f7f-905d-4e5045f45ab7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:06.363531 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7b252864-d3c2-4f7f-905d-4e5045f45ab7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a/action" status: 404 len: 111 microversion: 2.1 time: 0.165269 Oct 29 01:22:06.366849 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2234/4292] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:22:06 2022] POST /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a/action => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:06.376507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3c8547a6-55b0-422a-937b-10436a0013a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1847176530", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "417ddcf9-7930-440b-995d-5ce0b1f48a9f"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:06.403056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d81bc7ff-df90-4a7b-bc09-f26b6d020258 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:06.403917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d81bc7ff-df90-4a7b-bc09-f26b6d020258 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:06.404729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d81bc7ff-df90-4a7b-bc09-f26b6d020258 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:06.405411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-d81bc7ff-df90-4a7b-bc09-f26b6d020258 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lazy-loading 'fault' on Instance uuid 0741da1d-27c3-4b27-85b9-37d645e7ff26 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:22:06.490976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d81bc7ff-df90-4a7b-bc09-f26b6d020258 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb8fe33c5d64047ada50f44e01e4faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dc302f307494a61836f3afb38dccae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:06.497416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-3c8547a6-55b0-422a-937b-10436a0013a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] validate_networks() for [('417ddcf9-7930-440b-995d-5ce0b1f48a9f', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:22:06.503257 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d81bc7ff-df90-4a7b-bc09-f26b6d020258 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 200 len: 1283 microversion: 2.1 time: 0.240387 Oct 29 01:22:06.507069 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2059/4293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:06 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 1283 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:06.521598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-04233448-ca07-4df3-a023-6966a2845422 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:06.521953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-04233448-ca07-4df3-a023-6966a2845422 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:06.537419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04233448-ca07-4df3-a023-6966a2845422 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:06.541404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04233448-ca07-4df3-a023-6966a2845422 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:06.542015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04233448-ca07-4df3-a023-6966a2845422 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:06.542921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04233448-ca07-4df3-a023-6966a2845422 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:06.543424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04233448-ca07-4df3-a023-6966a2845422 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:06.543857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04233448-ca07-4df3-a023-6966a2845422 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:07.332310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-04233448-ca07-4df3-a023-6966a2845422 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:07.348882 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-04233448-ca07-4df3-a023-6966a2845422 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.838317 Oct 29 01:22:07.351758 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2060/4294] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:06 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:07.381632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2870ba95-efe6-4012-a2a8-0ce70b86b1a7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:07.382514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2870ba95-efe6-4012-a2a8-0ce70b86b1a7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:07.392075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2870ba95-efe6-4012-a2a8-0ce70b86b1a7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:07.392597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2870ba95-efe6-4012-a2a8-0ce70b86b1a7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:07.393311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2870ba95-efe6-4012-a2a8-0ce70b86b1a7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:07.404493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2870ba95-efe6-4012-a2a8-0ce70b86b1a7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:07.405091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2870ba95-efe6-4012-a2a8-0ce70b86b1a7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:07.406144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2870ba95-efe6-4012-a2a8-0ce70b86b1a7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:08.169898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2870ba95-efe6-4012-a2a8-0ce70b86b1a7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:08.190159 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2870ba95-efe6-4012-a2a8-0ce70b86b1a7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.815446 Oct 29 01:22:08.197294 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2061/4295] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:07 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:08.202227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bce5a1b0-bec2-4b4c-af7d-5915b020c607 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:08.205192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bce5a1b0-bec2-4b4c-af7d-5915b020c607 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] [instance: 0741da1d-27c3-4b27-85b9-37d645e7ff26] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:08.218709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bce5a1b0-bec2-4b4c-af7d-5915b020c607 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:08.223846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bce5a1b0-bec2-4b4c-af7d-5915b020c607 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:08.224784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bce5a1b0-bec2-4b4c-af7d-5915b020c607 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:08.225812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bce5a1b0-bec2-4b4c-af7d-5915b020c607 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:08.231832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bce5a1b0-bec2-4b4c-af7d-5915b020c607 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:08.231832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bce5a1b0-bec2-4b4c-af7d-5915b020c607 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:08.236546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-3c8547a6-55b0-422a-937b-10436a0013a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:22:08.237592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-3c8547a6-55b0-422a-937b-10436a0013a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:22:08.238262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-3c8547a6-55b0-422a-937b-10436a0013a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:22:08.238979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-3c8547a6-55b0-422a-937b-10436a0013a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:22:08.239594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-3c8547a6-55b0-422a-937b-10436a0013a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:22:08.255386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c8547a6-55b0-422a-937b-10436a0013a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:08.255386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c8547a6-55b0-422a-937b-10436a0013a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:08.255386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c8547a6-55b0-422a-937b-10436a0013a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:08.255386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c8547a6-55b0-422a-937b-10436a0013a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:08.255386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c8547a6-55b0-422a-937b-10436a0013a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:08.256745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c8547a6-55b0-422a-937b-10436a0013a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:08.259687 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-bce5a1b0-bec2-4b4c-af7d-5915b020c607 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] HTTP exception thrown: Instance 0741da1d-27c3-4b27-85b9-37d645e7ff26 could not be found. Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bce5a1b0-bec2-4b4c-af7d-5915b020c607 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Request method failure captured: Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 HTTP/1.1 Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH8s6L2iWD03FPbFvs-BBOYIIvQ6e7kqC_KC_VXy1xL9QaGELaxwox5lvNJPh6o9DWf09ion55RrCnENdLcW5nwARO8v5AWPb4lEpJN_bVO0p9Rw6iN8DCUXqgKfO0PxkGeBCGFTE_CX9nqREApUXT-xk_CUem1KS5yfZlNDbWIciaA Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc302f307494a61836f3afb38dccae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc302f307494a61836f3afb38dccae9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersTestJSON-1497195164 Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 6dc302f307494a61836f3afb38dccae9 Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersTestJSON-1497195164 Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 6cb8fe33c5d64047ada50f44e01e4faa Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersTestJSON-1497195164-project Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 0741da1d-27c3-4b27-85b9-37d645e7ff26 could not be found. Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '0741da1d-27c3-4b27-85b9-37d645e7ff26'} Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0741da1d-27c3-4b27-85b9-37d645e7ff26 could not be found. Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0741da1d-27c3-4b27-85b9-37d645e7ff26 could not be found. Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:08.261904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:08.265135 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:08.265135 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:08.265135 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:08.265135 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:08.265135 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:08.265135 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0741da1d-27c3-4b27-85b9-37d645e7ff26 could not be found. Oct 29 01:22:08.265135 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:08.265135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bce5a1b0-bec2-4b4c-af7d-5915b020c607 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] Returning 404 to user: Instance 0741da1d-27c3-4b27-85b9-37d645e7ff26 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:08.265135 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bce5a1b0-bec2-4b4c-af7d-5915b020c607 tempest-ServersTestJSON-1497195164 tempest-ServersTestJSON-1497195164-project] 10.222.0.26 "GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26" status: 404 len: 111 microversion: 2.1 time: 0.065220 Oct 29 01:22:08.265135 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2062/4296] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:08 2022] GET /compute/v2.1/servers/0741da1d-27c3-4b27-85b9-37d645e7ff26 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:08.271483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0e6cd06f-ecf5-4e5a-9b54-918fcd12f1d0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:08.273817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0e6cd06f-ecf5-4e5a-9b54-918fcd12f1d0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 4f05e7db-d0ab-43fb-b986-ad572e44bd3b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:08.280424 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-0e6cd06f-ecf5-4e5a-9b54-918fcd12f1d0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance 4f05e7db-d0ab-43fb-b986-ad572e44bd3b could not be found. Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0e6cd06f-ecf5-4e5a-9b54-918fcd12f1d0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/4f05e7db-d0ab-43fb-b986-ad572e44bd3b/action HTTP/1.1 Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 28 Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: {"reboot": {"type": "SOFT"}} Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 4f05e7db-d0ab-43fb-b986-ad572e44bd3b could not be found. Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '4f05e7db-d0ab-43fb-b986-ad572e44bd3b', 'body': {'reboot': {'type': 'SOFT'}}} Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f05e7db-d0ab-43fb-b986-ad572e44bd3b could not be found. Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f05e7db-d0ab-43fb-b986-ad572e44bd3b could not be found. Oct 29 01:22:08.282359 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:08.292122 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:08.292122 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:08.292122 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:08.292122 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:08.292122 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:08.292122 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:08.292122 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:08.292122 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f05e7db-d0ab-43fb-b986-ad572e44bd3b could not be found. Oct 29 01:22:08.292122 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:08.292122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0e6cd06f-ecf5-4e5a-9b54-918fcd12f1d0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance 4f05e7db-d0ab-43fb-b986-ad572e44bd3b could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:08.292122 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0e6cd06f-ecf5-4e5a-9b54-918fcd12f1d0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/4f05e7db-d0ab-43fb-b986-ad572e44bd3b/action" status: 404 len: 111 microversion: 2.1 time: 0.018702 Oct 29 01:22:08.292122 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2063/4297] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:22:08 2022] POST /compute/v2.1/servers/4f05e7db-d0ab-43fb-b986-ad572e44bd3b/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:08.295397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9045e7b1-d7d3-4f50-98d0-e243b77d77f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:08.296820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9045e7b1-d7d3-4f50-98d0-e243b77d77f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:08.301580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-3c8547a6-55b0-422a-937b-10436a0013a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Getting quotas for project b284e70790cf43e2b474559bb3e20faf. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:22:08.305701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9045e7b1-d7d3-4f50-98d0-e243b77d77f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:08.306267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9045e7b1-d7d3-4f50-98d0-e243b77d77f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:08.306717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9045e7b1-d7d3-4f50-98d0-e243b77d77f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:08.307436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9045e7b1-d7d3-4f50-98d0-e243b77d77f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:08.307966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9045e7b1-d7d3-4f50-98d0-e243b77d77f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:08.308400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9045e7b1-d7d3-4f50-98d0-e243b77d77f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:08.311562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-3c8547a6-55b0-422a-937b-10436a0013a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Getting quotas for user a35b358af11846f78debaf9e422a9558 and project b284e70790cf43e2b474559bb3e20faf. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:22:08.330651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3c8547a6-55b0-422a-937b-10436a0013a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:22:08.334639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3c8547a6-55b0-422a-937b-10436a0013a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:22:08.532883 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3c8547a6-55b0-422a-937b-10436a0013a6 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.164525 Oct 29 01:22:08.533924 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2235/4298] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:22:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:22:08.560919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-39876bba-6a19-47f4-9662-6c13308fd5cc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:08.573482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-39876bba-6a19-47f4-9662-6c13308fd5cc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:08.712770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-39876bba-6a19-47f4-9662-6c13308fd5cc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:08.736772 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-39876bba-6a19-47f4-9662-6c13308fd5cc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1208 microversion: 2.1 time: 0.190454 Oct 29 01:22:08.753920 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2236/4299] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:08 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1208 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:08.843134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9045e7b1-d7d3-4f50-98d0-e243b77d77f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:08.863505 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9045e7b1-d7d3-4f50-98d0-e243b77d77f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.572073 Oct 29 01:22:08.866755 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2064/4300] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:08 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:08.893908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-839a001d-ab4e-4194-9749-e86fa7546990 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:08.894083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-839a001d-ab4e-4194-9749-e86fa7546990 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:08.912985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-839a001d-ab4e-4194-9749-e86fa7546990 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:08.913837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-839a001d-ab4e-4194-9749-e86fa7546990 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:08.914434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-839a001d-ab4e-4194-9749-e86fa7546990 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:08.915314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-839a001d-ab4e-4194-9749-e86fa7546990 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:08.923142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-839a001d-ab4e-4194-9749-e86fa7546990 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:08.933149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-839a001d-ab4e-4194-9749-e86fa7546990 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:09.227292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-839a001d-ab4e-4194-9749-e86fa7546990 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:09.248884 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-839a001d-ab4e-4194-9749-e86fa7546990 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.359657 Oct 29 01:22:09.253553 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2237/4301] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:08 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:09.280954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0d1883c8-96aa-4fdf-b03c-a45bfd20e82b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:09.285097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0d1883c8-96aa-4fdf-b03c-a45bfd20e82b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:09.296539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0d1883c8-96aa-4fdf-b03c-a45bfd20e82b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:09.297070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0d1883c8-96aa-4fdf-b03c-a45bfd20e82b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:09.297547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0d1883c8-96aa-4fdf-b03c-a45bfd20e82b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:09.298507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0d1883c8-96aa-4fdf-b03c-a45bfd20e82b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:09.311336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0d1883c8-96aa-4fdf-b03c-a45bfd20e82b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:09.311802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0d1883c8-96aa-4fdf-b03c-a45bfd20e82b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:09.338687 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-0d1883c8-96aa-4fdf-b03c-a45bfd20e82b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0d1883c8-96aa-4fdf-b03c-a45bfd20e82b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a/action HTTP/1.1 Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 65 Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: {"rebuild": {"imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a"}} Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'ac895d78-7d15-451d-a60f-4e80afb0241a', 'body': {'rebuild': {'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a'}}} Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 29 01:22:09.345532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 29 01:22:09.350430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 01:22:09.350430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:09.350430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:09.350430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:09.350430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:09.350430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:22:09.350430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:09.350430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:09.350430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:09.350430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:09.350430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:09.350430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:09.350430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:09.350430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:09.350430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:22:09.350430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:09.350430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0d1883c8-96aa-4fdf-b03c-a45bfd20e82b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:09.350430 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0d1883c8-96aa-4fdf-b03c-a45bfd20e82b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a/action" status: 404 len: 111 microversion: 2.1 time: 0.066753 Oct 29 01:22:09.350430 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2065/4302] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:22:09 2022] POST /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a/action => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:09.356128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-98056b1c-27e8-4f9f-85d8-301dac199bdf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:09.356743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-98056b1c-27e8-4f9f-85d8-301dac199bdf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:09.363264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98056b1c-27e8-4f9f-85d8-301dac199bdf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:09.364146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98056b1c-27e8-4f9f-85d8-301dac199bdf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:09.364736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98056b1c-27e8-4f9f-85d8-301dac199bdf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:09.367632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98056b1c-27e8-4f9f-85d8-301dac199bdf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:09.367632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98056b1c-27e8-4f9f-85d8-301dac199bdf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:09.367632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98056b1c-27e8-4f9f-85d8-301dac199bdf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:09.602386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-f9c6529a-3d53-4ad4-9506-35534fb463e7 req-5f6ef199-1b18-4577-8d2b-df9c9c73af8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0fc606-5d53-4e70-b087-22db406a68f8", "name": "network-vif-deleted", "tag": "ee5981f8-c5ba-4a90-afb9-4849d919a97f"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:09.616551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f9c6529a-3d53-4ad4-9506-35534fb463e7 req-5f6ef199-1b18-4577-8d2b-df9c9c73af8e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:09.617037 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f9c6529a-3d53-4ad4-9506-35534fb463e7 req-5f6ef199-1b18-4577-8d2b-df9c9c73af8e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:09.617504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f9c6529a-3d53-4ad4-9506-35534fb463e7 req-5f6ef199-1b18-4577-8d2b-df9c9c73af8e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:09.649547 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f9c6529a-3d53-4ad4-9506-35534fb463e7 req-5f6ef199-1b18-4577-8d2b-df9c9c73af8e service nova] Creating event network-vif-deleted:ee5981f8-c5ba-4a90-afb9-4849d919a97f for instance 3d0fc606-5d53-4e70-b087-22db406a68f8 on n-h1-862964-3 Oct 29 01:22:09.657749 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-f9c6529a-3d53-4ad4-9506-35534fb463e7 req-5f6ef199-1b18-4577-8d2b-df9c9c73af8e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059468 Oct 29 01:22:09.659723 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2066/4303] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:22:09.705799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-98056b1c-27e8-4f9f-85d8-301dac199bdf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:09.716222 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-98056b1c-27e8-4f9f-85d8-301dac199bdf tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.366022 Oct 29 01:22:09.743888 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2238/4304] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:09 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:09.746895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cf3a7cff-deea-4158-89e2-0675a40e8bcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:09.747610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cf3a7cff-deea-4158-89e2-0675a40e8bcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:09.757496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf3a7cff-deea-4158-89e2-0675a40e8bcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:09.761860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf3a7cff-deea-4158-89e2-0675a40e8bcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:09.763149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf3a7cff-deea-4158-89e2-0675a40e8bcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:09.763460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf3a7cff-deea-4158-89e2-0675a40e8bcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:09.764041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf3a7cff-deea-4158-89e2-0675a40e8bcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:09.764769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4ff96e77-4891-4dae-8b24-2adf1a0422a5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:09.765351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf3a7cff-deea-4158-89e2-0675a40e8bcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:09.770500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4ff96e77-4891-4dae-8b24-2adf1a0422a5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:09.773696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:22:09.795060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:22:09.954923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4ff96e77-4891-4dae-8b24-2adf1a0422a5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:09.973101 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4ff96e77-4891-4dae-8b24-2adf1a0422a5 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1208 microversion: 2.1 time: 0.213840 Oct 29 01:22:09.992320 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2239/4305] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:09 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1208 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:10.104303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cf3a7cff-deea-4158-89e2-0675a40e8bcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:10.118090 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cf3a7cff-deea-4158-89e2-0675a40e8bcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.375265 Oct 29 01:22:10.134041 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2067/4306] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:09 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:10.146858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-918be35e-8795-4026-93f5-74d2c6e851a7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:10.151523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-918be35e-8795-4026-93f5-74d2c6e851a7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 6c3b976f-9133-404e-8c96-f12331db23be] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:10.162259 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-918be35e-8795-4026-93f5-74d2c6e851a7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance 6c3b976f-9133-404e-8c96-f12331db23be could not be found. Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-918be35e-8795-4026-93f5-74d2c6e851a7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/6c3b976f-9133-404e-8c96-f12331db23be/action HTTP/1.1 Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 65 Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: {"rebuild": {"imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a"}} Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 6c3b976f-9133-404e-8c96-f12331db23be could not be found. Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '6c3b976f-9133-404e-8c96-f12331db23be', 'body': {'rebuild': {'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a'}}} Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c3b976f-9133-404e-8c96-f12331db23be could not be found. Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 01:22:10.164939 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:10.168132 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:10.168132 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:10.168132 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:10.168132 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c3b976f-9133-404e-8c96-f12331db23be could not be found. Oct 29 01:22:10.168132 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:10.168132 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:10.168132 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:10.168132 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:10.168132 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:10.168132 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:10.168132 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:10.168132 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:10.168132 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c3b976f-9133-404e-8c96-f12331db23be could not be found. Oct 29 01:22:10.168132 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:10.172064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-918be35e-8795-4026-93f5-74d2c6e851a7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance 6c3b976f-9133-404e-8c96-f12331db23be could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:10.174452 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-918be35e-8795-4026-93f5-74d2c6e851a7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/6c3b976f-9133-404e-8c96-f12331db23be/action" status: 404 len: 111 microversion: 2.1 time: 0.035609 Oct 29 01:22:10.184762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7a51098c-1ba0-4973-8ecc-f2301e6e060c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:10.185609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7a51098c-1ba0-4973-8ecc-f2301e6e060c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:10.188491 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2240/4307] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:22:10 2022] POST /compute/v2.1/servers/6c3b976f-9133-404e-8c96-f12331db23be/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:10.196959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a51098c-1ba0-4973-8ecc-f2301e6e060c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:10.197708 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a51098c-1ba0-4973-8ecc-f2301e6e060c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:10.200762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a51098c-1ba0-4973-8ecc-f2301e6e060c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:10.200762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a51098c-1ba0-4973-8ecc-f2301e6e060c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:10.200762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a51098c-1ba0-4973-8ecc-f2301e6e060c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:10.200762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a51098c-1ba0-4973-8ecc-f2301e6e060c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:10.380892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7a51098c-1ba0-4973-8ecc-f2301e6e060c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:10.389863 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7a51098c-1ba0-4973-8ecc-f2301e6e060c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.209311 Oct 29 01:22:10.397563 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2068/4308] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:10 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:10.414277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3386803c-ce03-49a1-bed3-21330b91749c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:10.415405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3386803c-ce03-49a1-bed3-21330b91749c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:10.424265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3386803c-ce03-49a1-bed3-21330b91749c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:10.424761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3386803c-ce03-49a1-bed3-21330b91749c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:10.425390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3386803c-ce03-49a1-bed3-21330b91749c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:10.426348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3386803c-ce03-49a1-bed3-21330b91749c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:10.427186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3386803c-ce03-49a1-bed3-21330b91749c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:10.427627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3386803c-ce03-49a1-bed3-21330b91749c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:10.600893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3386803c-ce03-49a1-bed3-21330b91749c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:10.609627 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3386803c-ce03-49a1-bed3-21330b91749c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.199312 Oct 29 01:22:10.610162 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2241/4309] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:10 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:10.632832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9e27891e-37d0-4fa0-9d27-89d5941b6d79 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:10.633810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9e27891e-37d0-4fa0-9d27-89d5941b6d79 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: d096c717-1051-4994-89fd-c4b02d1bc890] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:10.641924 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-9e27891e-37d0-4fa0-9d27-89d5941b6d79 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance d096c717-1051-4994-89fd-c4b02d1bc890 could not be found. Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9e27891e-37d0-4fa0-9d27-89d5941b6d79 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/d096c717-1051-4994-89fd-c4b02d1bc890/action HTTP/1.1 Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 15 Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: {"restore": {}} Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance d096c717-1051-4994-89fd-c4b02d1bc890 could not be found. Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'd096c717-1051-4994-89fd-c4b02d1bc890', 'body': {'restore': {}}} Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d096c717-1051-4994-89fd-c4b02d1bc890 could not be found. Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d096c717-1051-4994-89fd-c4b02d1bc890 could not be found. Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:10.644113 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:10.647913 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:10.647913 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:10.647913 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d096c717-1051-4994-89fd-c4b02d1bc890 could not be found. Oct 29 01:22:10.647913 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:10.650227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9e27891e-37d0-4fa0-9d27-89d5941b6d79 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance d096c717-1051-4994-89fd-c4b02d1bc890 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:10.651380 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9e27891e-37d0-4fa0-9d27-89d5941b6d79 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/d096c717-1051-4994-89fd-c4b02d1bc890/action" status: 404 len: 111 microversion: 2.1 time: 0.022856 Oct 29 01:22:10.655154 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2069/4310] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:22:10 2022] POST /compute/v2.1/servers/d096c717-1051-4994-89fd-c4b02d1bc890/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:10.660650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-391d725a-6150-42c4-8e6e-38b934b6d3cd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:10.661647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-391d725a-6150-42c4-8e6e-38b934b6d3cd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:10.668930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-391d725a-6150-42c4-8e6e-38b934b6d3cd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:10.669573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-391d725a-6150-42c4-8e6e-38b934b6d3cd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:10.670214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-391d725a-6150-42c4-8e6e-38b934b6d3cd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:10.671012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-391d725a-6150-42c4-8e6e-38b934b6d3cd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:10.671747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-391d725a-6150-42c4-8e6e-38b934b6d3cd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:10.672326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-391d725a-6150-42c4-8e6e-38b934b6d3cd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:10.853370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-391d725a-6150-42c4-8e6e-38b934b6d3cd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:10.861562 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-391d725a-6150-42c4-8e6e-38b934b6d3cd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.204714 Oct 29 01:22:10.862073 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2242/4311] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:10 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:10.885253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3362e9d7-860b-41cc-9047-48b67bb31b4d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:10.885856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3362e9d7-860b-41cc-9047-48b67bb31b4d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:10.895839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3362e9d7-860b-41cc-9047-48b67bb31b4d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:10.896447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3362e9d7-860b-41cc-9047-48b67bb31b4d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:10.896885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3362e9d7-860b-41cc-9047-48b67bb31b4d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:10.900030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3362e9d7-860b-41cc-9047-48b67bb31b4d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:10.900030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3362e9d7-860b-41cc-9047-48b67bb31b4d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:10.900030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3362e9d7-860b-41cc-9047-48b67bb31b4d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:11.006285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a943e70b-c552-4290-a658-8dfe0408d5ca tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:11.007506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a943e70b-c552-4290-a658-8dfe0408d5ca tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:11.016452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a943e70b-c552-4290-a658-8dfe0408d5ca tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:11.017204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a943e70b-c552-4290-a658-8dfe0408d5ca tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:11.018459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a943e70b-c552-4290-a658-8dfe0408d5ca tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:11.019911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a943e70b-c552-4290-a658-8dfe0408d5ca tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:11.021086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a943e70b-c552-4290-a658-8dfe0408d5ca tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:11.022562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a943e70b-c552-4290-a658-8dfe0408d5ca tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:11.140871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a943e70b-c552-4290-a658-8dfe0408d5ca tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:11.154032 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a943e70b-c552-4290-a658-8dfe0408d5ca tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1260 microversion: 2.1 time: 0.153486 Oct 29 01:22:11.155877 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2243/4312] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:10 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:11.162129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3362e9d7-860b-41cc-9047-48b67bb31b4d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:11.175490 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3362e9d7-860b-41cc-9047-48b67bb31b4d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.292130 Oct 29 01:22:11.187474 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2070/4313] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:10 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:11.202168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2b6229e5-d3ef-43a9-8e38-7de1131b6bdb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:11.203214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2b6229e5-d3ef-43a9-8e38-7de1131b6bdb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:11.229006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b6229e5-d3ef-43a9-8e38-7de1131b6bdb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:11.230149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b6229e5-d3ef-43a9-8e38-7de1131b6bdb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:11.232688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b6229e5-d3ef-43a9-8e38-7de1131b6bdb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:11.233839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b6229e5-d3ef-43a9-8e38-7de1131b6bdb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:11.235027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b6229e5-d3ef-43a9-8e38-7de1131b6bdb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:11.235789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b6229e5-d3ef-43a9-8e38-7de1131b6bdb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:11.250687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:22:11.273678 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-2b6229e5-d3ef-43a9-8e38-7de1131b6bdb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Cannot 'restore' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2b6229e5-d3ef-43a9-8e38-7de1131b6bdb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action HTTP/1.1 Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 15 Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: {"restore": {}} Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: exception: Cannot 'restore' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '63371d26-fe85-4cfa-bdca-c8ad84b81ee6', 'body': {'restore': {}}} Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 in vm_state active. Cannot restore while the instance is in this state. Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:11.275203 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:11.280942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:11.280942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:11.280942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:11.280942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active Oct 29 01:22:11.280942 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:11.280942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2b6229e5-d3ef-43a9-8e38-7de1131b6bdb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 409 to user: Cannot 'restore' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:11.280942 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2b6229e5-d3ef-43a9-8e38-7de1131b6bdb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action" status: 409 len: 145 microversion: 2.1 time: 0.078433 Oct 29 01:22:11.280942 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2244/4314] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:22:11 2022] POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action => generated 145 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:22:11.288287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f421f709-9859-4b4d-acf1-abcd672de3c2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:11.288915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f421f709-9859-4b4d-acf1-abcd672de3c2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:11.302342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f421f709-9859-4b4d-acf1-abcd672de3c2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:11.302849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f421f709-9859-4b4d-acf1-abcd672de3c2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:11.303644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f421f709-9859-4b4d-acf1-abcd672de3c2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:11.304013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f421f709-9859-4b4d-acf1-abcd672de3c2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:11.306723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f421f709-9859-4b4d-acf1-abcd672de3c2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:11.307212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f421f709-9859-4b4d-acf1-abcd672de3c2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:11.496814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f421f709-9859-4b4d-acf1-abcd672de3c2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:11.510932 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f421f709-9859-4b4d-acf1-abcd672de3c2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.228990 Oct 29 01:22:11.511625 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2071/4315] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:11 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:11.539848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-57590ac3-ca4e-45a6-97c7-81a2ebcc6a77 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:11.541040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-57590ac3-ca4e-45a6-97c7-81a2ebcc6a77 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:11.547433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57590ac3-ca4e-45a6-97c7-81a2ebcc6a77 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:11.547914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57590ac3-ca4e-45a6-97c7-81a2ebcc6a77 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:11.548600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57590ac3-ca4e-45a6-97c7-81a2ebcc6a77 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:11.549315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57590ac3-ca4e-45a6-97c7-81a2ebcc6a77 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:11.549765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57590ac3-ca4e-45a6-97c7-81a2ebcc6a77 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:11.550185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57590ac3-ca4e-45a6-97c7-81a2ebcc6a77 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:11.856935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-57590ac3-ca4e-45a6-97c7-81a2ebcc6a77 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:11.869761 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-57590ac3-ca4e-45a6-97c7-81a2ebcc6a77 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.333954 Oct 29 01:22:11.870628 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2245/4316] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:11 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:11.897322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2bdbb8ee-d3d4-47c8-8595-a68b4343e0ee tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:11.898207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2bdbb8ee-d3d4-47c8-8595-a68b4343e0ee tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 75b261d8-5012-4fff-9f5e-6eb25c64dc32] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:11.908278 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-2bdbb8ee-d3d4-47c8-8595-a68b4343e0ee tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance 75b261d8-5012-4fff-9f5e-6eb25c64dc32 could not be found. Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2bdbb8ee-d3d4-47c8-8595-a68b4343e0ee tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/75b261d8-5012-4fff-9f5e-6eb25c64dc32/action HTTP/1.1 Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 14 Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: {"resume": {}} Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 75b261d8-5012-4fff-9f5e-6eb25c64dc32 could not be found. Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '75b261d8-5012-4fff-9f5e-6eb25c64dc32', 'body': {'resume': {}}} Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75b261d8-5012-4fff-9f5e-6eb25c64dc32 could not be found. Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75b261d8-5012-4fff-9f5e-6eb25c64dc32 could not be found. Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:11.925288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:11.928701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:11.928701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:11.928701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75b261d8-5012-4fff-9f5e-6eb25c64dc32 could not be found. Oct 29 01:22:11.928701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:11.930838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2bdbb8ee-d3d4-47c8-8595-a68b4343e0ee tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance 75b261d8-5012-4fff-9f5e-6eb25c64dc32 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:11.931950 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2bdbb8ee-d3d4-47c8-8595-a68b4343e0ee tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/75b261d8-5012-4fff-9f5e-6eb25c64dc32/action" status: 404 len: 111 microversion: 2.1 time: 0.041277 Oct 29 01:22:11.933078 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2072/4317] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:22:11 2022] POST /compute/v2.1/servers/75b261d8-5012-4fff-9f5e-6eb25c64dc32/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:11.941030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cee371e2-a270-453c-9567-a434f791a298 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:11.941769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cee371e2-a270-453c-9567-a434f791a298 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:11.953899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cee371e2-a270-453c-9567-a434f791a298 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:11.954513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cee371e2-a270-453c-9567-a434f791a298 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:11.955028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cee371e2-a270-453c-9567-a434f791a298 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:11.955814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cee371e2-a270-453c-9567-a434f791a298 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:11.963153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cee371e2-a270-453c-9567-a434f791a298 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:11.969266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cee371e2-a270-453c-9567-a434f791a298 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:12.184658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2f95b0c3-d959-40fe-a582-0c5197df9193 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:12.186606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2f95b0c3-d959-40fe-a582-0c5197df9193 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:12.199438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f95b0c3-d959-40fe-a582-0c5197df9193 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:12.200221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f95b0c3-d959-40fe-a582-0c5197df9193 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:12.201286 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f95b0c3-d959-40fe-a582-0c5197df9193 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:12.206071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f95b0c3-d959-40fe-a582-0c5197df9193 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:12.206874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f95b0c3-d959-40fe-a582-0c5197df9193 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:12.210015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f95b0c3-d959-40fe-a582-0c5197df9193 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:12.343506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2f95b0c3-d959-40fe-a582-0c5197df9193 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:12.350733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cee371e2-a270-453c-9567-a434f791a298 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:12.379482 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2f95b0c3-d959-40fe-a582-0c5197df9193 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1278 microversion: 2.1 time: 0.202837 Oct 29 01:22:12.380999 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2073/4318] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:12 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1278 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:12.384263 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cee371e2-a270-453c-9567-a434f791a298 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.446913 Oct 29 01:22:12.390461 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2246/4319] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:11 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:12.428821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1e0a3309-a52a-4fa5-902a-6d46e75f5cf4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:12.435166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1e0a3309-a52a-4fa5-902a-6d46e75f5cf4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:12.443398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1e0a3309-a52a-4fa5-902a-6d46e75f5cf4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:12.444280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1e0a3309-a52a-4fa5-902a-6d46e75f5cf4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:12.444935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1e0a3309-a52a-4fa5-902a-6d46e75f5cf4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:12.445925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1e0a3309-a52a-4fa5-902a-6d46e75f5cf4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:12.446607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1e0a3309-a52a-4fa5-902a-6d46e75f5cf4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:12.447265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1e0a3309-a52a-4fa5-902a-6d46e75f5cf4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:12.639968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1e0a3309-a52a-4fa5-902a-6d46e75f5cf4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:12.650063 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1e0a3309-a52a-4fa5-902a-6d46e75f5cf4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.228719 Oct 29 01:22:12.651158 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2074/4320] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:12 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:12.680980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-12aca688-ff66-46f4-86a4-dba92e5cd4ce tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:12.681629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-12aca688-ff66-46f4-86a4-dba92e5cd4ce tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:12.695155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12aca688-ff66-46f4-86a4-dba92e5cd4ce tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:12.695696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12aca688-ff66-46f4-86a4-dba92e5cd4ce tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:12.696992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12aca688-ff66-46f4-86a4-dba92e5cd4ce tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:12.697894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12aca688-ff66-46f4-86a4-dba92e5cd4ce tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:12.699031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12aca688-ff66-46f4-86a4-dba92e5cd4ce tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:12.699463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12aca688-ff66-46f4-86a4-dba92e5cd4ce tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:12.740697 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-12aca688-ff66-46f4-86a4-dba92e5cd4ce tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Cannot 'resume' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-12aca688-ff66-46f4-86a4-dba92e5cd4ce tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action HTTP/1.1 Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 14 Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: {"resume": {}} Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: exception: Cannot 'resume' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '63371d26-fe85-4cfa-bdca-c8ad84b81ee6', 'body': {'resume': {}}} Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 in vm_state active. Cannot resume while the instance is in this state. Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:12.742484 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:12.745856 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:12.745856 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:12.745856 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:12.745856 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:12.745856 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:12.745856 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active Oct 29 01:22:12.745856 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:12.745856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-12aca688-ff66-46f4-86a4-dba92e5cd4ce tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 409 to user: Cannot 'resume' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:12.745856 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-12aca688-ff66-46f4-86a4-dba92e5cd4ce tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action" status: 409 len: 144 microversion: 2.1 time: 0.072223 Oct 29 01:22:12.745856 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2247/4321] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:22:12 2022] POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action => generated 144 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 29 01:22:12.754041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-51d18d81-0b19-4283-b1b7-fe1523df069e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:12.755732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-51d18d81-0b19-4283-b1b7-fe1523df069e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:12.764190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51d18d81-0b19-4283-b1b7-fe1523df069e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:12.764742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51d18d81-0b19-4283-b1b7-fe1523df069e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:12.765644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51d18d81-0b19-4283-b1b7-fe1523df069e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:12.766499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51d18d81-0b19-4283-b1b7-fe1523df069e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:12.766971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51d18d81-0b19-4283-b1b7-fe1523df069e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:12.767459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51d18d81-0b19-4283-b1b7-fe1523df069e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:13.187753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-51d18d81-0b19-4283-b1b7-fe1523df069e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:13.199332 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-51d18d81-0b19-4283-b1b7-fe1523df069e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.449568 Oct 29 01:22:13.202063 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2075/4322] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:12 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:13.232852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e17ed2f3-b821-402a-9cb7-be5b7a0612c0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:13.233607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e17ed2f3-b821-402a-9cb7-be5b7a0612c0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:13.243363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e17ed2f3-b821-402a-9cb7-be5b7a0612c0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:13.244335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e17ed2f3-b821-402a-9cb7-be5b7a0612c0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:13.245091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e17ed2f3-b821-402a-9cb7-be5b7a0612c0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:13.246974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e17ed2f3-b821-402a-9cb7-be5b7a0612c0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:13.247332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e17ed2f3-b821-402a-9cb7-be5b7a0612c0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:13.247904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e17ed2f3-b821-402a-9cb7-be5b7a0612c0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:13.422041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-991fcfc9-a9f5-4bc1-ad90-f6eb71bd700f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:13.422986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-991fcfc9-a9f5-4bc1-ad90-f6eb71bd700f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:13.432943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-991fcfc9-a9f5-4bc1-ad90-f6eb71bd700f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:13.434032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-991fcfc9-a9f5-4bc1-ad90-f6eb71bd700f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:13.434636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-991fcfc9-a9f5-4bc1-ad90-f6eb71bd700f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:13.435958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-991fcfc9-a9f5-4bc1-ad90-f6eb71bd700f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:13.436703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-991fcfc9-a9f5-4bc1-ad90-f6eb71bd700f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:13.437323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-991fcfc9-a9f5-4bc1-ad90-f6eb71bd700f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:13.822674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e17ed2f3-b821-402a-9cb7-be5b7a0612c0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:13.831559 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e17ed2f3-b821-402a-9cb7-be5b7a0612c0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.604582 Oct 29 01:22:13.832148 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2248/4323] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:13 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:13.891941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-991fcfc9-a9f5-4bc1-ad90-f6eb71bd700f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:13.906967 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-991fcfc9-a9f5-4bc1-ad90-f6eb71bd700f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1308 microversion: 2.1 time: 0.499373 Oct 29 01:22:13.916303 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2076/4324] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:13 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1308 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:14.076286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-21b4137a-e759-478f-9af0-cdf1a13fb47a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-21b4137a-e759-478f-9af0-cdf1a13fb47a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 160 Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: {"server": {"name": "", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "daf068bd-431d-4e20-b386-6225154844e0"}]}} Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'server': {'name': '', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'networks': [{'uuid': 'daf068bd-431d-4e20-b386-6225154844e0'}]}}} Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi '' Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:22:14.081961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:22:14.085981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:22:14.085981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 29 01:22:14.085981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:14.085981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:14.085981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:14.085981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:14.085981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:14.085981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:14.085981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:22:14.085981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:22:14.085981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 29 01:22:14.085981 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:14.087743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-21b4137a-e759-478f-9af0-cdf1a13fb47a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:14.091240 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-21b4137a-e759-478f-9af0-cdf1a13fb47a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.019686 Oct 29 01:22:14.092763 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2249/4325] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:22:14 2022] POST /compute/v2.1/servers => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:22:14.105896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eb948d9d-b883-46d7-8569-bc27baef88da tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:14.108802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-eb948d9d-b883-46d7-8569-bc27baef88da tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:14.121379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb948d9d-b883-46d7-8569-bc27baef88da tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:14.122774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb948d9d-b883-46d7-8569-bc27baef88da tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:14.123936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb948d9d-b883-46d7-8569-bc27baef88da tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:14.126349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb948d9d-b883-46d7-8569-bc27baef88da tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:14.127126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb948d9d-b883-46d7-8569-bc27baef88da tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:14.128522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb948d9d-b883-46d7-8569-bc27baef88da tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:14.488233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-eb948d9d-b883-46d7-8569-bc27baef88da tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:14.501974 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-eb948d9d-b883-46d7-8569-bc27baef88da tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.405396 Oct 29 01:22:14.506201 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2077/4326] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:14 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:14.547732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-679dbfe0-9f24-4f69-856f-ed95bfc72b46 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:14.548603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-679dbfe0-9f24-4f69-856f-ed95bfc72b46 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:14.568738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-679dbfe0-9f24-4f69-856f-ed95bfc72b46 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:14.569208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-679dbfe0-9f24-4f69-856f-ed95bfc72b46 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:14.569662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-679dbfe0-9f24-4f69-856f-ed95bfc72b46 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:14.570384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-679dbfe0-9f24-4f69-856f-ed95bfc72b46 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:14.570853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-679dbfe0-9f24-4f69-856f-ed95bfc72b46 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:14.571284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-679dbfe0-9f24-4f69-856f-ed95bfc72b46 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:14.932183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c2bb2a82-e94d-4ad1-a542-f1ee97f804b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:14.932826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c2bb2a82-e94d-4ad1-a542-f1ee97f804b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:14.942844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c2bb2a82-e94d-4ad1-a542-f1ee97f804b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:14.943415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c2bb2a82-e94d-4ad1-a542-f1ee97f804b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:14.943857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c2bb2a82-e94d-4ad1-a542-f1ee97f804b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:14.977261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c2bb2a82-e94d-4ad1-a542-f1ee97f804b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:14.983107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c2bb2a82-e94d-4ad1-a542-f1ee97f804b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:14.983107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c2bb2a82-e94d-4ad1-a542-f1ee97f804b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:14.984114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-679dbfe0-9f24-4f69-856f-ed95bfc72b46 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:14.996527 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-679dbfe0-9f24-4f69-856f-ed95bfc72b46 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.463983 Oct 29 01:22:15.019515 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2250/4327] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:14 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:15.030916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-68a8fed3-32a5-4ef3-8902-b7c9a042732e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:15.037853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-68a8fed3-32a5-4ef3-8902-b7c9a042732e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 154eb334-483a-43c7-a968-13979bd53d9e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:15.046005 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-68a8fed3-32a5-4ef3-8902-b7c9a042732e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance 154eb334-483a-43c7-a968-13979bd53d9e could not be found. Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-68a8fed3-32a5-4ef3-8902-b7c9a042732e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/154eb334-483a-43c7-a968-13979bd53d9e/action HTTP/1.1 Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 14 Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: {"shelve": {}} Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 154eb334-483a-43c7-a968-13979bd53d9e could not be found. Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '154eb334-483a-43c7-a968-13979bd53d9e', 'body': {'shelve': {}}} Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 154eb334-483a-43c7-a968-13979bd53d9e could not be found. Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 154eb334-483a-43c7-a968-13979bd53d9e could not be found. Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:15.057617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:15.062098 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:15.062098 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:15.062098 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 154eb334-483a-43c7-a968-13979bd53d9e could not be found. Oct 29 01:22:15.062098 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:15.064292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-68a8fed3-32a5-4ef3-8902-b7c9a042732e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance 154eb334-483a-43c7-a968-13979bd53d9e could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:15.065395 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-68a8fed3-32a5-4ef3-8902-b7c9a042732e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/154eb334-483a-43c7-a968-13979bd53d9e/action" status: 404 len: 111 microversion: 2.1 time: 0.044716 Oct 29 01:22:15.066175 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2251/4328] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:22:15 2022] POST /compute/v2.1/servers/154eb334-483a-43c7-a968-13979bd53d9e/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:15.084347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ec468af9-124f-4e56-bf50-ed88d713723b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:15.085327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ec468af9-124f-4e56-bf50-ed88d713723b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:15.106360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec468af9-124f-4e56-bf50-ed88d713723b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:15.107098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec468af9-124f-4e56-bf50-ed88d713723b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:15.107760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec468af9-124f-4e56-bf50-ed88d713723b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:15.108671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec468af9-124f-4e56-bf50-ed88d713723b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:15.109322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec468af9-124f-4e56-bf50-ed88d713723b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:15.109897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec468af9-124f-4e56-bf50-ed88d713723b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:15.695663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ec468af9-124f-4e56-bf50-ed88d713723b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:15.710711 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ec468af9-124f-4e56-bf50-ed88d713723b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.637707 Oct 29 01:22:15.711315 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2252/4329] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:15 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:15.739359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c2bb2a82-e94d-4ad1-a542-f1ee97f804b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:15.751327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e7bb35a6-59ad-4ebe-9a21-ba92af36349f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:15.751327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e7bb35a6-59ad-4ebe-9a21-ba92af36349f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:15.751912 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c2bb2a82-e94d-4ad1-a542-f1ee97f804b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1308 microversion: 2.1 time: 0.819597 Oct 29 01:22:15.751912 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2078/4330] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:14 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1308 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:15.770821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7bb35a6-59ad-4ebe-9a21-ba92af36349f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:15.771345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7bb35a6-59ad-4ebe-9a21-ba92af36349f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:15.771796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7bb35a6-59ad-4ebe-9a21-ba92af36349f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:15.772525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7bb35a6-59ad-4ebe-9a21-ba92af36349f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:15.780933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7bb35a6-59ad-4ebe-9a21-ba92af36349f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:15.781838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7bb35a6-59ad-4ebe-9a21-ba92af36349f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:16.216551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e7bb35a6-59ad-4ebe-9a21-ba92af36349f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:16.229063 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e7bb35a6-59ad-4ebe-9a21-ba92af36349f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.494787 Oct 29 01:22:16.230006 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2253/4331] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:15 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:16.259392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f3e3f609-2964-4f71-9504-2b30b0f321bb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:16.260188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f3e3f609-2964-4f71-9504-2b30b0f321bb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:16.270067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3e3f609-2964-4f71-9504-2b30b0f321bb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:16.271096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3e3f609-2964-4f71-9504-2b30b0f321bb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:16.272605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3e3f609-2964-4f71-9504-2b30b0f321bb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:16.273896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3e3f609-2964-4f71-9504-2b30b0f321bb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:16.275665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3e3f609-2964-4f71-9504-2b30b0f321bb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:16.280288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3e3f609-2964-4f71-9504-2b30b0f321bb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:16.306736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-7d1a4599-aeb0-4b83-a021-042f04c0255b req-dea3b6e8-379a-461b-b982-1b7e0bf8ad13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7778d21f-aaaa-4aee-9d55-da624663865d", "tag": "e27ff987-8d42-45a6-8c9a-8b9ca331f97c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:16.335100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7d1a4599-aeb0-4b83-a021-042f04c0255b req-dea3b6e8-379a-461b-b982-1b7e0bf8ad13 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:16.335914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7d1a4599-aeb0-4b83-a021-042f04c0255b req-dea3b6e8-379a-461b-b982-1b7e0bf8ad13 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:16.337526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7d1a4599-aeb0-4b83-a021-042f04c0255b req-dea3b6e8-379a-461b-b982-1b7e0bf8ad13 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:16.359768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-f3e3f609-2964-4f71-9504-2b30b0f321bb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lazy-loading 'flavor' on Instance uuid 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:22:16.362770 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-7d1a4599-aeb0-4b83-a021-042f04c0255b req-dea3b6e8-379a-461b-b982-1b7e0bf8ad13 service nova] Creating event network-changed:e27ff987-8d42-45a6-8c9a-8b9ca331f97c for instance 7778d21f-aaaa-4aee-9d55-da624663865d on n-h1-862964-3 Oct 29 01:22:16.373652 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-7d1a4599-aeb0-4b83-a021-042f04c0255b req-dea3b6e8-379a-461b-b982-1b7e0bf8ad13 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070926 Oct 29 01:22:16.374449 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2254/4332] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:16.777183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f38df526-dd6e-434d-b85c-3f62e39f5ed0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:16.778216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f38df526-dd6e-434d-b85c-3f62e39f5ed0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:16.790788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f38df526-dd6e-434d-b85c-3f62e39f5ed0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:16.791292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f38df526-dd6e-434d-b85c-3f62e39f5ed0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:16.791834 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f38df526-dd6e-434d-b85c-3f62e39f5ed0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:16.792444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f38df526-dd6e-434d-b85c-3f62e39f5ed0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:16.792905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f38df526-dd6e-434d-b85c-3f62e39f5ed0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:16.793364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f38df526-dd6e-434d-b85c-3f62e39f5ed0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:17.057725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f38df526-dd6e-434d-b85c-3f62e39f5ed0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:17.065983 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f38df526-dd6e-434d-b85c-3f62e39f5ed0 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1308 microversion: 2.1 time: 0.294001 Oct 29 01:22:17.066582 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2255/4333] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:16 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1308 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:17.211037 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f3e3f609-2964-4f71-9504-2b30b0f321bb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action" status: 202 len: 0 microversion: 2.1 time: 0.961587 Oct 29 01:22:17.211732 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2079/4334] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:22:16 2022] POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action => generated 0 bytes in 963 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:22:17.228018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-59f4c3fe-9d47-4682-b0da-9e3e55ffce42 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:17.228698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-59f4c3fe-9d47-4682-b0da-9e3e55ffce42 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:17.241407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59f4c3fe-9d47-4682-b0da-9e3e55ffce42 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:17.243008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59f4c3fe-9d47-4682-b0da-9e3e55ffce42 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:17.243633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59f4c3fe-9d47-4682-b0da-9e3e55ffce42 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:17.244870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59f4c3fe-9d47-4682-b0da-9e3e55ffce42 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:17.248334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59f4c3fe-9d47-4682-b0da-9e3e55ffce42 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:17.248334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59f4c3fe-9d47-4682-b0da-9e3e55ffce42 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:17.519063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-59f4c3fe-9d47-4682-b0da-9e3e55ffce42 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:17.535193 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-59f4c3fe-9d47-4682-b0da-9e3e55ffce42 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1511 microversion: 2.1 time: 0.318808 Oct 29 01:22:17.536826 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2256/4335] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:17 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1511 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:18.091729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a4a9a0bf-6f50-481b-a553-81af6ba19785 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:18.092694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a4a9a0bf-6f50-481b-a553-81af6ba19785 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:18.101322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4a9a0bf-6f50-481b-a553-81af6ba19785 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:18.101868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4a9a0bf-6f50-481b-a553-81af6ba19785 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:18.102497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4a9a0bf-6f50-481b-a553-81af6ba19785 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:18.103260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4a9a0bf-6f50-481b-a553-81af6ba19785 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:18.103908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4a9a0bf-6f50-481b-a553-81af6ba19785 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:18.104336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4a9a0bf-6f50-481b-a553-81af6ba19785 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:18.284824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a4a9a0bf-6f50-481b-a553-81af6ba19785 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:18.294409 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a4a9a0bf-6f50-481b-a553-81af6ba19785 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1308 microversion: 2.1 time: 0.208147 Oct 29 01:22:18.295214 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2080/4336] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:18 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1308 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:18.560143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8a7cbdfa-9de9-4879-8ae7-a8b495d2e7bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:18.560767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8a7cbdfa-9de9-4879-8ae7-a8b495d2e7bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:18.564114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:22:18.570748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a7cbdfa-9de9-4879-8ae7-a8b495d2e7bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:18.572579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a7cbdfa-9de9-4879-8ae7-a8b495d2e7bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:18.573183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a7cbdfa-9de9-4879-8ae7-a8b495d2e7bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:18.574105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a7cbdfa-9de9-4879-8ae7-a8b495d2e7bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:18.574571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a7cbdfa-9de9-4879-8ae7-a8b495d2e7bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:18.574997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a7cbdfa-9de9-4879-8ae7-a8b495d2e7bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:18.727442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8a7cbdfa-9de9-4879-8ae7-a8b495d2e7bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:18.735453 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8a7cbdfa-9de9-4879-8ae7-a8b495d2e7bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1511 microversion: 2.1 time: 0.179384 Oct 29 01:22:18.736028 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2257/4337] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:18 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:19.320538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3584e746-644f-4a2b-a393-ba6f8adf39dc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:19.321558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3584e746-644f-4a2b-a393-ba6f8adf39dc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:19.329479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3584e746-644f-4a2b-a393-ba6f8adf39dc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:19.333874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3584e746-644f-4a2b-a393-ba6f8adf39dc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:19.333874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3584e746-644f-4a2b-a393-ba6f8adf39dc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:19.333874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3584e746-644f-4a2b-a393-ba6f8adf39dc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:19.333874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3584e746-644f-4a2b-a393-ba6f8adf39dc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:19.334514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3584e746-644f-4a2b-a393-ba6f8adf39dc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:19.611650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3584e746-644f-4a2b-a393-ba6f8adf39dc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:19.622957 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3584e746-644f-4a2b-a393-ba6f8adf39dc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1308 microversion: 2.1 time: 0.307480 Oct 29 01:22:19.624731 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2081/4338] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:19 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1308 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:19.759588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-523b5855-2cea-4eed-8544-6dc1120a6057 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:19.761328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-523b5855-2cea-4eed-8544-6dc1120a6057 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:19.771539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-523b5855-2cea-4eed-8544-6dc1120a6057 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:19.772332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-523b5855-2cea-4eed-8544-6dc1120a6057 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:19.772996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-523b5855-2cea-4eed-8544-6dc1120a6057 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:19.773974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-523b5855-2cea-4eed-8544-6dc1120a6057 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:19.774617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-523b5855-2cea-4eed-8544-6dc1120a6057 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:19.775223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-523b5855-2cea-4eed-8544-6dc1120a6057 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:19.972353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=10 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:22:20.023034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-523b5855-2cea-4eed-8544-6dc1120a6057 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:20.033452 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-523b5855-2cea-4eed-8544-6dc1120a6057 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1511 microversion: 2.1 time: 0.277573 Oct 29 01:22:20.034050 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2258/4339] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:19 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1511 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:20.649704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6492183f-f37e-4d62-ab3a-a87df3c7cdda tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:20.650991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6492183f-f37e-4d62-ab3a-a87df3c7cdda tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:20.667117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6492183f-f37e-4d62-ab3a-a87df3c7cdda tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:20.668896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6492183f-f37e-4d62-ab3a-a87df3c7cdda tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:20.669538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6492183f-f37e-4d62-ab3a-a87df3c7cdda tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:20.671749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6492183f-f37e-4d62-ab3a-a87df3c7cdda tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:20.672383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6492183f-f37e-4d62-ab3a-a87df3c7cdda tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:20.673009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6492183f-f37e-4d62-ab3a-a87df3c7cdda tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:20.932876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6492183f-f37e-4d62-ab3a-a87df3c7cdda tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:20.946985 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6492183f-f37e-4d62-ab3a-a87df3c7cdda tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1308 microversion: 2.1 time: 0.302758 Oct 29 01:22:20.948534 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2082/4340] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:20 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1308 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:21.071920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-041c5ab8-e805-47d0-97e4-f716258dc7fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:21.074121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-041c5ab8-e805-47d0-97e4-f716258dc7fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:21.086952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-041c5ab8-e805-47d0-97e4-f716258dc7fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:21.087695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-041c5ab8-e805-47d0-97e4-f716258dc7fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:21.091125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-041c5ab8-e805-47d0-97e4-f716258dc7fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:21.092676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-041c5ab8-e805-47d0-97e4-f716258dc7fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:21.094164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-041c5ab8-e805-47d0-97e4-f716258dc7fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:21.094762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-041c5ab8-e805-47d0-97e4-f716258dc7fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:21.404953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-041c5ab8-e805-47d0-97e4-f716258dc7fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:21.431256 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-041c5ab8-e805-47d0-97e4-f716258dc7fe tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1511 microversion: 2.1 time: 0.376499 Oct 29 01:22:21.434088 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2259/4341] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:21 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1511 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:21.973547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3225dbda-dba3-41e7-bae9-cd99b25916bc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:21.974089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3225dbda-dba3-41e7-bae9-cd99b25916bc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:21.986800 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3225dbda-dba3-41e7-bae9-cd99b25916bc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:21.987522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3225dbda-dba3-41e7-bae9-cd99b25916bc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:21.991204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3225dbda-dba3-41e7-bae9-cd99b25916bc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:21.993096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3225dbda-dba3-41e7-bae9-cd99b25916bc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:21.993769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3225dbda-dba3-41e7-bae9-cd99b25916bc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:21.994370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3225dbda-dba3-41e7-bae9-cd99b25916bc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:22.260774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3225dbda-dba3-41e7-bae9-cd99b25916bc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:22.266590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:22:22.275126 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3225dbda-dba3-41e7-bae9-cd99b25916bc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1308 microversion: 2.1 time: 0.307142 Oct 29 01:22:22.281015 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2083/4342] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:21 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1308 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:22.458898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-350eb180-f61f-4609-9756-fd510b21b6e2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:22.461738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-350eb180-f61f-4609-9756-fd510b21b6e2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:22.479102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-350eb180-f61f-4609-9756-fd510b21b6e2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:22.479780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-350eb180-f61f-4609-9756-fd510b21b6e2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:22.480766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-350eb180-f61f-4609-9756-fd510b21b6e2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:22.484440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-350eb180-f61f-4609-9756-fd510b21b6e2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:22.484989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-350eb180-f61f-4609-9756-fd510b21b6e2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:22.486128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-350eb180-f61f-4609-9756-fd510b21b6e2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:22.771836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-350eb180-f61f-4609-9756-fd510b21b6e2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:22.785973 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-350eb180-f61f-4609-9756-fd510b21b6e2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1511 microversion: 2.1 time: 0.332683 Oct 29 01:22:22.807144 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2260/4343] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:22 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1511 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:23.311683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-26b92742-2eb5-49b9-9f81-99b190f51a0b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:23.319147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-26b92742-2eb5-49b9-9f81-99b190f51a0b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:23.340015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26b92742-2eb5-49b9-9f81-99b190f51a0b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:23.340509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26b92742-2eb5-49b9-9f81-99b190f51a0b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:23.354768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26b92742-2eb5-49b9-9f81-99b190f51a0b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:23.355596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26b92742-2eb5-49b9-9f81-99b190f51a0b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:23.359519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26b92742-2eb5-49b9-9f81-99b190f51a0b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:23.360619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26b92742-2eb5-49b9-9f81-99b190f51a0b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:23.816307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1dc59475-9a97-429f-bc53-cf2a02fea1bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:23.818102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1dc59475-9a97-429f-bc53-cf2a02fea1bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:23.838810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dc59475-9a97-429f-bc53-cf2a02fea1bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:23.839379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dc59475-9a97-429f-bc53-cf2a02fea1bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:23.847475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dc59475-9a97-429f-bc53-cf2a02fea1bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:23.848802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dc59475-9a97-429f-bc53-cf2a02fea1bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:23.859210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dc59475-9a97-429f-bc53-cf2a02fea1bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:23.859210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dc59475-9a97-429f-bc53-cf2a02fea1bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:23.873767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-26b92742-2eb5-49b9-9f81-99b190f51a0b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:23.883376 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-26b92742-2eb5-49b9-9f81-99b190f51a0b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1308 microversion: 2.1 time: 0.578385 Oct 29 01:22:23.887154 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2084/4344] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:23 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1308 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:24.172092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1dc59475-9a97-429f-bc53-cf2a02fea1bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:24.186444 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1dc59475-9a97-429f-bc53-cf2a02fea1bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1511 microversion: 2.1 time: 0.374550 Oct 29 01:22:24.187042 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2261/4345] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:23 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1511 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:24.912506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cb11ea54-4c99-4dd8-b89f-7cd6fdf37883 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:24.913896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cb11ea54-4c99-4dd8-b89f-7cd6fdf37883 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:24.933267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb11ea54-4c99-4dd8-b89f-7cd6fdf37883 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:24.933915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb11ea54-4c99-4dd8-b89f-7cd6fdf37883 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:24.934464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb11ea54-4c99-4dd8-b89f-7cd6fdf37883 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:24.935286 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb11ea54-4c99-4dd8-b89f-7cd6fdf37883 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:24.935860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb11ea54-4c99-4dd8-b89f-7cd6fdf37883 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:24.936398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb11ea54-4c99-4dd8-b89f-7cd6fdf37883 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:25.150125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cb11ea54-4c99-4dd8-b89f-7cd6fdf37883 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:25.161089 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cb11ea54-4c99-4dd8-b89f-7cd6fdf37883 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1308 microversion: 2.1 time: 0.253788 Oct 29 01:22:25.162284 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2085/4346] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:24 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1308 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:25.212406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4c4adec6-339a-4e51-84aa-a858c7ee4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:25.213026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4c4adec6-339a-4e51-84aa-a858c7ee4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:25.237742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c4adec6-339a-4e51-84aa-a858c7ee4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:25.241990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c4adec6-339a-4e51-84aa-a858c7ee4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:25.242721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c4adec6-339a-4e51-84aa-a858c7ee4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:25.243767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c4adec6-339a-4e51-84aa-a858c7ee4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:25.244424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c4adec6-339a-4e51-84aa-a858c7ee4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:25.248254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c4adec6-339a-4e51-84aa-a858c7ee4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:25.574144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4c4adec6-339a-4e51-84aa-a858c7ee4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:25.602557 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4c4adec6-339a-4e51-84aa-a858c7ee4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1511 microversion: 2.1 time: 0.395683 Oct 29 01:22:25.606212 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2262/4347] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:25 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1511 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:26.188782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-34e61617-06e3-48a8-8f5f-ef621948b966 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:26.190201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-34e61617-06e3-48a8-8f5f-ef621948b966 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:26.205906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34e61617-06e3-48a8-8f5f-ef621948b966 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:26.208036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34e61617-06e3-48a8-8f5f-ef621948b966 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:26.208571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34e61617-06e3-48a8-8f5f-ef621948b966 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:26.210237 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34e61617-06e3-48a8-8f5f-ef621948b966 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:26.210988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34e61617-06e3-48a8-8f5f-ef621948b966 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:26.213293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34e61617-06e3-48a8-8f5f-ef621948b966 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:26.481739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-34e61617-06e3-48a8-8f5f-ef621948b966 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:26.496484 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-34e61617-06e3-48a8-8f5f-ef621948b966 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1308 microversion: 2.1 time: 0.314481 Oct 29 01:22:26.515913 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2086/4348] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:26 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1308 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:26.635034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3ac1d511-4391-41af-81d1-989bfa79abd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:26.635650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3ac1d511-4391-41af-81d1-989bfa79abd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:26.649901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ac1d511-4391-41af-81d1-989bfa79abd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:26.654712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ac1d511-4391-41af-81d1-989bfa79abd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:26.657060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ac1d511-4391-41af-81d1-989bfa79abd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:26.658059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ac1d511-4391-41af-81d1-989bfa79abd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:26.659564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ac1d511-4391-41af-81d1-989bfa79abd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:26.663987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ac1d511-4391-41af-81d1-989bfa79abd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:26.947330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-162a445e-3026-4012-8569-ea24efcc5bb1 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1610027204", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:27.009801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3ac1d511-4391-41af-81d1-989bfa79abd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:27.023338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-162a445e-3026-4012-8569-ea24efcc5bb1 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] validate_networks() for [('20341499-3199-40e1-8e7c-461b0e453acb', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:22:27.026280 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3ac1d511-4391-41af-81d1-989bfa79abd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1511 microversion: 2.1 time: 0.397831 Oct 29 01:22:27.028327 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2263/4349] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:26 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1511 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:27.034126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-334522a5-8c52-4226-a26f-ba8259b643bb req-9b057bb0-a23e-46bf-9779-cf5ab0018ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7778d21f-aaaa-4aee-9d55-da624663865d", "name": "network-vif-plugged", "status": "completed", "tag": "e27ff987-8d42-45a6-8c9a-8b9ca331f97c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:27.048335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-334522a5-8c52-4226-a26f-ba8259b643bb req-9b057bb0-a23e-46bf-9779-cf5ab0018ab4 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:27.049096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-334522a5-8c52-4226-a26f-ba8259b643bb req-9b057bb0-a23e-46bf-9779-cf5ab0018ab4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:27.049564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-334522a5-8c52-4226-a26f-ba8259b643bb req-9b057bb0-a23e-46bf-9779-cf5ab0018ab4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:27.053873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:22:27.061800 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-334522a5-8c52-4226-a26f-ba8259b643bb req-9b057bb0-a23e-46bf-9779-cf5ab0018ab4 service nova] Creating event network-vif-plugged:e27ff987-8d42-45a6-8c9a-8b9ca331f97c for instance 7778d21f-aaaa-4aee-9d55-da624663865d on n-h1-862964-3 Oct 29 01:22:27.068062 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-334522a5-8c52-4226-a26f-ba8259b643bb req-9b057bb0-a23e-46bf-9779-cf5ab0018ab4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037176 Oct 29 01:22:27.068150 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2264/4350] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:27.547157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ab06820d-28e5-4c23-bf94-188b44aaf1d7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:27.554506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ab06820d-28e5-4c23-bf94-188b44aaf1d7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:27.559783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab06820d-28e5-4c23-bf94-188b44aaf1d7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:27.560276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab06820d-28e5-4c23-bf94-188b44aaf1d7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:27.560715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab06820d-28e5-4c23-bf94-188b44aaf1d7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:27.561457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab06820d-28e5-4c23-bf94-188b44aaf1d7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:27.564091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab06820d-28e5-4c23-bf94-188b44aaf1d7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:27.566342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab06820d-28e5-4c23-bf94-188b44aaf1d7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:28.187156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ab06820d-28e5-4c23-bf94-188b44aaf1d7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:28.207122 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ab06820d-28e5-4c23-bf94-188b44aaf1d7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1308 microversion: 2.1 time: 0.659591 Oct 29 01:22:28.210811 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2265/4351] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:27 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1308 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:28.218146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-54059839-6d40-412e-80ec-d4e97d85290e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:28.229738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-54059839-6d40-412e-80ec-d4e97d85290e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:28.238494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54059839-6d40-412e-80ec-d4e97d85290e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:28.239229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54059839-6d40-412e-80ec-d4e97d85290e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:28.239672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54059839-6d40-412e-80ec-d4e97d85290e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:28.240384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54059839-6d40-412e-80ec-d4e97d85290e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:28.240999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54059839-6d40-412e-80ec-d4e97d85290e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:28.241602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54059839-6d40-412e-80ec-d4e97d85290e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:28.326557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-162a445e-3026-4012-8569-ea24efcc5bb1 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:22:28.328532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-162a445e-3026-4012-8569-ea24efcc5bb1 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:22:28.329288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-162a445e-3026-4012-8569-ea24efcc5bb1 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:22:28.330274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-162a445e-3026-4012-8569-ea24efcc5bb1 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:22:28.330903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-162a445e-3026-4012-8569-ea24efcc5bb1 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:22:28.374960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-162a445e-3026-4012-8569-ea24efcc5bb1 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:28.375820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-162a445e-3026-4012-8569-ea24efcc5bb1 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:28.376537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-162a445e-3026-4012-8569-ea24efcc5bb1 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:28.377610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-162a445e-3026-4012-8569-ea24efcc5bb1 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:28.378362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-162a445e-3026-4012-8569-ea24efcc5bb1 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:28.379544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-162a445e-3026-4012-8569-ea24efcc5bb1 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:28.415375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-162a445e-3026-4012-8569-ea24efcc5bb1 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Getting quotas for project cf83fbbe41fd41bdb4b862d44634cf4c. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:22:28.431020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-162a445e-3026-4012-8569-ea24efcc5bb1 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Getting quotas for user 1089d449eff3454394061a44dd6ad52d and project cf83fbbe41fd41bdb4b862d44634cf4c. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:22:28.447536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-162a445e-3026-4012-8569-ea24efcc5bb1 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:22:28.450338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-162a445e-3026-4012-8569-ea24efcc5bb1 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:22:28.666345 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-162a445e-3026-4012-8569-ea24efcc5bb1 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.968193 Oct 29 01:22:28.672153 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2087/4352] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:22:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 1975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:22:28.694468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1663d6bd-3da9-498f-9d6e-44bf6eea941d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:28.694992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-54059839-6d40-412e-80ec-d4e97d85290e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:28.695119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1663d6bd-3da9-498f-9d6e-44bf6eea941d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:28.710051 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-54059839-6d40-412e-80ec-d4e97d85290e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1511 microversion: 2.1 time: 0.498046 Oct 29 01:22:28.710658 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2266/4353] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:28 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1511 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:28.836961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1663d6bd-3da9-498f-9d6e-44bf6eea941d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:28.850784 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1663d6bd-3da9-498f-9d6e-44bf6eea941d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1214 microversion: 2.1 time: 0.167592 Oct 29 01:22:28.857462 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2088/4354] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:28 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:29.231821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8d5c4fbb-3fc2-4158-83c7-042dc90c4d33 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:29.233939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8d5c4fbb-3fc2-4158-83c7-042dc90c4d33 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:29.248843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d5c4fbb-3fc2-4158-83c7-042dc90c4d33 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:29.249422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d5c4fbb-3fc2-4158-83c7-042dc90c4d33 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:29.249868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d5c4fbb-3fc2-4158-83c7-042dc90c4d33 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:29.252576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d5c4fbb-3fc2-4158-83c7-042dc90c4d33 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:29.253429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d5c4fbb-3fc2-4158-83c7-042dc90c4d33 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:29.256351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d5c4fbb-3fc2-4158-83c7-042dc90c4d33 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:29.667048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8d5c4fbb-3fc2-4158-83c7-042dc90c4d33 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:29.679705 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8d5c4fbb-3fc2-4158-83c7-042dc90c4d33 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1488 microversion: 2.1 time: 0.452740 Oct 29 01:22:29.680907 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2267/4355] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:29 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1488 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:29.708551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-947a17a3-120f-4673-bee4-f61f4be7bbbb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1660699790"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:29.713529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-947a17a3-120f-4673-bee4-f61f4be7bbbb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:29.740864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2e690bd1-e669-40dd-b9ca-94a2b0249cd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:29.743164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2e690bd1-e669-40dd-b9ca-94a2b0249cd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:29.746178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-947a17a3-120f-4673-bee4-f61f4be7bbbb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:29.747998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-947a17a3-120f-4673-bee4-f61f4be7bbbb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:29.753710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-947a17a3-120f-4673-bee4-f61f4be7bbbb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:29.757805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-947a17a3-120f-4673-bee4-f61f4be7bbbb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:29.758801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-947a17a3-120f-4673-bee4-f61f4be7bbbb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:29.762739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-947a17a3-120f-4673-bee4-f61f4be7bbbb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:29.771107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e690bd1-e669-40dd-b9ca-94a2b0249cd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:29.776003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e690bd1-e669-40dd-b9ca-94a2b0249cd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:29.777981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e690bd1-e669-40dd-b9ca-94a2b0249cd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:29.779752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e690bd1-e669-40dd-b9ca-94a2b0249cd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:29.783377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e690bd1-e669-40dd-b9ca-94a2b0249cd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:29.789750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e690bd1-e669-40dd-b9ca-94a2b0249cd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:30.107330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2e690bd1-e669-40dd-b9ca-94a2b0249cd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:30.118126 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2e690bd1-e669-40dd-b9ca-94a2b0249cd5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1532 microversion: 2.1 time: 0.383495 Oct 29 01:22:30.119258 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2268/4356] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:29 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1532 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:30.174812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ea122d76-8f57-417e-997d-8b766c01b452 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:30.179514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ea122d76-8f57-417e-997d-8b766c01b452 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:30.357146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ea122d76-8f57-417e-997d-8b766c01b452 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:30.365440 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ea122d76-8f57-417e-997d-8b766c01b452 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1214 microversion: 2.1 time: 0.244859 Oct 29 01:22:30.366030 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2269/4357] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:30 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1214 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:30.499432 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-947a17a3-120f-4673-bee4-f61f4be7bbbb tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "POST /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d/action" status: 202 len: 0 microversion: 2.1 time: 0.796466 Oct 29 01:22:30.503784 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2089/4358] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:22:29 2022] POST /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d/action => generated 0 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 01:22:30.515302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9913423b-78b3-4cb7-968c-c7b88f0a1d1c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96a0aee0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:30.600324 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9913423b-78b3-4cb7-968c-c7b88f0a1d1c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/a016d710-7008-4a93-a262-d3030dff117a" status: 200 len: 1414 microversion: 2.1 time: 0.088850 Oct 29 01:22:30.616170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d619cbe8-4153-4bd8-85d8-bd5fb8c2109c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d971b2ca0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:30.629873 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2270/4359] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:22:30 2022] GET /compute/v2.1/images/a016d710-7008-4a93-a262-d3030dff117a => generated 1414 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:30.692482 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d619cbe8-4153-4bd8-85d8-bd5fb8c2109c tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/a016d710-7008-4a93-a262-d3030dff117a" status: 200 len: 1414 microversion: 2.1 time: 0.080074 Oct 29 01:22:30.701323 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2090/4360] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:22:30 2022] GET /compute/v2.1/images/a016d710-7008-4a93-a262-d3030dff117a => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:30.713755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bca04856-4b16-449e-8b3b-01a029b25107 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96a3cee0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:31.071584 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bca04856-4b16-449e-8b3b-01a029b25107 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/images/a016d710-7008-4a93-a262-d3030dff117a" status: 204 len: 0 microversion: 2.1 time: 0.362436 Oct 29 01:22:31.072180 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2271/4361] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:30 2022] DELETE /compute/v2.1/images/a016d710-7008-4a93-a262-d3030dff117a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:22:31.081269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4a848172-3848-4f5f-bf1a-2a3a67fee805 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97f77550>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:31.126694 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-4a848172-3848-4f5f-bf1a-2a3a67fee805 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] HTTP exception thrown: Image not found. Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4a848172-3848-4f5f-bf1a-2a3a67fee805 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Request method failure captured: Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/images/a016d710-7008-4a93-a262-d3030dff117a HTTP/1.1 Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7v4RP_R_3GJoqhm0bR3qseeRZYksj6k0BjbYweOj3YMmdVxUXCLGKjP8iTyvRfd3NoM4oj8Lqwg6qpFHcH9V44fXUPXPLXNirXiXGUUgBYxuP9h31kZwELGpQK3eELzytEf6s4bV27QVSOmfG6hrQQPzXFvoVA2L-UB8mkqvg9Wng Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b284e70790cf43e2b474559bb3e20faf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: a35b358af11846f78debaf9e422a9558 Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: exception: Image not found. Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'a016d710-7008-4a93-a262-d3030dff117a'} Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a016d710-7008-4a93-a262-d3030dff117a Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 01:22:31.129358 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a016d710-7008-4a93-a262-d3030dff117a could not be found. Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4a848172-3848-4f5f-bf1a-2a3a67fee805 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Returning 404 to user: Image not found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4a848172-3848-4f5f-bf1a-2a3a67fee805 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/images/a016d710-7008-4a93-a262-d3030dff117a" status: 404 len: 62 microversion: 2.1 time: 0.054759 Oct 29 01:22:31.140544 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2091/4362] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:22:31 2022] GET /compute/v2.1/images/a016d710-7008-4a93-a262-d3030dff117a => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:22:31.148862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1077e32f-0613-4d7b-b455-2a7c4ede59ee tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:31.149661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1077e32f-0613-4d7b-b455-2a7c4ede59ee tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:31.152695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-59a8dd77-bf87-4ab7-bc1c-2a35603e3dfc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:31.153654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-59a8dd77-bf87-4ab7-bc1c-2a35603e3dfc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:31.162150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1077e32f-0613-4d7b-b455-2a7c4ede59ee tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:31.162654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1077e32f-0613-4d7b-b455-2a7c4ede59ee tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:31.163108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1077e32f-0613-4d7b-b455-2a7c4ede59ee tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:31.163829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1077e32f-0613-4d7b-b455-2a7c4ede59ee tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:31.164294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1077e32f-0613-4d7b-b455-2a7c4ede59ee tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:31.164403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a8dd77-bf87-4ab7-bc1c-2a35603e3dfc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:31.164729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1077e32f-0613-4d7b-b455-2a7c4ede59ee tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:31.165036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a8dd77-bf87-4ab7-bc1c-2a35603e3dfc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:31.165630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a8dd77-bf87-4ab7-bc1c-2a35603e3dfc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:31.166586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a8dd77-bf87-4ab7-bc1c-2a35603e3dfc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:31.175804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a8dd77-bf87-4ab7-bc1c-2a35603e3dfc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:31.178284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a8dd77-bf87-4ab7-bc1c-2a35603e3dfc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:31.461729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1077e32f-0613-4d7b-b455-2a7c4ede59ee tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:31.476033 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1077e32f-0613-4d7b-b455-2a7c4ede59ee tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1532 microversion: 2.1 time: 0.331449 Oct 29 01:22:31.477393 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2092/4363] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:31 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1532 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:31.495613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-924a791b-315d-441e-94de-9efad18ade9a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:31.497092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-59a8dd77-bf87-4ab7-bc1c-2a35603e3dfc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:31.499083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-924a791b-315d-441e-94de-9efad18ade9a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:31.507323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-924a791b-315d-441e-94de-9efad18ade9a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:31.507889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-924a791b-315d-441e-94de-9efad18ade9a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:31.508341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-924a791b-315d-441e-94de-9efad18ade9a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:31.512643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-924a791b-315d-441e-94de-9efad18ade9a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:31.512643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-924a791b-315d-441e-94de-9efad18ade9a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:31.512643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-924a791b-315d-441e-94de-9efad18ade9a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:31.512889 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-59a8dd77-bf87-4ab7-bc1c-2a35603e3dfc tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1500 microversion: 2.1 time: 0.375731 Oct 29 01:22:31.527763 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2272/4364] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:31 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1500 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:31.557035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d533cb68-bc1f-4486-827e-fd914779cda9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:31.558727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d533cb68-bc1f-4486-827e-fd914779cda9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:31.574492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d533cb68-bc1f-4486-827e-fd914779cda9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:31.575326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d533cb68-bc1f-4486-827e-fd914779cda9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:31.577992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d533cb68-bc1f-4486-827e-fd914779cda9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:31.577992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d533cb68-bc1f-4486-827e-fd914779cda9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:31.577992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d533cb68-bc1f-4486-827e-fd914779cda9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:31.577992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d533cb68-bc1f-4486-827e-fd914779cda9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:31.594893 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-924a791b-315d-441e-94de-9efad18ade9a tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.115804 Oct 29 01:22:31.603896 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2093/4365] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:22:31 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3/os-volume_attachments => generated 25 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:22:31.680141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1776d770-151c-4e6d-be01-242aaab574e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:31.680700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1776d770-151c-4e6d-be01-242aaab574e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:31.684969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d533cb68-bc1f-4486-827e-fd914779cda9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:31.691088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1776d770-151c-4e6d-be01-242aaab574e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:31.692639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1776d770-151c-4e6d-be01-242aaab574e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:31.693486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1776d770-151c-4e6d-be01-242aaab574e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:31.694512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1776d770-151c-4e6d-be01-242aaab574e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:31.695151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1776d770-151c-4e6d-be01-242aaab574e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:31.695893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1776d770-151c-4e6d-be01-242aaab574e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:31.698087 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d533cb68-bc1f-4486-827e-fd914779cda9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1266 microversion: 2.1 time: 0.168680 Oct 29 01:22:31.699399 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2273/4366] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:31 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:31.735724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1776d770-151c-4e6d-be01-242aaab574e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:22:32.176495 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1776d770-151c-4e6d-be01-242aaab574e6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 204 len: 0 microversion: 2.1 time: 0.504945 Oct 29 01:22:32.177560 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2094/4367] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:22:31 2022] DELETE /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:22:32.185685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5fd992c2-2acc-42fd-9ecf-c8586ac41802 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:32.186294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5fd992c2-2acc-42fd-9ecf-c8586ac41802 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:32.195548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5fd992c2-2acc-42fd-9ecf-c8586ac41802 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:32.196296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5fd992c2-2acc-42fd-9ecf-c8586ac41802 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:32.197504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5fd992c2-2acc-42fd-9ecf-c8586ac41802 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:32.198898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5fd992c2-2acc-42fd-9ecf-c8586ac41802 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:32.199516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5fd992c2-2acc-42fd-9ecf-c8586ac41802 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:32.200090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5fd992c2-2acc-42fd-9ecf-c8586ac41802 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:32.501571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e0d59309-75b4-4417-9b5b-81fdbed7dadd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:32.502400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e0d59309-75b4-4417-9b5b-81fdbed7dadd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:32.529225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0d59309-75b4-4417-9b5b-81fdbed7dadd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:32.530201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0d59309-75b4-4417-9b5b-81fdbed7dadd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:32.533558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0d59309-75b4-4417-9b5b-81fdbed7dadd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:32.536277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0d59309-75b4-4417-9b5b-81fdbed7dadd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:32.539763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0d59309-75b4-4417-9b5b-81fdbed7dadd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:32.541668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0d59309-75b4-4417-9b5b-81fdbed7dadd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:32.548885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5fd992c2-2acc-42fd-9ecf-c8586ac41802 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:32.577768 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5fd992c2-2acc-42fd-9ecf-c8586ac41802 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1671 microversion: 2.1 time: 0.393420 Oct 29 01:22:32.577768 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2274/4368] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:32 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1671 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:32.600534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-681014ce-cdf4-4b2b-818f-78caec59aa7f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:32.619606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-681014ce-cdf4-4b2b-818f-78caec59aa7f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:32.635820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-681014ce-cdf4-4b2b-818f-78caec59aa7f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:32.636317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-681014ce-cdf4-4b2b-818f-78caec59aa7f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:32.637294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-681014ce-cdf4-4b2b-818f-78caec59aa7f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:32.637523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-681014ce-cdf4-4b2b-818f-78caec59aa7f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:32.637992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-681014ce-cdf4-4b2b-818f-78caec59aa7f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:32.638426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-681014ce-cdf4-4b2b-818f-78caec59aa7f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:33.657317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e0d59309-75b4-4417-9b5b-81fdbed7dadd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:33.671237 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e0d59309-75b4-4417-9b5b-81fdbed7dadd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1532 microversion: 2.1 time: 1.174640 Oct 29 01:22:33.683152 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2095/4369] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:32 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1532 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:33.712466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-37395298-088e-434d-bfc3-eaf1e9a01b23 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:33.715291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-37395298-088e-434d-bfc3-eaf1e9a01b23 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:33.736441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37395298-088e-434d-bfc3-eaf1e9a01b23 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:33.741936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37395298-088e-434d-bfc3-eaf1e9a01b23 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:33.742487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37395298-088e-434d-bfc3-eaf1e9a01b23 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:33.750130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37395298-088e-434d-bfc3-eaf1e9a01b23 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:33.751322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37395298-088e-434d-bfc3-eaf1e9a01b23 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:33.751815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-37395298-088e-434d-bfc3-eaf1e9a01b23 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:33.828754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-681014ce-cdf4-4b2b-818f-78caec59aa7f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:33.843967 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-681014ce-cdf4-4b2b-818f-78caec59aa7f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1500 microversion: 2.1 time: 1.267172 Oct 29 01:22:33.844891 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2275/4370] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:32 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1500 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:33.850190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5449d853-9db3-412c-bfa3-d0f1c4628c9b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:33.850808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5449d853-9db3-412c-bfa3-d0f1c4628c9b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:33.882404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5449d853-9db3-412c-bfa3-d0f1c4628c9b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:33.882905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5449d853-9db3-412c-bfa3-d0f1c4628c9b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:33.883350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5449d853-9db3-412c-bfa3-d0f1c4628c9b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:33.884167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5449d853-9db3-412c-bfa3-d0f1c4628c9b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:33.884645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5449d853-9db3-412c-bfa3-d0f1c4628c9b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:33.885077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5449d853-9db3-412c-bfa3-d0f1c4628c9b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:34.035650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-37395298-088e-434d-bfc3-eaf1e9a01b23 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:34.050520 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-37395298-088e-434d-bfc3-eaf1e9a01b23 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1274 microversion: 2.1 time: 0.364070 Oct 29 01:22:34.074351 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2096/4371] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:33 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1274 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:34.267070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5449d853-9db3-412c-bfa3-d0f1c4628c9b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:34.279535 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5449d853-9db3-412c-bfa3-d0f1c4628c9b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1671 microversion: 2.1 time: 0.433404 Oct 29 01:22:34.284100 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2276/4372] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:33 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1671 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:34.697329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f522411e-8521-4d3e-9fdf-d93b5ec1b986 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:34.697948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f522411e-8521-4d3e-9fdf-d93b5ec1b986 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:34.711512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f522411e-8521-4d3e-9fdf-d93b5ec1b986 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:34.712210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f522411e-8521-4d3e-9fdf-d93b5ec1b986 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:34.713693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f522411e-8521-4d3e-9fdf-d93b5ec1b986 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:34.721638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f522411e-8521-4d3e-9fdf-d93b5ec1b986 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:34.728593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f522411e-8521-4d3e-9fdf-d93b5ec1b986 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:34.729322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f522411e-8521-4d3e-9fdf-d93b5ec1b986 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:34.872758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-57297ff5-c260-421e-8ae8-62c694c1f498 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:34.873924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-57297ff5-c260-421e-8ae8-62c694c1f498 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:34.891913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57297ff5-c260-421e-8ae8-62c694c1f498 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:34.891913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57297ff5-c260-421e-8ae8-62c694c1f498 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:34.891913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57297ff5-c260-421e-8ae8-62c694c1f498 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:34.891913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57297ff5-c260-421e-8ae8-62c694c1f498 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:34.891913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57297ff5-c260-421e-8ae8-62c694c1f498 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:34.891913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57297ff5-c260-421e-8ae8-62c694c1f498 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:35.381481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f522411e-8521-4d3e-9fdf-d93b5ec1b986 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:35.402253 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f522411e-8521-4d3e-9fdf-d93b5ec1b986 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1532 microversion: 2.1 time: 0.707347 Oct 29 01:22:35.403706 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2097/4373] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:34 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1532 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:35.416025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6ffc61cc-caeb-4bdc-baee-4108b2917d88 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:35.416869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6ffc61cc-caeb-4bdc-baee-4108b2917d88 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:35.435183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ffc61cc-caeb-4bdc-baee-4108b2917d88 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:35.436253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ffc61cc-caeb-4bdc-baee-4108b2917d88 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:35.436876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ffc61cc-caeb-4bdc-baee-4108b2917d88 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:35.441009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ffc61cc-caeb-4bdc-baee-4108b2917d88 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:35.441848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ffc61cc-caeb-4bdc-baee-4108b2917d88 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:35.443072 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ffc61cc-caeb-4bdc-baee-4108b2917d88 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:35.480447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-57297ff5-c260-421e-8ae8-62c694c1f498 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:35.491899 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-57297ff5-c260-421e-8ae8-62c694c1f498 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1506 microversion: 2.1 time: 0.623649 Oct 29 01:22:35.498115 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2277/4374] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:34 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1506 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:35.504389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c289227c-7dab-4c45-babc-b8fc44bbef32 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:35.522153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c289227c-7dab-4c45-babc-b8fc44bbef32 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:35.566152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c289227c-7dab-4c45-babc-b8fc44bbef32 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:35.570304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c289227c-7dab-4c45-babc-b8fc44bbef32 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:35.577734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c289227c-7dab-4c45-babc-b8fc44bbef32 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:35.580650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c289227c-7dab-4c45-babc-b8fc44bbef32 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:35.583528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6ffc61cc-caeb-4bdc-baee-4108b2917d88 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:35.584233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c289227c-7dab-4c45-babc-b8fc44bbef32 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:35.589666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c289227c-7dab-4c45-babc-b8fc44bbef32 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:35.594219 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6ffc61cc-caeb-4bdc-baee-4108b2917d88 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1272 microversion: 2.1 time: 0.187421 Oct 29 01:22:35.596720 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2098/4375] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:35 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1272 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:35.898527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c289227c-7dab-4c45-babc-b8fc44bbef32 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:35.916479 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c289227c-7dab-4c45-babc-b8fc44bbef32 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1671 microversion: 2.1 time: 0.414286 Oct 29 01:22:35.936899 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2278/4376] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:35 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1671 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:36.435671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-59300896-60dd-4af3-a1d1-9de93edbb0bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:36.435671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-59300896-60dd-4af3-a1d1-9de93edbb0bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:36.460154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:22:36.469955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59300896-60dd-4af3-a1d1-9de93edbb0bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:36.470718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59300896-60dd-4af3-a1d1-9de93edbb0bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:36.471381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59300896-60dd-4af3-a1d1-9de93edbb0bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:36.475222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59300896-60dd-4af3-a1d1-9de93edbb0bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:36.475730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59300896-60dd-4af3-a1d1-9de93edbb0bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:36.476210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59300896-60dd-4af3-a1d1-9de93edbb0bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:36.524217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fb664619-ff7f-4db1-aa4e-e9da9e99cb8a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:36.524763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fb664619-ff7f-4db1-aa4e-e9da9e99cb8a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:36.550966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb664619-ff7f-4db1-aa4e-e9da9e99cb8a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:36.552327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb664619-ff7f-4db1-aa4e-e9da9e99cb8a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:36.552779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb664619-ff7f-4db1-aa4e-e9da9e99cb8a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:36.553530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb664619-ff7f-4db1-aa4e-e9da9e99cb8a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:36.553991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb664619-ff7f-4db1-aa4e-e9da9e99cb8a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:36.554423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb664619-ff7f-4db1-aa4e-e9da9e99cb8a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:36.913524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fb664619-ff7f-4db1-aa4e-e9da9e99cb8a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:36.941042 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fb664619-ff7f-4db1-aa4e-e9da9e99cb8a tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1506 microversion: 2.1 time: 0.420774 Oct 29 01:22:36.941936 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2279/4377] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:36 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:36.951819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-57b3d151-408d-46f7-816d-2097b149a772 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:36.954444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-57b3d151-408d-46f7-816d-2097b149a772 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:36.967704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-59300896-60dd-4af3-a1d1-9de93edbb0bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:36.981995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57b3d151-408d-46f7-816d-2097b149a772 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:36.983611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57b3d151-408d-46f7-816d-2097b149a772 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:36.984349 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-59300896-60dd-4af3-a1d1-9de93edbb0bd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1527 microversion: 2.1 time: 0.555277 Oct 29 01:22:36.984952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57b3d151-408d-46f7-816d-2097b149a772 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:36.998383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57b3d151-408d-46f7-816d-2097b149a772 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:36.998879 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2099/4378] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:36 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1527 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:37.013529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57b3d151-408d-46f7-816d-2097b149a772 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:37.014241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57b3d151-408d-46f7-816d-2097b149a772 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:37.022469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dcc84728-74fc-4896-aae1-bd56259ad3c4 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:37.023100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dcc84728-74fc-4896-aae1-bd56259ad3c4 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:37.042328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dcc84728-74fc-4896-aae1-bd56259ad3c4 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:37.042328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dcc84728-74fc-4896-aae1-bd56259ad3c4 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:37.042328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dcc84728-74fc-4896-aae1-bd56259ad3c4 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:37.042328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dcc84728-74fc-4896-aae1-bd56259ad3c4 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:37.042328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dcc84728-74fc-4896-aae1-bd56259ad3c4 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:37.042938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dcc84728-74fc-4896-aae1-bd56259ad3c4 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:37.372036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-dcc84728-74fc-4896-aae1-bd56259ad3c4 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:37.372036 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dcc84728-74fc-4896-aae1-bd56259ad3c4 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1604 microversion: 2.1 time: 0.369811 Oct 29 01:22:37.372036 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2100/4379] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:36 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1604 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:37.398931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-d5aae3ba-531b-4a9f-86b1-0ae8a037a3a4 req-f5df5f68-3446-4e23-8ae0-1c2af5434d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63371d26-fe85-4cfa-bdca-c8ad84b81ee6", "name": "network-vif-plugged", "status": "completed", "tag": "f93b16c7-df1a-462b-be91-442aa008d850"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:37.428291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-57b3d151-408d-46f7-816d-2097b149a772 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:37.436066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d5aae3ba-531b-4a9f-86b1-0ae8a037a3a4 req-f5df5f68-3446-4e23-8ae0-1c2af5434d69 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:37.437496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d5aae3ba-531b-4a9f-86b1-0ae8a037a3a4 req-f5df5f68-3446-4e23-8ae0-1c2af5434d69 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:37.438099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d5aae3ba-531b-4a9f-86b1-0ae8a037a3a4 req-f5df5f68-3446-4e23-8ae0-1c2af5434d69 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:37.440070 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-57b3d151-408d-46f7-816d-2097b149a772 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1314 microversion: 2.1 time: 0.494019 Oct 29 01:22:37.443232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:22:37.458891 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2280/4380] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:36 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:37.475807 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-d5aae3ba-531b-4a9f-86b1-0ae8a037a3a4 req-f5df5f68-3446-4e23-8ae0-1c2af5434d69 service nova] Creating event network-vif-plugged:f93b16c7-df1a-462b-be91-442aa008d850 for instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 on n-h2-862964-3 Oct 29 01:22:37.484490 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-d5aae3ba-531b-4a9f-86b1-0ae8a037a3a4 req-f5df5f68-3446-4e23-8ae0-1c2af5434d69 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088678 Oct 29 01:22:37.493230 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2101/4381] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:37.969881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f0ea82e-8744-4788-bd7d-98965e46c19f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:37.971222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1f0ea82e-8744-4788-bd7d-98965e46c19f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:37.985345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f0ea82e-8744-4788-bd7d-98965e46c19f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:37.988945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f0ea82e-8744-4788-bd7d-98965e46c19f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:37.988945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f0ea82e-8744-4788-bd7d-98965e46c19f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:37.988945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f0ea82e-8744-4788-bd7d-98965e46c19f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:37.991049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f0ea82e-8744-4788-bd7d-98965e46c19f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:37.991821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f0ea82e-8744-4788-bd7d-98965e46c19f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:38.017625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6a391796-a553-415d-988d-af9c59a01a45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:38.018354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6a391796-a553-415d-988d-af9c59a01a45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:38.036573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a391796-a553-415d-988d-af9c59a01a45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:38.036573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a391796-a553-415d-988d-af9c59a01a45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:38.036787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a391796-a553-415d-988d-af9c59a01a45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:38.037467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a391796-a553-415d-988d-af9c59a01a45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:38.037929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a391796-a553-415d-988d-af9c59a01a45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:38.038455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a391796-a553-415d-988d-af9c59a01a45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:38.368864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1f0ea82e-8744-4788-bd7d-98965e46c19f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:38.378067 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1f0ea82e-8744-4788-bd7d-98965e46c19f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1488 microversion: 2.1 time: 0.412243 Oct 29 01:22:38.386285 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2281/4382] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:37 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1488 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:38.395262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:22:38.400224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a665baf0-b608-458a-aff1-1501ace9858c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:38.407087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a665baf0-b608-458a-aff1-1501ace9858c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:38.422610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a665baf0-b608-458a-aff1-1501ace9858c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:38.426385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a665baf0-b608-458a-aff1-1501ace9858c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:38.427284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a665baf0-b608-458a-aff1-1501ace9858c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:38.432786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a665baf0-b608-458a-aff1-1501ace9858c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:38.432786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a665baf0-b608-458a-aff1-1501ace9858c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:38.432786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a665baf0-b608-458a-aff1-1501ace9858c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:38.482591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6a391796-a553-415d-988d-af9c59a01a45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:38.501022 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6a391796-a553-415d-988d-af9c59a01a45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1527 microversion: 2.1 time: 0.486492 Oct 29 01:22:38.509935 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2102/4383] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:38 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1527 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:38.526653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b791fc96-b67f-4945-a1c2-8a9c8ed82343 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:38.527645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b791fc96-b67f-4945-a1c2-8a9c8ed82343 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:38.553669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b791fc96-b67f-4945-a1c2-8a9c8ed82343 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:38.554804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b791fc96-b67f-4945-a1c2-8a9c8ed82343 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:38.555306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b791fc96-b67f-4945-a1c2-8a9c8ed82343 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:38.556068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b791fc96-b67f-4945-a1c2-8a9c8ed82343 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:38.556684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b791fc96-b67f-4945-a1c2-8a9c8ed82343 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:38.557384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b791fc96-b67f-4945-a1c2-8a9c8ed82343 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:38.636525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b791fc96-b67f-4945-a1c2-8a9c8ed82343 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:22:38.675622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a665baf0-b608-458a-aff1-1501ace9858c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:38.706420 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a665baf0-b608-458a-aff1-1501ace9858c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1604 microversion: 2.1 time: 0.295443 Oct 29 01:22:38.706420 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2282/4384] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:38 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1604 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:38.706420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e5469b48-0333-4a37-831e-6fd6955c3654 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:38.706420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e5469b48-0333-4a37-831e-6fd6955c3654 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:38.720750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5469b48-0333-4a37-831e-6fd6955c3654 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:38.725476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5469b48-0333-4a37-831e-6fd6955c3654 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:38.726220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5469b48-0333-4a37-831e-6fd6955c3654 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:38.727341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5469b48-0333-4a37-831e-6fd6955c3654 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:38.727993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5469b48-0333-4a37-831e-6fd6955c3654 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:38.728730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5469b48-0333-4a37-831e-6fd6955c3654 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:38.853267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:22:39.001959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e5469b48-0333-4a37-831e-6fd6955c3654 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:39.016210 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e5469b48-0333-4a37-831e-6fd6955c3654 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1314 microversion: 2.1 time: 0.323200 Oct 29 01:22:39.038422 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2283/4385] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:38 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:39.050616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4d6354d3-a9a4-491d-a530-e03f3892d505 req-eb6e092e-eebe-431a-b0c5-f2de74065404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7341065-fb16-4c56-9924-fe9a56d7a7b3", "name": "network-vif-deleted", "tag": "abf3212e-ab37-4f92-9f15-e2695f580a30"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:39.071209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4d6354d3-a9a4-491d-a530-e03f3892d505 req-eb6e092e-eebe-431a-b0c5-f2de74065404 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:39.079460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4d6354d3-a9a4-491d-a530-e03f3892d505 req-eb6e092e-eebe-431a-b0c5-f2de74065404 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:39.080170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4d6354d3-a9a4-491d-a530-e03f3892d505 req-eb6e092e-eebe-431a-b0c5-f2de74065404 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:39.103281 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4d6354d3-a9a4-491d-a530-e03f3892d505 req-eb6e092e-eebe-431a-b0c5-f2de74065404 service nova] Creating event network-vif-deleted:abf3212e-ab37-4f92-9f15-e2695f580a30 for instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 on n-h2-862964-3 Oct 29 01:22:39.121617 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4d6354d3-a9a4-491d-a530-e03f3892d505 req-eb6e092e-eebe-431a-b0c5-f2de74065404 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081418 Oct 29 01:22:39.126598 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2284/4386] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:39.132376 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b791fc96-b67f-4945-a1c2-8a9c8ed82343 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 204 len: 0 microversion: 2.1 time: 0.628921 Oct 29 01:22:39.134585 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2103/4387] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:22:38 2022] DELETE /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 0 bytes in 631 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:22:39.154221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-60e25cc3-069e-43aa-a109-17a4791b68f7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d96ab9670>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:39.219606 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-60e25cc3-069e-43aa-a109-17a4791b68f7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] HTTP exception thrown: Image not found. Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-60e25cc3-069e-43aa-a109-17a4791b68f7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Request method failure captured: Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/images/a016d710-7008-4a93-a262-d3030dff117a HTTP/1.1 Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH7v4RP_R_3GJoqhm0bR3qseeRZYksj6k0BjbYweOj3YMmdVxUXCLGKjP8iTyvRfd3NoM4oj8Lqwg6qpFHcH9V44fXUPXPLXNirXiXGUUgBYxuP9h31kZwELGpQK3eELzytEf6s4bV27QVSOmfG6hrQQPzXFvoVA2L-UB8mkqvg9Wng Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b284e70790cf43e2b474559bb3e20faf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: a35b358af11846f78debaf9e422a9558 Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: exception: Image not found. Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'a016d710-7008-4a93-a262-d3030dff117a'} Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a016d710-7008-4a93-a262-d3030dff117a to delete Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a016d710-7008-4a93-a262-d3030dff117a could not be found. Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:39.221816 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:22:39.226248 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:39.228605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-60e25cc3-069e-43aa-a109-17a4791b68f7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Returning 404 to user: Image not found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:39.229956 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-60e25cc3-069e-43aa-a109-17a4791b68f7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/images/a016d710-7008-4a93-a262-d3030dff117a" status: 404 len: 62 microversion: 2.1 time: 0.086206 Oct 29 01:22:39.230914 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2285/4388] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:39 2022] DELETE /compute/v2.1/images/a016d710-7008-4a93-a262-d3030dff117a => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:22:39.243944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-21b03cf1-5613-4d6d-aaaa-813124f9be1f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:39.244517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-21b03cf1-5613-4d6d-aaaa-813124f9be1f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:39.253237 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21b03cf1-5613-4d6d-aaaa-813124f9be1f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:39.254463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21b03cf1-5613-4d6d-aaaa-813124f9be1f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:39.272239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21b03cf1-5613-4d6d-aaaa-813124f9be1f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:39.272239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21b03cf1-5613-4d6d-aaaa-813124f9be1f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:39.272239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21b03cf1-5613-4d6d-aaaa-813124f9be1f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:39.272239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21b03cf1-5613-4d6d-aaaa-813124f9be1f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:39.343819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-21b03cf1-5613-4d6d-aaaa-813124f9be1f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:22:39.508833 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.compute.api [None req-21b03cf1-5613-4d6d-aaaa-813124f9be1f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Instance is already in deleting state, ignoring this request Oct 29 01:22:39.512401 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-21b03cf1-5613-4d6d-aaaa-813124f9be1f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 204 len: 0 microversion: 2.1 time: 0.276934 Oct 29 01:22:39.517687 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2104/4389] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:22:39 2022] DELETE /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:22:39.527229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-28a64c29-a8dc-4b36-9369-618badbe69b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:39.528036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-28a64c29-a8dc-4b36-9369-618badbe69b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:39.539223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-29fa9a7f-0daf-4a2e-8b31-4eebae19c1d8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:39.539655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-29fa9a7f-0daf-4a2e-8b31-4eebae19c1d8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:39.542622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28a64c29-a8dc-4b36-9369-618badbe69b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:39.543131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28a64c29-a8dc-4b36-9369-618badbe69b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:39.543581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28a64c29-a8dc-4b36-9369-618badbe69b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:39.544312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28a64c29-a8dc-4b36-9369-618badbe69b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:39.544910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28a64c29-a8dc-4b36-9369-618badbe69b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:39.545387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28a64c29-a8dc-4b36-9369-618badbe69b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:39.560741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:22:39.575915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29fa9a7f-0daf-4a2e-8b31-4eebae19c1d8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:39.579322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29fa9a7f-0daf-4a2e-8b31-4eebae19c1d8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:39.580914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29fa9a7f-0daf-4a2e-8b31-4eebae19c1d8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:39.584372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29fa9a7f-0daf-4a2e-8b31-4eebae19c1d8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:39.587315 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29fa9a7f-0daf-4a2e-8b31-4eebae19c1d8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:39.589570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29fa9a7f-0daf-4a2e-8b31-4eebae19c1d8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:40.059950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-29fa9a7f-0daf-4a2e-8b31-4eebae19c1d8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:40.080564 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-29fa9a7f-0daf-4a2e-8b31-4eebae19c1d8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1527 microversion: 2.1 time: 0.556932 Oct 29 01:22:40.101714 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2105/4390] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:39 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1527 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:40.121214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-1fd0cc11-2cf6-49e5-88fe-c9db2c69a63f req-9778f3c6-e3a6-4eae-af09-813597c74248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7778d21f-aaaa-4aee-9d55-da624663865d", "name": "network-vif-plugged", "status": "completed", "tag": "e27ff987-8d42-45a6-8c9a-8b9ca331f97c"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:40.121428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-28a64c29-a8dc-4b36-9369-618badbe69b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:40.141727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1fd0cc11-2cf6-49e5-88fe-c9db2c69a63f req-9778f3c6-e3a6-4eae-af09-813597c74248 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:40.143211 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-28a64c29-a8dc-4b36-9369-618badbe69b7 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1494 microversion: 2.1 time: 0.619833 Oct 29 01:22:40.143417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1fd0cc11-2cf6-49e5-88fe-c9db2c69a63f req-9778f3c6-e3a6-4eae-af09-813597c74248 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:40.144500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1fd0cc11-2cf6-49e5-88fe-c9db2c69a63f req-9778f3c6-e3a6-4eae-af09-813597c74248 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:40.162820 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2286/4391] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:39 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1494 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:40.178129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c3908af7-f880-4a91-bd41-033c0b127313 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:40.181369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c3908af7-f880-4a91-bd41-033c0b127313 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:40.187976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3908af7-f880-4a91-bd41-033c0b127313 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:40.188735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3908af7-f880-4a91-bd41-033c0b127313 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:40.190231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3908af7-f880-4a91-bd41-033c0b127313 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:40.191155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3908af7-f880-4a91-bd41-033c0b127313 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:40.191870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3908af7-f880-4a91-bd41-033c0b127313 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:40.192626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3908af7-f880-4a91-bd41-033c0b127313 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:40.215971 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-1fd0cc11-2cf6-49e5-88fe-c9db2c69a63f req-9778f3c6-e3a6-4eae-af09-813597c74248 service nova] Creating event network-vif-plugged:e27ff987-8d42-45a6-8c9a-8b9ca331f97c for instance 7778d21f-aaaa-4aee-9d55-da624663865d on n-h1-862964-3 Oct 29 01:22:40.229703 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-1fd0cc11-2cf6-49e5-88fe-c9db2c69a63f req-9778f3c6-e3a6-4eae-af09-813597c74248 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128581 Oct 29 01:22:40.232623 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2106/4392] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:40.248954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d2d5adae-0615-4108-b5b5-18739ab4abb2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:40.250965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d2d5adae-0615-4108-b5b5-18739ab4abb2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:40.252032 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3908af7-f880-4a91-bd41-033c0b127313 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:40.256046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3908af7-f880-4a91-bd41-033c0b127313 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:40.256726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3908af7-f880-4a91-bd41-033c0b127313 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:40.257425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-c3908af7-f880-4a91-bd41-033c0b127313 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lazy-loading 'fault' on Instance uuid c7341065-fb16-4c56-9924-fe9a56d7a7b3 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:22:40.276120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2d5adae-0615-4108-b5b5-18739ab4abb2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:40.276851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2d5adae-0615-4108-b5b5-18739ab4abb2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:40.278548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2d5adae-0615-4108-b5b5-18739ab4abb2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:40.280714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2d5adae-0615-4108-b5b5-18739ab4abb2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:40.282149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2d5adae-0615-4108-b5b5-18739ab4abb2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:40.282623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2d5adae-0615-4108-b5b5-18739ab4abb2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:40.342966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c3908af7-f880-4a91-bd41-033c0b127313 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:40.361231 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c3908af7-f880-4a91-bd41-033c0b127313 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 200 len: 1326 microversion: 2.1 time: 0.194660 Oct 29 01:22:40.379259 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2287/4393] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:40 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 1326 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:40.625132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d2d5adae-0615-4108-b5b5-18739ab4abb2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:40.642499 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d2d5adae-0615-4108-b5b5-18739ab4abb2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1314 microversion: 2.1 time: 0.407933 Oct 29 01:22:40.650320 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2107/4394] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:40 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:41.113476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-407611be-4fa8-4382-85a3-e93fc43471f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:41.114356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-407611be-4fa8-4382-85a3-e93fc43471f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:41.123930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:22:41.127764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=96 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:22:41.129715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-407611be-4fa8-4382-85a3-e93fc43471f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:41.130291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-407611be-4fa8-4382-85a3-e93fc43471f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:41.130730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-407611be-4fa8-4382-85a3-e93fc43471f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:41.131437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-407611be-4fa8-4382-85a3-e93fc43471f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:41.132803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-407611be-4fa8-4382-85a3-e93fc43471f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:41.133852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-407611be-4fa8-4382-85a3-e93fc43471f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:41.169319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-72423153-1590-48f5-a602-a73e5ddd82db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:41.169937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-72423153-1590-48f5-a602-a73e5ddd82db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:41.178220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-72423153-1590-48f5-a602-a73e5ddd82db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:41.178775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-72423153-1590-48f5-a602-a73e5ddd82db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:41.179207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-72423153-1590-48f5-a602-a73e5ddd82db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:41.180487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-72423153-1590-48f5-a602-a73e5ddd82db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:41.180487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-72423153-1590-48f5-a602-a73e5ddd82db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:41.180768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-72423153-1590-48f5-a602-a73e5ddd82db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:41.577771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-407611be-4fa8-4382-85a3-e93fc43471f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:41.591989 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-407611be-4fa8-4382-85a3-e93fc43471f0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1527 microversion: 2.1 time: 0.485407 Oct 29 01:22:41.606423 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2288/4395] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:41 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1527 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:41.645993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-165fdc62-7aac-4a39-80e3-5bb7d595220d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:41.647549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-165fdc62-7aac-4a39-80e3-5bb7d595220d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:41.657668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-165fdc62-7aac-4a39-80e3-5bb7d595220d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:41.658402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-165fdc62-7aac-4a39-80e3-5bb7d595220d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:41.661912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-165fdc62-7aac-4a39-80e3-5bb7d595220d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:41.661912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-165fdc62-7aac-4a39-80e3-5bb7d595220d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:41.661912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-165fdc62-7aac-4a39-80e3-5bb7d595220d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:41.661912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-165fdc62-7aac-4a39-80e3-5bb7d595220d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:41.687963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-72423153-1590-48f5-a602-a73e5ddd82db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:41.692605 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-165fdc62-7aac-4a39-80e3-5bb7d595220d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] HTTP exception thrown: Instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 could not be found. Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-165fdc62-7aac-4a39-80e3-5bb7d595220d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Request method failure captured: Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 HTTP/1.1 Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8T9cSwFdJFodh1W8ghdDQmW-pn2kyLAmJXDG7JqHwQkxp1x5-_ByQ-M0MZ8IOINzMBo75Sz9HUttVi23Drj0OxToLqamj3b5WVLkWAdoa9pgDpa8xhbIm5zRvocGwXrBeVCRAZ4KTonRKxYXOK3B23izcAyBa6r1a6xlpcK4m2cXc Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: d45b8f0077804db29ad5864327aa6bbb Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeTestJSON-1597110018 Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d45b8f0077804db29ad5864327aa6bbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d45b8f0077804db29ad5864327aa6bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d45b8f0077804db29ad5864327aa6bbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d45b8f0077804db29ad5864327aa6bbb", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeTestJSON-1597110018 Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: d45b8f0077804db29ad5864327aa6bbb Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1597110018 Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AttachVolumeTestJSON-1597110018-project Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 7d922c9f49ff4e87b7b1ca2e10766c53 Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeTestJSON-1597110018-project Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 could not be found. Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'c7341065-fb16-4c56-9924-fe9a56d7a7b3'} Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 could not be found. Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 could not be found. Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:41.695543 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:41.699887 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:41.699887 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:41.699887 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:41.699887 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:41.699887 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:41.699887 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 could not be found. Oct 29 01:22:41.699887 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:41.701621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-165fdc62-7aac-4a39-80e3-5bb7d595220d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Returning 404 to user: Instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:41.702634 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-165fdc62-7aac-4a39-80e3-5bb7d595220d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 404 len: 111 microversion: 2.1 time: 0.094583 Oct 29 01:22:41.709701 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2289/4396] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:41 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:41.714058 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-72423153-1590-48f5-a602-a73e5ddd82db tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1494 microversion: 2.1 time: 0.548314 Oct 29 01:22:41.715656 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2108/4397] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:41 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1494 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:41.720903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-349df74b-9ef8-4675-a6ba-cecbc4eb2bae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:41.720903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-349df74b-9ef8-4675-a6ba-cecbc4eb2bae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:41.725000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ebd56987-824e-484b-91ee-fdac2ddbd3b6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '.version_select at 0x7f9d9c042940>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:41.753972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-349df74b-9ef8-4675-a6ba-cecbc4eb2bae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:41.758343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-349df74b-9ef8-4675-a6ba-cecbc4eb2bae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:41.758830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-349df74b-9ef8-4675-a6ba-cecbc4eb2bae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:41.759588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-349df74b-9ef8-4675-a6ba-cecbc4eb2bae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:41.760052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-349df74b-9ef8-4675-a6ba-cecbc4eb2bae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:41.760504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-349df74b-9ef8-4675-a6ba-cecbc4eb2bae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:41.883055 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ebd56987-824e-484b-91ee-fdac2ddbd3b6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-680022167" status: 202 len: 0 microversion: 2.1 time: 0.166047 Oct 29 01:22:41.889336 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2109/4398] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 29 01:22:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-680022167 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:22:41.966342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-ca465587-8af8-43c3-862b-d1e650ff146a req-cca1a966-72db-4e0e-b4cc-55fac2a455e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc3605c-5148-4fa3-9adb-8ff369c7bb03", "tag": "c30de807-a386-4699-aa55-38b60ef3fefe"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:42.021812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ca465587-8af8-43c3-862b-d1e650ff146a req-cca1a966-72db-4e0e-b4cc-55fac2a455e9 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:42.026337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ca465587-8af8-43c3-862b-d1e650ff146a req-cca1a966-72db-4e0e-b4cc-55fac2a455e9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:42.030492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ca465587-8af8-43c3-862b-d1e650ff146a req-cca1a966-72db-4e0e-b4cc-55fac2a455e9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:42.037833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-349df74b-9ef8-4675-a6ba-cecbc4eb2bae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:42.049431 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-349df74b-9ef8-4675-a6ba-cecbc4eb2bae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1314 microversion: 2.1 time: 0.337443 Oct 29 01:22:42.050243 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2290/4399] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:41 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:42.089881 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-ca465587-8af8-43c3-862b-d1e650ff146a req-cca1a966-72db-4e0e-b4cc-55fac2a455e9 service nova] Creating event network-changed:c30de807-a386-4699-aa55-38b60ef3fefe for instance 9bc3605c-5148-4fa3-9adb-8ff369c7bb03 on n-h2-862964-3 Oct 29 01:22:42.112042 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-ca465587-8af8-43c3-862b-d1e650ff146a req-cca1a966-72db-4e0e-b4cc-55fac2a455e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156865 Oct 29 01:22:42.114263 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2110/4400] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:22:42.503609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-46b5f256-32f5-4333-abd8-431762f4c8cf req-95b228cc-4785-4e56-9ced-0a6a5c5e46ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7778d21f-aaaa-4aee-9d55-da624663865d", "name": "network-vif-deleted", "tag": "e27ff987-8d42-45a6-8c9a-8b9ca331f97c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:42.529312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-46b5f256-32f5-4333-abd8-431762f4c8cf req-95b228cc-4785-4e56-9ced-0a6a5c5e46ce service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:42.530075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-46b5f256-32f5-4333-abd8-431762f4c8cf req-95b228cc-4785-4e56-9ced-0a6a5c5e46ce service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:42.530714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-46b5f256-32f5-4333-abd8-431762f4c8cf req-95b228cc-4785-4e56-9ced-0a6a5c5e46ce service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:42.556190 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-46b5f256-32f5-4333-abd8-431762f4c8cf req-95b228cc-4785-4e56-9ced-0a6a5c5e46ce service nova] Creating event network-vif-deleted:e27ff987-8d42-45a6-8c9a-8b9ca331f97c for instance 7778d21f-aaaa-4aee-9d55-da624663865d on n-h1-862964-3 Oct 29 01:22:42.562833 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-46b5f256-32f5-4333-abd8-431762f4c8cf req-95b228cc-4785-4e56-9ced-0a6a5c5e46ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063093 Oct 29 01:22:42.569121 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2291/4401] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:42.639702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-99309d05-ed64-4c2b-817e-a6615e3fbd3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:42.639702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-99309d05-ed64-4c2b-817e-a6615e3fbd3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:42.640324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99309d05-ed64-4c2b-817e-a6615e3fbd3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:42.641016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99309d05-ed64-4c2b-817e-a6615e3fbd3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:42.641667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99309d05-ed64-4c2b-817e-a6615e3fbd3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:42.642600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99309d05-ed64-4c2b-817e-a6615e3fbd3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:42.643244 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99309d05-ed64-4c2b-817e-a6615e3fbd3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:42.643684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99309d05-ed64-4c2b-817e-a6615e3fbd3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:42.744705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d3e036db-4a33-403e-86bd-a0585585c5ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:42.745494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d3e036db-4a33-403e-86bd-a0585585c5ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:42.758909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3e036db-4a33-403e-86bd-a0585585c5ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:42.759421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3e036db-4a33-403e-86bd-a0585585c5ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:42.764036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3e036db-4a33-403e-86bd-a0585585c5ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:42.776192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3e036db-4a33-403e-86bd-a0585585c5ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:42.778137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3e036db-4a33-403e-86bd-a0585585c5ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:42.780987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d3e036db-4a33-403e-86bd-a0585585c5ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:42.903292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d3e036db-4a33-403e-86bd-a0585585c5ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:42.915905 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d3e036db-4a33-403e-86bd-a0585585c5ce tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1452 microversion: 2.1 time: 0.176184 Oct 29 01:22:42.920508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-99309d05-ed64-4c2b-817e-a6615e3fbd3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:42.933543 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2292/4402] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:42 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1452 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:42.940153 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-99309d05-ed64-4c2b-817e-a6615e3fbd3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1527 microversion: 2.1 time: 0.322662 Oct 29 01:22:42.953860 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2111/4403] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:42 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1527 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:43.078682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a3c717f7-2a5b-48fd-ad24-ac6c8d41d598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:43.080771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a3c717f7-2a5b-48fd-ad24-ac6c8d41d598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:43.116439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3c717f7-2a5b-48fd-ad24-ac6c8d41d598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:43.120954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3c717f7-2a5b-48fd-ad24-ac6c8d41d598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:43.125110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3c717f7-2a5b-48fd-ad24-ac6c8d41d598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:43.125735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3c717f7-2a5b-48fd-ad24-ac6c8d41d598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:43.126624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3c717f7-2a5b-48fd-ad24-ac6c8d41d598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:43.131740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3c717f7-2a5b-48fd-ad24-ac6c8d41d598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:43.412735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a3c717f7-2a5b-48fd-ad24-ac6c8d41d598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:43.434509 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a3c717f7-2a5b-48fd-ad24-ac6c8d41d598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1314 microversion: 2.1 time: 0.361980 Oct 29 01:22:43.436712 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2293/4404] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:43 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:43.941148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9e7f17d9-6337-455e-96ac-341f59aa885d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:43.946358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9e7f17d9-6337-455e-96ac-341f59aa885d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:43.965381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7eff9235-4416-4229-b1a1-5cd469b68123 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:43.966666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7eff9235-4416-4229-b1a1-5cd469b68123 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:43.969460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e7f17d9-6337-455e-96ac-341f59aa885d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:43.971280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e7f17d9-6337-455e-96ac-341f59aa885d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:43.971883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e7f17d9-6337-455e-96ac-341f59aa885d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:43.974003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e7f17d9-6337-455e-96ac-341f59aa885d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:43.974717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e7f17d9-6337-455e-96ac-341f59aa885d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:43.975296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e7f17d9-6337-455e-96ac-341f59aa885d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:43.979373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7eff9235-4416-4229-b1a1-5cd469b68123 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:43.989886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7eff9235-4416-4229-b1a1-5cd469b68123 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:43.992027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7eff9235-4416-4229-b1a1-5cd469b68123 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:43.992027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7eff9235-4416-4229-b1a1-5cd469b68123 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:43.992027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7eff9235-4416-4229-b1a1-5cd469b68123 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:43.992326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7eff9235-4416-4229-b1a1-5cd469b68123 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:44.019164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e7f17d9-6337-455e-96ac-341f59aa885d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:44.020572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e7f17d9-6337-455e-96ac-341f59aa885d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:44.021211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e7f17d9-6337-455e-96ac-341f59aa885d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:44.021818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-9e7f17d9-6337-455e-96ac-341f59aa885d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lazy-loading 'fault' on Instance uuid 7778d21f-aaaa-4aee-9d55-da624663865d {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:22:44.219084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9e7f17d9-6337-455e-96ac-341f59aa885d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35b358af11846f78debaf9e422a9558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284e70790cf43e2b474559bb3e20faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:44.229616 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9e7f17d9-6337-455e-96ac-341f59aa885d tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 200 len: 1298 microversion: 2.1 time: 0.293515 Oct 29 01:22:44.243296 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2112/4405] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:43 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 1298 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:44.410340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7eff9235-4416-4229-b1a1-5cd469b68123 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:44.427596 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7eff9235-4416-4229-b1a1-5cd469b68123 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1527 microversion: 2.1 time: 0.465882 Oct 29 01:22:44.429472 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2294/4406] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:43 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1527 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:44.462124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-254a8868-97a9-4ca7-8e42-0a2027631e9b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:44.463268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-254a8868-97a9-4ca7-8e42-0a2027631e9b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:44.482025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-254a8868-97a9-4ca7-8e42-0a2027631e9b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:44.483219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-254a8868-97a9-4ca7-8e42-0a2027631e9b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:44.491016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-254a8868-97a9-4ca7-8e42-0a2027631e9b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:44.492066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-254a8868-97a9-4ca7-8e42-0a2027631e9b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:44.493464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-254a8868-97a9-4ca7-8e42-0a2027631e9b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:44.496529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-254a8868-97a9-4ca7-8e42-0a2027631e9b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:44.728463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f4eeb8b6-9c6b-48c9-94c8-8121d72eb5c6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Action: 'create', calling method: .version_select at 0x7f9d969c69d0>, body: {"keypair": {"name": "tempest-keypair-1176073554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+eEm1/OVRMEQJLLagDY50I/rBKw6SFNz80OVCtjV2cpP9xhHAG0UpOxBx3ZFMjZFujeReIzGM5Yf51Yx4GFnD6lJCr8XiDXp8q2mwq1hRP8t6QjSaLI5ADNbyoO+CQkw=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:44.774361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-f4eeb8b6-9c6b-48c9-94c8-8121d72eb5c6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Getting quotas for project d45b8f0077804db29ad5864327aa6bbb. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:22:44.790105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-f4eeb8b6-9c6b-48c9-94c8-8121d72eb5c6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Getting quotas for user 7d922c9f49ff4e87b7b1ca2e10766c53 and project d45b8f0077804db29ad5864327aa6bbb. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:22:44.866624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-254a8868-97a9-4ca7-8e42-0a2027631e9b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:44.884551 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-254a8868-97a9-4ca7-8e42-0a2027631e9b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1314 microversion: 2.1 time: 0.425312 Oct 29 01:22:44.886012 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2113/4407] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:44 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:44.919709 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f4eeb8b6-9c6b-48c9-94c8-8121d72eb5c6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.197480 Oct 29 01:22:44.921953 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2295/4408] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:22:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:45.256818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cfd24d9c-3cc1-43fc-86c3-01396d5f8b26 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:45.258071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cfd24d9c-3cc1-43fc-86c3-01396d5f8b26 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 7778d21f-aaaa-4aee-9d55-da624663865d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:45.270368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cfd24d9c-3cc1-43fc-86c3-01396d5f8b26 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:45.274424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cfd24d9c-3cc1-43fc-86c3-01396d5f8b26 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:45.275096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cfd24d9c-3cc1-43fc-86c3-01396d5f8b26 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:45.278199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cfd24d9c-3cc1-43fc-86c3-01396d5f8b26 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:45.279301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cfd24d9c-3cc1-43fc-86c3-01396d5f8b26 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:45.280356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cfd24d9c-3cc1-43fc-86c3-01396d5f8b26 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:45.319314 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-cfd24d9c-3cc1-43fc-86c3-01396d5f8b26 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] HTTP exception thrown: Instance 7778d21f-aaaa-4aee-9d55-da624663865d could not be found. Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cfd24d9c-3cc1-43fc-86c3-01396d5f8b26 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Request method failure captured: Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d HTTP/1.1 Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7v4RP_R_3GJoqhm0bR3qseeRZYksj6k0BjbYweOj3YMmdVxUXCLGKjP8iTyvRfd3NoM4oj8Lqwg6qpFHcH9V44fXUPXPLXNirXiXGUUgBYxuP9h31kZwELGpQK3eELzytEf6s4bV27QVSOmfG6hrQQPzXFvoVA2L-UB8mkqvg9Wng Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b284e70790cf43e2b474559bb3e20faf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: a35b358af11846f78debaf9e422a9558 Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 7778d21f-aaaa-4aee-9d55-da624663865d could not be found. Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '7778d21f-aaaa-4aee-9d55-da624663865d'} Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7778d21f-aaaa-4aee-9d55-da624663865d could not be found. Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7778d21f-aaaa-4aee-9d55-da624663865d could not be found. Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.323921 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.328485 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:45.328485 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:45.328485 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:45.328485 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:45.328485 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7778d21f-aaaa-4aee-9d55-da624663865d could not be found. Oct 29 01:22:45.328485 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.328485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cfd24d9c-3cc1-43fc-86c3-01396d5f8b26 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Returning 404 to user: Instance 7778d21f-aaaa-4aee-9d55-da624663865d could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:45.328485 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cfd24d9c-3cc1-43fc-86c3-01396d5f8b26 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d" status: 404 len: 111 microversion: 2.1 time: 0.074122 Oct 29 01:22:45.334646 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2114/4409] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:45 2022] GET /compute/v2.1/servers/7778d21f-aaaa-4aee-9d55-da624663865d => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:45.338320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-04488a9b-3c9a-405c-8503-98d60bda089b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:45.338836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-04488a9b-3c9a-405c-8503-98d60bda089b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:45.354147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04488a9b-3c9a-405c-8503-98d60bda089b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:45.357560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04488a9b-3c9a-405c-8503-98d60bda089b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:45.358237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04488a9b-3c9a-405c-8503-98d60bda089b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:45.359610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04488a9b-3c9a-405c-8503-98d60bda089b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:45.360639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04488a9b-3c9a-405c-8503-98d60bda089b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:45.361660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04488a9b-3c9a-405c-8503-98d60bda089b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:45.407870 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-04488a9b-3c9a-405c-8503-98d60bda089b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] HTTP exception thrown: Instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 could not be found. Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-04488a9b-3c9a-405c-8503-98d60bda089b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Request method failure captured: Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 HTTP/1.1 Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH7v4RP_R_3GJoqhm0bR3qseeRZYksj6k0BjbYweOj3YMmdVxUXCLGKjP8iTyvRfd3NoM4oj8Lqwg6qpFHcH9V44fXUPXPLXNirXiXGUUgBYxuP9h31kZwELGpQK3eELzytEf6s4bV27QVSOmfG6hrQQPzXFvoVA2L-UB8mkqvg9Wng Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b284e70790cf43e2b474559bb3e20faf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: a35b358af11846f78debaf9e422a9558 Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 could not be found. Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '802ee4ce-5a28-416c-a4eb-e0954859bcb2'} Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 could not be found. Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:45.410033 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 could not be found. Oct 29 01:22:45.415194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.415194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:45.415194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.415194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.415194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:45.415194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:45.415194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:45.415194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:45.415194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 could not be found. Oct 29 01:22:45.415194 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.417952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-04488a9b-3c9a-405c-8503-98d60bda089b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Returning 404 to user: Instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:45.419238 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-04488a9b-3c9a-405c-8503-98d60bda089b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 404 len: 111 microversion: 2.1 time: 0.084800 Oct 29 01:22:45.425044 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2296/4410] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:22:45 2022] DELETE /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:45.429558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cad5e124-9f51-4bbc-99df-8666257fe697 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:45.430376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cad5e124-9f51-4bbc-99df-8666257fe697 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 802ee4ce-5a28-416c-a4eb-e0954859bcb2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:45.438995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cad5e124-9f51-4bbc-99df-8666257fe697 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:45.439494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cad5e124-9f51-4bbc-99df-8666257fe697 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:45.439936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cad5e124-9f51-4bbc-99df-8666257fe697 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:45.440683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cad5e124-9f51-4bbc-99df-8666257fe697 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:45.441190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cad5e124-9f51-4bbc-99df-8666257fe697 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:45.446367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cad5e124-9f51-4bbc-99df-8666257fe697 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:45.463995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6dd5063c-c919-4a9d-90ac-c84f922c36be tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:45.468001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6dd5063c-c919-4a9d-90ac-c84f922c36be tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:45.483060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dd5063c-c919-4a9d-90ac-c84f922c36be tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:45.483221 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-cad5e124-9f51-4bbc-99df-8666257fe697 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] HTTP exception thrown: Instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 could not be found. Oct 29 01:22:45.483695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dd5063c-c919-4a9d-90ac-c84f922c36be tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:45.484216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dd5063c-c919-4a9d-90ac-c84f922c36be tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cad5e124-9f51-4bbc-99df-8666257fe697 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Request method failure captured: Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 HTTP/1.1 Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7v4RP_R_3GJoqhm0bR3qseeRZYksj6k0BjbYweOj3YMmdVxUXCLGKjP8iTyvRfd3NoM4oj8Lqwg6qpFHcH9V44fXUPXPLXNirXiXGUUgBYxuP9h31kZwELGpQK3eELzytEf6s4bV27QVSOmfG6hrQQPzXFvoVA2L-UB8mkqvg9Wng Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b284e70790cf43e2b474559bb3e20faf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: a35b358af11846f78debaf9e422a9558 Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 could not be found. Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '802ee4ce-5a28-416c-a4eb-e0954859bcb2'} Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 could not be found. Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 could not be found. Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.484892 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.488255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:45.488255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:45.488255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:45.488255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:45.488255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 could not be found. Oct 29 01:22:45.488255 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.489287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dd5063c-c919-4a9d-90ac-c84f922c36be tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:45.489287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dd5063c-c919-4a9d-90ac-c84f922c36be tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:45.489287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dd5063c-c919-4a9d-90ac-c84f922c36be tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:45.490328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cad5e124-9f51-4bbc-99df-8666257fe697 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Returning 404 to user: Instance 802ee4ce-5a28-416c-a4eb-e0954859bcb2 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:45.491316 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cad5e124-9f51-4bbc-99df-8666257fe697 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2" status: 404 len: 111 microversion: 2.1 time: 0.066031 Oct 29 01:22:45.495320 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2115/4411] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:45 2022] GET /compute/v2.1/servers/802ee4ce-5a28-416c-a4eb-e0954859bcb2 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:45.518385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0ebcd7e2-65b5-487e-9816-c41a8fd70681 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97a03280>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:45.553205 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-0ebcd7e2-65b5-487e-9816-c41a8fd70681 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] HTTP exception thrown: Image not found. Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0ebcd7e2-65b5-487e-9816-c41a8fd70681 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Request method failure captured: Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 HTTP/1.1 Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7v4RP_R_3GJoqhm0bR3qseeRZYksj6k0BjbYweOj3YMmdVxUXCLGKjP8iTyvRfd3NoM4oj8Lqwg6qpFHcH9V44fXUPXPLXNirXiXGUUgBYxuP9h31kZwELGpQK3eELzytEf6s4bV27QVSOmfG6hrQQPzXFvoVA2L-UB8mkqvg9Wng Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b284e70790cf43e2b474559bb3e20faf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: a35b358af11846f78debaf9e422a9558 Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: exception: Image not found. Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'c7dea790-48ba-4f98-a2aa-990eff60d130'} Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c7dea790-48ba-4f98-a2aa-990eff60d130 to delete Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c7dea790-48ba-4f98-a2aa-990eff60d130 could not be found. Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.555466 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0ebcd7e2-65b5-487e-9816-c41a8fd70681 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Returning 404 to user: Image not found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:45.559082 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0ebcd7e2-65b5-487e-9816-c41a8fd70681 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130" status: 404 len: 62 microversion: 2.1 time: 0.060563 Oct 29 01:22:45.563930 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2116/4412] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:45 2022] DELETE /compute/v2.1/images/c7dea790-48ba-4f98-a2aa-990eff60d130 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:22:45.575352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fd8b745c-8dd1-4b96-8c9f-621420de8c1e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:45.575864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fd8b745c-8dd1-4b96-8c9f-621420de8c1e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:45.589485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd8b745c-8dd1-4b96-8c9f-621420de8c1e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:45.589997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd8b745c-8dd1-4b96-8c9f-621420de8c1e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:45.598915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd8b745c-8dd1-4b96-8c9f-621420de8c1e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:45.600207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd8b745c-8dd1-4b96-8c9f-621420de8c1e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:45.600756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd8b745c-8dd1-4b96-8c9f-621420de8c1e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:45.601228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd8b745c-8dd1-4b96-8c9f-621420de8c1e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:45.636955 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-fd8b745c-8dd1-4b96-8c9f-621420de8c1e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] HTTP exception thrown: Instance 3d0fc606-5d53-4e70-b087-22db406a68f8 could not be found. Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fd8b745c-8dd1-4b96-8c9f-621420de8c1e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Request method failure captured: Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 HTTP/1.1 Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7v4RP_R_3GJoqhm0bR3qseeRZYksj6k0BjbYweOj3YMmdVxUXCLGKjP8iTyvRfd3NoM4oj8Lqwg6qpFHcH9V44fXUPXPLXNirXiXGUUgBYxuP9h31kZwELGpQK3eELzytEf6s4bV27QVSOmfG6hrQQPzXFvoVA2L-UB8mkqvg9Wng Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b284e70790cf43e2b474559bb3e20faf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: a35b358af11846f78debaf9e422a9558 Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 3d0fc606-5d53-4e70-b087-22db406a68f8 could not be found. Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '3d0fc606-5d53-4e70-b087-22db406a68f8'} Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0fc606-5d53-4e70-b087-22db406a68f8 could not be found. Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:45.638572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0fc606-5d53-4e70-b087-22db406a68f8 could not be found. Oct 29 01:22:45.641899 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.641899 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:45.641899 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.641899 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.641899 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:45.641899 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:45.641899 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:45.641899 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:45.641899 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0fc606-5d53-4e70-b087-22db406a68f8 could not be found. Oct 29 01:22:45.641899 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.642422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fd8b745c-8dd1-4b96-8c9f-621420de8c1e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Returning 404 to user: Instance 3d0fc606-5d53-4e70-b087-22db406a68f8 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:45.643290 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fd8b745c-8dd1-4b96-8c9f-621420de8c1e tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8" status: 404 len: 111 microversion: 2.1 time: 0.078350 Oct 29 01:22:45.648933 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2117/4413] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:22:45 2022] DELETE /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:45.661584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3525877f-6d34-471f-9e6e-c8522d708596 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:45.663296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3525877f-6d34-471f-9e6e-c8522d708596 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 3d0fc606-5d53-4e70-b087-22db406a68f8] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:45.681272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3525877f-6d34-471f-9e6e-c8522d708596 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:45.684099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3525877f-6d34-471f-9e6e-c8522d708596 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:45.684658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3525877f-6d34-471f-9e6e-c8522d708596 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:45.685642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3525877f-6d34-471f-9e6e-c8522d708596 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:45.686119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3525877f-6d34-471f-9e6e-c8522d708596 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:45.686557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3525877f-6d34-471f-9e6e-c8522d708596 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:45.734163 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-3525877f-6d34-471f-9e6e-c8522d708596 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] HTTP exception thrown: Instance 3d0fc606-5d53-4e70-b087-22db406a68f8 could not be found. Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3525877f-6d34-471f-9e6e-c8522d708596 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Request method failure captured: Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 HTTP/1.1 Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7v4RP_R_3GJoqhm0bR3qseeRZYksj6k0BjbYweOj3YMmdVxUXCLGKjP8iTyvRfd3NoM4oj8Lqwg6qpFHcH9V44fXUPXPLXNirXiXGUUgBYxuP9h31kZwELGpQK3eELzytEf6s4bV27QVSOmfG6hrQQPzXFvoVA2L-UB8mkqvg9Wng Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b284e70790cf43e2b474559bb3e20faf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: a35b358af11846f78debaf9e422a9558 Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 3d0fc606-5d53-4e70-b087-22db406a68f8 could not be found. Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '3d0fc606-5d53-4e70-b087-22db406a68f8'} Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0fc606-5d53-4e70-b087-22db406a68f8 could not be found. Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0fc606-5d53-4e70-b087-22db406a68f8 could not be found. Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.745447 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.752696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:45.752696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:45.752696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:45.752696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:45.752696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0fc606-5d53-4e70-b087-22db406a68f8 could not be found. Oct 29 01:22:45.752696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.752696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3525877f-6d34-471f-9e6e-c8522d708596 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Returning 404 to user: Instance 3d0fc606-5d53-4e70-b087-22db406a68f8 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:45.753595 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3525877f-6d34-471f-9e6e-c8522d708596 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8" status: 404 len: 111 microversion: 2.1 time: 0.100831 Oct 29 01:22:45.761204 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2118/4414] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:45 2022] GET /compute/v2.1/servers/3d0fc606-5d53-4e70-b087-22db406a68f8 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:45.778963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ad7a83ad-258b-4b18-b637-36cc96187873 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97f0ed30>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:45.827572 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-ad7a83ad-258b-4b18-b637-36cc96187873 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] HTTP exception thrown: Image not found. Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ad7a83ad-258b-4b18-b637-36cc96187873 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Request method failure captured: Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 HTTP/1.1 Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7v4RP_R_3GJoqhm0bR3qseeRZYksj6k0BjbYweOj3YMmdVxUXCLGKjP8iTyvRfd3NoM4oj8Lqwg6qpFHcH9V44fXUPXPLXNirXiXGUUgBYxuP9h31kZwELGpQK3eELzytEf6s4bV27QVSOmfG6hrQQPzXFvoVA2L-UB8mkqvg9Wng Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b284e70790cf43e2b474559bb3e20faf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: a35b358af11846f78debaf9e422a9558 Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: exception: Image not found. Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'b0096de7-004f-4912-b5c5-7fbe45239049'} Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b0096de7-004f-4912-b5c5-7fbe45239049 to delete Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b0096de7-004f-4912-b5c5-7fbe45239049 could not be found. Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.830171 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:45.835716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ad7a83ad-258b-4b18-b637-36cc96187873 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Returning 404 to user: Image not found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:45.837129 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ad7a83ad-258b-4b18-b637-36cc96187873 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049" status: 404 len: 62 microversion: 2.1 time: 0.071044 Oct 29 01:22:45.839121 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2119/4415] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:45 2022] DELETE /compute/v2.1/images/b0096de7-004f-4912-b5c5-7fbe45239049 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:22:45.867451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9725a397-03f4-40c7-8855-bcca84572b5b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:45.868242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9725a397-03f4-40c7-8855-bcca84572b5b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:45.887761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9725a397-03f4-40c7-8855-bcca84572b5b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:45.888610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9725a397-03f4-40c7-8855-bcca84572b5b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:45.890705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9725a397-03f4-40c7-8855-bcca84572b5b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:45.928291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9725a397-03f4-40c7-8855-bcca84572b5b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:45.929264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9725a397-03f4-40c7-8855-bcca84572b5b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:45.931053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6dd5063c-c919-4a9d-90ac-c84f922c36be tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:45.932644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9725a397-03f4-40c7-8855-bcca84572b5b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:45.945906 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6dd5063c-c919-4a9d-90ac-c84f922c36be tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1527 microversion: 2.1 time: 0.495262 Oct 29 01:22:45.952326 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2297/4416] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:45 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1527 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:45.965120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-833fed18-dd65-433d-887b-ef1c693ae83f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:45.965710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-833fed18-dd65-433d-887b-ef1c693ae83f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:45.982349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-833fed18-dd65-433d-887b-ef1c693ae83f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:45.984845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-833fed18-dd65-433d-887b-ef1c693ae83f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:45.987527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-833fed18-dd65-433d-887b-ef1c693ae83f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:45.989528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-833fed18-dd65-433d-887b-ef1c693ae83f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:45.990074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-833fed18-dd65-433d-887b-ef1c693ae83f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:45.991685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-833fed18-dd65-433d-887b-ef1c693ae83f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:45.997858 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-9725a397-03f4-40c7-8855-bcca84572b5b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] HTTP exception thrown: Instance 277b318c-bc53-4c0d-997b-8c96d92ce41b could not be found. Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9725a397-03f4-40c7-8855-bcca84572b5b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Request method failure captured: Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b HTTP/1.1 Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7v4RP_R_3GJoqhm0bR3qseeRZYksj6k0BjbYweOj3YMmdVxUXCLGKjP8iTyvRfd3NoM4oj8Lqwg6qpFHcH9V44fXUPXPLXNirXiXGUUgBYxuP9h31kZwELGpQK3eELzytEf6s4bV27QVSOmfG6hrQQPzXFvoVA2L-UB8mkqvg9Wng Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b284e70790cf43e2b474559bb3e20faf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: a35b358af11846f78debaf9e422a9558 Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 277b318c-bc53-4c0d-997b-8c96d92ce41b could not be found. Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '277b318c-bc53-4c0d-997b-8c96d92ce41b'} Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 277b318c-bc53-4c0d-997b-8c96d92ce41b could not be found. Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:46.000957 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 277b318c-bc53-4c0d-997b-8c96d92ce41b could not be found. Oct 29 01:22:46.007971 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.007971 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:46.007971 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.007971 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.007971 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:46.007971 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:46.007971 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:46.007971 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:46.007971 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 277b318c-bc53-4c0d-997b-8c96d92ce41b could not be found. Oct 29 01:22:46.007971 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.007971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9725a397-03f4-40c7-8855-bcca84572b5b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Returning 404 to user: Instance 277b318c-bc53-4c0d-997b-8c96d92ce41b could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:46.007971 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9725a397-03f4-40c7-8855-bcca84572b5b tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 404 len: 111 microversion: 2.1 time: 0.158088 Oct 29 01:22:46.007971 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2120/4417] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:22:45 2022] DELETE /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:22:46.017633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4473983f-822c-4306-9efb-12a27751cbb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:46.018462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4473983f-822c-4306-9efb-12a27751cbb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 277b318c-bc53-4c0d-997b-8c96d92ce41b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:46.027663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4473983f-822c-4306-9efb-12a27751cbb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:46.028509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4473983f-822c-4306-9efb-12a27751cbb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:46.029133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4473983f-822c-4306-9efb-12a27751cbb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:46.030117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4473983f-822c-4306-9efb-12a27751cbb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:46.030807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4473983f-822c-4306-9efb-12a27751cbb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:46.031618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4473983f-822c-4306-9efb-12a27751cbb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:46.053726 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-4473983f-822c-4306-9efb-12a27751cbb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] HTTP exception thrown: Instance 277b318c-bc53-4c0d-997b-8c96d92ce41b could not be found. Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4473983f-822c-4306-9efb-12a27751cbb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Request method failure captured: Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b HTTP/1.1 Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7v4RP_R_3GJoqhm0bR3qseeRZYksj6k0BjbYweOj3YMmdVxUXCLGKjP8iTyvRfd3NoM4oj8Lqwg6qpFHcH9V44fXUPXPLXNirXiXGUUgBYxuP9h31kZwELGpQK3eELzytEf6s4bV27QVSOmfG6hrQQPzXFvoVA2L-UB8mkqvg9Wng Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b284e70790cf43e2b474559bb3e20faf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: a35b358af11846f78debaf9e422a9558 Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 277b318c-bc53-4c0d-997b-8c96d92ce41b could not be found. Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '277b318c-bc53-4c0d-997b-8c96d92ce41b'} Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 277b318c-bc53-4c0d-997b-8c96d92ce41b could not be found. Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 277b318c-bc53-4c0d-997b-8c96d92ce41b could not be found. Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.062611 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.068081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:46.068081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:46.068081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:46.068081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:46.068081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 277b318c-bc53-4c0d-997b-8c96d92ce41b could not be found. Oct 29 01:22:46.068081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.068081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4473983f-822c-4306-9efb-12a27751cbb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Returning 404 to user: Instance 277b318c-bc53-4c0d-997b-8c96d92ce41b could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:46.068081 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4473983f-822c-4306-9efb-12a27751cbb2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b" status: 404 len: 111 microversion: 2.1 time: 0.047017 Oct 29 01:22:46.068081 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2121/4418] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:46 2022] GET /compute/v2.1/servers/277b318c-bc53-4c0d-997b-8c96d92ce41b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:46.096628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f96f3650-9ffe-4d01-b40e-4511d4734e0f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d9ffa0b80>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:46.143101 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-f96f3650-9ffe-4d01-b40e-4511d4734e0f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] HTTP exception thrown: Image not found. Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f96f3650-9ffe-4d01-b40e-4511d4734e0f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Request method failure captured: Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca HTTP/1.1 Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7v4RP_R_3GJoqhm0bR3qseeRZYksj6k0BjbYweOj3YMmdVxUXCLGKjP8iTyvRfd3NoM4oj8Lqwg6qpFHcH9V44fXUPXPLXNirXiXGUUgBYxuP9h31kZwELGpQK3eELzytEf6s4bV27QVSOmfG6hrQQPzXFvoVA2L-UB8mkqvg9Wng Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b284e70790cf43e2b474559bb3e20faf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: a35b358af11846f78debaf9e422a9558 Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: exception: Image not found. Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'baed08da-147e-49f9-a36e-53b28b3667ca'} Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image baed08da-147e-49f9-a36e-53b28b3667ca to delete Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image baed08da-147e-49f9-a36e-53b28b3667ca could not be found. Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.144133 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f96f3650-9ffe-4d01-b40e-4511d4734e0f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Returning 404 to user: Image not found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:46.149709 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f96f3650-9ffe-4d01-b40e-4511d4734e0f tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca" status: 404 len: 62 microversion: 2.1 time: 0.064037 Oct 29 01:22:46.153125 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2122/4419] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:46 2022] DELETE /compute/v2.1/images/baed08da-147e-49f9-a36e-53b28b3667ca => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:22:46.157688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5e0e8f43-5485-4e73-a15c-e8dabf8ba492 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:46.171410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5e0e8f43-5485-4e73-a15c-e8dabf8ba492 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:46.175664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e0e8f43-5485-4e73-a15c-e8dabf8ba492 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:46.176161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e0e8f43-5485-4e73-a15c-e8dabf8ba492 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:46.176597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e0e8f43-5485-4e73-a15c-e8dabf8ba492 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:46.177355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e0e8f43-5485-4e73-a15c-e8dabf8ba492 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:46.177813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e0e8f43-5485-4e73-a15c-e8dabf8ba492 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:46.178245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e0e8f43-5485-4e73-a15c-e8dabf8ba492 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:46.206562 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-5e0e8f43-5485-4e73-a15c-e8dabf8ba492 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] HTTP exception thrown: Instance 60e5221e-08a3-4b98-a068-1963700c814e could not be found. Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5e0e8f43-5485-4e73-a15c-e8dabf8ba492 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Request method failure captured: Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e HTTP/1.1 Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7v4RP_R_3GJoqhm0bR3qseeRZYksj6k0BjbYweOj3YMmdVxUXCLGKjP8iTyvRfd3NoM4oj8Lqwg6qpFHcH9V44fXUPXPLXNirXiXGUUgBYxuP9h31kZwELGpQK3eELzytEf6s4bV27QVSOmfG6hrQQPzXFvoVA2L-UB8mkqvg9Wng Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b284e70790cf43e2b474559bb3e20faf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: a35b358af11846f78debaf9e422a9558 Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 60e5221e-08a3-4b98-a068-1963700c814e could not be found. Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '60e5221e-08a3-4b98-a068-1963700c814e'} Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e5221e-08a3-4b98-a068-1963700c814e could not be found. Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:46.211038 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e5221e-08a3-4b98-a068-1963700c814e could not be found. Oct 29 01:22:46.215005 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.215005 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:46.215005 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.215005 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.215005 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:46.215005 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:46.215005 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:46.215005 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:46.215005 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e5221e-08a3-4b98-a068-1963700c814e could not be found. Oct 29 01:22:46.215005 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.215005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5e0e8f43-5485-4e73-a15c-e8dabf8ba492 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Returning 404 to user: Instance 60e5221e-08a3-4b98-a068-1963700c814e could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:46.215005 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5e0e8f43-5485-4e73-a15c-e8dabf8ba492 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 404 len: 111 microversion: 2.1 time: 0.063790 Oct 29 01:22:46.219095 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2123/4420] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:22:46 2022] DELETE /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:46.228770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eaec0b40-ac63-4c7e-b65f-8633c05414be tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:46.231456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-eaec0b40-ac63-4c7e-b65f-8633c05414be tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: 60e5221e-08a3-4b98-a068-1963700c814e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:46.246255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eaec0b40-ac63-4c7e-b65f-8633c05414be tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:46.246758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eaec0b40-ac63-4c7e-b65f-8633c05414be tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:46.247254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eaec0b40-ac63-4c7e-b65f-8633c05414be tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:46.247989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eaec0b40-ac63-4c7e-b65f-8633c05414be tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:46.250616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eaec0b40-ac63-4c7e-b65f-8633c05414be tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:46.252060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eaec0b40-ac63-4c7e-b65f-8633c05414be tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:46.280291 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-eaec0b40-ac63-4c7e-b65f-8633c05414be tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] HTTP exception thrown: Instance 60e5221e-08a3-4b98-a068-1963700c814e could not be found. Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eaec0b40-ac63-4c7e-b65f-8633c05414be tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Request method failure captured: Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e HTTP/1.1 Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7v4RP_R_3GJoqhm0bR3qseeRZYksj6k0BjbYweOj3YMmdVxUXCLGKjP8iTyvRfd3NoM4oj8Lqwg6qpFHcH9V44fXUPXPLXNirXiXGUUgBYxuP9h31kZwELGpQK3eELzytEf6s4bV27QVSOmfG6hrQQPzXFvoVA2L-UB8mkqvg9Wng Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b284e70790cf43e2b474559bb3e20faf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: a35b358af11846f78debaf9e422a9558 Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 60e5221e-08a3-4b98-a068-1963700c814e could not be found. Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '60e5221e-08a3-4b98-a068-1963700c814e'} Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e5221e-08a3-4b98-a068-1963700c814e could not be found. Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e5221e-08a3-4b98-a068-1963700c814e could not be found. Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.282551 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.288874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:46.288874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:46.288874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:46.288874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:46.288874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e5221e-08a3-4b98-a068-1963700c814e could not be found. Oct 29 01:22:46.288874 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.288874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eaec0b40-ac63-4c7e-b65f-8633c05414be tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Returning 404 to user: Instance 60e5221e-08a3-4b98-a068-1963700c814e could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:46.288874 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-eaec0b40-ac63-4c7e-b65f-8633c05414be tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e" status: 404 len: 111 microversion: 2.1 time: 0.066027 Oct 29 01:22:46.288874 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2124/4421] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:46 2022] GET /compute/v2.1/servers/60e5221e-08a3-4b98-a068-1963700c814e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:46.297127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5f6ac77f-16a5-479e-ae29-563e79035264 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '.version_select at 0x7f9d97f92b80>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:46.334853 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-5f6ac77f-16a5-479e-ae29-563e79035264 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] HTTP exception thrown: Image not found. Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5f6ac77f-16a5-479e-ae29-563e79035264 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Request method failure captured: Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 HTTP/1.1 Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7v4RP_R_3GJoqhm0bR3qseeRZYksj6k0BjbYweOj3YMmdVxUXCLGKjP8iTyvRfd3NoM4oj8Lqwg6qpFHcH9V44fXUPXPLXNirXiXGUUgBYxuP9h31kZwELGpQK3eELzytEf6s4bV27QVSOmfG6hrQQPzXFvoVA2L-UB8mkqvg9Wng Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b284e70790cf43e2b474559bb3e20faf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: a35b358af11846f78debaf9e422a9558 Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: exception: Image not found. Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '088fb549-2a84-4e1d-9613-017ab3aec5e7'} Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 088fb549-2a84-4e1d-9613-017ab3aec5e7 to delete Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 088fb549-2a84-4e1d-9613-017ab3aec5e7 could not be found. Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.337209 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 01:22:46.341126 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.342444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5f6ac77f-16a5-479e-ae29-563e79035264 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Returning 404 to user: Image not found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:46.350787 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5f6ac77f-16a5-479e-ae29-563e79035264 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7" status: 404 len: 62 microversion: 2.1 time: 0.051270 Oct 29 01:22:46.350787 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2125/4422] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:46 2022] DELETE /compute/v2.1/images/088fb549-2a84-4e1d-9613-017ab3aec5e7 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:22:46.353133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-833fed18-dd65-433d-887b-ef1c693ae83f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:46.359373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0009cf15-0335-4340-a58a-f9b83c3c1cae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:46.359883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0009cf15-0335-4340-a58a-f9b83c3c1cae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:46.371120 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-833fed18-dd65-433d-887b-ef1c693ae83f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1314 microversion: 2.1 time: 0.414002 Oct 29 01:22:46.371335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0009cf15-0335-4340-a58a-f9b83c3c1cae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:46.374107 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2298/4423] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:45 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:46.378195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0009cf15-0335-4340-a58a-f9b83c3c1cae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:46.378195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0009cf15-0335-4340-a58a-f9b83c3c1cae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:46.378195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0009cf15-0335-4340-a58a-f9b83c3c1cae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:46.378195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0009cf15-0335-4340-a58a-f9b83c3c1cae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:46.385688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0009cf15-0335-4340-a58a-f9b83c3c1cae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:46.403966 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-0009cf15-0335-4340-a58a-f9b83c3c1cae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] HTTP exception thrown: Instance d9692f5b-742e-4f42-ac47-05a1e536ac05 could not be found. Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0009cf15-0335-4340-a58a-f9b83c3c1cae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Request method failure captured: Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 HTTP/1.1 Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH7v4RP_R_3GJoqhm0bR3qseeRZYksj6k0BjbYweOj3YMmdVxUXCLGKjP8iTyvRfd3NoM4oj8Lqwg6qpFHcH9V44fXUPXPLXNirXiXGUUgBYxuP9h31kZwELGpQK3eELzytEf6s4bV27QVSOmfG6hrQQPzXFvoVA2L-UB8mkqvg9Wng Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b284e70790cf43e2b474559bb3e20faf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: a35b358af11846f78debaf9e422a9558 Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance d9692f5b-742e-4f42-ac47-05a1e536ac05 could not be found. Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'd9692f5b-742e-4f42-ac47-05a1e536ac05'} Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9692f5b-742e-4f42-ac47-05a1e536ac05 could not be found. Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:46.406420 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9692f5b-742e-4f42-ac47-05a1e536ac05 could not be found. Oct 29 01:22:46.410143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.410143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:46.410143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.410143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.410143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:46.410143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:46.410143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:46.410143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:46.410143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9692f5b-742e-4f42-ac47-05a1e536ac05 could not be found. Oct 29 01:22:46.410143 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.410143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0009cf15-0335-4340-a58a-f9b83c3c1cae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Returning 404 to user: Instance d9692f5b-742e-4f42-ac47-05a1e536ac05 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:46.410143 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0009cf15-0335-4340-a58a-f9b83c3c1cae tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 404 len: 111 microversion: 2.1 time: 0.056015 Oct 29 01:22:46.412212 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2126/4424] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:22:46 2022] DELETE /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:46.417817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-59107fea-29a6-4749-ae00-1ec9e6cd75e2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:46.418660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-59107fea-29a6-4749-ae00-1ec9e6cd75e2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] [instance: d9692f5b-742e-4f42-ac47-05a1e536ac05] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:46.427277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59107fea-29a6-4749-ae00-1ec9e6cd75e2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:46.428005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59107fea-29a6-4749-ae00-1ec9e6cd75e2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:46.428636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59107fea-29a6-4749-ae00-1ec9e6cd75e2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:46.430213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59107fea-29a6-4749-ae00-1ec9e6cd75e2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:46.431356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59107fea-29a6-4749-ae00-1ec9e6cd75e2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:46.431999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59107fea-29a6-4749-ae00-1ec9e6cd75e2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:46.458960 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-59107fea-29a6-4749-ae00-1ec9e6cd75e2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] HTTP exception thrown: Instance d9692f5b-742e-4f42-ac47-05a1e536ac05 could not be found. Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-59107fea-29a6-4749-ae00-1ec9e6cd75e2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Request method failure captured: Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 HTTP/1.1 Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH7v4RP_R_3GJoqhm0bR3qseeRZYksj6k0BjbYweOj3YMmdVxUXCLGKjP8iTyvRfd3NoM4oj8Lqwg6qpFHcH9V44fXUPXPLXNirXiXGUUgBYxuP9h31kZwELGpQK3eELzytEf6s4bV27QVSOmfG6hrQQPzXFvoVA2L-UB8mkqvg9Wng Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b284e70790cf43e2b474559bb3e20faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b284e70790cf43e2b474559bb3e20faf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: b284e70790cf43e2b474559bb3e20faf Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ImagesTestJSON-1800579314 Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: a35b358af11846f78debaf9e422a9558 Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ImagesTestJSON-1800579314-project Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance d9692f5b-742e-4f42-ac47-05a1e536ac05 could not be found. Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'd9692f5b-742e-4f42-ac47-05a1e536ac05'} Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9692f5b-742e-4f42-ac47-05a1e536ac05 could not be found. Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9692f5b-742e-4f42-ac47-05a1e536ac05 could not be found. Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.460823 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:22:46.465458 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:22:46.465458 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:22:46.465458 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:22:46.465458 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:22:46.465458 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9692f5b-742e-4f42-ac47-05a1e536ac05 could not be found. Oct 29 01:22:46.465458 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:22:46.466056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-59107fea-29a6-4749-ae00-1ec9e6cd75e2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] Returning 404 to user: Instance d9692f5b-742e-4f42-ac47-05a1e536ac05 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:22:46.471231 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-59107fea-29a6-4749-ae00-1ec9e6cd75e2 tempest-ImagesTestJSON-1800579314 tempest-ImagesTestJSON-1800579314-project] 10.222.0.26 "GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05" status: 404 len: 111 microversion: 2.1 time: 0.053393 Oct 29 01:22:46.471864 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2299/4425] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:46 2022] GET /compute/v2.1/servers/d9692f5b-742e-4f42-ac47-05a1e536ac05 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:22:46.969747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9f81b99f-1a14-4494-b420-4de47d31dcde tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:46.970832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9f81b99f-1a14-4494-b420-4de47d31dcde tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:46.983996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f81b99f-1a14-4494-b420-4de47d31dcde tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:46.984431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f81b99f-1a14-4494-b420-4de47d31dcde tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:46.984875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f81b99f-1a14-4494-b420-4de47d31dcde tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:46.985692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f81b99f-1a14-4494-b420-4de47d31dcde tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:46.986151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f81b99f-1a14-4494-b420-4de47d31dcde tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:46.986578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f81b99f-1a14-4494-b420-4de47d31dcde tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:47.062872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:22:47.400267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cd0c313c-0c76-4ac6-a8a0-9a86c7a30136 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:47.402385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cd0c313c-0c76-4ac6-a8a0-9a86c7a30136 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:47.413667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cd0c313c-0c76-4ac6-a8a0-9a86c7a30136 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:47.420886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cd0c313c-0c76-4ac6-a8a0-9a86c7a30136 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:47.424382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cd0c313c-0c76-4ac6-a8a0-9a86c7a30136 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:47.428480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cd0c313c-0c76-4ac6-a8a0-9a86c7a30136 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:47.431823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cd0c313c-0c76-4ac6-a8a0-9a86c7a30136 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:47.435190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cd0c313c-0c76-4ac6-a8a0-9a86c7a30136 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:48.090042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9f81b99f-1a14-4494-b420-4de47d31dcde tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:48.106453 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9f81b99f-1a14-4494-b420-4de47d31dcde tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1527 microversion: 2.1 time: 1.140033 Oct 29 01:22:48.108776 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2127/4426] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:46 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1527 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:48.547178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cd0c313c-0c76-4ac6-a8a0-9a86c7a30136 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:48.562028 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cd0c313c-0c76-4ac6-a8a0-9a86c7a30136 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1314 microversion: 2.1 time: 1.164664 Oct 29 01:22:48.563117 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2300/4427] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:47 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1314 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:49.151324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fcb640ee-674a-4aa0-8001-1befee298eb8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:49.151947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fcb640ee-674a-4aa0-8001-1befee298eb8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:49.173047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcb640ee-674a-4aa0-8001-1befee298eb8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:49.174150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcb640ee-674a-4aa0-8001-1befee298eb8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:49.174937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcb640ee-674a-4aa0-8001-1befee298eb8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:49.176657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcb640ee-674a-4aa0-8001-1befee298eb8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:49.178006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcb640ee-674a-4aa0-8001-1befee298eb8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:49.178827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fcb640ee-674a-4aa0-8001-1befee298eb8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:49.591321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4a46864f-165e-4bb0-84ac-992778f68cfb tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:49.594100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4a46864f-165e-4bb0-84ac-992778f68cfb tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:49.607304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a46864f-165e-4bb0-84ac-992778f68cfb tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:49.608108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a46864f-165e-4bb0-84ac-992778f68cfb tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:49.608707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a46864f-165e-4bb0-84ac-992778f68cfb tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:49.609633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a46864f-165e-4bb0-84ac-992778f68cfb tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:49.610244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a46864f-165e-4bb0-84ac-992778f68cfb tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:49.610841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a46864f-165e-4bb0-84ac-992778f68cfb tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:49.955961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fcb640ee-674a-4aa0-8001-1befee298eb8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:49.966622 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fcb640ee-674a-4aa0-8001-1befee298eb8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1527 microversion: 2.1 time: 0.820203 Oct 29 01:22:49.967221 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2128/4428] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:49 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1527 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:50.276329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4a46864f-165e-4bb0-84ac-992778f68cfb tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:50.291320 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4a46864f-165e-4bb0-84ac-992778f68cfb tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1314 microversion: 2.1 time: 0.704036 Oct 29 01:22:50.292602 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2301/4429] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:49 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:50.998697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-189cefd5-8c88-4d0c-a578-e691027ebaf3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:50.999949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-189cefd5-8c88-4d0c-a578-e691027ebaf3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:51.060961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-189cefd5-8c88-4d0c-a578-e691027ebaf3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:51.062688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-189cefd5-8c88-4d0c-a578-e691027ebaf3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:51.063163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-189cefd5-8c88-4d0c-a578-e691027ebaf3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:51.073684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-189cefd5-8c88-4d0c-a578-e691027ebaf3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:51.073684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-189cefd5-8c88-4d0c-a578-e691027ebaf3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:51.073684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-189cefd5-8c88-4d0c-a578-e691027ebaf3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:51.315532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b1fe6ba-47db-4783-9e40-5120f0000668 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:51.317030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7b1fe6ba-47db-4783-9e40-5120f0000668 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:51.338546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b1fe6ba-47db-4783-9e40-5120f0000668 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:51.339262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b1fe6ba-47db-4783-9e40-5120f0000668 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:51.341994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b1fe6ba-47db-4783-9e40-5120f0000668 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:51.349026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b1fe6ba-47db-4783-9e40-5120f0000668 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:51.357041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b1fe6ba-47db-4783-9e40-5120f0000668 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:51.357815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b1fe6ba-47db-4783-9e40-5120f0000668 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:52.200883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7b1fe6ba-47db-4783-9e40-5120f0000668 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:52.211272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-189cefd5-8c88-4d0c-a578-e691027ebaf3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:52.217792 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7b1fe6ba-47db-4783-9e40-5120f0000668 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1314 microversion: 2.1 time: 0.906837 Oct 29 01:22:52.218934 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2302/4430] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:51 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1314 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:52.225129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1e7431ac-f50f-47a3-8531-4d2aa19848e0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-320769368", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e62dec30-5f3b-401e-84a3-a4ce3948e7e7"}], "security_groups": [{"name": "tempest-securitygroup--664610735"}], "key_name": "tempest-keypair-1176073554", "user_data": "}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:52.245598 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-189cefd5-8c88-4d0c-a578-e691027ebaf3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1527 microversion: 2.1 time: 1.247203 Oct 29 01:22:52.247491 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2129/4431] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:50 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1527 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:52.565435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-1e7431ac-f50f-47a3-8531-4d2aa19848e0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] validate_networks() for [('e62dec30-5f3b-401e-84a3-a4ce3948e7e7', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:22:52.809073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-7044a072-c40d-4f0f-84d5-bc3512096be1 req-7029b64b-da54-4d01-bfbc-273932fdfbdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc3605c-5148-4fa3-9adb-8ff369c7bb03", "name": "network-vif-plugged", "status": "completed", "tag": "c30de807-a386-4699-aa55-38b60ef3fefe"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:52.829852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7044a072-c40d-4f0f-84d5-bc3512096be1 req-7029b64b-da54-4d01-bfbc-273932fdfbdf service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:52.834369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7044a072-c40d-4f0f-84d5-bc3512096be1 req-7029b64b-da54-4d01-bfbc-273932fdfbdf service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:52.835085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7044a072-c40d-4f0f-84d5-bc3512096be1 req-7029b64b-da54-4d01-bfbc-273932fdfbdf service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:52.852737 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-7044a072-c40d-4f0f-84d5-bc3512096be1 req-7029b64b-da54-4d01-bfbc-273932fdfbdf service nova] Creating event network-vif-plugged:c30de807-a386-4699-aa55-38b60ef3fefe for instance 9bc3605c-5148-4fa3-9adb-8ff369c7bb03 on n-h2-862964-3 Oct 29 01:22:52.860014 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-7044a072-c40d-4f0f-84d5-bc3512096be1 req-7029b64b-da54-4d01-bfbc-273932fdfbdf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055264 Oct 29 01:22:52.865229 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2130/4432] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:22:53.249331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b9ed1034-04f8-4dc6-a0db-86b9e95c85a9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:53.251309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b9ed1034-04f8-4dc6-a0db-86b9e95c85a9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:53.270187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9ed1034-04f8-4dc6-a0db-86b9e95c85a9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:53.271078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9ed1034-04f8-4dc6-a0db-86b9e95c85a9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:53.272599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9ed1034-04f8-4dc6-a0db-86b9e95c85a9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:53.274022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9ed1034-04f8-4dc6-a0db-86b9e95c85a9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:53.274715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9ed1034-04f8-4dc6-a0db-86b9e95c85a9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:53.277052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9ed1034-04f8-4dc6-a0db-86b9e95c85a9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:53.971285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b9ed1034-04f8-4dc6-a0db-86b9e95c85a9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:53.981425 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b9ed1034-04f8-4dc6-a0db-86b9e95c85a9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1314 microversion: 2.1 time: 0.741671 Oct 29 01:22:53.992511 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2131/4433] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:53 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:53.997998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-804707c6-328c-4d63-8b9c-327fb1f49f89 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:53.998815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-804707c6-328c-4d63-8b9c-327fb1f49f89 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:54.018009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-804707c6-328c-4d63-8b9c-327fb1f49f89 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:54.018764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-804707c6-328c-4d63-8b9c-327fb1f49f89 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:54.020266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-804707c6-328c-4d63-8b9c-327fb1f49f89 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:54.021951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-804707c6-328c-4d63-8b9c-327fb1f49f89 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:54.024336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-804707c6-328c-4d63-8b9c-327fb1f49f89 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:54.024977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-804707c6-328c-4d63-8b9c-327fb1f49f89 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:54.027115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1e7431ac-f50f-47a3-8531-4d2aa19848e0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:22:54.027649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1e7431ac-f50f-47a3-8531-4d2aa19848e0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:22:54.028564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1e7431ac-f50f-47a3-8531-4d2aa19848e0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:22:54.030478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1e7431ac-f50f-47a3-8531-4d2aa19848e0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:22:54.031456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1e7431ac-f50f-47a3-8531-4d2aa19848e0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:22:54.059213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e7431ac-f50f-47a3-8531-4d2aa19848e0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:54.059718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e7431ac-f50f-47a3-8531-4d2aa19848e0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:54.060168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e7431ac-f50f-47a3-8531-4d2aa19848e0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:54.060917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e7431ac-f50f-47a3-8531-4d2aa19848e0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:54.061954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e7431ac-f50f-47a3-8531-4d2aa19848e0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:54.061954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e7431ac-f50f-47a3-8531-4d2aa19848e0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:54.146317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-1e7431ac-f50f-47a3-8531-4d2aa19848e0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Getting quotas for project d45b8f0077804db29ad5864327aa6bbb. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:22:54.162993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-1e7431ac-f50f-47a3-8531-4d2aa19848e0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Getting quotas for user 7d922c9f49ff4e87b7b1ca2e10766c53 and project d45b8f0077804db29ad5864327aa6bbb. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:22:54.188226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1e7431ac-f50f-47a3-8531-4d2aa19848e0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:22:54.192201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1e7431ac-f50f-47a3-8531-4d2aa19848e0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:22:54.452067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-804707c6-328c-4d63-8b9c-327fb1f49f89 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:54.462070 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-804707c6-328c-4d63-8b9c-327fb1f49f89 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1527 microversion: 2.1 time: 0.468075 Oct 29 01:22:54.462667 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2132/4434] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:53 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1527 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:54.543974 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1e7431ac-f50f-47a3-8531-4d2aa19848e0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.323733 Oct 29 01:22:54.546394 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2303/4435] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:22:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 2327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:22:54.558930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ab48558e-a244-441d-9648-42fc2d3e6418 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:54.559740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ab48558e-a244-441d-9648-42fc2d3e6418 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:55.016569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eb172b7b-082b-4035-8a47-dfa1151dc67a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:55.017232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eb172b7b-082b-4035-8a47-dfa1151dc67a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:55.035759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb172b7b-082b-4035-8a47-dfa1151dc67a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:55.037351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb172b7b-082b-4035-8a47-dfa1151dc67a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:55.043892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb172b7b-082b-4035-8a47-dfa1151dc67a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:55.047281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb172b7b-082b-4035-8a47-dfa1151dc67a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:55.047955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb172b7b-082b-4035-8a47-dfa1151dc67a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:55.051293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb172b7b-082b-4035-8a47-dfa1151dc67a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:55.669773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ab48558e-a244-441d-9648-42fc2d3e6418 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:55.681210 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ab48558e-a244-441d-9648-42fc2d3e6418 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 200 len: 1237 microversion: 2.1 time: 1.126368 Oct 29 01:22:55.703129 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2133/4436] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:54 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 1237 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:55.887002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eb172b7b-082b-4035-8a47-dfa1151dc67a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:55.907468 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eb172b7b-082b-4035-8a47-dfa1151dc67a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1500 microversion: 2.1 time: 0.896120 Oct 29 01:22:55.910391 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2304/4437] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:55 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1500 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:55.940688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1bd4bed4-f60b-49a2-a2d0-6e49617376a8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:55.946873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1bd4bed4-f60b-49a2-a2d0-6e49617376a8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:55.969787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1bd4bed4-f60b-49a2-a2d0-6e49617376a8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:55.972831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1bd4bed4-f60b-49a2-a2d0-6e49617376a8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:55.975179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1bd4bed4-f60b-49a2-a2d0-6e49617376a8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:55.976142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1bd4bed4-f60b-49a2-a2d0-6e49617376a8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:55.976773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1bd4bed4-f60b-49a2-a2d0-6e49617376a8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:55.979201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1bd4bed4-f60b-49a2-a2d0-6e49617376a8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:56.333796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3fae1246-71f5-42ee-98ba-2352abdd23f6 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-288789611", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "c0181cb5-9848-4377-b456-86578a1b8b29"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:56.469577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-3fae1246-71f5-42ee-98ba-2352abdd23f6 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] validate_networks() for [('c0181cb5-9848-4377-b456-86578a1b8b29', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:22:56.493614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1bd4bed4-f60b-49a2-a2d0-6e49617376a8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:56.507739 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1bd4bed4-f60b-49a2-a2d0-6e49617376a8 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1527 microversion: 2.1 time: 0.577486 Oct 29 01:22:56.512063 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2305/4438] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:55 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1527 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:56.535666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3f89b6f9-2954-4ed4-8085-edcde0267929 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:56.541889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3f89b6f9-2954-4ed4-8085-edcde0267929 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:56.571235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f89b6f9-2954-4ed4-8085-edcde0267929 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:56.572285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f89b6f9-2954-4ed4-8085-edcde0267929 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:56.573076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f89b6f9-2954-4ed4-8085-edcde0267929 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:56.578372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f89b6f9-2954-4ed4-8085-edcde0267929 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:56.578372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f89b6f9-2954-4ed4-8085-edcde0267929 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:56.580091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f89b6f9-2954-4ed4-8085-edcde0267929 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:56.640708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-3f89b6f9-2954-4ed4-8085-edcde0267929 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lazy-loading 'flavor' on Instance uuid 9bc3605c-5148-4fa3-9adb-8ff369c7bb03 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:22:56.653833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:22:57.166761 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3f89b6f9-2954-4ed4-8085-edcde0267929 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "POST /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03/action" status: 200 len: 32 microversion: 2.1 time: 0.650080 Oct 29 01:22:57.174167 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2306/4439] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:22:56 2022] POST /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03/action => generated 32 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:22:57.192844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7ac82a5a-c61c-4265-802d-b25f8c590845 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:57.193928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7ac82a5a-c61c-4265-802d-b25f8c590845 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:57.209386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ac82a5a-c61c-4265-802d-b25f8c590845 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:57.210041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ac82a5a-c61c-4265-802d-b25f8c590845 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:57.216315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ac82a5a-c61c-4265-802d-b25f8c590845 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:57.217083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ac82a5a-c61c-4265-802d-b25f8c590845 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:57.217608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ac82a5a-c61c-4265-802d-b25f8c590845 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:57.221787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ac82a5a-c61c-4265-802d-b25f8c590845 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:57.500468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7ac82a5a-c61c-4265-802d-b25f8c590845 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:57.514705 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7ac82a5a-c61c-4265-802d-b25f8c590845 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 200 len: 1289 microversion: 2.1 time: 0.345406 Oct 29 01:22:57.515345 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2307/4440] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:57 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 1289 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:57.544489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6614a532-761a-4638-a15d-2ae5f5950955 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:57.546552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6614a532-761a-4638-a15d-2ae5f5950955 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:57.563402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6614a532-761a-4638-a15d-2ae5f5950955 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:57.563901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6614a532-761a-4638-a15d-2ae5f5950955 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:57.584155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6614a532-761a-4638-a15d-2ae5f5950955 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:57.584155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6614a532-761a-4638-a15d-2ae5f5950955 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:57.584155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6614a532-761a-4638-a15d-2ae5f5950955 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:57.584155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6614a532-761a-4638-a15d-2ae5f5950955 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:57.693604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3fae1246-71f5-42ee-98ba-2352abdd23f6 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:22:57.694105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3fae1246-71f5-42ee-98ba-2352abdd23f6 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:22:57.694542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3fae1246-71f5-42ee-98ba-2352abdd23f6 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:22:57.695023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3fae1246-71f5-42ee-98ba-2352abdd23f6 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:22:57.695494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3fae1246-71f5-42ee-98ba-2352abdd23f6 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:22:57.721877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3fae1246-71f5-42ee-98ba-2352abdd23f6 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:57.729675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3fae1246-71f5-42ee-98ba-2352abdd23f6 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:57.730600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3fae1246-71f5-42ee-98ba-2352abdd23f6 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:57.731434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3fae1246-71f5-42ee-98ba-2352abdd23f6 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:57.731907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3fae1246-71f5-42ee-98ba-2352abdd23f6 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:57.732333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3fae1246-71f5-42ee-98ba-2352abdd23f6 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:57.781773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-3fae1246-71f5-42ee-98ba-2352abdd23f6 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Getting quotas for project 65eae7f2715a42899e0a448e7e29e2ba. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:22:57.795802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-3fae1246-71f5-42ee-98ba-2352abdd23f6 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Getting quotas for user 7d267964e9b14dae9232c86ca280bdf1 and project 65eae7f2715a42899e0a448e7e29e2ba. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:22:57.818628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3fae1246-71f5-42ee-98ba-2352abdd23f6 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:22:57.821129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3fae1246-71f5-42ee-98ba-2352abdd23f6 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:22:57.930206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6614a532-761a-4638-a15d-2ae5f5950955 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:57.953497 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6614a532-761a-4638-a15d-2ae5f5950955 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.415140 Oct 29 01:22:57.977814 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2308/4441] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:57 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:57.999157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1ea86d33-f173-4d30-a35f-16392d8852f9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:57.999157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1ea86d33-f173-4d30-a35f-16392d8852f9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:58.013883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ea86d33-f173-4d30-a35f-16392d8852f9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:58.014511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ea86d33-f173-4d30-a35f-16392d8852f9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:58.014963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ea86d33-f173-4d30-a35f-16392d8852f9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:58.015702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ea86d33-f173-4d30-a35f-16392d8852f9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:58.016165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ea86d33-f173-4d30-a35f-16392d8852f9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:58.016599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1ea86d33-f173-4d30-a35f-16392d8852f9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:58.026096 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3fae1246-71f5-42ee-98ba-2352abdd23f6 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.321361 Oct 29 01:22:58.041291 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2134/4442] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:22:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:22:58.051847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b2a433a9-5493-461c-966e-01417712991c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:58.052755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b2a433a9-5493-461c-966e-01417712991c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:58.376176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b2a433a9-5493-461c-966e-01417712991c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:58.411883 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b2a433a9-5493-461c-966e-01417712991c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1227 microversion: 2.1 time: 0.364875 Oct 29 01:22:58.431212 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2135/4443] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:58 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1227 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:58.548345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cb5d92a4-13d2-4b64-828b-0ff251e4c8d0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:58.549850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cb5d92a4-13d2-4b64-828b-0ff251e4c8d0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:58.559717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb5d92a4-13d2-4b64-828b-0ff251e4c8d0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:58.564006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb5d92a4-13d2-4b64-828b-0ff251e4c8d0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:58.565834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb5d92a4-13d2-4b64-828b-0ff251e4c8d0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:58.567288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb5d92a4-13d2-4b64-828b-0ff251e4c8d0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:58.570517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb5d92a4-13d2-4b64-828b-0ff251e4c8d0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:58.571261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb5d92a4-13d2-4b64-828b-0ff251e4c8d0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:58.790132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cb5d92a4-13d2-4b64-828b-0ff251e4c8d0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:58.802302 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cb5d92a4-13d2-4b64-828b-0ff251e4c8d0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 200 len: 1307 microversion: 2.1 time: 0.259867 Oct 29 01:22:58.802893 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2136/4444] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:58 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 1307 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:58.961113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1ea86d33-f173-4d30-a35f-16392d8852f9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:58.969423 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1ea86d33-f173-4d30-a35f-16392d8852f9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1527 microversion: 2.1 time: 0.988403 Oct 29 01:22:58.973499 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2309/4445] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:57 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1527 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:58.994290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4499240c-b0e2-4a3c-8786-5eb714055049 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:58.996793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4499240c-b0e2-4a3c-8786-5eb714055049 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:59.006085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4499240c-b0e2-4a3c-8786-5eb714055049 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:59.006797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4499240c-b0e2-4a3c-8786-5eb714055049 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:59.007397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4499240c-b0e2-4a3c-8786-5eb714055049 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:59.008321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4499240c-b0e2-4a3c-8786-5eb714055049 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:59.008981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4499240c-b0e2-4a3c-8786-5eb714055049 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:59.009595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4499240c-b0e2-4a3c-8786-5eb714055049 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:59.458748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-44c864c3-a001-4734-a3c8-0166e84a73e4 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:59.459626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-44c864c3-a001-4734-a3c8-0166e84a73e4 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:59.590484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4499240c-b0e2-4a3c-8786-5eb714055049 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:59.598826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-44c864c3-a001-4734-a3c8-0166e84a73e4 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:22:59.609862 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-44c864c3-a001-4734-a3c8-0166e84a73e4 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1227 microversion: 2.1 time: 0.156155 Oct 29 01:22:59.611801 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4499240c-b0e2-4a3c-8786-5eb714055049 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.622621 Oct 29 01:22:59.612059 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2310/4446] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:59 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1227 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:59.613951 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2137/4447] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:58 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:22:59.831771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b870f4cc-dc83-4959-998e-7fffaa127e84 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:59.833096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b870f4cc-dc83-4959-998e-7fffaa127e84 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:22:59.847729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b870f4cc-dc83-4959-998e-7fffaa127e84 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:59.848724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b870f4cc-dc83-4959-998e-7fffaa127e84 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:59.849502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b870f4cc-dc83-4959-998e-7fffaa127e84 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:59.850566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b870f4cc-dc83-4959-998e-7fffaa127e84 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:22:59.851250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b870f4cc-dc83-4959-998e-7fffaa127e84 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:22:59.852417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b870f4cc-dc83-4959-998e-7fffaa127e84 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:22:59.996422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b870f4cc-dc83-4959-998e-7fffaa127e84 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:00.004634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-89ed96c1-979a-4660-b07d-06ffcca6e7d0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:00.005262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-89ed96c1-979a-4660-b07d-06ffcca6e7d0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:00.018597 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b870f4cc-dc83-4959-998e-7fffaa127e84 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 200 len: 1295 microversion: 2.1 time: 0.190265 Oct 29 01:23:00.021224 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2311/4448] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:59 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 1295 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:00.022344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89ed96c1-979a-4660-b07d-06ffcca6e7d0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:00.023234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89ed96c1-979a-4660-b07d-06ffcca6e7d0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:00.024359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89ed96c1-979a-4660-b07d-06ffcca6e7d0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:00.026367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89ed96c1-979a-4660-b07d-06ffcca6e7d0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:00.027391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89ed96c1-979a-4660-b07d-06ffcca6e7d0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:00.028269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89ed96c1-979a-4660-b07d-06ffcca6e7d0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:00.313484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-89ed96c1-979a-4660-b07d-06ffcca6e7d0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:00.322598 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-89ed96c1-979a-4660-b07d-06ffcca6e7d0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1527 microversion: 2.1 time: 0.329416 Oct 29 01:23:00.323583 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2138/4449] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:22:59 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1527 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:00.636187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c73cb7a7-0eb2-49b4-962e-6bf1d01d7e86 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:00.636831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c73cb7a7-0eb2-49b4-962e-6bf1d01d7e86 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:00.637595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-381900bb-64ca-4872-8217-de219e95e6e3 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:00.638223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-381900bb-64ca-4872-8217-de219e95e6e3 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:00.643574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:00.646245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-381900bb-64ca-4872-8217-de219e95e6e3 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:00.647961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c73cb7a7-0eb2-49b4-962e-6bf1d01d7e86 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:00.648534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c73cb7a7-0eb2-49b4-962e-6bf1d01d7e86 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:00.649047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c73cb7a7-0eb2-49b4-962e-6bf1d01d7e86 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:00.649936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c73cb7a7-0eb2-49b4-962e-6bf1d01d7e86 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:00.650454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c73cb7a7-0eb2-49b4-962e-6bf1d01d7e86 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:00.650940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c73cb7a7-0eb2-49b4-962e-6bf1d01d7e86 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:00.652848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-381900bb-64ca-4872-8217-de219e95e6e3 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:00.653340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-381900bb-64ca-4872-8217-de219e95e6e3 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:00.654255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-381900bb-64ca-4872-8217-de219e95e6e3 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:00.654899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-381900bb-64ca-4872-8217-de219e95e6e3 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:00.655492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-381900bb-64ca-4872-8217-de219e95e6e3 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:00.757973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c73cb7a7-0eb2-49b4-962e-6bf1d01d7e86 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:00.766486 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c73cb7a7-0eb2-49b4-962e-6bf1d01d7e86 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1223 microversion: 2.1 time: 0.134301 Oct 29 01:23:00.769630 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2312/4450] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:00 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1223 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:00.918273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-381900bb-64ca-4872-8217-de219e95e6e3 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:00.932478 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-381900bb-64ca-4872-8217-de219e95e6e3 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.298600 Oct 29 01:23:00.934115 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2139/4451] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:00 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:01.048018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3a4702e3-7562-4e3e-8786-9e69d7589d9e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:01.049569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3a4702e3-7562-4e3e-8786-9e69d7589d9e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:01.056365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a4702e3-7562-4e3e-8786-9e69d7589d9e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:01.057092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a4702e3-7562-4e3e-8786-9e69d7589d9e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:01.057546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a4702e3-7562-4e3e-8786-9e69d7589d9e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:01.058419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a4702e3-7562-4e3e-8786-9e69d7589d9e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:01.059071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a4702e3-7562-4e3e-8786-9e69d7589d9e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:01.059645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a4702e3-7562-4e3e-8786-9e69d7589d9e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:01.309516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3a4702e3-7562-4e3e-8786-9e69d7589d9e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:01.324478 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3a4702e3-7562-4e3e-8786-9e69d7589d9e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 200 len: 1362 microversion: 2.1 time: 0.277689 Oct 29 01:23:01.329319 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2313/4452] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:01 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:01.349873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f1ce700c-dd13-49a9-80d4-3e91a470a6d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:01.351044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f1ce700c-dd13-49a9-80d4-3e91a470a6d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:01.371052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1ce700c-dd13-49a9-80d4-3e91a470a6d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:01.371618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1ce700c-dd13-49a9-80d4-3e91a470a6d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:01.372097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1ce700c-dd13-49a9-80d4-3e91a470a6d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:01.372987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1ce700c-dd13-49a9-80d4-3e91a470a6d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:01.373472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1ce700c-dd13-49a9-80d4-3e91a470a6d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:01.374839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1ce700c-dd13-49a9-80d4-3e91a470a6d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:01.699741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f1ce700c-dd13-49a9-80d4-3e91a470a6d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:01.710051 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f1ce700c-dd13-49a9-80d4-3e91a470a6d1 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1509 microversion: 2.1 time: 0.365713 Oct 29 01:23:01.711053 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2140/4453] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:01 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1509 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:01.796577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-61c9a3a9-1f6e-4d81-a5c6-77ec9aefbaf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:01.805934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-61c9a3a9-1f6e-4d81-a5c6-77ec9aefbaf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:01.805934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61c9a3a9-1f6e-4d81-a5c6-77ec9aefbaf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:01.805934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61c9a3a9-1f6e-4d81-a5c6-77ec9aefbaf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:01.805934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61c9a3a9-1f6e-4d81-a5c6-77ec9aefbaf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:01.806290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61c9a3a9-1f6e-4d81-a5c6-77ec9aefbaf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:01.806430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61c9a3a9-1f6e-4d81-a5c6-77ec9aefbaf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:01.807120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61c9a3a9-1f6e-4d81-a5c6-77ec9aefbaf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:01.913515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-61c9a3a9-1f6e-4d81-a5c6-77ec9aefbaf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:01.926617 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-61c9a3a9-1f6e-4d81-a5c6-77ec9aefbaf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1287 microversion: 2.1 time: 0.133831 Oct 29 01:23:01.937205 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2314/4454] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:01 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1287 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:01.957857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1984f059-aa76-4389-bde1-172981ac981e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:01.958782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1984f059-aa76-4389-bde1-172981ac981e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:01.967160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1984f059-aa76-4389-bde1-172981ac981e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:01.968813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1984f059-aa76-4389-bde1-172981ac981e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:01.969856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1984f059-aa76-4389-bde1-172981ac981e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:01.971769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1984f059-aa76-4389-bde1-172981ac981e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:01.972582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1984f059-aa76-4389-bde1-172981ac981e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:01.973507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1984f059-aa76-4389-bde1-172981ac981e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:02.231453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1984f059-aa76-4389-bde1-172981ac981e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:02.240120 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1984f059-aa76-4389-bde1-172981ac981e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.287302 Oct 29 01:23:02.256810 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2141/4455] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:01 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:02.350686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ef1a1009-3437-4e9c-bbf9-cc7e8ced7851 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:02.351524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ef1a1009-3437-4e9c-bbf9-cc7e8ced7851 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:02.358511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef1a1009-3437-4e9c-bbf9-cc7e8ced7851 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:02.359003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef1a1009-3437-4e9c-bbf9-cc7e8ced7851 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:02.359442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef1a1009-3437-4e9c-bbf9-cc7e8ced7851 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:02.360150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef1a1009-3437-4e9c-bbf9-cc7e8ced7851 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:02.361287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef1a1009-3437-4e9c-bbf9-cc7e8ced7851 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:02.361728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef1a1009-3437-4e9c-bbf9-cc7e8ced7851 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:02.400019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-28abb3bc-b7cc-4433-a11c-f680e02f98c4 req-92356232-a17f-4143-99ce-580fd8ae2f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2172c139-992f-4b5d-97b3-f2e549f6fe29", "tag": "7de63336-a99f-4d68-b447-f1e9fada4204"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:02.417134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-28abb3bc-b7cc-4433-a11c-f680e02f98c4 req-92356232-a17f-4143-99ce-580fd8ae2f58 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:02.422702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-28abb3bc-b7cc-4433-a11c-f680e02f98c4 req-92356232-a17f-4143-99ce-580fd8ae2f58 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:02.422702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-28abb3bc-b7cc-4433-a11c-f680e02f98c4 req-92356232-a17f-4143-99ce-580fd8ae2f58 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:02.432858 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-28abb3bc-b7cc-4433-a11c-f680e02f98c4 req-92356232-a17f-4143-99ce-580fd8ae2f58 service nova] Creating event network-changed:7de63336-a99f-4d68-b447-f1e9fada4204 for instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 on n-h1-862964-3 Oct 29 01:23:02.439496 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-28abb3bc-b7cc-4433-a11c-f680e02f98c4 req-92356232-a17f-4143-99ce-580fd8ae2f58 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044635 Oct 29 01:23:02.440398 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2142/4456] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:23:02.736886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5127980b-61c3-4b56-b52b-a65670723696 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:02.737555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5127980b-61c3-4b56-b52b-a65670723696 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:02.740858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ef1a1009-3437-4e9c-bbf9-cc7e8ced7851 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:02.748172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5127980b-61c3-4b56-b52b-a65670723696 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:02.748666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5127980b-61c3-4b56-b52b-a65670723696 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:02.754593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5127980b-61c3-4b56-b52b-a65670723696 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:02.755665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5127980b-61c3-4b56-b52b-a65670723696 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:02.760512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5127980b-61c3-4b56-b52b-a65670723696 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:02.760652 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ef1a1009-3437-4e9c-bbf9-cc7e8ced7851 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 200 len: 1362 microversion: 2.1 time: 0.409461 Oct 29 01:23:02.760753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5127980b-61c3-4b56-b52b-a65670723696 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:02.760844 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2315/4457] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:02 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 1362 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:02.950941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-77827bd2-9d20-47b9-adc0-d7b2edcf53f0 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:02.952113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-77827bd2-9d20-47b9-adc0-d7b2edcf53f0 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:02.965353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77827bd2-9d20-47b9-adc0-d7b2edcf53f0 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:02.965850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77827bd2-9d20-47b9-adc0-d7b2edcf53f0 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:02.966552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77827bd2-9d20-47b9-adc0-d7b2edcf53f0 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:02.967460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77827bd2-9d20-47b9-adc0-d7b2edcf53f0 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:02.968081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77827bd2-9d20-47b9-adc0-d7b2edcf53f0 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:02.968887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77827bd2-9d20-47b9-adc0-d7b2edcf53f0 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:03.184417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-77827bd2-9d20-47b9-adc0-d7b2edcf53f0 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:03.194400 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-77827bd2-9d20-47b9-adc0-d7b2edcf53f0 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1285 microversion: 2.1 time: 0.247797 Oct 29 01:23:03.197826 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2316/4458] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:02 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1285 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:03.264595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fecce63c-f97c-43d7-af99-c2e1788a11e5 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:03.265591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fecce63c-f97c-43d7-af99-c2e1788a11e5 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:03.278546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fecce63c-f97c-43d7-af99-c2e1788a11e5 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:03.279522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fecce63c-f97c-43d7-af99-c2e1788a11e5 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:03.280197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fecce63c-f97c-43d7-af99-c2e1788a11e5 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:03.285403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fecce63c-f97c-43d7-af99-c2e1788a11e5 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:03.285403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fecce63c-f97c-43d7-af99-c2e1788a11e5 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:03.285403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fecce63c-f97c-43d7-af99-c2e1788a11e5 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:03.428507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5127980b-61c3-4b56-b52b-a65670723696 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:03.448962 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5127980b-61c3-4b56-b52b-a65670723696 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1509 microversion: 2.1 time: 0.714987 Oct 29 01:23:03.451102 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2143/4459] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:02 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1509 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:03.781924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c91d74f0-9d3a-42f7-b252-4a669b2ed3b1 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:03.783824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c91d74f0-9d3a-42f7-b252-4a669b2ed3b1 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:03.793956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c91d74f0-9d3a-42f7-b252-4a669b2ed3b1 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:03.794636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c91d74f0-9d3a-42f7-b252-4a669b2ed3b1 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:03.795182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c91d74f0-9d3a-42f7-b252-4a669b2ed3b1 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:03.796306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c91d74f0-9d3a-42f7-b252-4a669b2ed3b1 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:03.797026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c91d74f0-9d3a-42f7-b252-4a669b2ed3b1 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:03.797693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c91d74f0-9d3a-42f7-b252-4a669b2ed3b1 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:04.099133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:04.167980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fecce63c-f97c-43d7-af99-c2e1788a11e5 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:04.177925 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fecce63c-f97c-43d7-af99-c2e1788a11e5 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.917730 Oct 29 01:23:04.179362 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2317/4460] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:03 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:04.226367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-78e6669d-34ff-4ef5-b776-390e3a2ba67c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:04.227185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-78e6669d-34ff-4ef5-b776-390e3a2ba67c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:04.235231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78e6669d-34ff-4ef5-b776-390e3a2ba67c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:04.235231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78e6669d-34ff-4ef5-b776-390e3a2ba67c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:04.235433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c91d74f0-9d3a-42f7-b252-4a669b2ed3b1 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:04.235522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78e6669d-34ff-4ef5-b776-390e3a2ba67c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:04.235522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78e6669d-34ff-4ef5-b776-390e3a2ba67c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:04.236688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78e6669d-34ff-4ef5-b776-390e3a2ba67c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:04.237444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78e6669d-34ff-4ef5-b776-390e3a2ba67c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:04.248646 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c91d74f0-9d3a-42f7-b252-4a669b2ed3b1 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 200 len: 1362 microversion: 2.1 time: 0.472327 Oct 29 01:23:04.249275 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2144/4461] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:03 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 1362 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:04.491701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a43de227-4111-446e-be94-e66756d99dd2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:04.493715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a43de227-4111-446e-be94-e66756d99dd2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:04.502349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a43de227-4111-446e-be94-e66756d99dd2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:04.503027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a43de227-4111-446e-be94-e66756d99dd2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:04.504939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a43de227-4111-446e-be94-e66756d99dd2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:04.505907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a43de227-4111-446e-be94-e66756d99dd2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:04.506515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a43de227-4111-446e-be94-e66756d99dd2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:04.507088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a43de227-4111-446e-be94-e66756d99dd2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:04.633717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-78e6669d-34ff-4ef5-b776-390e3a2ba67c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:04.646388 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-78e6669d-34ff-4ef5-b776-390e3a2ba67c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1327 microversion: 2.1 time: 0.424344 Oct 29 01:23:04.646388 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2318/4462] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:04 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1327 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:04.651943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-f7f4a45c-ae83-4183-901f-6177e4ddf5e8 req-213c1b88-344c-41b5-856c-9f22aa85a0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63371d26-fe85-4cfa-bdca-c8ad84b81ee6", "name": "network-vif-unplugged", "status": "completed", "tag": "f93b16c7-df1a-462b-be91-442aa008d850"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:04.663256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f7f4a45c-ae83-4183-901f-6177e4ddf5e8 req-213c1b88-344c-41b5-856c-9f22aa85a0c6 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:04.663941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f7f4a45c-ae83-4183-901f-6177e4ddf5e8 req-213c1b88-344c-41b5-856c-9f22aa85a0c6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:04.664571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f7f4a45c-ae83-4183-901f-6177e4ddf5e8 req-213c1b88-344c-41b5-856c-9f22aa85a0c6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:04.676870 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-f7f4a45c-ae83-4183-901f-6177e4ddf5e8 req-213c1b88-344c-41b5-856c-9f22aa85a0c6 service nova] Creating event network-vif-unplugged:f93b16c7-df1a-462b-be91-442aa008d850 for instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 on n-h2-862964-3 Oct 29 01:23:04.682343 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-f7f4a45c-ae83-4183-901f-6177e4ddf5e8 req-213c1b88-344c-41b5-856c-9f22aa85a0c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036146 Oct 29 01:23:04.683139 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2319/4463] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:04.790374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a43de227-4111-446e-be94-e66756d99dd2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:04.799678 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a43de227-4111-446e-be94-e66756d99dd2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1512 microversion: 2.1 time: 0.323201 Oct 29 01:23:04.800869 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2145/4464] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:04 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1512 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:04.826246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-86892bc2-1ff4-4fd0-ad5b-b03022ae6a3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:04.826946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-86892bc2-1ff4-4fd0-ad5b-b03022ae6a3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:04.833501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86892bc2-1ff4-4fd0-ad5b-b03022ae6a3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:04.833986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86892bc2-1ff4-4fd0-ad5b-b03022ae6a3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:04.834428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86892bc2-1ff4-4fd0-ad5b-b03022ae6a3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:04.835307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86892bc2-1ff4-4fd0-ad5b-b03022ae6a3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:04.835720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86892bc2-1ff4-4fd0-ad5b-b03022ae6a3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:04.836150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86892bc2-1ff4-4fd0-ad5b-b03022ae6a3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:05.090894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-86892bc2-1ff4-4fd0-ad5b-b03022ae6a3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:05.099424 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-86892bc2-1ff4-4fd0-ad5b-b03022ae6a3d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1512 microversion: 2.1 time: 0.277854 Oct 29 01:23:05.100088 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2320/4465] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:04 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1512 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:05.178839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-56f88887-4fc3-44ca-a5dc-4dfbad8c5253 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:05.179714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-56f88887-4fc3-44ca-a5dc-4dfbad8c5253 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:05.186511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56f88887-4fc3-44ca-a5dc-4dfbad8c5253 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:05.187269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56f88887-4fc3-44ca-a5dc-4dfbad8c5253 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:05.187861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56f88887-4fc3-44ca-a5dc-4dfbad8c5253 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:05.188847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56f88887-4fc3-44ca-a5dc-4dfbad8c5253 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:05.189483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56f88887-4fc3-44ca-a5dc-4dfbad8c5253 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:05.190112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56f88887-4fc3-44ca-a5dc-4dfbad8c5253 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:05.209874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-39ec7cf2-d9d4-4667-b299-f6b5a107f370 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:05.210726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-39ec7cf2-d9d4-4667-b299-f6b5a107f370 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:05.222718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39ec7cf2-d9d4-4667-b299-f6b5a107f370 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:05.226788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39ec7cf2-d9d4-4667-b299-f6b5a107f370 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:05.226788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39ec7cf2-d9d4-4667-b299-f6b5a107f370 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:05.226788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39ec7cf2-d9d4-4667-b299-f6b5a107f370 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:05.226788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39ec7cf2-d9d4-4667-b299-f6b5a107f370 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:05.226788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39ec7cf2-d9d4-4667-b299-f6b5a107f370 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:05.236955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-56f88887-4fc3-44ca-a5dc-4dfbad8c5253 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lazy-loading 'flavor' on Instance uuid 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:23:05.251459 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-56f88887-4fc3-44ca-a5dc-4dfbad8c5253 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Cannot 'shelve' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state shelved_offloaded Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-56f88887-4fc3-44ca-a5dc-4dfbad8c5253 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action HTTP/1.1 Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 14 Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: {"shelve": {}} Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: exception: Cannot 'shelve' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state shelved_offloaded Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '63371d26-fe85-4cfa-bdca-c8ad84b81ee6', 'body': {'shelve': {}}} Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 01:23:05.254945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 01:23:05.259446 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state shelved_offloaded Oct 29 01:23:05.259446 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:05.259446 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:05.259446 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:05.259446 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:05.259446 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:05.259446 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:05.259446 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:23:05.259446 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:23:05.259446 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state shelved_offloaded Oct 29 01:23:05.259446 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:05.270802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-56f88887-4fc3-44ca-a5dc-4dfbad8c5253 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 409 to user: Cannot 'shelve' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state shelved_offloaded {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:23:05.274972 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-56f88887-4fc3-44ca-a5dc-4dfbad8c5253 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action" status: 409 len: 155 microversion: 2.1 time: 0.099649 Oct 29 01:23:05.277294 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2146/4466] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:23:05 2022] POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action => generated 155 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:23:05.282548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-20310812-975b-457f-8ade-b7ce51054edd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:05.283240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-20310812-975b-457f-8ade-b7ce51054edd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:05.291239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20310812-975b-457f-8ade-b7ce51054edd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:05.293588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20310812-975b-457f-8ade-b7ce51054edd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:05.294271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20310812-975b-457f-8ade-b7ce51054edd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:05.298023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20310812-975b-457f-8ade-b7ce51054edd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:05.298023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20310812-975b-457f-8ade-b7ce51054edd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:05.298023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20310812-975b-457f-8ade-b7ce51054edd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:05.348729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-20310812-975b-457f-8ade-b7ce51054edd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121100) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 01:23:05.478407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-39ec7cf2-d9d4-4667-b299-f6b5a107f370 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:05.487469 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-39ec7cf2-d9d4-4667-b299-f6b5a107f370 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.288287 Oct 29 01:23:05.489301 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2321/4467] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:05 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:05.494555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0cd133f8-42b7-4e0d-a985-022b53a7c5fd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:05.495595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0cd133f8-42b7-4e0d-a985-022b53a7c5fd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:05.502601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cd133f8-42b7-4e0d-a985-022b53a7c5fd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:05.503868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cd133f8-42b7-4e0d-a985-022b53a7c5fd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:05.504762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cd133f8-42b7-4e0d-a985-022b53a7c5fd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:05.506043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cd133f8-42b7-4e0d-a985-022b53a7c5fd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:05.506825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cd133f8-42b7-4e0d-a985-022b53a7c5fd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:05.507646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cd133f8-42b7-4e0d-a985-022b53a7c5fd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:05.508260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:05.648115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0cd133f8-42b7-4e0d-a985-022b53a7c5fd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:05.655892 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0cd133f8-42b7-4e0d-a985-022b53a7c5fd tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 200 len: 1362 microversion: 2.1 time: 0.165282 Oct 29 01:23:05.656456 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2322/4468] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:05 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:05.662582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-dc2abb72-53e8-4329-af52-c555121efc37 req-1cc97942-02f2-48d6-a1c2-fae3cd3802a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e138bf76-1216-4eef-9943-83f6a52f8425", "tag": "559292a4-68cb-4d70-97c2-ff3fffde0e41"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:05.672039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-dc2abb72-53e8-4329-af52-c555121efc37 req-1cc97942-02f2-48d6-a1c2-fae3cd3802a6 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:05.672583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-dc2abb72-53e8-4329-af52-c555121efc37 req-1cc97942-02f2-48d6-a1c2-fae3cd3802a6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:05.673060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-dc2abb72-53e8-4329-af52-c555121efc37 req-1cc97942-02f2-48d6-a1c2-fae3cd3802a6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:05.678079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:05.685491 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-dc2abb72-53e8-4329-af52-c555121efc37 req-1cc97942-02f2-48d6-a1c2-fae3cd3802a6 service nova] Creating event network-changed:559292a4-68cb-4d70-97c2-ff3fffde0e41 for instance e138bf76-1216-4eef-9943-83f6a52f8425 on n-h1-862964-3 Oct 29 01:23:05.691721 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-dc2abb72-53e8-4329-af52-c555121efc37 req-1cc97942-02f2-48d6-a1c2-fae3cd3802a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033397 Oct 29 01:23:05.692335 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2323/4469] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:05.697925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8c7aebae-02fc-4bc4-998e-8158bd6575ff tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:05.701711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8c7aebae-02fc-4bc4-998e-8158bd6575ff tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:05.701711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:05.705742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c7aebae-02fc-4bc4-998e-8158bd6575ff tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:05.706250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c7aebae-02fc-4bc4-998e-8158bd6575ff tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:05.707859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c7aebae-02fc-4bc4-998e-8158bd6575ff tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:05.708914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c7aebae-02fc-4bc4-998e-8158bd6575ff tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:05.709394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c7aebae-02fc-4bc4-998e-8158bd6575ff tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:05.709818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c7aebae-02fc-4bc4-998e-8158bd6575ff tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:05.726767 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-20310812-975b-457f-8ade-b7ce51054edd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action" status: 202 len: 0 microversion: 2.1 time: 0.448155 Oct 29 01:23:05.730599 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2147/4470] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:23:05 2022] POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:23:05.736259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aa364f89-a4d0-4be1-8fe4-ca0bbc49e23e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:05.737007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aa364f89-a4d0-4be1-8fe4-ca0bbc49e23e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:05.748136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa364f89-a4d0-4be1-8fe4-ca0bbc49e23e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:05.748653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa364f89-a4d0-4be1-8fe4-ca0bbc49e23e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:05.749106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa364f89-a4d0-4be1-8fe4-ca0bbc49e23e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:05.754246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa364f89-a4d0-4be1-8fe4-ca0bbc49e23e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:05.754246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa364f89-a4d0-4be1-8fe4-ca0bbc49e23e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:05.754246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa364f89-a4d0-4be1-8fe4-ca0bbc49e23e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:05.945960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8c7aebae-02fc-4bc4-998e-8158bd6575ff tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:05.953561 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8c7aebae-02fc-4bc4-998e-8158bd6575ff tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1327 microversion: 2.1 time: 0.259696 Oct 29 01:23:05.954138 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2324/4471] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:05 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1327 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:05.958221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aa364f89-a4d0-4be1-8fe4-ca0bbc49e23e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:05.966871 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aa364f89-a4d0-4be1-8fe4-ca0bbc49e23e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1460 microversion: 2.1 time: 0.234648 Oct 29 01:23:05.967641 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2148/4472] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:05 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1460 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:06.015639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2c63e188-1f2e-492e-9fbc-8dd996efed10 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d969eed30>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:06.058806 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2c63e188-1f2e-492e-9fbc-8dd996efed10 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/fa160d85-3663-46ee-870c-9e4bafc02bc6" status: 200 len: 662 microversion: 2.1 time: 0.046942 Oct 29 01:23:06.059392 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2325/4473] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:23:06 2022] GET /compute/v2.1/images/fa160d85-3663-46ee-870c-9e4bafc02bc6 => generated 662 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:06.074431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e6f94d50-de9f-402e-bbab-dc00566a98c9 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97f46f70>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:06.122489 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e6f94d50-de9f-402e-bbab-dc00566a98c9 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/fa160d85-3663-46ee-870c-9e4bafc02bc6" status: 200 len: 662 microversion: 2.1 time: 0.051706 Oct 29 01:23:06.123095 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2149/4474] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:23:06 2022] GET /compute/v2.1/images/fa160d85-3663-46ee-870c-9e4bafc02bc6 => generated 662 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:06.513096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0f3f6d03-874d-4abf-9ab9-0332ad94da73 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:06.514313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0f3f6d03-874d-4abf-9ab9-0332ad94da73 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:06.524306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f3f6d03-874d-4abf-9ab9-0332ad94da73 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:06.524802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f3f6d03-874d-4abf-9ab9-0332ad94da73 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:06.525309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f3f6d03-874d-4abf-9ab9-0332ad94da73 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:06.526027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f3f6d03-874d-4abf-9ab9-0332ad94da73 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:06.526484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f3f6d03-874d-4abf-9ab9-0332ad94da73 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:06.527084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f3f6d03-874d-4abf-9ab9-0332ad94da73 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:06.669347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0f3f6d03-874d-4abf-9ab9-0332ad94da73 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:06.678903 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0f3f6d03-874d-4abf-9ab9-0332ad94da73 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.170460 Oct 29 01:23:06.679564 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2326/4475] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:06 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:06.683445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1b59a2c1-4a20-4734-834f-e212c82d66b0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:06.684296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1b59a2c1-4a20-4734-834f-e212c82d66b0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:06.692595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b59a2c1-4a20-4734-834f-e212c82d66b0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:06.693542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b59a2c1-4a20-4734-834f-e212c82d66b0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:06.694160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b59a2c1-4a20-4734-834f-e212c82d66b0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:06.695518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b59a2c1-4a20-4734-834f-e212c82d66b0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:06.696236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b59a2c1-4a20-4734-834f-e212c82d66b0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:06.696876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b59a2c1-4a20-4734-834f-e212c82d66b0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:06.845387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1b59a2c1-4a20-4734-834f-e212c82d66b0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:06.855372 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1b59a2c1-4a20-4734-834f-e212c82d66b0 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 200 len: 1362 microversion: 2.1 time: 0.178178 Oct 29 01:23:06.856485 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2150/4476] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:06 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:06.980481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7c30316a-8d88-4d8f-a8f7-4d54da1f59c9 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:06.981283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7c30316a-8d88-4d8f-a8f7-4d54da1f59c9 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:06.989503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-83a14de7-2d59-4d55-8c56-46c0e7b93781 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:06.990016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c30316a-8d88-4d8f-a8f7-4d54da1f59c9 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:06.990508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c30316a-8d88-4d8f-a8f7-4d54da1f59c9 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:06.990843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-83a14de7-2d59-4d55-8c56-46c0e7b93781 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:06.991013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c30316a-8d88-4d8f-a8f7-4d54da1f59c9 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:06.994872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c30316a-8d88-4d8f-a8f7-4d54da1f59c9 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:06.994872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c30316a-8d88-4d8f-a8f7-4d54da1f59c9 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:06.994872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c30316a-8d88-4d8f-a8f7-4d54da1f59c9 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:06.997946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a14de7-2d59-4d55-8c56-46c0e7b93781 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:06.998441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a14de7-2d59-4d55-8c56-46c0e7b93781 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:06.998889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a14de7-2d59-4d55-8c56-46c0e7b93781 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:06.999602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a14de7-2d59-4d55-8c56-46c0e7b93781 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:07.000098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a14de7-2d59-4d55-8c56-46c0e7b93781 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:07.000530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a14de7-2d59-4d55-8c56-46c0e7b93781 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:07.302227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-83a14de7-2d59-4d55-8c56-46c0e7b93781 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:07.303027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7c30316a-8d88-4d8f-a8f7-4d54da1f59c9 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:07.314157 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-83a14de7-2d59-4d55-8c56-46c0e7b93781 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1460 microversion: 2.1 time: 0.328769 Oct 29 01:23:07.314997 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2151/4477] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:06 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1460 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:07.324230 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7c30316a-8d88-4d8f-a8f7-4d54da1f59c9 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1327 microversion: 2.1 time: 0.348814 Oct 29 01:23:07.324995 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2327/4478] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:06 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1327 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:07.705580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f95391e6-0379-4fbe-abb0-80b99df9042b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:07.706378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f95391e6-0379-4fbe-abb0-80b99df9042b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:07.719259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f95391e6-0379-4fbe-abb0-80b99df9042b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:07.719827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f95391e6-0379-4fbe-abb0-80b99df9042b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:07.721372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f95391e6-0379-4fbe-abb0-80b99df9042b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:07.725267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f95391e6-0379-4fbe-abb0-80b99df9042b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:07.725935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f95391e6-0379-4fbe-abb0-80b99df9042b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:07.726248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f95391e6-0379-4fbe-abb0-80b99df9042b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:07.757099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:07.842753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0784bd45-d11b-4819-9279-86f30d6c0fa5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:07.843463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0784bd45-d11b-4819-9279-86f30d6c0fa5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:07.851188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0784bd45-d11b-4819-9279-86f30d6c0fa5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:07.851706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0784bd45-d11b-4819-9279-86f30d6c0fa5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:07.852155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0784bd45-d11b-4819-9279-86f30d6c0fa5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:07.852869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0784bd45-d11b-4819-9279-86f30d6c0fa5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:07.853360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0784bd45-d11b-4819-9279-86f30d6c0fa5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:07.853794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0784bd45-d11b-4819-9279-86f30d6c0fa5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:08.010012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f95391e6-0379-4fbe-abb0-80b99df9042b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:08.021026 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f95391e6-0379-4fbe-abb0-80b99df9042b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.321734 Oct 29 01:23:08.031211 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2152/4479] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:07 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:08.037863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c05ad8ff-b891-4ab7-9473-df55f3305e3b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:08.038502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c05ad8ff-b891-4ab7-9473-df55f3305e3b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:08.044963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c05ad8ff-b891-4ab7-9473-df55f3305e3b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:08.045823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c05ad8ff-b891-4ab7-9473-df55f3305e3b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:08.046328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c05ad8ff-b891-4ab7-9473-df55f3305e3b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:08.047055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c05ad8ff-b891-4ab7-9473-df55f3305e3b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:08.047513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c05ad8ff-b891-4ab7-9473-df55f3305e3b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:08.047938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c05ad8ff-b891-4ab7-9473-df55f3305e3b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:08.104589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0784bd45-d11b-4819-9279-86f30d6c0fa5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:08.115805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0784bd45-d11b-4819-9279-86f30d6c0fa5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:08.117398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0784bd45-d11b-4819-9279-86f30d6c0fa5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:08.118764 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0784bd45-d11b-4819-9279-86f30d6c0fa5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 2950 microversion: 2.32 time: 0.280092 Oct 29 01:23:08.119439 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2328/4480] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:23:07 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 2950 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:23:08.147120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-476f806d-5920-4a65-befd-db3ad3cd6d1f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:08.147623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-476f806d-5920-4a65-befd-db3ad3cd6d1f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:08.153789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-476f806d-5920-4a65-befd-db3ad3cd6d1f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:08.154386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-476f806d-5920-4a65-befd-db3ad3cd6d1f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:08.154940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-476f806d-5920-4a65-befd-db3ad3cd6d1f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:08.155693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-476f806d-5920-4a65-befd-db3ad3cd6d1f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:08.156311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-476f806d-5920-4a65-befd-db3ad3cd6d1f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:08.157481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-476f806d-5920-4a65-befd-db3ad3cd6d1f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:08.203984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c05ad8ff-b891-4ab7-9473-df55f3305e3b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:08.213603 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c05ad8ff-b891-4ab7-9473-df55f3305e3b tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 200 len: 1362 microversion: 2.1 time: 0.180850 Oct 29 01:23:08.224942 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2153/4481] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:08 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:08.311677 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-476f806d-5920-4a65-befd-db3ad3cd6d1f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.169237 Oct 29 01:23:08.314582 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2329/4482] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Oct 29 01:23:08 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9/os-interface => generated 1830 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:23:08.339467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7c6d06ae-cdb8-4d60-8094-9f9e9d4d25d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:08.340141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7c6d06ae-cdb8-4d60-8094-9f9e9d4d25d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:08.346672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c6d06ae-cdb8-4d60-8094-9f9e9d4d25d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:08.347714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c6d06ae-cdb8-4d60-8094-9f9e9d4d25d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:08.348153 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c6d06ae-cdb8-4d60-8094-9f9e9d4d25d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:08.348399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aaeab745-8bbf-4745-b13d-a151306d7734 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:08.348859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c6d06ae-cdb8-4d60-8094-9f9e9d4d25d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:08.349019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-aaeab745-8bbf-4745-b13d-a151306d7734 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:08.349350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c6d06ae-cdb8-4d60-8094-9f9e9d4d25d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:08.349785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c6d06ae-cdb8-4d60-8094-9f9e9d4d25d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:08.360601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaeab745-8bbf-4745-b13d-a151306d7734 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:08.360601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaeab745-8bbf-4745-b13d-a151306d7734 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:08.360601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaeab745-8bbf-4745-b13d-a151306d7734 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:08.360601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaeab745-8bbf-4745-b13d-a151306d7734 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:08.360601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaeab745-8bbf-4745-b13d-a151306d7734 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:08.360601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaeab745-8bbf-4745-b13d-a151306d7734 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:08.385292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=10 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:08.955490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7c6d06ae-cdb8-4d60-8094-9f9e9d4d25d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:08.956402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-aaeab745-8bbf-4745-b13d-a151306d7734 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:08.961114 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7c6d06ae-cdb8-4d60-8094-9f9e9d4d25d7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.625989 Oct 29 01:23:08.964109 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aaeab745-8bbf-4745-b13d-a151306d7734 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1327 microversion: 2.1 time: 0.620145 Oct 29 01:23:08.964758 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2330/4483] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:08 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1327 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:08.965793 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2154/4484] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:08 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:08.970458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9d2b0f8b-b22f-43f9-b12b-5757b04634ba tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d969fcc10>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:09.027586 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9d2b0f8b-b22f-43f9-b12b-5757b04634ba tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/4ffe4e91-2e2e-41b9-b305-91655e674d65" status: 200 len: 661 microversion: 2.1 time: 0.060370 Oct 29 01:23:09.028609 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2331/4485] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:23:08 2022] GET /compute/v2.1/images/4ffe4e91-2e2e-41b9-b305-91655e674d65 => generated 661 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:09.044294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ae409ed4-8dd6-4787-af0d-3749c8edbdf4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96a98f70>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:09.044529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-525d1265-5430-4f82-9af4-f89aacc3ea8d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:09.045137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-525d1265-5430-4f82-9af4-f89aacc3ea8d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:09.053225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-525d1265-5430-4f82-9af4-f89aacc3ea8d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:09.053777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-525d1265-5430-4f82-9af4-f89aacc3ea8d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:09.054135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-525d1265-5430-4f82-9af4-f89aacc3ea8d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:09.055020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-525d1265-5430-4f82-9af4-f89aacc3ea8d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:09.055505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-525d1265-5430-4f82-9af4-f89aacc3ea8d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:09.055929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-525d1265-5430-4f82-9af4-f89aacc3ea8d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:09.095014 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ae409ed4-8dd6-4787-af0d-3749c8edbdf4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/4ffe4e91-2e2e-41b9-b305-91655e674d65" status: 200 len: 661 microversion: 2.1 time: 0.054840 Oct 29 01:23:09.095723 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2332/4486] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:23:09 2022] GET /compute/v2.1/images/4ffe4e91-2e2e-41b9-b305-91655e674d65 => generated 661 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:09.229928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-525d1265-5430-4f82-9af4-f89aacc3ea8d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:09.242139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1694552f-7b38-478f-9411-769a1db75437 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:09.243006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1694552f-7b38-478f-9411-769a1db75437 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:09.255578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1694552f-7b38-478f-9411-769a1db75437 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:09.255578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1694552f-7b38-478f-9411-769a1db75437 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:09.255578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1694552f-7b38-478f-9411-769a1db75437 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:09.255578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1694552f-7b38-478f-9411-769a1db75437 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:09.255578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1694552f-7b38-478f-9411-769a1db75437 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:09.255578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1694552f-7b38-478f-9411-769a1db75437 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:09.263954 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-525d1265-5430-4f82-9af4-f89aacc3ea8d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.223645 Oct 29 01:23:09.264560 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2155/4487] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:09 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:09.443308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1694552f-7b38-478f-9411-769a1db75437 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:09.461992 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1694552f-7b38-478f-9411-769a1db75437 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 200 len: 1362 microversion: 2.1 time: 0.225666 Oct 29 01:23:09.469984 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2333/4488] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:09 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:09.986641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ac7c0c1c-eeed-4444-9dd3-e7f308a30ac5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:09.987375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ac7c0c1c-eeed-4444-9dd3-e7f308a30ac5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:09.990620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-af5b3aeb-e86e-4183-85e4-18a30fb8688c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:09.992086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-af5b3aeb-e86e-4183-85e4-18a30fb8688c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:09.995561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=12 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:09.996041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac7c0c1c-eeed-4444-9dd3-e7f308a30ac5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:09.996727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac7c0c1c-eeed-4444-9dd3-e7f308a30ac5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:09.997991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac7c0c1c-eeed-4444-9dd3-e7f308a30ac5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:09.999164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac7c0c1c-eeed-4444-9dd3-e7f308a30ac5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:09.999813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac7c0c1c-eeed-4444-9dd3-e7f308a30ac5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:10.000438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac7c0c1c-eeed-4444-9dd3-e7f308a30ac5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:10.014590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af5b3aeb-e86e-4183-85e4-18a30fb8688c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:10.015174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af5b3aeb-e86e-4183-85e4-18a30fb8688c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:10.018093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af5b3aeb-e86e-4183-85e4-18a30fb8688c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:10.021495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af5b3aeb-e86e-4183-85e4-18a30fb8688c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:10.022013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af5b3aeb-e86e-4183-85e4-18a30fb8688c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:10.030900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af5b3aeb-e86e-4183-85e4-18a30fb8688c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:10.251914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-af5b3aeb-e86e-4183-85e4-18a30fb8688c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:10.257949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ac7c0c1c-eeed-4444-9dd3-e7f308a30ac5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:10.261847 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-af5b3aeb-e86e-4183-85e4-18a30fb8688c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1327 microversion: 2.1 time: 0.276533 Oct 29 01:23:10.262634 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2334/4489] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:09 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1327 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:10.271235 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ac7c0c1c-eeed-4444-9dd3-e7f308a30ac5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.286185 Oct 29 01:23:10.272531 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2156/4490] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:09 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:10.287475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0afd9248-7f1c-4709-af1b-3f729efdfea0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:10.288481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0afd9248-7f1c-4709-af1b-3f729efdfea0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:10.298372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0afd9248-7f1c-4709-af1b-3f729efdfea0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:10.298870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0afd9248-7f1c-4709-af1b-3f729efdfea0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:10.299561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0afd9248-7f1c-4709-af1b-3f729efdfea0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:10.301587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0afd9248-7f1c-4709-af1b-3f729efdfea0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:10.301587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0afd9248-7f1c-4709-af1b-3f729efdfea0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:10.301587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0afd9248-7f1c-4709-af1b-3f729efdfea0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:10.489483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e33c3114-e134-4155-ab97-62b93ffe8cd6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:10.491405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e33c3114-e134-4155-ab97-62b93ffe8cd6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:10.501459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e33c3114-e134-4155-ab97-62b93ffe8cd6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:10.502773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e33c3114-e134-4155-ab97-62b93ffe8cd6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:10.504170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e33c3114-e134-4155-ab97-62b93ffe8cd6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:10.505267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e33c3114-e134-4155-ab97-62b93ffe8cd6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:10.505939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e33c3114-e134-4155-ab97-62b93ffe8cd6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:10.508947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e33c3114-e134-4155-ab97-62b93ffe8cd6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:10.671524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0afd9248-7f1c-4709-af1b-3f729efdfea0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:10.693207 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0afd9248-7f1c-4709-af1b-3f729efdfea0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.409590 Oct 29 01:23:10.720846 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2335/4491] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:10 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:10.786738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-d48cbe22-196a-4f61-8066-98d31e63db9d req-50106e91-ee68-442a-8d79-27bf7a7db825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2172c139-992f-4b5d-97b3-f2e549f6fe29", "name": "network-vif-plugged", "status": "completed", "tag": "7de63336-a99f-4d68-b447-f1e9fada4204"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:10.812269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d48cbe22-196a-4f61-8066-98d31e63db9d req-50106e91-ee68-442a-8d79-27bf7a7db825 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:10.813609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d48cbe22-196a-4f61-8066-98d31e63db9d req-50106e91-ee68-442a-8d79-27bf7a7db825 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:10.816395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d48cbe22-196a-4f61-8066-98d31e63db9d req-50106e91-ee68-442a-8d79-27bf7a7db825 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:10.837502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e33c3114-e134-4155-ab97-62b93ffe8cd6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:10.849387 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e33c3114-e134-4155-ab97-62b93ffe8cd6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 200 len: 1362 microversion: 2.1 time: 0.364982 Oct 29 01:23:10.849983 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2157/4492] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:10 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 1362 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:10.853329 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-d48cbe22-196a-4f61-8066-98d31e63db9d req-50106e91-ee68-442a-8d79-27bf7a7db825 service nova] Creating event network-vif-plugged:7de63336-a99f-4d68-b447-f1e9fada4204 for instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 on n-h1-862964-3 Oct 29 01:23:10.865199 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-d48cbe22-196a-4f61-8066-98d31e63db9d req-50106e91-ee68-442a-8d79-27bf7a7db825 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086077 Oct 29 01:23:10.866491 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2336/4493] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:11.286662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-035289c7-bacf-4684-b339-93971db41c2c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:11.287418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-035289c7-bacf-4684-b339-93971db41c2c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:11.303097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-502b02b6-fcf7-4394-9e58-c8259752ee4b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:11.303811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-502b02b6-fcf7-4394-9e58-c8259752ee4b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:11.310651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-035289c7-bacf-4684-b339-93971db41c2c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:11.312376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-035289c7-bacf-4684-b339-93971db41c2c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:11.313384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-035289c7-bacf-4684-b339-93971db41c2c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:11.316283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-035289c7-bacf-4684-b339-93971db41c2c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:11.317897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-035289c7-bacf-4684-b339-93971db41c2c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:11.320156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-502b02b6-fcf7-4394-9e58-c8259752ee4b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:11.320156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-502b02b6-fcf7-4394-9e58-c8259752ee4b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:11.320533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-502b02b6-fcf7-4394-9e58-c8259752ee4b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:11.321515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-035289c7-bacf-4684-b339-93971db41c2c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:11.324266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-502b02b6-fcf7-4394-9e58-c8259752ee4b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:11.326592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-502b02b6-fcf7-4394-9e58-c8259752ee4b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:11.327307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-502b02b6-fcf7-4394-9e58-c8259752ee4b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:11.671469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-035289c7-bacf-4684-b339-93971db41c2c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:11.680485 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-035289c7-bacf-4684-b339-93971db41c2c tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1327 microversion: 2.1 time: 0.398196 Oct 29 01:23:11.697720 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2158/4494] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:11 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1327 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:11.703074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3be8d633-91db-4068-8d73-7086554acfb0 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9c042b80>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:11.712467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-502b02b6-fcf7-4394-9e58-c8259752ee4b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:11.726023 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-502b02b6-fcf7-4394-9e58-c8259752ee4b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.430661 Oct 29 01:23:11.727723 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2337/4495] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:11 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:11.735605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1b28e8e2-88e7-40f2-a074-65de42814f30 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:11.736718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1b28e8e2-88e7-40f2-a074-65de42814f30 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:11.746377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b28e8e2-88e7-40f2-a074-65de42814f30 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:11.747234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b28e8e2-88e7-40f2-a074-65de42814f30 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:11.748004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b28e8e2-88e7-40f2-a074-65de42814f30 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:11.750154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b28e8e2-88e7-40f2-a074-65de42814f30 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:11.751659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b28e8e2-88e7-40f2-a074-65de42814f30 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:11.752921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b28e8e2-88e7-40f2-a074-65de42814f30 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:11.770086 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3be8d633-91db-4068-8d73-7086554acfb0 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/6744085f-4562-48ff-815f-1f4c8cdd25e6" status: 200 len: 661 microversion: 2.1 time: 0.070335 Oct 29 01:23:11.780198 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2159/4496] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:23:11 2022] GET /compute/v2.1/images/6744085f-4562-48ff-815f-1f4c8cdd25e6 => generated 661 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:11.787095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d540c24c-9db6-44ac-aced-59d53fc21748 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97f0eb80>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:11.839325 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d540c24c-9db6-44ac-aced-59d53fc21748 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/6744085f-4562-48ff-815f-1f4c8cdd25e6" status: 200 len: 661 microversion: 2.1 time: 0.057679 Oct 29 01:23:11.840587 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2160/4497] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:23:11 2022] GET /compute/v2.1/images/6744085f-4562-48ff-815f-1f4c8cdd25e6 => generated 661 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:11.878871 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2def9f4b-431b-4642-bfea-8dce97579d19 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:11.880749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2def9f4b-431b-4642-bfea-8dce97579d19 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:11.888557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2def9f4b-431b-4642-bfea-8dce97579d19 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:11.890078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2def9f4b-431b-4642-bfea-8dce97579d19 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:11.891960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2def9f4b-431b-4642-bfea-8dce97579d19 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:11.893368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2def9f4b-431b-4642-bfea-8dce97579d19 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:11.895184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2def9f4b-431b-4642-bfea-8dce97579d19 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:11.896020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2def9f4b-431b-4642-bfea-8dce97579d19 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:12.100716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1b28e8e2-88e7-40f2-a074-65de42814f30 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:12.109483 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1b28e8e2-88e7-40f2-a074-65de42814f30 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.380217 Oct 29 01:23:12.110042 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2338/4498] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:11 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:12.123615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5ec587a7-440e-47d3-ad1a-799f9b28ef6f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-844085176", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:12.166756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2def9f4b-431b-4642-bfea-8dce97579d19 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:12.177520 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2def9f4b-431b-4642-bfea-8dce97579d19 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 200 len: 1362 microversion: 2.1 time: 0.304184 Oct 29 01:23:12.180417 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2161/4499] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:11 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:12.218632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-5ec587a7-440e-47d3-ad1a-799f9b28ef6f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] validate_networks() for None {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:23:12.631309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5ec587a7-440e-47d3-ad1a-799f9b28ef6f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:23:12.632009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5ec587a7-440e-47d3-ad1a-799f9b28ef6f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:23:12.632535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5ec587a7-440e-47d3-ad1a-799f9b28ef6f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:23:12.633050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5ec587a7-440e-47d3-ad1a-799f9b28ef6f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:23:12.633581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5ec587a7-440e-47d3-ad1a-799f9b28ef6f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:23:12.646129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ec587a7-440e-47d3-ad1a-799f9b28ef6f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:12.647016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ec587a7-440e-47d3-ad1a-799f9b28ef6f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:12.647659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ec587a7-440e-47d3-ad1a-799f9b28ef6f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:12.648480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ec587a7-440e-47d3-ad1a-799f9b28ef6f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:12.649032 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ec587a7-440e-47d3-ad1a-799f9b28ef6f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:12.649707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ec587a7-440e-47d3-ad1a-799f9b28ef6f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:12.670192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-5ec587a7-440e-47d3-ad1a-799f9b28ef6f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Getting quotas for project be0fa8a064884bd9a04bce4ef59bf17c. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:23:12.678007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-5ec587a7-440e-47d3-ad1a-799f9b28ef6f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Getting quotas for user 3285141c360f4209bd733520cb44b5ee and project be0fa8a064884bd9a04bce4ef59bf17c. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:23:12.694107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5ec587a7-440e-47d3-ad1a-799f9b28ef6f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:23:12.696468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5ec587a7-440e-47d3-ad1a-799f9b28ef6f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 7616f1ea-1339-425c-9ab9-45431f3cd608] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:23:12.730712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5e5d1ef1-95b8-42c8-a241-fb1185a48e05 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:12.736828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5e5d1ef1-95b8-42c8-a241-fb1185a48e05 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:12.769384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e5d1ef1-95b8-42c8-a241-fb1185a48e05 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:12.770207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e5d1ef1-95b8-42c8-a241-fb1185a48e05 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:12.770905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e5d1ef1-95b8-42c8-a241-fb1185a48e05 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:12.771917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e5d1ef1-95b8-42c8-a241-fb1185a48e05 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:12.772752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e5d1ef1-95b8-42c8-a241-fb1185a48e05 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:12.773394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e5d1ef1-95b8-42c8-a241-fb1185a48e05 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:12.859794 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5ec587a7-440e-47d3-ad1a-799f9b28ef6f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733854 Oct 29 01:23:12.859794 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2339/4500] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:23:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:23:12.869116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9620d3ba-dfe1-4c8f-aeba-86726637df2d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:12.870087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9620d3ba-dfe1-4c8f-aeba-86726637df2d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:12.891387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9620d3ba-dfe1-4c8f-aeba-86726637df2d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:12.893982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9620d3ba-dfe1-4c8f-aeba-86726637df2d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:12.896423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9620d3ba-dfe1-4c8f-aeba-86726637df2d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:12.901317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9620d3ba-dfe1-4c8f-aeba-86726637df2d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:12.902034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9620d3ba-dfe1-4c8f-aeba-86726637df2d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:12.902740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9620d3ba-dfe1-4c8f-aeba-86726637df2d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:13.130197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5e5d1ef1-95b8-42c8-a241-fb1185a48e05 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:13.142437 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5e5d1ef1-95b8-42c8-a241-fb1185a48e05 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1327 microversion: 2.1 time: 0.440915 Oct 29 01:23:13.143535 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2162/4501] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:12 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1327 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:13.150128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-107252b8-cc2e-4ed6-89a1-3a54586fef74 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1739271793", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:13.228008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9620d3ba-dfe1-4c8f-aeba-86726637df2d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:13.237717 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9620d3ba-dfe1-4c8f-aeba-86726637df2d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.388700 Oct 29 01:23:13.239198 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2340/4502] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:12 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:13.245399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-690d4742-149b-4a2a-ae45-3b6f017e6741 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:13.246159 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-690d4742-149b-4a2a-ae45-3b6f017e6741 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:13.255832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-690d4742-149b-4a2a-ae45-3b6f017e6741 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:13.256597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-690d4742-149b-4a2a-ae45-3b6f017e6741 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:13.257240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-690d4742-149b-4a2a-ae45-3b6f017e6741 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:13.258211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-690d4742-149b-4a2a-ae45-3b6f017e6741 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:13.258950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-690d4742-149b-4a2a-ae45-3b6f017e6741 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:13.259970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-690d4742-149b-4a2a-ae45-3b6f017e6741 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:13.263336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-107252b8-cc2e-4ed6-89a1-3a54586fef74 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] validate_networks() for None {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:23:13.525179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-690d4742-149b-4a2a-ae45-3b6f017e6741 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:13.589255 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-690d4742-149b-4a2a-ae45-3b6f017e6741 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.333632 Oct 29 01:23:13.589255 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2341/4503] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:13 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:13.607248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3addfa6a-8b4d-4bbb-950c-19268879dbec tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:13.619800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3addfa6a-8b4d-4bbb-950c-19268879dbec tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:13.638432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3addfa6a-8b4d-4bbb-950c-19268879dbec tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:13.646193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-107252b8-cc2e-4ed6-89a1-3a54586fef74 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:23:13.646752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-107252b8-cc2e-4ed6-89a1-3a54586fef74 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:23:13.647400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-107252b8-cc2e-4ed6-89a1-3a54586fef74 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:23:13.647913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-107252b8-cc2e-4ed6-89a1-3a54586fef74 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:23:13.648434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-107252b8-cc2e-4ed6-89a1-3a54586fef74 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:23:13.652498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3addfa6a-8b4d-4bbb-950c-19268879dbec tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:13.653177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3addfa6a-8b4d-4bbb-950c-19268879dbec tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:13.654144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3addfa6a-8b4d-4bbb-950c-19268879dbec tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:13.657075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3addfa6a-8b4d-4bbb-950c-19268879dbec tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:13.657734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3addfa6a-8b4d-4bbb-950c-19268879dbec tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:13.660208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-107252b8-cc2e-4ed6-89a1-3a54586fef74 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:13.661101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-107252b8-cc2e-4ed6-89a1-3a54586fef74 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:13.661831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-107252b8-cc2e-4ed6-89a1-3a54586fef74 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:13.663787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-107252b8-cc2e-4ed6-89a1-3a54586fef74 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:13.664479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-107252b8-cc2e-4ed6-89a1-3a54586fef74 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:13.666122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-107252b8-cc2e-4ed6-89a1-3a54586fef74 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:13.713496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-107252b8-cc2e-4ed6-89a1-3a54586fef74 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Getting quotas for project be0fa8a064884bd9a04bce4ef59bf17c. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:23:13.721346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-107252b8-cc2e-4ed6-89a1-3a54586fef74 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Getting quotas for user 3285141c360f4209bd733520cb44b5ee and project be0fa8a064884bd9a04bce4ef59bf17c. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:23:13.747328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-107252b8-cc2e-4ed6-89a1-3a54586fef74 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:23:13.750893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-107252b8-cc2e-4ed6-89a1-3a54586fef74 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:23:13.897609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3addfa6a-8b4d-4bbb-950c-19268879dbec tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:13.909916 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3addfa6a-8b4d-4bbb-950c-19268879dbec tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 200 len: 1546 microversion: 2.1 time: 0.318274 Oct 29 01:23:13.910552 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2342/4504] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:13 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 1546 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:13.936295 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-107252b8-cc2e-4ed6-89a1-3a54586fef74 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790951 Oct 29 01:23:13.936975 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2163/4505] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:23:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:23:13.942982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eb499132-5045-4cc1-b89b-ad0e09259ab6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:13.944091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eb499132-5045-4cc1-b89b-ad0e09259ab6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:13.980553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b27406c9-8cd2-4789-be68-0416d1428dc2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:13.981291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b27406c9-8cd2-4789-be68-0416d1428dc2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:13.983260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb499132-5045-4cc1-b89b-ad0e09259ab6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:13.985774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb499132-5045-4cc1-b89b-ad0e09259ab6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:13.987039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb499132-5045-4cc1-b89b-ad0e09259ab6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:13.992453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb499132-5045-4cc1-b89b-ad0e09259ab6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:13.994110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb499132-5045-4cc1-b89b-ad0e09259ab6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:13.995382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb499132-5045-4cc1-b89b-ad0e09259ab6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:14.235147 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eb499132-5045-4cc1-b89b-ad0e09259ab6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.299687 Oct 29 01:23:14.240904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b27406c9-8cd2-4789-be68-0416d1428dc2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:14.244428 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2343/4506] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:23:13 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-interface => generated 284 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:14.249186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d62aa0ce-ba93-4b5d-ade5-8dde62449bf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:14.249452 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b27406c9-8cd2-4789-be68-0416d1428dc2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1218 microversion: 2.1 time: 0.298176 Oct 29 01:23:14.249847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d62aa0ce-ba93-4b5d-ade5-8dde62449bf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:14.252013 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2164/4507] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:13 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1218 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:14.269248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d62aa0ce-ba93-4b5d-ade5-8dde62449bf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:14.273449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d62aa0ce-ba93-4b5d-ade5-8dde62449bf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:14.273449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d62aa0ce-ba93-4b5d-ade5-8dde62449bf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:14.273449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d62aa0ce-ba93-4b5d-ade5-8dde62449bf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:14.273449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d62aa0ce-ba93-4b5d-ade5-8dde62449bf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:14.273449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d62aa0ce-ba93-4b5d-ade5-8dde62449bf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:14.274497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-24ee3b91-71c0-43db-9663-9b44ac8368b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:14.275141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-24ee3b91-71c0-43db-9663-9b44ac8368b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:14.293598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24ee3b91-71c0-43db-9663-9b44ac8368b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:14.298268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24ee3b91-71c0-43db-9663-9b44ac8368b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:14.302370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24ee3b91-71c0-43db-9663-9b44ac8368b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:14.302370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24ee3b91-71c0-43db-9663-9b44ac8368b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:14.302370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24ee3b91-71c0-43db-9663-9b44ac8368b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:14.302370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24ee3b91-71c0-43db-9663-9b44ac8368b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:14.610832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d62aa0ce-ba93-4b5d-ade5-8dde62449bf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:14.623137 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d62aa0ce-ba93-4b5d-ade5-8dde62449bf3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1327 microversion: 2.1 time: 0.374908 Oct 29 01:23:14.625634 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2344/4508] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:14 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1327 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:14.633121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f6c40809-2073-40ae-91ec-3294604bb7b0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:14.634240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f6c40809-2073-40ae-91ec-3294604bb7b0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:14.647277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6c40809-2073-40ae-91ec-3294604bb7b0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:14.649792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6c40809-2073-40ae-91ec-3294604bb7b0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:14.650448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6c40809-2073-40ae-91ec-3294604bb7b0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:14.652443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6c40809-2073-40ae-91ec-3294604bb7b0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:14.653130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6c40809-2073-40ae-91ec-3294604bb7b0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:14.669957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6c40809-2073-40ae-91ec-3294604bb7b0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:14.717431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:14.804069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-24ee3b91-71c0-43db-9663-9b44ac8368b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:14.830947 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-24ee3b91-71c0-43db-9663-9b44ac8368b0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.570835 Oct 29 01:23:14.832437 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2165/4509] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:14 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:15.094532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-42c0ff92-0df1-42d9-8bee-9c243778376e req-05ea95d3-b4c4-448e-8036-3fe4ae1a7ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e138bf76-1216-4eef-9943-83f6a52f8425", "name": "network-vif-plugged", "status": "completed", "tag": "559292a4-68cb-4d70-97c2-ff3fffde0e41"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:15.109954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-42c0ff92-0df1-42d9-8bee-9c243778376e req-05ea95d3-b4c4-448e-8036-3fe4ae1a7ac9 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:15.110807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-42c0ff92-0df1-42d9-8bee-9c243778376e req-05ea95d3-b4c4-448e-8036-3fe4ae1a7ac9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:15.111937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-42c0ff92-0df1-42d9-8bee-9c243778376e req-05ea95d3-b4c4-448e-8036-3fe4ae1a7ac9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:15.121233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f6c40809-2073-40ae-91ec-3294604bb7b0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:15.129076 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f6c40809-2073-40ae-91ec-3294604bb7b0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.501680 Oct 29 01:23:15.131308 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2345/4510] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:14 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:15.139553 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-42c0ff92-0df1-42d9-8bee-9c243778376e req-05ea95d3-b4c4-448e-8036-3fe4ae1a7ac9 service nova] Creating event network-vif-plugged:559292a4-68cb-4d70-97c2-ff3fffde0e41 for instance e138bf76-1216-4eef-9943-83f6a52f8425 on n-h1-862964-3 Oct 29 01:23:15.146519 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-42c0ff92-0df1-42d9-8bee-9c243778376e req-05ea95d3-b4c4-448e-8036-3fe4ae1a7ac9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056075 Oct 29 01:23:15.149786 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2166/4511] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:15.282395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a41ec376-b70f-4512-b27e-a847c1440d09 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:15.282395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a41ec376-b70f-4512-b27e-a847c1440d09 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:15.443345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a41ec376-b70f-4512-b27e-a847c1440d09 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:15.452353 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a41ec376-b70f-4512-b27e-a847c1440d09 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1218 microversion: 2.1 time: 0.181705 Oct 29 01:23:15.453007 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2346/4512] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:15 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1218 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:15.648435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d97b8151-6c81-4043-aa99-96d0f5acdd48 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:15.650387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d97b8151-6c81-4043-aa99-96d0f5acdd48 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:15.665888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d97b8151-6c81-4043-aa99-96d0f5acdd48 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:15.666440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d97b8151-6c81-4043-aa99-96d0f5acdd48 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:15.666893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d97b8151-6c81-4043-aa99-96d0f5acdd48 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:15.667642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d97b8151-6c81-4043-aa99-96d0f5acdd48 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:15.668111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d97b8151-6c81-4043-aa99-96d0f5acdd48 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:15.668545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d97b8151-6c81-4043-aa99-96d0f5acdd48 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:15.863928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c31e85ab-e216-47ca-b5e0-737b06acf8e6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:15.866428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c31e85ab-e216-47ca-b5e0-737b06acf8e6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:15.888873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c31e85ab-e216-47ca-b5e0-737b06acf8e6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:15.890188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d97b8151-6c81-4043-aa99-96d0f5acdd48 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:15.895397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c31e85ab-e216-47ca-b5e0-737b06acf8e6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:15.896310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c31e85ab-e216-47ca-b5e0-737b06acf8e6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:15.908094 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d97b8151-6c81-4043-aa99-96d0f5acdd48 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1327 microversion: 2.1 time: 0.265269 Oct 29 01:23:15.909194 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2167/4513] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:15 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1327 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:15.910636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c31e85ab-e216-47ca-b5e0-737b06acf8e6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:15.913722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c31e85ab-e216-47ca-b5e0-737b06acf8e6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:15.914175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c31e85ab-e216-47ca-b5e0-737b06acf8e6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:16.127806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c31e85ab-e216-47ca-b5e0-737b06acf8e6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:16.140561 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c31e85ab-e216-47ca-b5e0-737b06acf8e6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.281820 Oct 29 01:23:16.141197 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2347/4514] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:15 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:16.164456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-97402d26-8aa5-4916-923a-59602d871c4c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:16.165536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-97402d26-8aa5-4916-923a-59602d871c4c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:16.173508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97402d26-8aa5-4916-923a-59602d871c4c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:16.174488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97402d26-8aa5-4916-923a-59602d871c4c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:16.177279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97402d26-8aa5-4916-923a-59602d871c4c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:16.177279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97402d26-8aa5-4916-923a-59602d871c4c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:16.177279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97402d26-8aa5-4916-923a-59602d871c4c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:16.177279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97402d26-8aa5-4916-923a-59602d871c4c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:16.386088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-60f17b19-f756-49ea-ba08-a09071d29d6f req-ea55041c-3dfe-41a9-aca5-c9d4a566df64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2172c139-992f-4b5d-97b3-f2e549f6fe29", "tag": "7de63336-a99f-4d68-b447-f1e9fada4204"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:16.415076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-60f17b19-f756-49ea-ba08-a09071d29d6f req-ea55041c-3dfe-41a9-aca5-c9d4a566df64 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:16.417915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-60f17b19-f756-49ea-ba08-a09071d29d6f req-ea55041c-3dfe-41a9-aca5-c9d4a566df64 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:16.419273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-60f17b19-f756-49ea-ba08-a09071d29d6f req-ea55041c-3dfe-41a9-aca5-c9d4a566df64 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:16.426178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-97402d26-8aa5-4916-923a-59602d871c4c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:16.437103 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-97402d26-8aa5-4916-923a-59602d871c4c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.277364 Oct 29 01:23:16.437731 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2168/4515] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:16 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:16.438492 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-60f17b19-f756-49ea-ba08-a09071d29d6f req-ea55041c-3dfe-41a9-aca5-c9d4a566df64 service nova] Creating event network-changed:7de63336-a99f-4d68-b447-f1e9fada4204 for instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 on n-h1-862964-3 Oct 29 01:23:16.462082 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-60f17b19-f756-49ea-ba08-a09071d29d6f req-ea55041c-3dfe-41a9-aca5-c9d4a566df64 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100506 Oct 29 01:23:16.470990 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2348/4516] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:16.479224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-285f4b5d-eb60-4396-9809-5f73f007c360 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:16.480512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-285f4b5d-eb60-4396-9809-5f73f007c360 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:16.495465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-285f4b5d-eb60-4396-9809-5f73f007c360 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:16.496324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-285f4b5d-eb60-4396-9809-5f73f007c360 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:16.496997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-285f4b5d-eb60-4396-9809-5f73f007c360 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:16.498476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-285f4b5d-eb60-4396-9809-5f73f007c360 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:16.505176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-285f4b5d-eb60-4396-9809-5f73f007c360 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:16.505176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-285f4b5d-eb60-4396-9809-5f73f007c360 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:16.506272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:16.678431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-285f4b5d-eb60-4396-9809-5f73f007c360 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:16.686495 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-285f4b5d-eb60-4396-9809-5f73f007c360 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1214 microversion: 2.1 time: 0.211773 Oct 29 01:23:16.687201 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2169/4517] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:16 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1214 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:16.873508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-71085a51-9156-4361-806e-94eb35df3f75 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "670389cf-00ce-4035-b4d4-b9a2feedd2b1"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:16.889336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-71085a51-9156-4361-806e-94eb35df3f75 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:16.933402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ff0aeead-3b0c-41ba-9188-07dae61505a3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:16.935330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ff0aeead-3b0c-41ba-9188-07dae61505a3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:16.937147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71085a51-9156-4361-806e-94eb35df3f75 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:16.948514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71085a51-9156-4361-806e-94eb35df3f75 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:16.948982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71085a51-9156-4361-806e-94eb35df3f75 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:16.949766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71085a51-9156-4361-806e-94eb35df3f75 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:16.950238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71085a51-9156-4361-806e-94eb35df3f75 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:16.950666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71085a51-9156-4361-806e-94eb35df3f75 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:16.951137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff0aeead-3b0c-41ba-9188-07dae61505a3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:16.953052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff0aeead-3b0c-41ba-9188-07dae61505a3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:16.953853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff0aeead-3b0c-41ba-9188-07dae61505a3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:16.956864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff0aeead-3b0c-41ba-9188-07dae61505a3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:16.959116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff0aeead-3b0c-41ba-9188-07dae61505a3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:16.960919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff0aeead-3b0c-41ba-9188-07dae61505a3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:17.373606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ff0aeead-3b0c-41ba-9188-07dae61505a3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:17.389596 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ff0aeead-3b0c-41ba-9188-07dae61505a3 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1327 microversion: 2.1 time: 0.456806 Oct 29 01:23:17.401771 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2170/4518] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:16 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1327 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:17.408143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d9c1198e-3191-43ac-826e-d7a910a7b193 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:17.409068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d9c1198e-3191-43ac-826e-d7a910a7b193 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:17.416535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9c1198e-3191-43ac-826e-d7a910a7b193 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:17.417408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9c1198e-3191-43ac-826e-d7a910a7b193 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:17.418155 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9c1198e-3191-43ac-826e-d7a910a7b193 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:17.423923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9c1198e-3191-43ac-826e-d7a910a7b193 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:17.423923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9c1198e-3191-43ac-826e-d7a910a7b193 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:17.423923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9c1198e-3191-43ac-826e-d7a910a7b193 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:17.962972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d9c1198e-3191-43ac-826e-d7a910a7b193 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:17.972353 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d9c1198e-3191-43ac-826e-d7a910a7b193 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.568045 Oct 29 01:23:17.972353 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2171/4519] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:17 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:17.981387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-736c92e0-d853-45b8-a672-985a0c232151 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:17.982366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-736c92e0-d853-45b8-a672-985a0c232151 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:17.993170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-736c92e0-d853-45b8-a672-985a0c232151 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:17.994142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-736c92e0-d853-45b8-a672-985a0c232151 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:17.994593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-736c92e0-d853-45b8-a672-985a0c232151 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:17.996029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-736c92e0-d853-45b8-a672-985a0c232151 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:17.996569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-736c92e0-d853-45b8-a672-985a0c232151 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:17.997058 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-736c92e0-d853-45b8-a672-985a0c232151 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:18.171947 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-71085a51-9156-4361-806e-94eb35df3f75 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "POST /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.295480 Oct 29 01:23:18.181172 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2349/4520] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 29 01:23:16 2022] POST /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments => generated 194 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:18.196794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0ffd8054-b8ca-438c-9b36-123872edbecd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:18.200593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0ffd8054-b8ca-438c-9b36-123872edbecd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:18.224309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ffd8054-b8ca-438c-9b36-123872edbecd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:18.225769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ffd8054-b8ca-438c-9b36-123872edbecd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:18.228187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ffd8054-b8ca-438c-9b36-123872edbecd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:18.229407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ffd8054-b8ca-438c-9b36-123872edbecd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:18.232231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ffd8054-b8ca-438c-9b36-123872edbecd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:18.233489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ffd8054-b8ca-438c-9b36-123872edbecd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:18.420466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0ffd8054-b8ca-438c-9b36-123872edbecd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:18.428971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-736c92e0-d853-45b8-a672-985a0c232151 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:18.430751 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0ffd8054-b8ca-438c-9b36-123872edbecd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1270 microversion: 2.1 time: 0.252751 Oct 29 01:23:18.431630 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2350/4521] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:18 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1270 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:18.437397 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-736c92e0-d853-45b8-a672-985a0c232151 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.463393 Oct 29 01:23:18.438386 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2172/4522] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:17 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:18.443027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cf9f0543-8d49-469a-8f77-e907610f34f7 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:18.443890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cf9f0543-8d49-469a-8f77-e907610f34f7 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:18.453580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf9f0543-8d49-469a-8f77-e907610f34f7 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:18.453580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf9f0543-8d49-469a-8f77-e907610f34f7 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:18.453580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf9f0543-8d49-469a-8f77-e907610f34f7 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:18.453580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf9f0543-8d49-469a-8f77-e907610f34f7 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:18.453580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf9f0543-8d49-469a-8f77-e907610f34f7 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:18.454305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf9f0543-8d49-469a-8f77-e907610f34f7 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:18.734820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cf9f0543-8d49-469a-8f77-e907610f34f7 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:18.744315 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cf9f0543-8d49-469a-8f77-e907610f34f7 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1527 microversion: 2.1 time: 0.310005 Oct 29 01:23:18.757780 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2351/4523] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:18 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1527 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:18.774876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e8da2e1e-be8d-4169-b04f-9a50858ac24b tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:18.778088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e8da2e1e-be8d-4169-b04f-9a50858ac24b tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:18.782876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8da2e1e-be8d-4169-b04f-9a50858ac24b tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:18.784153 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8da2e1e-be8d-4169-b04f-9a50858ac24b tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:18.784946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8da2e1e-be8d-4169-b04f-9a50858ac24b tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:18.785955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8da2e1e-be8d-4169-b04f-9a50858ac24b tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:18.786572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8da2e1e-be8d-4169-b04f-9a50858ac24b tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:18.787216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8da2e1e-be8d-4169-b04f-9a50858ac24b tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:18.952214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e8da2e1e-be8d-4169-b04f-9a50858ac24b tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:18.990317 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e8da2e1e-be8d-4169-b04f-9a50858ac24b tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1527 microversion: 2.1 time: 0.195896 Oct 29 01:23:18.990317 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2173/4524] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:18 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1527 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:19.027216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9e8b5360-de40-4416-877b-17b89b10cf45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:19.028476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9e8b5360-de40-4416-877b-17b89b10cf45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:19.042204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e8b5360-de40-4416-877b-17b89b10cf45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:19.044593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e8b5360-de40-4416-877b-17b89b10cf45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:19.045616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e8b5360-de40-4416-877b-17b89b10cf45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:19.047270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e8b5360-de40-4416-877b-17b89b10cf45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:19.051748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e8b5360-de40-4416-877b-17b89b10cf45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:19.053704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e8b5360-de40-4416-877b-17b89b10cf45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:19.297263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9e8b5360-de40-4416-877b-17b89b10cf45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:19.307665 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9e8b5360-de40-4416-877b-17b89b10cf45 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.312087 Oct 29 01:23:19.324166 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2174/4525] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:18 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:19.449136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-174d849e-45a0-48e6-b038-d45cddad5d9a tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:19.449741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-174d849e-45a0-48e6-b038-d45cddad5d9a tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:19.455027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2fe8f9a2-a224-4196-a80a-6367b1c8653a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:19.455785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2fe8f9a2-a224-4196-a80a-6367b1c8653a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:19.460910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-174d849e-45a0-48e6-b038-d45cddad5d9a tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:19.461443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-174d849e-45a0-48e6-b038-d45cddad5d9a tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:19.462541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-174d849e-45a0-48e6-b038-d45cddad5d9a tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:19.466158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fe8f9a2-a224-4196-a80a-6367b1c8653a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:19.466768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-174d849e-45a0-48e6-b038-d45cddad5d9a tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:19.467514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-174d849e-45a0-48e6-b038-d45cddad5d9a tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:19.468129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-174d849e-45a0-48e6-b038-d45cddad5d9a tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:19.468814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fe8f9a2-a224-4196-a80a-6367b1c8653a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:19.470721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fe8f9a2-a224-4196-a80a-6367b1c8653a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:19.472381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fe8f9a2-a224-4196-a80a-6367b1c8653a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:19.477129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fe8f9a2-a224-4196-a80a-6367b1c8653a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:19.477939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fe8f9a2-a224-4196-a80a-6367b1c8653a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:19.504196 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-174d849e-45a0-48e6-b038-d45cddad5d9a tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] HTTP exception thrown: Instance e138bf76-1216-4eef-9943-83f6a52f8425 could not be found. Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-174d849e-45a0-48e6-b038-d45cddad5d9a tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] Request method failure captured: Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 HTTP/1.1 Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIBub--cxTOZgISlHjf-qlw9jxFZbKSrGboniN2b0Zl_63KMjz07dc7_D4M45y8y9kM1riBaZ5wp26NuKO7gjSbFCS_DvHJnGjDH7LkHaKmGTYUZvLOeDg3pwp6n_7PrVvOkXVvm9CteIlT-keB40M2LKkge_BOPBdxkOoazmTqd_70 Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: c306386a1e6f419cb7eab09692c23aa2 Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-73647403 Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c306386a1e6f419cb7eab09692c23aa2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c306386a1e6f419cb7eab09692c23aa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c306386a1e6f419cb7eab09692c23aa2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c306386a1e6f419cb7eab09692c23aa2", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-73647403 Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: c306386a1e6f419cb7eab09692c23aa2 Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-73647403 Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestMultiTenantJSON-73647403-project Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 138388b3b1694f37b7248cfa137a2880 Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-73647403-project Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance e138bf76-1216-4eef-9943-83f6a52f8425 could not be found. Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'e138bf76-1216-4eef-9943-83f6a52f8425'} Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e138bf76-1216-4eef-9943-83f6a52f8425 could not be found. Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:23:19.506125 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:23:19.510666 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e138bf76-1216-4eef-9943-83f6a52f8425 could not be found. Oct 29 01:23:19.510666 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:19.510666 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:19.510666 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:19.510666 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:19.510666 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:19.510666 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:19.510666 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:23:19.510666 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:23:19.510666 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e138bf76-1216-4eef-9943-83f6a52f8425 could not be found. Oct 29 01:23:19.510666 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:19.510666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-174d849e-45a0-48e6-b038-d45cddad5d9a tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] Returning 404 to user: Instance e138bf76-1216-4eef-9943-83f6a52f8425 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:23:19.510666 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-174d849e-45a0-48e6-b038-d45cddad5d9a tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 404 len: 111 microversion: 2.1 time: 0.521935 Oct 29 01:23:19.512795 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2352/4526] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:23:18 2022] DELETE /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 111 bytes in 528 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:23:19.517916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9d368579-8f8f-453b-86f0-d57685787e66 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:19.518833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9d368579-8f8f-453b-86f0-d57685787e66 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:19.530956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d368579-8f8f-453b-86f0-d57685787e66 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:19.531376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d368579-8f8f-453b-86f0-d57685787e66 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:19.534953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d368579-8f8f-453b-86f0-d57685787e66 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:19.535784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d368579-8f8f-453b-86f0-d57685787e66 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:19.536266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d368579-8f8f-453b-86f0-d57685787e66 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:19.536880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d368579-8f8f-453b-86f0-d57685787e66 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:19.601900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2fe8f9a2-a224-4196-a80a-6367b1c8653a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:19.615524 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2fe8f9a2-a224-4196-a80a-6367b1c8653a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1278 microversion: 2.1 time: 0.164430 Oct 29 01:23:19.616428 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2175/4527] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:19 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:19.644789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e6bf56b-2707-41ad-924f-bb53b270af99 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:19.651026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7e6bf56b-2707-41ad-924f-bb53b270af99 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:19.664998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e6bf56b-2707-41ad-924f-bb53b270af99 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:19.665879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e6bf56b-2707-41ad-924f-bb53b270af99 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:19.666656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e6bf56b-2707-41ad-924f-bb53b270af99 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:19.667677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e6bf56b-2707-41ad-924f-bb53b270af99 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:19.668358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e6bf56b-2707-41ad-924f-bb53b270af99 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:19.669971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e6bf56b-2707-41ad-924f-bb53b270af99 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:20.165471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9d368579-8f8f-453b-86f0-d57685787e66 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:20.178080 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9d368579-8f8f-453b-86f0-d57685787e66 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.663914 Oct 29 01:23:20.180010 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2353/4528] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:19 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:20.188115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7e6bf56b-2707-41ad-924f-bb53b270af99 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:20.199953 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e6bf56b-2707-41ad-924f-bb53b270af99 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1527 microversion: 2.1 time: 0.581689 Oct 29 01:23:20.200569 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2176/4529] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:19 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1527 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:20.243409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-61c4955b-07f7-419a-98c3-a42e36e8a8f3 tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] Action: 'update', calling method: >, body: {"server": {"name": "e138bf76-1216-4eef-9943-83f6a52f8425_new"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:20.247910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-61c4955b-07f7-419a-98c3-a42e36e8a8f3 tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:20.267964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61c4955b-07f7-419a-98c3-a42e36e8a8f3 tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:20.268997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61c4955b-07f7-419a-98c3-a42e36e8a8f3 tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:20.269714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61c4955b-07f7-419a-98c3-a42e36e8a8f3 tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:20.270636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61c4955b-07f7-419a-98c3-a42e36e8a8f3 tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:20.271262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61c4955b-07f7-419a-98c3-a42e36e8a8f3 tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:20.273038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61c4955b-07f7-419a-98c3-a42e36e8a8f3 tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:20.298636 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-61c4955b-07f7-419a-98c3-a42e36e8a8f3 tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] HTTP exception thrown: Instance e138bf76-1216-4eef-9943-83f6a52f8425 could not be found. Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-61c4955b-07f7-419a-98c3-a42e36e8a8f3 tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] Request method failure captured: Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: request: PUT /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 HTTP/1.1 Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 64 Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIBub--cxTOZgISlHjf-qlw9jxFZbKSrGboniN2b0Zl_63KMjz07dc7_D4M45y8y9kM1riBaZ5wp26NuKO7gjSbFCS_DvHJnGjDH7LkHaKmGTYUZvLOeDg3pwp6n_7PrVvOkXVvm9CteIlT-keB40M2LKkge_BOPBdxkOoazmTqd_70 Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: c306386a1e6f419cb7eab09692c23aa2 Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-73647403 Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c306386a1e6f419cb7eab09692c23aa2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c306386a1e6f419cb7eab09692c23aa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c306386a1e6f419cb7eab09692c23aa2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c306386a1e6f419cb7eab09692c23aa2", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-73647403 Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: c306386a1e6f419cb7eab09692c23aa2 Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-73647403 Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestMultiTenantJSON-73647403-project Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 138388b3b1694f37b7248cfa137a2880 Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-73647403-project Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: {"server": {"name": "e138bf76-1216-4eef-9943-83f6a52f8425_new"}} Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance e138bf76-1216-4eef-9943-83f6a52f8425 could not be found. Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'e138bf76-1216-4eef-9943-83f6a52f8425', 'body': {'server': {'name': 'e138bf76-1216-4eef-9943-83f6a52f8425_new'}}} Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e138bf76-1216-4eef-9943-83f6a52f8425 could not be found. Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 01:23:20.314606 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 29 01:23:20.319289 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 29 01:23:20.319289 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:23:20.319289 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:23:20.319289 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:23:20.319289 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:23:20.319289 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e138bf76-1216-4eef-9943-83f6a52f8425 could not be found. Oct 29 01:23:20.319289 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:20.319289 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:20.319289 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:20.319289 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:20.319289 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:20.319289 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:20.319289 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:23:20.319289 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:23:20.319289 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e138bf76-1216-4eef-9943-83f6a52f8425 could not be found. Oct 29 01:23:20.319289 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:20.319289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-61c4955b-07f7-419a-98c3-a42e36e8a8f3 tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] Returning 404 to user: Instance e138bf76-1216-4eef-9943-83f6a52f8425 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:23:20.319289 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-61c4955b-07f7-419a-98c3-a42e36e8a8f3 tempest-ServersNegativeTestMultiTenantJSON-73647403 tempest-ServersNegativeTestMultiTenantJSON-73647403-project] 10.222.0.26 "PUT /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 404 len: 111 microversion: 2.1 time: 0.072528 Oct 29 01:23:20.319289 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2354/4530] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 29 01:23:20 2022] PUT /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:23:20.320627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ac7661d1-188c-4c3a-abcf-b79dd8aee697 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:20.320627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ac7661d1-188c-4c3a-abcf-b79dd8aee697 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:20.326850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac7661d1-188c-4c3a-abcf-b79dd8aee697 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:20.327488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac7661d1-188c-4c3a-abcf-b79dd8aee697 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:20.328378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac7661d1-188c-4c3a-abcf-b79dd8aee697 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:20.329389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac7661d1-188c-4c3a-abcf-b79dd8aee697 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:20.330421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac7661d1-188c-4c3a-abcf-b79dd8aee697 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:20.332451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac7661d1-188c-4c3a-abcf-b79dd8aee697 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:20.339597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c5fe793a-699d-458e-8dd0-bfa1bd670285 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:20.344188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c5fe793a-699d-458e-8dd0-bfa1bd670285 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:20.356152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5fe793a-699d-458e-8dd0-bfa1bd670285 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:20.356662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5fe793a-699d-458e-8dd0-bfa1bd670285 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:20.357109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5fe793a-699d-458e-8dd0-bfa1bd670285 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:20.357863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5fe793a-699d-458e-8dd0-bfa1bd670285 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:20.358333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5fe793a-699d-458e-8dd0-bfa1bd670285 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:20.358769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5fe793a-699d-458e-8dd0-bfa1bd670285 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:20.387487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ac7661d1-188c-4c3a-abcf-b79dd8aee697 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:23:20.758431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c5fe793a-699d-458e-8dd0-bfa1bd670285 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:20.769242 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c5fe793a-699d-458e-8dd0-bfa1bd670285 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.439318 Oct 29 01:23:20.774768 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2355/4531] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:20 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:20.786681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-33bdaf7e-fb09-4c62-b140-7758702d98b9 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:20.787577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-33bdaf7e-fb09-4c62-b140-7758702d98b9 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:20.805356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33bdaf7e-fb09-4c62-b140-7758702d98b9 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:20.806106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33bdaf7e-fb09-4c62-b140-7758702d98b9 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:20.806710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33bdaf7e-fb09-4c62-b140-7758702d98b9 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:20.807683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33bdaf7e-fb09-4c62-b140-7758702d98b9 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:20.810932 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ac7661d1-188c-4c3a-abcf-b79dd8aee697 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 204 len: 0 microversion: 2.1 time: 0.496121 Oct 29 01:23:20.811230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33bdaf7e-fb09-4c62-b140-7758702d98b9 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:20.811230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33bdaf7e-fb09-4c62-b140-7758702d98b9 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:20.813059 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2177/4532] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:23:20 2022] DELETE /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:23:20.821747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4cf9975c-ff06-42b3-921c-1a1480aca7d2 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:20.823864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4cf9975c-ff06-42b3-921c-1a1480aca7d2 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:20.840314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:20.844786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cf9975c-ff06-42b3-921c-1a1480aca7d2 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:20.845510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cf9975c-ff06-42b3-921c-1a1480aca7d2 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:20.849273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cf9975c-ff06-42b3-921c-1a1480aca7d2 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:20.850184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cf9975c-ff06-42b3-921c-1a1480aca7d2 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:20.851392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cf9975c-ff06-42b3-921c-1a1480aca7d2 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:20.854251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cf9975c-ff06-42b3-921c-1a1480aca7d2 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:20.960169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-33bdaf7e-fb09-4c62-b140-7758702d98b9 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:20.970825 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-33bdaf7e-fb09-4c62-b140-7758702d98b9 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1276 microversion: 2.1 time: 0.194624 Oct 29 01:23:20.971415 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2356/4533] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:20 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1276 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:21.109001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4cf9975c-ff06-42b3-921c-1a1480aca7d2 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:21.120915 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4cf9975c-ff06-42b3-921c-1a1480aca7d2 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1533 microversion: 2.1 time: 0.306122 Oct 29 01:23:21.127592 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2178/4534] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:20 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1533 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:21.205462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-71393ef5-c1ff-4d4d-90a7-0d4b3cd475de tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:21.207448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-71393ef5-c1ff-4d4d-90a7-0d4b3cd475de tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:21.231218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71393ef5-c1ff-4d4d-90a7-0d4b3cd475de tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:21.232114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71393ef5-c1ff-4d4d-90a7-0d4b3cd475de tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:21.233862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71393ef5-c1ff-4d4d-90a7-0d4b3cd475de tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:21.236460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71393ef5-c1ff-4d4d-90a7-0d4b3cd475de tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:21.238148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71393ef5-c1ff-4d4d-90a7-0d4b3cd475de tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:21.238345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71393ef5-c1ff-4d4d-90a7-0d4b3cd475de tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:21.485997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-71393ef5-c1ff-4d4d-90a7-0d4b3cd475de tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:21.497110 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-71393ef5-c1ff-4d4d-90a7-0d4b3cd475de tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.296788 Oct 29 01:23:21.497861 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2357/4535] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:21 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:21.803078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-823ebc7f-1925-47e9-90fb-d28b4f1d0e0f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:21.804307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-823ebc7f-1925-47e9-90fb-d28b4f1d0e0f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:21.820728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-823ebc7f-1925-47e9-90fb-d28b4f1d0e0f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:21.821283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-823ebc7f-1925-47e9-90fb-d28b4f1d0e0f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:21.821734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-823ebc7f-1925-47e9-90fb-d28b4f1d0e0f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:21.822498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-823ebc7f-1925-47e9-90fb-d28b4f1d0e0f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:21.822987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-823ebc7f-1925-47e9-90fb-d28b4f1d0e0f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:21.823462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-823ebc7f-1925-47e9-90fb-d28b4f1d0e0f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:21.929186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-23f534d0-2f7d-4226-94c0-a822d4ae1f78 req-2fac25bd-2eef-47ed-a715-243ac7eadb2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7616f1ea-1339-425c-9ab9-45431f3cd608", "tag": "1f225c5e-7d18-4b8d-9938-9a97f24a39fc"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:21.947534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-23f534d0-2f7d-4226-94c0-a822d4ae1f78 req-2fac25bd-2eef-47ed-a715-243ac7eadb2b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:21.949956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-23f534d0-2f7d-4226-94c0-a822d4ae1f78 req-2fac25bd-2eef-47ed-a715-243ac7eadb2b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:21.950620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-23f534d0-2f7d-4226-94c0-a822d4ae1f78 req-2fac25bd-2eef-47ed-a715-243ac7eadb2b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:21.982574 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-23f534d0-2f7d-4226-94c0-a822d4ae1f78 req-2fac25bd-2eef-47ed-a715-243ac7eadb2b service nova] Creating event network-changed:1f225c5e-7d18-4b8d-9938-9a97f24a39fc for instance 7616f1ea-1339-425c-9ab9-45431f3cd608 on n-h2-862964-3 Oct 29 01:23:21.993408 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-23f534d0-2f7d-4226-94c0-a822d4ae1f78 req-2fac25bd-2eef-47ed-a715-243ac7eadb2b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067876 Oct 29 01:23:21.999790 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2358/4536] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:22.012337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c34bfde5-8be6-4444-9190-bc113317dfb0 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:22.013441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c34bfde5-8be6-4444-9190-bc113317dfb0 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:22.028589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c34bfde5-8be6-4444-9190-bc113317dfb0 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:22.030552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c34bfde5-8be6-4444-9190-bc113317dfb0 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:22.036102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c34bfde5-8be6-4444-9190-bc113317dfb0 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:22.037323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c34bfde5-8be6-4444-9190-bc113317dfb0 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:22.037964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c34bfde5-8be6-4444-9190-bc113317dfb0 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:22.043868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c34bfde5-8be6-4444-9190-bc113317dfb0 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:22.662481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:22.991027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-823ebc7f-1925-47e9-90fb-d28b4f1d0e0f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:22.996552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c34bfde5-8be6-4444-9190-bc113317dfb0 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:23.013093 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-823ebc7f-1925-47e9-90fb-d28b4f1d0e0f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 1.215483 Oct 29 01:23:23.014175 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c34bfde5-8be6-4444-9190-bc113317dfb0 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1318 microversion: 2.1 time: 1.012244 Oct 29 01:23:23.015091 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2359/4537] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:22 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1318 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:23.016258 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2179/4538] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:21 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:23.042463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4f3ec332-c6c1-4dc5-8f07-65952d34e967 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:23.046367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f971b84d-f5de-417f-bf15-d8020405dc1c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:23.047343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4f3ec332-c6c1-4dc5-8f07-65952d34e967 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:23.048265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f971b84d-f5de-417f-bf15-d8020405dc1c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:23.064642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f3ec332-c6c1-4dc5-8f07-65952d34e967 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:23.065429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f971b84d-f5de-417f-bf15-d8020405dc1c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:23.066531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f3ec332-c6c1-4dc5-8f07-65952d34e967 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:23.066838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f971b84d-f5de-417f-bf15-d8020405dc1c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:23.067338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f3ec332-c6c1-4dc5-8f07-65952d34e967 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:23.068375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f3ec332-c6c1-4dc5-8f07-65952d34e967 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:23.068759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f971b84d-f5de-417f-bf15-d8020405dc1c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:23.069829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f971b84d-f5de-417f-bf15-d8020405dc1c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:23.070100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f3ec332-c6c1-4dc5-8f07-65952d34e967 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:23.070728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f3ec332-c6c1-4dc5-8f07-65952d34e967 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:23.071494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f971b84d-f5de-417f-bf15-d8020405dc1c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:23.072560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f971b84d-f5de-417f-bf15-d8020405dc1c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:23.698083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:23.789220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4f3ec332-c6c1-4dc5-8f07-65952d34e967 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:23.798815 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4f3ec332-c6c1-4dc5-8f07-65952d34e967 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1533 microversion: 2.1 time: 0.782481 Oct 29 01:23:23.802290 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2360/4539] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:23 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1533 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:23.822206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f971b84d-f5de-417f-bf15-d8020405dc1c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:23.828704 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f971b84d-f5de-417f-bf15-d8020405dc1c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.810729 Oct 29 01:23:23.834797 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2180/4540] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:23 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:24.041609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ddb546e7-d9fb-4bfd-9cd7-6426c7e6d112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:24.042409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ddb546e7-d9fb-4bfd-9cd7-6426c7e6d112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:24.050624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ddb546e7-d9fb-4bfd-9cd7-6426c7e6d112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:24.051563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ddb546e7-d9fb-4bfd-9cd7-6426c7e6d112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:24.052760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ddb546e7-d9fb-4bfd-9cd7-6426c7e6d112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:24.053787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ddb546e7-d9fb-4bfd-9cd7-6426c7e6d112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:24.054679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4f444297-fb9a-4ea2-bc8a-03d95533182b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:24.055633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4f444297-fb9a-4ea2-bc8a-03d95533182b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:24.056649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ddb546e7-d9fb-4bfd-9cd7-6426c7e6d112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:24.057668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ddb546e7-d9fb-4bfd-9cd7-6426c7e6d112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:24.072187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f444297-fb9a-4ea2-bc8a-03d95533182b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:24.076831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f444297-fb9a-4ea2-bc8a-03d95533182b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:24.077489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f444297-fb9a-4ea2-bc8a-03d95533182b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:24.083765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f444297-fb9a-4ea2-bc8a-03d95533182b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:24.083765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f444297-fb9a-4ea2-bc8a-03d95533182b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:24.083765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f444297-fb9a-4ea2-bc8a-03d95533182b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:24.246867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:24.423755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4f444297-fb9a-4ea2-bc8a-03d95533182b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:24.441466 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4f444297-fb9a-4ea2-bc8a-03d95533182b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1318 microversion: 2.1 time: 0.392660 Oct 29 01:23:24.446382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ddb546e7-d9fb-4bfd-9cd7-6426c7e6d112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:24.453788 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2181/4541] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:24 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:24.458093 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ddb546e7-d9fb-4bfd-9cd7-6426c7e6d112 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.420644 Oct 29 01:23:24.484921 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2361/4542] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:24 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:24.555186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-3526dc58-f78f-43b8-90d7-e4c81a88a386 req-0118ab21-9a5e-422d-ab16-ea74e372eea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e138bf76-1216-4eef-9943-83f6a52f8425", "name": "network-vif-deleted", "tag": "559292a4-68cb-4d70-97c2-ff3fffde0e41"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:24.566998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3526dc58-f78f-43b8-90d7-e4c81a88a386 req-0118ab21-9a5e-422d-ab16-ea74e372eea1 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:24.570363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3526dc58-f78f-43b8-90d7-e4c81a88a386 req-0118ab21-9a5e-422d-ab16-ea74e372eea1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:24.570363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3526dc58-f78f-43b8-90d7-e4c81a88a386 req-0118ab21-9a5e-422d-ab16-ea74e372eea1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:24.586169 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-3526dc58-f78f-43b8-90d7-e4c81a88a386 req-0118ab21-9a5e-422d-ab16-ea74e372eea1 service nova] Creating event network-vif-deleted:559292a4-68cb-4d70-97c2-ff3fffde0e41 for instance e138bf76-1216-4eef-9943-83f6a52f8425 on n-h1-862964-3 Oct 29 01:23:24.594224 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-3526dc58-f78f-43b8-90d7-e4c81a88a386 req-0118ab21-9a5e-422d-ab16-ea74e372eea1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042770 Oct 29 01:23:24.595643 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2182/4543] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:23:24.604913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-ea7a6b14-44a6-49d3-af99-cce389fe9a5b req-797e5bcc-0880-45c4-b2aa-aac0fad45789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "391c56c8-b8d8-424c-91d7-dc0408b9e71d", "tag": "bfe88ae5-26ce-42b9-a002-0635e32f69b1"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:24.621703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ea7a6b14-44a6-49d3-af99-cce389fe9a5b req-797e5bcc-0880-45c4-b2aa-aac0fad45789 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:24.622918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ea7a6b14-44a6-49d3-af99-cce389fe9a5b req-797e5bcc-0880-45c4-b2aa-aac0fad45789 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:24.624239 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ea7a6b14-44a6-49d3-af99-cce389fe9a5b req-797e5bcc-0880-45c4-b2aa-aac0fad45789 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:24.641246 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-ea7a6b14-44a6-49d3-af99-cce389fe9a5b req-797e5bcc-0880-45c4-b2aa-aac0fad45789 service nova] Creating event network-changed:bfe88ae5-26ce-42b9-a002-0635e32f69b1 for instance 391c56c8-b8d8-424c-91d7-dc0408b9e71d on n-h2-862964-3 Oct 29 01:23:24.650206 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-ea7a6b14-44a6-49d3-af99-cce389fe9a5b req-797e5bcc-0880-45c4-b2aa-aac0fad45789 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051626 Oct 29 01:23:24.651352 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2362/4544] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:23:24.832240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6a1fb672-71d2-4e42-bafd-03516771d111 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:24.833559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6a1fb672-71d2-4e42-bafd-03516771d111 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:24.839848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a1fb672-71d2-4e42-bafd-03516771d111 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:24.840333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a1fb672-71d2-4e42-bafd-03516771d111 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:24.840767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a1fb672-71d2-4e42-bafd-03516771d111 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:24.841514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a1fb672-71d2-4e42-bafd-03516771d111 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:24.842135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a1fb672-71d2-4e42-bafd-03516771d111 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:24.847602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6a1fb672-71d2-4e42-bafd-03516771d111 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:24.857187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0d351133-ea2f-455f-b471-77362ec1fb2a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:24.858333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0d351133-ea2f-455f-b471-77362ec1fb2a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:24.865539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d351133-ea2f-455f-b471-77362ec1fb2a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:24.867955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d351133-ea2f-455f-b471-77362ec1fb2a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:24.868660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d351133-ea2f-455f-b471-77362ec1fb2a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:24.869627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d351133-ea2f-455f-b471-77362ec1fb2a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:24.870308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d351133-ea2f-455f-b471-77362ec1fb2a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:24.870954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d351133-ea2f-455f-b471-77362ec1fb2a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:24.919362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6a1fb672-71d2-4e42-bafd-03516771d111 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d267964e9b14dae9232c86ca280bdf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65eae7f2715a42899e0a448e7e29e2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:24.927934 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6a1fb672-71d2-4e42-bafd-03516771d111 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 200 len: 1312 microversion: 2.1 time: 0.101680 Oct 29 01:23:24.928771 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2183/4545] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:24 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:25.068475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0d351133-ea2f-455f-b471-77362ec1fb2a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:25.079877 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0d351133-ea2f-455f-b471-77362ec1fb2a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.227515 Oct 29 01:23:25.080598 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2363/4546] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:24 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:25.466754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7db72308-8d93-4fdb-b44c-632db8b76a6a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:25.467371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7db72308-8d93-4fdb-b44c-632db8b76a6a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:25.479978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db72308-8d93-4fdb-b44c-632db8b76a6a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:25.480683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db72308-8d93-4fdb-b44c-632db8b76a6a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:25.481318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db72308-8d93-4fdb-b44c-632db8b76a6a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:25.482178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db72308-8d93-4fdb-b44c-632db8b76a6a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:25.482794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db72308-8d93-4fdb-b44c-632db8b76a6a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:25.483220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db72308-8d93-4fdb-b44c-632db8b76a6a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:25.485016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5276ca33-04c9-4906-8a94-5b742c1c0777 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:25.485914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5276ca33-04c9-4906-8a94-5b742c1c0777 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:25.489470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=8 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:25.500337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5276ca33-04c9-4906-8a94-5b742c1c0777 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:25.500916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5276ca33-04c9-4906-8a94-5b742c1c0777 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:25.501654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5276ca33-04c9-4906-8a94-5b742c1c0777 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:25.502443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5276ca33-04c9-4906-8a94-5b742c1c0777 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:25.503235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5276ca33-04c9-4906-8a94-5b742c1c0777 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:25.503986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5276ca33-04c9-4906-8a94-5b742c1c0777 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:25.730005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7db72308-8d93-4fdb-b44c-632db8b76a6a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:25.734124 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5276ca33-04c9-4906-8a94-5b742c1c0777 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:25.742333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:25.750424 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5276ca33-04c9-4906-8a94-5b742c1c0777 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.272110 Oct 29 01:23:25.754124 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2364/4547] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:25 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:25.754853 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7db72308-8d93-4fdb-b44c-632db8b76a6a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1318 microversion: 2.1 time: 0.293498 Oct 29 01:23:25.755441 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2184/4548] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:25 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:25.956225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a878fac0-f70d-4b4c-be00-f24cf5448954 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:25.961037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a878fac0-f70d-4b4c-be00-f24cf5448954 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] [instance: e138bf76-1216-4eef-9943-83f6a52f8425] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:25.974845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a878fac0-f70d-4b4c-be00-f24cf5448954 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:25.977210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a878fac0-f70d-4b4c-be00-f24cf5448954 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:25.977354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a878fac0-f70d-4b4c-be00-f24cf5448954 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:25.978076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a878fac0-f70d-4b4c-be00-f24cf5448954 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:25.978544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a878fac0-f70d-4b4c-be00-f24cf5448954 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:25.979005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a878fac0-f70d-4b4c-be00-f24cf5448954 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:25.984376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:25.995359 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-a878fac0-f70d-4b4c-be00-f24cf5448954 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] HTTP exception thrown: Instance e138bf76-1216-4eef-9943-83f6a52f8425 could not be found. Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a878fac0-f70d-4b4c-be00-f24cf5448954 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Request method failure captured: Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 HTTP/1.1 Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIBYEslvv08es3347l_vilV4VfSvTCJPPR6B1AC66tPWd-3j8q3BPXYvBFFw3u5gaQPEzYmt27QQQwlhiWLPI4pWRqA5Ix7CNFsxbitmUQUC6mZy9U_o37TxLlEJ3bP8p84LnJmZmA37rZtEwbnPVsRfHzVy67p4j0raPBsjzmUAupA Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 65eae7f2715a42899e0a448e7e29e2ba Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-457150723 Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/65eae7f2715a42899e0a448e7e29e2ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/65eae7f2715a42899e0a448e7e29e2ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/65eae7f2715a42899e0a448e7e29e2ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_65eae7f2715a42899e0a448e7e29e2ba", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-457150723 Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 65eae7f2715a42899e0a448e7e29e2ba Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-457150723 Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestMultiTenantJSON-457150723-project Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 7d267964e9b14dae9232c86ca280bdf1 Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-457150723-project Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance e138bf76-1216-4eef-9943-83f6a52f8425 could not be found. Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'e138bf76-1216-4eef-9943-83f6a52f8425'} Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e138bf76-1216-4eef-9943-83f6a52f8425 could not be found. Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e138bf76-1216-4eef-9943-83f6a52f8425 could not be found. Oct 29 01:23:26.000154 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:26.004130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:26.004130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:26.004130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:26.004130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:26.004130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:26.004130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:23:26.004130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:23:26.004130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e138bf76-1216-4eef-9943-83f6a52f8425 could not be found. Oct 29 01:23:26.004130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:26.004130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a878fac0-f70d-4b4c-be00-f24cf5448954 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] Returning 404 to user: Instance e138bf76-1216-4eef-9943-83f6a52f8425 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:23:26.004130 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a878fac0-f70d-4b4c-be00-f24cf5448954 tempest-ServersNegativeTestMultiTenantJSON-457150723 tempest-ServersNegativeTestMultiTenantJSON-457150723-project] 10.222.0.26 "GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425" status: 404 len: 111 microversion: 2.1 time: 0.049702 Oct 29 01:23:26.004130 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2365/4549] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:25 2022] GET /compute/v2.1/servers/e138bf76-1216-4eef-9943-83f6a52f8425 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:23:26.107226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d79505f3-bbb9-43db-af3e-0754cca86133 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:26.107226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d79505f3-bbb9-43db-af3e-0754cca86133 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:26.113383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d79505f3-bbb9-43db-af3e-0754cca86133 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:26.113888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d79505f3-bbb9-43db-af3e-0754cca86133 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:26.114332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d79505f3-bbb9-43db-af3e-0754cca86133 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:26.115188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d79505f3-bbb9-43db-af3e-0754cca86133 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:26.115873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d79505f3-bbb9-43db-af3e-0754cca86133 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:26.116391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d79505f3-bbb9-43db-af3e-0754cca86133 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:26.306300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d79505f3-bbb9-43db-af3e-0754cca86133 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:26.319192 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d79505f3-bbb9-43db-af3e-0754cca86133 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.219154 Oct 29 01:23:26.322357 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2185/4550] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:26 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:26.782083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-28068d5f-7ac8-4e12-a62a-470ccbe9f861 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:26.782763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-28068d5f-7ac8-4e12-a62a-470ccbe9f861 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:26.790657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-69beb787-79a4-46a7-8171-4f52231885dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:26.791186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28068d5f-7ac8-4e12-a62a-470ccbe9f861 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:26.791186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28068d5f-7ac8-4e12-a62a-470ccbe9f861 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:26.791590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28068d5f-7ac8-4e12-a62a-470ccbe9f861 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:26.792296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28068d5f-7ac8-4e12-a62a-470ccbe9f861 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:26.792747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28068d5f-7ac8-4e12-a62a-470ccbe9f861 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:26.793180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28068d5f-7ac8-4e12-a62a-470ccbe9f861 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:26.793731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-69beb787-79a4-46a7-8171-4f52231885dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:26.823109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69beb787-79a4-46a7-8171-4f52231885dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:26.823615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69beb787-79a4-46a7-8171-4f52231885dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:26.826792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69beb787-79a4-46a7-8171-4f52231885dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:26.827701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69beb787-79a4-46a7-8171-4f52231885dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:26.829596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69beb787-79a4-46a7-8171-4f52231885dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:26.833405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69beb787-79a4-46a7-8171-4f52231885dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:27.188876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-28068d5f-7ac8-4e12-a62a-470ccbe9f861 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:27.203535 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-28068d5f-7ac8-4e12-a62a-470ccbe9f861 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1318 microversion: 2.1 time: 0.425311 Oct 29 01:23:27.204817 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2186/4551] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:26 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:27.247727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-69beb787-79a4-46a7-8171-4f52231885dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:27.257851 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-69beb787-79a4-46a7-8171-4f52231885dd tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.485689 Oct 29 01:23:27.258045 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2366/4552] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:26 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:27.347935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b2083374-0e16-44bb-bb3e-271adc3415a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:27.349033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b2083374-0e16-44bb-bb3e-271adc3415a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:27.355382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2083374-0e16-44bb-bb3e-271adc3415a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:27.356066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2083374-0e16-44bb-bb3e-271adc3415a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:27.356694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2083374-0e16-44bb-bb3e-271adc3415a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:27.357586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2083374-0e16-44bb-bb3e-271adc3415a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:27.358199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2083374-0e16-44bb-bb3e-271adc3415a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:27.358785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2083374-0e16-44bb-bb3e-271adc3415a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:27.554817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b2083374-0e16-44bb-bb3e-271adc3415a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:27.565950 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b2083374-0e16-44bb-bb3e-271adc3415a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.221977 Oct 29 01:23:27.566886 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2187/4553] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:27 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:28.229418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-daf88033-5102-4232-ae66-cf4ad2ee0f80 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:28.230600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-daf88033-5102-4232-ae66-cf4ad2ee0f80 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:28.240278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-daf88033-5102-4232-ae66-cf4ad2ee0f80 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:28.241066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-daf88033-5102-4232-ae66-cf4ad2ee0f80 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:28.243422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-daf88033-5102-4232-ae66-cf4ad2ee0f80 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:28.246287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-daf88033-5102-4232-ae66-cf4ad2ee0f80 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:28.246963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-daf88033-5102-4232-ae66-cf4ad2ee0f80 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:28.247591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-daf88033-5102-4232-ae66-cf4ad2ee0f80 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:28.282738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-119a24e3-688b-4721-b7a3-22f036b751ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:28.283371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-119a24e3-688b-4721-b7a3-22f036b751ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:28.296898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-119a24e3-688b-4721-b7a3-22f036b751ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:28.298984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-119a24e3-688b-4721-b7a3-22f036b751ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:28.302774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-119a24e3-688b-4721-b7a3-22f036b751ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:28.303687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-119a24e3-688b-4721-b7a3-22f036b751ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:28.304179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-119a24e3-688b-4721-b7a3-22f036b751ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:28.304622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-119a24e3-688b-4721-b7a3-22f036b751ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:28.598369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-daf88033-5102-4232-ae66-cf4ad2ee0f80 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:28.606822 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-daf88033-5102-4232-ae66-cf4ad2ee0f80 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1318 microversion: 2.1 time: 0.382675 Oct 29 01:23:28.621794 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2367/4554] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:28 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:28.629478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c406f572-da5c-4a43-baa7-ab03eaf52852 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:28.634132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c406f572-da5c-4a43-baa7-ab03eaf52852 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:28.653133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c406f572-da5c-4a43-baa7-ab03eaf52852 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:28.655384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c406f572-da5c-4a43-baa7-ab03eaf52852 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:28.655938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c406f572-da5c-4a43-baa7-ab03eaf52852 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:28.657011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c406f572-da5c-4a43-baa7-ab03eaf52852 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:28.660280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c406f572-da5c-4a43-baa7-ab03eaf52852 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:28.660914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c406f572-da5c-4a43-baa7-ab03eaf52852 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:28.712822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-119a24e3-688b-4721-b7a3-22f036b751ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:28.724147 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-119a24e3-688b-4721-b7a3-22f036b751ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.447025 Oct 29 01:23:28.728147 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2188/4555] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:28 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:29.045506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c406f572-da5c-4a43-baa7-ab03eaf52852 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:29.045506 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c406f572-da5c-4a43-baa7-ab03eaf52852 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.377030 Oct 29 01:23:29.045506 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2368/4556] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:28 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:29.635287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-737c0076-64bd-4c31-8c2c-9efb628dd1d4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:29.636773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-737c0076-64bd-4c31-8c2c-9efb628dd1d4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:29.645597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-737c0076-64bd-4c31-8c2c-9efb628dd1d4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:29.646926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-737c0076-64bd-4c31-8c2c-9efb628dd1d4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:29.647179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-737c0076-64bd-4c31-8c2c-9efb628dd1d4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:29.648952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-737c0076-64bd-4c31-8c2c-9efb628dd1d4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:29.649731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-737c0076-64bd-4c31-8c2c-9efb628dd1d4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:29.650239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-737c0076-64bd-4c31-8c2c-9efb628dd1d4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:29.752572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-640484f6-f20b-4dd9-a2c4-f2ac392aed23 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:29.754647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-640484f6-f20b-4dd9-a2c4-f2ac392aed23 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:29.757926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:29.764413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-640484f6-f20b-4dd9-a2c4-f2ac392aed23 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:29.765019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-640484f6-f20b-4dd9-a2c4-f2ac392aed23 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:29.765552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-640484f6-f20b-4dd9-a2c4-f2ac392aed23 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:29.768523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-640484f6-f20b-4dd9-a2c4-f2ac392aed23 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:29.768523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-640484f6-f20b-4dd9-a2c4-f2ac392aed23 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:29.768523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-640484f6-f20b-4dd9-a2c4-f2ac392aed23 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:29.827197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-737c0076-64bd-4c31-8c2c-9efb628dd1d4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:29.836276 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-737c0076-64bd-4c31-8c2c-9efb628dd1d4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1318 microversion: 2.1 time: 0.205230 Oct 29 01:23:29.838639 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2189/4557] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:29 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:29.919245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-640484f6-f20b-4dd9-a2c4-f2ac392aed23 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:29.927608 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-640484f6-f20b-4dd9-a2c4-f2ac392aed23 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.179355 Oct 29 01:23:29.930564 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2369/4558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:29 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:30.056895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a61376f3-d709-40a9-9b31-9b099764d69f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:30.057577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a61376f3-d709-40a9-9b31-9b099764d69f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:30.064073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a61376f3-d709-40a9-9b31-9b099764d69f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:30.064761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a61376f3-d709-40a9-9b31-9b099764d69f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:30.065431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a61376f3-d709-40a9-9b31-9b099764d69f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:30.066686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a61376f3-d709-40a9-9b31-9b099764d69f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:30.067362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a61376f3-d709-40a9-9b31-9b099764d69f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:30.068436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a61376f3-d709-40a9-9b31-9b099764d69f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:30.324273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a61376f3-d709-40a9-9b31-9b099764d69f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:30.333657 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a61376f3-d709-40a9-9b31-9b099764d69f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.280750 Oct 29 01:23:30.337208 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2190/4559] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:30 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:30.864746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3851e0fd-8faf-4785-9b2f-b24f24342d39 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:30.878361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3851e0fd-8faf-4785-9b2f-b24f24342d39 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:30.878361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3851e0fd-8faf-4785-9b2f-b24f24342d39 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:30.878361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3851e0fd-8faf-4785-9b2f-b24f24342d39 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:30.878361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3851e0fd-8faf-4785-9b2f-b24f24342d39 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:30.878361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3851e0fd-8faf-4785-9b2f-b24f24342d39 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:30.878361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3851e0fd-8faf-4785-9b2f-b24f24342d39 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:30.878361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3851e0fd-8faf-4785-9b2f-b24f24342d39 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:30.953035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c9a2a37-b510-435b-b333-41992d7993e0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:30.953890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9c9a2a37-b510-435b-b333-41992d7993e0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:30.970459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9a2a37-b510-435b-b333-41992d7993e0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:30.973343 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9a2a37-b510-435b-b333-41992d7993e0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:30.973964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9a2a37-b510-435b-b333-41992d7993e0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:30.978488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9a2a37-b510-435b-b333-41992d7993e0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:30.979178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9a2a37-b510-435b-b333-41992d7993e0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:30.981516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c9a2a37-b510-435b-b333-41992d7993e0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:31.290254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9c9a2a37-b510-435b-b333-41992d7993e0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:31.293122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3851e0fd-8faf-4785-9b2f-b24f24342d39 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:31.303665 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3851e0fd-8faf-4785-9b2f-b24f24342d39 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1318 microversion: 2.1 time: 0.444887 Oct 29 01:23:31.304565 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9c9a2a37-b510-435b-b333-41992d7993e0 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.356314 Oct 29 01:23:31.305464 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2191/4560] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:30 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:31.318610 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2370/4561] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:30 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:31.359325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-29701f12-bf30-407e-8964-47acc353ac9f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:31.360286 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-29701f12-bf30-407e-8964-47acc353ac9f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:31.369458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29701f12-bf30-407e-8964-47acc353ac9f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:31.370102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29701f12-bf30-407e-8964-47acc353ac9f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:31.370640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29701f12-bf30-407e-8964-47acc353ac9f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:31.371348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29701f12-bf30-407e-8964-47acc353ac9f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:31.371803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29701f12-bf30-407e-8964-47acc353ac9f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:31.372289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29701f12-bf30-407e-8964-47acc353ac9f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:31.532040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-29701f12-bf30-407e-8964-47acc353ac9f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:31.541835 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-29701f12-bf30-407e-8964-47acc353ac9f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.187777 Oct 29 01:23:31.558376 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2192/4562] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:31 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:32.335500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-de85254a-c57f-4d6b-a316-3ecc3d956901 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:32.337337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-de85254a-c57f-4d6b-a316-3ecc3d956901 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:32.341466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cc2bccff-bc9f-4eea-befd-af086cc1f912 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:32.343024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cc2bccff-bc9f-4eea-befd-af086cc1f912 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:32.345767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de85254a-c57f-4d6b-a316-3ecc3d956901 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:32.348361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de85254a-c57f-4d6b-a316-3ecc3d956901 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:32.348361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de85254a-c57f-4d6b-a316-3ecc3d956901 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:32.348361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de85254a-c57f-4d6b-a316-3ecc3d956901 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:32.348361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de85254a-c57f-4d6b-a316-3ecc3d956901 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:32.349026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de85254a-c57f-4d6b-a316-3ecc3d956901 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:32.350539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc2bccff-bc9f-4eea-befd-af086cc1f912 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:32.351705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc2bccff-bc9f-4eea-befd-af086cc1f912 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:32.352157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc2bccff-bc9f-4eea-befd-af086cc1f912 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:32.352866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc2bccff-bc9f-4eea-befd-af086cc1f912 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:32.353364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc2bccff-bc9f-4eea-befd-af086cc1f912 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:32.353795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc2bccff-bc9f-4eea-befd-af086cc1f912 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:32.651084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cc2bccff-bc9f-4eea-befd-af086cc1f912 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:32.662262 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cc2bccff-bc9f-4eea-befd-af086cc1f912 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1318 microversion: 2.1 time: 0.324659 Oct 29 01:23:32.668006 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2193/4563] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:32 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:32.679270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-22641cab-0697-4b37-9e0b-46e4c10c0650 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:32.680393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-22641cab-0697-4b37-9e0b-46e4c10c0650 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:32.699473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22641cab-0697-4b37-9e0b-46e4c10c0650 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:32.700429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22641cab-0697-4b37-9e0b-46e4c10c0650 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:32.701102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22641cab-0697-4b37-9e0b-46e4c10c0650 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:32.706825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22641cab-0697-4b37-9e0b-46e4c10c0650 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:32.707187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22641cab-0697-4b37-9e0b-46e4c10c0650 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:32.707707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22641cab-0697-4b37-9e0b-46e4c10c0650 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:32.725580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-de85254a-c57f-4d6b-a316-3ecc3d956901 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:32.746415 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-de85254a-c57f-4d6b-a316-3ecc3d956901 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.415859 Oct 29 01:23:32.749384 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2371/4564] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:32 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:32.898935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-22641cab-0697-4b37-9e0b-46e4c10c0650 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:32.912183 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-22641cab-0697-4b37-9e0b-46e4c10c0650 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.241473 Oct 29 01:23:32.928507 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2194/4565] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:32 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:33.105293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-387eadc3-db76-49fb-80cf-357bc5d163c9 req-f5baf051-783e-4d5d-a017-5f6d8423567f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63371d26-fe85-4cfa-bdca-c8ad84b81ee6", "name": "network-vif-plugged", "status": "completed", "tag": "f93b16c7-df1a-462b-be91-442aa008d850"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:33.124970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-387eadc3-db76-49fb-80cf-357bc5d163c9 req-f5baf051-783e-4d5d-a017-5f6d8423567f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:33.126152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-387eadc3-db76-49fb-80cf-357bc5d163c9 req-f5baf051-783e-4d5d-a017-5f6d8423567f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:33.126756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-387eadc3-db76-49fb-80cf-357bc5d163c9 req-f5baf051-783e-4d5d-a017-5f6d8423567f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:33.143879 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-387eadc3-db76-49fb-80cf-357bc5d163c9 req-f5baf051-783e-4d5d-a017-5f6d8423567f service nova] Creating event network-vif-plugged:f93b16c7-df1a-462b-be91-442aa008d850 for instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 on n-h2-862964-3 Oct 29 01:23:33.154292 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-387eadc3-db76-49fb-80cf-357bc5d163c9 req-f5baf051-783e-4d5d-a017-5f6d8423567f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056918 Oct 29 01:23:33.159537 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2372/4566] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:33.698933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-16beb8c5-555f-42ad-80b0-537b588f0b3e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:33.700777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-16beb8c5-555f-42ad-80b0-537b588f0b3e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:33.713793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16beb8c5-555f-42ad-80b0-537b588f0b3e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:33.714626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16beb8c5-555f-42ad-80b0-537b588f0b3e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:33.717073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16beb8c5-555f-42ad-80b0-537b588f0b3e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:33.717073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16beb8c5-555f-42ad-80b0-537b588f0b3e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:33.717073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16beb8c5-555f-42ad-80b0-537b588f0b3e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:33.717073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16beb8c5-555f-42ad-80b0-537b588f0b3e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:33.773314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7d3ce225-d949-490d-b2a9-525f684fd4de tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:33.774751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7d3ce225-d949-490d-b2a9-525f684fd4de tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:33.788476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d3ce225-d949-490d-b2a9-525f684fd4de tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:33.789004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d3ce225-d949-490d-b2a9-525f684fd4de tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:33.789487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d3ce225-d949-490d-b2a9-525f684fd4de tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:33.793433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d3ce225-d949-490d-b2a9-525f684fd4de tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:33.794452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d3ce225-d949-490d-b2a9-525f684fd4de tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:33.795169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d3ce225-d949-490d-b2a9-525f684fd4de tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:34.149502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-16beb8c5-555f-42ad-80b0-537b588f0b3e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:34.162354 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-16beb8c5-555f-42ad-80b0-537b588f0b3e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1318 microversion: 2.1 time: 0.468622 Oct 29 01:23:34.182412 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2195/4567] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:33 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:34.200268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c49a526f-c4a8-410f-8c3b-c9144893b93c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:34.201344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c49a526f-c4a8-410f-8c3b-c9144893b93c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:34.219275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c49a526f-c4a8-410f-8c3b-c9144893b93c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:34.219275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c49a526f-c4a8-410f-8c3b-c9144893b93c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:34.219275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c49a526f-c4a8-410f-8c3b-c9144893b93c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:34.233873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c49a526f-c4a8-410f-8c3b-c9144893b93c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:34.234399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c49a526f-c4a8-410f-8c3b-c9144893b93c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:34.240217 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c49a526f-c4a8-410f-8c3b-c9144893b93c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:34.447911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7d3ce225-d949-490d-b2a9-525f684fd4de tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:34.457401 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7d3ce225-d949-490d-b2a9-525f684fd4de tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.688671 Oct 29 01:23:34.458364 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2373/4568] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:33 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:34.628273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c49a526f-c4a8-410f-8c3b-c9144893b93c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:34.668047 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c49a526f-c4a8-410f-8c3b-c9144893b93c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1506 microversion: 2.1 time: 0.484092 Oct 29 01:23:34.682069 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2196/4569] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:34 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1506 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:35.196778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1e982597-e4a7-45b5-b8d2-da72d7ecb9a4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:35.198269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1e982597-e4a7-45b5-b8d2-da72d7ecb9a4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:35.225118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e982597-e4a7-45b5-b8d2-da72d7ecb9a4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:35.225640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e982597-e4a7-45b5-b8d2-da72d7ecb9a4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:35.226083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e982597-e4a7-45b5-b8d2-da72d7ecb9a4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:35.226796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e982597-e4a7-45b5-b8d2-da72d7ecb9a4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:35.227439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e982597-e4a7-45b5-b8d2-da72d7ecb9a4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:35.227870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e982597-e4a7-45b5-b8d2-da72d7ecb9a4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:35.394064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1e982597-e4a7-45b5-b8d2-da72d7ecb9a4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:35.410223 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1e982597-e4a7-45b5-b8d2-da72d7ecb9a4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1318 microversion: 2.1 time: 0.217950 Oct 29 01:23:35.410824 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2374/4570] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:35 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:35.481476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6f8f16d3-b99a-416f-ac9a-81bcbee21c80 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:35.482734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6f8f16d3-b99a-416f-ac9a-81bcbee21c80 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:35.494389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f8f16d3-b99a-416f-ac9a-81bcbee21c80 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:35.494818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f8f16d3-b99a-416f-ac9a-81bcbee21c80 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:35.495252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f8f16d3-b99a-416f-ac9a-81bcbee21c80 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:35.495959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f8f16d3-b99a-416f-ac9a-81bcbee21c80 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:35.496413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f8f16d3-b99a-416f-ac9a-81bcbee21c80 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:35.497581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f8f16d3-b99a-416f-ac9a-81bcbee21c80 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:35.663221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6f8f16d3-b99a-416f-ac9a-81bcbee21c80 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:35.671516 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6f8f16d3-b99a-416f-ac9a-81bcbee21c80 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.193929 Oct 29 01:23:35.672196 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2197/4571] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:35 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:35.695130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-71c7ddf3-bf20-4274-80d6-51c19170a8d7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:35.695891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-71c7ddf3-bf20-4274-80d6-51c19170a8d7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:35.705421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71c7ddf3-bf20-4274-80d6-51c19170a8d7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:35.706882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71c7ddf3-bf20-4274-80d6-51c19170a8d7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:35.707399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71c7ddf3-bf20-4274-80d6-51c19170a8d7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:35.708251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71c7ddf3-bf20-4274-80d6-51c19170a8d7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:35.708857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71c7ddf3-bf20-4274-80d6-51c19170a8d7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:35.709323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71c7ddf3-bf20-4274-80d6-51c19170a8d7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:35.893103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-71c7ddf3-bf20-4274-80d6-51c19170a8d7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:35.903979 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-71c7ddf3-bf20-4274-80d6-51c19170a8d7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1486 microversion: 2.1 time: 0.212847 Oct 29 01:23:35.916659 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2375/4572] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:35 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1486 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:36.092243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0c7d2b3b-1e30-483e-b551-ca0f49407e5d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-146658090", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:36.182898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-0c7d2b3b-1e30-483e-b551-ca0f49407e5d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] validate_networks() for [('20341499-3199-40e1-8e7c-461b0e453acb', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:23:36.434736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ba1e9164-fe3c-490f-83a9-e0784ea2a39d tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:36.435505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ba1e9164-fe3c-490f-83a9-e0784ea2a39d tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:36.443136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba1e9164-fe3c-490f-83a9-e0784ea2a39d tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:36.443631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba1e9164-fe3c-490f-83a9-e0784ea2a39d tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:36.444059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba1e9164-fe3c-490f-83a9-e0784ea2a39d tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:36.444755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba1e9164-fe3c-490f-83a9-e0784ea2a39d tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:36.445240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba1e9164-fe3c-490f-83a9-e0784ea2a39d tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:36.445648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba1e9164-fe3c-490f-83a9-e0784ea2a39d tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:36.717727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ba1e9164-fe3c-490f-83a9-e0784ea2a39d tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:36.733423 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ba1e9164-fe3c-490f-83a9-e0784ea2a39d tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1318 microversion: 2.1 time: 0.302527 Oct 29 01:23:36.735286 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2376/4573] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:36 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:36.737144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-0c7d2b3b-1e30-483e-b551-ca0f49407e5d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:23:36.737850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-0c7d2b3b-1e30-483e-b551-ca0f49407e5d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:23:36.738540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-0c7d2b3b-1e30-483e-b551-ca0f49407e5d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:23:36.739110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-0c7d2b3b-1e30-483e-b551-ca0f49407e5d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:23:36.739679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-0c7d2b3b-1e30-483e-b551-ca0f49407e5d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:23:36.740254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-95dae8b8-5760-402b-a4fa-918ee399ecb5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:36.740862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-95dae8b8-5760-402b-a4fa-918ee399ecb5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:36.747030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95dae8b8-5760-402b-a4fa-918ee399ecb5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:36.747513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95dae8b8-5760-402b-a4fa-918ee399ecb5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:36.748135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95dae8b8-5760-402b-a4fa-918ee399ecb5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:36.749004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95dae8b8-5760-402b-a4fa-918ee399ecb5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:36.749485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95dae8b8-5760-402b-a4fa-918ee399ecb5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:36.750079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c7d2b3b-1e30-483e-b551-ca0f49407e5d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:36.750332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95dae8b8-5760-402b-a4fa-918ee399ecb5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:36.750783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c7d2b3b-1e30-483e-b551-ca0f49407e5d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:36.751227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c7d2b3b-1e30-483e-b551-ca0f49407e5d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:36.752039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c7d2b3b-1e30-483e-b551-ca0f49407e5d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:36.752498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c7d2b3b-1e30-483e-b551-ca0f49407e5d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:36.753651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c7d2b3b-1e30-483e-b551-ca0f49407e5d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:36.774422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-0c7d2b3b-1e30-483e-b551-ca0f49407e5d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Getting quotas for project cf83fbbe41fd41bdb4b862d44634cf4c. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:23:36.779930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-0c7d2b3b-1e30-483e-b551-ca0f49407e5d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Getting quotas for user 1089d449eff3454394061a44dd6ad52d and project cf83fbbe41fd41bdb4b862d44634cf4c. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:23:36.793258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0c7d2b3b-1e30-483e-b551-ca0f49407e5d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:23:36.795586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0c7d2b3b-1e30-483e-b551-ca0f49407e5d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:23:36.922612 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0c7d2b3b-1e30-483e-b551-ca0f49407e5d tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.836053 Oct 29 01:23:36.924128 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2198/4574] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:23:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:23:36.931365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-95dae8b8-5760-402b-a4fa-918ee399ecb5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:36.942333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-171cf019-6e1d-419e-bc7f-3498ca818616 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:36.942586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-171cf019-6e1d-419e-bc7f-3498ca818616 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:36.944758 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-95dae8b8-5760-402b-a4fa-918ee399ecb5 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.208411 Oct 29 01:23:36.945843 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2377/4575] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:36 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:37.030481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-171cf019-6e1d-419e-bc7f-3498ca818616 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:37.038079 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-171cf019-6e1d-419e-bc7f-3498ca818616 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1213 microversion: 2.1 time: 0.101572 Oct 29 01:23:37.041995 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2199/4576] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:36 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:37.543854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-3f87a45a-e2b7-40c7-b9a8-5c13fb25eb8b req-cdc32942-ad00-467a-9a80-5ac68e10806c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7616f1ea-1339-425c-9ab9-45431f3cd608", "name": "network-vif-plugged", "status": "completed", "tag": "1f225c5e-7d18-4b8d-9938-9a97f24a39fc"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:37.555810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-3f87a45a-e2b7-40c7-b9a8-5c13fb25eb8b req-cdc32942-ad00-467a-9a80-5ac68e10806c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:37.556300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-3f87a45a-e2b7-40c7-b9a8-5c13fb25eb8b req-cdc32942-ad00-467a-9a80-5ac68e10806c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:37.556735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-3f87a45a-e2b7-40c7-b9a8-5c13fb25eb8b req-cdc32942-ad00-467a-9a80-5ac68e10806c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:37.568619 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-3f87a45a-e2b7-40c7-b9a8-5c13fb25eb8b req-cdc32942-ad00-467a-9a80-5ac68e10806c service nova] Creating event network-vif-plugged:1f225c5e-7d18-4b8d-9938-9a97f24a39fc for instance 7616f1ea-1339-425c-9ab9-45431f3cd608 on n-h2-862964-3 Oct 29 01:23:37.574080 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-3f87a45a-e2b7-40c7-b9a8-5c13fb25eb8b req-cdc32942-ad00-467a-9a80-5ac68e10806c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033964 Oct 29 01:23:37.576851 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2378/4577] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:37.757490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-915d9987-39ad-4a6a-8660-7820f93f6008 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:37.758109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-915d9987-39ad-4a6a-8660-7820f93f6008 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:37.765115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-915d9987-39ad-4a6a-8660-7820f93f6008 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:37.765627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-915d9987-39ad-4a6a-8660-7820f93f6008 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:37.766064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-915d9987-39ad-4a6a-8660-7820f93f6008 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:37.766753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-915d9987-39ad-4a6a-8660-7820f93f6008 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:37.767296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-915d9987-39ad-4a6a-8660-7820f93f6008 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:37.767718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-915d9987-39ad-4a6a-8660-7820f93f6008 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:37.901056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-915d9987-39ad-4a6a-8660-7820f93f6008 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:37.909732 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-915d9987-39ad-4a6a-8660-7820f93f6008 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1318 microversion: 2.1 time: 0.155624 Oct 29 01:23:37.910328 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2200/4578] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:37 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:37.969065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-06c0b456-1843-4bca-880d-699530ae7326 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:37.978601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-06c0b456-1843-4bca-880d-699530ae7326 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:37.978601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06c0b456-1843-4bca-880d-699530ae7326 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:37.978601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06c0b456-1843-4bca-880d-699530ae7326 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:37.978601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06c0b456-1843-4bca-880d-699530ae7326 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:37.979182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06c0b456-1843-4bca-880d-699530ae7326 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:37.979840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06c0b456-1843-4bca-880d-699530ae7326 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:37.980260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06c0b456-1843-4bca-880d-699530ae7326 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:38.063035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-91bca2ec-7562-4deb-87f4-3e0f9057f64c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:38.064020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-91bca2ec-7562-4deb-87f4-3e0f9057f64c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:38.071622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91bca2ec-7562-4deb-87f4-3e0f9057f64c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:38.072219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91bca2ec-7562-4deb-87f4-3e0f9057f64c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:38.072889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91bca2ec-7562-4deb-87f4-3e0f9057f64c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:38.073700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91bca2ec-7562-4deb-87f4-3e0f9057f64c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:38.074360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91bca2ec-7562-4deb-87f4-3e0f9057f64c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:38.074861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91bca2ec-7562-4deb-87f4-3e0f9057f64c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:38.161809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-91bca2ec-7562-4deb-87f4-3e0f9057f64c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:38.165594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-06c0b456-1843-4bca-880d-699530ae7326 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:38.169861 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-91bca2ec-7562-4deb-87f4-3e0f9057f64c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1217 microversion: 2.1 time: 0.110961 Oct 29 01:23:38.170754 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2201/4579] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:38 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:38.174885 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-06c0b456-1843-4bca-880d-699530ae7326 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.209581 Oct 29 01:23:38.175467 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2379/4580] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:37 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:38.934058 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5d0321aa-1ff0-4ba9-95b2-f4934c51f55a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:38.934768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5d0321aa-1ff0-4ba9-95b2-f4934c51f55a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:38.942036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d0321aa-1ff0-4ba9-95b2-f4934c51f55a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:38.942526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d0321aa-1ff0-4ba9-95b2-f4934c51f55a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:38.943033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d0321aa-1ff0-4ba9-95b2-f4934c51f55a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:38.943762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d0321aa-1ff0-4ba9-95b2-f4934c51f55a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:38.944216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d0321aa-1ff0-4ba9-95b2-f4934c51f55a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:38.944637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d0321aa-1ff0-4ba9-95b2-f4934c51f55a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:39.102652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5d0321aa-1ff0-4ba9-95b2-f4934c51f55a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:39.115190 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5d0321aa-1ff0-4ba9-95b2-f4934c51f55a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1318 microversion: 2.1 time: 0.185512 Oct 29 01:23:39.117456 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2202/4581] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:38 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:39.193318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b37d391-104a-4839-b611-00113d282904 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:39.193946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7b37d391-104a-4839-b611-00113d282904 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:39.199836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3da7e2a4-87d1-45bd-bf69-7a3ff2e29d5f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:39.200456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3da7e2a4-87d1-45bd-bf69-7a3ff2e29d5f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:39.201348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b37d391-104a-4839-b611-00113d282904 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:39.201847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b37d391-104a-4839-b611-00113d282904 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:39.202289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b37d391-104a-4839-b611-00113d282904 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:39.203023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b37d391-104a-4839-b611-00113d282904 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:39.203483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b37d391-104a-4839-b611-00113d282904 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:39.203924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b37d391-104a-4839-b611-00113d282904 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:39.207656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3da7e2a4-87d1-45bd-bf69-7a3ff2e29d5f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:39.214111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3da7e2a4-87d1-45bd-bf69-7a3ff2e29d5f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:39.214111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3da7e2a4-87d1-45bd-bf69-7a3ff2e29d5f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:39.214111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3da7e2a4-87d1-45bd-bf69-7a3ff2e29d5f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:39.214111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3da7e2a4-87d1-45bd-bf69-7a3ff2e29d5f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:39.214111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3da7e2a4-87d1-45bd-bf69-7a3ff2e29d5f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:39.214954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:39.479139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7b37d391-104a-4839-b611-00113d282904 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:39.547101 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7b37d391-104a-4839-b611-00113d282904 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1265 microversion: 2.1 time: 0.357042 Oct 29 01:23:39.548168 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2380/4582] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:39 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1265 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:39.899477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3da7e2a4-87d1-45bd-bf69-7a3ff2e29d5f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:39.912087 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3da7e2a4-87d1-45bd-bf69-7a3ff2e29d5f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1518 microversion: 2.1 time: 0.715945 Oct 29 01:23:39.915168 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2203/4583] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:39 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1518 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:40.042678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-602e382e-d6fb-4b60-b98a-570b26aef15e tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "097b82ed-ea17-41de-b900-2af8a427fa73"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:40.048476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-602e382e-d6fb-4b60-b98a-570b26aef15e tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:40.057891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-602e382e-d6fb-4b60-b98a-570b26aef15e tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:40.058327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-602e382e-d6fb-4b60-b98a-570b26aef15e tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:40.058867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-602e382e-d6fb-4b60-b98a-570b26aef15e tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:40.059673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-602e382e-d6fb-4b60-b98a-570b26aef15e tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:40.060229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-602e382e-d6fb-4b60-b98a-570b26aef15e tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:40.060854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-602e382e-d6fb-4b60-b98a-570b26aef15e tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:40.146115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1a08f580-2d26-4e5d-98ad-34a79302df41 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:40.146115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1a08f580-2d26-4e5d-98ad-34a79302df41 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:40.154234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a08f580-2d26-4e5d-98ad-34a79302df41 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:40.155192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a08f580-2d26-4e5d-98ad-34a79302df41 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:40.155818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a08f580-2d26-4e5d-98ad-34a79302df41 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:40.156744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a08f580-2d26-4e5d-98ad-34a79302df41 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:40.157529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a08f580-2d26-4e5d-98ad-34a79302df41 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:40.158062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a08f580-2d26-4e5d-98ad-34a79302df41 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:40.203856 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-602e382e-d6fb-4b60-b98a-570b26aef15e tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] HTTP exception thrown: Volume 097b82ed-ea17-41de-b900-2af8a427fa73 could not be found. Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-602e382e-d6fb-4b60-b98a-570b26aef15e tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] Request method failure captured: Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: request: PUT /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments/670389cf-00ce-4035-b4d4-b9a2feedd2b1 HTTP/1.1 Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 74 Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIAPyaPww8dzsPZk0SoE02qZPrjV72uHGjVWxmQYEBDAbqt-gXQA_A-LbcaXOGrOCin2FJnoxj_gReEz9IfuHi-OLYOab0CK28SGGWrlfXGSW41O9EWr3KcC1MbAwteDjX9bid33k0pOtGiszVkNn7fLV521MNkVbL81DdXD2pSM0B0 Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 65a4554f9ed24a95b077cd602602b3c9 Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-VolumesAdminNegativeTest-953699152 Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/65a4554f9ed24a95b077cd602602b3c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/65a4554f9ed24a95b077cd602602b3c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/65a4554f9ed24a95b077cd602602b3c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_65a4554f9ed24a95b077cd602602b3c9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-VolumesAdminNegativeTest-953699152 Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 65a4554f9ed24a95b077cd602602b3c9 Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-953699152 Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-VolumesAdminNegativeTest-953699152-project-admin Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: a505e95dd74142d38c776fd9b320ed6a Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-VolumesAdminNegativeTest-953699152-project-admin Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: {"volumeAttachment": {"volumeId": "097b82ed-ea17-41de-b900-2af8a427fa73"}} Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: exception: Volume 097b82ed-ea17-41de-b900-2af8a427fa73 could not be found. Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'server_id': '960fd6c4-4418-4490-a15c-5b02d54b2097', 'id': '670389cf-00ce-4035-b4d4-b9a2feedd2b1', 'body': {'volumeAttachment': {'volumeId': '097b82ed-ea17-41de-b900-2af8a427fa73'}}} Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 097b82ed-ea17-41de-b900-2af8a427fa73 could not be found. (HTTP 404) (Request-ID: req-64dcc77e-b11b-4369-848b-6a45e3f274d5) Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 01:23:40.206900 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 097b82ed-ea17-41de-b900-2af8a427fa73 could not be found. Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 097b82ed-ea17-41de-b900-2af8a427fa73 could not be found. Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 097b82ed-ea17-41de-b900-2af8a427fa73 could not be found. Oct 29 01:23:40.211514 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:40.215962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-602e382e-d6fb-4b60-b98a-570b26aef15e tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] Returning 400 to user: Volume 097b82ed-ea17-41de-b900-2af8a427fa73 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:23:40.215962 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-602e382e-d6fb-4b60-b98a-570b26aef15e tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] 10.222.0.26 "PUT /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments/670389cf-00ce-4035-b4d4-b9a2feedd2b1" status: 400 len: 107 microversion: 2.1 time: 0.663781 Oct 29 01:23:40.215962 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2381/4584] 10.222.0.26 () {60 vars in 1433 bytes} [Sat Oct 29 01:23:39 2022] PUT /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments/670389cf-00ce-4035-b4d4-b9a2feedd2b1 => generated 107 bytes in 665 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:23:40.354547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8ff85a3e-58ea-405c-b335-1ffddee164e2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:40.355250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8ff85a3e-58ea-405c-b335-1ffddee164e2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:40.363316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ff85a3e-58ea-405c-b335-1ffddee164e2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:40.364327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ff85a3e-58ea-405c-b335-1ffddee164e2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:40.364924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ff85a3e-58ea-405c-b335-1ffddee164e2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:40.365820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ff85a3e-58ea-405c-b335-1ffddee164e2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:40.366492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ff85a3e-58ea-405c-b335-1ffddee164e2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:40.367124 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ff85a3e-58ea-405c-b335-1ffddee164e2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:40.464715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1a08f580-2d26-4e5d-98ad-34a79302df41 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:40.477432 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1a08f580-2d26-4e5d-98ad-34a79302df41 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1318 microversion: 2.1 time: 0.336212 Oct 29 01:23:40.485100 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2204/4585] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:40 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:40.523641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-8ff85a3e-58ea-405c-b335-1ffddee164e2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lazy-loading 'services' on Instance uuid 960fd6c4-4418-4490-a15c-5b02d54b2097 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:23:40.582633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-99bc8e46-41e5-44d8-a1ff-b6af86b1f155 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:40.586218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-99bc8e46-41e5-44d8-a1ff-b6af86b1f155 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:40.613065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99bc8e46-41e5-44d8-a1ff-b6af86b1f155 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:40.621400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99bc8e46-41e5-44d8-a1ff-b6af86b1f155 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:40.624320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99bc8e46-41e5-44d8-a1ff-b6af86b1f155 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:40.625238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99bc8e46-41e5-44d8-a1ff-b6af86b1f155 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:40.625810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99bc8e46-41e5-44d8-a1ff-b6af86b1f155 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:40.629210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99bc8e46-41e5-44d8-a1ff-b6af86b1f155 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:40.824845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-99bc8e46-41e5-44d8-a1ff-b6af86b1f155 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:40.839788 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-99bc8e46-41e5-44d8-a1ff-b6af86b1f155 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1271 microversion: 2.1 time: 0.268600 Oct 29 01:23:40.841956 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2205/4586] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:40 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1271 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:40.937607 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8ff85a3e-58ea-405c-b335-1ffddee164e2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "DELETE /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments/670389cf-00ce-4035-b4d4-b9a2feedd2b1" status: 202 len: 0 microversion: 2.1 time: 0.586766 Oct 29 01:23:40.938802 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2382/4587] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 29 01:23:40 2022] DELETE /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments/670389cf-00ce-4035-b4d4-b9a2feedd2b1 => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:23:40.939191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bd3c221e-4781-4c8c-be7f-a1d8c5606a7c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:40.940105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bd3c221e-4781-4c8c-be7f-a1d8c5606a7c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:40.952490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-19f1e1bc-f9c6-405c-8458-0c364b263148 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:40.955165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-19f1e1bc-f9c6-405c-8458-0c364b263148 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:40.958788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd3c221e-4781-4c8c-be7f-a1d8c5606a7c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:40.962198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd3c221e-4781-4c8c-be7f-a1d8c5606a7c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:40.962198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd3c221e-4781-4c8c-be7f-a1d8c5606a7c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:40.963456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd3c221e-4781-4c8c-be7f-a1d8c5606a7c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:40.964549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19f1e1bc-f9c6-405c-8458-0c364b263148 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:40.965230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19f1e1bc-f9c6-405c-8458-0c364b263148 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:40.965807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19f1e1bc-f9c6-405c-8458-0c364b263148 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:40.966365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd3c221e-4781-4c8c-be7f-a1d8c5606a7c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:40.966837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd3c221e-4781-4c8c-be7f-a1d8c5606a7c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:40.967066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19f1e1bc-f9c6-405c-8458-0c364b263148 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:40.967670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19f1e1bc-f9c6-405c-8458-0c364b263148 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:40.968181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19f1e1bc-f9c6-405c-8458-0c364b263148 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:41.005051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:41.024404 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-19f1e1bc-f9c6-405c-8458-0c364b263148 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079899 Oct 29 01:23:41.025446 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2383/4588] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:23:40 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:41.443103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bd3c221e-4781-4c8c-be7f-a1d8c5606a7c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:41.450922 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bd3c221e-4781-4c8c-be7f-a1d8c5606a7c tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.516600 Oct 29 01:23:41.451522 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2206/4589] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:40 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:41.476250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6ff21261-9497-4b45-84c8-f7fa97c54927 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:41.476929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6ff21261-9497-4b45-84c8-f7fa97c54927 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:41.484724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ff21261-9497-4b45-84c8-f7fa97c54927 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:41.485364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ff21261-9497-4b45-84c8-f7fa97c54927 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:41.485841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ff21261-9497-4b45-84c8-f7fa97c54927 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:41.486575 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ff21261-9497-4b45-84c8-f7fa97c54927 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:41.487677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ff21261-9497-4b45-84c8-f7fa97c54927 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:41.488255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ff21261-9497-4b45-84c8-f7fa97c54927 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:41.509653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-29e65a3b-aea2-400c-94fe-03aec7ee02bd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:41.510901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-29e65a3b-aea2-400c-94fe-03aec7ee02bd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:41.520158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29e65a3b-aea2-400c-94fe-03aec7ee02bd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:41.520955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29e65a3b-aea2-400c-94fe-03aec7ee02bd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:41.521453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29e65a3b-aea2-400c-94fe-03aec7ee02bd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:41.522413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29e65a3b-aea2-400c-94fe-03aec7ee02bd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:41.522946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29e65a3b-aea2-400c-94fe-03aec7ee02bd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:41.523472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29e65a3b-aea2-400c-94fe-03aec7ee02bd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:42.057734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6ff21261-9497-4b45-84c8-f7fa97c54927 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:42.070229 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6ff21261-9497-4b45-84c8-f7fa97c54927 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.597926 Oct 29 01:23:42.087688 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2384/4590] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:41 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:42.111220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6a89c158-45a5-44d3-b020-bf9a0c6c8800 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:42.112640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6a89c158-45a5-44d3-b020-bf9a0c6c8800 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:42.131058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a89c158-45a5-44d3-b020-bf9a0c6c8800 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:42.131446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-29e65a3b-aea2-400c-94fe-03aec7ee02bd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:42.131589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a89c158-45a5-44d3-b020-bf9a0c6c8800 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:42.131997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a89c158-45a5-44d3-b020-bf9a0c6c8800 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:42.132715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a89c158-45a5-44d3-b020-bf9a0c6c8800 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:42.133191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a89c158-45a5-44d3-b020-bf9a0c6c8800 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:42.133801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a89c158-45a5-44d3-b020-bf9a0c6c8800 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:42.145909 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-29e65a3b-aea2-400c-94fe-03aec7ee02bd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1318 microversion: 2.1 time: 0.637910 Oct 29 01:23:42.149270 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2207/4591] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:41 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1318 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:42.166033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d6d4a6a3-e60a-4ec5-b854-1817e2bc706d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:42.172742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d6d4a6a3-e60a-4ec5-b854-1817e2bc706d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:42.203752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6d4a6a3-e60a-4ec5-b854-1817e2bc706d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:42.205421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6d4a6a3-e60a-4ec5-b854-1817e2bc706d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:42.205421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6d4a6a3-e60a-4ec5-b854-1817e2bc706d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:42.210089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6d4a6a3-e60a-4ec5-b854-1817e2bc706d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:42.210898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6d4a6a3-e60a-4ec5-b854-1817e2bc706d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:42.211556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6d4a6a3-e60a-4ec5-b854-1817e2bc706d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:42.298844 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d6d4a6a3-e60a-4ec5-b854-1817e2bc706d tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146653 Oct 29 01:23:42.300188 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2208/4592] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:23:42 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:42.310604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c7b63bd7-13c8-47b3-aa02-61c8e9129271 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:42.311770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c7b63bd7-13c8-47b3-aa02-61c8e9129271 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:42.323025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7b63bd7-13c8-47b3-aa02-61c8e9129271 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:42.323524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7b63bd7-13c8-47b3-aa02-61c8e9129271 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:42.323960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7b63bd7-13c8-47b3-aa02-61c8e9129271 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:42.324865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7b63bd7-13c8-47b3-aa02-61c8e9129271 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:42.325648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7b63bd7-13c8-47b3-aa02-61c8e9129271 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:42.332013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7b63bd7-13c8-47b3-aa02-61c8e9129271 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:42.841533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c7b63bd7-13c8-47b3-aa02-61c8e9129271 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:42.850317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6a89c158-45a5-44d3-b020-bf9a0c6c8800 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:42.857964 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c7b63bd7-13c8-47b3-aa02-61c8e9129271 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.555846 Oct 29 01:23:42.860277 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2209/4593] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:42 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:42.883944 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6a89c158-45a5-44d3-b020-bf9a0c6c8800 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1313 microversion: 2.1 time: 0.788574 Oct 29 01:23:42.889254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-06fe5698-f322-4a66-ae07-c0f8be431efa tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:42.892193 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2385/4594] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:42 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1313 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:42.924191 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-06fe5698-f322-4a66-ae07-c0f8be431efa tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance a023bfc8-6e73-47c5-8977-d7a979524b6d has no mapping to a cell. Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-06fe5698-f322-4a66-ae07-c0f8be431efa tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/a023bfc8-6e73-47c5-8977-d7a979524b6d/action HTTP/1.1 Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 15 Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: {"os-stop": {}} Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance a023bfc8-6e73-47c5-8977-d7a979524b6d has no mapping to a cell. Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'a023bfc8-6e73-47c5-8977-d7a979524b6d', 'body': {'os-stop': {}}} Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance a023bfc8-6e73-47c5-8977-d7a979524b6d has no mapping to a cell. Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:23:42.941266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a023bfc8-6e73-47c5-8977-d7a979524b6d has no mapping to a cell. Oct 29 01:23:42.951138 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:42.951138 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:42.951138 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:42.951138 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:42.951138 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:42.951138 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:42.951138 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:23:42.951138 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:23:42.951138 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a023bfc8-6e73-47c5-8977-d7a979524b6d has no mapping to a cell. Oct 29 01:23:42.951138 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:42.951138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-06fe5698-f322-4a66-ae07-c0f8be431efa tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance a023bfc8-6e73-47c5-8977-d7a979524b6d has no mapping to a cell. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:23:42.951138 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-06fe5698-f322-4a66-ae07-c0f8be431efa tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/a023bfc8-6e73-47c5-8977-d7a979524b6d/action" status: 404 len: 117 microversion: 2.1 time: 0.060619 Oct 29 01:23:42.951138 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2210/4595] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:23:42 2022] POST /compute/v2.1/servers/a023bfc8-6e73-47c5-8977-d7a979524b6d/action => generated 117 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:23:42.955046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5a09a082-b862-4a5c-a21e-150c34719ec7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:42.956225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5a09a082-b862-4a5c-a21e-150c34719ec7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:42.969001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a09a082-b862-4a5c-a21e-150c34719ec7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:42.969531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a09a082-b862-4a5c-a21e-150c34719ec7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:42.972178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a09a082-b862-4a5c-a21e-150c34719ec7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:42.973058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a09a082-b862-4a5c-a21e-150c34719ec7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:42.975284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a09a082-b862-4a5c-a21e-150c34719ec7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:42.975783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a09a082-b862-4a5c-a21e-150c34719ec7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:43.043646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-e138e7fa-3cbb-4850-9a01-2e78927ba478 req-3f4a1612-dede-48d3-a849-de2fdf62d2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391c56c8-b8d8-424c-91d7-dc0408b9e71d", "name": "network-vif-plugged", "status": "completed", "tag": "bfe88ae5-26ce-42b9-a002-0635e32f69b1"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:43.074353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e138e7fa-3cbb-4850-9a01-2e78927ba478 req-3f4a1612-dede-48d3-a849-de2fdf62d2b6 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:43.074353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e138e7fa-3cbb-4850-9a01-2e78927ba478 req-3f4a1612-dede-48d3-a849-de2fdf62d2b6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:43.074353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e138e7fa-3cbb-4850-9a01-2e78927ba478 req-3f4a1612-dede-48d3-a849-de2fdf62d2b6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:43.104837 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-e138e7fa-3cbb-4850-9a01-2e78927ba478 req-3f4a1612-dede-48d3-a849-de2fdf62d2b6 service nova] Creating event network-vif-plugged:bfe88ae5-26ce-42b9-a002-0635e32f69b1 for instance 391c56c8-b8d8-424c-91d7-dc0408b9e71d on n-h2-862964-3 Oct 29 01:23:43.118760 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-e138e7fa-3cbb-4850-9a01-2e78927ba478 req-3f4a1612-dede-48d3-a849-de2fdf62d2b6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079552 Oct 29 01:23:43.120538 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2211/4596] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:23:43.181914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-333b2e1a-d26d-4e5d-8149-3caa9131808b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:43.183051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-333b2e1a-d26d-4e5d-8149-3caa9131808b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:43.198733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-333b2e1a-d26d-4e5d-8149-3caa9131808b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:43.198896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-333b2e1a-d26d-4e5d-8149-3caa9131808b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:43.199324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-333b2e1a-d26d-4e5d-8149-3caa9131808b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:43.200161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-333b2e1a-d26d-4e5d-8149-3caa9131808b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:43.208537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-333b2e1a-d26d-4e5d-8149-3caa9131808b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:43.209187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-333b2e1a-d26d-4e5d-8149-3caa9131808b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:43.341286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5a09a082-b862-4a5c-a21e-150c34719ec7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:43.355264 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5a09a082-b862-4a5c-a21e-150c34719ec7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.400518 Oct 29 01:23:43.356826 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2386/4597] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:42 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:43.373916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c86b635f-0575-4619-9464-5ee8e65c3558 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:43.376559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c86b635f-0575-4619-9464-5ee8e65c3558 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:43.394060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c86b635f-0575-4619-9464-5ee8e65c3558 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:43.396361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c86b635f-0575-4619-9464-5ee8e65c3558 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:43.404034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c86b635f-0575-4619-9464-5ee8e65c3558 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:43.404034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c86b635f-0575-4619-9464-5ee8e65c3558 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:43.404034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c86b635f-0575-4619-9464-5ee8e65c3558 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:43.404034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c86b635f-0575-4619-9464-5ee8e65c3558 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:43.505331 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c86b635f-0575-4619-9464-5ee8e65c3558 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147146 Oct 29 01:23:43.514722 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2387/4598] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:23:43 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:43.530319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e565fe5f-95a2-4182-83aa-aa82012c09ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:43.531139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e565fe5f-95a2-4182-83aa-aa82012c09ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:43.543318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e565fe5f-95a2-4182-83aa-aa82012c09ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:43.549866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e565fe5f-95a2-4182-83aa-aa82012c09ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:43.549866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e565fe5f-95a2-4182-83aa-aa82012c09ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:43.549866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e565fe5f-95a2-4182-83aa-aa82012c09ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:43.549866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e565fe5f-95a2-4182-83aa-aa82012c09ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:43.549866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e565fe5f-95a2-4182-83aa-aa82012c09ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:43.973057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-333b2e1a-d26d-4e5d-8149-3caa9131808b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:43.988734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e565fe5f-95a2-4182-83aa-aa82012c09ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:43.989344 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-333b2e1a-d26d-4e5d-8149-3caa9131808b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1318 microversion: 2.1 time: 0.813042 Oct 29 01:23:43.989781 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2212/4599] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:43 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1318 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:43.997509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a58eb8a0-ac6d-40e7-9f24-81249b91111a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:44.004514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a58eb8a0-ac6d-40e7-9f24-81249b91111a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:44.010883 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e565fe5f-95a2-4182-83aa-aa82012c09ae tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.488223 Oct 29 01:23:44.012272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a58eb8a0-ac6d-40e7-9f24-81249b91111a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:44.012484 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2388/4600] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:43 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:44.018125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a58eb8a0-ac6d-40e7-9f24-81249b91111a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:44.018791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a58eb8a0-ac6d-40e7-9f24-81249b91111a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:44.019698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a58eb8a0-ac6d-40e7-9f24-81249b91111a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:44.020320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a58eb8a0-ac6d-40e7-9f24-81249b91111a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:44.021109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a58eb8a0-ac6d-40e7-9f24-81249b91111a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:44.041357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c13c14ed-e5a4-4a58-a935-d4a65befb27e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:44.042096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c13c14ed-e5a4-4a58-a935-d4a65befb27e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 407662ed-b7ca-4688-8b45-0d1f3ac6fb64] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:44.050694 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-c13c14ed-e5a4-4a58-a935-d4a65befb27e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance 407662ed-b7ca-4688-8b45-0d1f3ac6fb64 could not be found. Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c13c14ed-e5a4-4a58-a935-d4a65befb27e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/407662ed-b7ca-4688-8b45-0d1f3ac6fb64/action HTTP/1.1 Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 15 Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: {"suspend": {}} Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 407662ed-b7ca-4688-8b45-0d1f3ac6fb64 could not be found. Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '407662ed-b7ca-4688-8b45-0d1f3ac6fb64', 'body': {'suspend': {}}} Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 407662ed-b7ca-4688-8b45-0d1f3ac6fb64 could not be found. Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 407662ed-b7ca-4688-8b45-0d1f3ac6fb64 could not be found. Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:44.054245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:44.059541 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:23:44.059541 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:23:44.059541 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 407662ed-b7ca-4688-8b45-0d1f3ac6fb64 could not be found. Oct 29 01:23:44.059541 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:44.059541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c13c14ed-e5a4-4a58-a935-d4a65befb27e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance 407662ed-b7ca-4688-8b45-0d1f3ac6fb64 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:23:44.062408 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c13c14ed-e5a4-4a58-a935-d4a65befb27e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/407662ed-b7ca-4688-8b45-0d1f3ac6fb64/action" status: 404 len: 111 microversion: 2.1 time: 0.023075 Oct 29 01:23:44.063642 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2389/4601] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:23:44 2022] POST /compute/v2.1/servers/407662ed-b7ca-4688-8b45-0d1f3ac6fb64/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:23:44.079905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f8b764e8-8153-456f-9af5-422cde7b0d9a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:44.082980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f8b764e8-8153-456f-9af5-422cde7b0d9a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:44.116872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8b764e8-8153-456f-9af5-422cde7b0d9a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:44.119556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8b764e8-8153-456f-9af5-422cde7b0d9a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:44.120753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8b764e8-8153-456f-9af5-422cde7b0d9a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:44.122543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8b764e8-8153-456f-9af5-422cde7b0d9a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:44.123419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8b764e8-8153-456f-9af5-422cde7b0d9a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:44.124806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8b764e8-8153-456f-9af5-422cde7b0d9a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:44.392683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a58eb8a0-ac6d-40e7-9f24-81249b91111a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:44.402522 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a58eb8a0-ac6d-40e7-9f24-81249b91111a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1313 microversion: 2.1 time: 0.411274 Oct 29 01:23:44.412752 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2213/4602] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:43 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:44.459849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f8b764e8-8153-456f-9af5-422cde7b0d9a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:44.473405 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f8b764e8-8153-456f-9af5-422cde7b0d9a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.404228 Oct 29 01:23:44.474126 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2390/4603] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:44 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:44.499494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5b40d684-e38e-4ac9-81ad-d6f6caac0598 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:44.500466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5b40d684-e38e-4ac9-81ad-d6f6caac0598 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:44.518972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-784c2eab-2b7b-4ef6-b6dd-647b9b74c03e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:44.521831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-784c2eab-2b7b-4ef6-b6dd-647b9b74c03e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:44.523920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5b40d684-e38e-4ac9-81ad-d6f6caac0598 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:44.549973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5b40d684-e38e-4ac9-81ad-d6f6caac0598 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:44.549973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5b40d684-e38e-4ac9-81ad-d6f6caac0598 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:44.549973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5b40d684-e38e-4ac9-81ad-d6f6caac0598 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:44.549973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5b40d684-e38e-4ac9-81ad-d6f6caac0598 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:44.549973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5b40d684-e38e-4ac9-81ad-d6f6caac0598 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:44.552151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-784c2eab-2b7b-4ef6-b6dd-647b9b74c03e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:44.552151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-784c2eab-2b7b-4ef6-b6dd-647b9b74c03e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:44.552151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-784c2eab-2b7b-4ef6-b6dd-647b9b74c03e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:44.552151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-784c2eab-2b7b-4ef6-b6dd-647b9b74c03e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:44.552151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-784c2eab-2b7b-4ef6-b6dd-647b9b74c03e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:44.552151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-784c2eab-2b7b-4ef6-b6dd-647b9b74c03e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:44.641523 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-784c2eab-2b7b-4ef6-b6dd-647b9b74c03e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127333 Oct 29 01:23:44.647872 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2391/4604] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:23:44 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:44.966500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-33df422b-9ae6-483d-8d33-ac17d4d72714 req-8116e755-766d-4071-b022-bd1b554b956b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c9a3141-aaee-4d61-b0f3-22423475f24f", "tag": "8475f6f3-e1ee-45b9-8a41-78cce1666bd4"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:44.992151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-33df422b-9ae6-483d-8d33-ac17d4d72714 req-8116e755-766d-4071-b022-bd1b554b956b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:44.993407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-33df422b-9ae6-483d-8d33-ac17d4d72714 req-8116e755-766d-4071-b022-bd1b554b956b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:44.994165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-33df422b-9ae6-483d-8d33-ac17d4d72714 req-8116e755-766d-4071-b022-bd1b554b956b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:45.012294 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-33df422b-9ae6-483d-8d33-ac17d4d72714 req-8116e755-766d-4071-b022-bd1b554b956b service nova] Creating event network-changed:8475f6f3-e1ee-45b9-8a41-78cce1666bd4 for instance 5c9a3141-aaee-4d61-b0f3-22423475f24f on n-h1-862964-3 Oct 29 01:23:45.018527 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-33df422b-9ae6-483d-8d33-ac17d4d72714 req-8116e755-766d-4071-b022-bd1b554b956b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063792 Oct 29 01:23:45.020612 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2392/4605] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:45.025195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-00862501-ffee-49d3-90ed-8fbd5a6e99a2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:45.026128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-00862501-ffee-49d3-90ed-8fbd5a6e99a2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:45.039122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00862501-ffee-49d3-90ed-8fbd5a6e99a2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:45.039827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00862501-ffee-49d3-90ed-8fbd5a6e99a2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:45.040376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00862501-ffee-49d3-90ed-8fbd5a6e99a2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:45.050203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00862501-ffee-49d3-90ed-8fbd5a6e99a2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:45.050203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00862501-ffee-49d3-90ed-8fbd5a6e99a2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:45.050203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00862501-ffee-49d3-90ed-8fbd5a6e99a2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:45.050505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5b40d684-e38e-4ac9-81ad-d6f6caac0598 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:45.053092 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5b40d684-e38e-4ac9-81ad-d6f6caac0598 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.557587 Oct 29 01:23:45.067469 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2214/4606] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:44 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:45.094463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e610f7b0-22e6-45e5-832a-884553c0ad9f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:45.095528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e610f7b0-22e6-45e5-832a-884553c0ad9f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:45.125431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e610f7b0-22e6-45e5-832a-884553c0ad9f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:45.126288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e610f7b0-22e6-45e5-832a-884553c0ad9f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:45.126892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e610f7b0-22e6-45e5-832a-884553c0ad9f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:45.128954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e610f7b0-22e6-45e5-832a-884553c0ad9f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:45.131309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e610f7b0-22e6-45e5-832a-884553c0ad9f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:45.134255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e610f7b0-22e6-45e5-832a-884553c0ad9f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:45.191413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-e610f7b0-22e6-45e5-832a-884553c0ad9f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lazy-loading 'flavor' on Instance uuid 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:23:45.664965 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e610f7b0-22e6-45e5-832a-884553c0ad9f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action" status: 202 len: 0 microversion: 2.1 time: 0.590225 Oct 29 01:23:45.666003 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2215/4607] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:23:45 2022] POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:23:45.678804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5da88d8d-4027-4841-b6eb-46cd6664d70e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:45.679967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5da88d8d-4027-4841-b6eb-46cd6664d70e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:45.697934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5da88d8d-4027-4841-b6eb-46cd6664d70e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:45.698453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5da88d8d-4027-4841-b6eb-46cd6664d70e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:45.698909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5da88d8d-4027-4841-b6eb-46cd6664d70e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:45.705345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5da88d8d-4027-4841-b6eb-46cd6664d70e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:45.706681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5da88d8d-4027-4841-b6eb-46cd6664d70e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:45.707639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5da88d8d-4027-4841-b6eb-46cd6664d70e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:45.807004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-00862501-ffee-49d3-90ed-8fbd5a6e99a2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:45.821954 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-00862501-ffee-49d3-90ed-8fbd5a6e99a2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1318 microversion: 2.1 time: 0.800350 Oct 29 01:23:45.822930 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2393/4608] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:45 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1318 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:45.833270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b66676ac-b95d-4cef-873e-f8e2a2ea376e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:45.841707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b66676ac-b95d-4cef-873e-f8e2a2ea376e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:45.857250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b66676ac-b95d-4cef-873e-f8e2a2ea376e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:45.857990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b66676ac-b95d-4cef-873e-f8e2a2ea376e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:45.858439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b66676ac-b95d-4cef-873e-f8e2a2ea376e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:45.859166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b66676ac-b95d-4cef-873e-f8e2a2ea376e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:45.859629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b66676ac-b95d-4cef-873e-f8e2a2ea376e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:45.860061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b66676ac-b95d-4cef-873e-f8e2a2ea376e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:45.936534 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b66676ac-b95d-4cef-873e-f8e2a2ea376e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111703 Oct 29 01:23:45.940270 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2394/4609] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:23:45 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:45.951815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c5fd4f1f-4075-4b24-bb44-17d96b8d237d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:45.962024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c5fd4f1f-4075-4b24-bb44-17d96b8d237d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:45.968404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5fd4f1f-4075-4b24-bb44-17d96b8d237d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:45.968901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5fd4f1f-4075-4b24-bb44-17d96b8d237d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:45.969380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5fd4f1f-4075-4b24-bb44-17d96b8d237d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:45.970088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5fd4f1f-4075-4b24-bb44-17d96b8d237d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:45.970560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5fd4f1f-4075-4b24-bb44-17d96b8d237d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:45.970978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5fd4f1f-4075-4b24-bb44-17d96b8d237d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:46.622295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5da88d8d-4027-4841-b6eb-46cd6664d70e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:46.630786 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5da88d8d-4027-4841-b6eb-46cd6664d70e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1313 microversion: 2.1 time: 0.963422 Oct 29 01:23:46.631372 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2216/4610] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:45 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1313 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:46.740529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c5fd4f1f-4075-4b24-bb44-17d96b8d237d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:46.754735 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c5fd4f1f-4075-4b24-bb44-17d96b8d237d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1513 microversion: 2.1 time: 0.806994 Oct 29 01:23:46.756280 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2395/4611] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:45 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1513 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:46.847666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:46.863645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-356f5fcc-8a33-4140-8574-63aa37525c92 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:46.865846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-356f5fcc-8a33-4140-8574-63aa37525c92 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:46.897897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-356f5fcc-8a33-4140-8574-63aa37525c92 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:46.898559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-356f5fcc-8a33-4140-8574-63aa37525c92 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:46.899135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-356f5fcc-8a33-4140-8574-63aa37525c92 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:46.899959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-356f5fcc-8a33-4140-8574-63aa37525c92 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:46.900519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-356f5fcc-8a33-4140-8574-63aa37525c92 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:46.901262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-356f5fcc-8a33-4140-8574-63aa37525c92 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:46.957858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1b385f99-93d3-43a3-8b41-0708d3c397e0 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:46.962496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1b385f99-93d3-43a3-8b41-0708d3c397e0 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:46.980317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b385f99-93d3-43a3-8b41-0708d3c397e0 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:46.983145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b385f99-93d3-43a3-8b41-0708d3c397e0 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:46.986881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b385f99-93d3-43a3-8b41-0708d3c397e0 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:46.988332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b385f99-93d3-43a3-8b41-0708d3c397e0 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:46.991284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b385f99-93d3-43a3-8b41-0708d3c397e0 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:46.992261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b385f99-93d3-43a3-8b41-0708d3c397e0 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:47.035347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:47.085945 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1b385f99-93d3-43a3-8b41-0708d3c397e0 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137416 Oct 29 01:23:47.088014 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2396/4612] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:23:46 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:47.562597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-356f5fcc-8a33-4140-8574-63aa37525c92 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:47.573973 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-356f5fcc-8a33-4140-8574-63aa37525c92 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1467 microversion: 2.1 time: 0.727380 Oct 29 01:23:47.577530 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2217/4613] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:46 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1467 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:47.605544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e4acdb5d-59d0-469a-935e-3d1e24360ea4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:47.606315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e4acdb5d-59d0-469a-935e-3d1e24360ea4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 7616f1ea-1339-425c-9ab9-45431f3cd608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:47.621896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4acdb5d-59d0-469a-935e-3d1e24360ea4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:47.622393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4acdb5d-59d0-469a-935e-3d1e24360ea4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:47.622880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4acdb5d-59d0-469a-935e-3d1e24360ea4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:47.630433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4acdb5d-59d0-469a-935e-3d1e24360ea4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:47.633626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4acdb5d-59d0-469a-935e-3d1e24360ea4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:47.634589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4acdb5d-59d0-469a-935e-3d1e24360ea4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:47.655965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b1b2fdb2-3584-4275-bbae-ce0eac63a598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:47.656626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b1b2fdb2-3584-4275-bbae-ce0eac63a598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:47.665882 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1b2fdb2-3584-4275-bbae-ce0eac63a598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:47.674211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1b2fdb2-3584-4275-bbae-ce0eac63a598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:47.680005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1b2fdb2-3584-4275-bbae-ce0eac63a598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:47.684971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1b2fdb2-3584-4275-bbae-ce0eac63a598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:47.685704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1b2fdb2-3584-4275-bbae-ce0eac63a598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:47.686360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1b2fdb2-3584-4275-bbae-ce0eac63a598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:48.340681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e4acdb5d-59d0-469a-935e-3d1e24360ea4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:48.354616 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e4acdb5d-59d0-469a-935e-3d1e24360ea4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608" status: 200 len: 1467 microversion: 2.1 time: 0.757086 Oct 29 01:23:48.356503 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2397/4614] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:47 2022] GET /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608 => generated 1467 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:48.361468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f3e9fe27-f40c-4e43-b68a-d212ef2eeedb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:48.363143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f3e9fe27-f40c-4e43-b68a-d212ef2eeedb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:48.371757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3e9fe27-f40c-4e43-b68a-d212ef2eeedb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:48.372512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3e9fe27-f40c-4e43-b68a-d212ef2eeedb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:48.374408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3e9fe27-f40c-4e43-b68a-d212ef2eeedb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:48.375285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3e9fe27-f40c-4e43-b68a-d212ef2eeedb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:48.376817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b1b2fdb2-3584-4275-bbae-ce0eac63a598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:48.383749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3e9fe27-f40c-4e43-b68a-d212ef2eeedb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:48.383749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3e9fe27-f40c-4e43-b68a-d212ef2eeedb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:48.385982 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b1b2fdb2-3584-4275-bbae-ce0eac63a598 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1313 microversion: 2.1 time: 0.733931 Oct 29 01:23:48.386573 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2218/4615] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:47 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1313 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:48.400581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-47a48d23-8a2b-4490-97d0-651b260bf6ec tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:48.402961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-47a48d23-8a2b-4490-97d0-651b260bf6ec tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:48.431816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a48d23-8a2b-4490-97d0-651b260bf6ec tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:48.432491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a48d23-8a2b-4490-97d0-651b260bf6ec tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:48.433084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a48d23-8a2b-4490-97d0-651b260bf6ec tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:48.437101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a48d23-8a2b-4490-97d0-651b260bf6ec tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:48.437896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a48d23-8a2b-4490-97d0-651b260bf6ec tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:48.439955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a48d23-8a2b-4490-97d0-651b260bf6ec tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:48.476157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:48.481899 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-47a48d23-8a2b-4490-97d0-651b260bf6ec tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094263 Oct 29 01:23:48.482667 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2219/4616] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:23:48 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:48.487844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a6a6c136-206d-4181-8e9b-a39aab329167 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-621436783"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:48.490677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a6a6c136-206d-4181-8e9b-a39aab329167 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 7616f1ea-1339-425c-9ab9-45431f3cd608] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:48.499965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:48.505772 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6a6c136-206d-4181-8e9b-a39aab329167 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:48.506666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6a6c136-206d-4181-8e9b-a39aab329167 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:48.517839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6a6c136-206d-4181-8e9b-a39aab329167 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:48.518997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6a6c136-206d-4181-8e9b-a39aab329167 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:48.519504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6a6c136-206d-4181-8e9b-a39aab329167 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:48.519946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6a6c136-206d-4181-8e9b-a39aab329167 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:48.792188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f3e9fe27-f40c-4e43-b68a-d212ef2eeedb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:48.806308 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f3e9fe27-f40c-4e43-b68a-d212ef2eeedb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1496 microversion: 2.1 time: 0.448484 Oct 29 01:23:48.809306 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2398/4617] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:48 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1496 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:48.838528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-049309ca-752f-489f-82c6-da0dfb9946b7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:48.839075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-049309ca-752f-489f-82c6-da0dfb9946b7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:48.845112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-049309ca-752f-489f-82c6-da0dfb9946b7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:48.845646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-049309ca-752f-489f-82c6-da0dfb9946b7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:48.849204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-049309ca-752f-489f-82c6-da0dfb9946b7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:48.849204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-049309ca-752f-489f-82c6-da0dfb9946b7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:48.849204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-049309ca-752f-489f-82c6-da0dfb9946b7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:48.849204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-049309ca-752f-489f-82c6-da0dfb9946b7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:48.911530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-049309ca-752f-489f-82c6-da0dfb9946b7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lazy-loading 'flavor' on Instance uuid 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:23:48.945135 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-049309ca-752f-489f-82c6-da0dfb9946b7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Cannot 'suspend' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state suspended Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-049309ca-752f-489f-82c6-da0dfb9946b7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action HTTP/1.1 Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 15 Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: {"suspend": {}} Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: exception: Cannot 'suspend' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state suspended Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '63371d26-fe85-4cfa-bdca-c8ad84b81ee6', 'body': {'suspend': {}}} Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 29 01:23:48.951337 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 01:23:48.957195 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 01:23:48.957195 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 01:23:48.957195 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state suspended Oct 29 01:23:48.957195 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:48.957195 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:48.957195 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:48.957195 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:48.957195 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:48.957195 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:48.957195 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:23:48.957195 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:23:48.957195 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state suspended Oct 29 01:23:48.957195 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:48.959059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-049309ca-752f-489f-82c6-da0dfb9946b7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 409 to user: Cannot 'suspend' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state suspended {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:23:48.963286 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-049309ca-752f-489f-82c6-da0dfb9946b7 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action" status: 409 len: 148 microversion: 2.1 time: 0.126327 Oct 29 01:23:48.964024 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2399/4618] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:23:48 2022] POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action => generated 148 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:23:48.974586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8262ecc5-ed71-4349-901b-ba4bdd210549 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:48.975179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8262ecc5-ed71-4349-901b-ba4bdd210549 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:48.993063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8262ecc5-ed71-4349-901b-ba4bdd210549 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:48.993929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8262ecc5-ed71-4349-901b-ba4bdd210549 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:48.994803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8262ecc5-ed71-4349-901b-ba4bdd210549 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:48.995698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8262ecc5-ed71-4349-901b-ba4bdd210549 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:48.996336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8262ecc5-ed71-4349-901b-ba4bdd210549 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:48.998091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8262ecc5-ed71-4349-901b-ba4bdd210549 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:49.134398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:49.164240 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a6a6c136-206d-4181-8e9b-a39aab329167 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "POST /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608/action" status: 202 len: 0 microversion: 2.1 time: 0.680176 Oct 29 01:23:49.165467 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2220/4619] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:23:48 2022] POST /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608/action => generated 0 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 01:23:49.248758 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8262ecc5-ed71-4349-901b-ba4bdd210549 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action" status: 202 len: 0 microversion: 2.1 time: 0.280114 Oct 29 01:23:49.250229 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2400/4620] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:23:48 2022] POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:23:49.259056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-96c2c6f9-b843-4975-9615-e7689b28bd54 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96b79b80>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:49.314091 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-96c2c6f9-b843-4975-9615-e7689b28bd54 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.062423 Oct 29 01:23:49.314699 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2401/4621] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:23:49 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:49.331997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9e0a2d03-3571-4365-8c14-0c4575da4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:49.332841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9e0a2d03-3571-4365-8c14-0c4575da4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:49.339758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e0a2d03-3571-4365-8c14-0c4575da4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:49.340206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e0a2d03-3571-4365-8c14-0c4575da4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:49.340843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e0a2d03-3571-4365-8c14-0c4575da4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:49.341617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e0a2d03-3571-4365-8c14-0c4575da4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:49.342240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e0a2d03-3571-4365-8c14-0c4575da4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:49.342728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e0a2d03-3571-4365-8c14-0c4575da4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:49.508469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8c62e069-3c82-4f73-857a-e1ef94d316b5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Action: 'create', calling method: .version_select at 0x7f9d9c77e040>, body: {"keypair": {"name": "tempest-keypair-214589788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIzkWPFARqlAwwNy9fTEH41LH4wiDVhkdXjcAT/tjxW65gRvvPpwm9ZTotbg+3TksiKw1c7Vp+CQ46ajSFhyZNWQxrr65C+6BEjjHJfCtQeWEV6rZyggxlTaOL7Ls2oWw=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:49.538464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9e0a2d03-3571-4365-8c14-0c4575da4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:49.550522 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9e0a2d03-3571-4365-8c14-0c4575da4496 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1502 microversion: 2.1 time: 0.233039 Oct 29 01:23:49.551108 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2402/4622] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:49 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1502 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:49.569521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c4370994-7aab-4540-9e03-6cb1a5db3bbc tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:49.569521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c4370994-7aab-4540-9e03-6cb1a5db3bbc tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:49.570354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-8c62e069-3c82-4f73-857a-e1ef94d316b5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Getting quotas for project ad278c0b0b9a41beae8b29986e315743. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:23:49.582053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-8c62e069-3c82-4f73-857a-e1ef94d316b5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Getting quotas for user 444e13f1f2d945dfb31b83d8e19c2032 and project ad278c0b0b9a41beae8b29986e315743. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:23:49.582340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4370994-7aab-4540-9e03-6cb1a5db3bbc tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:49.582340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4370994-7aab-4540-9e03-6cb1a5db3bbc tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:49.582340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4370994-7aab-4540-9e03-6cb1a5db3bbc tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:49.585902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4370994-7aab-4540-9e03-6cb1a5db3bbc tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:49.586405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4370994-7aab-4540-9e03-6cb1a5db3bbc tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:49.586846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4370994-7aab-4540-9e03-6cb1a5db3bbc tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:49.668210 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8c62e069-3c82-4f73-857a-e1ef94d316b5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.500850 Oct 29 01:23:49.670611 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2221/4623] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:23:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:49.676916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5dd2030c-b18c-4d61-b2a9-ab6e97629cb6 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:49.685194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5dd2030c-b18c-4d61-b2a9-ab6e97629cb6 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:49.693325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5dd2030c-b18c-4d61-b2a9-ab6e97629cb6 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:49.694042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5dd2030c-b18c-4d61-b2a9-ab6e97629cb6 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:49.694542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5dd2030c-b18c-4d61-b2a9-ab6e97629cb6 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:49.695434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5dd2030c-b18c-4d61-b2a9-ab6e97629cb6 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:49.696058 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5dd2030c-b18c-4d61-b2a9-ab6e97629cb6 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:49.696497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5dd2030c-b18c-4d61-b2a9-ab6e97629cb6 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:49.734965 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5dd2030c-b18c-4d61-b2a9-ab6e97629cb6 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063083 Oct 29 01:23:49.735555 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2222/4624] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:23:49 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:23:49.908572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c4370994-7aab-4540-9e03-6cb1a5db3bbc tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:49.921670 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c4370994-7aab-4540-9e03-6cb1a5db3bbc tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1313 microversion: 2.1 time: 0.369067 Oct 29 01:23:49.927359 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2403/4625] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:49 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:49.962406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-730be62e-b5cb-48e6-9d77-d39a8ea1cac7 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-625982955", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "99a92c6d-3381-4497-8269-da902d0c5a11"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:50.054687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-730be62e-b5cb-48e6-9d77-d39a8ea1cac7 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] validate_networks() for [('99a92c6d-3381-4497-8269-da902d0c5a11', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:23:50.331426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5a5ea5e0-3fb4-490a-a5e9-7e67cf76a425 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96956700>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:50.406802 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5a5ea5e0-3fb4-490a-a5e9-7e67cf76a425 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.074779 Oct 29 01:23:50.412083 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2404/4626] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:23:50 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:50.576752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8a2ccefb-307f-481b-b10b-8f0bd8f28b1e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:50.577787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8a2ccefb-307f-481b-b10b-8f0bd8f28b1e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:50.585307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a2ccefb-307f-481b-b10b-8f0bd8f28b1e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:50.585804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a2ccefb-307f-481b-b10b-8f0bd8f28b1e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:50.586345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a2ccefb-307f-481b-b10b-8f0bd8f28b1e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:50.587283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a2ccefb-307f-481b-b10b-8f0bd8f28b1e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:50.587807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a2ccefb-307f-481b-b10b-8f0bd8f28b1e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:50.588349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a2ccefb-307f-481b-b10b-8f0bd8f28b1e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:50.708069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-730be62e-b5cb-48e6-9d77-d39a8ea1cac7 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:23:50.708069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-730be62e-b5cb-48e6-9d77-d39a8ea1cac7 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:23:50.708746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-730be62e-b5cb-48e6-9d77-d39a8ea1cac7 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:23:50.708935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-730be62e-b5cb-48e6-9d77-d39a8ea1cac7 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:23:50.709846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-730be62e-b5cb-48e6-9d77-d39a8ea1cac7 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:23:50.721981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-730be62e-b5cb-48e6-9d77-d39a8ea1cac7 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:50.723014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-730be62e-b5cb-48e6-9d77-d39a8ea1cac7 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:50.725580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-730be62e-b5cb-48e6-9d77-d39a8ea1cac7 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:50.728207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-730be62e-b5cb-48e6-9d77-d39a8ea1cac7 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:50.729779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-730be62e-b5cb-48e6-9d77-d39a8ea1cac7 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:50.731324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-730be62e-b5cb-48e6-9d77-d39a8ea1cac7 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:50.760605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-730be62e-b5cb-48e6-9d77-d39a8ea1cac7 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Getting quotas for project 39133f363c084812920780d4eb6d227b. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:23:50.766260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-730be62e-b5cb-48e6-9d77-d39a8ea1cac7 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Getting quotas for user 8d3714617f36472f8e4b1d55887cdefc and project 39133f363c084812920780d4eb6d227b. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:23:50.781146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8a2ccefb-307f-481b-b10b-8f0bd8f28b1e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:50.781340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-730be62e-b5cb-48e6-9d77-d39a8ea1cac7 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:23:50.784373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-730be62e-b5cb-48e6-9d77-d39a8ea1cac7 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:23:50.791089 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8a2ccefb-307f-481b-b10b-8f0bd8f28b1e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1502 microversion: 2.1 time: 0.218979 Oct 29 01:23:50.791700 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2405/4627] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:50 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1502 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:50.885601 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-730be62e-b5cb-48e6-9d77-d39a8ea1cac7 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927062 Oct 29 01:23:50.886822 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2223/4628] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:23:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:23:50.900095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b283db7e-34fa-4d08-b464-8b042d391d23 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:50.900728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b283db7e-34fa-4d08-b464-8b042d391d23 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:50.950358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8c4a0c4b-eb7d-46e5-8655-6a0b04af675e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:50.951068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8c4a0c4b-eb7d-46e5-8655-6a0b04af675e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:50.958951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c4a0c4b-eb7d-46e5-8655-6a0b04af675e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:50.960015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c4a0c4b-eb7d-46e5-8655-6a0b04af675e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:50.960672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c4a0c4b-eb7d-46e5-8655-6a0b04af675e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:50.964626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c4a0c4b-eb7d-46e5-8655-6a0b04af675e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:50.965494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c4a0c4b-eb7d-46e5-8655-6a0b04af675e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:50.966153 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c4a0c4b-eb7d-46e5-8655-6a0b04af675e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:50.991939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b283db7e-34fa-4d08-b464-8b042d391d23 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:51.001365 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b283db7e-34fa-4d08-b464-8b042d391d23 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 200 len: 1217 microversion: 2.1 time: 0.107241 Oct 29 01:23:51.002916 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2406/4629] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:50 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 1217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:51.151620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8c4a0c4b-eb7d-46e5-8655-6a0b04af675e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:51.164374 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8c4a0c4b-eb7d-46e5-8655-6a0b04af675e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1313 microversion: 2.1 time: 0.217906 Oct 29 01:23:51.165270 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2224/4630] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:50 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:51.423399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8afd16f7-b92a-4ac9-801b-a8de3d09999e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96956d30>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:51.481642 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8afd16f7-b92a-4ac9-801b-a8de3d09999e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.062212 Oct 29 01:23:51.482306 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2407/4631] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:23:51 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:51.816486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7ce641c7-2322-4a42-ada1-aaff0f8adbe2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:51.817658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7ce641c7-2322-4a42-ada1-aaff0f8adbe2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:51.829519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ce641c7-2322-4a42-ada1-aaff0f8adbe2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:51.831281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ce641c7-2322-4a42-ada1-aaff0f8adbe2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:51.831842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ce641c7-2322-4a42-ada1-aaff0f8adbe2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:51.833267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ce641c7-2322-4a42-ada1-aaff0f8adbe2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:51.833744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ce641c7-2322-4a42-ada1-aaff0f8adbe2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:51.834180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ce641c7-2322-4a42-ada1-aaff0f8adbe2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:52.026372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7ce641c7-2322-4a42-ada1-aaff0f8adbe2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:52.034785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e1924a82-c4ac-4087-8328-5af6f73e3cd8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:52.036205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e1924a82-c4ac-4087-8328-5af6f73e3cd8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:52.036982 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7ce641c7-2322-4a42-ada1-aaff0f8adbe2 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1502 microversion: 2.1 time: 0.225157 Oct 29 01:23:52.049880 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2225/4632] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:51 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1502 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:52.081399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1924a82-c4ac-4087-8328-5af6f73e3cd8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:52.082423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1924a82-c4ac-4087-8328-5af6f73e3cd8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:52.083790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1924a82-c4ac-4087-8328-5af6f73e3cd8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:52.084740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1924a82-c4ac-4087-8328-5af6f73e3cd8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:52.085465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1924a82-c4ac-4087-8328-5af6f73e3cd8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:52.086124 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1924a82-c4ac-4087-8328-5af6f73e3cd8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:52.166833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e1924a82-c4ac-4087-8328-5af6f73e3cd8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:52.175787 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e1924a82-c4ac-4087-8328-5af6f73e3cd8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 200 len: 1221 microversion: 2.1 time: 0.150838 Oct 29 01:23:52.176368 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2408/4633] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:52 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 1221 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:52.192485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d74ac00-016f-4bec-85db-5879991572a6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:52.193108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7d74ac00-016f-4bec-85db-5879991572a6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:52.199363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d74ac00-016f-4bec-85db-5879991572a6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:52.199848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d74ac00-016f-4bec-85db-5879991572a6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:52.200277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d74ac00-016f-4bec-85db-5879991572a6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:52.201018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d74ac00-016f-4bec-85db-5879991572a6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:52.201514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d74ac00-016f-4bec-85db-5879991572a6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:52.202800 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d74ac00-016f-4bec-85db-5879991572a6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:52.387076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7d74ac00-016f-4bec-85db-5879991572a6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:52.391638 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7d74ac00-016f-4bec-85db-5879991572a6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1313 microversion: 2.1 time: 0.204561 Oct 29 01:23:52.392231 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2226/4634] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:52 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:52.501148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a1a81e24-6808-4deb-a3c9-97a95205e712 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96eb3af0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:52.574935 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a1a81e24-6808-4deb-a3c9-97a95205e712 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.080869 Oct 29 01:23:52.575099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-74ec9b68-4856-4de8-b5d8-8d8c9c5f3fcc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-748600007", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3aada4e4-ab9d-407f-aadb-56a56f4bc58e"}], "security_groups": [{"name": "tempest-securitygroup--1647022095"}], "key_name": "tempest-keypair-214589788", "user_data": "}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:52.584940 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2409/4635] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:23:52 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:52.718208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-74ec9b68-4856-4de8-b5d8-8d8c9c5f3fcc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] validate_networks() for [('3aada4e4-ab9d-407f-aadb-56a56f4bc58e', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:23:53.066384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-220de534-e644-4894-916d-3e1359aa2575 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:53.068226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-220de534-e644-4894-916d-3e1359aa2575 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:53.077197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-220de534-e644-4894-916d-3e1359aa2575 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:53.077666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-220de534-e644-4894-916d-3e1359aa2575 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:53.078102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-220de534-e644-4894-916d-3e1359aa2575 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:53.079060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-220de534-e644-4894-916d-3e1359aa2575 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:53.079784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-220de534-e644-4894-916d-3e1359aa2575 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:53.080228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-220de534-e644-4894-916d-3e1359aa2575 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:53.314335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-74ec9b68-4856-4de8-b5d8-8d8c9c5f3fcc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:23:53.315331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-74ec9b68-4856-4de8-b5d8-8d8c9c5f3fcc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:23:53.315412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-74ec9b68-4856-4de8-b5d8-8d8c9c5f3fcc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:23:53.315776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-74ec9b68-4856-4de8-b5d8-8d8c9c5f3fcc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:23:53.316193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-74ec9b68-4856-4de8-b5d8-8d8c9c5f3fcc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:23:53.334113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-74ec9b68-4856-4de8-b5d8-8d8c9c5f3fcc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:53.334740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-74ec9b68-4856-4de8-b5d8-8d8c9c5f3fcc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:53.335465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-74ec9b68-4856-4de8-b5d8-8d8c9c5f3fcc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:53.336425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-74ec9b68-4856-4de8-b5d8-8d8c9c5f3fcc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:53.336633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-220de534-e644-4894-916d-3e1359aa2575 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:53.336894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-74ec9b68-4856-4de8-b5d8-8d8c9c5f3fcc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:53.337689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-74ec9b68-4856-4de8-b5d8-8d8c9c5f3fcc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:53.345038 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-220de534-e644-4894-916d-3e1359aa2575 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.284633 Oct 29 01:23:53.345870 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2410/4636] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:53 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:53.372164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4f5adaac-0ccc-4ff2-b5ae-32c6ced6249e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:53.372981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4f5adaac-0ccc-4ff2-b5ae-32c6ced6249e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:53.382641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f5adaac-0ccc-4ff2-b5ae-32c6ced6249e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:53.382641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f5adaac-0ccc-4ff2-b5ae-32c6ced6249e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:53.382876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-74ec9b68-4856-4de8-b5d8-8d8c9c5f3fcc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Getting quotas for project ad278c0b0b9a41beae8b29986e315743. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:23:53.386335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f5adaac-0ccc-4ff2-b5ae-32c6ced6249e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:53.387345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f5adaac-0ccc-4ff2-b5ae-32c6ced6249e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:53.389766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f5adaac-0ccc-4ff2-b5ae-32c6ced6249e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:53.390410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f5adaac-0ccc-4ff2-b5ae-32c6ced6249e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:53.404304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-74ec9b68-4856-4de8-b5d8-8d8c9c5f3fcc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Getting quotas for user 444e13f1f2d945dfb31b83d8e19c2032 and project ad278c0b0b9a41beae8b29986e315743. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:23:53.441533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-74ec9b68-4856-4de8-b5d8-8d8c9c5f3fcc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:23:53.447255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-74ec9b68-4856-4de8-b5d8-8d8c9c5f3fcc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:23:53.541500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4f5adaac-0ccc-4ff2-b5ae-32c6ced6249e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:53.550382 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4f5adaac-0ccc-4ff2-b5ae-32c6ced6249e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 200 len: 1277 microversion: 2.1 time: 0.182500 Oct 29 01:23:53.553848 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2411/4637] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:53 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:53.558942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c39de3e5-59d4-4938-ba31-8773adb859c9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:53.562878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c39de3e5-59d4-4938-ba31-8773adb859c9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:53.576952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c39de3e5-59d4-4938-ba31-8773adb859c9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:53.581523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c39de3e5-59d4-4938-ba31-8773adb859c9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:53.582274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c39de3e5-59d4-4938-ba31-8773adb859c9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:53.583314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c39de3e5-59d4-4938-ba31-8773adb859c9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:53.583787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c39de3e5-59d4-4938-ba31-8773adb859c9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:53.584379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c39de3e5-59d4-4938-ba31-8773adb859c9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:53.664536 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-74ec9b68-4856-4de8-b5d8-8d8c9c5f3fcc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.092922 Oct 29 01:23:53.667016 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2227/4638] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:23:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:23:53.696773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-55106939-b80f-48d9-a7b0-77f710e86817 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:53.698845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-55106939-b80f-48d9-a7b0-77f710e86817 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:53.729821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55106939-b80f-48d9-a7b0-77f710e86817 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:53.731352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55106939-b80f-48d9-a7b0-77f710e86817 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:53.732029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55106939-b80f-48d9-a7b0-77f710e86817 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:53.733020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55106939-b80f-48d9-a7b0-77f710e86817 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:53.736105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55106939-b80f-48d9-a7b0-77f710e86817 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:53.738972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55106939-b80f-48d9-a7b0-77f710e86817 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:53.919930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c39de3e5-59d4-4938-ba31-8773adb859c9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:53.948101 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c39de3e5-59d4-4938-ba31-8773adb859c9 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.392476 Oct 29 01:23:53.969784 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2412/4639] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:53 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:53.982864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e929acfc-e7cd-4936-8892-b73bc0aebae6 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d969fce50>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:54.050157 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e929acfc-e7cd-4936-8892-b73bc0aebae6 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.078643 Oct 29 01:23:54.051208 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2413/4640] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:23:53 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:54.066394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-30bae63d-6d2e-4497-8a12-9ea21c8bd1db tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:54.067023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-30bae63d-6d2e-4497-8a12-9ea21c8bd1db tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:54.099638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-55106939-b80f-48d9-a7b0-77f710e86817 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:54.108561 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-55106939-b80f-48d9-a7b0-77f710e86817 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1313 microversion: 2.1 time: 0.440237 Oct 29 01:23:54.113535 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2228/4641] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:53 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:54.119640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-92760e39-7af2-4711-9f1b-dfea9570be1a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:54.120473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-92760e39-7af2-4711-9f1b-dfea9570be1a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 2d6da66f-450e-4ab7-a116-fb36978eb610] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:54.127000 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-92760e39-7af2-4711-9f1b-dfea9570be1a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance 2d6da66f-450e-4ab7-a116-fb36978eb610 could not be found. Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-92760e39-7af2-4711-9f1b-dfea9570be1a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/2d6da66f-450e-4ab7-a116-fb36978eb610/action HTTP/1.1 Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 15 Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: {"unpause": {}} Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 2d6da66f-450e-4ab7-a116-fb36978eb610 could not be found. Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '2d6da66f-450e-4ab7-a116-fb36978eb610', 'body': {'unpause': {}}} Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d6da66f-450e-4ab7-a116-fb36978eb610 could not be found. Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d6da66f-450e-4ab7-a116-fb36978eb610 could not be found. Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:54.129769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:54.133815 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:23:54.133815 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:23:54.133815 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d6da66f-450e-4ab7-a116-fb36978eb610 could not be found. Oct 29 01:23:54.133815 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:54.135505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-92760e39-7af2-4711-9f1b-dfea9570be1a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance 2d6da66f-450e-4ab7-a116-fb36978eb610 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:23:54.136625 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-92760e39-7af2-4711-9f1b-dfea9570be1a tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/2d6da66f-450e-4ab7-a116-fb36978eb610/action" status: 404 len: 111 microversion: 2.1 time: 0.021365 Oct 29 01:23:54.141323 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2229/4642] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:23:54 2022] POST /compute/v2.1/servers/2d6da66f-450e-4ab7-a116-fb36978eb610/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:23:54.150545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3e725454-d8e1-4f82-89a0-4eb33997f78d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:54.151319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3e725454-d8e1-4f82-89a0-4eb33997f78d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:54.161365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-30bae63d-6d2e-4497-8a12-9ea21c8bd1db tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:54.170863 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-30bae63d-6d2e-4497-8a12-9ea21c8bd1db tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1240 microversion: 2.1 time: 0.109173 Oct 29 01:23:54.172639 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2414/4643] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:54 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1240 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:54.173987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e725454-d8e1-4f82-89a0-4eb33997f78d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:54.175717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e725454-d8e1-4f82-89a0-4eb33997f78d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:54.176424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e725454-d8e1-4f82-89a0-4eb33997f78d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:54.177345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e725454-d8e1-4f82-89a0-4eb33997f78d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:54.178038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e725454-d8e1-4f82-89a0-4eb33997f78d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:54.184549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e725454-d8e1-4f82-89a0-4eb33997f78d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:54.578033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-608f23fc-7bd0-4b29-b23d-a3acfaf99e6b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:54.578666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-608f23fc-7bd0-4b29-b23d-a3acfaf99e6b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:54.585568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-608f23fc-7bd0-4b29-b23d-a3acfaf99e6b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:54.592231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-608f23fc-7bd0-4b29-b23d-a3acfaf99e6b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:54.592231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-608f23fc-7bd0-4b29-b23d-a3acfaf99e6b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:54.592231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-608f23fc-7bd0-4b29-b23d-a3acfaf99e6b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:54.592231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-608f23fc-7bd0-4b29-b23d-a3acfaf99e6b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:54.592231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-608f23fc-7bd0-4b29-b23d-a3acfaf99e6b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:54.704675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-608f23fc-7bd0-4b29-b23d-a3acfaf99e6b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:54.714872 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-608f23fc-7bd0-4b29-b23d-a3acfaf99e6b tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 200 len: 1275 microversion: 2.1 time: 0.141009 Oct 29 01:23:54.715705 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2415/4644] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:54 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 1275 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:54.761034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3e725454-d8e1-4f82-89a0-4eb33997f78d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:54.773443 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3e725454-d8e1-4f82-89a0-4eb33997f78d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.630359 Oct 29 01:23:54.831698 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2230/4645] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:54 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:54.852007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5be955ad-a030-47bc-aca2-267b128e113f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:54.852635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5be955ad-a030-47bc-aca2-267b128e113f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:54.862760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5be955ad-a030-47bc-aca2-267b128e113f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:54.863271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5be955ad-a030-47bc-aca2-267b128e113f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:54.864091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5be955ad-a030-47bc-aca2-267b128e113f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:54.864826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5be955ad-a030-47bc-aca2-267b128e113f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:54.865328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5be955ad-a030-47bc-aca2-267b128e113f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:54.866230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5be955ad-a030-47bc-aca2-267b128e113f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:54.944398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-654db1c5-fe9d-409d-b179-6897acd30725 req-54c98f1d-5019-4342-b87d-80a311b0eb39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c9a3141-aaee-4d61-b0f3-22423475f24f", "name": "network-vif-plugged", "status": "completed", "tag": "8475f6f3-e1ee-45b9-8a41-78cce1666bd4"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:54.957213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-654db1c5-fe9d-409d-b179-6897acd30725 req-54c98f1d-5019-4342-b87d-80a311b0eb39 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:54.957213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-654db1c5-fe9d-409d-b179-6897acd30725 req-54c98f1d-5019-4342-b87d-80a311b0eb39 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:54.957530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-654db1c5-fe9d-409d-b179-6897acd30725 req-54c98f1d-5019-4342-b87d-80a311b0eb39 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:54.970577 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-654db1c5-fe9d-409d-b179-6897acd30725 req-54c98f1d-5019-4342-b87d-80a311b0eb39 service nova] Creating event network-vif-plugged:8475f6f3-e1ee-45b9-8a41-78cce1666bd4 for instance 5c9a3141-aaee-4d61-b0f3-22423475f24f on n-h1-862964-3 Oct 29 01:23:54.976858 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-654db1c5-fe9d-409d-b179-6897acd30725 req-54c98f1d-5019-4342-b87d-80a311b0eb39 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037898 Oct 29 01:23:54.977803 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2231/4646] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:23:55.070940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2492890b-6068-4631-9572-f3f602c4edca tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97cae160>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:55.093859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5be955ad-a030-47bc-aca2-267b128e113f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:55.104812 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5be955ad-a030-47bc-aca2-267b128e113f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.256998 Oct 29 01:23:55.105996 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2416/4647] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:54 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:55.140118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-882a965a-f58e-4bd0-be58-09f0db97aaa0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:55.141705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-882a965a-f58e-4bd0-be58-09f0db97aaa0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:55.154972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-882a965a-f58e-4bd0-be58-09f0db97aaa0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:55.156658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-882a965a-f58e-4bd0-be58-09f0db97aaa0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:55.157410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-882a965a-f58e-4bd0-be58-09f0db97aaa0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:55.158415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-882a965a-f58e-4bd0-be58-09f0db97aaa0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:55.159902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-882a965a-f58e-4bd0-be58-09f0db97aaa0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:55.160567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-882a965a-f58e-4bd0-be58-09f0db97aaa0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:55.189183 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2492890b-6068-4631-9572-f3f602c4edca tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.122841 Oct 29 01:23:55.191206 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2232/4648] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:23:55 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:55.199090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-94b8d6fd-a204-4519-ac9f-c57cac96436f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:55.200229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-94b8d6fd-a204-4519-ac9f-c57cac96436f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:55.211145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94b8d6fd-a204-4519-ac9f-c57cac96436f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:55.212045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94b8d6fd-a204-4519-ac9f-c57cac96436f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:55.212830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94b8d6fd-a204-4519-ac9f-c57cac96436f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:55.216036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94b8d6fd-a204-4519-ac9f-c57cac96436f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:55.216750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94b8d6fd-a204-4519-ac9f-c57cac96436f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:55.217755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94b8d6fd-a204-4519-ac9f-c57cac96436f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:55.303047 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-94b8d6fd-a204-4519-ac9f-c57cac96436f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Cannot 'unpause' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-94b8d6fd-a204-4519-ac9f-c57cac96436f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action HTTP/1.1 Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 15 Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: {"unpause": {}} Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: exception: Cannot 'unpause' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '63371d26-fe85-4cfa-bdca-c8ad84b81ee6', 'body': {'unpause': {}}} Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 in vm_state active. Cannot unpause while the instance is in this state. Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:55.304849 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:55.317693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:55.317693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:23:55.317693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:23:55.317693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active Oct 29 01:23:55.317693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:55.317693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-94b8d6fd-a204-4519-ac9f-c57cac96436f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 409 to user: Cannot 'unpause' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:23:55.317693 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-94b8d6fd-a204-4519-ac9f-c57cac96436f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action" status: 409 len: 145 microversion: 2.1 time: 0.114205 Oct 29 01:23:55.317693 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2233/4649] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:23:55 2022] POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action => generated 145 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:23:55.328747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c3d41d82-abf2-40ad-b82e-7b7207abcd27 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:55.330126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c3d41d82-abf2-40ad-b82e-7b7207abcd27 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:55.342313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3d41d82-abf2-40ad-b82e-7b7207abcd27 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:55.342883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3d41d82-abf2-40ad-b82e-7b7207abcd27 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:55.343343 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3d41d82-abf2-40ad-b82e-7b7207abcd27 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:55.344069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3d41d82-abf2-40ad-b82e-7b7207abcd27 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:55.344662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3d41d82-abf2-40ad-b82e-7b7207abcd27 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:55.345309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3d41d82-abf2-40ad-b82e-7b7207abcd27 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:55.510899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c3d41d82-abf2-40ad-b82e-7b7207abcd27 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:55.543028 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c3d41d82-abf2-40ad-b82e-7b7207abcd27 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1244 microversion: 2.1 time: 0.220288 Oct 29 01:23:55.561375 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2234/4650] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:55 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1244 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:55.573195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-882a965a-f58e-4bd0-be58-09f0db97aaa0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:55.580719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-18b56dbe-b499-43cc-a1f3-fd5ec04e7471 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:55.581490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-18b56dbe-b499-43cc-a1f3-fd5ec04e7471 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:55.585970 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-882a965a-f58e-4bd0-be58-09f0db97aaa0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1313 microversion: 2.1 time: 0.448020 Oct 29 01:23:55.587642 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2417/4651] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:55 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:55.590389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18b56dbe-b499-43cc-a1f3-fd5ec04e7471 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:55.590944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18b56dbe-b499-43cc-a1f3-fd5ec04e7471 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:55.592932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18b56dbe-b499-43cc-a1f3-fd5ec04e7471 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:55.593966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18b56dbe-b499-43cc-a1f3-fd5ec04e7471 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:55.594637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18b56dbe-b499-43cc-a1f3-fd5ec04e7471 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:55.595262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18b56dbe-b499-43cc-a1f3-fd5ec04e7471 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:55.742110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c49f67e9-5630-44b2-be43-ef606a1a34f2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:55.742816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c49f67e9-5630-44b2-be43-ef606a1a34f2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:55.750438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c49f67e9-5630-44b2-be43-ef606a1a34f2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:55.750668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-18b56dbe-b499-43cc-a1f3-fd5ec04e7471 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:55.751268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c49f67e9-5630-44b2-be43-ef606a1a34f2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:55.751777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c49f67e9-5630-44b2-be43-ef606a1a34f2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:55.757894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c49f67e9-5630-44b2-be43-ef606a1a34f2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:55.757894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c49f67e9-5630-44b2-be43-ef606a1a34f2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:55.757894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c49f67e9-5630-44b2-be43-ef606a1a34f2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:55.759958 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-18b56dbe-b499-43cc-a1f3-fd5ec04e7471 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.196998 Oct 29 01:23:55.760777 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2235/4652] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:55 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:55.783128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-620494b5-afa7-4927-b8dd-1c8c2612d197 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:55.783953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-620494b5-afa7-4927-b8dd-1c8c2612d197 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:55.790117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-620494b5-afa7-4927-b8dd-1c8c2612d197 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:55.790609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-620494b5-afa7-4927-b8dd-1c8c2612d197 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:55.791051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-620494b5-afa7-4927-b8dd-1c8c2612d197 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:55.791745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-620494b5-afa7-4927-b8dd-1c8c2612d197 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:55.792198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-620494b5-afa7-4927-b8dd-1c8c2612d197 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:55.792619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-620494b5-afa7-4927-b8dd-1c8c2612d197 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:56.031942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c49f67e9-5630-44b2-be43-ef606a1a34f2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:56.042453 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c49f67e9-5630-44b2-be43-ef606a1a34f2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 200 len: 1317 microversion: 2.1 time: 0.304516 Oct 29 01:23:56.057190 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2418/4653] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:55 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:56.069636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-620494b5-afa7-4927-b8dd-1c8c2612d197 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:56.078631 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-620494b5-afa7-4927-b8dd-1c8c2612d197 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.299542 Oct 29 01:23:56.079805 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2236/4654] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:55 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:56.104761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b4c74043-c59d-4e86-be2b-42d4661b693e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:56.105466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b4c74043-c59d-4e86-be2b-42d4661b693e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 8bce7ce9-1204-4e0e-a392-18a900ed3534] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:56.112429 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-b4c74043-c59d-4e86-be2b-42d4661b693e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance 8bce7ce9-1204-4e0e-a392-18a900ed3534 could not be found. Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b4c74043-c59d-4e86-be2b-42d4661b693e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/8bce7ce9-1204-4e0e-a392-18a900ed3534/action HTTP/1.1 Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 18 Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: {"unshelve": null} Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 8bce7ce9-1204-4e0e-a392-18a900ed3534 could not be found. Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '8bce7ce9-1204-4e0e-a392-18a900ed3534', 'body': {'unshelve': None}} Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bce7ce9-1204-4e0e-a392-18a900ed3534 could not be found. Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bce7ce9-1204-4e0e-a392-18a900ed3534 could not be found. Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:56.114791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:56.119671 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:56.119671 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:56.119671 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:56.119671 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:56.119671 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:23:56.119671 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:23:56.119671 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bce7ce9-1204-4e0e-a392-18a900ed3534 could not be found. Oct 29 01:23:56.119671 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:56.121078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b4c74043-c59d-4e86-be2b-42d4661b693e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance 8bce7ce9-1204-4e0e-a392-18a900ed3534 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:23:56.122374 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b4c74043-c59d-4e86-be2b-42d4661b693e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/8bce7ce9-1204-4e0e-a392-18a900ed3534/action" status: 404 len: 111 microversion: 2.1 time: 0.022083 Oct 29 01:23:56.123376 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2419/4655] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:23:56 2022] POST /compute/v2.1/servers/8bce7ce9-1204-4e0e-a392-18a900ed3534/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:23:56.136592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a787f267-1f24-4c95-b6b9-ac7b98cf214f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:56.137323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a787f267-1f24-4c95-b6b9-ac7b98cf214f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:56.148456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a787f267-1f24-4c95-b6b9-ac7b98cf214f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:56.148928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a787f267-1f24-4c95-b6b9-ac7b98cf214f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:56.149392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a787f267-1f24-4c95-b6b9-ac7b98cf214f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:56.150099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a787f267-1f24-4c95-b6b9-ac7b98cf214f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:56.150559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a787f267-1f24-4c95-b6b9-ac7b98cf214f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:56.150987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a787f267-1f24-4c95-b6b9-ac7b98cf214f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:56.206960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-84b71fbc-d27f-44fa-b344-30390274be41 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96a0a0d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:56.259440 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-84b71fbc-d27f-44fa-b344-30390274be41 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.056907 Oct 29 01:23:56.268103 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2420/4656] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:23:56 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:56.380960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a787f267-1f24-4c95-b6b9-ac7b98cf214f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:56.391363 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a787f267-1f24-4c95-b6b9-ac7b98cf214f tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.262857 Oct 29 01:23:56.392572 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2237/4657] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:56 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:56.417529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6721e6a0-eff8-451f-b600-10d13dc5f441 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:56.418195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6721e6a0-eff8-451f-b600-10d13dc5f441 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:56.425433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6721e6a0-eff8-451f-b600-10d13dc5f441 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:56.425932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6721e6a0-eff8-451f-b600-10d13dc5f441 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:56.426410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6721e6a0-eff8-451f-b600-10d13dc5f441 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:56.427174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6721e6a0-eff8-451f-b600-10d13dc5f441 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:56.427639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6721e6a0-eff8-451f-b600-10d13dc5f441 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:56.428066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6721e6a0-eff8-451f-b600-10d13dc5f441 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:56.568770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-13e3f643-74c2-4469-a263-44114f02c6bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:56.571242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-13e3f643-74c2-4469-a263-44114f02c6bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:56.576980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13e3f643-74c2-4469-a263-44114f02c6bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:56.577875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13e3f643-74c2-4469-a263-44114f02c6bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:56.578496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13e3f643-74c2-4469-a263-44114f02c6bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:56.579508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13e3f643-74c2-4469-a263-44114f02c6bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:56.580797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13e3f643-74c2-4469-a263-44114f02c6bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:56.581342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13e3f643-74c2-4469-a263-44114f02c6bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:56.622710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6721e6a0-eff8-451f-b600-10d13dc5f441 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:56.638200 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6721e6a0-eff8-451f-b600-10d13dc5f441 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.218745 Oct 29 01:23:56.638200 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2421/4658] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:56 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:56.638200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d652e079-e880-4519-9aae-5d61979f3dfe tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:56.638959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d652e079-e880-4519-9aae-5d61979f3dfe tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:56.646105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d652e079-e880-4519-9aae-5d61979f3dfe tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:56.646784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d652e079-e880-4519-9aae-5d61979f3dfe tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:56.647371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d652e079-e880-4519-9aae-5d61979f3dfe tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:56.648289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d652e079-e880-4519-9aae-5d61979f3dfe tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:56.648887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d652e079-e880-4519-9aae-5d61979f3dfe tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:56.649496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d652e079-e880-4519-9aae-5d61979f3dfe tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:56.656603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-13e3f643-74c2-4469-a263-44114f02c6bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:56.665440 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-13e3f643-74c2-4469-a263-44114f02c6bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1292 microversion: 2.1 time: 0.101289 Oct 29 01:23:56.666383 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2238/4659] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:56 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1292 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:56.671554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4b6a0e44-e757-47d1-92a8-0bbf1e35b539 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:56.672332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4b6a0e44-e757-47d1-92a8-0bbf1e35b539 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:56.680022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b6a0e44-e757-47d1-92a8-0bbf1e35b539 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:56.680712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b6a0e44-e757-47d1-92a8-0bbf1e35b539 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:56.681481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b6a0e44-e757-47d1-92a8-0bbf1e35b539 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:56.682345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b6a0e44-e757-47d1-92a8-0bbf1e35b539 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:56.682953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b6a0e44-e757-47d1-92a8-0bbf1e35b539 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:56.683539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b6a0e44-e757-47d1-92a8-0bbf1e35b539 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:56.714633 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-4b6a0e44-e757-47d1-92a8-0bbf1e35b539 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Cannot 'unshelve' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4b6a0e44-e757-47d1-92a8-0bbf1e35b539 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action HTTP/1.1 Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 18 Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: {"unshelve": null} Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: exception: Cannot 'unshelve' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '63371d26-fe85-4cfa-bdca-c8ad84b81ee6', 'body': {'unshelve': None}} Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 in vm_state active. Cannot unshelve while the instance is in this state. Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 01:23:56.716266 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 01:23:56.720699 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active Oct 29 01:23:56.720699 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:56.720699 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:56.720699 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:56.720699 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:56.720699 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:56.720699 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:56.720699 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:23:56.720699 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:23:56.720699 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active Oct 29 01:23:56.720699 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:56.720699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4b6a0e44-e757-47d1-92a8-0bbf1e35b539 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 409 to user: Cannot 'unshelve' instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 while it is in vm_state active {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:23:56.720699 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4b6a0e44-e757-47d1-92a8-0bbf1e35b539 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action" status: 409 len: 146 microversion: 2.1 time: 0.051190 Oct 29 01:23:56.720699 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2239/4660] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:23:56 2022] POST /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6/action => generated 146 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:23:56.727738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-25d33661-3473-4d6d-a031-2f02963300aa tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:56.728699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-25d33661-3473-4d6d-a031-2f02963300aa tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:56.734793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-25d33661-3473-4d6d-a031-2f02963300aa tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:56.735178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-25d33661-3473-4d6d-a031-2f02963300aa tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:56.735623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-25d33661-3473-4d6d-a031-2f02963300aa tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:56.736326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-25d33661-3473-4d6d-a031-2f02963300aa tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:56.736853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-25d33661-3473-4d6d-a031-2f02963300aa tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:56.737305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-25d33661-3473-4d6d-a031-2f02963300aa tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:56.994206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d652e079-e880-4519-9aae-5d61979f3dfe tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:57.002043 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d652e079-e880-4519-9aae-5d61979f3dfe tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1313 microversion: 2.1 time: 0.367641 Oct 29 01:23:57.002806 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2422/4661] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:56 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:57.007512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-122b5ef4-e78b-4c60-96e7-d10e5fb1aa5f req-741224d3-b11d-4851-8fb7-71ebd8990a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7616f1ea-1339-425c-9ab9-45431f3cd608", "name": "network-vif-plugged", "status": "completed", "tag": "1f225c5e-7d18-4b8d-9938-9a97f24a39fc"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:57.016125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:57.021462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-25d33661-3473-4d6d-a031-2f02963300aa tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:57.032392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:57.034304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-122b5ef4-e78b-4c60-96e7-d10e5fb1aa5f req-741224d3-b11d-4851-8fb7-71ebd8990a39 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:57.036574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-122b5ef4-e78b-4c60-96e7-d10e5fb1aa5f req-741224d3-b11d-4851-8fb7-71ebd8990a39 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:57.037271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-122b5ef4-e78b-4c60-96e7-d10e5fb1aa5f req-741224d3-b11d-4851-8fb7-71ebd8990a39 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:57.053585 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-25d33661-3473-4d6d-a031-2f02963300aa tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.328145 Oct 29 01:23:57.057604 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2240/4662] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:56 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:57.062746 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-122b5ef4-e78b-4c60-96e7-d10e5fb1aa5f req-741224d3-b11d-4851-8fb7-71ebd8990a39 service nova] Creating event network-vif-plugged:1f225c5e-7d18-4b8d-9938-9a97f24a39fc for instance 7616f1ea-1339-425c-9ab9-45431f3cd608 on n-h2-862964-3 Oct 29 01:23:57.068686 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-122b5ef4-e78b-4c60-96e7-d10e5fb1aa5f req-741224d3-b11d-4851-8fb7-71ebd8990a39 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064433 Oct 29 01:23:57.069414 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2423/4663] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:57.077721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c0d98418-74f9-47a2-ab2c-e9a6bebdde1f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:57.078430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c0d98418-74f9-47a2-ab2c-e9a6bebdde1f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:57.083049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-31718e89-cce6-476d-88b4-30e80e9feea4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:57.083864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-31718e89-cce6-476d-88b4-30e80e9feea4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:57.086504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0d98418-74f9-47a2-ab2c-e9a6bebdde1f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:57.087011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0d98418-74f9-47a2-ab2c-e9a6bebdde1f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:57.087456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0d98418-74f9-47a2-ab2c-e9a6bebdde1f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:57.089035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0d98418-74f9-47a2-ab2c-e9a6bebdde1f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:57.089688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0d98418-74f9-47a2-ab2c-e9a6bebdde1f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:57.090248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0d98418-74f9-47a2-ab2c-e9a6bebdde1f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:57.091718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31718e89-cce6-476d-88b4-30e80e9feea4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:57.092673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31718e89-cce6-476d-88b4-30e80e9feea4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:57.093197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31718e89-cce6-476d-88b4-30e80e9feea4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:57.093903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31718e89-cce6-476d-88b4-30e80e9feea4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:57.094408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31718e89-cce6-476d-88b4-30e80e9feea4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:57.095130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31718e89-cce6-476d-88b4-30e80e9feea4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:57.354651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c0d98418-74f9-47a2-ab2c-e9a6bebdde1f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:57.360482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-31718e89-cce6-476d-88b4-30e80e9feea4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:57.363147 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c0d98418-74f9-47a2-ab2c-e9a6bebdde1f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 200 len: 1317 microversion: 2.1 time: 0.292366 Oct 29 01:23:57.363737 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2241/4664] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:57 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:57.369000 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-31718e89-cce6-476d-88b4-30e80e9feea4 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.291857 Oct 29 01:23:57.369654 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2424/4665] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:57 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:57.384386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-860960fb-fd0f-4057-8ebb-da610efb2f88 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97c71b80>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:57.416841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2731859f-8066-4b09-9424-429127c37d40 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1118518478_updated"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:57.419935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2731859f-8066-4b09-9424-429127c37d40 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 54152800-4fe5-4e39-9139-588788995f5b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:57.428812 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-2731859f-8066-4b09-9424-429127c37d40 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance 54152800-4fe5-4e39-9139-588788995f5b could not be found. Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2731859f-8066-4b09-9424-429127c37d40 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: request: PUT /compute/v2.1/servers/54152800-4fe5-4e39-9139-588788995f5b HTTP/1.1 Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 81 Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1118518478_updated"}} Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 54152800-4fe5-4e39-9139-588788995f5b could not be found. Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '54152800-4fe5-4e39-9139-588788995f5b', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1118518478_updated'}}} Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54152800-4fe5-4e39-9139-588788995f5b could not be found. Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 29 01:23:57.430880 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:23:57.434786 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:23:57.434786 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:23:57.434786 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:23:57.434786 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54152800-4fe5-4e39-9139-588788995f5b could not be found. Oct 29 01:23:57.434786 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:57.434786 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:57.434786 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:57.434786 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:57.434786 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:57.434786 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:57.434786 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:23:57.434786 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:23:57.434786 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54152800-4fe5-4e39-9139-588788995f5b could not be found. Oct 29 01:23:57.434786 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:23:57.437580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2731859f-8066-4b09-9424-429127c37d40 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance 54152800-4fe5-4e39-9139-588788995f5b could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:23:57.444704 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2731859f-8066-4b09-9424-429127c37d40 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "PUT /compute/v2.1/servers/54152800-4fe5-4e39-9139-588788995f5b" status: 404 len: 111 microversion: 2.1 time: 0.044623 Oct 29 01:23:57.446398 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2425/4666] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 29 01:23:57 2022] PUT /compute/v2.1/servers/54152800-4fe5-4e39-9139-588788995f5b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:23:57.451171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-299f28da-61e3-4992-bad6-ad8f406682a0 req-c8dad00a-3198-4fd8-a7c8-7fb93a317d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63625132-862d-4c5a-bf16-fb4c27473ded", "tag": "e6533a78-71c5-4092-9b62-6164d8395e9c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:57.467475 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-860960fb-fd0f-4057-8ebb-da610efb2f88 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.094411 Oct 29 01:23:57.468981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-299f28da-61e3-4992-bad6-ad8f406682a0 req-c8dad00a-3198-4fd8-a7c8-7fb93a317d72 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:57.469995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-299f28da-61e3-4992-bad6-ad8f406682a0 req-c8dad00a-3198-4fd8-a7c8-7fb93a317d72 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:57.470506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-299f28da-61e3-4992-bad6-ad8f406682a0 req-c8dad00a-3198-4fd8-a7c8-7fb93a317d72 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:57.476515 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2242/4667] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:23:57 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:57.482569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-409089e6-c9b8-4f67-b3b8-ba79ae016e0d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:57.483434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-409089e6-c9b8-4f67-b3b8-ba79ae016e0d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:57.491593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-409089e6-c9b8-4f67-b3b8-ba79ae016e0d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:57.492255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-409089e6-c9b8-4f67-b3b8-ba79ae016e0d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:57.492917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-409089e6-c9b8-4f67-b3b8-ba79ae016e0d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:57.493887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-409089e6-c9b8-4f67-b3b8-ba79ae016e0d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:57.494558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-409089e6-c9b8-4f67-b3b8-ba79ae016e0d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:57.495402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-409089e6-c9b8-4f67-b3b8-ba79ae016e0d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:57.504456 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-299f28da-61e3-4992-bad6-ad8f406682a0 req-c8dad00a-3198-4fd8-a7c8-7fb93a317d72 service nova] Creating event network-changed:e6533a78-71c5-4092-9b62-6164d8395e9c for instance 63625132-862d-4c5a-bf16-fb4c27473ded on n-h1-862964-3 Oct 29 01:23:57.539466 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-299f28da-61e3-4992-bad6-ad8f406682a0 req-c8dad00a-3198-4fd8-a7c8-7fb93a317d72 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091905 Oct 29 01:23:57.540116 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2426/4668] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:57.696784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-12730731-9060-4998-a34f-8817280a3f9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:57.697511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-12730731-9060-4998-a34f-8817280a3f9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:57.707572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12730731-9060-4998-a34f-8817280a3f9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:57.708067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12730731-9060-4998-a34f-8817280a3f9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:57.709056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12730731-9060-4998-a34f-8817280a3f9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:57.709974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12730731-9060-4998-a34f-8817280a3f9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:57.710434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12730731-9060-4998-a34f-8817280a3f9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:57.710868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12730731-9060-4998-a34f-8817280a3f9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:57.856130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-12730731-9060-4998-a34f-8817280a3f9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:57.872649 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-12730731-9060-4998-a34f-8817280a3f9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1300 microversion: 2.1 time: 0.180722 Oct 29 01:23:57.885188 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2427/4669] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:57 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1300 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:57.909570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-409089e6-c9b8-4f67-b3b8-ba79ae016e0d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:57.915441 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-409089e6-c9b8-4f67-b3b8-ba79ae016e0d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.437580 Oct 29 01:23:57.927195 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2243/4670] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:57 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:57.941489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0fc4413e-e043-4b95-945f-0836075d62c6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:57.942157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0fc4413e-e043-4b95-945f-0836075d62c6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:57.948383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc4413e-e043-4b95-945f-0836075d62c6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:57.948878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc4413e-e043-4b95-945f-0836075d62c6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:57.949374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc4413e-e043-4b95-945f-0836075d62c6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:57.950080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc4413e-e043-4b95-945f-0836075d62c6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:57.950572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc4413e-e043-4b95-945f-0836075d62c6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:57.950958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc4413e-e043-4b95-945f-0836075d62c6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:58.027834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ffbefc82-a382-4d70-9f8c-e5d8540da5a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:58.029620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ffbefc82-a382-4d70-9f8c-e5d8540da5a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:58.037608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ffbefc82-a382-4d70-9f8c-e5d8540da5a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:58.038173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ffbefc82-a382-4d70-9f8c-e5d8540da5a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:58.038636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ffbefc82-a382-4d70-9f8c-e5d8540da5a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:58.041370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ffbefc82-a382-4d70-9f8c-e5d8540da5a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:58.041370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ffbefc82-a382-4d70-9f8c-e5d8540da5a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:58.041370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ffbefc82-a382-4d70-9f8c-e5d8540da5a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:58.357343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0fc4413e-e043-4b95-945f-0836075d62c6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:58.370966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:23:58.374218 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0fc4413e-e043-4b95-945f-0836075d62c6 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.436616 Oct 29 01:23:58.375285 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2428/4671] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:57 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:58.398286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f3b2627d-461f-4384-bce6-c56cab8e176f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:58.399217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f3b2627d-461f-4384-bce6-c56cab8e176f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:58.410886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3b2627d-461f-4384-bce6-c56cab8e176f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:58.411774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3b2627d-461f-4384-bce6-c56cab8e176f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:58.412404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3b2627d-461f-4384-bce6-c56cab8e176f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:58.413433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3b2627d-461f-4384-bce6-c56cab8e176f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:58.414031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3b2627d-461f-4384-bce6-c56cab8e176f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:58.414941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f3b2627d-461f-4384-bce6-c56cab8e176f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:58.445929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ffbefc82-a382-4d70-9f8c-e5d8540da5a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:58.460219 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ffbefc82-a382-4d70-9f8c-e5d8540da5a0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1500 microversion: 2.1 time: 0.436320 Oct 29 01:23:58.486615 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2244/4672] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:58 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1500 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:58.498734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d6cd4e9b-94dd-400e-a456-89717a871e04 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d6cd4e9b-94dd-400e-a456-89717a871e04 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: request: PUT /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 HTTP/1.1 Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 280 Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '63371d26-fe85-4cfa-bdca-c8ad84b81ee6', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:58.507423 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 01:23:58.510945 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:58.513917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d6cd4e9b-94dd-400e-a456-89717a871e04 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:23:58.516974 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d6cd4e9b-94dd-400e-a456-89717a871e04 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "PUT /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 400 len: 619 microversion: 2.1 time: 0.027034 Oct 29 01:23:58.521844 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2245/4673] 10.222.0.26 () {60 vars in 1257 bytes} [Sat Oct 29 01:23:58 2022] PUT /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 619 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:23:58.527441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7945b35f-a69c-48b4-a830-a0539f4dc80b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9c042af0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:58.645345 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7945b35f-a69c-48b4-a830-a0539f4dc80b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.121910 Oct 29 01:23:58.646416 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2246/4674] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:23:58 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:58.655654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a1b2603e-34e3-4928-802e-dc0738c03830 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:58.660486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a1b2603e-34e3-4928-802e-dc0738c03830 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:58.671957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1b2603e-34e3-4928-802e-dc0738c03830 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:58.672858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1b2603e-34e3-4928-802e-dc0738c03830 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:58.674957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1b2603e-34e3-4928-802e-dc0738c03830 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:58.675675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1b2603e-34e3-4928-802e-dc0738c03830 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:58.676401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1b2603e-34e3-4928-802e-dc0738c03830 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:58.677088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1b2603e-34e3-4928-802e-dc0738c03830 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:58.705863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-a1b2603e-34e3-4928-802e-dc0738c03830 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lazy-loading 'flavor' on Instance uuid 5c9a3141-aaee-4d61-b0f3-22423475f24f {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:23:58.875509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f3b2627d-461f-4384-bce6-c56cab8e176f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:58.889548 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f3b2627d-461f-4384-bce6-c56cab8e176f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 200 len: 1317 microversion: 2.1 time: 0.498718 Oct 29 01:23:58.897755 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2429/4675] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:58 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 1317 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:58.920369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9794bd2a-396d-4ff2-a2ba-4ba2e9595867 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:58.921194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9794bd2a-396d-4ff2-a2ba-4ba2e9595867 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:58.939713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9794bd2a-396d-4ff2-a2ba-4ba2e9595867 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:58.939713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9794bd2a-396d-4ff2-a2ba-4ba2e9595867 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:58.939713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9794bd2a-396d-4ff2-a2ba-4ba2e9595867 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:58.941509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9794bd2a-396d-4ff2-a2ba-4ba2e9595867 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:58.942213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9794bd2a-396d-4ff2-a2ba-4ba2e9595867 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:58.942949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9794bd2a-396d-4ff2-a2ba-4ba2e9595867 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:59.025398 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a1b2603e-34e3-4928-802e-dc0738c03830 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "POST /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f/action" status: 200 len: 32 microversion: 2.1 time: 0.374731 Oct 29 01:23:59.026914 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2247/4676] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:23:58 2022] POST /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f/action => generated 32 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:23:59.036730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-33f0e53c-c599-4d70-b8c4-9a71a22b082c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:59.038349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-33f0e53c-c599-4d70-b8c4-9a71a22b082c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:59.055032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-33f0e53c-c599-4d70-b8c4-9a71a22b082c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:59.055547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-33f0e53c-c599-4d70-b8c4-9a71a22b082c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:59.055993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-33f0e53c-c599-4d70-b8c4-9a71a22b082c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:59.056732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-33f0e53c-c599-4d70-b8c4-9a71a22b082c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:59.057256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-33f0e53c-c599-4d70-b8c4-9a71a22b082c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:59.057946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-33f0e53c-c599-4d70-b8c4-9a71a22b082c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:59.185602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-33f0e53c-c599-4d70-b8c4-9a71a22b082c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:59.194584 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-33f0e53c-c599-4d70-b8c4-9a71a22b082c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1298 microversion: 2.1 time: 0.165542 Oct 29 01:23:59.195156 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2248/4677] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:59 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1298 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:59.200471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b954a056-b444-4bcd-b425-9bde7edd206b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:59.213308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b954a056-b444-4bcd-b425-9bde7edd206b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:59.219938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b954a056-b444-4bcd-b425-9bde7edd206b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:59.220713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b954a056-b444-4bcd-b425-9bde7edd206b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:59.221464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b954a056-b444-4bcd-b425-9bde7edd206b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:59.222381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b954a056-b444-4bcd-b425-9bde7edd206b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:59.223061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b954a056-b444-4bcd-b425-9bde7edd206b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:59.223829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b954a056-b444-4bcd-b425-9bde7edd206b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:59.266466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9794bd2a-396d-4ff2-a2ba-4ba2e9595867 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:59.277601 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9794bd2a-396d-4ff2-a2ba-4ba2e9595867 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.378232 Oct 29 01:23:59.278884 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2430/4678] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:58 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:59.305253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f02508d2-ace1-4371-8c87-06ff2def6fcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:59.306173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f02508d2-ace1-4371-8c87-06ff2def6fcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:59.314355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f02508d2-ace1-4371-8c87-06ff2def6fcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:59.315385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f02508d2-ace1-4371-8c87-06ff2def6fcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:59.316117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f02508d2-ace1-4371-8c87-06ff2def6fcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:59.317064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f02508d2-ace1-4371-8c87-06ff2def6fcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:59.317992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f02508d2-ace1-4371-8c87-06ff2def6fcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:59.318652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f02508d2-ace1-4371-8c87-06ff2def6fcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:59.465309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b954a056-b444-4bcd-b425-9bde7edd206b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:59.478676 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b954a056-b444-4bcd-b425-9bde7edd206b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.279838 Oct 29 01:23:59.495296 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2249/4679] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:59 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:59.543418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f02508d2-ace1-4371-8c87-06ff2def6fcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:59.552664 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f02508d2-ace1-4371-8c87-06ff2def6fcc tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.252029 Oct 29 01:23:59.554101 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2431/4680] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:59 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:59.585886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0a9c27ed-1b77-4068-98aa-5d85abb6c332 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0a9c27ed-1b77-4068-98aa-5d85abb6c332 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: request: PUT /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 HTTP/1.1 Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 24 Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: {"server": {"name": ""}} Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '63371d26-fe85-4cfa-bdca-c8ad84b81ee6', 'body': {'server': {'name': ''}}} Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi '' Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:23:59.591623 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 29 01:23:59.596620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:59.596620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:23:59.596620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:59.596620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:23:59.596620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:23:59.596620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:23:59.596620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:23:59.596620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:23:59.596620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 29 01:23:59.596620 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:23:59.596620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0a9c27ed-1b77-4068-98aa-5d85abb6c332 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:23:59.596620 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0a9c27ed-1b77-4068-98aa-5d85abb6c332 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "PUT /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 400 len: 108 microversion: 2.1 time: 0.019830 Oct 29 01:23:59.607010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eeb040e7-4db5-4ce9-83eb-817f5f3fa381 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:59.608018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eeb040e7-4db5-4ce9-83eb-817f5f3fa381 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:59.613478 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2250/4681] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 29 01:23:59 2022] PUT /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 108 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:23:59.615162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eeb040e7-4db5-4ce9-83eb-817f5f3fa381 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:59.615722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eeb040e7-4db5-4ce9-83eb-817f5f3fa381 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:59.616225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eeb040e7-4db5-4ce9-83eb-817f5f3fa381 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:59.616999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eeb040e7-4db5-4ce9-83eb-817f5f3fa381 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:59.617796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eeb040e7-4db5-4ce9-83eb-817f5f3fa381 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:59.618301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eeb040e7-4db5-4ce9-83eb-817f5f3fa381 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:59.662252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-72ca8596-44b4-4a08-a31a-41278c10cd30 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9c042310>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:59.724290 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-72ca8596-44b4-4a08-a31a-41278c10cd30 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.067303 Oct 29 01:23:59.725290 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2251/4682] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:23:59 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:59.925281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eeb040e7-4db5-4ce9-83eb-817f5f3fa381 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:23:59.935642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a66d766c-d2a2-4fcf-81bd-17e879a3db81 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:59.940810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a66d766c-d2a2-4fcf-81bd-17e879a3db81 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:23:59.957121 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eeb040e7-4db5-4ce9-83eb-817f5f3fa381 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1505 microversion: 2.1 time: 0.355405 Oct 29 01:23:59.959627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a66d766c-d2a2-4fcf-81bd-17e879a3db81 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:59.960355 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2432/4683] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:59 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:23:59.977878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a66d766c-d2a2-4fcf-81bd-17e879a3db81 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:59.978742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a66d766c-d2a2-4fcf-81bd-17e879a3db81 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:23:59.979729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a66d766c-d2a2-4fcf-81bd-17e879a3db81 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:23:59.980385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a66d766c-d2a2-4fcf-81bd-17e879a3db81 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:23:59.980773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a66d766c-d2a2-4fcf-81bd-17e879a3db81 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:00.192778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a66d766c-d2a2-4fcf-81bd-17e879a3db81 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:00.201665 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a66d766c-d2a2-4fcf-81bd-17e879a3db81 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 200 len: 1317 microversion: 2.1 time: 0.284636 Oct 29 01:24:00.205712 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2252/4684] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:23:59 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:00.219714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-18875a63-22ec-41a7-9fd0-f767ed63d72b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:00.220369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-18875a63-22ec-41a7-9fd0-f767ed63d72b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:00.245140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18875a63-22ec-41a7-9fd0-f767ed63d72b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:00.249015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18875a63-22ec-41a7-9fd0-f767ed63d72b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:00.249669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18875a63-22ec-41a7-9fd0-f767ed63d72b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:00.250609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18875a63-22ec-41a7-9fd0-f767ed63d72b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:00.263083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18875a63-22ec-41a7-9fd0-f767ed63d72b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:00.264907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18875a63-22ec-41a7-9fd0-f767ed63d72b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:00.468830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-18875a63-22ec-41a7-9fd0-f767ed63d72b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:00.484733 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-18875a63-22ec-41a7-9fd0-f767ed63d72b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1366 microversion: 2.1 time: 0.268221 Oct 29 01:24:00.488109 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2433/4685] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:00 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:00.505398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-607da8f7-de89-4501-8d31-a61a1a05f34e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:00.506139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-607da8f7-de89-4501-8d31-a61a1a05f34e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:00.512950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-607da8f7-de89-4501-8d31-a61a1a05f34e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:00.513465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-607da8f7-de89-4501-8d31-a61a1a05f34e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:00.513900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-607da8f7-de89-4501-8d31-a61a1a05f34e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:00.514611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-607da8f7-de89-4501-8d31-a61a1a05f34e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:00.515061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-607da8f7-de89-4501-8d31-a61a1a05f34e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:00.515529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-607da8f7-de89-4501-8d31-a61a1a05f34e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:00.686533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-607da8f7-de89-4501-8d31-a61a1a05f34e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:00.699225 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-607da8f7-de89-4501-8d31-a61a1a05f34e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.195693 Oct 29 01:24:00.699225 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2253/4686] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:00 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:00.740606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8b3a93df-c8d0-4992-8770-9af201cb3185 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96e93ee0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:00.815260 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8b3a93df-c8d0-4992-8770-9af201cb3185 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.078616 Oct 29 01:24:00.815857 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2434/4687] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:00 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:01.227464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8903f65e-f9b6-48c0-9a89-74b2efc63d45 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:01.228820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8903f65e-f9b6-48c0-9a89-74b2efc63d45 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:01.238686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8903f65e-f9b6-48c0-9a89-74b2efc63d45 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:01.244098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8903f65e-f9b6-48c0-9a89-74b2efc63d45 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:01.246224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8903f65e-f9b6-48c0-9a89-74b2efc63d45 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:01.248043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8903f65e-f9b6-48c0-9a89-74b2efc63d45 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:01.248541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8903f65e-f9b6-48c0-9a89-74b2efc63d45 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:01.250862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8903f65e-f9b6-48c0-9a89-74b2efc63d45 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:01.523654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0f7592be-5911-4df7-95c4-93823d39b87f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:01.524261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0f7592be-5911-4df7-95c4-93823d39b87f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:01.547324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f7592be-5911-4df7-95c4-93823d39b87f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:01.548108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f7592be-5911-4df7-95c4-93823d39b87f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:01.553502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f7592be-5911-4df7-95c4-93823d39b87f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:01.565674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f7592be-5911-4df7-95c4-93823d39b87f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:01.567267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f7592be-5911-4df7-95c4-93823d39b87f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:01.568044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f7592be-5911-4df7-95c4-93823d39b87f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:02.116170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8903f65e-f9b6-48c0-9a89-74b2efc63d45 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:02.132433 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8903f65e-f9b6-48c0-9a89-74b2efc63d45 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 200 len: 1317 microversion: 2.1 time: 0.909181 Oct 29 01:24:02.133786 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2254/4688] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:01 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 1317 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:02.145787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8dc48764-8512-43da-8fbd-c6a2e3699c6a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:02.148504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8dc48764-8512-43da-8fbd-c6a2e3699c6a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:02.184873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8dc48764-8512-43da-8fbd-c6a2e3699c6a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:02.187205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8dc48764-8512-43da-8fbd-c6a2e3699c6a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:02.187854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8dc48764-8512-43da-8fbd-c6a2e3699c6a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:02.191229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8dc48764-8512-43da-8fbd-c6a2e3699c6a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:02.191918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8dc48764-8512-43da-8fbd-c6a2e3699c6a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:02.193380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8dc48764-8512-43da-8fbd-c6a2e3699c6a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:02.468360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0f7592be-5911-4df7-95c4-93823d39b87f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:02.479974 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0f7592be-5911-4df7-95c4-93823d39b87f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1366 microversion: 2.1 time: 0.971961 Oct 29 01:24:02.482089 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2435/4689] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:01 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1366 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:02.492166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-726d6dac-69ad-435d-999d-d8223f8dd6ab tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96a03820>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:02.587927 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-726d6dac-69ad-435d-999d-d8223f8dd6ab tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.104583 Oct 29 01:24:02.588577 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2436/4690] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:02 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:02.753597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8dc48764-8512-43da-8fbd-c6a2e3699c6a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:02.772538 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8dc48764-8512-43da-8fbd-c6a2e3699c6a tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.637212 Oct 29 01:24:02.776918 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2255/4691] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:02 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:03.162040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b1d7881-7a20-4ee6-9165-90c089a573fb tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:03.163762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7b1d7881-7a20-4ee6-9165-90c089a573fb tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:03.176857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b1d7881-7a20-4ee6-9165-90c089a573fb tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:03.178676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b1d7881-7a20-4ee6-9165-90c089a573fb tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:03.180588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b1d7881-7a20-4ee6-9165-90c089a573fb tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:03.181533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b1d7881-7a20-4ee6-9165-90c089a573fb tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:03.183322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b1d7881-7a20-4ee6-9165-90c089a573fb tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:03.184711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b1d7881-7a20-4ee6-9165-90c089a573fb tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:03.505375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-59d876b5-55b2-47af-8760-f738c67d9b9b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:03.506040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-59d876b5-55b2-47af-8760-f738c67d9b9b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:03.521568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:24:03.537815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=16 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:24:03.543943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:24:03.546545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59d876b5-55b2-47af-8760-f738c67d9b9b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:03.547207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59d876b5-55b2-47af-8760-f738c67d9b9b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:03.547802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59d876b5-55b2-47af-8760-f738c67d9b9b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:03.551312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59d876b5-55b2-47af-8760-f738c67d9b9b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:03.551312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59d876b5-55b2-47af-8760-f738c67d9b9b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:03.551312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59d876b5-55b2-47af-8760-f738c67d9b9b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:03.603383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7b1d7881-7a20-4ee6-9165-90c089a573fb tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:03.640504 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7b1d7881-7a20-4ee6-9165-90c089a573fb tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 200 len: 1317 microversion: 2.1 time: 0.480042 Oct 29 01:24:03.641689 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2437/4692] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:03 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 1317 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:03.655721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-40f9e05b-ee4c-4fbc-9348-53622d0d9e38 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96956700>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:03.745976 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-40f9e05b-ee4c-4fbc-9348-53622d0d9e38 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.102760 Oct 29 01:24:03.747127 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2438/4693] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:03 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:03.803168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81903814-9047-4533-b018-24b3c08e7ce8 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:03.803793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-81903814-9047-4533-b018-24b3c08e7ce8 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:03.821100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81903814-9047-4533-b018-24b3c08e7ce8 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:03.821643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81903814-9047-4533-b018-24b3c08e7ce8 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:03.822092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81903814-9047-4533-b018-24b3c08e7ce8 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:03.822813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81903814-9047-4533-b018-24b3c08e7ce8 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:03.828311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81903814-9047-4533-b018-24b3c08e7ce8 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:03.828798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81903814-9047-4533-b018-24b3c08e7ce8 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:03.846816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-59d876b5-55b2-47af-8760-f738c67d9b9b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:03.865357 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-59d876b5-55b2-47af-8760-f738c67d9b9b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1366 microversion: 2.1 time: 0.357472 Oct 29 01:24:03.867311 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2256/4694] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:03 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:04.115040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-ef03ca62-c065-414a-8662-ef511d9faa45 req-9df168cd-d830-4475-bb6f-2b063e8b2fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c86e050-73e4-4c80-a145-420293bbf8b2", "tag": "85fe9242-041d-41ad-8dc3-ceea6e1ea126"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:04.135280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ef03ca62-c065-414a-8662-ef511d9faa45 req-9df168cd-d830-4475-bb6f-2b063e8b2fe7 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:04.136097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ef03ca62-c065-414a-8662-ef511d9faa45 req-9df168cd-d830-4475-bb6f-2b063e8b2fe7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:04.136688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ef03ca62-c065-414a-8662-ef511d9faa45 req-9df168cd-d830-4475-bb6f-2b063e8b2fe7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:04.164427 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-ef03ca62-c065-414a-8662-ef511d9faa45 req-9df168cd-d830-4475-bb6f-2b063e8b2fe7 service nova] Creating event network-changed:85fe9242-041d-41ad-8dc3-ceea6e1ea126 for instance 2c86e050-73e4-4c80-a145-420293bbf8b2 on n-h1-862964-3 Oct 29 01:24:04.169737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:24:04.175496 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-ef03ca62-c065-414a-8662-ef511d9faa45 req-9df168cd-d830-4475-bb6f-2b063e8b2fe7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065825 Oct 29 01:24:04.178686 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2257/4695] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:24:04.208022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-81903814-9047-4533-b018-24b3c08e7ce8 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:04.225763 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-81903814-9047-4533-b018-24b3c08e7ce8 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.425071 Oct 29 01:24:04.237180 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2439/4696] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:03 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:04.671455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d5e4a3ff-6326-402f-8db7-d06c3ca93b8a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:04.672443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d5e4a3ff-6326-402f-8db7-d06c3ca93b8a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:04.688511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5e4a3ff-6326-402f-8db7-d06c3ca93b8a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:04.692127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5e4a3ff-6326-402f-8db7-d06c3ca93b8a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:04.697412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5e4a3ff-6326-402f-8db7-d06c3ca93b8a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:04.698445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5e4a3ff-6326-402f-8db7-d06c3ca93b8a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:04.699460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5e4a3ff-6326-402f-8db7-d06c3ca93b8a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:04.700059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5e4a3ff-6326-402f-8db7-d06c3ca93b8a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:04.763235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a7bb297c-035d-478f-8b3b-cd4dbd2fa2e7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96eb1310>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:04.836952 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a7bb297c-035d-478f-8b3b-cd4dbd2fa2e7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.077411 Oct 29 01:24:04.841520 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2440/4697] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:04 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:04.890016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-844326fa-0a48-4839-b44b-a86a08abe6d6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:04.890992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-844326fa-0a48-4839-b44b-a86a08abe6d6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:04.903561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-844326fa-0a48-4839-b44b-a86a08abe6d6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:04.913924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-844326fa-0a48-4839-b44b-a86a08abe6d6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:04.914763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-844326fa-0a48-4839-b44b-a86a08abe6d6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:04.915733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-844326fa-0a48-4839-b44b-a86a08abe6d6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:04.916413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-844326fa-0a48-4839-b44b-a86a08abe6d6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:04.918346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-844326fa-0a48-4839-b44b-a86a08abe6d6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:05.276308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d5e4a3ff-6326-402f-8db7-d06c3ca93b8a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:05.309194 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d5e4a3ff-6326-402f-8db7-d06c3ca93b8a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 200 len: 1317 microversion: 2.1 time: 0.635341 Oct 29 01:24:05.310720 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2258/4698] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:04 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 1317 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:05.327114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-105bb267-245e-423c-bed6-338e67333474 req-51edd4ac-31cd-4656-9a42-38afe55cd7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63625132-862d-4c5a-bf16-fb4c27473ded", "name": "network-vif-plugged", "status": "completed", "tag": "e6533a78-71c5-4092-9b62-6164d8395e9c"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:05.359119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-105bb267-245e-423c-bed6-338e67333474 req-51edd4ac-31cd-4656-9a42-38afe55cd7b8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:05.359614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-105bb267-245e-423c-bed6-338e67333474 req-51edd4ac-31cd-4656-9a42-38afe55cd7b8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:05.370174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-105bb267-245e-423c-bed6-338e67333474 req-51edd4ac-31cd-4656-9a42-38afe55cd7b8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:05.390761 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-105bb267-245e-423c-bed6-338e67333474 req-51edd4ac-31cd-4656-9a42-38afe55cd7b8 service nova] Creating event network-vif-plugged:e6533a78-71c5-4092-9b62-6164d8395e9c for instance 63625132-862d-4c5a-bf16-fb4c27473ded on n-h1-862964-3 Oct 29 01:24:05.398805 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-105bb267-245e-423c-bed6-338e67333474 req-51edd4ac-31cd-4656-9a42-38afe55cd7b8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086657 Oct 29 01:24:05.399664 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2259/4699] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:24:05.413459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9f250c0b-d02c-4baf-ba2a-eee194005e52 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:05.414481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9f250c0b-d02c-4baf-ba2a-eee194005e52 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:05.428584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f250c0b-d02c-4baf-ba2a-eee194005e52 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:05.429418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f250c0b-d02c-4baf-ba2a-eee194005e52 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:05.432997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f250c0b-d02c-4baf-ba2a-eee194005e52 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:05.433936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f250c0b-d02c-4baf-ba2a-eee194005e52 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:05.435248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f250c0b-d02c-4baf-ba2a-eee194005e52 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:05.435887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f250c0b-d02c-4baf-ba2a-eee194005e52 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:05.462007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-844326fa-0a48-4839-b44b-a86a08abe6d6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:05.471487 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-844326fa-0a48-4839-b44b-a86a08abe6d6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1366 microversion: 2.1 time: 0.585490 Oct 29 01:24:05.472761 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2441/4700] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:04 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1366 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:05.797986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9f250c0b-d02c-4baf-ba2a-eee194005e52 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:05.813653 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9f250c0b-d02c-4baf-ba2a-eee194005e52 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.412526 Oct 29 01:24:05.815099 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2260/4701] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:05 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:05.855779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1c272401-f64a-48ff-8d99-57f5133f6e03 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97acaa60>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:05.936675 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1c272401-f64a-48ff-8d99-57f5133f6e03 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.085216 Oct 29 01:24:05.946405 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2442/4702] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:05 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:06.333188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-549232ad-186b-44e0-9f16-c512fe2c2b49 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:06.333815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-549232ad-186b-44e0-9f16-c512fe2c2b49 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:06.347719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-549232ad-186b-44e0-9f16-c512fe2c2b49 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:06.348139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-549232ad-186b-44e0-9f16-c512fe2c2b49 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:06.348618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-549232ad-186b-44e0-9f16-c512fe2c2b49 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:06.349311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-549232ad-186b-44e0-9f16-c512fe2c2b49 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:06.362612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-549232ad-186b-44e0-9f16-c512fe2c2b49 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:06.362992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-549232ad-186b-44e0-9f16-c512fe2c2b49 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:06.500396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8a1e210c-0b52-4687-a262-ade186428ba1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:06.503477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8a1e210c-0b52-4687-a262-ade186428ba1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:06.540288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a1e210c-0b52-4687-a262-ade186428ba1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:06.540777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a1e210c-0b52-4687-a262-ade186428ba1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:06.541236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a1e210c-0b52-4687-a262-ade186428ba1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:06.541942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a1e210c-0b52-4687-a262-ade186428ba1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:06.542393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a1e210c-0b52-4687-a262-ade186428ba1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:06.542820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a1e210c-0b52-4687-a262-ade186428ba1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:06.694254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-549232ad-186b-44e0-9f16-c512fe2c2b49 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:06.698187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:24:06.705832 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-549232ad-186b-44e0-9f16-c512fe2c2b49 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 200 len: 1317 microversion: 2.1 time: 0.375066 Oct 29 01:24:06.705832 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2261/4703] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:06 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:06.838587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7f1c6d6c-3899-4f2c-9d60-db8eb29ff736 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:06.839485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7f1c6d6c-3899-4f2c-9d60-db8eb29ff736 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:06.849904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7f1c6d6c-3899-4f2c-9d60-db8eb29ff736 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:06.850434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7f1c6d6c-3899-4f2c-9d60-db8eb29ff736 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:06.850886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7f1c6d6c-3899-4f2c-9d60-db8eb29ff736 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:06.851604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7f1c6d6c-3899-4f2c-9d60-db8eb29ff736 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:06.852064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7f1c6d6c-3899-4f2c-9d60-db8eb29ff736 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:06.852493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7f1c6d6c-3899-4f2c-9d60-db8eb29ff736 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:07.186943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7f1c6d6c-3899-4f2c-9d60-db8eb29ff736 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:07.198233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8a1e210c-0b52-4687-a262-ade186428ba1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:07.200284 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7f1c6d6c-3899-4f2c-9d60-db8eb29ff736 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.365043 Oct 29 01:24:07.204426 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2262/4704] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:06 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:07.208069 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8a1e210c-0b52-4687-a262-ade186428ba1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1366 microversion: 2.1 time: 0.711285 Oct 29 01:24:07.214007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8aff2aa0-a413-4b28-a8b8-0c8b78ad8fcc tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97a9e790>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:07.221803 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2443/4705] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:06 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1366 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:07.304766 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8aff2aa0-a413-4b28-a8b8-0c8b78ad8fcc tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.096864 Oct 29 01:24:07.309774 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2263/4706] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:07 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:07.729259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1c2a1f1b-59dc-4a64-9ce5-54424401dfb8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:07.730156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1c2a1f1b-59dc-4a64-9ce5-54424401dfb8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:07.753604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c2a1f1b-59dc-4a64-9ce5-54424401dfb8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:07.754560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c2a1f1b-59dc-4a64-9ce5-54424401dfb8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:07.755249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c2a1f1b-59dc-4a64-9ce5-54424401dfb8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:07.756189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c2a1f1b-59dc-4a64-9ce5-54424401dfb8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:07.756858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c2a1f1b-59dc-4a64-9ce5-54424401dfb8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:07.757555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c2a1f1b-59dc-4a64-9ce5-54424401dfb8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:07.988451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1c2a1f1b-59dc-4a64-9ce5-54424401dfb8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:07.999519 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1c2a1f1b-59dc-4a64-9ce5-54424401dfb8 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 200 len: 1317 microversion: 2.1 time: 0.272870 Oct 29 01:24:08.001340 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2444/4707] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:07 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:08.232790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7424abd6-63c7-4aa0-8729-29458712419b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:08.234939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7424abd6-63c7-4aa0-8729-29458712419b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:08.239396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6da9f901-674d-4ad3-9498-42e46b538e1b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:08.240217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6da9f901-674d-4ad3-9498-42e46b538e1b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:08.245103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7424abd6-63c7-4aa0-8729-29458712419b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:08.245634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7424abd6-63c7-4aa0-8729-29458712419b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:08.248953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7424abd6-63c7-4aa0-8729-29458712419b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:08.249921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7424abd6-63c7-4aa0-8729-29458712419b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:08.251104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6da9f901-674d-4ad3-9498-42e46b538e1b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:08.251606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6da9f901-674d-4ad3-9498-42e46b538e1b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:08.252582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7424abd6-63c7-4aa0-8729-29458712419b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:08.252749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6da9f901-674d-4ad3-9498-42e46b538e1b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:08.253468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7424abd6-63c7-4aa0-8729-29458712419b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:08.253644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6da9f901-674d-4ad3-9498-42e46b538e1b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:08.253938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6da9f901-674d-4ad3-9498-42e46b538e1b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:08.257749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6da9f901-674d-4ad3-9498-42e46b538e1b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:08.631563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6da9f901-674d-4ad3-9498-42e46b538e1b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:08.644731 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6da9f901-674d-4ad3-9498-42e46b538e1b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1366 microversion: 2.1 time: 0.409367 Oct 29 01:24:08.662344 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2445/4708] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:08 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:08.668215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a6e08db0-524b-4f7a-9d69-68614850fab1 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96eb1c10>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:08.699292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7424abd6-63c7-4aa0-8729-29458712419b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:08.716621 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7424abd6-63c7-4aa0-8729-29458712419b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.489159 Oct 29 01:24:08.717629 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2264/4709] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:08 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:08.723834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ace1459b-16ac-46c6-a098-cbd25a667d0b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:08.724455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ace1459b-16ac-46c6-a098-cbd25a667d0b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:08.731964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ace1459b-16ac-46c6-a098-cbd25a667d0b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:08.732858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ace1459b-16ac-46c6-a098-cbd25a667d0b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:08.733559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ace1459b-16ac-46c6-a098-cbd25a667d0b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:08.734549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ace1459b-16ac-46c6-a098-cbd25a667d0b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:08.735382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ace1459b-16ac-46c6-a098-cbd25a667d0b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:08.736048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ace1459b-16ac-46c6-a098-cbd25a667d0b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:08.760139 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-ace1459b-16ac-46c6-a098-cbd25a667d0b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:24:08.760533 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a6e08db0-524b-4f7a-9d69-68614850fab1 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.096235 Oct 29 01:24:08.761176 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2446/4710] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:08 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ace1459b-16ac-46c6-a098-cbd25a667d0b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a HTTP/1.1 Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'ac895d78-7d15-451d-a60f-4e80afb0241a'} Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:24:08.762689 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:24:08.772560 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:24:08.772560 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:24:08.772560 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:24:08.772560 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:24:08.772560 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:08.772560 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:24:08.772560 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:24:08.772560 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:24:08.772560 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:24:08.772560 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:24:08.772560 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:24:08.772560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ace1459b-16ac-46c6-a098-cbd25a667d0b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:24:08.772560 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ace1459b-16ac-46c6-a098-cbd25a667d0b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 404 len: 111 microversion: 2.1 time: 0.045571 Oct 29 01:24:08.772560 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2265/4711] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:24:08 2022] DELETE /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:24:08.779835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd62d6e6-7775-43d3-8a91-90cf7e5c4d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:08.780741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bd62d6e6-7775-43d3-8a91-90cf7e5c4d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: ac895d78-7d15-451d-a60f-4e80afb0241a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:08.788225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd62d6e6-7775-43d3-8a91-90cf7e5c4d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:08.788892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd62d6e6-7775-43d3-8a91-90cf7e5c4d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:08.791969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd62d6e6-7775-43d3-8a91-90cf7e5c4d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:08.791969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd62d6e6-7775-43d3-8a91-90cf7e5c4d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:08.791969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd62d6e6-7775-43d3-8a91-90cf7e5c4d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:08.791969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd62d6e6-7775-43d3-8a91-90cf7e5c4d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:08.815678 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-bd62d6e6-7775-43d3-8a91-90cf7e5c4d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd62d6e6-7775-43d3-8a91-90cf7e5c4d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a HTTP/1.1 Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'ac895d78-7d15-451d-a60f-4e80afb0241a'} Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:24:08.821610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:08.825949 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:08.825949 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:24:08.825949 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:24:08.825949 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:24:08.825949 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:24:08.825949 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. Oct 29 01:24:08.825949 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:08.825949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd62d6e6-7775-43d3-8a91-90cf7e5c4d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance ac895d78-7d15-451d-a60f-4e80afb0241a could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:24:08.825949 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bd62d6e6-7775-43d3-8a91-90cf7e5c4d3e tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a" status: 404 len: 111 microversion: 2.1 time: 0.048829 Oct 29 01:24:08.827077 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2447/4712] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:08 2022] GET /compute/v2.1/servers/ac895d78-7d15-451d-a60f-4e80afb0241a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:24:08.833206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-122e1ef2-f3a8-4d0d-bd30-f7971495ec8b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:08.833709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-122e1ef2-f3a8-4d0d-bd30-f7971495ec8b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:08.839888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-122e1ef2-f3a8-4d0d-bd30-f7971495ec8b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:08.840387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-122e1ef2-f3a8-4d0d-bd30-f7971495ec8b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:08.840823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-122e1ef2-f3a8-4d0d-bd30-f7971495ec8b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:08.841785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-122e1ef2-f3a8-4d0d-bd30-f7971495ec8b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:08.842802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-122e1ef2-f3a8-4d0d-bd30-f7971495ec8b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:08.843788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-122e1ef2-f3a8-4d0d-bd30-f7971495ec8b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:08.873734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-122e1ef2-f3a8-4d0d-bd30-f7971495ec8b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:24:09.025656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2743e292-74fa-457e-833b-8143662bb4a2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:09.026277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2743e292-74fa-457e-833b-8143662bb4a2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:09.034642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2743e292-74fa-457e-833b-8143662bb4a2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:09.035126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2743e292-74fa-457e-833b-8143662bb4a2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:09.035567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2743e292-74fa-457e-833b-8143662bb4a2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:09.036844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2743e292-74fa-457e-833b-8143662bb4a2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:09.037347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2743e292-74fa-457e-833b-8143662bb4a2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:09.037776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2743e292-74fa-457e-833b-8143662bb4a2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:09.179114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2743e292-74fa-457e-833b-8143662bb4a2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:09.187408 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2743e292-74fa-457e-833b-8143662bb4a2 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 200 len: 1317 microversion: 2.1 time: 0.165903 Oct 29 01:24:09.201723 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2448/4713] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:09 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:09.448865 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-122e1ef2-f3a8-4d0d-bd30-f7971495ec8b tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "DELETE /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 204 len: 0 microversion: 2.1 time: 0.619510 Oct 29 01:24:09.449506 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2266/4714] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:24:08 2022] DELETE /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:24:09.458289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b8a873bf-c805-4891-b16f-f95629fad2e3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:09.459086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b8a873bf-c805-4891-b16f-f95629fad2e3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:09.466754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8a873bf-c805-4891-b16f-f95629fad2e3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:09.467527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8a873bf-c805-4891-b16f-f95629fad2e3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:09.468035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8a873bf-c805-4891-b16f-f95629fad2e3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:09.468826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8a873bf-c805-4891-b16f-f95629fad2e3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:09.469411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8a873bf-c805-4891-b16f-f95629fad2e3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:09.469911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8a873bf-c805-4891-b16f-f95629fad2e3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:09.667984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b8a873bf-c805-4891-b16f-f95629fad2e3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:09.672450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3f58c651-4ee5-4f83-93e0-2f93da566dbe tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:09.675978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3f58c651-4ee5-4f83-93e0-2f93da566dbe tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:09.691438 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b8a873bf-c805-4891-b16f-f95629fad2e3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1511 microversion: 2.1 time: 0.235214 Oct 29 01:24:09.691641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f58c651-4ee5-4f83-93e0-2f93da566dbe tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:09.692292 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2449/4715] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:09 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1511 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:09.692740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f58c651-4ee5-4f83-93e0-2f93da566dbe tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:09.693286 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f58c651-4ee5-4f83-93e0-2f93da566dbe tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:09.694150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f58c651-4ee5-4f83-93e0-2f93da566dbe tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:09.694765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f58c651-4ee5-4f83-93e0-2f93da566dbe tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:09.695332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f58c651-4ee5-4f83-93e0-2f93da566dbe tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:09.751579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d43e0eaa-48e8-4b31-b35a-b136eca94ab9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:09.763178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d43e0eaa-48e8-4b31-b35a-b136eca94ab9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:09.763178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d43e0eaa-48e8-4b31-b35a-b136eca94ab9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:09.763178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d43e0eaa-48e8-4b31-b35a-b136eca94ab9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:09.763178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d43e0eaa-48e8-4b31-b35a-b136eca94ab9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:09.763178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d43e0eaa-48e8-4b31-b35a-b136eca94ab9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:09.763178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d43e0eaa-48e8-4b31-b35a-b136eca94ab9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:09.764229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d43e0eaa-48e8-4b31-b35a-b136eca94ab9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:09.975666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d43e0eaa-48e8-4b31-b35a-b136eca94ab9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:09.984948 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d43e0eaa-48e8-4b31-b35a-b136eca94ab9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.237180 Oct 29 01:24:09.986707 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2450/4716] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:09 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:09.991806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1dde3cb1-ba8a-4ab5-87ad-aa94552c0183 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96b75790>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:10.056060 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1dde3cb1-ba8a-4ab5-87ad-aa94552c0183 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.067803 Oct 29 01:24:10.056905 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2451/4717] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:09 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:10.212303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-55169680-9103-48f1-a6e1-a60e307a3a30 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:10.216847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-55169680-9103-48f1-a6e1-a60e307a3a30 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:10.229689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55169680-9103-48f1-a6e1-a60e307a3a30 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:10.230197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55169680-9103-48f1-a6e1-a60e307a3a30 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:10.233617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55169680-9103-48f1-a6e1-a60e307a3a30 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:10.234644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55169680-9103-48f1-a6e1-a60e307a3a30 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:10.235708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55169680-9103-48f1-a6e1-a60e307a3a30 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:10.236198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55169680-9103-48f1-a6e1-a60e307a3a30 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:10.281138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3f58c651-4ee5-4f83-93e0-2f93da566dbe tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:10.294165 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3f58c651-4ee5-4f83-93e0-2f93da566dbe tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1366 microversion: 2.1 time: 0.624125 Oct 29 01:24:10.294728 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2267/4718] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:09 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1366 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:10.460541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-55169680-9103-48f1-a6e1-a60e307a3a30 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:10.474645 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-55169680-9103-48f1-a6e1-a60e307a3a30 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 200 len: 1504 microversion: 2.1 time: 0.265573 Oct 29 01:24:10.476598 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2452/4719] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:10 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 1504 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:10.719151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ab7e0a2a-0740-4674-95b5-d5d122e75cfb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:10.719768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ab7e0a2a-0740-4674-95b5-d5d122e75cfb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:10.729570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab7e0a2a-0740-4674-95b5-d5d122e75cfb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:10.730294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab7e0a2a-0740-4674-95b5-d5d122e75cfb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:10.731391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab7e0a2a-0740-4674-95b5-d5d122e75cfb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:10.732269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab7e0a2a-0740-4674-95b5-d5d122e75cfb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:10.732890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab7e0a2a-0740-4674-95b5-d5d122e75cfb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:10.733549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab7e0a2a-0740-4674-95b5-d5d122e75cfb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:10.946385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ab7e0a2a-0740-4674-95b5-d5d122e75cfb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:10.959092 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ab7e0a2a-0740-4674-95b5-d5d122e75cfb tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1511 microversion: 2.1 time: 0.241403 Oct 29 01:24:10.963190 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2268/4720] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:10 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:11.016369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c3bcaa65-0d5e-4d13-8a74-9ab205a1c21f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:11.018696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c3bcaa65-0d5e-4d13-8a74-9ab205a1c21f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:11.034002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3bcaa65-0d5e-4d13-8a74-9ab205a1c21f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:11.035139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3bcaa65-0d5e-4d13-8a74-9ab205a1c21f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:11.037358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3bcaa65-0d5e-4d13-8a74-9ab205a1c21f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:11.038396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3bcaa65-0d5e-4d13-8a74-9ab205a1c21f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:11.040641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3bcaa65-0d5e-4d13-8a74-9ab205a1c21f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:11.041546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3bcaa65-0d5e-4d13-8a74-9ab205a1c21f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:11.056372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:24:11.072978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-54c632d4-53ec-4003-a773-d38b513c8546 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97c2baf0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:11.175363 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-54c632d4-53ec-4003-a773-d38b513c8546 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.105238 Oct 29 01:24:11.176308 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2269/4721] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:11 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:11.325099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3df23bba-475e-48f6-a5ea-be2515e26baf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:11.325099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3df23bba-475e-48f6-a5ea-be2515e26baf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:11.341141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c3bcaa65-0d5e-4d13-8a74-9ab205a1c21f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:11.347374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3df23bba-475e-48f6-a5ea-be2515e26baf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:11.347877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3df23bba-475e-48f6-a5ea-be2515e26baf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:11.348322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3df23bba-475e-48f6-a5ea-be2515e26baf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:11.349048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3df23bba-475e-48f6-a5ea-be2515e26baf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:11.349539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3df23bba-475e-48f6-a5ea-be2515e26baf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:11.349969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3df23bba-475e-48f6-a5ea-be2515e26baf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:11.356937 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c3bcaa65-0d5e-4d13-8a74-9ab205a1c21f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.348432 Oct 29 01:24:11.358035 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2453/4722] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:11 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:11.557543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3df23bba-475e-48f6-a5ea-be2515e26baf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:11.566648 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3df23bba-475e-48f6-a5ea-be2515e26baf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1366 microversion: 2.1 time: 0.252644 Oct 29 01:24:11.585536 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2270/4723] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:11 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:11.995407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-df5d95c6-1ee7-40a1-b72c-4a86d3b4d48d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:11.999921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-df5d95c6-1ee7-40a1-b72c-4a86d3b4d48d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:12.032847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df5d95c6-1ee7-40a1-b72c-4a86d3b4d48d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:12.033896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df5d95c6-1ee7-40a1-b72c-4a86d3b4d48d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:12.034534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df5d95c6-1ee7-40a1-b72c-4a86d3b4d48d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:12.035052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df5d95c6-1ee7-40a1-b72c-4a86d3b4d48d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:12.035515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df5d95c6-1ee7-40a1-b72c-4a86d3b4d48d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:12.035947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df5d95c6-1ee7-40a1-b72c-4a86d3b4d48d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:12.193484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-51a478dc-3025-4a7d-acbd-5aaf38b0740a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97ac1f70>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:12.255818 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-51a478dc-3025-4a7d-acbd-5aaf38b0740a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.068015 Oct 29 01:24:12.257402 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2271/4724] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:12 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:12.383422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1a487ab5-b99b-4717-a3b8-f81fa05a315f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:12.384206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1a487ab5-b99b-4717-a3b8-f81fa05a315f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:12.396995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a487ab5-b99b-4717-a3b8-f81fa05a315f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:12.398317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a487ab5-b99b-4717-a3b8-f81fa05a315f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:12.400345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a487ab5-b99b-4717-a3b8-f81fa05a315f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:12.401760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a487ab5-b99b-4717-a3b8-f81fa05a315f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:12.401875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-df5d95c6-1ee7-40a1-b72c-4a86d3b4d48d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:12.402546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a487ab5-b99b-4717-a3b8-f81fa05a315f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:12.403148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a487ab5-b99b-4717-a3b8-f81fa05a315f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:12.410537 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-df5d95c6-1ee7-40a1-b72c-4a86d3b4d48d tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1511 microversion: 2.1 time: 0.427036 Oct 29 01:24:12.414158 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2454/4725] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:11 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1511 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:12.591944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-200b3f5b-9d57-4dbe-a5a3-a64d282bb5d1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:12.591944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-200b3f5b-9d57-4dbe-a5a3-a64d282bb5d1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:12.608297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-200b3f5b-9d57-4dbe-a5a3-a64d282bb5d1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:12.608796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-200b3f5b-9d57-4dbe-a5a3-a64d282bb5d1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:12.609442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-200b3f5b-9d57-4dbe-a5a3-a64d282bb5d1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:12.610346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-200b3f5b-9d57-4dbe-a5a3-a64d282bb5d1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:12.617197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-200b3f5b-9d57-4dbe-a5a3-a64d282bb5d1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:12.617926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-200b3f5b-9d57-4dbe-a5a3-a64d282bb5d1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:12.672522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1a487ab5-b99b-4717-a3b8-f81fa05a315f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:12.685247 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1a487ab5-b99b-4717-a3b8-f81fa05a315f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.307133 Oct 29 01:24:12.686501 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2272/4726] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:12 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:12.976869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-200b3f5b-9d57-4dbe-a5a3-a64d282bb5d1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:12.979708 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-d5474099-6311-4173-b73e-79d6df9b1208 req-60ef5ae2-529c-4864-a80b-a53b98f80151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63371d26-fe85-4cfa-bdca-c8ad84b81ee6", "name": "network-vif-deleted", "tag": "f93b16c7-df1a-462b-be91-442aa008d850"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:12.989228 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-200b3f5b-9d57-4dbe-a5a3-a64d282bb5d1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1366 microversion: 2.1 time: 0.401415 Oct 29 01:24:12.991972 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2455/4727] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:12 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:13.001409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d5474099-6311-4173-b73e-79d6df9b1208 req-60ef5ae2-529c-4864-a80b-a53b98f80151 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:13.002753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d5474099-6311-4173-b73e-79d6df9b1208 req-60ef5ae2-529c-4864-a80b-a53b98f80151 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:13.003490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d5474099-6311-4173-b73e-79d6df9b1208 req-60ef5ae2-529c-4864-a80b-a53b98f80151 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:13.025082 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-d5474099-6311-4173-b73e-79d6df9b1208 req-60ef5ae2-529c-4864-a80b-a53b98f80151 service nova] Creating event network-vif-deleted:f93b16c7-df1a-462b-be91-442aa008d850 for instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 on n-h2-862964-3 Oct 29 01:24:13.043899 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-d5474099-6311-4173-b73e-79d6df9b1208 req-60ef5ae2-529c-4864-a80b-a53b98f80151 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068372 Oct 29 01:24:13.045259 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2273/4728] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:24:13.272564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-adb7ae8b-dc30-4e70-a06a-f1c7cb68a9f4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96b5b040>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:13.323519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-f53ab16c-2f1d-47d0-b4f9-6ef89426d4c8 req-135d5dc3-a20e-4e08-8254-e2cebab092e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c86e050-73e4-4c80-a145-420293bbf8b2", "name": "network-vif-plugged", "status": "completed", "tag": "85fe9242-041d-41ad-8dc3-ceea6e1ea126"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:13.329645 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-adb7ae8b-dc30-4e70-a06a-f1c7cb68a9f4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.060899 Oct 29 01:24:13.330290 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2456/4729] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:13 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:13.345978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f53ab16c-2f1d-47d0-b4f9-6ef89426d4c8 req-135d5dc3-a20e-4e08-8254-e2cebab092e7 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:13.346865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f53ab16c-2f1d-47d0-b4f9-6ef89426d4c8 req-135d5dc3-a20e-4e08-8254-e2cebab092e7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:13.347502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f53ab16c-2f1d-47d0-b4f9-6ef89426d4c8 req-135d5dc3-a20e-4e08-8254-e2cebab092e7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:13.362752 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f53ab16c-2f1d-47d0-b4f9-6ef89426d4c8 req-135d5dc3-a20e-4e08-8254-e2cebab092e7 service nova] Creating event network-vif-plugged:85fe9242-041d-41ad-8dc3-ceea6e1ea126 for instance 2c86e050-73e4-4c80-a145-420293bbf8b2 on n-h1-862964-3 Oct 29 01:24:13.369284 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-f53ab16c-2f1d-47d0-b4f9-6ef89426d4c8 req-135d5dc3-a20e-4e08-8254-e2cebab092e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052366 Oct 29 01:24:13.370288 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2274/4730] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:24:13.403836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-604ffa85-e20a-4ccb-b40b-a69402f33ae8 tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "9ef51538-19fb-4106-9489-e187c9ec8789"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:13.406259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-604ffa85-e20a-4ccb-b40b-a69402f33ae8 tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:13.414293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-604ffa85-e20a-4ccb-b40b-a69402f33ae8 tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:13.414994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-604ffa85-e20a-4ccb-b40b-a69402f33ae8 tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:13.415448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-604ffa85-e20a-4ccb-b40b-a69402f33ae8 tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:13.416165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-604ffa85-e20a-4ccb-b40b-a69402f33ae8 tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:13.416626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-604ffa85-e20a-4ccb-b40b-a69402f33ae8 tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:13.417061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-604ffa85-e20a-4ccb-b40b-a69402f33ae8 tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:13.443638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7447f93f-e408-466b-bbf1-7fee959f6246 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:13.444352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7447f93f-e408-466b-bbf1-7fee959f6246 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:13.451805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7447f93f-e408-466b-bbf1-7fee959f6246 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:13.452375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7447f93f-e408-466b-bbf1-7fee959f6246 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:13.452892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7447f93f-e408-466b-bbf1-7fee959f6246 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:13.453770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7447f93f-e408-466b-bbf1-7fee959f6246 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:13.454366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7447f93f-e408-466b-bbf1-7fee959f6246 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:13.454862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7447f93f-e408-466b-bbf1-7fee959f6246 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:13.469981 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-604ffa85-e20a-4ccb-b40b-a69402f33ae8 tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] HTTP exception thrown: Volume 191b5650-e968-4a32-bca7-59124af74079 could not be found. Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-604ffa85-e20a-4ccb-b40b-a69402f33ae8 tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] Request method failure captured: Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: request: PUT /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded/os-volume_attachments/191b5650-e968-4a32-bca7-59124af74079 HTTP/1.1 Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 74 Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIAPyaPww8dzsPZk0SoE02qZPrjV72uHGjVWxmQYEBDAbqt-gXQA_A-LbcaXOGrOCin2FJnoxj_gReEz9IfuHi-OLYOab0CK28SGGWrlfXGSW41O9EWr3KcC1MbAwteDjX9bid33k0pOtGiszVkNn7fLV521MNkVbL81DdXD2pSM0B0 Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 65a4554f9ed24a95b077cd602602b3c9 Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-VolumesAdminNegativeTest-953699152 Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/65a4554f9ed24a95b077cd602602b3c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/65a4554f9ed24a95b077cd602602b3c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/65a4554f9ed24a95b077cd602602b3c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_65a4554f9ed24a95b077cd602602b3c9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-VolumesAdminNegativeTest-953699152 Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 65a4554f9ed24a95b077cd602602b3c9 Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-953699152 Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-VolumesAdminNegativeTest-953699152-project-admin Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: a505e95dd74142d38c776fd9b320ed6a Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-VolumesAdminNegativeTest-953699152-project-admin Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: {"volumeAttachment": {"volumeId": "9ef51538-19fb-4106-9489-e187c9ec8789"}} Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: exception: Volume 191b5650-e968-4a32-bca7-59124af74079 could not be found. Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'server_id': '63625132-862d-4c5a-bf16-fb4c27473ded', 'id': '191b5650-e968-4a32-bca7-59124af74079', 'body': {'volumeAttachment': {'volumeId': '9ef51538-19fb-4106-9489-e187c9ec8789'}}} Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 191b5650-e968-4a32-bca7-59124af74079 could not be found. (HTTP 404) (Request-ID: req-5310ff79-5efa-4163-8191-bd1a5aa190d1) Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 01:24:13.472545 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 191b5650-e968-4a32-bca7-59124af74079 could not be found. Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 191b5650-e968-4a32-bca7-59124af74079 could not be found. Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 191b5650-e968-4a32-bca7-59124af74079 could not be found. Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-604ffa85-e20a-4ccb-b40b-a69402f33ae8 tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] Returning 404 to user: Volume 191b5650-e968-4a32-bca7-59124af74079 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-604ffa85-e20a-4ccb-b40b-a69402f33ae8 tempest-VolumesAdminNegativeTest-953699152 tempest-VolumesAdminNegativeTest-953699152-project-admin] 10.222.0.26 "PUT /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded/os-volume_attachments/191b5650-e968-4a32-bca7-59124af74079" status: 404 len: 109 microversion: 2.1 time: 0.074188 Oct 29 01:24:13.478220 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2457/4731] 10.222.0.26 () {60 vars in 1433 bytes} [Sat Oct 29 01:24:13 2022] PUT /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded/os-volume_attachments/191b5650-e968-4a32-bca7-59124af74079 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:24:13.548089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7447f93f-e408-466b-bbf1-7fee959f6246 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f1d9f22ae4b008486032a7f6269a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db514c084b19414db61960c65630a76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:13.557452 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7447f93f-e408-466b-bbf1-7fee959f6246 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 200 len: 1302 microversion: 2.1 time: 0.118856 Oct 29 01:24:13.558036 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2275/4732] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:13 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 1302 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:13.710691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-03e16d03-d840-4b4c-b5e3-3154541f4df4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:13.711344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-03e16d03-d840-4b4c-b5e3-3154541f4df4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:13.717905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03e16d03-d840-4b4c-b5e3-3154541f4df4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:13.718394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03e16d03-d840-4b4c-b5e3-3154541f4df4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:13.719037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03e16d03-d840-4b4c-b5e3-3154541f4df4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:13.719830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03e16d03-d840-4b4c-b5e3-3154541f4df4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:13.720495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03e16d03-d840-4b4c-b5e3-3154541f4df4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:13.721089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03e16d03-d840-4b4c-b5e3-3154541f4df4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:13.912044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-03e16d03-d840-4b4c-b5e3-3154541f4df4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:13.922574 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-03e16d03-d840-4b4c-b5e3-3154541f4df4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.215673 Oct 29 01:24:13.923923 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2458/4733] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:13 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:14.028637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4fdb02e8-c4fe-4a21-895c-7adb5cf34969 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:14.029485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4fdb02e8-c4fe-4a21-895c-7adb5cf34969 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:14.041917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fdb02e8-c4fe-4a21-895c-7adb5cf34969 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:14.043772 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fdb02e8-c4fe-4a21-895c-7adb5cf34969 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:14.044366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fdb02e8-c4fe-4a21-895c-7adb5cf34969 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:14.045987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fdb02e8-c4fe-4a21-895c-7adb5cf34969 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:14.046617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fdb02e8-c4fe-4a21-895c-7adb5cf34969 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:14.051622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fdb02e8-c4fe-4a21-895c-7adb5cf34969 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:14.213481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4fdb02e8-c4fe-4a21-895c-7adb5cf34969 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:14.226996 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4fdb02e8-c4fe-4a21-895c-7adb5cf34969 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1366 microversion: 2.1 time: 0.210277 Oct 29 01:24:14.228035 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2276/4734] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:14 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:14.347085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a35053be-24e4-4c32-97b4-10a47b56606c tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96a03550>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:14.397992 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a35053be-24e4-4c32-97b4-10a47b56606c tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1454 microversion: 2.1 time: 0.052420 Oct 29 01:24:14.397992 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2459/4735] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:14 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:14.583382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ead5cdef-4ef1-47ac-8566-cf6b6df6c3f3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:14.585187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ead5cdef-4ef1-47ac-8566-cf6b6df6c3f3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] [instance: 63371d26-fe85-4cfa-bdca-c8ad84b81ee6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:14.593149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ead5cdef-4ef1-47ac-8566-cf6b6df6c3f3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:14.593781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ead5cdef-4ef1-47ac-8566-cf6b6df6c3f3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:14.594346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ead5cdef-4ef1-47ac-8566-cf6b6df6c3f3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:14.595230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ead5cdef-4ef1-47ac-8566-cf6b6df6c3f3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:14.596412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ead5cdef-4ef1-47ac-8566-cf6b6df6c3f3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:14.599068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ead5cdef-4ef1-47ac-8566-cf6b6df6c3f3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:14.620375 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-ead5cdef-4ef1-47ac-8566-cf6b6df6c3f3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] HTTP exception thrown: Instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 could not be found. Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ead5cdef-4ef1-47ac-8566-cf6b6df6c3f3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Request method failure captured: Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 HTTP/1.1 Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH_Xzro7fvUGCsD93K0OthcsVzuwjvA-NjKSI-BO_XsHVh2X55NvGpSY3UUyLSN-Tcdaz5Qz2cMRDVx481YyAjyKgQL9dDMqCCEx7GwjkUOHqYZU44iFu0pg0flv4vSZ12RzbaOxqddG5nDCsp3NqCK186ICeKsyC4BH1ppsscXt0U8 Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db514c084b19414db61960c65630a76f Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db514c084b19414db61960c65630a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db514c084b19414db61960c65630a76f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db514c084b19414db61960c65630a76f", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db514c084b19414db61960c65630a76f Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersNegativeTestJSON-682468373 Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: db4f1d9f22ae4b008486032a7f6269a6 Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersNegativeTestJSON-682468373-project Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 could not be found. Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '63371d26-fe85-4cfa-bdca-c8ad84b81ee6'} Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 could not be found. Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 could not be found. Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:24:14.622084 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:24:14.626326 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:14.626326 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:24:14.626326 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:24:14.626326 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:24:14.626326 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:24:14.626326 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 could not be found. Oct 29 01:24:14.626326 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:24:14.626326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ead5cdef-4ef1-47ac-8566-cf6b6df6c3f3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] Returning 404 to user: Instance 63371d26-fe85-4cfa-bdca-c8ad84b81ee6 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:24:14.626326 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ead5cdef-4ef1-47ac-8566-cf6b6df6c3f3 tempest-ServersNegativeTestJSON-682468373 tempest-ServersNegativeTestJSON-682468373-project] 10.222.0.26 "GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6" status: 404 len: 111 microversion: 2.1 time: 0.046130 Oct 29 01:24:14.626326 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2277/4736] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:14 2022] GET /compute/v2.1/servers/63371d26-fe85-4cfa-bdca-c8ad84b81ee6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:24:14.947799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c2f8d5ae-9e90-4bf7-a711-35a3e3f1ab71 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:14.948635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c2f8d5ae-9e90-4bf7-a711-35a3e3f1ab71 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:14.958535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2f8d5ae-9e90-4bf7-a711-35a3e3f1ab71 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:14.959191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2f8d5ae-9e90-4bf7-a711-35a3e3f1ab71 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:14.959777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2f8d5ae-9e90-4bf7-a711-35a3e3f1ab71 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:14.960752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2f8d5ae-9e90-4bf7-a711-35a3e3f1ab71 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:14.961391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2f8d5ae-9e90-4bf7-a711-35a3e3f1ab71 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:14.961990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2f8d5ae-9e90-4bf7-a711-35a3e3f1ab71 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:15.132731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c2f8d5ae-9e90-4bf7-a711-35a3e3f1ab71 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:15.150594 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c2f8d5ae-9e90-4bf7-a711-35a3e3f1ab71 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.206830 Oct 29 01:24:15.157134 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2460/4737] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:14 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:15.254324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fb06d926-5d9c-498d-a43a-d58697f789c6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:15.257414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fb06d926-5d9c-498d-a43a-d58697f789c6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:15.263779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb06d926-5d9c-498d-a43a-d58697f789c6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:15.264279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb06d926-5d9c-498d-a43a-d58697f789c6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:15.264799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb06d926-5d9c-498d-a43a-d58697f789c6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:15.265540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb06d926-5d9c-498d-a43a-d58697f789c6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:15.266121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb06d926-5d9c-498d-a43a-d58697f789c6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:15.266562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb06d926-5d9c-498d-a43a-d58697f789c6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:15.417527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-190206ef-df54-4824-a204-823677ea39a1 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96f9eee0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:15.431563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fb06d926-5d9c-498d-a43a-d58697f789c6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:15.455595 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fb06d926-5d9c-498d-a43a-d58697f789c6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1366 microversion: 2.1 time: 0.205327 Oct 29 01:24:15.458120 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2278/4738] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:15 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:15.498067 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-190206ef-df54-4824-a204-823677ea39a1 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1463 microversion: 2.1 time: 0.084462 Oct 29 01:24:15.498067 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2461/4739] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:15 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1463 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:15.512205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6d499ab2-3de2-4794-8ad5-1216a7a27a38 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97b0dc10>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:15.575536 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6d499ab2-3de2-4794-8ad5-1216a7a27a38 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 200 len: 1463 microversion: 2.1 time: 0.071521 Oct 29 01:24:15.576123 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2279/4740] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:15 2022] GET /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 1463 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:15.592679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-299128e4-9fc0-4881-ba9a-b3f6e67a4ebd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:15.593651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-299128e4-9fc0-4881-ba9a-b3f6e67a4ebd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 7616f1ea-1339-425c-9ab9-45431f3cd608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:15.604312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-299128e4-9fc0-4881-ba9a-b3f6e67a4ebd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:15.605024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-299128e4-9fc0-4881-ba9a-b3f6e67a4ebd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:15.605615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-299128e4-9fc0-4881-ba9a-b3f6e67a4ebd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:15.606311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-299128e4-9fc0-4881-ba9a-b3f6e67a4ebd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:15.606927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-299128e4-9fc0-4881-ba9a-b3f6e67a4ebd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:15.609325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-299128e4-9fc0-4881-ba9a-b3f6e67a4ebd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:15.766505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-299128e4-9fc0-4881-ba9a-b3f6e67a4ebd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:15.793105 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-299128e4-9fc0-4881-ba9a-b3f6e67a4ebd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608" status: 200 len: 1480 microversion: 2.1 time: 0.204411 Oct 29 01:24:15.793807 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2462/4741] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:15 2022] GET /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608 => generated 1480 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:16.178202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d38d0044-5bf5-4657-8462-b3e2037f5d68 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:16.179199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d38d0044-5bf5-4657-8462-b3e2037f5d68 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:16.196998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d38d0044-5bf5-4657-8462-b3e2037f5d68 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:16.197911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d38d0044-5bf5-4657-8462-b3e2037f5d68 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:16.198361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d38d0044-5bf5-4657-8462-b3e2037f5d68 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:16.199089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d38d0044-5bf5-4657-8462-b3e2037f5d68 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:16.199733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d38d0044-5bf5-4657-8462-b3e2037f5d68 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:16.200198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d38d0044-5bf5-4657-8462-b3e2037f5d68 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:16.385847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d38d0044-5bf5-4657-8462-b3e2037f5d68 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:16.396016 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d38d0044-5bf5-4657-8462-b3e2037f5d68 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.223872 Oct 29 01:24:16.397337 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2280/4742] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:16 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:16.481126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-18534ec4-5759-4234-b383-9e5b450bc4f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:16.483028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-18534ec4-5759-4234-b383-9e5b450bc4f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:16.493310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18534ec4-5759-4234-b383-9e5b450bc4f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:16.493986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18534ec4-5759-4234-b383-9e5b450bc4f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:16.497508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18534ec4-5759-4234-b383-9e5b450bc4f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:16.497508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18534ec4-5759-4234-b383-9e5b450bc4f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:16.497508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18534ec4-5759-4234-b383-9e5b450bc4f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:16.499323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18534ec4-5759-4234-b383-9e5b450bc4f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:16.695784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-18534ec4-5759-4234-b383-9e5b450bc4f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:16.718384 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-18534ec4-5759-4234-b383-9e5b450bc4f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1556 microversion: 2.1 time: 0.240927 Oct 29 01:24:16.721416 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2463/4743] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:16 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1556 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:16.752476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-40897761-63b0-4138-b9a3-66d0bce51189 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:16.753763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-40897761-63b0-4138-b9a3-66d0bce51189 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:16.768983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40897761-63b0-4138-b9a3-66d0bce51189 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:16.768983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40897761-63b0-4138-b9a3-66d0bce51189 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:16.769185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40897761-63b0-4138-b9a3-66d0bce51189 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:16.770049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40897761-63b0-4138-b9a3-66d0bce51189 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:16.770514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40897761-63b0-4138-b9a3-66d0bce51189 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:16.771400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40897761-63b0-4138-b9a3-66d0bce51189 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:16.827682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e40d5c70-a166-4cfd-8e11-0154ab3dc262 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:16.828316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e40d5c70-a166-4cfd-8e11-0154ab3dc262 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 7616f1ea-1339-425c-9ab9-45431f3cd608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:16.876583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e40d5c70-a166-4cfd-8e11-0154ab3dc262 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:16.889634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e40d5c70-a166-4cfd-8e11-0154ab3dc262 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:16.890222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e40d5c70-a166-4cfd-8e11-0154ab3dc262 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:16.891511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e40d5c70-a166-4cfd-8e11-0154ab3dc262 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:16.892036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e40d5c70-a166-4cfd-8e11-0154ab3dc262 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:16.893282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e40d5c70-a166-4cfd-8e11-0154ab3dc262 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:17.037362 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-40897761-63b0-4138-b9a3-66d0bce51189 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.289803 Oct 29 01:24:17.038907 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2281/4744] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:24:16 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-interface => generated 284 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:24:17.152556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3b114b47-3766-415c-8ee1-8bc6ef4ee78e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:17.153048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3b114b47-3766-415c-8ee1-8bc6ef4ee78e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:17.165364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b114b47-3766-415c-8ee1-8bc6ef4ee78e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:17.171793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b114b47-3766-415c-8ee1-8bc6ef4ee78e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:17.171793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b114b47-3766-415c-8ee1-8bc6ef4ee78e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:17.171793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b114b47-3766-415c-8ee1-8bc6ef4ee78e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:17.171793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b114b47-3766-415c-8ee1-8bc6ef4ee78e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:17.171793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b114b47-3766-415c-8ee1-8bc6ef4ee78e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:17.203118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3b114b47-3766-415c-8ee1-8bc6ef4ee78e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:24:17.267720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:24:17.591551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e40d5c70-a166-4cfd-8e11-0154ab3dc262 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:17.601186 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e40d5c70-a166-4cfd-8e11-0154ab3dc262 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608" status: 200 len: 1467 microversion: 2.1 time: 0.783767 Oct 29 01:24:17.605497 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2464/4745] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:16 2022] GET /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608 => generated 1467 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:17.623518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a7a5e5e3-5189-446e-94ff-f5368e1c7811 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:17.623518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a7a5e5e3-5189-446e-94ff-f5368e1c7811 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:17.635832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7a5e5e3-5189-446e-94ff-f5368e1c7811 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:17.636609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7a5e5e3-5189-446e-94ff-f5368e1c7811 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:17.637241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7a5e5e3-5189-446e-94ff-f5368e1c7811 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:17.638123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7a5e5e3-5189-446e-94ff-f5368e1c7811 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:17.640993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7a5e5e3-5189-446e-94ff-f5368e1c7811 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:17.641690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7a5e5e3-5189-446e-94ff-f5368e1c7811 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:17.649372 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3b114b47-3766-415c-8ee1-8bc6ef4ee78e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "DELETE /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 204 len: 0 microversion: 2.1 time: 0.500055 Oct 29 01:24:17.652175 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2282/4746] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:24:17 2022] DELETE /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:24:17.661545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-80d9ccd6-c71b-414b-84c9-bc4bef92be97 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-31722964"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:17.667935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-80d9ccd6-c71b-414b-84c9-bc4bef92be97 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:17.686458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80d9ccd6-c71b-414b-84c9-bc4bef92be97 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:17.691537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80d9ccd6-c71b-414b-84c9-bc4bef92be97 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:17.692033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80d9ccd6-c71b-414b-84c9-bc4bef92be97 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:17.700712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80d9ccd6-c71b-414b-84c9-bc4bef92be97 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:17.700712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80d9ccd6-c71b-414b-84c9-bc4bef92be97 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:17.700712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80d9ccd6-c71b-414b-84c9-bc4bef92be97 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:18.318119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a7a5e5e3-5189-446e-94ff-f5368e1c7811 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:18.330545 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a7a5e5e3-5189-446e-94ff-f5368e1c7811 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.723099 Oct 29 01:24:18.331757 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2465/4747] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:17 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:18.342006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-16fb8885-7479-4673-8cf8-5301460d9691 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:18.350207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-16fb8885-7479-4673-8cf8-5301460d9691 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:18.363488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16fb8885-7479-4673-8cf8-5301460d9691 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:18.363488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16fb8885-7479-4673-8cf8-5301460d9691 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:18.363488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16fb8885-7479-4673-8cf8-5301460d9691 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:18.363488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16fb8885-7479-4673-8cf8-5301460d9691 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:18.363488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16fb8885-7479-4673-8cf8-5301460d9691 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:18.363488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16fb8885-7479-4673-8cf8-5301460d9691 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:18.488147 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-80d9ccd6-c71b-414b-84c9-bc4bef92be97 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "POST /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d/action" status: 202 len: 0 microversion: 2.1 time: 0.836316 Oct 29 01:24:18.492894 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2283/4748] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:24:17 2022] POST /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d/action => generated 0 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 01:24:18.511976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a1a6921b-dae0-4660-b812-0b294d690360 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97cae1f0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:18.583050 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a1a6921b-dae0-4660-b812-0b294d690360 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.078671 Oct 29 01:24:18.583593 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2284/4749] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:18 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:18.781041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-16fb8885-7479-4673-8cf8-5301460d9691 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:18.792454 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-16fb8885-7479-4673-8cf8-5301460d9691 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 200 len: 1510 microversion: 2.1 time: 0.459380 Oct 29 01:24:18.793049 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2466/4750] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:18 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 1510 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:19.354675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7eca2a81-10ac-4026-9a5b-db3e4dd60fc6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:19.355597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7eca2a81-10ac-4026-9a5b-db3e4dd60fc6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:19.371305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7eca2a81-10ac-4026-9a5b-db3e4dd60fc6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:19.375077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7eca2a81-10ac-4026-9a5b-db3e4dd60fc6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:19.379277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7eca2a81-10ac-4026-9a5b-db3e4dd60fc6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:19.382122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7eca2a81-10ac-4026-9a5b-db3e4dd60fc6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:19.385788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7eca2a81-10ac-4026-9a5b-db3e4dd60fc6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:19.387417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7eca2a81-10ac-4026-9a5b-db3e4dd60fc6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:19.594733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4b5ce829-d2ee-461d-91ba-8d5c929f4695 req-a0ae4032-7e37-4948-8e53-ddbe207baf47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c86e050-73e4-4c80-a145-420293bbf8b2", "tag": "85fe9242-041d-41ad-8dc3-ceea6e1ea126"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:19.615778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4b5ce829-d2ee-461d-91ba-8d5c929f4695 req-a0ae4032-7e37-4948-8e53-ddbe207baf47 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:19.616256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4b5ce829-d2ee-461d-91ba-8d5c929f4695 req-a0ae4032-7e37-4948-8e53-ddbe207baf47 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:19.616686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4b5ce829-d2ee-461d-91ba-8d5c929f4695 req-a0ae4032-7e37-4948-8e53-ddbe207baf47 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:19.641143 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4b5ce829-d2ee-461d-91ba-8d5c929f4695 req-a0ae4032-7e37-4948-8e53-ddbe207baf47 service nova] Creating event network-changed:85fe9242-041d-41ad-8dc3-ceea6e1ea126 for instance 2c86e050-73e4-4c80-a145-420293bbf8b2 on n-h1-862964-3 Oct 29 01:24:19.656240 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4b5ce829-d2ee-461d-91ba-8d5c929f4695 req-a0ae4032-7e37-4948-8e53-ddbe207baf47 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067165 Oct 29 01:24:19.656860 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2467/4751] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:24:19.675613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-241e79bc-5a5d-40a0-91d7-a917f83e57a4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96ec9280>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:19.746850 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-241e79bc-5a5d-40a0-91d7-a917f83e57a4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.083218 Oct 29 01:24:19.747861 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2468/4752] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:19 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:19.821516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80c948cb-5e4e-450e-8275-ec12b0e81431 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:19.822884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-80c948cb-5e4e-450e-8275-ec12b0e81431 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:19.835021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80c948cb-5e4e-450e-8275-ec12b0e81431 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:19.837782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80c948cb-5e4e-450e-8275-ec12b0e81431 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:19.838408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80c948cb-5e4e-450e-8275-ec12b0e81431 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:19.857930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80c948cb-5e4e-450e-8275-ec12b0e81431 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:19.860109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80c948cb-5e4e-450e-8275-ec12b0e81431 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:19.862769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80c948cb-5e4e-450e-8275-ec12b0e81431 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:19.935448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7eca2a81-10ac-4026-9a5b-db3e4dd60fc6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:19.951523 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7eca2a81-10ac-4026-9a5b-db3e4dd60fc6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.600431 Oct 29 01:24:19.966145 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2285/4753] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:19 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:19.966145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a43cde19-ada5-474f-9958-f1f6294b4caf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:19.966145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a43cde19-ada5-474f-9958-f1f6294b4caf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:19.992546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a43cde19-ada5-474f-9958-f1f6294b4caf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:19.993335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a43cde19-ada5-474f-9958-f1f6294b4caf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:19.995379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a43cde19-ada5-474f-9958-f1f6294b4caf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:19.995379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a43cde19-ada5-474f-9958-f1f6294b4caf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:19.995955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a43cde19-ada5-474f-9958-f1f6294b4caf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:19.998731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a43cde19-ada5-474f-9958-f1f6294b4caf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:20.035937 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a43cde19-ada5-474f-9958-f1f6294b4caf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/ips" status: 200 len: 144 microversion: 2.1 time: 0.077983 Oct 29 01:24:20.037343 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2286/4754] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 29 01:24:19 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/ips => generated 144 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:24:20.162774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-80c948cb-5e4e-450e-8275-ec12b0e81431 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:20.173105 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-80c948cb-5e4e-450e-8275-ec12b0e81431 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 200 len: 1510 microversion: 2.1 time: 0.358274 Oct 29 01:24:20.175339 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2469/4755] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:19 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 1510 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:20.402372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-61b89008-b1e4-4b35-90a6-43bf1aa6fb1f req-e4a11ccf-d58f-4240-86bd-ca21acf2b06e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7616f1ea-1339-425c-9ab9-45431f3cd608", "name": "network-vif-unplugged", "status": "completed", "tag": "1f225c5e-7d18-4b8d-9938-9a97f24a39fc"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:20.415814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-61b89008-b1e4-4b35-90a6-43bf1aa6fb1f req-e4a11ccf-d58f-4240-86bd-ca21acf2b06e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:20.416943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-61b89008-b1e4-4b35-90a6-43bf1aa6fb1f req-e4a11ccf-d58f-4240-86bd-ca21acf2b06e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:20.417590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-61b89008-b1e4-4b35-90a6-43bf1aa6fb1f req-e4a11ccf-d58f-4240-86bd-ca21acf2b06e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:20.435772 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-61b89008-b1e4-4b35-90a6-43bf1aa6fb1f req-e4a11ccf-d58f-4240-86bd-ca21acf2b06e service nova] Creating event network-vif-unplugged:1f225c5e-7d18-4b8d-9938-9a97f24a39fc for instance 7616f1ea-1339-425c-9ab9-45431f3cd608 on n-h2-862964-3 Oct 29 01:24:20.446986 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-61b89008-b1e4-4b35-90a6-43bf1aa6fb1f req-e4a11ccf-d58f-4240-86bd-ca21acf2b06e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048563 Oct 29 01:24:20.447961 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2287/4756] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:24:20.764789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eb2834cf-3159-4245-86d0-5c9f23e4d3d8 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9feea8b0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:20.840359 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eb2834cf-3159-4245-86d0-5c9f23e4d3d8 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.078245 Oct 29 01:24:20.842558 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2470/4757] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:20 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:20.979225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cf555fc0-39d9-4ca9-aa52-d904d1288c7f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:20.983036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cf555fc0-39d9-4ca9-aa52-d904d1288c7f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:21.000688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf555fc0-39d9-4ca9-aa52-d904d1288c7f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:21.000688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf555fc0-39d9-4ca9-aa52-d904d1288c7f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:21.000688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf555fc0-39d9-4ca9-aa52-d904d1288c7f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:21.001120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf555fc0-39d9-4ca9-aa52-d904d1288c7f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:21.003122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf555fc0-39d9-4ca9-aa52-d904d1288c7f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:21.003122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf555fc0-39d9-4ca9-aa52-d904d1288c7f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:21.198065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ebc7418a-04a2-4d80-b5eb-b5833d0f0f80 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:21.198980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ebc7418a-04a2-4d80-b5eb-b5833d0f0f80 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:21.226750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebc7418a-04a2-4d80-b5eb-b5833d0f0f80 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:21.227288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebc7418a-04a2-4d80-b5eb-b5833d0f0f80 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:21.227911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebc7418a-04a2-4d80-b5eb-b5833d0f0f80 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:21.229485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebc7418a-04a2-4d80-b5eb-b5833d0f0f80 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:21.232041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebc7418a-04a2-4d80-b5eb-b5833d0f0f80 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:21.232492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebc7418a-04a2-4d80-b5eb-b5833d0f0f80 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:21.306134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cf555fc0-39d9-4ca9-aa52-d904d1288c7f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:21.326950 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cf555fc0-39d9-4ca9-aa52-d904d1288c7f tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.352361 Oct 29 01:24:21.330888 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2288/4758] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:20 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:21.365184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ebc7418a-04a2-4d80-b5eb-b5833d0f0f80 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:21.375143 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ebc7418a-04a2-4d80-b5eb-b5833d0f0f80 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 200 len: 1302 microversion: 2.1 time: 0.181304 Oct 29 01:24:21.376228 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2471/4759] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:21 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 1302 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:21.743977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-418707b7-bd96-41fc-a7ab-4d487565823e req-e8ed5f79-779e-440e-97b2-85ee1a79ed85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63625132-862d-4c5a-bf16-fb4c27473ded", "name": "network-vif-deleted", "tag": "e6533a78-71c5-4092-9b62-6164d8395e9c"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:21.757802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-418707b7-bd96-41fc-a7ab-4d487565823e req-e8ed5f79-779e-440e-97b2-85ee1a79ed85 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:21.758531 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-418707b7-bd96-41fc-a7ab-4d487565823e req-e8ed5f79-779e-440e-97b2-85ee1a79ed85 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:21.759330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-418707b7-bd96-41fc-a7ab-4d487565823e req-e8ed5f79-779e-440e-97b2-85ee1a79ed85 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:21.781678 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-418707b7-bd96-41fc-a7ab-4d487565823e req-e8ed5f79-779e-440e-97b2-85ee1a79ed85 service nova] Creating event network-vif-deleted:e6533a78-71c5-4092-9b62-6164d8395e9c for instance 63625132-862d-4c5a-bf16-fb4c27473ded on n-h1-862964-3 Oct 29 01:24:21.791942 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-418707b7-bd96-41fc-a7ab-4d487565823e req-e8ed5f79-779e-440e-97b2-85ee1a79ed85 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058584 Oct 29 01:24:21.797786 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2289/4760] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:24:21.859413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-da40f706-003f-41af-b111-a10dad89eea8 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9c761d30>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:21.921765 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-da40f706-003f-41af-b111-a10dad89eea8 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.067664 Oct 29 01:24:21.922459 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2472/4761] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:21 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:22.356304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-75a3651f-7e56-438c-acab-06646a757e57 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:22.357704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-75a3651f-7e56-438c-acab-06646a757e57 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:22.371879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-75a3651f-7e56-438c-acab-06646a757e57 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:22.372645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-75a3651f-7e56-438c-acab-06646a757e57 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:22.373290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-75a3651f-7e56-438c-acab-06646a757e57 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:22.374222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-75a3651f-7e56-438c-acab-06646a757e57 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:22.374874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-75a3651f-7e56-438c-acab-06646a757e57 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:22.375485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-75a3651f-7e56-438c-acab-06646a757e57 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:22.402093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:22.403035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:22.416883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:22.422994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:22.423844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:22.425482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:22.426166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:22.426779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:22.573825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:22.574614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:22.575249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:22.575871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lazy-loading 'fault' on Instance uuid 63625132-862d-4c5a-bf16-fb4c27473ded {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:24:22.746719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:22.766006 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 200 len: 1307 microversion: 2.1 time: 0.360168 Oct 29 01:24:22.773314 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2473/4762] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:22 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 1307 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:22.801806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:22.803083 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001527 Oct 29 01:24:22.803920 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2474/4763] 10.222.0.26 () {56 vars in 886 bytes} [Sat Oct 29 01:24:22 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 29 01:24:22.813110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:22.814520 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001698 Oct 29 01:24:22.820813 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2475/4764] 10.222.0.26 () {54 vars in 1035 bytes} [Sat Oct 29 01:24:22 2022] GET /compute/v2/ => generated 379 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 29 01:24:22.830516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:22.831589 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.009862 Oct 29 01:24:22.832228 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2476/4765] 10.222.0.26 () {54 vars in 1041 bytes} [Sat Oct 29 01:24:22 2022] GET /compute/v2.1/ => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:24:22.842683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:22.845409 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d2be47fe-7742-4fee-b26a-f8e25e7dd97e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002912 Oct 29 01:24:22.855570 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2477/4766] 10.222.0.26 () {56 vars in 886 bytes} [Sat Oct 29 01:24:22 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 29 01:24:22.864825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-75a3651f-7e56-438c-acab-06646a757e57 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:22.874652 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-75a3651f-7e56-438c-acab-06646a757e57 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.521334 Oct 29 01:24:22.875134 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2290/4767] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:22 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:22.941043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cba209b6-204f-4db5-b7f3-d36e5fb5d52b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96ec9670>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:22.995866 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cba209b6-204f-4db5-b7f3-d36e5fb5d52b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.060627 Oct 29 01:24:22.996583 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2478/4768] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:22 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:23.358378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-02c43063-a7c4-45aa-ad8b-70e89ab9fdfa tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "daddb6cf-367c-484f-9780-fd9f5474bc58"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:23.361910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-02c43063-a7c4-45aa-ad8b-70e89ab9fdfa tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:23.368480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02c43063-a7c4-45aa-ad8b-70e89ab9fdfa tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:23.369189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02c43063-a7c4-45aa-ad8b-70e89ab9fdfa tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:23.369661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02c43063-a7c4-45aa-ad8b-70e89ab9fdfa tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:23.370359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02c43063-a7c4-45aa-ad8b-70e89ab9fdfa tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:23.370812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02c43063-a7c4-45aa-ad8b-70e89ab9fdfa tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:23.377146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02c43063-a7c4-45aa-ad8b-70e89ab9fdfa tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:23.791087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a0b8fba9-c5b4-4ad1-9186-200e622cc1ea tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:23.791709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a0b8fba9-c5b4-4ad1-9186-200e622cc1ea tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 63625132-862d-4c5a-bf16-fb4c27473ded] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:23.800894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0b8fba9-c5b4-4ad1-9186-200e622cc1ea tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:23.801342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0b8fba9-c5b4-4ad1-9186-200e622cc1ea tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:23.801783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0b8fba9-c5b4-4ad1-9186-200e622cc1ea tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:23.802697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0b8fba9-c5b4-4ad1-9186-200e622cc1ea tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:23.803160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0b8fba9-c5b4-4ad1-9186-200e622cc1ea tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:23.803585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0b8fba9-c5b4-4ad1-9186-200e622cc1ea tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:23.817393 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-a0b8fba9-c5b4-4ad1-9186-200e622cc1ea tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] HTTP exception thrown: Instance 63625132-862d-4c5a-bf16-fb4c27473ded could not be found. Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a0b8fba9-c5b4-4ad1-9186-200e622cc1ea tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Request method failure captured: Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded HTTP/1.1 Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_5GKr04zjeXc2CFsw6ZgrIPnipSf9CR4TjQ8ih_sCYqdRXn6341qyIve5sk1Akw5tpQTseiN3wcSBzoeiBGrosfmm3rk0t2q9Ti_vxpibAqS8GyQQmLrp3jYI7Sm4_9RNGhaSjJAiTjOnrRxVX8TYLdYEFI6wWKqPqknGitse066I Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 39133f363c084812920780d4eb6d227b Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-VolumesAdminNegativeTest-1903341061 Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/39133f363c084812920780d4eb6d227b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/39133f363c084812920780d4eb6d227b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/39133f363c084812920780d4eb6d227b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_39133f363c084812920780d4eb6d227b", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-VolumesAdminNegativeTest-1903341061 Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 39133f363c084812920780d4eb6d227b Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1903341061 Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-VolumesAdminNegativeTest-1903341061-project Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8d3714617f36472f8e4b1d55887cdefc Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-VolumesAdminNegativeTest-1903341061-project Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 63625132-862d-4c5a-bf16-fb4c27473ded could not be found. Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '63625132-862d-4c5a-bf16-fb4c27473ded'} Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63625132-862d-4c5a-bf16-fb4c27473ded could not be found. Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63625132-862d-4c5a-bf16-fb4c27473ded could not be found. Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:24:23.819082 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:23.823604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:23.823604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:24:23.823604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:24:23.823604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:24:23.823604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:24:23.823604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63625132-862d-4c5a-bf16-fb4c27473ded could not be found. Oct 29 01:24:23.823604 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:23.823604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a0b8fba9-c5b4-4ad1-9186-200e622cc1ea tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Returning 404 to user: Instance 63625132-862d-4c5a-bf16-fb4c27473ded could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:24:23.823604 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a0b8fba9-c5b4-4ad1-9186-200e622cc1ea tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded" status: 404 len: 111 microversion: 2.1 time: 0.033706 Oct 29 01:24:23.824674 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2479/4769] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:23 2022] GET /compute/v2.1/servers/63625132-862d-4c5a-bf16-fb4c27473ded => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:24:23.899157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5b3f6d25-a63b-4015-bf3a-b2bd291295ee tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:23.899771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5b3f6d25-a63b-4015-bf3a-b2bd291295ee tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:23.905745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b3f6d25-a63b-4015-bf3a-b2bd291295ee tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:23.906225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b3f6d25-a63b-4015-bf3a-b2bd291295ee tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:23.906669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b3f6d25-a63b-4015-bf3a-b2bd291295ee tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:23.907350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b3f6d25-a63b-4015-bf3a-b2bd291295ee tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:23.908324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b3f6d25-a63b-4015-bf3a-b2bd291295ee tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:23.908802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b3f6d25-a63b-4015-bf3a-b2bd291295ee tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:24.058194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5b3f6d25-a63b-4015-bf3a-b2bd291295ee tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:24.072338 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5b3f6d25-a63b-4015-bf3a-b2bd291295ee tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.176703 Oct 29 01:24:24.073825 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2480/4770] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:23 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:24.082611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-20a1262a-85af-4138-8010-d14815d90dc8 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96ec9430>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:24.139734 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-20a1262a-85af-4138-8010-d14815d90dc8 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.064441 Oct 29 01:24:24.140399 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2481/4771] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:24 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:24.420794 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-02c43063-a7c4-45aa-ad8b-70e89ab9fdfa tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "POST /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.053330 Oct 29 01:24:24.429241 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2291/4772] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 29 01:24:23 2022] POST /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments => generated 194 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:24:25.097183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cfebb384-9ab2-43ea-af93-6e8ff240f6c6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:25.097845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cfebb384-9ab2-43ea-af93-6e8ff240f6c6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:25.109651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfebb384-9ab2-43ea-af93-6e8ff240f6c6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:25.109986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfebb384-9ab2-43ea-af93-6e8ff240f6c6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:25.110433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfebb384-9ab2-43ea-af93-6e8ff240f6c6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:25.111951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfebb384-9ab2-43ea-af93-6e8ff240f6c6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:25.112409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfebb384-9ab2-43ea-af93-6e8ff240f6c6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:25.112839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfebb384-9ab2-43ea-af93-6e8ff240f6c6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:25.156363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1f671aa5-6f78-4c18-b455-6186c3e4f243 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97f0eaf0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:25.221251 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1f671aa5-6f78-4c18-b455-6186c3e4f243 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.068083 Oct 29 01:24:25.222151 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2292/4773] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:25 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:25.355626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cfebb384-9ab2-43ea-af93-6e8ff240f6c6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:25.366860 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cfebb384-9ab2-43ea-af93-6e8ff240f6c6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.274253 Oct 29 01:24:25.381181 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2482/4774] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:25 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:26.240155 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3e20b14b-2901-48f1-a6e2-d96114f6d7a2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97a9ea60>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:26.271117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-1d1d3057-875c-4cfa-903c-29b23cf1d611 req-b5c9f5aa-0ac9-4250-979e-d0803ba7ea68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391c56c8-b8d8-424c-91d7-dc0408b9e71d", "name": "network-vif-plugged", "status": "completed", "tag": "bfe88ae5-26ce-42b9-a002-0635e32f69b1"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:26.307381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1d1d3057-875c-4cfa-903c-29b23cf1d611 req-b5c9f5aa-0ac9-4250-979e-d0803ba7ea68 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:26.308846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1d1d3057-875c-4cfa-903c-29b23cf1d611 req-b5c9f5aa-0ac9-4250-979e-d0803ba7ea68 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:26.310829 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1d1d3057-875c-4cfa-903c-29b23cf1d611 req-b5c9f5aa-0ac9-4250-979e-d0803ba7ea68 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:26.313136 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3e20b14b-2901-48f1-a6e2-d96114f6d7a2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.079655 Oct 29 01:24:26.321323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:24:26.322635 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2293/4775] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:26 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:26.341435 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-1d1d3057-875c-4cfa-903c-29b23cf1d611 req-b5c9f5aa-0ac9-4250-979e-d0803ba7ea68 service nova] Creating event network-vif-plugged:bfe88ae5-26ce-42b9-a002-0635e32f69b1 for instance 391c56c8-b8d8-424c-91d7-dc0408b9e71d on n-h2-862964-3 Oct 29 01:24:26.353869 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-1d1d3057-875c-4cfa-903c-29b23cf1d611 req-b5c9f5aa-0ac9-4250-979e-d0803ba7ea68 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087819 Oct 29 01:24:26.357349 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2483/4776] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:24:26.391183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9f859331-e6e1-4245-bdd5-50566bfacae0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:26.396169 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9f859331-e6e1-4245-bdd5-50566bfacae0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:26.413090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f859331-e6e1-4245-bdd5-50566bfacae0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:26.415989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f859331-e6e1-4245-bdd5-50566bfacae0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:26.419160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f859331-e6e1-4245-bdd5-50566bfacae0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:26.420077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f859331-e6e1-4245-bdd5-50566bfacae0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:26.423290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f859331-e6e1-4245-bdd5-50566bfacae0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:26.425881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f859331-e6e1-4245-bdd5-50566bfacae0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:26.672389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9f859331-e6e1-4245-bdd5-50566bfacae0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:26.686807 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9f859331-e6e1-4245-bdd5-50566bfacae0 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.295487 Oct 29 01:24:26.699708 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2294/4777] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:26 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:27.333879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e64d956c-8e6c-46e7-80b0-3c901ed2e40c tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97060a60>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:27.422693 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e64d956c-8e6c-46e7-80b0-3c901ed2e40c tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.096519 Oct 29 01:24:27.423959 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2484/4778] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:27 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:27.714090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c1320c2d-3529-4660-9bcb-4faf47ea111b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:27.715026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c1320c2d-3529-4660-9bcb-4faf47ea111b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:27.722846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1320c2d-3529-4660-9bcb-4faf47ea111b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:27.723745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1320c2d-3529-4660-9bcb-4faf47ea111b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:27.732402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1320c2d-3529-4660-9bcb-4faf47ea111b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:27.734907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1320c2d-3529-4660-9bcb-4faf47ea111b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:27.735741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1320c2d-3529-4660-9bcb-4faf47ea111b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:27.736606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1320c2d-3529-4660-9bcb-4faf47ea111b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:27.956284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c1320c2d-3529-4660-9bcb-4faf47ea111b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:27.964859 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c1320c2d-3529-4660-9bcb-4faf47ea111b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.256464 Oct 29 01:24:27.976509 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2295/4779] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:27 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:28.442450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ab554a43-acbe-48c7-8e04-14b3cc3649fe tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d978235e0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:28.511440 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ab554a43-acbe-48c7-8e04-14b3cc3649fe tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.075757 Oct 29 01:24:28.521062 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2485/4780] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:28 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:28.623596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f6a678be-bcf3-48fe-b9ef-4152bbe573e0 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:28.624575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f6a678be-bcf3-48fe-b9ef-4152bbe573e0 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:28.633665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a678be-bcf3-48fe-b9ef-4152bbe573e0 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:28.652163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a678be-bcf3-48fe-b9ef-4152bbe573e0 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:28.652163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a678be-bcf3-48fe-b9ef-4152bbe573e0 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:28.652163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a678be-bcf3-48fe-b9ef-4152bbe573e0 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:28.652163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a678be-bcf3-48fe-b9ef-4152bbe573e0 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:28.652163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a678be-bcf3-48fe-b9ef-4152bbe573e0 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:28.706338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f6a678be-bcf3-48fe-b9ef-4152bbe573e0 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:24:28.992517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-23199186-039d-47cc-a434-71614be5154b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:28.994087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-23199186-039d-47cc-a434-71614be5154b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:28.996646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=86 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:24:29.012164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23199186-039d-47cc-a434-71614be5154b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:29.013929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23199186-039d-47cc-a434-71614be5154b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:29.016910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23199186-039d-47cc-a434-71614be5154b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:29.018233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23199186-039d-47cc-a434-71614be5154b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:29.021443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23199186-039d-47cc-a434-71614be5154b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:29.022200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23199186-039d-47cc-a434-71614be5154b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:29.134920 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f6a678be-bcf3-48fe-b9ef-4152bbe573e0 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "DELETE /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 204 len: 0 microversion: 2.1 time: 0.515076 Oct 29 01:24:29.135661 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2296/4781] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:24:28 2022] DELETE /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:24:29.145447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-974b29e8-e98f-4b05-912c-32d36f50e91f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:29.146341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-974b29e8-e98f-4b05-912c-32d36f50e91f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:29.178387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-974b29e8-e98f-4b05-912c-32d36f50e91f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:29.181817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-974b29e8-e98f-4b05-912c-32d36f50e91f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:29.183702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-974b29e8-e98f-4b05-912c-32d36f50e91f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:29.187011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-974b29e8-e98f-4b05-912c-32d36f50e91f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:29.187615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-974b29e8-e98f-4b05-912c-32d36f50e91f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:29.192202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-974b29e8-e98f-4b05-912c-32d36f50e91f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:29.664928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-974b29e8-e98f-4b05-912c-32d36f50e91f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:29.670966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-23199186-039d-47cc-a434-71614be5154b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:29.680049 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-974b29e8-e98f-4b05-912c-32d36f50e91f tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1679 microversion: 2.1 time: 0.537094 Oct 29 01:24:29.680595 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-23199186-039d-47cc-a434-71614be5154b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.693264 Oct 29 01:24:29.681281 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2297/4782] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:29 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1679 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:29.698572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-68b8e8db-ac58-4934-a0f9-6094739993c1 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9fef85e0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:29.703913 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2486/4783] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:28 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:29.761712 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-68b8e8db-ac58-4934-a0f9-6094739993c1 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.078081 Oct 29 01:24:29.763011 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2298/4784] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:29 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:30.736726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-962a4cb6-6c27-4c4c-b3ce-00ac5f014e94 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:30.736726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-962a4cb6-6c27-4c4c-b3ce-00ac5f014e94 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:30.737584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8d3b594d-f4b1-44df-854a-ab3fae7aaf9e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:30.737584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8d3b594d-f4b1-44df-854a-ab3fae7aaf9e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:30.737584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d3b594d-f4b1-44df-854a-ab3fae7aaf9e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:30.737584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d3b594d-f4b1-44df-854a-ab3fae7aaf9e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:30.737584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d3b594d-f4b1-44df-854a-ab3fae7aaf9e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:30.737584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d3b594d-f4b1-44df-854a-ab3fae7aaf9e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:30.737584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d3b594d-f4b1-44df-854a-ab3fae7aaf9e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:30.737584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d3b594d-f4b1-44df-854a-ab3fae7aaf9e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:30.738449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-962a4cb6-6c27-4c4c-b3ce-00ac5f014e94 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:30.738449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-962a4cb6-6c27-4c4c-b3ce-00ac5f014e94 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:30.738449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-962a4cb6-6c27-4c4c-b3ce-00ac5f014e94 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:30.738449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-962a4cb6-6c27-4c4c-b3ce-00ac5f014e94 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:30.738449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-962a4cb6-6c27-4c4c-b3ce-00ac5f014e94 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:30.738449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-962a4cb6-6c27-4c4c-b3ce-00ac5f014e94 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:31.014511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8d3b594d-f4b1-44df-854a-ab3fae7aaf9e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:31.016791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-962a4cb6-6c27-4c4c-b3ce-00ac5f014e94 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:31.026368 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-962a4cb6-6c27-4c4c-b3ce-00ac5f014e94 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.323768 Oct 29 01:24:31.026953 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2299/4785] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:30 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:31.065789 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8d3b594d-f4b1-44df-854a-ab3fae7aaf9e tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1679 microversion: 2.1 time: 0.347444 Oct 29 01:24:31.067382 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2487/4786] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:30 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1679 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:31.074921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2a8f244b-6197-4508-a63d-bbdc5104e8ba tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97e2c820>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:31.148523 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2a8f244b-6197-4508-a63d-bbdc5104e8ba tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.118449 Oct 29 01:24:31.160592 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2300/4787] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:31 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:32.053226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c6571893-8ea5-4c78-adcc-f9756cffc558 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:32.054004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c6571893-8ea5-4c78-adcc-f9756cffc558 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:32.074596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6571893-8ea5-4c78-adcc-f9756cffc558 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:32.075336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6571893-8ea5-4c78-adcc-f9756cffc558 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:32.075960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6571893-8ea5-4c78-adcc-f9756cffc558 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:32.077026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6571893-8ea5-4c78-adcc-f9756cffc558 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:32.077841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6571893-8ea5-4c78-adcc-f9756cffc558 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:32.078429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6571893-8ea5-4c78-adcc-f9756cffc558 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:32.104222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a1f81ebd-6b5e-4cdd-9001-ce8ef709ca1a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:32.104941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a1f81ebd-6b5e-4cdd-9001-ce8ef709ca1a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:32.119812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1f81ebd-6b5e-4cdd-9001-ce8ef709ca1a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:32.121433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1f81ebd-6b5e-4cdd-9001-ce8ef709ca1a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:32.122486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1f81ebd-6b5e-4cdd-9001-ce8ef709ca1a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:32.123421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1f81ebd-6b5e-4cdd-9001-ce8ef709ca1a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:32.124390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1f81ebd-6b5e-4cdd-9001-ce8ef709ca1a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:32.125033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1f81ebd-6b5e-4cdd-9001-ce8ef709ca1a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:32.132387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:24:32.320989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a1f81ebd-6b5e-4cdd-9001-ce8ef709ca1a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:32.341735 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a1f81ebd-6b5e-4cdd-9001-ce8ef709ca1a tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1612 microversion: 2.1 time: 0.242402 Oct 29 01:24:32.364305 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2301/4788] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:32 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1612 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:32.373473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-03857b00-251e-4fba-abb8-d6c21eaf2e22 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9ff23ca0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:32.450684 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-03857b00-251e-4fba-abb8-d6c21eaf2e22 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.084875 Oct 29 01:24:32.451871 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2302/4789] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:32 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:32.584207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-3d91499e-9544-4bec-b3f5-87a4f8aeee07 req-dc8e74e3-f86c-46c6-9978-01a2c8398f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "960fd6c4-4418-4490-a15c-5b02d54b2097", "name": "network-vif-deleted", "tag": "2f3ceabd-e8e2-4197-8235-3476fd669990"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:32.614204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3d91499e-9544-4bec-b3f5-87a4f8aeee07 req-dc8e74e3-f86c-46c6-9978-01a2c8398f6c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:32.614204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3d91499e-9544-4bec-b3f5-87a4f8aeee07 req-dc8e74e3-f86c-46c6-9978-01a2c8398f6c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:32.614204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3d91499e-9544-4bec-b3f5-87a4f8aeee07 req-dc8e74e3-f86c-46c6-9978-01a2c8398f6c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:32.633848 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-3d91499e-9544-4bec-b3f5-87a4f8aeee07 req-dc8e74e3-f86c-46c6-9978-01a2c8398f6c service nova] Creating event network-vif-deleted:2f3ceabd-e8e2-4197-8235-3476fd669990 for instance 960fd6c4-4418-4490-a15c-5b02d54b2097 on n-h2-862964-3 Oct 29 01:24:32.645477 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-3d91499e-9544-4bec-b3f5-87a4f8aeee07 req-dc8e74e3-f86c-46c6-9978-01a2c8398f6c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065530 Oct 29 01:24:32.649516 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2303/4790] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:24:32.999138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c6571893-8ea5-4c78-adcc-f9756cffc558 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:33.011262 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c6571893-8ea5-4c78-adcc-f9756cffc558 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1486 microversion: 2.1 time: 0.964709 Oct 29 01:24:33.026787 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2488/4791] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:32 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1486 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:33.042437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6ecc9dc3-626f-483b-881d-918bf55565bc tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:33.044815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6ecc9dc3-626f-483b-881d-918bf55565bc tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:33.050996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ecc9dc3-626f-483b-881d-918bf55565bc tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:33.051500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ecc9dc3-626f-483b-881d-918bf55565bc tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:33.051946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ecc9dc3-626f-483b-881d-918bf55565bc tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:33.052669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ecc9dc3-626f-483b-881d-918bf55565bc tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:33.070743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ecc9dc3-626f-483b-881d-918bf55565bc tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:33.071217 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ecc9dc3-626f-483b-881d-918bf55565bc tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:33.367425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e1be962c-a86c-4297-bbb1-fcf0ec2166fd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:33.368721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e1be962c-a86c-4297-bbb1-fcf0ec2166fd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:33.383192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1be962c-a86c-4297-bbb1-fcf0ec2166fd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:33.383751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1be962c-a86c-4297-bbb1-fcf0ec2166fd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:33.384211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1be962c-a86c-4297-bbb1-fcf0ec2166fd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:33.400252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1be962c-a86c-4297-bbb1-fcf0ec2166fd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:33.406743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1be962c-a86c-4297-bbb1-fcf0ec2166fd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:33.406921 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6ecc9dc3-626f-483b-881d-918bf55565bc tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "POST /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f/action" status: 202 len: 0 microversion: 2.1 time: 0.367811 Oct 29 01:24:33.408272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1be962c-a86c-4297-bbb1-fcf0ec2166fd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:33.408451 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2304/4792] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:24:33 2022] POST /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:24:33.425816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5bd5545a-187c-45c3-b4c8-c053de554eb4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:33.426574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5bd5545a-187c-45c3-b4c8-c053de554eb4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:33.452515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bd5545a-187c-45c3-b4c8-c053de554eb4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:33.457469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bd5545a-187c-45c3-b4c8-c053de554eb4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:33.459810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bd5545a-187c-45c3-b4c8-c053de554eb4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:33.462583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bd5545a-187c-45c3-b4c8-c053de554eb4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:33.472411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bd5545a-187c-45c3-b4c8-c053de554eb4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:33.473229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bd5545a-187c-45c3-b4c8-c053de554eb4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:33.491406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1be962c-a86c-4297-bbb1-fcf0ec2166fd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:33.491892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1be962c-a86c-4297-bbb1-fcf0ec2166fd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:33.492873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e1be962c-a86c-4297-bbb1-fcf0ec2166fd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:33.493639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-e1be962c-a86c-4297-bbb1-fcf0ec2166fd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lazy-loading 'fault' on Instance uuid 960fd6c4-4418-4490-a15c-5b02d54b2097 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:24:33.720684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e1be962c-a86c-4297-bbb1-fcf0ec2166fd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3714617f36472f8e4b1d55887cdefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39133f363c084812920780d4eb6d227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:33.730808 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e1be962c-a86c-4297-bbb1-fcf0ec2166fd tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 200 len: 1331 microversion: 2.1 time: 0.367558 Oct 29 01:24:33.737198 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2489/4793] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:33 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 1331 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:33.738567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a47c0208-1c89-42cb-9fa3-d8c9cc2ee5fa tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96b5b040>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:33.856527 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a47c0208-1c89-42cb-9fa3-d8c9cc2ee5fa tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.123205 Oct 29 01:24:33.857896 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2490/4794] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:33 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:34.111704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5bd5545a-187c-45c3-b4c8-c053de554eb4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:34.121654 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5bd5545a-187c-45c3-b4c8-c053de554eb4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1494 microversion: 2.1 time: 0.704969 Oct 29 01:24:34.140866 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2305/4795] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:33 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1494 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:34.762582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3c800cae-5222-4b77-b99b-16312071b800 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:34.764541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3c800cae-5222-4b77-b99b-16312071b800 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] [instance: 960fd6c4-4418-4490-a15c-5b02d54b2097] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:34.780471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c800cae-5222-4b77-b99b-16312071b800 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:34.781775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c800cae-5222-4b77-b99b-16312071b800 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:34.786917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c800cae-5222-4b77-b99b-16312071b800 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:34.789700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c800cae-5222-4b77-b99b-16312071b800 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:34.794296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c800cae-5222-4b77-b99b-16312071b800 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:34.796930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c800cae-5222-4b77-b99b-16312071b800 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:34.848179 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-3c800cae-5222-4b77-b99b-16312071b800 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] HTTP exception thrown: Instance 960fd6c4-4418-4490-a15c-5b02d54b2097 could not be found. Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3c800cae-5222-4b77-b99b-16312071b800 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Request method failure captured: Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 HTTP/1.1 Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH_5GKr04zjeXc2CFsw6ZgrIPnipSf9CR4TjQ8ih_sCYqdRXn6341qyIve5sk1Akw5tpQTseiN3wcSBzoeiBGrosfmm3rk0t2q9Ti_vxpibAqS8GyQQmLrp3jYI7Sm4_9RNGhaSjJAiTjOnrRxVX8TYLdYEFI6wWKqPqknGitse066I Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 39133f363c084812920780d4eb6d227b Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-VolumesAdminNegativeTest-1903341061 Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/39133f363c084812920780d4eb6d227b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/39133f363c084812920780d4eb6d227b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/39133f363c084812920780d4eb6d227b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_39133f363c084812920780d4eb6d227b", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-VolumesAdminNegativeTest-1903341061 Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 39133f363c084812920780d4eb6d227b Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1903341061 Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-VolumesAdminNegativeTest-1903341061-project Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8d3714617f36472f8e4b1d55887cdefc Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-VolumesAdminNegativeTest-1903341061-project Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 960fd6c4-4418-4490-a15c-5b02d54b2097 could not be found. Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '960fd6c4-4418-4490-a15c-5b02d54b2097'} Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 960fd6c4-4418-4490-a15c-5b02d54b2097 could not be found. Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 960fd6c4-4418-4490-a15c-5b02d54b2097 could not be found. Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:24:34.855576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:34.863888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:34.863888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:24:34.863888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:24:34.863888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:24:34.863888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:24:34.863888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 960fd6c4-4418-4490-a15c-5b02d54b2097 could not be found. Oct 29 01:24:34.863888 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:34.863888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3c800cae-5222-4b77-b99b-16312071b800 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Returning 404 to user: Instance 960fd6c4-4418-4490-a15c-5b02d54b2097 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:24:34.863888 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3c800cae-5222-4b77-b99b-16312071b800 tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097" status: 404 len: 111 microversion: 2.1 time: 0.102335 Oct 29 01:24:34.869643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0f3738b1-2fbd-4eb5-a15a-58238ba9dc3c tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] Calling method '.version_select at 0x7f9d9fe33820>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:34.874320 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2491/4796] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:34 2022] GET /compute/v2.1/servers/960fd6c4-4418-4490-a15c-5b02d54b2097 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:24:34.889228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-765afcc1-5864-4331-8520-6806371bc28a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97ac8790>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:34.895425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:24:34.952611 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-765afcc1-5864-4331-8520-6806371bc28a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.073394 Oct 29 01:24:34.962416 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2492/4797] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:34 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:35.026840 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0f3738b1-2fbd-4eb5-a15a-58238ba9dc3c tempest-VolumesAdminNegativeTest-1903341061 tempest-VolumesAdminNegativeTest-1903341061-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996099057" status: 202 len: 0 microversion: 2.1 time: 0.161758 Oct 29 01:24:35.027511 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2306/4798] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 29 01:24:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996099057 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:24:35.152513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-001d4bff-b1c8-4dd8-bd3a-9c6ee1b4ed74 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:35.157396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-001d4bff-b1c8-4dd8-bd3a-9c6ee1b4ed74 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:35.168097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-001d4bff-b1c8-4dd8-bd3a-9c6ee1b4ed74 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:35.169383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-001d4bff-b1c8-4dd8-bd3a-9c6ee1b4ed74 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:35.170165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-001d4bff-b1c8-4dd8-bd3a-9c6ee1b4ed74 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:35.185887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-001d4bff-b1c8-4dd8-bd3a-9c6ee1b4ed74 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:35.188185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-001d4bff-b1c8-4dd8-bd3a-9c6ee1b4ed74 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:35.190539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-001d4bff-b1c8-4dd8-bd3a-9c6ee1b4ed74 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:35.428406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-001d4bff-b1c8-4dd8-bd3a-9c6ee1b4ed74 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:35.447610 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-001d4bff-b1c8-4dd8-bd3a-9c6ee1b4ed74 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1494 microversion: 2.1 time: 0.300652 Oct 29 01:24:35.465969 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2493/4799] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:35 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1494 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:35.979486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-86438dd6-e90a-4395-adae-ee152f534162 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97440280>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:36.043620 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-86438dd6-e90a-4395-adae-ee152f534162 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.078053 Oct 29 01:24:36.044219 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2307/4800] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:35 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:36.480565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-70d36fc9-e379-46c7-98b6-019ec73c7d67 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:36.480565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-70d36fc9-e379-46c7-98b6-019ec73c7d67 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:36.487443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70d36fc9-e379-46c7-98b6-019ec73c7d67 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:36.488005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70d36fc9-e379-46c7-98b6-019ec73c7d67 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:36.488997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70d36fc9-e379-46c7-98b6-019ec73c7d67 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:36.490385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70d36fc9-e379-46c7-98b6-019ec73c7d67 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:36.490998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70d36fc9-e379-46c7-98b6-019ec73c7d67 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:36.491595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70d36fc9-e379-46c7-98b6-019ec73c7d67 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:36.835416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-70d36fc9-e379-46c7-98b6-019ec73c7d67 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:36.847613 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-70d36fc9-e379-46c7-98b6-019ec73c7d67 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1494 microversion: 2.1 time: 0.375562 Oct 29 01:24:36.848212 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2494/4801] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:36 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1494 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:37.064783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f10e4fb3-bea6-42d8-990d-7288445fd4fe tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97ac1f70>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:37.155659 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f10e4fb3-bea6-42d8-990d-7288445fd4fe tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.088829 Oct 29 01:24:37.156816 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2308/4802] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:37 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:37.875619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2d447d0d-9406-4fb4-8e73-7dbb8b7a0783 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:37.877040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2d447d0d-9406-4fb4-8e73-7dbb8b7a0783 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:37.889930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d447d0d-9406-4fb4-8e73-7dbb8b7a0783 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:37.890475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d447d0d-9406-4fb4-8e73-7dbb8b7a0783 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:37.890857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d447d0d-9406-4fb4-8e73-7dbb8b7a0783 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:37.891560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d447d0d-9406-4fb4-8e73-7dbb8b7a0783 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:37.903081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d447d0d-9406-4fb4-8e73-7dbb8b7a0783 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:37.903081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d447d0d-9406-4fb4-8e73-7dbb8b7a0783 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:38.182174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-29d34c26-6cd4-411d-86bc-3fe8870900fd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97f0ef70>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:38.302266 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-29d34c26-6cd4-411d-86bc-3fe8870900fd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.133361 Oct 29 01:24:38.303635 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2309/4803] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:38 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:38.432784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2d447d0d-9406-4fb4-8e73-7dbb8b7a0783 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:38.444401 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2d447d0d-9406-4fb4-8e73-7dbb8b7a0783 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1500 microversion: 2.1 time: 0.572654 Oct 29 01:24:38.464778 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2495/4804] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:37 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1500 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:38.503952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ff2e569e-57f3-4dbd-9162-0c5e736a715b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:38.506018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ff2e569e-57f3-4dbd-9162-0c5e736a715b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:38.547680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff2e569e-57f3-4dbd-9162-0c5e736a715b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:38.572839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff2e569e-57f3-4dbd-9162-0c5e736a715b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:38.574914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff2e569e-57f3-4dbd-9162-0c5e736a715b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:38.576766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff2e569e-57f3-4dbd-9162-0c5e736a715b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:38.579182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff2e569e-57f3-4dbd-9162-0c5e736a715b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:38.582834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff2e569e-57f3-4dbd-9162-0c5e736a715b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:38.643669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ff2e569e-57f3-4dbd-9162-0c5e736a715b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:24:38.921637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fe9b9c3d-bffd-42e7-b7e2-524cc1beed5f tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:38.929636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fe9b9c3d-bffd-42e7-b7e2-524cc1beed5f tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:38.943324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe9b9c3d-bffd-42e7-b7e2-524cc1beed5f tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:38.945296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe9b9c3d-bffd-42e7-b7e2-524cc1beed5f tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:38.945865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe9b9c3d-bffd-42e7-b7e2-524cc1beed5f tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:38.947480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe9b9c3d-bffd-42e7-b7e2-524cc1beed5f tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:38.948405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe9b9c3d-bffd-42e7-b7e2-524cc1beed5f tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:38.948965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe9b9c3d-bffd-42e7-b7e2-524cc1beed5f tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:39.010367 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fe9b9c3d-bffd-42e7-b7e2-524cc1beed5f tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092720 Oct 29 01:24:39.012391 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2496/4805] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:24:38 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:24:39.019981 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ff2e569e-57f3-4dbd-9162-0c5e736a715b tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 204 len: 0 microversion: 2.1 time: 0.543163 Oct 29 01:24:39.020857 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2310/4806] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:24:38 2022] DELETE /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:24:39.026957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-804e3f17-1b32-47c9-9eca-68d8cd086b00 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:39.029210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-804e3f17-1b32-47c9-9eca-68d8cd086b00 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:39.030174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ac5cfb5e-0b28-4a65-a812-c14437634969 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:39.030904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ac5cfb5e-0b28-4a65-a812-c14437634969 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:39.044949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-804e3f17-1b32-47c9-9eca-68d8cd086b00 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:39.045757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac5cfb5e-0b28-4a65-a812-c14437634969 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:39.049194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-804e3f17-1b32-47c9-9eca-68d8cd086b00 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:39.049686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-804e3f17-1b32-47c9-9eca-68d8cd086b00 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:39.052299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac5cfb5e-0b28-4a65-a812-c14437634969 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:39.053024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac5cfb5e-0b28-4a65-a812-c14437634969 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:39.053651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-804e3f17-1b32-47c9-9eca-68d8cd086b00 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:39.054284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-804e3f17-1b32-47c9-9eca-68d8cd086b00 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:39.054763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac5cfb5e-0b28-4a65-a812-c14437634969 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:39.055415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac5cfb5e-0b28-4a65-a812-c14437634969 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:39.055853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac5cfb5e-0b28-4a65-a812-c14437634969 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:39.057109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-804e3f17-1b32-47c9-9eca-68d8cd086b00 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:39.194997 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-804e3f17-1b32-47c9-9eca-68d8cd086b00 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments/daddb6cf-367c-484f-9780-fd9f5474bc58" status: 200 len: 194 microversion: 2.1 time: 0.176502 Oct 29 01:24:39.202186 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2497/4807] 10.222.0.26 () {58 vars in 1413 bytes} [Sat Oct 29 01:24:39 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments/daddb6cf-367c-484f-9780-fd9f5474bc58 => generated 194 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:24:39.317911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f4ff3e75-b3ac-47f6-96d3-3013b6060ff5 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96fea8b0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:39.422285 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f4ff3e75-b3ac-47f6-96d3-3013b6060ff5 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.108163 Oct 29 01:24:39.426604 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2498/4808] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:39 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:39.453944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1db875f5-ea5f-41d1-b8e0-ee05c71fca1c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-589264250", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:39.465088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ac5cfb5e-0b28-4a65-a812-c14437634969 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:39.475182 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ac5cfb5e-0b28-4a65-a812-c14437634969 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.449940 Oct 29 01:24:39.481321 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2311/4809] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:39 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:39.565346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-1db875f5-ea5f-41d1-b8e0-ee05c71fca1c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] validate_networks() for None {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:24:39.987731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1db875f5-ea5f-41d1-b8e0-ee05c71fca1c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:24:39.988994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1db875f5-ea5f-41d1-b8e0-ee05c71fca1c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:24:39.989762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1db875f5-ea5f-41d1-b8e0-ee05c71fca1c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:24:39.994576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1db875f5-ea5f-41d1-b8e0-ee05c71fca1c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:24:39.994576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1db875f5-ea5f-41d1-b8e0-ee05c71fca1c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:24:40.012273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1db875f5-ea5f-41d1-b8e0-ee05c71fca1c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:40.017340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1db875f5-ea5f-41d1-b8e0-ee05c71fca1c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:40.019416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1db875f5-ea5f-41d1-b8e0-ee05c71fca1c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:40.024098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1db875f5-ea5f-41d1-b8e0-ee05c71fca1c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:40.027583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1db875f5-ea5f-41d1-b8e0-ee05c71fca1c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:40.028427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1db875f5-ea5f-41d1-b8e0-ee05c71fca1c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:40.051196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-1db875f5-ea5f-41d1-b8e0-ee05c71fca1c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Getting quotas for project a5f642212144498fa45333d414284e28. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:24:40.057794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-1db875f5-ea5f-41d1-b8e0-ee05c71fca1c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Getting quotas for user b1185ee7721f400eb9cd7fea44d64364 and project a5f642212144498fa45333d414284e28. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:24:40.072104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1db875f5-ea5f-41d1-b8e0-ee05c71fca1c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:24:40.074939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1db875f5-ea5f-41d1-b8e0-ee05c71fca1c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:24:40.190291 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1db875f5-ea5f-41d1-b8e0-ee05c71fca1c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762545 Oct 29 01:24:40.203316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7360edcd-cfd0-489c-a3e7-33d9f652357e tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:40.204032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7360edcd-cfd0-489c-a3e7-33d9f652357e tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:40.208543 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2499/4810] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:24:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:24:40.334538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7360edcd-cfd0-489c-a3e7-33d9f652357e tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:40.342517 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7360edcd-cfd0-489c-a3e7-33d9f652357e tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1213 microversion: 2.1 time: 0.143409 Oct 29 01:24:40.358001 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2312/4811] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:40 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1213 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:40.442510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-876485c1-3a22-4539-807d-b46721459342 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9797b430>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:40.506592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f31cbd81-0ad0-4ef6-bf36-786e9ab53809 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:40.507282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f31cbd81-0ad0-4ef6-bf36-786e9ab53809 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:40.529564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f31cbd81-0ad0-4ef6-bf36-786e9ab53809 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:40.532720 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-876485c1-3a22-4539-807d-b46721459342 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.094630 Oct 29 01:24:40.532955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f31cbd81-0ad0-4ef6-bf36-786e9ab53809 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:40.533560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f31cbd81-0ad0-4ef6-bf36-786e9ab53809 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:40.537235 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2500/4812] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:40 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:40.537357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f31cbd81-0ad0-4ef6-bf36-786e9ab53809 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:40.538204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f31cbd81-0ad0-4ef6-bf36-786e9ab53809 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:40.539207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f31cbd81-0ad0-4ef6-bf36-786e9ab53809 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:40.731905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f31cbd81-0ad0-4ef6-bf36-786e9ab53809 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:40.758535 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f31cbd81-0ad0-4ef6-bf36-786e9ab53809 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.255952 Oct 29 01:24:40.762641 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2313/4813] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:40 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:41.370046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d891a3d6-edb8-456a-971b-4b0fdd39882c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:41.371367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d891a3d6-edb8-456a-971b-4b0fdd39882c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:41.456588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d891a3d6-edb8-456a-971b-4b0fdd39882c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:41.470194 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d891a3d6-edb8-456a-971b-4b0fdd39882c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1213 microversion: 2.1 time: 0.104695 Oct 29 01:24:41.475848 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2501/4814] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:41 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:41.556253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d183f403-3d98-4e78-b1b6-f879c3bd7315 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9fd3fe50>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:41.651599 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d183f403-3d98-4e78-b1b6-f879c3bd7315 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.102333 Oct 29 01:24:41.653862 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2314/4815] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:41 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:41.786002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c9114b0a-5da0-48e8-990a-fbfa859b52df tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:41.786634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c9114b0a-5da0-48e8-990a-fbfa859b52df tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:41.804015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9114b0a-5da0-48e8-990a-fbfa859b52df tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:41.804528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9114b0a-5da0-48e8-990a-fbfa859b52df tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:41.811726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9114b0a-5da0-48e8-990a-fbfa859b52df tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:41.812550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9114b0a-5da0-48e8-990a-fbfa859b52df tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:41.813045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9114b0a-5da0-48e8-990a-fbfa859b52df tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:41.813582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9114b0a-5da0-48e8-990a-fbfa859b52df tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:42.276121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c9114b0a-5da0-48e8-990a-fbfa859b52df tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:42.287908 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c9114b0a-5da0-48e8-990a-fbfa859b52df tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1506 microversion: 2.1 time: 0.506496 Oct 29 01:24:42.309391 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2502/4816] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:41 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1506 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:42.499475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a91917c0-8b5f-4578-9e72-b2df96e1672b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:42.500192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a91917c0-8b5f-4578-9e72-b2df96e1672b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:42.512918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a91917c0-8b5f-4578-9e72-b2df96e1672b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:42.513465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a91917c0-8b5f-4578-9e72-b2df96e1672b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:42.513911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a91917c0-8b5f-4578-9e72-b2df96e1672b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:42.514631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a91917c0-8b5f-4578-9e72-b2df96e1672b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:42.521417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a91917c0-8b5f-4578-9e72-b2df96e1672b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:42.522071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a91917c0-8b5f-4578-9e72-b2df96e1672b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:42.657002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a91917c0-8b5f-4578-9e72-b2df96e1672b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:42.667825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6d2e3d58-6d7e-4c51-9f60-c376bcf0eb69 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97acad30>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:42.672313 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a91917c0-8b5f-4578-9e72-b2df96e1672b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1217 microversion: 2.1 time: 0.176934 Oct 29 01:24:42.672909 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2315/4817] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:42 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:42.768434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-83be81eb-7519-4e1b-b7fa-4657398e31bf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a4a4ebc-4fc8-43d1-9b9c-99a76c986c5f"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:42.770918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-83be81eb-7519-4e1b-b7fa-4657398e31bf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:42.773603 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6d2e3d58-6d7e-4c51-9f60-c376bcf0eb69 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.108809 Oct 29 01:24:42.787338 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2503/4818] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:42 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:42.795194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83be81eb-7519-4e1b-b7fa-4657398e31bf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:42.795194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83be81eb-7519-4e1b-b7fa-4657398e31bf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:42.795194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83be81eb-7519-4e1b-b7fa-4657398e31bf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:42.795194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83be81eb-7519-4e1b-b7fa-4657398e31bf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:42.800241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83be81eb-7519-4e1b-b7fa-4657398e31bf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:42.801009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83be81eb-7519-4e1b-b7fa-4657398e31bf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:43.316677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-253afa6b-15b7-4193-a15c-baf463dbffae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:43.317487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-253afa6b-15b7-4193-a15c-baf463dbffae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:43.329264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-253afa6b-15b7-4193-a15c-baf463dbffae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:43.332232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-253afa6b-15b7-4193-a15c-baf463dbffae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:43.332855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-253afa6b-15b7-4193-a15c-baf463dbffae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:43.338245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-253afa6b-15b7-4193-a15c-baf463dbffae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:43.339012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-253afa6b-15b7-4193-a15c-baf463dbffae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:43.339610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-253afa6b-15b7-4193-a15c-baf463dbffae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:43.546067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-253afa6b-15b7-4193-a15c-baf463dbffae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:43.556338 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-253afa6b-15b7-4193-a15c-baf463dbffae tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1464 microversion: 2.1 time: 0.244202 Oct 29 01:24:43.577440 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2504/4819] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:43 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1464 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:43.585458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-85343b61-8e52-4a1d-bf89-64ebd8196465 req-9c48db4a-1756-479c-afda-826201c2b0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c9a3141-aaee-4d61-b0f3-22423475f24f", "name": "network-vif-deleted", "tag": "8475f6f3-e1ee-45b9-8a41-78cce1666bd4"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:43.611184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-85343b61-8e52-4a1d-bf89-64ebd8196465 req-9c48db4a-1756-479c-afda-826201c2b0f1 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:43.617460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-85343b61-8e52-4a1d-bf89-64ebd8196465 req-9c48db4a-1756-479c-afda-826201c2b0f1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:43.618249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-85343b61-8e52-4a1d-bf89-64ebd8196465 req-9c48db4a-1756-479c-afda-826201c2b0f1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:43.654264 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-85343b61-8e52-4a1d-bf89-64ebd8196465 req-9c48db4a-1756-479c-afda-826201c2b0f1 service nova] Creating event network-vif-deleted:8475f6f3-e1ee-45b9-8a41-78cce1666bd4 for instance 5c9a3141-aaee-4d61-b0f3-22423475f24f on n-h1-862964-3 Oct 29 01:24:43.670984 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-85343b61-8e52-4a1d-bf89-64ebd8196465 req-9c48db4a-1756-479c-afda-826201c2b0f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087808 Oct 29 01:24:43.672474 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2505/4820] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:24:43.700842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dcb207b0-5e60-4d95-8711-a1c44ef5d272 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:43.701803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dcb207b0-5e60-4d95-8711-a1c44ef5d272 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:43.718030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcb207b0-5e60-4d95-8711-a1c44ef5d272 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:43.718830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcb207b0-5e60-4d95-8711-a1c44ef5d272 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:43.720630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcb207b0-5e60-4d95-8711-a1c44ef5d272 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:43.722221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcb207b0-5e60-4d95-8711-a1c44ef5d272 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:43.723507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcb207b0-5e60-4d95-8711-a1c44ef5d272 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:43.724121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcb207b0-5e60-4d95-8711-a1c44ef5d272 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:43.887579 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-83be81eb-7519-4e1b-b7fa-4657398e31bf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "POST /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.116074 Oct 29 01:24:43.887579 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2316/4821] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 29 01:24:42 2022] POST /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments => generated 194 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:24:43.904411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-626f30af-f69f-4826-8cc6-345c6ef09cf9 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9fef81f0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:43.999485 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-626f30af-f69f-4826-8cc6-345c6ef09cf9 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.116489 Oct 29 01:24:44.000426 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2317/4822] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:43 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:44.163799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dcb207b0-5e60-4d95-8711-a1c44ef5d272 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:44.179526 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dcb207b0-5e60-4d95-8711-a1c44ef5d272 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1265 microversion: 2.1 time: 0.482774 Oct 29 01:24:44.180134 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2506/4823] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:43 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1265 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:44.598061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f4186ae4-f5d4-492e-8b4a-3649467f2fc4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:44.599076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f4186ae4-f5d4-492e-8b4a-3649467f2fc4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:44.620689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4186ae4-f5d4-492e-8b4a-3649467f2fc4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:44.622401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4186ae4-f5d4-492e-8b4a-3649467f2fc4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:44.624185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4186ae4-f5d4-492e-8b4a-3649467f2fc4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:44.636247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4186ae4-f5d4-492e-8b4a-3649467f2fc4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:44.636247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4186ae4-f5d4-492e-8b4a-3649467f2fc4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:44.636247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4186ae4-f5d4-492e-8b4a-3649467f2fc4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:44.677511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4186ae4-f5d4-492e-8b4a-3649467f2fc4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:44.678449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4186ae4-f5d4-492e-8b4a-3649467f2fc4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:44.679131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4186ae4-f5d4-492e-8b4a-3649467f2fc4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:44.679842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-f4186ae4-f5d4-492e-8b4a-3649467f2fc4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lazy-loading 'fault' on Instance uuid 5c9a3141-aaee-4d61-b0f3-22423475f24f {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:24:44.764431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f4186ae4-f5d4-492e-8b4a-3649467f2fc4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:44.780739 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f4186ae4-f5d4-492e-8b4a-3649467f2fc4 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 200 len: 1303 microversion: 2.1 time: 0.199613 Oct 29 01:24:44.785708 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2318/4824] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:44 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 1303 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:45.016001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-46f4d4d3-2e41-422d-8c33-58cce46b8496 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97957160>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:45.107993 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-46f4d4d3-2e41-422d-8c33-58cce46b8496 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.095940 Oct 29 01:24:45.109701 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2507/4825] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:45 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:45.213951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2fde35af-e7c7-4d43-8e40-c96f252d9c4f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:45.216697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2fde35af-e7c7-4d43-8e40-c96f252d9c4f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:45.241304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fde35af-e7c7-4d43-8e40-c96f252d9c4f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:45.242052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fde35af-e7c7-4d43-8e40-c96f252d9c4f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:45.243392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fde35af-e7c7-4d43-8e40-c96f252d9c4f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:45.245550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fde35af-e7c7-4d43-8e40-c96f252d9c4f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:45.246699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fde35af-e7c7-4d43-8e40-c96f252d9c4f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:45.247812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fde35af-e7c7-4d43-8e40-c96f252d9c4f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:45.364129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2fde35af-e7c7-4d43-8e40-c96f252d9c4f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:45.372821 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2fde35af-e7c7-4d43-8e40-c96f252d9c4f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1271 microversion: 2.1 time: 0.163463 Oct 29 01:24:45.383937 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2319/4826] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:45 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:45.811472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-689b4aa6-628b-40e4-b07b-13cdd25aeaa9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:45.812127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-689b4aa6-628b-40e4-b07b-13cdd25aeaa9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 5c9a3141-aaee-4d61-b0f3-22423475f24f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:45.826628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-689b4aa6-628b-40e4-b07b-13cdd25aeaa9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:45.827138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-689b4aa6-628b-40e4-b07b-13cdd25aeaa9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:45.827588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-689b4aa6-628b-40e4-b07b-13cdd25aeaa9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:45.828354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-689b4aa6-628b-40e4-b07b-13cdd25aeaa9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:45.828815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-689b4aa6-628b-40e4-b07b-13cdd25aeaa9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:45.842676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-689b4aa6-628b-40e4-b07b-13cdd25aeaa9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:45.900138 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-689b4aa6-628b-40e4-b07b-13cdd25aeaa9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] HTTP exception thrown: Instance 5c9a3141-aaee-4d61-b0f3-22423475f24f could not be found. Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-689b4aa6-628b-40e4-b07b-13cdd25aeaa9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Request method failure captured: Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f HTTP/1.1 Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIBSX8o8EcY4CI4Iv6qgYBkxlW27PhwBVj-o0Ia0n5nsWpdpKK8hCO3IiQlaWETNuMHisclujat5Cl6DH0rM-pSUIioX3w_vkFKO5VAgaBPsWzBzjJxV4IFIvU06dHnKV5Ur4CREJkH0di5RVNQClBeHTftJ332FYiuNQPM_Do-mCMU Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: cf83fbbe41fd41bdb4b862d44634cf4c Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerRescueTestJSON-354537670 Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cf83fbbe41fd41bdb4b862d44634cf4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cf83fbbe41fd41bdb4b862d44634cf4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cf83fbbe41fd41bdb4b862d44634cf4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cf83fbbe41fd41bdb4b862d44634cf4c", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerRescueTestJSON-354537670 Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: cf83fbbe41fd41bdb4b862d44634cf4c Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerRescueTestJSON-354537670 Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerRescueTestJSON-354537670-project Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 1089d449eff3454394061a44dd6ad52d Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerRescueTestJSON-354537670-project Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 5c9a3141-aaee-4d61-b0f3-22423475f24f could not be found. Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '5c9a3141-aaee-4d61-b0f3-22423475f24f'} Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c9a3141-aaee-4d61-b0f3-22423475f24f could not be found. Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c9a3141-aaee-4d61-b0f3-22423475f24f could not be found. Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:24:45.909329 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:45.914063 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:45.914063 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:24:45.914063 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:24:45.914063 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:24:45.914063 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:24:45.914063 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c9a3141-aaee-4d61-b0f3-22423475f24f could not be found. Oct 29 01:24:45.914063 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:24:45.916689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-689b4aa6-628b-40e4-b07b-13cdd25aeaa9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Returning 404 to user: Instance 5c9a3141-aaee-4d61-b0f3-22423475f24f could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:24:45.917821 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-689b4aa6-628b-40e4-b07b-13cdd25aeaa9 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f" status: 404 len: 111 microversion: 2.1 time: 0.110566 Oct 29 01:24:45.919588 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2508/4827] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:45 2022] GET /compute/v2.1/servers/5c9a3141-aaee-4d61-b0f3-22423475f24f => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:24:45.928764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f456c22a-925f-4920-b0c0-6c6a82edd41e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:45.929644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f456c22a-925f-4920-b0c0-6c6a82edd41e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:45.937721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f456c22a-925f-4920-b0c0-6c6a82edd41e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:45.938532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f456c22a-925f-4920-b0c0-6c6a82edd41e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:45.939743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f456c22a-925f-4920-b0c0-6c6a82edd41e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:45.940701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f456c22a-925f-4920-b0c0-6c6a82edd41e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:45.941420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f456c22a-925f-4920-b0c0-6c6a82edd41e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:45.942067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f456c22a-925f-4920-b0c0-6c6a82edd41e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:46.036745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f456c22a-925f-4920-b0c0-6c6a82edd41e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:24:46.127670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-92647fc5-db85-44a8-bab4-7797c31aa9ab tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97acad30>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:46.235191 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-92647fc5-db85-44a8-bab4-7797c31aa9ab tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.107552 Oct 29 01:24:46.235191 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2509/4828] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:46 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:46.313008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:24:46.410461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-13b4d081-9e95-424b-b528-8c08432c27c4 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:46.411261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-13b4d081-9e95-424b-b528-8c08432c27c4 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:46.423196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13b4d081-9e95-424b-b528-8c08432c27c4 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:46.426998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13b4d081-9e95-424b-b528-8c08432c27c4 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:46.431187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13b4d081-9e95-424b-b528-8c08432c27c4 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:46.431187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13b4d081-9e95-424b-b528-8c08432c27c4 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:46.436371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13b4d081-9e95-424b-b528-8c08432c27c4 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:46.438328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13b4d081-9e95-424b-b528-8c08432c27c4 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:46.665683 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f456c22a-925f-4920-b0c0-6c6a82edd41e tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 204 len: 0 microversion: 2.1 time: 0.741980 Oct 29 01:24:46.666280 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2320/4829] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:24:45 2022] DELETE /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:24:46.681076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-07ca89cb-4c93-4925-a935-afd16b83c03c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:46.683953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-07ca89cb-4c93-4925-a935-afd16b83c03c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:46.700050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07ca89cb-4c93-4925-a935-afd16b83c03c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:46.703728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07ca89cb-4c93-4925-a935-afd16b83c03c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:46.705872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07ca89cb-4c93-4925-a935-afd16b83c03c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:46.708478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07ca89cb-4c93-4925-a935-afd16b83c03c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:46.709195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07ca89cb-4c93-4925-a935-afd16b83c03c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:46.710754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07ca89cb-4c93-4925-a935-afd16b83c03c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:46.939907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-13b4d081-9e95-424b-b528-8c08432c27c4 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:46.959034 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-13b4d081-9e95-424b-b528-8c08432c27c4 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1313 microversion: 2.1 time: 0.550364 Oct 29 01:24:46.973934 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2510/4830] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:46 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:47.248572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d6832d07-6f37-4d5f-9f30-521da467742a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96feac10>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:47.341917 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d6832d07-6f37-4d5f-9f30-521da467742a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.098711 Oct 29 01:24:47.345043 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2511/4831] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:47 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:47.348307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-07ca89cb-4c93-4925-a935-afd16b83c03c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:47.359534 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-07ca89cb-4c93-4925-a935-afd16b83c03c tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1492 microversion: 2.1 time: 0.688567 Oct 29 01:24:47.366088 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2321/4832] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:46 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1492 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:47.987239 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dc622a5a-1d3b-4cd7-86b6-e096e203eb4a tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:47.989672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dc622a5a-1d3b-4cd7-86b6-e096e203eb4a tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:48.015721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc622a5a-1d3b-4cd7-86b6-e096e203eb4a tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:48.017903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc622a5a-1d3b-4cd7-86b6-e096e203eb4a tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:48.018752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc622a5a-1d3b-4cd7-86b6-e096e203eb4a tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:48.022623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc622a5a-1d3b-4cd7-86b6-e096e203eb4a tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:48.023733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc622a5a-1d3b-4cd7-86b6-e096e203eb4a tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:48.024479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc622a5a-1d3b-4cd7-86b6-e096e203eb4a tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:48.233901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dc622a5a-1d3b-4cd7-86b6-e096e203eb4a tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:48.244469 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dc622a5a-1d3b-4cd7-86b6-e096e203eb4a tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1313 microversion: 2.1 time: 0.262478 Oct 29 01:24:48.263349 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2512/4833] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:47 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:48.358171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c6074238-73a7-432b-8eb9-98ce7e6e5f4e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97440820>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:48.393937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2f45a874-64bc-429b-a8f5-bd214dea09f6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:48.395341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2f45a874-64bc-429b-a8f5-bd214dea09f6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:48.428234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f45a874-64bc-429b-a8f5-bd214dea09f6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:48.439138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f45a874-64bc-429b-a8f5-bd214dea09f6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:48.439816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f45a874-64bc-429b-a8f5-bd214dea09f6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:48.440561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f45a874-64bc-429b-a8f5-bd214dea09f6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:48.454573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f45a874-64bc-429b-a8f5-bd214dea09f6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:48.455432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f45a874-64bc-429b-a8f5-bd214dea09f6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:48.491780 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c6074238-73a7-432b-8eb9-98ce7e6e5f4e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.137805 Oct 29 01:24:48.492619 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2322/4834] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:48 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:48.801486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f45a874-64bc-429b-a8f5-bd214dea09f6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:48.805933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:24:48.812888 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2f45a874-64bc-429b-a8f5-bd214dea09f6 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1492 microversion: 2.1 time: 0.425017 Oct 29 01:24:48.826775 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2513/4835] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:48 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1492 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:49.278282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4ca5ae23-f458-4176-a3ae-83ef6fd32d32 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:49.280665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4ca5ae23-f458-4176-a3ae-83ef6fd32d32 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:49.302552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ca5ae23-f458-4176-a3ae-83ef6fd32d32 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:49.305761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ca5ae23-f458-4176-a3ae-83ef6fd32d32 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:49.306495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ca5ae23-f458-4176-a3ae-83ef6fd32d32 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:49.309052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ca5ae23-f458-4176-a3ae-83ef6fd32d32 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:49.310989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ca5ae23-f458-4176-a3ae-83ef6fd32d32 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:49.313232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ca5ae23-f458-4176-a3ae-83ef6fd32d32 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:49.508612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d9b1b1ea-4ba7-435c-a9a0-bebb06835b73 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9c451160>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:49.604303 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d9b1b1ea-4ba7-435c-a9a0-bebb06835b73 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.099643 Oct 29 01:24:49.608023 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2514/4836] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:49 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:49.839692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-88684cbb-ad1d-4c1b-af1c-44bdf0e28c43 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:49.840571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-88684cbb-ad1d-4c1b-af1c-44bdf0e28c43 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:49.855775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88684cbb-ad1d-4c1b-af1c-44bdf0e28c43 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:49.863803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88684cbb-ad1d-4c1b-af1c-44bdf0e28c43 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:49.863803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88684cbb-ad1d-4c1b-af1c-44bdf0e28c43 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:49.865229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88684cbb-ad1d-4c1b-af1c-44bdf0e28c43 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:49.866020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88684cbb-ad1d-4c1b-af1c-44bdf0e28c43 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:49.866865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88684cbb-ad1d-4c1b-af1c-44bdf0e28c43 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:49.873903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4ca5ae23-f458-4176-a3ae-83ef6fd32d32 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:49.893606 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4ca5ae23-f458-4176-a3ae-83ef6fd32d32 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1313 microversion: 2.1 time: 0.620128 Oct 29 01:24:49.901489 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2323/4837] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:49 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1313 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:50.042210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:24:50.204784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-29308b67-3871-4db2-8318-e1e40c9deea7 req-4cc02df5-c472-4f97-97f0-80f5bddd42e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd534e41-d223-4dd6-9b11-0b417c775beb", "tag": "ec3e3375-e6aa-44e1-b5c9-0a7450805488"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:50.214104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-88684cbb-ad1d-4c1b-af1c-44bdf0e28c43 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:50.226327 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-88684cbb-ad1d-4c1b-af1c-44bdf0e28c43 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1492 microversion: 2.1 time: 0.390317 Oct 29 01:24:50.228229 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2515/4838] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:49 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1492 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:50.246667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-29308b67-3871-4db2-8318-e1e40c9deea7 req-4cc02df5-c472-4f97-97f0-80f5bddd42e2 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:50.247401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-29308b67-3871-4db2-8318-e1e40c9deea7 req-4cc02df5-c472-4f97-97f0-80f5bddd42e2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:50.248255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-29308b67-3871-4db2-8318-e1e40c9deea7 req-4cc02df5-c472-4f97-97f0-80f5bddd42e2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:50.272011 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-29308b67-3871-4db2-8318-e1e40c9deea7 req-4cc02df5-c472-4f97-97f0-80f5bddd42e2 service nova] Creating event network-changed:ec3e3375-e6aa-44e1-b5c9-0a7450805488 for instance cd534e41-d223-4dd6-9b11-0b417c775beb on n-h2-862964-3 Oct 29 01:24:50.309250 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-29308b67-3871-4db2-8318-e1e40c9deea7 req-4cc02df5-c472-4f97-97f0-80f5bddd42e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116570 Oct 29 01:24:50.324597 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2324/4839] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:24:50.623785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6c04949e-679a-4292-8208-bce0fa1d29a6 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d977d64c0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:50.750180 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6c04949e-679a-4292-8208-bce0fa1d29a6 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.131085 Oct 29 01:24:50.751149 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2516/4840] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:50 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:50.915517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:24:50.921785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-59730383-ce42-42fb-a140-9fcec3dffb4b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:50.922509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-59730383-ce42-42fb-a140-9fcec3dffb4b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:50.939408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59730383-ce42-42fb-a140-9fcec3dffb4b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:50.941506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59730383-ce42-42fb-a140-9fcec3dffb4b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:50.945764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59730383-ce42-42fb-a140-9fcec3dffb4b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:50.946740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59730383-ce42-42fb-a140-9fcec3dffb4b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:50.947373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59730383-ce42-42fb-a140-9fcec3dffb4b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:50.948040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59730383-ce42-42fb-a140-9fcec3dffb4b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:51.227820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-59730383-ce42-42fb-a140-9fcec3dffb4b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:51.237421 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-59730383-ce42-42fb-a140-9fcec3dffb4b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1313 microversion: 2.1 time: 0.323284 Oct 29 01:24:51.238338 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2325/4841] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:50 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:51.257399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-87e5770a-0982-421d-9e73-f12e0e21c625 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:51.258300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-87e5770a-0982-421d-9e73-f12e0e21c625 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:51.277463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87e5770a-0982-421d-9e73-f12e0e21c625 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:51.277977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87e5770a-0982-421d-9e73-f12e0e21c625 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:51.278470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87e5770a-0982-421d-9e73-f12e0e21c625 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:51.293668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87e5770a-0982-421d-9e73-f12e0e21c625 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:51.293668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87e5770a-0982-421d-9e73-f12e0e21c625 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:51.294915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87e5770a-0982-421d-9e73-f12e0e21c625 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:51.412973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-f06ba4dd-0ff0-4fd5-8e8a-eecbeb941cb7 req-dda7d923-a0e0-44b8-b257-bde1aafdaee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc3605c-5148-4fa3-9adb-8ff369c7bb03", "name": "network-vif-deleted", "tag": "c30de807-a386-4699-aa55-38b60ef3fefe"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:51.443304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f06ba4dd-0ff0-4fd5-8e8a-eecbeb941cb7 req-dda7d923-a0e0-44b8-b257-bde1aafdaee2 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:51.444558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f06ba4dd-0ff0-4fd5-8e8a-eecbeb941cb7 req-dda7d923-a0e0-44b8-b257-bde1aafdaee2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:51.445397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f06ba4dd-0ff0-4fd5-8e8a-eecbeb941cb7 req-dda7d923-a0e0-44b8-b257-bde1aafdaee2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:51.445910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-87e5770a-0982-421d-9e73-f12e0e21c625 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:51.458204 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-87e5770a-0982-421d-9e73-f12e0e21c625 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1450 microversion: 2.1 time: 0.202480 Oct 29 01:24:51.473246 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2517/4842] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:51 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1450 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:51.506696 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f06ba4dd-0ff0-4fd5-8e8a-eecbeb941cb7 req-dda7d923-a0e0-44b8-b257-bde1aafdaee2 service nova] Creating event network-vif-deleted:c30de807-a386-4699-aa55-38b60ef3fefe for instance 9bc3605c-5148-4fa3-9adb-8ff369c7bb03 on n-h2-862964-3 Oct 29 01:24:51.523121 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-f06ba4dd-0ff0-4fd5-8e8a-eecbeb941cb7 req-dda7d923-a0e0-44b8-b257-bde1aafdaee2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118917 Oct 29 01:24:51.524139 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2326/4843] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:24:51.766412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-afbd41fd-d59a-4f68-9bd5-f982403850b6 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97bd6820>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:51.775754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=8 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:24:51.852410 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-afbd41fd-d59a-4f68-9bd5-f982403850b6 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.090352 Oct 29 01:24:51.853282 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2518/4844] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:51 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:52.266467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-365dcf54-e639-43c6-adf9-83a4508f58f7 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:52.268612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-365dcf54-e639-43c6-adf9-83a4508f58f7 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:52.277928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-365dcf54-e639-43c6-adf9-83a4508f58f7 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:52.278800 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-365dcf54-e639-43c6-adf9-83a4508f58f7 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:52.279299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-365dcf54-e639-43c6-adf9-83a4508f58f7 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:52.280020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-365dcf54-e639-43c6-adf9-83a4508f58f7 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:52.280474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-365dcf54-e639-43c6-adf9-83a4508f58f7 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:52.280902 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-365dcf54-e639-43c6-adf9-83a4508f58f7 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:52.456692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-365dcf54-e639-43c6-adf9-83a4508f58f7 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:52.464900 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-365dcf54-e639-43c6-adf9-83a4508f58f7 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1313 microversion: 2.1 time: 0.203389 Oct 29 01:24:52.477195 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2327/4845] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:52 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:52.488545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-44f13e13-1e05-4fec-b51e-3e6d97f378b7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:52.489804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-44f13e13-1e05-4fec-b51e-3e6d97f378b7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:52.499187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44f13e13-1e05-4fec-b51e-3e6d97f378b7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:52.499838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44f13e13-1e05-4fec-b51e-3e6d97f378b7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:52.500334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44f13e13-1e05-4fec-b51e-3e6d97f378b7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:52.501851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44f13e13-1e05-4fec-b51e-3e6d97f378b7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:52.502509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44f13e13-1e05-4fec-b51e-3e6d97f378b7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:52.503054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44f13e13-1e05-4fec-b51e-3e6d97f378b7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:52.545712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44f13e13-1e05-4fec-b51e-3e6d97f378b7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:52.546199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44f13e13-1e05-4fec-b51e-3e6d97f378b7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:52.546661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44f13e13-1e05-4fec-b51e-3e6d97f378b7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:52.547133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-44f13e13-1e05-4fec-b51e-3e6d97f378b7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lazy-loading 'fault' on Instance uuid 9bc3605c-5148-4fa3-9adb-8ff369c7bb03 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:24:52.596680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-44f13e13-1e05-4fec-b51e-3e6d97f378b7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:52.605131 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-44f13e13-1e05-4fec-b51e-3e6d97f378b7 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1304 microversion: 2.1 time: 0.122134 Oct 29 01:24:52.606065 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2519/4846] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:52 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:52.870758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-54425772-fa81-4183-aba7-7aaa0a39432e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97acddc0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:52.950019 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-54425772-fa81-4183-aba7-7aaa0a39432e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1453 microversion: 2.1 time: 0.085922 Oct 29 01:24:52.950602 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2328/4847] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:52 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:53.490020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-78bd1155-1ac5-4f98-b217-2604496c662f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:53.492228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-78bd1155-1ac5-4f98-b217-2604496c662f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:53.500366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78bd1155-1ac5-4f98-b217-2604496c662f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:53.501053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78bd1155-1ac5-4f98-b217-2604496c662f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:53.501782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78bd1155-1ac5-4f98-b217-2604496c662f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:53.504274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78bd1155-1ac5-4f98-b217-2604496c662f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:53.505019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78bd1155-1ac5-4f98-b217-2604496c662f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:53.505564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78bd1155-1ac5-4f98-b217-2604496c662f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:53.630164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4e10d0e7-431f-4713-81ef-5afd8c448851 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:53.630786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4e10d0e7-431f-4713-81ef-5afd8c448851 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:53.637907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e10d0e7-431f-4713-81ef-5afd8c448851 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:53.638404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e10d0e7-431f-4713-81ef-5afd8c448851 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:53.638954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e10d0e7-431f-4713-81ef-5afd8c448851 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:53.640025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e10d0e7-431f-4713-81ef-5afd8c448851 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:53.640146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e10d0e7-431f-4713-81ef-5afd8c448851 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:53.640574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e10d0e7-431f-4713-81ef-5afd8c448851 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:53.673692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e10d0e7-431f-4713-81ef-5afd8c448851 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:53.674521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e10d0e7-431f-4713-81ef-5afd8c448851 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:53.674834 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-78bd1155-1ac5-4f98-b217-2604496c662f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:53.674962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e10d0e7-431f-4713-81ef-5afd8c448851 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:53.675660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-4e10d0e7-431f-4713-81ef-5afd8c448851 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lazy-loading 'fault' on Instance uuid 9bc3605c-5148-4fa3-9adb-8ff369c7bb03 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:24:53.683859 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-78bd1155-1ac5-4f98-b217-2604496c662f tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1313 microversion: 2.1 time: 0.199229 Oct 29 01:24:53.684618 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2520/4848] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:53 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:53.736684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4e10d0e7-431f-4713-81ef-5afd8c448851 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:53.745675 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4e10d0e7-431f-4713-81ef-5afd8c448851 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1304 microversion: 2.1 time: 0.120369 Oct 29 01:24:53.746252 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2329/4849] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:53 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:53.968406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2226dcfd-db63-4b01-af1d-c7ece5fad0b8 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97acad30>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:54.020716 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2226dcfd-db63-4b01-af1d-c7ece5fad0b8 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1462 microversion: 2.1 time: 0.057005 Oct 29 01:24:54.021434 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2521/4850] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:53 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1462 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:54.035560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3db81f48-292b-452c-916c-cbf9d7b45656 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9747f9d0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:54.092126 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3db81f48-292b-452c-916c-cbf9d7b45656 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 200 len: 1462 microversion: 2.1 time: 0.055584 Oct 29 01:24:54.092126 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2330/4851] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:54 2022] GET /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 1462 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:54.102212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5928c453-ef73-4e0c-b903-a71142d76642 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:54.106236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5928c453-ef73-4e0c-b903-a71142d76642 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:54.111755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5928c453-ef73-4e0c-b903-a71142d76642 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:54.112423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5928c453-ef73-4e0c-b903-a71142d76642 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:54.112927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5928c453-ef73-4e0c-b903-a71142d76642 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:54.113693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5928c453-ef73-4e0c-b903-a71142d76642 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:54.114879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5928c453-ef73-4e0c-b903-a71142d76642 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:54.115630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5928c453-ef73-4e0c-b903-a71142d76642 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:54.270629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5928c453-ef73-4e0c-b903-a71142d76642 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:54.278443 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5928c453-ef73-4e0c-b903-a71142d76642 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1480 microversion: 2.1 time: 0.180214 Oct 29 01:24:54.279010 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2522/4852] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:54 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1480 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:54.709765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-674be728-b357-421a-b4c3-4af434aaa8ed tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:54.711038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-674be728-b357-421a-b4c3-4af434aaa8ed tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:54.718303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-674be728-b357-421a-b4c3-4af434aaa8ed tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:54.718798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-674be728-b357-421a-b4c3-4af434aaa8ed tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:54.719311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-674be728-b357-421a-b4c3-4af434aaa8ed tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:54.719967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-674be728-b357-421a-b4c3-4af434aaa8ed tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:54.720426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-674be728-b357-421a-b4c3-4af434aaa8ed tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:54.721015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-674be728-b357-421a-b4c3-4af434aaa8ed tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:54.770498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3a8958e0-2b32-42f2-b111-32b900d67ea2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:54.771276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3a8958e0-2b32-42f2-b111-32b900d67ea2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:54.778367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a8958e0-2b32-42f2-b111-32b900d67ea2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:54.779162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a8958e0-2b32-42f2-b111-32b900d67ea2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:54.788240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a8958e0-2b32-42f2-b111-32b900d67ea2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:54.788240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a8958e0-2b32-42f2-b111-32b900d67ea2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:54.788240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a8958e0-2b32-42f2-b111-32b900d67ea2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:54.788240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a8958e0-2b32-42f2-b111-32b900d67ea2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:54.819184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a8958e0-2b32-42f2-b111-32b900d67ea2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:54.819890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a8958e0-2b32-42f2-b111-32b900d67ea2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:54.820492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a8958e0-2b32-42f2-b111-32b900d67ea2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:54.821115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-3a8958e0-2b32-42f2-b111-32b900d67ea2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lazy-loading 'fault' on Instance uuid 9bc3605c-5148-4fa3-9adb-8ff369c7bb03 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:24:54.877963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3a8958e0-2b32-42f2-b111-32b900d67ea2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1089d449eff3454394061a44dd6ad52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf83fbbe41fd41bdb4b862d44634cf4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:54.887814 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3a8958e0-2b32-42f2-b111-32b900d67ea2 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 200 len: 1304 microversion: 2.1 time: 0.121694 Oct 29 01:24:54.889326 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2523/4853] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:54 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:54.901030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-674be728-b357-421a-b4c3-4af434aaa8ed tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:54.909790 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-674be728-b357-421a-b4c3-4af434aaa8ed tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1313 microversion: 2.1 time: 0.205826 Oct 29 01:24:54.910362 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2331/4854] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:54 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:55.302072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-675266d8-755b-4e08-872f-2456cb596312 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:55.302702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-675266d8-755b-4e08-872f-2456cb596312 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:55.309275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-675266d8-755b-4e08-872f-2456cb596312 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:55.309771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-675266d8-755b-4e08-872f-2456cb596312 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:55.310216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-675266d8-755b-4e08-872f-2456cb596312 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:55.310925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-675266d8-755b-4e08-872f-2456cb596312 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:55.311389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-675266d8-755b-4e08-872f-2456cb596312 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:55.311823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-675266d8-755b-4e08-872f-2456cb596312 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:55.479127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-675266d8-755b-4e08-872f-2456cb596312 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:55.487998 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-675266d8-755b-4e08-872f-2456cb596312 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1480 microversion: 2.1 time: 0.190350 Oct 29 01:24:55.489403 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2524/4855] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:55 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1480 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:55.912334 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-272c2b22-753f-4cf7-b427-34c0e486d027 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:55.912948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-272c2b22-753f-4cf7-b427-34c0e486d027 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] [instance: 9bc3605c-5148-4fa3-9adb-8ff369c7bb03] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:55.919883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-272c2b22-753f-4cf7-b427-34c0e486d027 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:55.920360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-272c2b22-753f-4cf7-b427-34c0e486d027 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:55.920794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-272c2b22-753f-4cf7-b427-34c0e486d027 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:55.921527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-272c2b22-753f-4cf7-b427-34c0e486d027 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:55.922164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-272c2b22-753f-4cf7-b427-34c0e486d027 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:55.922590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-272c2b22-753f-4cf7-b427-34c0e486d027 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:55.934286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8bef243f-fec1-4869-a797-58a0e7dce73c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:55.936074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8bef243f-fec1-4869-a797-58a0e7dce73c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:55.946513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8bef243f-fec1-4869-a797-58a0e7dce73c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:55.946513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8bef243f-fec1-4869-a797-58a0e7dce73c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:55.946513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8bef243f-fec1-4869-a797-58a0e7dce73c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:55.946730 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-272c2b22-753f-4cf7-b427-34c0e486d027 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] HTTP exception thrown: Instance 9bc3605c-5148-4fa3-9adb-8ff369c7bb03 could not be found. Oct 29 01:24:55.946818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8bef243f-fec1-4869-a797-58a0e7dce73c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:55.946818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8bef243f-fec1-4869-a797-58a0e7dce73c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:55.946818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8bef243f-fec1-4869-a797-58a0e7dce73c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-272c2b22-753f-4cf7-b427-34c0e486d027 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Request method failure captured: Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 HTTP/1.1 Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIBSX8o8EcY4CI4Iv6qgYBkxlW27PhwBVj-o0Ia0n5nsWpdpKK8hCO3IiQlaWETNuMHisclujat5Cl6DH0rM-pSUIioX3w_vkFKO5VAgaBPsWzBzjJxV4IFIvU06dHnKV5Ur4CREJkH0di5RVNQClBeHTftJ332FYiuNQPM_Do-mCMU Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: cf83fbbe41fd41bdb4b862d44634cf4c Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerRescueTestJSON-354537670 Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cf83fbbe41fd41bdb4b862d44634cf4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cf83fbbe41fd41bdb4b862d44634cf4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cf83fbbe41fd41bdb4b862d44634cf4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cf83fbbe41fd41bdb4b862d44634cf4c", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerRescueTestJSON-354537670 Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: cf83fbbe41fd41bdb4b862d44634cf4c Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerRescueTestJSON-354537670 Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerRescueTestJSON-354537670-project Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 1089d449eff3454394061a44dd6ad52d Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerRescueTestJSON-354537670-project Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 9bc3605c-5148-4fa3-9adb-8ff369c7bb03 could not be found. Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '9bc3605c-5148-4fa3-9adb-8ff369c7bb03'} Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bc3605c-5148-4fa3-9adb-8ff369c7bb03 could not be found. Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bc3605c-5148-4fa3-9adb-8ff369c7bb03 could not be found. Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:24:55.947058 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:24:55.951473 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:24:55.951473 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:24:55.951473 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:24:55.951473 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:24:55.951473 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:24:55.951473 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bc3605c-5148-4fa3-9adb-8ff369c7bb03 could not be found. Oct 29 01:24:55.951473 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:24:55.953035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-272c2b22-753f-4cf7-b427-34c0e486d027 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] Returning 404 to user: Instance 9bc3605c-5148-4fa3-9adb-8ff369c7bb03 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:24:55.954477 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-272c2b22-753f-4cf7-b427-34c0e486d027 tempest-ServerRescueTestJSON-354537670 tempest-ServerRescueTestJSON-354537670-project] 10.222.0.26 "GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03" status: 404 len: 111 microversion: 2.1 time: 0.045594 Oct 29 01:24:55.955292 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2332/4856] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:55 2022] GET /compute/v2.1/servers/9bc3605c-5148-4fa3-9adb-8ff369c7bb03 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:24:56.174830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8bef243f-fec1-4869-a797-58a0e7dce73c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:56.185015 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8bef243f-fec1-4869-a797-58a0e7dce73c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1313 microversion: 2.1 time: 0.255182 Oct 29 01:24:56.185645 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2525/4857] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:55 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:56.519060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2a82be29-5ff8-4734-8385-ab006c82ca5f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:56.519759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2a82be29-5ff8-4734-8385-ab006c82ca5f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:56.527060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a82be29-5ff8-4734-8385-ab006c82ca5f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:56.527540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a82be29-5ff8-4734-8385-ab006c82ca5f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:56.527975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a82be29-5ff8-4734-8385-ab006c82ca5f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:56.530260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a82be29-5ff8-4734-8385-ab006c82ca5f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:56.530260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a82be29-5ff8-4734-8385-ab006c82ca5f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:56.530260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a82be29-5ff8-4734-8385-ab006c82ca5f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:56.692224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2a82be29-5ff8-4734-8385-ab006c82ca5f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:56.702187 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2a82be29-5ff8-4734-8385-ab006c82ca5f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1467 microversion: 2.1 time: 0.189881 Oct 29 01:24:56.717535 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2333/4858] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:56 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1467 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:56.730935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-35d14985-9e10-4758-a32a-545449f8f12c tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-287641775"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:56.733393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-35d14985-9e10-4758-a32a-545449f8f12c tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 7616f1ea-1339-425c-9ab9-45431f3cd608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:56.740730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35d14985-9e10-4758-a32a-545449f8f12c tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:56.741524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35d14985-9e10-4758-a32a-545449f8f12c tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:56.741979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35d14985-9e10-4758-a32a-545449f8f12c tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:56.742688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35d14985-9e10-4758-a32a-545449f8f12c tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:56.743150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35d14985-9e10-4758-a32a-545449f8f12c tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:56.743580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35d14985-9e10-4758-a32a-545449f8f12c tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:57.214161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a67d2cef-f9f3-48a7-9f39-7dd88135ca93 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:57.214958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a67d2cef-f9f3-48a7-9f39-7dd88135ca93 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:57.225109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a67d2cef-f9f3-48a7-9f39-7dd88135ca93 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:57.228741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a67d2cef-f9f3-48a7-9f39-7dd88135ca93 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:57.229492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a67d2cef-f9f3-48a7-9f39-7dd88135ca93 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:57.230338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a67d2cef-f9f3-48a7-9f39-7dd88135ca93 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:57.230721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a67d2cef-f9f3-48a7-9f39-7dd88135ca93 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:57.231249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a67d2cef-f9f3-48a7-9f39-7dd88135ca93 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:57.304090 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-35d14985-9e10-4758-a32a-545449f8f12c tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "POST /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608/action" status: 202 len: 0 microversion: 2.1 time: 0.576664 Oct 29 01:24:57.306574 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2526/4859] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:24:56 2022] POST /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 01:24:57.333354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5e92c739-70cb-4e01-95f6-cf6f7253f5eb tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97823820>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:57.445523 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5e92c739-70cb-4e01-95f6-cf6f7253f5eb tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.128949 Oct 29 01:24:57.449732 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2527/4860] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:57 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:57.593551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a67d2cef-f9f3-48a7-9f39-7dd88135ca93 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:57.611190 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a67d2cef-f9f3-48a7-9f39-7dd88135ca93 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1313 microversion: 2.1 time: 0.402139 Oct 29 01:24:57.612604 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2334/4861] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:57 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:24:58.473412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a58c685d-9cd1-4057-8717-4ca425dca2ba tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96feaee0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:58.566426 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a58c685d-9cd1-4057-8717-4ca425dca2ba tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.099270 Oct 29 01:24:58.567932 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2528/4862] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:58 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:58.635595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a29ad5be-ca2f-4135-810b-5a9a4722fd6c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:58.636304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a29ad5be-ca2f-4135-810b-5a9a4722fd6c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:58.653690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a29ad5be-ca2f-4135-810b-5a9a4722fd6c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:58.654191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a29ad5be-ca2f-4135-810b-5a9a4722fd6c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:58.654641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a29ad5be-ca2f-4135-810b-5a9a4722fd6c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:58.655362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a29ad5be-ca2f-4135-810b-5a9a4722fd6c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:58.655817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a29ad5be-ca2f-4135-810b-5a9a4722fd6c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:58.661239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a29ad5be-ca2f-4135-810b-5a9a4722fd6c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:59.654127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-68cffda6-50b7-4395-8ccf-be5f38ce4599 req-4a5aad6e-8a6c-4af3-b72f-13884435789b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd534e41-d223-4dd6-9b11-0b417c775beb", "name": "network-vif-plugged", "status": "completed", "tag": "ec3e3375-e6aa-44e1-b5c9-0a7450805488"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:24:59.665509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:24:59.668350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-68cffda6-50b7-4395-8ccf-be5f38ce4599 req-4a5aad6e-8a6c-4af3-b72f-13884435789b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:59.669021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-68cffda6-50b7-4395-8ccf-be5f38ce4599 req-4a5aad6e-8a6c-4af3-b72f-13884435789b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:59.669854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-68cffda6-50b7-4395-8ccf-be5f38ce4599 req-4a5aad6e-8a6c-4af3-b72f-13884435789b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:59.685514 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-68cffda6-50b7-4395-8ccf-be5f38ce4599 req-4a5aad6e-8a6c-4af3-b72f-13884435789b service nova] Creating event network-vif-plugged:ec3e3375-e6aa-44e1-b5c9-0a7450805488 for instance cd534e41-d223-4dd6-9b11-0b417c775beb on n-h2-862964-3 Oct 29 01:24:59.694875 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-68cffda6-50b7-4395-8ccf-be5f38ce4599 req-4a5aad6e-8a6c-4af3-b72f-13884435789b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.461760 Oct 29 01:24:59.696104 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2529/4863] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:24:59.712932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bc378314-ea64-48da-bb18-a4e155d71a28 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96eb3280>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:59.836255 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bc378314-ea64-48da-bb18-a4e155d71a28 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.138617 Oct 29 01:24:59.837266 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2530/4864] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:24:59 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:24:59.842165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-15db5dfd-b25d-4292-a842-0d13c5e5d4d5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:24:59.845367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-15db5dfd-b25d-4292-a842-0d13c5e5d4d5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:24:59.855455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15db5dfd-b25d-4292-a842-0d13c5e5d4d5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:59.856221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15db5dfd-b25d-4292-a842-0d13c5e5d4d5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:59.856850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15db5dfd-b25d-4292-a842-0d13c5e5d4d5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:59.857782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15db5dfd-b25d-4292-a842-0d13c5e5d4d5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:24:59.858509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15db5dfd-b25d-4292-a842-0d13c5e5d4d5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:24:59.859091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15db5dfd-b25d-4292-a842-0d13c5e5d4d5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:24:59.886603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a29ad5be-ca2f-4135-810b-5a9a4722fd6c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:24:59.899708 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-15db5dfd-b25d-4292-a842-0d13c5e5d4d5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.061230 Oct 29 01:24:59.900570 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2531/4865] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:24:59 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments => generated 371 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:24:59.917297 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a29ad5be-ca2f-4135-810b-5a9a4722fd6c tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1313 microversion: 2.1 time: 1.268090 Oct 29 01:24:59.917297 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2335/4866] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:24:58 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1313 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:00.264380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-59bddff0-48bb-4df8-8a3e-9ec2fff2a560 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:00.265363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-59bddff0-48bb-4df8-8a3e-9ec2fff2a560 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:00.284581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59bddff0-48bb-4df8-8a3e-9ec2fff2a560 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:00.285385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59bddff0-48bb-4df8-8a3e-9ec2fff2a560 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:00.286008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59bddff0-48bb-4df8-8a3e-9ec2fff2a560 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:00.286940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59bddff0-48bb-4df8-8a3e-9ec2fff2a560 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:00.288610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59bddff0-48bb-4df8-8a3e-9ec2fff2a560 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:00.292953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59bddff0-48bb-4df8-8a3e-9ec2fff2a560 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:00.356204 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-59bddff0-48bb-4df8-8a3e-9ec2fff2a560 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments/daddb6cf-367c-484f-9780-fd9f5474bc58" status: 200 len: 194 microversion: 2.1 time: 0.098846 Oct 29 01:25:00.359383 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2532/4867] 10.222.0.26 () {58 vars in 1413 bytes} [Sat Oct 29 01:25:00 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments/daddb6cf-367c-484f-9780-fd9f5474bc58 => generated 194 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:00.370547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-88051517-30de-4680-88fa-401d23a63adc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:00.371723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-88051517-30de-4680-88fa-401d23a63adc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:00.384917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88051517-30de-4680-88fa-401d23a63adc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:00.385792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88051517-30de-4680-88fa-401d23a63adc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:00.386468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88051517-30de-4680-88fa-401d23a63adc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:00.388836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88051517-30de-4680-88fa-401d23a63adc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:00.389384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88051517-30de-4680-88fa-401d23a63adc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:00.389889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88051517-30de-4680-88fa-401d23a63adc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:00.555059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-88051517-30de-4680-88fa-401d23a63adc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lazy-loading 'services' on Instance uuid 2172c139-992f-4b5d-97b3-f2e549f6fe29 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:25:00.852394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5c551368-eb64-43a8-828e-9699d30a3518 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d977d6670>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:00.853276 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-88051517-30de-4680-88fa-401d23a63adc tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments/daddb6cf-367c-484f-9780-fd9f5474bc58" status: 202 len: 0 microversion: 2.1 time: 0.488014 Oct 29 01:25:00.854440 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2336/4868] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 29 01:25:00 2022] DELETE /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments/daddb6cf-367c-484f-9780-fd9f5474bc58 => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:25:00.934784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-43c47bd6-30a9-4e1c-a2b9-755aac7426b8 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:00.935892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-43c47bd6-30a9-4e1c-a2b9-755aac7426b8 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:01.005556 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5c551368-eb64-43a8-828e-9699d30a3518 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.156130 Oct 29 01:25:01.013345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43c47bd6-30a9-4e1c-a2b9-755aac7426b8 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:01.013883 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2533/4869] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:00 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:01.013966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43c47bd6-30a9-4e1c-a2b9-755aac7426b8 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:01.014715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43c47bd6-30a9-4e1c-a2b9-755aac7426b8 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:01.016310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43c47bd6-30a9-4e1c-a2b9-755aac7426b8 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:01.019008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43c47bd6-30a9-4e1c-a2b9-755aac7426b8 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:01.020369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43c47bd6-30a9-4e1c-a2b9-755aac7426b8 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:01.510540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-43c47bd6-30a9-4e1c-a2b9-755aac7426b8 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:01.521048 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-43c47bd6-30a9-4e1c-a2b9-755aac7426b8 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1313 microversion: 2.1 time: 0.596414 Oct 29 01:25:01.529391 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2337/4870] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:00 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1313 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:01.779277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-855d45df-afbf-4c7f-b563-42cf9d0b1316 req-b3535d4e-fece-4239-a556-76fa2088ed31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391c56c8-b8d8-424c-91d7-dc0408b9e71d", "name": "network-vif-unplugged", "status": "completed", "tag": "bfe88ae5-26ce-42b9-a002-0635e32f69b1"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:01.820881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-855d45df-afbf-4c7f-b563-42cf9d0b1316 req-b3535d4e-fece-4239-a556-76fa2088ed31 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:01.821400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-855d45df-afbf-4c7f-b563-42cf9d0b1316 req-b3535d4e-fece-4239-a556-76fa2088ed31 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:01.821841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-855d45df-afbf-4c7f-b563-42cf9d0b1316 req-b3535d4e-fece-4239-a556-76fa2088ed31 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:01.856638 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-855d45df-afbf-4c7f-b563-42cf9d0b1316 req-b3535d4e-fece-4239-a556-76fa2088ed31 service nova] Creating event network-vif-unplugged:bfe88ae5-26ce-42b9-a002-0635e32f69b1 for instance 391c56c8-b8d8-424c-91d7-dc0408b9e71d on n-h2-862964-3 Oct 29 01:25:01.872175 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-855d45df-afbf-4c7f-b563-42cf9d0b1316 req-b3535d4e-fece-4239-a556-76fa2088ed31 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100331 Oct 29 01:25:01.875542 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2534/4871] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:02.029111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f4ecb98c-fbb7-4c0b-ba1a-21971ea90023 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9fd2f670>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:02.140482 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f4ecb98c-fbb7-4c0b-ba1a-21971ea90023 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.115955 Oct 29 01:25:02.142893 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2338/4872] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:02 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:02.552844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ccff7366-f088-4ab8-afc5-58eec5c20e46 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:02.553130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ccff7366-f088-4ab8-afc5-58eec5c20e46 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:02.565186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccff7366-f088-4ab8-afc5-58eec5c20e46 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:02.565685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccff7366-f088-4ab8-afc5-58eec5c20e46 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:02.573999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccff7366-f088-4ab8-afc5-58eec5c20e46 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:02.576235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccff7366-f088-4ab8-afc5-58eec5c20e46 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:02.576954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccff7366-f088-4ab8-afc5-58eec5c20e46 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:02.577948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccff7366-f088-4ab8-afc5-58eec5c20e46 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:02.917908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ccff7366-f088-4ab8-afc5-58eec5c20e46 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:02.932787 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ccff7366-f088-4ab8-afc5-58eec5c20e46 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1463 microversion: 2.1 time: 0.382127 Oct 29 01:25:02.939189 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2535/4873] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:02 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1463 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:02.962306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-645b6bf2-3445-48c0-8782-3364267b34f2 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4414d17b-d561-4127-889e-8dd3bf0237dc", "device": "/dev/sdb"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:02.963766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-645b6bf2-3445-48c0-8782-3364267b34f2 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:02.972776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-645b6bf2-3445-48c0-8782-3364267b34f2 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:02.973590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-645b6bf2-3445-48c0-8782-3364267b34f2 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:02.974275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-645b6bf2-3445-48c0-8782-3364267b34f2 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:02.975176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-645b6bf2-3445-48c0-8782-3364267b34f2 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:02.975807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-645b6bf2-3445-48c0-8782-3364267b34f2 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:02.976510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-645b6bf2-3445-48c0-8782-3364267b34f2 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:03.158023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-65d350b9-477d-42cc-8698-49afe2b24a0f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9781f790>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:03.241030 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-65d350b9-477d-42cc-8698-49afe2b24a0f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.087135 Oct 29 01:25:03.241973 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2536/4874] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:03 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:04.095521 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-645b6bf2-3445-48c0-8782-3364267b34f2 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "POST /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.141120 Oct 29 01:25:04.097097 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2339/4875] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 29 01:25:02 2022] POST /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb/os-volume_attachments => generated 194 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:04.262226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5a24b0f9-e48a-4a96-ba49-3eea1ba71eb9 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96f88ee0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:04.336479 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5a24b0f9-e48a-4a96-ba49-3eea1ba71eb9 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.083688 Oct 29 01:25:04.346302 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2537/4876] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:04 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:05.017566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-5d9d486d-185b-4c2a-b1b6-b620cb0ca20d req-fb2e267b-1634-49bc-ad81-a91bc4b2c95a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7616f1ea-1339-425c-9ab9-45431f3cd608", "name": "network-vif-plugged", "status": "completed", "tag": "1f225c5e-7d18-4b8d-9938-9a97f24a39fc"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:05.039087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5d9d486d-185b-4c2a-b1b6-b620cb0ca20d req-fb2e267b-1634-49bc-ad81-a91bc4b2c95a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:05.039597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5d9d486d-185b-4c2a-b1b6-b620cb0ca20d req-fb2e267b-1634-49bc-ad81-a91bc4b2c95a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:05.047332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5d9d486d-185b-4c2a-b1b6-b620cb0ca20d req-fb2e267b-1634-49bc-ad81-a91bc4b2c95a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:05.072748 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-5d9d486d-185b-4c2a-b1b6-b620cb0ca20d req-fb2e267b-1634-49bc-ad81-a91bc4b2c95a service nova] Creating event network-vif-plugged:1f225c5e-7d18-4b8d-9938-9a97f24a39fc for instance 7616f1ea-1339-425c-9ab9-45431f3cd608 on n-h2-862964-3 Oct 29 01:25:05.079905 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-5d9d486d-185b-4c2a-b1b6-b620cb0ca20d req-fb2e267b-1634-49bc-ad81-a91bc4b2c95a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067015 Oct 29 01:25:05.081865 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2538/4877] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:25:05.130212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8ab422d6-e539-46c7-9d1c-99607b418385 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-141136406", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "bf44a312-d8d4-4636-8ed4-e759797fbb2e"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:05.231865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-8ab422d6-e539-46c7-9d1c-99607b418385 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] validate_networks() for [('bf44a312-d8d4-4636-8ed4-e759797fbb2e', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:25:05.366569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2d4e0ec8-180e-45f9-9e7b-87f19a3de413 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9781fa60>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:05.474791 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2d4e0ec8-180e-45f9-9e7b-87f19a3de413 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.126192 Oct 29 01:25:05.484767 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2539/4878] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:05 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:05.834628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-8ab422d6-e539-46c7-9d1c-99607b418385 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:25:05.839727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-8ab422d6-e539-46c7-9d1c-99607b418385 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:25:05.839727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-8ab422d6-e539-46c7-9d1c-99607b418385 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:25:05.839727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-8ab422d6-e539-46c7-9d1c-99607b418385 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:25:05.839727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-8ab422d6-e539-46c7-9d1c-99607b418385 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:25:05.846806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8ab422d6-e539-46c7-9d1c-99607b418385 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:05.847288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8ab422d6-e539-46c7-9d1c-99607b418385 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:05.847776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8ab422d6-e539-46c7-9d1c-99607b418385 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:05.848499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8ab422d6-e539-46c7-9d1c-99607b418385 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:05.849115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8ab422d6-e539-46c7-9d1c-99607b418385 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:05.849588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8ab422d6-e539-46c7-9d1c-99607b418385 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:05.869399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-8ab422d6-e539-46c7-9d1c-99607b418385 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Getting quotas for project 0dd5d9ef52524461a5ea497010bd3dc0. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:25:05.878109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-8ab422d6-e539-46c7-9d1c-99607b418385 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Getting quotas for user b7d6b090698b4ac29481af8eb9fa6b3c and project 0dd5d9ef52524461a5ea497010bd3dc0. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:25:05.897496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8ab422d6-e539-46c7-9d1c-99607b418385 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:25:05.902099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8ab422d6-e539-46c7-9d1c-99607b418385 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:25:06.087991 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8ab422d6-e539-46c7-9d1c-99607b418385 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.231893 Oct 29 01:25:06.088984 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2340/4879] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:25:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:25:06.101241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1708be5f-d880-4daf-ac82-9e96558332aa tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:06.108135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1708be5f-d880-4daf-ac82-9e96558332aa tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:06.202739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1708be5f-d880-4daf-ac82-9e96558332aa tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:06.213721 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1708be5f-d880-4daf-ac82-9e96558332aa tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 200 len: 1223 microversion: 2.1 time: 0.116264 Oct 29 01:25:06.216432 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2540/4880] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:06 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 1223 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:06.494599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5aa1feda-5075-4021-8243-f594cf00aba6 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97f099d0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:06.585480 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5aa1feda-5075-4021-8243-f594cf00aba6 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.096054 Oct 29 01:25:06.587901 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2341/4881] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:06 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:07.243675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0c9113a1-c6c3-40be-8394-17185c720be4 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:07.245196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0c9113a1-c6c3-40be-8394-17185c720be4 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:07.320257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0c9113a1-c6c3-40be-8394-17185c720be4 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:07.328349 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0c9113a1-c6c3-40be-8394-17185c720be4 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 200 len: 1223 microversion: 2.1 time: 0.090200 Oct 29 01:25:07.329304 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2541/4882] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:07 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:07.602691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4d188dbe-77be-4d95-9e2a-f8e423811cc5 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9c1c0ca0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:07.694269 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4d188dbe-77be-4d95-9e2a-f8e423811cc5 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.095554 Oct 29 01:25:07.695177 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2342/4883] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:07 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:08.095417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a4253e86-3655-4482-9323-8d66b015fadf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:08.096953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a4253e86-3655-4482-9323-8d66b015fadf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:08.113031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4253e86-3655-4482-9323-8d66b015fadf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:08.114878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4253e86-3655-4482-9323-8d66b015fadf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:08.115591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4253e86-3655-4482-9323-8d66b015fadf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:08.118196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4253e86-3655-4482-9323-8d66b015fadf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:08.118995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4253e86-3655-4482-9323-8d66b015fadf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:08.120940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4253e86-3655-4482-9323-8d66b015fadf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:08.178124 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a4253e86-3655-4482-9323-8d66b015fadf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments/1a4a4ebc-4fc8-43d1-9b9c-99a76c986c5f" status: 200 len: 194 microversion: 2.1 time: 0.088714 Oct 29 01:25:08.179556 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2542/4884] 10.222.0.26 () {58 vars in 1413 bytes} [Sat Oct 29 01:25:08 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments/1a4a4ebc-4fc8-43d1-9b9c-99a76c986c5f => generated 194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:08.195386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f84dda8c-465c-4923-a9b1-d021b9d4bdcf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:08.195899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f84dda8c-465c-4923-a9b1-d021b9d4bdcf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:08.209270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:25:08.211570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f84dda8c-465c-4923-a9b1-d021b9d4bdcf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:08.212083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f84dda8c-465c-4923-a9b1-d021b9d4bdcf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:08.212524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f84dda8c-465c-4923-a9b1-d021b9d4bdcf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:08.213660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f84dda8c-465c-4923-a9b1-d021b9d4bdcf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:08.214674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f84dda8c-465c-4923-a9b1-d021b9d4bdcf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:08.215307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f84dda8c-465c-4923-a9b1-d021b9d4bdcf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:08.246518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:25:08.352883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e45fed4d-526f-4285-a7e4-3066838683c9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:08.353589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e45fed4d-526f-4285-a7e4-3066838683c9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:08.365412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e45fed4d-526f-4285-a7e4-3066838683c9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:08.368745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e45fed4d-526f-4285-a7e4-3066838683c9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:08.377249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-f84dda8c-465c-4923-a9b1-d021b9d4bdcf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lazy-loading 'services' on Instance uuid 2172c139-992f-4b5d-97b3-f2e549f6fe29 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:25:08.379427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e45fed4d-526f-4285-a7e4-3066838683c9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:08.384726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e45fed4d-526f-4285-a7e4-3066838683c9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:08.385439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e45fed4d-526f-4285-a7e4-3066838683c9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:08.386003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e45fed4d-526f-4285-a7e4-3066838683c9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:08.445088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:25:08.554100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e45fed4d-526f-4285-a7e4-3066838683c9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:08.565339 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e45fed4d-526f-4285-a7e4-3066838683c9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 200 len: 1275 microversion: 2.1 time: 0.216667 Oct 29 01:25:08.577845 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2543/4885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:08 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 1275 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:08.681994 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f84dda8c-465c-4923-a9b1-d021b9d4bdcf tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments/1a4a4ebc-4fc8-43d1-9b9c-99a76c986c5f" status: 202 len: 0 microversion: 2.1 time: 0.489573 Oct 29 01:25:08.683354 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2343/4886] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 29 01:25:08 2022] DELETE /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments/1a4a4ebc-4fc8-43d1-9b9c-99a76c986c5f => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:25:08.715390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2965e2cf-3221-437a-9caa-1b59df6461f9 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9781fdc0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:08.810939 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2965e2cf-3221-437a-9caa-1b59df6461f9 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.103137 Oct 29 01:25:08.821359 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2544/4887] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:08 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:09.593970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b2337aa4-4695-44fd-948a-4cc96f99467b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:09.595573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b2337aa4-4695-44fd-948a-4cc96f99467b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:09.612276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2337aa4-4695-44fd-948a-4cc96f99467b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:09.616962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2337aa4-4695-44fd-948a-4cc96f99467b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:09.617722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2337aa4-4695-44fd-948a-4cc96f99467b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:09.618680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2337aa4-4695-44fd-948a-4cc96f99467b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:09.622286 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2337aa4-4695-44fd-948a-4cc96f99467b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:09.624297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2337aa4-4695-44fd-948a-4cc96f99467b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:09.829335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aac0a9b9-4c4b-400f-98b2-9b383f7007de tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97c59670>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:09.947197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b2337aa4-4695-44fd-948a-4cc96f99467b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:09.955754 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b2337aa4-4695-44fd-948a-4cc96f99467b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 200 len: 1293 microversion: 2.1 time: 0.367399 Oct 29 01:25:09.960297 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aac0a9b9-4c4b-400f-98b2-9b383f7007de tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.135736 Oct 29 01:25:09.961333 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2545/4888] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:09 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:09.965802 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2344/4889] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:09 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 1293 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:10.979397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f4b701b7-4698-4e6b-a63b-c45de01165d4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9781fe50>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:11.007393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8d20e959-a53e-4875-a02e-c30ab7dc88c5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:11.008944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8d20e959-a53e-4875-a02e-c30ab7dc88c5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:11.031540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d20e959-a53e-4875-a02e-c30ab7dc88c5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:11.034355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d20e959-a53e-4875-a02e-c30ab7dc88c5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:11.037342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d20e959-a53e-4875-a02e-c30ab7dc88c5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:11.039781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d20e959-a53e-4875-a02e-c30ab7dc88c5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:11.040982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d20e959-a53e-4875-a02e-c30ab7dc88c5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:11.045457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d20e959-a53e-4875-a02e-c30ab7dc88c5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:11.083334 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f4b701b7-4698-4e6b-a63b-c45de01165d4 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.110123 Oct 29 01:25:11.091972 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2546/4890] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:10 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:11.209230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8d20e959-a53e-4875-a02e-c30ab7dc88c5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:11.244516 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8d20e959-a53e-4875-a02e-c30ab7dc88c5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 200 len: 1281 microversion: 2.1 time: 0.243428 Oct 29 01:25:11.265505 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2345/4891] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:10 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 1281 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:12.101464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-015671f6-cb66-41f9-a5a7-c041d7d0fb12 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9770df70>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:12.223648 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-015671f6-cb66-41f9-a5a7-c041d7d0fb12 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.127887 Oct 29 01:25:12.224229 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2547/4892] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:12 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:12.289487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4f793d3f-ebe4-4237-87f1-302689350206 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:12.290164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4f793d3f-ebe4-4237-87f1-302689350206 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:12.308482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f793d3f-ebe4-4237-87f1-302689350206 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:12.311051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f793d3f-ebe4-4237-87f1-302689350206 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:12.312705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f793d3f-ebe4-4237-87f1-302689350206 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:12.316148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f793d3f-ebe4-4237-87f1-302689350206 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:12.316830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f793d3f-ebe4-4237-87f1-302689350206 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:12.317460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f793d3f-ebe4-4237-87f1-302689350206 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:12.907903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4f793d3f-ebe4-4237-87f1-302689350206 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:12.918758 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4f793d3f-ebe4-4237-87f1-302689350206 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 200 len: 1323 microversion: 2.1 time: 0.633757 Oct 29 01:25:12.919350 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2346/4893] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:12 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 1323 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:13.096720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fffee132-5e50-48f6-a77d-a39a27168dd4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:13.097453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fffee132-5e50-48f6-a77d-a39a27168dd4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:13.117204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fffee132-5e50-48f6-a77d-a39a27168dd4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:13.120108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fffee132-5e50-48f6-a77d-a39a27168dd4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:13.120876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fffee132-5e50-48f6-a77d-a39a27168dd4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:13.122178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fffee132-5e50-48f6-a77d-a39a27168dd4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:13.124857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fffee132-5e50-48f6-a77d-a39a27168dd4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:13.125977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fffee132-5e50-48f6-a77d-a39a27168dd4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:13.205051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fffee132-5e50-48f6-a77d-a39a27168dd4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:25:13.241776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-12f93943-1e11-4c13-8dda-ff237af44116 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97b0d1f0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:13.325638 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-12f93943-1e11-4c13-8dda-ff237af44116 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.088551 Oct 29 01:25:13.336891 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2347/4894] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:13 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:13.603614 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fffee132-5e50-48f6-a77d-a39a27168dd4 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "DELETE /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 204 len: 0 microversion: 2.32 time: 0.990847 Oct 29 01:25:13.604796 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2548/4895] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:25:12 2022] DELETE /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 0 bytes in 993 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:25:13.627872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5c0cceb3-7070-4a7c-8441-a18c701d8a74 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:13.628588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5c0cceb3-7070-4a7c-8441-a18c701d8a74 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:13.653511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c0cceb3-7070-4a7c-8441-a18c701d8a74 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:13.654032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c0cceb3-7070-4a7c-8441-a18c701d8a74 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:13.654460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c0cceb3-7070-4a7c-8441-a18c701d8a74 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:13.655183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c0cceb3-7070-4a7c-8441-a18c701d8a74 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:13.655705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c0cceb3-7070-4a7c-8441-a18c701d8a74 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:13.656136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c0cceb3-7070-4a7c-8441-a18c701d8a74 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:13.949013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9dc06f6a-d9c2-44d6-bff6-3ed559d962f0 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:13.950356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9dc06f6a-d9c2-44d6-bff6-3ed559d962f0 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:13.965580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9dc06f6a-d9c2-44d6-bff6-3ed559d962f0 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:13.970235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9dc06f6a-d9c2-44d6-bff6-3ed559d962f0 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:13.970740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9dc06f6a-d9c2-44d6-bff6-3ed559d962f0 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:13.971495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9dc06f6a-d9c2-44d6-bff6-3ed559d962f0 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:13.971968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9dc06f6a-d9c2-44d6-bff6-3ed559d962f0 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:13.976946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9dc06f6a-d9c2-44d6-bff6-3ed559d962f0 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:14.518958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5c0cceb3-7070-4a7c-8441-a18c701d8a74 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:14.554265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5c0cceb3-7070-4a7c-8441-a18c701d8a74 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:14.558149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5c0cceb3-7070-4a7c-8441-a18c701d8a74 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:14.563635 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5c0cceb3-7070-4a7c-8441-a18c701d8a74 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 2956 microversion: 2.32 time: 0.940282 Oct 29 01:25:14.569059 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2348/4896] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:13 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 2956 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:14.594043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8753efab-4034-4ad9-bb01-e0c5fcf1eb68 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9fe103a0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:14.618270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9dc06f6a-d9c2-44d6-bff6-3ed559d962f0 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:14.632215 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9dc06f6a-d9c2-44d6-bff6-3ed559d962f0 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 200 len: 1323 microversion: 2.1 time: 0.687651 Oct 29 01:25:14.633176 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2549/4897] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:13 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 1323 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:14.700503 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8753efab-4034-4ad9-bb01-e0c5fcf1eb68 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.126839 Oct 29 01:25:14.710572 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2349/4898] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:14 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:15.212025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-ec5dcd7f-fd59-4498-a44e-cce58cbb8ea7 req-64d0fb4d-b1d2-467c-8caf-c8e16ff31680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d81519da-d650-41a7-a009-4bcfb4e94d92", "tag": "ce177e8d-5249-49d2-a188-951d6561d827"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:15.229332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ec5dcd7f-fd59-4498-a44e-cce58cbb8ea7 req-64d0fb4d-b1d2-467c-8caf-c8e16ff31680 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:15.230104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ec5dcd7f-fd59-4498-a44e-cce58cbb8ea7 req-64d0fb4d-b1d2-467c-8caf-c8e16ff31680 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:15.230705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ec5dcd7f-fd59-4498-a44e-cce58cbb8ea7 req-64d0fb4d-b1d2-467c-8caf-c8e16ff31680 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:15.254352 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-ec5dcd7f-fd59-4498-a44e-cce58cbb8ea7 req-64d0fb4d-b1d2-467c-8caf-c8e16ff31680 service nova] Creating event network-changed:ce177e8d-5249-49d2-a188-951d6561d827 for instance d81519da-d650-41a7-a009-4bcfb4e94d92 on n-h1-862964-3 Oct 29 01:25:15.260539 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-ec5dcd7f-fd59-4498-a44e-cce58cbb8ea7 req-64d0fb4d-b1d2-467c-8caf-c8e16ff31680 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052714 Oct 29 01:25:15.262151 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2550/4899] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:15.606722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c67affa6-db61-4300-9787-13a3b1522bbb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:15.607350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c67affa6-db61-4300-9787-13a3b1522bbb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:15.658826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-34efc890-25bf-4454-b29c-8e809fadc620 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:15.661257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-34efc890-25bf-4454-b29c-8e809fadc620 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:15.675728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c67affa6-db61-4300-9787-13a3b1522bbb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:15.676392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c67affa6-db61-4300-9787-13a3b1522bbb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:15.676673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c67affa6-db61-4300-9787-13a3b1522bbb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:15.677422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c67affa6-db61-4300-9787-13a3b1522bbb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:15.677889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c67affa6-db61-4300-9787-13a3b1522bbb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:15.678502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c67affa6-db61-4300-9787-13a3b1522bbb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:15.698205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-34efc890-25bf-4454-b29c-8e809fadc620 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:15.698622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-34efc890-25bf-4454-b29c-8e809fadc620 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:15.699068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-34efc890-25bf-4454-b29c-8e809fadc620 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:15.699792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-34efc890-25bf-4454-b29c-8e809fadc620 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:15.700253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-34efc890-25bf-4454-b29c-8e809fadc620 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:15.700686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-34efc890-25bf-4454-b29c-8e809fadc620 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:15.855488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:25:15.890303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:25:16.588867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c67affa6-db61-4300-9787-13a3b1522bbb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:16.604326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-34efc890-25bf-4454-b29c-8e809fadc620 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:16.626634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c67affa6-db61-4300-9787-13a3b1522bbb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:16.628263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c67affa6-db61-4300-9787-13a3b1522bbb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:16.629599 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c67affa6-db61-4300-9787-13a3b1522bbb tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 2956 microversion: 2.32 time: 1.028279 Oct 29 01:25:16.630182 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2350/4900] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:15 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 2956 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:16.631690 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-34efc890-25bf-4454-b29c-8e809fadc620 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 200 len: 1323 microversion: 2.1 time: 0.978981 Oct 29 01:25:16.632546 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2551/4901] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:15 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 1323 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:16.637548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e381013-574a-4a65-b2a4-4ebb37e79ba1 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97b0df70>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:16.713564 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e381013-574a-4a65-b2a4-4ebb37e79ba1 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.082264 Oct 29 01:25:16.714153 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2351/4902] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:16 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:17.363427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-34efc890-25bf-4454-b29c-8e809fadc620 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:17.364578 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-34efc890-25bf-4454-b29c-8e809fadc620 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002100 Oct 29 01:25:17.369879 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2552/4903] 10.222.0.26 () {56 vars in 886 bytes} [Sat Oct 29 01:25:17 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 29 01:25:17.689360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a46832b8-7ef9-414e-972e-1fdd8de7d2ea tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:17.692963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a46832b8-7ef9-414e-972e-1fdd8de7d2ea tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:17.693892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4e7b5cad-deda-424d-9af8-4f1a753a96de tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:17.695203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4e7b5cad-deda-424d-9af8-4f1a753a96de tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:17.702085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:25:17.736761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e7b5cad-deda-424d-9af8-4f1a753a96de tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:17.736761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e7b5cad-deda-424d-9af8-4f1a753a96de tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:17.736761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e7b5cad-deda-424d-9af8-4f1a753a96de tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:17.736761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e7b5cad-deda-424d-9af8-4f1a753a96de tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:17.736761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e7b5cad-deda-424d-9af8-4f1a753a96de tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:17.737231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a46832b8-7ef9-414e-972e-1fdd8de7d2ea tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:17.737231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a46832b8-7ef9-414e-972e-1fdd8de7d2ea tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:17.737231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a46832b8-7ef9-414e-972e-1fdd8de7d2ea tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:17.737231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a46832b8-7ef9-414e-972e-1fdd8de7d2ea tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:17.737555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e7b5cad-deda-424d-9af8-4f1a753a96de tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:17.739386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a46832b8-7ef9-414e-972e-1fdd8de7d2ea tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:17.741426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a46832b8-7ef9-414e-972e-1fdd8de7d2ea tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:18.772650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4e7b5cad-deda-424d-9af8-4f1a753a96de tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:18.784318 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4e7b5cad-deda-424d-9af8-4f1a753a96de tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 200 len: 1323 microversion: 2.1 time: 1.105662 Oct 29 01:25:18.790369 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2352/4904] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:17 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 1323 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:18.795564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6d830d11-1b7b-4fea-a2ea-9ce38d624bdc tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9fd2fca0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:18.821429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a46832b8-7ef9-414e-972e-1fdd8de7d2ea tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:18.846942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a46832b8-7ef9-414e-972e-1fdd8de7d2ea tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:18.855286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a46832b8-7ef9-414e-972e-1fdd8de7d2ea tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:18.867352 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a46832b8-7ef9-414e-972e-1fdd8de7d2ea tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 2956 microversion: 2.32 time: 1.178950 Oct 29 01:25:18.871046 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2553/4905] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:17 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 2956 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:18.906604 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6d830d11-1b7b-4fea-a2ea-9ce38d624bdc tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.114709 Oct 29 01:25:18.915139 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2353/4906] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:18 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:19.819272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-790c3e87-c648-441e-8d66-14dea8f9270d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:19.819943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-790c3e87-c648-441e-8d66-14dea8f9270d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:19.833177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-790c3e87-c648-441e-8d66-14dea8f9270d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:19.833740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-790c3e87-c648-441e-8d66-14dea8f9270d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:19.834003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-790c3e87-c648-441e-8d66-14dea8f9270d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:19.834662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-790c3e87-c648-441e-8d66-14dea8f9270d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:19.835120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-790c3e87-c648-441e-8d66-14dea8f9270d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:19.835587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-790c3e87-c648-441e-8d66-14dea8f9270d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:19.909054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aba11cc0-1a59-4663-a39b-96d85ff71d8d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:19.910618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aba11cc0-1a59-4663-a39b-96d85ff71d8d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:19.933824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aba11cc0-1a59-4663-a39b-96d85ff71d8d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:19.938175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aba11cc0-1a59-4663-a39b-96d85ff71d8d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:19.939944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aba11cc0-1a59-4663-a39b-96d85ff71d8d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:19.942756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aba11cc0-1a59-4663-a39b-96d85ff71d8d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:19.945198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aba11cc0-1a59-4663-a39b-96d85ff71d8d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:19.948685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aba11cc0-1a59-4663-a39b-96d85ff71d8d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:20.821459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-790c3e87-c648-441e-8d66-14dea8f9270d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:20.831668 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-790c3e87-c648-441e-8d66-14dea8f9270d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 200 len: 1323 microversion: 2.1 time: 1.016103 Oct 29 01:25:20.832166 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2554/4907] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:19 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 1323 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:20.848673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aba11cc0-1a59-4663-a39b-96d85ff71d8d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:20.866134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6c35d955-db32-4596-94e4-fd4364534158 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9778c820>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:20.870120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aba11cc0-1a59-4663-a39b-96d85ff71d8d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:20.876585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aba11cc0-1a59-4663-a39b-96d85ff71d8d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:20.880455 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aba11cc0-1a59-4663-a39b-96d85ff71d8d tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 2914 microversion: 2.32 time: 0.983326 Oct 29 01:25:20.902796 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2354/4908] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:19 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 2914 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:25:20.969720 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6c35d955-db32-4596-94e4-fd4364534158 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.136420 Oct 29 01:25:20.973529 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2555/4909] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:20 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:21.276875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-5a84db46-a8b5-4834-9ebe-83c09a766cab req-995e25b5-5634-43e5-b7b4-23828665fe9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "name": "network-vif-deleted", "tag": "44b552d3-db18-4618-bee3-f48ae965062f"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:21.302216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5a84db46-a8b5-4834-9ebe-83c09a766cab req-995e25b5-5634-43e5-b7b4-23828665fe9d service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:21.304748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5a84db46-a8b5-4834-9ebe-83c09a766cab req-995e25b5-5634-43e5-b7b4-23828665fe9d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:21.307066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5a84db46-a8b5-4834-9ebe-83c09a766cab req-995e25b5-5634-43e5-b7b4-23828665fe9d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:21.356320 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-5a84db46-a8b5-4834-9ebe-83c09a766cab req-995e25b5-5634-43e5-b7b4-23828665fe9d service nova] Creating event network-vif-deleted:44b552d3-db18-4618-bee3-f48ae965062f for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:25:21.404876 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-5a84db46-a8b5-4834-9ebe-83c09a766cab req-995e25b5-5634-43e5-b7b4-23828665fe9d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.500469 Oct 29 01:25:21.405522 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2355/4910] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:21.822798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-979ef209-e8a2-43a5-ac91-a2e216cb5efd req-db5aac2b-80f4-4f88-a8d5-de1eda275c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "name": "network-vif-unplugged", "status": "completed", "tag": "4ebf9678-ed9a-4016-bd19-cc21fccd57ef"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:21.856296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-63413bc3-1aa3-48b3-b78d-b23a772f6344 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:21.857010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-63413bc3-1aa3-48b3-b78d-b23a772f6344 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:21.872683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63413bc3-1aa3-48b3-b78d-b23a772f6344 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:21.876011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-979ef209-e8a2-43a5-ac91-a2e216cb5efd req-db5aac2b-80f4-4f88-a8d5-de1eda275c41 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:21.877413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-979ef209-e8a2-43a5-ac91-a2e216cb5efd req-db5aac2b-80f4-4f88-a8d5-de1eda275c41 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:21.878752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-979ef209-e8a2-43a5-ac91-a2e216cb5efd req-db5aac2b-80f4-4f88-a8d5-de1eda275c41 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:21.878944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63413bc3-1aa3-48b3-b78d-b23a772f6344 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:21.882123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63413bc3-1aa3-48b3-b78d-b23a772f6344 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:21.888371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63413bc3-1aa3-48b3-b78d-b23a772f6344 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:21.889207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63413bc3-1aa3-48b3-b78d-b23a772f6344 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:21.893822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63413bc3-1aa3-48b3-b78d-b23a772f6344 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:21.945398 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-979ef209-e8a2-43a5-ac91-a2e216cb5efd req-db5aac2b-80f4-4f88-a8d5-de1eda275c41 service nova] Creating event network-vif-unplugged:4ebf9678-ed9a-4016-bd19-cc21fccd57ef for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:25:21.966215 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-979ef209-e8a2-43a5-ac91-a2e216cb5efd req-db5aac2b-80f4-4f88-a8d5-de1eda275c41 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146192 Oct 29 01:25:21.968705 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2556/4911] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:21.992239 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-76cce07c-7654-4dc3-bb23-ec8aa075f0f2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:21.996127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-76cce07c-7654-4dc3-bb23-ec8aa075f0f2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:22.038101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76cce07c-7654-4dc3-bb23-ec8aa075f0f2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:22.040313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76cce07c-7654-4dc3-bb23-ec8aa075f0f2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:22.040441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76cce07c-7654-4dc3-bb23-ec8aa075f0f2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:22.044378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76cce07c-7654-4dc3-bb23-ec8aa075f0f2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:22.044931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76cce07c-7654-4dc3-bb23-ec8aa075f0f2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:22.048296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-76cce07c-7654-4dc3-bb23-ec8aa075f0f2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:23.325360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-76cce07c-7654-4dc3-bb23-ec8aa075f0f2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:23.345613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-76cce07c-7654-4dc3-bb23-ec8aa075f0f2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:23.351073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-76cce07c-7654-4dc3-bb23-ec8aa075f0f2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:23.353346 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-76cce07c-7654-4dc3-bb23-ec8aa075f0f2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 2753 microversion: 2.32 time: 1.378681 Oct 29 01:25:23.357505 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2557/4912] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:21 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 2753 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:23.364724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9ebf2a1c-74e0-4956-a1b3-9fdfbccc5bb5 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97acaa60>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:23.445087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-63413bc3-1aa3-48b3-b78d-b23a772f6344 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:23.463726 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-63413bc3-1aa3-48b3-b78d-b23a772f6344 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 200 len: 1323 microversion: 2.1 time: 1.601883 Oct 29 01:25:23.478544 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2356/4913] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:21 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 1323 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:23.486196 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9ebf2a1c-74e0-4956-a1b3-9fdfbccc5bb5 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.127015 Oct 29 01:25:23.489620 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2558/4914] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:23 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:23.497020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-91e35a39-158c-454c-9a33-f1818fcceb76 req-f3df0af3-6eec-4165-b00f-4537440e4c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "name": "network-vif-deleted", "tag": "e3cb24be-1f0b-4f1e-8954-12fc1365bfd4"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:23.497306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c8fa6464-cd18-4462-8116-ff3d2fe1bdd6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:23.508450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c8fa6464-cd18-4462-8116-ff3d2fe1bdd6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:23.520163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8fa6464-cd18-4462-8116-ff3d2fe1bdd6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:23.520938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8fa6464-cd18-4462-8116-ff3d2fe1bdd6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:23.521567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8fa6464-cd18-4462-8116-ff3d2fe1bdd6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:23.522450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8fa6464-cd18-4462-8116-ff3d2fe1bdd6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:23.523075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8fa6464-cd18-4462-8116-ff3d2fe1bdd6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:23.528938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8fa6464-cd18-4462-8116-ff3d2fe1bdd6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:23.533406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-91e35a39-158c-454c-9a33-f1818fcceb76 req-f3df0af3-6eec-4165-b00f-4537440e4c95 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:23.533912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-91e35a39-158c-454c-9a33-f1818fcceb76 req-f3df0af3-6eec-4165-b00f-4537440e4c95 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:23.537635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-91e35a39-158c-454c-9a33-f1818fcceb76 req-f3df0af3-6eec-4165-b00f-4537440e4c95 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:23.565384 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-91e35a39-158c-454c-9a33-f1818fcceb76 req-f3df0af3-6eec-4165-b00f-4537440e4c95 service nova] Creating event network-vif-deleted:e3cb24be-1f0b-4f1e-8954-12fc1365bfd4 for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:25:23.589592 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-91e35a39-158c-454c-9a33-f1818fcceb76 req-f3df0af3-6eec-4165-b00f-4537440e4c95 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098034 Oct 29 01:25:23.590575 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2559/4915] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:23.613862 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c8fa6464-cd18-4462-8116-ff3d2fe1bdd6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.133993 Oct 29 01:25:23.617313 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2357/4916] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:25:23 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments => generated 25 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:25:23.881072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-faa0208e-4e9e-489a-8e11-4135be5a49d6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:23.884113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-faa0208e-4e9e-489a-8e11-4135be5a49d6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:23.909377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-faa0208e-4e9e-489a-8e11-4135be5a49d6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:23.910619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-faa0208e-4e9e-489a-8e11-4135be5a49d6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:23.911895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-faa0208e-4e9e-489a-8e11-4135be5a49d6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:23.915496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-faa0208e-4e9e-489a-8e11-4135be5a49d6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:23.916044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-faa0208e-4e9e-489a-8e11-4135be5a49d6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:23.916523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-faa0208e-4e9e-489a-8e11-4135be5a49d6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:23.990905 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-faa0208e-4e9e-489a-8e11-4135be5a49d6 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116427 Oct 29 01:25:23.991523 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2560/4917] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:25:23 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:25:24.096028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6fc689c6-8a21-4405-adbb-8da333781693 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:24.107286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-a300dc08-6eaf-4f08-bb04-57edff44bfe2 req-473c852f-e4d7-46ea-bd15-b91e9ef93f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "name": "network-vif-unplugged", "status": "completed", "tag": "46be779f-3615-4867-b33c-2aacb76c8f8d"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:24.112162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6fc689c6-8a21-4405-adbb-8da333781693 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:24.147932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6fc689c6-8a21-4405-adbb-8da333781693 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:24.148279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6fc689c6-8a21-4405-adbb-8da333781693 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:24.157943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6fc689c6-8a21-4405-adbb-8da333781693 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:24.158472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a300dc08-6eaf-4f08-bb04-57edff44bfe2 req-473c852f-e4d7-46ea-bd15-b91e9ef93f91 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:24.163085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6fc689c6-8a21-4405-adbb-8da333781693 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:24.169614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a300dc08-6eaf-4f08-bb04-57edff44bfe2 req-473c852f-e4d7-46ea-bd15-b91e9ef93f91 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:24.169614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a300dc08-6eaf-4f08-bb04-57edff44bfe2 req-473c852f-e4d7-46ea-bd15-b91e9ef93f91 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:24.169899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6fc689c6-8a21-4405-adbb-8da333781693 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:24.169899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6fc689c6-8a21-4405-adbb-8da333781693 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:24.210704 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-a300dc08-6eaf-4f08-bb04-57edff44bfe2 req-473c852f-e4d7-46ea-bd15-b91e9ef93f91 service nova] Creating event network-vif-unplugged:46be779f-3615-4867-b33c-2aacb76c8f8d for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:25:24.252017 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-a300dc08-6eaf-4f08-bb04-57edff44bfe2 req-473c852f-e4d7-46ea-bd15-b91e9ef93f91 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122573 Oct 29 01:25:24.254241 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2561/4918] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:25:24.262563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6fc689c6-8a21-4405-adbb-8da333781693 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:25:24.399680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a497c512-2dcb-4d7f-bc8c-eb7ca39fcc0b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:24.401094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a497c512-2dcb-4d7f-bc8c-eb7ca39fcc0b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:24.411041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a497c512-2dcb-4d7f-bc8c-eb7ca39fcc0b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:24.412895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a497c512-2dcb-4d7f-bc8c-eb7ca39fcc0b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:24.412895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a497c512-2dcb-4d7f-bc8c-eb7ca39fcc0b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:24.413297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a497c512-2dcb-4d7f-bc8c-eb7ca39fcc0b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:24.414113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a497c512-2dcb-4d7f-bc8c-eb7ca39fcc0b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:24.414773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a497c512-2dcb-4d7f-bc8c-eb7ca39fcc0b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:24.687935 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6fc689c6-8a21-4405-adbb-8da333781693 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 204 len: 0 microversion: 2.1 time: 0.591750 Oct 29 01:25:24.690129 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2358/4919] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:25:24 2022] DELETE /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:25:24.724211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ece06d04-d271-4211-bb09-0986d389df96 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:24.726686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ece06d04-d271-4211-bb09-0986d389df96 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:24.758024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ece06d04-d271-4211-bb09-0986d389df96 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:24.759936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ece06d04-d271-4211-bb09-0986d389df96 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:24.763375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ece06d04-d271-4211-bb09-0986d389df96 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:24.768357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ece06d04-d271-4211-bb09-0986d389df96 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:24.768357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ece06d04-d271-4211-bb09-0986d389df96 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:24.768357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ece06d04-d271-4211-bb09-0986d389df96 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:25.399710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a497c512-2dcb-4d7f-bc8c-eb7ca39fcc0b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:25.410146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ece06d04-d271-4211-bb09-0986d389df96 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:25.423961 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ece06d04-d271-4211-bb09-0986d389df96 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 200 len: 1323 microversion: 2.1 time: 0.728032 Oct 29 01:25:25.430552 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2359/4920] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:24 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 1323 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:25.441357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a497c512-2dcb-4d7f-bc8c-eb7ca39fcc0b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:25.441642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a497c512-2dcb-4d7f-bc8c-eb7ca39fcc0b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:25.448005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cc0e018a-c07b-49b5-a122-c30d5f0659d0 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9717e4c0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:25.449734 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a497c512-2dcb-4d7f-bc8c-eb7ca39fcc0b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 2546 microversion: 2.32 time: 1.055388 Oct 29 01:25:25.453464 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2562/4921] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:24 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 2546 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:25:25.482911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-18aef4eb-a4f4-4102-a69c-afe6131fdbce tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:25.483977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-18aef4eb-a4f4-4102-a69c-afe6131fdbce tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:25.508552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18aef4eb-a4f4-4102-a69c-afe6131fdbce tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:25.524634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18aef4eb-a4f4-4102-a69c-afe6131fdbce tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:25.525852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18aef4eb-a4f4-4102-a69c-afe6131fdbce tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:25.526798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18aef4eb-a4f4-4102-a69c-afe6131fdbce tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:25.527289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18aef4eb-a4f4-4102-a69c-afe6131fdbce tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:25.542506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18aef4eb-a4f4-4102-a69c-afe6131fdbce tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:25.577851 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cc0e018a-c07b-49b5-a122-c30d5f0659d0 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.145888 Oct 29 01:25:25.578995 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2360/4922] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:25 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:25.599482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-db727ec1-5752-44fb-8431-f94f2c34e474 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:25.602549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-db727ec1-5752-44fb-8431-f94f2c34e474 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:25.631596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db727ec1-5752-44fb-8431-f94f2c34e474 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:25.633008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db727ec1-5752-44fb-8431-f94f2c34e474 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:25.636213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db727ec1-5752-44fb-8431-f94f2c34e474 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:25.638397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db727ec1-5752-44fb-8431-f94f2c34e474 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:25.643406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db727ec1-5752-44fb-8431-f94f2c34e474 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:25.644135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db727ec1-5752-44fb-8431-f94f2c34e474 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:25.737995 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-db727ec1-5752-44fb-8431-f94f2c34e474 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/ips" status: 200 len: 150 microversion: 2.1 time: 0.156733 Oct 29 01:25:25.756137 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2361/4923] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 29 01:25:25 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/ips => generated 150 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:25.786704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-28d1b003-7a26-4686-99c9-eebf42713470 req-c29bde2b-ca87-4014-872b-a389676420b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "name": "network-vif-deleted", "tag": "b1d81c50-121c-4e21-adfd-a87f547012cc"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:25.835060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-28d1b003-7a26-4686-99c9-eebf42713470 req-c29bde2b-ca87-4014-872b-a389676420b6 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:25.845818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-28d1b003-7a26-4686-99c9-eebf42713470 req-c29bde2b-ca87-4014-872b-a389676420b6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:25.846612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-28d1b003-7a26-4686-99c9-eebf42713470 req-c29bde2b-ca87-4014-872b-a389676420b6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:25.912642 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-28d1b003-7a26-4686-99c9-eebf42713470 req-c29bde2b-ca87-4014-872b-a389676420b6 service nova] Creating event network-vif-deleted:b1d81c50-121c-4e21-adfd-a87f547012cc for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:25:25.950914 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-28d1b003-7a26-4686-99c9-eebf42713470 req-c29bde2b-ca87-4014-872b-a389676420b6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191489 Oct 29 01:25:25.972631 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2362/4924] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:26.033874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-18aef4eb-a4f4-4102-a69c-afe6131fdbce tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:26.050647 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-18aef4eb-a4f4-4102-a69c-afe6131fdbce tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 200 len: 1671 microversion: 2.1 time: 0.593061 Oct 29 01:25:26.065362 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2563/4925] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:25 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 1671 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:26.460836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2345d433-e7ed-4f24-921a-8a566debbbf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:26.461687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2345d433-e7ed-4f24-921a-8a566debbbf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:26.482036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-61f5d0b3-aeb0-4473-9654-d1ea92851267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:26.482651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-61f5d0b3-aeb0-4473-9654-d1ea92851267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:26.503505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61f5d0b3-aeb0-4473-9654-d1ea92851267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:26.505683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2345d433-e7ed-4f24-921a-8a566debbbf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:26.506408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61f5d0b3-aeb0-4473-9654-d1ea92851267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:26.507026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61f5d0b3-aeb0-4473-9654-d1ea92851267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:26.508482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2345d433-e7ed-4f24-921a-8a566debbbf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:26.508903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61f5d0b3-aeb0-4473-9654-d1ea92851267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:26.519887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61f5d0b3-aeb0-4473-9654-d1ea92851267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:26.520757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2345d433-e7ed-4f24-921a-8a566debbbf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:26.521730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2345d433-e7ed-4f24-921a-8a566debbbf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:26.522344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61f5d0b3-aeb0-4473-9654-d1ea92851267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:26.535612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2345d433-e7ed-4f24-921a-8a566debbbf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:26.536406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2345d433-e7ed-4f24-921a-8a566debbbf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:27.580181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2345d433-e7ed-4f24-921a-8a566debbbf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:27.594593 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2345d433-e7ed-4f24-921a-8a566debbbf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 200 len: 1323 microversion: 2.1 time: 1.142166 Oct 29 01:25:27.604459 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2363/4926] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:26 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 1323 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:27.612248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6f73386e-e2d7-4ba9-88de-eb43a5f31620 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9fe3eee0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:27.735624 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6f73386e-e2d7-4ba9-88de-eb43a5f31620 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.129635 Oct 29 01:25:27.745547 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2364/4927] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:27 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:27.757504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-9ffa3056-edae-401e-b85b-d3bb1ef31cd1 req-1eed6b66-0502-4265-a097-7951ee28dd24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d81519da-d650-41a7-a009-4bcfb4e94d92", "name": "network-vif-plugged", "status": "completed", "tag": "ce177e8d-5249-49d2-a188-951d6561d827"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:27.786904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9ffa3056-edae-401e-b85b-d3bb1ef31cd1 req-1eed6b66-0502-4265-a097-7951ee28dd24 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:27.787707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9ffa3056-edae-401e-b85b-d3bb1ef31cd1 req-1eed6b66-0502-4265-a097-7951ee28dd24 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:27.788336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9ffa3056-edae-401e-b85b-d3bb1ef31cd1 req-1eed6b66-0502-4265-a097-7951ee28dd24 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:27.807478 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-9ffa3056-edae-401e-b85b-d3bb1ef31cd1 req-1eed6b66-0502-4265-a097-7951ee28dd24 service nova] Creating event network-vif-plugged:ce177e8d-5249-49d2-a188-951d6561d827 for instance d81519da-d650-41a7-a009-4bcfb4e94d92 on n-h1-862964-3 Oct 29 01:25:27.822617 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-9ffa3056-edae-401e-b85b-d3bb1ef31cd1 req-1eed6b66-0502-4265-a097-7951ee28dd24 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075643 Oct 29 01:25:27.823230 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2365/4928] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:27.844150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-44cb6985-4dae-46f0-ba48-c40e34123998 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:27.845427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-44cb6985-4dae-46f0-ba48-c40e34123998 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:27.862598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44cb6985-4dae-46f0-ba48-c40e34123998 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:27.863390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44cb6985-4dae-46f0-ba48-c40e34123998 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:27.864512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44cb6985-4dae-46f0-ba48-c40e34123998 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:27.864642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44cb6985-4dae-46f0-ba48-c40e34123998 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:27.867275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44cb6985-4dae-46f0-ba48-c40e34123998 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:27.870038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44cb6985-4dae-46f0-ba48-c40e34123998 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:27.874849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-61f5d0b3-aeb0-4473-9654-d1ea92851267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:27.882489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:25:27.929218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-61f5d0b3-aeb0-4473-9654-d1ea92851267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:27.933370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-61f5d0b3-aeb0-4473-9654-d1ea92851267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:27.949661 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-61f5d0b3-aeb0-4473-9654-d1ea92851267 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 2260 microversion: 2.32 time: 1.468935 Oct 29 01:25:27.954939 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2564/4929] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:26 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 2260 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:28.262624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-18baa1ce-fd17-4971-929c-2e0bd95380c5 req-336c8a0e-61e0-4922-aae8-40acaf815d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "name": "network-vif-deleted", "tag": "4ebf9678-ed9a-4016-bd19-cc21fccd57ef"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:28.282877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-18baa1ce-fd17-4971-929c-2e0bd95380c5 req-336c8a0e-61e0-4922-aae8-40acaf815d43 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:28.283670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-18baa1ce-fd17-4971-929c-2e0bd95380c5 req-336c8a0e-61e0-4922-aae8-40acaf815d43 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:28.284375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-18baa1ce-fd17-4971-929c-2e0bd95380c5 req-336c8a0e-61e0-4922-aae8-40acaf815d43 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:28.312450 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-18baa1ce-fd17-4971-929c-2e0bd95380c5 req-336c8a0e-61e0-4922-aae8-40acaf815d43 service nova] Creating event network-vif-deleted:4ebf9678-ed9a-4016-bd19-cc21fccd57ef for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:25:28.321473 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-18baa1ce-fd17-4971-929c-2e0bd95380c5 req-336c8a0e-61e0-4922-aae8-40acaf815d43 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062622 Oct 29 01:25:28.322777 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2565/4930] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:25:28.430903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-44cb6985-4dae-46f0-ba48-c40e34123998 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:28.443572 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-44cb6985-4dae-46f0-ba48-c40e34123998 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 200 len: 1671 microversion: 2.1 time: 0.610362 Oct 29 01:25:28.461825 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2366/4931] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:27 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 1671 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:28.620817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c2926314-4f04-43d8-b530-33c8bca379a5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:28.621576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c2926314-4f04-43d8-b530-33c8bca379a5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:28.628756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2926314-4f04-43d8-b530-33c8bca379a5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:28.629435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2926314-4f04-43d8-b530-33c8bca379a5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:28.629880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2926314-4f04-43d8-b530-33c8bca379a5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:28.630592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2926314-4f04-43d8-b530-33c8bca379a5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:28.631049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2926314-4f04-43d8-b530-33c8bca379a5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:28.631474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2926314-4f04-43d8-b530-33c8bca379a5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:28.759190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-add1c028-a8bd-43fc-a69d-4e4e5af56b7b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9c1c0700>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:28.841823 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-add1c028-a8bd-43fc-a69d-4e4e5af56b7b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.094061 Oct 29 01:25:28.842590 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2367/4932] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:28 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:28.984932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-52647e51-710b-4ee8-b3d8-443dfc1f8270 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:28.986038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-52647e51-710b-4ee8-b3d8-443dfc1f8270 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:28.999027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52647e51-710b-4ee8-b3d8-443dfc1f8270 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:29.000625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52647e51-710b-4ee8-b3d8-443dfc1f8270 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:29.002641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52647e51-710b-4ee8-b3d8-443dfc1f8270 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:29.003553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52647e51-710b-4ee8-b3d8-443dfc1f8270 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:29.006273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52647e51-710b-4ee8-b3d8-443dfc1f8270 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:29.007056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52647e51-710b-4ee8-b3d8-443dfc1f8270 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:29.037660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c2926314-4f04-43d8-b530-33c8bca379a5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:29.053817 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c2926314-4f04-43d8-b530-33c8bca379a5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 200 len: 1323 microversion: 2.1 time: 0.436598 Oct 29 01:25:29.077318 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2566/4933] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:28 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 1323 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:29.247112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-52647e51-710b-4ee8-b3d8-443dfc1f8270 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:29.272408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-52647e51-710b-4ee8-b3d8-443dfc1f8270 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:29.290330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-52647e51-710b-4ee8-b3d8-443dfc1f8270 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:29.290330 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-52647e51-710b-4ee8-b3d8-443dfc1f8270 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1988 microversion: 2.32 time: 0.295964 Oct 29 01:25:29.290330 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2368/4934] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:28 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1988 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:25:29.437480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5275c4be-30d4-4948-8a6a-a5eccc1b82b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80a5c14b-d20c-4cab-8221-5997c5a733b3"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:29.440257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5275c4be-30d4-4948-8a6a-a5eccc1b82b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:29.472588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1ec00e88-6643-4722-acfd-137de13c7c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:29.473739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1ec00e88-6643-4722-acfd-137de13c7c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:29.478390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5275c4be-30d4-4948-8a6a-a5eccc1b82b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:29.479074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5275c4be-30d4-4948-8a6a-a5eccc1b82b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:29.486275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5275c4be-30d4-4948-8a6a-a5eccc1b82b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:29.488242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ec00e88-6643-4722-acfd-137de13c7c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:29.488956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ec00e88-6643-4722-acfd-137de13c7c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:29.489706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ec00e88-6643-4722-acfd-137de13c7c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:29.491328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5275c4be-30d4-4948-8a6a-a5eccc1b82b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:29.492051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ec00e88-6643-4722-acfd-137de13c7c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:29.493852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ec00e88-6643-4722-acfd-137de13c7c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:29.494813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ec00e88-6643-4722-acfd-137de13c7c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:29.497540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5275c4be-30d4-4948-8a6a-a5eccc1b82b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:29.498089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5275c4be-30d4-4948-8a6a-a5eccc1b82b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:29.952627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1ec00e88-6643-4722-acfd-137de13c7c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:29.970821 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1ec00e88-6643-4722-acfd-137de13c7c56 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 200 len: 1604 microversion: 2.1 time: 0.496563 Oct 29 01:25:29.972253 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2369/4935] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:29 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 1604 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:29.978814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2ad0cd3f-e998-4833-88a7-5ae864d2cb61 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97219040>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:30.050335 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2ad0cd3f-e998-4833-88a7-5ae864d2cb61 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.076133 Oct 29 01:25:30.051488 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2370/4936] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:29 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:30.074157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-bc7ad23a-4ca2-4312-9817-01528370cae0 req-b4feea23-330d-4d11-8fde-d348e0216b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2172c139-992f-4b5d-97b3-f2e549f6fe29", "name": "network-vif-deleted", "tag": "7de63336-a99f-4d68-b447-f1e9fada4204"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:30.092060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-bc7ad23a-4ca2-4312-9817-01528370cae0 req-b4feea23-330d-4d11-8fde-d348e0216b3e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:30.098026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-bc7ad23a-4ca2-4312-9817-01528370cae0 req-b4feea23-330d-4d11-8fde-d348e0216b3e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:30.099827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-bc7ad23a-4ca2-4312-9817-01528370cae0 req-b4feea23-330d-4d11-8fde-d348e0216b3e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:30.130996 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-bc7ad23a-4ca2-4312-9817-01528370cae0 req-b4feea23-330d-4d11-8fde-d348e0216b3e service nova] Creating event network-vif-deleted:7de63336-a99f-4d68-b447-f1e9fada4204 for instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 on n-h1-862964-3 Oct 29 01:25:30.137434 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-bc7ad23a-4ca2-4312-9817-01528370cae0 req-b4feea23-330d-4d11-8fde-d348e0216b3e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072541 Oct 29 01:25:30.138337 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2371/4937] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:30.155250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e12811f-3578-4c0e-a459-36c3586ab390 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:30.156217 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7e12811f-3578-4c0e-a459-36c3586ab390 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:30.168383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e12811f-3578-4c0e-a459-36c3586ab390 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:30.177020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e12811f-3578-4c0e-a459-36c3586ab390 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:30.178302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e12811f-3578-4c0e-a459-36c3586ab390 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:30.179306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e12811f-3578-4c0e-a459-36c3586ab390 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:30.180032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e12811f-3578-4c0e-a459-36c3586ab390 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:30.180729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e12811f-3578-4c0e-a459-36c3586ab390 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:30.389938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7e12811f-3578-4c0e-a459-36c3586ab390 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:30.401788 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e12811f-3578-4c0e-a459-36c3586ab390 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 200 len: 1518 microversion: 2.1 time: 0.254197 Oct 29 01:25:30.416243 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2372/4938] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:30 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 1518 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:30.427955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a74c1cb1-0e88-42be-8518-b8466c6b0d42 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:30.429095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a74c1cb1-0e88-42be-8518-b8466c6b0d42 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:30.447387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a74c1cb1-0e88-42be-8518-b8466c6b0d42 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:30.449007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a74c1cb1-0e88-42be-8518-b8466c6b0d42 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:30.449556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a74c1cb1-0e88-42be-8518-b8466c6b0d42 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:30.451551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a74c1cb1-0e88-42be-8518-b8466c6b0d42 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:30.452318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a74c1cb1-0e88-42be-8518-b8466c6b0d42 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:30.454238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a74c1cb1-0e88-42be-8518-b8466c6b0d42 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:30.628261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a74c1cb1-0e88-42be-8518-b8466c6b0d42 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:30.651915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a74c1cb1-0e88-42be-8518-b8466c6b0d42 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:30.653452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a74c1cb1-0e88-42be-8518-b8466c6b0d42 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:30.664080 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a74c1cb1-0e88-42be-8518-b8466c6b0d42 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.245733 Oct 29 01:25:30.664942 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2373/4939] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:30 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:30.694371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eb2575d3-0120-430e-9934-812b12a5f371 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Action: 'create', calling method: .version_select at 0x7f9d97f09430>, body: {"pool": null} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:30.863673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:25:31.072546 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5275c4be-30d4-4948-8a6a-a5eccc1b82b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "POST /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.640494 Oct 29 01:25:31.074226 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2567/4940] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 29 01:25:29 2022] POST /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-volume_attachments => generated 194 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:31.097853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-a33c62aa-2a29-4592-b54b-5434cec3d05c req-c9b72800-1a4a-40b6-abc6-2432ab28106c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9", "name": "network-vif-deleted", "tag": "46be779f-3615-4867-b33c-2aacb76c8f8d"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:31.118670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:25:31.123916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a33c62aa-2a29-4592-b54b-5434cec3d05c req-c9b72800-1a4a-40b6-abc6-2432ab28106c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:31.128847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a33c62aa-2a29-4592-b54b-5434cec3d05c req-c9b72800-1a4a-40b6-abc6-2432ab28106c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:31.129691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a33c62aa-2a29-4592-b54b-5434cec3d05c req-c9b72800-1a4a-40b6-abc6-2432ab28106c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:31.164536 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-a33c62aa-2a29-4592-b54b-5434cec3d05c req-c9b72800-1a4a-40b6-abc6-2432ab28106c service nova] Creating event network-vif-deleted:46be779f-3615-4867-b33c-2aacb76c8f8d for instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 on n-h2-862964-3 Oct 29 01:25:31.184598 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-a33c62aa-2a29-4592-b54b-5434cec3d05c req-c9b72800-1a4a-40b6-abc6-2432ab28106c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105924 Oct 29 01:25:31.189451 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2568/4941] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:31.214854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-709caded-47a0-438e-b4de-9966717a7c4c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:31.221264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-709caded-47a0-438e-b4de-9966717a7c4c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:31.232725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-709caded-47a0-438e-b4de-9966717a7c4c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:31.234861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-709caded-47a0-438e-b4de-9966717a7c4c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:31.235557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-709caded-47a0-438e-b4de-9966717a7c4c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:31.250534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-709caded-47a0-438e-b4de-9966717a7c4c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:31.251542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-709caded-47a0-438e-b4de-9966717a7c4c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:31.252208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-709caded-47a0-438e-b4de-9966717a7c4c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:31.305900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-709caded-47a0-438e-b4de-9966717a7c4c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:31.306764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-709caded-47a0-438e-b4de-9966717a7c4c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:31.307474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-709caded-47a0-438e-b4de-9966717a7c4c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:31.308148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-709caded-47a0-438e-b4de-9966717a7c4c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lazy-loading 'fault' on Instance uuid 2172c139-992f-4b5d-97b3-f2e549f6fe29 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:25:31.455041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-709caded-47a0-438e-b4de-9966717a7c4c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d922c9f49ff4e87b7b1ca2e10766c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45b8f0077804db29ad5864327aa6bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:31.466987 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-709caded-47a0-438e-b4de-9966717a7c4c tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 200 len: 1327 microversion: 2.1 time: 0.270914 Oct 29 01:25:31.467579 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2569/4942] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:31 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 1327 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:31.482166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4aa9bcb5-98dc-410e-80cb-6bd33392c8d5 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9770d790>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:31.582152 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4aa9bcb5-98dc-410e-80cb-6bd33392c8d5 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.106344 Oct 29 01:25:31.584494 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2570/4943] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:31 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:31.692742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-47707f9b-eb4a-40a4-974a-6e54f5abe87b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:31.693393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-47707f9b-eb4a-40a4-974a-6e54f5abe87b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:31.700657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47707f9b-eb4a-40a4-974a-6e54f5abe87b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:31.712266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47707f9b-eb4a-40a4-974a-6e54f5abe87b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:31.713452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47707f9b-eb4a-40a4-974a-6e54f5abe87b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:31.714231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47707f9b-eb4a-40a4-974a-6e54f5abe87b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:31.714712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47707f9b-eb4a-40a4-974a-6e54f5abe87b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:31.715143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47707f9b-eb4a-40a4-974a-6e54f5abe87b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:31.998121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-47707f9b-eb4a-40a4-974a-6e54f5abe87b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:32.019060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-47707f9b-eb4a-40a4-974a-6e54f5abe87b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:32.020591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-47707f9b-eb4a-40a4-974a-6e54f5abe87b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:32.021887 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-47707f9b-eb4a-40a4-974a-6e54f5abe87b tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.333541 Oct 29 01:25:32.038124 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2571/4944] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:31 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:25:32.502426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e70a7780-bed7-4126-aa59-8dfb5234f41e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:32.503466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e70a7780-bed7-4126-aa59-8dfb5234f41e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:32.531365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e70a7780-bed7-4126-aa59-8dfb5234f41e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:32.532724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e70a7780-bed7-4126-aa59-8dfb5234f41e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:32.535259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e70a7780-bed7-4126-aa59-8dfb5234f41e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:32.536626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e70a7780-bed7-4126-aa59-8dfb5234f41e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:32.539717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e70a7780-bed7-4126-aa59-8dfb5234f41e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:32.540349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e70a7780-bed7-4126-aa59-8dfb5234f41e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:32.582892 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-e70a7780-bed7-4126-aa59-8dfb5234f41e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] HTTP exception thrown: Instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 could not be found. Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e70a7780-bed7-4126-aa59-8dfb5234f41e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Request method failure captured: Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 HTTP/1.1 Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8T9cSwFdJFodh1W8ghdDQmW-pn2kyLAmJXDG7JqHwQkxp1x5-_ByQ-M0MZ8IOINzMBo75Sz9HUttVi23Drj0OxToLqamj3b5WVLkWAdoa9pgDpa8xhbIm5zRvocGwXrBeVCRAZ4KTonRKxYXOK3B23izcAyBa6r1a6xlpcK4m2cXc Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: d45b8f0077804db29ad5864327aa6bbb Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeTestJSON-1597110018 Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d45b8f0077804db29ad5864327aa6bbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d45b8f0077804db29ad5864327aa6bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d45b8f0077804db29ad5864327aa6bbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d45b8f0077804db29ad5864327aa6bbb", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeTestJSON-1597110018 Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: d45b8f0077804db29ad5864327aa6bbb Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1597110018 Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AttachVolumeTestJSON-1597110018-project Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 7d922c9f49ff4e87b7b1ca2e10766c53 Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeTestJSON-1597110018-project Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 could not be found. Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '2172c139-992f-4b5d-97b3-f2e549f6fe29'} Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 could not be found. Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 could not be found. Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:25:32.588141 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:25:32.598795 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:25:32.598795 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:25:32.598795 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:25:32.598795 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:25:32.598795 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:25:32.598795 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 could not be found. Oct 29 01:25:32.598795 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:25:32.598795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e70a7780-bed7-4126-aa59-8dfb5234f41e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Returning 404 to user: Instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:25:32.598795 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e70a7780-bed7-4126-aa59-8dfb5234f41e tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 404 len: 111 microversion: 2.1 time: 0.092504 Oct 29 01:25:32.601801 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2572/4945] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:32 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:25:32.621369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-32a9f5e9-8f5b-48a4-9aa7-5888a9ea5fda tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d977ff940>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:32.740618 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-32a9f5e9-8f5b-48a4-9aa7-5888a9ea5fda tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.135342 Oct 29 01:25:32.744730 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2573/4946] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:32 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:32.766938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-63981bbe-43dc-49b6-9acd-d9b59e5415d8 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '.version_select at 0x7f9d96feaca0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:32.782354 n-d-862964-3 devstack@n-api.service[121099]: ERROR oslo.messaging._drivers.impl_rabbit [None req-63981bbe-43dc-49b6-9acd-d9b59e5415d8 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [822279e9-4bb3-484d-b4bf-99c85f50bd8e] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 01:25:33.791640 n-d-862964-3 devstack@n-api.service[121099]: INFO oslo.messaging._drivers.impl_rabbit [None req-63981bbe-43dc-49b6-9acd-d9b59e5415d8 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [822279e9-4bb3-484d-b4bf-99c85f50bd8e] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 35692. Oct 29 01:25:33.906152 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-63981bbe-43dc-49b6-9acd-d9b59e5415d8 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176073554" status: 202 len: 0 microversion: 2.1 time: 1.150286 Oct 29 01:25:33.912531 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2574/4947] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 29 01:25:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176073554 => generated 0 bytes in 1167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:25:33.919628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a86dcb7f-a65a-462b-adca-44f83420401a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:33.920543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a86dcb7f-a65a-462b-adca-44f83420401a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:33.938608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a86dcb7f-a65a-462b-adca-44f83420401a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:33.939430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a86dcb7f-a65a-462b-adca-44f83420401a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:33.941723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a86dcb7f-a65a-462b-adca-44f83420401a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:33.943413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a86dcb7f-a65a-462b-adca-44f83420401a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:33.944527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a86dcb7f-a65a-462b-adca-44f83420401a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:33.945705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a86dcb7f-a65a-462b-adca-44f83420401a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:34.157441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a86dcb7f-a65a-462b-adca-44f83420401a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:34.182505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a86dcb7f-a65a-462b-adca-44f83420401a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:34.184307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a86dcb7f-a65a-462b-adca-44f83420401a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:34.194469 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a86dcb7f-a65a-462b-adca-44f83420401a tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.271934 Oct 29 01:25:34.195157 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2575/4948] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:33 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:34.237733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6a26890b-290e-47e8-b20b-3faae1c58ede tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9778cb80>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:34.319910 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6a26890b-290e-47e8-b20b-3faae1c58ede tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.100662 Oct 29 01:25:34.321631 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2576/4949] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:34 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:35.225708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a298dc33-fba6-4207-b8c8-96f9f940968e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:35.226689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a298dc33-fba6-4207-b8c8-96f9f940968e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:35.253053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a298dc33-fba6-4207-b8c8-96f9f940968e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:35.253516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a298dc33-fba6-4207-b8c8-96f9f940968e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:35.260690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a298dc33-fba6-4207-b8c8-96f9f940968e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:35.263040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a298dc33-fba6-4207-b8c8-96f9f940968e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:35.267864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a298dc33-fba6-4207-b8c8-96f9f940968e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:35.268329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a298dc33-fba6-4207-b8c8-96f9f940968e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:35.663648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a298dc33-fba6-4207-b8c8-96f9f940968e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:35.677518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a298dc33-fba6-4207-b8c8-96f9f940968e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:35.679225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a298dc33-fba6-4207-b8c8-96f9f940968e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:35.680701 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a298dc33-fba6-4207-b8c8-96f9f940968e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.459400 Oct 29 01:25:35.681925 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2577/4950] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:35 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:35.686796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2090c7f1-f774-424f-a6af-be1a1e244cd7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97c40820>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:35.762885 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2090c7f1-f774-424f-a6af-be1a1e244cd7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.079562 Oct 29 01:25:35.763606 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2578/4951] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:35 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:36.306800 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-eb2575d3-0120-430e-9934-812b12a5f371 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.627415 Oct 29 01:25:36.306800 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2374/4952] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 29 01:25:30 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:36.545747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4ebfe045-f6e6-444b-bfea-bc4255e92212 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-616811435", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "bf44a312-d8d4-4636-8ed4-e759797fbb2e"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:36.643599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-4ebfe045-f6e6-444b-bfea-bc4255e92212 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] validate_networks() for [('bf44a312-d8d4-4636-8ed4-e759797fbb2e', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:25:36.712962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f17653ac-5e1a-4daf-8ff0-2e85eb26607f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:36.713601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f17653ac-5e1a-4daf-8ff0-2e85eb26607f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:36.723089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f17653ac-5e1a-4daf-8ff0-2e85eb26607f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:36.723605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f17653ac-5e1a-4daf-8ff0-2e85eb26607f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:36.724039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f17653ac-5e1a-4daf-8ff0-2e85eb26607f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:36.724767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f17653ac-5e1a-4daf-8ff0-2e85eb26607f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:36.725282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f17653ac-5e1a-4daf-8ff0-2e85eb26607f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:36.725961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f17653ac-5e1a-4daf-8ff0-2e85eb26607f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:36.839806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f17653ac-5e1a-4daf-8ff0-2e85eb26607f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:36.850391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f17653ac-5e1a-4daf-8ff0-2e85eb26607f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:36.852143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f17653ac-5e1a-4daf-8ff0-2e85eb26607f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:36.853184 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f17653ac-5e1a-4daf-8ff0-2e85eb26607f tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.145017 Oct 29 01:25:36.865188 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2375/4953] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:36 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:36.865188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-86358079-210a-4bb9-a470-6ac9ff83e023 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9fd2fca0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:36.920614 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-86358079-210a-4bb9-a470-6ac9ff83e023 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.065767 Oct 29 01:25:36.921221 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2376/4954] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:36 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:37.235957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-4ebfe045-f6e6-444b-bfea-bc4255e92212 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:25:37.236690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-4ebfe045-f6e6-444b-bfea-bc4255e92212 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:25:37.237421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-4ebfe045-f6e6-444b-bfea-bc4255e92212 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:25:37.238075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-4ebfe045-f6e6-444b-bfea-bc4255e92212 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:25:37.238751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-4ebfe045-f6e6-444b-bfea-bc4255e92212 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:25:37.252140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ebfe045-f6e6-444b-bfea-bc4255e92212 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:37.252887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ebfe045-f6e6-444b-bfea-bc4255e92212 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:37.253665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ebfe045-f6e6-444b-bfea-bc4255e92212 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:37.254582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ebfe045-f6e6-444b-bfea-bc4255e92212 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:37.255372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ebfe045-f6e6-444b-bfea-bc4255e92212 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:37.255966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ebfe045-f6e6-444b-bfea-bc4255e92212 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:37.282559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-4ebfe045-f6e6-444b-bfea-bc4255e92212 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Getting quotas for project 0dd5d9ef52524461a5ea497010bd3dc0. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:25:37.289212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-4ebfe045-f6e6-444b-bfea-bc4255e92212 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Getting quotas for user b7d6b090698b4ac29481af8eb9fa6b3c and project 0dd5d9ef52524461a5ea497010bd3dc0. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:25:37.306974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4ebfe045-f6e6-444b-bfea-bc4255e92212 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:25:37.323475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4ebfe045-f6e6-444b-bfea-bc4255e92212 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:25:37.565593 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4ebfe045-f6e6-444b-bfea-bc4255e92212 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.027074 Oct 29 01:25:37.571451 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2579/4955] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:25:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:25:37.585951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1d2212b5-4222-48f5-8376-be130e163c7f tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:37.590757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1d2212b5-4222-48f5-8376-be130e163c7f tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:37.686151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1d2212b5-4222-48f5-8376-be130e163c7f tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:37.698313 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1d2212b5-4222-48f5-8376-be130e163c7f tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed" status: 200 len: 1223 microversion: 2.1 time: 0.118978 Oct 29 01:25:37.704683 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2377/4956] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:37 2022] GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed => generated 1223 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:37.891572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-314100a2-217e-4805-90bc-1b68e3748ddc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:37.892396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-314100a2-217e-4805-90bc-1b68e3748ddc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:37.915391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-314100a2-217e-4805-90bc-1b68e3748ddc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:37.922602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-314100a2-217e-4805-90bc-1b68e3748ddc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:37.923237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-314100a2-217e-4805-90bc-1b68e3748ddc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:37.940725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-38e9172b-335f-4279-b843-7666e8914e8b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9717a700>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:37.940833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-314100a2-217e-4805-90bc-1b68e3748ddc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:37.940833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-314100a2-217e-4805-90bc-1b68e3748ddc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:37.941272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-314100a2-217e-4805-90bc-1b68e3748ddc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:38.017220 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-38e9172b-335f-4279-b843-7666e8914e8b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.084003 Oct 29 01:25:38.018376 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2378/4957] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:37 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:38.169231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-314100a2-217e-4805-90bc-1b68e3748ddc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:38.191511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-314100a2-217e-4805-90bc-1b68e3748ddc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:38.199463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-314100a2-217e-4805-90bc-1b68e3748ddc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:38.200811 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-314100a2-217e-4805-90bc-1b68e3748ddc tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.314725 Oct 29 01:25:38.208110 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2580/4958] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:37 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:38.734905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-088dee86-2419-47d7-94b6-8980a3ea2bb1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:38.735627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-088dee86-2419-47d7-94b6-8980a3ea2bb1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:38.800473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-088dee86-2419-47d7-94b6-8980a3ea2bb1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:38.807920 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-088dee86-2419-47d7-94b6-8980a3ea2bb1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed" status: 200 len: 1223 microversion: 2.1 time: 0.078132 Oct 29 01:25:38.808515 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2379/4959] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:38 2022] GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed => generated 1223 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:39.039045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aed11e62-8223-4f7a-bb0b-0d0b742315c6 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9c761940>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:39.105000 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aed11e62-8223-4f7a-bb0b-0d0b742315c6 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1454 microversion: 2.1 time: 0.075083 Oct 29 01:25:39.106148 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2581/4960] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:39 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:39.236004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-567b81fb-72a1-4f34-9e2b-098976620d04 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:39.236547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-567b81fb-72a1-4f34-9e2b-098976620d04 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:39.243911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-567b81fb-72a1-4f34-9e2b-098976620d04 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:39.244371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-567b81fb-72a1-4f34-9e2b-098976620d04 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:39.244805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-567b81fb-72a1-4f34-9e2b-098976620d04 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:39.245529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-567b81fb-72a1-4f34-9e2b-098976620d04 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:39.245981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-567b81fb-72a1-4f34-9e2b-098976620d04 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:39.246405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-567b81fb-72a1-4f34-9e2b-098976620d04 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:39.328794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-567b81fb-72a1-4f34-9e2b-098976620d04 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:39.338868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-567b81fb-72a1-4f34-9e2b-098976620d04 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:39.340587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-567b81fb-72a1-4f34-9e2b-098976620d04 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:39.341816 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-567b81fb-72a1-4f34-9e2b-098976620d04 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.109993 Oct 29 01:25:39.349769 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2380/4961] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:39 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:39.841075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-03aaa5b9-255a-4b7f-af7a-6bd4f1e6625b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:39.841075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-03aaa5b9-255a-4b7f-af7a-6bd4f1e6625b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:39.848484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03aaa5b9-255a-4b7f-af7a-6bd4f1e6625b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:39.848997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03aaa5b9-255a-4b7f-af7a-6bd4f1e6625b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:39.849459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03aaa5b9-255a-4b7f-af7a-6bd4f1e6625b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:39.862329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03aaa5b9-255a-4b7f-af7a-6bd4f1e6625b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:39.862844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03aaa5b9-255a-4b7f-af7a-6bd4f1e6625b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:39.863294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-03aaa5b9-255a-4b7f-af7a-6bd4f1e6625b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:39.980842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-03aaa5b9-255a-4b7f-af7a-6bd4f1e6625b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:39.993256 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-03aaa5b9-255a-4b7f-af7a-6bd4f1e6625b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed" status: 200 len: 1275 microversion: 2.1 time: 0.159164 Oct 29 01:25:39.997324 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2582/4962] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:39 2022] GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:40.122946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-866e1297-ebf6-43b1-8e8f-74799b24e2a0 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d970d8700>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:40.179452 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-866e1297-ebf6-43b1-8e8f-74799b24e2a0 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1463 microversion: 2.1 time: 0.061249 Oct 29 01:25:40.180328 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2381/4963] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:40 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1463 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:40.194774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-679342b2-a125-47bc-868b-6dfa59a22b60 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9c761940>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:40.249025 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-679342b2-a125-47bc-868b-6dfa59a22b60 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 200 len: 1463 microversion: 2.1 time: 0.058022 Oct 29 01:25:40.251097 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2583/4964] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:40 2022] GET /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 1463 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:40.270709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-48d6d5fb-233f-4869-bf3c-242985b36c26 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:40.271342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-48d6d5fb-233f-4869-bf3c-242985b36c26 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 7616f1ea-1339-425c-9ab9-45431f3cd608] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:40.280382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48d6d5fb-233f-4869-bf3c-242985b36c26 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:40.280877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48d6d5fb-233f-4869-bf3c-242985b36c26 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:40.281888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48d6d5fb-233f-4869-bf3c-242985b36c26 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:40.284034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48d6d5fb-233f-4869-bf3c-242985b36c26 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:40.284705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48d6d5fb-233f-4869-bf3c-242985b36c26 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:40.287530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48d6d5fb-233f-4869-bf3c-242985b36c26 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:40.376919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-53733634-c9cd-4bdb-9b73-f1c337d1d8be tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:40.377601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-53733634-c9cd-4bdb-9b73-f1c337d1d8be tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:40.390665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53733634-c9cd-4bdb-9b73-f1c337d1d8be tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:40.391996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53733634-c9cd-4bdb-9b73-f1c337d1d8be tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:40.392726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53733634-c9cd-4bdb-9b73-f1c337d1d8be tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:40.396675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53733634-c9cd-4bdb-9b73-f1c337d1d8be tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:40.396675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53733634-c9cd-4bdb-9b73-f1c337d1d8be tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:40.396675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53733634-c9cd-4bdb-9b73-f1c337d1d8be tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:40.440153 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-48d6d5fb-233f-4869-bf3c-242985b36c26 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:40.456494 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-48d6d5fb-233f-4869-bf3c-242985b36c26 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608" status: 200 len: 1467 microversion: 2.1 time: 0.196004 Oct 29 01:25:40.458570 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2382/4965] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:40 2022] GET /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608 => generated 1467 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:40.482688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b850f164-af87-4a70-84b6-5e16dd105f43 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d970d8790>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:40.492923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-53733634-c9cd-4bdb-9b73-f1c337d1d8be tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:40.503941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-53733634-c9cd-4bdb-9b73-f1c337d1d8be tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:40.505405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-53733634-c9cd-4bdb-9b73-f1c337d1d8be tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:40.507108 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-53733634-c9cd-4bdb-9b73-f1c337d1d8be tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.135561 Oct 29 01:25:40.508353 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2584/4966] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:40 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:25:40.642181 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b850f164-af87-4a70-84b6-5e16dd105f43 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images?changes-since=2022-10-29T01%3A23%3A09Z" status: 200 len: 1899 microversion: 2.1 time: 0.163636 Oct 29 01:25:40.645457 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2383/4967] 10.222.0.26 () {58 vars in 1199 bytes} [Sat Oct 29 01:25:40 2022] GET /compute/v2.1/images?changes-since=2022-10-29T01%3A23%3A09Z => generated 1899 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:40.663332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-900a7bf8-56b1-4757-a6b6-f637bbb4fabb tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97799430>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:40.758108 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-900a7bf8-56b1-4757-a6b6-f637bbb4fabb tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1913563023" status: 200 len: 485 microversion: 2.1 time: 0.098635 Oct 29 01:25:40.779642 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2585/4968] 10.222.0.26 () {58 vars in 1231 bytes} [Sat Oct 29 01:25:40 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1913563023 => generated 485 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:40.789626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0be9b67c-d2e2-471a-9a63-2ab1ba70c8c3 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d970d8160>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:40.920173 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0be9b67c-d2e2-471a-9a63-2ab1ba70c8c3 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images?server=7616f1ea-1339-425c-9ab9-45431f3cd608" status: 200 len: 956 microversion: 2.1 time: 0.146996 Oct 29 01:25:40.921055 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2384/4969] 10.222.0.26 () {58 vars in 1209 bytes} [Sat Oct 29 01:25:40 2022] GET /compute/v2.1/images?server=7616f1ea-1339-425c-9ab9-45431f3cd608 => generated 956 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:40.936811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c4fee557-55b8-4b0c-a53c-5682b17fa2e7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97caeca0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:41.001121 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c4fee557-55b8-4b0c-a53c-5682b17fa2e7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 483 microversion: 2.1 time: 0.067697 Oct 29 01:25:41.001937 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2586/4970] 10.222.0.26 () {58 vars in 1317 bytes} [Sat Oct 29 01:25:40 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 483 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:41.014402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-55ef48dd-1276-4d81-82d8-e1a7cef41e37 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d970d83a0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:41.025450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-632d5049-1474-424f-a6dc-7417ff71cde9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:41.026296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-632d5049-1474-424f-a6dc-7417ff71cde9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:41.037530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-632d5049-1474-424f-a6dc-7417ff71cde9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:41.038193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-632d5049-1474-424f-a6dc-7417ff71cde9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:41.038876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-632d5049-1474-424f-a6dc-7417ff71cde9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:41.039584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-632d5049-1474-424f-a6dc-7417ff71cde9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:41.040041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-632d5049-1474-424f-a6dc-7417ff71cde9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:41.040473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-632d5049-1474-424f-a6dc-7417ff71cde9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:41.080837 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-55ef48dd-1276-4d81-82d8-e1a7cef41e37 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 483 microversion: 2.1 time: 0.070374 Oct 29 01:25:41.081492 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2385/4971] 10.222.0.26 () {58 vars in 1303 bytes} [Sat Oct 29 01:25:41 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 483 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:41.095109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4d83592d-05c9-4296-a10a-50762d023fc5 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9fd2fdc0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:41.146210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-632d5049-1474-424f-a6dc-7417ff71cde9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:41.167941 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-632d5049-1474-424f-a6dc-7417ff71cde9 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed" status: 200 len: 1293 microversion: 2.1 time: 0.143224 Oct 29 01:25:41.168615 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2587/4972] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:41 2022] GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed => generated 1293 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:41.265265 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4d83592d-05c9-4296-a10a-50762d023fc5 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3277 microversion: 2.1 time: 0.174658 Oct 29 01:25:41.266980 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2386/4973] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 29 01:25:41 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:41.283444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cdfdd6ec-1e05-41ff-b30f-c85c4663bc70 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96ef7e50>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:41.365209 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cdfdd6ec-1e05-41ff-b30f-c85c4663bc70 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1427 microversion: 2.1 time: 0.086835 Oct 29 01:25:41.365795 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2588/4974] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 29 01:25:41 2022] GET /compute/v2.1/images?type=snapshot => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:41.379459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-035643b1-c188-408e-9f94-5a13b5c61a5f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9717e040>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:41.476943 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-035643b1-c188-408e-9f94-5a13b5c61a5f tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.101311 Oct 29 01:25:41.478316 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2387/4975] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 29 01:25:41 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:25:41.495554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd995ed5-d857-4577-95f3-5944d5bfa3bd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97ac8790>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:41.535141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0e2dbe2c-225a-4bd8-9684-9864c2fd9433 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:41.536043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0e2dbe2c-225a-4bd8-9684-9864c2fd9433 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:41.544170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:25:41.552490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e2dbe2c-225a-4bd8-9684-9864c2fd9433 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:41.558013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e2dbe2c-225a-4bd8-9684-9864c2fd9433 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:41.558646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e2dbe2c-225a-4bd8-9684-9864c2fd9433 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:41.560444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e2dbe2c-225a-4bd8-9684-9864c2fd9433 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:41.561718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e2dbe2c-225a-4bd8-9684-9864c2fd9433 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:41.566335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e2dbe2c-225a-4bd8-9684-9864c2fd9433 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:41.702766 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bd995ed5-d857-4577-95f3-5944d5bfa3bd tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/detail?changes-since=2022-10-29T01%3A23%3A04Z" status: 200 len: 6330 microversion: 2.1 time: 0.213459 Oct 29 01:25:41.705440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0e2dbe2c-225a-4bd8-9684-9864c2fd9433 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:41.706961 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2589/4976] 10.222.0.26 () {58 vars in 1220 bytes} [Sat Oct 29 01:25:41 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-29T01%3A23%3A04Z => generated 6330 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:41.727245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4ed0c710-9b90-4e24-b97e-ec842df96976 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97778ca0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:41.731450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0e2dbe2c-225a-4bd8-9684-9864c2fd9433 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:41.735589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0e2dbe2c-225a-4bd8-9684-9864c2fd9433 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:41.735589 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0e2dbe2c-225a-4bd8-9684-9864c2fd9433 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.203678 Oct 29 01:25:41.735589 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2388/4977] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:41 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:25:41.803279 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4ed0c710-9b90-4e24-b97e-ec842df96976 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1913563023" status: 200 len: 665 microversion: 2.1 time: 0.080245 Oct 29 01:25:41.803905 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2590/4978] 10.222.0.26 () {58 vars in 1252 bytes} [Sat Oct 29 01:25:41 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1913563023 => generated 665 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:25:41.820723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f05aebe6-db7a-47a4-a2b1-730e035186b0 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d970d8a60>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:41.967034 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f05aebe6-db7a-47a4-a2b1-730e035186b0 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1465 microversion: 2.1 time: 0.149976 Oct 29 01:25:41.983689 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2389/4979] 10.222.0.26 () {58 vars in 1338 bytes} [Sat Oct 29 01:25:41 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1465 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:41.983893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4721e78d-80f1-4c90-b2ad-ff5579ab680d tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d977788b0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:42.075193 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4721e78d-80f1-4c90-b2ad-ff5579ab680d tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1465 microversion: 2.1 time: 0.092714 Oct 29 01:25:42.088078 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2591/4980] 10.222.0.26 () {58 vars in 1324 bytes} [Sat Oct 29 01:25:41 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1465 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:42.099348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4074fc1c-83e8-4e28-a383-b93f5d871dbb tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97f09af0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:42.204938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5ae96994-a9a3-424b-887f-d10bf9591880 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:42.205687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5ae96994-a9a3-424b-887f-d10bf9591880 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:42.225542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ae96994-a9a3-424b-887f-d10bf9591880 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:42.225542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ae96994-a9a3-424b-887f-d10bf9591880 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:42.225542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ae96994-a9a3-424b-887f-d10bf9591880 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:42.225542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ae96994-a9a3-424b-887f-d10bf9591880 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:42.225963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ae96994-a9a3-424b-887f-d10bf9591880 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:42.241226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5ae96994-a9a3-424b-887f-d10bf9591880 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:42.319932 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4074fc1c-83e8-4e28-a383-b93f5d871dbb tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7105 microversion: 2.1 time: 0.230747 Oct 29 01:25:42.321647 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2390/4981] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Oct 29 01:25:42 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7105 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:42.351475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8ed923df-1c89-4411-9290-3d44f988ede7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d9717a550>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:42.453638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5ae96994-a9a3-424b-887f-d10bf9591880 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:42.466786 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5ae96994-a9a3-424b-887f-d10bf9591880 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed" status: 200 len: 1323 microversion: 2.1 time: 0.275559 Oct 29 01:25:42.468361 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2592/4982] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:42 2022] GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed => generated 1323 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:42.484017 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8ed923df-1c89-4411-9290-3d44f988ede7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4373 microversion: 2.1 time: 0.136489 Oct 29 01:25:42.509894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e4ed64b4-290b-4f67-87a8-17311c12686c tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d977d63a0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:42.534764 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2391/4983] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Oct 29 01:25:42 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4373 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:42.578961 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e4ed64b4-290b-4f67-87a8-17311c12686c tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/99205ec5-992b-4d3c-9bcd-04eb4b06191a" status: 200 len: 784 microversion: 2.1 time: 0.073580 Oct 29 01:25:42.580459 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2593/4984] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 29 01:25:42 2022] GET /compute/v2.1/images/99205ec5-992b-4d3c-9bcd-04eb4b06191a => generated 784 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:25:42.598050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ef0c8717-8f7c-4dd6-8393-f2b3a9fd446e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d972194c0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:42.674731 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ef0c8717-8f7c-4dd6-8393-f2b3a9fd446e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.082642 Oct 29 01:25:42.692735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c75f2ec5-7450-41ce-9577-9aace8a3717b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97778ee0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:42.693303 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2392/4985] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 29 01:25:42 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:42.763207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-080ec4ee-79da-4ad2-8165-2270622959e9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:42.763822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-080ec4ee-79da-4ad2-8165-2270622959e9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:42.773036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-080ec4ee-79da-4ad2-8165-2270622959e9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:42.773668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-080ec4ee-79da-4ad2-8165-2270622959e9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:42.774118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-080ec4ee-79da-4ad2-8165-2270622959e9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:42.775053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-080ec4ee-79da-4ad2-8165-2270622959e9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:42.775781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-080ec4ee-79da-4ad2-8165-2270622959e9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:42.776506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-080ec4ee-79da-4ad2-8165-2270622959e9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:42.939662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-080ec4ee-79da-4ad2-8165-2270622959e9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:42.960094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-080ec4ee-79da-4ad2-8165-2270622959e9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:42.963669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-080ec4ee-79da-4ad2-8165-2270622959e9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:42.971421 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-080ec4ee-79da-4ad2-8165-2270622959e9 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.211977 Oct 29 01:25:42.972021 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2393/4986] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:42 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:43.494604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-51465f60-32e9-4f32-ba59-ffab4c1f9da6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:43.495228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-51465f60-32e9-4f32-ba59-ffab4c1f9da6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:43.514409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51465f60-32e9-4f32-ba59-ffab4c1f9da6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:43.514954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51465f60-32e9-4f32-ba59-ffab4c1f9da6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:43.515513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51465f60-32e9-4f32-ba59-ffab4c1f9da6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:43.519853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51465f60-32e9-4f32-ba59-ffab4c1f9da6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:43.520351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51465f60-32e9-4f32-ba59-ffab4c1f9da6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:43.520798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51465f60-32e9-4f32-ba59-ffab4c1f9da6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:43.733784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-51465f60-32e9-4f32-ba59-ffab4c1f9da6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:43.749459 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-51465f60-32e9-4f32-ba59-ffab4c1f9da6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed" status: 200 len: 1323 microversion: 2.1 time: 0.257205 Oct 29 01:25:43.755686 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2394/4987] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:43 2022] GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed => generated 1323 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:43.942307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-a5f3bec3-71f9-42ba-ae79-ae3a82bfbb96 req-8b5bbbf1-90a0-4f6f-82c9-2e962da981e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3928147-60bb-4304-90a7-103deb29e0ed", "tag": "1d88b97b-733a-44d8-a8a7-2f0c1fe45f26"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:43.976379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a5f3bec3-71f9-42ba-ae79-ae3a82bfbb96 req-8b5bbbf1-90a0-4f6f-82c9-2e962da981e6 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:43.976379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a5f3bec3-71f9-42ba-ae79-ae3a82bfbb96 req-8b5bbbf1-90a0-4f6f-82c9-2e962da981e6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:43.976379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a5f3bec3-71f9-42ba-ae79-ae3a82bfbb96 req-8b5bbbf1-90a0-4f6f-82c9-2e962da981e6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:43.985239 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-a5f3bec3-71f9-42ba-ae79-ae3a82bfbb96 req-8b5bbbf1-90a0-4f6f-82c9-2e962da981e6 service nova] Creating event network-changed:1d88b97b-733a-44d8-a8a7-2f0c1fe45f26 for instance a3928147-60bb-4304-90a7-103deb29e0ed on n-h2-862964-3 Oct 29 01:25:43.991807 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-a5f3bec3-71f9-42ba-ae79-ae3a82bfbb96 req-8b5bbbf1-90a0-4f6f-82c9-2e962da981e6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054530 Oct 29 01:25:43.993573 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2395/4988] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:25:44.002809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-00197145-4e80-47c9-b972-d1727d2ed4c6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:44.004861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-00197145-4e80-47c9-b972-d1727d2ed4c6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:44.013170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00197145-4e80-47c9-b972-d1727d2ed4c6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:44.014782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00197145-4e80-47c9-b972-d1727d2ed4c6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:44.016166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00197145-4e80-47c9-b972-d1727d2ed4c6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:44.017232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00197145-4e80-47c9-b972-d1727d2ed4c6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:44.017860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00197145-4e80-47c9-b972-d1727d2ed4c6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:44.018700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00197145-4e80-47c9-b972-d1727d2ed4c6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:44.169588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-00197145-4e80-47c9-b972-d1727d2ed4c6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:44.181816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-00197145-4e80-47c9-b972-d1727d2ed4c6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:44.183721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-00197145-4e80-47c9-b972-d1727d2ed4c6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:44.189567 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-00197145-4e80-47c9-b972-d1727d2ed4c6 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.190047 Oct 29 01:25:44.189567 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2396/4989] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:43 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:25:44.419146 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c75f2ec5-7450-41ce-9577-9aace8a3717b tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "DELETE /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3" status: 204 len: 0 microversion: 2.1 time: 1.729278 Oct 29 01:25:44.421252 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2594/4990] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:42 2022] DELETE /compute/v2.1/images/5879e75c-b1f8-4fc3-9cbd-8a0d05dfecc3 => generated 0 bytes in 1734 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:25:44.431520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-09a32148-5ad0-4697-9519-bcda1c6005c7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97f09af0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:44.779059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ebf5eeb6-5372-4ad1-8aec-9f9aa963b34b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:44.779395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ebf5eeb6-5372-4ad1-8aec-9f9aa963b34b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:44.794609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebf5eeb6-5372-4ad1-8aec-9f9aa963b34b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:44.795106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebf5eeb6-5372-4ad1-8aec-9f9aa963b34b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:44.795552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebf5eeb6-5372-4ad1-8aec-9f9aa963b34b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:44.796265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebf5eeb6-5372-4ad1-8aec-9f9aa963b34b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:44.801874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebf5eeb6-5372-4ad1-8aec-9f9aa963b34b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:44.802935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebf5eeb6-5372-4ad1-8aec-9f9aa963b34b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:45.144942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ebf5eeb6-5372-4ad1-8aec-9f9aa963b34b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:45.153664 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ebf5eeb6-5372-4ad1-8aec-9f9aa963b34b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed" status: 200 len: 1323 microversion: 2.1 time: 0.378711 Oct 29 01:25:45.154462 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2595/4991] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:44 2022] GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed => generated 1323 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:45.166838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-63f0e970-a07b-4bca-b4de-433ff82332d5 req-1cbd3f1a-1085-49e1-8a13-84fb40fc5b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7616f1ea-1339-425c-9ab9-45431f3cd608", "name": "network-vif-unplugged", "status": "completed", "tag": "1f225c5e-7d18-4b8d-9938-9a97f24a39fc"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:45.190264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-63f0e970-a07b-4bca-b4de-433ff82332d5 req-1cbd3f1a-1085-49e1-8a13-84fb40fc5b42 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:45.190752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-63f0e970-a07b-4bca-b4de-433ff82332d5 req-1cbd3f1a-1085-49e1-8a13-84fb40fc5b42 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:45.191227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-63f0e970-a07b-4bca-b4de-433ff82332d5 req-1cbd3f1a-1085-49e1-8a13-84fb40fc5b42 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:45.206898 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-63f0e970-a07b-4bca-b4de-433ff82332d5 req-1cbd3f1a-1085-49e1-8a13-84fb40fc5b42 service nova] Creating event network-vif-unplugged:1f225c5e-7d18-4b8d-9938-9a97f24a39fc for instance 7616f1ea-1339-425c-9ab9-45431f3cd608 on n-h2-862964-3 Oct 29 01:25:45.212783 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-63f0e970-a07b-4bca-b4de-433ff82332d5 req-1cbd3f1a-1085-49e1-8a13-84fb40fc5b42 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052691 Oct 29 01:25:45.213621 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2596/4992] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:45.219877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d44892ea-7441-4139-a5ee-421e34cfd616 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:45.220739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d44892ea-7441-4139-a5ee-421e34cfd616 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:45.227650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d44892ea-7441-4139-a5ee-421e34cfd616 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:45.228146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d44892ea-7441-4139-a5ee-421e34cfd616 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:45.228586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d44892ea-7441-4139-a5ee-421e34cfd616 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:45.229323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d44892ea-7441-4139-a5ee-421e34cfd616 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:45.229786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d44892ea-7441-4139-a5ee-421e34cfd616 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:45.230209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d44892ea-7441-4139-a5ee-421e34cfd616 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:45.358495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d44892ea-7441-4139-a5ee-421e34cfd616 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:45.375685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d44892ea-7441-4139-a5ee-421e34cfd616 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:45.377836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d44892ea-7441-4139-a5ee-421e34cfd616 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:45.379429 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d44892ea-7441-4139-a5ee-421e34cfd616 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.164405 Oct 29 01:25:45.380154 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2597/4993] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:45 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:46.177465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-760611a8-3db0-4a88-bab4-ef2e63f19a39 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:46.178178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-760611a8-3db0-4a88-bab4-ef2e63f19a39 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:46.191151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-760611a8-3db0-4a88-bab4-ef2e63f19a39 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:46.197567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-760611a8-3db0-4a88-bab4-ef2e63f19a39 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:46.197567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-760611a8-3db0-4a88-bab4-ef2e63f19a39 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:46.197567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-760611a8-3db0-4a88-bab4-ef2e63f19a39 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:46.197567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-760611a8-3db0-4a88-bab4-ef2e63f19a39 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:46.197567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-760611a8-3db0-4a88-bab4-ef2e63f19a39 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:46.255218 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-09a32148-5ad0-4697-9519-bcda1c6005c7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "DELETE /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5" status: 204 len: 0 microversion: 2.1 time: 1.827673 Oct 29 01:25:46.256923 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2397/4994] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:44 2022] DELETE /compute/v2.1/images/d788023e-7930-4788-a760-49cf734a91e5 => generated 0 bytes in 1831 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:25:46.268132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a48a11fa-d069-4674-af29-c850a96035db tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d970d88b0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:46.435081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-760611a8-3db0-4a88-bab4-ef2e63f19a39 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:46.445891 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-760611a8-3db0-4a88-bab4-ef2e63f19a39 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed" status: 200 len: 1323 microversion: 2.1 time: 0.272784 Oct 29 01:25:46.448964 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2598/4995] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:46 2022] GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed => generated 1323 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:46.464318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-37ee735d-d9eb-449e-90a0-54a83b6b8088 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:46.466818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-37ee735d-d9eb-449e-90a0-54a83b6b8088 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:46.483316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37ee735d-d9eb-449e-90a0-54a83b6b8088 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:46.486001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37ee735d-d9eb-449e-90a0-54a83b6b8088 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:46.486714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37ee735d-d9eb-449e-90a0-54a83b6b8088 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:46.488370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37ee735d-d9eb-449e-90a0-54a83b6b8088 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:46.490870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37ee735d-d9eb-449e-90a0-54a83b6b8088 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:46.493908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37ee735d-d9eb-449e-90a0-54a83b6b8088 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:46.625781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-37ee735d-d9eb-449e-90a0-54a83b6b8088 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:46.644002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-37ee735d-d9eb-449e-90a0-54a83b6b8088 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:46.645511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-37ee735d-d9eb-449e-90a0-54a83b6b8088 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:46.646863 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-37ee735d-d9eb-449e-90a0-54a83b6b8088 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.196064 Oct 29 01:25:46.647313 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2599/4996] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:46 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:47.472771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a63b6b08-b2de-4c15-bbbd-c6ef2229f5c3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:47.473493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a63b6b08-b2de-4c15-bbbd-c6ef2229f5c3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:47.475746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:25:47.476660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:25:47.496559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a63b6b08-b2de-4c15-bbbd-c6ef2229f5c3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:47.497060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a63b6b08-b2de-4c15-bbbd-c6ef2229f5c3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:47.497539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a63b6b08-b2de-4c15-bbbd-c6ef2229f5c3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:47.498250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a63b6b08-b2de-4c15-bbbd-c6ef2229f5c3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:47.498707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a63b6b08-b2de-4c15-bbbd-c6ef2229f5c3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:47.499319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a63b6b08-b2de-4c15-bbbd-c6ef2229f5c3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:47.726300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a63b6b08-b2de-4c15-bbbd-c6ef2229f5c3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:47.734929 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a63b6b08-b2de-4c15-bbbd-c6ef2229f5c3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed" status: 200 len: 1323 microversion: 2.1 time: 0.267076 Oct 29 01:25:47.735544 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2600/4997] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:47 2022] GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed => generated 1323 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:25:47.741046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a92bd64f-cce8-4b93-a29f-8bbfd58d2914 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:47.741553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a92bd64f-cce8-4b93-a29f-8bbfd58d2914 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:47.759333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a92bd64f-cce8-4b93-a29f-8bbfd58d2914 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:47.760112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a92bd64f-cce8-4b93-a29f-8bbfd58d2914 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:47.760554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a92bd64f-cce8-4b93-a29f-8bbfd58d2914 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:47.761313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a92bd64f-cce8-4b93-a29f-8bbfd58d2914 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:47.761776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a92bd64f-cce8-4b93-a29f-8bbfd58d2914 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:47.762208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a92bd64f-cce8-4b93-a29f-8bbfd58d2914 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:47.805853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:25:47.864883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a92bd64f-cce8-4b93-a29f-8bbfd58d2914 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:47.877493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a92bd64f-cce8-4b93-a29f-8bbfd58d2914 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:47.879391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a92bd64f-cce8-4b93-a29f-8bbfd58d2914 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:47.880912 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a92bd64f-cce8-4b93-a29f-8bbfd58d2914 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.144149 Oct 29 01:25:47.902207 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2601/4998] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:47 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:47.912330 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a48a11fa-d069-4674-af29-c850a96035db tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "DELETE /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57" status: 204 len: 0 microversion: 2.1 time: 1.650561 Oct 29 01:25:47.913301 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2398/4999] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:46 2022] DELETE /compute/v2.1/images/84651437-6851-44b4-96a6-36be0bb10a57 => generated 0 bytes in 1652 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:25:47.926960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e63d9a56-51b4-420e-8b7a-0dfca4310b62 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:47.927613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e63d9a56-51b4-420e-8b7a-0dfca4310b62 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:47.940341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e63d9a56-51b4-420e-8b7a-0dfca4310b62 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:47.941354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e63d9a56-51b4-420e-8b7a-0dfca4310b62 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:47.969640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e63d9a56-51b4-420e-8b7a-0dfca4310b62 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:47.969640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e63d9a56-51b4-420e-8b7a-0dfca4310b62 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:47.969640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e63d9a56-51b4-420e-8b7a-0dfca4310b62 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:47.969640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e63d9a56-51b4-420e-8b7a-0dfca4310b62 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:47.980288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e63d9a56-51b4-420e-8b7a-0dfca4310b62 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:25:48.505892 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e63d9a56-51b4-420e-8b7a-0dfca4310b62 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "DELETE /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 204 len: 0 microversion: 2.1 time: 0.588122 Oct 29 01:25:48.510598 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2602/5000] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:25:47 2022] DELETE /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:25:48.521836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3029b17b-06ad-4fd2-9071-1de63fb7471a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:48.522458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3029b17b-06ad-4fd2-9071-1de63fb7471a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:48.529792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3029b17b-06ad-4fd2-9071-1de63fb7471a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:48.530598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3029b17b-06ad-4fd2-9071-1de63fb7471a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:48.532016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3029b17b-06ad-4fd2-9071-1de63fb7471a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:48.535606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3029b17b-06ad-4fd2-9071-1de63fb7471a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:48.536286 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3029b17b-06ad-4fd2-9071-1de63fb7471a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:48.536811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3029b17b-06ad-4fd2-9071-1de63fb7471a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:48.714768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3029b17b-06ad-4fd2-9071-1de63fb7471a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:48.723867 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3029b17b-06ad-4fd2-9071-1de63fb7471a tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1473 microversion: 2.1 time: 0.209281 Oct 29 01:25:48.724450 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2399/5001] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:48 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1473 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:48.761554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f845deab-ff34-4702-89e0-dcba2a4dea59 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:48.762571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f845deab-ff34-4702-89e0-dcba2a4dea59 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:48.775465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f845deab-ff34-4702-89e0-dcba2a4dea59 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:48.775465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f845deab-ff34-4702-89e0-dcba2a4dea59 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:48.775465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f845deab-ff34-4702-89e0-dcba2a4dea59 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:48.775465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f845deab-ff34-4702-89e0-dcba2a4dea59 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:48.775906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f845deab-ff34-4702-89e0-dcba2a4dea59 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:48.776342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f845deab-ff34-4702-89e0-dcba2a4dea59 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:48.915830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-42fdb493-4bad-4265-97ce-31f4b71e3765 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:48.917177 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-42fdb493-4bad-4265-97ce-31f4b71e3765 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:48.923990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:25:48.935069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42fdb493-4bad-4265-97ce-31f4b71e3765 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:48.935752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42fdb493-4bad-4265-97ce-31f4b71e3765 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:48.936369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42fdb493-4bad-4265-97ce-31f4b71e3765 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:48.949532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42fdb493-4bad-4265-97ce-31f4b71e3765 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:48.950330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42fdb493-4bad-4265-97ce-31f4b71e3765 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:48.953264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42fdb493-4bad-4265-97ce-31f4b71e3765 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:48.958731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f845deab-ff34-4702-89e0-dcba2a4dea59 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:48.966604 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f845deab-ff34-4702-89e0-dcba2a4dea59 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed" status: 200 len: 1323 microversion: 2.1 time: 0.211896 Oct 29 01:25:48.967202 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2603/5002] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:48 2022] GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed => generated 1323 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:49.080006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-42fdb493-4bad-4265-97ce-31f4b71e3765 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:49.113432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-42fdb493-4bad-4265-97ce-31f4b71e3765 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:49.116661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-42fdb493-4bad-4265-97ce-31f4b71e3765 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:49.121897 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-42fdb493-4bad-4265-97ce-31f4b71e3765 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.209455 Oct 29 01:25:49.124168 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2400/5003] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:48 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:25:49.751386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-633008ac-fb58-4062-88b0-c1276a20beef tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:49.752865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-633008ac-fb58-4062-88b0-c1276a20beef tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:49.766521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-633008ac-fb58-4062-88b0-c1276a20beef tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:49.771829 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-633008ac-fb58-4062-88b0-c1276a20beef tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:49.772356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-633008ac-fb58-4062-88b0-c1276a20beef tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:49.773226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-633008ac-fb58-4062-88b0-c1276a20beef tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:49.773760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-633008ac-fb58-4062-88b0-c1276a20beef tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:49.774301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-633008ac-fb58-4062-88b0-c1276a20beef tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:49.931031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-633008ac-fb58-4062-88b0-c1276a20beef tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:49.944554 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-633008ac-fb58-4062-88b0-c1276a20beef tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1473 microversion: 2.1 time: 0.200822 Oct 29 01:25:49.945789 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2604/5004] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:49 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1473 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:49.996064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2582bc4f-4854-40f5-b53a-793f2fef3dc6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:49.998068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2582bc4f-4854-40f5-b53a-793f2fef3dc6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:50.011089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2582bc4f-4854-40f5-b53a-793f2fef3dc6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:50.012327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2582bc4f-4854-40f5-b53a-793f2fef3dc6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:50.013319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2582bc4f-4854-40f5-b53a-793f2fef3dc6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:50.016244 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2582bc4f-4854-40f5-b53a-793f2fef3dc6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:50.017461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2582bc4f-4854-40f5-b53a-793f2fef3dc6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:50.018421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2582bc4f-4854-40f5-b53a-793f2fef3dc6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:50.157404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9ef8220c-32cf-4508-b0c8-d392efae0fc2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:50.157404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9ef8220c-32cf-4508-b0c8-d392efae0fc2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:50.163948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ef8220c-32cf-4508-b0c8-d392efae0fc2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:50.164455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ef8220c-32cf-4508-b0c8-d392efae0fc2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:50.167428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ef8220c-32cf-4508-b0c8-d392efae0fc2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:50.169132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ef8220c-32cf-4508-b0c8-d392efae0fc2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:50.171993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ef8220c-32cf-4508-b0c8-d392efae0fc2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:50.174398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ef8220c-32cf-4508-b0c8-d392efae0fc2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:50.275678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2582bc4f-4854-40f5-b53a-793f2fef3dc6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:50.297664 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2582bc4f-4854-40f5-b53a-793f2fef3dc6 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed" status: 200 len: 1323 microversion: 2.1 time: 0.306437 Oct 29 01:25:50.311549 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2401/5005] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:49 2022] GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed => generated 1323 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:50.362209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9ef8220c-32cf-4508-b0c8-d392efae0fc2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:50.383856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9ef8220c-32cf-4508-b0c8-d392efae0fc2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:50.385703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9ef8220c-32cf-4508-b0c8-d392efae0fc2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:50.387238 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9ef8220c-32cf-4508-b0c8-d392efae0fc2 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.237490 Oct 29 01:25:50.387883 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2605/5006] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:50 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:50.969579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0028f8f9-6099-4ef2-b5ca-1ab627eb22b2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:50.970948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0028f8f9-6099-4ef2-b5ca-1ab627eb22b2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:50.982413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0028f8f9-6099-4ef2-b5ca-1ab627eb22b2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:50.982958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0028f8f9-6099-4ef2-b5ca-1ab627eb22b2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:50.983604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0028f8f9-6099-4ef2-b5ca-1ab627eb22b2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:50.988179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0028f8f9-6099-4ef2-b5ca-1ab627eb22b2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:50.988906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0028f8f9-6099-4ef2-b5ca-1ab627eb22b2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:50.992558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0028f8f9-6099-4ef2-b5ca-1ab627eb22b2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:51.199295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0028f8f9-6099-4ef2-b5ca-1ab627eb22b2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:51.208096 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0028f8f9-6099-4ef2-b5ca-1ab627eb22b2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1473 microversion: 2.1 time: 0.243300 Oct 29 01:25:51.208768 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2402/5007] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:50 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1473 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:51.327179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb84ad18-5e58-4d89-9a72-eb36434ca74d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:51.331333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bb84ad18-5e58-4d89-9a72-eb36434ca74d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:51.345913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb84ad18-5e58-4d89-9a72-eb36434ca74d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:51.346462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb84ad18-5e58-4d89-9a72-eb36434ca74d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:51.346859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb84ad18-5e58-4d89-9a72-eb36434ca74d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:51.353077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb84ad18-5e58-4d89-9a72-eb36434ca74d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:51.353615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb84ad18-5e58-4d89-9a72-eb36434ca74d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:51.354070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb84ad18-5e58-4d89-9a72-eb36434ca74d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:51.419969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ee54d9bf-b320-4bd3-a183-6d10036aad0e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:51.420689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ee54d9bf-b320-4bd3-a183-6d10036aad0e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:51.432208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee54d9bf-b320-4bd3-a183-6d10036aad0e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:51.433035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee54d9bf-b320-4bd3-a183-6d10036aad0e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:51.433665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee54d9bf-b320-4bd3-a183-6d10036aad0e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:51.434569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee54d9bf-b320-4bd3-a183-6d10036aad0e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:51.435271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee54d9bf-b320-4bd3-a183-6d10036aad0e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:51.435872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee54d9bf-b320-4bd3-a183-6d10036aad0e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:51.441893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:25:51.589253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ee54d9bf-b320-4bd3-a183-6d10036aad0e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:51.605447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ee54d9bf-b320-4bd3-a183-6d10036aad0e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:51.608143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ee54d9bf-b320-4bd3-a183-6d10036aad0e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:51.609778 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ee54d9bf-b320-4bd3-a183-6d10036aad0e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.198399 Oct 29 01:25:51.622025 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2403/5008] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:51 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:51.694114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-372cd2a6-6352-461a-ae94-9ce1ca6f5098 req-2f956049-d378-4384-9f60-152616e52823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3928147-60bb-4304-90a7-103deb29e0ed", "name": "network-vif-plugged", "status": "completed", "tag": "1d88b97b-733a-44d8-a8a7-2f0c1fe45f26"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:51.714776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bb84ad18-5e58-4d89-9a72-eb36434ca74d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:51.716218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-372cd2a6-6352-461a-ae94-9ce1ca6f5098 req-2f956049-d378-4384-9f60-152616e52823 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:51.716788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-372cd2a6-6352-461a-ae94-9ce1ca6f5098 req-2f956049-d378-4384-9f60-152616e52823 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:51.717390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-372cd2a6-6352-461a-ae94-9ce1ca6f5098 req-2f956049-d378-4384-9f60-152616e52823 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:51.724348 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bb84ad18-5e58-4d89-9a72-eb36434ca74d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed" status: 200 len: 1323 microversion: 2.1 time: 0.401827 Oct 29 01:25:51.725471 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2606/5009] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:51 2022] GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed => generated 1323 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:51.751929 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-372cd2a6-6352-461a-ae94-9ce1ca6f5098 req-2f956049-d378-4384-9f60-152616e52823 service nova] Creating event network-vif-plugged:1d88b97b-733a-44d8-a8a7-2f0c1fe45f26 for instance a3928147-60bb-4304-90a7-103deb29e0ed on n-h2-862964-3 Oct 29 01:25:51.759239 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-372cd2a6-6352-461a-ae94-9ce1ca6f5098 req-2f956049-d378-4384-9f60-152616e52823 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069559 Oct 29 01:25:51.764909 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2404/5010] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:51.940441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-e2a719df-d14a-4713-a298-b4b541856e04 req-6abde043-ee3b-485d-8aab-b89396783dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391c56c8-b8d8-424c-91d7-dc0408b9e71d", "name": "network-vif-deleted", "tag": "bfe88ae5-26ce-42b9-a002-0635e32f69b1"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:51.964821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e2a719df-d14a-4713-a298-b4b541856e04 req-6abde043-ee3b-485d-8aab-b89396783dcf service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:51.965734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e2a719df-d14a-4713-a298-b4b541856e04 req-6abde043-ee3b-485d-8aab-b89396783dcf service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:51.966443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e2a719df-d14a-4713-a298-b4b541856e04 req-6abde043-ee3b-485d-8aab-b89396783dcf service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:51.997525 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-e2a719df-d14a-4713-a298-b4b541856e04 req-6abde043-ee3b-485d-8aab-b89396783dcf service nova] Creating event network-vif-deleted:bfe88ae5-26ce-42b9-a002-0635e32f69b1 for instance 391c56c8-b8d8-424c-91d7-dc0408b9e71d on n-h2-862964-3 Oct 29 01:25:52.009493 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-e2a719df-d14a-4713-a298-b4b541856e04 req-6abde043-ee3b-485d-8aab-b89396783dcf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072559 Oct 29 01:25:52.016674 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2607/5011] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:52.237653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-10260736-87f5-4abf-8241-2624eaa422de tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:52.238501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-10260736-87f5-4abf-8241-2624eaa422de tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:52.262888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10260736-87f5-4abf-8241-2624eaa422de tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:52.267958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10260736-87f5-4abf-8241-2624eaa422de tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:52.269210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10260736-87f5-4abf-8241-2624eaa422de tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:52.270990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10260736-87f5-4abf-8241-2624eaa422de tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:52.272613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10260736-87f5-4abf-8241-2624eaa422de tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:52.274490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10260736-87f5-4abf-8241-2624eaa422de tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:52.505713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-10260736-87f5-4abf-8241-2624eaa422de tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:52.523971 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-10260736-87f5-4abf-8241-2624eaa422de tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1303 microversion: 2.1 time: 0.291675 Oct 29 01:25:52.525530 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2405/5012] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:52 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1303 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:52.637754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-395fade9-e860-4e23-add9-10365d44a03e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:52.639224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-395fade9-e860-4e23-add9-10365d44a03e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:52.647415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-395fade9-e860-4e23-add9-10365d44a03e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:52.648100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-395fade9-e860-4e23-add9-10365d44a03e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:52.648785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-395fade9-e860-4e23-add9-10365d44a03e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:52.649678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-395fade9-e860-4e23-add9-10365d44a03e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:52.650307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-395fade9-e860-4e23-add9-10365d44a03e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:52.650888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-395fade9-e860-4e23-add9-10365d44a03e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:52.724266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-395fade9-e860-4e23-add9-10365d44a03e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:52.735388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-395fade9-e860-4e23-add9-10365d44a03e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:52.738150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-395fade9-e860-4e23-add9-10365d44a03e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:52.739677 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-395fade9-e860-4e23-add9-10365d44a03e tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.106296 Oct 29 01:25:52.740745 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2608/5013] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:52 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:52.757947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ca14b33d-01f2-4519-a569-9826f5b7ecb2 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:52.759033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ca14b33d-01f2-4519-a569-9826f5b7ecb2 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:52.772062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca14b33d-01f2-4519-a569-9826f5b7ecb2 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:52.776149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca14b33d-01f2-4519-a569-9826f5b7ecb2 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:52.776149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca14b33d-01f2-4519-a569-9826f5b7ecb2 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:52.778398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca14b33d-01f2-4519-a569-9826f5b7ecb2 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:52.779226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca14b33d-01f2-4519-a569-9826f5b7ecb2 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:52.780159 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca14b33d-01f2-4519-a569-9826f5b7ecb2 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:53.020048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ca14b33d-01f2-4519-a569-9826f5b7ecb2 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:53.038395 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ca14b33d-01f2-4519-a569-9826f5b7ecb2 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed" status: 200 len: 1323 microversion: 2.1 time: 0.290305 Oct 29 01:25:53.043653 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2406/5014] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:52 2022] GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed => generated 1323 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:53.566850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cfa96972-1222-42af-8edf-bb3b08160ae2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:53.568144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cfa96972-1222-42af-8edf-bb3b08160ae2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:53.596895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfa96972-1222-42af-8edf-bb3b08160ae2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:53.597430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfa96972-1222-42af-8edf-bb3b08160ae2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:53.599888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfa96972-1222-42af-8edf-bb3b08160ae2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:53.604039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfa96972-1222-42af-8edf-bb3b08160ae2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:53.607742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfa96972-1222-42af-8edf-bb3b08160ae2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:53.610169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfa96972-1222-42af-8edf-bb3b08160ae2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:53.682079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfa96972-1222-42af-8edf-bb3b08160ae2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:53.682696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfa96972-1222-42af-8edf-bb3b08160ae2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:53.683150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfa96972-1222-42af-8edf-bb3b08160ae2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:53.683717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-cfa96972-1222-42af-8edf-bb3b08160ae2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lazy-loading 'fault' on Instance uuid 391c56c8-b8d8-424c-91d7-dc0408b9e71d {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:25:53.733714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cfa96972-1222-42af-8edf-bb3b08160ae2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:53.743375 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cfa96972-1222-42af-8edf-bb3b08160ae2 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 200 len: 1308 microversion: 2.1 time: 0.198325 Oct 29 01:25:53.757365 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2609/5015] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:53 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 1308 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:53.771206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1072193e-81ab-4acb-b516-0d90dbbd9626 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:53.771958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1072193e-81ab-4acb-b516-0d90dbbd9626 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:53.787335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1072193e-81ab-4acb-b516-0d90dbbd9626 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:53.788266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1072193e-81ab-4acb-b516-0d90dbbd9626 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:53.791432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1072193e-81ab-4acb-b516-0d90dbbd9626 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:53.792709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1072193e-81ab-4acb-b516-0d90dbbd9626 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:53.795178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1072193e-81ab-4acb-b516-0d90dbbd9626 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:53.797476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1072193e-81ab-4acb-b516-0d90dbbd9626 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:53.959919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1072193e-81ab-4acb-b516-0d90dbbd9626 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:53.971465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1072193e-81ab-4acb-b516-0d90dbbd9626 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:53.973181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1072193e-81ab-4acb-b516-0d90dbbd9626 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:53.974653 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1072193e-81ab-4acb-b516-0d90dbbd9626 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.211215 Oct 29 01:25:53.975391 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2407/5016] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:53 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:54.063813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dd7f453e-7ff1-4604-8619-7cdffd3f727c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:54.064706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dd7f453e-7ff1-4604-8619-7cdffd3f727c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:54.082701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd7f453e-7ff1-4604-8619-7cdffd3f727c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:54.090759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd7f453e-7ff1-4604-8619-7cdffd3f727c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:54.094161 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd7f453e-7ff1-4604-8619-7cdffd3f727c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:54.095531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd7f453e-7ff1-4604-8619-7cdffd3f727c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:54.096740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd7f453e-7ff1-4604-8619-7cdffd3f727c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:54.098807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd7f453e-7ff1-4604-8619-7cdffd3f727c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:54.350754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dd7f453e-7ff1-4604-8619-7cdffd3f727c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:54.365891 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dd7f453e-7ff1-4604-8619-7cdffd3f727c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed" status: 200 len: 1518 microversion: 2.1 time: 0.306845 Oct 29 01:25:54.366699 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2610/5017] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:54 2022] GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed => generated 1518 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:54.391882 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ca7670a7-bacd-4ecd-b5b4-5fe1d2092901 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.73"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:54.401628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ca7670a7-bacd-4ecd-b5b4-5fe1d2092901 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:54.415487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca7670a7-bacd-4ecd-b5b4-5fe1d2092901 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:54.418491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca7670a7-bacd-4ecd-b5b4-5fe1d2092901 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:54.418491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca7670a7-bacd-4ecd-b5b4-5fe1d2092901 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:54.418491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca7670a7-bacd-4ecd-b5b4-5fe1d2092901 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:54.418491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca7670a7-bacd-4ecd-b5b4-5fe1d2092901 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:54.420679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca7670a7-bacd-4ecd-b5b4-5fe1d2092901 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:54.470829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca7670a7-bacd-4ecd-b5b4-5fe1d2092901 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "refresh_cache-d81519da-d650-41a7-a009-4bcfb4e94d92" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 01:25:54.471477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca7670a7-bacd-4ecd-b5b4-5fe1d2092901 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquired lock "refresh_cache-d81519da-d650-41a7-a009-4bcfb4e94d92" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 01:25:54.771304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6f4a8f7e-7644-4f15-aeca-a140b679613e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:54.772797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6f4a8f7e-7644-4f15-aeca-a140b679613e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 391c56c8-b8d8-424c-91d7-dc0408b9e71d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:54.786001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f4a8f7e-7644-4f15-aeca-a140b679613e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:54.790389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f4a8f7e-7644-4f15-aeca-a140b679613e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:54.791551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f4a8f7e-7644-4f15-aeca-a140b679613e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:54.794694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f4a8f7e-7644-4f15-aeca-a140b679613e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:54.795564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f4a8f7e-7644-4f15-aeca-a140b679613e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:54.797150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f4a8f7e-7644-4f15-aeca-a140b679613e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:54.825256 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-6f4a8f7e-7644-4f15-aeca-a140b679613e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] HTTP exception thrown: Instance 391c56c8-b8d8-424c-91d7-dc0408b9e71d could not be found. Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6f4a8f7e-7644-4f15-aeca-a140b679613e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Request method failure captured: Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d HTTP/1.1 Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIB3uNyUu5Y3Zx6dnhpFjAzCimPBh4UVolaCCgXnjltYCGdovC5iC5-1wIOWst6gG8iRuqVrb6lfhSsg1Ud36QVcaUIkyTej3JGoONXf-7ZRXWfQE8Bz0O3N--Rkungy4D4hHcpPDX8DXGcseKsVtEfZR-0UfQDYMlSWRPeMvo2SX_U Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: be0fa8a064884bd9a04bce4ef59bf17c Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ListImageFiltersTestJSON-1305866998 Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/be0fa8a064884bd9a04bce4ef59bf17c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/be0fa8a064884bd9a04bce4ef59bf17c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/be0fa8a064884bd9a04bce4ef59bf17c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_be0fa8a064884bd9a04bce4ef59bf17c", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ListImageFiltersTestJSON-1305866998 Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: be0fa8a064884bd9a04bce4ef59bf17c Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1305866998 Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ListImageFiltersTestJSON-1305866998-project Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 3285141c360f4209bd733520cb44b5ee Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ListImageFiltersTestJSON-1305866998-project Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 391c56c8-b8d8-424c-91d7-dc0408b9e71d could not be found. Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '391c56c8-b8d8-424c-91d7-dc0408b9e71d'} Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 391c56c8-b8d8-424c-91d7-dc0408b9e71d could not be found. Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 391c56c8-b8d8-424c-91d7-dc0408b9e71d could not be found. Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:25:54.832374 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:25:54.836639 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:25:54.836639 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:25:54.836639 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:25:54.836639 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:25:54.836639 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:25:54.836639 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 391c56c8-b8d8-424c-91d7-dc0408b9e71d could not be found. Oct 29 01:25:54.836639 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:25:54.839010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6f4a8f7e-7644-4f15-aeca-a140b679613e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Returning 404 to user: Instance 391c56c8-b8d8-424c-91d7-dc0408b9e71d could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:25:54.840112 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6f4a8f7e-7644-4f15-aeca-a140b679613e tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d" status: 404 len: 111 microversion: 2.1 time: 0.073529 Oct 29 01:25:54.861290 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2611/5018] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:54 2022] GET /compute/v2.1/servers/391c56c8-b8d8-424c-91d7-dc0408b9e71d => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:25:54.882827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a359ddd3-a29e-4bc9-ae85-510086962aa3 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:54.883334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a359ddd3-a29e-4bc9-ae85-510086962aa3 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 7616f1ea-1339-425c-9ab9-45431f3cd608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:54.915630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a359ddd3-a29e-4bc9-ae85-510086962aa3 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:54.918253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a359ddd3-a29e-4bc9-ae85-510086962aa3 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:54.921225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a359ddd3-a29e-4bc9-ae85-510086962aa3 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:54.921225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a359ddd3-a29e-4bc9-ae85-510086962aa3 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:54.923338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a359ddd3-a29e-4bc9-ae85-510086962aa3 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:54.923764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a359ddd3-a29e-4bc9-ae85-510086962aa3 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:54.988119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a359ddd3-a29e-4bc9-ae85-510086962aa3 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 7616f1ea-1339-425c-9ab9-45431f3cd608] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:25:55.458869 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a359ddd3-a29e-4bc9-ae85-510086962aa3 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608" status: 204 len: 0 microversion: 2.1 time: 0.596113 Oct 29 01:25:55.459542 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2612/5019] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:25:54 2022] DELETE /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:25:55.471915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ec4d1712-bcf5-456d-b2b5-23d6495f49e7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:55.472944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ec4d1712-bcf5-456d-b2b5-23d6495f49e7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:55.479658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec4d1712-bcf5-456d-b2b5-23d6495f49e7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:55.480473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec4d1712-bcf5-456d-b2b5-23d6495f49e7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:55.481187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec4d1712-bcf5-456d-b2b5-23d6495f49e7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:55.482206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec4d1712-bcf5-456d-b2b5-23d6495f49e7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:55.482927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec4d1712-bcf5-456d-b2b5-23d6495f49e7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:55.483604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec4d1712-bcf5-456d-b2b5-23d6495f49e7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:55.677055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ec4d1712-bcf5-456d-b2b5-23d6495f49e7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:55.691152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ec4d1712-bcf5-456d-b2b5-23d6495f49e7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:55.695216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ec4d1712-bcf5-456d-b2b5-23d6495f49e7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:55.696526 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ec4d1712-bcf5-456d-b2b5-23d6495f49e7 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.231770 Oct 29 01:25:55.720185 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2613/5020] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:55 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:55.726336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e11fce59-6aad-4503-aabc-1bbcb373c2cf tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:55.731360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e11fce59-6aad-4503-aabc-1bbcb373c2cf tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 7616f1ea-1339-425c-9ab9-45431f3cd608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:55.755204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e11fce59-6aad-4503-aabc-1bbcb373c2cf tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:55.755710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e11fce59-6aad-4503-aabc-1bbcb373c2cf tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:55.756149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e11fce59-6aad-4503-aabc-1bbcb373c2cf tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:55.756866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e11fce59-6aad-4503-aabc-1bbcb373c2cf tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:55.757423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e11fce59-6aad-4503-aabc-1bbcb373c2cf tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:55.757850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e11fce59-6aad-4503-aabc-1bbcb373c2cf tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:56.039638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e11fce59-6aad-4503-aabc-1bbcb373c2cf tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:56.056451 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e11fce59-6aad-4503-aabc-1bbcb373c2cf tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608" status: 200 len: 1473 microversion: 2.1 time: 0.333399 Oct 29 01:25:56.057067 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2614/5021] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:55 2022] GET /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608 => generated 1473 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:56.726945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b22d5770-b324-4189-955f-471cf0441a82 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:56.727754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b22d5770-b324-4189-955f-471cf0441a82 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:56.736287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b22d5770-b324-4189-955f-471cf0441a82 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:56.736287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b22d5770-b324-4189-955f-471cf0441a82 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:56.737514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b22d5770-b324-4189-955f-471cf0441a82 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:56.738450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b22d5770-b324-4189-955f-471cf0441a82 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:56.739114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b22d5770-b324-4189-955f-471cf0441a82 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:56.739728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b22d5770-b324-4189-955f-471cf0441a82 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:56.918835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b22d5770-b324-4189-955f-471cf0441a82 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:56.923313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:25:56.948610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b22d5770-b324-4189-955f-471cf0441a82 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:56.952756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b22d5770-b324-4189-955f-471cf0441a82 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:56.966511 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b22d5770-b324-4189-955f-471cf0441a82 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1605 microversion: 2.32 time: 0.243701 Oct 29 01:25:56.969884 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2615/5022] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:56 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1605 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:25:56.972532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-58837f71-dd00-4859-97e6-85960d29fc5f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Action: 'create', calling method: .version_select at 0x7f9d9778caf0>, body: {"keypair": {"name": "tempest-keypair-901630675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAZeKlzXEd89u9/YSlqtPpiSHnp0AvkEaVNbt4BFxGAhN9oIyJJJd1O3Feu5t7EBAw/3ElLD/7gRSsO7TQ8u1TdAlOptPSHd3x8BzEZMdk0augV+Z/UQrp0lzt1HbsRng=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:56.993954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-ca7670a7-bacd-4ecd-b5b4-5fe1d2092901 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Building network info cache for instance {{(pid=121100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 01:25:57.014564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:25:57.038795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-58837f71-dd00-4859-97e6-85960d29fc5f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Getting quotas for project ad278c0b0b9a41beae8b29986e315743. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:25:57.056848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-58837f71-dd00-4859-97e6-85960d29fc5f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Getting quotas for user 444e13f1f2d945dfb31b83d8e19c2032 and project ad278c0b0b9a41beae8b29986e315743. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:25:57.219765 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-58837f71-dd00-4859-97e6-85960d29fc5f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.251126 Oct 29 01:25:57.220876 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2616/5023] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:25:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:57.229668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-dbde83f4-45ee-422e-9674-d817d206fd25 req-56185d74-709a-4c23-99d8-97749f01a23f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d81519da-d650-41a7-a009-4bcfb4e94d92", "tag": "ce177e8d-5249-49d2-a188-951d6561d827"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:57.254844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-dbde83f4-45ee-422e-9674-d817d206fd25 req-56185d74-709a-4c23-99d8-97749f01a23f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:57.256516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-dbde83f4-45ee-422e-9674-d817d206fd25 req-56185d74-709a-4c23-99d8-97749f01a23f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:57.258280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-dbde83f4-45ee-422e-9674-d817d206fd25 req-56185d74-709a-4c23-99d8-97749f01a23f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:57.288737 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-dbde83f4-45ee-422e-9674-d817d206fd25 req-56185d74-709a-4c23-99d8-97749f01a23f service nova] Creating event network-changed:ce177e8d-5249-49d2-a188-951d6561d827 for instance d81519da-d650-41a7-a009-4bcfb4e94d92 on n-h1-862964-3 Oct 29 01:25:57.302364 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-dbde83f4-45ee-422e-9674-d817d206fd25 req-56185d74-709a-4c23-99d8-97749f01a23f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079723 Oct 29 01:25:57.306140 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2617/5024] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:25:57.325118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-281ac44b-de63-4dfc-b914-f2461f2a7d88 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:57.327382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-281ac44b-de63-4dfc-b914-f2461f2a7d88 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 7616f1ea-1339-425c-9ab9-45431f3cd608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:57.349076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-281ac44b-de63-4dfc-b914-f2461f2a7d88 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:57.353396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-281ac44b-de63-4dfc-b914-f2461f2a7d88 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:57.359485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-281ac44b-de63-4dfc-b914-f2461f2a7d88 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:57.359485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-281ac44b-de63-4dfc-b914-f2461f2a7d88 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:57.359485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-281ac44b-de63-4dfc-b914-f2461f2a7d88 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:57.359485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-281ac44b-de63-4dfc-b914-f2461f2a7d88 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:58.346400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-281ac44b-de63-4dfc-b914-f2461f2a7d88 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:58.362539 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-281ac44b-de63-4dfc-b914-f2461f2a7d88 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608" status: 200 len: 1473 microversion: 2.1 time: 1.054820 Oct 29 01:25:58.363334 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2618/5025] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:57 2022] GET /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608 => generated 1473 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:58.372791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-079b1644-91a6-4937-8820-e771941253c5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:58.375227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-079b1644-91a6-4937-8820-e771941253c5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:58.392390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-079b1644-91a6-4937-8820-e771941253c5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:58.396114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-079b1644-91a6-4937-8820-e771941253c5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:58.396584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-079b1644-91a6-4937-8820-e771941253c5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:58.404209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-079b1644-91a6-4937-8820-e771941253c5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:58.404808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-079b1644-91a6-4937-8820-e771941253c5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:58.405299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-079b1644-91a6-4937-8820-e771941253c5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:58.524586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-079b1644-91a6-4937-8820-e771941253c5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:58.526043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-079b1644-91a6-4937-8820-e771941253c5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:58.526043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-079b1644-91a6-4937-8820-e771941253c5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:58.526043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-079b1644-91a6-4937-8820-e771941253c5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lazy-loading 'fault' on Instance uuid 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:25:58.674316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-079b1644-91a6-4937-8820-e771941253c5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:58.706166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-079b1644-91a6-4937-8820-e771941253c5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:58.725086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-079b1644-91a6-4937-8820-e771941253c5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34417a5511824b5aa82ce131f6a1324c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c226e05b4c2943a28fac5c95f02c8e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:25:58.725086 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-079b1644-91a6-4937-8820-e771941253c5 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 200 len: 1372 microversion: 2.32 time: 0.355732 Oct 29 01:25:58.738539 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2619/5026] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:25:58 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 1372 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:25:59.406761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7701108a-b1e8-4e15-9b96-7daf27da82f7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:59.406761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7701108a-b1e8-4e15-9b96-7daf27da82f7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 7616f1ea-1339-425c-9ab9-45431f3cd608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:59.417890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7701108a-b1e8-4e15-9b96-7daf27da82f7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:59.418447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7701108a-b1e8-4e15-9b96-7daf27da82f7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:59.418898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7701108a-b1e8-4e15-9b96-7daf27da82f7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:59.419643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7701108a-b1e8-4e15-9b96-7daf27da82f7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:59.420108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7701108a-b1e8-4e15-9b96-7daf27da82f7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:59.420543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7701108a-b1e8-4e15-9b96-7daf27da82f7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:59.592207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-ca7670a7-bacd-4ecd-b5b4-5fe1d2092901 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Updating instance_info_cache with network_info: [{"id": "ce177e8d-5249-49d2-a188-951d6561d827", "address": "fa:16:3e:52:aa:fc", "network": {"id": "bf44a312-d8d4-4636-8ed4-e759797fbb2e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-880825101-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0dd5d9ef52524461a5ea497010bd3dc0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapce177e8d-52", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 01:25:59.707413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca7670a7-bacd-4ecd-b5b4-5fe1d2092901 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Releasing lock "refresh_cache-d81519da-d650-41a7-a009-4bcfb4e94d92" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 01:25:59.708297 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ca7670a7-bacd-4ecd-b5b4-5fe1d2092901 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "POST /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92/action" status: 202 len: 0 microversion: 2.1 time: 5.322478 Oct 29 01:25:59.710102 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2408/5027] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:25:54 2022] POST /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92/action => generated 0 bytes in 5325 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 01:25:59.721578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ae9e7e77-6441-4efa-93cb-cdd838949abb tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.73"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:25:59.721578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ae9e7e77-6441-4efa-93cb-cdd838949abb tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:25:59.736547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae9e7e77-6441-4efa-93cb-cdd838949abb tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:59.738197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae9e7e77-6441-4efa-93cb-cdd838949abb tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:59.738197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae9e7e77-6441-4efa-93cb-cdd838949abb tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:59.738197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae9e7e77-6441-4efa-93cb-cdd838949abb tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:25:59.738710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae9e7e77-6441-4efa-93cb-cdd838949abb tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:25:59.753528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae9e7e77-6441-4efa-93cb-cdd838949abb tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:25:59.836270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae9e7e77-6441-4efa-93cb-cdd838949abb tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "refresh_cache-a3928147-60bb-4304-90a7-103deb29e0ed" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 01:25:59.836901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae9e7e77-6441-4efa-93cb-cdd838949abb tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquired lock "refresh_cache-a3928147-60bb-4304-90a7-103deb29e0ed" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 01:26:00.292661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7701108a-b1e8-4e15-9b96-7daf27da82f7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:00.313566 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7701108a-b1e8-4e15-9b96-7daf27da82f7 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608" status: 200 len: 1473 microversion: 2.1 time: 0.913669 Oct 29 01:26:00.313566 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2620/5028] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:25:59 2022] GET /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608 => generated 1473 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:00.330942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5490da23-293a-4ae6-90a7-0597aefb9473 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:00.333141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5490da23-293a-4ae6-90a7-0597aefb9473 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:00.342472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5490da23-293a-4ae6-90a7-0597aefb9473 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:00.342966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5490da23-293a-4ae6-90a7-0597aefb9473 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:00.344164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5490da23-293a-4ae6-90a7-0597aefb9473 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:00.351522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5490da23-293a-4ae6-90a7-0597aefb9473 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:00.352077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5490da23-293a-4ae6-90a7-0597aefb9473 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:00.352713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5490da23-293a-4ae6-90a7-0597aefb9473 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:00.394523 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-5490da23-293a-4ae6-90a7-0597aefb9473 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] HTTP exception thrown: Instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 could not be found. Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5490da23-293a-4ae6-90a7-0597aefb9473 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Request method failure captured: Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 HTTP/1.1 Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH9ilRpZCv6prdSXvFp0o42ViefpGJ2y5sauF3sQV9_1uVoucNH0fO6eozzDhFxTBlST3IfD-b5GI_NDo1yW6_hFg4eHv0lyYhS5zwBJk16Roj9U_gt-t8krfDuzogVwMbx6hBzKytGGCCbtPR02lb2bUSyzfMf5pSo9lr0vzh9Osk8 Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.32 Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: c226e05b4c2943a28fac5c95f02c8e68 Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-TaggedBootDevicesTest-155412317 Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c226e05b4c2943a28fac5c95f02c8e68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c226e05b4c2943a28fac5c95f02c8e68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c226e05b4c2943a28fac5c95f02c8e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c226e05b4c2943a28fac5c95f02c8e68", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-TaggedBootDevicesTest-155412317 Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: c226e05b4c2943a28fac5c95f02c8e68 Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-TaggedBootDevicesTest-155412317 Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-TaggedBootDevicesTest-155412317-project Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 34417a5511824b5aa82ce131f6a1324c Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-TaggedBootDevicesTest-155412317-project Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 could not be found. Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9'} Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 could not be found. Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 could not be found. Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:00.396390 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:00.401019 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:00.401019 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:00.401019 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:00.401019 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:26:00.401019 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:26:00.401019 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 could not be found. Oct 29 01:26:00.401019 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:00.401019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5490da23-293a-4ae6-90a7-0597aefb9473 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Returning 404 to user: Instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:26:00.401019 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5490da23-293a-4ae6-90a7-0597aefb9473 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 404 len: 111 microversion: 2.32 time: 0.092626 Oct 29 01:26:00.401019 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2621/5029] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:26:00 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:26:00.405518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-78d7e000-5454-4d79-93dd-1f690326ab5b req-4e4de3f5-e41a-4a4e-baf6-397bb47b88e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7616f1ea-1339-425c-9ab9-45431f3cd608", "name": "network-vif-deleted", "tag": "1f225c5e-7d18-4b8d-9938-9a97f24a39fc"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:00.418665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-78d7e000-5454-4d79-93dd-1f690326ab5b req-4e4de3f5-e41a-4a4e-baf6-397bb47b88e9 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:00.420049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-78d7e000-5454-4d79-93dd-1f690326ab5b req-4e4de3f5-e41a-4a4e-baf6-397bb47b88e9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:00.420489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-78d7e000-5454-4d79-93dd-1f690326ab5b req-4e4de3f5-e41a-4a4e-baf6-397bb47b88e9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:00.445418 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-78d7e000-5454-4d79-93dd-1f690326ab5b req-4e4de3f5-e41a-4a4e-baf6-397bb47b88e9 service nova] Creating event network-vif-deleted:1f225c5e-7d18-4b8d-9938-9a97f24a39fc for instance 7616f1ea-1339-425c-9ab9-45431f3cd608 on n-h2-862964-3 Oct 29 01:26:00.461674 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-78d7e000-5454-4d79-93dd-1f690326ab5b req-4e4de3f5-e41a-4a4e-baf6-397bb47b88e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055515 Oct 29 01:26:00.468181 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2622/5030] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:26:00.481539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c6f59ea6-ae59-4034-b4b1-31ae112d2350 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '.version_select at 0x7f9d97c7d940>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:00.628133 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c6f59ea6-ae59-4034-b4b1-31ae112d2350 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1235386955" status: 204 len: 0 microversion: 2.32 time: 0.156619 Oct 29 01:26:00.628747 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2623/5031] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 29 01:26:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1235386955 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:26:01.209093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fad69621-b4f6-4492-b86a-ef65660a4216 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:01.209816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fad69621-b4f6-4492-b86a-ef65660a4216 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:01.238693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fad69621-b4f6-4492-b86a-ef65660a4216 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:01.239638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fad69621-b4f6-4492-b86a-ef65660a4216 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:01.240319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fad69621-b4f6-4492-b86a-ef65660a4216 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:01.242453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fad69621-b4f6-4492-b86a-ef65660a4216 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:01.243264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fad69621-b4f6-4492-b86a-ef65660a4216 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:01.244059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fad69621-b4f6-4492-b86a-ef65660a4216 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:01.305765 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-fad69621-b4f6-4492-b86a-ef65660a4216 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] HTTP exception thrown: Instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 could not be found. Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fad69621-b4f6-4492-b86a-ef65660a4216 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Request method failure captured: Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 HTTP/1.1 Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8T9cSwFdJFodh1W8ghdDQmW-pn2kyLAmJXDG7JqHwQkxp1x5-_ByQ-M0MZ8IOINzMBo75Sz9HUttVi23Drj0OxToLqamj3b5WVLkWAdoa9pgDpa8xhbIm5zRvocGwXrBeVCRAZ4KTonRKxYXOK3B23izcAyBa6r1a6xlpcK4m2cXc Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: d45b8f0077804db29ad5864327aa6bbb Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeTestJSON-1597110018 Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d45b8f0077804db29ad5864327aa6bbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d45b8f0077804db29ad5864327aa6bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d45b8f0077804db29ad5864327aa6bbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d45b8f0077804db29ad5864327aa6bbb", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeTestJSON-1597110018 Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: d45b8f0077804db29ad5864327aa6bbb Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1597110018 Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AttachVolumeTestJSON-1597110018-project Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 7d922c9f49ff4e87b7b1ca2e10766c53 Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeTestJSON-1597110018-project Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 could not be found. Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '2172c139-992f-4b5d-97b3-f2e549f6fe29'} Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 could not be found. Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:26:01.315030 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:26:01.319914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 could not be found. Oct 29 01:26:01.319914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:01.319914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:01.319914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:01.319914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:01.319914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:01.319914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:01.319914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:26:01.319914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:26:01.319914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 could not be found. Oct 29 01:26:01.319914 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:01.330863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fad69621-b4f6-4492-b86a-ef65660a4216 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Returning 404 to user: Instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:26:01.330863 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fad69621-b4f6-4492-b86a-ef65660a4216 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 404 len: 111 microversion: 2.1 time: 0.130116 Oct 29 01:26:01.334980 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2624/5032] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:26:01 2022] DELETE /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:26:01.342689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-90dda4c4-1fd3-419b-a0ee-7cc7eedc4c75 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:01.350227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-90dda4c4-1fd3-419b-a0ee-7cc7eedc4c75 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 7616f1ea-1339-425c-9ab9-45431f3cd608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:01.366336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90dda4c4-1fd3-419b-a0ee-7cc7eedc4c75 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:01.367439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90dda4c4-1fd3-419b-a0ee-7cc7eedc4c75 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:01.378808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90dda4c4-1fd3-419b-a0ee-7cc7eedc4c75 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:01.379977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90dda4c4-1fd3-419b-a0ee-7cc7eedc4c75 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:01.380731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90dda4c4-1fd3-419b-a0ee-7cc7eedc4c75 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:01.381743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90dda4c4-1fd3-419b-a0ee-7cc7eedc4c75 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:01.461756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90dda4c4-1fd3-419b-a0ee-7cc7eedc4c75 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:01.463379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90dda4c4-1fd3-419b-a0ee-7cc7eedc4c75 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:01.464339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90dda4c4-1fd3-419b-a0ee-7cc7eedc4c75 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:01.465098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-90dda4c4-1fd3-419b-a0ee-7cc7eedc4c75 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lazy-loading 'fault' on Instance uuid 7616f1ea-1339-425c-9ab9-45431f3cd608 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:26:01.619008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-90dda4c4-1fd3-419b-a0ee-7cc7eedc4c75 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3285141c360f4209bd733520cb44b5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fa8a064884bd9a04bce4ef59bf17c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:01.628283 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-90dda4c4-1fd3-419b-a0ee-7cc7eedc4c75 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608" status: 200 len: 1307 microversion: 2.1 time: 0.291951 Oct 29 01:26:01.642272 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2625/5033] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:01 2022] GET /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608 => generated 1307 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:01.654673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6bd3fe42-598f-4660-8165-2349820ce6c2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:01.655296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6bd3fe42-598f-4660-8165-2349820ce6c2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: 2172c139-992f-4b5d-97b3-f2e549f6fe29] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:01.661800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6bd3fe42-598f-4660-8165-2349820ce6c2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:01.662287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6bd3fe42-598f-4660-8165-2349820ce6c2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:01.662724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6bd3fe42-598f-4660-8165-2349820ce6c2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:01.663417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6bd3fe42-598f-4660-8165-2349820ce6c2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:01.664209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6bd3fe42-598f-4660-8165-2349820ce6c2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:01.664651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6bd3fe42-598f-4660-8165-2349820ce6c2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:01.681695 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-6bd3fe42-598f-4660-8165-2349820ce6c2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] HTTP exception thrown: Instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 could not be found. Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6bd3fe42-598f-4660-8165-2349820ce6c2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Request method failure captured: Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 HTTP/1.1 Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8T9cSwFdJFodh1W8ghdDQmW-pn2kyLAmJXDG7JqHwQkxp1x5-_ByQ-M0MZ8IOINzMBo75Sz9HUttVi23Drj0OxToLqamj3b5WVLkWAdoa9pgDpa8xhbIm5zRvocGwXrBeVCRAZ4KTonRKxYXOK3B23izcAyBa6r1a6xlpcK4m2cXc Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: d45b8f0077804db29ad5864327aa6bbb Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeTestJSON-1597110018 Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d45b8f0077804db29ad5864327aa6bbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d45b8f0077804db29ad5864327aa6bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d45b8f0077804db29ad5864327aa6bbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d45b8f0077804db29ad5864327aa6bbb", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeTestJSON-1597110018 Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: d45b8f0077804db29ad5864327aa6bbb Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1597110018 Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AttachVolumeTestJSON-1597110018-project Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 7d922c9f49ff4e87b7b1ca2e10766c53 Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeTestJSON-1597110018-project Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 could not be found. Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '2172c139-992f-4b5d-97b3-f2e549f6fe29'} Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 could not be found. Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 could not be found. Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:01.683242 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:01.690720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:01.690720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:01.690720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:01.690720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:26:01.690720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:26:01.690720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 could not be found. Oct 29 01:26:01.690720 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:01.690720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6bd3fe42-598f-4660-8165-2349820ce6c2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Returning 404 to user: Instance 2172c139-992f-4b5d-97b3-f2e549f6fe29 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:26:01.690720 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6bd3fe42-598f-4660-8165-2349820ce6c2 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29" status: 404 len: 111 microversion: 2.1 time: 0.041187 Oct 29 01:26:01.690720 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2626/5034] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:01 2022] GET /compute/v2.1/servers/2172c139-992f-4b5d-97b3-f2e549f6fe29 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:26:02.633616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6369ddd8-87a8-4037-ab8b-f0562d46de35 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-625938246", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3aada4e4-ab9d-407f-aadb-56a56f4bc58e"}], "security_groups": [{"name": "tempest-securitygroup--1982600296"}], "key_name": "tempest-keypair-901630675", "user_data": "}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:03.266975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-6369ddd8-87a8-4037-ab8b-f0562d46de35 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] validate_networks() for [('3aada4e4-ab9d-407f-aadb-56a56f4bc58e', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:26:04.622248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-6369ddd8-87a8-4037-ab8b-f0562d46de35 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:26:04.631753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-6369ddd8-87a8-4037-ab8b-f0562d46de35 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:26:04.631753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-6369ddd8-87a8-4037-ab8b-f0562d46de35 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:26:04.631753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-6369ddd8-87a8-4037-ab8b-f0562d46de35 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:26:04.631753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-6369ddd8-87a8-4037-ab8b-f0562d46de35 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:26:04.642292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6369ddd8-87a8-4037-ab8b-f0562d46de35 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:04.642848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6369ddd8-87a8-4037-ab8b-f0562d46de35 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:04.643339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6369ddd8-87a8-4037-ab8b-f0562d46de35 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:04.645070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6369ddd8-87a8-4037-ab8b-f0562d46de35 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:04.645855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6369ddd8-87a8-4037-ab8b-f0562d46de35 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:04.646390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6369ddd8-87a8-4037-ab8b-f0562d46de35 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:04.684171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-6369ddd8-87a8-4037-ab8b-f0562d46de35 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Getting quotas for project ad278c0b0b9a41beae8b29986e315743. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:26:04.691449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-6369ddd8-87a8-4037-ab8b-f0562d46de35 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Getting quotas for user 444e13f1f2d945dfb31b83d8e19c2032 and project ad278c0b0b9a41beae8b29986e315743. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:26:04.715749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6369ddd8-87a8-4037-ab8b-f0562d46de35 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:26:04.718655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6369ddd8-87a8-4037-ab8b-f0562d46de35 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:26:04.878083 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6369ddd8-87a8-4037-ab8b-f0562d46de35 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.247993 Oct 29 01:26:04.879589 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2627/5035] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:26:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 2251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:26:04.899367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eab1bc38-b1b0-46a1-b0e2-6d6e3f08f454 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:04.899367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eab1bc38-b1b0-46a1-b0e2-6d6e3f08f454 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] [instance: 7616f1ea-1339-425c-9ab9-45431f3cd608] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:04.912209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eab1bc38-b1b0-46a1-b0e2-6d6e3f08f454 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:04.915583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eab1bc38-b1b0-46a1-b0e2-6d6e3f08f454 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:04.916054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eab1bc38-b1b0-46a1-b0e2-6d6e3f08f454 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:04.916806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eab1bc38-b1b0-46a1-b0e2-6d6e3f08f454 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:04.927024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eab1bc38-b1b0-46a1-b0e2-6d6e3f08f454 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:04.929046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eab1bc38-b1b0-46a1-b0e2-6d6e3f08f454 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:04.978172 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-eab1bc38-b1b0-46a1-b0e2-6d6e3f08f454 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] HTTP exception thrown: Instance 7616f1ea-1339-425c-9ab9-45431f3cd608 could not be found. Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eab1bc38-b1b0-46a1-b0e2-6d6e3f08f454 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Request method failure captured: Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608 HTTP/1.1 Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIB3uNyUu5Y3Zx6dnhpFjAzCimPBh4UVolaCCgXnjltYCGdovC5iC5-1wIOWst6gG8iRuqVrb6lfhSsg1Ud36QVcaUIkyTej3JGoONXf-7ZRXWfQE8Bz0O3N--Rkungy4D4hHcpPDX8DXGcseKsVtEfZR-0UfQDYMlSWRPeMvo2SX_U Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: be0fa8a064884bd9a04bce4ef59bf17c Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ListImageFiltersTestJSON-1305866998 Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/be0fa8a064884bd9a04bce4ef59bf17c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/be0fa8a064884bd9a04bce4ef59bf17c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/be0fa8a064884bd9a04bce4ef59bf17c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_be0fa8a064884bd9a04bce4ef59bf17c", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ListImageFiltersTestJSON-1305866998 Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: be0fa8a064884bd9a04bce4ef59bf17c Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1305866998 Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ListImageFiltersTestJSON-1305866998-project Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 3285141c360f4209bd733520cb44b5ee Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ListImageFiltersTestJSON-1305866998-project Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 7616f1ea-1339-425c-9ab9-45431f3cd608 could not be found. Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '7616f1ea-1339-425c-9ab9-45431f3cd608'} Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7616f1ea-1339-425c-9ab9-45431f3cd608 could not be found. Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7616f1ea-1339-425c-9ab9-45431f3cd608 could not be found. Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:04.979801 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:04.983805 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:04.983805 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:04.983805 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:04.983805 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:26:04.983805 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:26:04.983805 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7616f1ea-1339-425c-9ab9-45431f3cd608 could not be found. Oct 29 01:26:04.983805 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:04.983805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eab1bc38-b1b0-46a1-b0e2-6d6e3f08f454 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Returning 404 to user: Instance 7616f1ea-1339-425c-9ab9-45431f3cd608 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:26:04.983805 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eab1bc38-b1b0-46a1-b0e2-6d6e3f08f454 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "GET /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608" status: 404 len: 111 microversion: 2.1 time: 0.100326 Oct 29 01:26:04.984936 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2628/5036] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:04 2022] GET /compute/v2.1/servers/7616f1ea-1339-425c-9ab9-45431f3cd608 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:26:04.990638 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.network.neutron [None req-ae9e7e77-6441-4efa-93cb-cdd838949abb tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] re-assign floating IP 172.25.8.73 from instance d81519da-d650-41a7-a009-4bcfb4e94d92 Oct 29 01:26:05.150927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-ae9e7e77-6441-4efa-93cb-cdd838949abb tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Building network info cache for instance {{(pid=121100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 01:26:05.405380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-5b7e5f11-0a95-47c5-b0a0-cdac273c2816 req-096d8b7a-ca91-4234-b0b2-828e360fe897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d81519da-d650-41a7-a009-4bcfb4e94d92", "tag": "ce177e8d-5249-49d2-a188-951d6561d827"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:05.446827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5b7e5f11-0a95-47c5-b0a0-cdac273c2816 req-096d8b7a-ca91-4234-b0b2-828e360fe897 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:05.461379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5b7e5f11-0a95-47c5-b0a0-cdac273c2816 req-096d8b7a-ca91-4234-b0b2-828e360fe897 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:05.462576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5b7e5f11-0a95-47c5-b0a0-cdac273c2816 req-096d8b7a-ca91-4234-b0b2-828e360fe897 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:05.514503 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-5b7e5f11-0a95-47c5-b0a0-cdac273c2816 req-096d8b7a-ca91-4234-b0b2-828e360fe897 service nova] Creating event network-changed:ce177e8d-5249-49d2-a188-951d6561d827 for instance d81519da-d650-41a7-a009-4bcfb4e94d92 on n-h1-862964-3 Oct 29 01:26:05.539919 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-5b7e5f11-0a95-47c5-b0a0-cdac273c2816 req-096d8b7a-ca91-4234-b0b2-828e360fe897 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.553489 Oct 29 01:26:05.544464 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2629/5037] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:26:05.561268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dea6bb34-d0ef-4af1-a8fe-573accf4dd51 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:05.579194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dea6bb34-d0ef-4af1-a8fe-573accf4dd51 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:05.837034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dea6bb34-d0ef-4af1-a8fe-573accf4dd51 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:05.851566 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dea6bb34-d0ef-4af1-a8fe-573accf4dd51 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1240 microversion: 2.1 time: 0.305049 Oct 29 01:26:05.853289 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2630/5038] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:05 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1240 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:05.872859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-72d51200-1f9a-4dad-beff-0fa6fb4f5651 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d96feaca0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:07.130211 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-72d51200-1f9a-4dad-beff-0fa6fb4f5651 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "DELETE /compute/v2.1/images/6744085f-4562-48ff-815f-1f4c8cdd25e6" status: 204 len: 0 microversion: 2.1 time: 1.275452 Oct 29 01:26:07.130980 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2631/5039] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:05 2022] DELETE /compute/v2.1/images/6744085f-4562-48ff-815f-1f4c8cdd25e6 => generated 0 bytes in 1277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:26:07.136246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-28ac26b7-15c7-4670-a0e2-a484f6b64775 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:07.137497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-28ac26b7-15c7-4670-a0e2-a484f6b64775 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:07.150162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28ac26b7-15c7-4670-a0e2-a484f6b64775 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:07.163602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28ac26b7-15c7-4670-a0e2-a484f6b64775 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:07.165740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28ac26b7-15c7-4670-a0e2-a484f6b64775 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:07.166787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28ac26b7-15c7-4670-a0e2-a484f6b64775 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:07.169847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28ac26b7-15c7-4670-a0e2-a484f6b64775 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:07.182259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28ac26b7-15c7-4670-a0e2-a484f6b64775 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:07.388193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-28ac26b7-15c7-4670-a0e2-a484f6b64775 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:07.413355 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-28ac26b7-15c7-4670-a0e2-a484f6b64775 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1236 microversion: 2.1 time: 0.280975 Oct 29 01:26:07.451270 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2632/5040] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:07 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1236 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:07.458761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cb254b98-a68d-46bb-8e7c-534ec82b1b18 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d97769820>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:08.324893 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cb254b98-a68d-46bb-8e7c-534ec82b1b18 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "DELETE /compute/v2.1/images/4ffe4e91-2e2e-41b9-b305-91655e674d65" status: 204 len: 0 microversion: 2.1 time: 0.872386 Oct 29 01:26:08.326819 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2633/5041] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:07 2022] DELETE /compute/v2.1/images/4ffe4e91-2e2e-41b9-b305-91655e674d65 => generated 0 bytes in 874 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:26:08.332291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c3ebecae-c898-4304-a02b-f2def7dbf65d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:08.332807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c3ebecae-c898-4304-a02b-f2def7dbf65d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:08.347846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3ebecae-c898-4304-a02b-f2def7dbf65d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:08.348346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3ebecae-c898-4304-a02b-f2def7dbf65d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:08.348787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3ebecae-c898-4304-a02b-f2def7dbf65d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:08.367321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3ebecae-c898-4304-a02b-f2def7dbf65d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:08.367321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3ebecae-c898-4304-a02b-f2def7dbf65d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:08.367321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3ebecae-c898-4304-a02b-f2def7dbf65d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:08.387848 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-c3ebecae-c898-4304-a02b-f2def7dbf65d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] HTTP exception thrown: Instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 could not be found. Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c3ebecae-c898-4304-a02b-f2def7dbf65d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Request method failure captured: Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 HTTP/1.1 Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8T9cSwFdJFodh1W8ghdDQmW-pn2kyLAmJXDG7JqHwQkxp1x5-_ByQ-M0MZ8IOINzMBo75Sz9HUttVi23Drj0OxToLqamj3b5WVLkWAdoa9pgDpa8xhbIm5zRvocGwXrBeVCRAZ4KTonRKxYXOK3B23izcAyBa6r1a6xlpcK4m2cXc Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: d45b8f0077804db29ad5864327aa6bbb Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeTestJSON-1597110018 Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d45b8f0077804db29ad5864327aa6bbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d45b8f0077804db29ad5864327aa6bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d45b8f0077804db29ad5864327aa6bbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d45b8f0077804db29ad5864327aa6bbb", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeTestJSON-1597110018 Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: d45b8f0077804db29ad5864327aa6bbb Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1597110018 Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AttachVolumeTestJSON-1597110018-project Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 7d922c9f49ff4e87b7b1ca2e10766c53 Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeTestJSON-1597110018-project Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 could not be found. Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'c7341065-fb16-4c56-9924-fe9a56d7a7b3'} Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 could not be found. Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:26:08.396610 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:26:08.408163 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 could not be found. Oct 29 01:26:08.408163 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:08.408163 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:08.408163 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:08.408163 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:08.408163 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:08.408163 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:08.408163 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:26:08.408163 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:26:08.408163 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 could not be found. Oct 29 01:26:08.408163 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:08.408163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c3ebecae-c898-4304-a02b-f2def7dbf65d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Returning 404 to user: Instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:26:08.408163 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c3ebecae-c898-4304-a02b-f2def7dbf65d tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 404 len: 111 microversion: 2.1 time: 0.071286 Oct 29 01:26:08.408163 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2634/5042] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:26:08 2022] DELETE /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:26:08.408163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-20b2dd24-2d24-4987-a793-2c82c4a7f66f req-bebccf0f-6dd6-485e-a0cc-ddc01f08a274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3928147-60bb-4304-90a7-103deb29e0ed", "tag": "1d88b97b-733a-44d8-a8a7-2f0c1fe45f26"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:08.435649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-20b2dd24-2d24-4987-a793-2c82c4a7f66f req-bebccf0f-6dd6-485e-a0cc-ddc01f08a274 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:08.436212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-20b2dd24-2d24-4987-a793-2c82c4a7f66f req-bebccf0f-6dd6-485e-a0cc-ddc01f08a274 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:08.436743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-20b2dd24-2d24-4987-a793-2c82c4a7f66f req-bebccf0f-6dd6-485e-a0cc-ddc01f08a274 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:08.467557 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-20b2dd24-2d24-4987-a793-2c82c4a7f66f req-bebccf0f-6dd6-485e-a0cc-ddc01f08a274 service nova] Creating event network-changed:1d88b97b-733a-44d8-a8a7-2f0c1fe45f26 for instance a3928147-60bb-4304-90a7-103deb29e0ed on n-h2-862964-3 Oct 29 01:26:08.480596 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-20b2dd24-2d24-4987-a793-2c82c4a7f66f req-bebccf0f-6dd6-485e-a0cc-ddc01f08a274 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079827 Oct 29 01:26:08.481228 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2635/5043] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:26:08.499545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eee490b1-6042-47bb-a691-03ec0684bf15 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] Calling method '.version_select at 0x7f9d977698b0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:09.082845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-ae9e7e77-6441-4efa-93cb-cdd838949abb tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Updating instance_info_cache with network_info: [{"id": "ce177e8d-5249-49d2-a188-951d6561d827", "address": "fa:16:3e:52:aa:fc", "network": {"id": "bf44a312-d8d4-4636-8ed4-e759797fbb2e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-880825101-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0dd5d9ef52524461a5ea497010bd3dc0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapce177e8d-52", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 01:26:09.206561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-ae9e7e77-6441-4efa-93cb-cdd838949abb tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Building network info cache for instance {{(pid=121100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 01:26:09.732484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=31 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:26:10.064439 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eee490b1-6042-47bb-a691-03ec0684bf15 tempest-ListImageFiltersTestJSON-1305866998 tempest-ListImageFiltersTestJSON-1305866998-project] 10.222.0.26 "DELETE /compute/v2.1/images/fa160d85-3663-46ee-870c-9e4bafc02bc6" status: 204 len: 0 microversion: 2.1 time: 1.576720 Oct 29 01:26:10.067745 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2636/5044] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:08 2022] DELETE /compute/v2.1/images/fa160d85-3663-46ee-870c-9e4bafc02bc6 => generated 0 bytes in 1584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:26:10.083023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a5968ed2-eeff-4020-b9cd-cb1252b600f5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:10.084102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a5968ed2-eeff-4020-b9cd-cb1252b600f5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] [instance: c7341065-fb16-4c56-9924-fe9a56d7a7b3] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:10.099165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a5968ed2-eeff-4020-b9cd-cb1252b600f5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:10.099570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a5968ed2-eeff-4020-b9cd-cb1252b600f5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:10.100133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a5968ed2-eeff-4020-b9cd-cb1252b600f5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:10.101304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a5968ed2-eeff-4020-b9cd-cb1252b600f5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:10.102586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a5968ed2-eeff-4020-b9cd-cb1252b600f5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:10.103450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a5968ed2-eeff-4020-b9cd-cb1252b600f5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:10.146709 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-a5968ed2-eeff-4020-b9cd-cb1252b600f5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] HTTP exception thrown: Instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 could not be found. Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a5968ed2-eeff-4020-b9cd-cb1252b600f5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Request method failure captured: Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 HTTP/1.1 Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXH8T9cSwFdJFodh1W8ghdDQmW-pn2kyLAmJXDG7JqHwQkxp1x5-_ByQ-M0MZ8IOINzMBo75Sz9HUttVi23Drj0OxToLqamj3b5WVLkWAdoa9pgDpa8xhbIm5zRvocGwXrBeVCRAZ4KTonRKxYXOK3B23izcAyBa6r1a6xlpcK4m2cXc Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: d45b8f0077804db29ad5864327aa6bbb Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeTestJSON-1597110018 Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d45b8f0077804db29ad5864327aa6bbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d45b8f0077804db29ad5864327aa6bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d45b8f0077804db29ad5864327aa6bbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d45b8f0077804db29ad5864327aa6bbb", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeTestJSON-1597110018 Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: d45b8f0077804db29ad5864327aa6bbb Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1597110018 Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AttachVolumeTestJSON-1597110018-project Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 7d922c9f49ff4e87b7b1ca2e10766c53 Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeTestJSON-1597110018-project Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 could not be found. Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'c7341065-fb16-4c56-9924-fe9a56d7a7b3'} Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 could not be found. Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 could not be found. Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:10.149321 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:10.154135 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:10.154135 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:10.154135 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:10.154135 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:26:10.154135 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:26:10.154135 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 could not be found. Oct 29 01:26:10.154135 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:10.156278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a5968ed2-eeff-4020-b9cd-cb1252b600f5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] Returning 404 to user: Instance c7341065-fb16-4c56-9924-fe9a56d7a7b3 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:26:10.157707 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a5968ed2-eeff-4020-b9cd-cb1252b600f5 tempest-AttachVolumeTestJSON-1597110018 tempest-AttachVolumeTestJSON-1597110018-project] 10.222.0.26 "GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3" status: 404 len: 111 microversion: 2.1 time: 0.087069 Oct 29 01:26:10.159378 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2637/5045] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:10 2022] GET /compute/v2.1/servers/c7341065-fb16-4c56-9924-fe9a56d7a7b3 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:26:10.169747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-28792de7-63de-4e62-880b-79f30c0f3e2f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:10.171879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-28792de7-63de-4e62-880b-79f30c0f3e2f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:10.178897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28792de7-63de-4e62-880b-79f30c0f3e2f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:10.180143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28792de7-63de-4e62-880b-79f30c0f3e2f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:10.180799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28792de7-63de-4e62-880b-79f30c0f3e2f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:10.182403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28792de7-63de-4e62-880b-79f30c0f3e2f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:10.183067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28792de7-63de-4e62-880b-79f30c0f3e2f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:10.183709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28792de7-63de-4e62-880b-79f30c0f3e2f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:10.360435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-28792de7-63de-4e62-880b-79f30c0f3e2f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:10.368821 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-28792de7-63de-4e62-880b-79f30c0f3e2f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1298 microversion: 2.1 time: 0.208152 Oct 29 01:26:10.373055 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2638/5046] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:10 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1298 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:11.405405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dd20b3d6-4589-46e9-8864-689b7d03e386 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:11.406289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dd20b3d6-4589-46e9-8864-689b7d03e386 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:11.414224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd20b3d6-4589-46e9-8864-689b7d03e386 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:11.414721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd20b3d6-4589-46e9-8864-689b7d03e386 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:11.415160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd20b3d6-4589-46e9-8864-689b7d03e386 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:11.419216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd20b3d6-4589-46e9-8864-689b7d03e386 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:11.425128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd20b3d6-4589-46e9-8864-689b7d03e386 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:11.425128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dd20b3d6-4589-46e9-8864-689b7d03e386 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:11.783428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dd20b3d6-4589-46e9-8864-689b7d03e386 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:11.793786 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dd20b3d6-4589-46e9-8864-689b7d03e386 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1298 microversion: 2.1 time: 0.401002 Oct 29 01:26:11.830897 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2639/5047] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:11 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1298 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:11.881591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-ae9e7e77-6441-4efa-93cb-cdd838949abb tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Updating instance_info_cache with network_info: [{"id": "1d88b97b-733a-44d8-a8a7-2f0c1fe45f26", "address": "fa:16:3e:21:54:8e", "network": {"id": "bf44a312-d8d4-4636-8ed4-e759797fbb2e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-880825101-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0dd5d9ef52524461a5ea497010bd3dc0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1d88b97b-73", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 01:26:11.914078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae9e7e77-6441-4efa-93cb-cdd838949abb tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Releasing lock "refresh_cache-a3928147-60bb-4304-90a7-103deb29e0ed" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 01:26:11.919080 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ae9e7e77-6441-4efa-93cb-cdd838949abb tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "POST /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed/action" status: 202 len: 0 microversion: 2.1 time: 12.203198 Oct 29 01:26:11.920831 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2409/5048] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:25:59 2022] POST /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed/action => generated 0 bytes in 12208 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 29 01:26:11.934500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-15e809db-9688-493e-9457-18287d8c4f2a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.73"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:12.121874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-64b5eaa6-8493-4386-996c-000adecb5f48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:12.122549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-64b5eaa6-8493-4386-996c-000adecb5f48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:12.131190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64b5eaa6-8493-4386-996c-000adecb5f48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:12.135288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64b5eaa6-8493-4386-996c-000adecb5f48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:12.135288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64b5eaa6-8493-4386-996c-000adecb5f48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:12.135288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64b5eaa6-8493-4386-996c-000adecb5f48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:12.135288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64b5eaa6-8493-4386-996c-000adecb5f48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:12.135288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64b5eaa6-8493-4386-996c-000adecb5f48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:12.152412 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-64b5eaa6-8493-4386-996c-000adecb5f48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] HTTP exception thrown: Instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 could not be found. Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-64b5eaa6-8493-4386-996c-000adecb5f48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Request method failure captured: Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 HTTP/1.1 Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH9ilRpZCv6prdSXvFp0o42ViefpGJ2y5sauF3sQV9_1uVoucNH0fO6eozzDhFxTBlST3IfD-b5GI_NDo1yW6_hFg4eHv0lyYhS5zwBJk16Roj9U_gt-t8krfDuzogVwMbx6hBzKytGGCCbtPR02lb2bUSyzfMf5pSo9lr0vzh9Osk8 Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-Openstack-Nova-Api-Version: 2.32 Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: c226e05b4c2943a28fac5c95f02c8e68 Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TaggedBootDevicesTest-155412317 Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c226e05b4c2943a28fac5c95f02c8e68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c226e05b4c2943a28fac5c95f02c8e68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c226e05b4c2943a28fac5c95f02c8e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c226e05b4c2943a28fac5c95f02c8e68", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TaggedBootDevicesTest-155412317 Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: c226e05b4c2943a28fac5c95f02c8e68 Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TaggedBootDevicesTest-155412317 Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TaggedBootDevicesTest-155412317-project Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 34417a5511824b5aa82ce131f6a1324c Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TaggedBootDevicesTest-155412317-project Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 could not be found. Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9'} Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 could not be found. Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:26:12.155155 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:26:12.159769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 could not be found. Oct 29 01:26:12.159769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:12.159769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:12.159769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:12.159769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:12.159769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:12.159769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:12.159769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:26:12.159769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:26:12.159769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 could not be found. Oct 29 01:26:12.159769 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:12.162828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-64b5eaa6-8493-4386-996c-000adecb5f48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Returning 404 to user: Instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:26:12.163986 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-64b5eaa6-8493-4386-996c-000adecb5f48 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "DELETE /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 404 len: 111 microversion: 2.32 time: 0.059822 Oct 29 01:26:12.169313 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2410/5049] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:26:12 2022] DELETE /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:26:12.174859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-997a825e-6488-4588-8a7a-04f64d3a2886 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:12.176121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-997a825e-6488-4588-8a7a-04f64d3a2886 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] [instance: 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:12.184384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-997a825e-6488-4588-8a7a-04f64d3a2886 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:12.185133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-997a825e-6488-4588-8a7a-04f64d3a2886 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:12.185840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-997a825e-6488-4588-8a7a-04f64d3a2886 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:12.187296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-997a825e-6488-4588-8a7a-04f64d3a2886 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:12.187987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-997a825e-6488-4588-8a7a-04f64d3a2886 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:12.188901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-997a825e-6488-4588-8a7a-04f64d3a2886 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:12.209804 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-997a825e-6488-4588-8a7a-04f64d3a2886 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] HTTP exception thrown: Instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 could not be found. Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-997a825e-6488-4588-8a7a-04f64d3a2886 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Request method failure captured: Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 HTTP/1.1 Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXH9ilRpZCv6prdSXvFp0o42ViefpGJ2y5sauF3sQV9_1uVoucNH0fO6eozzDhFxTBlST3IfD-b5GI_NDo1yW6_hFg4eHv0lyYhS5zwBJk16Roj9U_gt-t8krfDuzogVwMbx6hBzKytGGCCbtPR02lb2bUSyzfMf5pSo9lr0vzh9Osk8 Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-Openstack-Nova-Api-Version: 2.32 Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: c226e05b4c2943a28fac5c95f02c8e68 Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TaggedBootDevicesTest-155412317 Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c226e05b4c2943a28fac5c95f02c8e68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c226e05b4c2943a28fac5c95f02c8e68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c226e05b4c2943a28fac5c95f02c8e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c226e05b4c2943a28fac5c95f02c8e68", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TaggedBootDevicesTest-155412317 Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: c226e05b4c2943a28fac5c95f02c8e68 Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TaggedBootDevicesTest-155412317 Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TaggedBootDevicesTest-155412317-project Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 34417a5511824b5aa82ce131f6a1324c Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TaggedBootDevicesTest-155412317-project Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 could not be found. Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9'} Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 could not be found. Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 could not be found. Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:12.211693 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:12.220472 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:12.220472 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:12.220472 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:12.220472 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:26:12.220472 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:26:12.220472 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 could not be found. Oct 29 01:26:12.220472 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:12.220472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-997a825e-6488-4588-8a7a-04f64d3a2886 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] Returning 404 to user: Instance 40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:26:12.220472 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-997a825e-6488-4588-8a7a-04f64d3a2886 tempest-TaggedBootDevicesTest-155412317 tempest-TaggedBootDevicesTest-155412317-project] 10.222.0.26 "GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9" status: 404 len: 111 microversion: 2.32 time: 0.042743 Oct 29 01:26:12.231795 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2411/5050] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:26:12 2022] GET /compute/v2.1/servers/40fe7e0a-2bbf-42b7-9e7d-e2e0677ef1d9 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:26:12.822069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-28b7eaf6-03cf-4b6d-b3e6-3159753cb359 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:12.823208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-28b7eaf6-03cf-4b6d-b3e6-3159753cb359 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:12.835733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-15e809db-9688-493e-9457-18287d8c4f2a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:12.842236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15e809db-9688-493e-9457-18287d8c4f2a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:12.842736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15e809db-9688-493e-9457-18287d8c4f2a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:12.843932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15e809db-9688-493e-9457-18287d8c4f2a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:12.852465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28b7eaf6-03cf-4b6d-b3e6-3159753cb359 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:12.852465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28b7eaf6-03cf-4b6d-b3e6-3159753cb359 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:12.852683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15e809db-9688-493e-9457-18287d8c4f2a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:12.852767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28b7eaf6-03cf-4b6d-b3e6-3159753cb359 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:12.852844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15e809db-9688-493e-9457-18287d8c4f2a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:12.852844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15e809db-9688-493e-9457-18287d8c4f2a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:12.853015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28b7eaf6-03cf-4b6d-b3e6-3159753cb359 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:12.854213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28b7eaf6-03cf-4b6d-b3e6-3159753cb359 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:12.855029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-28b7eaf6-03cf-4b6d-b3e6-3159753cb359 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:13.464930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-28b7eaf6-03cf-4b6d-b3e6-3159753cb359 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:13.486528 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-28b7eaf6-03cf-4b6d-b3e6-3159753cb359 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1366 microversion: 2.1 time: 0.665363 Oct 29 01:26:13.488238 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2412/5051] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:12 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1366 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-15e809db-9688-493e-9457-18287d8c4f2a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] HTTP exception thrown: Floating IP 172.25.8.73 is not associated with instance d81519da-d650-41a7-a009-4bcfb4e94d92. Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-15e809db-9688-493e-9457-18287d8c4f2a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Request method failure captured: Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92/action HTTP/1.1 Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 48 Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIDw5iiGVoUj0ExthEAokOqFRDebhDZpEkOyYI8F23AZXo514CdlVYTYZLdHye7kYeEsnoDGSbYnJYOtj76oiDya1A1o9ZR-LVMHM8ym3i6FfK5TS2bjHXqAg3PcLNNmLfEW4-rGO0gronpYf6Ro21UFE8ZfYT2f_iw4wMwa4Iukkhc Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 0dd5d9ef52524461a5ea497010bd3dc0 Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1246765038 Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0dd5d9ef52524461a5ea497010bd3dc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0dd5d9ef52524461a5ea497010bd3dc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0dd5d9ef52524461a5ea497010bd3dc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0dd5d9ef52524461a5ea497010bd3dc0", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1246765038 Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 0dd5d9ef52524461a5ea497010bd3dc0 Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1246765038 Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-FloatingIPsAssociationTestJSON-1246765038-project Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: b7d6b090698b4ac29481af8eb9fa6b3c Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1246765038-project Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: {"removeFloatingIp": {"address": "172.25.8.73"}} Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: exception: Floating IP 172.25.8.73 is not associated with instance d81519da-d650-41a7-a009-4bcfb4e94d92. Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'd81519da-d650-41a7-a009-4bcfb4e94d92', 'body': {'removeFloatingIp': {'address': '172.25.8.73'}}} Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.8.73 is not associated with instance d81519da-d650-41a7-a009-4bcfb4e94d92. Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.8.73 is not associated with instance d81519da-d650-41a7-a009-4bcfb4e94d92. Oct 29 01:26:14.101028 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:14.106211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-15e809db-9688-493e-9457-18287d8c4f2a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Returning 409 to user: Floating IP 172.25.8.73 is not associated with instance d81519da-d650-41a7-a009-4bcfb4e94d92. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:26:14.107826 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-15e809db-9688-493e-9457-18287d8c4f2a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "POST /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92/action" status: 409 len: 145 microversion: 2.1 time: 2.177177 Oct 29 01:26:14.109116 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2640/5052] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:26:11 2022] POST /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92/action => generated 145 bytes in 2182 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:26:14.119263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e40ea2b7-b76d-4947-95b0-02572493da2d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.73"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:14.514042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-683b1ca0-01f6-41cf-9b47-841b4cdafa98 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:14.515401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-683b1ca0-01f6-41cf-9b47-841b4cdafa98 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:14.524680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-683b1ca0-01f6-41cf-9b47-841b4cdafa98 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:14.533640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-683b1ca0-01f6-41cf-9b47-841b4cdafa98 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:14.535929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-683b1ca0-01f6-41cf-9b47-841b4cdafa98 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:14.542473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-683b1ca0-01f6-41cf-9b47-841b4cdafa98 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:14.543113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-683b1ca0-01f6-41cf-9b47-841b4cdafa98 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:14.545089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-683b1ca0-01f6-41cf-9b47-841b4cdafa98 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:14.617013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e40ea2b7-b76d-4947-95b0-02572493da2d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:14.625500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e40ea2b7-b76d-4947-95b0-02572493da2d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:14.626762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e40ea2b7-b76d-4947-95b0-02572493da2d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:14.627500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e40ea2b7-b76d-4947-95b0-02572493da2d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:14.632822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e40ea2b7-b76d-4947-95b0-02572493da2d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:14.632822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e40ea2b7-b76d-4947-95b0-02572493da2d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:14.633627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e40ea2b7-b76d-4947-95b0-02572493da2d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:14.669682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:26:15.111557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e40ea2b7-b76d-4947-95b0-02572493da2d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "refresh_cache-a3928147-60bb-4304-90a7-103deb29e0ed" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 01:26:15.112053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e40ea2b7-b76d-4947-95b0-02572493da2d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquired lock "refresh_cache-a3928147-60bb-4304-90a7-103deb29e0ed" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 01:26:15.120254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-683b1ca0-01f6-41cf-9b47-841b4cdafa98 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:15.137953 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-683b1ca0-01f6-41cf-9b47-841b4cdafa98 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1366 microversion: 2.1 time: 0.629914 Oct 29 01:26:15.165344 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2641/5053] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:14 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1366 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:26:15.578637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1fdfe7bd-1dab-451e-816d-d206a06c0450 tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-529096225", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:15.582022 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-1fdfe7bd-1dab-451e-816d-d206a06c0450 tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] HTTP exception thrown: min_count must be <= max_count Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1fdfe7bd-1dab-451e-816d-d206a06c0450 tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] Request method failure captured: Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 183 Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIE2t9DgsrOEpvgcVOg7R4L_4GhJ4k2o8NbKsJKQHYakLF1xdHBNrBwQENcrJfeEmLSaLDGRD2NVkI0v7kON-sQWgl05NSXxFrk5DQiZNoMqFIpi0tqFLs210CHldIgF2f-znPLyif-nvjpp5moZs7gBvcfxZ4SmRwfgq-DiJ-IdjmM Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 392c7737452e4ecb94201d7d6d8648b5 Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-787352866 Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/392c7737452e4ecb94201d7d6d8648b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/392c7737452e4ecb94201d7d6d8648b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/392c7737452e4ecb94201d7d6d8648b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_392c7737452e4ecb94201d7d6d8648b5", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-787352866 Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 392c7737452e4ecb94201d7d6d8648b5 Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-787352866 Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-MultipleCreateNegativeTestJSON-787352866-project Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8f052b838d1c4788925736145d9713f3 Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-787352866-project Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-529096225", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: exception: min_count must be <= max_count Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-529096225', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 29 01:26:15.584440 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.588669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1fdfe7bd-1dab-451e-816d-d206a06c0450 tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] Returning 400 to user: min_count must be <= max_count {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:26:15.588669 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1fdfe7bd-1dab-451e-816d-d206a06c0450 tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.416763 Oct 29 01:26:15.619116 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2642/5054] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:26:15 2022] POST /compute/v2.1/servers => generated 74 bytes in 447 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 01:26:15.685123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a579073c-7deb-4219-8e2f-bcf6ca3f2994 tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-89890219", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "max_count": 0}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a579073c-7deb-4219-8e2f-bcf6ca3f2994 tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] Request method failure captured: Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 166 Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIE2t9DgsrOEpvgcVOg7R4L_4GhJ4k2o8NbKsJKQHYakLF1xdHBNrBwQENcrJfeEmLSaLDGRD2NVkI0v7kON-sQWgl05NSXxFrk5DQiZNoMqFIpi0tqFLs210CHldIgF2f-znPLyif-nvjpp5moZs7gBvcfxZ4SmRwfgq-DiJ-IdjmM Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 392c7737452e4ecb94201d7d6d8648b5 Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-787352866 Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/392c7737452e4ecb94201d7d6d8648b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/392c7737452e4ecb94201d7d6d8648b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/392c7737452e4ecb94201d7d6d8648b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_392c7737452e4ecb94201d7d6d8648b5", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-787352866 Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 392c7737452e4ecb94201d7d6d8648b5 Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-787352866 Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-MultipleCreateNegativeTestJSON-787352866-project Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8f052b838d1c4788925736145d9713f3 Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-787352866-project Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-89890219", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "max_count": 0}} Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-89890219', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'max_count': 0}}} Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 0 Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:26:15.700432 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:26:15.705133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:26:15.705133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:26:15.705133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:26:15.705133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:26:15.705133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 29 01:26:15.705133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.705133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:15.705133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.705133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:15.705133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:15.705133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:15.705133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:26:15.705133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:26:15.705133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 29 01:26:15.705133 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.705133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a579073c-7deb-4219-8e2f-bcf6ca3f2994 tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:26:15.705133 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a579073c-7deb-4219-8e2f-bcf6ca3f2994 tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.025169 Oct 29 01:26:15.717696 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2643/5055] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:26:15 2022] POST /compute/v2.1/servers => generated 130 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:26:15.787147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-56a9c57a-e292-41c7-b6e3-f1390d54f8ae tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-978896521", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "max_count": 2.5}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-56a9c57a-e292-41c7-b6e3-f1390d54f8ae tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] Request method failure captured: Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 169 Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIE2t9DgsrOEpvgcVOg7R4L_4GhJ4k2o8NbKsJKQHYakLF1xdHBNrBwQENcrJfeEmLSaLDGRD2NVkI0v7kON-sQWgl05NSXxFrk5DQiZNoMqFIpi0tqFLs210CHldIgF2f-znPLyif-nvjpp5moZs7gBvcfxZ4SmRwfgq-DiJ-IdjmM Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 392c7737452e4ecb94201d7d6d8648b5 Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-787352866 Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/392c7737452e4ecb94201d7d6d8648b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/392c7737452e4ecb94201d7d6d8648b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/392c7737452e4ecb94201d7d6d8648b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_392c7737452e4ecb94201d7d6d8648b5", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-787352866 Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 392c7737452e4ecb94201d7d6d8648b5 Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-787352866 Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-MultipleCreateNegativeTestJSON-787352866-project Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8f052b838d1c4788925736145d9713f3 Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-787352866-project Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-978896521", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "max_count": 2.5}} Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-978896521', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'max_count': 2.5}}} Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 2.5 Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:26:15.792167 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:26:15.796524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:26:15.796524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:26:15.796524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:26:15.796524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:26:15.796524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 01:26:15.796524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.796524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:15.796524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.796524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:15.796524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:15.796524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:15.796524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:26:15.796524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:26:15.796524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 01:26:15.796524 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.800377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-56a9c57a-e292-41c7-b6e3-f1390d54f8ae tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:26:15.803898 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-56a9c57a-e292-41c7-b6e3-f1390d54f8ae tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.023362 Oct 29 01:26:15.807246 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2644/5056] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:26:15 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 01:26:15.893558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=12 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:26:15.899627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7cc6ca86-347d-43f0-8bfd-ec8c804b87f3 tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-343895021", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "min_count": 0}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7cc6ca86-347d-43f0-8bfd-ec8c804b87f3 tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] Request method failure captured: Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 167 Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIE2t9DgsrOEpvgcVOg7R4L_4GhJ4k2o8NbKsJKQHYakLF1xdHBNrBwQENcrJfeEmLSaLDGRD2NVkI0v7kON-sQWgl05NSXxFrk5DQiZNoMqFIpi0tqFLs210CHldIgF2f-znPLyif-nvjpp5moZs7gBvcfxZ4SmRwfgq-DiJ-IdjmM Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 392c7737452e4ecb94201d7d6d8648b5 Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-787352866 Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/392c7737452e4ecb94201d7d6d8648b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/392c7737452e4ecb94201d7d6d8648b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/392c7737452e4ecb94201d7d6d8648b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_392c7737452e4ecb94201d7d6d8648b5", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-787352866 Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 392c7737452e4ecb94201d7d6d8648b5 Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-787352866 Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-MultipleCreateNegativeTestJSON-787352866-project Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8f052b838d1c4788925736145d9713f3 Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-787352866-project Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-343895021", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "min_count": 0}} Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-343895021', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'min_count': 0}}} Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 0 Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:26:15.910907 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:26:15.920728 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:26:15.920728 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:26:15.920728 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:26:15.920728 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:26:15.920728 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 29 01:26:15.920728 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.920728 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:15.920728 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.920728 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:15.920728 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:15.920728 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:15.920728 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:26:15.920728 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:26:15.920728 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 29 01:26:15.920728 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.920728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7cc6ca86-347d-43f0-8bfd-ec8c804b87f3 tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:26:15.925323 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7cc6ca86-347d-43f0-8bfd-ec8c804b87f3 tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.024397 Oct 29 01:26:15.927933 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2645/5057] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:26:15 2022] POST /compute/v2.1/servers => generated 130 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:26:15.995419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fa969477-137f-4973-a960-0f9a4fab8b35 tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1108254023", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "min_count": 2.5}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fa969477-137f-4973-a960-0f9a4fab8b35 tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] Request method failure captured: Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 170 Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIE2t9DgsrOEpvgcVOg7R4L_4GhJ4k2o8NbKsJKQHYakLF1xdHBNrBwQENcrJfeEmLSaLDGRD2NVkI0v7kON-sQWgl05NSXxFrk5DQiZNoMqFIpi0tqFLs210CHldIgF2f-znPLyif-nvjpp5moZs7gBvcfxZ4SmRwfgq-DiJ-IdjmM Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 392c7737452e4ecb94201d7d6d8648b5 Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-787352866 Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/392c7737452e4ecb94201d7d6d8648b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/392c7737452e4ecb94201d7d6d8648b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/392c7737452e4ecb94201d7d6d8648b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_392c7737452e4ecb94201d7d6d8648b5", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-787352866 Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 392c7737452e4ecb94201d7d6d8648b5 Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-787352866 Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-MultipleCreateNegativeTestJSON-787352866-project Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8f052b838d1c4788925736145d9713f3 Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-787352866-project Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1108254023", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "min_count": 2.5}} Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1108254023', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'min_count': 2.5}}} Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 2.5 Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:26:15.997828 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:26:16.002206 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:26:16.002206 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:26:16.002206 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:26:16.002206 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:26:16.002206 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 01:26:16.002206 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:16.002206 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:16.002206 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:16.002206 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:16.002206 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:16.002206 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:16.002206 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:26:16.002206 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:26:16.002206 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 01:26:16.002206 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:26:16.004317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fa969477-137f-4973-a960-0f9a4fab8b35 tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:26:16.009671 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fa969477-137f-4973-a960-0f9a4fab8b35 tempest-MultipleCreateNegativeTestJSON-787352866 tempest-MultipleCreateNegativeTestJSON-787352866-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017802 Oct 29 01:26:16.010707 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2646/5058] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:26:15 2022] POST /compute/v2.1/servers => generated 139 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 01:26:16.164409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1b91ac9e-8068-4d39-b00f-107e87aa5066 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:16.165048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1b91ac9e-8068-4d39-b00f-107e87aa5066 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:16.175287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b91ac9e-8068-4d39-b00f-107e87aa5066 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:16.175789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b91ac9e-8068-4d39-b00f-107e87aa5066 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:16.176487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b91ac9e-8068-4d39-b00f-107e87aa5066 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:16.177256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b91ac9e-8068-4d39-b00f-107e87aa5066 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:16.177692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b91ac9e-8068-4d39-b00f-107e87aa5066 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:16.178120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b91ac9e-8068-4d39-b00f-107e87aa5066 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:16.929224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1b91ac9e-8068-4d39-b00f-107e87aa5066 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:16.938061 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1b91ac9e-8068-4d39-b00f-107e87aa5066 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1366 microversion: 2.1 time: 0.778357 Oct 29 01:26:16.953935 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2647/5059] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:16 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1366 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:17.982075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a9f8b7b3-f3e9-44ed-988e-edf84b1a47b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:17.984573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a9f8b7b3-f3e9-44ed-988e-edf84b1a47b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:17.997078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9f8b7b3-f3e9-44ed-988e-edf84b1a47b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:17.998238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9f8b7b3-f3e9-44ed-988e-edf84b1a47b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:18.002512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9f8b7b3-f3e9-44ed-988e-edf84b1a47b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:18.003700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9f8b7b3-f3e9-44ed-988e-edf84b1a47b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:18.004400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9f8b7b3-f3e9-44ed-988e-edf84b1a47b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:18.005227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9f8b7b3-f3e9-44ed-988e-edf84b1a47b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:18.645015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a9f8b7b3-f3e9-44ed-988e-edf84b1a47b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:18.657479 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a9f8b7b3-f3e9-44ed-988e-edf84b1a47b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1366 microversion: 2.1 time: 0.697499 Oct 29 01:26:18.658576 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2648/5060] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:17 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1366 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:18.664991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4f546713-5458-44ee-b4b8-95aecc9c0274 req-8910732d-8268-4662-8320-06125dda6caf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e86fdd3-e373-4b20-85cf-73ce67194dc2", "tag": "a69b3f30-d8f0-4feb-b963-b6a48a547e63"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:18.692344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4f546713-5458-44ee-b4b8-95aecc9c0274 req-8910732d-8268-4662-8320-06125dda6caf service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:18.692826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4f546713-5458-44ee-b4b8-95aecc9c0274 req-8910732d-8268-4662-8320-06125dda6caf service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:18.693286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4f546713-5458-44ee-b4b8-95aecc9c0274 req-8910732d-8268-4662-8320-06125dda6caf service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:18.713880 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4f546713-5458-44ee-b4b8-95aecc9c0274 req-8910732d-8268-4662-8320-06125dda6caf service nova] Creating event network-changed:a69b3f30-d8f0-4feb-b963-b6a48a547e63 for instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 on n-h1-862964-3 Oct 29 01:26:18.731150 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4f546713-5458-44ee-b4b8-95aecc9c0274 req-8910732d-8268-4662-8320-06125dda6caf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071049 Oct 29 01:26:18.732173 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2649/5061] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:26:19.089393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-e40ea2b7-b76d-4947-95b0-02572493da2d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Building network info cache for instance {{(pid=121100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 01:26:19.699193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e2ed89b1-e9e8-4a4b-b3e0-e343b330d4a1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:19.699193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e2ed89b1-e9e8-4a4b-b3e0-e343b330d4a1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:19.721642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2ed89b1-e9e8-4a4b-b3e0-e343b330d4a1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:19.722510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2ed89b1-e9e8-4a4b-b3e0-e343b330d4a1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:19.725647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2ed89b1-e9e8-4a4b-b3e0-e343b330d4a1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:19.727597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2ed89b1-e9e8-4a4b-b3e0-e343b330d4a1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:19.728716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2ed89b1-e9e8-4a4b-b3e0-e343b330d4a1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:19.735131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2ed89b1-e9e8-4a4b-b3e0-e343b330d4a1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:21.372657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e2ed89b1-e9e8-4a4b-b3e0-e343b330d4a1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:21.383450 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e2ed89b1-e9e8-4a4b-b3e0-e343b330d4a1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1366 microversion: 2.1 time: 1.705901 Oct 29 01:26:21.396853 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2650/5062] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:19 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1366 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:21.418331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-803a827f-49fb-459d-a341-0f6ee39eade6 req-610636c4-7737-480e-a2f4-272a37f0fc86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3928147-60bb-4304-90a7-103deb29e0ed", "tag": "1d88b97b-733a-44d8-a8a7-2f0c1fe45f26"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:21.476878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-803a827f-49fb-459d-a341-0f6ee39eade6 req-610636c4-7737-480e-a2f4-272a37f0fc86 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:21.477838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-803a827f-49fb-459d-a341-0f6ee39eade6 req-610636c4-7737-480e-a2f4-272a37f0fc86 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:21.478618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-803a827f-49fb-459d-a341-0f6ee39eade6 req-610636c4-7737-480e-a2f4-272a37f0fc86 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:21.488435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:26:21.528166 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-803a827f-49fb-459d-a341-0f6ee39eade6 req-610636c4-7737-480e-a2f4-272a37f0fc86 service nova] Creating event network-changed:1d88b97b-733a-44d8-a8a7-2f0c1fe45f26 for instance a3928147-60bb-4304-90a7-103deb29e0ed on n-h2-862964-3 Oct 29 01:26:21.557396 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-803a827f-49fb-459d-a341-0f6ee39eade6 req-610636c4-7737-480e-a2f4-272a37f0fc86 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157455 Oct 29 01:26:21.558326 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2651/5063] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:26:22.414729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-975a94a0-94de-46fc-b264-bccf7e14ec0c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:22.416233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-975a94a0-94de-46fc-b264-bccf7e14ec0c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:22.430562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-975a94a0-94de-46fc-b264-bccf7e14ec0c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:22.432342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-975a94a0-94de-46fc-b264-bccf7e14ec0c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:22.433681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-975a94a0-94de-46fc-b264-bccf7e14ec0c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:22.438711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-975a94a0-94de-46fc-b264-bccf7e14ec0c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:22.440263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-975a94a0-94de-46fc-b264-bccf7e14ec0c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:22.440904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-975a94a0-94de-46fc-b264-bccf7e14ec0c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:23.124732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-e40ea2b7-b76d-4947-95b0-02572493da2d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Updating instance_info_cache with network_info: [{"id": "1d88b97b-733a-44d8-a8a7-2f0c1fe45f26", "address": "fa:16:3e:21:54:8e", "network": {"id": "bf44a312-d8d4-4636-8ed4-e759797fbb2e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-880825101-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0dd5d9ef52524461a5ea497010bd3dc0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1d88b97b-73", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 01:26:23.124732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=63,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=2,nova_cell1:RELEASE=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:26:23.268830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e40ea2b7-b76d-4947-95b0-02572493da2d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Releasing lock "refresh_cache-a3928147-60bb-4304-90a7-103deb29e0ed" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 01:26:23.268830 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e40ea2b7-b76d-4947-95b0-02572493da2d tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "POST /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed/action" status: 202 len: 0 microversion: 2.1 time: 9.153640 Oct 29 01:26:23.268830 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2413/5064] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:26:14 2022] POST /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed/action => generated 0 bytes in 9155 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 01:26:23.277198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-311a364d-e3fe-448e-b65f-f902cce50625 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:23.277671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-311a364d-e3fe-448e-b65f-f902cce50625 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:23.311482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-311a364d-e3fe-448e-b65f-f902cce50625 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:23.311482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-311a364d-e3fe-448e-b65f-f902cce50625 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:23.311482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-311a364d-e3fe-448e-b65f-f902cce50625 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:23.311482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-311a364d-e3fe-448e-b65f-f902cce50625 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:23.311482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-311a364d-e3fe-448e-b65f-f902cce50625 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:23.325862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-311a364d-e3fe-448e-b65f-f902cce50625 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:23.381237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-975a94a0-94de-46fc-b264-bccf7e14ec0c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:23.397543 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-975a94a0-94de-46fc-b264-bccf7e14ec0c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1366 microversion: 2.1 time: 0.988864 Oct 29 01:26:23.398705 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2652/5065] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:22 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1366 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:26:23.400153 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-311a364d-e3fe-448e-b65f-f902cce50625 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:26:23.811049 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-311a364d-e3fe-448e-b65f-f902cce50625 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed" status: 204 len: 0 microversion: 2.1 time: 0.529797 Oct 29 01:26:23.811049 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2414/5066] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:26:23 2022] DELETE /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:26:23.815968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0e1a4d43-1b36-4e07-86b7-19a42d3fcccf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.73"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:23.819143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0e1a4d43-1b36-4e07-86b7-19a42d3fcccf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:23.842383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e1a4d43-1b36-4e07-86b7-19a42d3fcccf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:23.843976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e1a4d43-1b36-4e07-86b7-19a42d3fcccf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:23.846316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e1a4d43-1b36-4e07-86b7-19a42d3fcccf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:23.849306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e1a4d43-1b36-4e07-86b7-19a42d3fcccf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:23.850474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e1a4d43-1b36-4e07-86b7-19a42d3fcccf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:23.851136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e1a4d43-1b36-4e07-86b7-19a42d3fcccf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:23.931207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e1a4d43-1b36-4e07-86b7-19a42d3fcccf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "refresh_cache-d81519da-d650-41a7-a009-4bcfb4e94d92" {{(pid=121099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 01:26:23.932206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e1a4d43-1b36-4e07-86b7-19a42d3fcccf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquired lock "refresh_cache-d81519da-d650-41a7-a009-4bcfb4e94d92" {{(pid=121099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 01:26:24.430497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-07844f34-1dea-4a6d-831c-b555f70ad81d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:24.430497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-07844f34-1dea-4a6d-831c-b555f70ad81d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:24.440876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07844f34-1dea-4a6d-831c-b555f70ad81d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:24.442342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07844f34-1dea-4a6d-831c-b555f70ad81d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:24.445558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07844f34-1dea-4a6d-831c-b555f70ad81d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:24.446487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07844f34-1dea-4a6d-831c-b555f70ad81d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:24.447115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07844f34-1dea-4a6d-831c-b555f70ad81d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:24.447717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-07844f34-1dea-4a6d-831c-b555f70ad81d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:25.117846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-07844f34-1dea-4a6d-831c-b555f70ad81d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:25.127926 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-07844f34-1dea-4a6d-831c-b555f70ad81d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1366 microversion: 2.1 time: 0.704753 Oct 29 01:26:25.138484 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2415/5067] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:24 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1366 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:26.158906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8508f22a-3eb8-4011-a5e7-c70b92b33f96 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:26.160549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8508f22a-3eb8-4011-a5e7-c70b92b33f96 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:26.181085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8508f22a-3eb8-4011-a5e7-c70b92b33f96 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:26.187708 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8508f22a-3eb8-4011-a5e7-c70b92b33f96 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:26.188279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8508f22a-3eb8-4011-a5e7-c70b92b33f96 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:26.189049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8508f22a-3eb8-4011-a5e7-c70b92b33f96 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:26.192834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8508f22a-3eb8-4011-a5e7-c70b92b33f96 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:26.194226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8508f22a-3eb8-4011-a5e7-c70b92b33f96 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:27.220316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8508f22a-3eb8-4011-a5e7-c70b92b33f96 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:27.239890 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8508f22a-3eb8-4011-a5e7-c70b92b33f96 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1366 microversion: 2.1 time: 1.087064 Oct 29 01:26:27.244994 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2416/5068] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:26 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1366 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:28.271150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fbbf8c7e-ea3f-4ca2-b079-86605a064382 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:28.271922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fbbf8c7e-ea3f-4ca2-b079-86605a064382 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:28.293631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbbf8c7e-ea3f-4ca2-b079-86605a064382 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:28.298629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbbf8c7e-ea3f-4ca2-b079-86605a064382 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:28.302227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbbf8c7e-ea3f-4ca2-b079-86605a064382 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:28.306489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbbf8c7e-ea3f-4ca2-b079-86605a064382 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:28.312978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbbf8c7e-ea3f-4ca2-b079-86605a064382 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:28.316912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fbbf8c7e-ea3f-4ca2-b079-86605a064382 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:28.890064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fbbf8c7e-ea3f-4ca2-b079-86605a064382 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:28.894636 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fbbf8c7e-ea3f-4ca2-b079-86605a064382 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1366 microversion: 2.1 time: 0.630457 Oct 29 01:26:28.910181 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2417/5069] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:28 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1366 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:28.917463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-3d3b36e2-190d-4b07-a863-825af1915746 req-235dd2f6-eb69-42f3-9a71-45d845f2b03c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e86fdd3-e373-4b20-85cf-73ce67194dc2", "name": "network-vif-plugged", "status": "completed", "tag": "a69b3f30-d8f0-4feb-b963-b6a48a547e63"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:28.930440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3d3b36e2-190d-4b07-a863-825af1915746 req-235dd2f6-eb69-42f3-9a71-45d845f2b03c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:28.931109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3d3b36e2-190d-4b07-a863-825af1915746 req-235dd2f6-eb69-42f3-9a71-45d845f2b03c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:28.931690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3d3b36e2-190d-4b07-a863-825af1915746 req-235dd2f6-eb69-42f3-9a71-45d845f2b03c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:28.946918 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-3d3b36e2-190d-4b07-a863-825af1915746 req-235dd2f6-eb69-42f3-9a71-45d845f2b03c service nova] Creating event network-vif-plugged:a69b3f30-d8f0-4feb-b963-b6a48a547e63 for instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 on n-h1-862964-3 Oct 29 01:26:28.961146 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-3d3b36e2-190d-4b07-a863-825af1915746 req-235dd2f6-eb69-42f3-9a71-45d845f2b03c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049373 Oct 29 01:26:28.966250 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2418/5070] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:26:28.983333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-13d6a821-3d49-41fb-ba60-ddfad0cc7405 req-c02832aa-709d-4603-ad6e-1efebe226319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3928147-60bb-4304-90a7-103deb29e0ed", "name": "network-vif-deleted", "tag": "1d88b97b-733a-44d8-a8a7-2f0c1fe45f26"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:29.041472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-13d6a821-3d49-41fb-ba60-ddfad0cc7405 req-c02832aa-709d-4603-ad6e-1efebe226319 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:29.041981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-13d6a821-3d49-41fb-ba60-ddfad0cc7405 req-c02832aa-709d-4603-ad6e-1efebe226319 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:29.042419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-13d6a821-3d49-41fb-ba60-ddfad0cc7405 req-c02832aa-709d-4603-ad6e-1efebe226319 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:29.067932 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-13d6a821-3d49-41fb-ba60-ddfad0cc7405 req-c02832aa-709d-4603-ad6e-1efebe226319 service nova] Creating event network-vif-deleted:1d88b97b-733a-44d8-a8a7-2f0c1fe45f26 for instance a3928147-60bb-4304-90a7-103deb29e0ed on n-h2-862964-3 Oct 29 01:26:29.080643 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-13d6a821-3d49-41fb-ba60-ddfad0cc7405 req-c02832aa-709d-4603-ad6e-1efebe226319 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107343 Oct 29 01:26:29.081588 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2419/5071] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:26:29.628101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-0e1a4d43-1b36-4e07-86b7-19a42d3fcccf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Building network info cache for instance {{(pid=121099) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 01:26:29.922492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6203637c-2cf7-4668-94e3-764585e331b2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:29.923458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6203637c-2cf7-4668-94e3-764585e331b2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:29.952842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6203637c-2cf7-4668-94e3-764585e331b2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:29.953725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6203637c-2cf7-4668-94e3-764585e331b2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:29.956434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6203637c-2cf7-4668-94e3-764585e331b2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:29.959355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6203637c-2cf7-4668-94e3-764585e331b2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:29.961618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6203637c-2cf7-4668-94e3-764585e331b2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:29.962895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6203637c-2cf7-4668-94e3-764585e331b2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:30.455348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6203637c-2cf7-4668-94e3-764585e331b2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:30.466928 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6203637c-2cf7-4668-94e3-764585e331b2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1366 microversion: 2.1 time: 0.552448 Oct 29 01:26:30.470871 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2420/5072] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:29 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1366 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:30.943710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-0e1a4d43-1b36-4e07-86b7-19a42d3fcccf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Updating instance_info_cache with network_info: [{"id": "ce177e8d-5249-49d2-a188-951d6561d827", "address": "fa:16:3e:52:aa:fc", "network": {"id": "bf44a312-d8d4-4636-8ed4-e759797fbb2e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-880825101-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0dd5d9ef52524461a5ea497010bd3dc0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapce177e8d-52", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121099) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 01:26:31.085795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e1a4d43-1b36-4e07-86b7-19a42d3fcccf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Releasing lock "refresh_cache-d81519da-d650-41a7-a009-4bcfb4e94d92" {{(pid=121099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 01:26:31.086947 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0e1a4d43-1b36-4e07-86b7-19a42d3fcccf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "POST /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92/action" status: 202 len: 0 microversion: 2.1 time: 7.276735 Oct 29 01:26:31.087740 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2653/5073] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:26:23 2022] POST /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92/action => generated 0 bytes in 7278 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 01:26:31.105339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3659204b-8007-4857-bbc5-0d197558d5ed tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '.version_select at 0x7f9d9fe3eee0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:31.132281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-2b74c878-9c29-4603-88f5-f61f1c0755df req-38c0fd22-79e6-4483-bb56-04600417779e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d81519da-d650-41a7-a009-4bcfb4e94d92", "tag": "ce177e8d-5249-49d2-a188-951d6561d827"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:31.152215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:26:31.189724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2b74c878-9c29-4603-88f5-f61f1c0755df req-38c0fd22-79e6-4483-bb56-04600417779e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:31.194805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2b74c878-9c29-4603-88f5-f61f1c0755df req-38c0fd22-79e6-4483-bb56-04600417779e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:31.197684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2b74c878-9c29-4603-88f5-f61f1c0755df req-38c0fd22-79e6-4483-bb56-04600417779e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:31.272318 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-2b74c878-9c29-4603-88f5-f61f1c0755df req-38c0fd22-79e6-4483-bb56-04600417779e service nova] Creating event network-changed:ce177e8d-5249-49d2-a188-951d6561d827 for instance d81519da-d650-41a7-a009-4bcfb4e94d92 on n-h1-862964-3 Oct 29 01:26:31.309341 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-2b74c878-9c29-4603-88f5-f61f1c0755df req-38c0fd22-79e6-4483-bb56-04600417779e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181942 Oct 29 01:26:31.313941 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2654/5074] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:26:31.497359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e50dfae3-be9d-42bb-a49e-0568a7292281 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:31.498501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e50dfae3-be9d-42bb-a49e-0568a7292281 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:31.542512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e50dfae3-be9d-42bb-a49e-0568a7292281 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:31.542512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e50dfae3-be9d-42bb-a49e-0568a7292281 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:31.542512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e50dfae3-be9d-42bb-a49e-0568a7292281 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:31.542512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e50dfae3-be9d-42bb-a49e-0568a7292281 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:31.544833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e50dfae3-be9d-42bb-a49e-0568a7292281 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:31.547024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e50dfae3-be9d-42bb-a49e-0568a7292281 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:33.309872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e50dfae3-be9d-42bb-a49e-0568a7292281 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:33.329984 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e50dfae3-be9d-42bb-a49e-0568a7292281 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1556 microversion: 2.1 time: 1.837250 Oct 29 01:26:33.336523 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2655/5075] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:31 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1556 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:33.369912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b28cf858-e9f2-48e6-b756-237236b0738d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:33.373232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b28cf858-e9f2-48e6-b756-237236b0738d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:33.420407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b28cf858-e9f2-48e6-b756-237236b0738d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:33.424137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b28cf858-e9f2-48e6-b756-237236b0738d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:33.426392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b28cf858-e9f2-48e6-b756-237236b0738d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:33.431055 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3659204b-8007-4857-bbc5-0d197558d5ed tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/5bc3b0ae-8f1c-4cb6-88f7-a1f73f0d4e4f" status: 200 len: 183 microversion: 2.1 time: 2.338403 Oct 29 01:26:33.434901 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2421/5076] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 29 01:26:31 2022] GET /compute/v2.1/os-floating-ips/5bc3b0ae-8f1c-4cb6-88f7-a1f73f0d4e4f => generated 183 bytes in 2343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:26:33.437191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b28cf858-e9f2-48e6-b756-237236b0738d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:33.440518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b28cf858-e9f2-48e6-b756-237236b0738d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:33.448777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f40777e1-be1a-40b2-be00-1bd099c65a1a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.73"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:33.449724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b28cf858-e9f2-48e6-b756-237236b0738d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:33.949972 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b28cf858-e9f2-48e6-b756-237236b0738d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.594041 Oct 29 01:26:33.950885 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2656/5077] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:26:33 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2/os-interface => generated 284 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:26:34.024836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f40777e1-be1a-40b2-be00-1bd099c65a1a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:34.034498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f40777e1-be1a-40b2-be00-1bd099c65a1a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:34.035111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f40777e1-be1a-40b2-be00-1bd099c65a1a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:34.036433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f40777e1-be1a-40b2-be00-1bd099c65a1a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:34.044973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f40777e1-be1a-40b2-be00-1bd099c65a1a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:34.047035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f40777e1-be1a-40b2-be00-1bd099c65a1a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:34.051835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f40777e1-be1a-40b2-be00-1bd099c65a1a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:35.249876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f40777e1-be1a-40b2-be00-1bd099c65a1a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "refresh_cache-d81519da-d650-41a7-a009-4bcfb4e94d92" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 01:26:35.249876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f40777e1-be1a-40b2-be00-1bd099c65a1a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquired lock "refresh_cache-d81519da-d650-41a7-a009-4bcfb4e94d92" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 01:26:38.692904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c25026e6-1193-4d22-a048-307fcef27dbc tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Action: 'create', calling method: .version_select at 0x7f9d9fe48550>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1378713917", "policies": ["affinity"]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:38.745794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-c25026e6-1193-4d22-a048-307fcef27dbc tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:26:38.763447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-c25026e6-1193-4d22-a048-307fcef27dbc tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for user 32b2ed8dfd1945d69101697fc1a76b55 and project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:26:38.990349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-c25026e6-1193-4d22-a048-307fcef27dbc tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:26:39.010726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-c25026e6-1193-4d22-a048-307fcef27dbc tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for user 32b2ed8dfd1945d69101697fc1a76b55 and project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:26:39.034492 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c25026e6-1193-4d22-a048-307fcef27dbc tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.792778 Oct 29 01:26:39.035565 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2657/5078] 10.222.0.26 () {60 vars in 1174 bytes} [Sat Oct 29 01:26:38 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:26:39.050488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-000efc9d-9380-4110-84de-a6929f3381aa tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Action: 'create', calling method: .version_select at 0x7f9d97823d30>, body: {"server_group": {"name": "tempest-server-group-546137986", "policies": ["affinity"]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:39.072785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-000efc9d-9380-4110-84de-a6929f3381aa tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:26:39.078969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-000efc9d-9380-4110-84de-a6929f3381aa tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for user 32b2ed8dfd1945d69101697fc1a76b55 and project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:26:39.229796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-000efc9d-9380-4110-84de-a6929f3381aa tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:26:39.236484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-000efc9d-9380-4110-84de-a6929f3381aa tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for user 32b2ed8dfd1945d69101697fc1a76b55 and project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:26:39.252353 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-000efc9d-9380-4110-84de-a6929f3381aa tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.206955 Oct 29 01:26:39.253630 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2658/5079] 10.222.0.26 () {60 vars in 1173 bytes} [Sat Oct 29 01:26:39 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:26:39.263859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b16a1ff7-afd7-46b7-8b79-d917b7a3cf43 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Action: 'create', calling method: .version_select at 0x7f9d977d6280>, body: {"server_group": {"name": "tempest-server-group-546137986", "policies": ["affinity"]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:39.287138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b16a1ff7-afd7-46b7-8b79-d917b7a3cf43 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:26:39.293308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b16a1ff7-afd7-46b7-8b79-d917b7a3cf43 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for user 32b2ed8dfd1945d69101697fc1a76b55 and project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:26:39.540404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b16a1ff7-afd7-46b7-8b79-d917b7a3cf43 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:26:39.548554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b16a1ff7-afd7-46b7-8b79-d917b7a3cf43 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for user 32b2ed8dfd1945d69101697fc1a76b55 and project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:26:39.571083 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b16a1ff7-afd7-46b7-8b79-d917b7a3cf43 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.304814 Oct 29 01:26:39.571083 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2659/5080] 10.222.0.26 () {60 vars in 1173 bytes} [Sat Oct 29 01:26:39 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:26:39.582117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b789338d-1b35-4d19-8c3a-2f21ad50e1e4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:39.689135 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b789338d-1b35-4d19-8c3a-2f21ad50e1e4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/845a3869-9d10-498a-87ad-506895892d0d" status: 204 len: 0 microversion: 2.1 time: 0.115698 Oct 29 01:26:39.690377 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2660/5081] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 29 01:26:39 2022] DELETE /compute/v2.1/os-server-groups/845a3869-9d10-498a-87ad-506895892d0d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:26:39.706785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-90cca357-d259-4934-9138-9666e6508013 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:39.778878 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-90cca357-d259-4934-9138-9666e6508013 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.080706 Oct 29 01:26:39.783462 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2661/5082] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:26:39 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:26:39.798406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f580813f-1754-4701-9e89-7996f3447082 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:39.827728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:26:39.934011 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f580813f-1754-4701-9e89-7996f3447082 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/2ebacda8-c794-4486-8e41-550a2fcbf662" status: 204 len: 0 microversion: 2.1 time: 0.142409 Oct 29 01:26:39.934608 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2662/5083] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 29 01:26:39 2022] DELETE /compute/v2.1/os-server-groups/2ebacda8-c794-4486-8e41-550a2fcbf662 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:26:39.947850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fb27b8e5-1338-429e-b75b-bc4c163e7595 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:39.982596 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fb27b8e5-1338-429e-b75b-bc4c163e7595 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.035402 Oct 29 01:26:39.983862 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2663/5084] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:26:39 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:26:40.009950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f22395ee-f81c-473a-80ef-82a70ac82358 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Action: 'create', calling method: .version_select at 0x7f9d9fd5b430>, body: {"server_group": {"name": "tempest-server-group-613687041", "policies": ["affinity"]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:40.027664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-f22395ee-f81c-473a-80ef-82a70ac82358 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:26:40.034302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-f22395ee-f81c-473a-80ef-82a70ac82358 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for user 32b2ed8dfd1945d69101697fc1a76b55 and project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:26:40.181016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-f22395ee-f81c-473a-80ef-82a70ac82358 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:26:40.192020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-f22395ee-f81c-473a-80ef-82a70ac82358 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for user 32b2ed8dfd1945d69101697fc1a76b55 and project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:26:40.226661 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f22395ee-f81c-473a-80ef-82a70ac82358 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.233987 Oct 29 01:26:40.227273 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2664/5085] 10.222.0.26 () {60 vars in 1173 bytes} [Sat Oct 29 01:26:39 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:26:40.239197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-131f562c-b5ad-46f1-96f0-12c857142b8e tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:40.353946 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-131f562c-b5ad-46f1-96f0-12c857142b8e tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/2703f974-f352-4c48-83f2-e9a484a9f255" status: 204 len: 0 microversion: 2.1 time: 0.119286 Oct 29 01:26:40.354731 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2665/5086] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 29 01:26:40 2022] DELETE /compute/v2.1/os-server-groups/2703f974-f352-4c48-83f2-e9a484a9f255 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:26:40.365750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4ff8adcb-973e-43e2-9660-52ea5a0b44b1 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:40.402505 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4ff8adcb-973e-43e2-9660-52ea5a0b44b1 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.043245 Oct 29 01:26:40.403367 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2666/5087] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:26:40 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:26:40.415805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cf854433-3a52-4506-ba48-62b8ffa0d8c3 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Action: 'create', calling method: .version_select at 0x7f9d9fd5ba60>, body: {"server_group": {"name": "tempest-server-group-166441032", "policies": ["anti-affinity"]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:40.453103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-cf854433-3a52-4506-ba48-62b8ffa0d8c3 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:26:40.466100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-cf854433-3a52-4506-ba48-62b8ffa0d8c3 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for user 32b2ed8dfd1945d69101697fc1a76b55 and project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:26:40.556160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-f40777e1-be1a-40b2-be00-1bd099c65a1a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Building network info cache for instance {{(pid=121100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 01:26:40.637614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-cf854433-3a52-4506-ba48-62b8ffa0d8c3 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:26:40.654362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-cf854433-3a52-4506-ba48-62b8ffa0d8c3 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for user 32b2ed8dfd1945d69101697fc1a76b55 and project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_groups'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:26:40.688083 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cf854433-3a52-4506-ba48-62b8ffa0d8c3 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.276369 Oct 29 01:26:40.694058 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2667/5088] 10.222.0.26 () {60 vars in 1173 bytes} [Sat Oct 29 01:26:40 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:26:40.701428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-1f863dba-43ed-4bcf-8f62-c705739a1b71 req-e1b1945b-2780-45da-90b0-a13f839fae2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d81519da-d650-41a7-a009-4bcfb4e94d92", "tag": "ce177e8d-5249-49d2-a188-951d6561d827"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:40.734028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1f863dba-43ed-4bcf-8f62-c705739a1b71 req-e1b1945b-2780-45da-90b0-a13f839fae2f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:40.737697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1f863dba-43ed-4bcf-8f62-c705739a1b71 req-e1b1945b-2780-45da-90b0-a13f839fae2f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:40.742487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1f863dba-43ed-4bcf-8f62-c705739a1b71 req-e1b1945b-2780-45da-90b0-a13f839fae2f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:40.785477 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-1f863dba-43ed-4bcf-8f62-c705739a1b71 req-e1b1945b-2780-45da-90b0-a13f839fae2f service nova] Creating event network-changed:ce177e8d-5249-49d2-a188-951d6561d827 for instance d81519da-d650-41a7-a009-4bcfb4e94d92 on n-h1-862964-3 Oct 29 01:26:40.808743 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-1f863dba-43ed-4bcf-8f62-c705739a1b71 req-e1b1945b-2780-45da-90b0-a13f839fae2f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114974 Oct 29 01:26:40.813184 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2668/5089] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:26:40.830226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2813e7f5-bd39-4503-b221-2fe2acaedc7f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:41.000860 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2813e7f5-bd39-4503-b221-2fe2acaedc7f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/4aa9adc6-6d01-4e46-81a4-55b92231701f" status: 204 len: 0 microversion: 2.1 time: 0.185974 Oct 29 01:26:41.001493 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2669/5090] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 29 01:26:40 2022] DELETE /compute/v2.1/os-server-groups/4aa9adc6-6d01-4e46-81a4-55b92231701f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:26:41.009899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8c36016f-88f1-4319-896d-bf64834d8aaa tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:41.042156 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8c36016f-88f1-4319-896d-bf64834d8aaa tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.036332 Oct 29 01:26:41.042711 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2670/5091] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:26:41 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:26:41.166922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1266070246", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "104e248b-81b1-4548-bb5f-10afc543c5e1"}]}, "os:scheduler_hints": {"group": "c532b187-89f4-4d84-97c5-53038048beea"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:41.268515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] validate_networks() for [('104e248b-81b1-4548-bb5f-10afc543c5e1', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:26:43.394412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:26:43.399482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:26:43.399482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:26:43.399482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:26:43.399482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:26:43.427459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:43.429406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:43.431351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:43.434823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:43.435553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:43.437553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:43.470870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for project 6665b951aa434564ae17a148c0dbad0a. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:26:43.481196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for user 32b2ed8dfd1945d69101697fc1a76b55 and project 6665b951aa434564ae17a148c0dbad0a. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:26:43.500835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:26:43.505545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:26:43.579134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=9,nova_api:INSERT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:26:43.739213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:26:43.751433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for user 32b2ed8dfd1945d69101697fc1a76b55 and project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:26:43.954872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:26:43.982805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Getting quotas for user 32b2ed8dfd1945d69101697fc1a76b55 and project 6665b951aa434564ae17a148c0dbad0a. Resources: {'server_group_members'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:26:44.031092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:26:44.051671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-f40777e1-be1a-40b2-be00-1bd099c65a1a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Updating instance_info_cache with network_info: [{"id": "ce177e8d-5249-49d2-a188-951d6561d827", "address": "fa:16:3e:52:aa:fc", "network": {"id": "bf44a312-d8d4-4636-8ed4-e759797fbb2e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-880825101-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0dd5d9ef52524461a5ea497010bd3dc0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapce177e8d-52", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 01:26:44.062669 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-912cc0e9-7770-4924-93c2-c5fc9b05632d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.900181 Oct 29 01:26:44.064140 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2671/5092] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:26:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:26:44.069597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-2a43d8e5-381d-4704-8488-4dbf1d995f86 req-371cdca6-f0f0-4b13-b427-84af65069481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e86fdd3-e373-4b20-85cf-73ce67194dc2", "tag": "a69b3f30-d8f0-4feb-b963-b6a48a547e63"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:44.081949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2a43d8e5-381d-4704-8488-4dbf1d995f86 req-371cdca6-f0f0-4b13-b427-84af65069481 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:44.082723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2a43d8e5-381d-4704-8488-4dbf1d995f86 req-371cdca6-f0f0-4b13-b427-84af65069481 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:44.083438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2a43d8e5-381d-4704-8488-4dbf1d995f86 req-371cdca6-f0f0-4b13-b427-84af65069481 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:44.099480 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-2a43d8e5-381d-4704-8488-4dbf1d995f86 req-371cdca6-f0f0-4b13-b427-84af65069481 service nova] Creating event network-changed:a69b3f30-d8f0-4feb-b963-b6a48a547e63 for instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 on n-h1-862964-3 Oct 29 01:26:44.108727 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-2a43d8e5-381d-4704-8488-4dbf1d995f86 req-371cdca6-f0f0-4b13-b427-84af65069481 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042303 Oct 29 01:26:44.109700 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2672/5093] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:26:44.117436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2cb32441-6e16-49e4-8630-c7da99c63a51 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:44.125572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2cb32441-6e16-49e4-8630-c7da99c63a51 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:44.173497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f40777e1-be1a-40b2-be00-1bd099c65a1a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Releasing lock "refresh_cache-d81519da-d650-41a7-a009-4bcfb4e94d92" {{(pid=121100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 01:26:44.174780 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f40777e1-be1a-40b2-be00-1bd099c65a1a tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "POST /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92/action" status: 202 len: 0 microversion: 2.1 time: 10.730656 Oct 29 01:26:44.177077 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2422/5094] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:26:33 2022] POST /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92/action => generated 0 bytes in 10732 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 29 01:26:44.187400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1938455e-ef92-4803-bcd3-798f2356a35c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:44.188393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1938455e-ef92-4803-bcd3-798f2356a35c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:44.200672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1938455e-ef92-4803-bcd3-798f2356a35c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:44.210451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1938455e-ef92-4803-bcd3-798f2356a35c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:44.210451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1938455e-ef92-4803-bcd3-798f2356a35c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:44.210451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1938455e-ef92-4803-bcd3-798f2356a35c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:44.212193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1938455e-ef92-4803-bcd3-798f2356a35c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:44.213847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1938455e-ef92-4803-bcd3-798f2356a35c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:44.247037 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-1938455e-ef92-4803-bcd3-798f2356a35c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] HTTP exception thrown: Instance a3928147-60bb-4304-90a7-103deb29e0ed could not be found. Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1938455e-ef92-4803-bcd3-798f2356a35c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Request method failure captured: Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed HTTP/1.1 Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIDw5iiGVoUj0ExthEAokOqFRDebhDZpEkOyYI8F23AZXo514CdlVYTYZLdHye7kYeEsnoDGSbYnJYOtj76oiDya1A1o9ZR-LVMHM8ym3i6FfK5TS2bjHXqAg3PcLNNmLfEW4-rGO0gronpYf6Ro21UFE8ZfYT2f_iw4wMwa4Iukkhc Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 0dd5d9ef52524461a5ea497010bd3dc0 Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1246765038 Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0dd5d9ef52524461a5ea497010bd3dc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0dd5d9ef52524461a5ea497010bd3dc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0dd5d9ef52524461a5ea497010bd3dc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0dd5d9ef52524461a5ea497010bd3dc0", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1246765038 Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 0dd5d9ef52524461a5ea497010bd3dc0 Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1246765038 Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FloatingIPsAssociationTestJSON-1246765038-project Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: b7d6b090698b4ac29481af8eb9fa6b3c Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1246765038-project Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance a3928147-60bb-4304-90a7-103deb29e0ed could not be found. Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'a3928147-60bb-4304-90a7-103deb29e0ed'} Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3928147-60bb-4304-90a7-103deb29e0ed could not be found. Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:26:44.249753 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:26:44.255329 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3928147-60bb-4304-90a7-103deb29e0ed could not be found. Oct 29 01:26:44.255329 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:44.255329 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:44.255329 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:44.255329 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:44.255329 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:44.255329 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:44.255329 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:26:44.255329 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:26:44.255329 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3928147-60bb-4304-90a7-103deb29e0ed could not be found. Oct 29 01:26:44.255329 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:44.258321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1938455e-ef92-4803-bcd3-798f2356a35c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Returning 404 to user: Instance a3928147-60bb-4304-90a7-103deb29e0ed could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:26:44.259484 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1938455e-ef92-4803-bcd3-798f2356a35c tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed" status: 404 len: 111 microversion: 2.1 time: 0.078336 Oct 29 01:26:44.261884 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2423/5095] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:26:44 2022] DELETE /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:26:44.270628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3006d88d-6b36-4d50-bdad-2d3a6b794cf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:44.271559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3006d88d-6b36-4d50-bdad-2d3a6b794cf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: a3928147-60bb-4304-90a7-103deb29e0ed] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:44.279005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3006d88d-6b36-4d50-bdad-2d3a6b794cf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:44.281039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3006d88d-6b36-4d50-bdad-2d3a6b794cf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:44.281754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3006d88d-6b36-4d50-bdad-2d3a6b794cf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:44.282744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3006d88d-6b36-4d50-bdad-2d3a6b794cf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:44.283453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3006d88d-6b36-4d50-bdad-2d3a6b794cf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:44.284151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3006d88d-6b36-4d50-bdad-2d3a6b794cf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:44.342344 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-3006d88d-6b36-4d50-bdad-2d3a6b794cf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] HTTP exception thrown: Instance a3928147-60bb-4304-90a7-103deb29e0ed could not be found. Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3006d88d-6b36-4d50-bdad-2d3a6b794cf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Request method failure captured: Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed HTTP/1.1 Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIDw5iiGVoUj0ExthEAokOqFRDebhDZpEkOyYI8F23AZXo514CdlVYTYZLdHye7kYeEsnoDGSbYnJYOtj76oiDya1A1o9ZR-LVMHM8ym3i6FfK5TS2bjHXqAg3PcLNNmLfEW4-rGO0gronpYf6Ro21UFE8ZfYT2f_iw4wMwa4Iukkhc Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 0dd5d9ef52524461a5ea497010bd3dc0 Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1246765038 Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0dd5d9ef52524461a5ea497010bd3dc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0dd5d9ef52524461a5ea497010bd3dc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0dd5d9ef52524461a5ea497010bd3dc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0dd5d9ef52524461a5ea497010bd3dc0", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1246765038 Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 0dd5d9ef52524461a5ea497010bd3dc0 Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1246765038 Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FloatingIPsAssociationTestJSON-1246765038-project Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: b7d6b090698b4ac29481af8eb9fa6b3c Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1246765038-project Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance a3928147-60bb-4304-90a7-103deb29e0ed could not be found. Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'a3928147-60bb-4304-90a7-103deb29e0ed'} Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3928147-60bb-4304-90a7-103deb29e0ed could not be found. Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3928147-60bb-4304-90a7-103deb29e0ed could not be found. Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:44.344543 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:44.349575 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:44.349575 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:44.349575 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:44.349575 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:44.349575 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:26:44.349575 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:26:44.349575 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3928147-60bb-4304-90a7-103deb29e0ed could not be found. Oct 29 01:26:44.349575 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:44.349575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3006d88d-6b36-4d50-bdad-2d3a6b794cf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Returning 404 to user: Instance a3928147-60bb-4304-90a7-103deb29e0ed could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:26:44.352472 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3006d88d-6b36-4d50-bdad-2d3a6b794cf1 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed" status: 404 len: 111 microversion: 2.1 time: 0.086596 Oct 29 01:26:44.353408 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2424/5096] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:44 2022] GET /compute/v2.1/servers/a3928147-60bb-4304-90a7-103deb29e0ed => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:26:44.365836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e27c0c2-7b0a-441e-8f77-1b695c890ac4 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '.version_select at 0x7f9d970fe0d0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:44.385095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2cb32441-6e16-49e4-8630-c7da99c63a51 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b2ed8dfd1945d69101697fc1a76b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6665b951aa434564ae17a148c0dbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:44.398066 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2cb32441-6e16-49e4-8630-c7da99c63a51 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 200 len: 1213 microversion: 2.1 time: 0.286675 Oct 29 01:26:44.398743 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2673/5097] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:44 2022] GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 1213 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:45.423318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b4019e5c-5bea-424b-9160-2bcf713c9819 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:45.424164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b4019e5c-5bea-424b-9160-2bcf713c9819 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:45.626746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b4019e5c-5bea-424b-9160-2bcf713c9819 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b2ed8dfd1945d69101697fc1a76b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6665b951aa434564ae17a148c0dbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:45.645453 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b4019e5c-5bea-424b-9160-2bcf713c9819 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 200 len: 1213 microversion: 2.1 time: 0.228068 Oct 29 01:26:45.657866 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2674/5098] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:45 2022] GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 1213 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:26:46.673308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f5ef0169-0d1e-451b-9ad1-6734f92e37a4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:46.673308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f5ef0169-0d1e-451b-9ad1-6734f92e37a4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:46.698421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5ef0169-0d1e-451b-9ad1-6734f92e37a4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:46.700547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5ef0169-0d1e-451b-9ad1-6734f92e37a4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:46.701953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5ef0169-0d1e-451b-9ad1-6734f92e37a4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:46.703980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5ef0169-0d1e-451b-9ad1-6734f92e37a4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:46.704668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5ef0169-0d1e-451b-9ad1-6734f92e37a4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:46.705366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5ef0169-0d1e-451b-9ad1-6734f92e37a4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:46.836146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f5ef0169-0d1e-451b-9ad1-6734f92e37a4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b2ed8dfd1945d69101697fc1a76b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6665b951aa434564ae17a148c0dbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:46.864620 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f5ef0169-0d1e-451b-9ad1-6734f92e37a4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 200 len: 1209 microversion: 2.1 time: 0.196886 Oct 29 01:26:46.885264 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2675/5099] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:46 2022] GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 1209 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:26:47.816351 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e27c0c2-7b0a-441e-8f77-1b695c890ac4 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/5bc3b0ae-8f1c-4cb6-88f7-a1f73f0d4e4f" status: 202 len: 0 microversion: 2.1 time: 3.459003 Oct 29 01:26:47.816932 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2425/5100] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:26:44 2022] DELETE /compute/v2.1/os-floating-ips/5bc3b0ae-8f1c-4cb6-88f7-a1f73f0d4e4f => generated 0 bytes in 3460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:26:47.827621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7aca79dd-6a84-4c24-b380-e067a5009ad3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:47.828206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7aca79dd-6a84-4c24-b380-e067a5009ad3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:47.850953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7aca79dd-6a84-4c24-b380-e067a5009ad3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:47.855479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7aca79dd-6a84-4c24-b380-e067a5009ad3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:47.855479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7aca79dd-6a84-4c24-b380-e067a5009ad3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:47.855479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7aca79dd-6a84-4c24-b380-e067a5009ad3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:47.855479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7aca79dd-6a84-4c24-b380-e067a5009ad3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:47.859659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7aca79dd-6a84-4c24-b380-e067a5009ad3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:47.897797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-330604be-225e-468e-a757-00d09514e871 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:47.898804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-330604be-225e-468e-a757-00d09514e871 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:47.928986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-330604be-225e-468e-a757-00d09514e871 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:47.932487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-330604be-225e-468e-a757-00d09514e871 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:47.933269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-330604be-225e-468e-a757-00d09514e871 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:47.940400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-330604be-225e-468e-a757-00d09514e871 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:47.941451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-330604be-225e-468e-a757-00d09514e871 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:47.944915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-330604be-225e-468e-a757-00d09514e871 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:47.968646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7aca79dd-6a84-4c24-b380-e067a5009ad3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:26:48.176995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-330604be-225e-468e-a757-00d09514e871 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b2ed8dfd1945d69101697fc1a76b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6665b951aa434564ae17a148c0dbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:48.191256 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-330604be-225e-468e-a757-00d09514e871 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 200 len: 1273 microversion: 2.1 time: 0.295706 Oct 29 01:26:48.193105 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2426/5101] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:47 2022] GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 1273 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:26:48.595136 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7aca79dd-6a84-4c24-b380-e067a5009ad3 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 204 len: 0 microversion: 2.1 time: 0.773277 Oct 29 01:26:48.598989 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2676/5102] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:26:47 2022] DELETE /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:26:48.604481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b3388fd5-4606-4a6a-addc-d86d2995441b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:48.607004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b3388fd5-4606-4a6a-addc-d86d2995441b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:48.627756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b3388fd5-4606-4a6a-addc-d86d2995441b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:48.630148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b3388fd5-4606-4a6a-addc-d86d2995441b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:48.630615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b3388fd5-4606-4a6a-addc-d86d2995441b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:48.633200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b3388fd5-4606-4a6a-addc-d86d2995441b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:48.635403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b3388fd5-4606-4a6a-addc-d86d2995441b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:48.639095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b3388fd5-4606-4a6a-addc-d86d2995441b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:49.071323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b3388fd5-4606-4a6a-addc-d86d2995441b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:49.083265 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b3388fd5-4606-4a6a-addc-d86d2995441b tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 200 len: 1524 microversion: 2.1 time: 0.482920 Oct 29 01:26:49.083922 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2427/5103] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:48 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 1524 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:26:49.227103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-326d47b4-d98f-43f0-87b4-783ee4862739 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:49.233799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-326d47b4-d98f-43f0-87b4-783ee4862739 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:49.292135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-326d47b4-d98f-43f0-87b4-783ee4862739 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:49.296800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-326d47b4-d98f-43f0-87b4-783ee4862739 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:49.296800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-326d47b4-d98f-43f0-87b4-783ee4862739 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:49.297506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-326d47b4-d98f-43f0-87b4-783ee4862739 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:49.297990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-326d47b4-d98f-43f0-87b4-783ee4862739 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:49.298436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-326d47b4-d98f-43f0-87b4-783ee4862739 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:49.729066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-326d47b4-d98f-43f0-87b4-783ee4862739 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b2ed8dfd1945d69101697fc1a76b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6665b951aa434564ae17a148c0dbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:49.729066 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-326d47b4-d98f-43f0-87b4-783ee4862739 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 200 len: 1271 microversion: 2.1 time: 0.221859 Oct 29 01:26:49.729066 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2677/5104] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:49 2022] GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 1271 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:50.106622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-97dece1d-a237-454c-8520-022a79e419e5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:50.107431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-97dece1d-a237-454c-8520-022a79e419e5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:50.116390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97dece1d-a237-454c-8520-022a79e419e5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:50.117708 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97dece1d-a237-454c-8520-022a79e419e5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:50.118556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97dece1d-a237-454c-8520-022a79e419e5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:50.119451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97dece1d-a237-454c-8520-022a79e419e5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:50.120274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97dece1d-a237-454c-8520-022a79e419e5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:50.120867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97dece1d-a237-454c-8520-022a79e419e5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:50.469025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2fea6a93-a9b8-4f7d-84a6-b6b8455e7c15 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:50.469663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2fea6a93-a9b8-4f7d-84a6-b6b8455e7c15 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:50.476674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fea6a93-a9b8-4f7d-84a6-b6b8455e7c15 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:50.477182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fea6a93-a9b8-4f7d-84a6-b6b8455e7c15 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:50.477636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fea6a93-a9b8-4f7d-84a6-b6b8455e7c15 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:50.478341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fea6a93-a9b8-4f7d-84a6-b6b8455e7c15 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:50.478992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fea6a93-a9b8-4f7d-84a6-b6b8455e7c15 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:50.480084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fea6a93-a9b8-4f7d-84a6-b6b8455e7c15 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:50.662246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-97dece1d-a237-454c-8520-022a79e419e5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:50.674745 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-97dece1d-a237-454c-8520-022a79e419e5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 200 len: 1524 microversion: 2.1 time: 0.572048 Oct 29 01:26:50.676940 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2428/5105] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:50 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 1524 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:51.357319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2fea6a93-a9b8-4f7d-84a6-b6b8455e7c15 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b2ed8dfd1945d69101697fc1a76b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6665b951aa434564ae17a148c0dbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:51.379756 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2fea6a93-a9b8-4f7d-84a6-b6b8455e7c15 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 200 len: 1313 microversion: 2.1 time: 0.914565 Oct 29 01:26:51.383923 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2678/5106] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:50 2022] GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 1313 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:51.701490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-504675a8-bd89-4a9e-bd45-5aa80f789dc4 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:51.702136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-504675a8-bd89-4a9e-bd45-5aa80f789dc4 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:51.713643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-504675a8-bd89-4a9e-bd45-5aa80f789dc4 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:51.715636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-504675a8-bd89-4a9e-bd45-5aa80f789dc4 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:51.716423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-504675a8-bd89-4a9e-bd45-5aa80f789dc4 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:51.718257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-504675a8-bd89-4a9e-bd45-5aa80f789dc4 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:51.719920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-504675a8-bd89-4a9e-bd45-5aa80f789dc4 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:51.720369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-504675a8-bd89-4a9e-bd45-5aa80f789dc4 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:51.912130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-504675a8-bd89-4a9e-bd45-5aa80f789dc4 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:51.922581 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-504675a8-bd89-4a9e-bd45-5aa80f789dc4 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 200 len: 1482 microversion: 2.1 time: 0.226151 Oct 29 01:26:51.941650 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2429/5107] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:51 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 1482 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:52.063082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-00760a37-432a-4fbd-9ecf-f7c96b43f012 req-8c296d9a-281e-47dc-9595-bbce3d027add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d81519da-d650-41a7-a009-4bcfb4e94d92", "name": "network-vif-deleted", "tag": "ce177e8d-5249-49d2-a188-951d6561d827"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:52.082739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-00760a37-432a-4fbd-9ecf-f7c96b43f012 req-8c296d9a-281e-47dc-9595-bbce3d027add service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:52.084613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-00760a37-432a-4fbd-9ecf-f7c96b43f012 req-8c296d9a-281e-47dc-9595-bbce3d027add service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:52.084613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-00760a37-432a-4fbd-9ecf-f7c96b43f012 req-8c296d9a-281e-47dc-9595-bbce3d027add service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:52.103462 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-00760a37-432a-4fbd-9ecf-f7c96b43f012 req-8c296d9a-281e-47dc-9595-bbce3d027add service nova] Creating event network-vif-deleted:ce177e8d-5249-49d2-a188-951d6561d827 for instance d81519da-d650-41a7-a009-4bcfb4e94d92 on n-h1-862964-3 Oct 29 01:26:52.115640 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-00760a37-432a-4fbd-9ecf-f7c96b43f012 req-8c296d9a-281e-47dc-9595-bbce3d027add service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053618 Oct 29 01:26:52.115640 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2679/5108] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:26:52.407243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4cfe7e61-7742-4b1d-bfbc-fc8b9b7ccff4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:52.408171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4cfe7e61-7742-4b1d-bfbc-fc8b9b7ccff4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:52.414917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cfe7e61-7742-4b1d-bfbc-fc8b9b7ccff4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:52.414917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cfe7e61-7742-4b1d-bfbc-fc8b9b7ccff4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:52.415229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cfe7e61-7742-4b1d-bfbc-fc8b9b7ccff4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:52.416555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cfe7e61-7742-4b1d-bfbc-fc8b9b7ccff4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:52.417209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cfe7e61-7742-4b1d-bfbc-fc8b9b7ccff4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:52.417798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4cfe7e61-7742-4b1d-bfbc-fc8b9b7ccff4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:52.780889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4cfe7e61-7742-4b1d-bfbc-fc8b9b7ccff4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b2ed8dfd1945d69101697fc1a76b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6665b951aa434564ae17a148c0dbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:52.796557 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4cfe7e61-7742-4b1d-bfbc-fc8b9b7ccff4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 200 len: 1313 microversion: 2.1 time: 0.394063 Oct 29 01:26:52.797168 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2430/5109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:52 2022] GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:52.950135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-890b15e4-7546-485f-a7db-059f7e15b4cf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:52.951777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-890b15e4-7546-485f-a7db-059f7e15b4cf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:52.965092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-890b15e4-7546-485f-a7db-059f7e15b4cf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:52.965899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-890b15e4-7546-485f-a7db-059f7e15b4cf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:52.966364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-890b15e4-7546-485f-a7db-059f7e15b4cf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:52.968517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-890b15e4-7546-485f-a7db-059f7e15b4cf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:52.969000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-890b15e4-7546-485f-a7db-059f7e15b4cf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:52.969481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-890b15e4-7546-485f-a7db-059f7e15b4cf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:52.974778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=67,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:26:53.036002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-890b15e4-7546-485f-a7db-059f7e15b4cf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:53.036647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-890b15e4-7546-485f-a7db-059f7e15b4cf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:53.038800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-890b15e4-7546-485f-a7db-059f7e15b4cf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:53.041995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-890b15e4-7546-485f-a7db-059f7e15b4cf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lazy-loading 'fault' on Instance uuid d81519da-d650-41a7-a009-4bcfb4e94d92 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:26:53.175347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-890b15e4-7546-485f-a7db-059f7e15b4cf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d6b090698b4ac29481af8eb9fa6b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd5d9ef52524461a5ea497010bd3dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:53.186526 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-890b15e4-7546-485f-a7db-059f7e15b4cf tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 200 len: 1313 microversion: 2.1 time: 0.240468 Oct 29 01:26:53.205844 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2680/5110] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:52 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:53.821195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7db14cc3-550a-4c1f-8619-c5ace9fc2e5b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:53.821843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7db14cc3-550a-4c1f-8619-c5ace9fc2e5b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:53.836481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db14cc3-550a-4c1f-8619-c5ace9fc2e5b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:53.836976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db14cc3-550a-4c1f-8619-c5ace9fc2e5b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:53.837433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db14cc3-550a-4c1f-8619-c5ace9fc2e5b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:53.838139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db14cc3-550a-4c1f-8619-c5ace9fc2e5b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:53.838590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db14cc3-550a-4c1f-8619-c5ace9fc2e5b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:53.839046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7db14cc3-550a-4c1f-8619-c5ace9fc2e5b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:54.067325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7db14cc3-550a-4c1f-8619-c5ace9fc2e5b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b2ed8dfd1945d69101697fc1a76b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6665b951aa434564ae17a148c0dbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:54.079152 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7db14cc3-550a-4c1f-8619-c5ace9fc2e5b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 200 len: 1313 microversion: 2.1 time: 0.260917 Oct 29 01:26:54.080391 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2431/5111] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:53 2022] GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:54.151951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-0560885d-f000-4e67-abce-fb7c3d825ea8 req-c2265c81-dd48-4cc8-8d1f-8880b81439bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48c74ac8-7449-4326-9365-63b408d3b960", "tag": "0c3b3a0c-9263-4c37-8408-5b2e249824b8"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:54.152564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:26:54.181121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-0560885d-f000-4e67-abce-fb7c3d825ea8 req-c2265c81-dd48-4cc8-8d1f-8880b81439bf service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:54.182354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-0560885d-f000-4e67-abce-fb7c3d825ea8 req-c2265c81-dd48-4cc8-8d1f-8880b81439bf service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:54.182955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-0560885d-f000-4e67-abce-fb7c3d825ea8 req-c2265c81-dd48-4cc8-8d1f-8880b81439bf service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:54.209372 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-0560885d-f000-4e67-abce-fb7c3d825ea8 req-c2265c81-dd48-4cc8-8d1f-8880b81439bf service nova] Creating event network-changed:0c3b3a0c-9263-4c37-8408-5b2e249824b8 for instance 48c74ac8-7449-4326-9365-63b408d3b960 on n-h2-862964-3 Oct 29 01:26:54.218308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-529c8b73-95ba-4158-9e01-74a22ee4ccd5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:54.219197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-529c8b73-95ba-4158-9e01-74a22ee4ccd5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] [instance: d81519da-d650-41a7-a009-4bcfb4e94d92] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:54.229181 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-0560885d-f000-4e67-abce-fb7c3d825ea8 req-c2265c81-dd48-4cc8-8d1f-8880b81439bf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086850 Oct 29 01:26:54.230094 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2681/5112] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:26:54.246278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-529c8b73-95ba-4158-9e01-74a22ee4ccd5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:54.247356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-529c8b73-95ba-4158-9e01-74a22ee4ccd5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:54.252852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-529c8b73-95ba-4158-9e01-74a22ee4ccd5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:54.252852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-529c8b73-95ba-4158-9e01-74a22ee4ccd5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:54.253569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-529c8b73-95ba-4158-9e01-74a22ee4ccd5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:54.253659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-529c8b73-95ba-4158-9e01-74a22ee4ccd5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:54.261861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:26:54.278392 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-529c8b73-95ba-4158-9e01-74a22ee4ccd5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] HTTP exception thrown: Instance d81519da-d650-41a7-a009-4bcfb4e94d92 could not be found. Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-529c8b73-95ba-4158-9e01-74a22ee4ccd5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Request method failure captured: Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 HTTP/1.1 Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIDw5iiGVoUj0ExthEAokOqFRDebhDZpEkOyYI8F23AZXo514CdlVYTYZLdHye7kYeEsnoDGSbYnJYOtj76oiDya1A1o9ZR-LVMHM8ym3i6FfK5TS2bjHXqAg3PcLNNmLfEW4-rGO0gronpYf6Ro21UFE8ZfYT2f_iw4wMwa4Iukkhc Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 0dd5d9ef52524461a5ea497010bd3dc0 Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1246765038 Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0dd5d9ef52524461a5ea497010bd3dc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0dd5d9ef52524461a5ea497010bd3dc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0dd5d9ef52524461a5ea497010bd3dc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0dd5d9ef52524461a5ea497010bd3dc0", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1246765038 Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 0dd5d9ef52524461a5ea497010bd3dc0 Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1246765038 Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FloatingIPsAssociationTestJSON-1246765038-project Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: b7d6b090698b4ac29481af8eb9fa6b3c Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1246765038-project Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance d81519da-d650-41a7-a009-4bcfb4e94d92 could not be found. Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'd81519da-d650-41a7-a009-4bcfb4e94d92'} Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d81519da-d650-41a7-a009-4bcfb4e94d92 could not be found. Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d81519da-d650-41a7-a009-4bcfb4e94d92 could not be found. Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:54.280349 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:26:54.285430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:54.285430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:26:54.285430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:26:54.285430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:26:54.285430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:26:54.285430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:26:54.285430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d81519da-d650-41a7-a009-4bcfb4e94d92 could not be found. Oct 29 01:26:54.285430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:26:54.295931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-529c8b73-95ba-4158-9e01-74a22ee4ccd5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] Returning 404 to user: Instance d81519da-d650-41a7-a009-4bcfb4e94d92 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:26:54.297351 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-529c8b73-95ba-4158-9e01-74a22ee4ccd5 tempest-FloatingIPsAssociationTestJSON-1246765038 tempest-FloatingIPsAssociationTestJSON-1246765038-project] 10.222.0.26 "GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92" status: 404 len: 111 microversion: 2.1 time: 0.083864 Oct 29 01:26:54.302194 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2432/5113] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:54 2022] GET /compute/v2.1/servers/d81519da-d650-41a7-a009-4bcfb4e94d92 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:26:55.112929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fdadcd4c-dacd-40a6-ade3-40226a0c7c34 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:55.115120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fdadcd4c-dacd-40a6-ade3-40226a0c7c34 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:55.129800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fdadcd4c-dacd-40a6-ade3-40226a0c7c34 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:55.130508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fdadcd4c-dacd-40a6-ade3-40226a0c7c34 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:55.144978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fdadcd4c-dacd-40a6-ade3-40226a0c7c34 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:55.148112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fdadcd4c-dacd-40a6-ade3-40226a0c7c34 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:55.148623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fdadcd4c-dacd-40a6-ade3-40226a0c7c34 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:55.151503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fdadcd4c-dacd-40a6-ade3-40226a0c7c34 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:55.626941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fdadcd4c-dacd-40a6-ade3-40226a0c7c34 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b2ed8dfd1945d69101697fc1a76b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6665b951aa434564ae17a148c0dbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:55.633402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=58 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:26:55.653733 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fdadcd4c-dacd-40a6-ade3-40226a0c7c34 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 200 len: 1313 microversion: 2.1 time: 0.548395 Oct 29 01:26:55.653733 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2682/5114] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:55 2022] GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 1313 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:56.681703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cac87c86-0365-44f0-8fce-fa6fad7a91d4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:56.682450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cac87c86-0365-44f0-8fce-fa6fad7a91d4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:56.692749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cac87c86-0365-44f0-8fce-fa6fad7a91d4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:56.693362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cac87c86-0365-44f0-8fce-fa6fad7a91d4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:56.694053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cac87c86-0365-44f0-8fce-fa6fad7a91d4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:56.694850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cac87c86-0365-44f0-8fce-fa6fad7a91d4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:56.695574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cac87c86-0365-44f0-8fce-fa6fad7a91d4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:56.696191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cac87c86-0365-44f0-8fce-fa6fad7a91d4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:57.485269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cac87c86-0365-44f0-8fce-fa6fad7a91d4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b2ed8dfd1945d69101697fc1a76b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6665b951aa434564ae17a148c0dbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:57.493869 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cac87c86-0365-44f0-8fce-fa6fad7a91d4 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 200 len: 1313 microversion: 2.1 time: 0.817881 Oct 29 01:26:57.516920 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2433/5115] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:56 2022] GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 1313 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:58.528253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ab263df3-2310-4170-9f3e-15cdef26d92f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:58.535577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ab263df3-2310-4170-9f3e-15cdef26d92f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:58.549110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab263df3-2310-4170-9f3e-15cdef26d92f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:58.553217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab263df3-2310-4170-9f3e-15cdef26d92f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:58.558323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab263df3-2310-4170-9f3e-15cdef26d92f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:58.563696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab263df3-2310-4170-9f3e-15cdef26d92f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:58.564651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab263df3-2310-4170-9f3e-15cdef26d92f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:58.565304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab263df3-2310-4170-9f3e-15cdef26d92f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:58.937222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ab263df3-2310-4170-9f3e-15cdef26d92f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b2ed8dfd1945d69101697fc1a76b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6665b951aa434564ae17a148c0dbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:26:58.948484 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ab263df3-2310-4170-9f3e-15cdef26d92f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 200 len: 1313 microversion: 2.1 time: 0.436006 Oct 29 01:26:58.949083 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2683/5116] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:58 2022] GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:26:59.592194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-474a166e-b6f9-4e54-a308-0cc3689a26ae req-c5645a88-0f4f-4443-bacb-21dd0a26ca5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c74ac8-7449-4326-9365-63b408d3b960", "name": "network-vif-plugged", "status": "completed", "tag": "0c3b3a0c-9263-4c37-8408-5b2e249824b8"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:26:59.628358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-474a166e-b6f9-4e54-a308-0cc3689a26ae req-c5645a88-0f4f-4443-bacb-21dd0a26ca5e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:26:59.628847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-474a166e-b6f9-4e54-a308-0cc3689a26ae req-c5645a88-0f4f-4443-bacb-21dd0a26ca5e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:26:59.629318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-474a166e-b6f9-4e54-a308-0cc3689a26ae req-c5645a88-0f4f-4443-bacb-21dd0a26ca5e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:26:59.662693 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-474a166e-b6f9-4e54-a308-0cc3689a26ae req-c5645a88-0f4f-4443-bacb-21dd0a26ca5e service nova] Creating event network-vif-plugged:0c3b3a0c-9263-4c37-8408-5b2e249824b8 for instance 48c74ac8-7449-4326-9365-63b408d3b960 on n-h2-862964-3 Oct 29 01:26:59.689634 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-474a166e-b6f9-4e54-a308-0cc3689a26ae req-c5645a88-0f4f-4443-bacb-21dd0a26ca5e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103057 Oct 29 01:26:59.695107 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2434/5117] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:26:59.972868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0591798e-bc84-4113-be03-4397d2dd8893 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:26:59.973816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0591798e-bc84-4113-be03-4397d2dd8893 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:26:59.993246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0591798e-bc84-4113-be03-4397d2dd8893 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:00.000453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0591798e-bc84-4113-be03-4397d2dd8893 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:00.000978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0591798e-bc84-4113-be03-4397d2dd8893 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:00.001984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0591798e-bc84-4113-be03-4397d2dd8893 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:00.002626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0591798e-bc84-4113-be03-4397d2dd8893 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:00.003228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0591798e-bc84-4113-be03-4397d2dd8893 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:00.539392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0591798e-bc84-4113-be03-4397d2dd8893 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b2ed8dfd1945d69101697fc1a76b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6665b951aa434564ae17a148c0dbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:00.553937 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0591798e-bc84-4113-be03-4397d2dd8893 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 200 len: 1313 microversion: 2.1 time: 0.585742 Oct 29 01:27:00.557503 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2684/5118] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:26:59 2022] GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:27:01.583110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a2a47e4e-921a-409b-8ea6-8153f42bd411 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:01.584037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a2a47e4e-921a-409b-8ea6-8153f42bd411 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:01.609482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2a47e4e-921a-409b-8ea6-8153f42bd411 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:01.610086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2a47e4e-921a-409b-8ea6-8153f42bd411 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:01.610802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2a47e4e-921a-409b-8ea6-8153f42bd411 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:01.612883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2a47e4e-921a-409b-8ea6-8153f42bd411 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:01.614557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2a47e4e-921a-409b-8ea6-8153f42bd411 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:01.616125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2a47e4e-921a-409b-8ea6-8153f42bd411 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:01.821133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-70546662-ca2c-4ab9-9e04-7c0243cd548a tempest-PortsAdminExtendedAttrsTestJSON-1902567769 tempest-PortsAdminExtendedAttrsTestJSON-1902567769-project-admin] Calling method '.version_select at 0x7f9d970ddca0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:01.834161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70546662-ca2c-4ab9-9e04-7c0243cd548a tempest-PortsAdminExtendedAttrsTestJSON-1902567769 tempest-PortsAdminExtendedAttrsTestJSON-1902567769-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:01.834659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70546662-ca2c-4ab9-9e04-7c0243cd548a tempest-PortsAdminExtendedAttrsTestJSON-1902567769 tempest-PortsAdminExtendedAttrsTestJSON-1902567769-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:01.835103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70546662-ca2c-4ab9-9e04-7c0243cd548a tempest-PortsAdminExtendedAttrsTestJSON-1902567769 tempest-PortsAdminExtendedAttrsTestJSON-1902567769-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:01.867256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70546662-ca2c-4ab9-9e04-7c0243cd548a tempest-PortsAdminExtendedAttrsTestJSON-1902567769 tempest-PortsAdminExtendedAttrsTestJSON-1902567769-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:01.867761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70546662-ca2c-4ab9-9e04-7c0243cd548a tempest-PortsAdminExtendedAttrsTestJSON-1902567769 tempest-PortsAdminExtendedAttrsTestJSON-1902567769-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:01.868209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70546662-ca2c-4ab9-9e04-7c0243cd548a tempest-PortsAdminExtendedAttrsTestJSON-1902567769 tempest-PortsAdminExtendedAttrsTestJSON-1902567769-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:01.894089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70546662-ca2c-4ab9-9e04-7c0243cd548a tempest-PortsAdminExtendedAttrsTestJSON-1902567769 tempest-PortsAdminExtendedAttrsTestJSON-1902567769-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:01.894598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70546662-ca2c-4ab9-9e04-7c0243cd548a tempest-PortsAdminExtendedAttrsTestJSON-1902567769 tempest-PortsAdminExtendedAttrsTestJSON-1902567769-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:01.899648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70546662-ca2c-4ab9-9e04-7c0243cd548a tempest-PortsAdminExtendedAttrsTestJSON-1902567769 tempest-PortsAdminExtendedAttrsTestJSON-1902567769-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:01.910321 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-70546662-ca2c-4ab9-9e04-7c0243cd548a tempest-PortsAdminExtendedAttrsTestJSON-1902567769 tempest-PortsAdminExtendedAttrsTestJSON-1902567769-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.636870 Oct 29 01:27:01.911485 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2435/5119] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:27:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:27:01.988081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a2a47e4e-921a-409b-8ea6-8153f42bd411 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b2ed8dfd1945d69101697fc1a76b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6665b951aa434564ae17a148c0dbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:01.996936 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a2a47e4e-921a-409b-8ea6-8153f42bd411 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 200 len: 1313 microversion: 2.1 time: 0.418310 Oct 29 01:27:01.997559 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2685/5120] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:01 2022] GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:03.022269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a04a18cf-2184-45cd-953d-dc1f57ddb09e tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:03.023053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a04a18cf-2184-45cd-953d-dc1f57ddb09e tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:03.040445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a04a18cf-2184-45cd-953d-dc1f57ddb09e tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:03.042923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a04a18cf-2184-45cd-953d-dc1f57ddb09e tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:03.042923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a04a18cf-2184-45cd-953d-dc1f57ddb09e tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:03.042923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a04a18cf-2184-45cd-953d-dc1f57ddb09e tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:03.043340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a04a18cf-2184-45cd-953d-dc1f57ddb09e tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:03.043468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a04a18cf-2184-45cd-953d-dc1f57ddb09e tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:03.267514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a04a18cf-2184-45cd-953d-dc1f57ddb09e tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b2ed8dfd1945d69101697fc1a76b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6665b951aa434564ae17a148c0dbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:03.279973 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a04a18cf-2184-45cd-953d-dc1f57ddb09e tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 200 len: 1497 microversion: 2.1 time: 0.263228 Oct 29 01:27:03.280633 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2436/5121] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:03 2022] GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 1497 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:03.313914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-49570faa-494c-448c-83b5-2562aa897839 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:03.336060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.compute.server_groups [None req-49570faa-494c-448c-83b5-2562aa897839 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Querying cell 584133c9-70d9-4dbd-88ec-66308eedb7a2(cell1) for 1 instances {{(pid=121099) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 01:27:03.337362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49570faa-494c-448c-83b5-2562aa897839 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:03.338046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49570faa-494c-448c-83b5-2562aa897839 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:03.338965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49570faa-494c-448c-83b5-2562aa897839 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:03.362723 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-49570faa-494c-448c-83b5-2562aa897839 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/c532b187-89f4-4d84-97c5-53038048beea" status: 200 len: 222 microversion: 2.1 time: 0.054702 Oct 29 01:27:03.372557 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2686/5122] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:27:03 2022] GET /compute/v2.1/os-server-groups/c532b187-89f4-4d84-97c5-53038048beea => generated 222 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:27:03.383972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2e13ce12-f303-4eb4-b72a-71c6ed860b54 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:03.384888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2e13ce12-f303-4eb4-b72a-71c6ed860b54 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:03.398079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e13ce12-f303-4eb4-b72a-71c6ed860b54 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:03.398585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e13ce12-f303-4eb4-b72a-71c6ed860b54 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:03.399026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e13ce12-f303-4eb4-b72a-71c6ed860b54 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:03.399942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e13ce12-f303-4eb4-b72a-71c6ed860b54 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:03.400572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e13ce12-f303-4eb4-b72a-71c6ed860b54 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:03.401246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e13ce12-f303-4eb4-b72a-71c6ed860b54 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:03.446925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2e13ce12-f303-4eb4-b72a-71c6ed860b54 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:27:03.873874 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2e13ce12-f303-4eb4-b72a-71c6ed860b54 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "DELETE /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 204 len: 0 microversion: 2.1 time: 0.501912 Oct 29 01:27:03.875228 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2437/5123] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:27:03 2022] DELETE /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:27:03.889439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b1563f62-59e8-457b-ae37-5c0f85365150 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:03.890561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b1563f62-59e8-457b-ae37-5c0f85365150 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:03.899141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1563f62-59e8-457b-ae37-5c0f85365150 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:03.899999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1563f62-59e8-457b-ae37-5c0f85365150 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:03.900612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1563f62-59e8-457b-ae37-5c0f85365150 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:03.902611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1563f62-59e8-457b-ae37-5c0f85365150 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:03.903332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1563f62-59e8-457b-ae37-5c0f85365150 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:03.907339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1563f62-59e8-457b-ae37-5c0f85365150 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:04.128277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b1563f62-59e8-457b-ae37-5c0f85365150 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b2ed8dfd1945d69101697fc1a76b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6665b951aa434564ae17a148c0dbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:04.138325 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b1563f62-59e8-457b-ae37-5c0f85365150 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 200 len: 1503 microversion: 2.1 time: 0.258669 Oct 29 01:27:04.139859 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2687/5124] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:03 2022] GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 1503 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:05.182664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6415da58-3794-4c84-896e-2acff5a37ba2 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:05.183374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6415da58-3794-4c84-896e-2acff5a37ba2 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:05.196079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6415da58-3794-4c84-896e-2acff5a37ba2 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:05.196552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6415da58-3794-4c84-896e-2acff5a37ba2 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:05.197008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6415da58-3794-4c84-896e-2acff5a37ba2 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:05.202581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6415da58-3794-4c84-896e-2acff5a37ba2 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:05.203088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6415da58-3794-4c84-896e-2acff5a37ba2 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:05.203535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6415da58-3794-4c84-896e-2acff5a37ba2 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:06.016850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6415da58-3794-4c84-896e-2acff5a37ba2 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b2ed8dfd1945d69101697fc1a76b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6665b951aa434564ae17a148c0dbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:06.026690 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6415da58-3794-4c84-896e-2acff5a37ba2 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 200 len: 1503 microversion: 2.1 time: 0.848196 Oct 29 01:27:06.031582 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2438/5125] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:05 2022] GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 1503 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:06.776184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-142eeca3-ae49-495c-94e9-66c2717fa31f req-a5c8caff-bae9-47f6-b184-6d1083efdf27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c74ac8-7449-4326-9365-63b408d3b960", "name": "network-vif-deleted", "tag": "0c3b3a0c-9263-4c37-8408-5b2e249824b8"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:27:06.796573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-142eeca3-ae49-495c-94e9-66c2717fa31f req-a5c8caff-bae9-47f6-b184-6d1083efdf27 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:06.802167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-142eeca3-ae49-495c-94e9-66c2717fa31f req-a5c8caff-bae9-47f6-b184-6d1083efdf27 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:06.802719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-142eeca3-ae49-495c-94e9-66c2717fa31f req-a5c8caff-bae9-47f6-b184-6d1083efdf27 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:06.823620 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-142eeca3-ae49-495c-94e9-66c2717fa31f req-a5c8caff-bae9-47f6-b184-6d1083efdf27 service nova] Creating event network-vif-deleted:0c3b3a0c-9263-4c37-8408-5b2e249824b8 for instance 48c74ac8-7449-4326-9365-63b408d3b960 on n-h2-862964-3 Oct 29 01:27:06.831428 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-142eeca3-ae49-495c-94e9-66c2717fa31f req-a5c8caff-bae9-47f6-b184-6d1083efdf27 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060082 Oct 29 01:27:06.834798 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2688/5126] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:27:07.061064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-44cec842-5673-4eb8-b25a-68c9e2e0689b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:07.063385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-44cec842-5673-4eb8-b25a-68c9e2e0689b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:07.083462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44cec842-5673-4eb8-b25a-68c9e2e0689b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:07.085474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44cec842-5673-4eb8-b25a-68c9e2e0689b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:07.085474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44cec842-5673-4eb8-b25a-68c9e2e0689b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:07.086100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44cec842-5673-4eb8-b25a-68c9e2e0689b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:07.087313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44cec842-5673-4eb8-b25a-68c9e2e0689b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:07.087982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44cec842-5673-4eb8-b25a-68c9e2e0689b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:07.229902 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-44cec842-5673-4eb8-b25a-68c9e2e0689b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b2ed8dfd1945d69101697fc1a76b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6665b951aa434564ae17a148c0dbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:07.240318 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-44cec842-5673-4eb8-b25a-68c9e2e0689b tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 200 len: 1298 microversion: 2.1 time: 0.187668 Oct 29 01:27:07.240890 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2439/5127] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:07 2022] GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 1298 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:08.274661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6915e02c-0234-49ac-9f6b-91da6851ca8c tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:08.275637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6915e02c-0234-49ac-9f6b-91da6851ca8c tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:08.298905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6915e02c-0234-49ac-9f6b-91da6851ca8c tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:08.302727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6915e02c-0234-49ac-9f6b-91da6851ca8c tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:08.302727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6915e02c-0234-49ac-9f6b-91da6851ca8c tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:08.303302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6915e02c-0234-49ac-9f6b-91da6851ca8c tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:08.304759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6915e02c-0234-49ac-9f6b-91da6851ca8c tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:08.305373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6915e02c-0234-49ac-9f6b-91da6851ca8c tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:08.328055 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-6915e02c-0234-49ac-9f6b-91da6851ca8c tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] HTTP exception thrown: Instance 48c74ac8-7449-4326-9365-63b408d3b960 could not be found. Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6915e02c-0234-49ac-9f6b-91da6851ca8c tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Request method failure captured: Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 HTTP/1.1 Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIFOVZaTqH0AAdjiCFkU8zDf8EDddKkOmq6jvdwLfja8M9r03ITaDTfZrKH1S2dENo3I4lEDfwC1D8HuOhCxUcQxCarVL_EFLu_TlkVa5nB89K5kf0hn-7O6u9u66hGrJIr5stW6woH7J2V06WyWj7DtBL2wY91Ikfqs19TJ5Ou-dGY Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6665b951aa434564ae17a148c0dbad0a Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "tempest-type-1256669382", "name": "tempest-service-742402894", "endpoints": [{"region": "tempest-region-29364574", "publicURL": "https://url-1950094127.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "tempest-type-598773366", "name": "tempest-service-731538052", "endpoints": [{"region": "tempest-region-769961586", "internalURL": "https://url-1588670077.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6665b951aa434564ae17a148c0dbad0a", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6665b951aa434564ae17a148c0dbad0a Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerGroupTestJSON-282251516-project Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 32b2ed8dfd1945d69101697fc1a76b55 Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerGroupTestJSON-282251516-project Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 48c74ac8-7449-4326-9365-63b408d3b960 could not be found. Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '48c74ac8-7449-4326-9365-63b408d3b960'} Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48c74ac8-7449-4326-9365-63b408d3b960 could not be found. Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:27:08.329779 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:27:08.342908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48c74ac8-7449-4326-9365-63b408d3b960 could not be found. Oct 29 01:27:08.342908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.342908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:08.342908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.342908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.342908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:08.342908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:08.342908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:27:08.342908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:27:08.342908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48c74ac8-7449-4326-9365-63b408d3b960 could not be found. Oct 29 01:27:08.342908 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.342908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6915e02c-0234-49ac-9f6b-91da6851ca8c tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Returning 404 to user: Instance 48c74ac8-7449-4326-9365-63b408d3b960 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:27:08.342908 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6915e02c-0234-49ac-9f6b-91da6851ca8c tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 404 len: 111 microversion: 2.1 time: 0.067755 Oct 29 01:27:08.342908 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2689/5128] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:08 2022] GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:27:08.343840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bd2ba482-bc93-4d2c-ab7a-0bace4073bf2 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:08.362119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.compute.server_groups [None req-bd2ba482-bc93-4d2c-ab7a-0bace4073bf2 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Querying cell 584133c9-70d9-4dbd-88ec-66308eedb7a2(cell1) for 1 instances {{(pid=121100) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 01:27:08.362119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd2ba482-bc93-4d2c-ab7a-0bace4073bf2 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:08.362119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd2ba482-bc93-4d2c-ab7a-0bace4073bf2 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:08.362119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd2ba482-bc93-4d2c-ab7a-0bace4073bf2 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:08.383515 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bd2ba482-bc93-4d2c-ab7a-0bace4073bf2 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.045388 Oct 29 01:27:08.384120 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2440/5129] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:27:08 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:27:08.397105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ab475b64-fc8c-4f1c-982d-cd7942d63315 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:08.410965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.compute.server_groups [None req-ab475b64-fc8c-4f1c-982d-cd7942d63315 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Querying cell 584133c9-70d9-4dbd-88ec-66308eedb7a2(cell1) for 1 instances {{(pid=121099) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 01:27:08.411675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab475b64-fc8c-4f1c-982d-cd7942d63315 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:08.412176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab475b64-fc8c-4f1c-982d-cd7942d63315 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:08.412587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab475b64-fc8c-4f1c-982d-cd7942d63315 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:08.447996 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ab475b64-fc8c-4f1c-982d-cd7942d63315 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/c532b187-89f4-4d84-97c5-53038048beea" status: 200 len: 184 microversion: 2.1 time: 0.054915 Oct 29 01:27:08.449422 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2690/5130] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:27:08 2022] GET /compute/v2.1/os-server-groups/c532b187-89f4-4d84-97c5-53038048beea => generated 184 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:27:08.461648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c69ba654-4364-485c-b8b2-1dd56175ca36 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:08.464228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c69ba654-4364-485c-b8b2-1dd56175ca36 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:08.469347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c69ba654-4364-485c-b8b2-1dd56175ca36 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:08.470142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c69ba654-4364-485c-b8b2-1dd56175ca36 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:08.470849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c69ba654-4364-485c-b8b2-1dd56175ca36 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:08.471764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c69ba654-4364-485c-b8b2-1dd56175ca36 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:08.472445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c69ba654-4364-485c-b8b2-1dd56175ca36 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:08.473571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c69ba654-4364-485c-b8b2-1dd56175ca36 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:08.490980 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-c69ba654-4364-485c-b8b2-1dd56175ca36 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] HTTP exception thrown: Instance 48c74ac8-7449-4326-9365-63b408d3b960 could not be found. Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c69ba654-4364-485c-b8b2-1dd56175ca36 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Request method failure captured: Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 HTTP/1.1 Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIFOVZaTqH0AAdjiCFkU8zDf8EDddKkOmq6jvdwLfja8M9r03ITaDTfZrKH1S2dENo3I4lEDfwC1D8HuOhCxUcQxCarVL_EFLu_TlkVa5nB89K5kf0hn-7O6u9u66hGrJIr5stW6woH7J2V06WyWj7DtBL2wY91Ikfqs19TJ5Ou-dGY Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 6665b951aa434564ae17a148c0dbad0a Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "tempest-type-1256669382", "name": "tempest-service-742402894", "endpoints": [{"region": "tempest-region-29364574", "publicURL": "https://url-1950094127.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "tempest-type-598773366", "name": "tempest-service-731538052", "endpoints": [{"region": "tempest-region-769961586", "internalURL": "https://url-1588670077.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6665b951aa434564ae17a148c0dbad0a", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 6665b951aa434564ae17a148c0dbad0a Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerGroupTestJSON-282251516-project Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 32b2ed8dfd1945d69101697fc1a76b55 Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerGroupTestJSON-282251516-project Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 48c74ac8-7449-4326-9365-63b408d3b960 could not be found. Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '48c74ac8-7449-4326-9365-63b408d3b960'} Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48c74ac8-7449-4326-9365-63b408d3b960 could not be found. Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:27:08.494480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:27:08.500053 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:27:08.500053 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:27:08.500053 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48c74ac8-7449-4326-9365-63b408d3b960 could not be found. Oct 29 01:27:08.500053 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.500053 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:08.500053 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.500053 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.500053 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:08.500053 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:08.500053 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:27:08.500053 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:27:08.500053 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48c74ac8-7449-4326-9365-63b408d3b960 could not be found. Oct 29 01:27:08.500053 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.500053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c69ba654-4364-485c-b8b2-1dd56175ca36 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Returning 404 to user: Instance 48c74ac8-7449-4326-9365-63b408d3b960 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:27:08.502186 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c69ba654-4364-485c-b8b2-1dd56175ca36 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "DELETE /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 404 len: 111 microversion: 2.1 time: 0.038204 Oct 29 01:27:08.506062 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2441/5131] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:27:08 2022] DELETE /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:27:08.514942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-57d8b33c-fc09-4197-a1fd-60b0c60ab67f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:08.515939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-57d8b33c-fc09-4197-a1fd-60b0c60ab67f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] [instance: 48c74ac8-7449-4326-9365-63b408d3b960] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:08.567337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57d8b33c-fc09-4197-a1fd-60b0c60ab67f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:08.569675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57d8b33c-fc09-4197-a1fd-60b0c60ab67f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:08.572205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57d8b33c-fc09-4197-a1fd-60b0c60ab67f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:08.574767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57d8b33c-fc09-4197-a1fd-60b0c60ab67f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:08.576719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57d8b33c-fc09-4197-a1fd-60b0c60ab67f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:08.578050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57d8b33c-fc09-4197-a1fd-60b0c60ab67f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:08.610376 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-57d8b33c-fc09-4197-a1fd-60b0c60ab67f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] HTTP exception thrown: Instance 48c74ac8-7449-4326-9365-63b408d3b960 could not be found. Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-57d8b33c-fc09-4197-a1fd-60b0c60ab67f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Request method failure captured: Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 HTTP/1.1 Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIFOVZaTqH0AAdjiCFkU8zDf8EDddKkOmq6jvdwLfja8M9r03ITaDTfZrKH1S2dENo3I4lEDfwC1D8HuOhCxUcQxCarVL_EFLu_TlkVa5nB89K5kf0hn-7O6u9u66hGrJIr5stW6woH7J2V06WyWj7DtBL2wY91Ikfqs19TJ5Ou-dGY Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6665b951aa434564ae17a148c0dbad0a Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "tempest-type-1256669382", "name": "tempest-service-742402894", "endpoints": [{"region": "tempest-region-29364574", "publicURL": "https://url-1950094127.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "tempest-type-598773366", "name": "tempest-service-731538052", "endpoints": [{"region": "tempest-region-769961586", "internalURL": "https://url-1588670077.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6665b951aa434564ae17a148c0dbad0a", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6665b951aa434564ae17a148c0dbad0a Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerGroupTestJSON-282251516-project Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 32b2ed8dfd1945d69101697fc1a76b55 Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerGroupTestJSON-282251516-project Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 48c74ac8-7449-4326-9365-63b408d3b960 could not be found. Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '48c74ac8-7449-4326-9365-63b408d3b960'} Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48c74ac8-7449-4326-9365-63b408d3b960 could not be found. Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:27:08.612276 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:27:08.616826 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48c74ac8-7449-4326-9365-63b408d3b960 could not be found. Oct 29 01:27:08.616826 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.616826 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:08.616826 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.616826 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.616826 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:08.616826 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:08.616826 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:27:08.616826 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:27:08.616826 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48c74ac8-7449-4326-9365-63b408d3b960 could not be found. Oct 29 01:27:08.616826 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.618647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-57d8b33c-fc09-4197-a1fd-60b0c60ab67f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Returning 404 to user: Instance 48c74ac8-7449-4326-9365-63b408d3b960 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:27:08.619697 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-57d8b33c-fc09-4197-a1fd-60b0c60ab67f tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960" status: 404 len: 111 microversion: 2.1 time: 0.112550 Oct 29 01:27:08.620443 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2691/5132] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:08 2022] GET /compute/v2.1/servers/48c74ac8-7449-4326-9365-63b408d3b960 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:27:08.629363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-782b18c1-cac8-4d89-8c2b-4618b32c674d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:08.644383 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-782b18c1-cac8-4d89-8c2b-4618b32c674d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] HTTP exception thrown: Instance group 4aa9adc6-6d01-4e46-81a4-55b92231701f could not be found. Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-782b18c1-cac8-4d89-8c2b-4618b32c674d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Request method failure captured: Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/os-server-groups/4aa9adc6-6d01-4e46-81a4-55b92231701f HTTP/1.1 Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIFOVZaTqH0AAdjiCFkU8zDf8EDddKkOmq6jvdwLfja8M9r03ITaDTfZrKH1S2dENo3I4lEDfwC1D8HuOhCxUcQxCarVL_EFLu_TlkVa5nB89K5kf0hn-7O6u9u66hGrJIr5stW6woH7J2V06WyWj7DtBL2wY91Ikfqs19TJ5Ou-dGY Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 6665b951aa434564ae17a148c0dbad0a Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "tempest-type-1256669382", "name": "tempest-service-742402894", "endpoints": [{"region": "tempest-region-29364574", "publicURL": "https://url-1950094127.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "tempest-type-598773366", "name": "tempest-service-731538052", "endpoints": [{"region": "tempest-region-769961586", "internalURL": "https://url-1588670077.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6665b951aa434564ae17a148c0dbad0a", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 6665b951aa434564ae17a148c0dbad0a Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerGroupTestJSON-282251516-project Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 32b2ed8dfd1945d69101697fc1a76b55 Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerGroupTestJSON-282251516-project Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance group 4aa9adc6-6d01-4e46-81a4-55b92231701f could not be found. Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '4aa9adc6-6d01-4e46-81a4-55b92231701f'} Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 4aa9adc6-6d01-4e46-81a4-55b92231701f could not be found. Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:27:08.644925 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 4aa9adc6-6d01-4e46-81a4-55b92231701f could not be found. Oct 29 01:27:08.648786 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.648786 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:08.648786 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.648786 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.648786 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:08.648786 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:08.648786 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:27:08.648786 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:27:08.648786 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 4aa9adc6-6d01-4e46-81a4-55b92231701f could not be found. Oct 29 01:27:08.648786 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.648786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-782b18c1-cac8-4d89-8c2b-4618b32c674d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Returning 404 to user: Instance group 4aa9adc6-6d01-4e46-81a4-55b92231701f could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:27:08.648786 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-782b18c1-cac8-4d89-8c2b-4618b32c674d tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/4aa9adc6-6d01-4e46-81a4-55b92231701f" status: 404 len: 117 microversion: 2.1 time: 0.021653 Oct 29 01:27:08.656344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-047fbe5f-56ce-45bb-930e-4d1c44d9cd57 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:08.658700 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2442/5133] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 29 01:27:08 2022] DELETE /compute/v2.1/os-server-groups/4aa9adc6-6d01-4e46-81a4-55b92231701f => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:27:08.663849 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-047fbe5f-56ce-45bb-930e-4d1c44d9cd57 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] HTTP exception thrown: Instance group 2703f974-f352-4c48-83f2-e9a484a9f255 could not be found. Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-047fbe5f-56ce-45bb-930e-4d1c44d9cd57 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Request method failure captured: Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/os-server-groups/2703f974-f352-4c48-83f2-e9a484a9f255 HTTP/1.1 Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIFOVZaTqH0AAdjiCFkU8zDf8EDddKkOmq6jvdwLfja8M9r03ITaDTfZrKH1S2dENo3I4lEDfwC1D8HuOhCxUcQxCarVL_EFLu_TlkVa5nB89K5kf0hn-7O6u9u66hGrJIr5stW6woH7J2V06WyWj7DtBL2wY91Ikfqs19TJ5Ou-dGY Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6665b951aa434564ae17a148c0dbad0a Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "tempest-type-1256669382", "name": "tempest-service-742402894", "endpoints": [{"region": "tempest-region-29364574", "publicURL": "https://url-1950094127.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "tempest-type-598773366", "name": "tempest-service-731538052", "endpoints": [{"region": "tempest-region-769961586", "internalURL": "https://url-1588670077.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6665b951aa434564ae17a148c0dbad0a", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6665b951aa434564ae17a148c0dbad0a Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerGroupTestJSON-282251516-project Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 32b2ed8dfd1945d69101697fc1a76b55 Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerGroupTestJSON-282251516-project Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance group 2703f974-f352-4c48-83f2-e9a484a9f255 could not be found. Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '2703f974-f352-4c48-83f2-e9a484a9f255'} Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2703f974-f352-4c48-83f2-e9a484a9f255 could not be found. Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:27:08.665508 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2703f974-f352-4c48-83f2-e9a484a9f255 could not be found. Oct 29 01:27:08.670267 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.670267 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:08.670267 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.670267 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.670267 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:08.670267 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:08.670267 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:27:08.670267 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:27:08.670267 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2703f974-f352-4c48-83f2-e9a484a9f255 could not be found. Oct 29 01:27:08.670267 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.677059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-047fbe5f-56ce-45bb-930e-4d1c44d9cd57 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Returning 404 to user: Instance group 2703f974-f352-4c48-83f2-e9a484a9f255 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:27:08.677059 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-047fbe5f-56ce-45bb-930e-4d1c44d9cd57 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/2703f974-f352-4c48-83f2-e9a484a9f255" status: 404 len: 117 microversion: 2.1 time: 0.020324 Oct 29 01:27:08.677059 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2692/5134] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 29 01:27:08 2022] DELETE /compute/v2.1/os-server-groups/2703f974-f352-4c48-83f2-e9a484a9f255 => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:27:08.681630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cb2b885d-7b08-4a62-9cd6-9bb310c74bfe tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:08.721561 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-cb2b885d-7b08-4a62-9cd6-9bb310c74bfe tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] HTTP exception thrown: Instance group 2ebacda8-c794-4486-8e41-550a2fcbf662 could not be found. Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cb2b885d-7b08-4a62-9cd6-9bb310c74bfe tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Request method failure captured: Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/os-server-groups/2ebacda8-c794-4486-8e41-550a2fcbf662 HTTP/1.1 Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIFOVZaTqH0AAdjiCFkU8zDf8EDddKkOmq6jvdwLfja8M9r03ITaDTfZrKH1S2dENo3I4lEDfwC1D8HuOhCxUcQxCarVL_EFLu_TlkVa5nB89K5kf0hn-7O6u9u66hGrJIr5stW6woH7J2V06WyWj7DtBL2wY91Ikfqs19TJ5Ou-dGY Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 6665b951aa434564ae17a148c0dbad0a Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "tempest-type-1256669382", "name": "tempest-service-742402894", "endpoints": [{"region": "tempest-region-29364574", "publicURL": "https://url-1950094127.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "tempest-type-598773366", "name": "tempest-service-731538052", "endpoints": [{"region": "tempest-region-769961586", "internalURL": "https://url-1588670077.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6665b951aa434564ae17a148c0dbad0a", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 6665b951aa434564ae17a148c0dbad0a Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerGroupTestJSON-282251516-project Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 32b2ed8dfd1945d69101697fc1a76b55 Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerGroupTestJSON-282251516-project Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance group 2ebacda8-c794-4486-8e41-550a2fcbf662 could not be found. Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '2ebacda8-c794-4486-8e41-550a2fcbf662'} Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2ebacda8-c794-4486-8e41-550a2fcbf662 could not be found. Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:27:08.723121 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2ebacda8-c794-4486-8e41-550a2fcbf662 could not be found. Oct 29 01:27:08.732219 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.732219 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:08.732219 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.732219 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.732219 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:08.732219 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:08.732219 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:27:08.732219 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:27:08.732219 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2ebacda8-c794-4486-8e41-550a2fcbf662 could not be found. Oct 29 01:27:08.732219 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.732219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cb2b885d-7b08-4a62-9cd6-9bb310c74bfe tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Returning 404 to user: Instance group 2ebacda8-c794-4486-8e41-550a2fcbf662 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:27:08.732219 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cb2b885d-7b08-4a62-9cd6-9bb310c74bfe tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/2ebacda8-c794-4486-8e41-550a2fcbf662" status: 404 len: 117 microversion: 2.1 time: 0.046788 Oct 29 01:27:08.732219 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2443/5135] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 29 01:27:08 2022] DELETE /compute/v2.1/os-server-groups/2ebacda8-c794-4486-8e41-550a2fcbf662 => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:27:08.737962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-13856ee1-5085-4f3d-9a90-a18332afc9b7 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:08.749836 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-13856ee1-5085-4f3d-9a90-a18332afc9b7 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] HTTP exception thrown: Instance group 845a3869-9d10-498a-87ad-506895892d0d could not be found. Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-13856ee1-5085-4f3d-9a90-a18332afc9b7 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Request method failure captured: Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/os-server-groups/845a3869-9d10-498a-87ad-506895892d0d HTTP/1.1 Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIFOVZaTqH0AAdjiCFkU8zDf8EDddKkOmq6jvdwLfja8M9r03ITaDTfZrKH1S2dENo3I4lEDfwC1D8HuOhCxUcQxCarVL_EFLu_TlkVa5nB89K5kf0hn-7O6u9u66hGrJIr5stW6woH7J2V06WyWj7DtBL2wY91Ikfqs19TJ5Ou-dGY Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 6665b951aa434564ae17a148c0dbad0a Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "tempest-type-1256669382", "name": "tempest-service-742402894", "endpoints": [{"region": "tempest-region-29364574", "publicURL": "https://url-1950094127.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "tempest-type-598773366", "name": "tempest-service-731538052", "endpoints": [{"region": "tempest-region-769961586", "internalURL": "https://url-1588670077.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6665b951aa434564ae17a148c0dbad0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6665b951aa434564ae17a148c0dbad0a", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 6665b951aa434564ae17a148c0dbad0a Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerGroupTestJSON-282251516 Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerGroupTestJSON-282251516-project Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 32b2ed8dfd1945d69101697fc1a76b55 Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerGroupTestJSON-282251516-project Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance group 845a3869-9d10-498a-87ad-506895892d0d could not be found. Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '845a3869-9d10-498a-87ad-506895892d0d'} Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 845a3869-9d10-498a-87ad-506895892d0d could not be found. Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:27:08.754257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 845a3869-9d10-498a-87ad-506895892d0d could not be found. Oct 29 01:27:08.764751 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.764751 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:08.764751 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.764751 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:08.764751 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:08.764751 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:08.764751 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:27:08.764751 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:27:08.764751 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 845a3869-9d10-498a-87ad-506895892d0d could not be found. Oct 29 01:27:08.764751 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:08.764751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-13856ee1-5085-4f3d-9a90-a18332afc9b7 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Returning 404 to user: Instance group 845a3869-9d10-498a-87ad-506895892d0d could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:27:08.764751 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-13856ee1-5085-4f3d-9a90-a18332afc9b7 tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/845a3869-9d10-498a-87ad-506895892d0d" status: 404 len: 117 microversion: 2.1 time: 0.022715 Oct 29 01:27:08.764751 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2693/5136] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 29 01:27:08 2022] DELETE /compute/v2.1/os-server-groups/845a3869-9d10-498a-87ad-506895892d0d => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:27:08.766977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e1870315-487f-48f8-a6cb-aef35f47349e tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:08.901318 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e1870315-487f-48f8-a6cb-aef35f47349e tempest-ServerGroupTestJSON-282251516 tempest-ServerGroupTestJSON-282251516-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/c532b187-89f4-4d84-97c5-53038048beea" status: 204 len: 0 microversion: 2.1 time: 0.138190 Oct 29 01:27:08.903486 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2444/5137] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 29 01:27:08 2022] DELETE /compute/v2.1/os-server-groups/c532b187-89f4-4d84-97c5-53038048beea => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:27:09.053815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7dc66b01-e443-4550-bbbb-9b149b8dcfef tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1777675034", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "ba41dfb6-7963-415d-b427-3251ef4417f0"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:27:09.144059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-7dc66b01-e443-4550-bbbb-9b149b8dcfef tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] validate_networks() for [('ba41dfb6-7963-415d-b427-3251ef4417f0', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:27:09.950833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7dc66b01-e443-4550-bbbb-9b149b8dcfef tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:27:09.952099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7dc66b01-e443-4550-bbbb-9b149b8dcfef tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:27:09.952530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7dc66b01-e443-4550-bbbb-9b149b8dcfef tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:27:09.952993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7dc66b01-e443-4550-bbbb-9b149b8dcfef tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:27:09.953436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7dc66b01-e443-4550-bbbb-9b149b8dcfef tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:27:09.991160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc66b01-e443-4550-bbbb-9b149b8dcfef tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:09.991666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc66b01-e443-4550-bbbb-9b149b8dcfef tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:09.992106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc66b01-e443-4550-bbbb-9b149b8dcfef tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:09.993371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc66b01-e443-4550-bbbb-9b149b8dcfef tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:09.994273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc66b01-e443-4550-bbbb-9b149b8dcfef tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:09.996103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc66b01-e443-4550-bbbb-9b149b8dcfef tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:10.056459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-7dc66b01-e443-4550-bbbb-9b149b8dcfef tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Getting quotas for project d77c806ec0e341a687910b98da07e148. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:27:10.068088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-7dc66b01-e443-4550-bbbb-9b149b8dcfef tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Getting quotas for user 5e5a71f37f194b15a8da5fc14ffa3744 and project d77c806ec0e341a687910b98da07e148. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:27:10.097065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7dc66b01-e443-4550-bbbb-9b149b8dcfef tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:27:10.099484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7dc66b01-e443-4550-bbbb-9b149b8dcfef tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 96e3896c-816b-4491-9877-82db9ab6dc51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:27:10.157606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:27:10.281798 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7dc66b01-e443-4550-bbbb-9b149b8dcfef tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.505777 Oct 29 01:27:10.283232 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2694/5138] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:27:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:27:10.427264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-42e94528-b750-4e4e-bac2-8b053856f92a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1526115282", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "ba41dfb6-7963-415d-b427-3251ef4417f0"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:27:10.536398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-42e94528-b750-4e4e-bac2-8b053856f92a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] validate_networks() for [('ba41dfb6-7963-415d-b427-3251ef4417f0', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:27:11.158755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-42e94528-b750-4e4e-bac2-8b053856f92a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:27:11.159187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-42e94528-b750-4e4e-bac2-8b053856f92a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:27:11.159655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-42e94528-b750-4e4e-bac2-8b053856f92a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:27:11.160306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-42e94528-b750-4e4e-bac2-8b053856f92a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:27:11.160720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-42e94528-b750-4e4e-bac2-8b053856f92a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:27:11.169745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42e94528-b750-4e4e-bac2-8b053856f92a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:11.170229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42e94528-b750-4e4e-bac2-8b053856f92a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:11.170660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42e94528-b750-4e4e-bac2-8b053856f92a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:11.171379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42e94528-b750-4e4e-bac2-8b053856f92a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:11.171855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42e94528-b750-4e4e-bac2-8b053856f92a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:11.172286 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42e94528-b750-4e4e-bac2-8b053856f92a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:11.194493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-42e94528-b750-4e4e-bac2-8b053856f92a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Getting quotas for project d77c806ec0e341a687910b98da07e148. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:27:11.200445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-42e94528-b750-4e4e-bac2-8b053856f92a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Getting quotas for user 5e5a71f37f194b15a8da5fc14ffa3744 and project d77c806ec0e341a687910b98da07e148. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:27:11.219055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-42e94528-b750-4e4e-bac2-8b053856f92a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:27:11.222505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-42e94528-b750-4e4e-bac2-8b053856f92a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: ba394c36-e5b5-4e80-bf8b-70aff3251fa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:27:11.386901 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-42e94528-b750-4e4e-bac2-8b053856f92a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.965780 Oct 29 01:27:11.395152 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2445/5139] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:27:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:27:11.759711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9f6cc10c-a70f-4e24-adbe-bc70bed61187 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1101790366", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "451", "networks": [{"uuid": "ba41dfb6-7963-415d-b427-3251ef4417f0"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:27:11.860702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-9f6cc10c-a70f-4e24-adbe-bc70bed61187 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] validate_networks() for [('ba41dfb6-7963-415d-b427-3251ef4417f0', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:27:12.587694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9f6cc10c-a70f-4e24-adbe-bc70bed61187 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:27:12.588707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9f6cc10c-a70f-4e24-adbe-bc70bed61187 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:27:12.589488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9f6cc10c-a70f-4e24-adbe-bc70bed61187 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:27:12.590051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9f6cc10c-a70f-4e24-adbe-bc70bed61187 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:27:12.591055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9f6cc10c-a70f-4e24-adbe-bc70bed61187 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:27:12.603138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f6cc10c-a70f-4e24-adbe-bc70bed61187 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:12.603823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f6cc10c-a70f-4e24-adbe-bc70bed61187 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:12.604535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f6cc10c-a70f-4e24-adbe-bc70bed61187 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:12.606265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f6cc10c-a70f-4e24-adbe-bc70bed61187 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:12.607033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f6cc10c-a70f-4e24-adbe-bc70bed61187 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:12.607854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f6cc10c-a70f-4e24-adbe-bc70bed61187 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:12.632522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-9f6cc10c-a70f-4e24-adbe-bc70bed61187 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Getting quotas for project d77c806ec0e341a687910b98da07e148. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:27:12.639852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-9f6cc10c-a70f-4e24-adbe-bc70bed61187 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Getting quotas for user 5e5a71f37f194b15a8da5fc14ffa3744 and project d77c806ec0e341a687910b98da07e148. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:27:12.658291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9f6cc10c-a70f-4e24-adbe-bc70bed61187 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:27:12.660765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9f6cc10c-a70f-4e24-adbe-bc70bed61187 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:27:12.871476 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9f6cc10c-a70f-4e24-adbe-bc70bed61187 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116533 Oct 29 01:27:12.873607 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2695/5140] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:27:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:27:12.895650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e1934abf-76a5-45d7-b131-a8af1b66356d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:12.896299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e1934abf-76a5-45d7-b131-a8af1b66356d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:13.012030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e1934abf-76a5-45d7-b131-a8af1b66356d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:13.022187 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e1934abf-76a5-45d7-b131-a8af1b66356d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1221 microversion: 2.1 time: 0.141426 Oct 29 01:27:13.023192 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2446/5141] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:12 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1221 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:14.047507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5318d53c-4133-4be4-8e9a-90ad5910af2c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:14.049338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5318d53c-4133-4be4-8e9a-90ad5910af2c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:14.343849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5318d53c-4133-4be4-8e9a-90ad5910af2c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:14.353819 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5318d53c-4133-4be4-8e9a-90ad5910af2c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1221 microversion: 2.1 time: 0.311877 Oct 29 01:27:14.365228 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2696/5142] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:14 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1221 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:15.382611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0c7d38b7-9196-44d3-be02-15834b708fca tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:15.383387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0c7d38b7-9196-44d3-be02-15834b708fca tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:15.398200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:27:15.406425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c7d38b7-9196-44d3-be02-15834b708fca tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:15.407323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c7d38b7-9196-44d3-be02-15834b708fca tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:15.408293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c7d38b7-9196-44d3-be02-15834b708fca tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:15.409326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c7d38b7-9196-44d3-be02-15834b708fca tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:15.410176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c7d38b7-9196-44d3-be02-15834b708fca tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:15.410832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c7d38b7-9196-44d3-be02-15834b708fca tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:15.547681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0c7d38b7-9196-44d3-be02-15834b708fca tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:15.557378 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0c7d38b7-9196-44d3-be02-15834b708fca tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1217 microversion: 2.1 time: 0.181014 Oct 29 01:27:15.562783 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2447/5143] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:15 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:16.587151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-13aecb89-2d6a-48be-bc6b-d495b4e780d3 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:16.587964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-13aecb89-2d6a-48be-bc6b-d495b4e780d3 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:16.600293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13aecb89-2d6a-48be-bc6b-d495b4e780d3 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:16.600990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13aecb89-2d6a-48be-bc6b-d495b4e780d3 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:16.601637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13aecb89-2d6a-48be-bc6b-d495b4e780d3 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:16.602521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13aecb89-2d6a-48be-bc6b-d495b4e780d3 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:16.603145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13aecb89-2d6a-48be-bc6b-d495b4e780d3 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:16.603755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13aecb89-2d6a-48be-bc6b-d495b4e780d3 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:16.802504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-13aecb89-2d6a-48be-bc6b-d495b4e780d3 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:16.812049 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-13aecb89-2d6a-48be-bc6b-d495b4e780d3 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1273 microversion: 2.1 time: 0.229392 Oct 29 01:27:16.835204 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2697/5144] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:16 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:17.842833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a71b290a-a1b0-4ad7-9bdf-aad749db5576 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:17.847956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a71b290a-a1b0-4ad7-9bdf-aad749db5576 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:17.882855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a71b290a-a1b0-4ad7-9bdf-aad749db5576 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:17.883392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a71b290a-a1b0-4ad7-9bdf-aad749db5576 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:17.886000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a71b290a-a1b0-4ad7-9bdf-aad749db5576 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:17.887524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a71b290a-a1b0-4ad7-9bdf-aad749db5576 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:17.889020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a71b290a-a1b0-4ad7-9bdf-aad749db5576 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:17.889742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a71b290a-a1b0-4ad7-9bdf-aad749db5576 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:18.091194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a71b290a-a1b0-4ad7-9bdf-aad749db5576 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:18.100298 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a71b290a-a1b0-4ad7-9bdf-aad749db5576 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1279 microversion: 2.1 time: 0.261933 Oct 29 01:27:18.105466 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2448/5145] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:17 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1279 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:19.128038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5eb5ed7c-7e28-447f-ad85-67c2898c7278 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:19.128658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5eb5ed7c-7e28-447f-ad85-67c2898c7278 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:19.148944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5eb5ed7c-7e28-447f-ad85-67c2898c7278 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:19.149523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5eb5ed7c-7e28-447f-ad85-67c2898c7278 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:19.149911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5eb5ed7c-7e28-447f-ad85-67c2898c7278 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:19.150629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5eb5ed7c-7e28-447f-ad85-67c2898c7278 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:19.151166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5eb5ed7c-7e28-447f-ad85-67c2898c7278 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:19.151604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5eb5ed7c-7e28-447f-ad85-67c2898c7278 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:19.319639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5eb5ed7c-7e28-447f-ad85-67c2898c7278 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:19.330177 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5eb5ed7c-7e28-447f-ad85-67c2898c7278 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1279 microversion: 2.1 time: 0.205929 Oct 29 01:27:19.337198 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2698/5146] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:19 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1279 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:20.171196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-12390d1a-4ced-4427-ae9e-00360c5ed3ec req-ad950967-8f3c-4508-811d-67685a69c598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96e3896c-816b-4491-9877-82db9ab6dc51", "tag": "b6f400d0-de45-40c0-a308-0962cc5a2ffe"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:27:20.195876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-12390d1a-4ced-4427-ae9e-00360c5ed3ec req-ad950967-8f3c-4508-811d-67685a69c598 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:20.196624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-12390d1a-4ced-4427-ae9e-00360c5ed3ec req-ad950967-8f3c-4508-811d-67685a69c598 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:20.197061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-12390d1a-4ced-4427-ae9e-00360c5ed3ec req-ad950967-8f3c-4508-811d-67685a69c598 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:20.210770 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-12390d1a-4ced-4427-ae9e-00360c5ed3ec req-ad950967-8f3c-4508-811d-67685a69c598 service nova] Creating event network-changed:b6f400d0-de45-40c0-a308-0962cc5a2ffe for instance 96e3896c-816b-4491-9877-82db9ab6dc51 on n-h2-862964-3 Oct 29 01:27:20.234380 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-12390d1a-4ced-4427-ae9e-00360c5ed3ec req-ad950967-8f3c-4508-811d-67685a69c598 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068190 Oct 29 01:27:20.237870 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2449/5147] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:27:20.366049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b91ccf5f-38a8-413e-858e-6cd8492f4a9e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:20.369846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b91ccf5f-38a8-413e-858e-6cd8492f4a9e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:20.374871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b91ccf5f-38a8-413e-858e-6cd8492f4a9e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:20.374871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b91ccf5f-38a8-413e-858e-6cd8492f4a9e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:20.375095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b91ccf5f-38a8-413e-858e-6cd8492f4a9e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:20.375636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b91ccf5f-38a8-413e-858e-6cd8492f4a9e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:20.376101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b91ccf5f-38a8-413e-858e-6cd8492f4a9e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:20.376533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b91ccf5f-38a8-413e-858e-6cd8492f4a9e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:20.895333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b91ccf5f-38a8-413e-858e-6cd8492f4a9e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:20.927189 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b91ccf5f-38a8-413e-858e-6cd8492f4a9e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1321 microversion: 2.1 time: 0.545532 Oct 29 01:27:20.927189 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2699/5148] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:20 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1321 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:21.941400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:27:21.951576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e7e98be0-00e2-4717-a7de-d3eba1b98268 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:21.952295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e7e98be0-00e2-4717-a7de-d3eba1b98268 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:21.963616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7e98be0-00e2-4717-a7de-d3eba1b98268 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:21.964113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7e98be0-00e2-4717-a7de-d3eba1b98268 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:21.964546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7e98be0-00e2-4717-a7de-d3eba1b98268 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:21.965281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7e98be0-00e2-4717-a7de-d3eba1b98268 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:21.965735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7e98be0-00e2-4717-a7de-d3eba1b98268 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:21.979308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7e98be0-00e2-4717-a7de-d3eba1b98268 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:22.824074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e7e98be0-00e2-4717-a7de-d3eba1b98268 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:22.836112 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e7e98be0-00e2-4717-a7de-d3eba1b98268 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1321 microversion: 2.1 time: 0.893114 Oct 29 01:27:22.849743 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2450/5149] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:21 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1321 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:23.866542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fa3889b4-e8d0-4992-b669-0bc1eae88580 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:23.867710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fa3889b4-e8d0-4992-b669-0bc1eae88580 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:23.871305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:27:23.884137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa3889b4-e8d0-4992-b669-0bc1eae88580 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:23.887132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa3889b4-e8d0-4992-b669-0bc1eae88580 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:23.893258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa3889b4-e8d0-4992-b669-0bc1eae88580 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:23.893258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa3889b4-e8d0-4992-b669-0bc1eae88580 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:23.893853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa3889b4-e8d0-4992-b669-0bc1eae88580 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:23.895694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa3889b4-e8d0-4992-b669-0bc1eae88580 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:24.349089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=14 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:27:24.560475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fa3889b4-e8d0-4992-b669-0bc1eae88580 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:24.572210 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fa3889b4-e8d0-4992-b669-0bc1eae88580 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1321 microversion: 2.1 time: 0.713123 Oct 29 01:27:24.579266 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2700/5150] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:23 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1321 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:25.442660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-77296519-cc45-4ff8-98a9-66cf6cbdeba0 req-f9281dbd-1ed3-48f6-ac44-6872b2f930ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48860230-5ad5-4391-9c51-27fdaa24d27d", "tag": "f5627393-bf9a-4f73-8784-e20c8224a0dd"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:27:25.455364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:27:25.481991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-77296519-cc45-4ff8-98a9-66cf6cbdeba0 req-f9281dbd-1ed3-48f6-ac44-6872b2f930ec service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:25.484966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-77296519-cc45-4ff8-98a9-66cf6cbdeba0 req-f9281dbd-1ed3-48f6-ac44-6872b2f930ec service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:25.485570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-77296519-cc45-4ff8-98a9-66cf6cbdeba0 req-f9281dbd-1ed3-48f6-ac44-6872b2f930ec service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:25.535444 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-77296519-cc45-4ff8-98a9-66cf6cbdeba0 req-f9281dbd-1ed3-48f6-ac44-6872b2f930ec service nova] Creating event network-changed:f5627393-bf9a-4f73-8784-e20c8224a0dd for instance 48860230-5ad5-4391-9c51-27fdaa24d27d on n-h2-862964-3 Oct 29 01:27:25.542699 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-77296519-cc45-4ff8-98a9-66cf6cbdeba0 req-f9281dbd-1ed3-48f6-ac44-6872b2f930ec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109263 Oct 29 01:27:25.548475 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2451/5151] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:27:25.598842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c848b9a7-9ff5-4f48-9f58-d99268b97a43 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:25.599549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c848b9a7-9ff5-4f48-9f58-d99268b97a43 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:25.607730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c848b9a7-9ff5-4f48-9f58-d99268b97a43 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:25.608583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c848b9a7-9ff5-4f48-9f58-d99268b97a43 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:25.609357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c848b9a7-9ff5-4f48-9f58-d99268b97a43 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:25.610383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c848b9a7-9ff5-4f48-9f58-d99268b97a43 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:25.611057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c848b9a7-9ff5-4f48-9f58-d99268b97a43 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:25.611856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c848b9a7-9ff5-4f48-9f58-d99268b97a43 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:25.979288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c848b9a7-9ff5-4f48-9f58-d99268b97a43 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:25.996477 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c848b9a7-9ff5-4f48-9f58-d99268b97a43 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1321 microversion: 2.1 time: 0.401946 Oct 29 01:27:26.015286 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2701/5152] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:25 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1321 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:27.045683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5456857f-1062-4fb8-91de-eadabe16ad5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:27.053635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5456857f-1062-4fb8-91de-eadabe16ad5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:27.081405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5456857f-1062-4fb8-91de-eadabe16ad5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:27.081405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5456857f-1062-4fb8-91de-eadabe16ad5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:27.081405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5456857f-1062-4fb8-91de-eadabe16ad5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:27.081405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5456857f-1062-4fb8-91de-eadabe16ad5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:27.086012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5456857f-1062-4fb8-91de-eadabe16ad5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:27.086605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5456857f-1062-4fb8-91de-eadabe16ad5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:27.454758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5456857f-1062-4fb8-91de-eadabe16ad5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:27.467432 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5456857f-1062-4fb8-91de-eadabe16ad5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1321 microversion: 2.1 time: 0.450222 Oct 29 01:27:27.492275 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2452/5153] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:27 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1321 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:27.912668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-f09143be-778a-44df-848a-e987e8c259fb req-1b24f2a2-216e-4dd2-8a30-4b65904eefd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba394c36-e5b5-4e80-bf8b-70aff3251fa2", "tag": "57131cc4-bfbe-4875-9d0c-928112519e4a"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:27:27.934492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f09143be-778a-44df-848a-e987e8c259fb req-1b24f2a2-216e-4dd2-8a30-4b65904eefd3 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:27.938107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f09143be-778a-44df-848a-e987e8c259fb req-1b24f2a2-216e-4dd2-8a30-4b65904eefd3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:27.938624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f09143be-778a-44df-848a-e987e8c259fb req-1b24f2a2-216e-4dd2-8a30-4b65904eefd3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:27.970968 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-f09143be-778a-44df-848a-e987e8c259fb req-1b24f2a2-216e-4dd2-8a30-4b65904eefd3 service nova] Creating event network-changed:57131cc4-bfbe-4875-9d0c-928112519e4a for instance ba394c36-e5b5-4e80-bf8b-70aff3251fa2 on n-h2-862964-3 Oct 29 01:27:27.991102 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-f09143be-778a-44df-848a-e987e8c259fb req-1b24f2a2-216e-4dd2-8a30-4b65904eefd3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081966 Oct 29 01:27:27.994876 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2702/5154] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:27:28.499367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9e590381-2f71-4e81-bca8-65217759ceee tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:28.499976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9e590381-2f71-4e81-bca8-65217759ceee tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:28.524721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e590381-2f71-4e81-bca8-65217759ceee tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:28.525257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e590381-2f71-4e81-bca8-65217759ceee tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:28.528251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e590381-2f71-4e81-bca8-65217759ceee tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:28.529202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e590381-2f71-4e81-bca8-65217759ceee tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:28.529869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e590381-2f71-4e81-bca8-65217759ceee tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:28.529965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e590381-2f71-4e81-bca8-65217759ceee tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:28.859055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9e590381-2f71-4e81-bca8-65217759ceee tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:28.871243 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9e590381-2f71-4e81-bca8-65217759ceee tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1321 microversion: 2.1 time: 0.374820 Oct 29 01:27:28.872198 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2453/5155] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:28 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1321 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:28.976711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f60031d8-f2ec-46b7-81b4-349d8e222990 tempest-FloatingIPsNegativeTestJSON-1911157743 tempest-FloatingIPsNegativeTestJSON-1911157743-project] Calling method '.version_select at 0x7f9d96c68700>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:29.143153 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f60031d8-f2ec-46b7-81b4-349d8e222990 tempest-FloatingIPsNegativeTestJSON-1911157743 tempest-FloatingIPsNegativeTestJSON-1911157743-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.448065 Oct 29 01:27:29.147935 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2703/5156] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 29 01:27:28 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:27:29.162997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b173f6cc-1274-423b-a7b2-b9fbe31de87b tempest-FloatingIPsNegativeTestJSON-1911157743 tempest-FloatingIPsNegativeTestJSON-1911157743-project] Action: 'create', calling method: .version_select at 0x7f9d9fe104c0>, body: {"pool": "non_exist_pool"} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:27:29.284061 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-b173f6cc-1274-423b-a7b2-b9fbe31de87b tempest-FloatingIPsNegativeTestJSON-1911157743 tempest-FloatingIPsNegativeTestJSON-1911157743-project] HTTP exception thrown: Floating IP pool not found. Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b173f6cc-1274-423b-a7b2-b9fbe31de87b tempest-FloatingIPsNegativeTestJSON-1911157743 tempest-FloatingIPsNegativeTestJSON-1911157743-project] Request method failure captured: Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 26 Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIGAgCe3bSpfNabP-o5QvnniWzEpYRuHL-T-hscIMFQIGF0nsR8wCK12HPBmYpv5sk84_CnwW5yDo1r1iJUk55hRhTE6-_8FPxuYqja7EZpENVDnzNY2VnNM6npHle4YzmQO60zVIupP20DfZAvyhjfCuxVQJEcPhVMOUuwtHlmYyJo Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 1f660a01f9bb49b3b6d57c63dc2f05a7 Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1911157743 Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1f660a01f9bb49b3b6d57c63dc2f05a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1f660a01f9bb49b3b6d57c63dc2f05a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1f660a01f9bb49b3b6d57c63dc2f05a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1f660a01f9bb49b3b6d57c63dc2f05a7", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1911157743 Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 1f660a01f9bb49b3b6d57c63dc2f05a7 Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1911157743 Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-FloatingIPsNegativeTestJSON-1911157743-project Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 059fc7e0d50c493fb762139dbe920cb2 Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1911157743-project Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: {"pool": "non_exist_pool"} Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: exception: Floating IP pool not found. Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:27:29.286315 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:27:29.293016 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 29 01:27:29.293016 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:29.293016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b173f6cc-1274-423b-a7b2-b9fbe31de87b tempest-FloatingIPsNegativeTestJSON-1911157743 tempest-FloatingIPsNegativeTestJSON-1911157743-project] Returning 404 to user: Floating IP pool not found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:27:29.293016 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b173f6cc-1274-423b-a7b2-b9fbe31de87b tempest-FloatingIPsNegativeTestJSON-1911157743 tempest-FloatingIPsNegativeTestJSON-1911157743-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.132072 Oct 29 01:27:29.293016 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2454/5157] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 29 01:27:29 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:27:29.303983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-14eb55d7-05ab-4940-9889-69c37f432b98 tempest-FloatingIPsNegativeTestJSON-1911157743 tempest-FloatingIPsNegativeTestJSON-1911157743-project] Calling method '.version_select at 0x7f9d9fd481f0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:29.388992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG neutronclient.v2_0.client [None req-14eb55d7-05ab-4940-9889-69c37f432b98 tempest-FloatingIPsNegativeTestJSON-1911157743 tempest-FloatingIPsNegativeTestJSON-1911157743-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9a0ec499-1cae-406a-8e07-946537da3ec1 could not be found", "detail": ""}} {{(pid=121099) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 01:27:29.389695 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-14eb55d7-05ab-4940-9889-69c37f432b98 tempest-FloatingIPsNegativeTestJSON-1911157743 tempest-FloatingIPsNegativeTestJSON-1911157743-project] HTTP exception thrown: Floating IP not found for ID 9a0ec499-1cae-406a-8e07-946537da3ec1 Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-14eb55d7-05ab-4940-9889-69c37f432b98 tempest-FloatingIPsNegativeTestJSON-1911157743 tempest-FloatingIPsNegativeTestJSON-1911157743-project] Request method failure captured: Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/os-floating-ips/9a0ec499-1cae-406a-8e07-946537da3ec1 HTTP/1.1 Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIGAgCe3bSpfNabP-o5QvnniWzEpYRuHL-T-hscIMFQIGF0nsR8wCK12HPBmYpv5sk84_CnwW5yDo1r1iJUk55hRhTE6-_8FPxuYqja7EZpENVDnzNY2VnNM6npHle4YzmQO60zVIupP20DfZAvyhjfCuxVQJEcPhVMOUuwtHlmYyJo Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 1f660a01f9bb49b3b6d57c63dc2f05a7 Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1911157743 Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1f660a01f9bb49b3b6d57c63dc2f05a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1f660a01f9bb49b3b6d57c63dc2f05a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1f660a01f9bb49b3b6d57c63dc2f05a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1f660a01f9bb49b3b6d57c63dc2f05a7", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1911157743 Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 1f660a01f9bb49b3b6d57c63dc2f05a7 Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1911157743 Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-FloatingIPsNegativeTestJSON-1911157743-project Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 059fc7e0d50c493fb762139dbe920cb2 Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1911157743-project Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: exception: Floating IP not found for ID 9a0ec499-1cae-406a-8e07-946537da3ec1 Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '9a0ec499-1cae-406a-8e07-946537da3ec1'} Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9a0ec499-1cae-406a-8e07-946537da3ec1 could not be found Oct 29 01:27:29.391924 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-214112d8-db56-458f-b306-d2920fe168f4'] Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9a0ec499-1cae-406a-8e07-946537da3ec1. Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9a0ec499-1cae-406a-8e07-946537da3ec1 Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9a0ec499-1cae-406a-8e07-946537da3ec1 Oct 29 01:27:29.396236 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:29.400706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-14eb55d7-05ab-4940-9889-69c37f432b98 tempest-FloatingIPsNegativeTestJSON-1911157743 tempest-FloatingIPsNegativeTestJSON-1911157743-project] Returning 404 to user: Floating IP not found for ID 9a0ec499-1cae-406a-8e07-946537da3ec1 {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:27:29.401934 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-14eb55d7-05ab-4940-9889-69c37f432b98 tempest-FloatingIPsNegativeTestJSON-1911157743 tempest-FloatingIPsNegativeTestJSON-1911157743-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/9a0ec499-1cae-406a-8e07-946537da3ec1" status: 404 len: 111 microversion: 2.1 time: 0.104215 Oct 29 01:27:29.403337 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2704/5158] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:27:29 2022] DELETE /compute/v2.1/os-floating-ips/9a0ec499-1cae-406a-8e07-946537da3ec1 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:27:29.882942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-49e20fae-2cb5-47e2-b014-7edffd65cd8d req-aae47e62-b7ac-4c19-b337-369911e34205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e3896c-816b-4491-9877-82db9ab6dc51", "name": "network-vif-plugged", "status": "completed", "tag": "b6f400d0-de45-40c0-a308-0962cc5a2ffe"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:27:29.900429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3d8a076b-656e-4ef1-8422-d5b7cc6c5b78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:29.901022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-49e20fae-2cb5-47e2-b014-7edffd65cd8d req-aae47e62-b7ac-4c19-b337-369911e34205 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:29.901541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3d8a076b-656e-4ef1-8422-d5b7cc6c5b78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:29.901824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-49e20fae-2cb5-47e2-b014-7edffd65cd8d req-aae47e62-b7ac-4c19-b337-369911e34205 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:29.901982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-49e20fae-2cb5-47e2-b014-7edffd65cd8d req-aae47e62-b7ac-4c19-b337-369911e34205 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:29.914689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d8a076b-656e-4ef1-8422-d5b7cc6c5b78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:29.916084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d8a076b-656e-4ef1-8422-d5b7cc6c5b78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:29.917317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d8a076b-656e-4ef1-8422-d5b7cc6c5b78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:29.919409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d8a076b-656e-4ef1-8422-d5b7cc6c5b78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:29.921348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d8a076b-656e-4ef1-8422-d5b7cc6c5b78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:29.924855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d8a076b-656e-4ef1-8422-d5b7cc6c5b78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:29.928961 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-49e20fae-2cb5-47e2-b014-7edffd65cd8d req-aae47e62-b7ac-4c19-b337-369911e34205 service nova] Creating event network-vif-plugged:b6f400d0-de45-40c0-a308-0962cc5a2ffe for instance 96e3896c-816b-4491-9877-82db9ab6dc51 on n-h2-862964-3 Oct 29 01:27:29.942999 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-49e20fae-2cb5-47e2-b014-7edffd65cd8d req-aae47e62-b7ac-4c19-b337-369911e34205 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064452 Oct 29 01:27:29.944372 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2455/5159] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:27:30.390151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3d8a076b-656e-4ef1-8422-d5b7cc6c5b78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:30.406281 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3d8a076b-656e-4ef1-8422-d5b7cc6c5b78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1321 microversion: 2.1 time: 0.511201 Oct 29 01:27:30.407583 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2705/5160] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:29 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1321 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:31.436658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ff477183-bce5-4892-a09f-7e3b7b64dcfc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:31.437840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ff477183-bce5-4892-a09f-7e3b7b64dcfc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:31.465530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff477183-bce5-4892-a09f-7e3b7b64dcfc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:31.465530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff477183-bce5-4892-a09f-7e3b7b64dcfc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:31.465530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff477183-bce5-4892-a09f-7e3b7b64dcfc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:31.465530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff477183-bce5-4892-a09f-7e3b7b64dcfc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:31.465530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff477183-bce5-4892-a09f-7e3b7b64dcfc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:31.465530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff477183-bce5-4892-a09f-7e3b7b64dcfc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:32.082611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ff477183-bce5-4892-a09f-7e3b7b64dcfc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:32.085464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:27:32.097773 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ff477183-bce5-4892-a09f-7e3b7b64dcfc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1321 microversion: 2.1 time: 0.667434 Oct 29 01:27:32.099463 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2456/5161] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:31 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1321 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:33.123059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f765c6d4-74b0-4800-b8a6-7c0b52dea5fc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:33.125016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f765c6d4-74b0-4800-b8a6-7c0b52dea5fc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:33.141475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f765c6d4-74b0-4800-b8a6-7c0b52dea5fc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:33.142603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f765c6d4-74b0-4800-b8a6-7c0b52dea5fc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:33.145078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f765c6d4-74b0-4800-b8a6-7c0b52dea5fc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:33.150171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f765c6d4-74b0-4800-b8a6-7c0b52dea5fc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:33.152419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f765c6d4-74b0-4800-b8a6-7c0b52dea5fc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:33.156381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f765c6d4-74b0-4800-b8a6-7c0b52dea5fc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:33.169981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=94 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:27:33.967223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f765c6d4-74b0-4800-b8a6-7c0b52dea5fc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:33.987396 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f765c6d4-74b0-4800-b8a6-7c0b52dea5fc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1321 microversion: 2.1 time: 0.868400 Oct 29 01:27:33.988839 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2706/5162] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:33 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1321 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:35.017041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f546b5af-8195-40a2-b30e-147343e35b59 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:35.018381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f546b5af-8195-40a2-b30e-147343e35b59 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:35.027088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f546b5af-8195-40a2-b30e-147343e35b59 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:35.031536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f546b5af-8195-40a2-b30e-147343e35b59 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:35.034656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f546b5af-8195-40a2-b30e-147343e35b59 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:35.037829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f546b5af-8195-40a2-b30e-147343e35b59 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:35.040323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f546b5af-8195-40a2-b30e-147343e35b59 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:35.040999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f546b5af-8195-40a2-b30e-147343e35b59 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:35.546279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f546b5af-8195-40a2-b30e-147343e35b59 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:35.568712 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f546b5af-8195-40a2-b30e-147343e35b59 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1321 microversion: 2.1 time: 0.558486 Oct 29 01:27:35.569358 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2457/5163] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:35 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1321 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:36.249736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-a9e77042-e3ef-4f1e-b5c0-25624e0bfa3e req-432c8010-5e7b-4f07-a419-aa15771db405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba394c36-e5b5-4e80-bf8b-70aff3251fa2", "name": "network-vif-plugged", "status": "completed", "tag": "57131cc4-bfbe-4875-9d0c-928112519e4a"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:27:36.285714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a9e77042-e3ef-4f1e-b5c0-25624e0bfa3e req-432c8010-5e7b-4f07-a419-aa15771db405 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:36.286208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a9e77042-e3ef-4f1e-b5c0-25624e0bfa3e req-432c8010-5e7b-4f07-a419-aa15771db405 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:36.286643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a9e77042-e3ef-4f1e-b5c0-25624e0bfa3e req-432c8010-5e7b-4f07-a419-aa15771db405 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:36.316772 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-a9e77042-e3ef-4f1e-b5c0-25624e0bfa3e req-432c8010-5e7b-4f07-a419-aa15771db405 service nova] Creating event network-vif-plugged:57131cc4-bfbe-4875-9d0c-928112519e4a for instance ba394c36-e5b5-4e80-bf8b-70aff3251fa2 on n-h2-862964-3 Oct 29 01:27:36.336816 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-a9e77042-e3ef-4f1e-b5c0-25624e0bfa3e req-432c8010-5e7b-4f07-a419-aa15771db405 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091432 Oct 29 01:27:36.337937 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2707/5164] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:27:36.593906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b7cdccef-9486-441f-812c-fb4ce51f1182 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:36.594810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b7cdccef-9486-441f-812c-fb4ce51f1182 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:36.620320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7cdccef-9486-441f-812c-fb4ce51f1182 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:36.621075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7cdccef-9486-441f-812c-fb4ce51f1182 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:36.623382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7cdccef-9486-441f-812c-fb4ce51f1182 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:36.628413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7cdccef-9486-441f-812c-fb4ce51f1182 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:36.629254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7cdccef-9486-441f-812c-fb4ce51f1182 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:36.631823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7cdccef-9486-441f-812c-fb4ce51f1182 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:37.175815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b7cdccef-9486-441f-812c-fb4ce51f1182 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:37.195568 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b7cdccef-9486-441f-812c-fb4ce51f1182 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1321 microversion: 2.1 time: 0.601147 Oct 29 01:27:37.195568 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2458/5165] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:36 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1321 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:38.224767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e73147ca-727f-4aee-b5b2-5753d4f79d1f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:38.225436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e73147ca-727f-4aee-b5b2-5753d4f79d1f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:38.243698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e73147ca-727f-4aee-b5b2-5753d4f79d1f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:38.248979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e73147ca-727f-4aee-b5b2-5753d4f79d1f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:38.251065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e73147ca-727f-4aee-b5b2-5753d4f79d1f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:38.252203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e73147ca-727f-4aee-b5b2-5753d4f79d1f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:38.261726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e73147ca-727f-4aee-b5b2-5753d4f79d1f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:38.262686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e73147ca-727f-4aee-b5b2-5753d4f79d1f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:39.038632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e73147ca-727f-4aee-b5b2-5753d4f79d1f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:39.111003 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e73147ca-727f-4aee-b5b2-5753d4f79d1f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1321 microversion: 2.1 time: 0.895589 Oct 29 01:27:39.115799 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2708/5166] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:38 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1321 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:39.670357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-f15ac8b5-d4d9-411e-b0bf-2ecd59d5716e req-d3e6b62d-efd8-4af5-91d1-693fb1613f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48860230-5ad5-4391-9c51-27fdaa24d27d", "name": "network-vif-plugged", "status": "completed", "tag": "f5627393-bf9a-4f73-8784-e20c8224a0dd"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:27:39.699193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f15ac8b5-d4d9-411e-b0bf-2ecd59d5716e req-d3e6b62d-efd8-4af5-91d1-693fb1613f52 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:39.699932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f15ac8b5-d4d9-411e-b0bf-2ecd59d5716e req-d3e6b62d-efd8-4af5-91d1-693fb1613f52 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:39.700661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f15ac8b5-d4d9-411e-b0bf-2ecd59d5716e req-d3e6b62d-efd8-4af5-91d1-693fb1613f52 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:39.739185 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f15ac8b5-d4d9-411e-b0bf-2ecd59d5716e req-d3e6b62d-efd8-4af5-91d1-693fb1613f52 service nova] Creating event network-vif-plugged:f5627393-bf9a-4f73-8784-e20c8224a0dd for instance 48860230-5ad5-4391-9c51-27fdaa24d27d on n-h2-862964-3 Oct 29 01:27:39.748532 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-f15ac8b5-d4d9-411e-b0bf-2ecd59d5716e req-d3e6b62d-efd8-4af5-91d1-693fb1613f52 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082217 Oct 29 01:27:39.762575 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2459/5167] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:27:40.139700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-45c8393e-c768-4311-8c8f-91532f2844db tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:40.141087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-45c8393e-c768-4311-8c8f-91532f2844db tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:40.156695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45c8393e-c768-4311-8c8f-91532f2844db tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:40.157828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45c8393e-c768-4311-8c8f-91532f2844db tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:40.159787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45c8393e-c768-4311-8c8f-91532f2844db tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:40.160724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45c8393e-c768-4311-8c8f-91532f2844db tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:40.166511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45c8393e-c768-4311-8c8f-91532f2844db tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:40.167153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45c8393e-c768-4311-8c8f-91532f2844db tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:40.621973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-45c8393e-c768-4311-8c8f-91532f2844db tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:40.637995 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-45c8393e-c768-4311-8c8f-91532f2844db tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1321 microversion: 2.1 time: 0.503079 Oct 29 01:27:40.640496 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2709/5168] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:40 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1321 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:41.253951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-357a42d9-66ab-4bff-bcf5-43c7bdaa31b1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:41.254523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-357a42d9-66ab-4bff-bcf5-43c7bdaa31b1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:41.264629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-357a42d9-66ab-4bff-bcf5-43c7bdaa31b1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:41.265075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-357a42d9-66ab-4bff-bcf5-43c7bdaa31b1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:41.272038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-357a42d9-66ab-4bff-bcf5-43c7bdaa31b1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:41.272947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-357a42d9-66ab-4bff-bcf5-43c7bdaa31b1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:41.273448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-357a42d9-66ab-4bff-bcf5-43c7bdaa31b1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:41.273889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-357a42d9-66ab-4bff-bcf5-43c7bdaa31b1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:41.334549 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-357a42d9-66ab-4bff-bcf5-43c7bdaa31b1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2/ips" status: 200 len: 150 microversion: 2.1 time: 0.085266 Oct 29 01:27:41.335490 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2460/5169] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 29 01:27:41 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2/ips => generated 150 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:27:41.348715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6f710ece-5a55-4d49-a5df-ec76da599bd4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80a5c14b-d20c-4cab-8221-5997c5a733b3"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:27:41.351225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6f710ece-5a55-4d49-a5df-ec76da599bd4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:41.362468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f710ece-5a55-4d49-a5df-ec76da599bd4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:41.367644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f710ece-5a55-4d49-a5df-ec76da599bd4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:41.369385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f710ece-5a55-4d49-a5df-ec76da599bd4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:41.369812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f710ece-5a55-4d49-a5df-ec76da599bd4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:41.371541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f710ece-5a55-4d49-a5df-ec76da599bd4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:41.372120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f710ece-5a55-4d49-a5df-ec76da599bd4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:41.554658 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-6f710ece-5a55-4d49-a5df-ec76da599bd4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] HTTP exception thrown: Invalid volume: volume 80a5c14b-d20c-4cab-8221-5997c5a733b3 is already attached to instances: 2c86e050-73e4-4c80-a145-420293bbf8b2 Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6f710ece-5a55-4d49-a5df-ec76da599bd4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Request method failure captured: Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2/os-volume_attachments HTTP/1.1 Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 74 Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXICkjStyzUNQCP56iyabn5ahlWbK9bq57JWpf6w_r5-2BC1n9lfKn4n-q7ViwDGqwiAHQbWPA068CNGAzX2vWzwGSgwtRiu5lH8sKE1aT3VNdBS9vlw817eOLttRxo_xXGlmclE5Xf7yAYwC5hE1QU1PdlNbXv8l2Qz8VlCemFm6YRM Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad278c0b0b9a41beae8b29986e315743", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 444e13f1f2d945dfb31b83d8e19c2032 Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: {"volumeAttachment": {"volumeId": "80a5c14b-d20c-4cab-8221-5997c5a733b3"}} Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: exception: Invalid volume: volume 80a5c14b-d20c-4cab-8221-5997c5a733b3 is already attached to instances: 2c86e050-73e4-4c80-a145-420293bbf8b2 Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'server_id': '7e86fdd3-e373-4b20-85cf-73ce67194dc2', 'body': {'volumeAttachment': {'volumeId': '80a5c14b-d20c-4cab-8221-5997c5a733b3'}}} Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 80a5c14b-d20c-4cab-8221-5997c5a733b3 is already attached to instances: 2c86e050-73e4-4c80-a145-420293bbf8b2 Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:27:41.557730 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:27:41.578299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:27:41.578299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:27:41.578299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 29 01:27:41.578299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 01:27:41.578299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 80a5c14b-d20c-4cab-8221-5997c5a733b3 is already attached to instances: 2c86e050-73e4-4c80-a145-420293bbf8b2 Oct 29 01:27:41.578299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:41.578299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:41.578299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:41.578299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:41.578299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:41.578299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:41.578299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:27:41.578299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:27:41.578299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 80a5c14b-d20c-4cab-8221-5997c5a733b3 is already attached to instances: 2c86e050-73e4-4c80-a145-420293bbf8b2 Oct 29 01:27:41.578299 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:27:41.578299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6f710ece-5a55-4d49-a5df-ec76da599bd4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Returning 400 to user: Invalid volume: volume 80a5c14b-d20c-4cab-8221-5997c5a733b3 is already attached to instances: 2c86e050-73e4-4c80-a145-420293bbf8b2 {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:27:41.578299 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6f710ece-5a55-4d49-a5df-ec76da599bd4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "POST /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.220207 Oct 29 01:27:41.578299 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2710/5170] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 29 01:27:41 2022] POST /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2/os-volume_attachments => generated 174 bytes in 225 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 01:27:41.579713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-633f90eb-541d-4dff-9c8a-5f4ddbb9316f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:41.579713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-633f90eb-541d-4dff-9c8a-5f4ddbb9316f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:41.589254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-633f90eb-541d-4dff-9c8a-5f4ddbb9316f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:41.590001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-633f90eb-541d-4dff-9c8a-5f4ddbb9316f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:41.590682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-633f90eb-541d-4dff-9c8a-5f4ddbb9316f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:41.592313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-633f90eb-541d-4dff-9c8a-5f4ddbb9316f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:41.593013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-633f90eb-541d-4dff-9c8a-5f4ddbb9316f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:41.593690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-633f90eb-541d-4dff-9c8a-5f4ddbb9316f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:41.665687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8824f1ef-2626-4b41-9377-78b4d58fcd2c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:41.669703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8824f1ef-2626-4b41-9377-78b4d58fcd2c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:41.691422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-633f90eb-541d-4dff-9c8a-5f4ddbb9316f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:27:41.733904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8824f1ef-2626-4b41-9377-78b4d58fcd2c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:41.737370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8824f1ef-2626-4b41-9377-78b4d58fcd2c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:41.747920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8824f1ef-2626-4b41-9377-78b4d58fcd2c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:41.749352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8824f1ef-2626-4b41-9377-78b4d58fcd2c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:41.750312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8824f1ef-2626-4b41-9377-78b4d58fcd2c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:41.750941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8824f1ef-2626-4b41-9377-78b4d58fcd2c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:42.052490 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-633f90eb-541d-4dff-9c8a-5f4ddbb9316f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 204 len: 0 microversion: 2.1 time: 0.482644 Oct 29 01:27:42.053511 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2461/5171] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:27:41 2022] DELETE /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:27:42.066419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f882bf4d-a73d-431a-90bc-c5e51e42e41f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:42.066419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f882bf4d-a73d-431a-90bc-c5e51e42e41f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:42.080940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f882bf4d-a73d-431a-90bc-c5e51e42e41f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:42.081581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f882bf4d-a73d-431a-90bc-c5e51e42e41f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:42.082136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f882bf4d-a73d-431a-90bc-c5e51e42e41f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:42.082958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f882bf4d-a73d-431a-90bc-c5e51e42e41f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:42.083551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f882bf4d-a73d-431a-90bc-c5e51e42e41f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:42.084092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f882bf4d-a73d-431a-90bc-c5e51e42e41f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:42.331824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8824f1ef-2626-4b41-9377-78b4d58fcd2c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:42.340979 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8824f1ef-2626-4b41-9377-78b4d58fcd2c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1321 microversion: 2.1 time: 0.682103 Oct 29 01:27:42.363687 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2711/5172] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:41 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1321 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:42.719069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f882bf4d-a73d-431a-90bc-c5e51e42e41f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:42.727248 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f882bf4d-a73d-431a-90bc-c5e51e42e41f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1681 microversion: 2.1 time: 0.669560 Oct 29 01:27:42.739438 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2462/5173] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:42 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1681 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:43.379130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cfea3246-bb99-4451-9e5b-b88b51024476 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:43.379826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cfea3246-bb99-4451-9e5b-b88b51024476 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:43.441844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfea3246-bb99-4451-9e5b-b88b51024476 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:43.441844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfea3246-bb99-4451-9e5b-b88b51024476 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:43.443963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfea3246-bb99-4451-9e5b-b88b51024476 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:43.445030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfea3246-bb99-4451-9e5b-b88b51024476 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:43.445723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfea3246-bb99-4451-9e5b-b88b51024476 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:43.448489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfea3246-bb99-4451-9e5b-b88b51024476 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:43.757573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e74837a-40ef-4025-85e0-46a287397f04 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:43.758342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7e74837a-40ef-4025-85e0-46a287397f04 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:43.779545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e74837a-40ef-4025-85e0-46a287397f04 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:43.785550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e74837a-40ef-4025-85e0-46a287397f04 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:43.786460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e74837a-40ef-4025-85e0-46a287397f04 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:43.787444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e74837a-40ef-4025-85e0-46a287397f04 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:43.791652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e74837a-40ef-4025-85e0-46a287397f04 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:43.792415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e74837a-40ef-4025-85e0-46a287397f04 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:44.478965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7e74837a-40ef-4025-85e0-46a287397f04 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:44.491301 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e74837a-40ef-4025-85e0-46a287397f04 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1681 microversion: 2.1 time: 0.737823 Oct 29 01:27:44.495060 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2463/5174] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:43 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1681 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:44.543231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cfea3246-bb99-4451-9e5b-b88b51024476 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:44.562293 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cfea3246-bb99-4451-9e5b-b88b51024476 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1511 microversion: 2.1 time: 1.190023 Oct 29 01:27:44.563153 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2712/5175] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:43 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1511 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:44.600945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f28df516-7865-45bb-9a1c-36f4d41dd39d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:44.601737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f28df516-7865-45bb-9a1c-36f4d41dd39d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 96e3896c-816b-4491-9877-82db9ab6dc51] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:44.630053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f28df516-7865-45bb-9a1c-36f4d41dd39d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:44.630053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f28df516-7865-45bb-9a1c-36f4d41dd39d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:44.633558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f28df516-7865-45bb-9a1c-36f4d41dd39d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:44.639293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f28df516-7865-45bb-9a1c-36f4d41dd39d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:44.640899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f28df516-7865-45bb-9a1c-36f4d41dd39d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:44.642681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f28df516-7865-45bb-9a1c-36f4d41dd39d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:45.213785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-157ec764-88c4-400b-bd07-67d97115316f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-713110171", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "4f780d3c-3a32-45e2-93e5-7eeb7ba5b9f5"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:27:45.253625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:27:45.267527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f28df516-7865-45bb-9a1c-36f4d41dd39d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:45.277745 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f28df516-7865-45bb-9a1c-36f4d41dd39d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51" status: 200 len: 1511 microversion: 2.1 time: 0.689130 Oct 29 01:27:45.289321 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2464/5176] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:44 2022] GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51 => generated 1511 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:45.311946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fb4eaf56-ea46-41eb-b6cc-4b478fc990ec tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:45.312771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fb4eaf56-ea46-41eb-b6cc-4b478fc990ec tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: ba394c36-e5b5-4e80-bf8b-70aff3251fa2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:45.328548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb4eaf56-ea46-41eb-b6cc-4b478fc990ec tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:45.329267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb4eaf56-ea46-41eb-b6cc-4b478fc990ec tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:45.329883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb4eaf56-ea46-41eb-b6cc-4b478fc990ec tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:45.330769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb4eaf56-ea46-41eb-b6cc-4b478fc990ec tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:45.331406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb4eaf56-ea46-41eb-b6cc-4b478fc990ec tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:45.332001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb4eaf56-ea46-41eb-b6cc-4b478fc990ec tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:45.375871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-157ec764-88c4-400b-bd07-67d97115316f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] validate_networks() for [('4f780d3c-3a32-45e2-93e5-7eeb7ba5b9f5', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:27:46.382444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fb4eaf56-ea46-41eb-b6cc-4b478fc990ec tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:46.392019 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fb4eaf56-ea46-41eb-b6cc-4b478fc990ec tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/ba394c36-e5b5-4e80-bf8b-70aff3251fa2" status: 200 len: 1512 microversion: 2.1 time: 1.085458 Oct 29 01:27:46.405943 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2465/5177] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:45 2022] GET /compute/v2.1/servers/ba394c36-e5b5-4e80-bf8b-70aff3251fa2 => generated 1512 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:27:46.422182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c35fde36-dc8b-446b-b03a-e0582f0ec22e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:46.423116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c35fde36-dc8b-446b-b03a-e0582f0ec22e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:46.443952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c35fde36-dc8b-446b-b03a-e0582f0ec22e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:46.443952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c35fde36-dc8b-446b-b03a-e0582f0ec22e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:46.443952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c35fde36-dc8b-446b-b03a-e0582f0ec22e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:46.445342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c35fde36-dc8b-446b-b03a-e0582f0ec22e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:46.446031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c35fde36-dc8b-446b-b03a-e0582f0ec22e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:46.446682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c35fde36-dc8b-446b-b03a-e0582f0ec22e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:47.940567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c35fde36-dc8b-446b-b03a-e0582f0ec22e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:47.959436 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c35fde36-dc8b-446b-b03a-e0582f0ec22e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1681 microversion: 2.1 time: 1.552120 Oct 29 01:27:47.988138 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2466/5178] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:46 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1681 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:48.033190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4b110dbb-b81a-4374-9c30-ca354abf863b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:48.063336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4b110dbb-b81a-4374-9c30-ca354abf863b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:48.081187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4b110dbb-b81a-4374-9c30-ca354abf863b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:27:48.145214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b110dbb-b81a-4374-9c30-ca354abf863b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:48.148327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b110dbb-b81a-4374-9c30-ca354abf863b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:48.148818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b110dbb-b81a-4374-9c30-ca354abf863b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:48.154006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b110dbb-b81a-4374-9c30-ca354abf863b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:48.157492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b110dbb-b81a-4374-9c30-ca354abf863b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:48.160390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b110dbb-b81a-4374-9c30-ca354abf863b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:48.441477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.multi_cell_list [None req-4b110dbb-b81a-4374-9c30-ca354abf863b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121100) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:27:48.712596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4b110dbb-b81a-4374-9c30-ca354abf863b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:48.728570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b110dbb-b81a-4374-9c30-ca354abf863b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:48.738486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b110dbb-b81a-4374-9c30-ca354abf863b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:48.739159 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b110dbb-b81a-4374-9c30-ca354abf863b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:49.159770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-157ec764-88c4-400b-bd07-67d97115316f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:27:49.162759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-157ec764-88c4-400b-bd07-67d97115316f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:27:49.165198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-157ec764-88c4-400b-bd07-67d97115316f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:27:49.165873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-157ec764-88c4-400b-bd07-67d97115316f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:27:49.166453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-157ec764-88c4-400b-bd07-67d97115316f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:27:49.186453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-157ec764-88c4-400b-bd07-67d97115316f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:49.186453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-157ec764-88c4-400b-bd07-67d97115316f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:49.186453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-157ec764-88c4-400b-bd07-67d97115316f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:49.194724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-157ec764-88c4-400b-bd07-67d97115316f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:49.195706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-157ec764-88c4-400b-bd07-67d97115316f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:49.196330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-157ec764-88c4-400b-bd07-67d97115316f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:49.240457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-157ec764-88c4-400b-bd07-67d97115316f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Getting quotas for project eaeba7c125f54d15ac32683bb5b3595d. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:27:49.255484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-157ec764-88c4-400b-bd07-67d97115316f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Getting quotas for user 8e256dd021f34b3eb11d8828bbe82b82 and project eaeba7c125f54d15ac32683bb5b3595d. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:27:49.292474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-157ec764-88c4-400b-bd07-67d97115316f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:27:49.298805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-157ec764-88c4-400b-bd07-67d97115316f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:27:49.558332 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-157ec764-88c4-400b-bd07-67d97115316f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.576410 Oct 29 01:27:49.567911 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2713/5179] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:27:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 4588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:27:49.573579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b93bada1-3b44-430f-bd48-0a5a904fba6a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:49.574205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b93bada1-3b44-430f-bd48-0a5a904fba6a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:49.594442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b93bada1-3b44-430f-bd48-0a5a904fba6a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:49.594442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b93bada1-3b44-430f-bd48-0a5a904fba6a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:49.594442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b93bada1-3b44-430f-bd48-0a5a904fba6a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:49.594442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b93bada1-3b44-430f-bd48-0a5a904fba6a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:49.594781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b93bada1-3b44-430f-bd48-0a5a904fba6a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:49.595205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b93bada1-3b44-430f-bd48-0a5a904fba6a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:50.037289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b93bada1-3b44-430f-bd48-0a5a904fba6a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:50.039867 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4b110dbb-b81a-4374-9c30-ca354abf863b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 2.050499 Oct 29 01:27:50.041973 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2467/5180] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Oct 29 01:27:47 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 2053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:50.049093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-08090fec-f0be-4fca-9dd4-da8fa4bfbc8d tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:50.050316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-08090fec-f0be-4fca-9dd4-da8fa4bfbc8d tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:50.066146 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b93bada1-3b44-430f-bd48-0a5a904fba6a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1613 microversion: 2.1 time: 0.496989 Oct 29 01:27:50.073808 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2714/5181] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:49 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1613 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:50.098367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9cf12782-8c38-49a6-ad39-d1d8cd1b1f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:50.125434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9cf12782-8c38-49a6-ad39-d1d8cd1b1f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:50.126823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9cf12782-8c38-49a6-ad39-d1d8cd1b1f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1777675034', 'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:27:50.141773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cf12782-8c38-49a6-ad39-d1d8cd1b1f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:50.145121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cf12782-8c38-49a6-ad39-d1d8cd1b1f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:50.145121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cf12782-8c38-49a6-ad39-d1d8cd1b1f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:50.145121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cf12782-8c38-49a6-ad39-d1d8cd1b1f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:50.145121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cf12782-8c38-49a6-ad39-d1d8cd1b1f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:50.145121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cf12782-8c38-49a6-ad39-d1d8cd1b1f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:50.276493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-9cf12782-8c38-49a6-ad39-d1d8cd1b1f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:27:50.307899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-08090fec-f0be-4fca-9dd4-da8fa4bfbc8d tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e256dd021f34b3eb11d8828bbe82b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeba7c125f54d15ac32683bb5b3595d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:50.317704 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-08090fec-f0be-4fca-9dd4-da8fa4bfbc8d tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 200 len: 1223 microversion: 2.1 time: 0.273971 Oct 29 01:27:50.333496 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2468/5182] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:50 2022] GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 1223 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:50.410183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9cf12782-8c38-49a6-ad39-d1d8cd1b1f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:50.423181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cf12782-8c38-49a6-ad39-d1d8cd1b1f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:50.424080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cf12782-8c38-49a6-ad39-d1d8cd1b1f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:50.427817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cf12782-8c38-49a6-ad39-d1d8cd1b1f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:50.882272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-01ddb625-0968-47b0-bb12-2d2f9a4558dc req-678d79a9-0b16-4163-b59b-81dd066a6e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e86fdd3-e373-4b20-85cf-73ce67194dc2", "name": "network-vif-deleted", "tag": "a69b3f30-d8f0-4feb-b963-b6a48a547e63"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:27:50.900548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-01ddb625-0968-47b0-bb12-2d2f9a4558dc req-678d79a9-0b16-4163-b59b-81dd066a6e2e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:50.901446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-01ddb625-0968-47b0-bb12-2d2f9a4558dc req-678d79a9-0b16-4163-b59b-81dd066a6e2e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:50.903881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-01ddb625-0968-47b0-bb12-2d2f9a4558dc req-678d79a9-0b16-4163-b59b-81dd066a6e2e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:50.956280 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-01ddb625-0968-47b0-bb12-2d2f9a4558dc req-678d79a9-0b16-4163-b59b-81dd066a6e2e service nova] Creating event network-vif-deleted:a69b3f30-d8f0-4feb-b963-b6a48a547e63 for instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 on n-h1-862964-3 Oct 29 01:27:51.000868 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-01ddb625-0968-47b0-bb12-2d2f9a4558dc req-678d79a9-0b16-4163-b59b-81dd066a6e2e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122018 Oct 29 01:27:51.008228 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2469/5183] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:27:51.076240 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9cf12782-8c38-49a6-ad39-d1d8cd1b1f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1777675034" status: 200 len: 1514 microversion: 2.1 time: 0.994629 Oct 29 01:27:51.076774 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2715/5184] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:27:50 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1777675034 => generated 1514 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:51.098196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-49b139ef-8a37-4bcc-afe7-041c3367fa4a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:51.098917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-49b139ef-8a37-4bcc-afe7-041c3367fa4a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:51.104866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0d684a7b-076c-440b-8ec3-1b7877dfc5fe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:51.112991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0d684a7b-076c-440b-8ec3-1b7877dfc5fe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:51.132794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49b139ef-8a37-4bcc-afe7-041c3367fa4a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:51.133340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49b139ef-8a37-4bcc-afe7-041c3367fa4a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:51.134080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49b139ef-8a37-4bcc-afe7-041c3367fa4a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:51.134497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49b139ef-8a37-4bcc-afe7-041c3367fa4a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:51.135043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49b139ef-8a37-4bcc-afe7-041c3367fa4a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:51.135373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49b139ef-8a37-4bcc-afe7-041c3367fa4a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:51.140787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0d684a7b-076c-440b-8ec3-1b7877dfc5fe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:27:51.150314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d684a7b-076c-440b-8ec3-1b7877dfc5fe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:51.156518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d684a7b-076c-440b-8ec3-1b7877dfc5fe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:51.156686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d684a7b-076c-440b-8ec3-1b7877dfc5fe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:51.157567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d684a7b-076c-440b-8ec3-1b7877dfc5fe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:51.158046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d684a7b-076c-440b-8ec3-1b7877dfc5fe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:51.158477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d684a7b-076c-440b-8ec3-1b7877dfc5fe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:51.306858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-49b139ef-8a37-4bcc-afe7-041c3367fa4a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:51.320914 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-49b139ef-8a37-4bcc-afe7-041c3367fa4a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1325 microversion: 2.1 time: 0.221935 Oct 29 01:27:51.342494 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2470/5185] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:51 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1325 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:51.356200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b1f577da-e44d-4123-a9b7-8415796e03b4 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:51.357729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b1f577da-e44d-4123-a9b7-8415796e03b4 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:51.467706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-0d684a7b-076c-440b-8ec3-1b7877dfc5fe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:27:51.598936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b1f577da-e44d-4123-a9b7-8415796e03b4 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e256dd021f34b3eb11d8828bbe82b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeba7c125f54d15ac32683bb5b3595d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:51.608965 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b1f577da-e44d-4123-a9b7-8415796e03b4 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 200 len: 1223 microversion: 2.1 time: 0.256568 Oct 29 01:27:51.609603 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2471/5186] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:51 2022] GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 1223 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:51.661014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0d684a7b-076c-440b-8ec3-1b7877dfc5fe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:51.681986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d684a7b-076c-440b-8ec3-1b7877dfc5fe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:51.682564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d684a7b-076c-440b-8ec3-1b7877dfc5fe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:51.683022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d684a7b-076c-440b-8ec3-1b7877dfc5fe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:52.156031 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0d684a7b-076c-440b-8ec3-1b7877dfc5fe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 1.054897 Oct 29 01:27:52.156968 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2716/5187] 10.222.0.26 () {58 vars in 1173 bytes} [Sat Oct 29 01:27:51 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:27:52.187851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-272077af-30ca-4d66-895b-b3974f1c566c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:52.192983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-272077af-30ca-4d66-895b-b3974f1c566c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:52.193468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.compute.servers [None req-272077af-30ca-4d66-895b-b3974f1c566c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Removing options 'limit' from query {{(pid=121100) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 01:27:52.197613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-272077af-30ca-4d66-895b-b3974f1c566c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:27:52.219508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-272077af-30ca-4d66-895b-b3974f1c566c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:52.220325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-272077af-30ca-4d66-895b-b3974f1c566c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:52.224724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-272077af-30ca-4d66-895b-b3974f1c566c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:52.224724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-272077af-30ca-4d66-895b-b3974f1c566c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:52.224724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-272077af-30ca-4d66-895b-b3974f1c566c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:52.224724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-272077af-30ca-4d66-895b-b3974f1c566c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:52.312239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-272077af-30ca-4d66-895b-b3974f1c566c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:52.327562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-272077af-30ca-4d66-895b-b3974f1c566c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:52.328306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-272077af-30ca-4d66-895b-b3974f1c566c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:52.329130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-272077af-30ca-4d66-895b-b3974f1c566c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:52.344577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d2248589-76b7-4c56-9e12-0b561bebca00 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:52.346346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d2248589-76b7-4c56-9e12-0b561bebca00 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:52.364261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2248589-76b7-4c56-9e12-0b561bebca00 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:52.366288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2248589-76b7-4c56-9e12-0b561bebca00 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:52.368973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2248589-76b7-4c56-9e12-0b561bebca00 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:52.373714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2248589-76b7-4c56-9e12-0b561bebca00 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:52.376363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2248589-76b7-4c56-9e12-0b561bebca00 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:52.377286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2248589-76b7-4c56-9e12-0b561bebca00 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:52.486407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2248589-76b7-4c56-9e12-0b561bebca00 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:52.486407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2248589-76b7-4c56-9e12-0b561bebca00 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:52.487122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2248589-76b7-4c56-9e12-0b561bebca00 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:52.487797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-d2248589-76b7-4c56-9e12-0b561bebca00 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lazy-loading 'fault' on Instance uuid 7e86fdd3-e373-4b20-85cf-73ce67194dc2 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:27:52.690714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d2248589-76b7-4c56-9e12-0b561bebca00 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:52.703126 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d2248589-76b7-4c56-9e12-0b561bebca00 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 200 len: 1330 microversion: 2.1 time: 0.361200 Oct 29 01:27:52.703644 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2717/5188] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:52 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 1330 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:27:52.737984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-99babf61-c72c-4881-93e0-f18b02c34d1e tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:52.742302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-99babf61-c72c-4881-93e0-f18b02c34d1e tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:52.771357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99babf61-c72c-4881-93e0-f18b02c34d1e tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:52.771357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99babf61-c72c-4881-93e0-f18b02c34d1e tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:52.771357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99babf61-c72c-4881-93e0-f18b02c34d1e tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:52.776089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99babf61-c72c-4881-93e0-f18b02c34d1e tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:52.776593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99babf61-c72c-4881-93e0-f18b02c34d1e tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:52.777080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99babf61-c72c-4881-93e0-f18b02c34d1e tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:53.062068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-99babf61-c72c-4881-93e0-f18b02c34d1e tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e256dd021f34b3eb11d8828bbe82b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeba7c125f54d15ac32683bb5b3595d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:53.072890 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-99babf61-c72c-4881-93e0-f18b02c34d1e tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 200 len: 1275 microversion: 2.1 time: 0.352028 Oct 29 01:27:53.072890 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2718/5189] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:52 2022] GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 1275 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:53.197591 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-272077af-30ca-4d66-895b-b3974f1c566c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 1.013738 Oct 29 01:27:53.198244 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2472/5190] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 29 01:27:52 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:53.239968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b0b0f33b-ffef-4d5e-a6ce-847e498f9804 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:53.245123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b0b0f33b-ffef-4d5e-a6ce-847e498f9804 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:53.251616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b0b0f33b-ffef-4d5e-a6ce-847e498f9804 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:27:53.277841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0b0f33b-ffef-4d5e-a6ce-847e498f9804 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:53.278652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0b0f33b-ffef-4d5e-a6ce-847e498f9804 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:53.279811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0b0f33b-ffef-4d5e-a6ce-847e498f9804 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:53.279811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0b0f33b-ffef-4d5e-a6ce-847e498f9804 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:53.280267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0b0f33b-ffef-4d5e-a6ce-847e498f9804 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:53.280695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0b0f33b-ffef-4d5e-a6ce-847e498f9804 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:53.369667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-b0b0f33b-ffef-4d5e-a6ce-847e498f9804 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:27:53.430376 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b0b0f33b-ffef-4d5e-a6ce-847e498f9804 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.194386 Oct 29 01:27:53.430981 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2719/5191] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:27:53 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:53.455070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-10874b02-9657-487a-a883-68b40e6bb10b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:53.467565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-10874b02-9657-487a-a883-68b40e6bb10b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:53.468020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.compute.servers [None req-10874b02-9657-487a-a883-68b40e6bb10b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Removing options 'limit' from query {{(pid=121100) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 01:27:53.468697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-10874b02-9657-487a-a883-68b40e6bb10b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:27:53.490493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:27:53.492194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10874b02-9657-487a-a883-68b40e6bb10b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:53.498046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10874b02-9657-487a-a883-68b40e6bb10b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:53.498611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10874b02-9657-487a-a883-68b40e6bb10b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:53.502681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10874b02-9657-487a-a883-68b40e6bb10b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:53.502681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10874b02-9657-487a-a883-68b40e6bb10b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:53.502681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10874b02-9657-487a-a883-68b40e6bb10b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:53.593114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.multi_cell_list [None req-10874b02-9657-487a-a883-68b40e6bb10b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121100) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:27:53.676442 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-10874b02-9657-487a-a883-68b40e6bb10b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.227373 Oct 29 01:27:53.680420 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2473/5192] 10.222.0.26 () {58 vars in 1150 bytes} [Sat Oct 29 01:27:53 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:53.698127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-053fca93-bfc1-48ac-8c70-3a7902d36318 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:53.710402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-053fca93-bfc1-48ac-8c70-3a7902d36318 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:53.711599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-053fca93-bfc1-48ac-8c70-3a7902d36318 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:27:53.736198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-053fca93-bfc1-48ac-8c70-3a7902d36318 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:53.737447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7c3f3892-c190-465e-9278-a74afae4164c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:53.738056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-053fca93-bfc1-48ac-8c70-3a7902d36318 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:53.738196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7c3f3892-c190-465e-9278-a74afae4164c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:53.738727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-053fca93-bfc1-48ac-8c70-3a7902d36318 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:53.743917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-053fca93-bfc1-48ac-8c70-3a7902d36318 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:53.744746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-053fca93-bfc1-48ac-8c70-3a7902d36318 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:53.748727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-053fca93-bfc1-48ac-8c70-3a7902d36318 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:53.783724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c3f3892-c190-465e-9278-a74afae4164c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:53.786320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c3f3892-c190-465e-9278-a74afae4164c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:53.786320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c3f3892-c190-465e-9278-a74afae4164c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:53.786320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c3f3892-c190-465e-9278-a74afae4164c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:53.797211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c3f3892-c190-465e-9278-a74afae4164c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:53.797807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c3f3892-c190-465e-9278-a74afae4164c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:53.808651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-053fca93-bfc1-48ac-8c70-3a7902d36318 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:27:53.879060 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-053fca93-bfc1-48ac-8c70-3a7902d36318 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.186569 Oct 29 01:27:53.881489 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-7c3f3892-c190-465e-9278-a74afae4164c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] HTTP exception thrown: Instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 could not be found. Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7c3f3892-c190-465e-9278-a74afae4164c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Request method failure captured: Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 HTTP/1.1 Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXICkjStyzUNQCP56iyabn5ahlWbK9bq57JWpf6w_r5-2BC1n9lfKn4n-q7ViwDGqwiAHQbWPA068CNGAzX2vWzwGSgwtRiu5lH8sKE1aT3VNdBS9vlw817eOLttRxo_xXGlmclE5Xf7yAYwC5hE1QU1PdlNbXv8l2Qz8VlCemFm6YRM Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad278c0b0b9a41beae8b29986e315743", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 444e13f1f2d945dfb31b83d8e19c2032 Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 could not be found. Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '7e86fdd3-e373-4b20-85cf-73ce67194dc2'} Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 could not be found. Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 could not be found. Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:27:53.884743 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:53.901562 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:27:53.901562 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:27:53.901562 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:27:53.901562 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:27:53.901562 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:27:53.901562 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 could not be found. Oct 29 01:27:53.901562 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:27:53.902228 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2720/5193] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 29 01:27:53 2022] GET /compute/v2.1/servers => generated 1012 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:53.902317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7c3f3892-c190-465e-9278-a74afae4164c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Returning 404 to user: Instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:27:53.902317 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7c3f3892-c190-465e-9278-a74afae4164c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 404 len: 111 microversion: 2.1 time: 0.160859 Oct 29 01:27:53.902317 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2474/5194] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:53 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:27:53.908607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f27b3c53-86a1-4c3e-b597-68e448bfe676 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:53.916496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5971de9d-ad60-428b-a41b-3452ddfc7ca5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '.version_select at 0x7f9d97081700>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:53.930754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f27b3c53-86a1-4c3e-b597-68e448bfe676 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:53.931577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f27b3c53-86a1-4c3e-b597-68e448bfe676 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:27:53.978045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f27b3c53-86a1-4c3e-b597-68e448bfe676 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:53.979510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f27b3c53-86a1-4c3e-b597-68e448bfe676 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:53.982145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f27b3c53-86a1-4c3e-b597-68e448bfe676 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:53.988282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f27b3c53-86a1-4c3e-b597-68e448bfe676 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:53.988282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f27b3c53-86a1-4c3e-b597-68e448bfe676 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:53.996119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f27b3c53-86a1-4c3e-b597-68e448bfe676 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:54.092019 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5971de9d-ad60-428b-a41b-3452ddfc7ca5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-901630675" status: 202 len: 0 microversion: 2.1 time: 0.184897 Oct 29 01:27:54.092294 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2475/5195] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 29 01:27:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-901630675 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:27:54.101770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-35dbf687-4198-4604-a6a5-364603b2b570 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:54.102706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-35dbf687-4198-4604-a6a5-364603b2b570 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:54.125466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35dbf687-4198-4604-a6a5-364603b2b570 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:54.126447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35dbf687-4198-4604-a6a5-364603b2b570 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:54.128536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35dbf687-4198-4604-a6a5-364603b2b570 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:54.143117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35dbf687-4198-4604-a6a5-364603b2b570 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:54.144798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35dbf687-4198-4604-a6a5-364603b2b570 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:54.149213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35dbf687-4198-4604-a6a5-364603b2b570 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:54.224264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:27:54.292268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-f27b3c53-86a1-4c3e-b597-68e448bfe676 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:27:54.304956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:27:54.466898 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f27b3c53-86a1-4c3e-b597-68e448bfe676 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.544419 Oct 29 01:27:54.466898 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2721/5196] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:27:53 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:27:54.481868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a35c7cad-723e-4eca-992b-da6c33a81b30 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:54.507291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a35c7cad-723e-4eca-992b-da6c33a81b30 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:54.507291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.compute.servers [None req-a35c7cad-723e-4eca-992b-da6c33a81b30 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Removing options 'limit' from query {{(pid=121099) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 01:27:54.511228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a35c7cad-723e-4eca-992b-da6c33a81b30 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:27:54.528778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a35c7cad-723e-4eca-992b-da6c33a81b30 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:54.529334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a35c7cad-723e-4eca-992b-da6c33a81b30 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:54.529838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a35c7cad-723e-4eca-992b-da6c33a81b30 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:54.541400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a35c7cad-723e-4eca-992b-da6c33a81b30 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:54.544936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a35c7cad-723e-4eca-992b-da6c33a81b30 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:54.545669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a35c7cad-723e-4eca-992b-da6c33a81b30 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:54.603584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-35dbf687-4198-4604-a6a5-364603b2b570 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e256dd021f34b3eb11d8828bbe82b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeba7c125f54d15ac32683bb5b3595d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:54.618717 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-35dbf687-4198-4604-a6a5-364603b2b570 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 200 len: 1283 microversion: 2.1 time: 0.520557 Oct 29 01:27:54.622497 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2476/5197] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:54 2022] GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 1283 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:27:54.638592 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a35c7cad-723e-4eca-992b-da6c33a81b30 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.159442 Oct 29 01:27:54.640216 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2722/5198] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Oct 29 01:27:54 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:27:54.674181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-31b14c2c-20d4-4215-9516-75931d050306 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:54.683707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-31b14c2c-20d4-4215-9516-75931d050306 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:54.685829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-31b14c2c-20d4-4215-9516-75931d050306 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1777675034', 'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:27:54.698205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31b14c2c-20d4-4215-9516-75931d050306 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:54.702843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31b14c2c-20d4-4215-9516-75931d050306 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:54.705087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31b14c2c-20d4-4215-9516-75931d050306 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:54.706207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31b14c2c-20d4-4215-9516-75931d050306 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:54.709746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31b14c2c-20d4-4215-9516-75931d050306 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:54.716999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-31b14c2c-20d4-4215-9516-75931d050306 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:54.939719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.multi_cell_list [None req-31b14c2c-20d4-4215-9516-75931d050306 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121100) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:27:55.130820 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-31b14c2c-20d4-4215-9516-75931d050306 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1777675034" status: 200 len: 346 microversion: 2.1 time: 0.459414 Oct 29 01:27:55.133066 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2477/5199] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 29 01:27:54 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1777675034 => generated 346 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:27:55.162010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-667c9cd2-9a70-4867-9fdf-b6510e7c33d2 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:27:55.201886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-667c9cd2-9a70-4867-9fdf-b6510e7c33d2 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:55.203462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-667c9cd2-9a70-4867-9fdf-b6510e7c33d2 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:55.204150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-667c9cd2-9a70-4867-9fdf-b6510e7c33d2 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:55.241843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-667c9cd2-9a70-4867-9fdf-b6510e7c33d2 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 96e3896c-816b-4491-9877-82db9ab6dc51] Going to try to stop instance {{(pid=121099) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 01:27:55.572123 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-667c9cd2-9a70-4867-9fdf-b6510e7c33d2 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "POST /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51/action" status: 202 len: 0 microversion: 2.1 time: 0.424272 Oct 29 01:27:55.583655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f95eeffa-cfff-49f4-b3de-c6b73dc61ed8 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:55.585630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f95eeffa-cfff-49f4-b3de-c6b73dc61ed8 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 96e3896c-816b-4491-9877-82db9ab6dc51] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:55.586175 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2723/5200] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:27:55 2022] POST /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:27:55.622420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f95eeffa-cfff-49f4-b3de-c6b73dc61ed8 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:55.641255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f95eeffa-cfff-49f4-b3de-c6b73dc61ed8 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:55.641255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f95eeffa-cfff-49f4-b3de-c6b73dc61ed8 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:55.641255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f95eeffa-cfff-49f4-b3de-c6b73dc61ed8 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:55.641255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f95eeffa-cfff-49f4-b3de-c6b73dc61ed8 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:55.641255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f95eeffa-cfff-49f4-b3de-c6b73dc61ed8 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:55.677942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5e0deb21-7cd9-4812-a4d6-52a3c8fd23a9 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:55.679443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5e0deb21-7cd9-4812-a4d6-52a3c8fd23a9 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:55.691276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e0deb21-7cd9-4812-a4d6-52a3c8fd23a9 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:55.697642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e0deb21-7cd9-4812-a4d6-52a3c8fd23a9 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:55.704736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e0deb21-7cd9-4812-a4d6-52a3c8fd23a9 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:55.705912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e0deb21-7cd9-4812-a4d6-52a3c8fd23a9 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:55.707164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e0deb21-7cd9-4812-a4d6-52a3c8fd23a9 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:55.707850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e0deb21-7cd9-4812-a4d6-52a3c8fd23a9 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:55.979156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5e0deb21-7cd9-4812-a4d6-52a3c8fd23a9 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e256dd021f34b3eb11d8828bbe82b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeba7c125f54d15ac32683bb5b3595d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:56.021728 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5e0deb21-7cd9-4812-a4d6-52a3c8fd23a9 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 200 len: 1281 microversion: 2.1 time: 0.344927 Oct 29 01:27:56.037474 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2724/5201] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:55 2022] GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 1281 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:57.036061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f95eeffa-cfff-49f4-b3de-c6b73dc61ed8 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:57.048115 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f95eeffa-cfff-49f4-b3de-c6b73dc61ed8 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51" status: 200 len: 1521 microversion: 2.1 time: 1.468812 Oct 29 01:27:57.051202 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2478/5202] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:55 2022] GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51 => generated 1521 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:57.088815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c5c1ffea-7085-433a-ae2a-e29b38670cdd tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:57.090299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c5c1ffea-7085-433a-ae2a-e29b38670cdd tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:57.107321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5c1ffea-7085-433a-ae2a-e29b38670cdd tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:57.108996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5c1ffea-7085-433a-ae2a-e29b38670cdd tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:57.109703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5c1ffea-7085-433a-ae2a-e29b38670cdd tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:57.114268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5c1ffea-7085-433a-ae2a-e29b38670cdd tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:57.116164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5c1ffea-7085-433a-ae2a-e29b38670cdd tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:57.118067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5c1ffea-7085-433a-ae2a-e29b38670cdd tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:57.737406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c5c1ffea-7085-433a-ae2a-e29b38670cdd tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e256dd021f34b3eb11d8828bbe82b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeba7c125f54d15ac32683bb5b3595d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:57.753058 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c5c1ffea-7085-433a-ae2a-e29b38670cdd tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 200 len: 1323 microversion: 2.1 time: 0.679831 Oct 29 01:27:57.766278 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2725/5203] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:57 2022] GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 1323 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:58.083300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ac775eec-0e36-4366-b08c-0253fb52bbb4 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:58.083936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ac775eec-0e36-4366-b08c-0253fb52bbb4 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 96e3896c-816b-4491-9877-82db9ab6dc51] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:58.092033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac775eec-0e36-4366-b08c-0253fb52bbb4 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:58.092578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac775eec-0e36-4366-b08c-0253fb52bbb4 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:58.093665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac775eec-0e36-4366-b08c-0253fb52bbb4 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:58.094430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac775eec-0e36-4366-b08c-0253fb52bbb4 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:58.095139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac775eec-0e36-4366-b08c-0253fb52bbb4 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:58.095780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac775eec-0e36-4366-b08c-0253fb52bbb4 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:58.607719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-edd8bfd5-9825-4df6-bc56-70cc2fa73aae tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:58.609231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-edd8bfd5-9825-4df6-bc56-70cc2fa73aae tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:58.625749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edd8bfd5-9825-4df6-bc56-70cc2fa73aae tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:58.626667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edd8bfd5-9825-4df6-bc56-70cc2fa73aae tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:58.629295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edd8bfd5-9825-4df6-bc56-70cc2fa73aae tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:58.631024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edd8bfd5-9825-4df6-bc56-70cc2fa73aae tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:58.632226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edd8bfd5-9825-4df6-bc56-70cc2fa73aae tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:58.633284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edd8bfd5-9825-4df6-bc56-70cc2fa73aae tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:58.750103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-edd8bfd5-9825-4df6-bc56-70cc2fa73aae tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lazy-loading 'services' on Instance uuid 2c86e050-73e4-4c80-a145-420293bbf8b2 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:27:58.799766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ac775eec-0e36-4366-b08c-0253fb52bbb4 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:58.811848 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ac775eec-0e36-4366-b08c-0253fb52bbb4 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51" status: 200 len: 1521 microversion: 2.1 time: 0.736642 Oct 29 01:27:58.814632 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2479/5204] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:58 2022] GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51 => generated 1521 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:58.830404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-16285bee-44e7-4ab3-b626-47d6c3223f00 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:58.831462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-16285bee-44e7-4ab3-b626-47d6c3223f00 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:58.851873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16285bee-44e7-4ab3-b626-47d6c3223f00 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:58.854490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16285bee-44e7-4ab3-b626-47d6c3223f00 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:58.860725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16285bee-44e7-4ab3-b626-47d6c3223f00 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:58.868175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16285bee-44e7-4ab3-b626-47d6c3223f00 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:58.869825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16285bee-44e7-4ab3-b626-47d6c3223f00 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:58.872443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-16285bee-44e7-4ab3-b626-47d6c3223f00 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:59.037503 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-edd8bfd5-9825-4df6-bc56-70cc2fa73aae tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-volume_attachments/80a5c14b-d20c-4cab-8221-5997c5a733b3" status: 202 len: 0 microversion: 2.1 time: 0.441822 Oct 29 01:27:59.042912 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2726/5205] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 29 01:27:58 2022] DELETE /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-volume_attachments/80a5c14b-d20c-4cab-8221-5997c5a733b3 => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:27:59.068265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-feaf047d-e81e-4007-b08d-70101e5fd3de tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:59.072154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-feaf047d-e81e-4007-b08d-70101e5fd3de tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:59.082277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-feaf047d-e81e-4007-b08d-70101e5fd3de tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:59.083235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-feaf047d-e81e-4007-b08d-70101e5fd3de tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:59.083937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-feaf047d-e81e-4007-b08d-70101e5fd3de tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:59.085023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-feaf047d-e81e-4007-b08d-70101e5fd3de tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:59.085744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-feaf047d-e81e-4007-b08d-70101e5fd3de tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:59.086405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-feaf047d-e81e-4007-b08d-70101e5fd3de tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:59.165443 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-feaf047d-e81e-4007-b08d-70101e5fd3de tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106849 Oct 29 01:27:59.166635 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2727/5206] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:27:59 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:27:59.217085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-16285bee-44e7-4ab3-b626-47d6c3223f00 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e256dd021f34b3eb11d8828bbe82b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeba7c125f54d15ac32683bb5b3595d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:27:59.226733 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-16285bee-44e7-4ab3-b626-47d6c3223f00 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 200 len: 1323 microversion: 2.1 time: 0.410102 Oct 29 01:27:59.231226 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2480/5207] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:58 2022] GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 1323 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:27:59.847650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-62556591-1014-42e0-8b5e-0d212cb2c048 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:59.852716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-62556591-1014-42e0-8b5e-0d212cb2c048 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 96e3896c-816b-4491-9877-82db9ab6dc51] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:27:59.876338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62556591-1014-42e0-8b5e-0d212cb2c048 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:59.881082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62556591-1014-42e0-8b5e-0d212cb2c048 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:59.886443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62556591-1014-42e0-8b5e-0d212cb2c048 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:27:59.892181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62556591-1014-42e0-8b5e-0d212cb2c048 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:27:59.893264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62556591-1014-42e0-8b5e-0d212cb2c048 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:27:59.893994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62556591-1014-42e0-8b5e-0d212cb2c048 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:00.177671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-972ebb21-36c5-463a-b536-b71e3822927e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:00.184369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-972ebb21-36c5-463a-b536-b71e3822927e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:00.226829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-972ebb21-36c5-463a-b536-b71e3822927e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:00.227419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-972ebb21-36c5-463a-b536-b71e3822927e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:00.231966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-972ebb21-36c5-463a-b536-b71e3822927e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:00.232905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-972ebb21-36c5-463a-b536-b71e3822927e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:00.236375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-972ebb21-36c5-463a-b536-b71e3822927e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:00.238236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-972ebb21-36c5-463a-b536-b71e3822927e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:00.369023 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-972ebb21-36c5-463a-b536-b71e3822927e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196695 Oct 29 01:28:00.374131 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2481/5208] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:28:00 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:00.374536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-62556591-1014-42e0-8b5e-0d212cb2c048 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:00.381712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-24d915bb-f637-459d-adbf-04d62967a4ac req-a154a9ec-3771-4c07-a864-ef4257f4eba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf4a66f-98ff-43e9-8c7a-a1d2369a305a", "tag": "75927a9e-7062-4162-b7e7-ec50990c7e71"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:00.386422 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-62556591-1014-42e0-8b5e-0d212cb2c048 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51" status: 200 len: 1521 microversion: 2.1 time: 0.548318 Oct 29 01:28:00.401372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-24d915bb-f637-459d-adbf-04d62967a4ac req-a154a9ec-3771-4c07-a864-ef4257f4eba8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:00.401939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-24d915bb-f637-459d-adbf-04d62967a4ac req-a154a9ec-3771-4c07-a864-ef4257f4eba8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:00.402449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-24d915bb-f637-459d-adbf-04d62967a4ac req-a154a9ec-3771-4c07-a864-ef4257f4eba8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:00.409370 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2728/5209] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:27:59 2022] GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51 => generated 1521 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:00.425130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6764230f-23bb-4770-af40-eadce6d5f391 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:00.426357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6764230f-23bb-4770-af40-eadce6d5f391 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:00.430142 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-24d915bb-f637-459d-adbf-04d62967a4ac req-a154a9ec-3771-4c07-a864-ef4257f4eba8 service nova] Creating event network-changed:75927a9e-7062-4162-b7e7-ec50990c7e71 for instance fcf4a66f-98ff-43e9-8c7a-a1d2369a305a on n-h1-862964-3 Oct 29 01:28:00.437214 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-24d915bb-f637-459d-adbf-04d62967a4ac req-a154a9ec-3771-4c07-a864-ef4257f4eba8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066132 Oct 29 01:28:00.438215 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2482/5210] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:00.441470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6764230f-23bb-4770-af40-eadce6d5f391 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:00.442085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6764230f-23bb-4770-af40-eadce6d5f391 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:00.442601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6764230f-23bb-4770-af40-eadce6d5f391 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:00.443459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6764230f-23bb-4770-af40-eadce6d5f391 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:00.443999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6764230f-23bb-4770-af40-eadce6d5f391 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:00.444508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6764230f-23bb-4770-af40-eadce6d5f391 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:00.914428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6764230f-23bb-4770-af40-eadce6d5f391 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e256dd021f34b3eb11d8828bbe82b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeba7c125f54d15ac32683bb5b3595d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:00.940080 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6764230f-23bb-4770-af40-eadce6d5f391 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 200 len: 1323 microversion: 2.1 time: 0.529464 Oct 29 01:28:00.941031 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2729/5211] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:00 2022] GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 1323 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:01.113964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f392ea39-28e4-4b0d-9ccc-c70f177a7848 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:01.114641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f392ea39-28e4-4b0d-9ccc-c70f177a7848 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:01.127871 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f392ea39-28e4-4b0d-9ccc-c70f177a7848 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:01.128903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f392ea39-28e4-4b0d-9ccc-c70f177a7848 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:01.130227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f392ea39-28e4-4b0d-9ccc-c70f177a7848 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:01.130974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f392ea39-28e4-4b0d-9ccc-c70f177a7848 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:01.131445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f392ea39-28e4-4b0d-9ccc-c70f177a7848 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:01.131945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f392ea39-28e4-4b0d-9ccc-c70f177a7848 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:01.365945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-f392ea39-28e4-4b0d-9ccc-c70f177a7848 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lazy-loading 'services' on Instance uuid cd534e41-d223-4dd6-9b11-0b417c775beb {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:28:01.382570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e95b1b8-7c88-4b92-baa9-52d1584d3d38 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:01.385348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e95b1b8-7c88-4b92-baa9-52d1584d3d38 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:01.406237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e95b1b8-7c88-4b92-baa9-52d1584d3d38 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:01.411574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e95b1b8-7c88-4b92-baa9-52d1584d3d38 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:01.412384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e95b1b8-7c88-4b92-baa9-52d1584d3d38 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:01.413456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e95b1b8-7c88-4b92-baa9-52d1584d3d38 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:01.414162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e95b1b8-7c88-4b92-baa9-52d1584d3d38 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:01.414832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e95b1b8-7c88-4b92-baa9-52d1584d3d38 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:01.514365 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8e95b1b8-7c88-4b92-baa9-52d1584d3d38 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131466 Oct 29 01:28:01.519755 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2730/5212] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:28:01 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:01.532334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-23cd9486-4d77-46dc-8fca-975825b788fd tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:01.532964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-23cd9486-4d77-46dc-8fca-975825b788fd tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 96e3896c-816b-4491-9877-82db9ab6dc51] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:01.553609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23cd9486-4d77-46dc-8fca-975825b788fd tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:01.553969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23cd9486-4d77-46dc-8fca-975825b788fd tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:01.557782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23cd9486-4d77-46dc-8fca-975825b788fd tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:01.559974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23cd9486-4d77-46dc-8fca-975825b788fd tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:01.560805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23cd9486-4d77-46dc-8fca-975825b788fd tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:01.565105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23cd9486-4d77-46dc-8fca-975825b788fd tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:01.661194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=10 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:01.784305 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f392ea39-28e4-4b0d-9ccc-c70f177a7848 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb/os-volume_attachments/4414d17b-d561-4127-889e-8dd3bf0237dc" status: 202 len: 0 microversion: 2.1 time: 0.674528 Oct 29 01:28:01.785626 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2483/5213] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 29 01:28:01 2022] DELETE /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb/os-volume_attachments/4414d17b-d561-4127-889e-8dd3bf0237dc => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:28:01.970142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5c5a10a4-f804-411d-8efb-47df7fe50b4a tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:01.970968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5c5a10a4-f804-411d-8efb-47df7fe50b4a tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:02.013912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c5a10a4-f804-411d-8efb-47df7fe50b4a tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:02.014437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c5a10a4-f804-411d-8efb-47df7fe50b4a tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:02.014899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c5a10a4-f804-411d-8efb-47df7fe50b4a tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:02.015696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c5a10a4-f804-411d-8efb-47df7fe50b4a tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:02.016165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c5a10a4-f804-411d-8efb-47df7fe50b4a tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:02.016598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c5a10a4-f804-411d-8efb-47df7fe50b4a tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:02.263823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-23cd9486-4d77-46dc-8fca-975825b788fd tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:02.279622 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-23cd9486-4d77-46dc-8fca-975825b788fd tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51" status: 200 len: 1498 microversion: 2.1 time: 0.757010 Oct 29 01:28:02.284913 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2731/5214] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:01 2022] GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51 => generated 1498 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:02.310708 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:02.509733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-36ab98f8-e4f6-4e89-ac30-88984560598a tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] Action: 'create', calling method: .version_select at 0x7f9d9715a040>, body: {"pool": null} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:02.723650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5c5a10a4-f804-411d-8efb-47df7fe50b4a tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e256dd021f34b3eb11d8828bbe82b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeba7c125f54d15ac32683bb5b3595d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:02.736769 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5c5a10a4-f804-411d-8efb-47df7fe50b4a tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 200 len: 1323 microversion: 2.1 time: 0.775979 Oct 29 01:28:02.738418 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2484/5215] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:01 2022] GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 1323 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:02.754292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-63ccadcc-d0b3-4c05-b298-dc0884fdc99f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:02.768593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-63ccadcc-d0b3-4c05-b298-dc0884fdc99f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:02.774360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-63ccadcc-d0b3-4c05-b298-dc0884fdc99f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:28:02.795324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63ccadcc-d0b3-4c05-b298-dc0884fdc99f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:02.795807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63ccadcc-d0b3-4c05-b298-dc0884fdc99f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:02.796242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63ccadcc-d0b3-4c05-b298-dc0884fdc99f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:02.796978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63ccadcc-d0b3-4c05-b298-dc0884fdc99f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:02.800395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63ccadcc-d0b3-4c05-b298-dc0884fdc99f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:02.800395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63ccadcc-d0b3-4c05-b298-dc0884fdc99f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:03.004213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.multi_cell_list [None req-63ccadcc-d0b3-4c05-b298-dc0884fdc99f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121100) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:28:03.143858 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-63ccadcc-d0b3-4c05-b298-dc0884fdc99f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.403975 Oct 29 01:28:03.153766 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2485/5216] 10.222.0.26 () {58 vars in 1154 bytes} [Sat Oct 29 01:28:02 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:03.165485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aa63cd0d-8408-4fc0-b064-f892352f99e6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:03.167732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aa63cd0d-8408-4fc0-b064-f892352f99e6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:03.183246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa63cd0d-8408-4fc0-b064-f892352f99e6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:03.183745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa63cd0d-8408-4fc0-b064-f892352f99e6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:03.184297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa63cd0d-8408-4fc0-b064-f892352f99e6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:03.185112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa63cd0d-8408-4fc0-b064-f892352f99e6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:03.192501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa63cd0d-8408-4fc0-b064-f892352f99e6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:03.192971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa63cd0d-8408-4fc0-b064-f892352f99e6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:03.245337 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aa63cd0d-8408-4fc0-b064-f892352f99e6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090191 Oct 29 01:28:03.246530 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2486/5217] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:28:03 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:03.253393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-68cf1818-9e20-4118-bb3f-273b81970050 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:03.260023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68cf1818-9e20-4118-bb3f-273b81970050 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:03.260721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68cf1818-9e20-4118-bb3f-273b81970050 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:03.261374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68cf1818-9e20-4118-bb3f-273b81970050 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:03.302580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-68cf1818-9e20-4118-bb3f-273b81970050 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 96e3896c-816b-4491-9877-82db9ab6dc51] Going to try to start instance {{(pid=121100) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 01:28:03.955815 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-68cf1818-9e20-4118-bb3f-273b81970050 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "POST /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51/action" status: 202 len: 0 microversion: 2.1 time: 0.707556 Oct 29 01:28:03.972413 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2487/5218] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:28:03 2022] POST /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:28:03.973302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6ad1f3af-32aa-4bef-837d-83af08fa01be tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:03.974087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6ad1f3af-32aa-4bef-837d-83af08fa01be tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:03.984425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ad1f3af-32aa-4bef-837d-83af08fa01be tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:03.985988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ad1f3af-32aa-4bef-837d-83af08fa01be tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:03.986434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ad1f3af-32aa-4bef-837d-83af08fa01be tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:03.987192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ad1f3af-32aa-4bef-837d-83af08fa01be tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:03.987658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ad1f3af-32aa-4bef-837d-83af08fa01be tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:03.988088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ad1f3af-32aa-4bef-837d-83af08fa01be tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:04.583200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=14 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:04.726403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6ad1f3af-32aa-4bef-837d-83af08fa01be tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e256dd021f34b3eb11d8828bbe82b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeba7c125f54d15ac32683bb5b3595d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:04.735142 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6ad1f3af-32aa-4bef-837d-83af08fa01be tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 200 len: 1323 microversion: 2.1 time: 0.772618 Oct 29 01:28:04.735730 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2488/5219] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:03 2022] GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 1323 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:04.757647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1f995d55-c5fa-4905-84fd-b16f11709f95 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:04.762917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1f995d55-c5fa-4905-84fd-b16f11709f95 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 96e3896c-816b-4491-9877-82db9ab6dc51] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:04.781290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f995d55-c5fa-4905-84fd-b16f11709f95 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:04.782263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f995d55-c5fa-4905-84fd-b16f11709f95 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:04.782725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f995d55-c5fa-4905-84fd-b16f11709f95 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:04.783472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f995d55-c5fa-4905-84fd-b16f11709f95 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:04.784753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f995d55-c5fa-4905-84fd-b16f11709f95 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:04.785304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f995d55-c5fa-4905-84fd-b16f11709f95 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:06.455940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1f995d55-c5fa-4905-84fd-b16f11709f95 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:06.466382 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1f995d55-c5fa-4905-84fd-b16f11709f95 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51" status: 200 len: 1507 microversion: 2.1 time: 1.726774 Oct 29 01:28:06.467485 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2489/5220] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:04 2022] GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51 => generated 1507 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:06.474869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0c1f76fd-1910-4f35-8882-84c13e582ba5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:06.476984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0c1f76fd-1910-4f35-8882-84c13e582ba5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:06.486373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c1f76fd-1910-4f35-8882-84c13e582ba5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:06.496419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c1f76fd-1910-4f35-8882-84c13e582ba5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:06.496419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c1f76fd-1910-4f35-8882-84c13e582ba5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:06.496419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c1f76fd-1910-4f35-8882-84c13e582ba5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:06.496419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c1f76fd-1910-4f35-8882-84c13e582ba5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:06.496419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c1f76fd-1910-4f35-8882-84c13e582ba5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:06.554960 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0c1f76fd-1910-4f35-8882-84c13e582ba5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085981 Oct 29 01:28:06.556098 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2490/5221] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:28:06 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:06.586463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2a533ed5-bf79-4e23-8800-3a2879e58eeb tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:06.587419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2a533ed5-bf79-4e23-8800-3a2879e58eeb tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:06.606974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a533ed5-bf79-4e23-8800-3a2879e58eeb tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:06.607815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a533ed5-bf79-4e23-8800-3a2879e58eeb tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:06.610908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a533ed5-bf79-4e23-8800-3a2879e58eeb tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:06.612173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a533ed5-bf79-4e23-8800-3a2879e58eeb tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:06.613732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a533ed5-bf79-4e23-8800-3a2879e58eeb tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:06.614961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a533ed5-bf79-4e23-8800-3a2879e58eeb tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:06.704979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:07.289614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2a533ed5-bf79-4e23-8800-3a2879e58eeb tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e256dd021f34b3eb11d8828bbe82b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeba7c125f54d15ac32683bb5b3595d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:07.297699 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2a533ed5-bf79-4e23-8800-3a2879e58eeb tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 200 len: 1323 microversion: 2.1 time: 0.740203 Oct 29 01:28:07.298360 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2491/5222] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:06 2022] GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 1323 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:07.496282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-292a66f7-601e-4e5e-80b6-8d6e8e50c136 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:07.497568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-292a66f7-601e-4e5e-80b6-8d6e8e50c136 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 96e3896c-816b-4491-9877-82db9ab6dc51] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:07.508900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-292a66f7-601e-4e5e-80b6-8d6e8e50c136 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:07.509410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-292a66f7-601e-4e5e-80b6-8d6e8e50c136 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:07.509859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-292a66f7-601e-4e5e-80b6-8d6e8e50c136 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:07.510577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-292a66f7-601e-4e5e-80b6-8d6e8e50c136 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:07.513608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-292a66f7-601e-4e5e-80b6-8d6e8e50c136 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:07.514370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-292a66f7-601e-4e5e-80b6-8d6e8e50c136 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:07.988514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-292a66f7-601e-4e5e-80b6-8d6e8e50c136 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:08.003732 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-292a66f7-601e-4e5e-80b6-8d6e8e50c136 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51" status: 200 len: 1511 microversion: 2.1 time: 0.512062 Oct 29 01:28:08.029289 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2492/5223] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:07 2022] GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51 => generated 1511 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:28:08.043249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9fc62005-5f66-4c55-9109-a92b305605b2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:08.051070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9fc62005-5f66-4c55-9109-a92b305605b2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:08.084623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9fc62005-5f66-4c55-9109-a92b305605b2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:08.091225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9fc62005-5f66-4c55-9109-a92b305605b2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:08.092789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9fc62005-5f66-4c55-9109-a92b305605b2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:08.095052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9fc62005-5f66-4c55-9109-a92b305605b2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:08.096440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9fc62005-5f66-4c55-9109-a92b305605b2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:08.110480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9fc62005-5f66-4c55-9109-a92b305605b2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:08.180206 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9fc62005-5f66-4c55-9109-a92b305605b2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148492 Oct 29 01:28:08.180478 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2493/5224] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:28:08 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:08.187165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-908886ec-9bb1-41e8-b800-c750e20860a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:08.193934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-908886ec-9bb1-41e8-b800-c750e20860a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:08.194623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.compute.servers [None req-908886ec-9bb1-41e8-b800-c750e20860a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Removing options 'limit' from query {{(pid=121100) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 01:28:08.198511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-908886ec-9bb1-41e8-b800-c750e20860a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:28:08.198511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-908886ec-9bb1-41e8-b800-c750e20860a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:08.198511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-908886ec-9bb1-41e8-b800-c750e20860a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:08.198511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-908886ec-9bb1-41e8-b800-c750e20860a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:08.199900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-908886ec-9bb1-41e8-b800-c750e20860a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:08.200565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-908886ec-9bb1-41e8-b800-c750e20860a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:08.201183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-908886ec-9bb1-41e8-b800-c750e20860a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:08.203417 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-908886ec-9bb1-41e8-b800-c750e20860a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.021285 Oct 29 01:28:08.204233 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2494/5225] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Oct 29 01:28:08 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:28:08.219455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aa6c814c-a82c-49db-bd40-647b2665b2a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:08.220273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aa6c814c-a82c-49db-bd40-647b2665b2a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 96e3896c-816b-4491-9877-82db9ab6dc51] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:08.233851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa6c814c-a82c-49db-bd40-647b2665b2a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:08.234659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa6c814c-a82c-49db-bd40-647b2665b2a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:08.240984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa6c814c-a82c-49db-bd40-647b2665b2a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:08.241954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa6c814c-a82c-49db-bd40-647b2665b2a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:08.242597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa6c814c-a82c-49db-bd40-647b2665b2a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:08.243452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa6c814c-a82c-49db-bd40-647b2665b2a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:08.726320 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-36ab98f8-e4f6-4e89-ac30-88984560598a tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.441078 Oct 29 01:28:08.731234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aa6c814c-a82c-49db-bd40-647b2665b2a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:08.733401 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2732/5226] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 29 01:28:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:08.738839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-de262917-d010-4ab2-b806-1e9f332bd22f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:08.739461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-de262917-d010-4ab2-b806-1e9f332bd22f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:08.739578 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aa6c814c-a82c-49db-bd40-647b2665b2a0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51" status: 200 len: 1511 microversion: 2.1 time: 0.526405 Oct 29 01:28:08.748790 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2495/5227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:08 2022] GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51 => generated 1511 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:08.753007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de262917-d010-4ab2-b806-1e9f332bd22f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:08.755277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de262917-d010-4ab2-b806-1e9f332bd22f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:08.757736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de262917-d010-4ab2-b806-1e9f332bd22f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:08.758505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3995f3de-14c2-4fde-80d3-740ba5b1e80d tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] Action: 'create', calling method: .version_select at 0x7f9d970f0310>, body: {"pool": null} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:08.758969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de262917-d010-4ab2-b806-1e9f332bd22f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:08.767838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de262917-d010-4ab2-b806-1e9f332bd22f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:08.767838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de262917-d010-4ab2-b806-1e9f332bd22f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:09.092968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-de262917-d010-4ab2-b806-1e9f332bd22f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e256dd021f34b3eb11d8828bbe82b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeba7c125f54d15ac32683bb5b3595d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:09.104124 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-de262917-d010-4ab2-b806-1e9f332bd22f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 200 len: 1323 microversion: 2.1 time: 0.369483 Oct 29 01:28:09.107122 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2733/5228] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:08 2022] GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 1323 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:09.114356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-372a18bb-499b-43d7-9765-e39c33cd7ef0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:09.118099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-372a18bb-499b-43d7-9765-e39c33cd7ef0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: ba394c36-e5b5-4e80-bf8b-70aff3251fa2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:09.136891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-372a18bb-499b-43d7-9765-e39c33cd7ef0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:09.138382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-372a18bb-499b-43d7-9765-e39c33cd7ef0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:09.139120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-372a18bb-499b-43d7-9765-e39c33cd7ef0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:09.156566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-372a18bb-499b-43d7-9765-e39c33cd7ef0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:09.158935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-372a18bb-499b-43d7-9765-e39c33cd7ef0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:09.159717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-372a18bb-499b-43d7-9765-e39c33cd7ef0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:09.511671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-372a18bb-499b-43d7-9765-e39c33cd7ef0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:09.522646 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-372a18bb-499b-43d7-9765-e39c33cd7ef0 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/ba394c36-e5b5-4e80-bf8b-70aff3251fa2" status: 200 len: 1512 microversion: 2.1 time: 0.413660 Oct 29 01:28:09.523284 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2734/5229] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:09 2022] GET /compute/v2.1/servers/ba394c36-e5b5-4e80-bf8b-70aff3251fa2 => generated 1512 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:09.538449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-58176cdb-7022-4e99-8efb-31dd0a658b03 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:09.545053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-58176cdb-7022-4e99-8efb-31dd0a658b03 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:09.561316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58176cdb-7022-4e99-8efb-31dd0a658b03 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:09.561820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58176cdb-7022-4e99-8efb-31dd0a658b03 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:09.562453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58176cdb-7022-4e99-8efb-31dd0a658b03 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:09.563160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58176cdb-7022-4e99-8efb-31dd0a658b03 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:09.563615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58176cdb-7022-4e99-8efb-31dd0a658b03 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:09.564174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58176cdb-7022-4e99-8efb-31dd0a658b03 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:09.676459 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-58176cdb-7022-4e99-8efb-31dd0a658b03 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.144291 Oct 29 01:28:09.685365 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2735/5230] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:28:09 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2/os-volume_attachments => generated 25 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:28:09.697131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3399c28a-34c5-4472-b7c1-465053cc501f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:09.697793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3399c28a-34c5-4472-b7c1-465053cc501f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:09.732739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3399c28a-34c5-4472-b7c1-465053cc501f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:09.743503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3399c28a-34c5-4472-b7c1-465053cc501f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:09.744125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3399c28a-34c5-4472-b7c1-465053cc501f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:09.745677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3399c28a-34c5-4472-b7c1-465053cc501f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:09.753754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3399c28a-34c5-4472-b7c1-465053cc501f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:09.753754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3399c28a-34c5-4472-b7c1-465053cc501f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:10.168286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3399c28a-34c5-4472-b7c1-465053cc501f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:10.183934 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3399c28a-34c5-4472-b7c1-465053cc501f tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1511 microversion: 2.1 time: 0.493069 Oct 29 01:28:10.187190 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2736/5231] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:09 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1511 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:10.195019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-2f397c73-437a-45e8-b2eb-21ecef25d228 req-ffcd90ea-3add-4d49-b000-3009616c635b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf4a66f-98ff-43e9-8c7a-a1d2369a305a", "name": "network-vif-plugged", "status": "completed", "tag": "75927a9e-7062-4162-b7e7-ec50990c7e71"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:10.221299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2f397c73-437a-45e8-b2eb-21ecef25d228 req-ffcd90ea-3add-4d49-b000-3009616c635b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:10.223038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2f397c73-437a-45e8-b2eb-21ecef25d228 req-ffcd90ea-3add-4d49-b000-3009616c635b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:10.223525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2f397c73-437a-45e8-b2eb-21ecef25d228 req-ffcd90ea-3add-4d49-b000-3009616c635b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:10.237678 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-2f397c73-437a-45e8-b2eb-21ecef25d228 req-ffcd90ea-3add-4d49-b000-3009616c635b service nova] Creating event network-vif-plugged:75927a9e-7062-4162-b7e7-ec50990c7e71 for instance fcf4a66f-98ff-43e9-8c7a-a1d2369a305a on n-h1-862964-3 Oct 29 01:28:10.245200 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-2f397c73-437a-45e8-b2eb-21ecef25d228 req-ffcd90ea-3add-4d49-b000-3009616c635b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056334 Oct 29 01:28:10.247247 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2737/5232] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:10.258597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f47d62e5-68c8-43ca-a562-3f76ae8ed11a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:10.260199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f47d62e5-68c8-43ca-a562-3f76ae8ed11a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:10.273481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f47d62e5-68c8-43ca-a562-3f76ae8ed11a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:10.273481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f47d62e5-68c8-43ca-a562-3f76ae8ed11a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:10.273481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f47d62e5-68c8-43ca-a562-3f76ae8ed11a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:10.273481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f47d62e5-68c8-43ca-a562-3f76ae8ed11a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:10.273481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f47d62e5-68c8-43ca-a562-3f76ae8ed11a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:10.273481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f47d62e5-68c8-43ca-a562-3f76ae8ed11a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:10.318177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:10.328363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f47d62e5-68c8-43ca-a562-3f76ae8ed11a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:28:10.779105 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f47d62e5-68c8-43ca-a562-3f76ae8ed11a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 204 len: 0 microversion: 2.1 time: 0.527920 Oct 29 01:28:10.780933 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2738/5233] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:28:10 2022] DELETE /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:28:10.803377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b815a3e4-8b68-43c4-8888-0778fbee3fdc tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:10.806330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b815a3e4-8b68-43c4-8888-0778fbee3fdc tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:10.827672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b815a3e4-8b68-43c4-8888-0778fbee3fdc tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:10.828564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b815a3e4-8b68-43c4-8888-0778fbee3fdc tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:10.832491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b815a3e4-8b68-43c4-8888-0778fbee3fdc tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:10.834073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b815a3e4-8b68-43c4-8888-0778fbee3fdc tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:10.837446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b815a3e4-8b68-43c4-8888-0778fbee3fdc tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:10.840290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b815a3e4-8b68-43c4-8888-0778fbee3fdc tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:11.214451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b815a3e4-8b68-43c4-8888-0778fbee3fdc tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e256dd021f34b3eb11d8828bbe82b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeba7c125f54d15ac32683bb5b3595d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:11.225304 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b815a3e4-8b68-43c4-8888-0778fbee3fdc tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 200 len: 1323 microversion: 2.1 time: 0.440601 Oct 29 01:28:11.226998 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2739/5234] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:10 2022] GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 1323 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:11.233898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2716ec59-c1c8-4715-ae28-f9ba3b383f78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:11.240580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2716ec59-c1c8-4715-ae28-f9ba3b383f78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:11.241793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2716ec59-c1c8-4715-ae28-f9ba3b383f78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121099) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:28:11.410472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2716ec59-c1c8-4715-ae28-f9ba3b383f78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:11.411313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2716ec59-c1c8-4715-ae28-f9ba3b383f78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:11.412855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2716ec59-c1c8-4715-ae28-f9ba3b383f78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:11.415592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2716ec59-c1c8-4715-ae28-f9ba3b383f78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:11.416169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2716ec59-c1c8-4715-ae28-f9ba3b383f78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:11.416699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2716ec59-c1c8-4715-ae28-f9ba3b383f78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:11.553867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.multi_cell_list [None req-2716ec59-c1c8-4715-ae28-f9ba3b383f78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:28:11.596236 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3995f3de-14c2-4fde-80d3-740ba5b1e80d tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.845738 Oct 29 01:28:11.597496 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2496/5235] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 29 01:28:08 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:11.602509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e215ed8a-0067-4849-a6b9-0e43a6dd8692 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:11.603285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e215ed8a-0067-4849-a6b9-0e43a6dd8692 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:11.618297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e215ed8a-0067-4849-a6b9-0e43a6dd8692 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:11.619572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e215ed8a-0067-4849-a6b9-0e43a6dd8692 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:11.625645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e215ed8a-0067-4849-a6b9-0e43a6dd8692 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:11.626628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e215ed8a-0067-4849-a6b9-0e43a6dd8692 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:11.628138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e215ed8a-0067-4849-a6b9-0e43a6dd8692 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:11.628910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e215ed8a-0067-4849-a6b9-0e43a6dd8692 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:11.690565 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2716ec59-c1c8-4715-ae28-f9ba3b383f78 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 346 microversion: 2.1 time: 0.459989 Oct 29 01:28:11.691201 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2740/5236] 10.222.0.26 () {58 vars in 1154 bytes} [Sat Oct 29 01:28:11 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 346 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:11.705325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5d59eec8-e146-4e22-a02e-593847f458ee tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] Action: 'create', calling method: .version_select at 0x7f9d9fda5b80>, body: {"pool": null} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:11.938740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e215ed8a-0067-4849-a6b9-0e43a6dd8692 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:11.957784 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e215ed8a-0067-4849-a6b9-0e43a6dd8692 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1681 microversion: 2.1 time: 0.356979 Oct 29 01:28:11.958768 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2497/5237] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:11 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1681 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:11.973444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fe71d6ff-163d-44da-9a54-c7ee5c0ec2a1 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:11.975985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fe71d6ff-163d-44da-9a54-c7ee5c0ec2a1 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 96e3896c-816b-4491-9877-82db9ab6dc51] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:11.992186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe71d6ff-163d-44da-9a54-c7ee5c0ec2a1 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:11.993980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe71d6ff-163d-44da-9a54-c7ee5c0ec2a1 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:11.995824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe71d6ff-163d-44da-9a54-c7ee5c0ec2a1 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:11.998492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe71d6ff-163d-44da-9a54-c7ee5c0ec2a1 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:12.000195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe71d6ff-163d-44da-9a54-c7ee5c0ec2a1 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:12.008856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe71d6ff-163d-44da-9a54-c7ee5c0ec2a1 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:12.630092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fe71d6ff-163d-44da-9a54-c7ee5c0ec2a1 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:12.644251 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fe71d6ff-163d-44da-9a54-c7ee5c0ec2a1 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51" status: 200 len: 1511 microversion: 2.1 time: 0.681132 Oct 29 01:28:12.644251 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2498/5238] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:11 2022] GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51 => generated 1511 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:12.653457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-89f61b66-9edf-4b71-a6ac-ea263421e12f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:12.654480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-89f61b66-9edf-4b71-a6ac-ea263421e12f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:12.663289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89f61b66-9edf-4b71-a6ac-ea263421e12f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:12.664210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89f61b66-9edf-4b71-a6ac-ea263421e12f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:12.664827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89f61b66-9edf-4b71-a6ac-ea263421e12f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:12.665769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89f61b66-9edf-4b71-a6ac-ea263421e12f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:12.666238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89f61b66-9edf-4b71-a6ac-ea263421e12f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:12.666676 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-89f61b66-9edf-4b71-a6ac-ea263421e12f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:12.868911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=10 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:13.034030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-89f61b66-9edf-4b71-a6ac-ea263421e12f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e256dd021f34b3eb11d8828bbe82b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeba7c125f54d15ac32683bb5b3595d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:13.051811 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-89f61b66-9edf-4b71-a6ac-ea263421e12f tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 200 len: 1323 microversion: 2.1 time: 0.409422 Oct 29 01:28:13.053136 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2499/5239] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:12 2022] GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 1323 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:13.062078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3e5097a1-9041-4bdb-a849-092447e351da tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:13.063522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3e5097a1-9041-4bdb-a849-092447e351da tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: ba394c36-e5b5-4e80-bf8b-70aff3251fa2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:13.072365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e5097a1-9041-4bdb-a849-092447e351da tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:13.073001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e5097a1-9041-4bdb-a849-092447e351da tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:13.074152 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e5097a1-9041-4bdb-a849-092447e351da tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:13.075487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e5097a1-9041-4bdb-a849-092447e351da tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:13.076133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e5097a1-9041-4bdb-a849-092447e351da tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:13.076732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e5097a1-9041-4bdb-a849-092447e351da tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:13.572416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3e5097a1-9041-4bdb-a849-092447e351da tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:13.595686 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3e5097a1-9041-4bdb-a849-092447e351da tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/ba394c36-e5b5-4e80-bf8b-70aff3251fa2" status: 200 len: 1512 microversion: 2.1 time: 0.540493 Oct 29 01:28:13.597620 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2500/5240] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:13 2022] GET /compute/v2.1/servers/ba394c36-e5b5-4e80-bf8b-70aff3251fa2 => generated 1512 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:13.601887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-149e7093-9578-4e96-aa9a-80c700aec3f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:13.610115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-149e7093-9578-4e96-aa9a-80c700aec3f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:13.625776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-149e7093-9578-4e96-aa9a-80c700aec3f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:13.628580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-149e7093-9578-4e96-aa9a-80c700aec3f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:13.629274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-149e7093-9578-4e96-aa9a-80c700aec3f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:13.631738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-149e7093-9578-4e96-aa9a-80c700aec3f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:13.634495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-149e7093-9578-4e96-aa9a-80c700aec3f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:13.639812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-149e7093-9578-4e96-aa9a-80c700aec3f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:14.155362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-149e7093-9578-4e96-aa9a-80c700aec3f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:14.168511 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-149e7093-9578-4e96-aa9a-80c700aec3f0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1681 microversion: 2.1 time: 0.570556 Oct 29 01:28:14.171931 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2501/5241] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:13 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1681 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:14.190656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-17e24b28-bece-46d4-aee9-2d7e38998550 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:14.191273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-17e24b28-bece-46d4-aee9-2d7e38998550 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:14.210558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17e24b28-bece-46d4-aee9-2d7e38998550 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:14.211629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17e24b28-bece-46d4-aee9-2d7e38998550 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:14.212062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17e24b28-bece-46d4-aee9-2d7e38998550 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:14.213189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17e24b28-bece-46d4-aee9-2d7e38998550 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:14.213809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17e24b28-bece-46d4-aee9-2d7e38998550 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:14.223462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17e24b28-bece-46d4-aee9-2d7e38998550 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:14.941014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-17e24b28-bece-46d4-aee9-2d7e38998550 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:14.981526 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-17e24b28-bece-46d4-aee9-2d7e38998550 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1511 microversion: 2.1 time: 0.794438 Oct 29 01:28:14.999349 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2502/5242] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:14 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1511 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:15.023982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d93a979b-08b1-4d10-b3a3-dc801d2caab5 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:15.028484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d93a979b-08b1-4d10-b3a3-dc801d2caab5 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:15.036314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d93a979b-08b1-4d10-b3a3-dc801d2caab5 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:15.037949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d93a979b-08b1-4d10-b3a3-dc801d2caab5 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:15.039478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d93a979b-08b1-4d10-b3a3-dc801d2caab5 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:15.040317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d93a979b-08b1-4d10-b3a3-dc801d2caab5 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:15.040815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d93a979b-08b1-4d10-b3a3-dc801d2caab5 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:15.044239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d93a979b-08b1-4d10-b3a3-dc801d2caab5 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:15.475556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d93a979b-08b1-4d10-b3a3-dc801d2caab5 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e256dd021f34b3eb11d8828bbe82b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeba7c125f54d15ac32683bb5b3595d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:15.487801 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d93a979b-08b1-4d10-b3a3-dc801d2caab5 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 200 len: 1519 microversion: 2.1 time: 0.486627 Oct 29 01:28:15.488715 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2503/5243] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:14 2022] GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 1519 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:15.494773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f5d44e24-2e35-4452-8d84-bc0d405b64d5 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:15.495645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f5d44e24-2e35-4452-8d84-bc0d405b64d5 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:15.506206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5d44e24-2e35-4452-8d84-bc0d405b64d5 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:15.506902 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5d44e24-2e35-4452-8d84-bc0d405b64d5 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:15.507717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5d44e24-2e35-4452-8d84-bc0d405b64d5 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:15.510234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5d44e24-2e35-4452-8d84-bc0d405b64d5 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:15.510851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5d44e24-2e35-4452-8d84-bc0d405b64d5 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:15.511586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5d44e24-2e35-4452-8d84-bc0d405b64d5 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:15.595128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f5d44e24-2e35-4452-8d84-bc0d405b64d5 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:28:16.012093 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f5d44e24-2e35-4452-8d84-bc0d405b64d5 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 204 len: 0 microversion: 2.1 time: 0.521735 Oct 29 01:28:16.013107 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2504/5244] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:28:15 2022] DELETE /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:28:16.024419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fb7b7bd9-a0dc-44d8-9aa0-4d5a824e8f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:16.038936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fb7b7bd9-a0dc-44d8-9aa0-4d5a824e8f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:16.040766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fb7b7bd9-a0dc-44d8-9aa0-4d5a824e8f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:28:16.060872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb7b7bd9-a0dc-44d8-9aa0-4d5a824e8f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:16.063823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb7b7bd9-a0dc-44d8-9aa0-4d5a824e8f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:16.064642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb7b7bd9-a0dc-44d8-9aa0-4d5a824e8f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:16.065758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb7b7bd9-a0dc-44d8-9aa0-4d5a824e8f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:16.067033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb7b7bd9-a0dc-44d8-9aa0-4d5a824e8f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:16.070042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb7b7bd9-a0dc-44d8-9aa0-4d5a824e8f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:16.134858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.multi_cell_list [None req-fb7b7bd9-a0dc-44d8-9aa0-4d5a824e8f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121100) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:28:16.180173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fb7b7bd9-a0dc-44d8-9aa0-4d5a824e8f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:16.192662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb7b7bd9-a0dc-44d8-9aa0-4d5a824e8f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:16.193397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb7b7bd9-a0dc-44d8-9aa0-4d5a824e8f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:16.194473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb7b7bd9-a0dc-44d8-9aa0-4d5a824e8f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:17.109233 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fb7b7bd9-a0dc-44d8-9aa0-4d5a824e8f33 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 1.094363 Oct 29 01:28:17.110572 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2505/5245] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:28:16 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:17.117384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e8a69e1c-d8d9-4cf8-a1d1-88449627a917 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:17.119641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e8a69e1c-d8d9-4cf8-a1d1-88449627a917 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:17.146080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8a69e1c-d8d9-4cf8-a1d1-88449627a917 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:17.148574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8a69e1c-d8d9-4cf8-a1d1-88449627a917 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:17.148574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8a69e1c-d8d9-4cf8-a1d1-88449627a917 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:17.148574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8a69e1c-d8d9-4cf8-a1d1-88449627a917 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:17.148958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8a69e1c-d8d9-4cf8-a1d1-88449627a917 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:17.149055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8a69e1c-d8d9-4cf8-a1d1-88449627a917 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:17.214194 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5d59eec8-e146-4e22-a02e-593847f458ee tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.520640 Oct 29 01:28:17.215145 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2741/5246] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 29 01:28:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:17.228169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-838b801c-2ab0-4c77-95d3-f3c3030c2dec tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-943561600", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "4f780d3c-3a32-45e2-93e5-7eeb7ba5b9f5"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-838b801c-2ab0-4c77-95d3-f3c3030c2dec tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Request method failure captured: Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 242 Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIGQRkK-DyraYI4K2D-cYazvOqnV3UEuBwYGhjuyAtZ74Z3b0g_UMV9_r0xGx2gco21bv0HixjkK-OUyD40fAwI7KP5CcmEU7CmcX8rZJpRA6lLnTJv4xaAdaV9E42LudoUjkYYFrS_Lr7Fd8BgeHm3vN_1I19ED0lMbiOwajIQShcc Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: eaeba7c125f54d15ac32683bb5b3595d Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eaeba7c125f54d15ac32683bb5b3595d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: eaeba7c125f54d15ac32683bb5b3595d Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerMetadataNegativeTestJSON-1415351705-project Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8e256dd021f34b3eb11d8828bbe82b82 Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1415351705-project Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-943561600", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "4f780d3c-3a32-45e2-93e5-7eeb7ba5b9f5"}]}} Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-943561600', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '4f780d3c-3a32-45e2-93e5-7eeb7ba5b9f5'}]}}} Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:28:17.232849 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-838b801c-2ab0-4c77-95d3-f3c3030c2dec tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-838b801c-2ab0-4c77-95d3-f3c3030c2dec tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.022527 Oct 29 01:28:17.245642 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2742/5247] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:28:17 2022] POST /compute/v2.1/servers => generated 175 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:28:17.253921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9f8fbbc3-7778-4334-a1ff-b242e9cb6f98 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:17.254809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9f8fbbc3-7778-4334-a1ff-b242e9cb6f98 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:17.263806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:17.265740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f8fbbc3-7778-4334-a1ff-b242e9cb6f98 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:17.270042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f8fbbc3-7778-4334-a1ff-b242e9cb6f98 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:17.270042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f8fbbc3-7778-4334-a1ff-b242e9cb6f98 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:17.270042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f8fbbc3-7778-4334-a1ff-b242e9cb6f98 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:17.270042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f8fbbc3-7778-4334-a1ff-b242e9cb6f98 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:17.270042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f8fbbc3-7778-4334-a1ff-b242e9cb6f98 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:17.362751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e8a69e1c-d8d9-4cf8-a1d1-88449627a917 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:17.382916 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e8a69e1c-d8d9-4cf8-a1d1-88449627a917 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1613 microversion: 2.1 time: 0.268024 Oct 29 01:28:17.389899 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2506/5248] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:17 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1613 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:17.407207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-216882ab-61ed-4759-83d7-29342e334221 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:17.426999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-216882ab-61ed-4759-83d7-29342e334221 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:17.428133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-216882ab-61ed-4759-83d7-29342e334221 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:28:17.614347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-216882ab-61ed-4759-83d7-29342e334221 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:17.615764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-216882ab-61ed-4759-83d7-29342e334221 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:17.618302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-216882ab-61ed-4759-83d7-29342e334221 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:17.618302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-216882ab-61ed-4759-83d7-29342e334221 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:17.618991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-216882ab-61ed-4759-83d7-29342e334221 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:17.620349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-216882ab-61ed-4759-83d7-29342e334221 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:17.664381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9f8fbbc3-7778-4334-a1ff-b242e9cb6f98 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:17.687276 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9f8fbbc3-7778-4334-a1ff-b242e9cb6f98 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1469 microversion: 2.1 time: 0.436309 Oct 29 01:28:17.688277 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2743/5249] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:17 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1469 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:17.702572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3425f547-124a-4a01-8b3e-260398383ace tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] Action: 'create', calling method: .version_select at 0x7f9d96b84e50>, body: {"pool": null} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:17.797142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.multi_cell_list [None req-216882ab-61ed-4759-83d7-29342e334221 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121100) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:28:17.805827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:17.900751 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-216882ab-61ed-4759-83d7-29342e334221 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.508522 Oct 29 01:28:17.901396 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2507/5250] 10.222.0.26 () {58 vars in 1150 bytes} [Sat Oct 29 01:28:17 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:17.906678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-67282694-6c87-4da6-9417-3f9d40d732b8 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:17.907181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-67282694-6c87-4da6-9417-3f9d40d732b8 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: 21ea5aa9-5928-4c86-b1a5-0638c2cd316e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:17.960440 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-67282694-6c87-4da6-9417-3f9d40d732b8 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] HTTP exception thrown: Instance 21ea5aa9-5928-4c86-b1a5-0638c2cd316e could not be found. Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-67282694-6c87-4da6-9417-3f9d40d732b8 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Request method failure captured: Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/21ea5aa9-5928-4c86-b1a5-0638c2cd316e/metadata HTTP/1.1 Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIGQRkK-DyraYI4K2D-cYazvOqnV3UEuBwYGhjuyAtZ74Z3b0g_UMV9_r0xGx2gco21bv0HixjkK-OUyD40fAwI7KP5CcmEU7CmcX8rZJpRA6lLnTJv4xaAdaV9E42LudoUjkYYFrS_Lr7Fd8BgeHm3vN_1I19ED0lMbiOwajIQShcc Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: eaeba7c125f54d15ac32683bb5b3595d Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eaeba7c125f54d15ac32683bb5b3595d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: eaeba7c125f54d15ac32683bb5b3595d Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerMetadataNegativeTestJSON-1415351705-project Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 8e256dd021f34b3eb11d8828bbe82b82 Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1415351705-project Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 21ea5aa9-5928-4c86-b1a5-0638c2cd316e could not be found. Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'server_id': '21ea5aa9-5928-4c86-b1a5-0638c2cd316e'} Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ea5aa9-5928-4c86-b1a5-0638c2cd316e could not be found. Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ea5aa9-5928-4c86-b1a5-0638c2cd316e could not be found. Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:17.972069 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:17.977505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:28:17.977505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:28:17.977505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ea5aa9-5928-4c86-b1a5-0638c2cd316e could not be found. Oct 29 01:28:17.977505 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:17.977505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-67282694-6c87-4da6-9417-3f9d40d732b8 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Returning 404 to user: Instance 21ea5aa9-5928-4c86-b1a5-0638c2cd316e could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:28:17.977505 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-67282694-6c87-4da6-9417-3f9d40d732b8 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/21ea5aa9-5928-4c86-b1a5-0638c2cd316e/metadata" status: 404 len: 111 microversion: 2.1 time: 0.071324 Oct 29 01:28:17.986231 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2508/5251] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:28:17 2022] GET /compute/v2.1/servers/21ea5aa9-5928-4c86-b1a5-0638c2cd316e/metadata => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:28:18.001113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-342cc193-f029-44e1-bc05-47755cb4916b req-1a5939ed-19c6-47a3-914a-a4ec29baeda7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c86e050-73e4-4c80-a145-420293bbf8b2", "name": "network-vif-deleted", "tag": "85fe9242-041d-41ad-8dc3-ceea6e1ea126"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:18.044790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-342cc193-f029-44e1-bc05-47755cb4916b req-1a5939ed-19c6-47a3-914a-a4ec29baeda7 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:18.045299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-342cc193-f029-44e1-bc05-47755cb4916b req-1a5939ed-19c6-47a3-914a-a4ec29baeda7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:18.045738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-342cc193-f029-44e1-bc05-47755cb4916b req-1a5939ed-19c6-47a3-914a-a4ec29baeda7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:18.075703 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-342cc193-f029-44e1-bc05-47755cb4916b req-1a5939ed-19c6-47a3-914a-a4ec29baeda7 service nova] Creating event network-vif-deleted:85fe9242-041d-41ad-8dc3-ceea6e1ea126 for instance 2c86e050-73e4-4c80-a145-420293bbf8b2 on n-h1-862964-3 Oct 29 01:28:18.081461 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-342cc193-f029-44e1-bc05-47755cb4916b req-1a5939ed-19c6-47a3-914a-a4ec29baeda7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093302 Oct 29 01:28:18.086847 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2509/5252] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:18.090283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3721b264-0292-49ea-a59f-9b21fb53bd15 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:18.106787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3721b264-0292-49ea-a59f-9b21fb53bd15 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:18.109733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3721b264-0292-49ea-a59f-9b21fb53bd15 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:28:18.122437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3721b264-0292-49ea-a59f-9b21fb53bd15 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:18.125531 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3721b264-0292-49ea-a59f-9b21fb53bd15 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:18.126165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3721b264-0292-49ea-a59f-9b21fb53bd15 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:18.127104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3721b264-0292-49ea-a59f-9b21fb53bd15 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:18.127740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3721b264-0292-49ea-a59f-9b21fb53bd15 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:18.128384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3721b264-0292-49ea-a59f-9b21fb53bd15 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:18.272828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.multi_cell_list [None req-3721b264-0292-49ea-a59f-9b21fb53bd15 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121100) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:28:18.344743 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3721b264-0292-49ea-a59f-9b21fb53bd15 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.261260 Oct 29 01:28:18.346016 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2510/5253] 10.222.0.26 () {58 vars in 1212 bytes} [Sat Oct 29 01:28:18 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:18.352198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-95ae24b1-053d-4199-bb6a-8d814d4777dc tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-648750567", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4f780d3c-3a32-45e2-93e5-7eeb7ba5b9f5"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-95ae24b1-053d-4199-bb6a-8d814d4777dc tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Request method failure captured: Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 498 Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIGQRkK-DyraYI4K2D-cYazvOqnV3UEuBwYGhjuyAtZ74Z3b0g_UMV9_r0xGx2gco21bv0HixjkK-OUyD40fAwI7KP5CcmEU7CmcX8rZJpRA6lLnTJv4xaAdaV9E42LudoUjkYYFrS_Lr7Fd8BgeHm3vN_1I19ED0lMbiOwajIQShcc Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: eaeba7c125f54d15ac32683bb5b3595d Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eaeba7c125f54d15ac32683bb5b3595d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: eaeba7c125f54d15ac32683bb5b3595d Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerMetadataNegativeTestJSON-1415351705-project Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 8e256dd021f34b3eb11d8828bbe82b82 Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1415351705-project Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-648750567", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4f780d3c-3a32-45e2-93e5-7eeb7ba5b9f5"}]}} Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-648750567', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4f780d3c-3a32-45e2-93e5-7eeb7ba5b9f5'}]}}} Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 01:28:18.365047 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:18.369039 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:18.372687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-95ae24b1-053d-4199-bb6a-8d814d4777dc tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:28:18.375119 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-95ae24b1-053d-4199-bb6a-8d814d4777dc tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.027392 Oct 29 01:28:18.376255 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2511/5254] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:28:18 2022] POST /compute/v2.1/servers => generated 687 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:28:18.382410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b32c434b-7e68-40b1-8ac7-052f72490fdc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:18.391619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b32c434b-7e68-40b1-8ac7-052f72490fdc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:18.391619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b32c434b-7e68-40b1-8ac7-052f72490fdc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:28:18.407061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b32c434b-7e68-40b1-8ac7-052f72490fdc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:18.408270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b32c434b-7e68-40b1-8ac7-052f72490fdc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:18.408947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b32c434b-7e68-40b1-8ac7-052f72490fdc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:18.410748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b32c434b-7e68-40b1-8ac7-052f72490fdc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:18.411406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b32c434b-7e68-40b1-8ac7-052f72490fdc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:18.412668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b32c434b-7e68-40b1-8ac7-052f72490fdc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:18.554680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.multi_cell_list [None req-b32c434b-7e68-40b1-8ac7-052f72490fdc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121100) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:28:18.634309 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b32c434b-7e68-40b1-8ac7-052f72490fdc tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.256702 Oct 29 01:28:18.642917 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2512/5255] 10.222.0.26 () {58 vars in 1196 bytes} [Sat Oct 29 01:28:18 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:18.645457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4f69bae0-9a69-49f4-b94e-ad0f5611d892 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:18.646840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4f69bae0-9a69-49f4-b94e-ad0f5611d892 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:18.657092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f69bae0-9a69-49f4-b94e-ad0f5611d892 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:18.657630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f69bae0-9a69-49f4-b94e-ad0f5611d892 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:18.658130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f69bae0-9a69-49f4-b94e-ad0f5611d892 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:18.659268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f69bae0-9a69-49f4-b94e-ad0f5611d892 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:18.659852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f69bae0-9a69-49f4-b94e-ad0f5611d892 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:18.661216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f69bae0-9a69-49f4-b94e-ad0f5611d892 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:18.703173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f69bae0-9a69-49f4-b94e-ad0f5611d892 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:18.703671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f69bae0-9a69-49f4-b94e-ad0f5611d892 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:18.704203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f69bae0-9a69-49f4-b94e-ad0f5611d892 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:18.704682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-4f69bae0-9a69-49f4-b94e-ad0f5611d892 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lazy-loading 'fault' on Instance uuid 2c86e050-73e4-4c80-a145-420293bbf8b2 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:28:18.938164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4f69bae0-9a69-49f4-b94e-ad0f5611d892 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:18.943893 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4f69bae0-9a69-49f4-b94e-ad0f5611d892 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 200 len: 1330 microversion: 2.1 time: 0.305085 Oct 29 01:28:18.947929 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2513/5256] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:18 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 1330 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:18.966344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-58486852-743e-495c-9c2a-8df06a1e4555 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-444016690", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4f780d3c-3a32-45e2-93e5-7eeb7ba5b9f5"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-58486852-743e-495c-9c2a-8df06a1e4555 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Request method failure captured: Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 499 Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIGQRkK-DyraYI4K2D-cYazvOqnV3UEuBwYGhjuyAtZ74Z3b0g_UMV9_r0xGx2gco21bv0HixjkK-OUyD40fAwI7KP5CcmEU7CmcX8rZJpRA6lLnTJv4xaAdaV9E42LudoUjkYYFrS_Lr7Fd8BgeHm3vN_1I19ED0lMbiOwajIQShcc Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: eaeba7c125f54d15ac32683bb5b3595d Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eaeba7c125f54d15ac32683bb5b3595d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: eaeba7c125f54d15ac32683bb5b3595d Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerMetadataNegativeTestJSON-1415351705-project Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 8e256dd021f34b3eb11d8828bbe82b82 Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1415351705-project Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-444016690", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4f780d3c-3a32-45e2-93e5-7eeb7ba5b9f5"}]}} Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-444016690', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4f780d3c-3a32-45e2-93e5-7eeb7ba5b9f5'}]}}} Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 01:28:18.968609 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-58486852-743e-495c-9c2a-8df06a1e4555 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-58486852-743e-495c-9c2a-8df06a1e4555 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.021124 Oct 29 01:28:18.980579 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2514/5257] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:28:18 2022] POST /compute/v2.1/servers => generated 689 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:28:18.989427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1fdf4491-227e-4558-b373-07a1dce2c471 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:18.989427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1fdf4491-227e-4558-b373-07a1dce2c471 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:18.989427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1fdf4491-227e-4558-b373-07a1dce2c471 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'name': '1777675034', 'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:28:18.996030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1fdf4491-227e-4558-b373-07a1dce2c471 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:18.996618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1fdf4491-227e-4558-b373-07a1dce2c471 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:18.997070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1fdf4491-227e-4558-b373-07a1dce2c471 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:18.998307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1fdf4491-227e-4558-b373-07a1dce2c471 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:18.998307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1fdf4491-227e-4558-b373-07a1dce2c471 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:18.998722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1fdf4491-227e-4558-b373-07a1dce2c471 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:19.116340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.multi_cell_list [None req-1fdf4491-227e-4558-b373-07a1dce2c471 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121100) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:28:19.229231 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1fdf4491-227e-4558-b373-07a1dce2c471 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers?name=1777675034" status: 200 len: 346 microversion: 2.1 time: 0.255820 Oct 29 01:28:19.231693 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2515/5258] 10.222.0.26 () {58 vars in 1156 bytes} [Sat Oct 29 01:28:18 2022] GET /compute/v2.1/servers?name=1777675034 => generated 346 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:19.257486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d6c47d25-32f2-4986-a0cf-9cd1b8fff65e tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:19.261757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d6c47d25-32f2-4986-a0cf-9cd1b8fff65e tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:19.279318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6c47d25-32f2-4986-a0cf-9cd1b8fff65e tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:19.280401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6c47d25-32f2-4986-a0cf-9cd1b8fff65e tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:19.283311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6c47d25-32f2-4986-a0cf-9cd1b8fff65e tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:19.284232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6c47d25-32f2-4986-a0cf-9cd1b8fff65e tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:19.284814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6c47d25-32f2-4986-a0cf-9cd1b8fff65e tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:19.286178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6c47d25-32f2-4986-a0cf-9cd1b8fff65e tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:19.754385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d6c47d25-32f2-4986-a0cf-9cd1b8fff65e tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:19.765940 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d6c47d25-32f2-4986-a0cf-9cd1b8fff65e tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1469 microversion: 2.1 time: 0.532954 Oct 29 01:28:19.769011 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2516/5259] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:19 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1469 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:19.797287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-15be8c01-bb00-4b7d-962e-f5c31814deb3 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-405379111", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4f780d3c-3a32-45e2-93e5-7eeb7ba5b9f5"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-15be8c01-bb00-4b7d-962e-f5c31814deb3 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Request method failure captured: Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 753 Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIGQRkK-DyraYI4K2D-cYazvOqnV3UEuBwYGhjuyAtZ74Z3b0g_UMV9_r0xGx2gco21bv0HixjkK-OUyD40fAwI7KP5CcmEU7CmcX8rZJpRA6lLnTJv4xaAdaV9E42LudoUjkYYFrS_Lr7Fd8BgeHm3vN_1I19ED0lMbiOwajIQShcc Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: eaeba7c125f54d15ac32683bb5b3595d Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eaeba7c125f54d15ac32683bb5b3595d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: eaeba7c125f54d15ac32683bb5b3595d Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerMetadataNegativeTestJSON-1415351705-project Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 8e256dd021f34b3eb11d8828bbe82b82 Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1415351705-project Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-405379111", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4f780d3c-3a32-45e2-93e5-7eeb7ba5b9f5"}]}} Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-405379111', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4f780d3c-3a32-45e2-93e5-7eeb7ba5b9f5'}]}}} Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:28:19.809498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:28:19.812764 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:28:19.816314 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:19.816314 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:19.816314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-15be8c01-bb00-4b7d-962e-f5c31814deb3 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:28:19.816314 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-15be8c01-bb00-4b7d-962e-f5c31814deb3 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.029556 Oct 29 01:28:19.816314 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2517/5260] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:28:19 2022] POST /compute/v2.1/servers => generated 1197 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 29 01:28:19.823792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-47a98bb5-28db-4803-95be-ffb2807f5991 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:19.836399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-47a98bb5-28db-4803-95be-ffb2807f5991 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:19.837091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-47a98bb5-28db-4803-95be-ffb2807f5991 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:28:19.854808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a98bb5-28db-4803-95be-ffb2807f5991 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:19.855292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a98bb5-28db-4803-95be-ffb2807f5991 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:19.856535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a98bb5-28db-4803-95be-ffb2807f5991 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:19.857111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a98bb5-28db-4803-95be-ffb2807f5991 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:19.857594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a98bb5-28db-4803-95be-ffb2807f5991 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:19.858017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47a98bb5-28db-4803-95be-ffb2807f5991 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:20.051056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.multi_cell_list [None req-47a98bb5-28db-4803-95be-ffb2807f5991 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121100) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:28:20.170126 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-47a98bb5-28db-4803-95be-ffb2807f5991 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.353376 Oct 29 01:28:20.171660 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2518/5261] 10.222.0.26 () {58 vars in 1154 bytes} [Sat Oct 29 01:28:19 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:20.178366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e5aa9fdc-8ab1-4c23-b5ec-cbdbadf8d08b tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-570689641", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4f780d3c-3a32-45e2-93e5-7eeb7ba5b9f5"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e5aa9fdc-8ab1-4c23-b5ec-cbdbadf8d08b tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Request method failure captured: Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 1265 Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIGQRkK-DyraYI4K2D-cYazvOqnV3UEuBwYGhjuyAtZ74Z3b0g_UMV9_r0xGx2gco21bv0HixjkK-OUyD40fAwI7KP5CcmEU7CmcX8rZJpRA6lLnTJv4xaAdaV9E42LudoUjkYYFrS_Lr7Fd8BgeHm3vN_1I19ED0lMbiOwajIQShcc Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: eaeba7c125f54d15ac32683bb5b3595d Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eaeba7c125f54d15ac32683bb5b3595d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: eaeba7c125f54d15ac32683bb5b3595d Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerMetadataNegativeTestJSON-1415351705-project Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 8e256dd021f34b3eb11d8828bbe82b82 Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1415351705-project Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-570689641", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4f780d3c-3a32-45e2-93e5-7eeb7ba5b9f5"}]}} Oct 29 01:28:20.188384 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:28:20.191288 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:20.191288 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-570689641', 'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4f780d3c-3a32-45e2-93e5-7eeb7ba5b9f5'}]}}} Oct 29 01:28:20.191288 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:28:20.191288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:20.191288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 01:28:20.191288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 01:28:20.191288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 01:28:20.191288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise error Oct 29 01:28:20.191288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:20.191288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:20.191288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 01:28:20.191288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 01:28:20.191288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 01:28:20.191288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 01:28:20.191288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 01:28:20.191288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:20.191288 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 01:28:20.193706 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 01:28:20.201411 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 01:28:20.201411 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:20.201411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e5aa9fdc-8ab1-4c23-b5ec-cbdbadf8d08b tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:28:20.201411 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e5aa9fdc-8ab1-4c23-b5ec-cbdbadf8d08b tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.023652 Oct 29 01:28:20.201411 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2519/5262] 10.222.0.26 () {60 vars in 1148 bytes} [Sat Oct 29 01:28:20 2022] POST /compute/v2.1/servers => generated 2221 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 29 01:28:20.212411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-53fec435-2ad4-4b97-98ff-df5995b96d33 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:20.213272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-53fec435-2ad4-4b97-98ff-df5995b96d33 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:20.226250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-53fec435-2ad4-4b97-98ff-df5995b96d33 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:20.226250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-53fec435-2ad4-4b97-98ff-df5995b96d33 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:20.227297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-53fec435-2ad4-4b97-98ff-df5995b96d33 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:20.228518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-53fec435-2ad4-4b97-98ff-df5995b96d33 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:20.229581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-53fec435-2ad4-4b97-98ff-df5995b96d33 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:20.230189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-53fec435-2ad4-4b97-98ff-df5995b96d33 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:20.254745 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-53fec435-2ad4-4b97-98ff-df5995b96d33 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] HTTP exception thrown: Instance 2c86e050-73e4-4c80-a145-420293bbf8b2 could not be found. Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-53fec435-2ad4-4b97-98ff-df5995b96d33 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Request method failure captured: Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 HTTP/1.1 Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXICkjStyzUNQCP56iyabn5ahlWbK9bq57JWpf6w_r5-2BC1n9lfKn4n-q7ViwDGqwiAHQbWPA068CNGAzX2vWzwGSgwtRiu5lH8sKE1aT3VNdBS9vlw817eOLttRxo_xXGlmclE5Xf7yAYwC5hE1QU1PdlNbXv8l2Qz8VlCemFm6YRM Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad278c0b0b9a41beae8b29986e315743", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 444e13f1f2d945dfb31b83d8e19c2032 Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 2c86e050-73e4-4c80-a145-420293bbf8b2 could not be found. Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '2c86e050-73e4-4c80-a145-420293bbf8b2'} Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c86e050-73e4-4c80-a145-420293bbf8b2 could not be found. Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c86e050-73e4-4c80-a145-420293bbf8b2 could not be found. Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:20.256454 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:20.262648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:20.262648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:20.262648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:20.262648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:28:20.262648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:28:20.262648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c86e050-73e4-4c80-a145-420293bbf8b2 could not be found. Oct 29 01:28:20.262648 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:20.264696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-53fec435-2ad4-4b97-98ff-df5995b96d33 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Returning 404 to user: Instance 2c86e050-73e4-4c80-a145-420293bbf8b2 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:28:20.266072 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-53fec435-2ad4-4b97-98ff-df5995b96d33 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 404 len: 111 microversion: 2.1 time: 0.067257 Oct 29 01:28:20.267307 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2520/5263] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:20 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:28:20.279691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5152fceb-a190-4845-a919-18fa00f7f895 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:20.283504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5152fceb-a190-4845-a919-18fa00f7f895 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:20.284614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5152fceb-a190-4845-a919-18fa00f7f895 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-177767503', 'deleted': False, 'project_id': 'd77c806ec0e341a687910b98da07e148'} {{(pid=121100) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 01:28:20.292916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5152fceb-a190-4845-a919-18fa00f7f895 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:20.293804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5152fceb-a190-4845-a919-18fa00f7f895 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:20.294663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5152fceb-a190-4845-a919-18fa00f7f895 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:20.297086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5152fceb-a190-4845-a919-18fa00f7f895 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:20.297884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5152fceb-a190-4845-a919-18fa00f7f895 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:20.298538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5152fceb-a190-4845-a919-18fa00f7f895 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:20.426478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.multi_cell_list [None req-5152fceb-a190-4845-a919-18fa00f7f895 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121100) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 01:28:20.524508 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5152fceb-a190-4845-a919-18fa00f7f895 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-177767503" status: 200 len: 346 microversion: 2.1 time: 0.253623 Oct 29 01:28:20.525737 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2521/5264] 10.222.0.26 () {58 vars in 1228 bytes} [Sat Oct 29 01:28:20 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-177767503 => generated 346 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:20.540506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2505b433-c49a-42dd-bbaa-dbb301a0b017 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:20.541945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2505b433-c49a-42dd-bbaa-dbb301a0b017 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: 8a2d3699-becd-492b-b581-f749f67dc7a7] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:20.553307 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-2505b433-c49a-42dd-bbaa-dbb301a0b017 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] HTTP exception thrown: Instance 8a2d3699-becd-492b-b581-f749f67dc7a7 could not be found. Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2505b433-c49a-42dd-bbaa-dbb301a0b017 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Request method failure captured: Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/8a2d3699-becd-492b-b581-f749f67dc7a7/metadata/test2 HTTP/1.1 Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIGQRkK-DyraYI4K2D-cYazvOqnV3UEuBwYGhjuyAtZ74Z3b0g_UMV9_r0xGx2gco21bv0HixjkK-OUyD40fAwI7KP5CcmEU7CmcX8rZJpRA6lLnTJv4xaAdaV9E42LudoUjkYYFrS_Lr7Fd8BgeHm3vN_1I19ED0lMbiOwajIQShcc Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: eaeba7c125f54d15ac32683bb5b3595d Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eaeba7c125f54d15ac32683bb5b3595d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: eaeba7c125f54d15ac32683bb5b3595d Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerMetadataNegativeTestJSON-1415351705-project Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 8e256dd021f34b3eb11d8828bbe82b82 Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1415351705-project Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 8a2d3699-becd-492b-b581-f749f67dc7a7 could not be found. Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'server_id': '8a2d3699-becd-492b-b581-f749f67dc7a7', 'id': 'test2'} Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a2d3699-becd-492b-b581-f749f67dc7a7 could not be found. Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a2d3699-becd-492b-b581-f749f67dc7a7 could not be found. Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:20.559124 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:20.564095 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:28:20.564095 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:28:20.564095 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a2d3699-becd-492b-b581-f749f67dc7a7 could not be found. Oct 29 01:28:20.564095 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:20.564095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2505b433-c49a-42dd-bbaa-dbb301a0b017 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Returning 404 to user: Instance 8a2d3699-becd-492b-b581-f749f67dc7a7 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:28:20.564095 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2505b433-c49a-42dd-bbaa-dbb301a0b017 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/8a2d3699-becd-492b-b581-f749f67dc7a7/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.027707 Oct 29 01:28:20.564095 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2522/5265] 10.222.0.26 () {58 vars in 1281 bytes} [Sat Oct 29 01:28:20 2022] GET /compute/v2.1/servers/8a2d3699-becd-492b-b581-f749f67dc7a7/metadata/test2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:28:20.584710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-67de3e83-8802-4537-b8b8-8c55464f1c1c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '.version_select at 0x7f9d970f0310>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:20.628681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:20.712305 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-67de3e83-8802-4537-b8b8-8c55464f1c1c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-214589788" status: 202 len: 0 microversion: 2.1 time: 0.151417 Oct 29 01:28:20.717063 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2523/5266] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 29 01:28:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-214589788 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:28:20.719012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b2a5ff2c-c2ad-476f-8b71-c926e3e9d3ad tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:20.719454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b2a5ff2c-c2ad-476f-8b71-c926e3e9d3ad tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:20.726382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2a5ff2c-c2ad-476f-8b71-c926e3e9d3ad tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:20.727005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2a5ff2c-c2ad-476f-8b71-c926e3e9d3ad tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:20.727563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2a5ff2c-c2ad-476f-8b71-c926e3e9d3ad tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:20.728391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2a5ff2c-c2ad-476f-8b71-c926e3e9d3ad tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:20.728981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2a5ff2c-c2ad-476f-8b71-c926e3e9d3ad tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:20.729564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2a5ff2c-c2ad-476f-8b71-c926e3e9d3ad tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:20.758918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b2a5ff2c-c2ad-476f-8b71-c926e3e9d3ad tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:28:21.189144 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b2a5ff2c-c2ad-476f-8b71-c926e3e9d3ad tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "DELETE /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 204 len: 0 microversion: 2.1 time: 0.473932 Oct 29 01:28:21.189894 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2524/5267] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:28:20 2022] DELETE /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:28:21.197689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1f421f19-b61f-44d7-9147-80472d91b4a6 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:21.197689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1f421f19-b61f-44d7-9147-80472d91b4a6 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:21.205318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f421f19-b61f-44d7-9147-80472d91b4a6 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:21.206293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f421f19-b61f-44d7-9147-80472d91b4a6 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:21.206947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f421f19-b61f-44d7-9147-80472d91b4a6 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:21.208472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f421f19-b61f-44d7-9147-80472d91b4a6 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:21.209150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f421f19-b61f-44d7-9147-80472d91b4a6 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:21.209831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f421f19-b61f-44d7-9147-80472d91b4a6 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:21.256019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1f421f19-b61f-44d7-9147-80472d91b4a6 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:28:21.479981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:21.620239 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3425f547-124a-4a01-8b3e-260398383ace tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.930689 Oct 29 01:28:21.633081 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2744/5268] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 29 01:28:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:21.638695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-e4a2caba-8b92-4f5e-9cd6-ee125c623ac0 req-ce9b4905-4648-46e2-bad8-cee3b1937f7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd534e41-d223-4dd6-9b11-0b417c775beb", "name": "network-vif-deleted", "tag": "ec3e3375-e6aa-44e1-b5c9-0a7450805488"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:21.651643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e4a2caba-8b92-4f5e-9cd6-ee125c623ac0 req-ce9b4905-4648-46e2-bad8-cee3b1937f7f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:21.652363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e4a2caba-8b92-4f5e-9cd6-ee125c623ac0 req-ce9b4905-4648-46e2-bad8-cee3b1937f7f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:21.653394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e4a2caba-8b92-4f5e-9cd6-ee125c623ac0 req-ce9b4905-4648-46e2-bad8-cee3b1937f7f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:21.665609 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-e4a2caba-8b92-4f5e-9cd6-ee125c623ac0 req-ce9b4905-4648-46e2-bad8-cee3b1937f7f service nova] Creating event network-vif-deleted:ec3e3375-e6aa-44e1-b5c9-0a7450805488 for instance cd534e41-d223-4dd6-9b11-0b417c775beb on n-h2-862964-3 Oct 29 01:28:21.676812 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-e4a2caba-8b92-4f5e-9cd6-ee125c623ac0 req-ce9b4905-4648-46e2-bad8-cee3b1937f7f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037241 Oct 29 01:28:21.676812 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2745/5269] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:21.678208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9d8da477-e6e8-4400-bc25-328a4676666b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:21.678907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9d8da477-e6e8-4400-bc25-328a4676666b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:21.686349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d8da477-e6e8-4400-bc25-328a4676666b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:21.686767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d8da477-e6e8-4400-bc25-328a4676666b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:21.687228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d8da477-e6e8-4400-bc25-328a4676666b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:21.687968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d8da477-e6e8-4400-bc25-328a4676666b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:21.688561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d8da477-e6e8-4400-bc25-328a4676666b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:21.688993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d8da477-e6e8-4400-bc25-328a4676666b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:21.705920 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1f421f19-b61f-44d7-9147-80472d91b4a6 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 204 len: 0 microversion: 2.1 time: 0.512705 Oct 29 01:28:21.712616 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2525/5270] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:28:21 2022] DELETE /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:28:21.729535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d8da477-e6e8-4400-bc25-328a4676666b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:21.730525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d8da477-e6e8-4400-bc25-328a4676666b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:21.731394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d8da477-e6e8-4400-bc25-328a4676666b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:21.732053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-9d8da477-e6e8-4400-bc25-328a4676666b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lazy-loading 'fault' on Instance uuid cd534e41-d223-4dd6-9b11-0b417c775beb {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:28:21.742173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9a7e70d9-7ef1-4085-a449-feae19c22f54 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:21.746075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9a7e70d9-7ef1-4085-a449-feae19c22f54 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:21.754280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a7e70d9-7ef1-4085-a449-feae19c22f54 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:21.755145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a7e70d9-7ef1-4085-a449-feae19c22f54 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:21.755648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a7e70d9-7ef1-4085-a449-feae19c22f54 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:21.756853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a7e70d9-7ef1-4085-a449-feae19c22f54 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:21.756853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a7e70d9-7ef1-4085-a449-feae19c22f54 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:21.758583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a7e70d9-7ef1-4085-a449-feae19c22f54 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:21.818551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9d8da477-e6e8-4400-bc25-328a4676666b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:21.834247 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9d8da477-e6e8-4400-bc25-328a4676666b tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1303 microversion: 2.1 time: 0.160035 Oct 29 01:28:21.846860 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2746/5271] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:21 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1303 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:21.857746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-885041bb-099d-493a-9e47-fbf1464d1059 tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] Calling method '.version_select at 0x7f9d96c685e0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:22.060454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9a7e70d9-7ef1-4085-a449-feae19c22f54 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:22.066639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:22.072592 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9a7e70d9-7ef1-4085-a449-feae19c22f54 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1517 microversion: 2.1 time: 0.355905 Oct 29 01:28:22.073924 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2526/5272] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:21 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1517 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:22.109858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ffd79417-4c6c-4f50-bc43-edb154c7d869 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:22.110856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ffd79417-4c6c-4f50-bc43-edb154c7d869 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:22.129221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ffd79417-4c6c-4f50-bc43-edb154c7d869 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:22.129908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ffd79417-4c6c-4f50-bc43-edb154c7d869 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:22.130358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ffd79417-4c6c-4f50-bc43-edb154c7d869 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:22.131144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ffd79417-4c6c-4f50-bc43-edb154c7d869 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:22.131613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ffd79417-4c6c-4f50-bc43-edb154c7d869 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:22.132052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ffd79417-4c6c-4f50-bc43-edb154c7d869 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:22.838476 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-885041bb-099d-493a-9e47-fbf1464d1059 tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/34641d28-cf69-454a-a665-c922dfea95d2" status: 200 len: 142 microversion: 2.1 time: 0.990357 Oct 29 01:28:22.839063 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2747/5273] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 29 01:28:21 2022] GET /compute/v2.1/os-floating-ips/34641d28-cf69-454a-a665-c922dfea95d2 => generated 142 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:22.885668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cf3d7a83-2ee0-4367-98a6-3a7bb51a84e1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Action: 'create', calling method: .version_select at 0x7f9d969a65e0>, body: {"keypair": {"name": "tempest-keypair-1746870452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZKf9Ft4/M7Qh93VUz5G9kbBG8s56HJxSLcFuejzPRbd9SLl7KKzz60US1rxXvR38GDme2f0WPD/ExByTZUNWuv6jLfzRf1NdAAExtqgPGbnHbR1ZEjTYI81FcM4KXj5w=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:22.885668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-cf3d7a83-2ee0-4367-98a6-3a7bb51a84e1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Getting quotas for project ad278c0b0b9a41beae8b29986e315743. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:28:22.885668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-cf3d7a83-2ee0-4367-98a6-3a7bb51a84e1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Getting quotas for user 444e13f1f2d945dfb31b83d8e19c2032 and project ad278c0b0b9a41beae8b29986e315743. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:28:22.909408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ffd79417-4c6c-4f50-bc43-edb154c7d869 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e256dd021f34b3eb11d8828bbe82b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeba7c125f54d15ac32683bb5b3595d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:22.922868 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ffd79417-4c6c-4f50-bc43-edb154c7d869 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 200 len: 1525 microversion: 2.1 time: 0.844065 Oct 29 01:28:22.922868 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2527/5274] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:22 2022] GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 1525 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:22.930553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6cf6da10-8308-40d8-aaad-8a41bbd16d62 tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] Calling method '.version_select at 0x7f9d9747f700>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:23.167517 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cf3d7a83-2ee0-4367-98a6-3a7bb51a84e1 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.319230 Oct 29 01:28:23.168477 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2748/5275] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:28:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:23.174227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-92c5cd05-1a85-497e-b18e-b4a8d7d9bc77 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:23.175060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-92c5cd05-1a85-497e-b18e-b4a8d7d9bc77 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:23.181831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92c5cd05-1a85-497e-b18e-b4a8d7d9bc77 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:23.182525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92c5cd05-1a85-497e-b18e-b4a8d7d9bc77 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:23.183156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92c5cd05-1a85-497e-b18e-b4a8d7d9bc77 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:23.184405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92c5cd05-1a85-497e-b18e-b4a8d7d9bc77 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:23.185464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92c5cd05-1a85-497e-b18e-b4a8d7d9bc77 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:23.185893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92c5cd05-1a85-497e-b18e-b4a8d7d9bc77 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:23.220467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92c5cd05-1a85-497e-b18e-b4a8d7d9bc77 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:23.221252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92c5cd05-1a85-497e-b18e-b4a8d7d9bc77 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:23.221853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92c5cd05-1a85-497e-b18e-b4a8d7d9bc77 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:23.222472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-92c5cd05-1a85-497e-b18e-b4a8d7d9bc77 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lazy-loading 'fault' on Instance uuid cd534e41-d223-4dd6-9b11-0b417c775beb {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:28:23.313493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-92c5cd05-1a85-497e-b18e-b4a8d7d9bc77 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1185ee7721f400eb9cd7fea44d64364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f642212144498fa45333d414284e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:23.336118 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-92c5cd05-1a85-497e-b18e-b4a8d7d9bc77 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 200 len: 1303 microversion: 2.1 time: 0.166063 Oct 29 01:28:23.338093 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2749/5276] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:23 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 1303 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:23.345262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c8cf0829-1dd4-4cae-9e1a-a5817130540c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:23.346440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c8cf0829-1dd4-4cae-9e1a-a5817130540c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:23.360313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8cf0829-1dd4-4cae-9e1a-a5817130540c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:23.366126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8cf0829-1dd4-4cae-9e1a-a5817130540c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:23.366126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8cf0829-1dd4-4cae-9e1a-a5817130540c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:23.366126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8cf0829-1dd4-4cae-9e1a-a5817130540c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:23.366126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8cf0829-1dd4-4cae-9e1a-a5817130540c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:23.366126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8cf0829-1dd4-4cae-9e1a-a5817130540c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:23.889484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c8cf0829-1dd4-4cae-9e1a-a5817130540c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:23.905342 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c8cf0829-1dd4-4cae-9e1a-a5817130540c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1517 microversion: 2.1 time: 0.565776 Oct 29 01:28:23.906539 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2750/5277] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:23 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1517 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:23.912443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-1c325e6d-403b-40eb-9f3e-ab11c56e935f req-00e08b6c-6b80-43df-9e4c-b8082beedb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48860230-5ad5-4391-9c51-27fdaa24d27d", "name": "network-vif-deleted", "tag": "f5627393-bf9a-4f73-8784-e20c8224a0dd"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:23.927922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1c325e6d-403b-40eb-9f3e-ab11c56e935f req-00e08b6c-6b80-43df-9e4c-b8082beedb93 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:23.928944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1c325e6d-403b-40eb-9f3e-ab11c56e935f req-00e08b6c-6b80-43df-9e4c-b8082beedb93 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:23.929576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1c325e6d-403b-40eb-9f3e-ab11c56e935f req-00e08b6c-6b80-43df-9e4c-b8082beedb93 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:23.956217 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-1c325e6d-403b-40eb-9f3e-ab11c56e935f req-00e08b6c-6b80-43df-9e4c-b8082beedb93 service nova] Creating event network-vif-deleted:f5627393-bf9a-4f73-8784-e20c8224a0dd for instance 48860230-5ad5-4391-9c51-27fdaa24d27d on n-h2-862964-3 Oct 29 01:28:23.962794 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-1c325e6d-403b-40eb-9f3e-ab11c56e935f req-00e08b6c-6b80-43df-9e4c-b8082beedb93 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054834 Oct 29 01:28:23.965474 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2751/5278] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:23.975733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-16473395-3cee-49da-a95e-bd6c83bea3a7 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:23.977578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-16473395-3cee-49da-a95e-bd6c83bea3a7 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:23.993267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16473395-3cee-49da-a95e-bd6c83bea3a7 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:23.994629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16473395-3cee-49da-a95e-bd6c83bea3a7 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:23.995248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16473395-3cee-49da-a95e-bd6c83bea3a7 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:23.996280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16473395-3cee-49da-a95e-bd6c83bea3a7 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:24.000595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16473395-3cee-49da-a95e-bd6c83bea3a7 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:24.006426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16473395-3cee-49da-a95e-bd6c83bea3a7 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:24.537892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-16473395-3cee-49da-a95e-bd6c83bea3a7 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e256dd021f34b3eb11d8828bbe82b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeba7c125f54d15ac32683bb5b3595d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:24.552991 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-16473395-3cee-49da-a95e-bd6c83bea3a7 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 200 len: 1525 microversion: 2.1 time: 0.584768 Oct 29 01:28:24.553616 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2752/5279] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:23 2022] GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 1525 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:24.561532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8a038155-0b86-4748-aaf3-0fc8df595d99 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:24.565788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8a038155-0b86-4748-aaf3-0fc8df595d99 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] [instance: cd534e41-d223-4dd6-9b11-0b417c775beb] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:24.581699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a038155-0b86-4748-aaf3-0fc8df595d99 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:24.582192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a038155-0b86-4748-aaf3-0fc8df595d99 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:24.582827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a038155-0b86-4748-aaf3-0fc8df595d99 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:24.583544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a038155-0b86-4748-aaf3-0fc8df595d99 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:24.584176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a038155-0b86-4748-aaf3-0fc8df595d99 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:24.584571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a038155-0b86-4748-aaf3-0fc8df595d99 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:24.600806 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-8a038155-0b86-4748-aaf3-0fc8df595d99 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] HTTP exception thrown: Instance cd534e41-d223-4dd6-9b11-0b417c775beb could not be found. Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8a038155-0b86-4748-aaf3-0fc8df595d99 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Request method failure captured: Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb HTTP/1.1 Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIDT3d19ER7JJUdqB0X5aMackwSsZq2W3gv6OUgsYhmNu-Dlma1Z07fWyy0tdyOjKIEpnWcSumC0iSOD-USbK95lOf7nFgdvuKjJ3O7d1jXBdwt8Eo7m9c5WdaAU1FSZstXZ9UDxm17B1WD1awv-HIqca7TINFgcc_aO5y78kNF0mPQ Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: a5f642212144498fa45333d414284e28 Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-VolumesBackupsTest-1273086816 Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a5f642212144498fa45333d414284e28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a5f642212144498fa45333d414284e28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a5f642212144498fa45333d414284e28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a5f642212144498fa45333d414284e28", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-VolumesBackupsTest-1273086816 Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: a5f642212144498fa45333d414284e28 Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-VolumesBackupsTest-1273086816 Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-VolumesBackupsTest-1273086816-project Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: b1185ee7721f400eb9cd7fea44d64364 Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-VolumesBackupsTest-1273086816-project Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance cd534e41-d223-4dd6-9b11-0b417c775beb could not be found. Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'cd534e41-d223-4dd6-9b11-0b417c775beb'} Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd534e41-d223-4dd6-9b11-0b417c775beb could not be found. Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd534e41-d223-4dd6-9b11-0b417c775beb could not be found. Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:24.602369 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:24.607479 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:24.607479 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:24.607479 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:24.607479 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:28:24.607479 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:28:24.607479 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd534e41-d223-4dd6-9b11-0b417c775beb could not be found. Oct 29 01:28:24.607479 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:24.607479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8a038155-0b86-4748-aaf3-0fc8df595d99 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] Returning 404 to user: Instance cd534e41-d223-4dd6-9b11-0b417c775beb could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:28:24.607479 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8a038155-0b86-4748-aaf3-0fc8df595d99 tempest-VolumesBackupsTest-1273086816 tempest-VolumesBackupsTest-1273086816-project] 10.222.0.26 "GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb" status: 404 len: 111 microversion: 2.1 time: 0.049026 Oct 29 01:28:24.607479 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2753/5280] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:24 2022] GET /compute/v2.1/servers/cd534e41-d223-4dd6-9b11-0b417c775beb => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:28:24.932235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4265d24b-5392-4bb8-a369-8a615729a37a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:24.933555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4265d24b-5392-4bb8-a369-8a615729a37a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:24.946222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4265d24b-5392-4bb8-a369-8a615729a37a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:24.946717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4265d24b-5392-4bb8-a369-8a615729a37a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:24.947152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4265d24b-5392-4bb8-a369-8a615729a37a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:24.947961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4265d24b-5392-4bb8-a369-8a615729a37a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:24.948319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4265d24b-5392-4bb8-a369-8a615729a37a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:24.948745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4265d24b-5392-4bb8-a369-8a615729a37a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:25.013272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4265d24b-5392-4bb8-a369-8a615729a37a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:25.013945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4265d24b-5392-4bb8-a369-8a615729a37a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:25.014391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4265d24b-5392-4bb8-a369-8a615729a37a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:25.015118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-4265d24b-5392-4bb8-a369-8a615729a37a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lazy-loading 'fault' on Instance uuid 48860230-5ad5-4391-9c51-27fdaa24d27d {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:28:25.244878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4265d24b-5392-4bb8-a369-8a615729a37a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:25.268707 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4265d24b-5392-4bb8-a369-8a615729a37a tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 200 len: 1311 microversion: 2.1 time: 0.339554 Oct 29 01:28:25.299899 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2754/5281] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:24 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 1311 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:28:25.581325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-105de98c-11a7-4fa2-8748-c8653e8b1fce tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:25.582363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-105de98c-11a7-4fa2-8748-c8653e8b1fce tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:25.589291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-105de98c-11a7-4fa2-8748-c8653e8b1fce tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:25.590127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-105de98c-11a7-4fa2-8748-c8653e8b1fce tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:25.590769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-105de98c-11a7-4fa2-8748-c8653e8b1fce tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:25.595679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-105de98c-11a7-4fa2-8748-c8653e8b1fce tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:25.595679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-105de98c-11a7-4fa2-8748-c8653e8b1fce tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:25.595679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-105de98c-11a7-4fa2-8748-c8653e8b1fce tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:25.808466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-105de98c-11a7-4fa2-8748-c8653e8b1fce tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e256dd021f34b3eb11d8828bbe82b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeba7c125f54d15ac32683bb5b3595d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:25.829623 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-105de98c-11a7-4fa2-8748-c8653e8b1fce tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 200 len: 1483 microversion: 2.1 time: 0.253177 Oct 29 01:28:25.830880 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2755/5282] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:25 2022] GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 1483 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:25.860328 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6cf6da10-8308-40d8-aaad-8a41bbd16d62 tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/34641d28-cf69-454a-a665-c922dfea95d2" status: 202 len: 0 microversion: 2.1 time: 2.936845 Oct 29 01:28:25.861850 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2528/5283] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:28:22 2022] DELETE /compute/v2.1/os-floating-ips/34641d28-cf69-454a-a665-c922dfea95d2 => generated 0 bytes in 2940 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:28:25.872676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-11df8d38-e124-43c7-9b06-19470faa9512 tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] Calling method '.version_select at 0x7f9d96bf6f70>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:26.132527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-2935311d-58ad-4323-ae89-942f0799683d req-e8dcd4ab-78f6-422c-b6bd-16301571b5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf4a66f-98ff-43e9-8c7a-a1d2369a305a", "name": "network-vif-deleted", "tag": "75927a9e-7062-4162-b7e7-ec50990c7e71"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:26.145535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2935311d-58ad-4323-ae89-942f0799683d req-e8dcd4ab-78f6-422c-b6bd-16301571b5d9 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:26.147052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2935311d-58ad-4323-ae89-942f0799683d req-e8dcd4ab-78f6-422c-b6bd-16301571b5d9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:26.147840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2935311d-58ad-4323-ae89-942f0799683d req-e8dcd4ab-78f6-422c-b6bd-16301571b5d9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:26.166298 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-2935311d-58ad-4323-ae89-942f0799683d req-e8dcd4ab-78f6-422c-b6bd-16301571b5d9 service nova] Creating event network-vif-deleted:75927a9e-7062-4162-b7e7-ec50990c7e71 for instance fcf4a66f-98ff-43e9-8c7a-a1d2369a305a on n-h1-862964-3 Oct 29 01:28:26.172512 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-2935311d-58ad-4323-ae89-942f0799683d req-e8dcd4ab-78f6-422c-b6bd-16301571b5d9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044229 Oct 29 01:28:26.173590 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2529/5284] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:28:26.272946 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-11df8d38-e124-43c7-9b06-19470faa9512 tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 93 microversion: 2.1 time: 0.404231 Oct 29 01:28:26.275625 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2756/5285] 10.222.0.26 () {58 vars in 1164 bytes} [Sat Oct 29 01:28:25 2022] GET /compute/v2.1/os-floating-ip-pools => generated 93 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:28:26.288570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a517dffc-22f3-419a-884d-35f18143ac61 tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] Calling method '.version_select at 0x7f9d9fd2f3a0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:26.296555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:26.330051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-948b7fa2-5a7b-4f0d-9f35-4a6f0dcde18b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:26.331033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-948b7fa2-5a7b-4f0d-9f35-4a6f0dcde18b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 48860230-5ad5-4391-9c51-27fdaa24d27d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:26.341713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-948b7fa2-5a7b-4f0d-9f35-4a6f0dcde18b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:26.342778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-948b7fa2-5a7b-4f0d-9f35-4a6f0dcde18b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:26.343411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-948b7fa2-5a7b-4f0d-9f35-4a6f0dcde18b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:26.346084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-948b7fa2-5a7b-4f0d-9f35-4a6f0dcde18b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:26.349288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-948b7fa2-5a7b-4f0d-9f35-4a6f0dcde18b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:26.350141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-948b7fa2-5a7b-4f0d-9f35-4a6f0dcde18b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:26.365894 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-948b7fa2-5a7b-4f0d-9f35-4a6f0dcde18b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] HTTP exception thrown: Instance 48860230-5ad5-4391-9c51-27fdaa24d27d could not be found. Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-948b7fa2-5a7b-4f0d-9f35-4a6f0dcde18b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Request method failure captured: Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d HTTP/1.1 Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIFsyhhv14dNpFJOckZcFcOAhSnA6jyGFAAtHFgrWh6Ayfu-L0ysNf5Oeeyr_CfNdyLaAyen1teJ9SERptZSeRtw3-AWvD0tQ_J0efYzMdi8sLX97M4_vwgSNXmRAv5ah6Ui0_uEad9kiQz2XLSIpNnX_Ay-ksk3FMUsF5hstA025J8 Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: d77c806ec0e341a687910b98da07e148 Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ListServerFiltersTestJSON-688081980 Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d77c806ec0e341a687910b98da07e148"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d77c806ec0e341a687910b98da07e148"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d77c806ec0e341a687910b98da07e148"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d77c806ec0e341a687910b98da07e148", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ListServerFiltersTestJSON-688081980 Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: d77c806ec0e341a687910b98da07e148 Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-688081980 Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ListServerFiltersTestJSON-688081980-project Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 5e5a71f37f194b15a8da5fc14ffa3744 Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ListServerFiltersTestJSON-688081980-project Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 48860230-5ad5-4391-9c51-27fdaa24d27d could not be found. Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '48860230-5ad5-4391-9c51-27fdaa24d27d'} Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48860230-5ad5-4391-9c51-27fdaa24d27d could not be found. Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48860230-5ad5-4391-9c51-27fdaa24d27d could not be found. Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:26.368257 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:26.374799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:26.374799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:26.374799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:26.374799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:28:26.374799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:28:26.374799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48860230-5ad5-4391-9c51-27fdaa24d27d could not be found. Oct 29 01:28:26.374799 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:26.376127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-948b7fa2-5a7b-4f0d-9f35-4a6f0dcde18b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Returning 404 to user: Instance 48860230-5ad5-4391-9c51-27fdaa24d27d could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:28:26.377728 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-948b7fa2-5a7b-4f0d-9f35-4a6f0dcde18b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d" status: 404 len: 111 microversion: 2.1 time: 0.051590 Oct 29 01:28:26.382101 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2757/5286] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:26 2022] GET /compute/v2.1/servers/48860230-5ad5-4391-9c51-27fdaa24d27d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:28:26.387810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-01b9314b-04f4-4c39-9fb7-64ff60931e56 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:26.388580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-01b9314b-04f4-4c39-9fb7-64ff60931e56 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: ba394c36-e5b5-4e80-bf8b-70aff3251fa2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:26.395240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01b9314b-04f4-4c39-9fb7-64ff60931e56 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:26.398659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01b9314b-04f4-4c39-9fb7-64ff60931e56 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:26.398659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01b9314b-04f4-4c39-9fb7-64ff60931e56 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:26.398659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01b9314b-04f4-4c39-9fb7-64ff60931e56 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:26.398659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01b9314b-04f4-4c39-9fb7-64ff60931e56 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:26.398659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-01b9314b-04f4-4c39-9fb7-64ff60931e56 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:26.434393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-01b9314b-04f4-4c39-9fb7-64ff60931e56 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: ba394c36-e5b5-4e80-bf8b-70aff3251fa2] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:28:26.696618 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a517dffc-22f3-419a-884d-35f18143ac61 tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.412612 Oct 29 01:28:26.697231 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2530/5287] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 29 01:28:26 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:26.712572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-27fde757-a065-4826-b479-6b3234e30b3c tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] Calling method '.version_select at 0x7f9d97f0edc0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:26.764155 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-01b9314b-04f4-4c39-9fb7-64ff60931e56 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba394c36-e5b5-4e80-bf8b-70aff3251fa2" status: 204 len: 0 microversion: 2.1 time: 0.378130 Oct 29 01:28:26.764951 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2758/5288] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:28:26 2022] DELETE /compute/v2.1/servers/ba394c36-e5b5-4e80-bf8b-70aff3251fa2 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:28:26.778751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6085a99c-93af-4782-8759-a05893599b2d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:26.779586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6085a99c-93af-4782-8759-a05893599b2d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: ba394c36-e5b5-4e80-bf8b-70aff3251fa2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:26.792269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6085a99c-93af-4782-8759-a05893599b2d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:26.795153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6085a99c-93af-4782-8759-a05893599b2d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:26.796810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6085a99c-93af-4782-8759-a05893599b2d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:26.797668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6085a99c-93af-4782-8759-a05893599b2d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:26.806023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6085a99c-93af-4782-8759-a05893599b2d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:26.806023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6085a99c-93af-4782-8759-a05893599b2d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:26.812592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:27.702829 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6085a99c-93af-4782-8759-a05893599b2d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:27.716915 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6085a99c-93af-4782-8759-a05893599b2d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/ba394c36-e5b5-4e80-bf8b-70aff3251fa2" status: 200 len: 1518 microversion: 2.1 time: 0.943301 Oct 29 01:28:27.718223 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2759/5289] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:26 2022] GET /compute/v2.1/servers/ba394c36-e5b5-4e80-bf8b-70aff3251fa2 => generated 1518 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:28:27.723293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9877254f-d1f9-46c5-8c7d-486152aed300 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:27.728041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9877254f-d1f9-46c5-8c7d-486152aed300 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] [instance: fcf4a66f-98ff-43e9-8c7a-a1d2369a305a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:27.734511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9877254f-d1f9-46c5-8c7d-486152aed300 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:27.735072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9877254f-d1f9-46c5-8c7d-486152aed300 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:27.735937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9877254f-d1f9-46c5-8c7d-486152aed300 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:27.736984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9877254f-d1f9-46c5-8c7d-486152aed300 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:27.737648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9877254f-d1f9-46c5-8c7d-486152aed300 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:27.738090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9877254f-d1f9-46c5-8c7d-486152aed300 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:27.759551 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-9877254f-d1f9-46c5-8c7d-486152aed300 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] HTTP exception thrown: Instance fcf4a66f-98ff-43e9-8c7a-a1d2369a305a could not be found. Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9877254f-d1f9-46c5-8c7d-486152aed300 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Request method failure captured: Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a HTTP/1.1 Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIGQRkK-DyraYI4K2D-cYazvOqnV3UEuBwYGhjuyAtZ74Z3b0g_UMV9_r0xGx2gco21bv0HixjkK-OUyD40fAwI7KP5CcmEU7CmcX8rZJpRA6lLnTJv4xaAdaV9E42LudoUjkYYFrS_Lr7Fd8BgeHm3vN_1I19ED0lMbiOwajIQShcc Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: eaeba7c125f54d15ac32683bb5b3595d Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eaeba7c125f54d15ac32683bb5b3595d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eaeba7c125f54d15ac32683bb5b3595d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: eaeba7c125f54d15ac32683bb5b3595d Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1415351705 Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerMetadataNegativeTestJSON-1415351705-project Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8e256dd021f34b3eb11d8828bbe82b82 Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1415351705-project Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance fcf4a66f-98ff-43e9-8c7a-a1d2369a305a could not be found. Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'fcf4a66f-98ff-43e9-8c7a-a1d2369a305a'} Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcf4a66f-98ff-43e9-8c7a-a1d2369a305a could not be found. Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcf4a66f-98ff-43e9-8c7a-a1d2369a305a could not be found. Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:27.762659 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:27.767617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:27.767617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:27.767617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:27.767617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:27.767617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:28:27.767617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:28:27.767617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcf4a66f-98ff-43e9-8c7a-a1d2369a305a could not be found. Oct 29 01:28:27.767617 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:27.767617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9877254f-d1f9-46c5-8c7d-486152aed300 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] Returning 404 to user: Instance fcf4a66f-98ff-43e9-8c7a-a1d2369a305a could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:28:27.767617 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9877254f-d1f9-46c5-8c7d-486152aed300 tempest-ServerMetadataNegativeTestJSON-1415351705 tempest-ServerMetadataNegativeTestJSON-1415351705-project] 10.222.0.26 "GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a" status: 404 len: 111 microversion: 2.1 time: 0.045185 Oct 29 01:28:27.767617 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2760/5290] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:27 2022] GET /compute/v2.1/servers/fcf4a66f-98ff-43e9-8c7a-a1d2369a305a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:28:28.506254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-631b219a-5bf9-4a95-9c6e-94679f0438b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-336653367", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3aada4e4-ab9d-407f-aadb-56a56f4bc58e"}], "security_groups": [{"name": "tempest-securitygroup--1549699701"}], "key_name": "tempest-keypair-1746870452", "user_data": "}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:28.737509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-631b219a-5bf9-4a95-9c6e-94679f0438b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] validate_networks() for [('3aada4e4-ab9d-407f-aadb-56a56f4bc58e', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:28:29.291122 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-27fde757-a065-4826-b479-6b3234e30b3c tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/99eb32f3-5451-485a-aef3-14d35b7a23e6" status: 202 len: 0 microversion: 2.1 time: 2.582176 Oct 29 01:28:29.292433 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2531/5291] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:28:26 2022] DELETE /compute/v2.1/os-floating-ips/99eb32f3-5451-485a-aef3-14d35b7a23e6 => generated 0 bytes in 2584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:28:29.299864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bc631ab1-71ab-4e74-a7c1-f430fe4dff5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:29.303692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bc631ab1-71ab-4e74-a7c1-f430fe4dff5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: ba394c36-e5b5-4e80-bf8b-70aff3251fa2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:29.320945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc631ab1-71ab-4e74-a7c1-f430fe4dff5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:29.320945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc631ab1-71ab-4e74-a7c1-f430fe4dff5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:29.320945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc631ab1-71ab-4e74-a7c1-f430fe4dff5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:29.325991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc631ab1-71ab-4e74-a7c1-f430fe4dff5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:29.326731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc631ab1-71ab-4e74-a7c1-f430fe4dff5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:29.327447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc631ab1-71ab-4e74-a7c1-f430fe4dff5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:30.157695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bc631ab1-71ab-4e74-a7c1-f430fe4dff5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:30.170376 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bc631ab1-71ab-4e74-a7c1-f430fe4dff5b tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/ba394c36-e5b5-4e80-bf8b-70aff3251fa2" status: 200 len: 1518 microversion: 2.1 time: 0.876202 Oct 29 01:28:30.170982 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2532/5292] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:29 2022] GET /compute/v2.1/servers/ba394c36-e5b5-4e80-bf8b-70aff3251fa2 => generated 1518 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:30.179946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-631b219a-5bf9-4a95-9c6e-94679f0438b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:28:30.182277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-631b219a-5bf9-4a95-9c6e-94679f0438b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:28:30.182277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-631b219a-5bf9-4a95-9c6e-94679f0438b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:28:30.182277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-631b219a-5bf9-4a95-9c6e-94679f0438b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:28:30.182277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-631b219a-5bf9-4a95-9c6e-94679f0438b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:28:30.191333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e129e777-29c2-4416-9cef-5af59b52595e tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] Calling method '.version_select at 0x7f9d97d6a0d0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:30.194046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-631b219a-5bf9-4a95-9c6e-94679f0438b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:30.194536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-631b219a-5bf9-4a95-9c6e-94679f0438b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:30.194980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-631b219a-5bf9-4a95-9c6e-94679f0438b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:30.195709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-631b219a-5bf9-4a95-9c6e-94679f0438b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:30.196167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-631b219a-5bf9-4a95-9c6e-94679f0438b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:30.196595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-631b219a-5bf9-4a95-9c6e-94679f0438b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:30.218398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-631b219a-5bf9-4a95-9c6e-94679f0438b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Getting quotas for project ad278c0b0b9a41beae8b29986e315743. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:28:30.224534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-631b219a-5bf9-4a95-9c6e-94679f0438b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Getting quotas for user 444e13f1f2d945dfb31b83d8e19c2032 and project ad278c0b0b9a41beae8b29986e315743. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:28:30.249029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-631b219a-5bf9-4a95-9c6e-94679f0438b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:28:30.251821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-631b219a-5bf9-4a95-9c6e-94679f0438b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:28:30.335398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=14 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:30.490130 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-631b219a-5bf9-4a95-9c6e-94679f0438b3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.999597 Oct 29 01:28:30.491216 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2761/5293] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:28:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 2001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:28:30.503323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-466a94bf-6899-4937-8645-247d1d738930 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:30.504100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-466a94bf-6899-4937-8645-247d1d738930 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:30.666583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-466a94bf-6899-4937-8645-247d1d738930 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:30.681876 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-466a94bf-6899-4937-8645-247d1d738930 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1241 microversion: 2.1 time: 0.181920 Oct 29 01:28:30.683262 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2762/5294] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:30 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1241 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:28:31.099956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-1566106c-a40e-40c2-a08d-3d2933c3972b req-4e9da741-1e1f-42c4-84a8-f6c5597b0b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba394c36-e5b5-4e80-bf8b-70aff3251fa2", "name": "network-vif-deleted", "tag": "57131cc4-bfbe-4875-9d0c-928112519e4a"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:31.147356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1566106c-a40e-40c2-a08d-3d2933c3972b req-4e9da741-1e1f-42c4-84a8-f6c5597b0b93 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:31.147937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1566106c-a40e-40c2-a08d-3d2933c3972b req-4e9da741-1e1f-42c4-84a8-f6c5597b0b93 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:31.148386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-1566106c-a40e-40c2-a08d-3d2933c3972b req-4e9da741-1e1f-42c4-84a8-f6c5597b0b93 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:31.185053 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-1566106c-a40e-40c2-a08d-3d2933c3972b req-4e9da741-1e1f-42c4-84a8-f6c5597b0b93 service nova] Creating event network-vif-deleted:57131cc4-bfbe-4875-9d0c-928112519e4a for instance ba394c36-e5b5-4e80-bf8b-70aff3251fa2 on n-h2-862964-3 Oct 29 01:28:31.193601 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-1566106c-a40e-40c2-a08d-3d2933c3972b req-4e9da741-1e1f-42c4-84a8-f6c5597b0b93 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098028 Oct 29 01:28:31.195013 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2763/5295] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:28:31.201881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8a2794e6-c706-47a3-a6f7-cc2dd58b86ed tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:31.202991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8a2794e6-c706-47a3-a6f7-cc2dd58b86ed tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: ba394c36-e5b5-4e80-bf8b-70aff3251fa2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:31.214091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a2794e6-c706-47a3-a6f7-cc2dd58b86ed tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:31.215509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a2794e6-c706-47a3-a6f7-cc2dd58b86ed tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:31.216124 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a2794e6-c706-47a3-a6f7-cc2dd58b86ed tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:31.217088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a2794e6-c706-47a3-a6f7-cc2dd58b86ed tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:31.217737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a2794e6-c706-47a3-a6f7-cc2dd58b86ed tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:31.222280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a2794e6-c706-47a3-a6f7-cc2dd58b86ed tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:31.414845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8a2794e6-c706-47a3-a6f7-cc2dd58b86ed tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:31.426538 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8a2794e6-c706-47a3-a6f7-cc2dd58b86ed tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/ba394c36-e5b5-4e80-bf8b-70aff3251fa2" status: 200 len: 1476 microversion: 2.1 time: 0.230045 Oct 29 01:28:31.448633 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2764/5296] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:31 2022] GET /compute/v2.1/servers/ba394c36-e5b5-4e80-bf8b-70aff3251fa2 => generated 1476 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:31.723143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9c46568d-87e2-480d-b9a6-fea38357b9cb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:31.728162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9c46568d-87e2-480d-b9a6-fea38357b9cb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:31.938651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9c46568d-87e2-480d-b9a6-fea38357b9cb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:31.946019 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9c46568d-87e2-480d-b9a6-fea38357b9cb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1241 microversion: 2.1 time: 0.239741 Oct 29 01:28:31.950702 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2765/5297] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:31 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1241 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:28:32.135538 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e129e777-29c2-4416-9cef-5af59b52595e tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/9984bdbd-aac8-4b68-ab16-c75e3b66fb60" status: 202 len: 0 microversion: 2.1 time: 1.946487 Oct 29 01:28:32.138285 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2533/5298] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:28:30 2022] DELETE /compute/v2.1/os-floating-ips/9984bdbd-aac8-4b68-ab16-c75e3b66fb60 => generated 0 bytes in 1951 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:28:32.146234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b68dd822-6d2b-4d60-9a58-362e6a4c9450 tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] Calling method '.version_select at 0x7f9d9695e9d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:32.456941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-08dd6f8e-0e6b-4cd8-b0c9-e69b73f4cfbe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:32.457869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-08dd6f8e-0e6b-4cd8-b0c9-e69b73f4cfbe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: ba394c36-e5b5-4e80-bf8b-70aff3251fa2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:32.472532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08dd6f8e-0e6b-4cd8-b0c9-e69b73f4cfbe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:32.473679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08dd6f8e-0e6b-4cd8-b0c9-e69b73f4cfbe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:32.475236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08dd6f8e-0e6b-4cd8-b0c9-e69b73f4cfbe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:32.476159 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08dd6f8e-0e6b-4cd8-b0c9-e69b73f4cfbe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:32.477952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08dd6f8e-0e6b-4cd8-b0c9-e69b73f4cfbe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:32.479577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08dd6f8e-0e6b-4cd8-b0c9-e69b73f4cfbe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:32.561515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08dd6f8e-0e6b-4cd8-b0c9-e69b73f4cfbe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:32.562006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08dd6f8e-0e6b-4cd8-b0c9-e69b73f4cfbe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:32.562615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08dd6f8e-0e6b-4cd8-b0c9-e69b73f4cfbe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:32.563083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-08dd6f8e-0e6b-4cd8-b0c9-e69b73f4cfbe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lazy-loading 'fault' on Instance uuid ba394c36-e5b5-4e80-bf8b-70aff3251fa2 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:28:32.754656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-08dd6f8e-0e6b-4cd8-b0c9-e69b73f4cfbe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:32.765368 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-08dd6f8e-0e6b-4cd8-b0c9-e69b73f4cfbe tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/ba394c36-e5b5-4e80-bf8b-70aff3251fa2" status: 200 len: 1311 microversion: 2.1 time: 0.312524 Oct 29 01:28:32.766625 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2534/5299] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:32 2022] GET /compute/v2.1/servers/ba394c36-e5b5-4e80-bf8b-70aff3251fa2 => generated 1311 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:32.976894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-75d13774-310c-4eb7-a188-21388a960a94 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:32.978080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-75d13774-310c-4eb7-a188-21388a960a94 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:32.993601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-75d13774-310c-4eb7-a188-21388a960a94 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:32.994666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-75d13774-310c-4eb7-a188-21388a960a94 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:32.995361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-75d13774-310c-4eb7-a188-21388a960a94 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:32.999918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-75d13774-310c-4eb7-a188-21388a960a94 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:33.000698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-75d13774-310c-4eb7-a188-21388a960a94 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:33.001398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-75d13774-310c-4eb7-a188-21388a960a94 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:33.212931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-75d13774-310c-4eb7-a188-21388a960a94 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:33.223136 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-75d13774-310c-4eb7-a188-21388a960a94 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1293 microversion: 2.1 time: 0.255675 Oct 29 01:28:33.236138 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2535/5300] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:32 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1293 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:28:33.803165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5a41b48b-bc9d-42d8-a27b-4098e78dccba tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:33.804146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5a41b48b-bc9d-42d8-a27b-4098e78dccba tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: ba394c36-e5b5-4e80-bf8b-70aff3251fa2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:33.820291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a41b48b-bc9d-42d8-a27b-4098e78dccba tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:33.820827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a41b48b-bc9d-42d8-a27b-4098e78dccba tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:33.821257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a41b48b-bc9d-42d8-a27b-4098e78dccba tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:33.824974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a41b48b-bc9d-42d8-a27b-4098e78dccba tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:33.825765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a41b48b-bc9d-42d8-a27b-4098e78dccba tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:33.838014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a41b48b-bc9d-42d8-a27b-4098e78dccba tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:33.858411 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-5a41b48b-bc9d-42d8-a27b-4098e78dccba tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] HTTP exception thrown: Instance ba394c36-e5b5-4e80-bf8b-70aff3251fa2 could not be found. Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5a41b48b-bc9d-42d8-a27b-4098e78dccba tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Request method failure captured: Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/ba394c36-e5b5-4e80-bf8b-70aff3251fa2 HTTP/1.1 Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIFsyhhv14dNpFJOckZcFcOAhSnA6jyGFAAtHFgrWh6Ayfu-L0ysNf5Oeeyr_CfNdyLaAyen1teJ9SERptZSeRtw3-AWvD0tQ_J0efYzMdi8sLX97M4_vwgSNXmRAv5ah6Ui0_uEad9kiQz2XLSIpNnX_Ay-ksk3FMUsF5hstA025J8 Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: d77c806ec0e341a687910b98da07e148 Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ListServerFiltersTestJSON-688081980 Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d77c806ec0e341a687910b98da07e148"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d77c806ec0e341a687910b98da07e148"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d77c806ec0e341a687910b98da07e148"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d77c806ec0e341a687910b98da07e148", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ListServerFiltersTestJSON-688081980 Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: d77c806ec0e341a687910b98da07e148 Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-688081980 Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ListServerFiltersTestJSON-688081980-project Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 5e5a71f37f194b15a8da5fc14ffa3744 Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ListServerFiltersTestJSON-688081980-project Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance ba394c36-e5b5-4e80-bf8b-70aff3251fa2 could not be found. Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'ba394c36-e5b5-4e80-bf8b-70aff3251fa2'} Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba394c36-e5b5-4e80-bf8b-70aff3251fa2 could not be found. Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba394c36-e5b5-4e80-bf8b-70aff3251fa2 could not be found. Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:33.860109 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:33.864708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:33.864708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:33.864708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:33.864708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:28:33.864708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:28:33.864708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba394c36-e5b5-4e80-bf8b-70aff3251fa2 could not be found. Oct 29 01:28:33.864708 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:28:33.864708 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5a41b48b-bc9d-42d8-a27b-4098e78dccba tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Returning 404 to user: Instance ba394c36-e5b5-4e80-bf8b-70aff3251fa2 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:28:33.864708 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5a41b48b-bc9d-42d8-a27b-4098e78dccba tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/ba394c36-e5b5-4e80-bf8b-70aff3251fa2" status: 404 len: 111 microversion: 2.1 time: 0.062849 Oct 29 01:28:33.873535 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2536/5301] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:33 2022] GET /compute/v2.1/servers/ba394c36-e5b5-4e80-bf8b-70aff3251fa2 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:28:33.878571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cff0326e-f770-4a3c-81ae-6e7ff6ae6e9d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:33.879088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cff0326e-f770-4a3c-81ae-6e7ff6ae6e9d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 96e3896c-816b-4491-9877-82db9ab6dc51] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:33.889250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cff0326e-f770-4a3c-81ae-6e7ff6ae6e9d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:33.893309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cff0326e-f770-4a3c-81ae-6e7ff6ae6e9d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:33.893814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cff0326e-f770-4a3c-81ae-6e7ff6ae6e9d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:33.894689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cff0326e-f770-4a3c-81ae-6e7ff6ae6e9d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:33.895162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cff0326e-f770-4a3c-81ae-6e7ff6ae6e9d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:33.898258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cff0326e-f770-4a3c-81ae-6e7ff6ae6e9d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:33.968654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cff0326e-f770-4a3c-81ae-6e7ff6ae6e9d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 96e3896c-816b-4491-9877-82db9ab6dc51] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:28:34.470634 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cff0326e-f770-4a3c-81ae-6e7ff6ae6e9d tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "DELETE /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51" status: 204 len: 0 microversion: 2.1 time: 0.595680 Oct 29 01:28:34.472242 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2537/5302] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:28:33 2022] DELETE /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:28:34.478222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-24fea019-a65e-4f01-b625-0da6fcf5c048 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:34.479206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-24fea019-a65e-4f01-b625-0da6fcf5c048 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:34.495133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24fea019-a65e-4f01-b625-0da6fcf5c048 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:34.504973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24fea019-a65e-4f01-b625-0da6fcf5c048 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:34.505859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24fea019-a65e-4f01-b625-0da6fcf5c048 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:34.507077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24fea019-a65e-4f01-b625-0da6fcf5c048 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:34.508893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24fea019-a65e-4f01-b625-0da6fcf5c048 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:34.512451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24fea019-a65e-4f01-b625-0da6fcf5c048 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:34.687750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-24fea019-a65e-4f01-b625-0da6fcf5c048 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:34.717216 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-24fea019-a65e-4f01-b625-0da6fcf5c048 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1299 microversion: 2.1 time: 0.239705 Oct 29 01:28:34.735060 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2538/5303] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:34 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1299 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:34.757742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-47e6a9fb-35a6-4383-a3d7-b6fefcfd347e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:34.759826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-47e6a9fb-35a6-4383-a3d7-b6fefcfd347e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 96e3896c-816b-4491-9877-82db9ab6dc51] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:34.779213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47e6a9fb-35a6-4383-a3d7-b6fefcfd347e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:34.784103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47e6a9fb-35a6-4383-a3d7-b6fefcfd347e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:34.787994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47e6a9fb-35a6-4383-a3d7-b6fefcfd347e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:34.791116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47e6a9fb-35a6-4383-a3d7-b6fefcfd347e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:34.796001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47e6a9fb-35a6-4383-a3d7-b6fefcfd347e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:34.796725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47e6a9fb-35a6-4383-a3d7-b6fefcfd347e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:35.800047 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b68dd822-6d2b-4d60-9a58-362e6a4c9450 tempest-FloatingIPDetailsTestJSON-1989660966 tempest-FloatingIPDetailsTestJSON-1989660966-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/80aea910-a8f2-4f97-a538-4cecbc8e4130" status: 202 len: 0 microversion: 2.1 time: 3.657441 Oct 29 01:28:35.807012 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2766/5304] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 29 01:28:32 2022] DELETE /compute/v2.1/os-floating-ips/80aea910-a8f2-4f97-a538-4cecbc8e4130 => generated 0 bytes in 3665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:28:35.815982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b999e0e2-98b0-45c4-b3b4-a0aa3749c3bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:35.816858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b999e0e2-98b0-45c4-b3b4-a0aa3749c3bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:35.833701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b999e0e2-98b0-45c4-b3b4-a0aa3749c3bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:35.834572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b999e0e2-98b0-45c4-b3b4-a0aa3749c3bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:35.835451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b999e0e2-98b0-45c4-b3b4-a0aa3749c3bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:35.836482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b999e0e2-98b0-45c4-b3b4-a0aa3749c3bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:35.837218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b999e0e2-98b0-45c4-b3b4-a0aa3749c3bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:35.837882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b999e0e2-98b0-45c4-b3b4-a0aa3749c3bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:36.012733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b999e0e2-98b0-45c4-b3b4-a0aa3749c3bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:36.021377 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b999e0e2-98b0-45c4-b3b4-a0aa3749c3bf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1299 microversion: 2.1 time: 0.209652 Oct 29 01:28:36.026019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-47e6a9fb-35a6-4383-a3d7-b6fefcfd347e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:36.036733 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-47e6a9fb-35a6-4383-a3d7-b6fefcfd347e tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51" status: 200 len: 1517 microversion: 2.1 time: 1.296993 Oct 29 01:28:36.040843 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2767/5305] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:35 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1299 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:36.045780 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2539/5306] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:34 2022] GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51 => generated 1517 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:37.072189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d8407544-81ea-499e-aada-44e54eeeb1cb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:37.072741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-587ae29d-73c4-43bd-aae9-75674df32fe5 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:37.074787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d8407544-81ea-499e-aada-44e54eeeb1cb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:37.075390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-587ae29d-73c4-43bd-aae9-75674df32fe5 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 96e3896c-816b-4491-9877-82db9ab6dc51] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:37.094065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8407544-81ea-499e-aada-44e54eeeb1cb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:37.094595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8407544-81ea-499e-aada-44e54eeeb1cb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:37.096033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8407544-81ea-499e-aada-44e54eeeb1cb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:37.096977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8407544-81ea-499e-aada-44e54eeeb1cb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:37.097478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8407544-81ea-499e-aada-44e54eeeb1cb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:37.098118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8407544-81ea-499e-aada-44e54eeeb1cb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:37.118639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-587ae29d-73c4-43bd-aae9-75674df32fe5 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:37.119319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-587ae29d-73c4-43bd-aae9-75674df32fe5 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:37.124902 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-587ae29d-73c4-43bd-aae9-75674df32fe5 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:37.126992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-587ae29d-73c4-43bd-aae9-75674df32fe5 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:37.127491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-587ae29d-73c4-43bd-aae9-75674df32fe5 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:37.131144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-587ae29d-73c4-43bd-aae9-75674df32fe5 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:37.422927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d8407544-81ea-499e-aada-44e54eeeb1cb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:37.436919 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d8407544-81ea-499e-aada-44e54eeeb1cb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1299 microversion: 2.1 time: 0.377555 Oct 29 01:28:37.455407 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2768/5307] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:37 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1299 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:37.857824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-587ae29d-73c4-43bd-aae9-75674df32fe5 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:37.865820 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-587ae29d-73c4-43bd-aae9-75674df32fe5 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51" status: 200 len: 1517 microversion: 2.1 time: 0.797661 Oct 29 01:28:37.866408 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2540/5308] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:37 2022] GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51 => generated 1517 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:38.466374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9bd777fd-a46a-42e8-a506-5c97e0dcc8b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:38.468494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9bd777fd-a46a-42e8-a506-5c97e0dcc8b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:38.478377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bd777fd-a46a-42e8-a506-5c97e0dcc8b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:38.479963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bd777fd-a46a-42e8-a506-5c97e0dcc8b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:38.482150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bd777fd-a46a-42e8-a506-5c97e0dcc8b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:38.483124 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bd777fd-a46a-42e8-a506-5c97e0dcc8b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:38.483762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bd777fd-a46a-42e8-a506-5c97e0dcc8b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:38.484547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bd777fd-a46a-42e8-a506-5c97e0dcc8b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:38.895115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3a04b1de-67a5-405f-9cb8-69d6de80823c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:38.895741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3a04b1de-67a5-405f-9cb8-69d6de80823c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 96e3896c-816b-4491-9877-82db9ab6dc51] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:38.920323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a04b1de-67a5-405f-9cb8-69d6de80823c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:38.921273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a04b1de-67a5-405f-9cb8-69d6de80823c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:38.922006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a04b1de-67a5-405f-9cb8-69d6de80823c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:38.923006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a04b1de-67a5-405f-9cb8-69d6de80823c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:38.923707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a04b1de-67a5-405f-9cb8-69d6de80823c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:38.924426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a04b1de-67a5-405f-9cb8-69d6de80823c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:39.181015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9bd777fd-a46a-42e8-a506-5c97e0dcc8b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:39.196599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3a04b1de-67a5-405f-9cb8-69d6de80823c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a71f37f194b15a8da5fc14ffa3744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77c806ec0e341a687910b98da07e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:39.198182 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9bd777fd-a46a-42e8-a506-5c97e0dcc8b9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1367 microversion: 2.1 time: 0.740933 Oct 29 01:28:39.198785 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2769/5309] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:38 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1367 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:39.204077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-7f83d234-7f4c-48f6-8553-ebf24ec9a80d req-8d143115-14e5-4ccb-aa18-51f98eeaf402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e3896c-816b-4491-9877-82db9ab6dc51", "name": "network-vif-deleted", "tag": "b6f400d0-de45-40c0-a308-0962cc5a2ffe"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:39.227313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7f83d234-7f4c-48f6-8553-ebf24ec9a80d req-8d143115-14e5-4ccb-aa18-51f98eeaf402 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:39.227807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7f83d234-7f4c-48f6-8553-ebf24ec9a80d req-8d143115-14e5-4ccb-aa18-51f98eeaf402 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:39.228243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7f83d234-7f4c-48f6-8553-ebf24ec9a80d req-8d143115-14e5-4ccb-aa18-51f98eeaf402 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:39.232128 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3a04b1de-67a5-405f-9cb8-69d6de80823c tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51" status: 200 len: 1475 microversion: 2.1 time: 0.333775 Oct 29 01:28:39.234429 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2541/5310] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:38 2022] GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51 => generated 1475 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:39.254528 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-7f83d234-7f4c-48f6-8553-ebf24ec9a80d req-8d143115-14e5-4ccb-aa18-51f98eeaf402 service nova] Creating event network-vif-deleted:b6f400d0-de45-40c0-a308-0962cc5a2ffe for instance 96e3896c-816b-4491-9877-82db9ab6dc51 on n-h2-862964-3 Oct 29 01:28:39.270144 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-7f83d234-7f4c-48f6-8553-ebf24ec9a80d req-8d143115-14e5-4ccb-aa18-51f98eeaf402 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069308 Oct 29 01:28:39.270764 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2770/5311] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:40.229315 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-95dd9b59-ea4c-49b3-ad73-e0db1f674dfa tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:40.230383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-95dd9b59-ea4c-49b3-ad73-e0db1f674dfa tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:40.257125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-69ecbb78-c66f-402d-a18d-4ed17ba10764 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:40.257642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95dd9b59-ea4c-49b3-ad73-e0db1f674dfa tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:40.258786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-69ecbb78-c66f-402d-a18d-4ed17ba10764 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] [instance: 96e3896c-816b-4491-9877-82db9ab6dc51] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:40.259041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95dd9b59-ea4c-49b3-ad73-e0db1f674dfa tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:40.260328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95dd9b59-ea4c-49b3-ad73-e0db1f674dfa tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:40.262402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95dd9b59-ea4c-49b3-ad73-e0db1f674dfa tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:40.262634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:40.264337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95dd9b59-ea4c-49b3-ad73-e0db1f674dfa tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:40.267075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95dd9b59-ea4c-49b3-ad73-e0db1f674dfa tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:40.275091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69ecbb78-c66f-402d-a18d-4ed17ba10764 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:40.275573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69ecbb78-c66f-402d-a18d-4ed17ba10764 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:40.278101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69ecbb78-c66f-402d-a18d-4ed17ba10764 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:40.279172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69ecbb78-c66f-402d-a18d-4ed17ba10764 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:40.279816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69ecbb78-c66f-402d-a18d-4ed17ba10764 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:40.285845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-69ecbb78-c66f-402d-a18d-4ed17ba10764 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:40.317676 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-69ecbb78-c66f-402d-a18d-4ed17ba10764 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] HTTP exception thrown: Instance 96e3896c-816b-4491-9877-82db9ab6dc51 could not be found. Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-69ecbb78-c66f-402d-a18d-4ed17ba10764 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Request method failure captured: Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51 HTTP/1.1 Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIFsyhhv14dNpFJOckZcFcOAhSnA6jyGFAAtHFgrWh6Ayfu-L0ysNf5Oeeyr_CfNdyLaAyen1teJ9SERptZSeRtw3-AWvD0tQ_J0efYzMdi8sLX97M4_vwgSNXmRAv5ah6Ui0_uEad9kiQz2XLSIpNnX_Ay-ksk3FMUsF5hstA025J8 Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: d77c806ec0e341a687910b98da07e148 Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ListServerFiltersTestJSON-688081980 Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d77c806ec0e341a687910b98da07e148"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d77c806ec0e341a687910b98da07e148"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d77c806ec0e341a687910b98da07e148"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d77c806ec0e341a687910b98da07e148", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ListServerFiltersTestJSON-688081980 Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: d77c806ec0e341a687910b98da07e148 Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-688081980 Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ListServerFiltersTestJSON-688081980-project Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 5e5a71f37f194b15a8da5fc14ffa3744 Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ListServerFiltersTestJSON-688081980-project Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 96e3896c-816b-4491-9877-82db9ab6dc51 could not be found. Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '96e3896c-816b-4491-9877-82db9ab6dc51'} Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96e3896c-816b-4491-9877-82db9ab6dc51 could not be found. Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96e3896c-816b-4491-9877-82db9ab6dc51 could not be found. Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:28:40.321371 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:40.326972 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:28:40.326972 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:28:40.326972 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:28:40.326972 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:28:40.326972 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:28:40.326972 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96e3896c-816b-4491-9877-82db9ab6dc51 could not be found. Oct 29 01:28:40.326972 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:28:40.332049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-69ecbb78-c66f-402d-a18d-4ed17ba10764 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] Returning 404 to user: Instance 96e3896c-816b-4491-9877-82db9ab6dc51 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:28:40.338943 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-69ecbb78-c66f-402d-a18d-4ed17ba10764 tempest-ListServerFiltersTestJSON-688081980 tempest-ListServerFiltersTestJSON-688081980-project] 10.222.0.26 "GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51" status: 404 len: 111 microversion: 2.1 time: 0.080919 Oct 29 01:28:40.338943 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2771/5312] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:40 2022] GET /compute/v2.1/servers/96e3896c-816b-4491-9877-82db9ab6dc51 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:28:41.607710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-95dd9b59-ea4c-49b3-ad73-e0db1f674dfa tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:41.632853 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-95dd9b59-ea4c-49b3-ad73-e0db1f674dfa tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1367 microversion: 2.1 time: 1.409327 Oct 29 01:28:41.640662 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2542/5313] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:40 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1367 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:42.678611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7aaa0b2f-4d5a-447e-a302-dfee483734e8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:42.678611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7aaa0b2f-4d5a-447e-a302-dfee483734e8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:42.680027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=14 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:42.687943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7aaa0b2f-4d5a-447e-a302-dfee483734e8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:42.688463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7aaa0b2f-4d5a-447e-a302-dfee483734e8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:42.688927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7aaa0b2f-4d5a-447e-a302-dfee483734e8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:42.689769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7aaa0b2f-4d5a-447e-a302-dfee483734e8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:42.690417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7aaa0b2f-4d5a-447e-a302-dfee483734e8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:42.690843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7aaa0b2f-4d5a-447e-a302-dfee483734e8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:42.978281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7aaa0b2f-4d5a-447e-a302-dfee483734e8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:42.989808 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7aaa0b2f-4d5a-447e-a302-dfee483734e8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1367 microversion: 2.1 time: 0.320455 Oct 29 01:28:42.994049 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2772/5314] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:42 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:43.017308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-88b3a702-eaab-4591-8161-e9a9860605dd req-02a5792f-c501-4b2a-bdd4-a69dcd2df85d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c303716-1880-4adb-b972-3bc6e24ba1cc", "tag": "1fc7ef2d-5f81-4fa5-bffb-8c74fba80b4c"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:43.030910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-88b3a702-eaab-4591-8161-e9a9860605dd req-02a5792f-c501-4b2a-bdd4-a69dcd2df85d service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:43.031546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-88b3a702-eaab-4591-8161-e9a9860605dd req-02a5792f-c501-4b2a-bdd4-a69dcd2df85d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:43.031920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-88b3a702-eaab-4591-8161-e9a9860605dd req-02a5792f-c501-4b2a-bdd4-a69dcd2df85d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:43.060313 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-88b3a702-eaab-4591-8161-e9a9860605dd req-02a5792f-c501-4b2a-bdd4-a69dcd2df85d service nova] Creating event network-changed:1fc7ef2d-5f81-4fa5-bffb-8c74fba80b4c for instance 1c303716-1880-4adb-b972-3bc6e24ba1cc on n-h1-862964-3 Oct 29 01:28:43.086654 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-88b3a702-eaab-4591-8161-e9a9860605dd req-02a5792f-c501-4b2a-bdd4-a69dcd2df85d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067097 Oct 29 01:28:43.088609 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2543/5315] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:44.022929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7d5d656a-5259-4215-9946-42f57adae0f7 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:44.023572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7d5d656a-5259-4215-9946-42f57adae0f7 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:44.042550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d5d656a-5259-4215-9946-42f57adae0f7 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:44.051431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d5d656a-5259-4215-9946-42f57adae0f7 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:44.051997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d5d656a-5259-4215-9946-42f57adae0f7 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:44.055747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d5d656a-5259-4215-9946-42f57adae0f7 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:44.067531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d5d656a-5259-4215-9946-42f57adae0f7 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:44.068012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d5d656a-5259-4215-9946-42f57adae0f7 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:44.424583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7d5d656a-5259-4215-9946-42f57adae0f7 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:44.436274 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7d5d656a-5259-4215-9946-42f57adae0f7 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1367 microversion: 2.1 time: 0.421323 Oct 29 01:28:44.445321 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2773/5316] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:44 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1367 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:45.466012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-abe55664-4f27-4cf5-b8ee-fce3734bc948 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:45.466970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-abe55664-4f27-4cf5-b8ee-fce3734bc948 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:45.473601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abe55664-4f27-4cf5-b8ee-fce3734bc948 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:45.474083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abe55664-4f27-4cf5-b8ee-fce3734bc948 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:45.474523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abe55664-4f27-4cf5-b8ee-fce3734bc948 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:45.475427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abe55664-4f27-4cf5-b8ee-fce3734bc948 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:45.476063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abe55664-4f27-4cf5-b8ee-fce3734bc948 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:45.476670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abe55664-4f27-4cf5-b8ee-fce3734bc948 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:45.933992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-abe55664-4f27-4cf5-b8ee-fce3734bc948 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:45.960589 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-abe55664-4f27-4cf5-b8ee-fce3734bc948 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1367 microversion: 2.1 time: 0.496251 Oct 29 01:28:45.982042 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2544/5317] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:45 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1367 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:46.984544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-de58a68f-5c31-4fc5-8619-bf84d1e89e9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:46.985187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-de58a68f-5c31-4fc5-8619-bf84d1e89e9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:46.996623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de58a68f-5c31-4fc5-8619-bf84d1e89e9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:46.997122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de58a68f-5c31-4fc5-8619-bf84d1e89e9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:46.997587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de58a68f-5c31-4fc5-8619-bf84d1e89e9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:46.998321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de58a68f-5c31-4fc5-8619-bf84d1e89e9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:46.998768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de58a68f-5c31-4fc5-8619-bf84d1e89e9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:46.999197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de58a68f-5c31-4fc5-8619-bf84d1e89e9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:47.583477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-de58a68f-5c31-4fc5-8619-bf84d1e89e9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:47.591957 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-de58a68f-5c31-4fc5-8619-bf84d1e89e9c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1367 microversion: 2.1 time: 0.612085 Oct 29 01:28:47.610897 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2774/5318] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:46 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1367 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:48.618130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-acc2bfc3-39eb-444a-a6b6-9721b1fc220e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:48.618943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-acc2bfc3-39eb-444a-a6b6-9721b1fc220e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:48.641621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-acc2bfc3-39eb-444a-a6b6-9721b1fc220e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:48.647281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-acc2bfc3-39eb-444a-a6b6-9721b1fc220e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:48.647281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-acc2bfc3-39eb-444a-a6b6-9721b1fc220e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:48.647281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-acc2bfc3-39eb-444a-a6b6-9721b1fc220e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:48.647281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-acc2bfc3-39eb-444a-a6b6-9721b1fc220e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:48.647281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-acc2bfc3-39eb-444a-a6b6-9721b1fc220e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:48.954011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-acc2bfc3-39eb-444a-a6b6-9721b1fc220e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:48.963487 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-acc2bfc3-39eb-444a-a6b6-9721b1fc220e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1367 microversion: 2.1 time: 0.351476 Oct 29 01:28:48.966704 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2545/5319] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:48 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:49.458151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b9c0aa44-f3db-4053-a046-d3da89a6048a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1117071504", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": "none"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:49.473258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:49.536234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b9c0aa44-f3db-4053-a046-d3da89a6048a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:28:49.536777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b9c0aa44-f3db-4053-a046-d3da89a6048a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:28:49.537484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b9c0aa44-f3db-4053-a046-d3da89a6048a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:28:49.538862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b9c0aa44-f3db-4053-a046-d3da89a6048a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:28:49.539475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b9c0aa44-f3db-4053-a046-d3da89a6048a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:28:49.555115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9c0aa44-f3db-4053-a046-d3da89a6048a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:49.555819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9c0aa44-f3db-4053-a046-d3da89a6048a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:49.556427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9c0aa44-f3db-4053-a046-d3da89a6048a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:49.557374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9c0aa44-f3db-4053-a046-d3da89a6048a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:49.559126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9c0aa44-f3db-4053-a046-d3da89a6048a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:49.560265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9c0aa44-f3db-4053-a046-d3da89a6048a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:49.587340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b9c0aa44-f3db-4053-a046-d3da89a6048a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Getting quotas for project 1b14c66b575a4b95b1c85a0073e553b9. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:28:49.595922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b9c0aa44-f3db-4053-a046-d3da89a6048a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Getting quotas for user 5c0cda7d648946818a9090e194b2d427 and project 1b14c66b575a4b95b1c85a0073e553b9. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:28:49.615409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b9c0aa44-f3db-4053-a046-d3da89a6048a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:28:49.618828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b9c0aa44-f3db-4053-a046-d3da89a6048a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:28:49.765189 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b9c0aa44-f3db-4053-a046-d3da89a6048a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.030691 Oct 29 01:28:49.765885 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2775/5320] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 29 01:28:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 01:28:49.784576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-761fad01-4b5b-48f9-9891-827a42e0e92d tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:49.787881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-761fad01-4b5b-48f9-9891-827a42e0e92d tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:49.858357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e4b3de06-aefa-4788-b542-7de987938706 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-741894791", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": "none"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:49.960048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e4b3de06-aefa-4788-b542-7de987938706 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:28:49.960048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e4b3de06-aefa-4788-b542-7de987938706 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:28:49.960048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e4b3de06-aefa-4788-b542-7de987938706 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:28:49.960048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e4b3de06-aefa-4788-b542-7de987938706 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:28:49.960048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-e4b3de06-aefa-4788-b542-7de987938706 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:28:49.975258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4b3de06-aefa-4788-b542-7de987938706 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:49.975952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4b3de06-aefa-4788-b542-7de987938706 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:49.976589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4b3de06-aefa-4788-b542-7de987938706 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:49.977843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4b3de06-aefa-4788-b542-7de987938706 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:49.978507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4b3de06-aefa-4788-b542-7de987938706 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:49.979129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4b3de06-aefa-4788-b542-7de987938706 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:50.005264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-e4b3de06-aefa-4788-b542-7de987938706 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Getting quotas for project cea3789cff8b420584d2f6899c6a4dd8. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:28:50.014126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-761fad01-4b5b-48f9-9891-827a42e0e92d tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:50.037082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-761fad01-4b5b-48f9-9891-827a42e0e92d tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:50.038968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-761fad01-4b5b-48f9-9891-827a42e0e92d tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:50.040504 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-761fad01-4b5b-48f9-9891-827a42e0e92d tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1278 microversion: 2.54 time: 0.266925 Oct 29 01:28:50.041718 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2776/5321] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:28:49 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1278 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:28:50.051384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-e4b3de06-aefa-4788-b542-7de987938706 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Getting quotas for user 10d9a6dc73f142a899ca27b98bf25056 and project cea3789cff8b420584d2f6899c6a4dd8. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:28:50.082657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e4b3de06-aefa-4788-b542-7de987938706 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:28:50.087644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e4b3de06-aefa-4788-b542-7de987938706 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:28:50.257646 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e4b3de06-aefa-4788-b542-7de987938706 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.601483 Oct 29 01:28:50.258397 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2546/5322] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 29 01:28:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 29 01:28:50.280442 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a8d18179-a059-4a52-a528-2c1839abc091 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:50.280442 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a8d18179-a059-4a52-a528-2c1839abc091 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:50.508526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a8d18179-a059-4a52-a528-2c1839abc091 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:50.517861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a8d18179-a059-4a52-a528-2c1839abc091 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:50.528691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a8d18179-a059-4a52-a528-2c1839abc091 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:50.536437 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a8d18179-a059-4a52-a528-2c1839abc091 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e" status: 200 len: 1280 microversion: 2.47 time: 0.266201 Oct 29 01:28:50.537064 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2547/5323] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:28:50 2022] GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e => generated 1280 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:28:50.723901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4bfd69e2-8e2b-4938-ac81-17c23b7b6613 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:50.725382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4bfd69e2-8e2b-4938-ac81-17c23b7b6613 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:50.731961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bfd69e2-8e2b-4938-ac81-17c23b7b6613 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:50.738233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bfd69e2-8e2b-4938-ac81-17c23b7b6613 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:50.738669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bfd69e2-8e2b-4938-ac81-17c23b7b6613 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:50.742495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bfd69e2-8e2b-4938-ac81-17c23b7b6613 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:50.743053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bfd69e2-8e2b-4938-ac81-17c23b7b6613 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:50.743563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bfd69e2-8e2b-4938-ac81-17c23b7b6613 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:51.072847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-819e1fed-4c39-4c8f-a528-b70b07e15683 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:51.073556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-819e1fed-4c39-4c8f-a528-b70b07e15683 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:51.129412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4bfd69e2-8e2b-4938-ac81-17c23b7b6613 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:51.144879 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4bfd69e2-8e2b-4938-ac81-17c23b7b6613 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1367 microversion: 2.1 time: 1.100325 Oct 29 01:28:51.146101 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2777/5324] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:50 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1367 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:51.154260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-b7038b2c-c581-4968-b91c-e9bb34929aac req-5195966b-4b98-4a1f-899e-1671d1ff0048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c303716-1880-4adb-b972-3bc6e24ba1cc", "name": "network-vif-plugged", "status": "completed", "tag": "1fc7ef2d-5f81-4fa5-bffb-8c74fba80b4c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:51.170983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b7038b2c-c581-4968-b91c-e9bb34929aac req-5195966b-4b98-4a1f-899e-1671d1ff0048 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:51.172433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b7038b2c-c581-4968-b91c-e9bb34929aac req-5195966b-4b98-4a1f-899e-1671d1ff0048 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:51.173069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b7038b2c-c581-4968-b91c-e9bb34929aac req-5195966b-4b98-4a1f-899e-1671d1ff0048 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:51.233017 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-b7038b2c-c581-4968-b91c-e9bb34929aac req-5195966b-4b98-4a1f-899e-1671d1ff0048 service nova] Creating event network-vif-plugged:1fc7ef2d-5f81-4fa5-bffb-8c74fba80b4c for instance 1c303716-1880-4adb-b972-3bc6e24ba1cc on n-h1-862964-3 Oct 29 01:28:51.253636 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-b7038b2c-c581-4968-b91c-e9bb34929aac req-5195966b-4b98-4a1f-899e-1671d1ff0048 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103812 Oct 29 01:28:51.256612 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2778/5325] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:51.283933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-819e1fed-4c39-4c8f-a528-b70b07e15683 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:51.319251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-819e1fed-4c39-4c8f-a528-b70b07e15683 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:51.319251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-819e1fed-4c39-4c8f-a528-b70b07e15683 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:51.319251 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-819e1fed-4c39-4c8f-a528-b70b07e15683 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1278 microversion: 2.54 time: 0.247421 Oct 29 01:28:51.319611 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2548/5326] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:28:51 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1278 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:28:51.574651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-da3733d7-2460-4bcd-b644-61deb5a32696 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:51.575445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-da3733d7-2460-4bcd-b644-61deb5a32696 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:51.709049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-da3733d7-2460-4bcd-b644-61deb5a32696 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:51.717790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-da3733d7-2460-4bcd-b644-61deb5a32696 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:51.724294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-da3733d7-2460-4bcd-b644-61deb5a32696 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:51.726402 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-da3733d7-2460-4bcd-b644-61deb5a32696 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e" status: 200 len: 1280 microversion: 2.47 time: 0.158824 Oct 29 01:28:51.731756 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2779/5327] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:28:51 2022] GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e => generated 1280 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:28:52.173110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f04497ed-8547-4fad-8b49-a8126ba59ecf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:52.180395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f04497ed-8547-4fad-8b49-a8126ba59ecf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:52.191351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=75,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:52.233585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f04497ed-8547-4fad-8b49-a8126ba59ecf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:52.233585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f04497ed-8547-4fad-8b49-a8126ba59ecf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:52.233585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f04497ed-8547-4fad-8b49-a8126ba59ecf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:52.235194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f04497ed-8547-4fad-8b49-a8126ba59ecf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:52.235925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f04497ed-8547-4fad-8b49-a8126ba59ecf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:52.237399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f04497ed-8547-4fad-8b49-a8126ba59ecf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:52.351913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e78e4603-3e94-4801-8bec-b094e3dcd5c6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:52.357381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e78e4603-3e94-4801-8bec-b094e3dcd5c6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:52.384728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e78e4603-3e94-4801-8bec-b094e3dcd5c6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:52.384728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e78e4603-3e94-4801-8bec-b094e3dcd5c6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:52.384728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e78e4603-3e94-4801-8bec-b094e3dcd5c6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:52.386817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e78e4603-3e94-4801-8bec-b094e3dcd5c6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:52.389451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e78e4603-3e94-4801-8bec-b094e3dcd5c6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:52.394133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e78e4603-3e94-4801-8bec-b094e3dcd5c6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:52.680511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e78e4603-3e94-4801-8bec-b094e3dcd5c6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:52.692225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f04497ed-8547-4fad-8b49-a8126ba59ecf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:52.709279 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f04497ed-8547-4fad-8b49-a8126ba59ecf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1367 microversion: 2.1 time: 0.539835 Oct 29 01:28:52.709881 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2549/5328] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:52 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1367 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:52.713407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e78e4603-3e94-4801-8bec-b094e3dcd5c6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:52.714266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e78e4603-3e94-4801-8bec-b094e3dcd5c6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:52.720229 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e78e4603-3e94-4801-8bec-b094e3dcd5c6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1274 microversion: 2.54 time: 0.376956 Oct 29 01:28:52.725609 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2780/5329] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:28:52 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1274 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:28:52.765682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-44acb083-631e-4e1d-b385-a763ca8f2e50 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:52.766071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-44acb083-631e-4e1d-b385-a763ca8f2e50 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:52.797925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44acb083-631e-4e1d-b385-a763ca8f2e50 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:52.798429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44acb083-631e-4e1d-b385-a763ca8f2e50 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:52.798872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44acb083-631e-4e1d-b385-a763ca8f2e50 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:52.799638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44acb083-631e-4e1d-b385-a763ca8f2e50 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:52.800133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44acb083-631e-4e1d-b385-a763ca8f2e50 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:52.800585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44acb083-631e-4e1d-b385-a763ca8f2e50 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:52.819712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:52.971542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-44acb083-631e-4e1d-b385-a763ca8f2e50 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:52.986402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-44acb083-631e-4e1d-b385-a763ca8f2e50 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:52.988279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-44acb083-631e-4e1d-b385-a763ca8f2e50 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:52.995304 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-44acb083-631e-4e1d-b385-a763ca8f2e50 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e" status: 200 len: 1276 microversion: 2.47 time: 0.232524 Oct 29 01:28:52.996630 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2550/5330] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:28:52 2022] GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e => generated 1276 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:28:53.757880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-86637ed7-a649-4347-8f68-d83758a037d4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:53.758517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-86637ed7-a649-4347-8f68-d83758a037d4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:53.760888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7d0f9fcc-993e-4784-bfc4-ecd635ae88cf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:53.761819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7d0f9fcc-993e-4784-bfc4-ecd635ae88cf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:53.776151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86637ed7-a649-4347-8f68-d83758a037d4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:53.776682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86637ed7-a649-4347-8f68-d83758a037d4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:53.777744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86637ed7-a649-4347-8f68-d83758a037d4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:53.778472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86637ed7-a649-4347-8f68-d83758a037d4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:53.779852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86637ed7-a649-4347-8f68-d83758a037d4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:53.779852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86637ed7-a649-4347-8f68-d83758a037d4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:53.788063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d0f9fcc-993e-4784-bfc4-ecd635ae88cf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:53.788063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d0f9fcc-993e-4784-bfc4-ecd635ae88cf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:53.788063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d0f9fcc-993e-4784-bfc4-ecd635ae88cf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:53.788063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d0f9fcc-993e-4784-bfc4-ecd635ae88cf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:53.788063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d0f9fcc-993e-4784-bfc4-ecd635ae88cf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:53.788063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d0f9fcc-993e-4784-bfc4-ecd635ae88cf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:53.954709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-86637ed7-a649-4347-8f68-d83758a037d4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:53.966780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-86637ed7-a649-4347-8f68-d83758a037d4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:53.968329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-86637ed7-a649-4347-8f68-d83758a037d4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:53.972549 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-86637ed7-a649-4347-8f68-d83758a037d4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1338 microversion: 2.54 time: 0.218357 Oct 29 01:28:53.974770 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2551/5331] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:28:53 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1338 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:28:54.031355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c76bfb3a-288d-4389-a6c4-d053ef7a81b1 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:54.032455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c76bfb3a-288d-4389-a6c4-d053ef7a81b1 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:54.055995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c76bfb3a-288d-4389-a6c4-d053ef7a81b1 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:54.056820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c76bfb3a-288d-4389-a6c4-d053ef7a81b1 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:54.067883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c76bfb3a-288d-4389-a6c4-d053ef7a81b1 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:54.072299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c76bfb3a-288d-4389-a6c4-d053ef7a81b1 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:54.078276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c76bfb3a-288d-4389-a6c4-d053ef7a81b1 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:54.079089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c76bfb3a-288d-4389-a6c4-d053ef7a81b1 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:54.311230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c76bfb3a-288d-4389-a6c4-d053ef7a81b1 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:54.323161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c76bfb3a-288d-4389-a6c4-d053ef7a81b1 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:54.325869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c76bfb3a-288d-4389-a6c4-d053ef7a81b1 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:54.327148 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c76bfb3a-288d-4389-a6c4-d053ef7a81b1 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e" status: 200 len: 1332 microversion: 2.47 time: 0.300691 Oct 29 01:28:54.327982 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2552/5332] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:28:54 2022] GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e => generated 1332 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:28:54.393034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7d0f9fcc-993e-4784-bfc4-ecd635ae88cf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:54.403114 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7d0f9fcc-993e-4784-bfc4-ecd635ae88cf tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1367 microversion: 2.1 time: 0.657579 Oct 29 01:28:54.406114 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2781/5333] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:53 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1367 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:55.007832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aa7464c1-d458-4e92-bac9-65345fec9b52 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:55.008568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aa7464c1-d458-4e92-bac9-65345fec9b52 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:55.018409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa7464c1-d458-4e92-bac9-65345fec9b52 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:55.022868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa7464c1-d458-4e92-bac9-65345fec9b52 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:55.022868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa7464c1-d458-4e92-bac9-65345fec9b52 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:55.022868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa7464c1-d458-4e92-bac9-65345fec9b52 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:55.022868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa7464c1-d458-4e92-bac9-65345fec9b52 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:55.022868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa7464c1-d458-4e92-bac9-65345fec9b52 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:55.150298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aa7464c1-d458-4e92-bac9-65345fec9b52 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:55.163413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aa7464c1-d458-4e92-bac9-65345fec9b52 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:55.167211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aa7464c1-d458-4e92-bac9-65345fec9b52 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:55.175826 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aa7464c1-d458-4e92-bac9-65345fec9b52 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1336 microversion: 2.54 time: 0.171702 Oct 29 01:28:55.190140 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2553/5334] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:28:55 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1336 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:28:55.359136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ea54dd7a-e864-43ae-8b1e-2c57dedff1cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:55.360753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ea54dd7a-e864-43ae-8b1e-2c57dedff1cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:55.372483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea54dd7a-e864-43ae-8b1e-2c57dedff1cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:55.373736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea54dd7a-e864-43ae-8b1e-2c57dedff1cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:55.374544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea54dd7a-e864-43ae-8b1e-2c57dedff1cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:55.375980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea54dd7a-e864-43ae-8b1e-2c57dedff1cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:55.377536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea54dd7a-e864-43ae-8b1e-2c57dedff1cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:55.378469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea54dd7a-e864-43ae-8b1e-2c57dedff1cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:55.433553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aea6f76a-a80b-4e29-b5ec-f2e1184c65ed tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:55.435706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aea6f76a-a80b-4e29-b5ec-f2e1184c65ed tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:55.447669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aea6f76a-a80b-4e29-b5ec-f2e1184c65ed tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:55.451856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aea6f76a-a80b-4e29-b5ec-f2e1184c65ed tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:55.452561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aea6f76a-a80b-4e29-b5ec-f2e1184c65ed tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:55.453599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aea6f76a-a80b-4e29-b5ec-f2e1184c65ed tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:55.454279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aea6f76a-a80b-4e29-b5ec-f2e1184c65ed tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:55.454935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aea6f76a-a80b-4e29-b5ec-f2e1184c65ed tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:55.535862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ea54dd7a-e864-43ae-8b1e-2c57dedff1cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:55.547281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ea54dd7a-e864-43ae-8b1e-2c57dedff1cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:55.548964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ea54dd7a-e864-43ae-8b1e-2c57dedff1cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:55.550342 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ea54dd7a-e864-43ae-8b1e-2c57dedff1cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e" status: 200 len: 1338 microversion: 2.47 time: 0.199588 Oct 29 01:28:55.563411 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2782/5335] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:28:55 2022] GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e => generated 1338 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:28:55.653489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aea6f76a-a80b-4e29-b5ec-f2e1184c65ed tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:55.661656 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aea6f76a-a80b-4e29-b5ec-f2e1184c65ed tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1557 microversion: 2.1 time: 0.235509 Oct 29 01:28:55.662510 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2554/5336] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:28:55 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1557 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:28:55.688132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-719620ff-4c5c-4ead-8412-50f1925bc841 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:55.688926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-719620ff-4c5c-4ead-8412-50f1925bc841 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:55.719160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-719620ff-4c5c-4ead-8412-50f1925bc841 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:55.719774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-719620ff-4c5c-4ead-8412-50f1925bc841 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:55.720283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-719620ff-4c5c-4ead-8412-50f1925bc841 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:55.721272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-719620ff-4c5c-4ead-8412-50f1925bc841 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:55.721808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-719620ff-4c5c-4ead-8412-50f1925bc841 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:55.722344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-719620ff-4c5c-4ead-8412-50f1925bc841 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:55.876912 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-719620ff-4c5c-4ead-8412-50f1925bc841 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.192769 Oct 29 01:28:55.880321 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2783/5337] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:28:55 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-interface => generated 284 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:56.213903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ef76b697-8ec6-4ca3-aeb1-3eba37a3e3b1 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:56.215454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ef76b697-8ec6-4ca3-aeb1-3eba37a3e3b1 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:56.223220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef76b697-8ec6-4ca3-aeb1-3eba37a3e3b1 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:56.223704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef76b697-8ec6-4ca3-aeb1-3eba37a3e3b1 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:56.224352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef76b697-8ec6-4ca3-aeb1-3eba37a3e3b1 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:56.233586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef76b697-8ec6-4ca3-aeb1-3eba37a3e3b1 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:56.234431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef76b697-8ec6-4ca3-aeb1-3eba37a3e3b1 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:56.239555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef76b697-8ec6-4ca3-aeb1-3eba37a3e3b1 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:56.346932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ef76b697-8ec6-4ca3-aeb1-3eba37a3e3b1 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:56.370766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ef76b697-8ec6-4ca3-aeb1-3eba37a3e3b1 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:56.373478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ef76b697-8ec6-4ca3-aeb1-3eba37a3e3b1 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:56.374986 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ef76b697-8ec6-4ca3-aeb1-3eba37a3e3b1 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1336 microversion: 2.54 time: 0.166885 Oct 29 01:28:56.376224 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2555/5338] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:28:56 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1336 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:28:56.581063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d25c5927-4284-48e2-86ca-6072d0878286 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:56.582303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d25c5927-4284-48e2-86ca-6072d0878286 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:56.593991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d25c5927-4284-48e2-86ca-6072d0878286 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:56.594489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d25c5927-4284-48e2-86ca-6072d0878286 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:56.598381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d25c5927-4284-48e2-86ca-6072d0878286 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:56.599158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d25c5927-4284-48e2-86ca-6072d0878286 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:56.599634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d25c5927-4284-48e2-86ca-6072d0878286 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:56.600072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d25c5927-4284-48e2-86ca-6072d0878286 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:57.348367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d25c5927-4284-48e2-86ca-6072d0878286 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:57.377983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d25c5927-4284-48e2-86ca-6072d0878286 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:57.383863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d25c5927-4284-48e2-86ca-6072d0878286 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:57.385383 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d25c5927-4284-48e2-86ca-6072d0878286 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e" status: 200 len: 1338 microversion: 2.47 time: 0.809314 Oct 29 01:28:57.407619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fec1e1bb-1558-4e4a-89cf-8af74c933193 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:57.408173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fec1e1bb-1558-4e4a-89cf-8af74c933193 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:57.409409 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2784/5339] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:28:56 2022] GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e => generated 1338 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:28:57.428744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fec1e1bb-1558-4e4a-89cf-8af74c933193 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:57.429311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fec1e1bb-1558-4e4a-89cf-8af74c933193 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:57.429755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fec1e1bb-1558-4e4a-89cf-8af74c933193 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:57.430467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fec1e1bb-1558-4e4a-89cf-8af74c933193 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:57.430927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fec1e1bb-1558-4e4a-89cf-8af74c933193 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:57.431355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fec1e1bb-1558-4e4a-89cf-8af74c933193 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:57.686150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fec1e1bb-1558-4e4a-89cf-8af74c933193 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:57.695933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fec1e1bb-1558-4e4a-89cf-8af74c933193 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:57.697743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fec1e1bb-1558-4e4a-89cf-8af74c933193 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:57.699147 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fec1e1bb-1558-4e4a-89cf-8af74c933193 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1336 microversion: 2.54 time: 0.297239 Oct 29 01:28:57.700285 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2556/5340] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:28:57 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1336 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:28:58.445891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-736b4e37-fc10-4538-ac2c-e26496b4c473 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:58.446575 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-736b4e37-fc10-4538-ac2c-e26496b4c473 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:58.467871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-736b4e37-fc10-4538-ac2c-e26496b4c473 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:58.468373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-736b4e37-fc10-4538-ac2c-e26496b4c473 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:58.468810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-736b4e37-fc10-4538-ac2c-e26496b4c473 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:58.469553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-736b4e37-fc10-4538-ac2c-e26496b4c473 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:58.470015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-736b4e37-fc10-4538-ac2c-e26496b4c473 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:58.470445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-736b4e37-fc10-4538-ac2c-e26496b4c473 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:58.661520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-736b4e37-fc10-4538-ac2c-e26496b4c473 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:58.664091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=99 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:28:58.675857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-736b4e37-fc10-4538-ac2c-e26496b4c473 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:58.684175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-736b4e37-fc10-4538-ac2c-e26496b4c473 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:58.685613 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-736b4e37-fc10-4538-ac2c-e26496b4c473 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e" status: 200 len: 1338 microversion: 2.47 time: 0.243635 Oct 29 01:28:58.687240 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2785/5341] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:28:58 2022] GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e => generated 1338 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:28:58.728021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-15568b1d-7c9b-4531-8ca6-282753439114 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:58.728021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-15568b1d-7c9b-4531-8ca6-282753439114 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:58.743182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15568b1d-7c9b-4531-8ca6-282753439114 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:58.744018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15568b1d-7c9b-4531-8ca6-282753439114 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:58.744182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15568b1d-7c9b-4531-8ca6-282753439114 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:58.744815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15568b1d-7c9b-4531-8ca6-282753439114 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:58.745309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15568b1d-7c9b-4531-8ca6-282753439114 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:58.746014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15568b1d-7c9b-4531-8ca6-282753439114 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:58.950389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-15568b1d-7c9b-4531-8ca6-282753439114 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:58.964036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-15568b1d-7c9b-4531-8ca6-282753439114 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:58.972599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-15568b1d-7c9b-4531-8ca6-282753439114 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:58.974120 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-15568b1d-7c9b-4531-8ca6-282753439114 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1336 microversion: 2.54 time: 0.251867 Oct 29 01:28:58.975120 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2557/5342] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:28:58 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1336 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:28:59.386598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-e1185268-d460-4dbf-bf04-67cee7100a7d req-7c597935-b662-4273-b93e-af68414af38a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c303716-1880-4adb-b972-3bc6e24ba1cc", "tag": "1fc7ef2d-5f81-4fa5-bffb-8c74fba80b4c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:28:59.405918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e1185268-d460-4dbf-bf04-67cee7100a7d req-7c597935-b662-4273-b93e-af68414af38a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:59.406408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e1185268-d460-4dbf-bf04-67cee7100a7d req-7c597935-b662-4273-b93e-af68414af38a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:59.406845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e1185268-d460-4dbf-bf04-67cee7100a7d req-7c597935-b662-4273-b93e-af68414af38a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:59.434684 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-e1185268-d460-4dbf-bf04-67cee7100a7d req-7c597935-b662-4273-b93e-af68414af38a service nova] Creating event network-changed:1fc7ef2d-5f81-4fa5-bffb-8c74fba80b4c for instance 1c303716-1880-4adb-b972-3bc6e24ba1cc on n-h1-862964-3 Oct 29 01:28:59.447335 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-e1185268-d460-4dbf-bf04-67cee7100a7d req-7c597935-b662-4273-b93e-af68414af38a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068815 Oct 29 01:28:59.452590 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2786/5343] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:28:59.718282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9678c372-6a1e-4dcf-b821-facc84914b1f tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:28:59.719244 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9678c372-6a1e-4dcf-b821-facc84914b1f tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:28:59.732131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9678c372-6a1e-4dcf-b821-facc84914b1f tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:59.736167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9678c372-6a1e-4dcf-b821-facc84914b1f tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:59.742541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9678c372-6a1e-4dcf-b821-facc84914b1f tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:59.742541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9678c372-6a1e-4dcf-b821-facc84914b1f tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:28:59.742541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9678c372-6a1e-4dcf-b821-facc84914b1f tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:28:59.742541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9678c372-6a1e-4dcf-b821-facc84914b1f tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:28:59.860539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9678c372-6a1e-4dcf-b821-facc84914b1f tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:59.869801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9678c372-6a1e-4dcf-b821-facc84914b1f tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:59.871871 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9678c372-6a1e-4dcf-b821-facc84914b1f tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:28:59.873074 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9678c372-6a1e-4dcf-b821-facc84914b1f tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e" status: 200 len: 1338 microversion: 2.47 time: 0.159814 Oct 29 01:28:59.874657 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2558/5344] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:28:59 2022] GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e => generated 1338 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:00.004276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:29:00.006773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c4d93739-5803-482f-a1dd-8b532f699b1c tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:00.007685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c4d93739-5803-482f-a1dd-8b532f699b1c tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:00.021547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4d93739-5803-482f-a1dd-8b532f699b1c tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:00.022046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4d93739-5803-482f-a1dd-8b532f699b1c tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:00.022487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4d93739-5803-482f-a1dd-8b532f699b1c tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:00.023205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4d93739-5803-482f-a1dd-8b532f699b1c tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:00.023663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4d93739-5803-482f-a1dd-8b532f699b1c tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:00.027866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4d93739-5803-482f-a1dd-8b532f699b1c tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:00.220368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c4d93739-5803-482f-a1dd-8b532f699b1c tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:00.232462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c4d93739-5803-482f-a1dd-8b532f699b1c tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:00.234863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c4d93739-5803-482f-a1dd-8b532f699b1c tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:00.236121 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c4d93739-5803-482f-a1dd-8b532f699b1c tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1336 microversion: 2.54 time: 0.237942 Oct 29 01:29:00.239887 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2787/5345] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:28:59 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1336 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:00.908806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c8a8a696-d782-4833-9361-fe23a313c592 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:00.909636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c8a8a696-d782-4833-9361-fe23a313c592 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:00.911763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:29:00.937004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8a8a696-d782-4833-9361-fe23a313c592 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:00.937539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8a8a696-d782-4833-9361-fe23a313c592 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:00.937987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8a8a696-d782-4833-9361-fe23a313c592 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:00.938730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8a8a696-d782-4833-9361-fe23a313c592 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:00.939203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8a8a696-d782-4833-9361-fe23a313c592 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:00.939643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8a8a696-d782-4833-9361-fe23a313c592 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:01.263105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bfab8402-274f-4eb5-9387-1b2d21509473 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:01.263727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bfab8402-274f-4eb5-9387-1b2d21509473 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:01.277695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfab8402-274f-4eb5-9387-1b2d21509473 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:01.288384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfab8402-274f-4eb5-9387-1b2d21509473 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:01.288858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfab8402-274f-4eb5-9387-1b2d21509473 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:01.289660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfab8402-274f-4eb5-9387-1b2d21509473 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:01.290134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfab8402-274f-4eb5-9387-1b2d21509473 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:01.290583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfab8402-274f-4eb5-9387-1b2d21509473 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:01.305348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=10 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:29:01.358469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c8a8a696-d782-4833-9361-fe23a313c592 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:01.372573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c8a8a696-d782-4833-9361-fe23a313c592 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:01.378686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c8a8a696-d782-4833-9361-fe23a313c592 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:01.380256 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c8a8a696-d782-4833-9361-fe23a313c592 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e" status: 200 len: 1338 microversion: 2.47 time: 0.475763 Oct 29 01:29:01.380870 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2559/5346] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:00 2022] GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e => generated 1338 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:01.451549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bfab8402-274f-4eb5-9387-1b2d21509473 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:01.462185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bfab8402-274f-4eb5-9387-1b2d21509473 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:01.464183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bfab8402-274f-4eb5-9387-1b2d21509473 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:01.465443 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bfab8402-274f-4eb5-9387-1b2d21509473 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1357 microversion: 2.54 time: 0.206526 Oct 29 01:29:01.478456 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2788/5347] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:01 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:01.500857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-320a3bc6-7170-409f-8f21-26ca8833e503 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Action: 'create', calling method: .version_select at 0x7f9d97d43700>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-2122988442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBd0dGw5ngcuZvpNjspRgzWz8LorpMysNUHc7DxYGdBVSDYQmWr2JavRCZKN5km7BWndnLNezXuZ+uhMgp9StArSHKii9np10b17LBmOgIpqajGG53wIQxx005IQsuea3g=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:01.523410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-320a3bc6-7170-409f-8f21-26ca8833e503 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Getting quotas for project 1b14c66b575a4b95b1c85a0073e553b9. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:29:01.543787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-320a3bc6-7170-409f-8f21-26ca8833e503 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Getting quotas for user 5c0cda7d648946818a9090e194b2d427 and project 1b14c66b575a4b95b1c85a0073e553b9. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:29:01.735497 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-320a3bc6-7170-409f-8f21-26ca8833e503 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.239570 Oct 29 01:29:01.741748 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2560/5348] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 29 01:29:01 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 241 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 01:29:01.751066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-2122988442", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:01.754390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:01.771792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=10 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:29:01.773458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:01.773961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:01.774405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:01.775106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:01.778863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:01.790190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:01.924037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:29:01.926469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:29:01.927181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:29:01.928015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:29:01.928814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:29:02.414460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e60393d9-ac92-4ba5-87e4-5aac739aa0e0 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:02.415706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e60393d9-ac92-4ba5-87e4-5aac739aa0e0 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:02.423422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e60393d9-ac92-4ba5-87e4-5aac739aa0e0 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:02.424190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e60393d9-ac92-4ba5-87e4-5aac739aa0e0 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:02.424846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e60393d9-ac92-4ba5-87e4-5aac739aa0e0 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:02.425589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e60393d9-ac92-4ba5-87e4-5aac739aa0e0 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:02.426262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e60393d9-ac92-4ba5-87e4-5aac739aa0e0 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:02.426856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e60393d9-ac92-4ba5-87e4-5aac739aa0e0 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:02.550544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:02.563049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:02.564162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e60393d9-ac92-4ba5-87e4-5aac739aa0e0 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:02.567098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:02.569098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:02.570682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:02.574243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:02.575080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:02.578087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e60393d9-ac92-4ba5-87e4-5aac739aa0e0 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:02.585008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e60393d9-ac92-4ba5-87e4-5aac739aa0e0 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:02.588517 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e60393d9-ac92-4ba5-87e4-5aac739aa0e0 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e" status: 200 len: 1359 microversion: 2.47 time: 0.178053 Oct 29 01:29:02.606217 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2561/5349] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:02 2022] GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:02.618869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-36286f52-a311-425e-87a8-5d9e95737335 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1150586042"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:02.623259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-36286f52-a311-425e-87a8-5d9e95737335 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:02.630943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36286f52-a311-425e-87a8-5d9e95737335 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:02.631682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36286f52-a311-425e-87a8-5d9e95737335 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:02.632365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36286f52-a311-425e-87a8-5d9e95737335 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:02.633347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36286f52-a311-425e-87a8-5d9e95737335 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:02.634055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36286f52-a311-425e-87a8-5d9e95737335 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:02.634704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36286f52-a311-425e-87a8-5d9e95737335 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:02.646662 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8e12009e-238f-48ce-a47c-30a099cc1cd3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "POST /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1/action" status: 202 len: 1140 microversion: 2.54 time: 0.900084 Oct 29 01:29:02.647769 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2789/5350] 10.222.0.26 () {62 vars in 1320 bytes} [Sat Oct 29 01:29:01 2022] POST /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1/action => generated 1140 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 29 01:29:02.689744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c86d3fd7-efd6-4b5e-9c4a-3fe1518ad9b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:02.691167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c86d3fd7-efd6-4b5e-9c4a-3fe1518ad9b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:02.701442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c86d3fd7-efd6-4b5e-9c4a-3fe1518ad9b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:02.704265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c86d3fd7-efd6-4b5e-9c4a-3fe1518ad9b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:02.705216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c86d3fd7-efd6-4b5e-9c4a-3fe1518ad9b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:02.706228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c86d3fd7-efd6-4b5e-9c4a-3fe1518ad9b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:02.707522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c86d3fd7-efd6-4b5e-9c4a-3fe1518ad9b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:02.708286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c86d3fd7-efd6-4b5e-9c4a-3fe1518ad9b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:02.893123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c86d3fd7-efd6-4b5e-9c4a-3fe1518ad9b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:02.936322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c86d3fd7-efd6-4b5e-9c4a-3fe1518ad9b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:02.939902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c86d3fd7-efd6-4b5e-9c4a-3fe1518ad9b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:02.947811 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c86d3fd7-efd6-4b5e-9c4a-3fe1518ad9b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.276393 Oct 29 01:29:02.952990 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2790/5351] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:02 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:29:03.577990 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-36286f52-a311-425e-87a8-5d9e95737335 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "POST /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e/action" status: 202 len: 52 microversion: 2.47 time: 0.964373 Oct 29 01:29:03.587622 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2562/5352] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 29 01:29:02 2022] POST /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e/action => generated 52 bytes in 967 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Oct 29 01:29:03.593883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6c448ba4-cf8e-4975-9594-5918bc2afedd tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:03.596515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6c448ba4-cf8e-4975-9594-5918bc2afedd tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:03.643274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c448ba4-cf8e-4975-9594-5918bc2afedd tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:03.645452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c448ba4-cf8e-4975-9594-5918bc2afedd tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:03.646143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c448ba4-cf8e-4975-9594-5918bc2afedd tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:03.648222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c448ba4-cf8e-4975-9594-5918bc2afedd tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:03.652836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c448ba4-cf8e-4975-9594-5918bc2afedd tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:03.654740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c448ba4-cf8e-4975-9594-5918bc2afedd tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:03.817859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6c448ba4-cf8e-4975-9594-5918bc2afedd tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:29:03.986756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2d5b7015-45b7-4e09-9c1a-e2608a749d74 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:03.989829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2d5b7015-45b7-4e09-9c1a-e2608a749d74 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:04.002003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d5b7015-45b7-4e09-9c1a-e2608a749d74 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:04.002606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d5b7015-45b7-4e09-9c1a-e2608a749d74 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:04.003116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d5b7015-45b7-4e09-9c1a-e2608a749d74 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:04.008718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d5b7015-45b7-4e09-9c1a-e2608a749d74 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:04.008718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d5b7015-45b7-4e09-9c1a-e2608a749d74 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:04.008718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d5b7015-45b7-4e09-9c1a-e2608a749d74 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:04.248522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2d5b7015-45b7-4e09-9c1a-e2608a749d74 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:04.260370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2d5b7015-45b7-4e09-9c1a-e2608a749d74 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:04.263886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2d5b7015-45b7-4e09-9c1a-e2608a749d74 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:04.265421 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2d5b7015-45b7-4e09-9c1a-e2608a749d74 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.286517 Oct 29 01:29:04.266513 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2563/5353] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:03 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:04.492457 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6c448ba4-cf8e-4975-9594-5918bc2afedd tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "DELETE /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e" status: 204 len: 0 microversion: 2.47 time: 0.904968 Oct 29 01:29:04.493176 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2791/5354] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:29:03 2022] DELETE /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e => generated 0 bytes in 907 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:29:04.502858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-62fda5f9-0a73-499d-82da-49b0ccc26029 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:04.503477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-62fda5f9-0a73-499d-82da-49b0ccc26029 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:04.525371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-62fda5f9-0a73-499d-82da-49b0ccc26029 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:04.525371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-62fda5f9-0a73-499d-82da-49b0ccc26029 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:04.525371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-62fda5f9-0a73-499d-82da-49b0ccc26029 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:04.525371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-62fda5f9-0a73-499d-82da-49b0ccc26029 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:04.525371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-62fda5f9-0a73-499d-82da-49b0ccc26029 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:04.526010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-62fda5f9-0a73-499d-82da-49b0ccc26029 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:04.716106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-62fda5f9-0a73-499d-82da-49b0ccc26029 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:04.732080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-62fda5f9-0a73-499d-82da-49b0ccc26029 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:04.734043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-62fda5f9-0a73-499d-82da-49b0ccc26029 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:04.735366 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-62fda5f9-0a73-499d-82da-49b0ccc26029 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e" status: 200 len: 1365 microversion: 2.47 time: 0.236765 Oct 29 01:29:04.737581 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2564/5355] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:04 2022] GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:05.298829 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9128f1eb-3992-4884-9ab0-482a51e4a980 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:05.303155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9128f1eb-3992-4884-9ab0-482a51e4a980 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:05.317644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9128f1eb-3992-4884-9ab0-482a51e4a980 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:05.319847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9128f1eb-3992-4884-9ab0-482a51e4a980 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:05.320312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9128f1eb-3992-4884-9ab0-482a51e4a980 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:05.324145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9128f1eb-3992-4884-9ab0-482a51e4a980 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:05.325894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9128f1eb-3992-4884-9ab0-482a51e4a980 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:05.327375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9128f1eb-3992-4884-9ab0-482a51e4a980 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:05.571994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9128f1eb-3992-4884-9ab0-482a51e4a980 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:05.586255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9128f1eb-3992-4884-9ab0-482a51e4a980 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:05.587974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9128f1eb-3992-4884-9ab0-482a51e4a980 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:05.590862 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9128f1eb-3992-4884-9ab0-482a51e4a980 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.299066 Oct 29 01:29:05.616818 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2792/5356] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:05 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:05.763241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3216d636-fcf6-44fb-be9c-2c15bd178522 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:05.765120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3216d636-fcf6-44fb-be9c-2c15bd178522 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:05.783849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3216d636-fcf6-44fb-be9c-2c15bd178522 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:05.790423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3216d636-fcf6-44fb-be9c-2c15bd178522 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:05.791158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3216d636-fcf6-44fb-be9c-2c15bd178522 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:05.794067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3216d636-fcf6-44fb-be9c-2c15bd178522 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:05.796217 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3216d636-fcf6-44fb-be9c-2c15bd178522 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:05.797673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3216d636-fcf6-44fb-be9c-2c15bd178522 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:05.895867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3216d636-fcf6-44fb-be9c-2c15bd178522 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:05.914903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3216d636-fcf6-44fb-be9c-2c15bd178522 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:05.918092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3216d636-fcf6-44fb-be9c-2c15bd178522 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:05.920363 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3216d636-fcf6-44fb-be9c-2c15bd178522 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e" status: 200 len: 1365 microversion: 2.47 time: 0.161642 Oct 29 01:29:05.933735 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2565/5357] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:05 2022] GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:06.458577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3c5f6493-87a8-4252-bfb8-36f46b368a21 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-903704923", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "597311ce-aa95-4f12-8eaa-7c4f96ddc1b9"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:06.571842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-3c5f6493-87a8-4252-bfb8-36f46b368a21 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] validate_networks() for [('597311ce-aa95-4f12-8eaa-7c4f96ddc1b9', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:29:06.624220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-19f922ce-8a69-48a7-9d96-b01f290d6c31 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:06.624827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-19f922ce-8a69-48a7-9d96-b01f290d6c31 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:06.639186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19f922ce-8a69-48a7-9d96-b01f290d6c31 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:06.639975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19f922ce-8a69-48a7-9d96-b01f290d6c31 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:06.642234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19f922ce-8a69-48a7-9d96-b01f290d6c31 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:06.646486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19f922ce-8a69-48a7-9d96-b01f290d6c31 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:06.647179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19f922ce-8a69-48a7-9d96-b01f290d6c31 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:06.648101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19f922ce-8a69-48a7-9d96-b01f290d6c31 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:06.705939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:29:06.815828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-19f922ce-8a69-48a7-9d96-b01f290d6c31 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:06.830405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-19f922ce-8a69-48a7-9d96-b01f290d6c31 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:06.835066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-19f922ce-8a69-48a7-9d96-b01f290d6c31 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:06.838317 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-19f922ce-8a69-48a7-9d96-b01f290d6c31 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.219373 Oct 29 01:29:06.845874 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2566/5358] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:06 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:06.952616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c17cb491-636d-4ac8-a4c3-40ebcfb86011 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:06.953277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c17cb491-636d-4ac8-a4c3-40ebcfb86011 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:06.961265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c17cb491-636d-4ac8-a4c3-40ebcfb86011 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:06.961775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c17cb491-636d-4ac8-a4c3-40ebcfb86011 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:06.965646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c17cb491-636d-4ac8-a4c3-40ebcfb86011 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:06.967116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c17cb491-636d-4ac8-a4c3-40ebcfb86011 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:06.969225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c17cb491-636d-4ac8-a4c3-40ebcfb86011 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:06.969774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c17cb491-636d-4ac8-a4c3-40ebcfb86011 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:07.127909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c17cb491-636d-4ac8-a4c3-40ebcfb86011 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:07.140790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c17cb491-636d-4ac8-a4c3-40ebcfb86011 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:07.143962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c17cb491-636d-4ac8-a4c3-40ebcfb86011 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:07.145365 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c17cb491-636d-4ac8-a4c3-40ebcfb86011 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e" status: 200 len: 1365 microversion: 2.47 time: 0.197127 Oct 29 01:29:07.159849 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2567/5359] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:06 2022] GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:07.682939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-3c5f6493-87a8-4252-bfb8-36f46b368a21 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:29:07.683553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-3c5f6493-87a8-4252-bfb8-36f46b368a21 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:29:07.684153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-3c5f6493-87a8-4252-bfb8-36f46b368a21 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:29:07.684643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-3c5f6493-87a8-4252-bfb8-36f46b368a21 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:29:07.685144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-3c5f6493-87a8-4252-bfb8-36f46b368a21 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:29:07.695708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c5f6493-87a8-4252-bfb8-36f46b368a21 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:07.696827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c5f6493-87a8-4252-bfb8-36f46b368a21 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:07.697377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c5f6493-87a8-4252-bfb8-36f46b368a21 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:07.698262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c5f6493-87a8-4252-bfb8-36f46b368a21 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:07.699439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c5f6493-87a8-4252-bfb8-36f46b368a21 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:07.699944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3c5f6493-87a8-4252-bfb8-36f46b368a21 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:07.722184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-3c5f6493-87a8-4252-bfb8-36f46b368a21 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Getting quotas for project c1840006d715496788f2dc0ca7c40c6b. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:29:07.743171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-3c5f6493-87a8-4252-bfb8-36f46b368a21 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Getting quotas for user 683fc94021ee47e88a111980139e6786 and project c1840006d715496788f2dc0ca7c40c6b. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:29:07.766582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3c5f6493-87a8-4252-bfb8-36f46b368a21 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:29:07.769684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3c5f6493-87a8-4252-bfb8-36f46b368a21 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:29:07.875091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-83a72966-b970-4209-8356-99f36fceef2a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:07.875767 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3c5f6493-87a8-4252-bfb8-36f46b368a21 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.648955 Oct 29 01:29:07.875894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-83a72966-b970-4209-8356-99f36fceef2a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:07.877206 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2793/5360] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:29:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:29:07.884861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a72966-b970-4209-8356-99f36fceef2a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:07.885405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a72966-b970-4209-8356-99f36fceef2a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:07.886666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a72966-b970-4209-8356-99f36fceef2a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:07.887452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a72966-b970-4209-8356-99f36fceef2a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:07.888033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a72966-b970-4209-8356-99f36fceef2a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:07.895076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a72966-b970-4209-8356-99f36fceef2a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:07.895230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-caeb1dc3-a9e5-4747-9259-b9211d5ec5b5 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:07.895230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-caeb1dc3-a9e5-4747-9259-b9211d5ec5b5 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:08.043658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-caeb1dc3-a9e5-4747-9259-b9211d5ec5b5 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:08.046388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-83a72966-b970-4209-8356-99f36fceef2a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:08.053018 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-caeb1dc3-a9e5-4747-9259-b9211d5ec5b5 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1217 microversion: 2.1 time: 0.168519 Oct 29 01:29:08.054451 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2794/5361] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:07 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:08.057056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-83a72966-b970-4209-8356-99f36fceef2a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:08.059248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-83a72966-b970-4209-8356-99f36fceef2a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:08.060443 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-83a72966-b970-4209-8356-99f36fceef2a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.190054 Oct 29 01:29:08.062265 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2568/5362] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:07 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:08.184225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9d82944c-d439-4289-8e34-7cf7ceeb9936 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:08.185137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9d82944c-d439-4289-8e34-7cf7ceeb9936 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:08.197245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d82944c-d439-4289-8e34-7cf7ceeb9936 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:08.198029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d82944c-d439-4289-8e34-7cf7ceeb9936 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:08.199656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d82944c-d439-4289-8e34-7cf7ceeb9936 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:08.200651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d82944c-d439-4289-8e34-7cf7ceeb9936 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:08.202152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d82944c-d439-4289-8e34-7cf7ceeb9936 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:08.203235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d82944c-d439-4289-8e34-7cf7ceeb9936 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:08.367685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9d82944c-d439-4289-8e34-7cf7ceeb9936 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:08.378296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9d82944c-d439-4289-8e34-7cf7ceeb9936 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:08.380687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9d82944c-d439-4289-8e34-7cf7ceeb9936 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:08.382349 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9d82944c-d439-4289-8e34-7cf7ceeb9936 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e" status: 200 len: 1365 microversion: 2.47 time: 0.211961 Oct 29 01:29:08.383200 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2795/5363] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:08 2022] GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:09.087548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b495ce0a-e611-4267-93f6-185c4b3d7d8c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:09.087548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b495ce0a-e611-4267-93f6-185c4b3d7d8c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:09.093441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e5e53a9f-7385-4410-ac7a-a77c2ee2dfb4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:09.094059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e5e53a9f-7385-4410-ac7a-a77c2ee2dfb4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:09.101765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5e53a9f-7385-4410-ac7a-a77c2ee2dfb4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:09.104296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5e53a9f-7385-4410-ac7a-a77c2ee2dfb4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:09.107733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5e53a9f-7385-4410-ac7a-a77c2ee2dfb4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:09.108527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5e53a9f-7385-4410-ac7a-a77c2ee2dfb4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:09.109021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5e53a9f-7385-4410-ac7a-a77c2ee2dfb4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:09.111452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e5e53a9f-7385-4410-ac7a-a77c2ee2dfb4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:09.215985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b495ce0a-e611-4267-93f6-185c4b3d7d8c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:09.224951 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b495ce0a-e611-4267-93f6-185c4b3d7d8c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1217 microversion: 2.1 time: 0.148921 Oct 29 01:29:09.228485 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2569/5364] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:09 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:09.258074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e5e53a9f-7385-4410-ac7a-a77c2ee2dfb4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:09.270773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e5e53a9f-7385-4410-ac7a-a77c2ee2dfb4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:09.273997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e5e53a9f-7385-4410-ac7a-a77c2ee2dfb4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:09.275388 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e5e53a9f-7385-4410-ac7a-a77c2ee2dfb4 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.186553 Oct 29 01:29:09.283253 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2796/5365] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:09 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:09.415505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-52366e6d-3de9-4626-a3ea-f9b06b7f922e tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:09.416255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-52366e6d-3de9-4626-a3ea-f9b06b7f922e tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:09.429571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52366e6d-3de9-4626-a3ea-f9b06b7f922e tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:09.430081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52366e6d-3de9-4626-a3ea-f9b06b7f922e tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:09.430868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52366e6d-3de9-4626-a3ea-f9b06b7f922e tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:09.431266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52366e6d-3de9-4626-a3ea-f9b06b7f922e tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:09.431734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52366e6d-3de9-4626-a3ea-f9b06b7f922e tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:09.432171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52366e6d-3de9-4626-a3ea-f9b06b7f922e tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:09.555580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-52366e6d-3de9-4626-a3ea-f9b06b7f922e tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:09.568388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-52366e6d-3de9-4626-a3ea-f9b06b7f922e tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:09.570065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-52366e6d-3de9-4626-a3ea-f9b06b7f922e tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:09.571346 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-52366e6d-3de9-4626-a3ea-f9b06b7f922e tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e" status: 200 len: 1365 microversion: 2.47 time: 0.160521 Oct 29 01:29:09.572007 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2570/5366] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:09 2022] GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:10.252803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fb4c84d4-1135-4a50-8ba1-f0a0cf2db603 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:10.253284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fb4c84d4-1135-4a50-8ba1-f0a0cf2db603 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:10.265369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb4c84d4-1135-4a50-8ba1-f0a0cf2db603 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:10.265863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb4c84d4-1135-4a50-8ba1-f0a0cf2db603 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:10.266307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb4c84d4-1135-4a50-8ba1-f0a0cf2db603 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:10.267029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb4c84d4-1135-4a50-8ba1-f0a0cf2db603 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:10.267490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb4c84d4-1135-4a50-8ba1-f0a0cf2db603 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:10.267919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb4c84d4-1135-4a50-8ba1-f0a0cf2db603 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:10.309636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f360e6f3-2b78-40e2-8cbf-04246ee4c7f6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:10.310300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f360e6f3-2b78-40e2-8cbf-04246ee4c7f6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:10.322848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f360e6f3-2b78-40e2-8cbf-04246ee4c7f6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:10.328473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f360e6f3-2b78-40e2-8cbf-04246ee4c7f6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:10.330592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f360e6f3-2b78-40e2-8cbf-04246ee4c7f6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:10.332905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f360e6f3-2b78-40e2-8cbf-04246ee4c7f6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:10.333585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f360e6f3-2b78-40e2-8cbf-04246ee4c7f6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:10.337014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f360e6f3-2b78-40e2-8cbf-04246ee4c7f6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:10.780628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fb4c84d4-1135-4a50-8ba1-f0a0cf2db603 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:10.788606 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fb4c84d4-1135-4a50-8ba1-f0a0cf2db603 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1213 microversion: 2.1 time: 0.540099 Oct 29 01:29:10.789222 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2797/5367] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:10 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1213 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:10.844439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dc78bee3-7eac-4874-8bc3-8b220d91f0cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:10.845073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dc78bee3-7eac-4874-8bc3-8b220d91f0cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:10.867229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc78bee3-7eac-4874-8bc3-8b220d91f0cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:10.867728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc78bee3-7eac-4874-8bc3-8b220d91f0cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:10.868180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc78bee3-7eac-4874-8bc3-8b220d91f0cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:10.878177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc78bee3-7eac-4874-8bc3-8b220d91f0cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:10.878595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc78bee3-7eac-4874-8bc3-8b220d91f0cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:10.879052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc78bee3-7eac-4874-8bc3-8b220d91f0cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:10.996415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc78bee3-7eac-4874-8bc3-8b220d91f0cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:10.996925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc78bee3-7eac-4874-8bc3-8b220d91f0cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:11.001327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dc78bee3-7eac-4874-8bc3-8b220d91f0cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:11.006861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-dc78bee3-7eac-4874-8bc3-8b220d91f0cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lazy-loading 'fault' on Instance uuid 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:29:11.089474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f360e6f3-2b78-40e2-8cbf-04246ee4c7f6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:11.103147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f360e6f3-2b78-40e2-8cbf-04246ee4c7f6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:11.118841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f360e6f3-2b78-40e2-8cbf-04246ee4c7f6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:11.121085 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f360e6f3-2b78-40e2-8cbf-04246ee4c7f6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.816541 Oct 29 01:29:11.141503 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2571/5368] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:10 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:11.193275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dc78bee3-7eac-4874-8bc3-8b220d91f0cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:11.205312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dc78bee3-7eac-4874-8bc3-8b220d91f0cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:11.211005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dc78bee3-7eac-4874-8bc3-8b220d91f0cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d9a6dc73f142a899ca27b98bf25056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea3789cff8b420584d2f6899c6a4dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:11.212742 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dc78bee3-7eac-4874-8bc3-8b220d91f0cc tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e" status: 200 len: 1370 microversion: 2.47 time: 0.372532 Oct 29 01:29:11.214458 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2798/5369] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:10 2022] GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e => generated 1370 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:11.818889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4a878b66-fff6-4375-bb47-594b4ab1303d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:11.819492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4a878b66-fff6-4375-bb47-594b4ab1303d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:11.832371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a878b66-fff6-4375-bb47-594b4ab1303d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:11.835113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a878b66-fff6-4375-bb47-594b4ab1303d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:11.835579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a878b66-fff6-4375-bb47-594b4ab1303d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:11.837520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a878b66-fff6-4375-bb47-594b4ab1303d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:11.839952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a878b66-fff6-4375-bb47-594b4ab1303d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:11.840478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a878b66-fff6-4375-bb47-594b4ab1303d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:12.032827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4a878b66-fff6-4375-bb47-594b4ab1303d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:12.041694 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4a878b66-fff6-4375-bb47-594b4ab1303d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1275 microversion: 2.1 time: 0.227314 Oct 29 01:29:12.053704 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2572/5370] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:11 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1275 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:12.158914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-553f3df3-bbd8-46d9-9855-9a326bb0c2f8 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:12.159519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-553f3df3-bbd8-46d9-9855-9a326bb0c2f8 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:12.172715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-553f3df3-bbd8-46d9-9855-9a326bb0c2f8 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:12.178857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-553f3df3-bbd8-46d9-9855-9a326bb0c2f8 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:12.178857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-553f3df3-bbd8-46d9-9855-9a326bb0c2f8 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:12.178857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-553f3df3-bbd8-46d9-9855-9a326bb0c2f8 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:12.178857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-553f3df3-bbd8-46d9-9855-9a326bb0c2f8 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:12.178857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-553f3df3-bbd8-46d9-9855-9a326bb0c2f8 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:12.241164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e4f67a72-d619-4384-afc2-a1962ed30d18 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:12.241840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e4f67a72-d619-4384-afc2-a1962ed30d18 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] [instance: 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:12.250999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4f67a72-d619-4384-afc2-a1962ed30d18 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:12.251801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4f67a72-d619-4384-afc2-a1962ed30d18 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:12.255329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4f67a72-d619-4384-afc2-a1962ed30d18 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:12.256320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4f67a72-d619-4384-afc2-a1962ed30d18 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:12.256983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4f67a72-d619-4384-afc2-a1962ed30d18 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:12.257701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4f67a72-d619-4384-afc2-a1962ed30d18 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:12.305124 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-e4f67a72-d619-4384-afc2-a1962ed30d18 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] HTTP exception thrown: Instance 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e could not be found. Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e4f67a72-d619-4384-afc2-a1962ed30d18 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Request method failure captured: Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e HTTP/1.1 Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIHQdaGSPdrmIoqxvSUmYSZOYtPrf4_9jCMONT_JXvjyKRqcAifhJqR0wu_2hMvQT4HUZ6k0S4SUbEUh2gsrrc_os5nC4qLx7By5yhwSKkD0NgJxkIP7ZJ77D1A4N5E4BAeNzuidAukRbX1OIz8V33ZYo2cfm7IWKczRSifTswiCdB8 Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-Openstack-Nova-Api-Version: 2.47 Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: cea3789cff8b420584d2f6899c6a4dd8 Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersAaction247Test-1599169611 Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cea3789cff8b420584d2f6899c6a4dd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cea3789cff8b420584d2f6899c6a4dd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cea3789cff8b420584d2f6899c6a4dd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cea3789cff8b420584d2f6899c6a4dd8", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersAaction247Test-1599169611 Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: cea3789cff8b420584d2f6899c6a4dd8 Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersAaction247Test-1599169611 Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersAaction247Test-1599169611-project Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 10d9a6dc73f142a899ca27b98bf25056 Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersAaction247Test-1599169611-project Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e could not be found. Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '394b07f6-bc8c-4212-a56d-fdfa1ec1be4e'} Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e could not be found. Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e could not be found. Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:29:12.312794 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:29:12.326554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:29:12.326554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:29:12.326554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:29:12.326554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:29:12.326554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:29:12.326554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:29:12.326554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e could not be found. Oct 29 01:29:12.326554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:29:12.326554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e4f67a72-d619-4384-afc2-a1962ed30d18 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] Returning 404 to user: Instance 394b07f6-bc8c-4212-a56d-fdfa1ec1be4e could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:29:12.326554 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e4f67a72-d619-4384-afc2-a1962ed30d18 tempest-ServersAaction247Test-1599169611 tempest-ServersAaction247Test-1599169611-project] 10.222.0.26 "GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e" status: 404 len: 111 microversion: 2.47 time: 0.078949 Oct 29 01:29:12.329421 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2573/5371] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:12 2022] GET /compute/v2.1/servers/394b07f6-bc8c-4212-a56d-fdfa1ec1be4e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 29 01:29:12.412441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-553f3df3-bbd8-46d9-9855-9a326bb0c2f8 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:12.433347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-553f3df3-bbd8-46d9-9855-9a326bb0c2f8 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:12.435200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-553f3df3-bbd8-46d9-9855-9a326bb0c2f8 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:12.436428 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-553f3df3-bbd8-46d9-9855-9a326bb0c2f8 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.281344 Oct 29 01:29:12.451021 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2799/5372] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:12 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:13.069737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0926fef5-7df8-49b6-ba59-c2fe05580b34 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:13.070903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0926fef5-7df8-49b6-ba59-c2fe05580b34 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:13.086963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0926fef5-7df8-49b6-ba59-c2fe05580b34 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:13.087503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0926fef5-7df8-49b6-ba59-c2fe05580b34 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:13.092143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0926fef5-7df8-49b6-ba59-c2fe05580b34 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:13.093003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0926fef5-7df8-49b6-ba59-c2fe05580b34 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:13.093525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0926fef5-7df8-49b6-ba59-c2fe05580b34 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:13.093966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0926fef5-7df8-49b6-ba59-c2fe05580b34 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:13.214866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0926fef5-7df8-49b6-ba59-c2fe05580b34 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:13.231587 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0926fef5-7df8-49b6-ba59-c2fe05580b34 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1275 microversion: 2.1 time: 0.165688 Oct 29 01:29:13.252531 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2574/5373] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:13 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1275 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:13.466203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e75a4d74-056b-499d-beb0-ab644fe47bb2 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:13.467422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e75a4d74-056b-499d-beb0-ab644fe47bb2 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:13.480406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e75a4d74-056b-499d-beb0-ab644fe47bb2 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:13.480896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e75a4d74-056b-499d-beb0-ab644fe47bb2 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:13.482055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e75a4d74-056b-499d-beb0-ab644fe47bb2 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:13.483070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e75a4d74-056b-499d-beb0-ab644fe47bb2 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:13.483804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e75a4d74-056b-499d-beb0-ab644fe47bb2 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:13.484468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e75a4d74-056b-499d-beb0-ab644fe47bb2 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:13.510669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:29:13.625613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e75a4d74-056b-499d-beb0-ab644fe47bb2 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:13.639633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e75a4d74-056b-499d-beb0-ab644fe47bb2 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:13.641633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e75a4d74-056b-499d-beb0-ab644fe47bb2 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:13.647140 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e75a4d74-056b-499d-beb0-ab644fe47bb2 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.184957 Oct 29 01:29:13.656573 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2800/5374] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:13 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:14.263385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4b14e7d2-1bfe-40fc-84a0-b902b8a72437 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:14.264609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4b14e7d2-1bfe-40fc-84a0-b902b8a72437 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:14.274458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b14e7d2-1bfe-40fc-84a0-b902b8a72437 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:14.275481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b14e7d2-1bfe-40fc-84a0-b902b8a72437 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:14.276165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b14e7d2-1bfe-40fc-84a0-b902b8a72437 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:14.277964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b14e7d2-1bfe-40fc-84a0-b902b8a72437 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:14.278666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b14e7d2-1bfe-40fc-84a0-b902b8a72437 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:14.279407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4b14e7d2-1bfe-40fc-84a0-b902b8a72437 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:14.648578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4b14e7d2-1bfe-40fc-84a0-b902b8a72437 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:14.665643 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4b14e7d2-1bfe-40fc-84a0-b902b8a72437 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1317 microversion: 2.1 time: 0.410133 Oct 29 01:29:14.669838 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2575/5375] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:14 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:14.678472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c2ba449e-d254-42cf-8f63-b08101b054b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:14.680054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c2ba449e-d254-42cf-8f63-b08101b054b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:14.693124 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:29:14.696394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2ba449e-d254-42cf-8f63-b08101b054b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:14.697082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2ba449e-d254-42cf-8f63-b08101b054b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:14.698846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2ba449e-d254-42cf-8f63-b08101b054b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:14.700331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2ba449e-d254-42cf-8f63-b08101b054b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:14.700994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2ba449e-d254-42cf-8f63-b08101b054b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:14.701664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2ba449e-d254-42cf-8f63-b08101b054b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:14.854551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c2ba449e-d254-42cf-8f63-b08101b054b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:14.881615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c2ba449e-d254-42cf-8f63-b08101b054b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:14.883650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c2ba449e-d254-42cf-8f63-b08101b054b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:14.885595 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c2ba449e-d254-42cf-8f63-b08101b054b3 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.212232 Oct 29 01:29:14.896538 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2801/5376] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:14 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:15.693998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7ccde531-90a4-4b1b-9706-82b8f9b8214b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:15.695195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7ccde531-90a4-4b1b-9706-82b8f9b8214b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:15.713815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ccde531-90a4-4b1b-9706-82b8f9b8214b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:15.713815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ccde531-90a4-4b1b-9706-82b8f9b8214b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:15.713815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ccde531-90a4-4b1b-9706-82b8f9b8214b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:15.713815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ccde531-90a4-4b1b-9706-82b8f9b8214b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:15.713815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ccde531-90a4-4b1b-9706-82b8f9b8214b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:15.713815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ccde531-90a4-4b1b-9706-82b8f9b8214b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:15.930544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-45d02e5e-02a7-4930-90da-6e399af4c9b0 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:15.931160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-45d02e5e-02a7-4930-90da-6e399af4c9b0 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:15.971222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45d02e5e-02a7-4930-90da-6e399af4c9b0 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:15.974509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45d02e5e-02a7-4930-90da-6e399af4c9b0 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:15.975067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45d02e5e-02a7-4930-90da-6e399af4c9b0 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:15.975893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45d02e5e-02a7-4930-90da-6e399af4c9b0 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:15.976292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45d02e5e-02a7-4930-90da-6e399af4c9b0 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:15.976716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45d02e5e-02a7-4930-90da-6e399af4c9b0 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:16.178179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-45d02e5e-02a7-4930-90da-6e399af4c9b0 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:16.187181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-45d02e5e-02a7-4930-90da-6e399af4c9b0 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:16.189261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-45d02e5e-02a7-4930-90da-6e399af4c9b0 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:16.190824 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-45d02e5e-02a7-4930-90da-6e399af4c9b0 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.264365 Oct 29 01:29:16.192024 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2802/5377] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:15 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:16.196776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-b0afbc79-c170-48db-bf63-290572f2a960 req-fd034943-dee8-4a78-b37d-c393a1dfb990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3caef7a-fea6-4d7b-992f-78001494a729", "tag": "6e1dac29-d12e-4181-9daa-b2283db7de98"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:16.208500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b0afbc79-c170-48db-bf63-290572f2a960 req-fd034943-dee8-4a78-b37d-c393a1dfb990 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:16.209863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b0afbc79-c170-48db-bf63-290572f2a960 req-fd034943-dee8-4a78-b37d-c393a1dfb990 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:16.210633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b0afbc79-c170-48db-bf63-290572f2a960 req-fd034943-dee8-4a78-b37d-c393a1dfb990 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:16.240672 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-b0afbc79-c170-48db-bf63-290572f2a960 req-fd034943-dee8-4a78-b37d-c393a1dfb990 service nova] Creating event network-changed:6e1dac29-d12e-4181-9daa-b2283db7de98 for instance a3caef7a-fea6-4d7b-992f-78001494a729 on n-h1-862964-3 Oct 29 01:29:16.249560 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-b0afbc79-c170-48db-bf63-290572f2a960 req-fd034943-dee8-4a78-b37d-c393a1dfb990 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055979 Oct 29 01:29:16.253047 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2803/5378] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:16.325031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7ccde531-90a4-4b1b-9706-82b8f9b8214b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:16.336355 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7ccde531-90a4-4b1b-9706-82b8f9b8214b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1317 microversion: 2.1 time: 0.646367 Oct 29 01:29:16.337308 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2576/5379] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:15 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1317 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:17.223951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2b1c140c-ff7c-40af-ad44-259a214c0563 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:17.224523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2b1c140c-ff7c-40af-ad44-259a214c0563 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:17.243507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b1c140c-ff7c-40af-ad44-259a214c0563 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:17.244004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b1c140c-ff7c-40af-ad44-259a214c0563 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:17.244449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b1c140c-ff7c-40af-ad44-259a214c0563 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:17.245733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b1c140c-ff7c-40af-ad44-259a214c0563 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:17.246205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b1c140c-ff7c-40af-ad44-259a214c0563 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:17.246643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b1c140c-ff7c-40af-ad44-259a214c0563 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:17.360964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1b0c22cd-2ce3-4652-9a2b-b4ae8af2299f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:17.361615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1b0c22cd-2ce3-4652-9a2b-b4ae8af2299f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:17.376365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b0c22cd-2ce3-4652-9a2b-b4ae8af2299f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:17.377248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b0c22cd-2ce3-4652-9a2b-b4ae8af2299f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:17.377972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b0c22cd-2ce3-4652-9a2b-b4ae8af2299f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:17.378720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b0c22cd-2ce3-4652-9a2b-b4ae8af2299f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:17.379186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b0c22cd-2ce3-4652-9a2b-b4ae8af2299f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:17.379632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b0c22cd-2ce3-4652-9a2b-b4ae8af2299f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:17.598806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2b1c140c-ff7c-40af-ad44-259a214c0563 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:17.614082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2b1c140c-ff7c-40af-ad44-259a214c0563 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:17.629983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2b1c140c-ff7c-40af-ad44-259a214c0563 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:17.629983 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2b1c140c-ff7c-40af-ad44-259a214c0563 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.409980 Oct 29 01:29:17.629983 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2804/5380] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:17 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:17.687747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1b0c22cd-2ce3-4652-9a2b-b4ae8af2299f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:17.696419 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1b0c22cd-2ce3-4652-9a2b-b4ae8af2299f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1317 microversion: 2.1 time: 0.339747 Oct 29 01:29:17.697608 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2577/5381] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:17 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:18.658275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-36e2cf8a-3cf8-4ddd-87be-237cb65cbd68 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:18.659366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-36e2cf8a-3cf8-4ddd-87be-237cb65cbd68 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:18.682172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:29:18.683680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=8 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:29:18.690286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36e2cf8a-3cf8-4ddd-87be-237cb65cbd68 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:18.691243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36e2cf8a-3cf8-4ddd-87be-237cb65cbd68 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:18.691934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36e2cf8a-3cf8-4ddd-87be-237cb65cbd68 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:18.696962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36e2cf8a-3cf8-4ddd-87be-237cb65cbd68 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:18.699696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36e2cf8a-3cf8-4ddd-87be-237cb65cbd68 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:18.700524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36e2cf8a-3cf8-4ddd-87be-237cb65cbd68 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:18.810868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7a0deefd-1f2a-44bf-9b42-e4409c2da187 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:18.811488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7a0deefd-1f2a-44bf-9b42-e4409c2da187 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:18.823233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a0deefd-1f2a-44bf-9b42-e4409c2da187 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:18.825401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a0deefd-1f2a-44bf-9b42-e4409c2da187 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:18.826258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a0deefd-1f2a-44bf-9b42-e4409c2da187 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:18.827384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a0deefd-1f2a-44bf-9b42-e4409c2da187 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:18.828334 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a0deefd-1f2a-44bf-9b42-e4409c2da187 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:18.829561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a0deefd-1f2a-44bf-9b42-e4409c2da187 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:18.864769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-36e2cf8a-3cf8-4ddd-87be-237cb65cbd68 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:18.889579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-36e2cf8a-3cf8-4ddd-87be-237cb65cbd68 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:18.897274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-36e2cf8a-3cf8-4ddd-87be-237cb65cbd68 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:18.908454 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-36e2cf8a-3cf8-4ddd-87be-237cb65cbd68 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.250718 Oct 29 01:29:18.909975 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2805/5382] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:18 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:19.189964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7a0deefd-1f2a-44bf-9b42-e4409c2da187 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:19.198766 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7a0deefd-1f2a-44bf-9b42-e4409c2da187 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1317 microversion: 2.1 time: 0.394205 Oct 29 01:29:19.199516 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2578/5383] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:18 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:19.954649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6570e249-cc85-4ed1-8d15-17cd10f43990 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:19.955935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6570e249-cc85-4ed1-8d15-17cd10f43990 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:19.996062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6570e249-cc85-4ed1-8d15-17cd10f43990 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:19.996609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6570e249-cc85-4ed1-8d15-17cd10f43990 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:19.997711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6570e249-cc85-4ed1-8d15-17cd10f43990 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:20.004630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6570e249-cc85-4ed1-8d15-17cd10f43990 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:20.005437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6570e249-cc85-4ed1-8d15-17cd10f43990 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:20.006064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6570e249-cc85-4ed1-8d15-17cd10f43990 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:20.210886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6570e249-cc85-4ed1-8d15-17cd10f43990 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:20.218803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:29:20.226207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6570e249-cc85-4ed1-8d15-17cd10f43990 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:20.230576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-41521fad-f096-4c1b-a9f2-70c21dcb2fbd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:20.231519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-41521fad-f096-4c1b-a9f2-70c21dcb2fbd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:20.235142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6570e249-cc85-4ed1-8d15-17cd10f43990 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:20.236611 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6570e249-cc85-4ed1-8d15-17cd10f43990 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.287043 Oct 29 01:29:20.241004 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2806/5384] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:19 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:20.264904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41521fad-f096-4c1b-a9f2-70c21dcb2fbd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:20.265603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41521fad-f096-4c1b-a9f2-70c21dcb2fbd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:20.266188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41521fad-f096-4c1b-a9f2-70c21dcb2fbd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:20.271874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41521fad-f096-4c1b-a9f2-70c21dcb2fbd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:20.272914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41521fad-f096-4c1b-a9f2-70c21dcb2fbd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:20.273529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41521fad-f096-4c1b-a9f2-70c21dcb2fbd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:20.776602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-41521fad-f096-4c1b-a9f2-70c21dcb2fbd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:20.797060 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-41521fad-f096-4c1b-a9f2-70c21dcb2fbd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1317 microversion: 2.1 time: 0.576255 Oct 29 01:29:20.797060 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2579/5385] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:20 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1317 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:21.268121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5bcda7d3-f63b-4a5f-a61b-eb5e432cee4a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:21.268716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5bcda7d3-f63b-4a5f-a61b-eb5e432cee4a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:21.285080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bcda7d3-f63b-4a5f-a61b-eb5e432cee4a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:21.285858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bcda7d3-f63b-4a5f-a61b-eb5e432cee4a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:21.286296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bcda7d3-f63b-4a5f-a61b-eb5e432cee4a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:21.287013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bcda7d3-f63b-4a5f-a61b-eb5e432cee4a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:21.287465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bcda7d3-f63b-4a5f-a61b-eb5e432cee4a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:21.287967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bcda7d3-f63b-4a5f-a61b-eb5e432cee4a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:21.529210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5bcda7d3-f63b-4a5f-a61b-eb5e432cee4a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:21.546555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5bcda7d3-f63b-4a5f-a61b-eb5e432cee4a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:21.566949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5bcda7d3-f63b-4a5f-a61b-eb5e432cee4a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:21.566949 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5bcda7d3-f63b-4a5f-a61b-eb5e432cee4a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.285959 Oct 29 01:29:21.566949 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2807/5386] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:21 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:21.818728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bd6fa651-b00c-45b8-bd96-470a502fd1a8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:21.819706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bd6fa651-b00c-45b8-bd96-470a502fd1a8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:21.832729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd6fa651-b00c-45b8-bd96-470a502fd1a8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:21.835089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd6fa651-b00c-45b8-bd96-470a502fd1a8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:21.836212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd6fa651-b00c-45b8-bd96-470a502fd1a8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:21.838334 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd6fa651-b00c-45b8-bd96-470a502fd1a8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:21.839464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd6fa651-b00c-45b8-bd96-470a502fd1a8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:21.841908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bd6fa651-b00c-45b8-bd96-470a502fd1a8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:22.203628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bd6fa651-b00c-45b8-bd96-470a502fd1a8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:22.221747 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bd6fa651-b00c-45b8-bd96-470a502fd1a8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1317 microversion: 2.1 time: 0.403170 Oct 29 01:29:22.221747 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2580/5387] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:21 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:22.585318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a7b71b67-1f27-478d-b577-8ab7e54823fd tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:22.585951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a7b71b67-1f27-478d-b577-8ab7e54823fd tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:22.599280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7b71b67-1f27-478d-b577-8ab7e54823fd tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:22.600064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7b71b67-1f27-478d-b577-8ab7e54823fd tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:22.605541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7b71b67-1f27-478d-b577-8ab7e54823fd tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:22.606313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7b71b67-1f27-478d-b577-8ab7e54823fd tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:22.606783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7b71b67-1f27-478d-b577-8ab7e54823fd tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:22.610748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7b71b67-1f27-478d-b577-8ab7e54823fd tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:22.762001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a7b71b67-1f27-478d-b577-8ab7e54823fd tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:22.770713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a7b71b67-1f27-478d-b577-8ab7e54823fd tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:22.772043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a7b71b67-1f27-478d-b577-8ab7e54823fd tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:22.780184 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a7b71b67-1f27-478d-b577-8ab7e54823fd tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.192133 Oct 29 01:29:22.780829 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2808/5388] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:22 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:23.250422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1a495ed6-b46c-46d9-b842-ac30b9bc96c4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:23.251749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1a495ed6-b46c-46d9-b842-ac30b9bc96c4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:23.272726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a495ed6-b46c-46d9-b842-ac30b9bc96c4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:23.278120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a495ed6-b46c-46d9-b842-ac30b9bc96c4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:23.279334 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a495ed6-b46c-46d9-b842-ac30b9bc96c4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:23.282991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a495ed6-b46c-46d9-b842-ac30b9bc96c4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:23.285781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a495ed6-b46c-46d9-b842-ac30b9bc96c4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:23.286464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a495ed6-b46c-46d9-b842-ac30b9bc96c4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:23.773553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1a495ed6-b46c-46d9-b842-ac30b9bc96c4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:23.783973 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1a495ed6-b46c-46d9-b842-ac30b9bc96c4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1317 microversion: 2.1 time: 0.540628 Oct 29 01:29:23.789433 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2581/5389] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:23 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1317 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:23.819837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3fdcfeeb-a990-4515-b5c2-a4cbb2a20bca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:23.821373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3fdcfeeb-a990-4515-b5c2-a4cbb2a20bca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:23.835192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3fdcfeeb-a990-4515-b5c2-a4cbb2a20bca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:23.835192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3fdcfeeb-a990-4515-b5c2-a4cbb2a20bca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:23.835645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3fdcfeeb-a990-4515-b5c2-a4cbb2a20bca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:23.836424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3fdcfeeb-a990-4515-b5c2-a4cbb2a20bca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:23.839501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3fdcfeeb-a990-4515-b5c2-a4cbb2a20bca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:23.839885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3fdcfeeb-a990-4515-b5c2-a4cbb2a20bca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:24.039320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3fdcfeeb-a990-4515-b5c2-a4cbb2a20bca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:24.054873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3fdcfeeb-a990-4515-b5c2-a4cbb2a20bca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:24.061452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3fdcfeeb-a990-4515-b5c2-a4cbb2a20bca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:24.063600 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3fdcfeeb-a990-4515-b5c2-a4cbb2a20bca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.248594 Oct 29 01:29:24.064427 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2809/5390] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:23 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:24.824008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2c883f82-15ef-4220-8513-34d616b56dc6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:24.824008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2c883f82-15ef-4220-8513-34d616b56dc6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:24.852055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c883f82-15ef-4220-8513-34d616b56dc6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:24.852055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c883f82-15ef-4220-8513-34d616b56dc6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:24.852055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c883f82-15ef-4220-8513-34d616b56dc6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:24.852055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c883f82-15ef-4220-8513-34d616b56dc6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:24.852646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c883f82-15ef-4220-8513-34d616b56dc6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:24.853086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2c883f82-15ef-4220-8513-34d616b56dc6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:25.090104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e359997-6058-4ebb-9a1b-ae2652ec36ca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:25.090721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e359997-6058-4ebb-9a1b-ae2652ec36ca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:25.105690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e359997-6058-4ebb-9a1b-ae2652ec36ca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:25.106245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e359997-6058-4ebb-9a1b-ae2652ec36ca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:25.111255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e359997-6058-4ebb-9a1b-ae2652ec36ca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:25.113063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e359997-6058-4ebb-9a1b-ae2652ec36ca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:25.113586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e359997-6058-4ebb-9a1b-ae2652ec36ca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:25.114025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e359997-6058-4ebb-9a1b-ae2652ec36ca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:25.284089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8e359997-6058-4ebb-9a1b-ae2652ec36ca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:25.298806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8e359997-6058-4ebb-9a1b-ae2652ec36ca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:25.300249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8e359997-6058-4ebb-9a1b-ae2652ec36ca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:25.301695 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8e359997-6058-4ebb-9a1b-ae2652ec36ca tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.215833 Oct 29 01:29:25.302268 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2810/5391] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:25 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:25.313984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2c883f82-15ef-4220-8513-34d616b56dc6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:25.322851 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2c883f82-15ef-4220-8513-34d616b56dc6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1317 microversion: 2.1 time: 0.505290 Oct 29 01:29:25.324495 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2582/5392] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:24 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:26.161844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-cc990609-3dc1-4060-9dc7-22011ea234d0 req-353524a8-462d-434d-9d70-8f0e82c0a293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3caef7a-fea6-4d7b-992f-78001494a729", "name": "network-vif-plugged", "status": "completed", "tag": "6e1dac29-d12e-4181-9daa-b2283db7de98"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:26.182902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cc990609-3dc1-4060-9dc7-22011ea234d0 req-353524a8-462d-434d-9d70-8f0e82c0a293 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:26.183691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cc990609-3dc1-4060-9dc7-22011ea234d0 req-353524a8-462d-434d-9d70-8f0e82c0a293 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:26.188160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cc990609-3dc1-4060-9dc7-22011ea234d0 req-353524a8-462d-434d-9d70-8f0e82c0a293 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:26.217989 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-cc990609-3dc1-4060-9dc7-22011ea234d0 req-353524a8-462d-434d-9d70-8f0e82c0a293 service nova] Creating event network-vif-plugged:6e1dac29-d12e-4181-9daa-b2283db7de98 for instance a3caef7a-fea6-4d7b-992f-78001494a729 on n-h1-862964-3 Oct 29 01:29:26.230519 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-cc990609-3dc1-4060-9dc7-22011ea234d0 req-353524a8-462d-434d-9d70-8f0e82c0a293 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073266 Oct 29 01:29:26.235167 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2811/5393] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:29:26.354042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9dbc9621-de3e-4c75-ae5b-23527e62b64e tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:26.354042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9dbc9621-de3e-4c75-ae5b-23527e62b64e tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:26.361787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-93147e9f-cb67-4f83-80e1-532897626001 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:26.367045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-93147e9f-cb67-4f83-80e1-532897626001 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:26.391460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dbc9621-de3e-4c75-ae5b-23527e62b64e tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:26.392823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dbc9621-de3e-4c75-ae5b-23527e62b64e tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:26.394444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93147e9f-cb67-4f83-80e1-532897626001 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:26.397513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dbc9621-de3e-4c75-ae5b-23527e62b64e tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:26.397513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dbc9621-de3e-4c75-ae5b-23527e62b64e tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:26.397513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dbc9621-de3e-4c75-ae5b-23527e62b64e tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:26.397513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dbc9621-de3e-4c75-ae5b-23527e62b64e tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:26.399706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93147e9f-cb67-4f83-80e1-532897626001 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:26.400386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93147e9f-cb67-4f83-80e1-532897626001 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:26.404173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93147e9f-cb67-4f83-80e1-532897626001 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:26.404968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93147e9f-cb67-4f83-80e1-532897626001 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:26.405642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-93147e9f-cb67-4f83-80e1-532897626001 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:26.741669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9dbc9621-de3e-4c75-ae5b-23527e62b64e tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:26.751757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9dbc9621-de3e-4c75-ae5b-23527e62b64e tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:26.769393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9dbc9621-de3e-4c75-ae5b-23527e62b64e tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:26.769393 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9dbc9621-de3e-4c75-ae5b-23527e62b64e tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.409512 Oct 29 01:29:26.770874 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2583/5394] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:26 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:26.832132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-93147e9f-cb67-4f83-80e1-532897626001 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:26.843870 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-93147e9f-cb67-4f83-80e1-532897626001 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1317 microversion: 2.1 time: 0.496991 Oct 29 01:29:26.847031 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2812/5395] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:26 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:27.787796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aa733009-54f7-4b1f-b1b5-41b8e3f2f17a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:27.787796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aa733009-54f7-4b1f-b1b5-41b8e3f2f17a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:27.791540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:29:27.796632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa733009-54f7-4b1f-b1b5-41b8e3f2f17a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:27.797828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa733009-54f7-4b1f-b1b5-41b8e3f2f17a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:27.798559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa733009-54f7-4b1f-b1b5-41b8e3f2f17a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:27.809403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa733009-54f7-4b1f-b1b5-41b8e3f2f17a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:27.810469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa733009-54f7-4b1f-b1b5-41b8e3f2f17a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:27.815354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa733009-54f7-4b1f-b1b5-41b8e3f2f17a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:27.884430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3f3336ad-b95e-413c-9079-e843800ae79b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:27.888341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3f3336ad-b95e-413c-9079-e843800ae79b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:27.919090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aa733009-54f7-4b1f-b1b5-41b8e3f2f17a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:27.922420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f3336ad-b95e-413c-9079-e843800ae79b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:27.923394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:29:27.929943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f3336ad-b95e-413c-9079-e843800ae79b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:27.936008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f3336ad-b95e-413c-9079-e843800ae79b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:27.936008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f3336ad-b95e-413c-9079-e843800ae79b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:27.936008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f3336ad-b95e-413c-9079-e843800ae79b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:27.936008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f3336ad-b95e-413c-9079-e843800ae79b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:27.936651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aa733009-54f7-4b1f-b1b5-41b8e3f2f17a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:27.938721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aa733009-54f7-4b1f-b1b5-41b8e3f2f17a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:27.940316 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aa733009-54f7-4b1f-b1b5-41b8e3f2f17a tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.160671 Oct 29 01:29:27.954639 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2584/5396] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:27 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:28.868420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3f3336ad-b95e-413c-9079-e843800ae79b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:28.886966 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3f3336ad-b95e-413c-9079-e843800ae79b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1317 microversion: 2.1 time: 1.008910 Oct 29 01:29:28.894831 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2813/5397] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:27 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1317 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:28.972431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-63c5d6d9-46cf-4b18-bfbe-865feb8835ef tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:28.973244 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-63c5d6d9-46cf-4b18-bfbe-865feb8835ef tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:28.997572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63c5d6d9-46cf-4b18-bfbe-865feb8835ef tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:28.998268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63c5d6d9-46cf-4b18-bfbe-865feb8835ef tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:29.009523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63c5d6d9-46cf-4b18-bfbe-865feb8835ef tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:29.009523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63c5d6d9-46cf-4b18-bfbe-865feb8835ef tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:29.009523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63c5d6d9-46cf-4b18-bfbe-865feb8835ef tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:29.009523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63c5d6d9-46cf-4b18-bfbe-865feb8835ef tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:29.298017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-63c5d6d9-46cf-4b18-bfbe-865feb8835ef tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:29.316702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-63c5d6d9-46cf-4b18-bfbe-865feb8835ef tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:29.320869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-63c5d6d9-46cf-4b18-bfbe-865feb8835ef tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:29.325230 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-63c5d6d9-46cf-4b18-bfbe-865feb8835ef tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1409 microversion: 2.54 time: 0.358198 Oct 29 01:29:29.331621 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2585/5398] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:28 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1409 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:29.921891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6c19ce97-c5cc-4b60-8ef9-c4c20231dd1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:29.923935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6c19ce97-c5cc-4b60-8ef9-c4c20231dd1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:29.935534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c19ce97-c5cc-4b60-8ef9-c4c20231dd1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:29.936345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c19ce97-c5cc-4b60-8ef9-c4c20231dd1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:29.937051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c19ce97-c5cc-4b60-8ef9-c4c20231dd1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:29.938492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c19ce97-c5cc-4b60-8ef9-c4c20231dd1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:29.940057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c19ce97-c5cc-4b60-8ef9-c4c20231dd1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:29.940738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6c19ce97-c5cc-4b60-8ef9-c4c20231dd1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:30.361703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d19935bb-e0af-4730-b6e7-b2042618efcc tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:30.362318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d19935bb-e0af-4730-b6e7-b2042618efcc tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:30.380635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d19935bb-e0af-4730-b6e7-b2042618efcc tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:30.381843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d19935bb-e0af-4730-b6e7-b2042618efcc tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:30.386221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d19935bb-e0af-4730-b6e7-b2042618efcc tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:30.388580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d19935bb-e0af-4730-b6e7-b2042618efcc tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:30.389082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d19935bb-e0af-4730-b6e7-b2042618efcc tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:30.394560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d19935bb-e0af-4730-b6e7-b2042618efcc tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:30.502671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6c19ce97-c5cc-4b60-8ef9-c4c20231dd1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:30.525443 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6c19ce97-c5cc-4b60-8ef9-c4c20231dd1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1506 microversion: 2.1 time: 0.609098 Oct 29 01:29:30.558583 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2814/5399] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:29 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1506 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:30.582188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1d1ed20f-9b4a-4914-b7a6-ef5c88f6889f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:30.582809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1d1ed20f-9b4a-4914-b7a6-ef5c88f6889f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:30.600601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d1ed20f-9b4a-4914-b7a6-ef5c88f6889f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:30.602152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d1ed20f-9b4a-4914-b7a6-ef5c88f6889f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:30.603212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d1ed20f-9b4a-4914-b7a6-ef5c88f6889f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:30.605173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d1ed20f-9b4a-4914-b7a6-ef5c88f6889f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:30.605838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d1ed20f-9b4a-4914-b7a6-ef5c88f6889f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:30.606437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d1ed20f-9b4a-4914-b7a6-ef5c88f6889f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:30.772872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d19935bb-e0af-4730-b6e7-b2042618efcc tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:30.784967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d19935bb-e0af-4730-b6e7-b2042618efcc tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:30.792089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d19935bb-e0af-4730-b6e7-b2042618efcc tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:30.794277 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d19935bb-e0af-4730-b6e7-b2042618efcc tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1427 microversion: 2.54 time: 0.442083 Oct 29 01:29:30.795044 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2586/5400] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:30 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1427 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:31.019601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a0e0a7df-9f9e-433c-9705-2c8703d69904 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-923221390", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "51fa6aca-8163-4c2a-9037-a8a6fba8ff11"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:31.123304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-a0e0a7df-9f9e-433c-9705-2c8703d69904 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] validate_networks() for [('51fa6aca-8163-4c2a-9037-a8a6fba8ff11', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:29:31.303324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1d1ed20f-9b4a-4914-b7a6-ef5c88f6889f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:31.316538 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1d1ed20f-9b4a-4914-b7a6-ef5c88f6889f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1506 microversion: 2.1 time: 0.754385 Oct 29 01:29:31.317296 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2815/5401] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:30 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1506 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:31.340688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "OS-DCF:diskConfig": "AUTO"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:31.345967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:31.382846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:31.383641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:31.385622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:31.391667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:31.392153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:31.395854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:31.587322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:29:31.587981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:29:31.588672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:29:31.589402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:29:31.589983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:29:31.860378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:31.879435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:31.880234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:31.880884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:31.882097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:31.882778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:31.883407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:31.940595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:29:31.952476 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7796f6c6-d897-4467-a5ee-33f166b62d80 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "POST /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729/action" status: 202 len: 1108 microversion: 2.1 time: 0.616318 Oct 29 01:29:31.970341 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2816/5402] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:29:31 2022] POST /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729/action => generated 1108 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 29 01:29:31.978245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1e9c4a71-0d7d-4e90-b1e7-0b9a4d948257 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:31.979245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1e9c4a71-0d7d-4e90-b1e7-0b9a4d948257 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:31.988098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e9c4a71-0d7d-4e90-b1e7-0b9a4d948257 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:31.988872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e9c4a71-0d7d-4e90-b1e7-0b9a4d948257 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:31.989515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e9c4a71-0d7d-4e90-b1e7-0b9a4d948257 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:31.992389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e9c4a71-0d7d-4e90-b1e7-0b9a4d948257 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:31.993317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e9c4a71-0d7d-4e90-b1e7-0b9a4d948257 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:31.994462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e9c4a71-0d7d-4e90-b1e7-0b9a4d948257 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:32.209787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1e9c4a71-0d7d-4e90-b1e7-0b9a4d948257 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:32.227254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1e9c4a71-0d7d-4e90-b1e7-0b9a4d948257 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:32.234693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1e9c4a71-0d7d-4e90-b1e7-0b9a4d948257 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:32.235962 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1e9c4a71-0d7d-4e90-b1e7-0b9a4d948257 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1415 microversion: 2.54 time: 0.264506 Oct 29 01:29:32.251762 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2817/5403] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:31 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1415 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:32.264039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ec197742-2ee5-46e8-9315-c1e45e92a796 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:32.264677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ec197742-2ee5-46e8-9315-c1e45e92a796 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:32.297532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec197742-2ee5-46e8-9315-c1e45e92a796 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:32.298041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec197742-2ee5-46e8-9315-c1e45e92a796 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:32.298483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec197742-2ee5-46e8-9315-c1e45e92a796 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:32.316196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec197742-2ee5-46e8-9315-c1e45e92a796 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:32.316196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec197742-2ee5-46e8-9315-c1e45e92a796 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:32.316196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec197742-2ee5-46e8-9315-c1e45e92a796 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:32.808361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-a0e0a7df-9f9e-433c-9705-2c8703d69904 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:29:32.808934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-a0e0a7df-9f9e-433c-9705-2c8703d69904 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:29:32.809441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-a0e0a7df-9f9e-433c-9705-2c8703d69904 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:29:32.810128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-a0e0a7df-9f9e-433c-9705-2c8703d69904 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:29:32.810611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-a0e0a7df-9f9e-433c-9705-2c8703d69904 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:29:32.831691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0e0a7df-9f9e-433c-9705-2c8703d69904 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:32.837965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0e0a7df-9f9e-433c-9705-2c8703d69904 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:32.839235 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0e0a7df-9f9e-433c-9705-2c8703d69904 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:32.840261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0e0a7df-9f9e-433c-9705-2c8703d69904 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:32.840913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0e0a7df-9f9e-433c-9705-2c8703d69904 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:32.841560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a0e0a7df-9f9e-433c-9705-2c8703d69904 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:32.871351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ec197742-2ee5-46e8-9315-c1e45e92a796 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:32.893662 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ec197742-2ee5-46e8-9315-c1e45e92a796 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1513 microversion: 2.1 time: 0.639512 Oct 29 01:29:32.897298 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2818/5404] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:32 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1513 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:32.914001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-a0e0a7df-9f9e-433c-9705-2c8703d69904 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Getting quotas for project b964721634574d67b9c0c7b04d5ac900. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:29:32.929588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-a0e0a7df-9f9e-433c-9705-2c8703d69904 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Getting quotas for user 81617b47018b4885962ee7677d669a57 and project b964721634574d67b9c0c7b04d5ac900. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:29:32.957958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a0e0a7df-9f9e-433c-9705-2c8703d69904 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:29:32.961147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a0e0a7df-9f9e-433c-9705-2c8703d69904 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:29:33.170300 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a0e0a7df-9f9e-433c-9705-2c8703d69904 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.367936 Oct 29 01:29:33.172587 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2587/5405] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:29:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:29:33.184984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-48445fd6-f5c9-4b57-87c8-b579eb779edc tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:33.186373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-48445fd6-f5c9-4b57-87c8-b579eb779edc tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:33.279365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1ddfe4c3-f6d7-44a9-a92f-878deaf5cc32 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:33.280197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1ddfe4c3-f6d7-44a9-a92f-878deaf5cc32 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:33.304582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ddfe4c3-f6d7-44a9-a92f-878deaf5cc32 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:33.305549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ddfe4c3-f6d7-44a9-a92f-878deaf5cc32 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:33.306121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ddfe4c3-f6d7-44a9-a92f-878deaf5cc32 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:33.312222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ddfe4c3-f6d7-44a9-a92f-878deaf5cc32 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:33.313021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ddfe4c3-f6d7-44a9-a92f-878deaf5cc32 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:33.319903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ddfe4c3-f6d7-44a9-a92f-878deaf5cc32 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:33.576828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1ddfe4c3-f6d7-44a9-a92f-878deaf5cc32 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:33.593673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1ddfe4c3-f6d7-44a9-a92f-878deaf5cc32 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:33.597545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1ddfe4c3-f6d7-44a9-a92f-878deaf5cc32 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:33.609551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-48445fd6-f5c9-4b57-87c8-b579eb779edc tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81617b47018b4885962ee7677d669a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b964721634574d67b9c0c7b04d5ac900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:33.626502 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-48445fd6-f5c9-4b57-87c8-b579eb779edc tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534" status: 200 len: 1215 microversion: 2.1 time: 0.439165 Oct 29 01:29:33.626502 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2819/5406] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:33 2022] GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534 => generated 1215 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:33.641511 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1ddfe4c3-f6d7-44a9-a92f-878deaf5cc32 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1415 microversion: 2.54 time: 0.362451 Oct 29 01:29:33.646534 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2588/5407] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:33 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1415 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:29:33.926470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3036db8a-2fa4-4da5-bf98-84c952cc1775 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:33.929408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3036db8a-2fa4-4da5-bf98-84c952cc1775 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:33.943909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3036db8a-2fa4-4da5-bf98-84c952cc1775 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:33.943909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3036db8a-2fa4-4da5-bf98-84c952cc1775 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:33.948649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3036db8a-2fa4-4da5-bf98-84c952cc1775 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:33.951769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3036db8a-2fa4-4da5-bf98-84c952cc1775 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:33.954034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3036db8a-2fa4-4da5-bf98-84c952cc1775 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:33.954504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3036db8a-2fa4-4da5-bf98-84c952cc1775 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:34.425809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3036db8a-2fa4-4da5-bf98-84c952cc1775 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:34.442217 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3036db8a-2fa4-4da5-bf98-84c952cc1775 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1513 microversion: 2.1 time: 0.520730 Oct 29 01:29:34.445789 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2820/5408] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:33 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1513 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:34.651700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1e5b0898-97fe-4f40-9cb1-7a913b4dd2ee tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:34.654122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1e5b0898-97fe-4f40-9cb1-7a913b4dd2ee tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:34.688101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3f2c2642-0f99-405e-8377-12bfa01a9536 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:34.689223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3f2c2642-0f99-405e-8377-12bfa01a9536 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:34.712505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f2c2642-0f99-405e-8377-12bfa01a9536 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:34.720129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f2c2642-0f99-405e-8377-12bfa01a9536 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:34.723313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f2c2642-0f99-405e-8377-12bfa01a9536 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:34.730512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f2c2642-0f99-405e-8377-12bfa01a9536 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:34.738329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f2c2642-0f99-405e-8377-12bfa01a9536 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:34.739029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3f2c2642-0f99-405e-8377-12bfa01a9536 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:34.963613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3f2c2642-0f99-405e-8377-12bfa01a9536 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:34.974608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3f2c2642-0f99-405e-8377-12bfa01a9536 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:34.976117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3f2c2642-0f99-405e-8377-12bfa01a9536 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:34.977400 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3f2c2642-0f99-405e-8377-12bfa01a9536 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1415 microversion: 2.54 time: 0.295313 Oct 29 01:29:34.997736 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2821/5409] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:34 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1415 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:35.023936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1e5b0898-97fe-4f40-9cb1-7a913b4dd2ee tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81617b47018b4885962ee7677d669a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b964721634574d67b9c0c7b04d5ac900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:35.038213 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1e5b0898-97fe-4f40-9cb1-7a913b4dd2ee tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534" status: 200 len: 1215 microversion: 2.1 time: 0.394025 Oct 29 01:29:35.038989 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2589/5410] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:34 2022] GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534 => generated 1215 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:35.476058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-37dc3e1f-a7a0-474b-b3a4-aba0b48e1eaf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:35.476683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-37dc3e1f-a7a0-474b-b3a4-aba0b48e1eaf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:35.488706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37dc3e1f-a7a0-474b-b3a4-aba0b48e1eaf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:35.495784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37dc3e1f-a7a0-474b-b3a4-aba0b48e1eaf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:35.495784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37dc3e1f-a7a0-474b-b3a4-aba0b48e1eaf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:35.495784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37dc3e1f-a7a0-474b-b3a4-aba0b48e1eaf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:35.495784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37dc3e1f-a7a0-474b-b3a4-aba0b48e1eaf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:35.518269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37dc3e1f-a7a0-474b-b3a4-aba0b48e1eaf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:35.928751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-37dc3e1f-a7a0-474b-b3a4-aba0b48e1eaf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:35.939159 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-37dc3e1f-a7a0-474b-b3a4-aba0b48e1eaf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1513 microversion: 2.1 time: 0.471172 Oct 29 01:29:35.949126 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2822/5411] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:35 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1513 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:36.009832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f5e674df-c98b-4815-9f14-d3fdbd747e56 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:36.009832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f5e674df-c98b-4815-9f14-d3fdbd747e56 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:36.023584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5e674df-c98b-4815-9f14-d3fdbd747e56 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:36.024084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5e674df-c98b-4815-9f14-d3fdbd747e56 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:36.032571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5e674df-c98b-4815-9f14-d3fdbd747e56 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:36.033811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5e674df-c98b-4815-9f14-d3fdbd747e56 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:36.034822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5e674df-c98b-4815-9f14-d3fdbd747e56 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:36.035934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5e674df-c98b-4815-9f14-d3fdbd747e56 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:36.068619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-70009a94-1d3d-4b79-a10b-832e2e41ea89 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:36.069276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-70009a94-1d3d-4b79-a10b-832e2e41ea89 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:36.080236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70009a94-1d3d-4b79-a10b-832e2e41ea89 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:36.080743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70009a94-1d3d-4b79-a10b-832e2e41ea89 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:36.081215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70009a94-1d3d-4b79-a10b-832e2e41ea89 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:36.081938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70009a94-1d3d-4b79-a10b-832e2e41ea89 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:36.082398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70009a94-1d3d-4b79-a10b-832e2e41ea89 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:36.085605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70009a94-1d3d-4b79-a10b-832e2e41ea89 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:36.209787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f5e674df-c98b-4815-9f14-d3fdbd747e56 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:36.228245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f5e674df-c98b-4815-9f14-d3fdbd747e56 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:36.230224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f5e674df-c98b-4815-9f14-d3fdbd747e56 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:36.231689 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f5e674df-c98b-4815-9f14-d3fdbd747e56 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1400 microversion: 2.54 time: 0.231453 Oct 29 01:29:36.252801 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2590/5412] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:35 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1400 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:36.259659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-62d2361c-c66b-4e49-93f1-70d54484a1e0 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '.version_select at 0x7f9d97a094c0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:36.336617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-70009a94-1d3d-4b79-a10b-832e2e41ea89 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81617b47018b4885962ee7677d669a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b964721634574d67b9c0c7b04d5ac900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:36.347053 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-70009a94-1d3d-4b79-a10b-832e2e41ea89 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534" status: 200 len: 1267 microversion: 2.1 time: 0.282893 Oct 29 01:29:36.348381 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2823/5413] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:36 2022] GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534 => generated 1267 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:36.386311 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-62d2361c-c66b-4e49-93f1-70d54484a1e0 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2122988442" status: 204 len: 0 microversion: 2.54 time: 0.130365 Oct 29 01:29:36.387176 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2591/5414] 10.222.0.26 () {60 vars in 1319 bytes} [Sat Oct 29 01:29:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2122988442 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 29 01:29:36.404435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a30f82cf-7220-4b9e-8f54-8b929c8b2a5d tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:36.405263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a30f82cf-7220-4b9e-8f54-8b929c8b2a5d tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:36.415246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a30f82cf-7220-4b9e-8f54-8b929c8b2a5d tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:36.415745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a30f82cf-7220-4b9e-8f54-8b929c8b2a5d tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:36.416182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a30f82cf-7220-4b9e-8f54-8b929c8b2a5d tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:36.419977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a30f82cf-7220-4b9e-8f54-8b929c8b2a5d tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:36.419977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a30f82cf-7220-4b9e-8f54-8b929c8b2a5d tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:36.419977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a30f82cf-7220-4b9e-8f54-8b929c8b2a5d tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:36.486526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a30f82cf-7220-4b9e-8f54-8b929c8b2a5d tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:29:36.920203 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a30f82cf-7220-4b9e-8f54-8b929c8b2a5d tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 204 len: 0 microversion: 2.54 time: 0.520998 Oct 29 01:29:36.921255 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2824/5415] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:29:36 2022] DELETE /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:29:36.930185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d3afd7da-d707-43f5-9afb-f247985cefc6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:36.930841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d3afd7da-d707-43f5-9afb-f247985cefc6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:36.943048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3afd7da-d707-43f5-9afb-f247985cefc6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:36.943655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3afd7da-d707-43f5-9afb-f247985cefc6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:36.947875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3afd7da-d707-43f5-9afb-f247985cefc6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:36.948575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3afd7da-d707-43f5-9afb-f247985cefc6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:36.948575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3afd7da-d707-43f5-9afb-f247985cefc6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:36.949021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d3afd7da-d707-43f5-9afb-f247985cefc6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:36.977477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ac54a7df-86f8-4fbe-b03f-d62ce5449e3e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:36.978265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ac54a7df-86f8-4fbe-b03f-d62ce5449e3e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:36.990311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac54a7df-86f8-4fbe-b03f-d62ce5449e3e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:36.992828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac54a7df-86f8-4fbe-b03f-d62ce5449e3e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:36.993494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac54a7df-86f8-4fbe-b03f-d62ce5449e3e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:36.999063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac54a7df-86f8-4fbe-b03f-d62ce5449e3e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:37.001397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac54a7df-86f8-4fbe-b03f-d62ce5449e3e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:37.001833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac54a7df-86f8-4fbe-b03f-d62ce5449e3e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:37.595050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d3afd7da-d707-43f5-9afb-f247985cefc6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:37.608228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d3afd7da-d707-43f5-9afb-f247985cefc6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:37.610843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d3afd7da-d707-43f5-9afb-f247985cefc6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:37.613086 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d3afd7da-d707-43f5-9afb-f247985cefc6 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1406 microversion: 2.54 time: 0.687376 Oct 29 01:29:37.629178 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2592/5416] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:36 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1406 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:37.634458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-92235375-e551-4fec-bb83-3a3f1fb53e3a tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:37.635589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-92235375-e551-4fec-bb83-3a3f1fb53e3a tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:37.642543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-92235375-e551-4fec-bb83-3a3f1fb53e3a tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:37.643788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-92235375-e551-4fec-bb83-3a3f1fb53e3a tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:37.644243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-92235375-e551-4fec-bb83-3a3f1fb53e3a tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:37.644957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-92235375-e551-4fec-bb83-3a3f1fb53e3a tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:37.645463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-92235375-e551-4fec-bb83-3a3f1fb53e3a tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:37.645894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-92235375-e551-4fec-bb83-3a3f1fb53e3a tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:37.900977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ac54a7df-86f8-4fbe-b03f-d62ce5449e3e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:37.910578 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ac54a7df-86f8-4fbe-b03f-d62ce5449e3e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1513 microversion: 2.1 time: 0.938720 Oct 29 01:29:37.911172 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2825/5417] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:36 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1513 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:37.945466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-92235375-e551-4fec-bb83-3a3f1fb53e3a tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81617b47018b4885962ee7677d669a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b964721634574d67b9c0c7b04d5ac900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:37.962734 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-92235375-e551-4fec-bb83-3a3f1fb53e3a tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534" status: 200 len: 1273 microversion: 2.1 time: 0.336260 Oct 29 01:29:37.963390 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2593/5418] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:37 2022] GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534 => generated 1273 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:38.641778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c7ef43c3-511c-49fa-8596-e9bfa3bf9457 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:38.642445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c7ef43c3-511c-49fa-8596-e9bfa3bf9457 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:38.668312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7ef43c3-511c-49fa-8596-e9bfa3bf9457 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:38.669109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7ef43c3-511c-49fa-8596-e9bfa3bf9457 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:38.671996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7ef43c3-511c-49fa-8596-e9bfa3bf9457 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:38.672993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7ef43c3-511c-49fa-8596-e9bfa3bf9457 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:38.676816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7ef43c3-511c-49fa-8596-e9bfa3bf9457 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:38.676816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c7ef43c3-511c-49fa-8596-e9bfa3bf9457 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:38.942723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-702c0184-2b5e-4183-8ae9-4d395a4cbb0d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:38.943342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-702c0184-2b5e-4183-8ae9-4d395a4cbb0d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:38.954900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-702c0184-2b5e-4183-8ae9-4d395a4cbb0d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:38.957709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-702c0184-2b5e-4183-8ae9-4d395a4cbb0d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:38.958735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-702c0184-2b5e-4183-8ae9-4d395a4cbb0d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:38.961670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-702c0184-2b5e-4183-8ae9-4d395a4cbb0d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:38.963009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-702c0184-2b5e-4183-8ae9-4d395a4cbb0d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:38.964358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-702c0184-2b5e-4183-8ae9-4d395a4cbb0d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:39.628154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c7ef43c3-511c-49fa-8596-e9bfa3bf9457 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:39.642478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c7ef43c3-511c-49fa-8596-e9bfa3bf9457 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:39.650646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c7ef43c3-511c-49fa-8596-e9bfa3bf9457 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c0cda7d648946818a9090e194b2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b14c66b575a4b95b1c85a0073e553b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:39.653103 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c7ef43c3-511c-49fa-8596-e9bfa3bf9457 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 200 len: 1406 microversion: 2.54 time: 1.015716 Oct 29 01:29:39.660125 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2826/5419] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:38 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 1406 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:39.665510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4f6075f8-19e2-4be1-ac12-edd27ffa4f3d tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:39.669791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4f6075f8-19e2-4be1-ac12-edd27ffa4f3d tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:39.685272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f6075f8-19e2-4be1-ac12-edd27ffa4f3d tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:39.686128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f6075f8-19e2-4be1-ac12-edd27ffa4f3d tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:39.688850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f6075f8-19e2-4be1-ac12-edd27ffa4f3d tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:39.689916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f6075f8-19e2-4be1-ac12-edd27ffa4f3d tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:39.692228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f6075f8-19e2-4be1-ac12-edd27ffa4f3d tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:39.692844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f6075f8-19e2-4be1-ac12-edd27ffa4f3d tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:39.839900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-702c0184-2b5e-4183-8ae9-4d395a4cbb0d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:39.851008 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-702c0184-2b5e-4183-8ae9-4d395a4cbb0d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1513 microversion: 2.1 time: 0.914671 Oct 29 01:29:39.855363 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2594/5420] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:38 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1513 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:40.021487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4f6075f8-19e2-4be1-ac12-edd27ffa4f3d tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81617b47018b4885962ee7677d669a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b964721634574d67b9c0c7b04d5ac900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:40.035030 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4f6075f8-19e2-4be1-ac12-edd27ffa4f3d tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534" status: 200 len: 1315 microversion: 2.1 time: 0.373430 Oct 29 01:29:40.039477 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2827/5421] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:39 2022] GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:40.687656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6467a9ec-3010-41c6-abed-deec46bcf055 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:40.688349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6467a9ec-3010-41c6-abed-deec46bcf055 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] [instance: c68b2781-49f5-4547-ba3d-d76d61828fb1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:40.695706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6467a9ec-3010-41c6-abed-deec46bcf055 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:40.696496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6467a9ec-3010-41c6-abed-deec46bcf055 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:40.697196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6467a9ec-3010-41c6-abed-deec46bcf055 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:40.698161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6467a9ec-3010-41c6-abed-deec46bcf055 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:40.698824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6467a9ec-3010-41c6-abed-deec46bcf055 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:40.699524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6467a9ec-3010-41c6-abed-deec46bcf055 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:40.717054 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-6467a9ec-3010-41c6-abed-deec46bcf055 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] HTTP exception thrown: Instance c68b2781-49f5-4547-ba3d-d76d61828fb1 could not be found. Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6467a9ec-3010-41c6-abed-deec46bcf055 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Request method failure captured: Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 HTTP/1.1 Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIHQQ_dZLHcywOOXF6a-E5AGDXJ92sC0IfWhwU3kdNhgp-3Go8G-GAG6k7CIFd0lJYMbZOlZ7sMu4K5ratzkf_kRuSMiJraCAQa_ZzCWjyjKSnMIwbPBKskgwcATLEVfz9RdcdZitboUmX2HFgWfJKudXGmaNxOw4hLP7ngUJh74ulw Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-Openstack-Nova-Api-Version: 2.54 Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 1b14c66b575a4b95b1c85a0073e553b9 Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerShowV254Test-1327731524 Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b14c66b575a4b95b1c85a0073e553b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1b14c66b575a4b95b1c85a0073e553b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b14c66b575a4b95b1c85a0073e553b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1b14c66b575a4b95b1c85a0073e553b9", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerShowV254Test-1327731524 Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 1b14c66b575a4b95b1c85a0073e553b9 Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerShowV254Test-1327731524 Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerShowV254Test-1327731524-project Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 5c0cda7d648946818a9090e194b2d427 Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerShowV254Test-1327731524-project Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance c68b2781-49f5-4547-ba3d-d76d61828fb1 could not be found. Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'c68b2781-49f5-4547-ba3d-d76d61828fb1'} Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c68b2781-49f5-4547-ba3d-d76d61828fb1 could not be found. Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c68b2781-49f5-4547-ba3d-d76d61828fb1 could not be found. Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:29:40.719140 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:29:40.725101 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:29:40.725101 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:29:40.725101 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:29:40.725101 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:29:40.725101 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:29:40.725101 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c68b2781-49f5-4547-ba3d-d76d61828fb1 could not be found. Oct 29 01:29:40.725101 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:29:40.730526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6467a9ec-3010-41c6-abed-deec46bcf055 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] Returning 404 to user: Instance c68b2781-49f5-4547-ba3d-d76d61828fb1 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:29:40.731717 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6467a9ec-3010-41c6-abed-deec46bcf055 tempest-ServerShowV254Test-1327731524 tempest-ServerShowV254Test-1327731524-project] 10.222.0.26 "GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1" status: 404 len: 111 microversion: 2.54 time: 0.048094 Oct 29 01:29:40.733033 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2595/5422] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:29:40 2022] GET /compute/v2.1/servers/c68b2781-49f5-4547-ba3d-d76d61828fb1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:29:40.881384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6e1ef0ec-ff9a-45aa-a587-94383921e1f0 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:40.882741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6e1ef0ec-ff9a-45aa-a587-94383921e1f0 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:40.892594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e1ef0ec-ff9a-45aa-a587-94383921e1f0 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:40.893372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e1ef0ec-ff9a-45aa-a587-94383921e1f0 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:40.894111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e1ef0ec-ff9a-45aa-a587-94383921e1f0 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:40.895266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e1ef0ec-ff9a-45aa-a587-94383921e1f0 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:40.896139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e1ef0ec-ff9a-45aa-a587-94383921e1f0 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:40.896882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e1ef0ec-ff9a-45aa-a587-94383921e1f0 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:41.030325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-919091ba-0703-49d8-8366-8a6e2dbd4cf9 req-e6126706-1d8e-4110-9f5c-668dbe64aa2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be84751-ae0a-47fe-9e20-e3851d782534", "tag": "ab1479da-7b25-4159-a747-299a12613371"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:41.045580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-919091ba-0703-49d8-8366-8a6e2dbd4cf9 req-e6126706-1d8e-4110-9f5c-668dbe64aa2a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:41.046565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-919091ba-0703-49d8-8366-8a6e2dbd4cf9 req-e6126706-1d8e-4110-9f5c-668dbe64aa2a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:41.047575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-919091ba-0703-49d8-8366-8a6e2dbd4cf9 req-e6126706-1d8e-4110-9f5c-668dbe64aa2a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:41.077055 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-919091ba-0703-49d8-8366-8a6e2dbd4cf9 req-e6126706-1d8e-4110-9f5c-668dbe64aa2a service nova] Creating event network-changed:ab1479da-7b25-4159-a747-299a12613371 for instance 0be84751-ae0a-47fe-9e20-e3851d782534 on n-h2-862964-3 Oct 29 01:29:41.084611 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-919091ba-0703-49d8-8366-8a6e2dbd4cf9 req-e6126706-1d8e-4110-9f5c-668dbe64aa2a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063777 Oct 29 01:29:41.085834 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2596/5423] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:41.092809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ad22e23e-9181-43eb-b5db-2a95f5af65a7 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:41.093893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ad22e23e-9181-43eb-b5db-2a95f5af65a7 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:41.108953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad22e23e-9181-43eb-b5db-2a95f5af65a7 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:41.110569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad22e23e-9181-43eb-b5db-2a95f5af65a7 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:41.111275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad22e23e-9181-43eb-b5db-2a95f5af65a7 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:41.112851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad22e23e-9181-43eb-b5db-2a95f5af65a7 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:41.114067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad22e23e-9181-43eb-b5db-2a95f5af65a7 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:41.115139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad22e23e-9181-43eb-b5db-2a95f5af65a7 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:41.514857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6e1ef0ec-ff9a-45aa-a587-94383921e1f0 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:41.549061 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6e1ef0ec-ff9a-45aa-a587-94383921e1f0 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1513 microversion: 2.1 time: 0.671905 Oct 29 01:29:41.550197 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2828/5424] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:40 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1513 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:41.743704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ad22e23e-9181-43eb-b5db-2a95f5af65a7 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81617b47018b4885962ee7677d669a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b964721634574d67b9c0c7b04d5ac900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:41.759741 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ad22e23e-9181-43eb-b5db-2a95f5af65a7 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534" status: 200 len: 1315 microversion: 2.1 time: 0.672324 Oct 29 01:29:41.761833 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2597/5425] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:41 2022] GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534 => generated 1315 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:42.580641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4466634e-74bf-4ef9-86d6-d8d510ee0984 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:42.581992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4466634e-74bf-4ef9-86d6-d8d510ee0984 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:42.591139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4466634e-74bf-4ef9-86d6-d8d510ee0984 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:42.598088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4466634e-74bf-4ef9-86d6-d8d510ee0984 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:42.600981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4466634e-74bf-4ef9-86d6-d8d510ee0984 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:42.604718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4466634e-74bf-4ef9-86d6-d8d510ee0984 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:42.608037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4466634e-74bf-4ef9-86d6-d8d510ee0984 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:42.608677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4466634e-74bf-4ef9-86d6-d8d510ee0984 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:42.786578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2d8f4100-a5ed-4c15-b17c-af238edd16d8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:42.788297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2d8f4100-a5ed-4c15-b17c-af238edd16d8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:42.801627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d8f4100-a5ed-4c15-b17c-af238edd16d8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:42.802425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d8f4100-a5ed-4c15-b17c-af238edd16d8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:42.803281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d8f4100-a5ed-4c15-b17c-af238edd16d8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:42.804725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d8f4100-a5ed-4c15-b17c-af238edd16d8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:42.805762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d8f4100-a5ed-4c15-b17c-af238edd16d8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:42.806509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d8f4100-a5ed-4c15-b17c-af238edd16d8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:42.905681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:29:43.047416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4466634e-74bf-4ef9-86d6-d8d510ee0984 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:43.062523 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4466634e-74bf-4ef9-86d6-d8d510ee0984 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1513 microversion: 2.1 time: 0.483724 Oct 29 01:29:43.063842 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2829/5426] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:42 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1513 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:43.154867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2d8f4100-a5ed-4c15-b17c-af238edd16d8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81617b47018b4885962ee7677d669a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b964721634574d67b9c0c7b04d5ac900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:43.163078 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2d8f4100-a5ed-4c15-b17c-af238edd16d8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534" status: 200 len: 1315 microversion: 2.1 time: 0.382815 Oct 29 01:29:43.163659 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2598/5427] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:42 2022] GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:44.089980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6e17f251-e561-49b8-807a-6468bf706bbb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:44.090802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6e17f251-e561-49b8-807a-6468bf706bbb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:44.094223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:29:44.122345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e17f251-e561-49b8-807a-6468bf706bbb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:44.122345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e17f251-e561-49b8-807a-6468bf706bbb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:44.122345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e17f251-e561-49b8-807a-6468bf706bbb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:44.122345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e17f251-e561-49b8-807a-6468bf706bbb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:44.123090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e17f251-e561-49b8-807a-6468bf706bbb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:44.123643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e17f251-e561-49b8-807a-6468bf706bbb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:44.200806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-035f516b-7ef0-4e80-941a-e2a0d8788cfd tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:44.205577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-035f516b-7ef0-4e80-941a-e2a0d8788cfd tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:44.217784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-035f516b-7ef0-4e80-941a-e2a0d8788cfd tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:44.222846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-035f516b-7ef0-4e80-941a-e2a0d8788cfd tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:44.227919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-035f516b-7ef0-4e80-941a-e2a0d8788cfd tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:44.227919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-035f516b-7ef0-4e80-941a-e2a0d8788cfd tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:44.227919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-035f516b-7ef0-4e80-941a-e2a0d8788cfd tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:44.227919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-035f516b-7ef0-4e80-941a-e2a0d8788cfd tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:45.051022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:29:45.301509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6e17f251-e561-49b8-807a-6468bf706bbb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:45.313728 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6e17f251-e561-49b8-807a-6468bf706bbb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1513 microversion: 2.1 time: 1.227654 Oct 29 01:29:45.318312 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2830/5428] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:44 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1513 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:45.326161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-035f516b-7ef0-4e80-941a-e2a0d8788cfd tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81617b47018b4885962ee7677d669a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b964721634574d67b9c0c7b04d5ac900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:45.340598 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-035f516b-7ef0-4e80-941a-e2a0d8788cfd tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534" status: 200 len: 1315 microversion: 2.1 time: 1.144673 Oct 29 01:29:45.343179 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2599/5429] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:44 2022] GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534 => generated 1315 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:46.344299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-78fbe2eb-424a-4851-a94b-9756f4b3ad92 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:46.344299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-78fbe2eb-424a-4851-a94b-9756f4b3ad92 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:46.352748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78fbe2eb-424a-4851-a94b-9756f4b3ad92 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:46.353281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78fbe2eb-424a-4851-a94b-9756f4b3ad92 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:46.353839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78fbe2eb-424a-4851-a94b-9756f4b3ad92 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:46.354608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78fbe2eb-424a-4851-a94b-9756f4b3ad92 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:46.364969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78fbe2eb-424a-4851-a94b-9756f4b3ad92 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:46.365667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78fbe2eb-424a-4851-a94b-9756f4b3ad92 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:46.374137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8157da0a-9738-490a-b923-be982b88d200 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:46.378126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8157da0a-9738-490a-b923-be982b88d200 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:46.382447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8157da0a-9738-490a-b923-be982b88d200 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:46.382942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8157da0a-9738-490a-b923-be982b88d200 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:46.383379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8157da0a-9738-490a-b923-be982b88d200 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:46.392176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8157da0a-9738-490a-b923-be982b88d200 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:46.392863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8157da0a-9738-490a-b923-be982b88d200 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:46.396497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8157da0a-9738-490a-b923-be982b88d200 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:46.778802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-78fbe2eb-424a-4851-a94b-9756f4b3ad92 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:46.795276 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-78fbe2eb-424a-4851-a94b-9756f4b3ad92 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1513 microversion: 2.1 time: 0.458861 Oct 29 01:29:46.797940 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2831/5430] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:46 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1513 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:46.813193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8157da0a-9738-490a-b923-be982b88d200 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81617b47018b4885962ee7677d669a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b964721634574d67b9c0c7b04d5ac900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:46.825392 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8157da0a-9738-490a-b923-be982b88d200 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534" status: 200 len: 1315 microversion: 2.1 time: 0.456004 Oct 29 01:29:46.827738 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2600/5431] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:46 2022] GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:47.140264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1fb8cbc0-76dd-4fea-9250-b816e876d294 tempest-ComputeTenantNetworksTest-36364313 tempest-ComputeTenantNetworksTest-36364313-project] Calling method '.version_select at 0x7f9d9fdd2ca0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:47.347530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-7083116d-85b7-49cf-8eae-fb0c1b4142f3 req-8d64acf8-e7b6-4042-8509-372b2cf0832b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be84751-ae0a-47fe-9e20-e3851d782534", "name": "network-vif-plugged", "status": "completed", "tag": "ab1479da-7b25-4159-a747-299a12613371"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:47.364065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7083116d-85b7-49cf-8eae-fb0c1b4142f3 req-8d64acf8-e7b6-4042-8509-372b2cf0832b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:47.366914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7083116d-85b7-49cf-8eae-fb0c1b4142f3 req-8d64acf8-e7b6-4042-8509-372b2cf0832b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:47.366914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7083116d-85b7-49cf-8eae-fb0c1b4142f3 req-8d64acf8-e7b6-4042-8509-372b2cf0832b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:47.377940 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-7083116d-85b7-49cf-8eae-fb0c1b4142f3 req-8d64acf8-e7b6-4042-8509-372b2cf0832b service nova] Creating event network-vif-plugged:ab1479da-7b25-4159-a747-299a12613371 for instance 0be84751-ae0a-47fe-9e20-e3851d782534 on n-h2-862964-3 Oct 29 01:29:47.383772 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-7083116d-85b7-49cf-8eae-fb0c1b4142f3 req-8d64acf8-e7b6-4042-8509-372b2cf0832b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040048 Oct 29 01:29:47.384681 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2601/5432] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:29:47.471471 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1fb8cbc0-76dd-4fea-9250-b816e876d294 tempest-ComputeTenantNetworksTest-36364313 tempest-ComputeTenantNetworksTest-36364313-project] 10.222.0.26 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.670590 Oct 29 01:29:47.482972 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2832/5433] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 29 01:29:46 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:47.501952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dd37ca9a-229b-4a69-8361-2218faec06c8 tempest-ComputeTenantNetworksTest-36364313 tempest-ComputeTenantNetworksTest-36364313-project] Calling method '.version_select at 0x7f9d9fd3fc10>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:47.707247 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dd37ca9a-229b-4a69-8361-2218faec06c8 tempest-ComputeTenantNetworksTest-36364313 tempest-ComputeTenantNetworksTest-36364313-project] 10.222.0.26 "GET /compute/v2.1/os-tenant-networks/fe154525-cc5d-41f9-b0e0-c0a31dc75995" status: 200 len: 139 microversion: 2.1 time: 0.215110 Oct 29 01:29:47.708316 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2602/5434] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 29 01:29:47 2022] GET /compute/v2.1/os-tenant-networks/fe154525-cc5d-41f9-b0e0-c0a31dc75995 => generated 139 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:47.824595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-54a17d62-ed7f-4a0f-bb9f-7c378ef25b4b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:47.825672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-54a17d62-ed7f-4a0f-bb9f-7c378ef25b4b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:47.835226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54a17d62-ed7f-4a0f-bb9f-7c378ef25b4b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:47.839567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54a17d62-ed7f-4a0f-bb9f-7c378ef25b4b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:47.841081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54a17d62-ed7f-4a0f-bb9f-7c378ef25b4b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:47.843211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54a17d62-ed7f-4a0f-bb9f-7c378ef25b4b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:47.844452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54a17d62-ed7f-4a0f-bb9f-7c378ef25b4b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:47.851016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-182f2920-c4ac-4c97-9d5c-b9f5a0c9aa32 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:47.855962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-182f2920-c4ac-4c97-9d5c-b9f5a0c9aa32 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:47.859311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54a17d62-ed7f-4a0f-bb9f-7c378ef25b4b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:47.871722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-182f2920-c4ac-4c97-9d5c-b9f5a0c9aa32 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:47.872334 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-182f2920-c4ac-4c97-9d5c-b9f5a0c9aa32 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:47.873615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-182f2920-c4ac-4c97-9d5c-b9f5a0c9aa32 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:47.876921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-182f2920-c4ac-4c97-9d5c-b9f5a0c9aa32 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:47.881804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-182f2920-c4ac-4c97-9d5c-b9f5a0c9aa32 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:47.887456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-182f2920-c4ac-4c97-9d5c-b9f5a0c9aa32 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:47.899001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:29:48.351170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-182f2920-c4ac-4c97-9d5c-b9f5a0c9aa32 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81617b47018b4885962ee7677d669a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b964721634574d67b9c0c7b04d5ac900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:48.364045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-54a17d62-ed7f-4a0f-bb9f-7c378ef25b4b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:48.374787 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-54a17d62-ed7f-4a0f-bb9f-7c378ef25b4b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1513 microversion: 2.1 time: 0.554568 Oct 29 01:29:48.378103 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-182f2920-c4ac-4c97-9d5c-b9f5a0c9aa32 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534" status: 200 len: 1315 microversion: 2.1 time: 0.530790 Oct 29 01:29:48.379231 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2603/5435] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:47 2022] GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534 => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:48.395433 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2833/5436] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:47 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1513 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:49.408565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9c06ba23-54ee-4051-b883-5dd092f048cc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:49.412996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5888f6ea-2251-49fd-8334-ded1b6745f6c tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:49.421038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9c06ba23-54ee-4051-b883-5dd092f048cc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:49.423861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5888f6ea-2251-49fd-8334-ded1b6745f6c tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:49.438031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:29:49.445105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c06ba23-54ee-4051-b883-5dd092f048cc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:49.446599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5888f6ea-2251-49fd-8334-ded1b6745f6c tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:49.447088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5888f6ea-2251-49fd-8334-ded1b6745f6c tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:49.447720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5888f6ea-2251-49fd-8334-ded1b6745f6c tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:49.448516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5888f6ea-2251-49fd-8334-ded1b6745f6c tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:49.451239 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c06ba23-54ee-4051-b883-5dd092f048cc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:49.451693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c06ba23-54ee-4051-b883-5dd092f048cc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:49.452423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c06ba23-54ee-4051-b883-5dd092f048cc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:49.452883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c06ba23-54ee-4051-b883-5dd092f048cc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:49.453348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c06ba23-54ee-4051-b883-5dd092f048cc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:49.456707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5888f6ea-2251-49fd-8334-ded1b6745f6c tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:49.457165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5888f6ea-2251-49fd-8334-ded1b6745f6c tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:50.038313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5888f6ea-2251-49fd-8334-ded1b6745f6c tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81617b47018b4885962ee7677d669a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b964721634574d67b9c0c7b04d5ac900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:50.040601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9c06ba23-54ee-4051-b883-5dd092f048cc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:50.045950 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5888f6ea-2251-49fd-8334-ded1b6745f6c tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534" status: 200 len: 1315 microversion: 2.1 time: 0.645351 Oct 29 01:29:50.051013 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9c06ba23-54ee-4051-b883-5dd092f048cc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1513 microversion: 2.1 time: 0.648405 Oct 29 01:29:50.065560 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2834/5437] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:49 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1513 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:50.065732 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2604/5438] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:49 2022] GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534 => generated 1315 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:51.087951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d0a06e07-594c-4268-9dde-f054e648fdc1 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:51.088621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d0a06e07-594c-4268-9dde-f054e648fdc1 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:51.090961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9d456532-68a4-4810-9d74-02e2eb9f0dd5 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:51.091690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9d456532-68a4-4810-9d74-02e2eb9f0dd5 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:51.104638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0a06e07-594c-4268-9dde-f054e648fdc1 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:51.110758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d456532-68a4-4810-9d74-02e2eb9f0dd5 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:51.110925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0a06e07-594c-4268-9dde-f054e648fdc1 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:51.110925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0a06e07-594c-4268-9dde-f054e648fdc1 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:51.111139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d456532-68a4-4810-9d74-02e2eb9f0dd5 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:51.111139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d456532-68a4-4810-9d74-02e2eb9f0dd5 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:51.111375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0a06e07-594c-4268-9dde-f054e648fdc1 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:51.111375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0a06e07-594c-4268-9dde-f054e648fdc1 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:51.111375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0a06e07-594c-4268-9dde-f054e648fdc1 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:51.111662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d456532-68a4-4810-9d74-02e2eb9f0dd5 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:51.111662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d456532-68a4-4810-9d74-02e2eb9f0dd5 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:51.111662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d456532-68a4-4810-9d74-02e2eb9f0dd5 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:51.359475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d0a06e07-594c-4268-9dde-f054e648fdc1 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:51.360941 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d0a06e07-594c-4268-9dde-f054e648fdc1 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1513 microversion: 2.1 time: 0.279526 Oct 29 01:29:51.374526 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2835/5439] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:51 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1513 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:51.399728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9d456532-68a4-4810-9d74-02e2eb9f0dd5 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81617b47018b4885962ee7677d669a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b964721634574d67b9c0c7b04d5ac900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:51.413408 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9d456532-68a4-4810-9d74-02e2eb9f0dd5 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534" status: 200 len: 1504 microversion: 2.1 time: 0.323582 Oct 29 01:29:51.413408 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2605/5440] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:51 2022] GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534 => generated 1504 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:51.436840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2dd53edb-8e38-43ed-badc-90b4ab14850c tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:51.437892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2dd53edb-8e38-43ed-badc-90b4ab14850c tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:51.459228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2dd53edb-8e38-43ed-badc-90b4ab14850c tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:51.461925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2dd53edb-8e38-43ed-badc-90b4ab14850c tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:51.462462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2dd53edb-8e38-43ed-badc-90b4ab14850c tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:51.465096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2dd53edb-8e38-43ed-badc-90b4ab14850c tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:51.470795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2dd53edb-8e38-43ed-badc-90b4ab14850c tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:51.470795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2dd53edb-8e38-43ed-badc-90b4ab14850c tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:51.719375 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2dd53edb-8e38-43ed-badc-90b4ab14850c tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.287968 Oct 29 01:29:51.721136 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2836/5441] 10.222.0.26 () {58 vars in 1296 bytes} [Sat Oct 29 01:29:51 2022] DELETE /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534/os-server-password => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:29:51.731184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e1d5dd4a-5024-4da6-90f3-e04b20f31924 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:51.731767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e1d5dd4a-5024-4da6-90f3-e04b20f31924 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:51.752604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1d5dd4a-5024-4da6-90f3-e04b20f31924 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:51.763716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1d5dd4a-5024-4da6-90f3-e04b20f31924 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:51.764523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1d5dd4a-5024-4da6-90f3-e04b20f31924 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:51.765522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1d5dd4a-5024-4da6-90f3-e04b20f31924 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:51.766205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1d5dd4a-5024-4da6-90f3-e04b20f31924 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:51.767705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1d5dd4a-5024-4da6-90f3-e04b20f31924 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:51.806000 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e1d5dd4a-5024-4da6-90f3-e04b20f31924 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.078156 Oct 29 01:29:51.806751 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2606/5442] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Oct 29 01:29:51 2022] GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534/os-server-password => generated 16 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:29:51.821436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dcf94447-604e-41da-aae8-15e42e508316 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:51.821436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dcf94447-604e-41da-aae8-15e42e508316 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:51.831479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcf94447-604e-41da-aae8-15e42e508316 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:51.834473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcf94447-604e-41da-aae8-15e42e508316 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:51.835443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcf94447-604e-41da-aae8-15e42e508316 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:51.839751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcf94447-604e-41da-aae8-15e42e508316 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:51.840345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcf94447-604e-41da-aae8-15e42e508316 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:51.840796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcf94447-604e-41da-aae8-15e42e508316 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:51.925388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dcf94447-604e-41da-aae8-15e42e508316 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:29:52.398647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-82af2f10-60bc-44b0-bac9-52973089b168 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:52.398647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-82af2f10-60bc-44b0-bac9-52973089b168 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:52.404468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82af2f10-60bc-44b0-bac9-52973089b168 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:52.405060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82af2f10-60bc-44b0-bac9-52973089b168 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:52.405648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82af2f10-60bc-44b0-bac9-52973089b168 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:52.406612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82af2f10-60bc-44b0-bac9-52973089b168 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:52.407207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82af2f10-60bc-44b0-bac9-52973089b168 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:52.407742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82af2f10-60bc-44b0-bac9-52973089b168 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:52.411785 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dcf94447-604e-41da-aae8-15e42e508316 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534" status: 204 len: 0 microversion: 2.1 time: 0.598349 Oct 29 01:29:52.413571 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2837/5443] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:29:51 2022] DELETE /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:29:52.428787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-46beb21a-2190-4ceb-ad0c-28fa103a42b8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:52.429824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-46beb21a-2190-4ceb-ad0c-28fa103a42b8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:52.444701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46beb21a-2190-4ceb-ad0c-28fa103a42b8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:52.445527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46beb21a-2190-4ceb-ad0c-28fa103a42b8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:52.446170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46beb21a-2190-4ceb-ad0c-28fa103a42b8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:52.447189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46beb21a-2190-4ceb-ad0c-28fa103a42b8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:52.448129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46beb21a-2190-4ceb-ad0c-28fa103a42b8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:52.448806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46beb21a-2190-4ceb-ad0c-28fa103a42b8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:52.508974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:29:53.033440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-46beb21a-2190-4ceb-ad0c-28fa103a42b8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81617b47018b4885962ee7677d669a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b964721634574d67b9c0c7b04d5ac900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:53.041581 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-46beb21a-2190-4ceb-ad0c-28fa103a42b8 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534" status: 200 len: 1510 microversion: 2.1 time: 0.617195 Oct 29 01:29:53.048946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-82af2f10-60bc-44b0-bac9-52973089b168 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:53.067153 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-82af2f10-60bc-44b0-bac9-52973089b168 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1513 microversion: 2.1 time: 0.677496 Oct 29 01:29:53.067769 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2607/5444] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:52 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1513 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:53.071147 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2838/5445] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:52 2022] GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534 => generated 1510 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:54.096150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9aaecf4b-259e-4263-bb22-68fc07dd6d75 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:54.096764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9aaecf4b-259e-4263-bb22-68fc07dd6d75 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:54.106139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8cfab966-1795-4de6-8b27-a7249c17c08e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:54.108161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8cfab966-1795-4de6-8b27-a7249c17c08e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:54.138550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9aaecf4b-259e-4263-bb22-68fc07dd6d75 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:54.139051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9aaecf4b-259e-4263-bb22-68fc07dd6d75 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:54.139498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9aaecf4b-259e-4263-bb22-68fc07dd6d75 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:54.145473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfab966-1795-4de6-8b27-a7249c17c08e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:54.145849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfab966-1795-4de6-8b27-a7249c17c08e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:54.146333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfab966-1795-4de6-8b27-a7249c17c08e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:54.146520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9aaecf4b-259e-4263-bb22-68fc07dd6d75 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:54.148594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9aaecf4b-259e-4263-bb22-68fc07dd6d75 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:54.149861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9aaecf4b-259e-4263-bb22-68fc07dd6d75 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:54.153439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfab966-1795-4de6-8b27-a7249c17c08e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:54.159208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfab966-1795-4de6-8b27-a7249c17c08e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:54.160128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfab966-1795-4de6-8b27-a7249c17c08e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:54.787879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9aaecf4b-259e-4263-bb22-68fc07dd6d75 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81617b47018b4885962ee7677d669a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b964721634574d67b9c0c7b04d5ac900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:54.800642 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9aaecf4b-259e-4263-bb22-68fc07dd6d75 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534" status: 200 len: 1510 microversion: 2.1 time: 0.706542 Oct 29 01:29:54.818346 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2839/5446] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:54 2022] GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534 => generated 1510 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:54.975255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8cfab966-1795-4de6-8b27-a7249c17c08e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:54.998994 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8cfab966-1795-4de6-8b27-a7249c17c08e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1513 microversion: 2.1 time: 0.911582 Oct 29 01:29:55.005371 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2608/5447] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:54 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1513 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:55.279409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-e2a12fed-b23e-4728-8967-98e341f70ddc req-466f4c24-6330-4586-9baa-0b5a7466bca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be84751-ae0a-47fe-9e20-e3851d782534", "name": "network-vif-deleted", "tag": "ab1479da-7b25-4159-a747-299a12613371"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:55.316692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e2a12fed-b23e-4728-8967-98e341f70ddc req-466f4c24-6330-4586-9baa-0b5a7466bca7 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:55.316692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e2a12fed-b23e-4728-8967-98e341f70ddc req-466f4c24-6330-4586-9baa-0b5a7466bca7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:55.316692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e2a12fed-b23e-4728-8967-98e341f70ddc req-466f4c24-6330-4586-9baa-0b5a7466bca7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:55.376087 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-e2a12fed-b23e-4728-8967-98e341f70ddc req-466f4c24-6330-4586-9baa-0b5a7466bca7 service nova] Creating event network-vif-deleted:ab1479da-7b25-4159-a747-299a12613371 for instance 0be84751-ae0a-47fe-9e20-e3851d782534 on n-h2-862964-3 Oct 29 01:29:55.390655 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-e2a12fed-b23e-4728-8967-98e341f70ddc req-466f4c24-6330-4586-9baa-0b5a7466bca7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116439 Oct 29 01:29:55.394403 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2840/5448] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:55.832349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a3d2da90-53f4-44ce-96c6-65822ed7dc7b tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:55.833665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a3d2da90-53f4-44ce-96c6-65822ed7dc7b tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:55.846083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3d2da90-53f4-44ce-96c6-65822ed7dc7b tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:55.846576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3d2da90-53f4-44ce-96c6-65822ed7dc7b tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:55.847013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3d2da90-53f4-44ce-96c6-65822ed7dc7b tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:55.847721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3d2da90-53f4-44ce-96c6-65822ed7dc7b tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:55.849034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3d2da90-53f4-44ce-96c6-65822ed7dc7b tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:55.849034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3d2da90-53f4-44ce-96c6-65822ed7dc7b tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:55.911656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3d2da90-53f4-44ce-96c6-65822ed7dc7b tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:55.912149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3d2da90-53f4-44ce-96c6-65822ed7dc7b tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:55.912587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3d2da90-53f4-44ce-96c6-65822ed7dc7b tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:55.913045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-a3d2da90-53f4-44ce-96c6-65822ed7dc7b tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lazy-loading 'fault' on Instance uuid 0be84751-ae0a-47fe-9e20-e3851d782534 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:29:55.987455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a3d2da90-53f4-44ce-96c6-65822ed7dc7b tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81617b47018b4885962ee7677d669a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b964721634574d67b9c0c7b04d5ac900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:56.001352 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a3d2da90-53f4-44ce-96c6-65822ed7dc7b tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534" status: 200 len: 1305 microversion: 2.1 time: 0.174661 Oct 29 01:29:56.002002 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2609/5449] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:55 2022] GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534 => generated 1305 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:56.029663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-979bf377-26b1-4e6f-864d-f20362f35e2d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:56.030377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-979bf377-26b1-4e6f-864d-f20362f35e2d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:56.040324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-979bf377-26b1-4e6f-864d-f20362f35e2d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:56.043344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-979bf377-26b1-4e6f-864d-f20362f35e2d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:56.045391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-979bf377-26b1-4e6f-864d-f20362f35e2d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:56.054217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-979bf377-26b1-4e6f-864d-f20362f35e2d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:56.054217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-979bf377-26b1-4e6f-864d-f20362f35e2d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:56.054217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-979bf377-26b1-4e6f-864d-f20362f35e2d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:56.277170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-979bf377-26b1-4e6f-864d-f20362f35e2d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:56.285183 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-979bf377-26b1-4e6f-864d-f20362f35e2d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1513 microversion: 2.1 time: 0.260573 Oct 29 01:29:56.297358 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2841/5450] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:56 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1513 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:57.031312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-20441534-4e88-48a1-8a2b-b211d67f3b43 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:57.032590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-20441534-4e88-48a1-8a2b-b211d67f3b43 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] [instance: 0be84751-ae0a-47fe-9e20-e3851d782534] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:57.076074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20441534-4e88-48a1-8a2b-b211d67f3b43 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:57.076654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20441534-4e88-48a1-8a2b-b211d67f3b43 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:57.077276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20441534-4e88-48a1-8a2b-b211d67f3b43 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:57.077896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20441534-4e88-48a1-8a2b-b211d67f3b43 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:57.078401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20441534-4e88-48a1-8a2b-b211d67f3b43 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:57.078884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-20441534-4e88-48a1-8a2b-b211d67f3b43 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:57.147465 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-20441534-4e88-48a1-8a2b-b211d67f3b43 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] HTTP exception thrown: Instance 0be84751-ae0a-47fe-9e20-e3851d782534 could not be found. Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-20441534-4e88-48a1-8a2b-b211d67f3b43 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Request method failure captured: Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534 HTTP/1.1 Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIH6cu65lZTVVU4H0cbD0qJyQu9aX-2iTpiH1hlbRBXTFtQiGgddcqz83HU41841xbikFHrnrfalncxvBry_TMgZxjQSWcoAk_pFpqB2XkyOYIGJvQ2rUmGNyXdcsHwL5LrzGZcSEybhsmuFQEYiUI-Ubxila74gWVzKlq2q8DIj9io Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: b964721634574d67b9c0c7b04d5ac900 Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerPasswordTestJSON-1967475413 Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b964721634574d67b9c0c7b04d5ac900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b964721634574d67b9c0c7b04d5ac900"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b964721634574d67b9c0c7b04d5ac900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b964721634574d67b9c0c7b04d5ac900", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerPasswordTestJSON-1967475413 Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: b964721634574d67b9c0c7b04d5ac900 Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1967475413 Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerPasswordTestJSON-1967475413-project Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 81617b47018b4885962ee7677d669a57 Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerPasswordTestJSON-1967475413-project Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 0be84751-ae0a-47fe-9e20-e3851d782534 could not be found. Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '0be84751-ae0a-47fe-9e20-e3851d782534'} Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0be84751-ae0a-47fe-9e20-e3851d782534 could not be found. Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0be84751-ae0a-47fe-9e20-e3851d782534 could not be found. Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:29:57.149308 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:29:57.157284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:29:57.157284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:29:57.157284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:29:57.157284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:29:57.157284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:29:57.157284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0be84751-ae0a-47fe-9e20-e3851d782534 could not be found. Oct 29 01:29:57.157284 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:29:57.157284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-20441534-4e88-48a1-8a2b-b211d67f3b43 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] Returning 404 to user: Instance 0be84751-ae0a-47fe-9e20-e3851d782534 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:29:57.157284 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-20441534-4e88-48a1-8a2b-b211d67f3b43 tempest-ServerPasswordTestJSON-1967475413 tempest-ServerPasswordTestJSON-1967475413-project] 10.222.0.26 "GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534" status: 404 len: 111 microversion: 2.1 time: 0.126532 Oct 29 01:29:57.158963 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2610/5451] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:57 2022] GET /compute/v2.1/servers/0be84751-ae0a-47fe-9e20-e3851d782534 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:29:57.311249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-08ce81bb-fdfe-425e-ab03-30a794ae34db tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:57.313354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-08ce81bb-fdfe-425e-ab03-30a794ae34db tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:57.332238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08ce81bb-fdfe-425e-ab03-30a794ae34db tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:57.332783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08ce81bb-fdfe-425e-ab03-30a794ae34db tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:57.333265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08ce81bb-fdfe-425e-ab03-30a794ae34db tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:57.334203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08ce81bb-fdfe-425e-ab03-30a794ae34db tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:57.334675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08ce81bb-fdfe-425e-ab03-30a794ae34db tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:57.341282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08ce81bb-fdfe-425e-ab03-30a794ae34db tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:58.256445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-08ce81bb-fdfe-425e-ab03-30a794ae34db tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:58.266199 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-08ce81bb-fdfe-425e-ab03-30a794ae34db tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1513 microversion: 2.1 time: 0.958786 Oct 29 01:29:58.271961 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2842/5452] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:57 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1513 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:59.295251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6e4450ed-8385-4998-b8ba-3d2def4bd4d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:59.296358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6e4450ed-8385-4998-b8ba-3d2def4bd4d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:29:59.304374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e4450ed-8385-4998-b8ba-3d2def4bd4d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:59.304935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e4450ed-8385-4998-b8ba-3d2def4bd4d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:59.305466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e4450ed-8385-4998-b8ba-3d2def4bd4d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:59.306383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e4450ed-8385-4998-b8ba-3d2def4bd4d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:29:59.307500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e4450ed-8385-4998-b8ba-3d2def4bd4d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:29:59.308051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e4450ed-8385-4998-b8ba-3d2def4bd4d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:29:59.864818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6e4450ed-8385-4998-b8ba-3d2def4bd4d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:59.874810 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6e4450ed-8385-4998-b8ba-3d2def4bd4d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1513 microversion: 2.1 time: 0.583554 Oct 29 01:29:59.877603 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2611/5453] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:29:59 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1513 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:00.626227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b9904d65-f998-46a9-9e8b-ea2acd8cfc13 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:00.627573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b9904d65-f998-46a9-9e8b-ea2acd8cfc13 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:00.638400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9904d65-f998-46a9-9e8b-ea2acd8cfc13 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:00.639189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9904d65-f998-46a9-9e8b-ea2acd8cfc13 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:00.640133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9904d65-f998-46a9-9e8b-ea2acd8cfc13 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:00.641390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9904d65-f998-46a9-9e8b-ea2acd8cfc13 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:00.642167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9904d65-f998-46a9-9e8b-ea2acd8cfc13 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:00.642803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b9904d65-f998-46a9-9e8b-ea2acd8cfc13 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:00.689582 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b9904d65-f998-46a9-9e8b-ea2acd8cfc13 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/ips" status: 200 len: 150 microversion: 2.1 time: 0.067192 Oct 29 01:30:00.690469 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2843/5454] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 29 01:30:00 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/ips => generated 150 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:00.902363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d5169ff7-3922-46b1-b012-93d06f067376 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:00.904480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d5169ff7-3922-46b1-b012-93d06f067376 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:00.914459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:30:00.916341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5169ff7-3922-46b1-b012-93d06f067376 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:00.918297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5169ff7-3922-46b1-b012-93d06f067376 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:00.919958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5169ff7-3922-46b1-b012-93d06f067376 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:00.920913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5169ff7-3922-46b1-b012-93d06f067376 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:00.921909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5169ff7-3922-46b1-b012-93d06f067376 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:00.923323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5169ff7-3922-46b1-b012-93d06f067376 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:01.361787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d5169ff7-3922-46b1-b012-93d06f067376 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:01.375030 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d5169ff7-3922-46b1-b012-93d06f067376 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1519 microversion: 2.1 time: 0.479688 Oct 29 01:30:01.378874 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2612/5455] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:00 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1519 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:02.423023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e79e33f7-c5e6-4ffe-9c0f-eb45f8940080 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:02.423649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e79e33f7-c5e6-4ffe-9c0f-eb45f8940080 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:02.437937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e79e33f7-c5e6-4ffe-9c0f-eb45f8940080 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:02.438439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e79e33f7-c5e6-4ffe-9c0f-eb45f8940080 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:02.438880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e79e33f7-c5e6-4ffe-9c0f-eb45f8940080 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:02.439602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e79e33f7-c5e6-4ffe-9c0f-eb45f8940080 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:02.440062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e79e33f7-c5e6-4ffe-9c0f-eb45f8940080 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:02.440495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e79e33f7-c5e6-4ffe-9c0f-eb45f8940080 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:02.799806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e79e33f7-c5e6-4ffe-9c0f-eb45f8940080 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:02.814038 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e79e33f7-c5e6-4ffe-9c0f-eb45f8940080 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1519 microversion: 2.1 time: 0.392470 Oct 29 01:30:02.833424 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2844/5456] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:02 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1519 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:03.845139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bf16bbd8-70cd-4f3b-a9f8-24e353f1cc1b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:03.846197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bf16bbd8-70cd-4f3b-a9f8-24e353f1cc1b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:03.873437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf16bbd8-70cd-4f3b-a9f8-24e353f1cc1b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:03.873951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf16bbd8-70cd-4f3b-a9f8-24e353f1cc1b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:03.891201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf16bbd8-70cd-4f3b-a9f8-24e353f1cc1b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:03.891201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf16bbd8-70cd-4f3b-a9f8-24e353f1cc1b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:03.891201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf16bbd8-70cd-4f3b-a9f8-24e353f1cc1b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:03.899898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf16bbd8-70cd-4f3b-a9f8-24e353f1cc1b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:04.308546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-6c8ac289-a220-4705-a3b1-07ed6e5c8a89 req-6797b1e5-3547-4381-8ed0-bb4515fc86a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3caef7a-fea6-4d7b-992f-78001494a729", "name": "network-vif-unplugged", "status": "completed", "tag": "6e1dac29-d12e-4181-9daa-b2283db7de98"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:04.329872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6c8ac289-a220-4705-a3b1-07ed6e5c8a89 req-6797b1e5-3547-4381-8ed0-bb4515fc86a5 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:04.330364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6c8ac289-a220-4705-a3b1-07ed6e5c8a89 req-6797b1e5-3547-4381-8ed0-bb4515fc86a5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:04.330806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6c8ac289-a220-4705-a3b1-07ed6e5c8a89 req-6797b1e5-3547-4381-8ed0-bb4515fc86a5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:04.366634 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-6c8ac289-a220-4705-a3b1-07ed6e5c8a89 req-6797b1e5-3547-4381-8ed0-bb4515fc86a5 service nova] Creating event network-vif-unplugged:6e1dac29-d12e-4181-9daa-b2283db7de98 for instance a3caef7a-fea6-4d7b-992f-78001494a729 on n-h1-862964-3 Oct 29 01:30:04.381053 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-6c8ac289-a220-4705-a3b1-07ed6e5c8a89 req-6797b1e5-3547-4381-8ed0-bb4515fc86a5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.387820 Oct 29 01:30:04.383915 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2845/5457] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:04.627358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bf16bbd8-70cd-4f3b-a9f8-24e353f1cc1b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:04.637123 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bf16bbd8-70cd-4f3b-a9f8-24e353f1cc1b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1519 microversion: 2.1 time: 0.796629 Oct 29 01:30:04.665433 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2613/5458] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:03 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1519 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:05.099218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b4bbc4b1-4abb-4de0-bee8-f7ca2393390e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eafed3da-9275-4141-946a-509e29f58ecf"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:05.104011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b4bbc4b1-4abb-4de0-bee8-f7ca2393390e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:05.123959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b4bbc4b1-4abb-4de0-bee8-f7ca2393390e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:05.125326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b4bbc4b1-4abb-4de0-bee8-f7ca2393390e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:05.125811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b4bbc4b1-4abb-4de0-bee8-f7ca2393390e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:05.127670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b4bbc4b1-4abb-4de0-bee8-f7ca2393390e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:05.130421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b4bbc4b1-4abb-4de0-bee8-f7ca2393390e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:05.131303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b4bbc4b1-4abb-4de0-bee8-f7ca2393390e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:05.673667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-558608ce-5a9b-4a66-a176-4e122c7b31c7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:05.679297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-558608ce-5a9b-4a66-a176-4e122c7b31c7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:05.692997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-558608ce-5a9b-4a66-a176-4e122c7b31c7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:05.693540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-558608ce-5a9b-4a66-a176-4e122c7b31c7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:05.693988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-558608ce-5a9b-4a66-a176-4e122c7b31c7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:05.702200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-558608ce-5a9b-4a66-a176-4e122c7b31c7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:05.705378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-558608ce-5a9b-4a66-a176-4e122c7b31c7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:05.708252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-558608ce-5a9b-4a66-a176-4e122c7b31c7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:06.050071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-558608ce-5a9b-4a66-a176-4e122c7b31c7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:06.071052 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-558608ce-5a9b-4a66-a176-4e122c7b31c7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1519 microversion: 2.1 time: 0.398331 Oct 29 01:30:06.071702 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2614/5459] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:05 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1519 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:06.407008 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b4bbc4b1-4abb-4de0-bee8-f7ca2393390e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "POST /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.313267 Oct 29 01:30:06.415577 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2846/5460] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 29 01:30:05 2022] POST /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments => generated 194 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:07.101282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f4bc2563-3393-4249-b6a3-cf651b845d1d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:07.102275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f4bc2563-3393-4249-b6a3-cf651b845d1d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:07.134990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4bc2563-3393-4249-b6a3-cf651b845d1d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:07.137850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4bc2563-3393-4249-b6a3-cf651b845d1d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:07.142775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4bc2563-3393-4249-b6a3-cf651b845d1d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:07.151398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4bc2563-3393-4249-b6a3-cf651b845d1d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:07.168820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4bc2563-3393-4249-b6a3-cf651b845d1d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:07.174663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4bc2563-3393-4249-b6a3-cf651b845d1d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:07.473594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f4bc2563-3393-4249-b6a3-cf651b845d1d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:07.501479 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f4bc2563-3393-4249-b6a3-cf651b845d1d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1519 microversion: 2.1 time: 0.403494 Oct 29 01:30:07.505716 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2615/5461] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:07 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1519 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:08.537375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-edb4c207-39aa-431c-bd85-31f3ef0c9ef6 req-ac335dcf-461c-4fad-9437-b7015df21dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3caef7a-fea6-4d7b-992f-78001494a729", "name": "network-vif-plugged", "status": "completed", "tag": "6e1dac29-d12e-4181-9daa-b2283db7de98"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:08.554666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-edb4c207-39aa-431c-bd85-31f3ef0c9ef6 req-ac335dcf-461c-4fad-9437-b7015df21dae service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:08.554794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-edb4c207-39aa-431c-bd85-31f3ef0c9ef6 req-ac335dcf-461c-4fad-9437-b7015df21dae service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:08.560332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-edb4c207-39aa-431c-bd85-31f3ef0c9ef6 req-ac335dcf-461c-4fad-9437-b7015df21dae service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:08.563022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ab550a3c-3c51-479b-b3e8-20ac07bcdf1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:08.588109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ab550a3c-3c51-479b-b3e8-20ac07bcdf1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:08.600853 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-edb4c207-39aa-431c-bd85-31f3ef0c9ef6 req-ac335dcf-461c-4fad-9437-b7015df21dae service nova] Creating event network-vif-plugged:6e1dac29-d12e-4181-9daa-b2283db7de98 for instance a3caef7a-fea6-4d7b-992f-78001494a729 on n-h1-862964-3 Oct 29 01:30:08.615385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab550a3c-3c51-479b-b3e8-20ac07bcdf1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:08.618935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab550a3c-3c51-479b-b3e8-20ac07bcdf1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:08.622824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab550a3c-3c51-479b-b3e8-20ac07bcdf1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:08.625844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab550a3c-3c51-479b-b3e8-20ac07bcdf1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:08.626390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab550a3c-3c51-479b-b3e8-20ac07bcdf1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:08.629088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab550a3c-3c51-479b-b3e8-20ac07bcdf1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:08.629593 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-edb4c207-39aa-431c-bd85-31f3ef0c9ef6 req-ac335dcf-461c-4fad-9437-b7015df21dae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095798 Oct 29 01:30:08.630211 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2616/5462] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:30:08.732878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:30:09.236748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ab550a3c-3c51-479b-b3e8-20ac07bcdf1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:09.247183 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ab550a3c-3c51-479b-b3e8-20ac07bcdf1f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1519 microversion: 2.1 time: 0.707508 Oct 29 01:30:09.251880 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2847/5463] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:08 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1519 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:10.278135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b081b0f2-d823-4e14-876f-00e9f30a5a57 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:10.278851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b081b0f2-d823-4e14-876f-00e9f30a5a57 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:10.300816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b081b0f2-d823-4e14-876f-00e9f30a5a57 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:10.309496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b081b0f2-d823-4e14-876f-00e9f30a5a57 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:10.309972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b081b0f2-d823-4e14-876f-00e9f30a5a57 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:10.310737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b081b0f2-d823-4e14-876f-00e9f30a5a57 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:10.317476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b081b0f2-d823-4e14-876f-00e9f30a5a57 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:10.318280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b081b0f2-d823-4e14-876f-00e9f30a5a57 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:10.733723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b081b0f2-d823-4e14-876f-00e9f30a5a57 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:10.741533 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b081b0f2-d823-4e14-876f-00e9f30a5a57 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1519 microversion: 2.1 time: 0.469223 Oct 29 01:30:10.742113 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2617/5464] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:10 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1519 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:11.768457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-32f7024d-3625-4b85-8c5f-a2b2e0632c2c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:11.772717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-32f7024d-3625-4b85-8c5f-a2b2e0632c2c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:11.793333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32f7024d-3625-4b85-8c5f-a2b2e0632c2c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:11.794303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32f7024d-3625-4b85-8c5f-a2b2e0632c2c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:11.797563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32f7024d-3625-4b85-8c5f-a2b2e0632c2c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:11.798619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32f7024d-3625-4b85-8c5f-a2b2e0632c2c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:11.807413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32f7024d-3625-4b85-8c5f-a2b2e0632c2c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:11.807413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32f7024d-3625-4b85-8c5f-a2b2e0632c2c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:12.584508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-32f7024d-3625-4b85-8c5f-a2b2e0632c2c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:12.600247 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-32f7024d-3625-4b85-8c5f-a2b2e0632c2c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1504 microversion: 2.1 time: 0.835568 Oct 29 01:30:12.628200 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2848/5465] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:11 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1504 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:12.628339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-db522fea-1c58-4ec9-bfce-1cb340dd4da8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:12.628339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-db522fea-1c58-4ec9-bfce-1cb340dd4da8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:12.650881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db522fea-1c58-4ec9-bfce-1cb340dd4da8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:12.653634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db522fea-1c58-4ec9-bfce-1cb340dd4da8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:12.654183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db522fea-1c58-4ec9-bfce-1cb340dd4da8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:12.655171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db522fea-1c58-4ec9-bfce-1cb340dd4da8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:12.656647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db522fea-1c58-4ec9-bfce-1cb340dd4da8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:12.660425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-db522fea-1c58-4ec9-bfce-1cb340dd4da8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:13.033553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-db522fea-1c58-4ec9-bfce-1cb340dd4da8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:13.091621 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-db522fea-1c58-4ec9-bfce-1cb340dd4da8 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 200 len: 1504 microversion: 2.1 time: 0.470152 Oct 29 01:30:13.097477 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2618/5466] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:12 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 1504 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:13.117858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a06526a1-a4ee-4286-885a-3c10e9a29f65 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:13.120573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a06526a1-a4ee-4286-885a-3c10e9a29f65 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:13.135528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a06526a1-a4ee-4286-885a-3c10e9a29f65 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:13.140306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a06526a1-a4ee-4286-885a-3c10e9a29f65 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:13.140996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a06526a1-a4ee-4286-885a-3c10e9a29f65 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:13.144198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a06526a1-a4ee-4286-885a-3c10e9a29f65 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:13.144907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a06526a1-a4ee-4286-885a-3c10e9a29f65 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:13.145541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a06526a1-a4ee-4286-885a-3c10e9a29f65 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:13.209998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a06526a1-a4ee-4286-885a-3c10e9a29f65 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:30:13.611337 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a06526a1-a4ee-4286-885a-3c10e9a29f65 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 204 len: 0 microversion: 2.1 time: 0.497557 Oct 29 01:30:13.612415 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2849/5467] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:30:13 2022] DELETE /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:30:13.910954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-81fd7199-4501-4d93-a30f-8c7039e95c70 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-725521435", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "597311ce-aa95-4f12-8eaa-7c4f96ddc1b9"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:14.004983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-81fd7199-4501-4d93-a30f-8c7039e95c70 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] validate_networks() for [('597311ce-aa95-4f12-8eaa-7c4f96ddc1b9', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:30:15.503778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-81fd7199-4501-4d93-a30f-8c7039e95c70 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:30:15.504367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-81fd7199-4501-4d93-a30f-8c7039e95c70 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:30:15.504746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-81fd7199-4501-4d93-a30f-8c7039e95c70 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:30:15.505447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-81fd7199-4501-4d93-a30f-8c7039e95c70 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:30:15.506040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-81fd7199-4501-4d93-a30f-8c7039e95c70 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:30:15.519799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81fd7199-4501-4d93-a30f-8c7039e95c70 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:15.520809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81fd7199-4501-4d93-a30f-8c7039e95c70 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:15.523548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81fd7199-4501-4d93-a30f-8c7039e95c70 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:15.526799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81fd7199-4501-4d93-a30f-8c7039e95c70 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:15.527487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81fd7199-4501-4d93-a30f-8c7039e95c70 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:15.528138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81fd7199-4501-4d93-a30f-8c7039e95c70 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:15.556859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-81fd7199-4501-4d93-a30f-8c7039e95c70 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Getting quotas for project c1840006d715496788f2dc0ca7c40c6b. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:30:15.566470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-81fd7199-4501-4d93-a30f-8c7039e95c70 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Getting quotas for user 683fc94021ee47e88a111980139e6786 and project c1840006d715496788f2dc0ca7c40c6b. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:30:15.581743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-81fd7199-4501-4d93-a30f-8c7039e95c70 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:30:15.584313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-81fd7199-4501-4d93-a30f-8c7039e95c70 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:30:15.796221 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-81fd7199-4501-4d93-a30f-8c7039e95c70 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.890886 Oct 29 01:30:15.800498 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2619/5468] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:30:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:30:15.821273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c42de9ac-e890-4ef0-aad0-cf65b2af2d81 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:15.821273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c42de9ac-e890-4ef0-aad0-cf65b2af2d81 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:15.988293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c42de9ac-e890-4ef0-aad0-cf65b2af2d81 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:16.007240 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c42de9ac-e890-4ef0-aad0-cf65b2af2d81 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1217 microversion: 2.1 time: 0.197881 Oct 29 01:30:16.007858 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2850/5469] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:15 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1217 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:17.035375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-21ae6c81-3170-4969-a0fe-4967156c183e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:17.036022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-21ae6c81-3170-4969-a0fe-4967156c183e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:17.272015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-21ae6c81-3170-4969-a0fe-4967156c183e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:17.283977 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-21ae6c81-3170-4969-a0fe-4967156c183e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1217 microversion: 2.1 time: 0.255590 Oct 29 01:30:17.308318 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2620/5470] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:17 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1217 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:17.349717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-d5ff6f47-0178-429a-96de-06efbebfd613 req-807d3e61-296f-4b84-aa46-ec16672955a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3caef7a-fea6-4d7b-992f-78001494a729", "name": "network-vif-deleted", "tag": "6e1dac29-d12e-4181-9daa-b2283db7de98"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:17.374944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d5ff6f47-0178-429a-96de-06efbebfd613 req-807d3e61-296f-4b84-aa46-ec16672955a5 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:17.381772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d5ff6f47-0178-429a-96de-06efbebfd613 req-807d3e61-296f-4b84-aa46-ec16672955a5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:17.382216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d5ff6f47-0178-429a-96de-06efbebfd613 req-807d3e61-296f-4b84-aa46-ec16672955a5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:17.419688 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-d5ff6f47-0178-429a-96de-06efbebfd613 req-807d3e61-296f-4b84-aa46-ec16672955a5 service nova] Creating event network-vif-deleted:6e1dac29-d12e-4181-9daa-b2283db7de98 for instance a3caef7a-fea6-4d7b-992f-78001494a729 on n-h1-862964-3 Oct 29 01:30:17.430631 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-d5ff6f47-0178-429a-96de-06efbebfd613 req-807d3e61-296f-4b84-aa46-ec16672955a5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084647 Oct 29 01:30:17.432664 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2851/5471] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:18.313869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0be3b5cf-82c7-4911-94dc-733d5e7d986d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:18.315854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0be3b5cf-82c7-4911-94dc-733d5e7d986d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:18.326963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0be3b5cf-82c7-4911-94dc-733d5e7d986d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:18.329638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0be3b5cf-82c7-4911-94dc-733d5e7d986d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:18.330103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0be3b5cf-82c7-4911-94dc-733d5e7d986d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:18.331034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0be3b5cf-82c7-4911-94dc-733d5e7d986d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:18.331503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0be3b5cf-82c7-4911-94dc-733d5e7d986d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:18.331934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0be3b5cf-82c7-4911-94dc-733d5e7d986d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:18.579812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0be3b5cf-82c7-4911-94dc-733d5e7d986d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:18.595432 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0be3b5cf-82c7-4911-94dc-733d5e7d986d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1213 microversion: 2.1 time: 0.286316 Oct 29 01:30:18.596054 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2621/5472] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:18 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1213 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:19.630780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ad473504-b4ca-498c-be61-8c6857dbadeb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:19.630780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ad473504-b4ca-498c-be61-8c6857dbadeb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:19.676041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad473504-b4ca-498c-be61-8c6857dbadeb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:19.676672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad473504-b4ca-498c-be61-8c6857dbadeb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:19.680206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad473504-b4ca-498c-be61-8c6857dbadeb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:19.681081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad473504-b4ca-498c-be61-8c6857dbadeb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:19.691321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad473504-b4ca-498c-be61-8c6857dbadeb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:19.691321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad473504-b4ca-498c-be61-8c6857dbadeb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:20.020957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ad473504-b4ca-498c-be61-8c6857dbadeb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:20.060922 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ad473504-b4ca-498c-be61-8c6857dbadeb tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1277 microversion: 2.1 time: 0.440848 Oct 29 01:30:20.076989 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2852/5473] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:19 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1277 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:21.090710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0bfd930a-6d8f-4062-aacb-e1865895e04d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:21.091331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0bfd930a-6d8f-4062-aacb-e1865895e04d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:21.101239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0bfd930a-6d8f-4062-aacb-e1865895e04d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:21.105299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0bfd930a-6d8f-4062-aacb-e1865895e04d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:21.114236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0bfd930a-6d8f-4062-aacb-e1865895e04d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:21.114236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0bfd930a-6d8f-4062-aacb-e1865895e04d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:21.114236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0bfd930a-6d8f-4062-aacb-e1865895e04d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:21.114236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0bfd930a-6d8f-4062-aacb-e1865895e04d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:21.217310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0bfd930a-6d8f-4062-aacb-e1865895e04d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:21.230558 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0bfd930a-6d8f-4062-aacb-e1865895e04d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1275 microversion: 2.1 time: 0.148683 Oct 29 01:30:21.233508 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2622/5474] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:21 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:22.259010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-caf49d4a-4579-4e91-8cf3-5209ed6b24b2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:22.259843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-caf49d4a-4579-4e91-8cf3-5209ed6b24b2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:22.262097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:30:22.279945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-caf49d4a-4579-4e91-8cf3-5209ed6b24b2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:22.282925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-caf49d4a-4579-4e91-8cf3-5209ed6b24b2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:22.288934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-caf49d4a-4579-4e91-8cf3-5209ed6b24b2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:22.291916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-caf49d4a-4579-4e91-8cf3-5209ed6b24b2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:22.291916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-caf49d4a-4579-4e91-8cf3-5209ed6b24b2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:22.291916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-caf49d4a-4579-4e91-8cf3-5209ed6b24b2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:22.487517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-caf49d4a-4579-4e91-8cf3-5209ed6b24b2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:22.491219 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-caf49d4a-4579-4e91-8cf3-5209ed6b24b2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1275 microversion: 2.1 time: 0.238053 Oct 29 01:30:22.502448 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2853/5475] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:22 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1275 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:23.537541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-17050102-7b42-4879-9a22-14593c17c475 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:23.537541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-17050102-7b42-4879-9a22-14593c17c475 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:23.579173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17050102-7b42-4879-9a22-14593c17c475 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:23.579676 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17050102-7b42-4879-9a22-14593c17c475 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:23.580164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17050102-7b42-4879-9a22-14593c17c475 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:23.580897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17050102-7b42-4879-9a22-14593c17c475 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:23.596315 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17050102-7b42-4879-9a22-14593c17c475 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:23.596865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17050102-7b42-4879-9a22-14593c17c475 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:24.039679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-17050102-7b42-4879-9a22-14593c17c475 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:24.053820 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-17050102-7b42-4879-9a22-14593c17c475 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1317 microversion: 2.1 time: 0.532687 Oct 29 01:30:24.067125 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2623/5476] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:23 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1317 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:25.095065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2bb88476-d202-47e0-82c9-da35228100a9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:25.096268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2bb88476-d202-47e0-82c9-da35228100a9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:25.107149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2bb88476-d202-47e0-82c9-da35228100a9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:25.109608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2bb88476-d202-47e0-82c9-da35228100a9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:25.121977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2bb88476-d202-47e0-82c9-da35228100a9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:25.123173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2bb88476-d202-47e0-82c9-da35228100a9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:25.123897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2bb88476-d202-47e0-82c9-da35228100a9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:25.124590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2bb88476-d202-47e0-82c9-da35228100a9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:25.508157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bf29f136-726f-4687-8d1e-2a4a556bbd32 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eafed3da-9275-4141-946a-509e29f58ecf"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:25.521505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bf29f136-726f-4687-8d1e-2a4a556bbd32 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:25.567114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:30:25.567971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf29f136-726f-4687-8d1e-2a4a556bbd32 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:25.580304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf29f136-726f-4687-8d1e-2a4a556bbd32 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:25.581038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf29f136-726f-4687-8d1e-2a4a556bbd32 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:25.582020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf29f136-726f-4687-8d1e-2a4a556bbd32 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:25.586207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf29f136-726f-4687-8d1e-2a4a556bbd32 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:25.597549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf29f136-726f-4687-8d1e-2a4a556bbd32 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:25.619542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=83 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:30:25.837613 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-bf29f136-726f-4687-8d1e-2a4a556bbd32 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] HTTP exception thrown: Invalid volume: volume eafed3da-9275-4141-946a-509e29f58ecf is already attached to instances: 1c303716-1880-4adb-b972-3bc6e24ba1cc Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bf29f136-726f-4687-8d1e-2a4a556bbd32 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Request method failure captured: Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments HTTP/1.1 Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 74 Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXICkjStyzUNQCP56iyabn5ahlWbK9bq57JWpf6w_r5-2BC1n9lfKn4n-q7ViwDGqwiAHQbWPA068CNGAzX2vWzwGSgwtRiu5lH8sKE1aT3VNdBS9vlw817eOLttRxo_xXGlmclE5Xf7yAYwC5hE1QU1PdlNbXv8l2Qz8VlCemFm6YRM Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad278c0b0b9a41beae8b29986e315743", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 444e13f1f2d945dfb31b83d8e19c2032 Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: {"volumeAttachment": {"volumeId": "eafed3da-9275-4141-946a-509e29f58ecf"}} Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: exception: Invalid volume: volume eafed3da-9275-4141-946a-509e29f58ecf is already attached to instances: 1c303716-1880-4adb-b972-3bc6e24ba1cc Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'server_id': '1c303716-1880-4adb-b972-3bc6e24ba1cc', 'body': {'volumeAttachment': {'volumeId': 'eafed3da-9275-4141-946a-509e29f58ecf'}}} Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume eafed3da-9275-4141-946a-509e29f58ecf is already attached to instances: 1c303716-1880-4adb-b972-3bc6e24ba1cc Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:30:25.847559 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:30:25.854696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:30:25.854696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:30:25.854696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 29 01:30:25.854696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 01:30:25.854696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume eafed3da-9275-4141-946a-509e29f58ecf is already attached to instances: 1c303716-1880-4adb-b972-3bc6e24ba1cc Oct 29 01:30:25.854696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:30:25.854696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:30:25.854696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:30:25.854696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:30:25.854696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:30:25.854696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:30:25.854696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:30:25.854696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:30:25.854696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume eafed3da-9275-4141-946a-509e29f58ecf is already attached to instances: 1c303716-1880-4adb-b972-3bc6e24ba1cc Oct 29 01:30:25.854696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:30:25.859296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bf29f136-726f-4687-8d1e-2a4a556bbd32 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Returning 400 to user: Invalid volume: volume eafed3da-9275-4141-946a-509e29f58ecf is already attached to instances: 1c303716-1880-4adb-b972-3bc6e24ba1cc {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:30:25.859296 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bf29f136-726f-4687-8d1e-2a4a556bbd32 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "POST /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.356749 Oct 29 01:30:25.864100 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2624/5477] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 29 01:30:25 2022] POST /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments => generated 174 bytes in 362 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:30:25.999505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d62ed5b8-8c4f-4a33-84fd-6465846c9117 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:26.000162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d62ed5b8-8c4f-4a33-84fd-6465846c9117 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:26.006357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:30:26.020492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d62ed5b8-8c4f-4a33-84fd-6465846c9117 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:26.020492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d62ed5b8-8c4f-4a33-84fd-6465846c9117 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:26.020910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d62ed5b8-8c4f-4a33-84fd-6465846c9117 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:26.021739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d62ed5b8-8c4f-4a33-84fd-6465846c9117 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:26.022137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d62ed5b8-8c4f-4a33-84fd-6465846c9117 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:26.022563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d62ed5b8-8c4f-4a33-84fd-6465846c9117 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:26.235740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-d62ed5b8-8c4f-4a33-84fd-6465846c9117 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lazy-loading 'services' on Instance uuid 1c303716-1880-4adb-b972-3bc6e24ba1cc {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:30:26.497848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2bb88476-d202-47e0-82c9-da35228100a9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:26.511565 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2bb88476-d202-47e0-82c9-da35228100a9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1317 microversion: 2.1 time: 1.420169 Oct 29 01:30:26.514829 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2854/5478] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:25 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1317 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:26.607004 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d62ed5b8-8c4f-4a33-84fd-6465846c9117 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments/eafed3da-9275-4141-946a-509e29f58ecf" status: 202 len: 0 microversion: 2.1 time: 0.619206 Oct 29 01:30:26.612378 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2625/5479] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 29 01:30:25 2022] DELETE /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments/eafed3da-9275-4141-946a-509e29f58ecf => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:30:26.628085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-318efa90-159f-4c21-b59f-84b8138c661f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:26.635876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-318efa90-159f-4c21-b59f-84b8138c661f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:26.651077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-318efa90-159f-4c21-b59f-84b8138c661f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:26.653066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-318efa90-159f-4c21-b59f-84b8138c661f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:26.654149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-318efa90-159f-4c21-b59f-84b8138c661f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:26.667591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-318efa90-159f-4c21-b59f-84b8138c661f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:26.668674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-318efa90-159f-4c21-b59f-84b8138c661f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:26.669108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-318efa90-159f-4c21-b59f-84b8138c661f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:26.767591 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-318efa90-159f-4c21-b59f-84b8138c661f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150635 Oct 29 01:30:26.775854 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2855/5480] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:30:26 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:27.536214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:30:27.542650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fc15b952-09fc-4ab0-a2c2-9daf7ef32d2b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:27.543370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fc15b952-09fc-4ab0-a2c2-9daf7ef32d2b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:27.565633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc15b952-09fc-4ab0-a2c2-9daf7ef32d2b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:27.566813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc15b952-09fc-4ab0-a2c2-9daf7ef32d2b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:27.574124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc15b952-09fc-4ab0-a2c2-9daf7ef32d2b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:27.580892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc15b952-09fc-4ab0-a2c2-9daf7ef32d2b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:27.586549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc15b952-09fc-4ab0-a2c2-9daf7ef32d2b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:27.589428 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc15b952-09fc-4ab0-a2c2-9daf7ef32d2b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:28.148048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-f9da25c3-5578-472c-8e7e-6310d875ec9a req-5154b49b-ae0f-42a1-81e8-851bb3c6135b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc1e59d-7992-4344-9a0a-c3f1b2decdf5", "tag": "11031898-b13e-41f2-ae9c-2e6752af137d"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:28.198792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f9da25c3-5578-472c-8e7e-6310d875ec9a req-5154b49b-ae0f-42a1-81e8-851bb3c6135b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:28.201059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f9da25c3-5578-472c-8e7e-6310d875ec9a req-5154b49b-ae0f-42a1-81e8-851bb3c6135b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:28.202016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f9da25c3-5578-472c-8e7e-6310d875ec9a req-5154b49b-ae0f-42a1-81e8-851bb3c6135b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:28.255504 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-f9da25c3-5578-472c-8e7e-6310d875ec9a req-5154b49b-ae0f-42a1-81e8-851bb3c6135b service nova] Creating event network-changed:11031898-b13e-41f2-ae9c-2e6752af137d for instance 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 on n-h2-862964-3 Oct 29 01:30:28.285855 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-f9da25c3-5578-472c-8e7e-6310d875ec9a req-5154b49b-ae0f-42a1-81e8-851bb3c6135b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.684000 Oct 29 01:30:28.297282 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2856/5481] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:28.327331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-47e30a2a-5c6b-49fb-ba08-40342d9bc25c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:28.332875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-47e30a2a-5c6b-49fb-ba08-40342d9bc25c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:28.383535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47e30a2a-5c6b-49fb-ba08-40342d9bc25c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:28.384681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47e30a2a-5c6b-49fb-ba08-40342d9bc25c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:28.397001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47e30a2a-5c6b-49fb-ba08-40342d9bc25c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:28.401878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47e30a2a-5c6b-49fb-ba08-40342d9bc25c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:28.407701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47e30a2a-5c6b-49fb-ba08-40342d9bc25c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:28.408220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47e30a2a-5c6b-49fb-ba08-40342d9bc25c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:28.559964 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-47e30a2a-5c6b-49fb-ba08-40342d9bc25c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.260960 Oct 29 01:30:28.569365 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2857/5482] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:30:28 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments => generated 197 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:29.538081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fc15b952-09fc-4ab0-a2c2-9daf7ef32d2b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:29.571004 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fc15b952-09fc-4ab0-a2c2-9daf7ef32d2b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1317 microversion: 2.1 time: 2.036083 Oct 29 01:30:29.579415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-48936d0d-998e-40f4-bafb-32a28f3b57a2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:29.580037 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2626/5483] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:27 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1317 bytes in 2046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:29.583563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-48936d0d-998e-40f4-bafb-32a28f3b57a2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:29.643340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48936d0d-998e-40f4-bafb-32a28f3b57a2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:29.647304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48936d0d-998e-40f4-bafb-32a28f3b57a2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:29.647304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48936d0d-998e-40f4-bafb-32a28f3b57a2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:29.654696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48936d0d-998e-40f4-bafb-32a28f3b57a2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:29.655295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48936d0d-998e-40f4-bafb-32a28f3b57a2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:29.655745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48936d0d-998e-40f4-bafb-32a28f3b57a2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:29.884175 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-48936d0d-998e-40f4-bafb-32a28f3b57a2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.311352 Oct 29 01:30:29.892943 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2858/5484] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:30:29 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments => generated 197 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:30.599277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2efd0bef-c930-4d34-846b-bd97ea8f62cd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:30.603396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2efd0bef-c930-4d34-846b-bd97ea8f62cd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:30.617575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2efd0bef-c930-4d34-846b-bd97ea8f62cd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:30.626937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2efd0bef-c930-4d34-846b-bd97ea8f62cd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:30.633813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2efd0bef-c930-4d34-846b-bd97ea8f62cd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:30.644404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2efd0bef-c930-4d34-846b-bd97ea8f62cd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:30.645094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2efd0bef-c930-4d34-846b-bd97ea8f62cd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:30.660168 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2efd0bef-c930-4d34-846b-bd97ea8f62cd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:30.905520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-941047b4-d68a-456c-ae4f-abad6bbca9ac tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:30.908610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-941047b4-d68a-456c-ae4f-abad6bbca9ac tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:31.004825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-941047b4-d68a-456c-ae4f-abad6bbca9ac tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:31.005500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-941047b4-d68a-456c-ae4f-abad6bbca9ac tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:31.005967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-941047b4-d68a-456c-ae4f-abad6bbca9ac tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:31.013082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-941047b4-d68a-456c-ae4f-abad6bbca9ac tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:31.018025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-941047b4-d68a-456c-ae4f-abad6bbca9ac tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:31.018478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-941047b4-d68a-456c-ae4f-abad6bbca9ac tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:31.147820 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-941047b4-d68a-456c-ae4f-abad6bbca9ac tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.247125 Oct 29 01:30:31.161549 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2859/5485] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:30:30 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments => generated 197 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:30:31.965307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-79a8086a-93c3-4636-8388-a26c44f37f5e tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-446645780", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "8868286a-2a81-48b3-a73e-b2b38e003f7f"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:32.126335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-79a8086a-93c3-4636-8388-a26c44f37f5e tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] validate_networks() for [('8868286a-2a81-48b3-a73e-b2b38e003f7f', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:30:33.154666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2efd0bef-c930-4d34-846b-bd97ea8f62cd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:33.177923 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2efd0bef-c930-4d34-846b-bd97ea8f62cd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1317 microversion: 2.1 time: 2.580245 Oct 29 01:30:33.194357 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2627/5486] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:30 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1317 bytes in 2599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:33.223103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-985e76ff-a4cb-4218-93bb-8cf832364388 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:33.230984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-985e76ff-a4cb-4218-93bb-8cf832364388 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:33.257438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-985e76ff-a4cb-4218-93bb-8cf832364388 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:33.258555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-985e76ff-a4cb-4218-93bb-8cf832364388 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:33.260040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-985e76ff-a4cb-4218-93bb-8cf832364388 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:33.264598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-985e76ff-a4cb-4218-93bb-8cf832364388 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:33.264598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-985e76ff-a4cb-4218-93bb-8cf832364388 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:33.264598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-985e76ff-a4cb-4218-93bb-8cf832364388 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:33.378260 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-985e76ff-a4cb-4218-93bb-8cf832364388 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182358 Oct 29 01:30:33.378859 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2628/5487] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:30:33 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:34.206847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ef38406a-340e-487e-81be-87866f74ac43 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:34.208969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ef38406a-340e-487e-81be-87866f74ac43 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:34.234548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef38406a-340e-487e-81be-87866f74ac43 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:34.235329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef38406a-340e-487e-81be-87866f74ac43 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:34.235949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef38406a-340e-487e-81be-87866f74ac43 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:34.241016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef38406a-340e-487e-81be-87866f74ac43 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:34.245709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef38406a-340e-487e-81be-87866f74ac43 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:34.246299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef38406a-340e-487e-81be-87866f74ac43 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:35.023361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ef38406a-340e-487e-81be-87866f74ac43 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:35.039536 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ef38406a-340e-487e-81be-87866f74ac43 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1317 microversion: 2.1 time: 0.837846 Oct 29 01:30:35.058712 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2629/5488] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:34 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1317 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:35.078184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7deb6f71-d736-4496-832d-3f9291f4bf5c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:35.085074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7deb6f71-d736-4496-832d-3f9291f4bf5c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:35.112838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7deb6f71-d736-4496-832d-3f9291f4bf5c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:35.113703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7deb6f71-d736-4496-832d-3f9291f4bf5c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:35.115512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7deb6f71-d736-4496-832d-3f9291f4bf5c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:35.116465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7deb6f71-d736-4496-832d-3f9291f4bf5c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:35.121575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7deb6f71-d736-4496-832d-3f9291f4bf5c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:35.122268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7deb6f71-d736-4496-832d-3f9291f4bf5c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:35.179252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-79a8086a-93c3-4636-8388-a26c44f37f5e tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:30:35.179831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-79a8086a-93c3-4636-8388-a26c44f37f5e tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:30:35.180535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-79a8086a-93c3-4636-8388-a26c44f37f5e tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:30:35.181913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-79a8086a-93c3-4636-8388-a26c44f37f5e tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:30:35.182633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-79a8086a-93c3-4636-8388-a26c44f37f5e tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:30:35.208868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79a8086a-93c3-4636-8388-a26c44f37f5e tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:35.212813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79a8086a-93c3-4636-8388-a26c44f37f5e tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:35.218572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79a8086a-93c3-4636-8388-a26c44f37f5e tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:35.222242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79a8086a-93c3-4636-8388-a26c44f37f5e tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:35.230219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79a8086a-93c3-4636-8388-a26c44f37f5e tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:35.230219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79a8086a-93c3-4636-8388-a26c44f37f5e tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:35.283710 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7deb6f71-d736-4496-832d-3f9291f4bf5c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.222870 Oct 29 01:30:35.284486 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2630/5489] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:30:35 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:35.293621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-79a8086a-93c3-4636-8388-a26c44f37f5e tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Getting quotas for project bbda68d5c80741cca4c48dbc47276b90. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:30:35.303007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-79a8086a-93c3-4636-8388-a26c44f37f5e tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Getting quotas for user bcf2691d051343c09168138a74b1b692 and project bbda68d5c80741cca4c48dbc47276b90. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:30:35.336612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-79a8086a-93c3-4636-8388-a26c44f37f5e tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:30:35.339938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-79a8086a-93c3-4636-8388-a26c44f37f5e tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:30:35.560908 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-79a8086a-93c3-4636-8388-a26c44f37f5e tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 4.112041 Oct 29 01:30:35.567392 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2860/5490] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 29 01:30:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 4119 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 29 01:30:35.576767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-62c4102f-a9a5-43e8-9916-33631e437069 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:35.577768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-62c4102f-a9a5-43e8-9916-33631e437069 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:35.697987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-62c4102f-a9a5-43e8-9916-33631e437069 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:35.725750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-62c4102f-a9a5-43e8-9916-33631e437069 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:35.727746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-62c4102f-a9a5-43e8-9916-33631e437069 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:35.737677 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-62c4102f-a9a5-43e8-9916-33631e437069 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1261 microversion: 2.26 time: 0.156919 Oct 29 01:30:35.746364 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2631/5491] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:30:35 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:30:36.079737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3abf35b9-052d-4e25-a3b4-df75b16dcfb5 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:36.080581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3abf35b9-052d-4e25-a3b4-df75b16dcfb5 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:36.103674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3abf35b9-052d-4e25-a3b4-df75b16dcfb5 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:36.105686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3abf35b9-052d-4e25-a3b4-df75b16dcfb5 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:36.106426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3abf35b9-052d-4e25-a3b4-df75b16dcfb5 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:36.109830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3abf35b9-052d-4e25-a3b4-df75b16dcfb5 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:36.112881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3abf35b9-052d-4e25-a3b4-df75b16dcfb5 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:36.127337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3abf35b9-052d-4e25-a3b4-df75b16dcfb5 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:36.299340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b5caab3a-c88f-4a0a-8778-50c7cc5c004c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:36.308253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b5caab3a-c88f-4a0a-8778-50c7cc5c004c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:36.327259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:30:36.331590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5caab3a-c88f-4a0a-8778-50c7cc5c004c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:36.332277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5caab3a-c88f-4a0a-8778-50c7cc5c004c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:36.333719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5caab3a-c88f-4a0a-8778-50c7cc5c004c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:36.337483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5caab3a-c88f-4a0a-8778-50c7cc5c004c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:36.338439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5caab3a-c88f-4a0a-8778-50c7cc5c004c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:36.342902 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5caab3a-c88f-4a0a-8778-50c7cc5c004c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:36.457725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3abf35b9-052d-4e25-a3b4-df75b16dcfb5 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:36.474007 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3abf35b9-052d-4e25-a3b4-df75b16dcfb5 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1317 microversion: 2.1 time: 0.399709 Oct 29 01:30:36.478902 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2861/5492] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:36 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:36.480613 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b5caab3a-c88f-4a0a-8778-50c7cc5c004c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187025 Oct 29 01:30:36.483961 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2632/5493] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:30:36 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:30:36.768816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-150ae7a0-1a38-4a46-a99f-ae546c8a3ba6 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:36.769677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-150ae7a0-1a38-4a46-a99f-ae546c8a3ba6 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:36.781666 n-d-862964-3 devstack@n-api.service[121099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:30:36.790659 n-d-862964-3 devstack@n-api.service[121099]: Sat Oct 29 01:30:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d (ip 10.222.0.26) !!! Oct 29 01:30:37.071832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-150ae7a0-1a38-4a46-a99f-ae546c8a3ba6 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:37.090286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-150ae7a0-1a38-4a46-a99f-ae546c8a3ba6 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:37.099283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-150ae7a0-1a38-4a46-a99f-ae546c8a3ba6 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:37.101077 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-150ae7a0-1a38-4a46-a99f-ae546c8a3ba6 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1261 microversion: 2.26 time: 0.338865 Oct 29 01:30:37.105093 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2862/5494] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:30:36 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1261 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:30:37.498480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-95da6b51-5225-4fc0-8e6e-5d986635d547 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:37.506767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-95da6b51-5225-4fc0-8e6e-5d986635d547 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:37.523819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c4593ded-9b60-49e7-8da8-a96e89374069 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:37.525038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c4593ded-9b60-49e7-8da8-a96e89374069 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:37.527601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95da6b51-5225-4fc0-8e6e-5d986635d547 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:37.529810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95da6b51-5225-4fc0-8e6e-5d986635d547 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:37.531454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95da6b51-5225-4fc0-8e6e-5d986635d547 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:37.534972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95da6b51-5225-4fc0-8e6e-5d986635d547 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:37.535772 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95da6b51-5225-4fc0-8e6e-5d986635d547 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:37.536418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95da6b51-5225-4fc0-8e6e-5d986635d547 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:37.555336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4593ded-9b60-49e7-8da8-a96e89374069 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:37.558246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4593ded-9b60-49e7-8da8-a96e89374069 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:37.558962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4593ded-9b60-49e7-8da8-a96e89374069 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:37.560142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4593ded-9b60-49e7-8da8-a96e89374069 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:37.560995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4593ded-9b60-49e7-8da8-a96e89374069 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:37.561800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4593ded-9b60-49e7-8da8-a96e89374069 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:37.699081 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-95da6b51-5225-4fc0-8e6e-5d986635d547 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207661 Oct 29 01:30:37.718153 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2633/5495] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:30:37 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments => generated 197 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:38.012184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c4593ded-9b60-49e7-8da8-a96e89374069 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:38.047794 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c4593ded-9b60-49e7-8da8-a96e89374069 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1317 microversion: 2.1 time: 0.547556 Oct 29 01:30:38.058321 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2863/5496] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:37 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1317 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:38.128787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fb7d2a1c-1a23-4c8a-993f-ba634eaa4977 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:38.129823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fb7d2a1c-1a23-4c8a-993f-ba634eaa4977 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:38.155216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb7d2a1c-1a23-4c8a-993f-ba634eaa4977 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:38.157316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb7d2a1c-1a23-4c8a-993f-ba634eaa4977 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:38.164291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb7d2a1c-1a23-4c8a-993f-ba634eaa4977 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:38.166420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb7d2a1c-1a23-4c8a-993f-ba634eaa4977 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:38.167768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb7d2a1c-1a23-4c8a-993f-ba634eaa4977 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:38.169359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb7d2a1c-1a23-4c8a-993f-ba634eaa4977 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:38.379302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fb7d2a1c-1a23-4c8a-993f-ba634eaa4977 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:38.398288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fb7d2a1c-1a23-4c8a-993f-ba634eaa4977 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:38.406018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fb7d2a1c-1a23-4c8a-993f-ba634eaa4977 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:38.408820 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fb7d2a1c-1a23-4c8a-993f-ba634eaa4977 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1265 microversion: 2.26 time: 0.284110 Oct 29 01:30:38.426043 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2634/5497] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:30:38 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1265 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:30:38.732853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-432096ab-0406-4544-982d-c4dfa691d004 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:38.736466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-432096ab-0406-4544-982d-c4dfa691d004 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:38.769630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-432096ab-0406-4544-982d-c4dfa691d004 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:38.770581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-432096ab-0406-4544-982d-c4dfa691d004 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:38.772818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-432096ab-0406-4544-982d-c4dfa691d004 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:38.772818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-432096ab-0406-4544-982d-c4dfa691d004 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:38.772818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-432096ab-0406-4544-982d-c4dfa691d004 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:38.773436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-432096ab-0406-4544-982d-c4dfa691d004 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:38.860273 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-432096ab-0406-4544-982d-c4dfa691d004 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138322 Oct 29 01:30:38.866338 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2864/5498] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:30:38 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:39.097884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d39aa07f-5a7a-41cc-becf-83539a083da4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:39.098552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d39aa07f-5a7a-41cc-becf-83539a083da4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:39.120659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d39aa07f-5a7a-41cc-becf-83539a083da4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:39.121872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d39aa07f-5a7a-41cc-becf-83539a083da4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:39.126218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d39aa07f-5a7a-41cc-becf-83539a083da4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:39.127196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d39aa07f-5a7a-41cc-becf-83539a083da4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:39.128016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d39aa07f-5a7a-41cc-becf-83539a083da4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:39.130756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d39aa07f-5a7a-41cc-becf-83539a083da4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:39.368979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-41c823eb-b55f-47ae-b380-7818c60f1fb4 req-a8a26763-69dc-4ff3-a917-b016dd01fe45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc1e59d-7992-4344-9a0a-c3f1b2decdf5", "name": "network-vif-plugged", "status": "completed", "tag": "11031898-b13e-41f2-ae9c-2e6752af137d"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:39.398510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-41c823eb-b55f-47ae-b380-7818c60f1fb4 req-a8a26763-69dc-4ff3-a917-b016dd01fe45 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:39.401924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-41c823eb-b55f-47ae-b380-7818c60f1fb4 req-a8a26763-69dc-4ff3-a917-b016dd01fe45 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:39.405586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-41c823eb-b55f-47ae-b380-7818c60f1fb4 req-a8a26763-69dc-4ff3-a917-b016dd01fe45 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:39.479354 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-41c823eb-b55f-47ae-b380-7818c60f1fb4 req-a8a26763-69dc-4ff3-a917-b016dd01fe45 service nova] Creating event network-vif-plugged:11031898-b13e-41f2-ae9c-2e6752af137d for instance 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 on n-h2-862964-3 Oct 29 01:30:39.519088 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-41c823eb-b55f-47ae-b380-7818c60f1fb4 req-a8a26763-69dc-4ff3-a917-b016dd01fe45 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156276 Oct 29 01:30:39.531287 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2865/5499] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:39.586658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d67d01cc-25c0-42fc-8142-8a63323a8da3 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:39.591693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d67d01cc-25c0-42fc-8142-8a63323a8da3 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:39.691543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d67d01cc-25c0-42fc-8142-8a63323a8da3 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:39.709652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d67d01cc-25c0-42fc-8142-8a63323a8da3 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:39.712376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d67d01cc-25c0-42fc-8142-8a63323a8da3 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:39.717352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d67d01cc-25c0-42fc-8142-8a63323a8da3 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:39.718226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d67d01cc-25c0-42fc-8142-8a63323a8da3 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:39.720571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d67d01cc-25c0-42fc-8142-8a63323a8da3 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:39.726172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d39aa07f-5a7a-41cc-becf-83539a083da4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:39.742937 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d39aa07f-5a7a-41cc-becf-83539a083da4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1317 microversion: 2.1 time: 0.656843 Oct 29 01:30:39.766490 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2635/5500] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:39 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1317 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:39.896751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ec93d573-e83c-4dd8-851b-21afe7fc2cb3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:39.924710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ec93d573-e83c-4dd8-851b-21afe7fc2cb3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:39.943186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec93d573-e83c-4dd8-851b-21afe7fc2cb3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:39.947214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec93d573-e83c-4dd8-851b-21afe7fc2cb3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:39.952302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec93d573-e83c-4dd8-851b-21afe7fc2cb3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:39.957437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec93d573-e83c-4dd8-851b-21afe7fc2cb3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:39.959688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec93d573-e83c-4dd8-851b-21afe7fc2cb3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:39.966297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec93d573-e83c-4dd8-851b-21afe7fc2cb3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:40.096439 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ec93d573-e83c-4dd8-851b-21afe7fc2cb3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.227235 Oct 29 01:30:40.111911 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2636/5501] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:30:39 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments => generated 197 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:40.132217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d67d01cc-25c0-42fc-8142-8a63323a8da3 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:40.147767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d67d01cc-25c0-42fc-8142-8a63323a8da3 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:40.155723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d67d01cc-25c0-42fc-8142-8a63323a8da3 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:40.162554 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d67d01cc-25c0-42fc-8142-8a63323a8da3 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1313 microversion: 2.26 time: 0.627073 Oct 29 01:30:40.164858 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2866/5502] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:30:39 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1313 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:30:40.796232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2abead49-6b37-401d-ba82-32f4b5c4acc2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:40.808469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2abead49-6b37-401d-ba82-32f4b5c4acc2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:40.846983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2abead49-6b37-401d-ba82-32f4b5c4acc2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:40.849588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2abead49-6b37-401d-ba82-32f4b5c4acc2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:40.851157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2abead49-6b37-401d-ba82-32f4b5c4acc2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:40.853201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2abead49-6b37-401d-ba82-32f4b5c4acc2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:40.856445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2abead49-6b37-401d-ba82-32f4b5c4acc2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:40.857848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2abead49-6b37-401d-ba82-32f4b5c4acc2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:41.109642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f52a3911-5367-4305-bc5f-15ec0306552c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:41.112434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f52a3911-5367-4305-bc5f-15ec0306552c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:41.124971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f52a3911-5367-4305-bc5f-15ec0306552c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:41.129341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f52a3911-5367-4305-bc5f-15ec0306552c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:41.129986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f52a3911-5367-4305-bc5f-15ec0306552c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:41.130936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f52a3911-5367-4305-bc5f-15ec0306552c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:41.133349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f52a3911-5367-4305-bc5f-15ec0306552c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:41.134581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f52a3911-5367-4305-bc5f-15ec0306552c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:41.139464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:30:41.288683 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f52a3911-5367-4305-bc5f-15ec0306552c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183419 Oct 29 01:30:41.290475 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2867/5503] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:30:41 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:41.314433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-48aff0ba-e19e-4d3d-94c2-4de5f0353c34 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:41.315417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-48aff0ba-e19e-4d3d-94c2-4de5f0353c34 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:41.338722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48aff0ba-e19e-4d3d-94c2-4de5f0353c34 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:41.339634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48aff0ba-e19e-4d3d-94c2-4de5f0353c34 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:41.340565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48aff0ba-e19e-4d3d-94c2-4de5f0353c34 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:41.343486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48aff0ba-e19e-4d3d-94c2-4de5f0353c34 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:41.344272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48aff0ba-e19e-4d3d-94c2-4de5f0353c34 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:41.347520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48aff0ba-e19e-4d3d-94c2-4de5f0353c34 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:41.921313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-48aff0ba-e19e-4d3d-94c2-4de5f0353c34 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:41.939748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-48aff0ba-e19e-4d3d-94c2-4de5f0353c34 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:41.942761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-48aff0ba-e19e-4d3d-94c2-4de5f0353c34 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:41.950754 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-48aff0ba-e19e-4d3d-94c2-4de5f0353c34 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1319 microversion: 2.26 time: 0.656563 Oct 29 01:30:41.956818 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2868/5504] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:30:41 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1319 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:30:42.048816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2abead49-6b37-401d-ba82-32f4b5c4acc2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:42.064552 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2abead49-6b37-401d-ba82-32f4b5c4acc2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1317 microversion: 2.1 time: 1.297550 Oct 29 01:30:42.070814 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2637/5505] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:40 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1317 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:42.306327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6a2542d5-c6cb-4446-b30c-79c8d7be1bcd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:42.309643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6a2542d5-c6cb-4446-b30c-79c8d7be1bcd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:42.329059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a2542d5-c6cb-4446-b30c-79c8d7be1bcd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:42.330007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a2542d5-c6cb-4446-b30c-79c8d7be1bcd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:42.332006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a2542d5-c6cb-4446-b30c-79c8d7be1bcd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:42.334864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a2542d5-c6cb-4446-b30c-79c8d7be1bcd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:42.341494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a2542d5-c6cb-4446-b30c-79c8d7be1bcd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:42.348110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a2542d5-c6cb-4446-b30c-79c8d7be1bcd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:42.459582 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6a2542d5-c6cb-4446-b30c-79c8d7be1bcd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.161426 Oct 29 01:30:42.480609 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2869/5506] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:30:42 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc/os-volume_attachments => generated 25 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:30:42.751517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7b4955fa-1655-4b0e-af02-9b95025c8a5d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:42.752025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7b4955fa-1655-4b0e-af02-9b95025c8a5d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:42.772456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b4955fa-1655-4b0e-af02-9b95025c8a5d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:42.773246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b4955fa-1655-4b0e-af02-9b95025c8a5d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:42.777542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b4955fa-1655-4b0e-af02-9b95025c8a5d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:42.778379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b4955fa-1655-4b0e-af02-9b95025c8a5d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:42.778931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b4955fa-1655-4b0e-af02-9b95025c8a5d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:42.779376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b4955fa-1655-4b0e-af02-9b95025c8a5d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:42.905973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7b4955fa-1655-4b0e-af02-9b95025c8a5d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:30:42.986164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aaed3865-a5c4-4941-b23f-470099cd3265 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:42.986655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-aaed3865-a5c4-4941-b23f-470099cd3265 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:42.995262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaed3865-a5c4-4941-b23f-470099cd3265 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:42.995761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaed3865-a5c4-4941-b23f-470099cd3265 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:42.996206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaed3865-a5c4-4941-b23f-470099cd3265 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:42.996917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaed3865-a5c4-4941-b23f-470099cd3265 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:43.018706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaed3865-a5c4-4941-b23f-470099cd3265 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:43.022330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaed3865-a5c4-4941-b23f-470099cd3265 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:43.219064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-aaed3865-a5c4-4941-b23f-470099cd3265 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:43.236267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-aaed3865-a5c4-4941-b23f-470099cd3265 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:43.238086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-aaed3865-a5c4-4941-b23f-470099cd3265 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:43.242818 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aaed3865-a5c4-4941-b23f-470099cd3265 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1319 microversion: 2.26 time: 0.261321 Oct 29 01:30:43.272327 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2870/5507] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:30:42 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:30:43.295344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1a61dd5d-dcbb-42a1-9899-7ae1e3fc899f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:43.312742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1a61dd5d-dcbb-42a1-9899-7ae1e3fc899f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:43.334972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a61dd5d-dcbb-42a1-9899-7ae1e3fc899f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:43.343446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a61dd5d-dcbb-42a1-9899-7ae1e3fc899f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:43.351099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a61dd5d-dcbb-42a1-9899-7ae1e3fc899f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:43.351099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a61dd5d-dcbb-42a1-9899-7ae1e3fc899f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:43.351099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a61dd5d-dcbb-42a1-9899-7ae1e3fc899f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:43.351099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a61dd5d-dcbb-42a1-9899-7ae1e3fc899f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:43.421524 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7b4955fa-1655-4b0e-af02-9b95025c8a5d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 204 len: 0 microversion: 2.1 time: 0.674640 Oct 29 01:30:43.422122 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2638/5508] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:30:42 2022] DELETE /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 0 bytes in 676 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:30:43.431190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-506e94d6-fdc1-4071-8855-3adc73f467ad tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:43.431902 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-506e94d6-fdc1-4071-8855-3adc73f467ad tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:43.458490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-506e94d6-fdc1-4071-8855-3adc73f467ad tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:43.458995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-506e94d6-fdc1-4071-8855-3adc73f467ad tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:43.459438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-506e94d6-fdc1-4071-8855-3adc73f467ad tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:43.460151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-506e94d6-fdc1-4071-8855-3adc73f467ad tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:43.460608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-506e94d6-fdc1-4071-8855-3adc73f467ad tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:43.461038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-506e94d6-fdc1-4071-8855-3adc73f467ad tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:43.507572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:30:43.796983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1a61dd5d-dcbb-42a1-9899-7ae1e3fc899f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:43.809593 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1a61dd5d-dcbb-42a1-9899-7ae1e3fc899f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1507 microversion: 2.1 time: 0.535155 Oct 29 01:30:43.815611 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2871/5509] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:43 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1507 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:43.847503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dbd9e1fd-57f2-4062-b39a-db349429667d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:43.848888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dbd9e1fd-57f2-4062-b39a-db349429667d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:43.863315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbd9e1fd-57f2-4062-b39a-db349429667d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:43.869828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbd9e1fd-57f2-4062-b39a-db349429667d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:43.870645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbd9e1fd-57f2-4062-b39a-db349429667d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:43.872153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbd9e1fd-57f2-4062-b39a-db349429667d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:43.877440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbd9e1fd-57f2-4062-b39a-db349429667d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:43.877440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbd9e1fd-57f2-4062-b39a-db349429667d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:43.963034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-506e94d6-fdc1-4071-8855-3adc73f467ad tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:43.980702 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-506e94d6-fdc1-4071-8855-3adc73f467ad tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1682 microversion: 2.1 time: 0.554000 Oct 29 01:30:43.982808 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2639/5510] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:43 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1682 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:44.304767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-43ec2509-1733-433b-8449-19961d8ed785 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:44.307031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-43ec2509-1733-433b-8449-19961d8ed785 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:44.319650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43ec2509-1733-433b-8449-19961d8ed785 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:44.326705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43ec2509-1733-433b-8449-19961d8ed785 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:44.327539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43ec2509-1733-433b-8449-19961d8ed785 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:44.331279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43ec2509-1733-433b-8449-19961d8ed785 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:44.346729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43ec2509-1733-433b-8449-19961d8ed785 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:44.347610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43ec2509-1733-433b-8449-19961d8ed785 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:44.982584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dbd9e1fd-57f2-4062-b39a-db349429667d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:44.990955 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dbd9e1fd-57f2-4062-b39a-db349429667d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1507 microversion: 2.1 time: 1.155499 Oct 29 01:30:44.994986 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2872/5511] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:43 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1507 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:45.014101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2b493020-5460-4021-9ede-fc0da7dbda8c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:45.014823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2b493020-5460-4021-9ede-fc0da7dbda8c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:45.030604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b493020-5460-4021-9ede-fc0da7dbda8c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:45.034850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b493020-5460-4021-9ede-fc0da7dbda8c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:45.039777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b493020-5460-4021-9ede-fc0da7dbda8c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:45.042068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b493020-5460-4021-9ede-fc0da7dbda8c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:45.042636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b493020-5460-4021-9ede-fc0da7dbda8c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:45.045734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b493020-5460-4021-9ede-fc0da7dbda8c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:45.070707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-43ec2509-1733-433b-8449-19961d8ed785 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:45.080814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-43ec2509-1733-433b-8449-19961d8ed785 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:45.081183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-43ec2509-1733-433b-8449-19961d8ed785 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:45.082364 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-43ec2509-1733-433b-8449-19961d8ed785 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1361 microversion: 2.26 time: 0.782743 Oct 29 01:30:45.090739 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2640/5512] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:30:44 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1361 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:30:45.105607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2eb78d52-1b93-4e63-bf8f-c2f1cf7018f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:45.108469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2eb78d52-1b93-4e63-bf8f-c2f1cf7018f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:45.120624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2eb78d52-1b93-4e63-bf8f-c2f1cf7018f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:45.132533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2eb78d52-1b93-4e63-bf8f-c2f1cf7018f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:45.137415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2eb78d52-1b93-4e63-bf8f-c2f1cf7018f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:45.146973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2eb78d52-1b93-4e63-bf8f-c2f1cf7018f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:45.153122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2eb78d52-1b93-4e63-bf8f-c2f1cf7018f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:45.153776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2eb78d52-1b93-4e63-bf8f-c2f1cf7018f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:45.275902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:30:45.380335 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2eb78d52-1b93-4e63-bf8f-c2f1cf7018f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "PUT /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1079 microversion: 2.1 time: 0.288257 Oct 29 01:30:45.381624 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2641/5513] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 29 01:30:45 2022] PUT /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1079 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:45.406610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b86390e0-4f86-4153-8957-8dd9939eb439 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:45.407516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b86390e0-4f86-4153-8957-8dd9939eb439 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:45.419146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b86390e0-4f86-4153-8957-8dd9939eb439 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:45.419956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b86390e0-4f86-4153-8957-8dd9939eb439 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:45.421231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b86390e0-4f86-4153-8957-8dd9939eb439 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:45.425740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b86390e0-4f86-4153-8957-8dd9939eb439 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:45.426409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b86390e0-4f86-4153-8957-8dd9939eb439 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:45.427018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b86390e0-4f86-4153-8957-8dd9939eb439 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:45.449137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2b493020-5460-4021-9ede-fc0da7dbda8c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:45.457599 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2b493020-5460-4021-9ede-fc0da7dbda8c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1682 microversion: 2.1 time: 0.447868 Oct 29 01:30:45.478215 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2873/5514] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:45 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1682 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:45.721504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:30:46.120096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f2597a5c-859f-455c-915a-5fd15a12f42a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:46.120722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f2597a5c-859f-455c-915a-5fd15a12f42a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:46.139174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b86390e0-4f86-4153-8957-8dd9939eb439 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:46.150828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2597a5c-859f-455c-915a-5fd15a12f42a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:46.156076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2597a5c-859f-455c-915a-5fd15a12f42a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:46.156792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2597a5c-859f-455c-915a-5fd15a12f42a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:46.157747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2597a5c-859f-455c-915a-5fd15a12f42a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:46.158401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2597a5c-859f-455c-915a-5fd15a12f42a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:46.159302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f2597a5c-859f-455c-915a-5fd15a12f42a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:46.165471 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b86390e0-4f86-4153-8957-8dd9939eb439 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1505 microversion: 2.1 time: 0.762048 Oct 29 01:30:46.169754 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2642/5515] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:45 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1505 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:46.199061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4716f883-a0d2-4a82-990e-e54e849ca7ec tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:46.200027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4716f883-a0d2-4a82-990e-e54e849ca7ec tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:46.211157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4716f883-a0d2-4a82-990e-e54e849ca7ec tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:46.212564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4716f883-a0d2-4a82-990e-e54e849ca7ec tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:46.214125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4716f883-a0d2-4a82-990e-e54e849ca7ec tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:46.215137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4716f883-a0d2-4a82-990e-e54e849ca7ec tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:46.217845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4716f883-a0d2-4a82-990e-e54e849ca7ec tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:46.218596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4716f883-a0d2-4a82-990e-e54e849ca7ec tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:47.084262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=8 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:30:47.094559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f2597a5c-859f-455c-915a-5fd15a12f42a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:47.112281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f2597a5c-859f-455c-915a-5fd15a12f42a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:47.114891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f2597a5c-859f-455c-915a-5fd15a12f42a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:47.122292 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f2597a5c-859f-455c-915a-5fd15a12f42a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1361 microversion: 2.26 time: 1.006165 Oct 29 01:30:47.125136 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2874/5516] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:30:46 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1361 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:30:47.130398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0a2d316b-3a11-486b-9fcc-773ebe343861 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:47.133273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0a2d316b-3a11-486b-9fcc-773ebe343861 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:47.145377 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4716f883-a0d2-4a82-990e-e54e849ca7ec tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:47.148763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a2d316b-3a11-486b-9fcc-773ebe343861 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:47.150642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a2d316b-3a11-486b-9fcc-773ebe343861 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:47.151723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a2d316b-3a11-486b-9fcc-773ebe343861 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:47.156301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a2d316b-3a11-486b-9fcc-773ebe343861 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:47.156905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a2d316b-3a11-486b-9fcc-773ebe343861 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:47.157488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a2d316b-3a11-486b-9fcc-773ebe343861 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:47.170463 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4716f883-a0d2-4a82-990e-e54e849ca7ec tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1505 microversion: 2.1 time: 0.973363 Oct 29 01:30:47.175269 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2643/5517] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:46 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1505 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:47.202977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:47.206021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:47.225838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:47.226601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:47.227240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:47.228434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:47.229083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:47.229722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:47.342268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:30:47.342943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:30:47.352245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:30:47.353553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:30:47.358073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:30:47.725429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:47.733703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:47.734649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:47.735266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:47.736309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:47.737019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:47.738318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:47.774889 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a3b1d22e-915b-46ef-b09f-3c47dd2d8573 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "POST /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5/action" status: 202 len: 1111 microversion: 2.1 time: 0.575695 Oct 29 01:30:47.776058 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2644/5518] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:30:47 2022] POST /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5/action => generated 1111 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 29 01:30:47.796531 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cb049371-3b02-4f74-b166-b2f7044427a2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:47.797452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cb049371-3b02-4f74-b166-b2f7044427a2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:47.809807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb049371-3b02-4f74-b166-b2f7044427a2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:47.811051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb049371-3b02-4f74-b166-b2f7044427a2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:47.812999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb049371-3b02-4f74-b166-b2f7044427a2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:47.814151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb049371-3b02-4f74-b166-b2f7044427a2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:47.817189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb049371-3b02-4f74-b166-b2f7044427a2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:47.817869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb049371-3b02-4f74-b166-b2f7044427a2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:47.962471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0a2d316b-3a11-486b-9fcc-773ebe343861 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:47.973723 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0a2d316b-3a11-486b-9fcc-773ebe343861 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1682 microversion: 2.1 time: 0.847105 Oct 29 01:30:48.009032 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2875/5519] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:47 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1682 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:48.063227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cb049371-3b02-4f74-b166-b2f7044427a2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:48.072292 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cb049371-3b02-4f74-b166-b2f7044427a2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1516 microversion: 2.1 time: 0.280239 Oct 29 01:30:48.072885 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2645/5520] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:47 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1516 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:48.153565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3026af79-13df-4b9a-bf71-b5317384fe28 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:48.155372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3026af79-13df-4b9a-bf71-b5317384fe28 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:48.167278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3026af79-13df-4b9a-bf71-b5317384fe28 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:48.168065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3026af79-13df-4b9a-bf71-b5317384fe28 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:48.168774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3026af79-13df-4b9a-bf71-b5317384fe28 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:48.170811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3026af79-13df-4b9a-bf71-b5317384fe28 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:48.172460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3026af79-13df-4b9a-bf71-b5317384fe28 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:48.173602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3026af79-13df-4b9a-bf71-b5317384fe28 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:49.003833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a40668f7-4e9e-483f-9f5c-6679e16cb5c2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:49.003833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a40668f7-4e9e-483f-9f5c-6679e16cb5c2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:49.033068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a40668f7-4e9e-483f-9f5c-6679e16cb5c2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:49.041802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a40668f7-4e9e-483f-9f5c-6679e16cb5c2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:49.041802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a40668f7-4e9e-483f-9f5c-6679e16cb5c2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:49.041802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a40668f7-4e9e-483f-9f5c-6679e16cb5c2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:49.042298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a40668f7-4e9e-483f-9f5c-6679e16cb5c2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:49.042875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a40668f7-4e9e-483f-9f5c-6679e16cb5c2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:49.090519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3026af79-13df-4b9a-bf71-b5317384fe28 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:49.106578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3026af79-13df-4b9a-bf71-b5317384fe28 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:49.120381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3026af79-13df-4b9a-bf71-b5317384fe28 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:49.141279 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3026af79-13df-4b9a-bf71-b5317384fe28 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1361 microversion: 2.26 time: 0.988144 Oct 29 01:30:49.143693 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2876/5521] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:30:48 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1361 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:30:49.162598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-909945b1-6d01-4b60-b08d-0bb0d76235a7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:49.168173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-909945b1-6d01-4b60-b08d-0bb0d76235a7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:49.192740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-909945b1-6d01-4b60-b08d-0bb0d76235a7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:49.197101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-909945b1-6d01-4b60-b08d-0bb0d76235a7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:49.197843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-909945b1-6d01-4b60-b08d-0bb0d76235a7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:49.198701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-909945b1-6d01-4b60-b08d-0bb0d76235a7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:49.199241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-909945b1-6d01-4b60-b08d-0bb0d76235a7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:49.200284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-909945b1-6d01-4b60-b08d-0bb0d76235a7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:49.600288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a40668f7-4e9e-483f-9f5c-6679e16cb5c2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:49.614769 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a40668f7-4e9e-483f-9f5c-6679e16cb5c2 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1614 microversion: 2.1 time: 0.618503 Oct 29 01:30:49.615689 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2646/5522] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:48 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1614 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:49.757631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-ce035683-2f80-44d9-897c-5c2796319df6 req-e72fd283-e2d2-4320-b5f2-206051832897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c303716-1880-4adb-b972-3bc6e24ba1cc", "name": "network-vif-deleted", "tag": "1fc7ef2d-5f81-4fa5-bffb-8c74fba80b4c"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:49.780230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ce035683-2f80-44d9-897c-5c2796319df6 req-e72fd283-e2d2-4320-b5f2-206051832897 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:49.782101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ce035683-2f80-44d9-897c-5c2796319df6 req-e72fd283-e2d2-4320-b5f2-206051832897 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:49.784331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ce035683-2f80-44d9-897c-5c2796319df6 req-e72fd283-e2d2-4320-b5f2-206051832897 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:49.832299 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-ce035683-2f80-44d9-897c-5c2796319df6 req-e72fd283-e2d2-4320-b5f2-206051832897 service nova] Creating event network-vif-deleted:1fc7ef2d-5f81-4fa5-bffb-8c74fba80b4c for instance 1c303716-1880-4adb-b972-3bc6e24ba1cc on n-h1-862964-3 Oct 29 01:30:49.855258 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-ce035683-2f80-44d9-897c-5c2796319df6 req-e72fd283-e2d2-4320-b5f2-206051832897 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101489 Oct 29 01:30:49.857432 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2647/5523] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:30:49.977628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-909945b1-6d01-4b60-b08d-0bb0d76235a7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:49.998222 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-909945b1-6d01-4b60-b08d-0bb0d76235a7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1516 microversion: 2.1 time: 0.848098 Oct 29 01:30:49.998909 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2877/5524] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:49 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1516 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:50.173559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d4f6fadd-b852-4cfa-9070-25054ea619d9 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:50.174140 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d4f6fadd-b852-4cfa-9070-25054ea619d9 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:50.198359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4f6fadd-b852-4cfa-9070-25054ea619d9 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:50.199818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4f6fadd-b852-4cfa-9070-25054ea619d9 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:50.200563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4f6fadd-b852-4cfa-9070-25054ea619d9 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:50.204079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4f6fadd-b852-4cfa-9070-25054ea619d9 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:50.206846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4f6fadd-b852-4cfa-9070-25054ea619d9 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:50.208419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4f6fadd-b852-4cfa-9070-25054ea619d9 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:50.643307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8d7f5ffe-d0f4-4e60-8142-494e43a25bb6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:50.650662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8d7f5ffe-d0f4-4e60-8142-494e43a25bb6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:50.666748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d7f5ffe-d0f4-4e60-8142-494e43a25bb6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:50.672480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d7f5ffe-d0f4-4e60-8142-494e43a25bb6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:50.674546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d7f5ffe-d0f4-4e60-8142-494e43a25bb6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:50.681898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d7f5ffe-d0f4-4e60-8142-494e43a25bb6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:50.682797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d7f5ffe-d0f4-4e60-8142-494e43a25bb6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:50.683548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d7f5ffe-d0f4-4e60-8142-494e43a25bb6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:50.771345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d7f5ffe-d0f4-4e60-8142-494e43a25bb6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:50.772535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d7f5ffe-d0f4-4e60-8142-494e43a25bb6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:50.801896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d7f5ffe-d0f4-4e60-8142-494e43a25bb6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:50.802536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-8d7f5ffe-d0f4-4e60-8142-494e43a25bb6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lazy-loading 'fault' on Instance uuid 1c303716-1880-4adb-b972-3bc6e24ba1cc {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:30:50.811905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d4f6fadd-b852-4cfa-9070-25054ea619d9 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:50.825352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d4f6fadd-b852-4cfa-9070-25054ea619d9 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:50.834522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d4f6fadd-b852-4cfa-9070-25054ea619d9 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:50.835726 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d4f6fadd-b852-4cfa-9070-25054ea619d9 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1361 microversion: 2.26 time: 0.667599 Oct 29 01:30:50.838138 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2648/5525] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:30:50 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1361 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:30:51.022476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-77371b18-5109-4d54-ac2b-284d10053273 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:51.023098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-77371b18-5109-4d54-ac2b-284d10053273 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:51.037433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77371b18-5109-4d54-ac2b-284d10053273 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:51.037943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77371b18-5109-4d54-ac2b-284d10053273 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:51.038373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77371b18-5109-4d54-ac2b-284d10053273 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:51.039088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77371b18-5109-4d54-ac2b-284d10053273 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:51.039544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77371b18-5109-4d54-ac2b-284d10053273 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:51.040037 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77371b18-5109-4d54-ac2b-284d10053273 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:51.079868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8d7f5ffe-d0f4-4e60-8142-494e43a25bb6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:51.116124 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8d7f5ffe-d0f4-4e60-8142-494e43a25bb6 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 200 len: 1331 microversion: 2.1 time: 0.478744 Oct 29 01:30:51.149103 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2878/5526] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:50 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 1331 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:51.867608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a55d77e5-64f6-433a-81b0-520e28edc64b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:51.869273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a55d77e5-64f6-433a-81b0-520e28edc64b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:51.892378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a55d77e5-64f6-433a-81b0-520e28edc64b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:51.893320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a55d77e5-64f6-433a-81b0-520e28edc64b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:51.893792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a55d77e5-64f6-433a-81b0-520e28edc64b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:51.894545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a55d77e5-64f6-433a-81b0-520e28edc64b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:51.895016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a55d77e5-64f6-433a-81b0-520e28edc64b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:51.895454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a55d77e5-64f6-433a-81b0-520e28edc64b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:52.067896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-77371b18-5109-4d54-ac2b-284d10053273 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:52.081672 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-77371b18-5109-4d54-ac2b-284d10053273 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1516 microversion: 2.1 time: 1.062948 Oct 29 01:30:52.105845 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2649/5527] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:51 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1516 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:52.115193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-6f8a3966-3fc1-41c5-9432-d0289b395ac8 req-bb05e525-c0a5-4d12-bf32-7c1385f54b2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3be39107-febf-4007-b4d7-b9b4d6138f5d", "tag": "cffd6ac5-c525-4650-af66-66c2e61aac96"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:52.127030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6f8a3966-3fc1-41c5-9432-d0289b395ac8 req-bb05e525-c0a5-4d12-bf32-7c1385f54b2f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:52.127826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6f8a3966-3fc1-41c5-9432-d0289b395ac8 req-bb05e525-c0a5-4d12-bf32-7c1385f54b2f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:52.128490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6f8a3966-3fc1-41c5-9432-d0289b395ac8 req-bb05e525-c0a5-4d12-bf32-7c1385f54b2f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:52.143024 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-6f8a3966-3fc1-41c5-9432-d0289b395ac8 req-bb05e525-c0a5-4d12-bf32-7c1385f54b2f service nova] Creating event network-changed:cffd6ac5-c525-4650-af66-66c2e61aac96 for instance 3be39107-febf-4007-b4d7-b9b4d6138f5d on n-h1-862964-3 Oct 29 01:30:52.149032 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-6f8a3966-3fc1-41c5-9432-d0289b395ac8 req-bb05e525-c0a5-4d12-bf32-7c1385f54b2f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039963 Oct 29 01:30:52.149996 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2650/5528] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:52.155648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-627549da-1172-427a-b5a1-5c7a83c3cd77 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:52.156624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-627549da-1172-427a-b5a1-5c7a83c3cd77 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:52.164324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-627549da-1172-427a-b5a1-5c7a83c3cd77 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:52.166123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-627549da-1172-427a-b5a1-5c7a83c3cd77 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:52.166764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-627549da-1172-427a-b5a1-5c7a83c3cd77 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:52.167808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-627549da-1172-427a-b5a1-5c7a83c3cd77 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:52.168574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-627549da-1172-427a-b5a1-5c7a83c3cd77 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:52.169191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-627549da-1172-427a-b5a1-5c7a83c3cd77 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:52.230085 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-627549da-1172-427a-b5a1-5c7a83c3cd77 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] HTTP exception thrown: Instance 1c303716-1880-4adb-b972-3bc6e24ba1cc could not be found. Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-627549da-1172-427a-b5a1-5c7a83c3cd77 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Request method failure captured: Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc HTTP/1.1 Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXICkjStyzUNQCP56iyabn5ahlWbK9bq57JWpf6w_r5-2BC1n9lfKn4n-q7ViwDGqwiAHQbWPA068CNGAzX2vWzwGSgwtRiu5lH8sKE1aT3VNdBS9vlw817eOLttRxo_xXGlmclE5Xf7yAYwC5hE1QU1PdlNbXv8l2Qz8VlCemFm6YRM Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad278c0b0b9a41beae8b29986e315743", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 444e13f1f2d945dfb31b83d8e19c2032 Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 1c303716-1880-4adb-b972-3bc6e24ba1cc could not be found. Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '1c303716-1880-4adb-b972-3bc6e24ba1cc'} Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c303716-1880-4adb-b972-3bc6e24ba1cc could not be found. Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c303716-1880-4adb-b972-3bc6e24ba1cc could not be found. Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:30:52.236346 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:30:52.243584 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:30:52.243584 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:30:52.243584 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:30:52.243584 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:30:52.243584 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:30:52.243584 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c303716-1880-4adb-b972-3bc6e24ba1cc could not be found. Oct 29 01:30:52.243584 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:30:52.243584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-627549da-1172-427a-b5a1-5c7a83c3cd77 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Returning 404 to user: Instance 1c303716-1880-4adb-b972-3bc6e24ba1cc could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:30:52.244332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a55d77e5-64f6-433a-81b0-520e28edc64b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:52.244618 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-627549da-1172-427a-b5a1-5c7a83c3cd77 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 404 len: 111 microversion: 2.1 time: 0.089697 Oct 29 01:30:52.246493 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2651/5529] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:52 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:30:52.254322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a687652b-6f92-459d-b103-490daf0956f5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '.version_select at 0x7f9d97f6cee0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:52.264796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a55d77e5-64f6-433a-81b0-520e28edc64b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:52.270817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a55d77e5-64f6-433a-81b0-520e28edc64b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:52.272172 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a55d77e5-64f6-433a-81b0-520e28edc64b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1361 microversion: 2.26 time: 0.409599 Oct 29 01:30:52.274929 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2879/5530] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:30:51 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1361 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:30:52.385584 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a687652b-6f92-459d-b103-490daf0956f5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746870452" status: 202 len: 0 microversion: 2.1 time: 0.135083 Oct 29 01:30:52.391544 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2652/5531] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 29 01:30:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746870452 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:30:53.134933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c41c5cf3-6bbc-4dd7-9e88-b44c1c5df454 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:53.134933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c41c5cf3-6bbc-4dd7-9e88-b44c1c5df454 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:53.134933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c41c5cf3-6bbc-4dd7-9e88-b44c1c5df454 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:53.141060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c41c5cf3-6bbc-4dd7-9e88-b44c1c5df454 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:53.141060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c41c5cf3-6bbc-4dd7-9e88-b44c1c5df454 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:53.141060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c41c5cf3-6bbc-4dd7-9e88-b44c1c5df454 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:53.141060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c41c5cf3-6bbc-4dd7-9e88-b44c1c5df454 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:53.147239 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c41c5cf3-6bbc-4dd7-9e88-b44c1c5df454 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:53.303145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-76932591-a33c-49ea-a067-3819a9ba80af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:53.305892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-76932591-a33c-49ea-a067-3819a9ba80af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:53.339714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76932591-a33c-49ea-a067-3819a9ba80af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:53.341539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76932591-a33c-49ea-a067-3819a9ba80af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:53.342218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76932591-a33c-49ea-a067-3819a9ba80af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:53.345340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76932591-a33c-49ea-a067-3819a9ba80af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:53.346595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76932591-a33c-49ea-a067-3819a9ba80af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:53.349229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76932591-a33c-49ea-a067-3819a9ba80af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:53.526019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c41c5cf3-6bbc-4dd7-9e88-b44c1c5df454 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:53.537957 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c41c5cf3-6bbc-4dd7-9e88-b44c1c5df454 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1516 microversion: 2.1 time: 0.421985 Oct 29 01:30:53.539100 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2880/5532] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:53 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1516 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:53.714050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-76932591-a33c-49ea-a067-3819a9ba80af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:53.729805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-76932591-a33c-49ea-a067-3819a9ba80af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:53.734903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-76932591-a33c-49ea-a067-3819a9ba80af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:53.736313 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-76932591-a33c-49ea-a067-3819a9ba80af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1361 microversion: 2.26 time: 0.437612 Oct 29 01:30:53.738218 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2653/5533] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:30:53 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1361 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:30:54.039145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bfd8f046-f6b0-425c-81be-de854b23f538 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Action: 'create', calling method: .version_select at 0x7f9d96b7a1f0>, body: {"keypair": {"name": "tempest-keypair-730506144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIL2a1HkyReszFHJHs4XERRlt17mTlxigprr7A3JOJlQ2KPq7NO56y3FRqvbNz39rxScaRpi0+wshRZkSNlcwjBB+a40AyUjxKTMiWPEeygv8CZugY6016zLAdU6DOQSZg=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:54.068372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-bfd8f046-f6b0-425c-81be-de854b23f538 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Getting quotas for project ad278c0b0b9a41beae8b29986e315743. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:30:54.084537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-bfd8f046-f6b0-425c-81be-de854b23f538 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Getting quotas for user 444e13f1f2d945dfb31b83d8e19c2032 and project ad278c0b0b9a41beae8b29986e315743. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:30:54.314315 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bfd8f046-f6b0-425c-81be-de854b23f538 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.273432 Oct 29 01:30:54.314315 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2881/5534] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:30:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:30:54.570792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a352505a-b98c-4edd-95af-5f6a8672c8cf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:54.572977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a352505a-b98c-4edd-95af-5f6a8672c8cf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:54.583214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a352505a-b98c-4edd-95af-5f6a8672c8cf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:54.585090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a352505a-b98c-4edd-95af-5f6a8672c8cf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:54.585790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a352505a-b98c-4edd-95af-5f6a8672c8cf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:54.587264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a352505a-b98c-4edd-95af-5f6a8672c8cf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:54.588035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a352505a-b98c-4edd-95af-5f6a8672c8cf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:54.588739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a352505a-b98c-4edd-95af-5f6a8672c8cf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:54.778715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-119c2a1e-a0db-4996-ab07-1d33d9986e2a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:54.783232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-119c2a1e-a0db-4996-ab07-1d33d9986e2a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:54.835819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-119c2a1e-a0db-4996-ab07-1d33d9986e2a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:54.835819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-119c2a1e-a0db-4996-ab07-1d33d9986e2a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:54.835819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-119c2a1e-a0db-4996-ab07-1d33d9986e2a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:54.835819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-119c2a1e-a0db-4996-ab07-1d33d9986e2a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:54.835819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-119c2a1e-a0db-4996-ab07-1d33d9986e2a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:54.835819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-119c2a1e-a0db-4996-ab07-1d33d9986e2a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:55.167160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a352505a-b98c-4edd-95af-5f6a8672c8cf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:55.177594 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a352505a-b98c-4edd-95af-5f6a8672c8cf tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1516 microversion: 2.1 time: 0.613912 Oct 29 01:30:55.190143 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2654/5535] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:54 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1516 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:55.256058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-119c2a1e-a0db-4996-ab07-1d33d9986e2a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:55.266083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-119c2a1e-a0db-4996-ab07-1d33d9986e2a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:55.267507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-119c2a1e-a0db-4996-ab07-1d33d9986e2a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:55.268741 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-119c2a1e-a0db-4996-ab07-1d33d9986e2a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1361 microversion: 2.26 time: 0.506485 Oct 29 01:30:55.269328 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2882/5536] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:30:54 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1361 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:30:56.205455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2787ffe0-ec85-4ad3-8db4-a7d743136a10 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:56.206791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2787ffe0-ec85-4ad3-8db4-a7d743136a10 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:56.222699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2787ffe0-ec85-4ad3-8db4-a7d743136a10 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:56.223170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2787ffe0-ec85-4ad3-8db4-a7d743136a10 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:56.223773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2787ffe0-ec85-4ad3-8db4-a7d743136a10 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:56.224725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2787ffe0-ec85-4ad3-8db4-a7d743136a10 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:56.225375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2787ffe0-ec85-4ad3-8db4-a7d743136a10 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:56.225948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2787ffe0-ec85-4ad3-8db4-a7d743136a10 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:56.295543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-695ba051-25a5-47a4-946b-32c8a9cd6772 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:56.296838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-695ba051-25a5-47a4-946b-32c8a9cd6772 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:56.322003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:30:56.327811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-695ba051-25a5-47a4-946b-32c8a9cd6772 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:56.329587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-695ba051-25a5-47a4-946b-32c8a9cd6772 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:56.330450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-695ba051-25a5-47a4-946b-32c8a9cd6772 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:56.333872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-695ba051-25a5-47a4-946b-32c8a9cd6772 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:56.334655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-695ba051-25a5-47a4-946b-32c8a9cd6772 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:56.335297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-695ba051-25a5-47a4-946b-32c8a9cd6772 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:57.067888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2787ffe0-ec85-4ad3-8db4-a7d743136a10 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:57.084368 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2787ffe0-ec85-4ad3-8db4-a7d743136a10 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1516 microversion: 2.1 time: 0.884087 Oct 29 01:30:57.087920 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2655/5537] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:56 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1516 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:57.101769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-695ba051-25a5-47a4-946b-32c8a9cd6772 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:57.113371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-695ba051-25a5-47a4-946b-32c8a9cd6772 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:57.116566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-695ba051-25a5-47a4-946b-32c8a9cd6772 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:57.117881 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-695ba051-25a5-47a4-946b-32c8a9cd6772 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1361 microversion: 2.26 time: 0.826958 Oct 29 01:30:57.118926 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2883/5538] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:30:56 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1361 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:30:57.580913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-53d90271-3a50-4153-b917-6ac815cf538c req-9eb47cd4-6671-4ea9-9894-2cd61806ee07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be39107-febf-4007-b4d7-b9b4d6138f5d", "name": "network-vif-plugged", "status": "completed", "tag": "cffd6ac5-c525-4650-af66-66c2e61aac96"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:57.596819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-53d90271-3a50-4153-b917-6ac815cf538c req-9eb47cd4-6671-4ea9-9894-2cd61806ee07 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:57.597606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-53d90271-3a50-4153-b917-6ac815cf538c req-9eb47cd4-6671-4ea9-9894-2cd61806ee07 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:57.598249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-53d90271-3a50-4153-b917-6ac815cf538c req-9eb47cd4-6671-4ea9-9894-2cd61806ee07 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:57.611754 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-53d90271-3a50-4153-b917-6ac815cf538c req-9eb47cd4-6671-4ea9-9894-2cd61806ee07 service nova] Creating event network-vif-plugged:cffd6ac5-c525-4650-af66-66c2e61aac96 for instance 3be39107-febf-4007-b4d7-b9b4d6138f5d on n-h1-862964-3 Oct 29 01:30:57.617589 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-53d90271-3a50-4153-b917-6ac815cf538c req-9eb47cd4-6671-4ea9-9894-2cd61806ee07 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041913 Oct 29 01:30:57.620322 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2656/5539] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:58.115376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a8a0b294-0453-4724-a728-2d59bf8359d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:58.116065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a8a0b294-0453-4724-a728-2d59bf8359d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:58.131878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8a0b294-0453-4724-a728-2d59bf8359d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:58.134079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8a0b294-0453-4724-a728-2d59bf8359d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:58.134988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8a0b294-0453-4724-a728-2d59bf8359d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:58.139499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8a0b294-0453-4724-a728-2d59bf8359d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:58.140394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8a0b294-0453-4724-a728-2d59bf8359d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:58.141129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8a0b294-0453-4724-a728-2d59bf8359d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:58.146265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1c7a9fb6-3de3-4008-8b4e-f9c04935bb79 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:58.147078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1c7a9fb6-3de3-4008-8b4e-f9c04935bb79 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:58.166489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c7a9fb6-3de3-4008-8b4e-f9c04935bb79 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:58.170014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c7a9fb6-3de3-4008-8b4e-f9c04935bb79 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:58.172123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c7a9fb6-3de3-4008-8b4e-f9c04935bb79 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:58.172977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c7a9fb6-3de3-4008-8b4e-f9c04935bb79 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:58.181931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c7a9fb6-3de3-4008-8b4e-f9c04935bb79 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:58.186442 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c7a9fb6-3de3-4008-8b4e-f9c04935bb79 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:58.194973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:30:58.213321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:30:58.646362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1c7a9fb6-3de3-4008-8b4e-f9c04935bb79 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:58.668026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1c7a9fb6-3de3-4008-8b4e-f9c04935bb79 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:58.669620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1c7a9fb6-3de3-4008-8b4e-f9c04935bb79 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:58.670811 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1c7a9fb6-3de3-4008-8b4e-f9c04935bb79 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1361 microversion: 2.26 time: 0.529284 Oct 29 01:30:58.671389 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2657/5540] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:30:58 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1361 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:30:58.691582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a8a0b294-0453-4724-a728-2d59bf8359d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:58.705082 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a8a0b294-0453-4724-a728-2d59bf8359d6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1516 microversion: 2.1 time: 0.598727 Oct 29 01:30:58.708155 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2884/5541] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:58 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1516 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:59.702427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-906c948d-280f-45cf-8449-3d68f2fe2304 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:59.703252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-906c948d-280f-45cf-8449-3d68f2fe2304 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:59.725848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-906c948d-280f-45cf-8449-3d68f2fe2304 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:59.727274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-906c948d-280f-45cf-8449-3d68f2fe2304 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:59.729899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-906c948d-280f-45cf-8449-3d68f2fe2304 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:59.730940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-906c948d-280f-45cf-8449-3d68f2fe2304 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:59.731536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-906c948d-280f-45cf-8449-3d68f2fe2304 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:59.732610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-906c948d-280f-45cf-8449-3d68f2fe2304 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:59.737784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-26213b00-0ee9-4118-89cf-031602d4eba6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:59.740668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-26213b00-0ee9-4118-89cf-031602d4eba6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:30:59.763618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26213b00-0ee9-4118-89cf-031602d4eba6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:59.769089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26213b00-0ee9-4118-89cf-031602d4eba6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:59.769766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26213b00-0ee9-4118-89cf-031602d4eba6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:30:59.770668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26213b00-0ee9-4118-89cf-031602d4eba6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:30:59.771310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26213b00-0ee9-4118-89cf-031602d4eba6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:30:59.771811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26213b00-0ee9-4118-89cf-031602d4eba6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:00.036301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-906c948d-280f-45cf-8449-3d68f2fe2304 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:00.046973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-906c948d-280f-45cf-8449-3d68f2fe2304 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:00.048826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-906c948d-280f-45cf-8449-3d68f2fe2304 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:00.050071 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-906c948d-280f-45cf-8449-3d68f2fe2304 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1545 microversion: 2.26 time: 0.352028 Oct 29 01:31:00.051570 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2658/5542] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:30:59 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1545 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:00.058190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-83f8510b-036b-48b0-93fc-dbbdbf0aa605 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1638982436", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3aada4e4-ab9d-407f-aadb-56a56f4bc58e"}], "security_groups": [{"name": "tempest-securitygroup--1527573103"}], "key_name": "tempest-keypair-730506144", "user_data": "}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:00.068350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-26213b00-0ee9-4118-89cf-031602d4eba6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:00.081859 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-26213b00-0ee9-4118-89cf-031602d4eba6 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1516 microversion: 2.1 time: 0.347811 Oct 29 01:31:00.094567 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2885/5543] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:30:59 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1516 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:00.107749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cc260c60-643e-49bd-ab88-4e4616e0cf93 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '.version_select at 0x7f9d9fd93550>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:00.125684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc260c60-643e-49bd-ab88-4e4616e0cf93 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:00.126177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc260c60-643e-49bd-ab88-4e4616e0cf93 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:00.126617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc260c60-643e-49bd-ab88-4e4616e0cf93 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:00.128713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cc260c60-643e-49bd-ab88-4e4616e0cf93 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:00.138702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc260c60-643e-49bd-ab88-4e4616e0cf93 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:00.139229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc260c60-643e-49bd-ab88-4e4616e0cf93 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:00.139641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc260c60-643e-49bd-ab88-4e4616e0cf93 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:00.140360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc260c60-643e-49bd-ab88-4e4616e0cf93 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:00.140806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc260c60-643e-49bd-ab88-4e4616e0cf93 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:00.141268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc260c60-643e-49bd-ab88-4e4616e0cf93 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:00.192239 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc260c60-643e-49bd-ab88-4e4616e0cf93 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:00.193128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc260c60-643e-49bd-ab88-4e4616e0cf93 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:00.193777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc260c60-643e-49bd-ab88-4e4616e0cf93 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:00.241107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-83f8510b-036b-48b0-93fc-dbbdbf0aa605 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] validate_networks() for [('3aada4e4-ab9d-407f-aadb-56a56f4bc58e', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:31:00.251288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc260c60-643e-49bd-ab88-4e4616e0cf93 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:00.252079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc260c60-643e-49bd-ab88-4e4616e0cf93 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:00.252686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc260c60-643e-49bd-ab88-4e4616e0cf93 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:00.437604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-cc260c60-643e-49bd-ab88-4e4616e0cf93 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lazy-loading 'flavor' on Instance uuid 3be39107-febf-4007-b4d7-b9b4d6138f5d {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:31:00.466512 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cc260c60-643e-49bd-ab88-4e4616e0cf93 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "PUT /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags/tempest-tag-1365868371" status: 201 len: 0 microversion: 2.26 time: 0.369924 Oct 29 01:31:00.467530 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2886/5544] 10.222.0.26 () {62 vars in 1380 bytes} [Sat Oct 29 01:31:00 2022] PUT /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags/tempest-tag-1365868371 => generated 0 bytes in 372 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 29 01:31:00.480126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-924c9c6e-733c-4215-800b-39c9709164c7 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '.version_select at 0x7f9d97769940>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:00.489872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-924c9c6e-733c-4215-800b-39c9709164c7 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:00.490772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-924c9c6e-733c-4215-800b-39c9709164c7 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:00.491600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-924c9c6e-733c-4215-800b-39c9709164c7 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:00.508065 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-924c9c6e-733c-4215-800b-39c9709164c7 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags/tempest-tag-1365868371" status: 204 len: 0 microversion: 2.26 time: 0.033164 Oct 29 01:31:00.508989 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2887/5545] 10.222.0.26 () {60 vars in 1361 bytes} [Sat Oct 29 01:31:00 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags/tempest-tag-1365868371 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:31:00.525203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f0eea8b4-1752-46f6-98ca-d3d52b58ac8b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '.version_select at 0x7f9d9fd93b80>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:00.541543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0eea8b4-1752-46f6-98ca-d3d52b58ac8b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:00.542107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0eea8b4-1752-46f6-98ca-d3d52b58ac8b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:00.542615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0eea8b4-1752-46f6-98ca-d3d52b58ac8b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:00.543663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f0eea8b4-1752-46f6-98ca-d3d52b58ac8b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:00.552219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0eea8b4-1752-46f6-98ca-d3d52b58ac8b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:00.552727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0eea8b4-1752-46f6-98ca-d3d52b58ac8b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:00.553193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0eea8b4-1752-46f6-98ca-d3d52b58ac8b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:00.554552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0eea8b4-1752-46f6-98ca-d3d52b58ac8b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:00.555629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0eea8b4-1752-46f6-98ca-d3d52b58ac8b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:00.557214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0eea8b4-1752-46f6-98ca-d3d52b58ac8b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:00.589224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0eea8b4-1752-46f6-98ca-d3d52b58ac8b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:00.589895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0eea8b4-1752-46f6-98ca-d3d52b58ac8b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:00.590485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0eea8b4-1752-46f6-98ca-d3d52b58ac8b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:00.794550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-83f8510b-036b-48b0-93fc-dbbdbf0aa605 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:31:00.795092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-83f8510b-036b-48b0-93fc-dbbdbf0aa605 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:31:00.795583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-83f8510b-036b-48b0-93fc-dbbdbf0aa605 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:31:00.796069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-83f8510b-036b-48b0-93fc-dbbdbf0aa605 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:31:00.796489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-83f8510b-036b-48b0-93fc-dbbdbf0aa605 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:31:00.808012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83f8510b-036b-48b0-93fc-dbbdbf0aa605 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:00.808501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83f8510b-036b-48b0-93fc-dbbdbf0aa605 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:00.808940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83f8510b-036b-48b0-93fc-dbbdbf0aa605 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:00.809720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83f8510b-036b-48b0-93fc-dbbdbf0aa605 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:00.810213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83f8510b-036b-48b0-93fc-dbbdbf0aa605 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:00.810638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83f8510b-036b-48b0-93fc-dbbdbf0aa605 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:00.829995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-83f8510b-036b-48b0-93fc-dbbdbf0aa605 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Getting quotas for project ad278c0b0b9a41beae8b29986e315743. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:31:00.835532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-83f8510b-036b-48b0-93fc-dbbdbf0aa605 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Getting quotas for user 444e13f1f2d945dfb31b83d8e19c2032 and project ad278c0b0b9a41beae8b29986e315743. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:31:00.848849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-83f8510b-036b-48b0-93fc-dbbdbf0aa605 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:31:00.851340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-83f8510b-036b-48b0-93fc-dbbdbf0aa605 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:31:00.938383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-f0eea8b4-1752-46f6-98ca-d3d52b58ac8b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lazy-loading 'flavor' on Instance uuid 3be39107-febf-4007-b4d7-b9b4d6138f5d {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:31:00.995168 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f0eea8b4-1752-46f6-98ca-d3d52b58ac8b tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags" status: 204 len: 0 microversion: 2.26 time: 0.480890 Oct 29 01:31:00.995874 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2888/5546] 10.222.0.26 () {60 vars in 1295 bytes} [Sat Oct 29 01:31:00 2022] DELETE /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 29 01:31:01.030415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f42dd47f-a7fd-4735-a00b-6dbe94bac0b3 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '.version_select at 0x7f9d9fe61c10>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:01.047796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f42dd47f-a7fd-4735-a00b-6dbe94bac0b3 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:01.048711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f42dd47f-a7fd-4735-a00b-6dbe94bac0b3 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:01.049383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f42dd47f-a7fd-4735-a00b-6dbe94bac0b3 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:01.062763 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f42dd47f-a7fd-4735-a00b-6dbe94bac0b3 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags" status: 200 len: 12 microversion: 2.26 time: 0.057462 Oct 29 01:31:01.063995 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2889/5547] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 29 01:31:01 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags => generated 12 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:01.079322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-92507bb2-a5de-471b-939d-8a49b839dcf2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '.version_select at 0x7f9d9fefb820>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:01.099624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92507bb2-a5de-471b-939d-8a49b839dcf2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:01.099624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92507bb2-a5de-471b-939d-8a49b839dcf2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:01.099624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92507bb2-a5de-471b-939d-8a49b839dcf2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:01.100316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-92507bb2-a5de-471b-939d-8a49b839dcf2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:01.110876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92507bb2-a5de-471b-939d-8a49b839dcf2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:01.111750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92507bb2-a5de-471b-939d-8a49b839dcf2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:01.112373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92507bb2-a5de-471b-939d-8a49b839dcf2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:01.113380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92507bb2-a5de-471b-939d-8a49b839dcf2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:01.114043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92507bb2-a5de-471b-939d-8a49b839dcf2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:01.114784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92507bb2-a5de-471b-939d-8a49b839dcf2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:01.125548 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-83f8510b-036b-48b0-93fc-dbbdbf0aa605 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.072603 Oct 29 01:31:01.126489 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2659/5548] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:31:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:31:01.135226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5a6ac119-5129-4091-8a13-3e6352de587c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:01.139764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5a6ac119-5129-4091-8a13-3e6352de587c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:01.154408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a6ac119-5129-4091-8a13-3e6352de587c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:01.155770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a6ac119-5129-4091-8a13-3e6352de587c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:01.156312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a6ac119-5129-4091-8a13-3e6352de587c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:01.158598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a6ac119-5129-4091-8a13-3e6352de587c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:01.160357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a6ac119-5129-4091-8a13-3e6352de587c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:01.161702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a6ac119-5129-4091-8a13-3e6352de587c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:01.178666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92507bb2-a5de-471b-939d-8a49b839dcf2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:01.179731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92507bb2-a5de-471b-939d-8a49b839dcf2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:01.180908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92507bb2-a5de-471b-939d-8a49b839dcf2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:01.191930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92507bb2-a5de-471b-939d-8a49b839dcf2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:01.192642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92507bb2-a5de-471b-939d-8a49b839dcf2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:01.193535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-92507bb2-a5de-471b-939d-8a49b839dcf2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:01.369214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-92507bb2-a5de-471b-939d-8a49b839dcf2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lazy-loading 'flavor' on Instance uuid 3be39107-febf-4007-b4d7-b9b4d6138f5d {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:31:01.437459 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-92507bb2-a5de-471b-939d-8a49b839dcf2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "PUT /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags/tempest-tag-1240438412" status: 201 len: 0 microversion: 2.26 time: 0.367413 Oct 29 01:31:01.440892 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2890/5549] 10.222.0.26 () {62 vars in 1380 bytes} [Sat Oct 29 01:31:01 2022] PUT /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags/tempest-tag-1240438412 => generated 0 bytes in 372 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 29 01:31:01.456343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c2e24b91-d907-42f3-850e-c59375cf8aa3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:01.458293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c2e24b91-d907-42f3-850e-c59375cf8aa3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:01.467952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5a6ac119-5129-4091-8a13-3e6352de587c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:01.479292 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5a6ac119-5129-4091-8a13-3e6352de587c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1516 microversion: 2.1 time: 0.350128 Oct 29 01:31:01.498293 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2660/5550] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:01 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1516 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:01.504888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7c42e843-28b5-4c87-87bc-3351c7efed62 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '.version_select at 0x7f9d97e2c4c0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:01.516287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c42e843-28b5-4c87-87bc-3351c7efed62 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:01.519874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c42e843-28b5-4c87-87bc-3351c7efed62 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:01.521272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c42e843-28b5-4c87-87bc-3351c7efed62 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:01.563494 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7c42e843-28b5-4c87-87bc-3351c7efed62 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags" status: 200 len: 36 microversion: 2.26 time: 0.063872 Oct 29 01:31:01.566117 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2661/5551] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 29 01:31:01 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags => generated 36 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:01.599272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c2e24b91-d907-42f3-850e-c59375cf8aa3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:01.608631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-40064de7-fc41-4f44-bb51-54aebaa8ef8c tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '.version_select at 0x7f9d9c1f05e0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:01.627136 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c2e24b91-d907-42f3-850e-c59375cf8aa3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 200 len: 1241 microversion: 2.1 time: 0.165352 Oct 29 01:31:01.631582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40064de7-fc41-4f44-bb51-54aebaa8ef8c tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:01.632554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40064de7-fc41-4f44-bb51-54aebaa8ef8c tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:01.633759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40064de7-fc41-4f44-bb51-54aebaa8ef8c tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:01.635916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-40064de7-fc41-4f44-bb51-54aebaa8ef8c tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:01.646886 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2891/5552] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:01 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 1241 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:01.650851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40064de7-fc41-4f44-bb51-54aebaa8ef8c tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:01.651364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40064de7-fc41-4f44-bb51-54aebaa8ef8c tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:01.651807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40064de7-fc41-4f44-bb51-54aebaa8ef8c tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:01.658247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40064de7-fc41-4f44-bb51-54aebaa8ef8c tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:01.666530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40064de7-fc41-4f44-bb51-54aebaa8ef8c tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:01.666530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40064de7-fc41-4f44-bb51-54aebaa8ef8c tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:01.743968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40064de7-fc41-4f44-bb51-54aebaa8ef8c tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:01.747473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40064de7-fc41-4f44-bb51-54aebaa8ef8c tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:01.747997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40064de7-fc41-4f44-bb51-54aebaa8ef8c tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:01.907513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-40064de7-fc41-4f44-bb51-54aebaa8ef8c tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lazy-loading 'flavor' on Instance uuid 3be39107-febf-4007-b4d7-b9b4d6138f5d {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:31:01.970853 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-40064de7-fc41-4f44-bb51-54aebaa8ef8c tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags/tempest-tag-1240438412" status: 204 len: 0 microversion: 2.26 time: 0.382417 Oct 29 01:31:01.971521 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2662/5553] 10.222.0.26 () {60 vars in 1364 bytes} [Sat Oct 29 01:31:01 2022] DELETE /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags/tempest-tag-1240438412 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:31:01.981541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0fc4b235-9ab3-4c81-a239-3bd720ce18fa tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '.version_select at 0x7f9d9695e550>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:02.004422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc4b235-9ab3-4c81-a239-3bd720ce18fa tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:02.010007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc4b235-9ab3-4c81-a239-3bd720ce18fa tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:02.014586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc4b235-9ab3-4c81-a239-3bd720ce18fa tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:02.046568 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0fc4b235-9ab3-4c81-a239-3bd720ce18fa tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags" status: 200 len: 12 microversion: 2.26 time: 0.069058 Oct 29 01:31:02.049122 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2892/5554] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 29 01:31:01 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags => generated 12 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:02.063581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eb60c84f-0cdc-4374-a825-b2e9bff7903f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '.version_select at 0x7f9d97ac13a0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:02.100124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb60c84f-0cdc-4374-a825-b2e9bff7903f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:02.100895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb60c84f-0cdc-4374-a825-b2e9bff7903f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:02.101511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb60c84f-0cdc-4374-a825-b2e9bff7903f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:02.102332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-eb60c84f-0cdc-4374-a825-b2e9bff7903f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:02.109965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb60c84f-0cdc-4374-a825-b2e9bff7903f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:02.110686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb60c84f-0cdc-4374-a825-b2e9bff7903f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:02.111301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb60c84f-0cdc-4374-a825-b2e9bff7903f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:02.112155 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb60c84f-0cdc-4374-a825-b2e9bff7903f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:02.112762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb60c84f-0cdc-4374-a825-b2e9bff7903f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:02.113896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb60c84f-0cdc-4374-a825-b2e9bff7903f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:02.146182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb60c84f-0cdc-4374-a825-b2e9bff7903f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:02.147311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb60c84f-0cdc-4374-a825-b2e9bff7903f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:02.148385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb60c84f-0cdc-4374-a825-b2e9bff7903f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:02.210695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-eb60c84f-0cdc-4374-a825-b2e9bff7903f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lazy-loading 'flavor' on Instance uuid 3be39107-febf-4007-b4d7-b9b4d6138f5d {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:31:02.264417 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-eb60c84f-0cdc-4374-a825-b2e9bff7903f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags" status: 204 len: 0 microversion: 2.26 time: 0.205734 Oct 29 01:31:02.268802 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2663/5555] 10.222.0.26 () {60 vars in 1295 bytes} [Sat Oct 29 01:31:02 2022] DELETE /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:31:02.279153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0ff4f00e-f62a-429f-b1f0-76fa46b2d2fc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '.version_select at 0x7f9d96c490d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:02.299047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ff4f00e-f62a-429f-b1f0-76fa46b2d2fc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:02.299741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ff4f00e-f62a-429f-b1f0-76fa46b2d2fc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:02.300333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ff4f00e-f62a-429f-b1f0-76fa46b2d2fc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:02.301118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0ff4f00e-f62a-429f-b1f0-76fa46b2d2fc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:02.320742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ff4f00e-f62a-429f-b1f0-76fa46b2d2fc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:02.324536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ff4f00e-f62a-429f-b1f0-76fa46b2d2fc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:02.325696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ff4f00e-f62a-429f-b1f0-76fa46b2d2fc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:02.326990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ff4f00e-f62a-429f-b1f0-76fa46b2d2fc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:02.327629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ff4f00e-f62a-429f-b1f0-76fa46b2d2fc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:02.331141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ff4f00e-f62a-429f-b1f0-76fa46b2d2fc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:02.364770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ff4f00e-f62a-429f-b1f0-76fa46b2d2fc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:02.365519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ff4f00e-f62a-429f-b1f0-76fa46b2d2fc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:02.366113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ff4f00e-f62a-429f-b1f0-76fa46b2d2fc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:02.378424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ff4f00e-f62a-429f-b1f0-76fa46b2d2fc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:02.396688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ff4f00e-f62a-429f-b1f0-76fa46b2d2fc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:02.398732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ff4f00e-f62a-429f-b1f0-76fa46b2d2fc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:02.506686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f1eb0c73-0a6a-4554-9db2-59bcff18af64 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:02.507311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f1eb0c73-0a6a-4554-9db2-59bcff18af64 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:02.516785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1eb0c73-0a6a-4554-9db2-59bcff18af64 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:02.517462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1eb0c73-0a6a-4554-9db2-59bcff18af64 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:02.517912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1eb0c73-0a6a-4554-9db2-59bcff18af64 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:02.524376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1eb0c73-0a6a-4554-9db2-59bcff18af64 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:02.525515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1eb0c73-0a6a-4554-9db2-59bcff18af64 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:02.526585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1eb0c73-0a6a-4554-9db2-59bcff18af64 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:02.610506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-0ff4f00e-f62a-429f-b1f0-76fa46b2d2fc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lazy-loading 'flavor' on Instance uuid 3be39107-febf-4007-b4d7-b9b4d6138f5d {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:31:02.677025 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0ff4f00e-f62a-429f-b1f0-76fa46b2d2fc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "PUT /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags/tempest-tag-1839325771" status: 201 len: 0 microversion: 2.26 time: 0.403642 Oct 29 01:31:02.682637 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2893/5556] 10.222.0.26 () {62 vars in 1380 bytes} [Sat Oct 29 01:31:02 2022] PUT /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags/tempest-tag-1839325771 => generated 0 bytes in 406 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 29 01:31:02.685590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f241b9a6-5daa-4541-8e32-87404dae6862 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:02.691218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f241b9a6-5daa-4541-8e32-87404dae6862 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:02.947166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f241b9a6-5daa-4541-8e32-87404dae6862 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:02.960170 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f241b9a6-5daa-4541-8e32-87404dae6862 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 200 len: 1241 microversion: 2.1 time: 0.278376 Oct 29 01:31:02.961074 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2894/5557] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:02 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 1241 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:02.984758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f1eb0c73-0a6a-4554-9db2-59bcff18af64 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:02.993769 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f1eb0c73-0a6a-4554-9db2-59bcff18af64 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1516 microversion: 2.1 time: 0.491242 Oct 29 01:31:02.994546 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2664/5558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:02 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1516 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:02.996472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81bc4570-d9ae-4ee4-acd2-f0f8eb64e58f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '.version_select at 0x7f9d967429d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:03.011456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81bc4570-d9ae-4ee4-acd2-f0f8eb64e58f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:03.012185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81bc4570-d9ae-4ee4-acd2-f0f8eb64e58f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:03.012906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81bc4570-d9ae-4ee4-acd2-f0f8eb64e58f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:03.014434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-81bc4570-d9ae-4ee4-acd2-f0f8eb64e58f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:03.022064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81bc4570-d9ae-4ee4-acd2-f0f8eb64e58f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:03.023593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81bc4570-d9ae-4ee4-acd2-f0f8eb64e58f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:03.025305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81bc4570-d9ae-4ee4-acd2-f0f8eb64e58f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:03.026451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81bc4570-d9ae-4ee4-acd2-f0f8eb64e58f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:03.027078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81bc4570-d9ae-4ee4-acd2-f0f8eb64e58f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:03.027827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81bc4570-d9ae-4ee4-acd2-f0f8eb64e58f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:03.113147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81bc4570-d9ae-4ee4-acd2-f0f8eb64e58f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:03.113796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81bc4570-d9ae-4ee4-acd2-f0f8eb64e58f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:03.114328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81bc4570-d9ae-4ee4-acd2-f0f8eb64e58f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:03.138339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81bc4570-d9ae-4ee4-acd2-f0f8eb64e58f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:03.138843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81bc4570-d9ae-4ee4-acd2-f0f8eb64e58f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:03.142568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81bc4570-d9ae-4ee4-acd2-f0f8eb64e58f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:03.342779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-81bc4570-d9ae-4ee4-acd2-f0f8eb64e58f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lazy-loading 'flavor' on Instance uuid 3be39107-febf-4007-b4d7-b9b4d6138f5d {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:31:03.400320 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-81bc4570-d9ae-4ee4-acd2-f0f8eb64e58f tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "PUT /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags/tempest-tag-791359999" status: 201 len: 0 microversion: 2.26 time: 0.425841 Oct 29 01:31:03.401249 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2895/5559] 10.222.0.26 () {62 vars in 1377 bytes} [Sat Oct 29 01:31:02 2022] PUT /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags/tempest-tag-791359999 => generated 0 bytes in 440 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 29 01:31:03.411093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ee9f9952-ea31-4f73-8af7-e4389ee3cd97 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '.version_select at 0x7f9d9c476310>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:03.419837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9f9952-ea31-4f73-8af7-e4389ee3cd97 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:03.429897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9f9952-ea31-4f73-8af7-e4389ee3cd97 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:03.430737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9f9952-ea31-4f73-8af7-e4389ee3cd97 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:03.431612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ee9f9952-ea31-4f73-8af7-e4389ee3cd97 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:03.439688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:31:03.441628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9f9952-ea31-4f73-8af7-e4389ee3cd97 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:03.442267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9f9952-ea31-4f73-8af7-e4389ee3cd97 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:03.442853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9f9952-ea31-4f73-8af7-e4389ee3cd97 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:03.443705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9f9952-ea31-4f73-8af7-e4389ee3cd97 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:03.444332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9f9952-ea31-4f73-8af7-e4389ee3cd97 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:03.444922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9f9952-ea31-4f73-8af7-e4389ee3cd97 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:03.472067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9f9952-ea31-4f73-8af7-e4389ee3cd97 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:03.473136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9f9952-ea31-4f73-8af7-e4389ee3cd97 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:03.473762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee9f9952-ea31-4f73-8af7-e4389ee3cd97 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:03.675986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-ee9f9952-ea31-4f73-8af7-e4389ee3cd97 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lazy-loading 'flavor' on Instance uuid 3be39107-febf-4007-b4d7-b9b4d6138f5d {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:31:03.750006 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ee9f9952-ea31-4f73-8af7-e4389ee3cd97 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags" status: 204 len: 0 microversion: 2.26 time: 0.335336 Oct 29 01:31:03.755933 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2665/5560] 10.222.0.26 () {60 vars in 1295 bytes} [Sat Oct 29 01:31:03 2022] DELETE /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:31:03.764905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-213690b0-0aea-4760-baea-9ad21aea0a40 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '.version_select at 0x7f9d9fefb3a0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:03.780263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-213690b0-0aea-4760-baea-9ad21aea0a40 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:03.786734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-213690b0-0aea-4760-baea-9ad21aea0a40 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:03.792638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-213690b0-0aea-4760-baea-9ad21aea0a40 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:03.825549 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-213690b0-0aea-4760-baea-9ad21aea0a40 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags" status: 200 len: 12 microversion: 2.26 time: 0.064957 Oct 29 01:31:03.834423 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2896/5561] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 29 01:31:03 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags => generated 12 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:03.844263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bdcefbeb-fcde-42c6-babe-5eb8146ca740 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '.version_select at 0x7f9d9fe5b1f0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:03.860131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bdcefbeb-fcde-42c6-babe-5eb8146ca740 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:03.860797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bdcefbeb-fcde-42c6-babe-5eb8146ca740 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:03.862567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bdcefbeb-fcde-42c6-babe-5eb8146ca740 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:03.863145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bdcefbeb-fcde-42c6-babe-5eb8146ca740 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:03.877384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bdcefbeb-fcde-42c6-babe-5eb8146ca740 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:03.881978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bdcefbeb-fcde-42c6-babe-5eb8146ca740 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:03.882544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bdcefbeb-fcde-42c6-babe-5eb8146ca740 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:03.885576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bdcefbeb-fcde-42c6-babe-5eb8146ca740 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:03.885576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bdcefbeb-fcde-42c6-babe-5eb8146ca740 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:03.885576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bdcefbeb-fcde-42c6-babe-5eb8146ca740 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:03.950997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bdcefbeb-fcde-42c6-babe-5eb8146ca740 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:03.953095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bdcefbeb-fcde-42c6-babe-5eb8146ca740 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:03.953722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bdcefbeb-fcde-42c6-babe-5eb8146ca740 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:03.985614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-bdcefbeb-fcde-42c6-babe-5eb8146ca740 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lazy-loading 'flavor' on Instance uuid 3be39107-febf-4007-b4d7-b9b4d6138f5d {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:31:03.988314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7d63e100-a826-4b37-8d8b-a8150d4c2204 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:03.989051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7d63e100-a826-4b37-8d8b-a8150d4c2204 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:04.003121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d63e100-a826-4b37-8d8b-a8150d4c2204 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:04.004436 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bdcefbeb-fcde-42c6-babe-5eb8146ca740 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags" status: 204 len: 0 microversion: 2.26 time: 0.164356 Oct 29 01:31:04.005565 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2666/5562] 10.222.0.26 () {60 vars in 1295 bytes} [Sat Oct 29 01:31:03 2022] DELETE /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:31:04.010815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d63e100-a826-4b37-8d8b-a8150d4c2204 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:04.011310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d63e100-a826-4b37-8d8b-a8150d4c2204 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:04.012067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d63e100-a826-4b37-8d8b-a8150d4c2204 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:04.016656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d63e100-a826-4b37-8d8b-a8150d4c2204 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:04.017132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d63e100-a826-4b37-8d8b-a8150d4c2204 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:04.018017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b87f76a2-cbe8-42a0-9cd3-7b1dede196b4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '.version_select at 0x7f9d9c5b6550>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:04.029806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b87f76a2-cbe8-42a0-9cd3-7b1dede196b4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:04.029806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b87f76a2-cbe8-42a0-9cd3-7b1dede196b4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:04.029806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b87f76a2-cbe8-42a0-9cd3-7b1dede196b4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:04.030817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b87f76a2-cbe8-42a0-9cd3-7b1dede196b4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:04.038295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=4,nova_cell1:INSERT=4,nova_cell1:RELEASE=4,nova_cell1:DELETE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:31:04.040570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b87f76a2-cbe8-42a0-9cd3-7b1dede196b4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:04.042959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b87f76a2-cbe8-42a0-9cd3-7b1dede196b4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:04.043642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b87f76a2-cbe8-42a0-9cd3-7b1dede196b4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:04.044587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b87f76a2-cbe8-42a0-9cd3-7b1dede196b4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:04.045284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b87f76a2-cbe8-42a0-9cd3-7b1dede196b4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:04.045918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b87f76a2-cbe8-42a0-9cd3-7b1dede196b4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:04.077879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b87f76a2-cbe8-42a0-9cd3-7b1dede196b4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:04.078818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b87f76a2-cbe8-42a0-9cd3-7b1dede196b4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:04.079465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b87f76a2-cbe8-42a0-9cd3-7b1dede196b4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:04.099950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b87f76a2-cbe8-42a0-9cd3-7b1dede196b4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:04.100789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b87f76a2-cbe8-42a0-9cd3-7b1dede196b4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:04.101515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b87f76a2-cbe8-42a0-9cd3-7b1dede196b4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:04.233675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-b87f76a2-cbe8-42a0-9cd3-7b1dede196b4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lazy-loading 'flavor' on Instance uuid 3be39107-febf-4007-b4d7-b9b4d6138f5d {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:31:04.261007 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b87f76a2-cbe8-42a0-9cd3-7b1dede196b4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "PUT /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags/tempest-tag-791475634" status: 201 len: 0 microversion: 2.26 time: 0.248429 Oct 29 01:31:04.262246 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2667/5563] 10.222.0.26 () {62 vars in 1377 bytes} [Sat Oct 29 01:31:04 2022] PUT /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags/tempest-tag-791475634 => generated 0 bytes in 251 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 29 01:31:04.274544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6cd60731-bbc2-4d91-a010-6bc1a2e05123 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:04.275227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6cd60731-bbc2-4d91-a010-6bc1a2e05123 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:04.291335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7d63e100-a826-4b37-8d8b-a8150d4c2204 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:04.294677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6cd60731-bbc2-4d91-a010-6bc1a2e05123 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:04.296557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6cd60731-bbc2-4d91-a010-6bc1a2e05123 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:04.297003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6cd60731-bbc2-4d91-a010-6bc1a2e05123 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:04.301538 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7d63e100-a826-4b37-8d8b-a8150d4c2204 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 200 len: 1293 microversion: 2.1 time: 0.317546 Oct 29 01:31:04.301679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6cd60731-bbc2-4d91-a010-6bc1a2e05123 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:04.302388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6cd60731-bbc2-4d91-a010-6bc1a2e05123 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:04.302762 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2897/5564] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:03 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 1293 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:04.303268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6cd60731-bbc2-4d91-a010-6bc1a2e05123 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:04.309858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d8923c76-1345-4bf9-96ab-e0335c1759af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '.version_select at 0x7f9d9fe480d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:04.320615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8923c76-1345-4bf9-96ab-e0335c1759af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:04.321381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8923c76-1345-4bf9-96ab-e0335c1759af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:04.322074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8923c76-1345-4bf9-96ab-e0335c1759af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:04.322748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d8923c76-1345-4bf9-96ab-e0335c1759af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:04.333718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8923c76-1345-4bf9-96ab-e0335c1759af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:04.334233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8923c76-1345-4bf9-96ab-e0335c1759af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:04.335162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8923c76-1345-4bf9-96ab-e0335c1759af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:04.335978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8923c76-1345-4bf9-96ab-e0335c1759af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:04.337451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8923c76-1345-4bf9-96ab-e0335c1759af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:04.344264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8923c76-1345-4bf9-96ab-e0335c1759af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:04.384974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8923c76-1345-4bf9-96ab-e0335c1759af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:04.386390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8923c76-1345-4bf9-96ab-e0335c1759af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:04.387161 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8923c76-1345-4bf9-96ab-e0335c1759af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:04.435394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8923c76-1345-4bf9-96ab-e0335c1759af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:04.438501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8923c76-1345-4bf9-96ab-e0335c1759af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:04.439981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8923c76-1345-4bf9-96ab-e0335c1759af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:04.573733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-d8923c76-1345-4bf9-96ab-e0335c1759af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lazy-loading 'flavor' on Instance uuid 3be39107-febf-4007-b4d7-b9b4d6138f5d {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:31:04.622575 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d8923c76-1345-4bf9-96ab-e0335c1759af tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "PUT /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags/tempest-tag-1288606555" status: 201 len: 0 microversion: 2.26 time: 0.318305 Oct 29 01:31:04.630159 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2898/5565] 10.222.0.26 () {62 vars in 1380 bytes} [Sat Oct 29 01:31:04 2022] PUT /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags/tempest-tag-1288606555 => generated 0 bytes in 323 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 29 01:31:04.642723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f1f35f51-4cf8-4b2d-9ab0-fbaa74727a5a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Action: 'update_all', calling method: .version_select at 0x7f9d96b7a4c0>, body: {"tags": ["tempest-tag-1186589576", "tempest-tag-696661530"]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:04.661063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1f35f51-4cf8-4b2d-9ab0-fbaa74727a5a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:04.661595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1f35f51-4cf8-4b2d-9ab0-fbaa74727a5a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:04.662061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1f35f51-4cf8-4b2d-9ab0-fbaa74727a5a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:04.662533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f1f35f51-4cf8-4b2d-9ab0-fbaa74727a5a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:04.677854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1f35f51-4cf8-4b2d-9ab0-fbaa74727a5a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:04.678363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1f35f51-4cf8-4b2d-9ab0-fbaa74727a5a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:04.682551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1f35f51-4cf8-4b2d-9ab0-fbaa74727a5a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:04.686194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6cd60731-bbc2-4d91-a010-6bc1a2e05123 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:04.693977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1f35f51-4cf8-4b2d-9ab0-fbaa74727a5a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:04.694484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1f35f51-4cf8-4b2d-9ab0-fbaa74727a5a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:04.699111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1f35f51-4cf8-4b2d-9ab0-fbaa74727a5a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:04.699914 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6cd60731-bbc2-4d91-a010-6bc1a2e05123 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1516 microversion: 2.1 time: 0.435169 Oct 29 01:31:04.700733 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2668/5566] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:04 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1516 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:04.747715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1f35f51-4cf8-4b2d-9ab0-fbaa74727a5a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:04.747715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1f35f51-4cf8-4b2d-9ab0-fbaa74727a5a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:04.747715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1f35f51-4cf8-4b2d-9ab0-fbaa74727a5a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:04.841348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-f1f35f51-4cf8-4b2d-9ab0-fbaa74727a5a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lazy-loading 'flavor' on Instance uuid 3be39107-febf-4007-b4d7-b9b4d6138f5d {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:31:04.914062 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f1f35f51-4cf8-4b2d-9ab0-fbaa74727a5a tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "PUT /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags" status: 200 len: 61 microversion: 2.26 time: 0.261414 Oct 29 01:31:04.921007 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2899/5567] 10.222.0.26 () {62 vars in 1312 bytes} [Sat Oct 29 01:31:04 2022] PUT /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags => generated 61 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:04.931147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e2286841-1255-4c41-8ff8-ba21438e33cc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '.version_select at 0x7f9d97d43e50>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:04.955214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2286841-1255-4c41-8ff8-ba21438e33cc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:04.960674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2286841-1255-4c41-8ff8-ba21438e33cc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:04.961228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2286841-1255-4c41-8ff8-ba21438e33cc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:04.982355 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e2286841-1255-4c41-8ff8-ba21438e33cc tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags" status: 200 len: 61 microversion: 2.26 time: 0.058819 Oct 29 01:31:04.985011 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2669/5568] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 29 01:31:04 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags => generated 61 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:05.003606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f284bef-9ced-4388-8ccf-9fd7eb40ab68 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '.version_select at 0x7f9d9fe48dc0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:05.032940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f284bef-9ced-4388-8ccf-9fd7eb40ab68 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:05.033753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f284bef-9ced-4388-8ccf-9fd7eb40ab68 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:05.034380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f284bef-9ced-4388-8ccf-9fd7eb40ab68 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:05.035870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1f284bef-9ced-4388-8ccf-9fd7eb40ab68 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:05.051396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f284bef-9ced-4388-8ccf-9fd7eb40ab68 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:05.052117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f284bef-9ced-4388-8ccf-9fd7eb40ab68 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:05.053539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f284bef-9ced-4388-8ccf-9fd7eb40ab68 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:05.058822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f284bef-9ced-4388-8ccf-9fd7eb40ab68 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:05.059528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f284bef-9ced-4388-8ccf-9fd7eb40ab68 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:05.061449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f284bef-9ced-4388-8ccf-9fd7eb40ab68 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:05.125035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f284bef-9ced-4388-8ccf-9fd7eb40ab68 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:05.127285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f284bef-9ced-4388-8ccf-9fd7eb40ab68 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:05.128057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f284bef-9ced-4388-8ccf-9fd7eb40ab68 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:05.275789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-1f284bef-9ced-4388-8ccf-9fd7eb40ab68 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lazy-loading 'flavor' on Instance uuid 3be39107-febf-4007-b4d7-b9b4d6138f5d {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:31:05.294677 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1f284bef-9ced-4388-8ccf-9fd7eb40ab68 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags" status: 204 len: 0 microversion: 2.26 time: 0.304459 Oct 29 01:31:05.295402 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2900/5569] 10.222.0.26 () {60 vars in 1295 bytes} [Sat Oct 29 01:31:04 2022] DELETE /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d/tags => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:31:05.307018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-621c0e11-5c21-4a03-918c-2f445ceb1df2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:05.307597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-621c0e11-5c21-4a03-918c-2f445ceb1df2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:05.314952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-621c0e11-5c21-4a03-918c-2f445ceb1df2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:05.315987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-621c0e11-5c21-4a03-918c-2f445ceb1df2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:05.326146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-621c0e11-5c21-4a03-918c-2f445ceb1df2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:05.326146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-621c0e11-5c21-4a03-918c-2f445ceb1df2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:05.326146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-621c0e11-5c21-4a03-918c-2f445ceb1df2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:05.326146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-621c0e11-5c21-4a03-918c-2f445ceb1df2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:05.331515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-648bd3b5-0d6b-4f05-8cd9-9c152e3c76bd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:05.334172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-648bd3b5-0d6b-4f05-8cd9-9c152e3c76bd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:05.346973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-648bd3b5-0d6b-4f05-8cd9-9c152e3c76bd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:05.349454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-648bd3b5-0d6b-4f05-8cd9-9c152e3c76bd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:05.349639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-648bd3b5-0d6b-4f05-8cd9-9c152e3c76bd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:05.353359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-648bd3b5-0d6b-4f05-8cd9-9c152e3c76bd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:05.354020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-648bd3b5-0d6b-4f05-8cd9-9c152e3c76bd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:05.354590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-648bd3b5-0d6b-4f05-8cd9-9c152e3c76bd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:05.376100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-621c0e11-5c21-4a03-918c-2f445ceb1df2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:31:05.409055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=93,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:31:05.443725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-648bd3b5-0d6b-4f05-8cd9-9c152e3c76bd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:05.453010 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-648bd3b5-0d6b-4f05-8cd9-9c152e3c76bd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 200 len: 1311 microversion: 2.1 time: 0.126360 Oct 29 01:31:05.457199 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2901/5570] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:05 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 1311 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:05.727893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b1caeebc-1a60-4cdd-be11-c901ed456fbc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:05.728542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b1caeebc-1a60-4cdd-be11-c901ed456fbc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:05.741114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1caeebc-1a60-4cdd-be11-c901ed456fbc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:05.741637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1caeebc-1a60-4cdd-be11-c901ed456fbc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:05.744346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1caeebc-1a60-4cdd-be11-c901ed456fbc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:05.745104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1caeebc-1a60-4cdd-be11-c901ed456fbc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:05.745604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1caeebc-1a60-4cdd-be11-c901ed456fbc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:05.746036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1caeebc-1a60-4cdd-be11-c901ed456fbc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:05.793952 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-621c0e11-5c21-4a03-918c-2f445ceb1df2 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 204 len: 0 microversion: 2.26 time: 0.492566 Oct 29 01:31:05.794619 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2670/5571] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:31:05 2022] DELETE /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 29 01:31:05.807847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e367113-edba-40b8-bdea-0b48b1865a49 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:05.808752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7e367113-edba-40b8-bdea-0b48b1865a49 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:05.823154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e367113-edba-40b8-bdea-0b48b1865a49 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:05.823914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e367113-edba-40b8-bdea-0b48b1865a49 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:05.828718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e367113-edba-40b8-bdea-0b48b1865a49 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:05.830259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e367113-edba-40b8-bdea-0b48b1865a49 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:05.831706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e367113-edba-40b8-bdea-0b48b1865a49 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:05.832175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e367113-edba-40b8-bdea-0b48b1865a49 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:06.185962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b1caeebc-1a60-4cdd-be11-c901ed456fbc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:06.194855 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b1caeebc-1a60-4cdd-be11-c901ed456fbc tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1516 microversion: 2.1 time: 0.471707 Oct 29 01:31:06.199010 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2902/5572] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:05 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1516 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:06.374033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7e367113-edba-40b8-bdea-0b48b1865a49 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:06.377066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7e367113-edba-40b8-bdea-0b48b1865a49 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:06.381308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7e367113-edba-40b8-bdea-0b48b1865a49 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:06.385841 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e367113-edba-40b8-bdea-0b48b1865a49 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1551 microversion: 2.26 time: 0.586382 Oct 29 01:31:06.388162 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2671/5573] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:31:05 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1551 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:06.478883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6cff6d66-0375-40cc-a7a8-80831b9125f4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:06.479752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6cff6d66-0375-40cc-a7a8-80831b9125f4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:06.491708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cff6d66-0375-40cc-a7a8-80831b9125f4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:06.492418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cff6d66-0375-40cc-a7a8-80831b9125f4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:06.494130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cff6d66-0375-40cc-a7a8-80831b9125f4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:06.495846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cff6d66-0375-40cc-a7a8-80831b9125f4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:06.499261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cff6d66-0375-40cc-a7a8-80831b9125f4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:06.499841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cff6d66-0375-40cc-a7a8-80831b9125f4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:06.946685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6cff6d66-0375-40cc-a7a8-80831b9125f4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:06.956493 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6cff6d66-0375-40cc-a7a8-80831b9125f4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 200 len: 1367 microversion: 2.1 time: 0.482624 Oct 29 01:31:06.962658 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2903/5574] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:06 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 1367 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:07.231519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3afe64eb-b50e-47cd-89ee-183f81da570f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:07.232335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3afe64eb-b50e-47cd-89ee-183f81da570f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:07.252068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3afe64eb-b50e-47cd-89ee-183f81da570f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:07.257416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3afe64eb-b50e-47cd-89ee-183f81da570f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:07.259884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3afe64eb-b50e-47cd-89ee-183f81da570f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:07.265819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3afe64eb-b50e-47cd-89ee-183f81da570f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:07.268236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3afe64eb-b50e-47cd-89ee-183f81da570f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:07.268830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3afe64eb-b50e-47cd-89ee-183f81da570f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:07.415609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7e290026-711a-4f0b-9f06-26203374180d tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:07.419007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7e290026-711a-4f0b-9f06-26203374180d tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:07.450344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e290026-711a-4f0b-9f06-26203374180d tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:07.450847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e290026-711a-4f0b-9f06-26203374180d tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:07.451281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e290026-711a-4f0b-9f06-26203374180d tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:07.462384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e290026-711a-4f0b-9f06-26203374180d tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:07.462384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e290026-711a-4f0b-9f06-26203374180d tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:07.463104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e290026-711a-4f0b-9f06-26203374180d tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:08.088845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7e290026-711a-4f0b-9f06-26203374180d tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:08.100439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7e290026-711a-4f0b-9f06-26203374180d tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:08.102727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7e290026-711a-4f0b-9f06-26203374180d tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:08.103961 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7e290026-711a-4f0b-9f06-26203374180d tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1551 microversion: 2.26 time: 0.693164 Oct 29 01:31:08.135661 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2904/5575] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:31:07 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1551 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:08.142454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-99845c04-c4ee-4f89-9727-6c4ddb1d8df8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:08.143079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-99845c04-c4ee-4f89-9727-6c4ddb1d8df8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:08.160091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99845c04-c4ee-4f89-9727-6c4ddb1d8df8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:08.161745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99845c04-c4ee-4f89-9727-6c4ddb1d8df8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:08.163557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99845c04-c4ee-4f89-9727-6c4ddb1d8df8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:08.164496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99845c04-c4ee-4f89-9727-6c4ddb1d8df8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:08.170005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3afe64eb-b50e-47cd-89ee-183f81da570f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:08.178552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99845c04-c4ee-4f89-9727-6c4ddb1d8df8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:08.181085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99845c04-c4ee-4f89-9727-6c4ddb1d8df8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:08.188152 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3afe64eb-b50e-47cd-89ee-183f81da570f tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1516 microversion: 2.1 time: 0.963529 Oct 29 01:31:08.189033 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2672/5576] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:07 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1516 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:08.706122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-99845c04-c4ee-4f89-9727-6c4ddb1d8df8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:08.720162 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-99845c04-c4ee-4f89-9727-6c4ddb1d8df8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 200 len: 1367 microversion: 2.1 time: 0.583262 Oct 29 01:31:08.726630 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2905/5577] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:08 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 1367 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:08.930932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-f444045e-ebcc-4727-ac03-c8831daace51 req-3d86ed1e-deef-4c26-bad2-4b1478edd8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94e7890d-907a-4ed3-9bab-73c679fe5e6f", "tag": "91a6b00a-75da-45ae-9f7a-13274873357a"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:08.955745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f444045e-ebcc-4727-ac03-c8831daace51 req-3d86ed1e-deef-4c26-bad2-4b1478edd8b9 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:08.962074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f444045e-ebcc-4727-ac03-c8831daace51 req-3d86ed1e-deef-4c26-bad2-4b1478edd8b9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:08.964515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f444045e-ebcc-4727-ac03-c8831daace51 req-3d86ed1e-deef-4c26-bad2-4b1478edd8b9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:09.006734 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f444045e-ebcc-4727-ac03-c8831daace51 req-3d86ed1e-deef-4c26-bad2-4b1478edd8b9 service nova] Creating event network-changed:91a6b00a-75da-45ae-9f7a-13274873357a for instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f on n-h2-862964-3 Oct 29 01:31:09.027505 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-f444045e-ebcc-4727-ac03-c8831daace51 req-3d86ed1e-deef-4c26-bad2-4b1478edd8b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103248 Oct 29 01:31:09.028762 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2673/5578] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:31:09.134804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e18301d1-dc49-43d0-82e3-d8294f891ac4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:09.135435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e18301d1-dc49-43d0-82e3-d8294f891ac4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:09.152887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e18301d1-dc49-43d0-82e3-d8294f891ac4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:09.153414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e18301d1-dc49-43d0-82e3-d8294f891ac4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:09.153861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e18301d1-dc49-43d0-82e3-d8294f891ac4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:09.154649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e18301d1-dc49-43d0-82e3-d8294f891ac4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:09.155126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e18301d1-dc49-43d0-82e3-d8294f891ac4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:09.155553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e18301d1-dc49-43d0-82e3-d8294f891ac4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:09.222034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5e691e0a-cab0-4d1f-b994-6f994052f108 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:09.222749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5e691e0a-cab0-4d1f-b994-6f994052f108 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:09.247220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e691e0a-cab0-4d1f-b994-6f994052f108 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:09.247726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e691e0a-cab0-4d1f-b994-6f994052f108 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:09.248175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e691e0a-cab0-4d1f-b994-6f994052f108 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:09.249615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e691e0a-cab0-4d1f-b994-6f994052f108 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:09.249615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e691e0a-cab0-4d1f-b994-6f994052f108 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:09.249954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e691e0a-cab0-4d1f-b994-6f994052f108 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:09.353233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e18301d1-dc49-43d0-82e3-d8294f891ac4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:09.386164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e18301d1-dc49-43d0-82e3-d8294f891ac4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:09.396073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e18301d1-dc49-43d0-82e3-d8294f891ac4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:09.397498 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e18301d1-dc49-43d0-82e3-d8294f891ac4 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1509 microversion: 2.26 time: 0.267393 Oct 29 01:31:09.398122 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2906/5579] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:31:09 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1509 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:09.700464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5e691e0a-cab0-4d1f-b994-6f994052f108 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:09.712758 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5e691e0a-cab0-4d1f-b994-6f994052f108 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1516 microversion: 2.1 time: 0.491358 Oct 29 01:31:09.735879 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2674/5580] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:09 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1516 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:09.754692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-035db414-959b-492a-9e52-d3f53bc8d43d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:09.755610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-035db414-959b-492a-9e52-d3f53bc8d43d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:09.772936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-035db414-959b-492a-9e52-d3f53bc8d43d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:09.773875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-035db414-959b-492a-9e52-d3f53bc8d43d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:09.774642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-035db414-959b-492a-9e52-d3f53bc8d43d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:09.777148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-035db414-959b-492a-9e52-d3f53bc8d43d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:09.781116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-035db414-959b-492a-9e52-d3f53bc8d43d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:09.783346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-035db414-959b-492a-9e52-d3f53bc8d43d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:09.877039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-d6c18d4b-080d-4f01-9aca-eee43948fa48 req-251ab104-da82-4fc7-aa2a-1a25cb25ff54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be39107-febf-4007-b4d7-b9b4d6138f5d", "name": "network-vif-deleted", "tag": "cffd6ac5-c525-4650-af66-66c2e61aac96"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:09.896456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d6c18d4b-080d-4f01-9aca-eee43948fa48 req-251ab104-da82-4fc7-aa2a-1a25cb25ff54 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:09.897268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d6c18d4b-080d-4f01-9aca-eee43948fa48 req-251ab104-da82-4fc7-aa2a-1a25cb25ff54 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:09.898528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d6c18d4b-080d-4f01-9aca-eee43948fa48 req-251ab104-da82-4fc7-aa2a-1a25cb25ff54 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:09.916712 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-d6c18d4b-080d-4f01-9aca-eee43948fa48 req-251ab104-da82-4fc7-aa2a-1a25cb25ff54 service nova] Creating event network-vif-deleted:cffd6ac5-c525-4650-af66-66c2e61aac96 for instance 3be39107-febf-4007-b4d7-b9b4d6138f5d on n-h1-862964-3 Oct 29 01:31:09.935045 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-d6c18d4b-080d-4f01-9aca-eee43948fa48 req-251ab104-da82-4fc7-aa2a-1a25cb25ff54 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.446790 Oct 29 01:31:09.936313 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2907/5581] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:31:10.127475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-035db414-959b-492a-9e52-d3f53bc8d43d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:10.144617 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-035db414-959b-492a-9e52-d3f53bc8d43d tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 200 len: 1367 microversion: 2.1 time: 0.393006 Oct 29 01:31:10.146725 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2675/5582] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:09 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 1367 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:10.428762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5452a85d-a2c7-4976-baec-c0741d7a7073 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:10.430814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5452a85d-a2c7-4976-baec-c0741d7a7073 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:10.448320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5452a85d-a2c7-4976-baec-c0741d7a7073 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:10.449003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5452a85d-a2c7-4976-baec-c0741d7a7073 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:10.450675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5452a85d-a2c7-4976-baec-c0741d7a7073 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:10.451670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5452a85d-a2c7-4976-baec-c0741d7a7073 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:10.452238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5452a85d-a2c7-4976-baec-c0741d7a7073 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:10.452679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5452a85d-a2c7-4976-baec-c0741d7a7073 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:10.523059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5452a85d-a2c7-4976-baec-c0741d7a7073 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:10.529296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5452a85d-a2c7-4976-baec-c0741d7a7073 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:10.530033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5452a85d-a2c7-4976-baec-c0741d7a7073 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:10.530671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-5452a85d-a2c7-4976-baec-c0741d7a7073 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lazy-loading 'fault' on Instance uuid 3be39107-febf-4007-b4d7-b9b4d6138f5d {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:31:10.613656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5452a85d-a2c7-4976-baec-c0741d7a7073 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:10.623493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5452a85d-a2c7-4976-baec-c0741d7a7073 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:10.625205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5452a85d-a2c7-4976-baec-c0741d7a7073 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcf2691d051343c09168138a74b1b692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbda68d5c80741cca4c48dbc47276b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:10.626437 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5452a85d-a2c7-4976-baec-c0741d7a7073 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 200 len: 1351 microversion: 2.26 time: 0.202891 Oct 29 01:31:10.627011 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2908/5583] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:31:10 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 1351 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:10.743280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ec03f0fc-845a-4561-b77d-75825d0ae24a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:10.745095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ec03f0fc-845a-4561-b77d-75825d0ae24a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:10.753927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec03f0fc-845a-4561-b77d-75825d0ae24a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:10.754740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec03f0fc-845a-4561-b77d-75825d0ae24a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:10.756218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec03f0fc-845a-4561-b77d-75825d0ae24a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:10.757113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec03f0fc-845a-4561-b77d-75825d0ae24a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:10.757774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec03f0fc-845a-4561-b77d-75825d0ae24a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:10.759709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec03f0fc-845a-4561-b77d-75825d0ae24a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:10.820401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:31:10.849754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:31:11.175839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c9775143-daa1-4960-9f84-3abb76289dd8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:11.177846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c9775143-daa1-4960-9f84-3abb76289dd8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:11.187509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ec03f0fc-845a-4561-b77d-75825d0ae24a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:11.199488 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ec03f0fc-845a-4561-b77d-75825d0ae24a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1516 microversion: 2.1 time: 0.461538 Oct 29 01:31:11.213711 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2676/5584] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:10 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1516 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:11.213846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9775143-daa1-4960-9f84-3abb76289dd8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:11.213846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9775143-daa1-4960-9f84-3abb76289dd8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:11.213846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9775143-daa1-4960-9f84-3abb76289dd8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:11.213846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9775143-daa1-4960-9f84-3abb76289dd8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:11.233950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9775143-daa1-4960-9f84-3abb76289dd8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:11.234451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9775143-daa1-4960-9f84-3abb76289dd8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:11.615270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c9775143-daa1-4960-9f84-3abb76289dd8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:11.630684 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c9775143-daa1-4960-9f84-3abb76289dd8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 200 len: 1367 microversion: 2.1 time: 0.464517 Oct 29 01:31:11.642203 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2909/5585] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:11 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 1367 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:11.655647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e921d977-cc19-407d-836b-2aa90baffbb0 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:11.656259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e921d977-cc19-407d-836b-2aa90baffbb0 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] [instance: 3be39107-febf-4007-b4d7-b9b4d6138f5d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:11.671096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e921d977-cc19-407d-836b-2aa90baffbb0 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:11.672640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e921d977-cc19-407d-836b-2aa90baffbb0 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:11.673087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e921d977-cc19-407d-836b-2aa90baffbb0 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:11.673844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e921d977-cc19-407d-836b-2aa90baffbb0 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:11.674305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e921d977-cc19-407d-836b-2aa90baffbb0 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:11.674740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e921d977-cc19-407d-836b-2aa90baffbb0 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:11.701460 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-e921d977-cc19-407d-836b-2aa90baffbb0 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] HTTP exception thrown: Instance 3be39107-febf-4007-b4d7-b9b4d6138f5d could not be found. Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e921d977-cc19-407d-836b-2aa90baffbb0 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Request method failure captured: Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d HTTP/1.1 Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXII3xZLS2llZuuPmZmY54G1BVGcXhuTnd0qsvel9_Xr-275f6bJ2pf9WJAWZKQ8_WXGYtTZo8_0QxERXezDrlPgoe_PI19o8fJyRo8rP5w8g1G1q1zQDUo9BihQ5xWfxeLUP_xPc95b5JPBaSd98CRyxpeX26OEjhKy7LXtry2TpCqE Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-Openstack-Nova-Api-Version: 2.26 Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: bbda68d5c80741cca4c48dbc47276b90 Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerTagsTestJSON-1763391264 Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bbda68d5c80741cca4c48dbc47276b90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bbda68d5c80741cca4c48dbc47276b90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bbda68d5c80741cca4c48dbc47276b90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bbda68d5c80741cca4c48dbc47276b90", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerTagsTestJSON-1763391264 Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: bbda68d5c80741cca4c48dbc47276b90 Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerTagsTestJSON-1763391264 Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerTagsTestJSON-1763391264-project Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: bcf2691d051343c09168138a74b1b692 Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerTagsTestJSON-1763391264-project Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 3be39107-febf-4007-b4d7-b9b4d6138f5d could not be found. Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '3be39107-febf-4007-b4d7-b9b4d6138f5d'} Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3be39107-febf-4007-b4d7-b9b4d6138f5d could not be found. Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3be39107-febf-4007-b4d7-b9b4d6138f5d could not be found. Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:31:11.703509 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:31:11.706985 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:31:11.706985 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:31:11.706985 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:31:11.706985 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:31:11.706985 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:31:11.706985 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3be39107-febf-4007-b4d7-b9b4d6138f5d could not be found. Oct 29 01:31:11.706985 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:31:11.708803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e921d977-cc19-407d-836b-2aa90baffbb0 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] Returning 404 to user: Instance 3be39107-febf-4007-b4d7-b9b4d6138f5d could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:31:11.710427 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e921d977-cc19-407d-836b-2aa90baffbb0 tempest-ServerTagsTestJSON-1763391264 tempest-ServerTagsTestJSON-1763391264-project] 10.222.0.26 "GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d" status: 404 len: 111 microversion: 2.26 time: 0.058221 Oct 29 01:31:11.717183 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2677/5586] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:31:11 2022] GET /compute/v2.1/servers/3be39107-febf-4007-b4d7-b9b4d6138f5d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:31:12.257822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6db72850-8e24-4e2c-8630-5da9d078d5a3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:12.300919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6db72850-8e24-4e2c-8630-5da9d078d5a3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:12.313496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6db72850-8e24-4e2c-8630-5da9d078d5a3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:12.316291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6db72850-8e24-4e2c-8630-5da9d078d5a3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:12.316910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6db72850-8e24-4e2c-8630-5da9d078d5a3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:12.319026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6db72850-8e24-4e2c-8630-5da9d078d5a3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:12.321303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6db72850-8e24-4e2c-8630-5da9d078d5a3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:12.321969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6db72850-8e24-4e2c-8630-5da9d078d5a3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:12.655365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ff511121-83b7-4124-8356-79dd3fc7ae0b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:12.655992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ff511121-83b7-4124-8356-79dd3fc7ae0b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:12.680445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff511121-83b7-4124-8356-79dd3fc7ae0b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:12.681392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff511121-83b7-4124-8356-79dd3fc7ae0b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:12.681830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff511121-83b7-4124-8356-79dd3fc7ae0b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:12.682545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff511121-83b7-4124-8356-79dd3fc7ae0b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:12.683006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff511121-83b7-4124-8356-79dd3fc7ae0b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:12.683431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff511121-83b7-4124-8356-79dd3fc7ae0b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:12.954307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=8 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:31:13.870576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6db72850-8e24-4e2c-8630-5da9d078d5a3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:13.875907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:31:13.886991 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6db72850-8e24-4e2c-8630-5da9d078d5a3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1516 microversion: 2.1 time: 1.657991 Oct 29 01:31:13.887613 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2910/5587] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:12 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1516 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:13.921794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ff511121-83b7-4124-8356-79dd3fc7ae0b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:13.951358 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ff511121-83b7-4124-8356-79dd3fc7ae0b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 200 len: 1367 microversion: 2.1 time: 1.297687 Oct 29 01:31:13.952518 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2678/5588] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:12 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 1367 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:14.918224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-16a3b448-4b30-40f9-acfc-d50f81928f8d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:14.918900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-16a3b448-4b30-40f9-acfc-d50f81928f8d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:14.950805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16a3b448-4b30-40f9-acfc-d50f81928f8d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:14.951288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16a3b448-4b30-40f9-acfc-d50f81928f8d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:14.951781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16a3b448-4b30-40f9-acfc-d50f81928f8d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:14.952411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16a3b448-4b30-40f9-acfc-d50f81928f8d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:14.952861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16a3b448-4b30-40f9-acfc-d50f81928f8d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:14.953306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-16a3b448-4b30-40f9-acfc-d50f81928f8d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:14.976968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c3aa994b-e02f-4b4b-8188-54219a161a95 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:14.977872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c3aa994b-e02f-4b4b-8188-54219a161a95 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:14.993725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3aa994b-e02f-4b4b-8188-54219a161a95 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:14.994565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3aa994b-e02f-4b4b-8188-54219a161a95 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:14.994683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3aa994b-e02f-4b4b-8188-54219a161a95 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:14.995415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3aa994b-e02f-4b4b-8188-54219a161a95 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:14.995874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3aa994b-e02f-4b4b-8188-54219a161a95 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:14.996307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3aa994b-e02f-4b4b-8188-54219a161a95 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:15.429258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-16a3b448-4b30-40f9-acfc-d50f81928f8d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:15.444625 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-16a3b448-4b30-40f9-acfc-d50f81928f8d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1516 microversion: 2.1 time: 0.533115 Oct 29 01:31:15.448748 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2911/5589] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:14 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1516 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:15.501989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c3aa994b-e02f-4b4b-8188-54219a161a95 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:15.538134 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c3aa994b-e02f-4b4b-8188-54219a161a95 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 200 len: 1367 microversion: 2.1 time: 0.565197 Oct 29 01:31:15.554532 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2679/5590] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:14 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 1367 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:16.422665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-7e9db486-2fa4-4eb8-a1a6-e72755430f1f req-8cb5c0a5-2860-43c3-9ecc-6a21adbe89f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94e7890d-907a-4ed3-9bab-73c679fe5e6f", "name": "network-vif-plugged", "status": "completed", "tag": "91a6b00a-75da-45ae-9f7a-13274873357a"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:16.455523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7e9db486-2fa4-4eb8-a1a6-e72755430f1f req-8cb5c0a5-2860-43c3-9ecc-6a21adbe89f0 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:16.456423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7e9db486-2fa4-4eb8-a1a6-e72755430f1f req-8cb5c0a5-2860-43c3-9ecc-6a21adbe89f0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:16.457978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7e9db486-2fa4-4eb8-a1a6-e72755430f1f req-8cb5c0a5-2860-43c3-9ecc-6a21adbe89f0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:16.479127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c695dc41-b104-4558-95b4-fce6aaf74824 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:16.479746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c695dc41-b104-4558-95b4-fce6aaf74824 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:16.495976 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-7e9db486-2fa4-4eb8-a1a6-e72755430f1f req-8cb5c0a5-2860-43c3-9ecc-6a21adbe89f0 service nova] Creating event network-vif-plugged:91a6b00a-75da-45ae-9f7a-13274873357a for instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f on n-h2-862964-3 Oct 29 01:31:16.509120 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-7e9db486-2fa4-4eb8-a1a6-e72755430f1f req-8cb5c0a5-2860-43c3-9ecc-6a21adbe89f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093557 Oct 29 01:31:16.513068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c695dc41-b104-4558-95b4-fce6aaf74824 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:16.516310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c695dc41-b104-4558-95b4-fce6aaf74824 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:16.517758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c695dc41-b104-4558-95b4-fce6aaf74824 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:16.520591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c695dc41-b104-4558-95b4-fce6aaf74824 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:16.522386 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2912/5591] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:31:16.525609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c695dc41-b104-4558-95b4-fce6aaf74824 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:16.534465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c695dc41-b104-4558-95b4-fce6aaf74824 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:16.569905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-efe7fbf9-6a66-4721-bd7a-23ef998b1174 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:16.571499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-efe7fbf9-6a66-4721-bd7a-23ef998b1174 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:16.597353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efe7fbf9-6a66-4721-bd7a-23ef998b1174 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:16.598154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efe7fbf9-6a66-4721-bd7a-23ef998b1174 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:16.602664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efe7fbf9-6a66-4721-bd7a-23ef998b1174 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:16.603443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efe7fbf9-6a66-4721-bd7a-23ef998b1174 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:16.603925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efe7fbf9-6a66-4721-bd7a-23ef998b1174 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:16.604365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efe7fbf9-6a66-4721-bd7a-23ef998b1174 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:17.152954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-efe7fbf9-6a66-4721-bd7a-23ef998b1174 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:17.165403 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-efe7fbf9-6a66-4721-bd7a-23ef998b1174 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 200 len: 1367 microversion: 2.1 time: 0.599953 Oct 29 01:31:17.166383 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2913/5592] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:16 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 1367 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:17.237282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c695dc41-b104-4558-95b4-fce6aaf74824 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:17.251297 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c695dc41-b104-4558-95b4-fce6aaf74824 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1522 microversion: 2.1 time: 0.773751 Oct 29 01:31:17.251297 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2680/5593] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:16 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1522 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:18.194868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-55f91c83-e826-4f29-b6f8-2f8115c913ca tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:18.201289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-55f91c83-e826-4f29-b6f8-2f8115c913ca tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:18.224396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55f91c83-e826-4f29-b6f8-2f8115c913ca tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:18.227870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55f91c83-e826-4f29-b6f8-2f8115c913ca tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:18.233372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55f91c83-e826-4f29-b6f8-2f8115c913ca tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:18.234391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55f91c83-e826-4f29-b6f8-2f8115c913ca tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:18.235100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55f91c83-e826-4f29-b6f8-2f8115c913ca tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:18.235690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-55f91c83-e826-4f29-b6f8-2f8115c913ca tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:18.281261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-949a8650-44b5-4b46-87e1-af6182b9030a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:18.282753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-949a8650-44b5-4b46-87e1-af6182b9030a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:18.295720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-949a8650-44b5-4b46-87e1-af6182b9030a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:18.296486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-949a8650-44b5-4b46-87e1-af6182b9030a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:18.297128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-949a8650-44b5-4b46-87e1-af6182b9030a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:18.303426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-949a8650-44b5-4b46-87e1-af6182b9030a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:18.304463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-949a8650-44b5-4b46-87e1-af6182b9030a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:18.308750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-949a8650-44b5-4b46-87e1-af6182b9030a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:19.402469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-55f91c83-e826-4f29-b6f8-2f8115c913ca tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:19.414221 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-55f91c83-e826-4f29-b6f8-2f8115c913ca tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 200 len: 1367 microversion: 2.1 time: 1.226465 Oct 29 01:31:19.421226 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2914/5594] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:18 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 1367 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:19.745868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-949a8650-44b5-4b46-87e1-af6182b9030a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:19.754847 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-949a8650-44b5-4b46-87e1-af6182b9030a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1522 microversion: 2.1 time: 1.483279 Oct 29 01:31:19.759025 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2681/5595] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:18 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1522 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:20.453324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-04d32df3-9ddb-409f-9c02-f08ab0283cbb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:20.453961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-04d32df3-9ddb-409f-9c02-f08ab0283cbb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:20.475703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04d32df3-9ddb-409f-9c02-f08ab0283cbb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:20.480663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04d32df3-9ddb-409f-9c02-f08ab0283cbb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:20.480816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04d32df3-9ddb-409f-9c02-f08ab0283cbb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:20.482027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04d32df3-9ddb-409f-9c02-f08ab0283cbb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:20.485781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04d32df3-9ddb-409f-9c02-f08ab0283cbb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:20.490273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04d32df3-9ddb-409f-9c02-f08ab0283cbb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:20.781723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-847c980a-5015-4ad2-8633-a7ec3e9d4de2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:20.783004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-847c980a-5015-4ad2-8633-a7ec3e9d4de2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:20.800400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-847c980a-5015-4ad2-8633-a7ec3e9d4de2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:20.801905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-847c980a-5015-4ad2-8633-a7ec3e9d4de2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:20.804613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-847c980a-5015-4ad2-8633-a7ec3e9d4de2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:20.806650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-847c980a-5015-4ad2-8633-a7ec3e9d4de2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:20.814720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-847c980a-5015-4ad2-8633-a7ec3e9d4de2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:20.815405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-847c980a-5015-4ad2-8633-a7ec3e9d4de2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:21.419703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-04d32df3-9ddb-409f-9c02-f08ab0283cbb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:21.434172 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-04d32df3-9ddb-409f-9c02-f08ab0283cbb tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 200 len: 1557 microversion: 2.1 time: 0.985671 Oct 29 01:31:21.437519 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2915/5596] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:20 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 1557 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:21.463296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-be972ed8-3cad-4737-be29-9c100a1f5598 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:21.464973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-be972ed8-3cad-4737-be29-9c100a1f5598 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:21.479640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be972ed8-3cad-4737-be29-9c100a1f5598 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:21.483144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be972ed8-3cad-4737-be29-9c100a1f5598 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:21.483144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be972ed8-3cad-4737-be29-9c100a1f5598 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:21.490076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be972ed8-3cad-4737-be29-9c100a1f5598 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:21.490907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be972ed8-3cad-4737-be29-9c100a1f5598 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:21.491354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be972ed8-3cad-4737-be29-9c100a1f5598 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:21.583130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-847c980a-5015-4ad2-8633-a7ec3e9d4de2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:21.595683 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-847c980a-5015-4ad2-8633-a7ec3e9d4de2 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1522 microversion: 2.1 time: 0.818008 Oct 29 01:31:21.598565 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2682/5597] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:20 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1522 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:21.785335 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-be972ed8-3cad-4737-be29-9c100a1f5598 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.326144 Oct 29 01:31:21.794954 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2916/5598] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:31:21 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-interface => generated 284 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:31:22.539945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-913abd36-49ef-4237-9210-1b1fe2ed32eb req-80c6c83f-1d15-4fe4-82d8-223edf9bc5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc1e59d-7992-4344-9a0a-c3f1b2decdf5", "name": "network-vif-plugged", "status": "completed", "tag": "11031898-b13e-41f2-ae9c-2e6752af137d"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:22.570017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-913abd36-49ef-4237-9210-1b1fe2ed32eb req-80c6c83f-1d15-4fe4-82d8-223edf9bc5a8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:22.571539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-913abd36-49ef-4237-9210-1b1fe2ed32eb req-80c6c83f-1d15-4fe4-82d8-223edf9bc5a8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:22.572396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-913abd36-49ef-4237-9210-1b1fe2ed32eb req-80c6c83f-1d15-4fe4-82d8-223edf9bc5a8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:22.594352 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-913abd36-49ef-4237-9210-1b1fe2ed32eb req-80c6c83f-1d15-4fe4-82d8-223edf9bc5a8 service nova] Creating event network-vif-plugged:11031898-b13e-41f2-ae9c-2e6752af137d for instance 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 on n-h2-862964-3 Oct 29 01:31:22.602941 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-913abd36-49ef-4237-9210-1b1fe2ed32eb req-80c6c83f-1d15-4fe4-82d8-223edf9bc5a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068119 Oct 29 01:31:22.608805 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2683/5599] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:31:22.623898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-273df2cb-6cf1-4447-92a2-b27c3575aed3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:22.624609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-273df2cb-6cf1-4447-92a2-b27c3575aed3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:22.636780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-273df2cb-6cf1-4447-92a2-b27c3575aed3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:22.637774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-273df2cb-6cf1-4447-92a2-b27c3575aed3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:22.641983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-273df2cb-6cf1-4447-92a2-b27c3575aed3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:22.642841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-273df2cb-6cf1-4447-92a2-b27c3575aed3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:22.643330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-273df2cb-6cf1-4447-92a2-b27c3575aed3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:22.643764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-273df2cb-6cf1-4447-92a2-b27c3575aed3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:22.902614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-273df2cb-6cf1-4447-92a2-b27c3575aed3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:22.915114 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-273df2cb-6cf1-4447-92a2-b27c3575aed3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1522 microversion: 2.1 time: 0.295146 Oct 29 01:31:22.916190 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2917/5600] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:22 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:23.942696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-abc90b44-eecd-429b-9a79-e78315079a48 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:23.943409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-abc90b44-eecd-429b-9a79-e78315079a48 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:23.952063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abc90b44-eecd-429b-9a79-e78315079a48 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:23.952563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abc90b44-eecd-429b-9a79-e78315079a48 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:23.953004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abc90b44-eecd-429b-9a79-e78315079a48 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:23.953739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abc90b44-eecd-429b-9a79-e78315079a48 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:23.954199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abc90b44-eecd-429b-9a79-e78315079a48 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:23.954629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abc90b44-eecd-429b-9a79-e78315079a48 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:24.334023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-abc90b44-eecd-429b-9a79-e78315079a48 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:24.342952 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-abc90b44-eecd-429b-9a79-e78315079a48 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1522 microversion: 2.1 time: 0.405360 Oct 29 01:31:24.347994 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2684/5601] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:23 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:24.988534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-ecc44598-dabf-40d7-b6f5-7343a69d1f0f req-8af3731e-e608-4514-beb0-b99ea318c1dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94e7890d-907a-4ed3-9bab-73c679fe5e6f", "tag": "91a6b00a-75da-45ae-9f7a-13274873357a"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:25.014636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ecc44598-dabf-40d7-b6f5-7343a69d1f0f req-8af3731e-e608-4514-beb0-b99ea318c1dc service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:25.021715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ecc44598-dabf-40d7-b6f5-7343a69d1f0f req-8af3731e-e608-4514-beb0-b99ea318c1dc service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:25.022364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ecc44598-dabf-40d7-b6f5-7343a69d1f0f req-8af3731e-e608-4514-beb0-b99ea318c1dc service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:25.050140 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-ecc44598-dabf-40d7-b6f5-7343a69d1f0f req-8af3731e-e608-4514-beb0-b99ea318c1dc service nova] Creating event network-changed:91a6b00a-75da-45ae-9f7a-13274873357a for instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f on n-h2-862964-3 Oct 29 01:31:25.058884 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-ecc44598-dabf-40d7-b6f5-7343a69d1f0f req-8af3731e-e608-4514-beb0-b99ea318c1dc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073931 Oct 29 01:31:25.059896 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2918/5602] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:31:25.378822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2f8dba03-db8c-40be-8e44-46fb4240c08b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:25.379530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2f8dba03-db8c-40be-8e44-46fb4240c08b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:25.390000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f8dba03-db8c-40be-8e44-46fb4240c08b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:25.390819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f8dba03-db8c-40be-8e44-46fb4240c08b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:25.391403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f8dba03-db8c-40be-8e44-46fb4240c08b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:25.392473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f8dba03-db8c-40be-8e44-46fb4240c08b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:25.393073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f8dba03-db8c-40be-8e44-46fb4240c08b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:25.393664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f8dba03-db8c-40be-8e44-46fb4240c08b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:25.865058 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2f8dba03-db8c-40be-8e44-46fb4240c08b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:25.882610 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2f8dba03-db8c-40be-8e44-46fb4240c08b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1507 microversion: 2.1 time: 0.510131 Oct 29 01:31:25.896795 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2685/5603] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:25 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1507 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:25.913642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9a682273-ef33-466f-b28d-5cc6ef5dd344 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:25.914587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9a682273-ef33-466f-b28d-5cc6ef5dd344 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:25.921821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a682273-ef33-466f-b28d-5cc6ef5dd344 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:25.922625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a682273-ef33-466f-b28d-5cc6ef5dd344 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:25.923346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a682273-ef33-466f-b28d-5cc6ef5dd344 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:25.924507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a682273-ef33-466f-b28d-5cc6ef5dd344 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:25.925387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a682273-ef33-466f-b28d-5cc6ef5dd344 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:25.926000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9a682273-ef33-466f-b28d-5cc6ef5dd344 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:26.215246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9a682273-ef33-466f-b28d-5cc6ef5dd344 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:26.225075 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9a682273-ef33-466f-b28d-5cc6ef5dd344 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 200 len: 1507 microversion: 2.1 time: 0.315573 Oct 29 01:31:26.225957 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2919/5604] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:25 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 1507 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:26.260259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a9269c41-782d-4583-aa14-1b9d536f352e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:26.261602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a9269c41-782d-4583-aa14-1b9d536f352e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:26.303265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a9269c41-782d-4583-aa14-1b9d536f352e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:26.311505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a9269c41-782d-4583-aa14-1b9d536f352e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:26.314408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a9269c41-782d-4583-aa14-1b9d536f352e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:26.318351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a9269c41-782d-4583-aa14-1b9d536f352e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:26.318942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a9269c41-782d-4583-aa14-1b9d536f352e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:26.319285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a9269c41-782d-4583-aa14-1b9d536f352e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:26.399998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a9269c41-782d-4583-aa14-1b9d536f352e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:31:26.585568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:31:26.843636 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a9269c41-782d-4583-aa14-1b9d536f352e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 204 len: 0 microversion: 2.1 time: 0.595387 Oct 29 01:31:26.846879 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2686/5605] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:31:26 2022] DELETE /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:31:27.122795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-818936be-e8ed-48f2-88ee-c8157e5c7814 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1883822940", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "597311ce-aa95-4f12-8eaa-7c4f96ddc1b9"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:27.242970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-818936be-e8ed-48f2-88ee-c8157e5c7814 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] validate_networks() for [('597311ce-aa95-4f12-8eaa-7c4f96ddc1b9', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:31:30.005298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-818936be-e8ed-48f2-88ee-c8157e5c7814 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:31:30.005949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-818936be-e8ed-48f2-88ee-c8157e5c7814 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:31:30.011195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-818936be-e8ed-48f2-88ee-c8157e5c7814 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:31:30.015811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-818936be-e8ed-48f2-88ee-c8157e5c7814 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:31:30.015811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-818936be-e8ed-48f2-88ee-c8157e5c7814 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:31:30.022934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=98 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:31:30.036685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-818936be-e8ed-48f2-88ee-c8157e5c7814 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:30.039060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-818936be-e8ed-48f2-88ee-c8157e5c7814 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:30.039060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-818936be-e8ed-48f2-88ee-c8157e5c7814 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:30.039060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-818936be-e8ed-48f2-88ee-c8157e5c7814 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:30.039680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-818936be-e8ed-48f2-88ee-c8157e5c7814 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:30.040325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-818936be-e8ed-48f2-88ee-c8157e5c7814 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:30.083582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-818936be-e8ed-48f2-88ee-c8157e5c7814 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Getting quotas for project c1840006d715496788f2dc0ca7c40c6b. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:31:30.096220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-818936be-e8ed-48f2-88ee-c8157e5c7814 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Getting quotas for user 683fc94021ee47e88a111980139e6786 and project c1840006d715496788f2dc0ca7c40c6b. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:31:30.162821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-818936be-e8ed-48f2-88ee-c8157e5c7814 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:31:30.168092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-818936be-e8ed-48f2-88ee-c8157e5c7814 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:31:30.371578 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-818936be-e8ed-48f2-88ee-c8157e5c7814 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.252949 Oct 29 01:31:30.379348 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2920/5606] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:31:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:31:30.387980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-420f6e2d-f62a-4f91-a508-f0cb3fbd57f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:30.387980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-420f6e2d-f62a-4f91-a508-f0cb3fbd57f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:30.554016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-420f6e2d-f62a-4f91-a508-f0cb3fbd57f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:30.567953 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-420f6e2d-f62a-4f91-a508-f0cb3fbd57f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1218 microversion: 2.1 time: 0.186974 Oct 29 01:31:30.571838 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2687/5607] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:30 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1218 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:31.598141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3bd394dc-d7eb-42b5-bd16-9562d6121981 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:31.598829 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3bd394dc-d7eb-42b5-bd16-9562d6121981 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:31.785105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3bd394dc-d7eb-42b5-bd16-9562d6121981 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:31.803152 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3bd394dc-d7eb-42b5-bd16-9562d6121981 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1218 microversion: 2.1 time: 0.209384 Oct 29 01:31:31.805943 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2921/5608] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:31 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1218 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:32.302136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-19bee769-7516-4c5a-8594-ff83ce616ef2 req-23630fc2-a5c1-45e9-b289-15220a7f16ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc1e59d-7992-4344-9a0a-c3f1b2decdf5", "name": "network-vif-deleted", "tag": "11031898-b13e-41f2-ae9c-2e6752af137d"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:32.366185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-19bee769-7516-4c5a-8594-ff83ce616ef2 req-23630fc2-a5c1-45e9-b289-15220a7f16ad service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:32.370291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-19bee769-7516-4c5a-8594-ff83ce616ef2 req-23630fc2-a5c1-45e9-b289-15220a7f16ad service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:32.372568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-19bee769-7516-4c5a-8594-ff83ce616ef2 req-23630fc2-a5c1-45e9-b289-15220a7f16ad service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:32.403770 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-19bee769-7516-4c5a-8594-ff83ce616ef2 req-23630fc2-a5c1-45e9-b289-15220a7f16ad service nova] Creating event network-vif-deleted:11031898-b13e-41f2-ae9c-2e6752af137d for instance 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 on n-h2-862964-3 Oct 29 01:31:32.416497 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-19bee769-7516-4c5a-8594-ff83ce616ef2 req-23630fc2-a5c1-45e9-b289-15220a7f16ad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116940 Oct 29 01:31:32.419840 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2688/5609] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:31:32.834766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b27c4c1e-d0c1-45ae-be33-3fd8145d84f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:32.835280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b27c4c1e-d0c1-45ae-be33-3fd8145d84f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:32.861525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b27c4c1e-d0c1-45ae-be33-3fd8145d84f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:32.864647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b27c4c1e-d0c1-45ae-be33-3fd8145d84f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:32.865494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b27c4c1e-d0c1-45ae-be33-3fd8145d84f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:32.884506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b27c4c1e-d0c1-45ae-be33-3fd8145d84f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:32.887807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b27c4c1e-d0c1-45ae-be33-3fd8145d84f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:32.888328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b27c4c1e-d0c1-45ae-be33-3fd8145d84f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:33.073796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b27c4c1e-d0c1-45ae-be33-3fd8145d84f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:33.087286 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b27c4c1e-d0c1-45ae-be33-3fd8145d84f9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1270 microversion: 2.1 time: 0.259284 Oct 29 01:31:33.088473 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2922/5610] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:32 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1270 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:33.845066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f6d1e6c7-f659-41d0-819e-27cc343d593c tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2122372637", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:34.042501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-f6d1e6c7-f659-41d0-819e-27cc343d593c tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] validate_networks() for None {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:31:34.119087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-67c96d52-3978-41f5-91c0-0500dcb14415 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:34.120368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-67c96d52-3978-41f5-91c0-0500dcb14415 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:34.145038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-67c96d52-3978-41f5-91c0-0500dcb14415 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:34.148897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-67c96d52-3978-41f5-91c0-0500dcb14415 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:34.150080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-67c96d52-3978-41f5-91c0-0500dcb14415 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:34.150865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-67c96d52-3978-41f5-91c0-0500dcb14415 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:34.152969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-67c96d52-3978-41f5-91c0-0500dcb14415 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:34.153455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-67c96d52-3978-41f5-91c0-0500dcb14415 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:35.078142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-67c96d52-3978-41f5-91c0-0500dcb14415 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:35.092147 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-67c96d52-3978-41f5-91c0-0500dcb14415 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1288 microversion: 2.1 time: 0.977806 Oct 29 01:31:35.103525 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2923/5611] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:34 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1288 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:35.351885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f6d1e6c7-f659-41d0-819e-27cc343d593c tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:31:35.352388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f6d1e6c7-f659-41d0-819e-27cc343d593c tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:31:35.352849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f6d1e6c7-f659-41d0-819e-27cc343d593c tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:31:35.353463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f6d1e6c7-f659-41d0-819e-27cc343d593c tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:31:35.354621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-f6d1e6c7-f659-41d0-819e-27cc343d593c tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:31:35.379037 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d1e6c7-f659-41d0-819e-27cc343d593c tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:35.383500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d1e6c7-f659-41d0-819e-27cc343d593c tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:35.384256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d1e6c7-f659-41d0-819e-27cc343d593c tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:35.387548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d1e6c7-f659-41d0-819e-27cc343d593c tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:35.389440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d1e6c7-f659-41d0-819e-27cc343d593c tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:35.390841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d1e6c7-f659-41d0-819e-27cc343d593c tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:35.422341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-f6d1e6c7-f659-41d0-819e-27cc343d593c tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Getting quotas for project 3b4d345ae5d8452a9afec2c6f198d82c. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:31:35.431105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-f6d1e6c7-f659-41d0-819e-27cc343d593c tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Getting quotas for user 5fe232a4fc4c41dbb9d800d742c70162 and project 3b4d345ae5d8452a9afec2c6f198d82c. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:31:35.447570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f6d1e6c7-f659-41d0-819e-27cc343d593c tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:31:35.453540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f6d1e6c7-f659-41d0-819e-27cc343d593c tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:31:35.625704 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f6d1e6c7-f659-41d0-819e-27cc343d593c tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.789382 Oct 29 01:31:35.631791 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2689/5612] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:31:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:31:35.643471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3e067434-e7ee-4785-ab0a-89e1029e03c2 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:35.646439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3e067434-e7ee-4785-ab0a-89e1029e03c2 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:35.896704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3e067434-e7ee-4785-ab0a-89e1029e03c2 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe232a4fc4c41dbb9d800d742c70162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4d345ae5d8452a9afec2c6f198d82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:35.916134 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3e067434-e7ee-4785-ab0a-89e1029e03c2 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 200 len: 1215 microversion: 2.1 time: 0.276399 Oct 29 01:31:35.916779 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2924/5613] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:35 2022] GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 1215 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:36.118336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0124a893-9185-4aaa-b2af-68a3ed4ff336 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:36.119364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0124a893-9185-4aaa-b2af-68a3ed4ff336 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:36.134892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0124a893-9185-4aaa-b2af-68a3ed4ff336 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:36.135388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0124a893-9185-4aaa-b2af-68a3ed4ff336 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:36.136289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0124a893-9185-4aaa-b2af-68a3ed4ff336 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:36.136519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0124a893-9185-4aaa-b2af-68a3ed4ff336 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:36.136977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0124a893-9185-4aaa-b2af-68a3ed4ff336 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:36.137518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0124a893-9185-4aaa-b2af-68a3ed4ff336 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:36.391188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0124a893-9185-4aaa-b2af-68a3ed4ff336 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:36.400979 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0124a893-9185-4aaa-b2af-68a3ed4ff336 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1276 microversion: 2.1 time: 0.288187 Oct 29 01:31:36.413583 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2690/5614] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:36 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1276 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:36.940854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a39ba059-d374-43d4-b677-577581cec61a tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:36.942176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a39ba059-d374-43d4-b677-577581cec61a tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:37.076327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a39ba059-d374-43d4-b677-577581cec61a tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe232a4fc4c41dbb9d800d742c70162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4d345ae5d8452a9afec2c6f198d82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:37.088923 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a39ba059-d374-43d4-b677-577581cec61a tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 200 len: 1215 microversion: 2.1 time: 0.152802 Oct 29 01:31:37.089847 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2925/5615] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:36 2022] GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:37.426182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5f4c2fca-9fd9-46d1-821b-2bfb258459ab tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:37.432954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5f4c2fca-9fd9-46d1-821b-2bfb258459ab tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:37.446395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:31:37.453149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f4c2fca-9fd9-46d1-821b-2bfb258459ab tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:37.463260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f4c2fca-9fd9-46d1-821b-2bfb258459ab tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:37.465028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f4c2fca-9fd9-46d1-821b-2bfb258459ab tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:37.465849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f4c2fca-9fd9-46d1-821b-2bfb258459ab tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:37.466324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f4c2fca-9fd9-46d1-821b-2bfb258459ab tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:37.469721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f4c2fca-9fd9-46d1-821b-2bfb258459ab tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:37.859833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5f4c2fca-9fd9-46d1-821b-2bfb258459ab tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:37.869389 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5f4c2fca-9fd9-46d1-821b-2bfb258459ab tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1318 microversion: 2.1 time: 0.443052 Oct 29 01:31:37.870261 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2691/5616] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:37 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1318 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:38.112838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-89de8a21-ad23-40de-ad5f-56a545fc396d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:38.113599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-89de8a21-ad23-40de-ad5f-56a545fc396d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:38.125523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89de8a21-ad23-40de-ad5f-56a545fc396d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:38.126276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89de8a21-ad23-40de-ad5f-56a545fc396d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:38.127469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89de8a21-ad23-40de-ad5f-56a545fc396d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:38.128428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89de8a21-ad23-40de-ad5f-56a545fc396d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:38.128893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89de8a21-ad23-40de-ad5f-56a545fc396d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:38.129697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-89de8a21-ad23-40de-ad5f-56a545fc396d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:38.278040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-89de8a21-ad23-40de-ad5f-56a545fc396d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe232a4fc4c41dbb9d800d742c70162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4d345ae5d8452a9afec2c6f198d82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:38.290729 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-89de8a21-ad23-40de-ad5f-56a545fc396d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 200 len: 1267 microversion: 2.1 time: 0.182500 Oct 29 01:31:38.291983 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2926/5617] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:38 2022] GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:38.899737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5214e20d-de62-44d7-a69d-0ae24fde8b32 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:38.900485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5214e20d-de62-44d7-a69d-0ae24fde8b32 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:38.912968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5214e20d-de62-44d7-a69d-0ae24fde8b32 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:38.919742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5214e20d-de62-44d7-a69d-0ae24fde8b32 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:38.921405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5214e20d-de62-44d7-a69d-0ae24fde8b32 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:38.922405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5214e20d-de62-44d7-a69d-0ae24fde8b32 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:38.923533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5214e20d-de62-44d7-a69d-0ae24fde8b32 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:38.925684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5214e20d-de62-44d7-a69d-0ae24fde8b32 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:39.326786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b6822684-297e-4f02-80bd-25c5bb601885 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:39.327420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b6822684-297e-4f02-80bd-25c5bb601885 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:39.334635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6822684-297e-4f02-80bd-25c5bb601885 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:39.335351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6822684-297e-4f02-80bd-25c5bb601885 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:39.336757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6822684-297e-4f02-80bd-25c5bb601885 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:39.337666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6822684-297e-4f02-80bd-25c5bb601885 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:39.338312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6822684-297e-4f02-80bd-25c5bb601885 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:39.338901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6822684-297e-4f02-80bd-25c5bb601885 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:39.647291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5214e20d-de62-44d7-a69d-0ae24fde8b32 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:39.648424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b6822684-297e-4f02-80bd-25c5bb601885 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe232a4fc4c41dbb9d800d742c70162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4d345ae5d8452a9afec2c6f198d82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:39.661626 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5214e20d-de62-44d7-a69d-0ae24fde8b32 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1318 microversion: 2.1 time: 0.765385 Oct 29 01:31:39.663604 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2692/5618] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:38 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1318 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:39.677371 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b6822684-297e-4f02-80bd-25c5bb601885 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 200 len: 1285 microversion: 2.1 time: 0.359233 Oct 29 01:31:39.682324 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2927/5619] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:39 2022] GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 1285 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:40.019893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f05732a2-4afd-4b7a-b884-d6769170bbca tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Action: 'create', calling method: .version_select at 0x7f9d9c336a60>, body: {"keypair": {"name": "tempest-keypair-364583021", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdbAjlhBukX52DsMxQ6a/FiWXSe73pNFaSOX+bDmOAr7OmLScyG+2VUtTx1vPjhXOUPoRrdJ1vVlSzmvfB5ASsHOVxTN06K3Hv50ETxFJ0YR5r2yRuMAXlqmH0GFDrMmA=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:40.066209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-f05732a2-4afd-4b7a-b884-d6769170bbca tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Getting quotas for project 55774814073449bf962d219e4a1b3b5e. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:31:40.081495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-f05732a2-4afd-4b7a-b884-d6769170bbca tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Getting quotas for user 0265e8a9ea3040429b5f00c409b58b32 and project 55774814073449bf962d219e4a1b3b5e. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:31:40.214651 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f05732a2-4afd-4b7a-b884-d6769170bbca tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.450238 Oct 29 01:31:40.215565 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2693/5620] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 29 01:31:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 462 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 01:31:40.684409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5bb59b1d-94a6-46cc-ba9f-4aa90c657d46 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:40.685030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5bb59b1d-94a6-46cc-ba9f-4aa90c657d46 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:40.687145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:31:40.700503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bb59b1d-94a6-46cc-ba9f-4aa90c657d46 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:40.701618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bb59b1d-94a6-46cc-ba9f-4aa90c657d46 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:40.711698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-98686c5e-c391-4345-bffe-a2890700946e tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:40.712679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-98686c5e-c391-4345-bffe-a2890700946e tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:40.720277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bb59b1d-94a6-46cc-ba9f-4aa90c657d46 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:40.721751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bb59b1d-94a6-46cc-ba9f-4aa90c657d46 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:40.723355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bb59b1d-94a6-46cc-ba9f-4aa90c657d46 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:40.723969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5bb59b1d-94a6-46cc-ba9f-4aa90c657d46 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:40.724636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98686c5e-c391-4345-bffe-a2890700946e tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:40.729740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98686c5e-c391-4345-bffe-a2890700946e tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:40.730385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98686c5e-c391-4345-bffe-a2890700946e tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:40.731282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98686c5e-c391-4345-bffe-a2890700946e tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:40.733447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98686c5e-c391-4345-bffe-a2890700946e tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:40.739110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98686c5e-c391-4345-bffe-a2890700946e tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:41.671769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-98686c5e-c391-4345-bffe-a2890700946e tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe232a4fc4c41dbb9d800d742c70162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4d345ae5d8452a9afec2c6f198d82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:41.687589 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-98686c5e-c391-4345-bffe-a2890700946e tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 200 len: 1273 microversion: 2.1 time: 0.980294 Oct 29 01:31:41.689718 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2694/5621] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:40 2022] GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 1273 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:41.702231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-5ff6dca8-cdf3-46a7-bab5-816cd4135572 req-06f9cc3c-0362-49f2-9ea4-ae91299ba56f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42fae64a-c246-4cac-b36b-0cd85ca3e526", "tag": "3411bf72-d3a8-4575-ba45-eaae4349dec4"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:41.737769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5ff6dca8-cdf3-46a7-bab5-816cd4135572 req-06f9cc3c-0362-49f2-9ea4-ae91299ba56f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:41.738277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5ff6dca8-cdf3-46a7-bab5-816cd4135572 req-06f9cc3c-0362-49f2-9ea4-ae91299ba56f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:41.756647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5ff6dca8-cdf3-46a7-bab5-816cd4135572 req-06f9cc3c-0362-49f2-9ea4-ae91299ba56f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:41.770536 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-5ff6dca8-cdf3-46a7-bab5-816cd4135572 req-06f9cc3c-0362-49f2-9ea4-ae91299ba56f service nova] Creating event network-changed:3411bf72-d3a8-4575-ba45-eaae4349dec4 for instance 42fae64a-c246-4cac-b36b-0cd85ca3e526 on n-h1-862964-3 Oct 29 01:31:41.779832 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-5ff6dca8-cdf3-46a7-bab5-816cd4135572 req-06f9cc3c-0362-49f2-9ea4-ae91299ba56f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086472 Oct 29 01:31:41.780720 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2695/5622] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:31:42.352709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5bb59b1d-94a6-46cc-ba9f-4aa90c657d46 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:42.370145 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5bb59b1d-94a6-46cc-ba9f-4aa90c657d46 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1318 microversion: 2.1 time: 1.689621 Oct 29 01:31:42.370831 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2928/5623] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:40 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1318 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:42.715854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ade365f9-661f-40de-97ff-f630ccb4e0c4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:42.717439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ade365f9-661f-40de-97ff-f630ccb4e0c4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:42.735919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ade365f9-661f-40de-97ff-f630ccb4e0c4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:42.736734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ade365f9-661f-40de-97ff-f630ccb4e0c4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:42.737637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ade365f9-661f-40de-97ff-f630ccb4e0c4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:42.738688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ade365f9-661f-40de-97ff-f630ccb4e0c4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:42.739511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ade365f9-661f-40de-97ff-f630ccb4e0c4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:42.740078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ade365f9-661f-40de-97ff-f630ccb4e0c4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:42.874859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-152a71b1-6a08-4d12-a3f5-7f0e6f9e7654 req-f24a33d9-16ff-419b-8be8-24ceb2547aba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d3a802-22de-4119-a5c8-b856ebf6a00d", "tag": "bdc2c347-c4c4-486c-9c60-58d2ab311daf"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:43.131883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-152a71b1-6a08-4d12-a3f5-7f0e6f9e7654 req-f24a33d9-16ff-419b-8be8-24ceb2547aba service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:43.131883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-152a71b1-6a08-4d12-a3f5-7f0e6f9e7654 req-f24a33d9-16ff-419b-8be8-24ceb2547aba service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:43.131883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-152a71b1-6a08-4d12-a3f5-7f0e6f9e7654 req-f24a33d9-16ff-419b-8be8-24ceb2547aba service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:43.131883 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-152a71b1-6a08-4d12-a3f5-7f0e6f9e7654 req-f24a33d9-16ff-419b-8be8-24ceb2547aba service nova] Creating event network-changed:bdc2c347-c4c4-486c-9c60-58d2ab311daf for instance 10d3a802-22de-4119-a5c8-b856ebf6a00d on n-h2-862964-3 Oct 29 01:31:43.131883 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-152a71b1-6a08-4d12-a3f5-7f0e6f9e7654 req-f24a33d9-16ff-419b-8be8-24ceb2547aba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061281 Oct 29 01:31:43.131883 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2929/5624] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:31:43.399829 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e04763e3-80b3-45f7-810c-1f307bc7588b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:43.400678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e04763e3-80b3-45f7-810c-1f307bc7588b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:43.418361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e04763e3-80b3-45f7-810c-1f307bc7588b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:43.419151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e04763e3-80b3-45f7-810c-1f307bc7588b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:43.419819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e04763e3-80b3-45f7-810c-1f307bc7588b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:43.422170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e04763e3-80b3-45f7-810c-1f307bc7588b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:43.425510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e04763e3-80b3-45f7-810c-1f307bc7588b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:43.426317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e04763e3-80b3-45f7-810c-1f307bc7588b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:43.636088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ade365f9-661f-40de-97ff-f630ccb4e0c4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe232a4fc4c41dbb9d800d742c70162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4d345ae5d8452a9afec2c6f198d82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:43.650334 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ade365f9-661f-40de-97ff-f630ccb4e0c4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 200 len: 1315 microversion: 2.1 time: 0.942151 Oct 29 01:31:43.650857 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2696/5625] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:42 2022] GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 1315 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:44.062956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e04763e3-80b3-45f7-810c-1f307bc7588b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:44.077891 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e04763e3-80b3-45f7-810c-1f307bc7588b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1318 microversion: 2.1 time: 0.683453 Oct 29 01:31:44.083314 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2930/5626] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:43 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1318 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:44.676841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4600a998-c146-4884-bbef-c51e30237f19 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:44.677502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4600a998-c146-4884-bbef-c51e30237f19 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:44.690127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4600a998-c146-4884-bbef-c51e30237f19 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:44.693898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4600a998-c146-4884-bbef-c51e30237f19 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:44.698437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4600a998-c146-4884-bbef-c51e30237f19 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:44.698437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4600a998-c146-4884-bbef-c51e30237f19 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:44.698437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4600a998-c146-4884-bbef-c51e30237f19 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:44.698437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4600a998-c146-4884-bbef-c51e30237f19 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:45.107988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fe33fec2-dba1-4165-a0c2-1691860c2c0c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:45.109223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fe33fec2-dba1-4165-a0c2-1691860c2c0c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:45.127434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe33fec2-dba1-4165-a0c2-1691860c2c0c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:45.131242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe33fec2-dba1-4165-a0c2-1691860c2c0c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:45.131968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe33fec2-dba1-4165-a0c2-1691860c2c0c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:45.137319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe33fec2-dba1-4165-a0c2-1691860c2c0c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:45.138164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe33fec2-dba1-4165-a0c2-1691860c2c0c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:45.138838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe33fec2-dba1-4165-a0c2-1691860c2c0c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:45.191302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4600a998-c146-4884-bbef-c51e30237f19 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe232a4fc4c41dbb9d800d742c70162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4d345ae5d8452a9afec2c6f198d82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:45.206725 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4600a998-c146-4884-bbef-c51e30237f19 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 200 len: 1315 microversion: 2.1 time: 0.533978 Oct 29 01:31:45.228850 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2697/5627] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:44 2022] GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:45.887406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fe33fec2-dba1-4165-a0c2-1691860c2c0c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:45.939242 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fe33fec2-dba1-4165-a0c2-1691860c2c0c tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1318 microversion: 2.1 time: 0.834595 Oct 29 01:31:45.943258 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2931/5628] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:45 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1318 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:46.236414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-baf7fe88-b08d-4a06-b66a-4b4c16257478 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:46.237698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-baf7fe88-b08d-4a06-b66a-4b4c16257478 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:46.246191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:31:46.250669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-baf7fe88-b08d-4a06-b66a-4b4c16257478 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:46.252069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-baf7fe88-b08d-4a06-b66a-4b4c16257478 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:46.253574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-baf7fe88-b08d-4a06-b66a-4b4c16257478 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:46.255221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-baf7fe88-b08d-4a06-b66a-4b4c16257478 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:46.256705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-baf7fe88-b08d-4a06-b66a-4b4c16257478 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:46.258830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-baf7fe88-b08d-4a06-b66a-4b4c16257478 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:46.533365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-baf7fe88-b08d-4a06-b66a-4b4c16257478 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe232a4fc4c41dbb9d800d742c70162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4d345ae5d8452a9afec2c6f198d82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:46.545736 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-baf7fe88-b08d-4a06-b66a-4b4c16257478 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 200 len: 1315 microversion: 2.1 time: 0.313246 Oct 29 01:31:46.546659 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2698/5629] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:46 2022] GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:46.968268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-06e84639-4965-4934-9418-888b19af8a1e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:46.969016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-06e84639-4965-4934-9418-888b19af8a1e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:47.002307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06e84639-4965-4934-9418-888b19af8a1e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:47.003399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06e84639-4965-4934-9418-888b19af8a1e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:47.006913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06e84639-4965-4934-9418-888b19af8a1e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:47.008217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06e84639-4965-4934-9418-888b19af8a1e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:47.011071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06e84639-4965-4934-9418-888b19af8a1e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:47.011733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06e84639-4965-4934-9418-888b19af8a1e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:47.108852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=12 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:31:47.571832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8cdd9b77-18d1-4f18-a887-1019bcd93e5d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:47.573316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8cdd9b77-18d1-4f18-a887-1019bcd93e5d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:47.593837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cdd9b77-18d1-4f18-a887-1019bcd93e5d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:47.594693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cdd9b77-18d1-4f18-a887-1019bcd93e5d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:47.599669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cdd9b77-18d1-4f18-a887-1019bcd93e5d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:47.603032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cdd9b77-18d1-4f18-a887-1019bcd93e5d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:47.605635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cdd9b77-18d1-4f18-a887-1019bcd93e5d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:47.608056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cdd9b77-18d1-4f18-a887-1019bcd93e5d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:47.851586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-06e84639-4965-4934-9418-888b19af8a1e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:47.860391 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-06e84639-4965-4934-9418-888b19af8a1e tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1318 microversion: 2.1 time: 0.900383 Oct 29 01:31:47.868264 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2932/5630] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:46 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1318 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:48.186462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8cdd9b77-18d1-4f18-a887-1019bcd93e5d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe232a4fc4c41dbb9d800d742c70162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4d345ae5d8452a9afec2c6f198d82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:48.249528 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8cdd9b77-18d1-4f18-a887-1019bcd93e5d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 200 len: 1315 microversion: 2.1 time: 0.682822 Oct 29 01:31:48.250159 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2699/5631] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:47 2022] GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:48.341842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ebe764bb-85ba-45f1-b3ac-f1d082ccfa08 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1629435186", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc8bfa0c-cf27-464e-950d-2a7722265459"}], "security_groups": [{"name": "tempest-securitygroup--561234185"}], "key_name": "tempest-keypair-364583021", "user_data": "}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:48.654471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-ebe764bb-85ba-45f1-b3ac-f1d082ccfa08 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] validate_networks() for [('bc8bfa0c-cf27-464e-950d-2a7722265459', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:31:48.897784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8a715154-f24d-4c9d-94d5-2330ad75b372 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:48.900212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8a715154-f24d-4c9d-94d5-2330ad75b372 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:48.921305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a715154-f24d-4c9d-94d5-2330ad75b372 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:48.921305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a715154-f24d-4c9d-94d5-2330ad75b372 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:48.921305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a715154-f24d-4c9d-94d5-2330ad75b372 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:48.921305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a715154-f24d-4c9d-94d5-2330ad75b372 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:48.921305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a715154-f24d-4c9d-94d5-2330ad75b372 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:48.921305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a715154-f24d-4c9d-94d5-2330ad75b372 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:49.309277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8a715154-f24d-4c9d-94d5-2330ad75b372 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:49.316692 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8a715154-f24d-4c9d-94d5-2330ad75b372 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1318 microversion: 2.1 time: 0.428421 Oct 29 01:31:49.317957 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2700/5632] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:48 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:49.322884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aab5aee1-da6d-4268-8faf-ea3a613e293d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:49.323689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aab5aee1-da6d-4268-8faf-ea3a613e293d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:49.330403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aab5aee1-da6d-4268-8faf-ea3a613e293d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:49.331161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aab5aee1-da6d-4268-8faf-ea3a613e293d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:49.331823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aab5aee1-da6d-4268-8faf-ea3a613e293d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:49.332834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aab5aee1-da6d-4268-8faf-ea3a613e293d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:49.333546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aab5aee1-da6d-4268-8faf-ea3a613e293d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:49.334205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aab5aee1-da6d-4268-8faf-ea3a613e293d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:49.790838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aab5aee1-da6d-4268-8faf-ea3a613e293d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe232a4fc4c41dbb9d800d742c70162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4d345ae5d8452a9afec2c6f198d82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:49.807254 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aab5aee1-da6d-4268-8faf-ea3a613e293d tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 200 len: 1315 microversion: 2.1 time: 0.486792 Oct 29 01:31:49.825305 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2701/5633] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:49 2022] GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:49.978410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ebe764bb-85ba-45f1-b3ac-f1d082ccfa08 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:31:49.986687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ebe764bb-85ba-45f1-b3ac-f1d082ccfa08 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:31:49.986687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ebe764bb-85ba-45f1-b3ac-f1d082ccfa08 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:31:49.986687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ebe764bb-85ba-45f1-b3ac-f1d082ccfa08 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:31:49.986687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-ebe764bb-85ba-45f1-b3ac-f1d082ccfa08 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:31:49.996210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebe764bb-85ba-45f1-b3ac-f1d082ccfa08 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:49.997003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebe764bb-85ba-45f1-b3ac-f1d082ccfa08 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:49.997845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebe764bb-85ba-45f1-b3ac-f1d082ccfa08 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:49.998910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebe764bb-85ba-45f1-b3ac-f1d082ccfa08 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:49.999639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebe764bb-85ba-45f1-b3ac-f1d082ccfa08 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:50.000526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebe764bb-85ba-45f1-b3ac-f1d082ccfa08 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:50.014246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:31:50.027749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-ebe764bb-85ba-45f1-b3ac-f1d082ccfa08 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Getting quotas for project 55774814073449bf962d219e4a1b3b5e. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:31:50.043152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-ebe764bb-85ba-45f1-b3ac-f1d082ccfa08 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Getting quotas for user 0265e8a9ea3040429b5f00c409b58b32 and project 55774814073449bf962d219e4a1b3b5e. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:31:50.087349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ebe764bb-85ba-45f1-b3ac-f1d082ccfa08 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:31:50.087541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-78074176-d12d-4852-88d6-a0ab87f57122 req-325146e4-04c4-4ad5-94d8-68475b1c3b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42fae64a-c246-4cac-b36b-0cd85ca3e526", "name": "network-vif-plugged", "status": "completed", "tag": "3411bf72-d3a8-4575-ba45-eaae4349dec4"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:50.088071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ebe764bb-85ba-45f1-b3ac-f1d082ccfa08 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:31:50.092444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-78074176-d12d-4852-88d6-a0ab87f57122 req-325146e4-04c4-4ad5-94d8-68475b1c3b74 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:50.096575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-78074176-d12d-4852-88d6-a0ab87f57122 req-325146e4-04c4-4ad5-94d8-68475b1c3b74 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:50.102275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-78074176-d12d-4852-88d6-a0ab87f57122 req-325146e4-04c4-4ad5-94d8-68475b1c3b74 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:50.113092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=12 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:31:50.131744 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-78074176-d12d-4852-88d6-a0ab87f57122 req-325146e4-04c4-4ad5-94d8-68475b1c3b74 service nova] Creating event network-vif-plugged:3411bf72-d3a8-4575-ba45-eaae4349dec4 for instance 42fae64a-c246-4cac-b36b-0cd85ca3e526 on n-h1-862964-3 Oct 29 01:31:50.143801 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-78074176-d12d-4852-88d6-a0ab87f57122 req-325146e4-04c4-4ad5-94d8-68475b1c3b74 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085421 Oct 29 01:31:50.153234 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2702/5634] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:31:50.240476 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ebe764bb-85ba-45f1-b3ac-f1d082ccfa08 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.900327 Oct 29 01:31:50.240476 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2933/5635] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 29 01:31:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 1904 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 01:31:50.261078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9ac5bc85-5799-41f7-9872-fdf4b4898308 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:50.261835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9ac5bc85-5799-41f7-9872-fdf4b4898308 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:50.345520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-84d807a3-fe90-4711-b342-fca744f51be7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:50.349958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-84d807a3-fe90-4711-b342-fca744f51be7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:50.362927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84d807a3-fe90-4711-b342-fca744f51be7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:50.363427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84d807a3-fe90-4711-b342-fca744f51be7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:50.363885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84d807a3-fe90-4711-b342-fca744f51be7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:50.364600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84d807a3-fe90-4711-b342-fca744f51be7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:50.372664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84d807a3-fe90-4711-b342-fca744f51be7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:50.381186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84d807a3-fe90-4711-b342-fca744f51be7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:50.487710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9ac5bc85-5799-41f7-9872-fdf4b4898308 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:50.504960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9ac5bc85-5799-41f7-9872-fdf4b4898308 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:50.513885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9ac5bc85-5799-41f7-9872-fdf4b4898308 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:50.515421 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9ac5bc85-5799-41f7-9872-fdf4b4898308 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1281 microversion: 2.20 time: 0.267113 Oct 29 01:31:50.536123 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2703/5636] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:31:50 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1281 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:50.678399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-84d807a3-fe90-4711-b342-fca744f51be7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:50.689225 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-84d807a3-fe90-4711-b342-fca744f51be7 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1318 microversion: 2.1 time: 0.347573 Oct 29 01:31:50.689803 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2934/5637] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:50 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:50.840788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f8b9aca7-4cc7-4748-b00b-72932414c9d4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:50.845906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f8b9aca7-4cc7-4748-b00b-72932414c9d4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:50.848494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8b9aca7-4cc7-4748-b00b-72932414c9d4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:50.849094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8b9aca7-4cc7-4748-b00b-72932414c9d4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:50.849794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8b9aca7-4cc7-4748-b00b-72932414c9d4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:50.850730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8b9aca7-4cc7-4748-b00b-72932414c9d4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:50.851653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8b9aca7-4cc7-4748-b00b-72932414c9d4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:50.859725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8b9aca7-4cc7-4748-b00b-72932414c9d4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:51.131768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f8b9aca7-4cc7-4748-b00b-72932414c9d4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe232a4fc4c41dbb9d800d742c70162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4d345ae5d8452a9afec2c6f198d82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:51.143034 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f8b9aca7-4cc7-4748-b00b-72932414c9d4 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 200 len: 1315 microversion: 2.1 time: 0.305749 Oct 29 01:31:51.144336 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2704/5638] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:50 2022] GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:51.548932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a4bd5599-1968-41a7-9727-5496e76d6f46 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:51.552744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a4bd5599-1968-41a7-9727-5496e76d6f46 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:51.656435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a4bd5599-1968-41a7-9727-5496e76d6f46 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:51.665101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a4bd5599-1968-41a7-9727-5496e76d6f46 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:51.666891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a4bd5599-1968-41a7-9727-5496e76d6f46 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:51.668354 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a4bd5599-1968-41a7-9727-5496e76d6f46 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1281 microversion: 2.20 time: 0.123336 Oct 29 01:31:51.669507 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2935/5639] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:31:51 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1281 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:51.715569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4f77382b-f4bd-4320-b70b-b68d24689b78 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:51.716393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4f77382b-f4bd-4320-b70b-b68d24689b78 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:51.724092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f77382b-f4bd-4320-b70b-b68d24689b78 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:51.724815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f77382b-f4bd-4320-b70b-b68d24689b78 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:51.725456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f77382b-f4bd-4320-b70b-b68d24689b78 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:51.732117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f77382b-f4bd-4320-b70b-b68d24689b78 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:51.732825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f77382b-f4bd-4320-b70b-b68d24689b78 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:51.733474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f77382b-f4bd-4320-b70b-b68d24689b78 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:51.948958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4f77382b-f4bd-4320-b70b-b68d24689b78 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:51.962074 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4f77382b-f4bd-4320-b70b-b68d24689b78 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1318 microversion: 2.1 time: 0.250914 Oct 29 01:31:51.963948 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2705/5640] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:51 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:52.169927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-779efaf5-dde6-4958-bbb5-e22a474c0e3f tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:52.170692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-779efaf5-dde6-4958-bbb5-e22a474c0e3f tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:52.177667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-779efaf5-dde6-4958-bbb5-e22a474c0e3f tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:52.178272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-779efaf5-dde6-4958-bbb5-e22a474c0e3f tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:52.178846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-779efaf5-dde6-4958-bbb5-e22a474c0e3f tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:52.179767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-779efaf5-dde6-4958-bbb5-e22a474c0e3f tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:52.180410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-779efaf5-dde6-4958-bbb5-e22a474c0e3f tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:52.180850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-779efaf5-dde6-4958-bbb5-e22a474c0e3f tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:52.377210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-779efaf5-dde6-4958-bbb5-e22a474c0e3f tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe232a4fc4c41dbb9d800d742c70162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4d345ae5d8452a9afec2c6f198d82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:52.386331 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-779efaf5-dde6-4958-bbb5-e22a474c0e3f tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 200 len: 1315 microversion: 2.1 time: 0.220413 Oct 29 01:31:52.386932 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2936/5641] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:52 2022] GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:52.695989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c0135520-9737-43c9-b105-0ab8d83c140c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:52.697894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c0135520-9737-43c9-b105-0ab8d83c140c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:52.708785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0135520-9737-43c9-b105-0ab8d83c140c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:52.709609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0135520-9737-43c9-b105-0ab8d83c140c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:52.712987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0135520-9737-43c9-b105-0ab8d83c140c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:52.716716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0135520-9737-43c9-b105-0ab8d83c140c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:52.717236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0135520-9737-43c9-b105-0ab8d83c140c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:52.720679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0135520-9737-43c9-b105-0ab8d83c140c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:52.728994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-73db3079-5938-43ee-98af-1ab0434d28a3 req-c0491a4d-b2d9-44cb-a4d5-e051d3f062e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d3a802-22de-4119-a5c8-b856ebf6a00d", "name": "network-vif-plugged", "status": "completed", "tag": "bdc2c347-c4c4-486c-9c60-58d2ab311daf"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:52.759418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-73db3079-5938-43ee-98af-1ab0434d28a3 req-c0491a4d-b2d9-44cb-a4d5-e051d3f062e1 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:52.759922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-73db3079-5938-43ee-98af-1ab0434d28a3 req-c0491a4d-b2d9-44cb-a4d5-e051d3f062e1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:52.760372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-73db3079-5938-43ee-98af-1ab0434d28a3 req-c0491a4d-b2d9-44cb-a4d5-e051d3f062e1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:52.839151 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-73db3079-5938-43ee-98af-1ab0434d28a3 req-c0491a4d-b2d9-44cb-a4d5-e051d3f062e1 service nova] Creating event network-vif-plugged:bdc2c347-c4c4-486c-9c60-58d2ab311daf for instance 10d3a802-22de-4119-a5c8-b856ebf6a00d on n-h2-862964-3 Oct 29 01:31:52.854288 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-73db3079-5938-43ee-98af-1ab0434d28a3 req-c0491a4d-b2d9-44cb-a4d5-e051d3f062e1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130968 Oct 29 01:31:52.859363 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2937/5642] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:31:52.875941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c0135520-9737-43c9-b105-0ab8d83c140c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:52.887364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c0135520-9737-43c9-b105-0ab8d83c140c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:52.912475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c0135520-9737-43c9-b105-0ab8d83c140c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:52.914633 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c0135520-9737-43c9-b105-0ab8d83c140c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1277 microversion: 2.20 time: 0.223772 Oct 29 01:31:52.917379 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2706/5643] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:31:52 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:53.001228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8b61f139-05c7-4821-a636-0a2d8f7e9d00 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:53.002958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8b61f139-05c7-4821-a636-0a2d8f7e9d00 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:53.029852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b61f139-05c7-4821-a636-0a2d8f7e9d00 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:53.032177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b61f139-05c7-4821-a636-0a2d8f7e9d00 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:53.034455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b61f139-05c7-4821-a636-0a2d8f7e9d00 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:53.039312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b61f139-05c7-4821-a636-0a2d8f7e9d00 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:53.039501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b61f139-05c7-4821-a636-0a2d8f7e9d00 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:53.041720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b61f139-05c7-4821-a636-0a2d8f7e9d00 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:53.407607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8b61f139-05c7-4821-a636-0a2d8f7e9d00 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:53.412524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-32305585-8995-4a98-9e6b-a52b9b618a5b tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:53.412524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-32305585-8995-4a98-9e6b-a52b9b618a5b tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:53.424174 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8b61f139-05c7-4821-a636-0a2d8f7e9d00 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1507 microversion: 2.1 time: 0.436340 Oct 29 01:31:53.425624 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2938/5644] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:52 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1507 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:53.434926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32305585-8995-4a98-9e6b-a52b9b618a5b tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:53.435810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32305585-8995-4a98-9e6b-a52b9b618a5b tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:53.436481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32305585-8995-4a98-9e6b-a52b9b618a5b tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:53.441662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32305585-8995-4a98-9e6b-a52b9b618a5b tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:53.442379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32305585-8995-4a98-9e6b-a52b9b618a5b tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:53.443040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32305585-8995-4a98-9e6b-a52b9b618a5b tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:53.459207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-716b5fda-0728-4305-a6d5-8d1bf6eef755 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:53.459835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-716b5fda-0728-4305-a6d5-8d1bf6eef755 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:53.474702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-716b5fda-0728-4305-a6d5-8d1bf6eef755 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:53.475513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-716b5fda-0728-4305-a6d5-8d1bf6eef755 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:53.477083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-716b5fda-0728-4305-a6d5-8d1bf6eef755 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:53.478918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-716b5fda-0728-4305-a6d5-8d1bf6eef755 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:53.481103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-716b5fda-0728-4305-a6d5-8d1bf6eef755 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:53.482813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-716b5fda-0728-4305-a6d5-8d1bf6eef755 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:54.308213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-32305585-8995-4a98-9e6b-a52b9b618a5b tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe232a4fc4c41dbb9d800d742c70162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4d345ae5d8452a9afec2c6f198d82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:54.324303 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-32305585-8995-4a98-9e6b-a52b9b618a5b tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 200 len: 1315 microversion: 2.1 time: 0.918454 Oct 29 01:31:54.340280 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2707/5645] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:53 2022] GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 1315 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:54.343524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-716b5fda-0728-4305-a6d5-8d1bf6eef755 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:54.344017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0ba43eba-2c59-457b-bdbd-025d51036f37 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:54.344017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0ba43eba-2c59-457b-bdbd-025d51036f37 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:54.344017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ba43eba-2c59-457b-bdbd-025d51036f37 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:54.344017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ba43eba-2c59-457b-bdbd-025d51036f37 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:54.344017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ba43eba-2c59-457b-bdbd-025d51036f37 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:54.344017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ba43eba-2c59-457b-bdbd-025d51036f37 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:54.344017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ba43eba-2c59-457b-bdbd-025d51036f37 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:54.344017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ba43eba-2c59-457b-bdbd-025d51036f37 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:54.346223 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-716b5fda-0728-4305-a6d5-8d1bf6eef755 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1507 microversion: 2.1 time: 0.897940 Oct 29 01:31:54.347016 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2939/5646] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:53 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1507 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:54.371162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0c8df4d2-29f1-42e0-a9dd-dbbabe3f88d0 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:54.374188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0c8df4d2-29f1-42e0-a9dd-dbbabe3f88d0 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:54.384366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c8df4d2-29f1-42e0-a9dd-dbbabe3f88d0 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:54.384876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c8df4d2-29f1-42e0-a9dd-dbbabe3f88d0 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:54.385354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c8df4d2-29f1-42e0-a9dd-dbbabe3f88d0 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:54.386068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c8df4d2-29f1-42e0-a9dd-dbbabe3f88d0 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:54.386527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c8df4d2-29f1-42e0-a9dd-dbbabe3f88d0 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:54.386955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c8df4d2-29f1-42e0-a9dd-dbbabe3f88d0 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:54.428128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0ba43eba-2c59-457b-bdbd-025d51036f37 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:54.430731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:31:54.438647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0ba43eba-2c59-457b-bdbd-025d51036f37 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:54.440439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0ba43eba-2c59-457b-bdbd-025d51036f37 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:54.441791 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0ba43eba-2c59-457b-bdbd-025d51036f37 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1339 microversion: 2.20 time: 0.115567 Oct 29 01:31:54.442360 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2708/5647] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:31:54 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1339 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:54.592966 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0c8df4d2-29f1-42e0-a9dd-dbbabe3f88d0 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "PUT /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1079 microversion: 2.1 time: 0.226145 Oct 29 01:31:54.597922 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2940/5648] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 29 01:31:54 2022] PUT /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1079 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:54.619409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fff31df5-6ef0-493a-a56e-b0a76326e3dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:54.620364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fff31df5-6ef0-493a-a56e-b0a76326e3dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:54.631534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fff31df5-6ef0-493a-a56e-b0a76326e3dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:54.634122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fff31df5-6ef0-493a-a56e-b0a76326e3dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:54.634821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fff31df5-6ef0-493a-a56e-b0a76326e3dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:54.637596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fff31df5-6ef0-493a-a56e-b0a76326e3dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:54.639967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fff31df5-6ef0-493a-a56e-b0a76326e3dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:54.640606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fff31df5-6ef0-493a-a56e-b0a76326e3dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:55.151704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fff31df5-6ef0-493a-a56e-b0a76326e3dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:55.167952 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fff31df5-6ef0-493a-a56e-b0a76326e3dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1505 microversion: 2.1 time: 0.553272 Oct 29 01:31:55.186344 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2709/5649] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:54 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1505 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:55.194081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-20d7983b-d69e-4227-bdf1-6fc5d113fbb9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:55.195831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-20d7983b-d69e-4227-bdf1-6fc5d113fbb9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:55.204156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20d7983b-d69e-4227-bdf1-6fc5d113fbb9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:55.204964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20d7983b-d69e-4227-bdf1-6fc5d113fbb9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:55.205744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20d7983b-d69e-4227-bdf1-6fc5d113fbb9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:55.207141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20d7983b-d69e-4227-bdf1-6fc5d113fbb9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:55.207539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20d7983b-d69e-4227-bdf1-6fc5d113fbb9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:55.208143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20d7983b-d69e-4227-bdf1-6fc5d113fbb9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:55.349376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-697e7e64-5ace-43f1-ab74-d06ecbf841b0 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:55.350483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-697e7e64-5ace-43f1-ab74-d06ecbf841b0 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:55.374509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-697e7e64-5ace-43f1-ab74-d06ecbf841b0 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:55.377282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-697e7e64-5ace-43f1-ab74-d06ecbf841b0 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:55.385318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-697e7e64-5ace-43f1-ab74-d06ecbf841b0 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:55.385318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-697e7e64-5ace-43f1-ab74-d06ecbf841b0 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:55.389006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-697e7e64-5ace-43f1-ab74-d06ecbf841b0 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:55.392634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-697e7e64-5ace-43f1-ab74-d06ecbf841b0 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:55.603424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-20d7983b-d69e-4227-bdf1-6fc5d113fbb9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:55.614884 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-20d7983b-d69e-4227-bdf1-6fc5d113fbb9 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1505 microversion: 2.1 time: 0.425308 Oct 29 01:31:55.616218 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2941/5650] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:55 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:55.654783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9b691a84-d075-4fe9-a79f-9e8cdb20296e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:55.658112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9b691a84-d075-4fe9-a79f-9e8cdb20296e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:55.698787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b691a84-d075-4fe9-a79f-9e8cdb20296e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:55.700608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b691a84-d075-4fe9-a79f-9e8cdb20296e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:55.701526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b691a84-d075-4fe9-a79f-9e8cdb20296e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:55.704558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b691a84-d075-4fe9-a79f-9e8cdb20296e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:55.705134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b691a84-d075-4fe9-a79f-9e8cdb20296e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:55.706323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b691a84-d075-4fe9-a79f-9e8cdb20296e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:56.659133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-697e7e64-5ace-43f1-ab74-d06ecbf841b0 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe232a4fc4c41dbb9d800d742c70162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4d345ae5d8452a9afec2c6f198d82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:56.672343 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-697e7e64-5ace-43f1-ab74-d06ecbf841b0 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 200 len: 1464 microversion: 2.1 time: 1.328032 Oct 29 01:31:56.674407 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2710/5651] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:55 2022] GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 1464 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:56.683649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3b7b3364-1ef2-4a03-a854-ef3a4686b973 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:56.689422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3b7b3364-1ef2-4a03-a854-ef3a4686b973 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:56.712405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b7b3364-1ef2-4a03-a854-ef3a4686b973 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:56.717664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b7b3364-1ef2-4a03-a854-ef3a4686b973 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:56.718161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b7b3364-1ef2-4a03-a854-ef3a4686b973 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:56.718958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b7b3364-1ef2-4a03-a854-ef3a4686b973 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:56.719428 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b7b3364-1ef2-4a03-a854-ef3a4686b973 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:56.720527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b7b3364-1ef2-4a03-a854-ef3a4686b973 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:56.811999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9b691a84-d075-4fe9-a79f-9e8cdb20296e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:56.826977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9b691a84-d075-4fe9-a79f-9e8cdb20296e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:56.837022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9b691a84-d075-4fe9-a79f-9e8cdb20296e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:56.842454 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9b691a84-d075-4fe9-a79f-9e8cdb20296e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1406 microversion: 2.20 time: 1.220757 Oct 29 01:31:56.843114 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2942/5652] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:31:55 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1406 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:56.856401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9f5476f2-3035-45b5-9562-011b0f9bafa7 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:56.857384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9f5476f2-3035-45b5-9562-011b0f9bafa7 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:56.868866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f5476f2-3035-45b5-9562-011b0f9bafa7 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:56.874727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f5476f2-3035-45b5-9562-011b0f9bafa7 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:56.874727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f5476f2-3035-45b5-9562-011b0f9bafa7 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:56.874727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f5476f2-3035-45b5-9562-011b0f9bafa7 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:56.874727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f5476f2-3035-45b5-9562-011b0f9bafa7 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:56.874727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f5476f2-3035-45b5-9562-011b0f9bafa7 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:56.916633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9f5476f2-3035-45b5-9562-011b0f9bafa7 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:31:56.967535 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3b7b3364-1ef2-4a03-a854-ef3a4686b973 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "PUT /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1081 microversion: 2.1 time: 0.291480 Oct 29 01:31:56.979993 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2711/5653] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 29 01:31:56 2022] PUT /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1081 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:57.000063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f2dd3b29-c812-43d0-b77c-7cbec8933629 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:57.001675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f2dd3b29-c812-43d0-b77c-7cbec8933629 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:57.008755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2dd3b29-c812-43d0-b77c-7cbec8933629 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:57.009269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2dd3b29-c812-43d0-b77c-7cbec8933629 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:57.009969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2dd3b29-c812-43d0-b77c-7cbec8933629 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:57.010678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2dd3b29-c812-43d0-b77c-7cbec8933629 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:57.011141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2dd3b29-c812-43d0-b77c-7cbec8933629 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:57.011579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2dd3b29-c812-43d0-b77c-7cbec8933629 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:57.283618 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9f5476f2-3035-45b5-9562-011b0f9bafa7 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "DELETE /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 204 len: 0 microversion: 2.1 time: 0.437749 Oct 29 01:31:57.288037 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f2dd3b29-c812-43d0-b77c-7cbec8933629 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:57.288693 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2943/5654] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:31:56 2022] DELETE /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:31:57.297066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-392596fa-a2a6-4190-a3ad-d7d87f7a3347 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:57.298080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-392596fa-a2a6-4190-a3ad-d7d87f7a3347 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:57.306566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-392596fa-a2a6-4190-a3ad-d7d87f7a3347 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:57.307624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-392596fa-a2a6-4190-a3ad-d7d87f7a3347 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:57.308249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-392596fa-a2a6-4190-a3ad-d7d87f7a3347 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:57.309831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-392596fa-a2a6-4190-a3ad-d7d87f7a3347 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:57.310479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-392596fa-a2a6-4190-a3ad-d7d87f7a3347 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:57.311068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-392596fa-a2a6-4190-a3ad-d7d87f7a3347 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:57.331100 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f2dd3b29-c812-43d0-b77c-7cbec8933629 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1507 microversion: 2.1 time: 0.340325 Oct 29 01:31:57.331100 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2712/5655] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:56 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1507 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:57.353439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7c2a908b-0970-4509-901b-36f502e7b9e4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:57.355861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7c2a908b-0970-4509-901b-36f502e7b9e4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:57.364647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c2a908b-0970-4509-901b-36f502e7b9e4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:57.365071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c2a908b-0970-4509-901b-36f502e7b9e4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:57.365552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c2a908b-0970-4509-901b-36f502e7b9e4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:57.368899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c2a908b-0970-4509-901b-36f502e7b9e4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:57.369428 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c2a908b-0970-4509-901b-36f502e7b9e4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:57.369871 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c2a908b-0970-4509-901b-36f502e7b9e4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:57.842131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7c2a908b-0970-4509-901b-36f502e7b9e4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:57.852213 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7c2a908b-0970-4509-901b-36f502e7b9e4 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1507 microversion: 2.1 time: 0.503862 Oct 29 01:31:57.852745 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2713/5656] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:57 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1507 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:57.860757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-392596fa-a2a6-4190-a3ad-d7d87f7a3347 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe232a4fc4c41dbb9d800d742c70162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4d345ae5d8452a9afec2c6f198d82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:57.882372 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-392596fa-a2a6-4190-a3ad-d7d87f7a3347 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 200 len: 1470 microversion: 2.1 time: 0.585604 Oct 29 01:31:57.882372 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2944/5657] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:57 2022] GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 1470 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:57.898671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-45e6459f-b97b-4602-81bb-1c04610dd794 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:57.902598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-73e921b7-0a8d-4534-bdeb-baaa16ea8df3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:57.903536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-45e6459f-b97b-4602-81bb-1c04610dd794 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:57.915169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-73e921b7-0a8d-4534-bdeb-baaa16ea8df3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:57.923005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45e6459f-b97b-4602-81bb-1c04610dd794 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:57.924389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45e6459f-b97b-4602-81bb-1c04610dd794 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:57.926942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45e6459f-b97b-4602-81bb-1c04610dd794 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:57.927932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45e6459f-b97b-4602-81bb-1c04610dd794 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:57.929077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45e6459f-b97b-4602-81bb-1c04610dd794 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:57.931349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73e921b7-0a8d-4534-bdeb-baaa16ea8df3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:57.932089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45e6459f-b97b-4602-81bb-1c04610dd794 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:57.937142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73e921b7-0a8d-4534-bdeb-baaa16ea8df3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:57.943043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73e921b7-0a8d-4534-bdeb-baaa16ea8df3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:57.945496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73e921b7-0a8d-4534-bdeb-baaa16ea8df3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:57.945852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73e921b7-0a8d-4534-bdeb-baaa16ea8df3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:57.947077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-73e921b7-0a8d-4534-bdeb-baaa16ea8df3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:58.014824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-73e921b7-0a8d-4534-bdeb-baaa16ea8df3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:31:58.223247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-45e6459f-b97b-4602-81bb-1c04610dd794 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:58.232538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-45e6459f-b97b-4602-81bb-1c04610dd794 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:58.234254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-45e6459f-b97b-4602-81bb-1c04610dd794 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:58.235787 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-45e6459f-b97b-4602-81bb-1c04610dd794 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1406 microversion: 2.20 time: 0.366262 Oct 29 01:31:58.236786 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2714/5658] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:31:57 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1406 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:58.302087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-d84d9769-a81b-446f-abb7-8e1f8d76f436 req-c3665a3d-4f5f-4dd7-b065-efa3927cf442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db08ce62-9806-4b5e-90e6-ca4fe64a2885", "tag": "9a179e9f-8e3d-4dcd-b553-24e9832a186e"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:58.341696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d84d9769-a81b-446f-abb7-8e1f8d76f436 req-c3665a3d-4f5f-4dd7-b065-efa3927cf442 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:58.343002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d84d9769-a81b-446f-abb7-8e1f8d76f436 req-c3665a3d-4f5f-4dd7-b065-efa3927cf442 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:58.343682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d84d9769-a81b-446f-abb7-8e1f8d76f436 req-c3665a3d-4f5f-4dd7-b065-efa3927cf442 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:58.373040 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-d84d9769-a81b-446f-abb7-8e1f8d76f436 req-c3665a3d-4f5f-4dd7-b065-efa3927cf442 service nova] Creating event network-changed:9a179e9f-8e3d-4dcd-b553-24e9832a186e for instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 on n-h1-862964-3 Oct 29 01:31:58.400397 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-d84d9769-a81b-446f-abb7-8e1f8d76f436 req-c3665a3d-4f5f-4dd7-b065-efa3927cf442 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104477 Oct 29 01:31:58.401757 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2715/5659] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:31:58.461107 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-73e921b7-0a8d-4534-bdeb-baaa16ea8df3 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 204 len: 0 microversion: 2.1 time: 0.561737 Oct 29 01:31:58.469810 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2945/5660] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:31:57 2022] DELETE /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:31:58.473514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b2d57f94-3147-4c75-8024-5d7ae0e02084 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:58.474107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b2d57f94-3147-4c75-8024-5d7ae0e02084 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:58.483229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2d57f94-3147-4c75-8024-5d7ae0e02084 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:58.483724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2d57f94-3147-4c75-8024-5d7ae0e02084 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:58.484167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2d57f94-3147-4c75-8024-5d7ae0e02084 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:58.484866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2d57f94-3147-4c75-8024-5d7ae0e02084 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:58.485356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2d57f94-3147-4c75-8024-5d7ae0e02084 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:58.485828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2d57f94-3147-4c75-8024-5d7ae0e02084 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:58.552796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b2d57f94-3147-4c75-8024-5d7ae0e02084 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:31:58.733341 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.compute.api [None req-b2d57f94-3147-4c75-8024-5d7ae0e02084 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Instance is already in deleting state, ignoring this request Oct 29 01:31:58.734216 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b2d57f94-3147-4c75-8024-5d7ae0e02084 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 204 len: 0 microversion: 2.1 time: 0.265076 Oct 29 01:31:58.735132 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2716/5661] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:31:58 2022] DELETE /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:31:58.747977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4e22ec92-82d0-4529-be05-30467cfc6d24 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:58.748917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4e22ec92-82d0-4529-be05-30467cfc6d24 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:58.756322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:31:58.759462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e22ec92-82d0-4529-be05-30467cfc6d24 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:58.760044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e22ec92-82d0-4529-be05-30467cfc6d24 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:58.760576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e22ec92-82d0-4529-be05-30467cfc6d24 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:58.763266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e22ec92-82d0-4529-be05-30467cfc6d24 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:58.763910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e22ec92-82d0-4529-be05-30467cfc6d24 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:58.765263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e22ec92-82d0-4529-be05-30467cfc6d24 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:58.909407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b4ea0237-2b80-42b1-9d50-025584d36ca2 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:58.909407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b4ea0237-2b80-42b1-9d50-025584d36ca2 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:58.919496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4ea0237-2b80-42b1-9d50-025584d36ca2 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:58.921379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4ea0237-2b80-42b1-9d50-025584d36ca2 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:58.922306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4ea0237-2b80-42b1-9d50-025584d36ca2 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:58.925118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4ea0237-2b80-42b1-9d50-025584d36ca2 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:58.927200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4ea0237-2b80-42b1-9d50-025584d36ca2 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:58.932488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b4ea0237-2b80-42b1-9d50-025584d36ca2 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:59.126257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4e22ec92-82d0-4529-be05-30467cfc6d24 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:59.140869 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4e22ec92-82d0-4529-be05-30467cfc6d24 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1513 microversion: 2.1 time: 0.399238 Oct 29 01:31:59.142611 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2946/5662] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:58 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1513 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:59.254081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b4ea0237-2b80-42b1-9d50-025584d36ca2 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe232a4fc4c41dbb9d800d742c70162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4d345ae5d8452a9afec2c6f198d82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:59.262290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ca06c76c-62e7-4450-a9d1-ddab835ea059 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:59.263130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ca06c76c-62e7-4450-a9d1-ddab835ea059 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:31:59.266273 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b4ea0237-2b80-42b1-9d50-025584d36ca2 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 200 len: 1470 microversion: 2.1 time: 0.365989 Oct 29 01:31:59.267330 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2717/5663] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:31:58 2022] GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 1470 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:59.276092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca06c76c-62e7-4450-a9d1-ddab835ea059 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:59.276588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca06c76c-62e7-4450-a9d1-ddab835ea059 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:59.277024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca06c76c-62e7-4450-a9d1-ddab835ea059 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:59.277758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca06c76c-62e7-4450-a9d1-ddab835ea059 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:31:59.278216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca06c76c-62e7-4450-a9d1-ddab835ea059 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:31:59.278686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca06c76c-62e7-4450-a9d1-ddab835ea059 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:31:59.468814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ca06c76c-62e7-4450-a9d1-ddab835ea059 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:59.477746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ca06c76c-62e7-4450-a9d1-ddab835ea059 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:59.479303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ca06c76c-62e7-4450-a9d1-ddab835ea059 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:59.480892 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ca06c76c-62e7-4450-a9d1-ddab835ea059 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1406 microversion: 2.20 time: 0.223227 Oct 29 01:31:59.484474 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2947/5664] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:31:59 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:32:00.166353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-736cc94b-8376-4328-8ee6-80415cfb19dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:00.166978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-736cc94b-8376-4328-8ee6-80415cfb19dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:00.184434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-736cc94b-8376-4328-8ee6-80415cfb19dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:00.185257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-736cc94b-8376-4328-8ee6-80415cfb19dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:00.185844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-736cc94b-8376-4328-8ee6-80415cfb19dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:00.186719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-736cc94b-8376-4328-8ee6-80415cfb19dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:00.187439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-736cc94b-8376-4328-8ee6-80415cfb19dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:00.187754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-736cc94b-8376-4328-8ee6-80415cfb19dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:00.295760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3caa443d-d5c6-4948-9e43-842438eb6f23 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:00.308463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3caa443d-d5c6-4948-9e43-842438eb6f23 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:00.310777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:32:00.321933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3caa443d-d5c6-4948-9e43-842438eb6f23 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:00.322641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3caa443d-d5c6-4948-9e43-842438eb6f23 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:00.323267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3caa443d-d5c6-4948-9e43-842438eb6f23 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:00.324635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3caa443d-d5c6-4948-9e43-842438eb6f23 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:00.325305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3caa443d-d5c6-4948-9e43-842438eb6f23 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:00.331759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3caa443d-d5c6-4948-9e43-842438eb6f23 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:00.337815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:32:00.761382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-736cc94b-8376-4328-8ee6-80415cfb19dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:00.769788 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-736cc94b-8376-4328-8ee6-80415cfb19dd tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1513 microversion: 2.1 time: 0.607991 Oct 29 01:32:00.774262 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2718/5665] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:00 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1513 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:00.791593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e8d1d564-9a04-4b3b-8e70-ec3f2498d547 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:00.793093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e8d1d564-9a04-4b3b-8e70-ec3f2498d547 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:00.809946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8d1d564-9a04-4b3b-8e70-ec3f2498d547 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:00.811451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8d1d564-9a04-4b3b-8e70-ec3f2498d547 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:00.811875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8d1d564-9a04-4b3b-8e70-ec3f2498d547 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:00.812602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8d1d564-9a04-4b3b-8e70-ec3f2498d547 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:00.813068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8d1d564-9a04-4b3b-8e70-ec3f2498d547 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:00.813530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8d1d564-9a04-4b3b-8e70-ec3f2498d547 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:00.867706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:32:01.019718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3caa443d-d5c6-4948-9e43-842438eb6f23 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe232a4fc4c41dbb9d800d742c70162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4d345ae5d8452a9afec2c6f198d82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:01.040713 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3caa443d-d5c6-4948-9e43-842438eb6f23 tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 200 len: 1470 microversion: 2.1 time: 0.749004 Oct 29 01:32:01.045758 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2948/5666] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:00 2022] GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 1470 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:01.360941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e8d1d564-9a04-4b3b-8e70-ec3f2498d547 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:01.380149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e8d1d564-9a04-4b3b-8e70-ec3f2498d547 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:01.382001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e8d1d564-9a04-4b3b-8e70-ec3f2498d547 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:01.383497 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e8d1d564-9a04-4b3b-8e70-ec3f2498d547 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1406 microversion: 2.20 time: 0.608152 Oct 29 01:32:01.384073 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2719/5667] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:32:00 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1406 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:01.538936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-eaacba23-c5db-4084-89cf-7dc8aa51b19f req-128e0078-af65-49f0-8763-8b0bba1db09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d3a802-22de-4119-a5c8-b856ebf6a00d", "name": "network-vif-deleted", "tag": "bdc2c347-c4c4-486c-9c60-58d2ab311daf"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:01.558395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-eaacba23-c5db-4084-89cf-7dc8aa51b19f req-128e0078-af65-49f0-8763-8b0bba1db09b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:01.561013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-eaacba23-c5db-4084-89cf-7dc8aa51b19f req-128e0078-af65-49f0-8763-8b0bba1db09b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:01.561013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-eaacba23-c5db-4084-89cf-7dc8aa51b19f req-128e0078-af65-49f0-8763-8b0bba1db09b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:01.594387 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-eaacba23-c5db-4084-89cf-7dc8aa51b19f req-128e0078-af65-49f0-8763-8b0bba1db09b service nova] Creating event network-vif-deleted:bdc2c347-c4c4-486c-9c60-58d2ab311daf for instance 10d3a802-22de-4119-a5c8-b856ebf6a00d on n-h2-862964-3 Oct 29 01:32:01.614653 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-eaacba23-c5db-4084-89cf-7dc8aa51b19f req-128e0078-af65-49f0-8763-8b0bba1db09b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075617 Oct 29 01:32:01.615893 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2949/5668] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:32:01.798590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=8 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:32:01.806402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9efdc3c3-2665-4074-a923-e1726e767d19 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:01.817979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-7a8b32d0-7e93-4d4c-9bca-aef0d0eb1705 req-56808a2c-9883-44d5-ab30-ea848fddf427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42fae64a-c246-4cac-b36b-0cd85ca3e526", "name": "network-vif-deleted", "tag": "3411bf72-d3a8-4575-ba45-eaae4349dec4"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:01.821006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9efdc3c3-2665-4074-a923-e1726e767d19 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:01.837854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9efdc3c3-2665-4074-a923-e1726e767d19 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:01.838364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9efdc3c3-2665-4074-a923-e1726e767d19 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:01.843340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9efdc3c3-2665-4074-a923-e1726e767d19 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:01.844144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9efdc3c3-2665-4074-a923-e1726e767d19 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:01.844633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9efdc3c3-2665-4074-a923-e1726e767d19 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:01.847579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7a8b32d0-7e93-4d4c-9bca-aef0d0eb1705 req-56808a2c-9883-44d5-ab30-ea848fddf427 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:01.848070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7a8b32d0-7e93-4d4c-9bca-aef0d0eb1705 req-56808a2c-9883-44d5-ab30-ea848fddf427 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:01.848511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-7a8b32d0-7e93-4d4c-9bca-aef0d0eb1705 req-56808a2c-9883-44d5-ab30-ea848fddf427 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:01.852373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9efdc3c3-2665-4074-a923-e1726e767d19 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:01.886918 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-7a8b32d0-7e93-4d4c-9bca-aef0d0eb1705 req-56808a2c-9883-44d5-ab30-ea848fddf427 service nova] Creating event network-vif-deleted:3411bf72-d3a8-4575-ba45-eaae4349dec4 for instance 42fae64a-c246-4cac-b36b-0cd85ca3e526 on n-h1-862964-3 Oct 29 01:32:01.918415 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-7a8b32d0-7e93-4d4c-9bca-aef0d0eb1705 req-56808a2c-9883-44d5-ab30-ea848fddf427 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117535 Oct 29 01:32:01.918415 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2950/5669] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:01.986575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9efdc3c3-2665-4074-a923-e1726e767d19 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:02.022986 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9efdc3c3-2665-4074-a923-e1726e767d19 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1471 microversion: 2.1 time: 0.227546 Oct 29 01:32:02.027253 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2720/5670] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:01 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1471 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:02.070157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-87163a62-0976-426b-a72e-b79a5c9d7bbf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:02.071481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-87163a62-0976-426b-a72e-b79a5c9d7bbf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:02.081752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87163a62-0976-426b-a72e-b79a5c9d7bbf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:02.082378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87163a62-0976-426b-a72e-b79a5c9d7bbf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:02.082887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87163a62-0976-426b-a72e-b79a5c9d7bbf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:02.083809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87163a62-0976-426b-a72e-b79a5c9d7bbf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:02.084271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87163a62-0976-426b-a72e-b79a5c9d7bbf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:02.084700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87163a62-0976-426b-a72e-b79a5c9d7bbf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:02.131371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87163a62-0976-426b-a72e-b79a5c9d7bbf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:02.131933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87163a62-0976-426b-a72e-b79a5c9d7bbf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:02.132985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87163a62-0976-426b-a72e-b79a5c9d7bbf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:02.133550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-87163a62-0976-426b-a72e-b79a5c9d7bbf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lazy-loading 'fault' on Instance uuid 10d3a802-22de-4119-a5c8-b856ebf6a00d {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:32:02.292961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-87163a62-0976-426b-a72e-b79a5c9d7bbf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe232a4fc4c41dbb9d800d742c70162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4d345ae5d8452a9afec2c6f198d82c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:02.306798 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-87163a62-0976-426b-a72e-b79a5c9d7bbf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 200 len: 1305 microversion: 2.1 time: 0.241824 Oct 29 01:32:02.313355 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2951/5671] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:02 2022] GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 1305 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:02.412372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2d73ea94-688d-4673-af8f-b01ab832a7cf tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:02.414560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2d73ea94-688d-4673-af8f-b01ab832a7cf tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:02.428962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d73ea94-688d-4673-af8f-b01ab832a7cf tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:02.433306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d73ea94-688d-4673-af8f-b01ab832a7cf tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:02.433306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d73ea94-688d-4673-af8f-b01ab832a7cf tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:02.433306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d73ea94-688d-4673-af8f-b01ab832a7cf tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:02.433306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d73ea94-688d-4673-af8f-b01ab832a7cf tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:02.433306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d73ea94-688d-4673-af8f-b01ab832a7cf tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:02.621251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2d73ea94-688d-4673-af8f-b01ab832a7cf tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:02.634355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2d73ea94-688d-4673-af8f-b01ab832a7cf tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:02.636541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2d73ea94-688d-4673-af8f-b01ab832a7cf tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:02.638323 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2d73ea94-688d-4673-af8f-b01ab832a7cf tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1406 microversion: 2.20 time: 0.229867 Oct 29 01:32:02.639783 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2721/5672] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:32:02 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:03.049507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-48193061-049f-4e5d-9aea-f9ed2c9aca77 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:03.050233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-48193061-049f-4e5d-9aea-f9ed2c9aca77 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:03.062033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48193061-049f-4e5d-9aea-f9ed2c9aca77 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:03.062499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48193061-049f-4e5d-9aea-f9ed2c9aca77 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:03.063889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48193061-049f-4e5d-9aea-f9ed2c9aca77 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:03.066646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48193061-049f-4e5d-9aea-f9ed2c9aca77 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:03.067369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48193061-049f-4e5d-9aea-f9ed2c9aca77 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:03.067963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48193061-049f-4e5d-9aea-f9ed2c9aca77 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:03.118463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48193061-049f-4e5d-9aea-f9ed2c9aca77 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:03.119229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48193061-049f-4e5d-9aea-f9ed2c9aca77 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:03.120115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48193061-049f-4e5d-9aea-f9ed2c9aca77 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:03.125397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-48193061-049f-4e5d-9aea-f9ed2c9aca77 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lazy-loading 'fault' on Instance uuid 42fae64a-c246-4cac-b36b-0cd85ca3e526 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:32:03.203981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-48193061-049f-4e5d-9aea-f9ed2c9aca77 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683fc94021ee47e88a111980139e6786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1840006d715496788f2dc0ca7c40c6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:03.223122 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-48193061-049f-4e5d-9aea-f9ed2c9aca77 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 200 len: 1308 microversion: 2.1 time: 0.178492 Oct 29 01:32:03.223720 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2952/5673] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:03 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 1308 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:03.335458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-da4d40e2-04b3-47c7-9c9f-e65f6ecd98cf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:03.338848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-da4d40e2-04b3-47c7-9c9f-e65f6ecd98cf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] [instance: 10d3a802-22de-4119-a5c8-b856ebf6a00d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:03.349393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-da4d40e2-04b3-47c7-9c9f-e65f6ecd98cf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:03.349907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-da4d40e2-04b3-47c7-9c9f-e65f6ecd98cf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:03.350248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-da4d40e2-04b3-47c7-9c9f-e65f6ecd98cf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:03.352382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-da4d40e2-04b3-47c7-9c9f-e65f6ecd98cf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:03.353036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-da4d40e2-04b3-47c7-9c9f-e65f6ecd98cf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:03.353645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-da4d40e2-04b3-47c7-9c9f-e65f6ecd98cf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:03.373774 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-da4d40e2-04b3-47c7-9c9f-e65f6ecd98cf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] HTTP exception thrown: Instance 10d3a802-22de-4119-a5c8-b856ebf6a00d could not be found. Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-da4d40e2-04b3-47c7-9c9f-e65f6ecd98cf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Request method failure captured: Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d HTTP/1.1 Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIJwfjaeG2ECGHq0BpmXy6TJHa5i05JsAHFrGwHYE6y0qs_fZh92C0-XIzAI7eZyMZa-tpn_S3b34azpnHmfNoIC23Y2ZfR8-T3gyIY-a0DkXKhrVFumR2qD0oPlwyyCYyiucKXk1ASuZlnGqXUuEvLkXj7Ny3VMUDMx6TLCq3pIhWQ Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 3b4d345ae5d8452a9afec2c6f198d82c Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-VolumesNegativeTest-645444658 Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b4d345ae5d8452a9afec2c6f198d82c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b4d345ae5d8452a9afec2c6f198d82c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b4d345ae5d8452a9afec2c6f198d82c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b4d345ae5d8452a9afec2c6f198d82c", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-VolumesNegativeTest-645444658 Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 3b4d345ae5d8452a9afec2c6f198d82c Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-VolumesNegativeTest-645444658 Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-VolumesNegativeTest-645444658-project Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 5fe232a4fc4c41dbb9d800d742c70162 Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-VolumesNegativeTest-645444658-project Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 10d3a802-22de-4119-a5c8-b856ebf6a00d could not be found. Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '10d3a802-22de-4119-a5c8-b856ebf6a00d'} Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10d3a802-22de-4119-a5c8-b856ebf6a00d could not be found. Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10d3a802-22de-4119-a5c8-b856ebf6a00d could not be found. Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:32:03.375512 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:03.379271 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:32:03.379271 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:32:03.379271 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:32:03.379271 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:32:03.379271 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:32:03.379271 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10d3a802-22de-4119-a5c8-b856ebf6a00d could not be found. Oct 29 01:32:03.379271 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:03.379271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-da4d40e2-04b3-47c7-9c9f-e65f6ecd98cf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] Returning 404 to user: Instance 10d3a802-22de-4119-a5c8-b856ebf6a00d could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:32:03.379271 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-da4d40e2-04b3-47c7-9c9f-e65f6ecd98cf tempest-VolumesNegativeTest-645444658 tempest-VolumesNegativeTest-645444658-project] 10.222.0.26 "GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d" status: 404 len: 111 microversion: 2.1 time: 0.047276 Oct 29 01:32:03.379981 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2722/5674] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:03 2022] GET /compute/v2.1/servers/10d3a802-22de-4119-a5c8-b856ebf6a00d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:32:03.671485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b143d98f-6098-429a-81fe-83cb761d9d85 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:03.672545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b143d98f-6098-429a-81fe-83cb761d9d85 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:03.695175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b143d98f-6098-429a-81fe-83cb761d9d85 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:03.695972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b143d98f-6098-429a-81fe-83cb761d9d85 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:03.696435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b143d98f-6098-429a-81fe-83cb761d9d85 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:03.697299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b143d98f-6098-429a-81fe-83cb761d9d85 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:03.697795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b143d98f-6098-429a-81fe-83cb761d9d85 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:03.698221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b143d98f-6098-429a-81fe-83cb761d9d85 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:04.026850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b143d98f-6098-429a-81fe-83cb761d9d85 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:04.039441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b143d98f-6098-429a-81fe-83cb761d9d85 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:04.046179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b143d98f-6098-429a-81fe-83cb761d9d85 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:04.047611 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b143d98f-6098-429a-81fe-83cb761d9d85 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1406 microversion: 2.20 time: 0.380858 Oct 29 01:32:04.048203 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2953/5675] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:32:03 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1406 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:04.285470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eb11ba72-ea7f-4922-be34-fbc7dde2ba7a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:04.285470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-eb11ba72-ea7f-4922-be34-fbc7dde2ba7a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 42fae64a-c246-4cac-b36b-0cd85ca3e526] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:04.285470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb11ba72-ea7f-4922-be34-fbc7dde2ba7a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:04.285470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb11ba72-ea7f-4922-be34-fbc7dde2ba7a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:04.285470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb11ba72-ea7f-4922-be34-fbc7dde2ba7a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:04.285470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb11ba72-ea7f-4922-be34-fbc7dde2ba7a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:04.285470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb11ba72-ea7f-4922-be34-fbc7dde2ba7a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:04.285470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb11ba72-ea7f-4922-be34-fbc7dde2ba7a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:04.300318 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-eb11ba72-ea7f-4922-be34-fbc7dde2ba7a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] HTTP exception thrown: Instance 42fae64a-c246-4cac-b36b-0cd85ca3e526 could not be found. Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eb11ba72-ea7f-4922-be34-fbc7dde2ba7a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Request method failure captured: Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 HTTP/1.1 Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIHhzVnilSKQwxqexJxhoOjX5_d6tRjxIwr1FdvCjWtN0kXgUJZUR_tx2v9IQNKxHA4fin7x134BRClotL0m5wH583SitvT-c3TVnJJAaZ3UAhg4blsZh-C7jxiB9ZgocB4QFbj706f3Jm4spf85bD5LjZvjFa-TLoP9F-0iYD5xXAo Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: c1840006d715496788f2dc0ca7c40c6b Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1491451577 Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1840006d715496788f2dc0ca7c40c6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c1840006d715496788f2dc0ca7c40c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1840006d715496788f2dc0ca7c40c6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c1840006d715496788f2dc0ca7c40c6b", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerDiskConfigTestJSON-1491451577 Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: c1840006d715496788f2dc0ca7c40c6b Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1491451577 Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerDiskConfigTestJSON-1491451577-project Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 683fc94021ee47e88a111980139e6786 Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerDiskConfigTestJSON-1491451577-project Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 42fae64a-c246-4cac-b36b-0cd85ca3e526 could not be found. Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '42fae64a-c246-4cac-b36b-0cd85ca3e526'} Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42fae64a-c246-4cac-b36b-0cd85ca3e526 could not be found. Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42fae64a-c246-4cac-b36b-0cd85ca3e526 could not be found. Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:32:04.302398 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.307404 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:32:04.307404 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:32:04.307404 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:32:04.307404 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:32:04.307404 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:32:04.307404 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42fae64a-c246-4cac-b36b-0cd85ca3e526 could not be found. Oct 29 01:32:04.307404 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.309641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eb11ba72-ea7f-4922-be34-fbc7dde2ba7a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Returning 404 to user: Instance 42fae64a-c246-4cac-b36b-0cd85ca3e526 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:32:04.310838 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-eb11ba72-ea7f-4922-be34-fbc7dde2ba7a tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526" status: 404 len: 111 microversion: 2.1 time: 0.063376 Oct 29 01:32:04.312017 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2723/5676] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:04 2022] GET /compute/v2.1/servers/42fae64a-c246-4cac-b36b-0cd85ca3e526 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:32:04.333520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a9bec52c-d9d7-413f-8728-79cf6a4c346b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:04.333520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a9bec52c-d9d7-413f-8728-79cf6a4c346b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:04.335938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9bec52c-d9d7-413f-8728-79cf6a4c346b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:04.336444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9bec52c-d9d7-413f-8728-79cf6a4c346b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:04.336887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9bec52c-d9d7-413f-8728-79cf6a4c346b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:04.337757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9bec52c-d9d7-413f-8728-79cf6a4c346b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:04.338219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9bec52c-d9d7-413f-8728-79cf6a4c346b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:04.338927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9bec52c-d9d7-413f-8728-79cf6a4c346b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:04.368418 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-a9bec52c-d9d7-413f-8728-79cf6a4c346b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] HTTP exception thrown: Instance 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 could not be found. Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a9bec52c-d9d7-413f-8728-79cf6a4c346b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Request method failure captured: Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 HTTP/1.1 Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIHhzVnilSKQwxqexJxhoOjX5_d6tRjxIwr1FdvCjWtN0kXgUJZUR_tx2v9IQNKxHA4fin7x134BRClotL0m5wH583SitvT-c3TVnJJAaZ3UAhg4blsZh-C7jxiB9ZgocB4QFbj706f3Jm4spf85bD5LjZvjFa-TLoP9F-0iYD5xXAo Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: c1840006d715496788f2dc0ca7c40c6b Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1491451577 Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1840006d715496788f2dc0ca7c40c6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c1840006d715496788f2dc0ca7c40c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1840006d715496788f2dc0ca7c40c6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c1840006d715496788f2dc0ca7c40c6b", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerDiskConfigTestJSON-1491451577 Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: c1840006d715496788f2dc0ca7c40c6b Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1491451577 Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerDiskConfigTestJSON-1491451577-project Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 683fc94021ee47e88a111980139e6786 Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerDiskConfigTestJSON-1491451577-project Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 could not be found. Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '8cc1e59d-7992-4344-9a0a-c3f1b2decdf5'} Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 could not be found. Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:32:04.370579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:32:04.375674 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 could not be found. Oct 29 01:32:04.375674 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.375674 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:32:04.375674 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.375674 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:32:04.375674 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:32:04.375674 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:32:04.375674 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:32:04.375674 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:32:04.375674 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 could not be found. Oct 29 01:32:04.375674 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.378946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a9bec52c-d9d7-413f-8728-79cf6a4c346b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Returning 404 to user: Instance 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:32:04.379766 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a9bec52c-d9d7-413f-8728-79cf6a4c346b tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 404 len: 111 microversion: 2.1 time: 0.062991 Oct 29 01:32:04.384894 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2954/5677] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:32:04 2022] DELETE /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:32:04.390763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-82a4fc83-9a12-4eee-bc56-0a3b2d9ed83d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:04.397330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-82a4fc83-9a12-4eee-bc56-0a3b2d9ed83d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:04.404583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82a4fc83-9a12-4eee-bc56-0a3b2d9ed83d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:04.405077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82a4fc83-9a12-4eee-bc56-0a3b2d9ed83d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:04.405552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82a4fc83-9a12-4eee-bc56-0a3b2d9ed83d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:04.406264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82a4fc83-9a12-4eee-bc56-0a3b2d9ed83d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:04.406730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82a4fc83-9a12-4eee-bc56-0a3b2d9ed83d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:04.407158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82a4fc83-9a12-4eee-bc56-0a3b2d9ed83d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:04.422098 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-82a4fc83-9a12-4eee-bc56-0a3b2d9ed83d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] HTTP exception thrown: Instance 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 could not be found. Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-82a4fc83-9a12-4eee-bc56-0a3b2d9ed83d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Request method failure captured: Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 HTTP/1.1 Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIHhzVnilSKQwxqexJxhoOjX5_d6tRjxIwr1FdvCjWtN0kXgUJZUR_tx2v9IQNKxHA4fin7x134BRClotL0m5wH583SitvT-c3TVnJJAaZ3UAhg4blsZh-C7jxiB9ZgocB4QFbj706f3Jm4spf85bD5LjZvjFa-TLoP9F-0iYD5xXAo Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: c1840006d715496788f2dc0ca7c40c6b Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1491451577 Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1840006d715496788f2dc0ca7c40c6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c1840006d715496788f2dc0ca7c40c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1840006d715496788f2dc0ca7c40c6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c1840006d715496788f2dc0ca7c40c6b", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerDiskConfigTestJSON-1491451577 Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: c1840006d715496788f2dc0ca7c40c6b Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1491451577 Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerDiskConfigTestJSON-1491451577-project Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 683fc94021ee47e88a111980139e6786 Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerDiskConfigTestJSON-1491451577-project Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 could not be found. Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '8cc1e59d-7992-4344-9a0a-c3f1b2decdf5'} Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 could not be found. Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 could not be found. Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:32:04.424701 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.435572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:32:04.435572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:32:04.435572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:32:04.435572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:32:04.435572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:32:04.435572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 could not be found. Oct 29 01:32:04.435572 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.435572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-82a4fc83-9a12-4eee-bc56-0a3b2d9ed83d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Returning 404 to user: Instance 8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:32:04.435572 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-82a4fc83-9a12-4eee-bc56-0a3b2d9ed83d tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5" status: 404 len: 111 microversion: 2.1 time: 0.040071 Oct 29 01:32:04.435572 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2724/5678] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:04 2022] GET /compute/v2.1/servers/8cc1e59d-7992-4344-9a0a-c3f1b2decdf5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:32:04.442728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-31ab8824-60c6-4a66-8c10-488e6e5b4043 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:04.443231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-31ab8824-60c6-4a66-8c10-488e6e5b4043 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:04.451968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31ab8824-60c6-4a66-8c10-488e6e5b4043 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:04.452840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31ab8824-60c6-4a66-8c10-488e6e5b4043 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:04.453558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31ab8824-60c6-4a66-8c10-488e6e5b4043 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:04.454665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31ab8824-60c6-4a66-8c10-488e6e5b4043 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:04.455660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31ab8824-60c6-4a66-8c10-488e6e5b4043 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:04.456346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31ab8824-60c6-4a66-8c10-488e6e5b4043 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:04.475782 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-31ab8824-60c6-4a66-8c10-488e6e5b4043 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] HTTP exception thrown: Instance a3caef7a-fea6-4d7b-992f-78001494a729 could not be found. Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-31ab8824-60c6-4a66-8c10-488e6e5b4043 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Request method failure captured: Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 HTTP/1.1 Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIHhzVnilSKQwxqexJxhoOjX5_d6tRjxIwr1FdvCjWtN0kXgUJZUR_tx2v9IQNKxHA4fin7x134BRClotL0m5wH583SitvT-c3TVnJJAaZ3UAhg4blsZh-C7jxiB9ZgocB4QFbj706f3Jm4spf85bD5LjZvjFa-TLoP9F-0iYD5xXAo Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: c1840006d715496788f2dc0ca7c40c6b Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1491451577 Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1840006d715496788f2dc0ca7c40c6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c1840006d715496788f2dc0ca7c40c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1840006d715496788f2dc0ca7c40c6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c1840006d715496788f2dc0ca7c40c6b", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerDiskConfigTestJSON-1491451577 Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: c1840006d715496788f2dc0ca7c40c6b Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1491451577 Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerDiskConfigTestJSON-1491451577-project Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 683fc94021ee47e88a111980139e6786 Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerDiskConfigTestJSON-1491451577-project Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance a3caef7a-fea6-4d7b-992f-78001494a729 could not be found. Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'a3caef7a-fea6-4d7b-992f-78001494a729'} Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3caef7a-fea6-4d7b-992f-78001494a729 could not be found. Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:32:04.477700 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:32:04.481871 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3caef7a-fea6-4d7b-992f-78001494a729 could not be found. Oct 29 01:32:04.481871 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.481871 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:32:04.481871 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.481871 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:32:04.481871 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:32:04.481871 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:32:04.481871 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:32:04.481871 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:32:04.481871 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3caef7a-fea6-4d7b-992f-78001494a729 could not be found. Oct 29 01:32:04.481871 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.482887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-31ab8824-60c6-4a66-8c10-488e6e5b4043 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Returning 404 to user: Instance a3caef7a-fea6-4d7b-992f-78001494a729 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:32:04.483889 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-31ab8824-60c6-4a66-8c10-488e6e5b4043 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 404 len: 111 microversion: 2.1 time: 0.045273 Oct 29 01:32:04.487848 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2955/5679] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:32:04 2022] DELETE /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:32:04.497329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e9a7c7a9-7c6c-4d4c-adbc-78b57a4dd517 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:04.498181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e9a7c7a9-7c6c-4d4c-adbc-78b57a4dd517 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] [instance: a3caef7a-fea6-4d7b-992f-78001494a729] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:04.510783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9a7c7a9-7c6c-4d4c-adbc-78b57a4dd517 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:04.513086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9a7c7a9-7c6c-4d4c-adbc-78b57a4dd517 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:04.516633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9a7c7a9-7c6c-4d4c-adbc-78b57a4dd517 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:04.516633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9a7c7a9-7c6c-4d4c-adbc-78b57a4dd517 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:04.516633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9a7c7a9-7c6c-4d4c-adbc-78b57a4dd517 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:04.517072 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9a7c7a9-7c6c-4d4c-adbc-78b57a4dd517 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:04.561754 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-e9a7c7a9-7c6c-4d4c-adbc-78b57a4dd517 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] HTTP exception thrown: Instance a3caef7a-fea6-4d7b-992f-78001494a729 could not be found. Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e9a7c7a9-7c6c-4d4c-adbc-78b57a4dd517 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Request method failure captured: Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 HTTP/1.1 Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIHhzVnilSKQwxqexJxhoOjX5_d6tRjxIwr1FdvCjWtN0kXgUJZUR_tx2v9IQNKxHA4fin7x134BRClotL0m5wH583SitvT-c3TVnJJAaZ3UAhg4blsZh-C7jxiB9ZgocB4QFbj706f3Jm4spf85bD5LjZvjFa-TLoP9F-0iYD5xXAo Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: c1840006d715496788f2dc0ca7c40c6b Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1491451577 Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1840006d715496788f2dc0ca7c40c6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c1840006d715496788f2dc0ca7c40c6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1840006d715496788f2dc0ca7c40c6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c1840006d715496788f2dc0ca7c40c6b", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerDiskConfigTestJSON-1491451577 Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: c1840006d715496788f2dc0ca7c40c6b Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1491451577 Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerDiskConfigTestJSON-1491451577-project Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 683fc94021ee47e88a111980139e6786 Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerDiskConfigTestJSON-1491451577-project Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance a3caef7a-fea6-4d7b-992f-78001494a729 could not be found. Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'a3caef7a-fea6-4d7b-992f-78001494a729'} Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3caef7a-fea6-4d7b-992f-78001494a729 could not be found. Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3caef7a-fea6-4d7b-992f-78001494a729 could not be found. Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:32:04.568262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.573940 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:32:04.573940 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:32:04.573940 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:32:04.573940 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:32:04.573940 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:32:04.573940 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3caef7a-fea6-4d7b-992f-78001494a729 could not be found. Oct 29 01:32:04.573940 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:32:04.578420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e9a7c7a9-7c6c-4d4c-adbc-78b57a4dd517 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] Returning 404 to user: Instance a3caef7a-fea6-4d7b-992f-78001494a729 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:32:04.581818 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e9a7c7a9-7c6c-4d4c-adbc-78b57a4dd517 tempest-ServerDiskConfigTestJSON-1491451577 tempest-ServerDiskConfigTestJSON-1491451577-project] 10.222.0.26 "GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729" status: 404 len: 111 microversion: 2.1 time: 0.089277 Oct 29 01:32:04.586965 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2725/5680] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:04 2022] GET /compute/v2.1/servers/a3caef7a-fea6-4d7b-992f-78001494a729 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:32:05.075231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e2a23a0c-cd15-4510-8937-f461456a664b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:05.076134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e2a23a0c-cd15-4510-8937-f461456a664b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:05.086991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2a23a0c-cd15-4510-8937-f461456a664b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:05.087748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2a23a0c-cd15-4510-8937-f461456a664b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:05.088436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2a23a0c-cd15-4510-8937-f461456a664b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:05.089365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2a23a0c-cd15-4510-8937-f461456a664b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:05.089983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2a23a0c-cd15-4510-8937-f461456a664b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:05.090572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2a23a0c-cd15-4510-8937-f461456a664b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:05.468536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e2a23a0c-cd15-4510-8937-f461456a664b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:05.481952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e2a23a0c-cd15-4510-8937-f461456a664b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:05.483647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e2a23a0c-cd15-4510-8937-f461456a664b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:05.485023 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e2a23a0c-cd15-4510-8937-f461456a664b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1406 microversion: 2.20 time: 0.413762 Oct 29 01:32:05.486128 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2956/5681] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:32:05 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1406 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:06.424030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-ee7adac9-8fcc-4087-a923-178e1c266a2c req-5a2ce108-a52f-4123-9f9f-bf66817b7c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db08ce62-9806-4b5e-90e6-ca4fe64a2885", "name": "network-vif-plugged", "status": "completed", "tag": "9a179e9f-8e3d-4dcd-b553-24e9832a186e"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:06.439718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ee7adac9-8fcc-4087-a923-178e1c266a2c req-5a2ce108-a52f-4123-9f9f-bf66817b7c80 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:06.440525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ee7adac9-8fcc-4087-a923-178e1c266a2c req-5a2ce108-a52f-4123-9f9f-bf66817b7c80 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:06.441184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ee7adac9-8fcc-4087-a923-178e1c266a2c req-5a2ce108-a52f-4123-9f9f-bf66817b7c80 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:06.459689 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-ee7adac9-8fcc-4087-a923-178e1c266a2c req-5a2ce108-a52f-4123-9f9f-bf66817b7c80 service nova] Creating event network-vif-plugged:9a179e9f-8e3d-4dcd-b553-24e9832a186e for instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 on n-h1-862964-3 Oct 29 01:32:06.475147 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-ee7adac9-8fcc-4087-a923-178e1c266a2c req-5a2ce108-a52f-4123-9f9f-bf66817b7c80 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065434 Oct 29 01:32:06.476828 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2726/5682] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:32:06.520370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1b78daf1-8d1f-46b9-ae6c-0c86830f43c2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:06.537524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1b78daf1-8d1f-46b9-ae6c-0c86830f43c2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:06.555488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b78daf1-8d1f-46b9-ae6c-0c86830f43c2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:06.563253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b78daf1-8d1f-46b9-ae6c-0c86830f43c2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:06.563253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b78daf1-8d1f-46b9-ae6c-0c86830f43c2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:06.563253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b78daf1-8d1f-46b9-ae6c-0c86830f43c2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:06.563253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b78daf1-8d1f-46b9-ae6c-0c86830f43c2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:06.563253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b78daf1-8d1f-46b9-ae6c-0c86830f43c2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:06.956322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1b78daf1-8d1f-46b9-ae6c-0c86830f43c2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:06.978037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1b78daf1-8d1f-46b9-ae6c-0c86830f43c2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:06.978037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1b78daf1-8d1f-46b9-ae6c-0c86830f43c2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:06.978037 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1b78daf1-8d1f-46b9-ae6c-0c86830f43c2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1406 microversion: 2.20 time: 0.456112 Oct 29 01:32:06.987012 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2957/5683] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:32:06 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1406 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:07.999579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4d5c14ec-f4e7-4305-b8dc-8e4d68e64f96 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:08.000300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4d5c14ec-f4e7-4305-b8dc-8e4d68e64f96 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:08.008151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d5c14ec-f4e7-4305-b8dc-8e4d68e64f96 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:08.008646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d5c14ec-f4e7-4305-b8dc-8e4d68e64f96 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:08.009090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d5c14ec-f4e7-4305-b8dc-8e4d68e64f96 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:08.009827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d5c14ec-f4e7-4305-b8dc-8e4d68e64f96 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:08.010289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d5c14ec-f4e7-4305-b8dc-8e4d68e64f96 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:08.010719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d5c14ec-f4e7-4305-b8dc-8e4d68e64f96 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:08.080045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:32:08.525679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4d5c14ec-f4e7-4305-b8dc-8e4d68e64f96 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:08.540412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4d5c14ec-f4e7-4305-b8dc-8e4d68e64f96 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:08.546558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4d5c14ec-f4e7-4305-b8dc-8e4d68e64f96 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:08.551610 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4d5c14ec-f4e7-4305-b8dc-8e4d68e64f96 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1406 microversion: 2.20 time: 0.556325 Oct 29 01:32:08.557101 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2727/5684] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:32:07 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1406 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:09.585769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7edd820f-a94d-4076-b471-0a4ca5d3363c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:09.586544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7edd820f-a94d-4076-b471-0a4ca5d3363c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:09.622941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7edd820f-a94d-4076-b471-0a4ca5d3363c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:09.626592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7edd820f-a94d-4076-b471-0a4ca5d3363c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:09.629852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7edd820f-a94d-4076-b471-0a4ca5d3363c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:09.630640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7edd820f-a94d-4076-b471-0a4ca5d3363c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:09.635015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7edd820f-a94d-4076-b471-0a4ca5d3363c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:09.635480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7edd820f-a94d-4076-b471-0a4ca5d3363c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:09.927196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7edd820f-a94d-4076-b471-0a4ca5d3363c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:09.976548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7edd820f-a94d-4076-b471-0a4ca5d3363c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:09.979677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7edd820f-a94d-4076-b471-0a4ca5d3363c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:09.989445 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7edd820f-a94d-4076-b471-0a4ca5d3363c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1598 microversion: 2.20 time: 0.403430 Oct 29 01:32:09.989445 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2958/5685] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:32:09 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1598 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:10.027846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f73f7f82-8cd1-463c-b114-c1e187adda46 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:10.028363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f73f7f82-8cd1-463c-b114-c1e187adda46 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:10.035591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:32:10.047115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f73f7f82-8cd1-463c-b114-c1e187adda46 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:10.047626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f73f7f82-8cd1-463c-b114-c1e187adda46 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:10.048082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f73f7f82-8cd1-463c-b114-c1e187adda46 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:10.048806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f73f7f82-8cd1-463c-b114-c1e187adda46 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:10.049305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f73f7f82-8cd1-463c-b114-c1e187adda46 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:10.049741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f73f7f82-8cd1-463c-b114-c1e187adda46 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:10.356973 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f73f7f82-8cd1-463c-b114-c1e187adda46 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.335348 Oct 29 01:32:10.358594 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2728/5686] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Oct 29 01:32:10 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-interface => generated 284 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:32:13.754339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-33de0290-b6b8-4195-a534-9a60d52ef62b req-c8288466-b2fa-4f53-97dd-c140db6dda87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db08ce62-9806-4b5e-90e6-ca4fe64a2885", "tag": "9a179e9f-8e3d-4dcd-b553-24e9832a186e"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:13.771963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-33de0290-b6b8-4195-a534-9a60d52ef62b req-c8288466-b2fa-4f53-97dd-c140db6dda87 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:13.773147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-33de0290-b6b8-4195-a534-9a60d52ef62b req-c8288466-b2fa-4f53-97dd-c140db6dda87 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:13.773646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-33de0290-b6b8-4195-a534-9a60d52ef62b req-c8288466-b2fa-4f53-97dd-c140db6dda87 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:13.830473 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-33de0290-b6b8-4195-a534-9a60d52ef62b req-c8288466-b2fa-4f53-97dd-c140db6dda87 service nova] Creating event network-changed:9a179e9f-8e3d-4dcd-b553-24e9832a186e for instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 on n-h1-862964-3 Oct 29 01:32:13.837987 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-33de0290-b6b8-4195-a534-9a60d52ef62b req-c8288466-b2fa-4f53-97dd-c140db6dda87 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087177 Oct 29 01:32:13.840478 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2959/5687] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:28.491966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=7 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:32:28.518782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d6d18e68-f793-4da6-82ec-0bfa941cd32e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:28.536166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d6d18e68-f793-4da6-82ec-0bfa941cd32e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:28.583443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6d18e68-f793-4da6-82ec-0bfa941cd32e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:28.584024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6d18e68-f793-4da6-82ec-0bfa941cd32e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:28.589696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6d18e68-f793-4da6-82ec-0bfa941cd32e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:28.591938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6d18e68-f793-4da6-82ec-0bfa941cd32e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:28.592456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6d18e68-f793-4da6-82ec-0bfa941cd32e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:28.592908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6d18e68-f793-4da6-82ec-0bfa941cd32e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:28.665964 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d6d18e68-f793-4da6-82ec-0bfa941cd32e tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/ips" status: 200 len: 148 microversion: 2.1 time: 0.183930 Oct 29 01:32:28.668007 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2729/5688] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 29 01:32:28 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/ips => generated 148 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:29.786190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=31 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:32:29.788104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=55 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:32:30.185982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-06448818-01df-4ce4-b42a-f939a5b64c1a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-328000635", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "046a605d-6f52-4fba-8d99-69f124e1fb40"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:30.323576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-06448818-01df-4ce4-b42a-f939a5b64c1a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] validate_networks() for [('046a605d-6f52-4fba-8d99-69f124e1fb40', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:32:32.544276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-06448818-01df-4ce4-b42a-f939a5b64c1a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:32:32.544826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-06448818-01df-4ce4-b42a-f939a5b64c1a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:32:32.545958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-06448818-01df-4ce4-b42a-f939a5b64c1a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:32:32.546514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-06448818-01df-4ce4-b42a-f939a5b64c1a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:32:32.547887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-06448818-01df-4ce4-b42a-f939a5b64c1a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:32:32.582940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06448818-01df-4ce4-b42a-f939a5b64c1a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:32.591687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06448818-01df-4ce4-b42a-f939a5b64c1a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:32.594301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06448818-01df-4ce4-b42a-f939a5b64c1a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:32.597482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06448818-01df-4ce4-b42a-f939a5b64c1a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:32.598161 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06448818-01df-4ce4-b42a-f939a5b64c1a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:32.599374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06448818-01df-4ce4-b42a-f939a5b64c1a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:32.624446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-06448818-01df-4ce4-b42a-f939a5b64c1a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Getting quotas for project 2faa675b6860490fa5521d319bee1e42. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:32:32.630405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-06448818-01df-4ce4-b42a-f939a5b64c1a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Getting quotas for user 472c6488c03a402ab57ab2798d869def and project 2faa675b6860490fa5521d319bee1e42. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:32:32.659517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-06448818-01df-4ce4-b42a-f939a5b64c1a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:32:32.662175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-06448818-01df-4ce4-b42a-f939a5b64c1a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:32:32.840456 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-06448818-01df-4ce4-b42a-f939a5b64c1a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.057003 Oct 29 01:32:32.841122 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2960/5689] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:32:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:32:32.854634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-97a3663f-749d-4866-9772-e8f8f4cde923 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:32.855843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-97a3663f-749d-4866-9772-e8f8f4cde923 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:33.072574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b8ddac9a-04fb-40a2-aa28-a707ecbd19e3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2755d56-0da5-449c-aa64-68b886050042"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:33.072998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b8ddac9a-04fb-40a2-aa28-a707ecbd19e3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:33.082266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8ddac9a-04fb-40a2-aa28-a707ecbd19e3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:33.083015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8ddac9a-04fb-40a2-aa28-a707ecbd19e3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:33.083648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8ddac9a-04fb-40a2-aa28-a707ecbd19e3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:33.084692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8ddac9a-04fb-40a2-aa28-a707ecbd19e3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:33.085499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8ddac9a-04fb-40a2-aa28-a707ecbd19e3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:33.086165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8ddac9a-04fb-40a2-aa28-a707ecbd19e3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:33.314236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-97a3663f-749d-4866-9772-e8f8f4cde923 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:33.322850 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-97a3663f-749d-4866-9772-e8f8f4cde923 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1216 microversion: 2.1 time: 0.473573 Oct 29 01:32:33.349347 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2730/5690] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:32 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1216 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:34.359634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b67232f3-553b-4078-8e03-c5628a782812 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:34.360480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b67232f3-553b-4078-8e03-c5628a782812 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:34.430643 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b8ddac9a-04fb-40a2-aa28-a707ecbd19e3 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "POST /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.374343 Oct 29 01:32:34.431944 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2961/5691] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 29 01:32:33 2022] POST /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments => generated 194 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:32:34.630723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b67232f3-553b-4078-8e03-c5628a782812 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:34.645518 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b67232f3-553b-4078-8e03-c5628a782812 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1216 microversion: 2.1 time: 0.289963 Oct 29 01:32:34.661438 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2731/5692] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:34 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1216 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:35.681305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b8c24e74-118e-432d-99e8-4e7bb1fe2276 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:35.682729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b8c24e74-118e-432d-99e8-4e7bb1fe2276 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:35.704380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8c24e74-118e-432d-99e8-4e7bb1fe2276 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:35.705347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8c24e74-118e-432d-99e8-4e7bb1fe2276 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:35.706022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8c24e74-118e-432d-99e8-4e7bb1fe2276 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:35.710561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8c24e74-118e-432d-99e8-4e7bb1fe2276 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:35.711358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8c24e74-118e-432d-99e8-4e7bb1fe2276 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:35.712358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8c24e74-118e-432d-99e8-4e7bb1fe2276 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:36.118698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b8c24e74-118e-432d-99e8-4e7bb1fe2276 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:36.127356 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b8c24e74-118e-432d-99e8-4e7bb1fe2276 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1212 microversion: 2.1 time: 0.450728 Oct 29 01:32:36.133890 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2962/5693] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:35 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1212 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:37.164506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-728c5b06-b05b-424e-a7e7-885d38780600 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:37.165126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-728c5b06-b05b-424e-a7e7-885d38780600 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:37.183671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-728c5b06-b05b-424e-a7e7-885d38780600 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:37.184326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-728c5b06-b05b-424e-a7e7-885d38780600 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:37.184780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-728c5b06-b05b-424e-a7e7-885d38780600 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:37.185531 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-728c5b06-b05b-424e-a7e7-885d38780600 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:37.185991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-728c5b06-b05b-424e-a7e7-885d38780600 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:37.190278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-728c5b06-b05b-424e-a7e7-885d38780600 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:38.372873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-728c5b06-b05b-424e-a7e7-885d38780600 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:38.402246 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-728c5b06-b05b-424e-a7e7-885d38780600 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1276 microversion: 2.1 time: 1.243160 Oct 29 01:32:38.403574 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2732/5694] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:37 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1276 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:39.430112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dfdd3a45-9d71-4061-9349-3b846f72ad25 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:39.430737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dfdd3a45-9d71-4061-9349-3b846f72ad25 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:39.448030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dfdd3a45-9d71-4061-9349-3b846f72ad25 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:39.448820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dfdd3a45-9d71-4061-9349-3b846f72ad25 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:39.449567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dfdd3a45-9d71-4061-9349-3b846f72ad25 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:39.450502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dfdd3a45-9d71-4061-9349-3b846f72ad25 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:39.451157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dfdd3a45-9d71-4061-9349-3b846f72ad25 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:39.451795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dfdd3a45-9d71-4061-9349-3b846f72ad25 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:40.052476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dfdd3a45-9d71-4061-9349-3b846f72ad25 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:40.064220 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dfdd3a45-9d71-4061-9349-3b846f72ad25 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1274 microversion: 2.1 time: 0.638316 Oct 29 01:32:40.065098 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2963/5695] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:39 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1274 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:41.099057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c839270c-a7bf-482f-b104-3453772d05c1 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:41.099811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c839270c-a7bf-482f-b104-3453772d05c1 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:41.116037 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c839270c-a7bf-482f-b104-3453772d05c1 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:41.116539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c839270c-a7bf-482f-b104-3453772d05c1 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:41.117135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c839270c-a7bf-482f-b104-3453772d05c1 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:41.117885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c839270c-a7bf-482f-b104-3453772d05c1 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:41.118348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c839270c-a7bf-482f-b104-3453772d05c1 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:41.118776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c839270c-a7bf-482f-b104-3453772d05c1 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:41.636894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c839270c-a7bf-482f-b104-3453772d05c1 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:41.644755 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c839270c-a7bf-482f-b104-3453772d05c1 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1316 microversion: 2.1 time: 0.550245 Oct 29 01:32:41.657519 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2733/5696] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:41 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1316 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:42.699218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8d2fabe5-9309-427d-a300-c9ad3a2b7ba6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:42.700946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8d2fabe5-9309-427d-a300-c9ad3a2b7ba6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:42.705865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:32:42.707931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:32:42.714228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d2fabe5-9309-427d-a300-c9ad3a2b7ba6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:42.718885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d2fabe5-9309-427d-a300-c9ad3a2b7ba6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:42.718885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d2fabe5-9309-427d-a300-c9ad3a2b7ba6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:42.718885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d2fabe5-9309-427d-a300-c9ad3a2b7ba6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:42.718885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d2fabe5-9309-427d-a300-c9ad3a2b7ba6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:42.718885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d2fabe5-9309-427d-a300-c9ad3a2b7ba6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:43.244021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8d2fabe5-9309-427d-a300-c9ad3a2b7ba6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:43.259003 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8d2fabe5-9309-427d-a300-c9ad3a2b7ba6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1316 microversion: 2.1 time: 0.587763 Oct 29 01:32:43.260204 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2964/5697] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:42 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1316 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:43.854898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-9500e5bd-17eb-4b79-81d9-c3212b026954 req-1225e126-334c-4160-9c77-0cd0a3c8c02a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f3c16a-e6fb-4f35-a590-52e0d0fba57f", "tag": "fdb51cf1-a289-46ca-9745-c6b7c4001446"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:43.887703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9500e5bd-17eb-4b79-81d9-c3212b026954 req-1225e126-334c-4160-9c77-0cd0a3c8c02a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:43.888186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9500e5bd-17eb-4b79-81d9-c3212b026954 req-1225e126-334c-4160-9c77-0cd0a3c8c02a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:43.888615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9500e5bd-17eb-4b79-81d9-c3212b026954 req-1225e126-334c-4160-9c77-0cd0a3c8c02a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:43.916137 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-9500e5bd-17eb-4b79-81d9-c3212b026954 req-1225e126-334c-4160-9c77-0cd0a3c8c02a service nova] Creating event network-changed:fdb51cf1-a289-46ca-9745-c6b7c4001446 for instance 95f3c16a-e6fb-4f35-a590-52e0d0fba57f on n-h1-862964-3 Oct 29 01:32:43.926412 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-9500e5bd-17eb-4b79-81d9-c3212b026954 req-1225e126-334c-4160-9c77-0cd0a3c8c02a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080095 Oct 29 01:32:43.929004 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2734/5698] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:44.284959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3b697916-fcc7-4f42-808e-49e890ec562a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:44.286236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3b697916-fcc7-4f42-808e-49e890ec562a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:44.301726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b697916-fcc7-4f42-808e-49e890ec562a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:44.302558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b697916-fcc7-4f42-808e-49e890ec562a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:44.303805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b697916-fcc7-4f42-808e-49e890ec562a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:44.334593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b697916-fcc7-4f42-808e-49e890ec562a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:44.335819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b697916-fcc7-4f42-808e-49e890ec562a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:44.337785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b697916-fcc7-4f42-808e-49e890ec562a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:45.336988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3b697916-fcc7-4f42-808e-49e890ec562a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:45.349262 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3b697916-fcc7-4f42-808e-49e890ec562a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1316 microversion: 2.1 time: 1.066756 Oct 29 01:32:45.353274 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2965/5699] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:44 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1316 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:46.383444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f99c282d-24e0-4f2a-a4fe-09dc0ccf4745 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:46.383444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f99c282d-24e0-4f2a-a4fe-09dc0ccf4745 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:46.384369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:32:46.392895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f99c282d-24e0-4f2a-a4fe-09dc0ccf4745 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:46.393420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f99c282d-24e0-4f2a-a4fe-09dc0ccf4745 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:46.393861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f99c282d-24e0-4f2a-a4fe-09dc0ccf4745 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:46.394767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f99c282d-24e0-4f2a-a4fe-09dc0ccf4745 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:46.395378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f99c282d-24e0-4f2a-a4fe-09dc0ccf4745 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:46.397335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f99c282d-24e0-4f2a-a4fe-09dc0ccf4745 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:46.798815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f99c282d-24e0-4f2a-a4fe-09dc0ccf4745 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:46.809201 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f99c282d-24e0-4f2a-a4fe-09dc0ccf4745 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1316 microversion: 2.1 time: 0.435953 Oct 29 01:32:46.810027 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2735/5700] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:46 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1316 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:47.834671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-489b46ab-0d0e-4fa7-8519-b7cca3876159 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:47.836073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-489b46ab-0d0e-4fa7-8519-b7cca3876159 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:47.843069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-489b46ab-0d0e-4fa7-8519-b7cca3876159 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:47.843625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-489b46ab-0d0e-4fa7-8519-b7cca3876159 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:47.844147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-489b46ab-0d0e-4fa7-8519-b7cca3876159 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:47.844903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-489b46ab-0d0e-4fa7-8519-b7cca3876159 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:47.845666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-489b46ab-0d0e-4fa7-8519-b7cca3876159 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:47.846080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-489b46ab-0d0e-4fa7-8519-b7cca3876159 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:48.044399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-489b46ab-0d0e-4fa7-8519-b7cca3876159 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:48.057760 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-489b46ab-0d0e-4fa7-8519-b7cca3876159 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1316 microversion: 2.1 time: 0.227062 Oct 29 01:32:48.073630 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2966/5701] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:47 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:49.082002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-925a86a3-cf41-470d-89b5-2c9ea3b47613 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:49.082721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-925a86a3-cf41-470d-89b5-2c9ea3b47613 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:49.090499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-925a86a3-cf41-470d-89b5-2c9ea3b47613 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:49.093294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-925a86a3-cf41-470d-89b5-2c9ea3b47613 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:49.093294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-925a86a3-cf41-470d-89b5-2c9ea3b47613 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:49.093294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-925a86a3-cf41-470d-89b5-2c9ea3b47613 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:49.093294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-925a86a3-cf41-470d-89b5-2c9ea3b47613 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:49.093294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-925a86a3-cf41-470d-89b5-2c9ea3b47613 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:49.251969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-925a86a3-cf41-470d-89b5-2c9ea3b47613 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:49.261608 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-925a86a3-cf41-470d-89b5-2c9ea3b47613 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1316 microversion: 2.1 time: 0.183457 Oct 29 01:32:49.268888 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2736/5702] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:49 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:50.288454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f4b4b098-85cc-42ed-8007-7a3a338311ab tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:50.290075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f4b4b098-85cc-42ed-8007-7a3a338311ab tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:50.302520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4b4b098-85cc-42ed-8007-7a3a338311ab tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:50.305737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4b4b098-85cc-42ed-8007-7a3a338311ab tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:50.306493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4b4b098-85cc-42ed-8007-7a3a338311ab tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:50.307484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4b4b098-85cc-42ed-8007-7a3a338311ab tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:50.308776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4b4b098-85cc-42ed-8007-7a3a338311ab tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:50.310887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4b4b098-85cc-42ed-8007-7a3a338311ab tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:50.542676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f4b4b098-85cc-42ed-8007-7a3a338311ab tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:50.551005 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f4b4b098-85cc-42ed-8007-7a3a338311ab tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1316 microversion: 2.1 time: 0.266979 Oct 29 01:32:50.566073 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2967/5703] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:50 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:51.577539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4ff8a1fd-bc5b-4fee-acc5-2a0f7709bb7f tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:51.578889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4ff8a1fd-bc5b-4fee-acc5-2a0f7709bb7f tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:51.594042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ff8a1fd-bc5b-4fee-acc5-2a0f7709bb7f tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:51.594908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ff8a1fd-bc5b-4fee-acc5-2a0f7709bb7f tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:51.596663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ff8a1fd-bc5b-4fee-acc5-2a0f7709bb7f tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:51.597664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ff8a1fd-bc5b-4fee-acc5-2a0f7709bb7f tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:51.598146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ff8a1fd-bc5b-4fee-acc5-2a0f7709bb7f tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:51.598593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ff8a1fd-bc5b-4fee-acc5-2a0f7709bb7f tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:52.011937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4ff8a1fd-bc5b-4fee-acc5-2a0f7709bb7f tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:52.019974 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4ff8a1fd-bc5b-4fee-acc5-2a0f7709bb7f tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1316 microversion: 2.1 time: 0.446361 Oct 29 01:32:52.042635 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2737/5704] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:51 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1316 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:52.092028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3df6d309-e9d6-4e56-b930-5e0429fd2059 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:52.094133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3df6d309-e9d6-4e56-b930-5e0429fd2059 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:52.109391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3df6d309-e9d6-4e56-b930-5e0429fd2059 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:52.111610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3df6d309-e9d6-4e56-b930-5e0429fd2059 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:52.112206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3df6d309-e9d6-4e56-b930-5e0429fd2059 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:52.113026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3df6d309-e9d6-4e56-b930-5e0429fd2059 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:52.113641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3df6d309-e9d6-4e56-b930-5e0429fd2059 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:52.114427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3df6d309-e9d6-4e56-b930-5e0429fd2059 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:52.236605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-3df6d309-e9d6-4e56-b930-5e0429fd2059 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lazy-loading 'services' on Instance uuid 94e7890d-907a-4ed3-9bab-73c679fe5e6f {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:32:52.579779 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3df6d309-e9d6-4e56-b930-5e0429fd2059 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "DELETE /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments/b2755d56-0da5-449c-aa64-68b886050042" status: 202 len: 0 microversion: 2.1 time: 0.491719 Oct 29 01:32:52.580840 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2968/5705] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 29 01:32:52 2022] DELETE /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments/b2755d56-0da5-449c-aa64-68b886050042 => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:32:52.600587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-00e14029-42dd-4b1f-8ca9-588ff792a8b0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:52.602092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-00e14029-42dd-4b1f-8ca9-588ff792a8b0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:52.622889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00e14029-42dd-4b1f-8ca9-588ff792a8b0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:52.623392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00e14029-42dd-4b1f-8ca9-588ff792a8b0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:52.627861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00e14029-42dd-4b1f-8ca9-588ff792a8b0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:52.627861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00e14029-42dd-4b1f-8ca9-588ff792a8b0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:52.628792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00e14029-42dd-4b1f-8ca9-588ff792a8b0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:52.629547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-00e14029-42dd-4b1f-8ca9-588ff792a8b0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:52.654512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-31ee39a0-3647-4d5f-905f-26c40de2e268 req-e84a3fad-73d0-4afe-9a3c-60fc4a599761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f3c16a-e6fb-4f35-a590-52e0d0fba57f", "name": "network-vif-plugged", "status": "completed", "tag": "fdb51cf1-a289-46ca-9745-c6b7c4001446"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:52.670739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-31ee39a0-3647-4d5f-905f-26c40de2e268 req-e84a3fad-73d0-4afe-9a3c-60fc4a599761 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:52.671516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-31ee39a0-3647-4d5f-905f-26c40de2e268 req-e84a3fad-73d0-4afe-9a3c-60fc4a599761 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:52.672227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-31ee39a0-3647-4d5f-905f-26c40de2e268 req-e84a3fad-73d0-4afe-9a3c-60fc4a599761 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:52.685217 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-00e14029-42dd-4b1f-8ca9-588ff792a8b0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094994 Oct 29 01:32:52.685217 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2738/5706] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:32:52 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:52.691878 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-31ee39a0-3647-4d5f-905f-26c40de2e268 req-e84a3fad-73d0-4afe-9a3c-60fc4a599761 service nova] Creating event network-vif-plugged:fdb51cf1-a289-46ca-9745-c6b7c4001446 for instance 95f3c16a-e6fb-4f35-a590-52e0d0fba57f on n-h1-862964-3 Oct 29 01:32:52.704839 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-31ee39a0-3647-4d5f-905f-26c40de2e268 req-e84a3fad-73d0-4afe-9a3c-60fc4a599761 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065730 Oct 29 01:32:52.706250 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2969/5707] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:53.051914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-10c025b6-6317-40a4-a3aa-afb29895362b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:53.053844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-10c025b6-6317-40a4-a3aa-afb29895362b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:53.062299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10c025b6-6317-40a4-a3aa-afb29895362b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:53.063047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10c025b6-6317-40a4-a3aa-afb29895362b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:53.063828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10c025b6-6317-40a4-a3aa-afb29895362b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:53.064879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10c025b6-6317-40a4-a3aa-afb29895362b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:53.065752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10c025b6-6317-40a4-a3aa-afb29895362b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:53.067432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10c025b6-6317-40a4-a3aa-afb29895362b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:53.292324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-10c025b6-6317-40a4-a3aa-afb29895362b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:53.301608 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-10c025b6-6317-40a4-a3aa-afb29895362b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1316 microversion: 2.1 time: 0.254851 Oct 29 01:32:53.303548 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2739/5708] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:53 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:53.694442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a63185c8-1c98-4a88-bf41-9d6166b3499a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:53.696871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a63185c8-1c98-4a88-bf41-9d6166b3499a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:53.724917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a63185c8-1c98-4a88-bf41-9d6166b3499a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:53.725521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a63185c8-1c98-4a88-bf41-9d6166b3499a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:53.725987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a63185c8-1c98-4a88-bf41-9d6166b3499a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:53.726718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a63185c8-1c98-4a88-bf41-9d6166b3499a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:53.727186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a63185c8-1c98-4a88-bf41-9d6166b3499a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:53.727607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a63185c8-1c98-4a88-bf41-9d6166b3499a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:53.872586 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a63185c8-1c98-4a88-bf41-9d6166b3499a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180484 Oct 29 01:32:53.878634 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2970/5709] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:32:53 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:54.326953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b6b3453a-f5d3-44be-bd3e-97d69331662d tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:54.327568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b6b3453a-f5d3-44be-bd3e-97d69331662d tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:54.340587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6b3453a-f5d3-44be-bd3e-97d69331662d tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:54.341105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6b3453a-f5d3-44be-bd3e-97d69331662d tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:54.343799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6b3453a-f5d3-44be-bd3e-97d69331662d tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:54.344575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6b3453a-f5d3-44be-bd3e-97d69331662d tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:54.345052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6b3453a-f5d3-44be-bd3e-97d69331662d tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:54.347873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6b3453a-f5d3-44be-bd3e-97d69331662d tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:54.885888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b6b3453a-f5d3-44be-bd3e-97d69331662d tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:54.900975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b859915-6c47-47ad-b2af-1344ab6c3b48 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:54.903864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7b859915-6c47-47ad-b2af-1344ab6c3b48 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:54.923266 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b6b3453a-f5d3-44be-bd3e-97d69331662d tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1316 microversion: 2.1 time: 0.590413 Oct 29 01:32:54.925427 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2740/5710] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:54 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1316 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:54.930334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b859915-6c47-47ad-b2af-1344ab6c3b48 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:54.937344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b859915-6c47-47ad-b2af-1344ab6c3b48 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:54.938166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b859915-6c47-47ad-b2af-1344ab6c3b48 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:54.939047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b859915-6c47-47ad-b2af-1344ab6c3b48 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:54.939789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b859915-6c47-47ad-b2af-1344ab6c3b48 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:54.940448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b859915-6c47-47ad-b2af-1344ab6c3b48 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:55.017625 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7b859915-6c47-47ad-b2af-1344ab6c3b48 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129907 Oct 29 01:32:55.018333 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2971/5711] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:32:54 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:32:55.949000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-219be2f0-ccaa-4114-a670-bdd856a4b5a8 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:55.951028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-219be2f0-ccaa-4114-a670-bdd856a4b5a8 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:55.963231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-219be2f0-ccaa-4114-a670-bdd856a4b5a8 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:55.964443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-219be2f0-ccaa-4114-a670-bdd856a4b5a8 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:55.965031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-219be2f0-ccaa-4114-a670-bdd856a4b5a8 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:55.966547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-219be2f0-ccaa-4114-a670-bdd856a4b5a8 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:55.967273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-219be2f0-ccaa-4114-a670-bdd856a4b5a8 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:55.975261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-219be2f0-ccaa-4114-a670-bdd856a4b5a8 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:56.030813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ce148503-83e4-477c-bd45-d1e35fa03fb8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:56.033047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ce148503-83e4-477c-bd45-d1e35fa03fb8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:56.050772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ce148503-83e4-477c-bd45-d1e35fa03fb8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:56.051266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ce148503-83e4-477c-bd45-d1e35fa03fb8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:56.056684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ce148503-83e4-477c-bd45-d1e35fa03fb8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:56.059977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ce148503-83e4-477c-bd45-d1e35fa03fb8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:56.062139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ce148503-83e4-477c-bd45-d1e35fa03fb8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:56.062715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ce148503-83e4-477c-bd45-d1e35fa03fb8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:56.163044 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ce148503-83e4-477c-bd45-d1e35fa03fb8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136364 Oct 29 01:32:56.164250 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2972/5712] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:32:56 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:32:56.365863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-219be2f0-ccaa-4114-a670-bdd856a4b5a8 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:56.379379 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-219be2f0-ccaa-4114-a670-bdd856a4b5a8 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1505 microversion: 2.1 time: 0.434728 Oct 29 01:32:56.383846 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2741/5713] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:55 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1505 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:56.410891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7c5262f5-8d5f-4daa-9925-16323278d188 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:56.411685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7c5262f5-8d5f-4daa-9925-16323278d188 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:56.419269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c5262f5-8d5f-4daa-9925-16323278d188 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:56.420050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c5262f5-8d5f-4daa-9925-16323278d188 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:56.420683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c5262f5-8d5f-4daa-9925-16323278d188 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:56.421657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c5262f5-8d5f-4daa-9925-16323278d188 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:56.422408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c5262f5-8d5f-4daa-9925-16323278d188 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:56.423025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c5262f5-8d5f-4daa-9925-16323278d188 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:56.460517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7c5262f5-8d5f-4daa-9925-16323278d188 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:56.462104 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7c5262f5-8d5f-4daa-9925-16323278d188 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f/os-instance-actions/req-06448818-01df-4ce4-b42a-f939a5b64c1a" status: 200 len: 313 microversion: 2.1 time: 0.055506 Oct 29 01:32:56.472664 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2973/5714] 10.222.0.26 () {58 vars in 1419 bytes} [Sat Oct 29 01:32:56 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f/os-instance-actions/req-06448818-01df-4ce4-b42a-f939a5b64c1a => generated 313 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:56.478383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c6b89824-123b-4638-8719-300bc9c8f194 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:56.481534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c6b89824-123b-4638-8719-300bc9c8f194 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:56.496802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6b89824-123b-4638-8719-300bc9c8f194 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:56.497526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6b89824-123b-4638-8719-300bc9c8f194 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:56.498409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6b89824-123b-4638-8719-300bc9c8f194 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:56.499289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6b89824-123b-4638-8719-300bc9c8f194 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:56.502068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6b89824-123b-4638-8719-300bc9c8f194 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:56.502716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6b89824-123b-4638-8719-300bc9c8f194 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:56.814165 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c6b89824-123b-4638-8719-300bc9c8f194 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "POST /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f/action" status: 202 len: 0 microversion: 2.1 time: 0.340458 Oct 29 01:32:56.820403 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2742/5715] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:32:56 2022] POST /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:32:56.825598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a60f9db0-a530-4a1c-8c1b-64f3cc3821ef tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:56.826468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a60f9db0-a530-4a1c-8c1b-64f3cc3821ef tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:56.834789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a60f9db0-a530-4a1c-8c1b-64f3cc3821ef tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:56.851786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a60f9db0-a530-4a1c-8c1b-64f3cc3821ef tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:56.854780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a60f9db0-a530-4a1c-8c1b-64f3cc3821ef tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:56.855850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a60f9db0-a530-4a1c-8c1b-64f3cc3821ef tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:56.860798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a60f9db0-a530-4a1c-8c1b-64f3cc3821ef tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:56.863767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a60f9db0-a530-4a1c-8c1b-64f3cc3821ef tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:57.182343 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e6099437-1db9-4a5b-9e51-74ca90b964df tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:57.185975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e6099437-1db9-4a5b-9e51-74ca90b964df tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:57.202622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e6099437-1db9-4a5b-9e51-74ca90b964df tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:57.203503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e6099437-1db9-4a5b-9e51-74ca90b964df tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:57.205593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e6099437-1db9-4a5b-9e51-74ca90b964df tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:57.209080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e6099437-1db9-4a5b-9e51-74ca90b964df tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:57.223045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e6099437-1db9-4a5b-9e51-74ca90b964df tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:57.226177 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e6099437-1db9-4a5b-9e51-74ca90b964df tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:57.347797 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e6099437-1db9-4a5b-9e51-74ca90b964df tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173211 Oct 29 01:32:57.348383 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2743/5716] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:32:57 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:58.189086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a60f9db0-a530-4a1c-8c1b-64f3cc3821ef tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:58.200991 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a60f9db0-a530-4a1c-8c1b-64f3cc3821ef tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1507 microversion: 2.1 time: 1.380275 Oct 29 01:32:58.218592 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2974/5717] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:56 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1507 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:58.360843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8a834f00-b1f3-4ffb-a86f-f7ada9a988c8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:58.364479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8a834f00-b1f3-4ffb-a86f-f7ada9a988c8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:58.380118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a834f00-b1f3-4ffb-a86f-f7ada9a988c8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:58.381756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a834f00-b1f3-4ffb-a86f-f7ada9a988c8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:58.382527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a834f00-b1f3-4ffb-a86f-f7ada9a988c8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:58.390404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a834f00-b1f3-4ffb-a86f-f7ada9a988c8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:58.391194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a834f00-b1f3-4ffb-a86f-f7ada9a988c8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:58.391821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a834f00-b1f3-4ffb-a86f-f7ada9a988c8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:58.452012 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8a834f00-b1f3-4ffb-a86f-f7ada9a988c8 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095022 Oct 29 01:32:58.456797 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2744/5718] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:32:58 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:58.951248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d9d8e67a-28c4-436c-b2fe-914793dbead8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'create', calling method: .version_select at 0x7f9d96f88820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-218713555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDg+KVPzF+swthHhYAWKLwa0haEVmuhqI4ecTyfCRdUrgc+aoWRZadnYyOZzHXug8WE+RCB+y4nGQMRlE9lzOCFHHGewm01aG3znFrSpoV9PPkE0JGn4BjZmIq+IYD69g=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:58.987249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-d9d8e67a-28c4-436c-b2fe-914793dbead8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Getting quotas for project 2842ba05180046839fb5d064ad9132a1. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:32:58.996776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-d9d8e67a-28c4-436c-b2fe-914793dbead8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Getting quotas for user c70e2b34406c4e11afd9471a09d9cfef and project 2842ba05180046839fb5d064ad9132a1. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:32:59.142562 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d9d8e67a-28c4-436c-b2fe-914793dbead8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.520813 Oct 29 01:32:59.142562 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2975/5719] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:32:58 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:59.231710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e1eebed9-cad0-42ae-a050-f6dfe6d52004 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:59.233578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e1eebed9-cad0-42ae-a050-f6dfe6d52004 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:59.242366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=38 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:32:59.244279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1eebed9-cad0-42ae-a050-f6dfe6d52004 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:59.244972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1eebed9-cad0-42ae-a050-f6dfe6d52004 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:59.246939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1eebed9-cad0-42ae-a050-f6dfe6d52004 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:59.248797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1eebed9-cad0-42ae-a050-f6dfe6d52004 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:59.249809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1eebed9-cad0-42ae-a050-f6dfe6d52004 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:59.254953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1eebed9-cad0-42ae-a050-f6dfe6d52004 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:59.326978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:32:59.464800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2c046b3c-cfa0-46be-a1b7-0418ed4ec2b5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:59.467315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2c046b3c-cfa0-46be-a1b7-0418ed4ec2b5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:32:59.486348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c046b3c-cfa0-46be-a1b7-0418ed4ec2b5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:59.493973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c046b3c-cfa0-46be-a1b7-0418ed4ec2b5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:59.495666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c046b3c-cfa0-46be-a1b7-0418ed4ec2b5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:59.501808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c046b3c-cfa0-46be-a1b7-0418ed4ec2b5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:32:59.503449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c046b3c-cfa0-46be-a1b7-0418ed4ec2b5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:32:59.504835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2c046b3c-cfa0-46be-a1b7-0418ed4ec2b5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:32:59.619151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:32:59.633829 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2c046b3c-cfa0-46be-a1b7-0418ed4ec2b5 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173653 Oct 29 01:32:59.646322 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2976/5720] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:32:59 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:59.666841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e1eebed9-cad0-42ae-a050-f6dfe6d52004 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:59.676100 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e1eebed9-cad0-42ae-a050-f6dfe6d52004 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1507 microversion: 2.1 time: 0.452915 Oct 29 01:32:59.677690 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2745/5721] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:32:59 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1507 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:00.648222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-737ba8ca-7fea-4be2-aeaf-ae069e6a30bc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:00.650708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-737ba8ca-7fea-4be2-aeaf-ae069e6a30bc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:00.653756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:33:00.667573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-737ba8ca-7fea-4be2-aeaf-ae069e6a30bc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:00.668082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-737ba8ca-7fea-4be2-aeaf-ae069e6a30bc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:00.668531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-737ba8ca-7fea-4be2-aeaf-ae069e6a30bc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:00.669274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-737ba8ca-7fea-4be2-aeaf-ae069e6a30bc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:00.669738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-737ba8ca-7fea-4be2-aeaf-ae069e6a30bc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:00.670164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-737ba8ca-7fea-4be2-aeaf-ae069e6a30bc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:00.703298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1f0ba867-6e39-4476-ade6-1e9bcaa794f7 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:00.704011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1f0ba867-6e39-4476-ade6-1e9bcaa794f7 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:00.720737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f0ba867-6e39-4476-ade6-1e9bcaa794f7 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:00.721606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f0ba867-6e39-4476-ade6-1e9bcaa794f7 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:00.723409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f0ba867-6e39-4476-ade6-1e9bcaa794f7 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:00.726083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f0ba867-6e39-4476-ade6-1e9bcaa794f7 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:00.727311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f0ba867-6e39-4476-ade6-1e9bcaa794f7 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:00.731526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f0ba867-6e39-4476-ade6-1e9bcaa794f7 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:00.749312 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-737ba8ca-7fea-4be2-aeaf-ae069e6a30bc tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105232 Oct 29 01:33:00.754530 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2977/5722] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:33:00 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:33:01.122057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1f0ba867-6e39-4476-ade6-1e9bcaa794f7 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:01.137582 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1f0ba867-6e39-4476-ade6-1e9bcaa794f7 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1505 microversion: 2.1 time: 0.439418 Oct 29 01:33:01.154372 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2746/5723] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:00 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1505 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:33:01.176961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-22c643dd-2457-44e1-aae4-e1f57b77504a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '.version_select at 0x7f9d96fea1f0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:01.181739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-22c643dd-2457-44e1-aae4-e1f57b77504a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:01.194096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22c643dd-2457-44e1-aae4-e1f57b77504a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:01.194841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22c643dd-2457-44e1-aae4-e1f57b77504a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:01.195441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22c643dd-2457-44e1-aae4-e1f57b77504a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:01.196318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22c643dd-2457-44e1-aae4-e1f57b77504a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:01.196933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22c643dd-2457-44e1-aae4-e1f57b77504a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:01.201292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22c643dd-2457-44e1-aae4-e1f57b77504a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:01.261453 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-22c643dd-2457-44e1-aae4-e1f57b77504a tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.090882 Oct 29 01:33:01.264599 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2978/5724] 10.222.0.26 () {58 vars in 1296 bytes} [Sat Oct 29 01:33:01 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f/os-instance-actions => generated 611 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:33:01.282139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4695c2da-a3b9-45e0-bf9e-009de17c88d0 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:01.283857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4695c2da-a3b9-45e0-bf9e-009de17c88d0 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:01.294045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4695c2da-a3b9-45e0-bf9e-009de17c88d0 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:01.295399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4695c2da-a3b9-45e0-bf9e-009de17c88d0 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:01.296217 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4695c2da-a3b9-45e0-bf9e-009de17c88d0 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:01.310329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4695c2da-a3b9-45e0-bf9e-009de17c88d0 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:01.310329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4695c2da-a3b9-45e0-bf9e-009de17c88d0 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:01.310329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4695c2da-a3b9-45e0-bf9e-009de17c88d0 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:01.379848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4695c2da-a3b9-45e0-bf9e-009de17c88d0 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:33:01.795995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7f15c865-1d16-4f0d-a655-72153f0b4807 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:01.813907 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4695c2da-a3b9-45e0-bf9e-009de17c88d0 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "DELETE /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 204 len: 0 microversion: 2.1 time: 0.527682 Oct 29 01:33:01.823070 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2747/5725] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:33:01 2022] DELETE /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:33:01.827726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7f15c865-1d16-4f0d-a655-72153f0b4807 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:01.836390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-56993e7f-b0ca-471c-8431-c1eb43247f4c tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:01.837103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-56993e7f-b0ca-471c-8431-c1eb43247f4c tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:01.855761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f15c865-1d16-4f0d-a655-72153f0b4807 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:01.856527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f15c865-1d16-4f0d-a655-72153f0b4807 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:01.857708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f15c865-1d16-4f0d-a655-72153f0b4807 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:01.861182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f15c865-1d16-4f0d-a655-72153f0b4807 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:01.863717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f15c865-1d16-4f0d-a655-72153f0b4807 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:01.864622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56993e7f-b0ca-471c-8431-c1eb43247f4c tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:01.865693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56993e7f-b0ca-471c-8431-c1eb43247f4c tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:01.866355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56993e7f-b0ca-471c-8431-c1eb43247f4c tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:01.868478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f15c865-1d16-4f0d-a655-72153f0b4807 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:01.869774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56993e7f-b0ca-471c-8431-c1eb43247f4c tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:01.870309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56993e7f-b0ca-471c-8431-c1eb43247f4c tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:01.871128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56993e7f-b0ca-471c-8431-c1eb43247f4c tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:01.966259 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7f15c865-1d16-4f0d-a655-72153f0b4807 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.207182 Oct 29 01:33:01.971261 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2979/5726] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:33:01 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f/os-volume_attachments => generated 25 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:33:02.107481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-54281405-0ba7-4f37-93b6-b78a898c67a4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:02.108041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-54281405-0ba7-4f37-93b6-b78a898c67a4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:02.118880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54281405-0ba7-4f37-93b6-b78a898c67a4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:02.119393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54281405-0ba7-4f37-93b6-b78a898c67a4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:02.119846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54281405-0ba7-4f37-93b6-b78a898c67a4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:02.125385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54281405-0ba7-4f37-93b6-b78a898c67a4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:02.127766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54281405-0ba7-4f37-93b6-b78a898c67a4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:02.128396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54281405-0ba7-4f37-93b6-b78a898c67a4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:02.195126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-54281405-0ba7-4f37-93b6-b78a898c67a4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:33:02.298560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-56993e7f-b0ca-471c-8431-c1eb43247f4c tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:02.325466 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-56993e7f-b0ca-471c-8431-c1eb43247f4c tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1511 microversion: 2.1 time: 0.500023 Oct 29 01:33:02.342633 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2748/5727] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:01 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1511 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:33:02.752668 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-54281405-0ba7-4f37-93b6-b78a898c67a4 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "DELETE /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 204 len: 0 microversion: 2.1 time: 0.648111 Oct 29 01:33:02.757392 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2980/5728] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:33:02 2022] DELETE /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:33:02.771203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2616b571-8090-477d-af25-7a7772d9a560 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:02.772100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2616b571-8090-477d-af25-7a7772d9a560 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:02.785700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2616b571-8090-477d-af25-7a7772d9a560 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:02.788395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2616b571-8090-477d-af25-7a7772d9a560 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:02.789130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2616b571-8090-477d-af25-7a7772d9a560 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:02.790288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2616b571-8090-477d-af25-7a7772d9a560 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:02.790994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2616b571-8090-477d-af25-7a7772d9a560 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:02.791701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2616b571-8090-477d-af25-7a7772d9a560 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:03.024544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2616b571-8090-477d-af25-7a7772d9a560 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:03.042276 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2616b571-8090-477d-af25-7a7772d9a560 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 200 len: 1680 microversion: 2.1 time: 0.275332 Oct 29 01:33:03.042877 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2749/5729] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:02 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 1680 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:03.358853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7e47215e-66bc-4066-a892-c0ea53f7771b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:03.359552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7e47215e-66bc-4066-a892-c0ea53f7771b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:03.367020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e47215e-66bc-4066-a892-c0ea53f7771b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:03.367563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e47215e-66bc-4066-a892-c0ea53f7771b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:03.368011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e47215e-66bc-4066-a892-c0ea53f7771b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:03.368722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e47215e-66bc-4066-a892-c0ea53f7771b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:03.369263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e47215e-66bc-4066-a892-c0ea53f7771b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:03.369700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e47215e-66bc-4066-a892-c0ea53f7771b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:03.935896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7e47215e-66bc-4066-a892-c0ea53f7771b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:03.955263 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7e47215e-66bc-4066-a892-c0ea53f7771b tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1511 microversion: 2.1 time: 0.601639 Oct 29 01:33:03.956656 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2981/5730] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:03 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1511 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:04.071711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a6832356-ebe4-44f8-8e8e-2e9003eb6a4c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:04.075235 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a6832356-ebe4-44f8-8e8e-2e9003eb6a4c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:04.100662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6832356-ebe4-44f8-8e8e-2e9003eb6a4c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:04.101864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6832356-ebe4-44f8-8e8e-2e9003eb6a4c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:04.102080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6832356-ebe4-44f8-8e8e-2e9003eb6a4c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:04.103059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6832356-ebe4-44f8-8e8e-2e9003eb6a4c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:04.103521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6832356-ebe4-44f8-8e8e-2e9003eb6a4c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:04.103951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6832356-ebe4-44f8-8e8e-2e9003eb6a4c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:04.544104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a6832356-ebe4-44f8-8e8e-2e9003eb6a4c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:04.563154 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a6832356-ebe4-44f8-8e8e-2e9003eb6a4c tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 200 len: 1680 microversion: 2.1 time: 0.497356 Oct 29 01:33:04.577523 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2750/5731] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:04 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 1680 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:04.988884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-11472b21-77ed-44d2-a750-b041b6274e1e tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:04.989632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-11472b21-77ed-44d2-a750-b041b6274e1e tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:05.020433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11472b21-77ed-44d2-a750-b041b6274e1e tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:05.021958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11472b21-77ed-44d2-a750-b041b6274e1e tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:05.022646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11472b21-77ed-44d2-a750-b041b6274e1e tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:05.026996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11472b21-77ed-44d2-a750-b041b6274e1e tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:05.028935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11472b21-77ed-44d2-a750-b041b6274e1e tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:05.029677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11472b21-77ed-44d2-a750-b041b6274e1e tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:05.602813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b512160a-978e-4077-8522-e76d7f99d002 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:05.604643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b512160a-978e-4077-8522-e76d7f99d002 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:05.631233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b512160a-978e-4077-8522-e76d7f99d002 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:05.644384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b512160a-978e-4077-8522-e76d7f99d002 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:05.645373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b512160a-978e-4077-8522-e76d7f99d002 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:05.646714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b512160a-978e-4077-8522-e76d7f99d002 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:05.648442 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b512160a-978e-4077-8522-e76d7f99d002 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:05.649414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b512160a-978e-4077-8522-e76d7f99d002 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:05.873510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-11472b21-77ed-44d2-a750-b041b6274e1e tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:05.888800 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-11472b21-77ed-44d2-a750-b041b6274e1e tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1469 microversion: 2.1 time: 0.907366 Oct 29 01:33:05.903222 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2982/5732] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:04 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1469 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:05.987023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-13aaef14-e628-4248-a15d-0d013603c2d5 req-daaa07d1-3266-42e9-ada4-602afe916bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f3c16a-e6fb-4f35-a590-52e0d0fba57f", "name": "network-vif-deleted", "tag": "fdb51cf1-a289-46ca-9745-c6b7c4001446"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:05.999406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-13aaef14-e628-4248-a15d-0d013603c2d5 req-daaa07d1-3266-42e9-ada4-602afe916bb0 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:06.000156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-13aaef14-e628-4248-a15d-0d013603c2d5 req-daaa07d1-3266-42e9-ada4-602afe916bb0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:06.000315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-13aaef14-e628-4248-a15d-0d013603c2d5 req-daaa07d1-3266-42e9-ada4-602afe916bb0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:06.013696 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-13aaef14-e628-4248-a15d-0d013603c2d5 req-daaa07d1-3266-42e9-ada4-602afe916bb0 service nova] Creating event network-vif-deleted:fdb51cf1-a289-46ca-9745-c6b7c4001446 for instance 95f3c16a-e6fb-4f35-a590-52e0d0fba57f on n-h1-862964-3 Oct 29 01:33:06.019766 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-13aaef14-e628-4248-a15d-0d013603c2d5 req-daaa07d1-3266-42e9-ada4-602afe916bb0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037847 Oct 29 01:33:06.022884 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2983/5733] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:33:06.194108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b512160a-978e-4077-8522-e76d7f99d002 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:06.203330 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b512160a-978e-4077-8522-e76d7f99d002 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 200 len: 1680 microversion: 2.1 time: 0.607480 Oct 29 01:33:06.213707 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2751/5734] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:05 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 1680 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:33:06.898219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-f25767cc-c84d-44f9-beba-311b3d12b3ad req-1336acf4-3c6c-4eed-b20e-b5aca1ca81c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94e7890d-907a-4ed3-9bab-73c679fe5e6f", "name": "network-vif-deleted", "tag": "91a6b00a-75da-45ae-9f7a-13274873357a"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:06.918853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d618c9c-47d0-4a95-b26d-5f3bcc3c7cf6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:06.920247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7d618c9c-47d0-4a95-b26d-5f3bcc3c7cf6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:06.940658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f25767cc-c84d-44f9-beba-311b3d12b3ad req-1336acf4-3c6c-4eed-b20e-b5aca1ca81c1 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:06.941132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f25767cc-c84d-44f9-beba-311b3d12b3ad req-1336acf4-3c6c-4eed-b20e-b5aca1ca81c1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:06.941609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f25767cc-c84d-44f9-beba-311b3d12b3ad req-1336acf4-3c6c-4eed-b20e-b5aca1ca81c1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:06.949199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d618c9c-47d0-4a95-b26d-5f3bcc3c7cf6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:06.949714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d618c9c-47d0-4a95-b26d-5f3bcc3c7cf6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:06.950155 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d618c9c-47d0-4a95-b26d-5f3bcc3c7cf6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:06.950871 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d618c9c-47d0-4a95-b26d-5f3bcc3c7cf6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:06.951331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d618c9c-47d0-4a95-b26d-5f3bcc3c7cf6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:06.956398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d618c9c-47d0-4a95-b26d-5f3bcc3c7cf6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:06.961854 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-f25767cc-c84d-44f9-beba-311b3d12b3ad req-1336acf4-3c6c-4eed-b20e-b5aca1ca81c1 service nova] Creating event network-vif-deleted:91a6b00a-75da-45ae-9f7a-13274873357a for instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f on n-h2-862964-3 Oct 29 01:33:06.970495 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-f25767cc-c84d-44f9-beba-311b3d12b3ad req-1336acf4-3c6c-4eed-b20e-b5aca1ca81c1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076771 Oct 29 01:33:06.971288 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2984/5735] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:33:07.038351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d618c9c-47d0-4a95-b26d-5f3bcc3c7cf6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:07.039308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d618c9c-47d0-4a95-b26d-5f3bcc3c7cf6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:07.039931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d618c9c-47d0-4a95-b26d-5f3bcc3c7cf6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:07.040484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-7d618c9c-47d0-4a95-b26d-5f3bcc3c7cf6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lazy-loading 'fault' on Instance uuid 95f3c16a-e6fb-4f35-a590-52e0d0fba57f {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:33:07.089659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7d618c9c-47d0-4a95-b26d-5f3bcc3c7cf6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:07.097644 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7d618c9c-47d0-4a95-b26d-5f3bcc3c7cf6 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1306 microversion: 2.1 time: 0.183183 Oct 29 01:33:07.098226 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2752/5736] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:06 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1306 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:07.228765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a0ac2120-4d97-431c-b2a4-5f2f78a42e31 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:07.232201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a0ac2120-4d97-431c-b2a4-5f2f78a42e31 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:07.240266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0ac2120-4d97-431c-b2a4-5f2f78a42e31 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:07.241228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0ac2120-4d97-431c-b2a4-5f2f78a42e31 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:07.241814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0ac2120-4d97-431c-b2a4-5f2f78a42e31 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:07.242539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0ac2120-4d97-431c-b2a4-5f2f78a42e31 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:07.243001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0ac2120-4d97-431c-b2a4-5f2f78a42e31 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:07.243430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0ac2120-4d97-431c-b2a4-5f2f78a42e31 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:07.454733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a0ac2120-4d97-431c-b2a4-5f2f78a42e31 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:07.470295 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a0ac2120-4d97-431c-b2a4-5f2f78a42e31 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 200 len: 1612 microversion: 2.1 time: 0.245862 Oct 29 01:33:07.487139 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2985/5737] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:07 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 1612 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:08.121820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-98bf665d-4481-48c6-ba18-9f2298a31f57 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:08.122445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-98bf665d-4481-48c6-ba18-9f2298a31f57 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:08.138691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98bf665d-4481-48c6-ba18-9f2298a31f57 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:08.139508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98bf665d-4481-48c6-ba18-9f2298a31f57 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:08.140122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98bf665d-4481-48c6-ba18-9f2298a31f57 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:08.141307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98bf665d-4481-48c6-ba18-9f2298a31f57 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:08.143539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98bf665d-4481-48c6-ba18-9f2298a31f57 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:08.144218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98bf665d-4481-48c6-ba18-9f2298a31f57 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:08.249471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98bf665d-4481-48c6-ba18-9f2298a31f57 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:08.249471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98bf665d-4481-48c6-ba18-9f2298a31f57 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:08.251271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98bf665d-4481-48c6-ba18-9f2298a31f57 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:08.252677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-98bf665d-4481-48c6-ba18-9f2298a31f57 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lazy-loading 'fault' on Instance uuid 95f3c16a-e6fb-4f35-a590-52e0d0fba57f {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:33:08.334058 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-98bf665d-4481-48c6-ba18-9f2298a31f57 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472c6488c03a402ab57ab2798d869def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faa675b6860490fa5521d319bee1e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:08.343917 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-98bf665d-4481-48c6-ba18-9f2298a31f57 tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 200 len: 1306 microversion: 2.1 time: 0.225395 Oct 29 01:33:08.345593 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2753/5738] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:08 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 1306 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:08.497046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-36d22c0f-a0ba-41a5-94c2-2ba74aa2431f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:08.497860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-36d22c0f-a0ba-41a5-94c2-2ba74aa2431f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:08.517556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36d22c0f-a0ba-41a5-94c2-2ba74aa2431f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:08.521385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36d22c0f-a0ba-41a5-94c2-2ba74aa2431f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:08.524361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36d22c0f-a0ba-41a5-94c2-2ba74aa2431f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:08.526990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36d22c0f-a0ba-41a5-94c2-2ba74aa2431f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:08.529145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36d22c0f-a0ba-41a5-94c2-2ba74aa2431f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:08.530013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36d22c0f-a0ba-41a5-94c2-2ba74aa2431f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:08.631895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36d22c0f-a0ba-41a5-94c2-2ba74aa2431f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:08.635012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36d22c0f-a0ba-41a5-94c2-2ba74aa2431f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:08.636520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36d22c0f-a0ba-41a5-94c2-2ba74aa2431f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:08.638218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-36d22c0f-a0ba-41a5-94c2-2ba74aa2431f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lazy-loading 'fault' on Instance uuid 94e7890d-907a-4ed3-9bab-73c679fe5e6f {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:33:08.707093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-36d22c0f-a0ba-41a5-94c2-2ba74aa2431f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444e13f1f2d945dfb31b83d8e19c2032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad278c0b0b9a41beae8b29986e315743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:08.718358 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-36d22c0f-a0ba-41a5-94c2-2ba74aa2431f tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 200 len: 1331 microversion: 2.1 time: 0.226775 Oct 29 01:33:08.735256 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2986/5739] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:08 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 1331 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:09.376073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4308b534-0db3-47ab-9af3-4930cc74c4ff tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:09.384600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4308b534-0db3-47ab-9af3-4930cc74c4ff tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] [instance: 95f3c16a-e6fb-4f35-a590-52e0d0fba57f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:09.404852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4308b534-0db3-47ab-9af3-4930cc74c4ff tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:09.409128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4308b534-0db3-47ab-9af3-4930cc74c4ff tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:09.411371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4308b534-0db3-47ab-9af3-4930cc74c4ff tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:09.416975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4308b534-0db3-47ab-9af3-4930cc74c4ff tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:09.417721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4308b534-0db3-47ab-9af3-4930cc74c4ff tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:09.418369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4308b534-0db3-47ab-9af3-4930cc74c4ff tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:09.501065 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-4308b534-0db3-47ab-9af3-4930cc74c4ff tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] HTTP exception thrown: Instance 95f3c16a-e6fb-4f35-a590-52e0d0fba57f could not be found. Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4308b534-0db3-47ab-9af3-4930cc74c4ff tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Request method failure captured: Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f HTTP/1.1 Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIKtiUhuR2dXot6EsmXUseqyVvFQXOn8Y7duxsbOhq_h2sfGbQEHCYv9146dk3ipl1rp4zzQFp-xLFg47UYgJPUUU5-avVlpGZ9-gmKU-1PX5h71LEBL60MF_Bo1WTc9LwACRNqU6RiVXGBLBeLRU_Jqk-pHrdkUeSp7cr14WEGkQWU Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 2faa675b6860490fa5521d319bee1e42 Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-InstanceActionsTestJSON-6619310 Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2faa675b6860490fa5521d319bee1e42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2faa675b6860490fa5521d319bee1e42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2faa675b6860490fa5521d319bee1e42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2faa675b6860490fa5521d319bee1e42", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-InstanceActionsTestJSON-6619310 Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 2faa675b6860490fa5521d319bee1e42 Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-InstanceActionsTestJSON-6619310 Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-InstanceActionsTestJSON-6619310-project Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 472c6488c03a402ab57ab2798d869def Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-InstanceActionsTestJSON-6619310-project Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 95f3c16a-e6fb-4f35-a590-52e0d0fba57f could not be found. Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '95f3c16a-e6fb-4f35-a590-52e0d0fba57f'} Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95f3c16a-e6fb-4f35-a590-52e0d0fba57f could not be found. Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95f3c16a-e6fb-4f35-a590-52e0d0fba57f could not be found. Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:09.514205 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:09.519855 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:09.519855 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:09.519855 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:09.519855 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:33:09.519855 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:33:09.519855 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95f3c16a-e6fb-4f35-a590-52e0d0fba57f could not be found. Oct 29 01:33:09.519855 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:09.525982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4308b534-0db3-47ab-9af3-4930cc74c4ff tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] Returning 404 to user: Instance 95f3c16a-e6fb-4f35-a590-52e0d0fba57f could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:33:09.527531 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4308b534-0db3-47ab-9af3-4930cc74c4ff tempest-InstanceActionsTestJSON-6619310 tempest-InstanceActionsTestJSON-6619310-project] 10.222.0.26 "GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f" status: 404 len: 111 microversion: 2.1 time: 0.161414 Oct 29 01:33:09.530417 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2754/5740] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:09 2022] GET /compute/v2.1/servers/95f3c16a-e6fb-4f35-a590-52e0d0fba57f => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:33:09.744874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e6b759b2-3a88-404e-9c58-f965570d244a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:09.746085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e6b759b2-3a88-404e-9c58-f965570d244a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:09.748360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:33:09.761330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6b759b2-3a88-404e-9c58-f965570d244a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:09.767600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6b759b2-3a88-404e-9c58-f965570d244a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:09.768956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6b759b2-3a88-404e-9c58-f965570d244a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:09.769863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6b759b2-3a88-404e-9c58-f965570d244a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:09.772264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6b759b2-3a88-404e-9c58-f965570d244a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:09.775279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6b759b2-3a88-404e-9c58-f965570d244a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:09.809248 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-e6b759b2-3a88-404e-9c58-f965570d244a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] HTTP exception thrown: Instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f could not be found. Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e6b759b2-3a88-404e-9c58-f965570d244a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Request method failure captured: Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f HTTP/1.1 Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXICkjStyzUNQCP56iyabn5ahlWbK9bq57JWpf6w_r5-2BC1n9lfKn4n-q7ViwDGqwiAHQbWPA068CNGAzX2vWzwGSgwtRiu5lH8sKE1aT3VNdBS9vlw817eOLttRxo_xXGlmclE5Xf7yAYwC5hE1QU1PdlNbXv8l2Qz8VlCemFm6YRM Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad278c0b0b9a41beae8b29986e315743", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 444e13f1f2d945dfb31b83d8e19c2032 Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f could not be found. Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '94e7890d-907a-4ed3-9bab-73c679fe5e6f'} Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f could not be found. Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f could not be found. Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:09.812911 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:09.817729 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:09.817729 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:09.817729 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:09.817729 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:33:09.817729 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:33:09.817729 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f could not be found. Oct 29 01:33:09.817729 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:09.819070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e6b759b2-3a88-404e-9c58-f965570d244a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Returning 404 to user: Instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:33:09.821612 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e6b759b2-3a88-404e-9c58-f965570d244a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 404 len: 111 microversion: 2.1 time: 0.081480 Oct 29 01:33:09.835587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8ca19ce0-d0c3-4809-a04c-ed16d631ffa9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '.version_select at 0x7f9d9fefa280>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:09.839499 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2987/5741] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:09 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:33:10.010673 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8ca19ce0-d0c3-4809-a04c-ed16d631ffa9 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-730506144" status: 202 len: 0 microversion: 2.1 time: 0.180629 Oct 29 01:33:10.012537 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2755/5742] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 29 01:33:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-730506144 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:33:14.169788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c8cabc4e-65f1-40f1-8b9c-475298aeb894 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:14.170336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c8cabc4e-65f1-40f1-8b9c-475298aeb894 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:14.198261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8cabc4e-65f1-40f1-8b9c-475298aeb894 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:14.199062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8cabc4e-65f1-40f1-8b9c-475298aeb894 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:14.200754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8cabc4e-65f1-40f1-8b9c-475298aeb894 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:14.203149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8cabc4e-65f1-40f1-8b9c-475298aeb894 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:14.203782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8cabc4e-65f1-40f1-8b9c-475298aeb894 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:14.204369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8cabc4e-65f1-40f1-8b9c-475298aeb894 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:14.315558 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c8cabc4e-65f1-40f1-8b9c-475298aeb894 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/ips" status: 200 len: 152 microversion: 2.20 time: 0.149594 Oct 29 01:33:14.329260 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2988/5743] 10.222.0.26 () {60 vars in 1289 bytes} [Sat Oct 29 01:33:14 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/ips => generated 152 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:33:19.120699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7afd75bb-c43e-41cd-bc8d-133b0c971ee1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:19.122004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7afd75bb-c43e-41cd-bc8d-133b0c971ee1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:19.139578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7afd75bb-c43e-41cd-bc8d-133b0c971ee1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:19.140567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7afd75bb-c43e-41cd-bc8d-133b0c971ee1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:19.141227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7afd75bb-c43e-41cd-bc8d-133b0c971ee1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:19.143234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7afd75bb-c43e-41cd-bc8d-133b0c971ee1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:19.146500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7afd75bb-c43e-41cd-bc8d-133b0c971ee1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:19.147289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7afd75bb-c43e-41cd-bc8d-133b0c971ee1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:19.198735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-7afd75bb-c43e-41cd-bc8d-133b0c971ee1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lazy-loading 'flavor' on Instance uuid db08ce62-9806-4b5e-90e6-ca4fe64a2885 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:33:19.968904 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7afd75bb-c43e-41cd-bc8d-133b0c971ee1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "POST /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/action" status: 202 len: 0 microversion: 2.20 time: 0.852378 Oct 29 01:33:19.974927 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2756/5744] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 29 01:33:19 2022] POST /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/action => generated 0 bytes in 859 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:33:19.983117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c0f613d4-9db1-4f89-8aa6-82cfb890625e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:19.983740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c0f613d4-9db1-4f89-8aa6-82cfb890625e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:19.996416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0f613d4-9db1-4f89-8aa6-82cfb890625e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:19.999195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0f613d4-9db1-4f89-8aa6-82cfb890625e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:20.000892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0f613d4-9db1-4f89-8aa6-82cfb890625e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:20.003820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0f613d4-9db1-4f89-8aa6-82cfb890625e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:20.003820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0f613d4-9db1-4f89-8aa6-82cfb890625e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:20.003820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0f613d4-9db1-4f89-8aa6-82cfb890625e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:20.365147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c0f613d4-9db1-4f89-8aa6-82cfb890625e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:20.382264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c0f613d4-9db1-4f89-8aa6-82cfb890625e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:20.390741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c0f613d4-9db1-4f89-8aa6-82cfb890625e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:20.395605 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c0f613d4-9db1-4f89-8aa6-82cfb890625e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1723 microversion: 2.20 time: 0.416501 Oct 29 01:33:20.418050 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2989/5745] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:19 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1723 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:33:21.100111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2b037a17-c7fc-484e-9e23-3b432a917161 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:21.101793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2b037a17-c7fc-484e-9e23-3b432a917161 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:21.116938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b037a17-c7fc-484e-9e23-3b432a917161 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:21.117792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b037a17-c7fc-484e-9e23-3b432a917161 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:21.118458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b037a17-c7fc-484e-9e23-3b432a917161 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:21.122211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b037a17-c7fc-484e-9e23-3b432a917161 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:21.122895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b037a17-c7fc-484e-9e23-3b432a917161 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:21.124079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b037a17-c7fc-484e-9e23-3b432a917161 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:21.162947 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-2b037a17-c7fc-484e-9e23-3b432a917161 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] HTTP exception thrown: Instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f could not be found. Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2b037a17-c7fc-484e-9e23-3b432a917161 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Request method failure captured: Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f HTTP/1.1 Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXICkjStyzUNQCP56iyabn5ahlWbK9bq57JWpf6w_r5-2BC1n9lfKn4n-q7ViwDGqwiAHQbWPA068CNGAzX2vWzwGSgwtRiu5lH8sKE1aT3VNdBS9vlw817eOLttRxo_xXGlmclE5Xf7yAYwC5hE1QU1PdlNbXv8l2Qz8VlCemFm6YRM Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad278c0b0b9a41beae8b29986e315743", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 444e13f1f2d945dfb31b83d8e19c2032 Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f could not be found. Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '94e7890d-907a-4ed3-9bab-73c679fe5e6f'} Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f could not be found. Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:33:21.168964 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:33:21.173721 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f could not be found. Oct 29 01:33:21.173721 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:21.173721 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:21.173721 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:21.173721 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:21.173721 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:21.173721 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:21.173721 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:33:21.173721 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:33:21.173721 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f could not be found. Oct 29 01:33:21.173721 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:21.177096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2b037a17-c7fc-484e-9e23-3b432a917161 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Returning 404 to user: Instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:33:21.178290 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2b037a17-c7fc-484e-9e23-3b432a917161 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "DELETE /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 404 len: 111 microversion: 2.1 time: 0.083328 Oct 29 01:33:21.181692 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2757/5746] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:33:21 2022] DELETE /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:33:21.188166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a0cfc84b-53cb-4360-87b7-bd5e880b591a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:21.189493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a0cfc84b-53cb-4360-87b7-bd5e880b591a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 94e7890d-907a-4ed3-9bab-73c679fe5e6f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:21.209958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0cfc84b-53cb-4360-87b7-bd5e880b591a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:21.215698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0cfc84b-53cb-4360-87b7-bd5e880b591a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:21.221018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0cfc84b-53cb-4360-87b7-bd5e880b591a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:21.221018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0cfc84b-53cb-4360-87b7-bd5e880b591a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:21.221018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0cfc84b-53cb-4360-87b7-bd5e880b591a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:21.221018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0cfc84b-53cb-4360-87b7-bd5e880b591a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:21.265769 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-a0cfc84b-53cb-4360-87b7-bd5e880b591a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] HTTP exception thrown: Instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f could not be found. Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a0cfc84b-53cb-4360-87b7-bd5e880b591a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Request method failure captured: Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f HTTP/1.1 Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXICkjStyzUNQCP56iyabn5ahlWbK9bq57JWpf6w_r5-2BC1n9lfKn4n-q7ViwDGqwiAHQbWPA068CNGAzX2vWzwGSgwtRiu5lH8sKE1aT3VNdBS9vlw817eOLttRxo_xXGlmclE5Xf7yAYwC5hE1QU1PdlNbXv8l2Qz8VlCemFm6YRM Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad278c0b0b9a41beae8b29986e315743", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 444e13f1f2d945dfb31b83d8e19c2032 Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f could not be found. Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '94e7890d-907a-4ed3-9bab-73c679fe5e6f'} Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f could not be found. Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f could not be found. Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:21.267623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:21.274548 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:21.274548 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:21.274548 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:21.274548 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:33:21.274548 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:33:21.274548 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f could not be found. Oct 29 01:33:21.274548 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:21.274548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a0cfc84b-53cb-4360-87b7-bd5e880b591a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Returning 404 to user: Instance 94e7890d-907a-4ed3-9bab-73c679fe5e6f could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:33:21.274548 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a0cfc84b-53cb-4360-87b7-bd5e880b591a tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f" status: 404 len: 111 microversion: 2.1 time: 0.089237 Oct 29 01:33:21.275464 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2990/5747] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:21 2022] GET /compute/v2.1/servers/94e7890d-907a-4ed3-9bab-73c679fe5e6f => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:33:21.435556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-40486d31-124e-4f11-9287-ba17c6f4d34b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:21.438969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-40486d31-124e-4f11-9287-ba17c6f4d34b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:21.450970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40486d31-124e-4f11-9287-ba17c6f4d34b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:21.451761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40486d31-124e-4f11-9287-ba17c6f4d34b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:21.453225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40486d31-124e-4f11-9287-ba17c6f4d34b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:21.455583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40486d31-124e-4f11-9287-ba17c6f4d34b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:21.457581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40486d31-124e-4f11-9287-ba17c6f4d34b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:21.458404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40486d31-124e-4f11-9287-ba17c6f4d34b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:21.744767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-40486d31-124e-4f11-9287-ba17c6f4d34b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:21.758723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-40486d31-124e-4f11-9287-ba17c6f4d34b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:21.760229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-40486d31-124e-4f11-9287-ba17c6f4d34b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:21.768990 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-40486d31-124e-4f11-9287-ba17c6f4d34b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1723 microversion: 2.20 time: 0.337667 Oct 29 01:33:21.769829 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2758/5748] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:21 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1723 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:33:22.812586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f90e5852-2d10-40e2-9de0-ebfe9db64367 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:22.814679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f90e5852-2d10-40e2-9de0-ebfe9db64367 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:22.829061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f90e5852-2d10-40e2-9de0-ebfe9db64367 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:22.834232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f90e5852-2d10-40e2-9de0-ebfe9db64367 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:22.835053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f90e5852-2d10-40e2-9de0-ebfe9db64367 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:22.836204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f90e5852-2d10-40e2-9de0-ebfe9db64367 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:22.836894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f90e5852-2d10-40e2-9de0-ebfe9db64367 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:22.837590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f90e5852-2d10-40e2-9de0-ebfe9db64367 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:23.547808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f90e5852-2d10-40e2-9de0-ebfe9db64367 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:23.558096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f90e5852-2d10-40e2-9de0-ebfe9db64367 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:23.559559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f90e5852-2d10-40e2-9de0-ebfe9db64367 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:23.560813 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f90e5852-2d10-40e2-9de0-ebfe9db64367 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1723 microversion: 2.20 time: 0.752370 Oct 29 01:33:23.577181 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2991/5749] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:22 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1723 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:33:24.593514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fd14847b-a0cd-4c79-8fae-92faa5378da5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:24.599513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fd14847b-a0cd-4c79-8fae-92faa5378da5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:24.634025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd14847b-a0cd-4c79-8fae-92faa5378da5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:24.634025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd14847b-a0cd-4c79-8fae-92faa5378da5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:24.634025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd14847b-a0cd-4c79-8fae-92faa5378da5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:24.634025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd14847b-a0cd-4c79-8fae-92faa5378da5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:24.634025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd14847b-a0cd-4c79-8fae-92faa5378da5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:24.634025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd14847b-a0cd-4c79-8fae-92faa5378da5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:25.375785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d20d729a-3afe-475e-9158-239304317f70 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-614305747", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "0d0ee331-0cea-461b-ba0d-f89673b36027"}], "key_name": "tempest-TestNetworkAdvancedServerOps-218713555", "security_groups": [{"name": "tempest-secgroup-smoke-699690832"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:25.515888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fd14847b-a0cd-4c79-8fae-92faa5378da5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:25.518449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:33:25.557058 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fd14847b-a0cd-4c79-8fae-92faa5378da5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:25.564764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fd14847b-a0cd-4c79-8fae-92faa5378da5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:25.568387 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fd14847b-a0cd-4c79-8fae-92faa5378da5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1723 microversion: 2.20 time: 0.980611 Oct 29 01:33:25.569990 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2759/5750] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:24 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1723 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:33:26.039695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-d20d729a-3afe-475e-9158-239304317f70 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] validate_networks() for [('0d0ee331-0cea-461b-ba0d-f89673b36027', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:33:26.600499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a6053c9d-5d76-428c-b203-3e14fe7eacfb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:26.601129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a6053c9d-5d76-428c-b203-3e14fe7eacfb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:26.618760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6053c9d-5d76-428c-b203-3e14fe7eacfb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:26.621771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6053c9d-5d76-428c-b203-3e14fe7eacfb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:26.624133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6053c9d-5d76-428c-b203-3e14fe7eacfb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:26.626142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6053c9d-5d76-428c-b203-3e14fe7eacfb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:26.631366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6053c9d-5d76-428c-b203-3e14fe7eacfb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:26.632348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6053c9d-5d76-428c-b203-3e14fe7eacfb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:27.975923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a6053c9d-5d76-428c-b203-3e14fe7eacfb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:27.991289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a6053c9d-5d76-428c-b203-3e14fe7eacfb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:27.993125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a6053c9d-5d76-428c-b203-3e14fe7eacfb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:28.007372 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a6053c9d-5d76-428c-b203-3e14fe7eacfb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1723 microversion: 2.20 time: 1.412305 Oct 29 01:33:28.008529 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2760/5751] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:26 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1723 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:33:28.839218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-d20d729a-3afe-475e-9158-239304317f70 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:33:28.840426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-d20d729a-3afe-475e-9158-239304317f70 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:33:28.841318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-d20d729a-3afe-475e-9158-239304317f70 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:33:28.841914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-d20d729a-3afe-475e-9158-239304317f70 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:33:28.842511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-d20d729a-3afe-475e-9158-239304317f70 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:33:28.859159 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d20d729a-3afe-475e-9158-239304317f70 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:28.859944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d20d729a-3afe-475e-9158-239304317f70 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:28.862893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d20d729a-3afe-475e-9158-239304317f70 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:28.881965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d20d729a-3afe-475e-9158-239304317f70 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:28.882890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d20d729a-3afe-475e-9158-239304317f70 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:28.889388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d20d729a-3afe-475e-9158-239304317f70 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:28.952681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-d20d729a-3afe-475e-9158-239304317f70 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Getting quotas for project 2842ba05180046839fb5d064ad9132a1. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:33:28.967087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-d20d729a-3afe-475e-9158-239304317f70 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Getting quotas for user c70e2b34406c4e11afd9471a09d9cfef and project 2842ba05180046839fb5d064ad9132a1. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:33:28.987093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d20d729a-3afe-475e-9158-239304317f70 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:33:28.991297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d20d729a-3afe-475e-9158-239304317f70 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:33:29.033560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-35a9b4ad-bc0e-4e59-b0a1-cc838dc24af7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:29.034797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-35a9b4ad-bc0e-4e59-b0a1-cc838dc24af7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:29.046727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35a9b4ad-bc0e-4e59-b0a1-cc838dc24af7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:29.047377 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35a9b4ad-bc0e-4e59-b0a1-cc838dc24af7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:29.049714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35a9b4ad-bc0e-4e59-b0a1-cc838dc24af7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:29.050967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35a9b4ad-bc0e-4e59-b0a1-cc838dc24af7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:29.057848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35a9b4ad-bc0e-4e59-b0a1-cc838dc24af7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:29.059336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35a9b4ad-bc0e-4e59-b0a1-cc838dc24af7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:29.281388 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d20d729a-3afe-475e-9158-239304317f70 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.910721 Oct 29 01:33:29.283612 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2992/5752] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:33:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 3914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:33:29.319881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-76543f40-1cbd-4c5f-a7b2-6ff735bbb40d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:29.322442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-76543f40-1cbd-4c5f-a7b2-6ff735bbb40d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:29.488543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-35a9b4ad-bc0e-4e59-b0a1-cc838dc24af7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:29.506875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-35a9b4ad-bc0e-4e59-b0a1-cc838dc24af7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:29.520206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-35a9b4ad-bc0e-4e59-b0a1-cc838dc24af7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:29.522588 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-35a9b4ad-bc0e-4e59-b0a1-cc838dc24af7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1723 microversion: 2.20 time: 0.492890 Oct 29 01:33:29.528710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-76543f40-1cbd-4c5f-a7b2-6ff735bbb40d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:29.542015 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2761/5753] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:29 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1723 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:33:29.569542 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-76543f40-1cbd-4c5f-a7b2-6ff735bbb40d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1265 microversion: 2.1 time: 0.254154 Oct 29 01:33:29.569542 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2993/5754] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:29 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:29.580735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bc3594c8-e62e-49fc-9d6f-1d01444435dd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:29.585928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bc3594c8-e62e-49fc-9d6f-1d01444435dd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:29.593651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:33:29.595054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc3594c8-e62e-49fc-9d6f-1d01444435dd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:29.595552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc3594c8-e62e-49fc-9d6f-1d01444435dd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:29.595986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc3594c8-e62e-49fc-9d6f-1d01444435dd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:29.602332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc3594c8-e62e-49fc-9d6f-1d01444435dd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:29.603273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc3594c8-e62e-49fc-9d6f-1d01444435dd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:29.605780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc3594c8-e62e-49fc-9d6f-1d01444435dd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:29.654660 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-bc3594c8-e62e-49fc-9d6f-1d01444435dd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] HTTP exception thrown: Instance 1c303716-1880-4adb-b972-3bc6e24ba1cc could not be found. Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bc3594c8-e62e-49fc-9d6f-1d01444435dd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Request method failure captured: Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc HTTP/1.1 Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXICkjStyzUNQCP56iyabn5ahlWbK9bq57JWpf6w_r5-2BC1n9lfKn4n-q7ViwDGqwiAHQbWPA068CNGAzX2vWzwGSgwtRiu5lH8sKE1aT3VNdBS9vlw817eOLttRxo_xXGlmclE5Xf7yAYwC5hE1QU1PdlNbXv8l2Qz8VlCemFm6YRM Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad278c0b0b9a41beae8b29986e315743", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 444e13f1f2d945dfb31b83d8e19c2032 Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 1c303716-1880-4adb-b972-3bc6e24ba1cc could not be found. Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '1c303716-1880-4adb-b972-3bc6e24ba1cc'} Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c303716-1880-4adb-b972-3bc6e24ba1cc could not be found. Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:33:29.656530 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:33:29.661815 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c303716-1880-4adb-b972-3bc6e24ba1cc could not be found. Oct 29 01:33:29.661815 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.661815 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:29.661815 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.661815 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:29.661815 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:29.661815 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:29.661815 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:33:29.661815 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:33:29.661815 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c303716-1880-4adb-b972-3bc6e24ba1cc could not be found. Oct 29 01:33:29.661815 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.665193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bc3594c8-e62e-49fc-9d6f-1d01444435dd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Returning 404 to user: Instance 1c303716-1880-4adb-b972-3bc6e24ba1cc could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:33:29.665193 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bc3594c8-e62e-49fc-9d6f-1d01444435dd tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 404 len: 111 microversion: 2.1 time: 0.088230 Oct 29 01:33:29.673517 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2762/5755] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:33:29 2022] DELETE /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:33:29.683129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-70ad53c6-4826-4da9-a2f0-60d45a0cd216 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:29.684061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-70ad53c6-4826-4da9-a2f0-60d45a0cd216 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 1c303716-1880-4adb-b972-3bc6e24ba1cc] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:29.701500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70ad53c6-4826-4da9-a2f0-60d45a0cd216 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:29.705710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70ad53c6-4826-4da9-a2f0-60d45a0cd216 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:29.705710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70ad53c6-4826-4da9-a2f0-60d45a0cd216 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:29.705710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70ad53c6-4826-4da9-a2f0-60d45a0cd216 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:29.709793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70ad53c6-4826-4da9-a2f0-60d45a0cd216 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:29.710610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70ad53c6-4826-4da9-a2f0-60d45a0cd216 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:29.746273 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-70ad53c6-4826-4da9-a2f0-60d45a0cd216 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] HTTP exception thrown: Instance 1c303716-1880-4adb-b972-3bc6e24ba1cc could not be found. Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-70ad53c6-4826-4da9-a2f0-60d45a0cd216 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Request method failure captured: Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc HTTP/1.1 Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXICkjStyzUNQCP56iyabn5ahlWbK9bq57JWpf6w_r5-2BC1n9lfKn4n-q7ViwDGqwiAHQbWPA068CNGAzX2vWzwGSgwtRiu5lH8sKE1aT3VNdBS9vlw817eOLttRxo_xXGlmclE5Xf7yAYwC5hE1QU1PdlNbXv8l2Qz8VlCemFm6YRM Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad278c0b0b9a41beae8b29986e315743", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 444e13f1f2d945dfb31b83d8e19c2032 Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 1c303716-1880-4adb-b972-3bc6e24ba1cc could not be found. Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '1c303716-1880-4adb-b972-3bc6e24ba1cc'} Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c303716-1880-4adb-b972-3bc6e24ba1cc could not be found. Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c303716-1880-4adb-b972-3bc6e24ba1cc could not be found. Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:29.751857 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.757408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:29.757408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:29.757408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:29.757408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:33:29.757408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:33:29.757408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c303716-1880-4adb-b972-3bc6e24ba1cc could not be found. Oct 29 01:33:29.757408 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.761285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-70ad53c6-4826-4da9-a2f0-60d45a0cd216 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Returning 404 to user: Instance 1c303716-1880-4adb-b972-3bc6e24ba1cc could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:33:29.762652 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-70ad53c6-4826-4da9-a2f0-60d45a0cd216 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc" status: 404 len: 111 microversion: 2.1 time: 0.084913 Oct 29 01:33:29.766076 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2994/5756] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:29 2022] GET /compute/v2.1/servers/1c303716-1880-4adb-b972-3bc6e24ba1cc => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:33:29.776405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-21ccbf7f-3d4e-41a7-bb28-f48192ea9fef tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:29.777246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-21ccbf7f-3d4e-41a7-bb28-f48192ea9fef tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:29.790953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21ccbf7f-3d4e-41a7-bb28-f48192ea9fef tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:29.793564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21ccbf7f-3d4e-41a7-bb28-f48192ea9fef tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:29.794410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21ccbf7f-3d4e-41a7-bb28-f48192ea9fef tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:29.798651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21ccbf7f-3d4e-41a7-bb28-f48192ea9fef tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:29.799333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21ccbf7f-3d4e-41a7-bb28-f48192ea9fef tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:29.799848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-21ccbf7f-3d4e-41a7-bb28-f48192ea9fef tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:29.862596 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-21ccbf7f-3d4e-41a7-bb28-f48192ea9fef tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] HTTP exception thrown: Instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 could not be found. Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-21ccbf7f-3d4e-41a7-bb28-f48192ea9fef tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Request method failure captured: Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 HTTP/1.1 Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXICkjStyzUNQCP56iyabn5ahlWbK9bq57JWpf6w_r5-2BC1n9lfKn4n-q7ViwDGqwiAHQbWPA068CNGAzX2vWzwGSgwtRiu5lH8sKE1aT3VNdBS9vlw817eOLttRxo_xXGlmclE5Xf7yAYwC5hE1QU1PdlNbXv8l2Qz8VlCemFm6YRM Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad278c0b0b9a41beae8b29986e315743", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 444e13f1f2d945dfb31b83d8e19c2032 Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 could not be found. Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '7e86fdd3-e373-4b20-85cf-73ce67194dc2'} Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 could not be found. Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:33:29.867226 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:33:29.871301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 could not be found. Oct 29 01:33:29.871301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.871301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:29.871301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.871301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:29.871301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:29.871301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:29.871301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:33:29.871301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:33:29.871301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 could not be found. Oct 29 01:33:29.871301 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.875126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-21ccbf7f-3d4e-41a7-bb28-f48192ea9fef tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Returning 404 to user: Instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:33:29.877926 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-21ccbf7f-3d4e-41a7-bb28-f48192ea9fef tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 404 len: 111 microversion: 2.1 time: 0.107575 Oct 29 01:33:29.881338 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2763/5757] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:33:29 2022] DELETE /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:33:29.889537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e6423481-44d4-40fa-b789-be56e986256b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:29.890847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e6423481-44d4-40fa-b789-be56e986256b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 7e86fdd3-e373-4b20-85cf-73ce67194dc2] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:29.900228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6423481-44d4-40fa-b789-be56e986256b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:29.904059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6423481-44d4-40fa-b789-be56e986256b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:29.904987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6423481-44d4-40fa-b789-be56e986256b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:29.907192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6423481-44d4-40fa-b789-be56e986256b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:29.908073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6423481-44d4-40fa-b789-be56e986256b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:29.909439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6423481-44d4-40fa-b789-be56e986256b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:29.955109 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-e6423481-44d4-40fa-b789-be56e986256b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] HTTP exception thrown: Instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 could not be found. Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e6423481-44d4-40fa-b789-be56e986256b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Request method failure captured: Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 HTTP/1.1 Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXICkjStyzUNQCP56iyabn5ahlWbK9bq57JWpf6w_r5-2BC1n9lfKn4n-q7ViwDGqwiAHQbWPA068CNGAzX2vWzwGSgwtRiu5lH8sKE1aT3VNdBS9vlw817eOLttRxo_xXGlmclE5Xf7yAYwC5hE1QU1PdlNbXv8l2Qz8VlCemFm6YRM Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad278c0b0b9a41beae8b29986e315743", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 444e13f1f2d945dfb31b83d8e19c2032 Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 could not be found. Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '7e86fdd3-e373-4b20-85cf-73ce67194dc2'} Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 could not be found. Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 could not be found. Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:29.957382 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.962000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:29.962000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:29.962000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:29.962000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:33:29.962000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:33:29.962000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 could not be found. Oct 29 01:33:29.962000 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:33:29.963896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e6423481-44d4-40fa-b789-be56e986256b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Returning 404 to user: Instance 7e86fdd3-e373-4b20-85cf-73ce67194dc2 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:33:29.980867 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e6423481-44d4-40fa-b789-be56e986256b tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2" status: 404 len: 111 microversion: 2.1 time: 0.079641 Oct 29 01:33:29.981568 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2995/5758] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:29 2022] GET /compute/v2.1/servers/7e86fdd3-e373-4b20-85cf-73ce67194dc2 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:33:30.559877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9df11b85-d94d-4ee7-835b-b3f252080511 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:30.560561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9df11b85-d94d-4ee7-835b-b3f252080511 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:30.569966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9df11b85-d94d-4ee7-835b-b3f252080511 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:30.582560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f873e7ed-0fac-4d3e-a076-a1f06318f9cc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:30.583776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f873e7ed-0fac-4d3e-a076-a1f06318f9cc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:30.587054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9df11b85-d94d-4ee7-835b-b3f252080511 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:30.587652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9df11b85-d94d-4ee7-835b-b3f252080511 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:30.595331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9df11b85-d94d-4ee7-835b-b3f252080511 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:30.612167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9df11b85-d94d-4ee7-835b-b3f252080511 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:30.616251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9df11b85-d94d-4ee7-835b-b3f252080511 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:30.801294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f873e7ed-0fac-4d3e-a076-a1f06318f9cc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:30.817246 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f873e7ed-0fac-4d3e-a076-a1f06318f9cc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1265 microversion: 2.1 time: 0.238677 Oct 29 01:33:30.819161 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2996/5759] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:30 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:31.441607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9df11b85-d94d-4ee7-835b-b3f252080511 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:31.460801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9df11b85-d94d-4ee7-835b-b3f252080511 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:31.470889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9df11b85-d94d-4ee7-835b-b3f252080511 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:31.474834 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9df11b85-d94d-4ee7-835b-b3f252080511 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1723 microversion: 2.20 time: 0.920512 Oct 29 01:33:31.477425 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2764/5760] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:30 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1723 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:33:31.842085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0736c49b-7bee-4daa-838f-5c756a4ecba9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:31.842831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0736c49b-7bee-4daa-838f-5c756a4ecba9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:31.862170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0736c49b-7bee-4daa-838f-5c756a4ecba9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:31.874356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0736c49b-7bee-4daa-838f-5c756a4ecba9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:31.875582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0736c49b-7bee-4daa-838f-5c756a4ecba9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:31.877438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0736c49b-7bee-4daa-838f-5c756a4ecba9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:31.878323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0736c49b-7bee-4daa-838f-5c756a4ecba9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:31.884640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0736c49b-7bee-4daa-838f-5c756a4ecba9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:31.900326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:33:32.106115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0736c49b-7bee-4daa-838f-5c756a4ecba9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:32.123766 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0736c49b-7bee-4daa-838f-5c756a4ecba9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1269 microversion: 2.1 time: 0.284619 Oct 29 01:33:32.150895 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2997/5761] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:31 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1269 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:32.525455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-808c2d3e-c783-4609-adb0-c6ef79046982 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:32.529665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-808c2d3e-c783-4609-adb0-c6ef79046982 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:32.569440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-808c2d3e-c783-4609-adb0-c6ef79046982 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:32.569950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-808c2d3e-c783-4609-adb0-c6ef79046982 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:32.579297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-808c2d3e-c783-4609-adb0-c6ef79046982 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:32.583567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-808c2d3e-c783-4609-adb0-c6ef79046982 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:32.584593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-808c2d3e-c783-4609-adb0-c6ef79046982 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:32.585308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-808c2d3e-c783-4609-adb0-c6ef79046982 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:33.151987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b7f39dbe-5afb-4199-85c6-ec543637afc6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:33.153214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b7f39dbe-5afb-4199-85c6-ec543637afc6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:33.159002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:33:33.172355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7f39dbe-5afb-4199-85c6-ec543637afc6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:33.173359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7f39dbe-5afb-4199-85c6-ec543637afc6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:33.173990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7f39dbe-5afb-4199-85c6-ec543637afc6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:33.174912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7f39dbe-5afb-4199-85c6-ec543637afc6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:33.176912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7f39dbe-5afb-4199-85c6-ec543637afc6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:33.177572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b7f39dbe-5afb-4199-85c6-ec543637afc6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:33.739071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b7f39dbe-5afb-4199-85c6-ec543637afc6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:33.756284 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b7f39dbe-5afb-4199-85c6-ec543637afc6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1325 microversion: 2.1 time: 0.601875 Oct 29 01:33:33.765275 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2998/5762] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:33 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1325 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:34.035794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-808c2d3e-c783-4609-adb0-c6ef79046982 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:34.048731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-808c2d3e-c783-4609-adb0-c6ef79046982 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:34.054358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-808c2d3e-c783-4609-adb0-c6ef79046982 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:34.062690 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-808c2d3e-c783-4609-adb0-c6ef79046982 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1723 microversion: 2.20 time: 1.560606 Oct 29 01:33:34.074680 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2765/5763] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:32 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1723 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:33:34.787854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c9b1318b-778a-4bcb-a481-7d00d06a9ae6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:34.789829 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c9b1318b-778a-4bcb-a481-7d00d06a9ae6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:34.804916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9b1318b-778a-4bcb-a481-7d00d06a9ae6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:34.815468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9b1318b-778a-4bcb-a481-7d00d06a9ae6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:34.816196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9b1318b-778a-4bcb-a481-7d00d06a9ae6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:34.817203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9b1318b-778a-4bcb-a481-7d00d06a9ae6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:34.818564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9b1318b-778a-4bcb-a481-7d00d06a9ae6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:34.819170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c9b1318b-778a-4bcb-a481-7d00d06a9ae6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:35.100263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e8b77f18-7511-447e-b8ff-622a86c1528f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:35.101074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e8b77f18-7511-447e-b8ff-622a86c1528f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:35.127207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8b77f18-7511-447e-b8ff-622a86c1528f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:35.127892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8b77f18-7511-447e-b8ff-622a86c1528f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:35.128486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8b77f18-7511-447e-b8ff-622a86c1528f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:35.129376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8b77f18-7511-447e-b8ff-622a86c1528f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:35.130532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8b77f18-7511-447e-b8ff-622a86c1528f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:35.137908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e8b77f18-7511-447e-b8ff-622a86c1528f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:35.724820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c9b1318b-778a-4bcb-a481-7d00d06a9ae6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:35.733230 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c9b1318b-778a-4bcb-a481-7d00d06a9ae6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1323 microversion: 2.1 time: 0.949926 Oct 29 01:33:35.747381 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 2999/5764] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:34 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1323 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:36.226290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e8b77f18-7511-447e-b8ff-622a86c1528f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:36.254543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e8b77f18-7511-447e-b8ff-622a86c1528f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:36.256991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e8b77f18-7511-447e-b8ff-622a86c1528f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:36.258471 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e8b77f18-7511-447e-b8ff-622a86c1528f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1723 microversion: 2.20 time: 1.162445 Oct 29 01:33:36.266097 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2766/5765] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:35 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1723 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:33:36.760047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b759f93f-6ab3-4b67-b8f6-2b0067155fea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:36.761624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b759f93f-6ab3-4b67-b8f6-2b0067155fea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:36.778870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b759f93f-6ab3-4b67-b8f6-2b0067155fea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:36.779538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b759f93f-6ab3-4b67-b8f6-2b0067155fea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:36.780362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b759f93f-6ab3-4b67-b8f6-2b0067155fea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:36.781287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b759f93f-6ab3-4b67-b8f6-2b0067155fea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:36.782443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b759f93f-6ab3-4b67-b8f6-2b0067155fea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:36.783024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b759f93f-6ab3-4b67-b8f6-2b0067155fea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:36.925543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b759f93f-6ab3-4b67-b8f6-2b0067155fea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:36.934754 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b759f93f-6ab3-4b67-b8f6-2b0067155fea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1323 microversion: 2.1 time: 0.178817 Oct 29 01:33:36.946758 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3000/5766] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:36 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1323 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:37.295925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0d432153-ec5d-47f9-9976-5edde68513da tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:37.297131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0d432153-ec5d-47f9-9976-5edde68513da tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:37.319222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0d432153-ec5d-47f9-9976-5edde68513da tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:37.319727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0d432153-ec5d-47f9-9976-5edde68513da tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:37.320171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0d432153-ec5d-47f9-9976-5edde68513da tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:37.320892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0d432153-ec5d-47f9-9976-5edde68513da tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:37.321386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0d432153-ec5d-47f9-9976-5edde68513da tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:37.342013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0d432153-ec5d-47f9-9976-5edde68513da tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:37.745043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0d432153-ec5d-47f9-9976-5edde68513da tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:37.778471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0d432153-ec5d-47f9-9976-5edde68513da tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:37.780575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0d432153-ec5d-47f9-9976-5edde68513da tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:37.782521 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0d432153-ec5d-47f9-9976-5edde68513da tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1744 microversion: 2.20 time: 0.490624 Oct 29 01:33:37.783391 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2767/5767] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:37 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1744 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:33:37.970831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-07ea8444-97b2-4043-a95c-dc73bfd65d59 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:37.971451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-07ea8444-97b2-4043-a95c-dc73bfd65d59 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:37.991612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07ea8444-97b2-4043-a95c-dc73bfd65d59 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:37.992407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07ea8444-97b2-4043-a95c-dc73bfd65d59 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:37.993318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07ea8444-97b2-4043-a95c-dc73bfd65d59 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:37.994252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07ea8444-97b2-4043-a95c-dc73bfd65d59 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:37.994716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07ea8444-97b2-4043-a95c-dc73bfd65d59 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:37.995157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07ea8444-97b2-4043-a95c-dc73bfd65d59 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:38.297311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-07ea8444-97b2-4043-a95c-dc73bfd65d59 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:38.311381 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-07ea8444-97b2-4043-a95c-dc73bfd65d59 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1390 microversion: 2.1 time: 0.344311 Oct 29 01:33:38.312063 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3001/5768] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:37 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1390 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:38.813671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c57b2d2e-1412-4902-85fc-4400ed480c83 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:38.816436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c57b2d2e-1412-4902-85fc-4400ed480c83 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:38.834112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c57b2d2e-1412-4902-85fc-4400ed480c83 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:38.835489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c57b2d2e-1412-4902-85fc-4400ed480c83 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:38.836323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c57b2d2e-1412-4902-85fc-4400ed480c83 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:38.837409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c57b2d2e-1412-4902-85fc-4400ed480c83 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:38.838108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c57b2d2e-1412-4902-85fc-4400ed480c83 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:38.838812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c57b2d2e-1412-4902-85fc-4400ed480c83 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:39.340557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-934173b4-78f1-4616-b129-370d99bbf993 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:39.342179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-934173b4-78f1-4616-b129-370d99bbf993 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:39.344625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:33:39.366387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-934173b4-78f1-4616-b129-370d99bbf993 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:39.367833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-934173b4-78f1-4616-b129-370d99bbf993 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:39.372707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-934173b4-78f1-4616-b129-370d99bbf993 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:39.373889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-934173b4-78f1-4616-b129-370d99bbf993 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:39.376578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-934173b4-78f1-4616-b129-370d99bbf993 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:39.380187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-934173b4-78f1-4616-b129-370d99bbf993 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:39.982186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c57b2d2e-1412-4902-85fc-4400ed480c83 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:39.995535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c57b2d2e-1412-4902-85fc-4400ed480c83 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:39.997920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c57b2d2e-1412-4902-85fc-4400ed480c83 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:40.009281 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c57b2d2e-1412-4902-85fc-4400ed480c83 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1744 microversion: 2.20 time: 1.200732 Oct 29 01:33:40.012516 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2768/5769] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:38 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1744 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:33:40.031097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8511f2d0-666e-4a44-bac8-359ef0c47849 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:40.031996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8511f2d0-666e-4a44-bac8-359ef0c47849 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:40.059211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8511f2d0-666e-4a44-bac8-359ef0c47849 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:40.060213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8511f2d0-666e-4a44-bac8-359ef0c47849 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:40.060757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8511f2d0-666e-4a44-bac8-359ef0c47849 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:40.069563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8511f2d0-666e-4a44-bac8-359ef0c47849 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:40.070129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8511f2d0-666e-4a44-bac8-359ef0c47849 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:40.070583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8511f2d0-666e-4a44-bac8-359ef0c47849 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:40.108837 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-8511f2d0-666e-4a44-bac8-359ef0c47849 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] HTTP exception thrown: Instance 2c86e050-73e4-4c80-a145-420293bbf8b2 could not be found. Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8511f2d0-666e-4a44-bac8-359ef0c47849 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Request method failure captured: Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 HTTP/1.1 Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXICkjStyzUNQCP56iyabn5ahlWbK9bq57JWpf6w_r5-2BC1n9lfKn4n-q7ViwDGqwiAHQbWPA068CNGAzX2vWzwGSgwtRiu5lH8sKE1aT3VNdBS9vlw817eOLttRxo_xXGlmclE5Xf7yAYwC5hE1QU1PdlNbXv8l2Qz8VlCemFm6YRM Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad278c0b0b9a41beae8b29986e315743", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 444e13f1f2d945dfb31b83d8e19c2032 Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 2c86e050-73e4-4c80-a145-420293bbf8b2 could not be found. Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '2c86e050-73e4-4c80-a145-420293bbf8b2'} Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c86e050-73e4-4c80-a145-420293bbf8b2 could not be found. Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:33:40.110483 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:33:40.118578 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c86e050-73e4-4c80-a145-420293bbf8b2 could not be found. Oct 29 01:33:40.118578 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:40.118578 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:40.118578 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:40.118578 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:40.118578 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:40.118578 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:40.118578 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:33:40.118578 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:33:40.118578 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c86e050-73e4-4c80-a145-420293bbf8b2 could not be found. Oct 29 01:33:40.118578 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:40.120670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8511f2d0-666e-4a44-bac8-359ef0c47849 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Returning 404 to user: Instance 2c86e050-73e4-4c80-a145-420293bbf8b2 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:33:40.121866 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8511f2d0-666e-4a44-bac8-359ef0c47849 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 404 len: 111 microversion: 2.1 time: 0.106777 Oct 29 01:33:40.122615 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2769/5770] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:33:40 2022] DELETE /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:33:40.148337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f7c4430c-b77f-4056-81a8-53ee5950e9d0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:40.148964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f7c4430c-b77f-4056-81a8-53ee5950e9d0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] [instance: 2c86e050-73e4-4c80-a145-420293bbf8b2] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:40.181093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7c4430c-b77f-4056-81a8-53ee5950e9d0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:40.181668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7c4430c-b77f-4056-81a8-53ee5950e9d0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:40.182286 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7c4430c-b77f-4056-81a8-53ee5950e9d0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:40.183896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7c4430c-b77f-4056-81a8-53ee5950e9d0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:40.184561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7c4430c-b77f-4056-81a8-53ee5950e9d0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:40.184926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7c4430c-b77f-4056-81a8-53ee5950e9d0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:40.201572 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-f7c4430c-b77f-4056-81a8-53ee5950e9d0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] HTTP exception thrown: Instance 2c86e050-73e4-4c80-a145-420293bbf8b2 could not be found. Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f7c4430c-b77f-4056-81a8-53ee5950e9d0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Request method failure captured: Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 HTTP/1.1 Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXICkjStyzUNQCP56iyabn5ahlWbK9bq57JWpf6w_r5-2BC1n9lfKn4n-q7ViwDGqwiAHQbWPA068CNGAzX2vWzwGSgwtRiu5lH8sKE1aT3VNdBS9vlw817eOLttRxo_xXGlmclE5Xf7yAYwC5hE1QU1PdlNbXv8l2Qz8VlCemFm6YRM Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad278c0b0b9a41beae8b29986e315743"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad278c0b0b9a41beae8b29986e315743", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: ad278c0b0b9a41beae8b29986e315743 Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1881901863 Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 444e13f1f2d945dfb31b83d8e19c2032 Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AttachVolumeNegativeTest-1881901863-project Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 2c86e050-73e4-4c80-a145-420293bbf8b2 could not be found. Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '2c86e050-73e4-4c80-a145-420293bbf8b2'} Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c86e050-73e4-4c80-a145-420293bbf8b2 could not be found. Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c86e050-73e4-4c80-a145-420293bbf8b2 could not be found. Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:33:40.203413 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:40.208208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:33:40.208208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:33:40.208208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:33:40.208208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:33:40.208208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:33:40.208208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c86e050-73e4-4c80-a145-420293bbf8b2 could not be found. Oct 29 01:33:40.208208 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:33:40.209969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f7c4430c-b77f-4056-81a8-53ee5950e9d0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] Returning 404 to user: Instance 2c86e050-73e4-4c80-a145-420293bbf8b2 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:33:40.211038 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f7c4430c-b77f-4056-81a8-53ee5950e9d0 tempest-AttachVolumeNegativeTest-1881901863 tempest-AttachVolumeNegativeTest-1881901863-project] 10.222.0.26 "GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2" status: 404 len: 111 microversion: 2.1 time: 0.083775 Oct 29 01:33:40.212267 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2770/5771] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:40 2022] GET /compute/v2.1/servers/2c86e050-73e4-4c80-a145-420293bbf8b2 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:33:40.217671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-934173b4-78f1-4616-b129-370d99bbf993 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:40.230291 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-934173b4-78f1-4616-b129-370d99bbf993 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1390 microversion: 2.1 time: 0.895759 Oct 29 01:33:40.231354 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3002/5772] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:39 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1390 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:41.045891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cbfb34e9-2c89-4e2e-a2f3-07fd97b9cbe5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:41.045891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cbfb34e9-2c89-4e2e-a2f3-07fd97b9cbe5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:41.054313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cbfb34e9-2c89-4e2e-a2f3-07fd97b9cbe5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:41.054898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cbfb34e9-2c89-4e2e-a2f3-07fd97b9cbe5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:41.055691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cbfb34e9-2c89-4e2e-a2f3-07fd97b9cbe5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:41.056497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cbfb34e9-2c89-4e2e-a2f3-07fd97b9cbe5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:41.057054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cbfb34e9-2c89-4e2e-a2f3-07fd97b9cbe5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:41.057592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cbfb34e9-2c89-4e2e-a2f3-07fd97b9cbe5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:41.259253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2ad2239e-ca2e-42e7-a57f-293689448d38 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:41.260487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2ad2239e-ca2e-42e7-a57f-293689448d38 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:41.263625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=10 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:33:41.277036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ad2239e-ca2e-42e7-a57f-293689448d38 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:41.281536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ad2239e-ca2e-42e7-a57f-293689448d38 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:41.282400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ad2239e-ca2e-42e7-a57f-293689448d38 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:41.283374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ad2239e-ca2e-42e7-a57f-293689448d38 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:41.284128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ad2239e-ca2e-42e7-a57f-293689448d38 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:41.314973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ad2239e-ca2e-42e7-a57f-293689448d38 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:42.596631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cbfb34e9-2c89-4e2e-a2f3-07fd97b9cbe5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:42.616215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cbfb34e9-2c89-4e2e-a2f3-07fd97b9cbe5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:42.628843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cbfb34e9-2c89-4e2e-a2f3-07fd97b9cbe5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:42.635279 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cbfb34e9-2c89-4e2e-a2f3-07fd97b9cbe5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1744 microversion: 2.20 time: 1.594512 Oct 29 01:33:42.638674 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2771/5773] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:41 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1744 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:33:42.684426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2ad2239e-ca2e-42e7-a57f-293689448d38 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:42.698403 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2ad2239e-ca2e-42e7-a57f-293689448d38 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1390 microversion: 2.1 time: 1.440907 Oct 29 01:33:42.704008 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3003/5774] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:41 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1390 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:33:43.662656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-de728cf4-0cc1-45e0-a63e-5c3a069aba51 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:43.665063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-de728cf4-0cc1-45e0-a63e-5c3a069aba51 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:43.697723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de728cf4-0cc1-45e0-a63e-5c3a069aba51 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:43.700202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de728cf4-0cc1-45e0-a63e-5c3a069aba51 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:43.701990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de728cf4-0cc1-45e0-a63e-5c3a069aba51 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:43.708584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de728cf4-0cc1-45e0-a63e-5c3a069aba51 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:43.708584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de728cf4-0cc1-45e0-a63e-5c3a069aba51 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:43.708584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de728cf4-0cc1-45e0-a63e-5c3a069aba51 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:43.731924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-20822d56-9a41-486d-a527-8b9b3684f3ea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:43.734577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-20822d56-9a41-486d-a527-8b9b3684f3ea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:43.748210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20822d56-9a41-486d-a527-8b9b3684f3ea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:43.752277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20822d56-9a41-486d-a527-8b9b3684f3ea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:43.754001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20822d56-9a41-486d-a527-8b9b3684f3ea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:43.757750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20822d56-9a41-486d-a527-8b9b3684f3ea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:43.758974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20822d56-9a41-486d-a527-8b9b3684f3ea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:43.760274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20822d56-9a41-486d-a527-8b9b3684f3ea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:44.424729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-20822d56-9a41-486d-a527-8b9b3684f3ea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:44.436034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-de728cf4-0cc1-45e0-a63e-5c3a069aba51 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:44.439381 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-20822d56-9a41-486d-a527-8b9b3684f3ea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1390 microversion: 2.1 time: 0.715308 Oct 29 01:33:44.443958 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3004/5775] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:43 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1390 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:33:44.462623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-de728cf4-0cc1-45e0-a63e-5c3a069aba51 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:44.469988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-de728cf4-0cc1-45e0-a63e-5c3a069aba51 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:44.471946 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-de728cf4-0cc1-45e0-a63e-5c3a069aba51 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1739 microversion: 2.20 time: 0.814045 Oct 29 01:33:44.476975 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2772/5776] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:43 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1739 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:33:44.814591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-671f9115-0bd0-4454-bf5c-c8292660f47c req-910c53ce-a0c0-407f-baf3-89540b5174d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b81380db-5388-4da3-a0be-e9734e60fa24", "tag": "3692ad9d-2f8e-486e-9a37-4e99f5a005a7"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:44.867771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-671f9115-0bd0-4454-bf5c-c8292660f47c req-910c53ce-a0c0-407f-baf3-89540b5174d0 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:44.868485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-671f9115-0bd0-4454-bf5c-c8292660f47c req-910c53ce-a0c0-407f-baf3-89540b5174d0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:44.868972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-671f9115-0bd0-4454-bf5c-c8292660f47c req-910c53ce-a0c0-407f-baf3-89540b5174d0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:44.898026 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-671f9115-0bd0-4454-bf5c-c8292660f47c req-910c53ce-a0c0-407f-baf3-89540b5174d0 service nova] Creating event network-changed:3692ad9d-2f8e-486e-9a37-4e99f5a005a7 for instance b81380db-5388-4da3-a0be-e9734e60fa24 on n-h2-862964-3 Oct 29 01:33:44.918758 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-671f9115-0bd0-4454-bf5c-c8292660f47c req-910c53ce-a0c0-407f-baf3-89540b5174d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104500 Oct 29 01:33:44.918758 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3005/5777] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:33:45.480797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0a6f06de-69de-4925-a12d-7141ba143c4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:45.481467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0a6f06de-69de-4925-a12d-7141ba143c4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:45.509981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-001db273-16d0-4e4b-a70e-330eef751ae4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:45.513322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-001db273-16d0-4e4b-a70e-330eef751ae4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:45.533650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-001db273-16d0-4e4b-a70e-330eef751ae4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:45.534178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-001db273-16d0-4e4b-a70e-330eef751ae4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:45.534802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-001db273-16d0-4e4b-a70e-330eef751ae4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:45.537194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-001db273-16d0-4e4b-a70e-330eef751ae4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:45.541855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-001db273-16d0-4e4b-a70e-330eef751ae4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:45.542542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-001db273-16d0-4e4b-a70e-330eef751ae4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:45.552983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a6f06de-69de-4925-a12d-7141ba143c4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:45.559546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a6f06de-69de-4925-a12d-7141ba143c4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:45.566575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a6f06de-69de-4925-a12d-7141ba143c4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:45.573623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a6f06de-69de-4925-a12d-7141ba143c4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:45.574180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a6f06de-69de-4925-a12d-7141ba143c4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:45.574642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a6f06de-69de-4925-a12d-7141ba143c4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:45.952972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-001db273-16d0-4e4b-a70e-330eef751ae4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:45.969530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-001db273-16d0-4e4b-a70e-330eef751ae4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:45.971698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-001db273-16d0-4e4b-a70e-330eef751ae4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:45.973109 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-001db273-16d0-4e4b-a70e-330eef751ae4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1739 microversion: 2.20 time: 0.468318 Oct 29 01:33:45.976339 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3006/5778] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:45 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1739 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:33:46.275427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0a6f06de-69de-4925-a12d-7141ba143c4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:46.286672 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0a6f06de-69de-4925-a12d-7141ba143c4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1390 microversion: 2.1 time: 0.824385 Oct 29 01:33:46.299440 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2773/5779] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:45 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1390 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:47.013640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-50cd9694-3e18-4631-895b-bf7ab8f6c2de tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:47.014379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-50cd9694-3e18-4631-895b-bf7ab8f6c2de tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:47.035327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50cd9694-3e18-4631-895b-bf7ab8f6c2de tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:47.041607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50cd9694-3e18-4631-895b-bf7ab8f6c2de tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:47.043899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50cd9694-3e18-4631-895b-bf7ab8f6c2de tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:47.043899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50cd9694-3e18-4631-895b-bf7ab8f6c2de tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:47.043899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50cd9694-3e18-4631-895b-bf7ab8f6c2de tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:47.050180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50cd9694-3e18-4631-895b-bf7ab8f6c2de tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:47.326085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ce8c2004-a929-4242-8cff-da184a78a79f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:47.326716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ce8c2004-a929-4242-8cff-da184a78a79f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:47.359416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce8c2004-a929-4242-8cff-da184a78a79f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:47.359416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce8c2004-a929-4242-8cff-da184a78a79f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:47.359416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce8c2004-a929-4242-8cff-da184a78a79f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:47.364903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce8c2004-a929-4242-8cff-da184a78a79f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:47.365456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce8c2004-a929-4242-8cff-da184a78a79f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:47.365912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce8c2004-a929-4242-8cff-da184a78a79f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:47.975046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-50cd9694-3e18-4631-895b-bf7ab8f6c2de tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:48.000601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-50cd9694-3e18-4631-895b-bf7ab8f6c2de tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:48.009735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-50cd9694-3e18-4631-895b-bf7ab8f6c2de tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:48.012484 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-50cd9694-3e18-4631-895b-bf7ab8f6c2de tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1739 microversion: 2.20 time: 1.012263 Oct 29 01:33:48.013107 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3007/5780] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:46 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1739 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:33:48.146669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ce8c2004-a929-4242-8cff-da184a78a79f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:48.156974 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ce8c2004-a929-4242-8cff-da184a78a79f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1390 microversion: 2.1 time: 0.836582 Oct 29 01:33:48.160102 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2774/5781] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:47 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1390 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:48.450960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-182da4e1-2904-4b47-bca3-89e9d5d108f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'create', calling method: .version_select at 0x7f9d96ec9ca0>, body: {"keypair": {"name": "tempest-keypair-789054541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUc1yjE7oyB0aPh87Aqrn0ihN1kiXSiF9Vjuy3mN+a24NO3mcUOFPs/GSlmGG4PWsY2ilRtAD3HZfs+5pTyAHQREb3OsI5RaJF/2gSGG2fuTUib4DZLLd4B1VlDJdbkrw=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:48.557809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-182da4e1-2904-4b47-bca3-89e9d5d108f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Getting quotas for project 238c2e0d9e0b48198767a357cff1a442. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:33:48.594638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-182da4e1-2904-4b47-bca3-89e9d5d108f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Getting quotas for user 9c097ba205f6453ba793dfb1d1876f3e and project 238c2e0d9e0b48198767a357cff1a442. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:33:48.826791 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-182da4e1-2904-4b47-bca3-89e9d5d108f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.812388 Oct 29 01:33:48.827749 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3008/5782] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:33:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:33:49.043597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5eab8503-8422-4923-ba35-37f69ac07a5d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:49.046102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5eab8503-8422-4923-ba35-37f69ac07a5d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:49.061277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5eab8503-8422-4923-ba35-37f69ac07a5d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:49.068525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5eab8503-8422-4923-ba35-37f69ac07a5d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:49.069361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5eab8503-8422-4923-ba35-37f69ac07a5d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:49.071611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5eab8503-8422-4923-ba35-37f69ac07a5d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:49.072873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5eab8503-8422-4923-ba35-37f69ac07a5d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:49.073344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5eab8503-8422-4923-ba35-37f69ac07a5d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:49.188819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-29f3da60-913a-4683-a5d9-64d1c509c659 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:49.189840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-29f3da60-913a-4683-a5d9-64d1c509c659 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:49.213611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f3da60-913a-4683-a5d9-64d1c509c659 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:49.216557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f3da60-913a-4683-a5d9-64d1c509c659 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:49.218788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f3da60-913a-4683-a5d9-64d1c509c659 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:49.220017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f3da60-913a-4683-a5d9-64d1c509c659 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:49.223370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f3da60-913a-4683-a5d9-64d1c509c659 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:49.224788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29f3da60-913a-4683-a5d9-64d1c509c659 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:51.640949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-29f3da60-913a-4683-a5d9-64d1c509c659 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:51.671379 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-29f3da60-913a-4683-a5d9-64d1c509c659 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1390 microversion: 2.1 time: 2.484555 Oct 29 01:33:51.672692 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3009/5783] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:49 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1390 bytes in 2490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:33:51.688292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-d64d7ba1-b64c-4eef-9a4c-5654b4fabdbc req-7ba1c05a-3f91-4a2a-bdea-b1e37cc22e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db08ce62-9806-4b5e-90e6-ca4fe64a2885", "name": "network-vif-plugged", "status": "completed", "tag": "9a179e9f-8e3d-4dcd-b553-24e9832a186e"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:51.723859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d64d7ba1-b64c-4eef-9a4c-5654b4fabdbc req-7ba1c05a-3f91-4a2a-bdea-b1e37cc22e59 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:51.725988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d64d7ba1-b64c-4eef-9a4c-5654b4fabdbc req-7ba1c05a-3f91-4a2a-bdea-b1e37cc22e59 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:51.726721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d64d7ba1-b64c-4eef-9a4c-5654b4fabdbc req-7ba1c05a-3f91-4a2a-bdea-b1e37cc22e59 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:51.762270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5eab8503-8422-4923-ba35-37f69ac07a5d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:51.770926 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-d64d7ba1-b64c-4eef-9a4c-5654b4fabdbc req-7ba1c05a-3f91-4a2a-bdea-b1e37cc22e59 service nova] Creating event network-vif-plugged:9a179e9f-8e3d-4dcd-b553-24e9832a186e for instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 on n-h1-862964-3 Oct 29 01:33:51.781681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5eab8503-8422-4923-ba35-37f69ac07a5d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:51.785784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5eab8503-8422-4923-ba35-37f69ac07a5d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:51.793716 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5eab8503-8422-4923-ba35-37f69ac07a5d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1739 microversion: 2.20 time: 2.754411 Oct 29 01:33:51.795364 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-d64d7ba1-b64c-4eef-9a4c-5654b4fabdbc req-7ba1c05a-3f91-4a2a-bdea-b1e37cc22e59 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118378 Oct 29 01:33:51.796685 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3010/5784] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:33:51.800640 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2775/5785] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:49 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1739 bytes in 2762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:33:52.699995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6130e63f-5f20-4f4f-b03e-00447d389245 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:52.701553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6130e63f-5f20-4f4f-b03e-00447d389245 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:52.722146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6130e63f-5f20-4f4f-b03e-00447d389245 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:52.723679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6130e63f-5f20-4f4f-b03e-00447d389245 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:52.724320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6130e63f-5f20-4f4f-b03e-00447d389245 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:52.727096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6130e63f-5f20-4f4f-b03e-00447d389245 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:52.729203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6130e63f-5f20-4f4f-b03e-00447d389245 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:52.729864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6130e63f-5f20-4f4f-b03e-00447d389245 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:52.832000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-adafee6a-1755-49d5-9708-3164037ac524 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:52.834585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-adafee6a-1755-49d5-9708-3164037ac524 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:52.857900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-adafee6a-1755-49d5-9708-3164037ac524 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:52.860897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-adafee6a-1755-49d5-9708-3164037ac524 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:52.861789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-adafee6a-1755-49d5-9708-3164037ac524 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:52.867078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-adafee6a-1755-49d5-9708-3164037ac524 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:52.868784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-adafee6a-1755-49d5-9708-3164037ac524 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:52.871686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-adafee6a-1755-49d5-9708-3164037ac524 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:53.643800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6130e63f-5f20-4f4f-b03e-00447d389245 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:53.662006 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6130e63f-5f20-4f4f-b03e-00447d389245 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1390 microversion: 2.1 time: 0.967442 Oct 29 01:33:53.677182 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3011/5786] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:52 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1390 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:53.858974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-adafee6a-1755-49d5-9708-3164037ac524 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:53.877635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-adafee6a-1755-49d5-9708-3164037ac524 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:53.879093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-adafee6a-1755-49d5-9708-3164037ac524 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:53.889372 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-adafee6a-1755-49d5-9708-3164037ac524 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1739 microversion: 2.20 time: 1.061140 Oct 29 01:33:53.901534 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2776/5787] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:52 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1739 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:33:54.693437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3fd34f6d-b6db-4da0-ad29-e2990140c656 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:54.694696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3fd34f6d-b6db-4da0-ad29-e2990140c656 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:54.708850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3fd34f6d-b6db-4da0-ad29-e2990140c656 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:54.709740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3fd34f6d-b6db-4da0-ad29-e2990140c656 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:54.710402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3fd34f6d-b6db-4da0-ad29-e2990140c656 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:54.711427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3fd34f6d-b6db-4da0-ad29-e2990140c656 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:54.712042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3fd34f6d-b6db-4da0-ad29-e2990140c656 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:54.712765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3fd34f6d-b6db-4da0-ad29-e2990140c656 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:54.919290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-051e4917-512a-4e04-81fe-a9a8665a17e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:54.920084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-051e4917-512a-4e04-81fe-a9a8665a17e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:54.939875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-051e4917-512a-4e04-81fe-a9a8665a17e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:54.942683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-051e4917-512a-4e04-81fe-a9a8665a17e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:54.943657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-051e4917-512a-4e04-81fe-a9a8665a17e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:54.946960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-051e4917-512a-4e04-81fe-a9a8665a17e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:54.948610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-051e4917-512a-4e04-81fe-a9a8665a17e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:54.949312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-051e4917-512a-4e04-81fe-a9a8665a17e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:55.250053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-051e4917-512a-4e04-81fe-a9a8665a17e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:55.270698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-051e4917-512a-4e04-81fe-a9a8665a17e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:55.277257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-051e4917-512a-4e04-81fe-a9a8665a17e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:55.279246 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-051e4917-512a-4e04-81fe-a9a8665a17e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1739 microversion: 2.20 time: 0.364173 Oct 29 01:33:55.280117 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2777/5788] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:54 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1739 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:33:55.621192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3fd34f6d-b6db-4da0-ad29-e2990140c656 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:55.631765 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3fd34f6d-b6db-4da0-ad29-e2990140c656 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1390 microversion: 2.1 time: 0.943300 Oct 29 01:33:55.635542 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3012/5789] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:54 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1390 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:56.310295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-39614c88-efd6-452a-892e-da2d9a99f72c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:56.311106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-39614c88-efd6-452a-892e-da2d9a99f72c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:56.332741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39614c88-efd6-452a-892e-da2d9a99f72c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:56.334491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39614c88-efd6-452a-892e-da2d9a99f72c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:56.335435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39614c88-efd6-452a-892e-da2d9a99f72c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:56.337388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39614c88-efd6-452a-892e-da2d9a99f72c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:56.340179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39614c88-efd6-452a-892e-da2d9a99f72c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:56.340887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39614c88-efd6-452a-892e-da2d9a99f72c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:56.659256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dbb9b25f-70c9-4526-a43e-ecd135ff5f97 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:56.661207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dbb9b25f-70c9-4526-a43e-ecd135ff5f97 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:56.678967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbb9b25f-70c9-4526-a43e-ecd135ff5f97 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:56.680163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbb9b25f-70c9-4526-a43e-ecd135ff5f97 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:56.684684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbb9b25f-70c9-4526-a43e-ecd135ff5f97 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:56.684684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbb9b25f-70c9-4526-a43e-ecd135ff5f97 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:56.684684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbb9b25f-70c9-4526-a43e-ecd135ff5f97 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:56.684684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbb9b25f-70c9-4526-a43e-ecd135ff5f97 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:58.006011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dbb9b25f-70c9-4526-a43e-ecd135ff5f97 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:58.016532 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dbb9b25f-70c9-4526-a43e-ecd135ff5f97 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1390 microversion: 2.1 time: 1.361217 Oct 29 01:33:58.041118 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3013/5790] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:56 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1390 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:33:58.099505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-39614c88-efd6-452a-892e-da2d9a99f72c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:58.102497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:33:58.131112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-39614c88-efd6-452a-892e-da2d9a99f72c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:58.137751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-39614c88-efd6-452a-892e-da2d9a99f72c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:58.139010 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-39614c88-efd6-452a-892e-da2d9a99f72c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1739 microversion: 2.20 time: 1.833977 Oct 29 01:33:58.163877 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2778/5791] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:56 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1739 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:33:59.050300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e74e5371-fc46-49c6-b597-1c32ce32d780 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:59.050926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e74e5371-fc46-49c6-b597-1c32ce32d780 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:59.054499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:33:59.083428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e74e5371-fc46-49c6-b597-1c32ce32d780 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:59.084181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e74e5371-fc46-49c6-b597-1c32ce32d780 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:59.084846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e74e5371-fc46-49c6-b597-1c32ce32d780 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:59.093267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e74e5371-fc46-49c6-b597-1c32ce32d780 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:59.094156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e74e5371-fc46-49c6-b597-1c32ce32d780 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:59.094787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e74e5371-fc46-49c6-b597-1c32ce32d780 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:59.178376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9edb2da7-fde0-4f10-bf0f-cede58dfb599 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:59.179001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9edb2da7-fde0-4f10-bf0f-cede58dfb599 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:33:59.198948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9edb2da7-fde0-4f10-bf0f-cede58dfb599 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:59.203550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9edb2da7-fde0-4f10-bf0f-cede58dfb599 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:59.203550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9edb2da7-fde0-4f10-bf0f-cede58dfb599 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:59.203550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9edb2da7-fde0-4f10-bf0f-cede58dfb599 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:33:59.203550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9edb2da7-fde0-4f10-bf0f-cede58dfb599 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:33:59.215398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9edb2da7-fde0-4f10-bf0f-cede58dfb599 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:33:59.624515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e74e5371-fc46-49c6-b597-1c32ce32d780 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:59.641019 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e74e5371-fc46-49c6-b597-1c32ce32d780 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1390 microversion: 2.1 time: 0.592359 Oct 29 01:33:59.642007 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3014/5792] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:33:59 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1390 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:59.661392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1333f946-f9c6-45c3-9b32-40f763aefc91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1113220866", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8568990a-4f98-461a-8f32-e20720daa4e5"}], "security_groups": [{"name": "tempest-securitygroup--2093388182"}], "key_name": "tempest-keypair-789054541", "user_data": "}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:59.704267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9edb2da7-fde0-4f10-bf0f-cede58dfb599 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:59.719685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9edb2da7-fde0-4f10-bf0f-cede58dfb599 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:59.722089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9edb2da7-fde0-4f10-bf0f-cede58dfb599 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:59.725020 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9edb2da7-fde0-4f10-bf0f-cede58dfb599 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1739 microversion: 2.20 time: 0.560368 Oct 29 01:33:59.727394 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2779/5793] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:33:59 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1739 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:33:59.921503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-1333f946-f9c6-45c3-9b32-40f763aefc91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] validate_networks() for [('8568990a-4f98-461a-8f32-e20720daa4e5', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:34:00.671010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2b923c3b-eafa-486f-8ab3-871ec6b15ed3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:00.672234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2b923c3b-eafa-486f-8ab3-871ec6b15ed3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:00.677889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=36 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:34:00.700587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b923c3b-eafa-486f-8ab3-871ec6b15ed3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:00.704010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b923c3b-eafa-486f-8ab3-871ec6b15ed3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:00.704513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b923c3b-eafa-486f-8ab3-871ec6b15ed3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:00.711248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b923c3b-eafa-486f-8ab3-871ec6b15ed3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:00.713582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b923c3b-eafa-486f-8ab3-871ec6b15ed3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:00.723533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b923c3b-eafa-486f-8ab3-871ec6b15ed3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:01.099880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1333f946-f9c6-45c3-9b32-40f763aefc91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:34:01.100454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1333f946-f9c6-45c3-9b32-40f763aefc91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:34:01.100786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1333f946-f9c6-45c3-9b32-40f763aefc91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:34:01.101288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1333f946-f9c6-45c3-9b32-40f763aefc91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:34:01.101715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1333f946-f9c6-45c3-9b32-40f763aefc91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:34:01.124598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1333f946-f9c6-45c3-9b32-40f763aefc91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:01.125185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1333f946-f9c6-45c3-9b32-40f763aefc91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:01.125645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1333f946-f9c6-45c3-9b32-40f763aefc91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:01.130293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1333f946-f9c6-45c3-9b32-40f763aefc91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:01.130293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1333f946-f9c6-45c3-9b32-40f763aefc91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:01.130784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1333f946-f9c6-45c3-9b32-40f763aefc91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:01.210739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-1333f946-f9c6-45c3-9b32-40f763aefc91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Getting quotas for project 238c2e0d9e0b48198767a357cff1a442. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:34:01.251077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-1333f946-f9c6-45c3-9b32-40f763aefc91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Getting quotas for user 9c097ba205f6453ba793dfb1d1876f3e and project 238c2e0d9e0b48198767a357cff1a442. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:34:01.299525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1333f946-f9c6-45c3-9b32-40f763aefc91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:34:01.314924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1333f946-f9c6-45c3-9b32-40f763aefc91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:34:01.518178 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1333f946-f9c6-45c3-9b32-40f763aefc91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.873605 Oct 29 01:34:01.532762 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3015/5794] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:33:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 1890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:34:01.574589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9ef618a0-0e24-48ba-ae5f-6bf2f630ac1c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:01.577368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9ef618a0-0e24-48ba-ae5f-6bf2f630ac1c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:01.597426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ef618a0-0e24-48ba-ae5f-6bf2f630ac1c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:01.600461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ef618a0-0e24-48ba-ae5f-6bf2f630ac1c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:01.601040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ef618a0-0e24-48ba-ae5f-6bf2f630ac1c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:01.604894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ef618a0-0e24-48ba-ae5f-6bf2f630ac1c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:01.606004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ef618a0-0e24-48ba-ae5f-6bf2f630ac1c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:01.606645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ef618a0-0e24-48ba-ae5f-6bf2f630ac1c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:03.578907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2b923c3b-eafa-486f-8ab3-871ec6b15ed3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:03.601107 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2b923c3b-eafa-486f-8ab3-871ec6b15ed3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1390 microversion: 2.1 time: 2.935580 Oct 29 01:34:03.601976 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2780/5795] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:00 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1390 bytes in 2938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:34:03.628515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6e49b9b7-93a5-4fce-a9b6-754aa9f83be9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:03.629659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6e49b9b7-93a5-4fce-a9b6-754aa9f83be9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:03.640172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e49b9b7-93a5-4fce-a9b6-754aa9f83be9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:03.641017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e49b9b7-93a5-4fce-a9b6-754aa9f83be9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:03.641647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e49b9b7-93a5-4fce-a9b6-754aa9f83be9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:03.647216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e49b9b7-93a5-4fce-a9b6-754aa9f83be9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:03.647950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e49b9b7-93a5-4fce-a9b6-754aa9f83be9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:03.648546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e49b9b7-93a5-4fce-a9b6-754aa9f83be9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:03.708831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9ef618a0-0e24-48ba-ae5f-6bf2f630ac1c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:03.711683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:34:03.719574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9ef618a0-0e24-48ba-ae5f-6bf2f630ac1c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:03.721092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9ef618a0-0e24-48ba-ae5f-6bf2f630ac1c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:03.739478 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9ef618a0-0e24-48ba-ae5f-6bf2f630ac1c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1739 microversion: 2.20 time: 2.195164 Oct 29 01:34:03.764287 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3016/5796] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:01 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1739 bytes in 2220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:03.822423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6e49b9b7-93a5-4fce-a9b6-754aa9f83be9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:03.840641 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6e49b9b7-93a5-4fce-a9b6-754aa9f83be9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1242 microversion: 2.1 time: 0.237416 Oct 29 01:34:03.846834 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2781/5797] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:03 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1242 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:04.635582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-952434a1-ed20-4212-b8ee-02e33abc9dd9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:04.639401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-952434a1-ed20-4212-b8ee-02e33abc9dd9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:04.674691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:34:04.678147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-952434a1-ed20-4212-b8ee-02e33abc9dd9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:04.678930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-952434a1-ed20-4212-b8ee-02e33abc9dd9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:04.679657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-952434a1-ed20-4212-b8ee-02e33abc9dd9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:04.680867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-952434a1-ed20-4212-b8ee-02e33abc9dd9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:04.688703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-952434a1-ed20-4212-b8ee-02e33abc9dd9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:04.691030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-952434a1-ed20-4212-b8ee-02e33abc9dd9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:04.771410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9a566189-8519-46cb-970c-951371a0c1d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:04.773518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9a566189-8519-46cb-970c-951371a0c1d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:04.788885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a566189-8519-46cb-970c-951371a0c1d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:04.789149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a566189-8519-46cb-970c-951371a0c1d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:04.793821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a566189-8519-46cb-970c-951371a0c1d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:04.794759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a566189-8519-46cb-970c-951371a0c1d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:04.795384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a566189-8519-46cb-970c-951371a0c1d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:04.795969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a566189-8519-46cb-970c-951371a0c1d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:05.234915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-952434a1-ed20-4212-b8ee-02e33abc9dd9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:05.282480 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-952434a1-ed20-4212-b8ee-02e33abc9dd9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1390 microversion: 2.1 time: 0.657764 Oct 29 01:34:05.283681 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3017/5798] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:04 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1390 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:05.297080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-54b38272-27bd-4623-a2ff-a1d60da099ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:05.298385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-54b38272-27bd-4623-a2ff-a1d60da099ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:05.319657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54b38272-27bd-4623-a2ff-a1d60da099ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:05.323679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54b38272-27bd-4623-a2ff-a1d60da099ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:05.325707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54b38272-27bd-4623-a2ff-a1d60da099ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:05.328688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54b38272-27bd-4623-a2ff-a1d60da099ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:05.329449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54b38272-27bd-4623-a2ff-a1d60da099ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:05.330138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54b38272-27bd-4623-a2ff-a1d60da099ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:05.602676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-54b38272-27bd-4623-a2ff-a1d60da099ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:05.615336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9a566189-8519-46cb-970c-951371a0c1d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:05.637674 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-54b38272-27bd-4623-a2ff-a1d60da099ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1290 microversion: 2.1 time: 0.352525 Oct 29 01:34:05.644630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9a566189-8519-46cb-970c-951371a0c1d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:05.652511 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3018/5799] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:05 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1290 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:05.662553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9a566189-8519-46cb-970c-951371a0c1d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:05.685518 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9a566189-8519-46cb-970c-951371a0c1d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1739 microversion: 2.20 time: 0.904546 Oct 29 01:34:05.685518 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2782/5800] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:04 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1739 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:06.300786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-c1db452d-63ab-40a1-93fd-b45149613d31 req-cbf94cd0-9a46-467f-84c0-cc7bc5a7a506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81380db-5388-4da3-a0be-e9734e60fa24", "name": "network-vif-plugged", "status": "completed", "tag": "3692ad9d-2f8e-486e-9a37-4e99f5a005a7"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:06.316281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3ded9a77-d34c-4902-bc88-aa573b411356 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:06.316281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3ded9a77-d34c-4902-bc88-aa573b411356 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:06.323381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3ded9a77-d34c-4902-bc88-aa573b411356 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:06.339808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3ded9a77-d34c-4902-bc88-aa573b411356 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:06.343855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3ded9a77-d34c-4902-bc88-aa573b411356 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:06.357559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3ded9a77-d34c-4902-bc88-aa573b411356 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:06.358356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c1db452d-63ab-40a1-93fd-b45149613d31 req-cbf94cd0-9a46-467f-84c0-cc7bc5a7a506 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:06.362173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3ded9a77-d34c-4902-bc88-aa573b411356 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:06.477623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3ded9a77-d34c-4902-bc88-aa573b411356 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:06.479116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c1db452d-63ab-40a1-93fd-b45149613d31 req-cbf94cd0-9a46-467f-84c0-cc7bc5a7a506 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:06.479116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c1db452d-63ab-40a1-93fd-b45149613d31 req-cbf94cd0-9a46-467f-84c0-cc7bc5a7a506 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:06.479116 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-c1db452d-63ab-40a1-93fd-b45149613d31 req-cbf94cd0-9a46-467f-84c0-cc7bc5a7a506 service nova] Creating event network-vif-plugged:3692ad9d-2f8e-486e-9a37-4e99f5a005a7 for instance b81380db-5388-4da3-a0be-e9734e60fa24 on n-h2-862964-3 Oct 29 01:34:06.492834 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-c1db452d-63ab-40a1-93fd-b45149613d31 req-cbf94cd0-9a46-467f-84c0-cc7bc5a7a506 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.304946 Oct 29 01:34:06.497397 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3019/5801] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:34:06.678212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4ab03c21-1263-44ae-a541-cb9b0010ad45 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:06.679140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4ab03c21-1263-44ae-a541-cb9b0010ad45 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:06.723924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ab03c21-1263-44ae-a541-cb9b0010ad45 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:06.724265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ab03c21-1263-44ae-a541-cb9b0010ad45 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:06.724731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ab03c21-1263-44ae-a541-cb9b0010ad45 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:06.732852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ab03c21-1263-44ae-a541-cb9b0010ad45 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:06.733459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ab03c21-1263-44ae-a541-cb9b0010ad45 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:06.733923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4ab03c21-1263-44ae-a541-cb9b0010ad45 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:07.616536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3ded9a77-d34c-4902-bc88-aa573b411356 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:07.637013 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3ded9a77-d34c-4902-bc88-aa573b411356 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1390 microversion: 2.1 time: 1.327917 Oct 29 01:34:07.644908 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2783/5802] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:06 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1390 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:07.652281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2334a5d5-ef9a-428d-bda0-85b2d6f20c3d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:07.664617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2334a5d5-ef9a-428d-bda0-85b2d6f20c3d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:07.687004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2334a5d5-ef9a-428d-bda0-85b2d6f20c3d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:07.693133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2334a5d5-ef9a-428d-bda0-85b2d6f20c3d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:07.707005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2334a5d5-ef9a-428d-bda0-85b2d6f20c3d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:07.709764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2334a5d5-ef9a-428d-bda0-85b2d6f20c3d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:07.710690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2334a5d5-ef9a-428d-bda0-85b2d6f20c3d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:07.713512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2334a5d5-ef9a-428d-bda0-85b2d6f20c3d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:08.162879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4ab03c21-1263-44ae-a541-cb9b0010ad45 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:08.200342 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4ab03c21-1263-44ae-a541-cb9b0010ad45 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1296 microversion: 2.1 time: 1.525316 Oct 29 01:34:08.201287 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3020/5803] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:06 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1296 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:34:08.379747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2334a5d5-ef9a-428d-bda0-85b2d6f20c3d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:08.393565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2334a5d5-ef9a-428d-bda0-85b2d6f20c3d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:08.395322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2334a5d5-ef9a-428d-bda0-85b2d6f20c3d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:08.398313 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2334a5d5-ef9a-428d-bda0-85b2d6f20c3d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1739 microversion: 2.20 time: 0.755445 Oct 29 01:34:08.398313 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2784/5804] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:07 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1739 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:08.662690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dbaa761d-b332-4dcc-82b0-862ea6ba6b96 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:08.663321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dbaa761d-b332-4dcc-82b0-862ea6ba6b96 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:08.690904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbaa761d-b332-4dcc-82b0-862ea6ba6b96 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:08.691419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbaa761d-b332-4dcc-82b0-862ea6ba6b96 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:08.692068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbaa761d-b332-4dcc-82b0-862ea6ba6b96 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:08.699702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbaa761d-b332-4dcc-82b0-862ea6ba6b96 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:08.701702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbaa761d-b332-4dcc-82b0-862ea6ba6b96 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:08.705735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbaa761d-b332-4dcc-82b0-862ea6ba6b96 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:09.231281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-64a13e22-7a16-4379-80e5-018dca2b60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:09.233858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-64a13e22-7a16-4379-80e5-018dca2b60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:09.243530 n-d-862964-3 devstack@n-api.service[121100]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:34:09.243755 n-d-862964-3 devstack@n-api.service[121100]: Sat Oct 29 01:34:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a (ip 10.222.0.26) !!! Oct 29 01:34:09.283238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64a13e22-7a16-4379-80e5-018dca2b60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:09.294944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64a13e22-7a16-4379-80e5-018dca2b60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:09.303062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64a13e22-7a16-4379-80e5-018dca2b60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:09.313302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64a13e22-7a16-4379-80e5-018dca2b60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:09.313302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64a13e22-7a16-4379-80e5-018dca2b60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:09.313302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-64a13e22-7a16-4379-80e5-018dca2b60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:09.578988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-64a13e22-7a16-4379-80e5-018dca2b60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:09.588713 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-64a13e22-7a16-4379-80e5-018dca2b60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1296 microversion: 2.1 time: 0.367778 Oct 29 01:34:09.605801 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2785/5805] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:09 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1296 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:09.617911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7b8c4d55-8a59-4f25-ad7d-1712a6fe0fcd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:09.621433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7b8c4d55-8a59-4f25-ad7d-1712a6fe0fcd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:09.626113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dbaa761d-b332-4dcc-82b0-862ea6ba6b96 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:09.639562 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dbaa761d-b332-4dcc-82b0-862ea6ba6b96 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1390 microversion: 2.1 time: 0.981952 Oct 29 01:34:09.647005 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3021/5806] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:08 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1390 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:09.651514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b8c4d55-8a59-4f25-ad7d-1712a6fe0fcd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:09.654273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b8c4d55-8a59-4f25-ad7d-1712a6fe0fcd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:09.654907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b8c4d55-8a59-4f25-ad7d-1712a6fe0fcd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:09.657254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b8c4d55-8a59-4f25-ad7d-1712a6fe0fcd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:09.658714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b8c4d55-8a59-4f25-ad7d-1712a6fe0fcd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:09.659306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b8c4d55-8a59-4f25-ad7d-1712a6fe0fcd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:09.971407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7b8c4d55-8a59-4f25-ad7d-1712a6fe0fcd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:09.985955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7b8c4d55-8a59-4f25-ad7d-1712a6fe0fcd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:09.987518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7b8c4d55-8a59-4f25-ad7d-1712a6fe0fcd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:09.994399 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7b8c4d55-8a59-4f25-ad7d-1712a6fe0fcd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1739 microversion: 2.20 time: 0.381640 Oct 29 01:34:09.994399 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2786/5807] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:09 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1739 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:10.621359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d9b9c4df-591b-4434-884e-e76ef19a63ed tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:10.622287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d9b9c4df-591b-4434-884e-e76ef19a63ed tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:10.640656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9b9c4df-591b-4434-884e-e76ef19a63ed tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:10.649070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9b9c4df-591b-4434-884e-e76ef19a63ed tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:10.650397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9b9c4df-591b-4434-884e-e76ef19a63ed tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:10.651399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9b9c4df-591b-4434-884e-e76ef19a63ed tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:10.652070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9b9c4df-591b-4434-884e-e76ef19a63ed tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:10.652724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9b9c4df-591b-4434-884e-e76ef19a63ed tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:10.672140 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6286234f-d508-40e8-a3e8-0cf68c8f15a6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:10.673527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6286234f-d508-40e8-a3e8-0cf68c8f15a6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:10.689949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6286234f-d508-40e8-a3e8-0cf68c8f15a6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:10.691645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6286234f-d508-40e8-a3e8-0cf68c8f15a6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:10.693084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6286234f-d508-40e8-a3e8-0cf68c8f15a6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:10.694669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6286234f-d508-40e8-a3e8-0cf68c8f15a6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:10.702757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6286234f-d508-40e8-a3e8-0cf68c8f15a6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:10.705482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6286234f-d508-40e8-a3e8-0cf68c8f15a6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:11.162152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:34:11.284107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:34:12.824618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d9b9c4df-591b-4434-884e-e76ef19a63ed tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:12.839964 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d9b9c4df-591b-4434-884e-e76ef19a63ed tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1364 microversion: 2.1 time: 2.221869 Oct 29 01:34:12.846311 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3022/5808] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:10 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1364 bytes in 2225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:34:12.862198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2f73fd5b-2f2b-41db-a804-230cdf9b1b59 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:12.867426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2f73fd5b-2f2b-41db-a804-230cdf9b1b59 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:12.881384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f73fd5b-2f2b-41db-a804-230cdf9b1b59 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:12.881794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f73fd5b-2f2b-41db-a804-230cdf9b1b59 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:12.882235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f73fd5b-2f2b-41db-a804-230cdf9b1b59 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:12.882944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f73fd5b-2f2b-41db-a804-230cdf9b1b59 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:12.883399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f73fd5b-2f2b-41db-a804-230cdf9b1b59 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:12.883821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2f73fd5b-2f2b-41db-a804-230cdf9b1b59 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:13.630743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6286234f-d508-40e8-a3e8-0cf68c8f15a6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:13.668296 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6286234f-d508-40e8-a3e8-0cf68c8f15a6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1563 microversion: 2.1 time: 2.986446 Oct 29 01:34:13.669000 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2787/5809] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:10 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1563 bytes in 3002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:13.698973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d27f5b09-475e-47fe-9fe5-03919c220fd7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:13.700481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d27f5b09-475e-47fe-9fe5-03919c220fd7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:13.713791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d27f5b09-475e-47fe-9fe5-03919c220fd7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:13.721505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d27f5b09-475e-47fe-9fe5-03919c220fd7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:13.730899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d27f5b09-475e-47fe-9fe5-03919c220fd7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:13.737085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d27f5b09-475e-47fe-9fe5-03919c220fd7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:13.740305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d27f5b09-475e-47fe-9fe5-03919c220fd7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:13.742512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d27f5b09-475e-47fe-9fe5-03919c220fd7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:14.450162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f73fd5b-2f2b-41db-a804-230cdf9b1b59 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:14.466962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f73fd5b-2f2b-41db-a804-230cdf9b1b59 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:14.478388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2f73fd5b-2f2b-41db-a804-230cdf9b1b59 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:14.486522 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2f73fd5b-2f2b-41db-a804-230cdf9b1b59 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1739 microversion: 2.20 time: 1.639421 Oct 29 01:34:14.495986 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3023/5810] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:12 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1739 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:14.506051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f28bb62f-3798-4bfa-9de7-5acf64e866fb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:14.506902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f28bb62f-3798-4bfa-9de7-5acf64e866fb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:14.561128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f28bb62f-3798-4bfa-9de7-5acf64e866fb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:14.562211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f28bb62f-3798-4bfa-9de7-5acf64e866fb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:14.564124 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f28bb62f-3798-4bfa-9de7-5acf64e866fb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:14.567695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f28bb62f-3798-4bfa-9de7-5acf64e866fb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:14.568544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f28bb62f-3798-4bfa-9de7-5acf64e866fb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:14.570361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f28bb62f-3798-4bfa-9de7-5acf64e866fb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:15.060162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d27f5b09-475e-47fe-9fe5-03919c220fd7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:15.079377 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d27f5b09-475e-47fe-9fe5-03919c220fd7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1563 microversion: 2.1 time: 1.383205 Oct 29 01:34:15.083624 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2788/5811] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:13 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1563 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:15.530617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-03097eb7-7193-4a36-a6e4-fbb7f548fad8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:15.532318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-03097eb7-7193-4a36-a6e4-fbb7f548fad8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:15.544162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03097eb7-7193-4a36-a6e4-fbb7f548fad8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:15.564221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03097eb7-7193-4a36-a6e4-fbb7f548fad8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:15.566293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03097eb7-7193-4a36-a6e4-fbb7f548fad8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:15.569921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03097eb7-7193-4a36-a6e4-fbb7f548fad8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:15.571022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03097eb7-7193-4a36-a6e4-fbb7f548fad8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:15.573565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03097eb7-7193-4a36-a6e4-fbb7f548fad8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:16.496649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f28bb62f-3798-4bfa-9de7-5acf64e866fb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:16.524896 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f28bb62f-3798-4bfa-9de7-5acf64e866fb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1364 microversion: 2.1 time: 2.027419 Oct 29 01:34:16.525730 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3024/5812] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:14 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1364 bytes in 2029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:17.210406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-03097eb7-7193-4a36-a6e4-fbb7f548fad8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:17.226289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-03097eb7-7193-4a36-a6e4-fbb7f548fad8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:17.229086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-03097eb7-7193-4a36-a6e4-fbb7f548fad8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:17.233075 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-03097eb7-7193-4a36-a6e4-fbb7f548fad8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1739 microversion: 2.20 time: 1.708292 Oct 29 01:34:17.249830 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2789/5813] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:15 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1739 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:17.554319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cfe6a0d7-72c4-4d72-ac18-3465236b51f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:17.554861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cfe6a0d7-72c4-4d72-ac18-3465236b51f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:17.570895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfe6a0d7-72c4-4d72-ac18-3465236b51f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:17.575597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfe6a0d7-72c4-4d72-ac18-3465236b51f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:17.581077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfe6a0d7-72c4-4d72-ac18-3465236b51f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:17.583113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfe6a0d7-72c4-4d72-ac18-3465236b51f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:17.583561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfe6a0d7-72c4-4d72-ac18-3465236b51f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:17.585196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfe6a0d7-72c4-4d72-ac18-3465236b51f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:17.629772 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-166eaf27-83aa-4706-9698-35c453d6bc52 req-ec0348b7-083f-44c6-b6f7-c413ae241b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a", "tag": "5a9cbab0-94b4-4948-a2da-c29b923b64da"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:17.665953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-166eaf27-83aa-4706-9698-35c453d6bc52 req-ec0348b7-083f-44c6-b6f7-c413ae241b22 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:17.666789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-166eaf27-83aa-4706-9698-35c453d6bc52 req-ec0348b7-083f-44c6-b6f7-c413ae241b22 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:17.668016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-166eaf27-83aa-4706-9698-35c453d6bc52 req-ec0348b7-083f-44c6-b6f7-c413ae241b22 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:17.718234 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-166eaf27-83aa-4706-9698-35c453d6bc52 req-ec0348b7-083f-44c6-b6f7-c413ae241b22 service nova] Creating event network-changed:5a9cbab0-94b4-4948-a2da-c29b923b64da for instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a on n-h1-862964-3 Oct 29 01:34:17.730928 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-166eaf27-83aa-4706-9698-35c453d6bc52 req-ec0348b7-083f-44c6-b6f7-c413ae241b22 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105173 Oct 29 01:34:17.735115 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2790/5814] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:34:18.270391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-15928095-aa1e-4ab3-8ff3-2cd672b84dc0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:18.271971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-15928095-aa1e-4ab3-8ff3-2cd672b84dc0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:18.282884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15928095-aa1e-4ab3-8ff3-2cd672b84dc0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:18.283853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15928095-aa1e-4ab3-8ff3-2cd672b84dc0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:18.295697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15928095-aa1e-4ab3-8ff3-2cd672b84dc0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:18.299369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15928095-aa1e-4ab3-8ff3-2cd672b84dc0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:18.300356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15928095-aa1e-4ab3-8ff3-2cd672b84dc0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:18.301023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15928095-aa1e-4ab3-8ff3-2cd672b84dc0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:18.796738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cfe6a0d7-72c4-4d72-ac18-3465236b51f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:18.810787 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cfe6a0d7-72c4-4d72-ac18-3465236b51f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1364 microversion: 2.1 time: 1.262067 Oct 29 01:34:18.812890 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3025/5815] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:17 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1364 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:18.834829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-15928095-aa1e-4ab3-8ff3-2cd672b84dc0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:18.849534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-15928095-aa1e-4ab3-8ff3-2cd672b84dc0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:18.851791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-15928095-aa1e-4ab3-8ff3-2cd672b84dc0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:18.856836 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-15928095-aa1e-4ab3-8ff3-2cd672b84dc0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1739 microversion: 2.20 time: 0.592300 Oct 29 01:34:18.877086 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2791/5816] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:18 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1739 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:19.845661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e6190e0-0055-4a62-a447-542283157bd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:19.846884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e6190e0-0055-4a62-a447-542283157bd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:19.883047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e6190e0-0055-4a62-a447-542283157bd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:19.891946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6705f761-f4b1-4c33-8900-7a855f18c60b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:19.893440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6705f761-f4b1-4c33-8900-7a855f18c60b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:19.893923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e6190e0-0055-4a62-a447-542283157bd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:19.894782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e6190e0-0055-4a62-a447-542283157bd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:19.895617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e6190e0-0055-4a62-a447-542283157bd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:19.897302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e6190e0-0055-4a62-a447-542283157bd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:19.897924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e6190e0-0055-4a62-a447-542283157bd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:19.902601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6705f761-f4b1-4c33-8900-7a855f18c60b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:19.905322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6705f761-f4b1-4c33-8900-7a855f18c60b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:19.908351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6705f761-f4b1-4c33-8900-7a855f18c60b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:19.909434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6705f761-f4b1-4c33-8900-7a855f18c60b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:19.952036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6705f761-f4b1-4c33-8900-7a855f18c60b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:19.952036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6705f761-f4b1-4c33-8900-7a855f18c60b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:20.358770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8e6190e0-0055-4a62-a447-542283157bd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:20.370186 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8e6190e0-0055-4a62-a447-542283157bd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1364 microversion: 2.1 time: 0.533518 Oct 29 01:34:20.375083 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3026/5817] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:19 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1364 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:20.399240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6705f761-f4b1-4c33-8900-7a855f18c60b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:20.408938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6705f761-f4b1-4c33-8900-7a855f18c60b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:20.422120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6705f761-f4b1-4c33-8900-7a855f18c60b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:20.426567 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6705f761-f4b1-4c33-8900-7a855f18c60b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1721 microversion: 2.20 time: 0.536939 Oct 29 01:34:20.427389 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2792/5818] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:19 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1721 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:21.404808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ec1e3d6f-8534-4c9d-842a-4802e25285d4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:21.409044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ec1e3d6f-8534-4c9d-842a-4802e25285d4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:21.432629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec1e3d6f-8534-4c9d-842a-4802e25285d4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:21.439415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec1e3d6f-8534-4c9d-842a-4802e25285d4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:21.439415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec1e3d6f-8534-4c9d-842a-4802e25285d4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:21.439415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec1e3d6f-8534-4c9d-842a-4802e25285d4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:21.439415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec1e3d6f-8534-4c9d-842a-4802e25285d4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:21.439415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec1e3d6f-8534-4c9d-842a-4802e25285d4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:21.463466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-06f12f81-0a63-4455-ac98-b9308fc90a55 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:21.464287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-06f12f81-0a63-4455-ac98-b9308fc90a55 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:21.487622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06f12f81-0a63-4455-ac98-b9308fc90a55 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:21.488270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06f12f81-0a63-4455-ac98-b9308fc90a55 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:21.497662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06f12f81-0a63-4455-ac98-b9308fc90a55 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:21.498535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06f12f81-0a63-4455-ac98-b9308fc90a55 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:21.500989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06f12f81-0a63-4455-ac98-b9308fc90a55 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:21.501488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06f12f81-0a63-4455-ac98-b9308fc90a55 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:21.727002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ec1e3d6f-8534-4c9d-842a-4802e25285d4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:21.742647 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ec1e3d6f-8534-4c9d-842a-4802e25285d4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1364 microversion: 2.1 time: 0.346189 Oct 29 01:34:21.746374 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3027/5819] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:21 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1364 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:21.914149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-06f12f81-0a63-4455-ac98-b9308fc90a55 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:21.924315 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-06f12f81-0a63-4455-ac98-b9308fc90a55 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:21.927117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-06f12f81-0a63-4455-ac98-b9308fc90a55 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:21.928370 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-06f12f81-0a63-4455-ac98-b9308fc90a55 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1721 microversion: 2.20 time: 0.473515 Oct 29 01:34:21.930001 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2793/5820] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:21 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1721 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:22.769031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f8f0fb5a-1780-442b-88c6-3b5f4f56dec5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:22.775961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f8f0fb5a-1780-442b-88c6-3b5f4f56dec5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:22.796642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8f0fb5a-1780-442b-88c6-3b5f4f56dec5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:22.797197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8f0fb5a-1780-442b-88c6-3b5f4f56dec5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:22.800238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8f0fb5a-1780-442b-88c6-3b5f4f56dec5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:22.812274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8f0fb5a-1780-442b-88c6-3b5f4f56dec5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:22.814035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8f0fb5a-1780-442b-88c6-3b5f4f56dec5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:22.814656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8f0fb5a-1780-442b-88c6-3b5f4f56dec5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:22.989621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0d5d6f1d-4e85-48ca-b551-6525c227024c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:22.992583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0d5d6f1d-4e85-48ca-b551-6525c227024c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:23.058123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0d5d6f1d-4e85-48ca-b551-6525c227024c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:23.058123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0d5d6f1d-4e85-48ca-b551-6525c227024c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:23.058123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0d5d6f1d-4e85-48ca-b551-6525c227024c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:23.058123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0d5d6f1d-4e85-48ca-b551-6525c227024c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:23.066615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0d5d6f1d-4e85-48ca-b551-6525c227024c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:23.068585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0d5d6f1d-4e85-48ca-b551-6525c227024c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:23.948147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f8f0fb5a-1780-442b-88c6-3b5f4f56dec5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:23.964176 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f8f0fb5a-1780-442b-88c6-3b5f4f56dec5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1364 microversion: 2.1 time: 1.199150 Oct 29 01:34:23.985724 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3028/5821] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:22 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1364 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:24.008002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ac03da0c-5862-4726-9c02-20d614420191 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:24.008002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ac03da0c-5862-4726-9c02-20d614420191 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:24.042011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0d5d6f1d-4e85-48ca-b551-6525c227024c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:24.048689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac03da0c-5862-4726-9c02-20d614420191 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:24.054960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac03da0c-5862-4726-9c02-20d614420191 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:24.054960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac03da0c-5862-4726-9c02-20d614420191 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:24.056400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac03da0c-5862-4726-9c02-20d614420191 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:24.060976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac03da0c-5862-4726-9c02-20d614420191 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:24.061733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac03da0c-5862-4726-9c02-20d614420191 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:24.077373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0d5d6f1d-4e85-48ca-b551-6525c227024c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:24.093311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0d5d6f1d-4e85-48ca-b551-6525c227024c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:24.095254 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0d5d6f1d-4e85-48ca-b551-6525c227024c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1721 microversion: 2.20 time: 1.141709 Oct 29 01:34:24.101084 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2794/5822] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:22 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1721 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:24.105657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-0c8d53e4-cddd-48c6-882b-c38adf186b3f req-59676012-3d9a-4343-9b49-e23bbb84e00d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b81380db-5388-4da3-a0be-e9734e60fa24", "tag": "3692ad9d-2f8e-486e-9a37-4e99f5a005a7"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:24.139903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-0c8d53e4-cddd-48c6-882b-c38adf186b3f req-59676012-3d9a-4343-9b49-e23bbb84e00d service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:24.140713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-0c8d53e4-cddd-48c6-882b-c38adf186b3f req-59676012-3d9a-4343-9b49-e23bbb84e00d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:24.142162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-0c8d53e4-cddd-48c6-882b-c38adf186b3f req-59676012-3d9a-4343-9b49-e23bbb84e00d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:24.193965 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-0c8d53e4-cddd-48c6-882b-c38adf186b3f req-59676012-3d9a-4343-9b49-e23bbb84e00d service nova] Creating event network-changed:3692ad9d-2f8e-486e-9a37-4e99f5a005a7 for instance b81380db-5388-4da3-a0be-e9734e60fa24 on n-h2-862964-3 Oct 29 01:34:24.226474 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-0c8d53e4-cddd-48c6-882b-c38adf186b3f req-59676012-3d9a-4343-9b49-e23bbb84e00d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128454 Oct 29 01:34:24.284317 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2795/5823] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:34:24.284317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-d6f2d379-9205-4c33-a7de-3874d3bb56b2 req-4f4800fe-a6db-4765-b115-d534c323b46f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db08ce62-9806-4b5e-90e6-ca4fe64a2885", "name": "network-vif-unplugged", "status": "completed", "tag": "9a179e9f-8e3d-4dcd-b553-24e9832a186e"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:24.284614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d6f2d379-9205-4c33-a7de-3874d3bb56b2 req-4f4800fe-a6db-4765-b115-d534c323b46f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:24.285933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d6f2d379-9205-4c33-a7de-3874d3bb56b2 req-4f4800fe-a6db-4765-b115-d534c323b46f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:24.289047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d6f2d379-9205-4c33-a7de-3874d3bb56b2 req-4f4800fe-a6db-4765-b115-d534c323b46f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:24.311975 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-d6f2d379-9205-4c33-a7de-3874d3bb56b2 req-4f4800fe-a6db-4765-b115-d534c323b46f service nova] Creating event network-vif-unplugged:9a179e9f-8e3d-4dcd-b553-24e9832a186e for instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 on n-h1-862964-3 Oct 29 01:34:24.325437 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-d6f2d379-9205-4c33-a7de-3874d3bb56b2 req-4f4800fe-a6db-4765-b115-d534c323b46f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091288 Oct 29 01:34:24.326588 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2796/5824] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:34:24.992104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9743b495-e90b-4e81-8326-1a8fb6f0d512 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:24.992985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9743b495-e90b-4e81-8326-1a8fb6f0d512 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:25.005915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9743b495-e90b-4e81-8326-1a8fb6f0d512 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:25.006323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9743b495-e90b-4e81-8326-1a8fb6f0d512 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:25.020459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9743b495-e90b-4e81-8326-1a8fb6f0d512 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:25.021427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9743b495-e90b-4e81-8326-1a8fb6f0d512 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:25.021933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9743b495-e90b-4e81-8326-1a8fb6f0d512 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:25.024579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9743b495-e90b-4e81-8326-1a8fb6f0d512 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:25.086455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:34:25.127212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ac03da0c-5862-4726-9c02-20d614420191 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:25.152597 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ac03da0c-5862-4726-9c02-20d614420191 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1563 microversion: 2.1 time: 1.164622 Oct 29 01:34:25.159196 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3029/5825] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:23 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1563 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:25.171207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4e01d2c9-0793-45d2-8a2e-e14730cfd31a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:25.171839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4e01d2c9-0793-45d2-8a2e-e14730cfd31a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:25.183523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e01d2c9-0793-45d2-8a2e-e14730cfd31a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:25.189582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e01d2c9-0793-45d2-8a2e-e14730cfd31a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:25.190118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e01d2c9-0793-45d2-8a2e-e14730cfd31a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:25.194419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e01d2c9-0793-45d2-8a2e-e14730cfd31a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:25.194419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e01d2c9-0793-45d2-8a2e-e14730cfd31a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:25.194419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e01d2c9-0793-45d2-8a2e-e14730cfd31a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:25.634982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9743b495-e90b-4e81-8326-1a8fb6f0d512 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:25.648241 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9743b495-e90b-4e81-8326-1a8fb6f0d512 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1364 microversion: 2.1 time: 0.660278 Oct 29 01:34:25.649493 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2797/5826] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:24 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1364 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:34:25.673461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4e01d2c9-0793-45d2-8a2e-e14730cfd31a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:25.684438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4e01d2c9-0793-45d2-8a2e-e14730cfd31a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:25.686371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4e01d2c9-0793-45d2-8a2e-e14730cfd31a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:25.687733 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4e01d2c9-0793-45d2-8a2e-e14730cfd31a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1721 microversion: 2.20 time: 0.526207 Oct 29 01:34:25.688670 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3030/5827] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:25 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1721 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:26.685574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9a705615-0891-46c3-91ba-b043597353b4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:26.686203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9a705615-0891-46c3-91ba-b043597353b4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:26.716548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-176ea098-6936-4613-b1e6-4d9958402396 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:26.718009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-176ea098-6936-4613-b1e6-4d9958402396 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:26.736923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a705615-0891-46c3-91ba-b043597353b4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:26.738881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a705615-0891-46c3-91ba-b043597353b4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:26.745469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a705615-0891-46c3-91ba-b043597353b4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:26.746815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a705615-0891-46c3-91ba-b043597353b4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:26.747326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a705615-0891-46c3-91ba-b043597353b4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:26.751148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a705615-0891-46c3-91ba-b043597353b4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:26.777041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-176ea098-6936-4613-b1e6-4d9958402396 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:26.777041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-176ea098-6936-4613-b1e6-4d9958402396 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:26.777041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-176ea098-6936-4613-b1e6-4d9958402396 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:26.779169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-176ea098-6936-4613-b1e6-4d9958402396 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:26.779532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-176ea098-6936-4613-b1e6-4d9958402396 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:26.779977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-176ea098-6936-4613-b1e6-4d9958402396 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:27.476806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-176ea098-6936-4613-b1e6-4d9958402396 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:27.495095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-176ea098-6936-4613-b1e6-4d9958402396 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:27.510605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-176ea098-6936-4613-b1e6-4d9958402396 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:27.520791 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-176ea098-6936-4613-b1e6-4d9958402396 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1721 microversion: 2.20 time: 0.808555 Oct 29 01:34:27.523899 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3031/5828] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:26 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1721 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:27.570102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9a705615-0891-46c3-91ba-b043597353b4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:27.580143 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9a705615-0891-46c3-91ba-b043597353b4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1364 microversion: 2.1 time: 0.903754 Oct 29 01:34:27.598947 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2798/5829] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:26 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1364 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:28.557299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-34605eae-f8e6-4bab-9903-df86c6ad35e4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:28.558808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-34605eae-f8e6-4bab-9903-df86c6ad35e4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:28.569087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-34605eae-f8e6-4bab-9903-df86c6ad35e4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:28.569792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-34605eae-f8e6-4bab-9903-df86c6ad35e4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:28.570377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-34605eae-f8e6-4bab-9903-df86c6ad35e4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:28.571323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-34605eae-f8e6-4bab-9903-df86c6ad35e4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:28.571927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-34605eae-f8e6-4bab-9903-df86c6ad35e4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:28.583857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-34605eae-f8e6-4bab-9903-df86c6ad35e4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:28.604166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-92acc6c5-d3d5-4128-b578-fd43250fd9b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:28.606942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-92acc6c5-d3d5-4128-b578-fd43250fd9b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:28.626387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-92acc6c5-d3d5-4128-b578-fd43250fd9b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:28.628106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-92acc6c5-d3d5-4128-b578-fd43250fd9b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:28.634049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-92acc6c5-d3d5-4128-b578-fd43250fd9b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:28.636503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-92acc6c5-d3d5-4128-b578-fd43250fd9b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:28.637184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-92acc6c5-d3d5-4128-b578-fd43250fd9b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:28.639145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-92acc6c5-d3d5-4128-b578-fd43250fd9b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:29.215111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-34605eae-f8e6-4bab-9903-df86c6ad35e4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:29.223769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-92acc6c5-d3d5-4128-b578-fd43250fd9b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:29.230421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-34605eae-f8e6-4bab-9903-df86c6ad35e4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:29.232547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-34605eae-f8e6-4bab-9903-df86c6ad35e4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:29.242420 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-34605eae-f8e6-4bab-9903-df86c6ad35e4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1664 microversion: 2.20 time: 0.685144 Oct 29 01:34:29.242420 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3032/5830] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:28 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1664 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:29.256513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-993b46e3-56df-4a80-bcb4-5840687cf9d4 req-7505cff2-c3fe-4c7f-b4d1-a93f8e8ed9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a", "name": "network-vif-plugged", "status": "completed", "tag": "5a9cbab0-94b4-4948-a2da-c29b923b64da"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:29.291890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-993b46e3-56df-4a80-bcb4-5840687cf9d4 req-7505cff2-c3fe-4c7f-b4d1-a93f8e8ed9c4 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:29.293330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-993b46e3-56df-4a80-bcb4-5840687cf9d4 req-7505cff2-c3fe-4c7f-b4d1-a93f8e8ed9c4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:29.293582 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-92acc6c5-d3d5-4128-b578-fd43250fd9b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1364 microversion: 2.1 time: 0.692922 Oct 29 01:34:29.294302 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2799/5831] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:28 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1364 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:29.294929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-993b46e3-56df-4a80-bcb4-5840687cf9d4 req-7505cff2-c3fe-4c7f-b4d1-a93f8e8ed9c4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:29.299987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cca17b95-4f40-4059-9222-75b8c506da4d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c14e1a9a-e0b5-46b2-9c40-2b6dba55aade"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:29.335891 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-993b46e3-56df-4a80-bcb4-5840687cf9d4 req-7505cff2-c3fe-4c7f-b4d1-a93f8e8ed9c4 service nova] Creating event network-vif-plugged:5a9cbab0-94b4-4948-a2da-c29b923b64da for instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a on n-h1-862964-3 Oct 29 01:34:29.348542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cca17b95-4f40-4059-9222-75b8c506da4d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:29.359802 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-993b46e3-56df-4a80-bcb4-5840687cf9d4 req-7505cff2-c3fe-4c7f-b4d1-a93f8e8ed9c4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116485 Oct 29 01:34:29.362118 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3033/5832] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:34:29.362336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cca17b95-4f40-4059-9222-75b8c506da4d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:29.362877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cca17b95-4f40-4059-9222-75b8c506da4d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:29.363643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cca17b95-4f40-4059-9222-75b8c506da4d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:29.364382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cca17b95-4f40-4059-9222-75b8c506da4d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:29.364848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cca17b95-4f40-4059-9222-75b8c506da4d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:29.369336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cca17b95-4f40-4059-9222-75b8c506da4d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:30.333249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c51bbec9-5e21-46bf-a924-16aeb6cb733b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:30.333961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c51bbec9-5e21-46bf-a924-16aeb6cb733b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:30.386423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c51bbec9-5e21-46bf-a924-16aeb6cb733b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:30.387214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c51bbec9-5e21-46bf-a924-16aeb6cb733b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:30.387812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c51bbec9-5e21-46bf-a924-16aeb6cb733b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:30.388715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c51bbec9-5e21-46bf-a924-16aeb6cb733b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:30.389557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c51bbec9-5e21-46bf-a924-16aeb6cb733b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:30.390157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c51bbec9-5e21-46bf-a924-16aeb6cb733b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:30.808556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c51bbec9-5e21-46bf-a924-16aeb6cb733b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:30.810964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:34:30.835945 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c51bbec9-5e21-46bf-a924-16aeb6cb733b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1364 microversion: 2.1 time: 0.521969 Oct 29 01:34:30.836545 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3034/5833] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:30 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1364 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:30.969983 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cca17b95-4f40-4059-9222-75b8c506da4d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "POST /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.673665 Oct 29 01:34:30.986401 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2800/5834] 10.222.0.26 () {62 vars in 1364 bytes} [Sat Oct 29 01:34:29 2022] POST /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments => generated 188 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:34:31.188141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-68cc49ac-c78a-40f7-b089-6ffec3e09c13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:31.194469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-68cc49ac-c78a-40f7-b089-6ffec3e09c13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:31.199263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68cc49ac-c78a-40f7-b089-6ffec3e09c13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:31.199753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68cc49ac-c78a-40f7-b089-6ffec3e09c13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:31.200189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68cc49ac-c78a-40f7-b089-6ffec3e09c13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:31.200885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68cc49ac-c78a-40f7-b089-6ffec3e09c13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:31.201532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68cc49ac-c78a-40f7-b089-6ffec3e09c13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:31.202889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-68cc49ac-c78a-40f7-b089-6ffec3e09c13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:31.278884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-68cc49ac-c78a-40f7-b089-6ffec3e09c13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121099) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 01:34:31.854136 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-68cc49ac-c78a-40f7-b089-6ffec3e09c13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "POST /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/action" status: 202 len: 0 microversion: 2.20 time: 0.670368 Oct 29 01:34:31.857590 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3035/5835] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 29 01:34:31 2022] POST /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/action => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:34:31.867687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-01330f5f-a43f-4ff4-9936-cb492f788a3f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:31.868324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-01330f5f-a43f-4ff4-9936-cb492f788a3f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:31.871000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9b44e28e-18c5-457c-bb53-c40b0dc5d577 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:31.874720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9b44e28e-18c5-457c-bb53-c40b0dc5d577 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:31.875544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=42 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:34:31.883389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b44e28e-18c5-457c-bb53-c40b0dc5d577 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:31.883935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b44e28e-18c5-457c-bb53-c40b0dc5d577 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:31.885449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b44e28e-18c5-457c-bb53-c40b0dc5d577 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:31.886505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b44e28e-18c5-457c-bb53-c40b0dc5d577 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:31.887022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b44e28e-18c5-457c-bb53-c40b0dc5d577 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:31.887511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b44e28e-18c5-457c-bb53-c40b0dc5d577 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:31.892280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01330f5f-a43f-4ff4-9936-cb492f788a3f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:31.897960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01330f5f-a43f-4ff4-9936-cb492f788a3f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:31.898483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01330f5f-a43f-4ff4-9936-cb492f788a3f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:31.899452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01330f5f-a43f-4ff4-9936-cb492f788a3f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:31.900361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01330f5f-a43f-4ff4-9936-cb492f788a3f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:31.906325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01330f5f-a43f-4ff4-9936-cb492f788a3f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:32.865360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-01330f5f-a43f-4ff4-9936-cb492f788a3f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:32.895986 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-01330f5f-a43f-4ff4-9936-cb492f788a3f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1552 microversion: 2.1 time: 1.035088 Oct 29 01:34:32.909303 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2801/5836] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:34:31 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1552 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:32.937318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-69cdb1b0-5210-484f-9362-8014adb9f3f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:32.937975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-69cdb1b0-5210-484f-9362-8014adb9f3f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:32.952770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69cdb1b0-5210-484f-9362-8014adb9f3f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:32.957721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69cdb1b0-5210-484f-9362-8014adb9f3f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:32.958494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69cdb1b0-5210-484f-9362-8014adb9f3f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:32.959445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69cdb1b0-5210-484f-9362-8014adb9f3f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:32.960487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69cdb1b0-5210-484f-9362-8014adb9f3f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:32.962214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-69cdb1b0-5210-484f-9362-8014adb9f3f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:33.260027 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-69cdb1b0-5210-484f-9362-8014adb9f3f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.330832 Oct 29 01:34:33.261062 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2802/5837] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:34:32 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/os-interface => generated 285 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:34:33.440183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9b44e28e-18c5-457c-bb53-c40b0dc5d577 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:33.452054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9b44e28e-18c5-457c-bb53-c40b0dc5d577 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:33.453554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9b44e28e-18c5-457c-bb53-c40b0dc5d577 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:33.461574 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9b44e28e-18c5-457c-bb53-c40b0dc5d577 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1750 microversion: 2.20 time: 1.597687 Oct 29 01:34:33.474494 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3036/5838] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:31 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1750 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:34.513664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-86ae5df0-a72b-432c-b614-0dda7acdf7ab tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:34.516230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-86ae5df0-a72b-432c-b614-0dda7acdf7ab tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:34.536503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86ae5df0-a72b-432c-b614-0dda7acdf7ab tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:34.537051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86ae5df0-a72b-432c-b614-0dda7acdf7ab tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:34.537530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86ae5df0-a72b-432c-b614-0dda7acdf7ab tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:34.538335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86ae5df0-a72b-432c-b614-0dda7acdf7ab tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:34.562256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86ae5df0-a72b-432c-b614-0dda7acdf7ab tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:34.565670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86ae5df0-a72b-432c-b614-0dda7acdf7ab tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:35.739375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-86ae5df0-a72b-432c-b614-0dda7acdf7ab tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:35.779980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-86ae5df0-a72b-432c-b614-0dda7acdf7ab tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:35.789727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-86ae5df0-a72b-432c-b614-0dda7acdf7ab tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:35.796170 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-86ae5df0-a72b-432c-b614-0dda7acdf7ab tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1750 microversion: 2.20 time: 1.295462 Oct 29 01:34:35.798857 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2803/5839] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:34 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1750 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:36.832297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f6e8ea7a-cacd-43cc-898e-cb502c7ca559 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:36.837089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f6e8ea7a-cacd-43cc-898e-cb502c7ca559 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:36.858741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:34:36.861069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6e8ea7a-cacd-43cc-898e-cb502c7ca559 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:36.871190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6e8ea7a-cacd-43cc-898e-cb502c7ca559 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:36.871851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6e8ea7a-cacd-43cc-898e-cb502c7ca559 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:36.875366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6e8ea7a-cacd-43cc-898e-cb502c7ca559 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:36.876298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6e8ea7a-cacd-43cc-898e-cb502c7ca559 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:36.876907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6e8ea7a-cacd-43cc-898e-cb502c7ca559 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:37.465467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f6e8ea7a-cacd-43cc-898e-cb502c7ca559 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:37.484687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f6e8ea7a-cacd-43cc-898e-cb502c7ca559 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:37.490674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f6e8ea7a-cacd-43cc-898e-cb502c7ca559 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:37.494380 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f6e8ea7a-cacd-43cc-898e-cb502c7ca559 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1752 microversion: 2.20 time: 0.666603 Oct 29 01:34:37.513489 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3037/5840] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:36 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1752 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:38.320391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-21015c7c-3e44-468e-901e-e2c583136db4 req-f3706c17-cae2-4bb5-83ca-2f4df5e22e50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a", "tag": "5a9cbab0-94b4-4948-a2da-c29b923b64da"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:38.336805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-21015c7c-3e44-468e-901e-e2c583136db4 req-f3706c17-cae2-4bb5-83ca-2f4df5e22e50 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:38.337622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-21015c7c-3e44-468e-901e-e2c583136db4 req-f3706c17-cae2-4bb5-83ca-2f4df5e22e50 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:38.338060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-21015c7c-3e44-468e-901e-e2c583136db4 req-f3706c17-cae2-4bb5-83ca-2f4df5e22e50 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:38.351485 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-21015c7c-3e44-468e-901e-e2c583136db4 req-f3706c17-cae2-4bb5-83ca-2f4df5e22e50 service nova] Creating event network-changed:5a9cbab0-94b4-4948-a2da-c29b923b64da for instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a on n-h1-862964-3 Oct 29 01:34:38.357310 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-21015c7c-3e44-468e-901e-e2c583136db4 req-f3706c17-cae2-4bb5-83ca-2f4df5e22e50 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041110 Oct 29 01:34:38.357802 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2804/5841] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:34:38.526439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3b42a2c5-bd86-4c1a-bbe1-9e09410acdf3 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:38.527624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3b42a2c5-bd86-4c1a-bbe1-9e09410acdf3 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:38.543247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b42a2c5-bd86-4c1a-bbe1-9e09410acdf3 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:38.595169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b42a2c5-bd86-4c1a-bbe1-9e09410acdf3 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:38.595745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b42a2c5-bd86-4c1a-bbe1-9e09410acdf3 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:38.603431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b42a2c5-bd86-4c1a-bbe1-9e09410acdf3 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:38.606461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b42a2c5-bd86-4c1a-bbe1-9e09410acdf3 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:38.612993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b42a2c5-bd86-4c1a-bbe1-9e09410acdf3 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:39.116504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3b42a2c5-bd86-4c1a-bbe1-9e09410acdf3 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:39.141032 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3b42a2c5-bd86-4c1a-bbe1-9e09410acdf3 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:39.145917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3b42a2c5-bd86-4c1a-bbe1-9e09410acdf3 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:39.149473 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3b42a2c5-bd86-4c1a-bbe1-9e09410acdf3 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1752 microversion: 2.20 time: 0.626958 Oct 29 01:34:39.174242 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3038/5842] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:38 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1752 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:40.189134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e7a517c0-8d2d-4e66-aa76-6204c3fc1620 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:40.189134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e7a517c0-8d2d-4e66-aa76-6204c3fc1620 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:40.202131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7a517c0-8d2d-4e66-aa76-6204c3fc1620 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:40.206902 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7a517c0-8d2d-4e66-aa76-6204c3fc1620 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:40.209396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7a517c0-8d2d-4e66-aa76-6204c3fc1620 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:40.210788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7a517c0-8d2d-4e66-aa76-6204c3fc1620 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:40.211565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7a517c0-8d2d-4e66-aa76-6204c3fc1620 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:40.214457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7a517c0-8d2d-4e66-aa76-6204c3fc1620 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:40.594000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e7a517c0-8d2d-4e66-aa76-6204c3fc1620 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:40.607589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e7a517c0-8d2d-4e66-aa76-6204c3fc1620 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:40.610601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e7a517c0-8d2d-4e66-aa76-6204c3fc1620 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:40.612057 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e7a517c0-8d2d-4e66-aa76-6204c3fc1620 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1752 microversion: 2.20 time: 0.434785 Oct 29 01:34:40.613353 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2805/5843] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:40 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1752 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:41.642189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-59c55e6a-dd01-446b-bdb5-2911965c247b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:41.642862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-59c55e6a-dd01-446b-bdb5-2911965c247b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:41.655917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59c55e6a-dd01-446b-bdb5-2911965c247b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:41.656293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59c55e6a-dd01-446b-bdb5-2911965c247b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:41.656750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59c55e6a-dd01-446b-bdb5-2911965c247b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:41.657527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59c55e6a-dd01-446b-bdb5-2911965c247b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:41.657993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59c55e6a-dd01-446b-bdb5-2911965c247b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:41.658428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59c55e6a-dd01-446b-bdb5-2911965c247b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:42.040652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-59c55e6a-dd01-446b-bdb5-2911965c247b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:42.058044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-59c55e6a-dd01-446b-bdb5-2911965c247b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:42.059518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-59c55e6a-dd01-446b-bdb5-2911965c247b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:42.060751 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-59c55e6a-dd01-446b-bdb5-2911965c247b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1752 microversion: 2.20 time: 0.423207 Oct 29 01:34:42.061739 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3039/5844] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:41 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1752 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:43.087157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b16761c4-3288-4c69-98a6-e3d2102489dd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:43.087773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b16761c4-3288-4c69-98a6-e3d2102489dd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:43.107841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b16761c4-3288-4c69-98a6-e3d2102489dd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:43.111654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b16761c4-3288-4c69-98a6-e3d2102489dd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:43.114406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b16761c4-3288-4c69-98a6-e3d2102489dd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:43.115886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b16761c4-3288-4c69-98a6-e3d2102489dd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:43.116533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b16761c4-3288-4c69-98a6-e3d2102489dd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:43.117218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b16761c4-3288-4c69-98a6-e3d2102489dd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:43.490549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b16761c4-3288-4c69-98a6-e3d2102489dd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:43.507496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b16761c4-3288-4c69-98a6-e3d2102489dd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:43.510691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b16761c4-3288-4c69-98a6-e3d2102489dd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:43.514337 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b16761c4-3288-4c69-98a6-e3d2102489dd tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1752 microversion: 2.20 time: 0.431434 Oct 29 01:34:43.525822 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2806/5845] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:43 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1752 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:34:44.548019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-97550d7d-8eef-4972-b46d-bd7a7eb90430 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:44.548722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-97550d7d-8eef-4972-b46d-bd7a7eb90430 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:44.562586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97550d7d-8eef-4972-b46d-bd7a7eb90430 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:44.563089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97550d7d-8eef-4972-b46d-bd7a7eb90430 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:44.563536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97550d7d-8eef-4972-b46d-bd7a7eb90430 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:44.566991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97550d7d-8eef-4972-b46d-bd7a7eb90430 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:44.567758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97550d7d-8eef-4972-b46d-bd7a7eb90430 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:44.570807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-97550d7d-8eef-4972-b46d-bd7a7eb90430 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:44.896751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-82d1442a-2ecd-4412-a2eb-448667ce5583 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:44.899302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-82d1442a-2ecd-4412-a2eb-448667ce5583 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:44.931473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82d1442a-2ecd-4412-a2eb-448667ce5583 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:44.931473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82d1442a-2ecd-4412-a2eb-448667ce5583 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:44.931473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82d1442a-2ecd-4412-a2eb-448667ce5583 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:44.931473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82d1442a-2ecd-4412-a2eb-448667ce5583 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:44.931473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82d1442a-2ecd-4412-a2eb-448667ce5583 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:44.931473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82d1442a-2ecd-4412-a2eb-448667ce5583 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:44.977027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-97550d7d-8eef-4972-b46d-bd7a7eb90430 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:44.995942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-97550d7d-8eef-4972-b46d-bd7a7eb90430 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:45.018081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-97550d7d-8eef-4972-b46d-bd7a7eb90430 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:45.019787 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-97550d7d-8eef-4972-b46d-bd7a7eb90430 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1752 microversion: 2.20 time: 0.475696 Oct 29 01:34:45.025956 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3040/5846] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:44 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1752 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:45.102642 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-82d1442a-2ecd-4412-a2eb-448667ce5583 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24/action" status: 200 len: 24570 microversion: 2.1 time: 0.210131 Oct 29 01:34:45.105134 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2807/5847] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:34:44 2022] POST /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24/action => generated 24570 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:34:46.052674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f842eb72-8107-4d2e-818f-dff7916302af tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:46.053364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f842eb72-8107-4d2e-818f-dff7916302af tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:46.070471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f842eb72-8107-4d2e-818f-dff7916302af tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:46.071743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f842eb72-8107-4d2e-818f-dff7916302af tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:46.072122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f842eb72-8107-4d2e-818f-dff7916302af tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:46.072980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f842eb72-8107-4d2e-818f-dff7916302af tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:46.073466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f842eb72-8107-4d2e-818f-dff7916302af tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:46.073895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f842eb72-8107-4d2e-818f-dff7916302af tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:46.596474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f842eb72-8107-4d2e-818f-dff7916302af tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:46.626118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f842eb72-8107-4d2e-818f-dff7916302af tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:46.629988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f842eb72-8107-4d2e-818f-dff7916302af tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:46.631704 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f842eb72-8107-4d2e-818f-dff7916302af tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1752 microversion: 2.20 time: 0.583690 Oct 29 01:34:46.637642 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3041/5848] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:46 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1752 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:47.667733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fd537dd5-598c-4ee1-a13c-859d3a1300ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:47.669038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fd537dd5-598c-4ee1-a13c-859d3a1300ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:47.682664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd537dd5-598c-4ee1-a13c-859d3a1300ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:47.685837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd537dd5-598c-4ee1-a13c-859d3a1300ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:47.685837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd537dd5-598c-4ee1-a13c-859d3a1300ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:47.685837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd537dd5-598c-4ee1-a13c-859d3a1300ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:47.685837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd537dd5-598c-4ee1-a13c-859d3a1300ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:47.691632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd537dd5-598c-4ee1-a13c-859d3a1300ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:48.012859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fd537dd5-598c-4ee1-a13c-859d3a1300ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:48.025660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fd537dd5-598c-4ee1-a13c-859d3a1300ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:48.027643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fd537dd5-598c-4ee1-a13c-859d3a1300ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:48.028869 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fd537dd5-598c-4ee1-a13c-859d3a1300ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1752 microversion: 2.20 time: 0.365617 Oct 29 01:34:48.029799 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2808/5849] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:47 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1752 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:49.058665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6d703181-0409-4a54-b312-eda678589f6f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:49.059975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6d703181-0409-4a54-b312-eda678589f6f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:49.077894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d703181-0409-4a54-b312-eda678589f6f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:49.078877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d703181-0409-4a54-b312-eda678589f6f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:49.080419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d703181-0409-4a54-b312-eda678589f6f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:49.084123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d703181-0409-4a54-b312-eda678589f6f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:49.085324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d703181-0409-4a54-b312-eda678589f6f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:49.085933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d703181-0409-4a54-b312-eda678589f6f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:49.642425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6d703181-0409-4a54-b312-eda678589f6f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:49.664390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6d703181-0409-4a54-b312-eda678589f6f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:49.670890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6d703181-0409-4a54-b312-eda678589f6f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:49.672194 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6d703181-0409-4a54-b312-eda678589f6f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1752 microversion: 2.20 time: 0.618368 Oct 29 01:34:49.672770 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3042/5850] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:49 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1752 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:50.703620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ad3cc188-fc9b-48aa-a7a7-0cb589d38a60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:50.704345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ad3cc188-fc9b-48aa-a7a7-0cb589d38a60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:50.716034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad3cc188-fc9b-48aa-a7a7-0cb589d38a60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:50.718576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad3cc188-fc9b-48aa-a7a7-0cb589d38a60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:50.719180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad3cc188-fc9b-48aa-a7a7-0cb589d38a60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:50.720345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad3cc188-fc9b-48aa-a7a7-0cb589d38a60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:50.721110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad3cc188-fc9b-48aa-a7a7-0cb589d38a60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:50.722240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad3cc188-fc9b-48aa-a7a7-0cb589d38a60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:51.073725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ad3cc188-fc9b-48aa-a7a7-0cb589d38a60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:51.100359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ad3cc188-fc9b-48aa-a7a7-0cb589d38a60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:51.101921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ad3cc188-fc9b-48aa-a7a7-0cb589d38a60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:51.105029 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ad3cc188-fc9b-48aa-a7a7-0cb589d38a60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.405986 Oct 29 01:34:51.113196 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2809/5851] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:50 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:52.136406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-54283d7f-d275-4a2e-9772-a4d7d33a68b7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:52.137752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-54283d7f-d275-4a2e-9772-a4d7d33a68b7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:52.146144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54283d7f-d275-4a2e-9772-a4d7d33a68b7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:52.146959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54283d7f-d275-4a2e-9772-a4d7d33a68b7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:52.147620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54283d7f-d275-4a2e-9772-a4d7d33a68b7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:52.148565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54283d7f-d275-4a2e-9772-a4d7d33a68b7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:52.149271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54283d7f-d275-4a2e-9772-a4d7d33a68b7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:52.149914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54283d7f-d275-4a2e-9772-a4d7d33a68b7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:52.363575 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-54283d7f-d275-4a2e-9772-a4d7d33a68b7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:52.380238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-54283d7f-d275-4a2e-9772-a4d7d33a68b7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:52.393317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-54283d7f-d275-4a2e-9772-a4d7d33a68b7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:52.393317 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-54283d7f-d275-4a2e-9772-a4d7d33a68b7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.252150 Oct 29 01:34:52.393317 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3043/5852] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:52 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:52.892123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-48508809-5d2a-4bb7-b310-e71b65714ad8 req-0e46b27c-2e85-4cb6-ba38-521cea1f4b4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db08ce62-9806-4b5e-90e6-ca4fe64a2885", "tag": "9a179e9f-8e3d-4dcd-b553-24e9832a186e"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:52.925011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-48508809-5d2a-4bb7-b310-e71b65714ad8 req-0e46b27c-2e85-4cb6-ba38-521cea1f4b4f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:52.928241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-48508809-5d2a-4bb7-b310-e71b65714ad8 req-0e46b27c-2e85-4cb6-ba38-521cea1f4b4f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:52.934715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-48508809-5d2a-4bb7-b310-e71b65714ad8 req-0e46b27c-2e85-4cb6-ba38-521cea1f4b4f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:53.020770 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-48508809-5d2a-4bb7-b310-e71b65714ad8 req-0e46b27c-2e85-4cb6-ba38-521cea1f4b4f service nova] Creating event network-changed:9a179e9f-8e3d-4dcd-b553-24e9832a186e for instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 on n-h2-862964-3 Oct 29 01:34:53.052001 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-48508809-5d2a-4bb7-b310-e71b65714ad8 req-0e46b27c-2e85-4cb6-ba38-521cea1f4b4f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169992 Oct 29 01:34:53.058608 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2810/5853] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:34:53.417478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6d287cd3-e339-4f1b-a4cb-671870109bed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:53.418848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6d287cd3-e339-4f1b-a4cb-671870109bed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:53.435393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d287cd3-e339-4f1b-a4cb-671870109bed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:53.437664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d287cd3-e339-4f1b-a4cb-671870109bed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:53.439667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d287cd3-e339-4f1b-a4cb-671870109bed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:53.442759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d287cd3-e339-4f1b-a4cb-671870109bed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:53.444639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d287cd3-e339-4f1b-a4cb-671870109bed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:53.445365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d287cd3-e339-4f1b-a4cb-671870109bed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:53.971710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6d287cd3-e339-4f1b-a4cb-671870109bed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:53.986116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6d287cd3-e339-4f1b-a4cb-671870109bed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:53.988379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6d287cd3-e339-4f1b-a4cb-671870109bed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:53.991087 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6d287cd3-e339-4f1b-a4cb-671870109bed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.578907 Oct 29 01:34:53.991951 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3044/5854] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:53 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:55.030326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e0203894-4661-4e0d-bcfb-cb8a5a068c2e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:55.034667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e0203894-4661-4e0d-bcfb-cb8a5a068c2e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:55.064451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0203894-4661-4e0d-bcfb-cb8a5a068c2e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:55.066558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0203894-4661-4e0d-bcfb-cb8a5a068c2e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:55.067125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0203894-4661-4e0d-bcfb-cb8a5a068c2e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:55.070094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0203894-4661-4e0d-bcfb-cb8a5a068c2e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:55.072086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0203894-4661-4e0d-bcfb-cb8a5a068c2e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:55.074245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0203894-4661-4e0d-bcfb-cb8a5a068c2e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:55.490026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e0203894-4661-4e0d-bcfb-cb8a5a068c2e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:55.492526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:34:55.519329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e0203894-4661-4e0d-bcfb-cb8a5a068c2e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:55.521536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e0203894-4661-4e0d-bcfb-cb8a5a068c2e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:55.528489 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e0203894-4661-4e0d-bcfb-cb8a5a068c2e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.509842 Oct 29 01:34:55.539947 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2811/5855] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:55 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:56.564314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f6d871d7-3ef3-4095-8d4f-9a3a5ced84e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:56.564935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f6d871d7-3ef3-4095-8d4f-9a3a5ced84e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:56.579721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6d871d7-3ef3-4095-8d4f-9a3a5ced84e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:56.583874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6d871d7-3ef3-4095-8d4f-9a3a5ced84e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:56.584334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6d871d7-3ef3-4095-8d4f-9a3a5ced84e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:56.585091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6d871d7-3ef3-4095-8d4f-9a3a5ced84e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:56.585587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6d871d7-3ef3-4095-8d4f-9a3a5ced84e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:56.586019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6d871d7-3ef3-4095-8d4f-9a3a5ced84e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:56.884083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f6d871d7-3ef3-4095-8d4f-9a3a5ced84e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:56.919007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f6d871d7-3ef3-4095-8d4f-9a3a5ced84e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:56.942460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f6d871d7-3ef3-4095-8d4f-9a3a5ced84e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:56.946921 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f6d871d7-3ef3-4095-8d4f-9a3a5ced84e7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.388240 Oct 29 01:34:56.947435 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3045/5856] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:56 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:57.987289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6f8df121-a4f1-4119-b7a1-55cec082fb0e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:57.993020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6f8df121-a4f1-4119-b7a1-55cec082fb0e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:58.022104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f8df121-a4f1-4119-b7a1-55cec082fb0e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:58.025782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f8df121-a4f1-4119-b7a1-55cec082fb0e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:58.027163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f8df121-a4f1-4119-b7a1-55cec082fb0e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:58.030679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f8df121-a4f1-4119-b7a1-55cec082fb0e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:58.030679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f8df121-a4f1-4119-b7a1-55cec082fb0e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:58.030679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f8df121-a4f1-4119-b7a1-55cec082fb0e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:58.389589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6f8df121-a4f1-4119-b7a1-55cec082fb0e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:58.404040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6f8df121-a4f1-4119-b7a1-55cec082fb0e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:58.408372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6f8df121-a4f1-4119-b7a1-55cec082fb0e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:58.412638 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6f8df121-a4f1-4119-b7a1-55cec082fb0e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.439035 Oct 29 01:34:58.414093 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2812/5857] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:57 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:59.454166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ff59867b-1fad-48c6-a3cd-1b5f0271c518 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:59.458255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ff59867b-1fad-48c6-a3cd-1b5f0271c518 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:34:59.494043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff59867b-1fad-48c6-a3cd-1b5f0271c518 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:59.497367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff59867b-1fad-48c6-a3cd-1b5f0271c518 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:59.502163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff59867b-1fad-48c6-a3cd-1b5f0271c518 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:59.517878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff59867b-1fad-48c6-a3cd-1b5f0271c518 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:34:59.519382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff59867b-1fad-48c6-a3cd-1b5f0271c518 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:34:59.539112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff59867b-1fad-48c6-a3cd-1b5f0271c518 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:34:59.924100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ff59867b-1fad-48c6-a3cd-1b5f0271c518 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:59.963293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ff59867b-1fad-48c6-a3cd-1b5f0271c518 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:59.965471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ff59867b-1fad-48c6-a3cd-1b5f0271c518 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:59.971890 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ff59867b-1fad-48c6-a3cd-1b5f0271c518 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.527495 Oct 29 01:34:59.973471 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3046/5858] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:34:59 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:01.014170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5e00e832-451d-48e4-9c46-3a3fc82a1e60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:01.015737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5e00e832-451d-48e4-9c46-3a3fc82a1e60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:01.030870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e00e832-451d-48e4-9c46-3a3fc82a1e60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:01.032477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e00e832-451d-48e4-9c46-3a3fc82a1e60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:01.036417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e00e832-451d-48e4-9c46-3a3fc82a1e60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:01.037767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e00e832-451d-48e4-9c46-3a3fc82a1e60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:01.039906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e00e832-451d-48e4-9c46-3a3fc82a1e60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:01.039906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e00e832-451d-48e4-9c46-3a3fc82a1e60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:01.554387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5e00e832-451d-48e4-9c46-3a3fc82a1e60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:01.582824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5e00e832-451d-48e4-9c46-3a3fc82a1e60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:01.585310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5e00e832-451d-48e4-9c46-3a3fc82a1e60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:01.589477 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5e00e832-451d-48e4-9c46-3a3fc82a1e60 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.582262 Oct 29 01:35:01.614946 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2813/5859] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:01 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:02.622925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0312eafa-e652-471f-bfa0-b07cff286a18 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:02.623492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0312eafa-e652-471f-bfa0-b07cff286a18 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:02.643366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0312eafa-e652-471f-bfa0-b07cff286a18 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:02.644541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0312eafa-e652-471f-bfa0-b07cff286a18 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:02.647497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0312eafa-e652-471f-bfa0-b07cff286a18 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:02.647497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0312eafa-e652-471f-bfa0-b07cff286a18 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:02.647497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0312eafa-e652-471f-bfa0-b07cff286a18 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:02.647497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0312eafa-e652-471f-bfa0-b07cff286a18 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:02.666268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:35:03.269309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0312eafa-e652-471f-bfa0-b07cff286a18 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:03.295612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0312eafa-e652-471f-bfa0-b07cff286a18 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:03.319923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0312eafa-e652-471f-bfa0-b07cff286a18 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:03.338823 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0312eafa-e652-471f-bfa0-b07cff286a18 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.704537 Oct 29 01:35:03.339567 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3047/5860] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:02 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:04.375385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3544d33f-21cb-4bde-865b-c7227848515d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:04.376029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3544d33f-21cb-4bde-865b-c7227848515d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:04.402932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=26 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:35:04.405700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3544d33f-21cb-4bde-865b-c7227848515d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:04.407865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3544d33f-21cb-4bde-865b-c7227848515d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:04.410873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3544d33f-21cb-4bde-865b-c7227848515d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:04.413620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3544d33f-21cb-4bde-865b-c7227848515d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:04.414668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3544d33f-21cb-4bde-865b-c7227848515d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:04.417380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3544d33f-21cb-4bde-865b-c7227848515d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:04.765666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3544d33f-21cb-4bde-865b-c7227848515d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:04.783056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3544d33f-21cb-4bde-865b-c7227848515d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:04.792563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3544d33f-21cb-4bde-865b-c7227848515d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:04.793922 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3544d33f-21cb-4bde-865b-c7227848515d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.424454 Oct 29 01:35:04.794509 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2814/5861] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:04 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:05.832104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f570de6-d9ac-4ccd-8451-81c978fa7768 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:05.833417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1f570de6-d9ac-4ccd-8451-81c978fa7768 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:05.861802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f570de6-d9ac-4ccd-8451-81c978fa7768 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:05.863133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f570de6-d9ac-4ccd-8451-81c978fa7768 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:05.865061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f570de6-d9ac-4ccd-8451-81c978fa7768 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:05.874464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f570de6-d9ac-4ccd-8451-81c978fa7768 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:05.874986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f570de6-d9ac-4ccd-8451-81c978fa7768 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:05.877219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f570de6-d9ac-4ccd-8451-81c978fa7768 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:06.229677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1f570de6-d9ac-4ccd-8451-81c978fa7768 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:06.244113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1f570de6-d9ac-4ccd-8451-81c978fa7768 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:06.245812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1f570de6-d9ac-4ccd-8451-81c978fa7768 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:06.257436 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1f570de6-d9ac-4ccd-8451-81c978fa7768 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.425190 Oct 29 01:35:06.258469 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3048/5862] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:05 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:07.286021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a94c3ec9-3af0-457d-ae72-8782d1ed969d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:07.290647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a94c3ec9-3af0-457d-ae72-8782d1ed969d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:07.316311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a94c3ec9-3af0-457d-ae72-8782d1ed969d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:07.332607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a94c3ec9-3af0-457d-ae72-8782d1ed969d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:07.333110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a94c3ec9-3af0-457d-ae72-8782d1ed969d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:07.342335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a94c3ec9-3af0-457d-ae72-8782d1ed969d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:07.343211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a94c3ec9-3af0-457d-ae72-8782d1ed969d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:07.343844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a94c3ec9-3af0-457d-ae72-8782d1ed969d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:08.282985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a94c3ec9-3af0-457d-ae72-8782d1ed969d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:08.310588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a94c3ec9-3af0-457d-ae72-8782d1ed969d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:08.323780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a94c3ec9-3af0-457d-ae72-8782d1ed969d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:08.326469 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a94c3ec9-3af0-457d-ae72-8782d1ed969d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 1.049662 Oct 29 01:35:08.329838 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2815/5863] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:07 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:09.360245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3b381fca-47ab-4b51-9d99-dd8852a5b7e8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:09.361049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3b381fca-47ab-4b51-9d99-dd8852a5b7e8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:09.376500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=24 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:35:09.406171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b381fca-47ab-4b51-9d99-dd8852a5b7e8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:09.414845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b381fca-47ab-4b51-9d99-dd8852a5b7e8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:09.417956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b381fca-47ab-4b51-9d99-dd8852a5b7e8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:09.428773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b381fca-47ab-4b51-9d99-dd8852a5b7e8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:09.433192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b381fca-47ab-4b51-9d99-dd8852a5b7e8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:09.434910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b381fca-47ab-4b51-9d99-dd8852a5b7e8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:10.186995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3b381fca-47ab-4b51-9d99-dd8852a5b7e8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:10.199251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3b381fca-47ab-4b51-9d99-dd8852a5b7e8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:10.212210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3b381fca-47ab-4b51-9d99-dd8852a5b7e8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:10.213805 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3b381fca-47ab-4b51-9d99-dd8852a5b7e8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.857776 Oct 29 01:35:10.233922 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3049/5864] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:09 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:11.248324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b06a54b0-1f9c-426b-901e-0c7029c59fad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:11.248947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b06a54b0-1f9c-426b-901e-0c7029c59fad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:11.273681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b06a54b0-1f9c-426b-901e-0c7029c59fad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:11.274184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b06a54b0-1f9c-426b-901e-0c7029c59fad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:11.274633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b06a54b0-1f9c-426b-901e-0c7029c59fad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:11.285994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b06a54b0-1f9c-426b-901e-0c7029c59fad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:11.286503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b06a54b0-1f9c-426b-901e-0c7029c59fad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:11.297994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b06a54b0-1f9c-426b-901e-0c7029c59fad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:12.012980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b06a54b0-1f9c-426b-901e-0c7029c59fad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:12.039751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b06a54b0-1f9c-426b-901e-0c7029c59fad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:12.053475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b06a54b0-1f9c-426b-901e-0c7029c59fad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:12.163630 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b06a54b0-1f9c-426b-901e-0c7029c59fad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.810994 Oct 29 01:35:12.163630 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2816/5865] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:11 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:13.104276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a790d3a8-013e-41e1-8cf6-479ed188415d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:13.104911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a790d3a8-013e-41e1-8cf6-479ed188415d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:13.119386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a790d3a8-013e-41e1-8cf6-479ed188415d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:13.123116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a790d3a8-013e-41e1-8cf6-479ed188415d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:13.123116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a790d3a8-013e-41e1-8cf6-479ed188415d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:13.123116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a790d3a8-013e-41e1-8cf6-479ed188415d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:13.123116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a790d3a8-013e-41e1-8cf6-479ed188415d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:13.125036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a790d3a8-013e-41e1-8cf6-479ed188415d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:13.724916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a790d3a8-013e-41e1-8cf6-479ed188415d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:13.739664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a790d3a8-013e-41e1-8cf6-479ed188415d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:13.741623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a790d3a8-013e-41e1-8cf6-479ed188415d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:13.743072 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a790d3a8-013e-41e1-8cf6-479ed188415d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.646684 Oct 29 01:35:13.760229 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3050/5866] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:13 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:14.774659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ae2c13d8-12fd-4c75-899f-d7d8ceff1d11 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:14.777055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ae2c13d8-12fd-4c75-899f-d7d8ceff1d11 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:14.788950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae2c13d8-12fd-4c75-899f-d7d8ceff1d11 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:14.790020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae2c13d8-12fd-4c75-899f-d7d8ceff1d11 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:14.790715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae2c13d8-12fd-4c75-899f-d7d8ceff1d11 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:14.791894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae2c13d8-12fd-4c75-899f-d7d8ceff1d11 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:14.792762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae2c13d8-12fd-4c75-899f-d7d8ceff1d11 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:14.793435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae2c13d8-12fd-4c75-899f-d7d8ceff1d11 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:15.034975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ae2c13d8-12fd-4c75-899f-d7d8ceff1d11 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:15.045639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ae2c13d8-12fd-4c75-899f-d7d8ceff1d11 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:15.054326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ae2c13d8-12fd-4c75-899f-d7d8ceff1d11 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:15.055974 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ae2c13d8-12fd-4c75-899f-d7d8ceff1d11 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.287981 Oct 29 01:35:15.071757 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2817/5867] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:14 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:16.084709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-18422472-dd53-4025-86cd-51c9cd53900a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:16.085454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-18422472-dd53-4025-86cd-51c9cd53900a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:16.095314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18422472-dd53-4025-86cd-51c9cd53900a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:16.095314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18422472-dd53-4025-86cd-51c9cd53900a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:16.095314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18422472-dd53-4025-86cd-51c9cd53900a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:16.095314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18422472-dd53-4025-86cd-51c9cd53900a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:16.095314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18422472-dd53-4025-86cd-51c9cd53900a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:16.096012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18422472-dd53-4025-86cd-51c9cd53900a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:16.999310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-18422472-dd53-4025-86cd-51c9cd53900a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:17.020291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-18422472-dd53-4025-86cd-51c9cd53900a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:17.031458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-18422472-dd53-4025-86cd-51c9cd53900a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:17.032926 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-18422472-dd53-4025-86cd-51c9cd53900a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.953490 Oct 29 01:35:17.045339 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3051/5868] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:16 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:18.062775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c4a15a83-c1e8-458c-aebd-dff0471b6eca tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:18.064002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c4a15a83-c1e8-458c-aebd-dff0471b6eca tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:18.095634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4a15a83-c1e8-458c-aebd-dff0471b6eca tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:18.096674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4a15a83-c1e8-458c-aebd-dff0471b6eca tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:18.097231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4a15a83-c1e8-458c-aebd-dff0471b6eca tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:18.097967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4a15a83-c1e8-458c-aebd-dff0471b6eca tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:18.098429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4a15a83-c1e8-458c-aebd-dff0471b6eca tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:18.105748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4a15a83-c1e8-458c-aebd-dff0471b6eca tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:18.466215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c4a15a83-c1e8-458c-aebd-dff0471b6eca tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:18.494560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c4a15a83-c1e8-458c-aebd-dff0471b6eca tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:18.497393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c4a15a83-c1e8-458c-aebd-dff0471b6eca tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:18.498878 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c4a15a83-c1e8-458c-aebd-dff0471b6eca tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.440955 Oct 29 01:35:18.512312 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2818/5869] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:18 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:19.540868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-59a15632-d8a8-4738-9174-57ccbac30c7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:19.541531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-59a15632-d8a8-4738-9174-57ccbac30c7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:19.552930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a15632-d8a8-4738-9174-57ccbac30c7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:19.565294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a15632-d8a8-4738-9174-57ccbac30c7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:19.569498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a15632-d8a8-4738-9174-57ccbac30c7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:19.569498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a15632-d8a8-4738-9174-57ccbac30c7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:19.569498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a15632-d8a8-4738-9174-57ccbac30c7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:19.569498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a15632-d8a8-4738-9174-57ccbac30c7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:19.994584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-59a15632-d8a8-4738-9174-57ccbac30c7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:20.005648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-59a15632-d8a8-4738-9174-57ccbac30c7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:20.007208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-59a15632-d8a8-4738-9174-57ccbac30c7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:20.008710 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-59a15632-d8a8-4738-9174-57ccbac30c7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.472525 Oct 29 01:35:20.010029 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3052/5870] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:19 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:21.056260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e7ca27f6-4624-4df7-a68c-5c836ea6782f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:21.057970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e7ca27f6-4624-4df7-a68c-5c836ea6782f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:21.067480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7ca27f6-4624-4df7-a68c-5c836ea6782f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:21.068334 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7ca27f6-4624-4df7-a68c-5c836ea6782f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:21.084689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7ca27f6-4624-4df7-a68c-5c836ea6782f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:21.086215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7ca27f6-4624-4df7-a68c-5c836ea6782f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:21.087504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7ca27f6-4624-4df7-a68c-5c836ea6782f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:21.088280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7ca27f6-4624-4df7-a68c-5c836ea6782f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:21.661058 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e7ca27f6-4624-4df7-a68c-5c836ea6782f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:21.695670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e7ca27f6-4624-4df7-a68c-5c836ea6782f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:21.700260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e7ca27f6-4624-4df7-a68c-5c836ea6782f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:21.702760 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e7ca27f6-4624-4df7-a68c-5c836ea6782f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.668622 Oct 29 01:35:21.706030 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2819/5871] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:21 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:22.731895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9ff80804-b1fa-4771-b2d7-00bb1e6ab461 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:22.733096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9ff80804-b1fa-4771-b2d7-00bb1e6ab461 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:22.741251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ff80804-b1fa-4771-b2d7-00bb1e6ab461 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:22.747574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ff80804-b1fa-4771-b2d7-00bb1e6ab461 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:22.750175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ff80804-b1fa-4771-b2d7-00bb1e6ab461 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:22.751161 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ff80804-b1fa-4771-b2d7-00bb1e6ab461 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:22.751795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ff80804-b1fa-4771-b2d7-00bb1e6ab461 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:22.752221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ff80804-b1fa-4771-b2d7-00bb1e6ab461 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:23.167805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9ff80804-b1fa-4771-b2d7-00bb1e6ab461 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:23.183423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9ff80804-b1fa-4771-b2d7-00bb1e6ab461 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:23.184883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9ff80804-b1fa-4771-b2d7-00bb1e6ab461 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:23.186959 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9ff80804-b1fa-4771-b2d7-00bb1e6ab461 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.458138 Oct 29 01:35:23.213166 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3053/5872] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:22 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:23.865875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d4e441eb-b154-43b2-bdf6-2b10b1d36822 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:23.866817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d4e441eb-b154-43b2-bdf6-2b10b1d36822 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:23.875280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4e441eb-b154-43b2-bdf6-2b10b1d36822 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:23.875770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4e441eb-b154-43b2-bdf6-2b10b1d36822 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:23.876208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4e441eb-b154-43b2-bdf6-2b10b1d36822 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:23.877194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4e441eb-b154-43b2-bdf6-2b10b1d36822 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:23.877722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4e441eb-b154-43b2-bdf6-2b10b1d36822 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:23.878187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4e441eb-b154-43b2-bdf6-2b10b1d36822 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:24.242681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c17e6425-9acb-4f1d-8e6c-84ce175a9606 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:24.243963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c17e6425-9acb-4f1d-8e6c-84ce175a9606 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:24.255027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c17e6425-9acb-4f1d-8e6c-84ce175a9606 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:24.260247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c17e6425-9acb-4f1d-8e6c-84ce175a9606 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:24.260954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c17e6425-9acb-4f1d-8e6c-84ce175a9606 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:24.262770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c17e6425-9acb-4f1d-8e6c-84ce175a9606 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:24.266304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c17e6425-9acb-4f1d-8e6c-84ce175a9606 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:24.267028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c17e6425-9acb-4f1d-8e6c-84ce175a9606 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:24.863560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c17e6425-9acb-4f1d-8e6c-84ce175a9606 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:24.926717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c17e6425-9acb-4f1d-8e6c-84ce175a9606 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:24.933276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c17e6425-9acb-4f1d-8e6c-84ce175a9606 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:24.947783 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c17e6425-9acb-4f1d-8e6c-84ce175a9606 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.706869 Oct 29 01:35:24.961859 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3054/5873] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:24 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:25.085872 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d4e441eb-b154-43b2-bdf6-2b10b1d36822 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1832 microversion: 2.1 time: 1.224614 Oct 29 01:35:25.097195 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2820/5874] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:23 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1832 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:25.113319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cc63331b-7d22-4ee1-abbd-7c3d6a60ba22 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:25.115603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cc63331b-7d22-4ee1-abbd-7c3d6a60ba22 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:25.128127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc63331b-7d22-4ee1-abbd-7c3d6a60ba22 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:25.128763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc63331b-7d22-4ee1-abbd-7c3d6a60ba22 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:25.130739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc63331b-7d22-4ee1-abbd-7c3d6a60ba22 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:25.131798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc63331b-7d22-4ee1-abbd-7c3d6a60ba22 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:25.133782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc63331b-7d22-4ee1-abbd-7c3d6a60ba22 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:25.134468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc63331b-7d22-4ee1-abbd-7c3d6a60ba22 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:25.689514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cc63331b-7d22-4ee1-abbd-7c3d6a60ba22 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:25.705604 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cc63331b-7d22-4ee1-abbd-7c3d6a60ba22 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1681 microversion: 2.1 time: 0.596753 Oct 29 01:35:25.707615 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3055/5875] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:25 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1681 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:25.982107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c767cb96-841c-4056-8806-0b3397de3785 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:25.982941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c767cb96-841c-4056-8806-0b3397de3785 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:25.995045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c767cb96-841c-4056-8806-0b3397de3785 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:25.995933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c767cb96-841c-4056-8806-0b3397de3785 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:25.997213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c767cb96-841c-4056-8806-0b3397de3785 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:25.999831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c767cb96-841c-4056-8806-0b3397de3785 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:26.000666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c767cb96-841c-4056-8806-0b3397de3785 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:26.001354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c767cb96-841c-4056-8806-0b3397de3785 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:26.036083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ebc0b803-79fc-4ff9-9ea4-ebdfcfab6cda tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:26.046118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ebc0b803-79fc-4ff9-9ea4-ebdfcfab6cda tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:26.080818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebc0b803-79fc-4ff9-9ea4-ebdfcfab6cda tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:26.085448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebc0b803-79fc-4ff9-9ea4-ebdfcfab6cda tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:26.086169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebc0b803-79fc-4ff9-9ea4-ebdfcfab6cda tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:26.090199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebc0b803-79fc-4ff9-9ea4-ebdfcfab6cda tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:26.092405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebc0b803-79fc-4ff9-9ea4-ebdfcfab6cda tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:26.098101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebc0b803-79fc-4ff9-9ea4-ebdfcfab6cda tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:26.213136 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ebc0b803-79fc-4ff9-9ea4-ebdfcfab6cda tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24/action" status: 200 len: 32643 microversion: 2.1 time: 0.188200 Oct 29 01:35:26.231046 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3056/5876] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:35:26 2022] POST /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24/action => generated 32643 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:35:26.372395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d047bde9-c8d8-4e63-9957-3b0133dbda66 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:26.373188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d047bde9-c8d8-4e63-9957-3b0133dbda66 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:26.382968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d047bde9-c8d8-4e63-9957-3b0133dbda66 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:26.383908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d047bde9-c8d8-4e63-9957-3b0133dbda66 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:26.384530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d047bde9-c8d8-4e63-9957-3b0133dbda66 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:26.385596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d047bde9-c8d8-4e63-9957-3b0133dbda66 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:26.386293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d047bde9-c8d8-4e63-9957-3b0133dbda66 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:26.386896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d047bde9-c8d8-4e63-9957-3b0133dbda66 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:26.457217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d047bde9-c8d8-4e63-9957-3b0133dbda66 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a77ce3edf2b84dbe904f4154a33e9ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88c5606c800429f9dc9092d3d02d20d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:26.457842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d047bde9-c8d8-4e63-9957-3b0133dbda66 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] flavor_id is None. Assuming migration. {{(pid=121099) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 29 01:35:26.458273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d047bde9-c8d8-4e63-9957-3b0133dbda66 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121099) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 01:35:26.486053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c767cb96-841c-4056-8806-0b3397de3785 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:26.511573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c767cb96-841c-4056-8806-0b3397de3785 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:26.519689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c767cb96-841c-4056-8806-0b3397de3785 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:26.521113 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c767cb96-841c-4056-8806-0b3397de3785 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.547220 Oct 29 01:35:26.539550 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2821/5877] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:25 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:27.184544 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d047bde9-c8d8-4e63-9957-3b0133dbda66 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24/action" status: 202 len: 0 microversion: 2.1 time: 0.816439 Oct 29 01:35:27.189097 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3057/5878] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:35:26 2022] POST /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24/action => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:35:27.195732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f0b76a2d-3ebe-498a-a6ee-8827f04a2d0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:27.195732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f0b76a2d-3ebe-498a-a6ee-8827f04a2d0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:27.210420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0b76a2d-3ebe-498a-a6ee-8827f04a2d0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:27.211017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0b76a2d-3ebe-498a-a6ee-8827f04a2d0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:27.211746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0b76a2d-3ebe-498a-a6ee-8827f04a2d0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:27.213026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0b76a2d-3ebe-498a-a6ee-8827f04a2d0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:27.213745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0b76a2d-3ebe-498a-a6ee-8827f04a2d0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:27.214349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0b76a2d-3ebe-498a-a6ee-8827f04a2d0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:27.613837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-b573a29d-7907-4820-8abb-1de155e4a5bd req-2953d1d4-a04e-478f-8c87-1b97ad22aca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db08ce62-9806-4b5e-90e6-ca4fe64a2885", "name": "network-vif-plugged", "status": "completed", "tag": "9a179e9f-8e3d-4dcd-b553-24e9832a186e"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:27.637313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b573a29d-7907-4820-8abb-1de155e4a5bd req-2953d1d4-a04e-478f-8c87-1b97ad22aca8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:27.637890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b573a29d-7907-4820-8abb-1de155e4a5bd req-2953d1d4-a04e-478f-8c87-1b97ad22aca8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:27.639669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b573a29d-7907-4820-8abb-1de155e4a5bd req-2953d1d4-a04e-478f-8c87-1b97ad22aca8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:27.684902 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-b573a29d-7907-4820-8abb-1de155e4a5bd req-2953d1d4-a04e-478f-8c87-1b97ad22aca8 service nova] Creating event network-vif-plugged:9a179e9f-8e3d-4dcd-b553-24e9832a186e for instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 on n-h2-862964-3 Oct 29 01:35:27.694936 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-b573a29d-7907-4820-8abb-1de155e4a5bd req-2953d1d4-a04e-478f-8c87-1b97ad22aca8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.321351 Oct 29 01:35:27.695556 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3058/5879] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:35:27.708492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-30e7a373-5d0c-4033-b0c2-6b413964afde tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:27.716293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-30e7a373-5d0c-4033-b0c2-6b413964afde tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:27.741668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30e7a373-5d0c-4033-b0c2-6b413964afde tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:27.742177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30e7a373-5d0c-4033-b0c2-6b413964afde tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:27.742621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30e7a373-5d0c-4033-b0c2-6b413964afde tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:27.746744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30e7a373-5d0c-4033-b0c2-6b413964afde tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:27.748987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30e7a373-5d0c-4033-b0c2-6b413964afde tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:27.750762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30e7a373-5d0c-4033-b0c2-6b413964afde tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:28.681136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f0b76a2d-3ebe-498a-a6ee-8827f04a2d0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:28.689134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=66 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:35:28.694771 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f0b76a2d-3ebe-498a-a6ee-8827f04a2d0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1690 microversion: 2.1 time: 1.504040 Oct 29 01:35:28.698152 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2822/5880] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:27 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1690 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:29.095201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-30e7a373-5d0c-4033-b0c2-6b413964afde tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:29.109188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-30e7a373-5d0c-4033-b0c2-6b413964afde tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:29.114438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-30e7a373-5d0c-4033-b0c2-6b413964afde tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:29.123101 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-30e7a373-5d0c-4033-b0c2-6b413964afde tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 1.412632 Oct 29 01:35:29.139135 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3059/5881] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:27 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:29.730948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c3815b3a-18e3-4f16-8e3d-702201d0311e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:29.731646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c3815b3a-18e3-4f16-8e3d-702201d0311e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:29.748267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3815b3a-18e3-4f16-8e3d-702201d0311e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:29.748778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3815b3a-18e3-4f16-8e3d-702201d0311e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:29.756213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3815b3a-18e3-4f16-8e3d-702201d0311e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:29.757379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3815b3a-18e3-4f16-8e3d-702201d0311e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:29.758017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3815b3a-18e3-4f16-8e3d-702201d0311e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:29.758320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c3815b3a-18e3-4f16-8e3d-702201d0311e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:30.161092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a2aa4c78-1994-433e-aa4c-a6c247a3b2b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:30.161726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a2aa4c78-1994-433e-aa4c-a6c247a3b2b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:30.184041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2aa4c78-1994-433e-aa4c-a6c247a3b2b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:30.187796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2aa4c78-1994-433e-aa4c-a6c247a3b2b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:30.198735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2aa4c78-1994-433e-aa4c-a6c247a3b2b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:30.198735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2aa4c78-1994-433e-aa4c-a6c247a3b2b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:30.205736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2aa4c78-1994-433e-aa4c-a6c247a3b2b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:30.206573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a2aa4c78-1994-433e-aa4c-a6c247a3b2b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:30.391983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c3815b3a-18e3-4f16-8e3d-702201d0311e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:30.399063 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c3815b3a-18e3-4f16-8e3d-702201d0311e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1690 microversion: 2.1 time: 0.677790 Oct 29 01:35:30.405109 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2823/5882] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:29 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1690 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:30.626502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a2aa4c78-1994-433e-aa4c-a6c247a3b2b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:30.639264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a2aa4c78-1994-433e-aa4c-a6c247a3b2b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:30.645855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a2aa4c78-1994-433e-aa4c-a6c247a3b2b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:30.649570 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a2aa4c78-1994-433e-aa4c-a6c247a3b2b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.494175 Oct 29 01:35:30.665476 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3060/5883] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:30 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:31.431045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4f0f3310-3590-4aef-82e2-ed6796d4e6dc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:31.439815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4f0f3310-3590-4aef-82e2-ed6796d4e6dc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:31.457410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f0f3310-3590-4aef-82e2-ed6796d4e6dc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:31.457410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f0f3310-3590-4aef-82e2-ed6796d4e6dc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:31.457410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f0f3310-3590-4aef-82e2-ed6796d4e6dc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:31.457776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f0f3310-3590-4aef-82e2-ed6796d4e6dc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:31.458122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f0f3310-3590-4aef-82e2-ed6796d4e6dc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:31.458604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f0f3310-3590-4aef-82e2-ed6796d4e6dc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:31.691340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-932ea3da-6c90-4ddc-a873-c91e2411a5d6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:31.692085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-932ea3da-6c90-4ddc-a873-c91e2411a5d6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:31.726683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-932ea3da-6c90-4ddc-a873-c91e2411a5d6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:31.728086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-932ea3da-6c90-4ddc-a873-c91e2411a5d6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:31.728725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-932ea3da-6c90-4ddc-a873-c91e2411a5d6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:31.729658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-932ea3da-6c90-4ddc-a873-c91e2411a5d6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:31.730307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-932ea3da-6c90-4ddc-a873-c91e2411a5d6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:31.730913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-932ea3da-6c90-4ddc-a873-c91e2411a5d6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:32.566063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-932ea3da-6c90-4ddc-a873-c91e2411a5d6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:32.596672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-932ea3da-6c90-4ddc-a873-c91e2411a5d6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:32.601215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-932ea3da-6c90-4ddc-a873-c91e2411a5d6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:32.602471 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-932ea3da-6c90-4ddc-a873-c91e2411a5d6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.924106 Oct 29 01:35:32.605605 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3061/5884] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:31 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:32.624698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4f0f3310-3590-4aef-82e2-ed6796d4e6dc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:32.644744 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4f0f3310-3590-4aef-82e2-ed6796d4e6dc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1690 microversion: 2.1 time: 1.217178 Oct 29 01:35:32.648301 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2824/5885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:31 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1690 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:33.644832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d66e41cb-46c2-4f7b-bf88-60ba8443914e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:33.645492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d66e41cb-46c2-4f7b-bf88-60ba8443914e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:33.664776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d66e41cb-46c2-4f7b-bf88-60ba8443914e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:33.665620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d66e41cb-46c2-4f7b-bf88-60ba8443914e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:33.670910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d66e41cb-46c2-4f7b-bf88-60ba8443914e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:33.674618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d66e41cb-46c2-4f7b-bf88-60ba8443914e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:33.675638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d66e41cb-46c2-4f7b-bf88-60ba8443914e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:33.677097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d66e41cb-46c2-4f7b-bf88-60ba8443914e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:33.692718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9f4e00d4-b684-4f31-8f44-9d1d9a337bcb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:33.697053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9f4e00d4-b684-4f31-8f44-9d1d9a337bcb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:33.721261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f4e00d4-b684-4f31-8f44-9d1d9a337bcb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:33.723226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f4e00d4-b684-4f31-8f44-9d1d9a337bcb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:33.725506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f4e00d4-b684-4f31-8f44-9d1d9a337bcb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:33.726477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f4e00d4-b684-4f31-8f44-9d1d9a337bcb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:33.729937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f4e00d4-b684-4f31-8f44-9d1d9a337bcb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:33.730599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f4e00d4-b684-4f31-8f44-9d1d9a337bcb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:33.795069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:35:34.467979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d66e41cb-46c2-4f7b-bf88-60ba8443914e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:34.482712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d66e41cb-46c2-4f7b-bf88-60ba8443914e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:34.485756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d66e41cb-46c2-4f7b-bf88-60ba8443914e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:34.491246 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d66e41cb-46c2-4f7b-bf88-60ba8443914e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1808 microversion: 2.20 time: 0.859042 Oct 29 01:35:34.492085 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3062/5886] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:33 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1808 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:34.749797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9f4e00d4-b684-4f31-8f44-9d1d9a337bcb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:34.767205 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9f4e00d4-b684-4f31-8f44-9d1d9a337bcb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1690 microversion: 2.1 time: 1.077909 Oct 29 01:35:34.781090 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2825/5887] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:33 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1690 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:35:35.539328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a3bd8eee-7a49-4b0f-9bcf-376fe57b83e1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:35.540064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a3bd8eee-7a49-4b0f-9bcf-376fe57b83e1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:35.562882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3bd8eee-7a49-4b0f-9bcf-376fe57b83e1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:35.568951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3bd8eee-7a49-4b0f-9bcf-376fe57b83e1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:35.568951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3bd8eee-7a49-4b0f-9bcf-376fe57b83e1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:35.596390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3bd8eee-7a49-4b0f-9bcf-376fe57b83e1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:35.596390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3bd8eee-7a49-4b0f-9bcf-376fe57b83e1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:35.596390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3bd8eee-7a49-4b0f-9bcf-376fe57b83e1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:35.800360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d5e42c29-e200-4996-9bc3-53c460a7ec7d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:35.801008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d5e42c29-e200-4996-9bc3-53c460a7ec7d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:35.810045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5e42c29-e200-4996-9bc3-53c460a7ec7d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:35.810727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5e42c29-e200-4996-9bc3-53c460a7ec7d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:35.811418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5e42c29-e200-4996-9bc3-53c460a7ec7d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:35.812309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5e42c29-e200-4996-9bc3-53c460a7ec7d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:35.813084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5e42c29-e200-4996-9bc3-53c460a7ec7d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:35.813719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5e42c29-e200-4996-9bc3-53c460a7ec7d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:36.057921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a3bd8eee-7a49-4b0f-9bcf-376fe57b83e1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:36.075155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a3bd8eee-7a49-4b0f-9bcf-376fe57b83e1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:36.076991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a3bd8eee-7a49-4b0f-9bcf-376fe57b83e1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:36.078465 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a3bd8eee-7a49-4b0f-9bcf-376fe57b83e1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1795 microversion: 2.20 time: 0.558900 Oct 29 01:35:36.079428 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3063/5888] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:35:35 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1795 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:36.097051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d5e42c29-e200-4996-9bc3-53c460a7ec7d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:36.112375 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d5e42c29-e200-4996-9bc3-53c460a7ec7d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1695 microversion: 2.1 time: 0.319925 Oct 29 01:35:36.113774 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2826/5889] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:35 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1695 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:37.145561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-223a3e1f-965d-488b-9c71-29a0f08acbf2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:37.146112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-223a3e1f-965d-488b-9c71-29a0f08acbf2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:37.153387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-223a3e1f-965d-488b-9c71-29a0f08acbf2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:37.153879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-223a3e1f-965d-488b-9c71-29a0f08acbf2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:37.154318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-223a3e1f-965d-488b-9c71-29a0f08acbf2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:37.155196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-223a3e1f-965d-488b-9c71-29a0f08acbf2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:37.156028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-223a3e1f-965d-488b-9c71-29a0f08acbf2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:37.156650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-223a3e1f-965d-488b-9c71-29a0f08acbf2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:37.555045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-223a3e1f-965d-488b-9c71-29a0f08acbf2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:37.567210 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-223a3e1f-965d-488b-9c71-29a0f08acbf2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1695 microversion: 2.1 time: 0.426696 Oct 29 01:35:37.567803 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3064/5890] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:37 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1695 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:38.591422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-df5c354d-ebd3-4be2-9354-c31b0ee5b09c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:38.592715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-df5c354d-ebd3-4be2-9354-c31b0ee5b09c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:38.598384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=26 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:35:38.604310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df5c354d-ebd3-4be2-9354-c31b0ee5b09c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:38.607857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df5c354d-ebd3-4be2-9354-c31b0ee5b09c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:38.607857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df5c354d-ebd3-4be2-9354-c31b0ee5b09c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:38.607857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df5c354d-ebd3-4be2-9354-c31b0ee5b09c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:38.607857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df5c354d-ebd3-4be2-9354-c31b0ee5b09c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:38.607857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df5c354d-ebd3-4be2-9354-c31b0ee5b09c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:38.840725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-df5c354d-ebd3-4be2-9354-c31b0ee5b09c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:38.851377 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-df5c354d-ebd3-4be2-9354-c31b0ee5b09c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1695 microversion: 2.1 time: 0.264044 Oct 29 01:35:38.851966 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2827/5891] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:38 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1695 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:39.367072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ba23808a-d960-4585-bad6-352bac50d049 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:39.368951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ba23808a-d960-4585-bad6-352bac50d049 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:39.397504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba23808a-d960-4585-bad6-352bac50d049 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:39.401461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba23808a-d960-4585-bad6-352bac50d049 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:39.405517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba23808a-d960-4585-bad6-352bac50d049 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:39.406520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba23808a-d960-4585-bad6-352bac50d049 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:39.407213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba23808a-d960-4585-bad6-352bac50d049 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:39.407851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ba23808a-d960-4585-bad6-352bac50d049 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:39.788644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ba23808a-d960-4585-bad6-352bac50d049 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:39.799932 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ba23808a-d960-4585-bad6-352bac50d049 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.454995 Oct 29 01:35:39.800528 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3065/5892] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:39 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:39.835973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1d86fe2a-4345-41af-bb70-b57e1e94dce1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:39.835973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1d86fe2a-4345-41af-bb70-b57e1e94dce1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:39.843753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d86fe2a-4345-41af-bb70-b57e1e94dce1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:39.844471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d86fe2a-4345-41af-bb70-b57e1e94dce1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:39.845083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d86fe2a-4345-41af-bb70-b57e1e94dce1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:39.847265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d86fe2a-4345-41af-bb70-b57e1e94dce1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:39.847972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d86fe2a-4345-41af-bb70-b57e1e94dce1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:39.848582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1d86fe2a-4345-41af-bb70-b57e1e94dce1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:39.877474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c1dae99a-a397-446b-ad30-8cd6948c59c6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:39.878086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c1dae99a-a397-446b-ad30-8cd6948c59c6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:39.893786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=36 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:35:39.895982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1dae99a-a397-446b-ad30-8cd6948c59c6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:39.896828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1dae99a-a397-446b-ad30-8cd6948c59c6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:39.897367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1dae99a-a397-446b-ad30-8cd6948c59c6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:39.898412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1dae99a-a397-446b-ad30-8cd6948c59c6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:39.899012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1dae99a-a397-446b-ad30-8cd6948c59c6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:39.899506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1dae99a-a397-446b-ad30-8cd6948c59c6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:40.378816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1d86fe2a-4345-41af-bb70-b57e1e94dce1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:40.396318 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1d86fe2a-4345-41af-bb70-b57e1e94dce1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.574742 Oct 29 01:35:40.397634 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2828/5893] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:39 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:40.420561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c1dae99a-a397-446b-ad30-8cd6948c59c6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:40.422909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-94b37df9-d185-4c5e-b79b-59628acdad3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:40.424486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-94b37df9-d185-4c5e-b79b-59628acdad3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:40.433115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94b37df9-d185-4c5e-b79b-59628acdad3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:40.433964 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c1dae99a-a397-446b-ad30-8cd6948c59c6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1695 microversion: 2.1 time: 0.560830 Oct 29 01:35:40.434132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94b37df9-d185-4c5e-b79b-59628acdad3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:40.434759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94b37df9-d185-4c5e-b79b-59628acdad3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:40.435200 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3066/5894] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:39 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1695 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:40.447486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94b37df9-d185-4c5e-b79b-59628acdad3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:40.448012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94b37df9-d185-4c5e-b79b-59628acdad3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:40.448470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94b37df9-d185-4c5e-b79b-59628acdad3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:40.909606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-94b37df9-d185-4c5e-b79b-59628acdad3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:40.921016 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-94b37df9-d185-4c5e-b79b-59628acdad3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.502013 Oct 29 01:35:40.922059 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2829/5895] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:40 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:35:40.945710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c1fd67e6-2e31-487d-9293-28535711849c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1313043879"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:40.948263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c1fd67e6-2e31-487d-9293-28535711849c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:40.954765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1fd67e6-2e31-487d-9293-28535711849c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:40.955880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1fd67e6-2e31-487d-9293-28535711849c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:40.956325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1fd67e6-2e31-487d-9293-28535711849c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:40.957077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1fd67e6-2e31-487d-9293-28535711849c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:40.957570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1fd67e6-2e31-487d-9293-28535711849c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:40.958080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c1fd67e6-2e31-487d-9293-28535711849c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:41.465581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-04d96412-985f-4aff-b6fb-9305f1ea518e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:41.466289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-04d96412-985f-4aff-b6fb-9305f1ea518e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:41.473856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04d96412-985f-4aff-b6fb-9305f1ea518e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:41.474609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04d96412-985f-4aff-b6fb-9305f1ea518e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:41.475282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04d96412-985f-4aff-b6fb-9305f1ea518e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:41.476280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04d96412-985f-4aff-b6fb-9305f1ea518e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:41.476974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04d96412-985f-4aff-b6fb-9305f1ea518e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:41.477683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04d96412-985f-4aff-b6fb-9305f1ea518e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:41.674080 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c1fd67e6-2e31-487d-9293-28535711849c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.732589 Oct 29 01:35:41.678111 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3067/5896] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:35:40 2022] POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action => generated 0 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 29 01:35:42.081124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-04d96412-985f-4aff-b6fb-9305f1ea518e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:42.103732 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-04d96412-985f-4aff-b6fb-9305f1ea518e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1695 microversion: 2.1 time: 0.643322 Oct 29 01:35:42.105962 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2830/5897] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:41 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1695 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:35:43.136202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-335bd5b3-a7f0-4d45-a119-3a08ed477074 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:43.140015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-335bd5b3-a7f0-4d45-a119-3a08ed477074 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:43.155764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-335bd5b3-a7f0-4d45-a119-3a08ed477074 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:43.156561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-335bd5b3-a7f0-4d45-a119-3a08ed477074 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:43.159457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-335bd5b3-a7f0-4d45-a119-3a08ed477074 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:43.160539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-335bd5b3-a7f0-4d45-a119-3a08ed477074 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:43.161314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-335bd5b3-a7f0-4d45-a119-3a08ed477074 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:43.163457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-335bd5b3-a7f0-4d45-a119-3a08ed477074 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:44.094155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-335bd5b3-a7f0-4d45-a119-3a08ed477074 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:44.103378 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-335bd5b3-a7f0-4d45-a119-3a08ed477074 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1695 microversion: 2.1 time: 0.973599 Oct 29 01:35:44.107655 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3068/5898] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:43 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1695 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:45.151195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9d557f30-3d3f-4de3-b2a8-d9eb1de19ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:45.151843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9d557f30-3d3f-4de3-b2a8-d9eb1de19ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:45.193224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d557f30-3d3f-4de3-b2a8-d9eb1de19ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:45.201926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d557f30-3d3f-4de3-b2a8-d9eb1de19ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:45.202606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d557f30-3d3f-4de3-b2a8-d9eb1de19ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:45.203614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d557f30-3d3f-4de3-b2a8-d9eb1de19ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:45.204249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d557f30-3d3f-4de3-b2a8-d9eb1de19ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:45.204840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d557f30-3d3f-4de3-b2a8-d9eb1de19ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:45.687771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9d557f30-3d3f-4de3-b2a8-d9eb1de19ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:45.698103 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9d557f30-3d3f-4de3-b2a8-d9eb1de19ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1695 microversion: 2.1 time: 0.566791 Oct 29 01:35:45.698697 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2831/5899] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:45 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1695 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:46.726458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-14788077-5d6c-4cb2-a181-01149f161773 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:46.727103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-14788077-5d6c-4cb2-a181-01149f161773 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:46.734509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14788077-5d6c-4cb2-a181-01149f161773 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:46.734925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14788077-5d6c-4cb2-a181-01149f161773 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:46.735369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14788077-5d6c-4cb2-a181-01149f161773 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:46.736931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14788077-5d6c-4cb2-a181-01149f161773 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:46.748895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14788077-5d6c-4cb2-a181-01149f161773 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:46.749449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14788077-5d6c-4cb2-a181-01149f161773 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:47.260859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-14788077-5d6c-4cb2-a181-01149f161773 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:47.283434 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-14788077-5d6c-4cb2-a181-01149f161773 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1695 microversion: 2.1 time: 0.557383 Oct 29 01:35:47.283434 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3069/5900] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:46 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1695 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:48.309343 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0e97edd3-92f6-49c1-892e-e827f8edc147 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:48.310247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0e97edd3-92f6-49c1-892e-e827f8edc147 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:48.341742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e97edd3-92f6-49c1-892e-e827f8edc147 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:48.343165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e97edd3-92f6-49c1-892e-e827f8edc147 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:48.343619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e97edd3-92f6-49c1-892e-e827f8edc147 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:48.345323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e97edd3-92f6-49c1-892e-e827f8edc147 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:48.345323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e97edd3-92f6-49c1-892e-e827f8edc147 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:48.347069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e97edd3-92f6-49c1-892e-e827f8edc147 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:48.815740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0e97edd3-92f6-49c1-892e-e827f8edc147 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:48.823106 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0e97edd3-92f6-49c1-892e-e827f8edc147 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1695 microversion: 2.1 time: 0.518930 Oct 29 01:35:48.831296 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2832/5901] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:48 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1695 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:49.862645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ca2e51f2-c9f3-4038-80a6-52874efc741a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:49.863871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ca2e51f2-c9f3-4038-80a6-52874efc741a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:49.891810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca2e51f2-c9f3-4038-80a6-52874efc741a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:49.892804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca2e51f2-c9f3-4038-80a6-52874efc741a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:49.895368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca2e51f2-c9f3-4038-80a6-52874efc741a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:49.897638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca2e51f2-c9f3-4038-80a6-52874efc741a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:49.902449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca2e51f2-c9f3-4038-80a6-52874efc741a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:49.911169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca2e51f2-c9f3-4038-80a6-52874efc741a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:50.176758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ca2e51f2-c9f3-4038-80a6-52874efc741a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:50.189921 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ca2e51f2-c9f3-4038-80a6-52874efc741a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1695 microversion: 2.1 time: 0.328079 Oct 29 01:35:50.190710 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3070/5902] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:49 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1695 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:50.282645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-90404d93-17f0-401d-9b70-7dad666df2e2 req-6cc6b773-8870-4631-a836-0ffcd1aaa493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a", "name": "network-vif-plugged", "status": "completed", "tag": "5a9cbab0-94b4-4948-a2da-c29b923b64da"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:50.310942 n-d-862964-3 devstack@n-api.service[121100]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:35:50.311389 n-d-862964-3 devstack@n-api.service[121100]: Sat Oct 29 01:35:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Oct 29 01:35:50.320621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-90404d93-17f0-401d-9b70-7dad666df2e2 req-6cc6b773-8870-4631-a836-0ffcd1aaa493 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:50.321501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-90404d93-17f0-401d-9b70-7dad666df2e2 req-6cc6b773-8870-4631-a836-0ffcd1aaa493 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:50.323013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-90404d93-17f0-401d-9b70-7dad666df2e2 req-6cc6b773-8870-4631-a836-0ffcd1aaa493 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:50.383368 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-90404d93-17f0-401d-9b70-7dad666df2e2 req-6cc6b773-8870-4631-a836-0ffcd1aaa493 service nova] Creating event network-vif-plugged:5a9cbab0-94b4-4948-a2da-c29b923b64da for instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a on n-h1-862964-3 Oct 29 01:35:50.400930 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-90404d93-17f0-401d-9b70-7dad666df2e2 req-6cc6b773-8870-4631-a836-0ffcd1aaa493 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122029 Oct 29 01:35:50.402620 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2833/5903] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:35:51.221596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a3389d7b-e1d6-49ed-a15e-ad0d533ebda2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:51.222307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a3389d7b-e1d6-49ed-a15e-ad0d533ebda2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:51.235191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3389d7b-e1d6-49ed-a15e-ad0d533ebda2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:51.238213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3389d7b-e1d6-49ed-a15e-ad0d533ebda2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:51.238987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3389d7b-e1d6-49ed-a15e-ad0d533ebda2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:51.239989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3389d7b-e1d6-49ed-a15e-ad0d533ebda2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:51.240856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3389d7b-e1d6-49ed-a15e-ad0d533ebda2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:51.241714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3389d7b-e1d6-49ed-a15e-ad0d533ebda2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:51.708036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a3389d7b-e1d6-49ed-a15e-ad0d533ebda2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:51.730283 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a3389d7b-e1d6-49ed-a15e-ad0d533ebda2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1695 microversion: 2.1 time: 0.514583 Oct 29 01:35:51.754167 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3071/5904] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:51 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1695 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:52.765084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1096c9e2-04fb-4924-97e3-daf354a9154e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:52.766488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1096c9e2-04fb-4924-97e3-daf354a9154e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:52.785751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1096c9e2-04fb-4924-97e3-daf354a9154e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:52.785751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1096c9e2-04fb-4924-97e3-daf354a9154e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:52.785751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1096c9e2-04fb-4924-97e3-daf354a9154e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:52.785751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1096c9e2-04fb-4924-97e3-daf354a9154e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:52.785751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1096c9e2-04fb-4924-97e3-daf354a9154e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:52.789460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1096c9e2-04fb-4924-97e3-daf354a9154e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:53.093531 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1096c9e2-04fb-4924-97e3-daf354a9154e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:53.108080 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1096c9e2-04fb-4924-97e3-daf354a9154e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1695 microversion: 2.1 time: 0.347149 Oct 29 01:35:53.119885 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2834/5905] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:52 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1695 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:54.154844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-06ebb9e4-6b68-476f-b5b9-dc17b6785922 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:54.155474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-06ebb9e4-6b68-476f-b5b9-dc17b6785922 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:54.174469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06ebb9e4-6b68-476f-b5b9-dc17b6785922 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:54.174983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06ebb9e4-6b68-476f-b5b9-dc17b6785922 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:54.175436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06ebb9e4-6b68-476f-b5b9-dc17b6785922 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:54.186537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06ebb9e4-6b68-476f-b5b9-dc17b6785922 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:54.191878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06ebb9e4-6b68-476f-b5b9-dc17b6785922 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:54.192676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06ebb9e4-6b68-476f-b5b9-dc17b6785922 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:55.149685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-06ebb9e4-6b68-476f-b5b9-dc17b6785922 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:55.169521 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-06ebb9e4-6b68-476f-b5b9-dc17b6785922 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1694 microversion: 2.1 time: 1.019176 Oct 29 01:35:55.193068 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3072/5906] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:54 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1694 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:55.533645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-ff6f0c2c-91cd-4bfb-8155-762bf32070a0 req-d7620c55-db9b-4b81-85dc-4bd45ec989dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81380db-5388-4da3-a0be-e9734e60fa24", "name": "network-vif-unplugged", "status": "completed", "tag": "3692ad9d-2f8e-486e-9a37-4e99f5a005a7"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:55.557453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ff6f0c2c-91cd-4bfb-8155-762bf32070a0 req-d7620c55-db9b-4b81-85dc-4bd45ec989dd service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:55.560000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ff6f0c2c-91cd-4bfb-8155-762bf32070a0 req-d7620c55-db9b-4b81-85dc-4bd45ec989dd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:55.562754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ff6f0c2c-91cd-4bfb-8155-762bf32070a0 req-d7620c55-db9b-4b81-85dc-4bd45ec989dd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:55.592615 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-ff6f0c2c-91cd-4bfb-8155-762bf32070a0 req-d7620c55-db9b-4b81-85dc-4bd45ec989dd service nova] Creating event network-vif-unplugged:3692ad9d-2f8e-486e-9a37-4e99f5a005a7 for instance b81380db-5388-4da3-a0be-e9734e60fa24 on n-h1-862964-3 Oct 29 01:35:55.610333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [req-ff6f0c2c-91cd-4bfb-8155-762bf32070a0 req-d7620c55-db9b-4b81-85dc-4bd45ec989dd service nova] Instance b81380db-5388-4da3-a0be-e9734e60fa24 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121100) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:35:55.639732 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-ff6f0c2c-91cd-4bfb-8155-762bf32070a0 req-d7620c55-db9b-4b81-85dc-4bd45ec989dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113854 Oct 29 01:35:55.645235 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2835/5907] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:35:56.200406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4abeb2d8-8599-424a-918d-a419846c03d8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:56.202487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4abeb2d8-8599-424a-918d-a419846c03d8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:56.223769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4abeb2d8-8599-424a-918d-a419846c03d8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:56.224156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4abeb2d8-8599-424a-918d-a419846c03d8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:56.231381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4abeb2d8-8599-424a-918d-a419846c03d8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:56.232986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4abeb2d8-8599-424a-918d-a419846c03d8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:56.234521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4abeb2d8-8599-424a-918d-a419846c03d8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:56.236036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4abeb2d8-8599-424a-918d-a419846c03d8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:56.943906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4abeb2d8-8599-424a-918d-a419846c03d8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:56.958748 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4abeb2d8-8599-424a-918d-a419846c03d8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1694 microversion: 2.1 time: 0.762384 Oct 29 01:35:56.963664 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3073/5908] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:56 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1694 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:57.998090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c56a3519-83af-4e77-b280-0f980cfc1547 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:57.999693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c56a3519-83af-4e77-b280-0f980cfc1547 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:58.016891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c56a3519-83af-4e77-b280-0f980cfc1547 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:58.018467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c56a3519-83af-4e77-b280-0f980cfc1547 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:58.020762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c56a3519-83af-4e77-b280-0f980cfc1547 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:58.023174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c56a3519-83af-4e77-b280-0f980cfc1547 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:58.023858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c56a3519-83af-4e77-b280-0f980cfc1547 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:58.027247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c56a3519-83af-4e77-b280-0f980cfc1547 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:58.597799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c56a3519-83af-4e77-b280-0f980cfc1547 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:58.609521 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c56a3519-83af-4e77-b280-0f980cfc1547 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1694 microversion: 2.1 time: 0.621929 Oct 29 01:35:58.610112 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2836/5909] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:57 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1694 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:58.984217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-bd414ab8-7374-45ac-9987-431a02d3281c req-a272403d-c3ca-422c-bef5-5a37468d36d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b81380db-5388-4da3-a0be-e9734e60fa24", "tag": "3692ad9d-2f8e-486e-9a37-4e99f5a005a7"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:59.007866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-bd414ab8-7374-45ac-9987-431a02d3281c req-a272403d-c3ca-422c-bef5-5a37468d36d6 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:59.009087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-bd414ab8-7374-45ac-9987-431a02d3281c req-a272403d-c3ca-422c-bef5-5a37468d36d6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:59.009087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-bd414ab8-7374-45ac-9987-431a02d3281c req-a272403d-c3ca-422c-bef5-5a37468d36d6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:59.048932 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-bd414ab8-7374-45ac-9987-431a02d3281c req-a272403d-c3ca-422c-bef5-5a37468d36d6 service nova] Creating event network-changed:3692ad9d-2f8e-486e-9a37-4e99f5a005a7 for instance b81380db-5388-4da3-a0be-e9734e60fa24 on n-h1-862964-3 Oct 29 01:35:59.055953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [req-bd414ab8-7374-45ac-9987-431a02d3281c req-a272403d-c3ca-422c-bef5-5a37468d36d6 service nova] Instance b81380db-5388-4da3-a0be-e9734e60fa24 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121099) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:35:59.104969 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-bd414ab8-7374-45ac-9987-431a02d3281c req-a272403d-c3ca-422c-bef5-5a37468d36d6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123106 Oct 29 01:35:59.105655 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3074/5910] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:35:59.650249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d47d3a7b-dc16-4618-9434-ffdc3b8c9b06 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:59.651644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d47d3a7b-dc16-4618-9434-ffdc3b8c9b06 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:35:59.668794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d47d3a7b-dc16-4618-9434-ffdc3b8c9b06 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:59.678972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d47d3a7b-dc16-4618-9434-ffdc3b8c9b06 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:59.680136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d47d3a7b-dc16-4618-9434-ffdc3b8c9b06 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:35:59.683582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d47d3a7b-dc16-4618-9434-ffdc3b8c9b06 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:35:59.691799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d47d3a7b-dc16-4618-9434-ffdc3b8c9b06 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:35:59.694487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d47d3a7b-dc16-4618-9434-ffdc3b8c9b06 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:00.430422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d47d3a7b-dc16-4618-9434-ffdc3b8c9b06 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:00.437061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=84 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:36:00.442638 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d47d3a7b-dc16-4618-9434-ffdc3b8c9b06 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1694 microversion: 2.1 time: 0.807387 Oct 29 01:36:00.463707 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2837/5911] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:35:59 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1694 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:01.471695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-63c7fe32-1cdb-4cb7-93e6-47a9a32459cf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:01.473026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-63c7fe32-1cdb-4cb7-93e6-47a9a32459cf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:01.489896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63c7fe32-1cdb-4cb7-93e6-47a9a32459cf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:01.490968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63c7fe32-1cdb-4cb7-93e6-47a9a32459cf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:01.491597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63c7fe32-1cdb-4cb7-93e6-47a9a32459cf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:01.492317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63c7fe32-1cdb-4cb7-93e6-47a9a32459cf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:01.495309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63c7fe32-1cdb-4cb7-93e6-47a9a32459cf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:01.495932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63c7fe32-1cdb-4cb7-93e6-47a9a32459cf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:02.021099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-63c7fe32-1cdb-4cb7-93e6-47a9a32459cf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:02.033560 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-63c7fe32-1cdb-4cb7-93e6-47a9a32459cf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1694 microversion: 2.1 time: 0.564560 Oct 29 01:36:02.034512 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3075/5912] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:36:01 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1694 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:03.062158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a8703e15-3f77-488a-ba2a-8590e94ef53c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:03.066880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a8703e15-3f77-488a-ba2a-8590e94ef53c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:03.099074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a8703e15-3f77-488a-ba2a-8590e94ef53c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:03.099749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a8703e15-3f77-488a-ba2a-8590e94ef53c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:03.101126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a8703e15-3f77-488a-ba2a-8590e94ef53c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:03.103828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a8703e15-3f77-488a-ba2a-8590e94ef53c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:03.104426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a8703e15-3f77-488a-ba2a-8590e94ef53c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:03.107949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a8703e15-3f77-488a-ba2a-8590e94ef53c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:03.991326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a8703e15-3f77-488a-ba2a-8590e94ef53c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:04.001033 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a8703e15-3f77-488a-ba2a-8590e94ef53c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1692 microversion: 2.1 time: 0.942280 Oct 29 01:36:04.024728 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2838/5913] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:36:03 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1692 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:05.035276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0ce6aaf0-5678-4d7c-81fe-7ec95596b8ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:05.036045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0ce6aaf0-5678-4d7c-81fe-7ec95596b8ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:05.070063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ce6aaf0-5678-4d7c-81fe-7ec95596b8ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:05.078012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ce6aaf0-5678-4d7c-81fe-7ec95596b8ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:05.079174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ce6aaf0-5678-4d7c-81fe-7ec95596b8ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:05.082422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ce6aaf0-5678-4d7c-81fe-7ec95596b8ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:05.085058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ce6aaf0-5678-4d7c-81fe-7ec95596b8ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:05.086293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ce6aaf0-5678-4d7c-81fe-7ec95596b8ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:05.119746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:36:05.632904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0ce6aaf0-5678-4d7c-81fe-7ec95596b8ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:05.644234 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0ce6aaf0-5678-4d7c-81fe-7ec95596b8ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1692 microversion: 2.1 time: 0.614182 Oct 29 01:36:05.644903 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3076/5914] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:36:05 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1692 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:06.669958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c9696b91-58ea-4ba8-abae-c15b2f40790f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:06.669958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c9696b91-58ea-4ba8-abae-c15b2f40790f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:06.679711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9696b91-58ea-4ba8-abae-c15b2f40790f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:06.681050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9696b91-58ea-4ba8-abae-c15b2f40790f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:06.681730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9696b91-58ea-4ba8-abae-c15b2f40790f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:06.683821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9696b91-58ea-4ba8-abae-c15b2f40790f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:06.685096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9696b91-58ea-4ba8-abae-c15b2f40790f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:06.685788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9696b91-58ea-4ba8-abae-c15b2f40790f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:07.145365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c9696b91-58ea-4ba8-abae-c15b2f40790f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:07.159914 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c9696b91-58ea-4ba8-abae-c15b2f40790f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1689 microversion: 2.1 time: 0.494840 Oct 29 01:36:07.173740 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2839/5915] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:36:06 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1689 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:07.194234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c83930e8-c9de-4088-a408-e1c8e724caa1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:07.194924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c83930e8-c9de-4088-a408-e1c8e724caa1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:07.207929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c83930e8-c9de-4088-a408-e1c8e724caa1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:07.208923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c83930e8-c9de-4088-a408-e1c8e724caa1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:07.211830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c83930e8-c9de-4088-a408-e1c8e724caa1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:07.212756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c83930e8-c9de-4088-a408-e1c8e724caa1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:07.213278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c83930e8-c9de-4088-a408-e1c8e724caa1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:07.213732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c83930e8-c9de-4088-a408-e1c8e724caa1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:07.688468 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c83930e8-c9de-4088-a408-e1c8e724caa1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24/action" status: 204 len: 0 microversion: 2.1 time: 0.482417 Oct 29 01:36:07.698732 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3077/5916] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:36:07 2022] POST /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24/action => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:36:07.706246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-87c710e4-0032-4524-a7c5-0b88d8e8f662 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:07.706246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-87c710e4-0032-4524-a7c5-0b88d8e8f662 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:07.713984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87c710e4-0032-4524-a7c5-0b88d8e8f662 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:07.714480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87c710e4-0032-4524-a7c5-0b88d8e8f662 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:07.715087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87c710e4-0032-4524-a7c5-0b88d8e8f662 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:07.716291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87c710e4-0032-4524-a7c5-0b88d8e8f662 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:07.716765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87c710e4-0032-4524-a7c5-0b88d8e8f662 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:07.717231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87c710e4-0032-4524-a7c5-0b88d8e8f662 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:08.174353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-87c710e4-0032-4524-a7c5-0b88d8e8f662 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:08.204886 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-87c710e4-0032-4524-a7c5-0b88d8e8f662 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1689 microversion: 2.1 time: 0.503625 Oct 29 01:36:08.237189 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2840/5917] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:36:07 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1689 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:09.234350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e4772206-f191-4833-b3b2-421b66ff02f1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:09.234927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e4772206-f191-4833-b3b2-421b66ff02f1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:09.265266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4772206-f191-4833-b3b2-421b66ff02f1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:09.266004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4772206-f191-4833-b3b2-421b66ff02f1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:09.266630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4772206-f191-4833-b3b2-421b66ff02f1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:09.268594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4772206-f191-4833-b3b2-421b66ff02f1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:09.272223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4772206-f191-4833-b3b2-421b66ff02f1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:09.273149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4772206-f191-4833-b3b2-421b66ff02f1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:09.916472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e4772206-f191-4833-b3b2-421b66ff02f1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:09.931436 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e4772206-f191-4833-b3b2-421b66ff02f1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1689 microversion: 2.1 time: 0.702519 Oct 29 01:36:09.932529 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3078/5918] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:36:09 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1689 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:10.628201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-18fb7342-22c4-402b-bc47-86da782ee40e req-0d0a5c30-ee41-471d-8fef-e836b7f77698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81380db-5388-4da3-a0be-e9734e60fa24", "name": "network-vif-plugged", "status": "completed", "tag": "3692ad9d-2f8e-486e-9a37-4e99f5a005a7"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:10.640502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=28 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:36:10.645546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-18fb7342-22c4-402b-bc47-86da782ee40e req-0d0a5c30-ee41-471d-8fef-e836b7f77698 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:10.646250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-18fb7342-22c4-402b-bc47-86da782ee40e req-0d0a5c30-ee41-471d-8fef-e836b7f77698 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:10.646847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-18fb7342-22c4-402b-bc47-86da782ee40e req-0d0a5c30-ee41-471d-8fef-e836b7f77698 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:10.668006 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-18fb7342-22c4-402b-bc47-86da782ee40e req-0d0a5c30-ee41-471d-8fef-e836b7f77698 service nova] Creating event network-vif-plugged:3692ad9d-2f8e-486e-9a37-4e99f5a005a7 for instance b81380db-5388-4da3-a0be-e9734e60fa24 on n-h1-862964-3 Oct 29 01:36:10.705474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [req-18fb7342-22c4-402b-bc47-86da782ee40e req-0d0a5c30-ee41-471d-8fef-e836b7f77698 service nova] Instance b81380db-5388-4da3-a0be-e9734e60fa24 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121100) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:36:10.739368 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-18fb7342-22c4-402b-bc47-86da782ee40e req-0d0a5c30-ee41-471d-8fef-e836b7f77698 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115693 Oct 29 01:36:10.743205 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2841/5919] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:36:10.964747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b38eec2e-22f5-4b6a-b876-7c0ee650d3b1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:10.966393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b38eec2e-22f5-4b6a-b876-7c0ee650d3b1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:10.984339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=26 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:36:10.992453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b38eec2e-22f5-4b6a-b876-7c0ee650d3b1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:11.000583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b38eec2e-22f5-4b6a-b876-7c0ee650d3b1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:11.000583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b38eec2e-22f5-4b6a-b876-7c0ee650d3b1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:11.000583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b38eec2e-22f5-4b6a-b876-7c0ee650d3b1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:11.000583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b38eec2e-22f5-4b6a-b876-7c0ee650d3b1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:11.005309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b38eec2e-22f5-4b6a-b876-7c0ee650d3b1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:11.351375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b38eec2e-22f5-4b6a-b876-7c0ee650d3b1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:11.368284 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b38eec2e-22f5-4b6a-b876-7c0ee650d3b1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1689 microversion: 2.1 time: 0.410344 Oct 29 01:36:11.372295 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3079/5920] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:36:10 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1689 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:12.398050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-da5a7c25-a340-4a98-9cfd-8f72857d8db6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:12.398795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-da5a7c25-a340-4a98-9cfd-8f72857d8db6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:12.411904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-da5a7c25-a340-4a98-9cfd-8f72857d8db6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:12.415045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-da5a7c25-a340-4a98-9cfd-8f72857d8db6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:12.415547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-da5a7c25-a340-4a98-9cfd-8f72857d8db6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:12.416329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-da5a7c25-a340-4a98-9cfd-8f72857d8db6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:12.416794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-da5a7c25-a340-4a98-9cfd-8f72857d8db6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:12.417250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-da5a7c25-a340-4a98-9cfd-8f72857d8db6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:12.697111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-da5a7c25-a340-4a98-9cfd-8f72857d8db6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:12.705261 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-da5a7c25-a340-4a98-9cfd-8f72857d8db6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1681 microversion: 2.1 time: 0.313354 Oct 29 01:36:12.709000 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2842/5921] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:36:12 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1681 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:17.391909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8449eb09-ca57-4367-8184-e7462bf8b2eb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:17.393517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8449eb09-ca57-4367-8184-e7462bf8b2eb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:17.405809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8449eb09-ca57-4367-8184-e7462bf8b2eb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:17.406615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8449eb09-ca57-4367-8184-e7462bf8b2eb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:17.407898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8449eb09-ca57-4367-8184-e7462bf8b2eb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:17.409026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8449eb09-ca57-4367-8184-e7462bf8b2eb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:17.409757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8449eb09-ca57-4367-8184-e7462bf8b2eb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:17.410527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8449eb09-ca57-4367-8184-e7462bf8b2eb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:17.781259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8449eb09-ca57-4367-8184-e7462bf8b2eb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:17.804193 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8449eb09-ca57-4367-8184-e7462bf8b2eb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 0.418250 Oct 29 01:36:17.807259 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3080/5922] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:36:17 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:18.831847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1c845250-6078-4882-be0d-c2d3a0d2f39f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:18.833436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1c845250-6078-4882-be0d-c2d3a0d2f39f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:18.846579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c845250-6078-4882-be0d-c2d3a0d2f39f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:18.847086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c845250-6078-4882-be0d-c2d3a0d2f39f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:18.847532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c845250-6078-4882-be0d-c2d3a0d2f39f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:18.848254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c845250-6078-4882-be0d-c2d3a0d2f39f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:18.848721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c845250-6078-4882-be0d-c2d3a0d2f39f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:18.849177 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c845250-6078-4882-be0d-c2d3a0d2f39f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:19.147521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1c845250-6078-4882-be0d-c2d3a0d2f39f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:19.157038 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1c845250-6078-4882-be0d-c2d3a0d2f39f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.329385 Oct 29 01:36:19.158978 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2843/5923] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:36:18 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:19.185268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-080efdb6-6a5f-4a9a-a60e-aee307f4899e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1792081991"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:19.202586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-080efdb6-6a5f-4a9a-a60e-aee307f4899e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:19.213721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-080efdb6-6a5f-4a9a-a60e-aee307f4899e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:19.213943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-080efdb6-6a5f-4a9a-a60e-aee307f4899e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:19.214620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-080efdb6-6a5f-4a9a-a60e-aee307f4899e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:19.216576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-080efdb6-6a5f-4a9a-a60e-aee307f4899e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:19.216576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-080efdb6-6a5f-4a9a-a60e-aee307f4899e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:19.218263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-080efdb6-6a5f-4a9a-a60e-aee307f4899e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:20.123176 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-080efdb6-6a5f-4a9a-a60e-aee307f4899e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.942142 Oct 29 01:36:20.124286 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3081/5924] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:36:19 2022] POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action => generated 0 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 29 01:36:22.363022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-176bd913-ef15-4b06-9897-6b00b236bfdc req-c7a97276-67e5-4066-9388-c8f6101796a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a", "name": "network-vif-unplugged", "status": "completed", "tag": "5a9cbab0-94b4-4948-a2da-c29b923b64da"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:22.386890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-176bd913-ef15-4b06-9897-6b00b236bfdc req-c7a97276-67e5-4066-9388-c8f6101796a3 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:22.387387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-176bd913-ef15-4b06-9897-6b00b236bfdc req-c7a97276-67e5-4066-9388-c8f6101796a3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:22.387975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-176bd913-ef15-4b06-9897-6b00b236bfdc req-c7a97276-67e5-4066-9388-c8f6101796a3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:22.416306 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-176bd913-ef15-4b06-9897-6b00b236bfdc req-c7a97276-67e5-4066-9388-c8f6101796a3 service nova] Creating event network-vif-unplugged:5a9cbab0-94b4-4948-a2da-c29b923b64da for instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a on n-h1-862964-3 Oct 29 01:36:22.426090 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-176bd913-ef15-4b06-9897-6b00b236bfdc req-c7a97276-67e5-4066-9388-c8f6101796a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067969 Oct 29 01:36:22.426719 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2844/5925] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:36:28.562457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-208c0379-64df-4de0-aa32-a4990a7a01e5 req-fd3b58bb-91c7-4a29-a2d5-d7e36a42b1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a", "name": "network-vif-plugged", "status": "completed", "tag": "5a9cbab0-94b4-4948-a2da-c29b923b64da"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:28.595478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-208c0379-64df-4de0-aa32-a4990a7a01e5 req-fd3b58bb-91c7-4a29-a2d5-d7e36a42b1c7 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:28.600932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-208c0379-64df-4de0-aa32-a4990a7a01e5 req-fd3b58bb-91c7-4a29-a2d5-d7e36a42b1c7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:28.601693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-208c0379-64df-4de0-aa32-a4990a7a01e5 req-fd3b58bb-91c7-4a29-a2d5-d7e36a42b1c7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:28.642070 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-208c0379-64df-4de0-aa32-a4990a7a01e5 req-fd3b58bb-91c7-4a29-a2d5-d7e36a42b1c7 service nova] Creating event network-vif-plugged:5a9cbab0-94b4-4948-a2da-c29b923b64da for instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a on n-h1-862964-3 Oct 29 01:36:28.654084 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-208c0379-64df-4de0-aa32-a4990a7a01e5 req-fd3b58bb-91c7-4a29-a2d5-d7e36a42b1c7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096939 Oct 29 01:36:28.660159 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3082/5926] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:36:32.274845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ba9757c3-e62d-43cf-945e-90ec9059267c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:32.277366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ba9757c3-e62d-43cf-945e-90ec9059267c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:32.297087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba9757c3-e62d-43cf-945e-90ec9059267c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:32.301135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba9757c3-e62d-43cf-945e-90ec9059267c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:32.302488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba9757c3-e62d-43cf-945e-90ec9059267c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:32.307501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba9757c3-e62d-43cf-945e-90ec9059267c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:32.308919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba9757c3-e62d-43cf-945e-90ec9059267c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:32.311377 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba9757c3-e62d-43cf-945e-90ec9059267c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:32.475733 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ba9757c3-e62d-43cf-945e-90ec9059267c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments/c14e1a9a-e0b5-46b2-9c40-2b6dba55aade" status: 200 len: 194 microversion: 2.20 time: 0.200283 Oct 29 01:36:32.486018 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2845/5927] 10.222.0.26 () {60 vars in 1454 bytes} [Sat Oct 29 01:36:32 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments/c14e1a9a-e0b5-46b2-9c40-2b6dba55aade => generated 194 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:36:32.690146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2adf655f-bac0-4dc4-8c5e-452b1402d036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:32.690146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2adf655f-bac0-4dc4-8c5e-452b1402d036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:32.698587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2adf655f-bac0-4dc4-8c5e-452b1402d036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:32.699087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2adf655f-bac0-4dc4-8c5e-452b1402d036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:32.699530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2adf655f-bac0-4dc4-8c5e-452b1402d036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:32.709214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2adf655f-bac0-4dc4-8c5e-452b1402d036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:32.709883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2adf655f-bac0-4dc4-8c5e-452b1402d036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:32.710341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2adf655f-bac0-4dc4-8c5e-452b1402d036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:33.060975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-2adf655f-bac0-4dc4-8c5e-452b1402d036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lazy-loading 'services' on Instance uuid db08ce62-9806-4b5e-90e6-ca4fe64a2885 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:36:33.470223 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2adf655f-bac0-4dc4-8c5e-452b1402d036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "DELETE /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments/c14e1a9a-e0b5-46b2-9c40-2b6dba55aade" status: 202 len: 0 microversion: 2.20 time: 0.789426 Oct 29 01:36:33.471546 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3083/5928] 10.222.0.26 () {60 vars in 1457 bytes} [Sat Oct 29 01:36:32 2022] DELETE /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments/c14e1a9a-e0b5-46b2-9c40-2b6dba55aade => generated 0 bytes in 793 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:36:33.489622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-84ef3c88-1525-4bf0-b6d6-cda451fbbf0f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:33.494299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-84ef3c88-1525-4bf0-b6d6-cda451fbbf0f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:33.523973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84ef3c88-1525-4bf0-b6d6-cda451fbbf0f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:33.524548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84ef3c88-1525-4bf0-b6d6-cda451fbbf0f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:33.525091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84ef3c88-1525-4bf0-b6d6-cda451fbbf0f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:33.526109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84ef3c88-1525-4bf0-b6d6-cda451fbbf0f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:33.526809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84ef3c88-1525-4bf0-b6d6-cda451fbbf0f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:33.527459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84ef3c88-1525-4bf0-b6d6-cda451fbbf0f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:33.530623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=44 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:36:33.639324 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-84ef3c88-1525-4bf0-b6d6-cda451fbbf0f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.163154 Oct 29 01:36:33.647650 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2846/5929] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:36:33 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:36:34.653686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fd3fa277-9c00-46ee-a1aa-38dacacb20a0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:34.656429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fd3fa277-9c00-46ee-a1aa-38dacacb20a0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:34.670544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd3fa277-9c00-46ee-a1aa-38dacacb20a0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:34.671041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd3fa277-9c00-46ee-a1aa-38dacacb20a0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:34.671493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd3fa277-9c00-46ee-a1aa-38dacacb20a0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:34.672235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd3fa277-9c00-46ee-a1aa-38dacacb20a0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:34.681529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd3fa277-9c00-46ee-a1aa-38dacacb20a0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:34.682540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd3fa277-9c00-46ee-a1aa-38dacacb20a0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:34.756463 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fd3fa277-9c00-46ee-a1aa-38dacacb20a0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.107737 Oct 29 01:36:34.761503 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3084/5930] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:36:34 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:36:35.774130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e2ace3f-148c-4a52-af98-20166aead277 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:35.776338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7e2ace3f-148c-4a52-af98-20166aead277 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:35.785999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e2ace3f-148c-4a52-af98-20166aead277 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:35.786488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e2ace3f-148c-4a52-af98-20166aead277 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:35.786930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e2ace3f-148c-4a52-af98-20166aead277 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:35.787643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e2ace3f-148c-4a52-af98-20166aead277 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:35.788101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e2ace3f-148c-4a52-af98-20166aead277 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:35.788533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e2ace3f-148c-4a52-af98-20166aead277 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:35.821864 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e2ace3f-148c-4a52-af98-20166aead277 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051692 Oct 29 01:36:35.822972 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2847/5931] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:36:35 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:36:36.836228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3d94fd93-2e41-4223-b157-6c441c63e87c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:36.839456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3d94fd93-2e41-4223-b157-6c441c63e87c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:36.859031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d94fd93-2e41-4223-b157-6c441c63e87c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:36.861095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d94fd93-2e41-4223-b157-6c441c63e87c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:36.862097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d94fd93-2e41-4223-b157-6c441c63e87c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:36.865422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d94fd93-2e41-4223-b157-6c441c63e87c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:36.868305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d94fd93-2e41-4223-b157-6c441c63e87c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:36.869766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d94fd93-2e41-4223-b157-6c441c63e87c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:36.961206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:36:37.016626 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3d94fd93-2e41-4223-b157-6c441c63e87c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.183944 Oct 29 01:36:37.025367 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3085/5932] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:36:36 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:36:38.028513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-202a47c9-7519-4721-8544-e2f04c22ff97 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:38.031334 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-202a47c9-7519-4721-8544-e2f04c22ff97 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:38.043673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-202a47c9-7519-4721-8544-e2f04c22ff97 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:38.056647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-202a47c9-7519-4721-8544-e2f04c22ff97 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:38.058050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-202a47c9-7519-4721-8544-e2f04c22ff97 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:38.059535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-202a47c9-7519-4721-8544-e2f04c22ff97 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:38.073964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-202a47c9-7519-4721-8544-e2f04c22ff97 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:38.074690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-202a47c9-7519-4721-8544-e2f04c22ff97 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:38.174490 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-202a47c9-7519-4721-8544-e2f04c22ff97 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.149665 Oct 29 01:36:38.178698 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2848/5933] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:36:38 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:36:39.192596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c71afca9-8971-41ca-bf65-9cd4e376d453 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:39.196485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c71afca9-8971-41ca-bf65-9cd4e376d453 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:39.222605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c71afca9-8971-41ca-bf65-9cd4e376d453 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:39.227474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c71afca9-8971-41ca-bf65-9cd4e376d453 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:39.230504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c71afca9-8971-41ca-bf65-9cd4e376d453 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:39.231601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c71afca9-8971-41ca-bf65-9cd4e376d453 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:39.234825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c71afca9-8971-41ca-bf65-9cd4e376d453 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:39.237223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c71afca9-8971-41ca-bf65-9cd4e376d453 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:39.358340 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c71afca9-8971-41ca-bf65-9cd4e376d453 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.169351 Oct 29 01:36:39.368378 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3086/5934] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:36:39 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:36:40.987528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-100a78cb-7f98-4951-b7ab-eb2c4244b133 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:40.992137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-100a78cb-7f98-4951-b7ab-eb2c4244b133 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:41.019987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-100a78cb-7f98-4951-b7ab-eb2c4244b133 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:41.024263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-100a78cb-7f98-4951-b7ab-eb2c4244b133 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:41.024263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-100a78cb-7f98-4951-b7ab-eb2c4244b133 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:41.024263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-100a78cb-7f98-4951-b7ab-eb2c4244b133 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:41.024263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-100a78cb-7f98-4951-b7ab-eb2c4244b133 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:41.024263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-100a78cb-7f98-4951-b7ab-eb2c4244b133 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:41.193376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b6a691e1-4100-4feb-836d-edae08d66b76 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:41.200919 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-100a78cb-7f98-4951-b7ab-eb2c4244b133 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24/action" status: 200 len: 24577 microversion: 2.1 time: 0.219183 Oct 29 01:36:41.202922 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3087/5935] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:36:40 2022] POST /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24/action => generated 24577 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:36:41.225918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b6a691e1-4100-4feb-836d-edae08d66b76 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:41.275380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6a691e1-4100-4feb-836d-edae08d66b76 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:41.292792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6a691e1-4100-4feb-836d-edae08d66b76 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:41.293410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6a691e1-4100-4feb-836d-edae08d66b76 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:41.298920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6a691e1-4100-4feb-836d-edae08d66b76 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:41.303791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6a691e1-4100-4feb-836d-edae08d66b76 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:41.303791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6a691e1-4100-4feb-836d-edae08d66b76 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:41.383956 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b6a691e1-4100-4feb-836d-edae08d66b76 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 1.007229 Oct 29 01:36:41.383956 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2849/5936] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:36:40 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments => generated 197 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:36:42.395950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-093c2b89-3ae1-4570-a8dd-9ac7783cf39f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:42.399118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-093c2b89-3ae1-4570-a8dd-9ac7783cf39f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:42.412537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=18 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:36:42.424621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-093c2b89-3ae1-4570-a8dd-9ac7783cf39f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:42.429260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-093c2b89-3ae1-4570-a8dd-9ac7783cf39f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:42.429260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-093c2b89-3ae1-4570-a8dd-9ac7783cf39f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:42.429260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-093c2b89-3ae1-4570-a8dd-9ac7783cf39f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:42.429260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-093c2b89-3ae1-4570-a8dd-9ac7783cf39f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:42.429260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-093c2b89-3ae1-4570-a8dd-9ac7783cf39f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:42.545826 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-093c2b89-3ae1-4570-a8dd-9ac7783cf39f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.152755 Oct 29 01:36:42.570881 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3088/5937] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:36:42 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:36:43.560018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7a83e03b-7463-44e7-91f2-e0a41de7a40e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:43.566101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7a83e03b-7463-44e7-91f2-e0a41de7a40e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:43.594318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=18 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:36:43.599879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a83e03b-7463-44e7-91f2-e0a41de7a40e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:43.600384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a83e03b-7463-44e7-91f2-e0a41de7a40e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:43.600833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a83e03b-7463-44e7-91f2-e0a41de7a40e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:43.604581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a83e03b-7463-44e7-91f2-e0a41de7a40e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:43.605066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a83e03b-7463-44e7-91f2-e0a41de7a40e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:43.605527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a83e03b-7463-44e7-91f2-e0a41de7a40e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:43.732961 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7a83e03b-7463-44e7-91f2-e0a41de7a40e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.177317 Oct 29 01:36:43.750255 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2850/5938] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:36:43 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:36:44.762095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fbbabb43-9cc1-4655-98e8-a872451abfed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:44.766694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fbbabb43-9cc1-4655-98e8-a872451abfed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:44.792170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbbabb43-9cc1-4655-98e8-a872451abfed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:44.792854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbbabb43-9cc1-4655-98e8-a872451abfed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:44.794723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbbabb43-9cc1-4655-98e8-a872451abfed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:44.799230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbbabb43-9cc1-4655-98e8-a872451abfed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:44.803877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbbabb43-9cc1-4655-98e8-a872451abfed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:44.803877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fbbabb43-9cc1-4655-98e8-a872451abfed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:44.961882 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fbbabb43-9cc1-4655-98e8-a872451abfed tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.205735 Oct 29 01:36:44.967036 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3089/5939] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:36:44 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:36:45.980228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a358063e-f298-4dce-84e4-fa49298ef75b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:45.983295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a358063e-f298-4dce-84e4-fa49298ef75b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:45.992775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a358063e-f298-4dce-84e4-fa49298ef75b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:45.995056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a358063e-f298-4dce-84e4-fa49298ef75b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:45.995916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a358063e-f298-4dce-84e4-fa49298ef75b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:45.998046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a358063e-f298-4dce-84e4-fa49298ef75b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:45.998804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a358063e-f298-4dce-84e4-fa49298ef75b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:46.000273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a358063e-f298-4dce-84e4-fa49298ef75b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:46.074953 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a358063e-f298-4dce-84e4-fa49298ef75b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.099913 Oct 29 01:36:46.085258 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2851/5940] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:36:45 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:36:47.101073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4c056e5a-3465-4c69-9488-3e600497d669 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:47.106234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4c056e5a-3465-4c69-9488-3e600497d669 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:47.114566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c056e5a-3465-4c69-9488-3e600497d669 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:47.115163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c056e5a-3465-4c69-9488-3e600497d669 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:47.115811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c056e5a-3465-4c69-9488-3e600497d669 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:47.117016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c056e5a-3465-4c69-9488-3e600497d669 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:47.120916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c056e5a-3465-4c69-9488-3e600497d669 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:47.122536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c056e5a-3465-4c69-9488-3e600497d669 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:47.216385 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4c056e5a-3465-4c69-9488-3e600497d669 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.124870 Oct 29 01:36:47.219003 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3090/5941] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:36:47 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:47.380784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5ddf242e-8c9b-41ce-a1d9-a0a6c850e4d7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:47.381486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5ddf242e-8c9b-41ce-a1d9-a0a6c850e4d7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:47.396672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ddf242e-8c9b-41ce-a1d9-a0a6c850e4d7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:47.398268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ddf242e-8c9b-41ce-a1d9-a0a6c850e4d7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:47.398914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ddf242e-8c9b-41ce-a1d9-a0a6c850e4d7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:47.401521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ddf242e-8c9b-41ce-a1d9-a0a6c850e4d7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:47.402640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ddf242e-8c9b-41ce-a1d9-a0a6c850e4d7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:47.404129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ddf242e-8c9b-41ce-a1d9-a0a6c850e4d7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:47.476931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5ddf242e-8c9b-41ce-a1d9-a0a6c850e4d7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:36:47.943447 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5ddf242e-8c9b-41ce-a1d9-a0a6c850e4d7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "DELETE /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 204 len: 0 microversion: 2.20 time: 0.571138 Oct 29 01:36:47.944042 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2852/5942] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:36:47 2022] DELETE /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:36:47.954917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9b2ed633-9304-4588-a190-48f86d287aa6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:47.955536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9b2ed633-9304-4588-a190-48f86d287aa6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:47.982611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b2ed633-9304-4588-a190-48f86d287aa6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:47.983153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b2ed633-9304-4588-a190-48f86d287aa6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:47.983604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b2ed633-9304-4588-a190-48f86d287aa6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:47.984356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b2ed633-9304-4588-a190-48f86d287aa6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:47.994292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b2ed633-9304-4588-a190-48f86d287aa6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:48.007221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b2ed633-9304-4588-a190-48f86d287aa6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:48.523176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9b2ed633-9304-4588-a190-48f86d287aa6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:48.540281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9b2ed633-9304-4588-a190-48f86d287aa6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:48.545413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9b2ed633-9304-4588-a190-48f86d287aa6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:48.551033 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9b2ed633-9304-4588-a190-48f86d287aa6 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1723 microversion: 2.20 time: 0.598271 Oct 29 01:36:48.559018 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3091/5943] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:36:47 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1723 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:36:49.646157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d8c8e70b-0d2e-4aab-9999-78b95903fe50 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:49.646157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d8c8e70b-0d2e-4aab-9999-78b95903fe50 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:49.646157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8c8e70b-0d2e-4aab-9999-78b95903fe50 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:49.646157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8c8e70b-0d2e-4aab-9999-78b95903fe50 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:49.646157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8c8e70b-0d2e-4aab-9999-78b95903fe50 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:49.646157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8c8e70b-0d2e-4aab-9999-78b95903fe50 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:49.646157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8c8e70b-0d2e-4aab-9999-78b95903fe50 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:49.646157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8c8e70b-0d2e-4aab-9999-78b95903fe50 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:50.048452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d8c8e70b-0d2e-4aab-9999-78b95903fe50 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:50.060873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d8c8e70b-0d2e-4aab-9999-78b95903fe50 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:50.064122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d8c8e70b-0d2e-4aab-9999-78b95903fe50 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:50.065870 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d8c8e70b-0d2e-4aab-9999-78b95903fe50 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1723 microversion: 2.20 time: 0.490276 Oct 29 01:36:50.066718 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2853/5944] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:36:49 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1723 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:36:51.102347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-afaf0d0f-7646-4bb0-958c-a989958391a4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:51.102995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-afaf0d0f-7646-4bb0-958c-a989958391a4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:51.120729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afaf0d0f-7646-4bb0-958c-a989958391a4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:51.121299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afaf0d0f-7646-4bb0-958c-a989958391a4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:51.121804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afaf0d0f-7646-4bb0-958c-a989958391a4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:51.122647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afaf0d0f-7646-4bb0-958c-a989958391a4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:51.123196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afaf0d0f-7646-4bb0-958c-a989958391a4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:51.123886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afaf0d0f-7646-4bb0-958c-a989958391a4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:51.666536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-afaf0d0f-7646-4bb0-958c-a989958391a4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:51.682489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-afaf0d0f-7646-4bb0-958c-a989958391a4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:51.686619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-afaf0d0f-7646-4bb0-958c-a989958391a4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:51.693254 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-afaf0d0f-7646-4bb0-958c-a989958391a4 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1723 microversion: 2.20 time: 0.595594 Oct 29 01:36:51.715547 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3092/5945] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:36:51 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1723 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:36:52.732742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-77e3c80a-c666-43e5-98ab-64f6c6947f49 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:52.733502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-77e3c80a-c666-43e5-98ab-64f6c6947f49 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:52.763374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77e3c80a-c666-43e5-98ab-64f6c6947f49 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:52.770443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77e3c80a-c666-43e5-98ab-64f6c6947f49 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:52.774175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77e3c80a-c666-43e5-98ab-64f6c6947f49 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:52.775064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77e3c80a-c666-43e5-98ab-64f6c6947f49 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:52.778314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77e3c80a-c666-43e5-98ab-64f6c6947f49 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:52.780875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77e3c80a-c666-43e5-98ab-64f6c6947f49 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:53.005314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-77e3c80a-c666-43e5-98ab-64f6c6947f49 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:53.028365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-77e3c80a-c666-43e5-98ab-64f6c6947f49 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:53.033470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-77e3c80a-c666-43e5-98ab-64f6c6947f49 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:53.033470 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-77e3c80a-c666-43e5-98ab-64f6c6947f49 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1656 microversion: 2.20 time: 0.305390 Oct 29 01:36:53.033470 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2854/5946] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:36:52 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1656 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:36:53.443939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-ca6fa008-5cf9-4ae4-8ab8-a9f234757568 req-e258ae48-c7ff-4bd6-878f-443a861c856f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db08ce62-9806-4b5e-90e6-ca4fe64a2885", "name": "network-vif-deleted", "tag": "9a179e9f-8e3d-4dcd-b553-24e9832a186e"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:53.457335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ca6fa008-5cf9-4ae4-8ab8-a9f234757568 req-e258ae48-c7ff-4bd6-878f-443a861c856f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:53.459002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ca6fa008-5cf9-4ae4-8ab8-a9f234757568 req-e258ae48-c7ff-4bd6-878f-443a861c856f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:53.459002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ca6fa008-5cf9-4ae4-8ab8-a9f234757568 req-e258ae48-c7ff-4bd6-878f-443a861c856f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:53.487007 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-ca6fa008-5cf9-4ae4-8ab8-a9f234757568 req-e258ae48-c7ff-4bd6-878f-443a861c856f service nova] Creating event network-vif-deleted:9a179e9f-8e3d-4dcd-b553-24e9832a186e for instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 on n-h2-862964-3 Oct 29 01:36:53.494940 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-ca6fa008-5cf9-4ae4-8ab8-a9f234757568 req-e258ae48-c7ff-4bd6-878f-443a861c856f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.416910 Oct 29 01:36:53.507561 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3093/5947] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:36:54.060959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8cfbf06f-723f-453a-be0b-c6de065696b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:54.065370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8cfbf06f-723f-453a-be0b-c6de065696b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:54.076562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfbf06f-723f-453a-be0b-c6de065696b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:54.083516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfbf06f-723f-453a-be0b-c6de065696b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:54.084377 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfbf06f-723f-453a-be0b-c6de065696b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:54.086704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfbf06f-723f-453a-be0b-c6de065696b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:54.087480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfbf06f-723f-453a-be0b-c6de065696b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:54.094787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfbf06f-723f-453a-be0b-c6de065696b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:54.185942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfbf06f-723f-453a-be0b-c6de065696b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:54.186453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfbf06f-723f-453a-be0b-c6de065696b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:54.186900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfbf06f-723f-453a-be0b-c6de065696b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:54.190819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-8cfbf06f-723f-453a-be0b-c6de065696b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lazy-loading 'fault' on Instance uuid db08ce62-9806-4b5e-90e6-ca4fe64a2885 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:36:54.310871 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8cfbf06f-723f-453a-be0b-c6de065696b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:54.325733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8cfbf06f-723f-453a-be0b-c6de065696b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:54.331533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8cfbf06f-723f-453a-be0b-c6de065696b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:54.334033 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8cfbf06f-723f-453a-be0b-c6de065696b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 200 len: 1371 microversion: 2.20 time: 0.275212 Oct 29 01:36:54.336703 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2855/5948] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:36:54 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 1371 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:36:55.369285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-47b53083-5063-4a91-8809-51bb1b45fb94 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:55.371202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-47b53083-5063-4a91-8809-51bb1b45fb94 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:36:55.406117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47b53083-5063-4a91-8809-51bb1b45fb94 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:55.407142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47b53083-5063-4a91-8809-51bb1b45fb94 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:55.407785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47b53083-5063-4a91-8809-51bb1b45fb94 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:55.409878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47b53083-5063-4a91-8809-51bb1b45fb94 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:36:55.411007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47b53083-5063-4a91-8809-51bb1b45fb94 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:36:55.412427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47b53083-5063-4a91-8809-51bb1b45fb94 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:36:55.468285 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-47b53083-5063-4a91-8809-51bb1b45fb94 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] HTTP exception thrown: Instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 could not be found. Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-47b53083-5063-4a91-8809-51bb1b45fb94 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Request method failure captured: Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 HTTP/1.1 Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIJ7UD26DtcasJQPddXyLcsnMwEWA673JNIdYzdsjXQ-niI3JmDmwDpfNKGaUg2B3bw2aDLTnu1FgPzlWmnWMkA3Y_PA92B7B4r9UDctR58mgU8Vm8Hk1l6IUQeU2jvzZioG5VOJi_SaQpFbYY3L5zjUMtFIeAK1jrjmdhNxLVbHpzM Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 55774814073449bf962d219e4a1b3b5e Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-742246682 Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55774814073449bf962d219e4a1b3b5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/55774814073449bf962d219e4a1b3b5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55774814073449bf962d219e4a1b3b5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_55774814073449bf962d219e4a1b3b5e", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeShelveTestJSON-742246682 Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 55774814073449bf962d219e4a1b3b5e Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-742246682 Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AttachVolumeShelveTestJSON-742246682-project Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 0265e8a9ea3040429b5f00c409b58b32 Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeShelveTestJSON-742246682-project Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 could not be found. Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'db08ce62-9806-4b5e-90e6-ca4fe64a2885'} Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 could not be found. Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 could not be found. Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:36:55.476536 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:36:55.489523 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:36:55.489523 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:36:55.489523 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:36:55.489523 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:36:55.489523 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:36:55.489523 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:36:55.489523 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 could not be found. Oct 29 01:36:55.489523 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:36:55.489523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-47b53083-5063-4a91-8809-51bb1b45fb94 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Returning 404 to user: Instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:36:55.489523 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-47b53083-5063-4a91-8809-51bb1b45fb94 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 404 len: 111 microversion: 2.20 time: 0.114242 Oct 29 01:36:55.498267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d616b72b-35a7-43b2-b51b-73679f3e562d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '.version_select at 0x7f9d9ff8cee0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:55.505143 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3094/5949] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:36:55 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:36:55.614737 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d616b72b-35a7-43b2-b51b-73679f3e562d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-364583021" status: 204 len: 0 microversion: 2.20 time: 0.120342 Oct 29 01:36:55.615776 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2856/5950] 10.222.0.26 () {60 vars in 1259 bytes} [Sat Oct 29 01:36:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-364583021 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:36:58.098658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e323982a-3a7f-439a-a822-56cc2eb8f456 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Action: 'create', calling method: .version_select at 0x7f9d97c7d280>, body: {"keypair": {"name": "tempest-keypair-2053370307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0oHMBI5qUWLa5VE+WJnRjgxrCZHTw7ZLFcRquZbjKZpRSIOoJi4uX0pwrope/l/wWydQVc/kJ5Q3Ni1NVtwyNBt7BVmeSCnF+Z6pYzHEeWpgmlafx6a4MbmL6kAJpU2g=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:58.119486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-e323982a-3a7f-439a-a822-56cc2eb8f456 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Getting quotas for project 55774814073449bf962d219e4a1b3b5e. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:36:58.128147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-e323982a-3a7f-439a-a822-56cc2eb8f456 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Getting quotas for user 0265e8a9ea3040429b5f00c409b58b32 and project 55774814073449bf962d219e4a1b3b5e. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:36:58.225875 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e323982a-3a7f-439a-a822-56cc2eb8f456 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.132910 Oct 29 01:36:58.226548 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3095/5951] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 29 01:36:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 01:37:03.961850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-65027a1b-3c5b-4939-ae24-c187f436611f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-827028619", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc8bfa0c-cf27-464e-950d-2a7722265459"}], "security_groups": [{"name": "tempest-securitygroup--1943239811"}], "key_name": "tempest-keypair-2053370307", "user_data": "}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:04.170886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-65027a1b-3c5b-4939-ae24-c187f436611f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] validate_networks() for [('bc8bfa0c-cf27-464e-950d-2a7722265459', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:37:04.215865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-43514369-0bde-4c02-bbaa-efa0b59a316b tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:04.215865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-43514369-0bde-4c02-bbaa-efa0b59a316b tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:04.229180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43514369-0bde-4c02-bbaa-efa0b59a316b tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:04.230101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43514369-0bde-4c02-bbaa-efa0b59a316b tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:04.230962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43514369-0bde-4c02-bbaa-efa0b59a316b tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:04.233337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43514369-0bde-4c02-bbaa-efa0b59a316b tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:04.233996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43514369-0bde-4c02-bbaa-efa0b59a316b tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:04.234828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43514369-0bde-4c02-bbaa-efa0b59a316b tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:04.315706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:37:04.560629 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-43514369-0bde-4c02-bbaa-efa0b59a316b tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1832 microversion: 2.1 time: 0.363317 Oct 29 01:37:04.561251 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3096/5952] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:04 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1832 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:37:04.767143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f884346f-eed8-4ec0-8526-f8338a345041 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:04.768125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f884346f-eed8-4ec0-8526-f8338a345041 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:04.808277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f884346f-eed8-4ec0-8526-f8338a345041 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:04.811579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f884346f-eed8-4ec0-8526-f8338a345041 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:04.811579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f884346f-eed8-4ec0-8526-f8338a345041 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:04.819198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f884346f-eed8-4ec0-8526-f8338a345041 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:04.821852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f884346f-eed8-4ec0-8526-f8338a345041 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:04.828627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f884346f-eed8-4ec0-8526-f8338a345041 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:05.254805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f884346f-eed8-4ec0-8526-f8338a345041 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:05.273389 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f884346f-eed8-4ec0-8526-f8338a345041 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 0.510545 Oct 29 01:37:05.275961 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3097/5953] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:04 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:37:05.322865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-65027a1b-3c5b-4939-ae24-c187f436611f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:37:05.323339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-65027a1b-3c5b-4939-ae24-c187f436611f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:37:05.323760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-65027a1b-3c5b-4939-ae24-c187f436611f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:37:05.324168 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-65027a1b-3c5b-4939-ae24-c187f436611f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:37:05.324610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-65027a1b-3c5b-4939-ae24-c187f436611f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:37:05.352642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65027a1b-3c5b-4939-ae24-c187f436611f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:05.367118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65027a1b-3c5b-4939-ae24-c187f436611f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:05.367586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65027a1b-3c5b-4939-ae24-c187f436611f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:05.380491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65027a1b-3c5b-4939-ae24-c187f436611f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:05.380994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65027a1b-3c5b-4939-ae24-c187f436611f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:05.381950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65027a1b-3c5b-4939-ae24-c187f436611f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:05.439662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-65027a1b-3c5b-4939-ae24-c187f436611f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Getting quotas for project 55774814073449bf962d219e4a1b3b5e. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:37:05.454504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-65027a1b-3c5b-4939-ae24-c187f436611f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Getting quotas for user 0265e8a9ea3040429b5f00c409b58b32 and project 55774814073449bf962d219e4a1b3b5e. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:37:05.480376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-65027a1b-3c5b-4939-ae24-c187f436611f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:37:05.484453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-65027a1b-3c5b-4939-ae24-c187f436611f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:37:05.779585 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-65027a1b-3c5b-4939-ae24-c187f436611f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.822010 Oct 29 01:37:05.780365 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2857/5954] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 29 01:37:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 1824 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 01:37:05.799188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-43c91827-1fd4-4197-8f8c-6f4ed154db19 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:05.800023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-43c91827-1fd4-4197-8f8c-6f4ed154db19 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:05.878521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-43c91827-1fd4-4197-8f8c-6f4ed154db19 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:05.886527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-43c91827-1fd4-4197-8f8c-6f4ed154db19 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:05.889379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-43c91827-1fd4-4197-8f8c-6f4ed154db19 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:05.891292 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-43c91827-1fd4-4197-8f8c-6f4ed154db19 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1281 microversion: 2.20 time: 0.096253 Oct 29 01:37:05.905693 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3098/5955] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:37:05 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1281 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:37:06.307791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a36646d8-2897-415a-ac40-99ae1e938c9e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:06.307791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a36646d8-2897-415a-ac40-99ae1e938c9e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:06.318674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a36646d8-2897-415a-ac40-99ae1e938c9e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:06.319557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a36646d8-2897-415a-ac40-99ae1e938c9e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:06.320221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a36646d8-2897-415a-ac40-99ae1e938c9e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:06.349379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a36646d8-2897-415a-ac40-99ae1e938c9e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:06.353896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a36646d8-2897-415a-ac40-99ae1e938c9e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:06.404360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a36646d8-2897-415a-ac40-99ae1e938c9e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:06.934594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3b600b46-e5dc-4b28-91c7-2ccc8b33ca4f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:06.936069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3b600b46-e5dc-4b28-91c7-2ccc8b33ca4f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:07.051248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a36646d8-2897-415a-ac40-99ae1e938c9e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:07.078528 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a36646d8-2897-415a-ac40-99ae1e938c9e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.775037 Oct 29 01:37:07.096871 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2858/5956] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:06 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:07.116412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6d63311c-7ccd-4e54-86a2-5476465fde63 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-2125464259"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:07.129408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6d63311c-7ccd-4e54-86a2-5476465fde63 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:07.148916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3b600b46-e5dc-4b28-91c7-2ccc8b33ca4f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:07.158016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d63311c-7ccd-4e54-86a2-5476465fde63 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:07.158534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d63311c-7ccd-4e54-86a2-5476465fde63 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:07.161522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d63311c-7ccd-4e54-86a2-5476465fde63 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:07.162300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d63311c-7ccd-4e54-86a2-5476465fde63 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:07.162797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d63311c-7ccd-4e54-86a2-5476465fde63 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:07.163223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d63311c-7ccd-4e54-86a2-5476465fde63 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:07.165829 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3b600b46-e5dc-4b28-91c7-2ccc8b33ca4f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:07.169404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3b600b46-e5dc-4b28-91c7-2ccc8b33ca4f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:07.174138 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3b600b46-e5dc-4b28-91c7-2ccc8b33ca4f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1281 microversion: 2.20 time: 0.242880 Oct 29 01:37:07.198360 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3099/5957] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:37:06 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1281 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:37:07.465064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-50b266b4-9820-4876-a79b-162168ad98b8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:07.466757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-50b266b4-9820-4876-a79b-162168ad98b8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:07.476645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50b266b4-9820-4876-a79b-162168ad98b8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:07.479713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50b266b4-9820-4876-a79b-162168ad98b8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:07.480434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50b266b4-9820-4876-a79b-162168ad98b8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:07.483228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50b266b4-9820-4876-a79b-162168ad98b8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:07.501464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50b266b4-9820-4876-a79b-162168ad98b8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:07.502399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50b266b4-9820-4876-a79b-162168ad98b8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:07.575255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-50b266b4-9820-4876-a79b-162168ad98b8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:37:08.003565 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-50b266b4-9820-4876-a79b-162168ad98b8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 204 len: 0 microversion: 2.1 time: 0.542321 Oct 29 01:37:08.012484 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3100/5958] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:37:07 2022] DELETE /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:37:08.022963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-a69bcd99-683b-447f-b575-530d1ddca1ab req-d756528c-d67f-479b-98a9-d8a68cd3cf7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b81380db-5388-4da3-a0be-e9734e60fa24", "tag": "3692ad9d-2f8e-486e-9a37-4e99f5a005a7"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:08.023922 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6d63311c-7ccd-4e54-86a2-5476465fde63 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.912692 Oct 29 01:37:08.024611 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2859/5959] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:37:07 2022] POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action => generated 0 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 29 01:37:08.044573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-04c4c3c4-1875-4443-9c38-d38484999546 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:08.047480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-04c4c3c4-1875-4443-9c38-d38484999546 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:08.052143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a69bcd99-683b-447f-b575-530d1ddca1ab req-d756528c-d67f-479b-98a9-d8a68cd3cf7c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:08.054512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a69bcd99-683b-447f-b575-530d1ddca1ab req-d756528c-d67f-479b-98a9-d8a68cd3cf7c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:08.055817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a69bcd99-683b-447f-b575-530d1ddca1ab req-d756528c-d67f-479b-98a9-d8a68cd3cf7c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:08.067694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04c4c3c4-1875-4443-9c38-d38484999546 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:08.068196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04c4c3c4-1875-4443-9c38-d38484999546 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:08.068639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04c4c3c4-1875-4443-9c38-d38484999546 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:08.088874 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-a69bcd99-683b-447f-b575-530d1ddca1ab req-d756528c-d67f-479b-98a9-d8a68cd3cf7c service nova] Creating event network-changed:3692ad9d-2f8e-486e-9a37-4e99f5a005a7 for instance b81380db-5388-4da3-a0be-e9734e60fa24 on n-h1-862964-3 Oct 29 01:37:08.088999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04c4c3c4-1875-4443-9c38-d38484999546 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:08.088999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04c4c3c4-1875-4443-9c38-d38484999546 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:08.088999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-04c4c3c4-1875-4443-9c38-d38484999546 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:08.093912 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-a69bcd99-683b-447f-b575-530d1ddca1ab req-d756528c-d67f-479b-98a9-d8a68cd3cf7c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083585 Oct 29 01:37:08.095865 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3101/5960] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:08.107628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-afa69c77-bcab-4a8c-8d19-475d5f1e66ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:08.112728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-afa69c77-bcab-4a8c-8d19-475d5f1e66ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:08.124111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afa69c77-bcab-4a8c-8d19-475d5f1e66ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:08.128581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afa69c77-bcab-4a8c-8d19-475d5f1e66ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:08.129194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afa69c77-bcab-4a8c-8d19-475d5f1e66ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:08.130024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afa69c77-bcab-4a8c-8d19-475d5f1e66ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:08.134072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afa69c77-bcab-4a8c-8d19-475d5f1e66ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:08.135237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afa69c77-bcab-4a8c-8d19-475d5f1e66ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:08.541927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-04c4c3c4-1875-4443-9c38-d38484999546 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:08.546421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-afa69c77-bcab-4a8c-8d19-475d5f1e66ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:08.564938 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-afa69c77-bcab-4a8c-8d19-475d5f1e66ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1680 microversion: 2.1 time: 0.462126 Oct 29 01:37:08.564938 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3102/5961] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:08 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1680 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:08.565311 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-04c4c3c4-1875-4443-9c38-d38484999546 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1687 microversion: 2.1 time: 0.535910 Oct 29 01:37:08.567948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-09ff9750-da8e-43cd-aa3c-c548aa41fede tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:08.568788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-09ff9750-da8e-43cd-aa3c-c548aa41fede tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:08.574153 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2860/5962] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:08 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1687 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:08.577678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09ff9750-da8e-43cd-aa3c-c548aa41fede tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:08.578217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09ff9750-da8e-43cd-aa3c-c548aa41fede tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:08.578670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09ff9750-da8e-43cd-aa3c-c548aa41fede tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:08.579391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09ff9750-da8e-43cd-aa3c-c548aa41fede tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:08.579566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-f41a776c-f560-46b4-a7e4-50ffa63c4a1d req-cb62a9ad-4103-4d67-96df-d98520d74760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a", "name": "network-vif-unplugged", "status": "completed", "tag": "5a9cbab0-94b4-4948-a2da-c29b923b64da"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:08.579885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09ff9750-da8e-43cd-aa3c-c548aa41fede tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:08.580322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09ff9750-da8e-43cd-aa3c-c548aa41fede tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:08.605851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f41a776c-f560-46b4-a7e4-50ffa63c4a1d req-cb62a9ad-4103-4d67-96df-d98520d74760 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:08.605851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f41a776c-f560-46b4-a7e4-50ffa63c4a1d req-cb62a9ad-4103-4d67-96df-d98520d74760 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:08.606259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f41a776c-f560-46b4-a7e4-50ffa63c4a1d req-cb62a9ad-4103-4d67-96df-d98520d74760 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:08.630509 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f41a776c-f560-46b4-a7e4-50ffa63c4a1d req-cb62a9ad-4103-4d67-96df-d98520d74760 service nova] Creating event network-vif-unplugged:5a9cbab0-94b4-4948-a2da-c29b923b64da for instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a on n-h1-862964-3 Oct 29 01:37:08.643106 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-f41a776c-f560-46b4-a7e4-50ffa63c4a1d req-cb62a9ad-4103-4d67-96df-d98520d74760 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067676 Oct 29 01:37:08.648813 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2861/5963] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:08.662483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-09ff9750-da8e-43cd-aa3c-c548aa41fede tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:08.673835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-09ff9750-da8e-43cd-aa3c-c548aa41fede tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:08.680502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-09ff9750-da8e-43cd-aa3c-c548aa41fede tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:08.685248 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-09ff9750-da8e-43cd-aa3c-c548aa41fede tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1333 microversion: 2.20 time: 0.123330 Oct 29 01:37:08.686649 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3103/5964] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:37:08 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1333 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:37:09.598110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0cee09cf-5105-4094-a73a-d6f4b049b7a2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:09.598110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0cee09cf-5105-4094-a73a-d6f4b049b7a2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:09.612447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b1188b8c-46a9-4b97-a18a-428d8dae9833 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:09.613668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b1188b8c-46a9-4b97-a18a-428d8dae9833 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:09.623873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1188b8c-46a9-4b97-a18a-428d8dae9833 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:09.624514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cee09cf-5105-4094-a73a-d6f4b049b7a2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:09.626903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cee09cf-5105-4094-a73a-d6f4b049b7a2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:09.627659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cee09cf-5105-4094-a73a-d6f4b049b7a2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:09.627809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1188b8c-46a9-4b97-a18a-428d8dae9833 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:09.628917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cee09cf-5105-4094-a73a-d6f4b049b7a2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:09.629629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cee09cf-5105-4094-a73a-d6f4b049b7a2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:09.630619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1188b8c-46a9-4b97-a18a-428d8dae9833 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:09.631564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1188b8c-46a9-4b97-a18a-428d8dae9833 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:09.632276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cee09cf-5105-4094-a73a-d6f4b049b7a2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:09.632872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1188b8c-46a9-4b97-a18a-428d8dae9833 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:09.633461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b1188b8c-46a9-4b97-a18a-428d8dae9833 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:10.445564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b1188b8c-46a9-4b97-a18a-428d8dae9833 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:10.454395 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b1188b8c-46a9-4b97-a18a-428d8dae9833 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1687 microversion: 2.1 time: 0.854539 Oct 29 01:37:10.469425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0cee09cf-5105-4094-a73a-d6f4b049b7a2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:10.470312 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3104/5965] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:09 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1687 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:10.478405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-07a68a9f-2741-4f15-8e02-adb9d494ca8e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:10.479342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-07a68a9f-2741-4f15-8e02-adb9d494ca8e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:10.480523 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0cee09cf-5105-4094-a73a-d6f4b049b7a2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1680 microversion: 2.1 time: 0.897396 Oct 29 01:37:10.481172 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2862/5966] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:09 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1680 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:37:10.487613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07a68a9f-2741-4f15-8e02-adb9d494ca8e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:10.488515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07a68a9f-2741-4f15-8e02-adb9d494ca8e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:10.489444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07a68a9f-2741-4f15-8e02-adb9d494ca8e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:10.490435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07a68a9f-2741-4f15-8e02-adb9d494ca8e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:10.491176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07a68a9f-2741-4f15-8e02-adb9d494ca8e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:10.491699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07a68a9f-2741-4f15-8e02-adb9d494ca8e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:10.526728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:37:11.423020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-07a68a9f-2741-4f15-8e02-adb9d494ca8e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:11.441496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-07a68a9f-2741-4f15-8e02-adb9d494ca8e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:11.444207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-07a68a9f-2741-4f15-8e02-adb9d494ca8e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:11.445714 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-07a68a9f-2741-4f15-8e02-adb9d494ca8e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1407 microversion: 2.20 time: 0.973529 Oct 29 01:37:11.462489 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3105/5967] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:37:10 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1407 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:37:11.491134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c12b8db6-4f60-4233-ad49-4d567bbdb2de tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:11.492816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c12b8db6-4f60-4233-ad49-4d567bbdb2de tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:11.509263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0fc5a87f-0869-4e77-870c-56b3479cbfbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:11.509263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0fc5a87f-0869-4e77-870c-56b3479cbfbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:11.509489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c12b8db6-4f60-4233-ad49-4d567bbdb2de tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:11.509931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c12b8db6-4f60-4233-ad49-4d567bbdb2de tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:11.510754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c12b8db6-4f60-4233-ad49-4d567bbdb2de tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:11.513579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c12b8db6-4f60-4233-ad49-4d567bbdb2de tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:11.514991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c12b8db6-4f60-4233-ad49-4d567bbdb2de tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:11.519100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c12b8db6-4f60-4233-ad49-4d567bbdb2de tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:11.534585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc5a87f-0869-4e77-870c-56b3479cbfbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:11.535069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc5a87f-0869-4e77-870c-56b3479cbfbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:11.535516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc5a87f-0869-4e77-870c-56b3479cbfbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:11.543199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc5a87f-0869-4e77-870c-56b3479cbfbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:11.544350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc5a87f-0869-4e77-870c-56b3479cbfbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:11.544670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fc5a87f-0869-4e77-870c-56b3479cbfbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:12.108173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c12b8db6-4f60-4233-ad49-4d567bbdb2de tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:12.174382 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c12b8db6-4f60-4233-ad49-4d567bbdb2de tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1687 microversion: 2.1 time: 0.695320 Oct 29 01:37:12.182022 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2863/5968] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:11 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1687 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:12.245708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0fc5a87f-0869-4e77-870c-56b3479cbfbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:12.261368 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0fc5a87f-0869-4e77-870c-56b3479cbfbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1680 microversion: 2.1 time: 0.758015 Oct 29 01:37:12.273250 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3106/5969] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:11 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1680 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:12.491431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2cf6a713-1cdb-4b08-a253-667e10c254df tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:12.492220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2cf6a713-1cdb-4b08-a253-667e10c254df tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:12.535601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:37:12.539708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cf6a713-1cdb-4b08-a253-667e10c254df tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:12.540828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-784ea137-b84f-44d9-8d50-355b1a56b234 req-bf68ff90-72c7-4d14-a4fa-f4ca8084be8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81380db-5388-4da3-a0be-e9734e60fa24", "name": "network-vif-deleted", "tag": "3692ad9d-2f8e-486e-9a37-4e99f5a005a7"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:12.542069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cf6a713-1cdb-4b08-a253-667e10c254df tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:12.542522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cf6a713-1cdb-4b08-a253-667e10c254df tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:12.549436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cf6a713-1cdb-4b08-a253-667e10c254df tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:12.550681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cf6a713-1cdb-4b08-a253-667e10c254df tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:12.550681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cf6a713-1cdb-4b08-a253-667e10c254df tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:12.573108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-784ea137-b84f-44d9-8d50-355b1a56b234 req-bf68ff90-72c7-4d14-a4fa-f4ca8084be8f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:12.573798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-784ea137-b84f-44d9-8d50-355b1a56b234 req-bf68ff90-72c7-4d14-a4fa-f4ca8084be8f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:12.575137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-784ea137-b84f-44d9-8d50-355b1a56b234 req-bf68ff90-72c7-4d14-a4fa-f4ca8084be8f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:12.621335 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-784ea137-b84f-44d9-8d50-355b1a56b234 req-bf68ff90-72c7-4d14-a4fa-f4ca8084be8f service nova] Creating event network-vif-deleted:3692ad9d-2f8e-486e-9a37-4e99f5a005a7 for instance b81380db-5388-4da3-a0be-e9734e60fa24 on n-h1-862964-3 Oct 29 01:37:12.636717 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-784ea137-b84f-44d9-8d50-355b1a56b234 req-bf68ff90-72c7-4d14-a4fa-f4ca8084be8f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.452743 Oct 29 01:37:12.637374 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2864/5970] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:12.851203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2cf6a713-1cdb-4b08-a253-667e10c254df tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:12.863219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2cf6a713-1cdb-4b08-a253-667e10c254df tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:12.866174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2cf6a713-1cdb-4b08-a253-667e10c254df tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:12.868034 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2cf6a713-1cdb-4b08-a253-667e10c254df tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1407 microversion: 2.20 time: 0.382309 Oct 29 01:37:12.889864 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3107/5971] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:37:12 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:37:12.935866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-40fb0f3b-3824-40f2-a459-7b4f709524c5 req-83075176-0486-44ab-a18b-c7a487b12ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c66a75-9fbd-4f0c-baf5-e19875095e42", "tag": "5ea23a70-144a-4d50-a1b1-6a74d325a5f1"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:12.947562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-40fb0f3b-3824-40f2-a459-7b4f709524c5 req-83075176-0486-44ab-a18b-c7a487b12ac9 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:12.948386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-40fb0f3b-3824-40f2-a459-7b4f709524c5 req-83075176-0486-44ab-a18b-c7a487b12ac9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:12.948833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-40fb0f3b-3824-40f2-a459-7b4f709524c5 req-83075176-0486-44ab-a18b-c7a487b12ac9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:12.974743 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-40fb0f3b-3824-40f2-a459-7b4f709524c5 req-83075176-0486-44ab-a18b-c7a487b12ac9 service nova] Creating event network-changed:5ea23a70-144a-4d50-a1b1-6a74d325a5f1 for instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 on n-h2-862964-3 Oct 29 01:37:12.981221 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-40fb0f3b-3824-40f2-a459-7b4f709524c5 req-83075176-0486-44ab-a18b-c7a487b12ac9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050647 Oct 29 01:37:12.982676 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2865/5972] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:13.209911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b424eafa-0915-4a90-b454-143adba6944d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:13.210557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b424eafa-0915-4a90-b454-143adba6944d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:13.239450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b424eafa-0915-4a90-b454-143adba6944d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:13.240204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b424eafa-0915-4a90-b454-143adba6944d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:13.240860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b424eafa-0915-4a90-b454-143adba6944d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:13.242665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b424eafa-0915-4a90-b454-143adba6944d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:13.243355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b424eafa-0915-4a90-b454-143adba6944d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:13.244173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b424eafa-0915-4a90-b454-143adba6944d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:13.300636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a6a9047e-6a1d-4e6d-93ae-dfa8d6d41670 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:13.301679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a6a9047e-6a1d-4e6d-93ae-dfa8d6d41670 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:13.313192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6a9047e-6a1d-4e6d-93ae-dfa8d6d41670 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:13.315727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6a9047e-6a1d-4e6d-93ae-dfa8d6d41670 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:13.327305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6a9047e-6a1d-4e6d-93ae-dfa8d6d41670 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:13.327305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6a9047e-6a1d-4e6d-93ae-dfa8d6d41670 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:13.327591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b424eafa-0915-4a90-b454-143adba6944d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:13.327715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6a9047e-6a1d-4e6d-93ae-dfa8d6d41670 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:13.327715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6a9047e-6a1d-4e6d-93ae-dfa8d6d41670 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:13.327908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b424eafa-0915-4a90-b454-143adba6944d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:13.327908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b424eafa-0915-4a90-b454-143adba6944d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:13.327908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-b424eafa-0915-4a90-b454-143adba6944d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lazy-loading 'fault' on Instance uuid b81380db-5388-4da3-a0be-e9734e60fa24 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:37:13.408468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b424eafa-0915-4a90-b454-143adba6944d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:13.420895 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b424eafa-0915-4a90-b454-143adba6944d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 200 len: 1355 microversion: 2.1 time: 0.221533 Oct 29 01:37:13.421532 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3108/5973] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:13 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 1355 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:13.735539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a6a9047e-6a1d-4e6d-93ae-dfa8d6d41670 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:13.755103 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a6a9047e-6a1d-4e6d-93ae-dfa8d6d41670 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1688 microversion: 2.1 time: 0.460755 Oct 29 01:37:13.776014 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2866/5974] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:13 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1688 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:37:13.912727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-591ad706-be69-4cba-9a32-8e454d1fb4d0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:13.915119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-591ad706-be69-4cba-9a32-8e454d1fb4d0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:13.947460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-591ad706-be69-4cba-9a32-8e454d1fb4d0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:13.947460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-591ad706-be69-4cba-9a32-8e454d1fb4d0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:13.947460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-591ad706-be69-4cba-9a32-8e454d1fb4d0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:13.948130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-591ad706-be69-4cba-9a32-8e454d1fb4d0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:13.949035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-591ad706-be69-4cba-9a32-8e454d1fb4d0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:13.956848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-591ad706-be69-4cba-9a32-8e454d1fb4d0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:14.281763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-591ad706-be69-4cba-9a32-8e454d1fb4d0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:14.333529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-591ad706-be69-4cba-9a32-8e454d1fb4d0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:14.333529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-591ad706-be69-4cba-9a32-8e454d1fb4d0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:14.333529 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-591ad706-be69-4cba-9a32-8e454d1fb4d0 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1407 microversion: 2.20 time: 0.416770 Oct 29 01:37:14.333529 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3109/5975] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:37:13 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1407 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:37:14.451908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ba17c506-b024-429b-9fda-1220b00ac304 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:14.452709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ba17c506-b024-429b-9fda-1220b00ac304 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: b81380db-5388-4da3-a0be-e9734e60fa24] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:14.467158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba17c506-b024-429b-9fda-1220b00ac304 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:14.467655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba17c506-b024-429b-9fda-1220b00ac304 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:14.468095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba17c506-b024-429b-9fda-1220b00ac304 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:14.470863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba17c506-b024-429b-9fda-1220b00ac304 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:14.471608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba17c506-b024-429b-9fda-1220b00ac304 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:14.473611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba17c506-b024-429b-9fda-1220b00ac304 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:14.544342 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-ba17c506-b024-429b-9fda-1220b00ac304 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] HTTP exception thrown: Instance b81380db-5388-4da3-a0be-e9734e60fa24 could not be found. Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ba17c506-b024-429b-9fda-1220b00ac304 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Request method failure captured: Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 HTTP/1.1 Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXILJPg9Teh04-xrfpejfETyHRBlSuOio40kYpBC7b_6HCncBaKOEtwakgsRFaHKUUVodh217xaKH9_jXg1fYudvg1KG6UvSVte3n5sImSaOZIiyh3V5b8dvECLF6tMPuqqNu5Tyyb2L7G4A-k4CbTXuNsP0CgTWtsdXxylpF7mJbiNI Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 2842ba05180046839fb5d064ad9132a1 Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1405101352 Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2842ba05180046839fb5d064ad9132a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2842ba05180046839fb5d064ad9132a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2842ba05180046839fb5d064ad9132a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2842ba05180046839fb5d064ad9132a1", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1405101352 Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 2842ba05180046839fb5d064ad9132a1 Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1405101352 Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TestNetworkAdvancedServerOps-1405101352-project Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: c70e2b34406c4e11afd9471a09d9cfef Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1405101352-project Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance b81380db-5388-4da3-a0be-e9734e60fa24 could not be found. Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'b81380db-5388-4da3-a0be-e9734e60fa24'} Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b81380db-5388-4da3-a0be-e9734e60fa24 could not be found. Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b81380db-5388-4da3-a0be-e9734e60fa24 could not be found. Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:37:14.551982 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:37:14.566938 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:37:14.566938 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:37:14.566938 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:37:14.566938 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:37:14.566938 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:37:14.566938 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:37:14.566938 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b81380db-5388-4da3-a0be-e9734e60fa24 could not be found. Oct 29 01:37:14.566938 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:37:14.566938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ba17c506-b024-429b-9fda-1220b00ac304 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Returning 404 to user: Instance b81380db-5388-4da3-a0be-e9734e60fa24 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:37:14.566938 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ba17c506-b024-429b-9fda-1220b00ac304 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24" status: 404 len: 111 microversion: 2.1 time: 0.108174 Oct 29 01:37:14.566938 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2867/5976] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:14 2022] GET /compute/v2.1/servers/b81380db-5388-4da3-a0be-e9734e60fa24 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:37:14.785811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-047d3ef0-011a-4c5e-ab96-bbacf3968068 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:14.787499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-047d3ef0-011a-4c5e-ab96-bbacf3968068 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:14.801082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-047d3ef0-011a-4c5e-ab96-bbacf3968068 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:14.802169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-047d3ef0-011a-4c5e-ab96-bbacf3968068 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:14.802825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-047d3ef0-011a-4c5e-ab96-bbacf3968068 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:14.803747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-047d3ef0-011a-4c5e-ab96-bbacf3968068 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:14.805919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-047d3ef0-011a-4c5e-ab96-bbacf3968068 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:14.807675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-047d3ef0-011a-4c5e-ab96-bbacf3968068 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:15.243387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-047d3ef0-011a-4c5e-ab96-bbacf3968068 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:15.262815 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-047d3ef0-011a-4c5e-ab96-bbacf3968068 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1688 microversion: 2.1 time: 0.477786 Oct 29 01:37:15.263536 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3110/5977] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:14 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1688 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:15.352317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b035eb70-18bc-4263-bf3c-0a6d2f5e482e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:15.357728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b035eb70-18bc-4263-bf3c-0a6d2f5e482e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:15.381530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b035eb70-18bc-4263-bf3c-0a6d2f5e482e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:15.387790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b035eb70-18bc-4263-bf3c-0a6d2f5e482e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:15.389218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b035eb70-18bc-4263-bf3c-0a6d2f5e482e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:15.390821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b035eb70-18bc-4263-bf3c-0a6d2f5e482e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:15.393073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b035eb70-18bc-4263-bf3c-0a6d2f5e482e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:15.394322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b035eb70-18bc-4263-bf3c-0a6d2f5e482e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:15.454276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:37:15.467024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:37:15.770775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b035eb70-18bc-4263-bf3c-0a6d2f5e482e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:15.782159 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b035eb70-18bc-4263-bf3c-0a6d2f5e482e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:15.794171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b035eb70-18bc-4263-bf3c-0a6d2f5e482e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:15.795677 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b035eb70-18bc-4263-bf3c-0a6d2f5e482e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1407 microversion: 2.20 time: 0.454265 Oct 29 01:37:15.809469 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2868/5978] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:37:15 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1407 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:37:16.293675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-41fae267-30df-44f0-b239-92a485f2af52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:16.294297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-41fae267-30df-44f0-b239-92a485f2af52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:16.303265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41fae267-30df-44f0-b239-92a485f2af52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:16.305022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41fae267-30df-44f0-b239-92a485f2af52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:16.305750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41fae267-30df-44f0-b239-92a485f2af52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:16.314231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41fae267-30df-44f0-b239-92a485f2af52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:16.315194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41fae267-30df-44f0-b239-92a485f2af52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:16.315970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41fae267-30df-44f0-b239-92a485f2af52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:16.656926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-f3a94393-a0e8-4a81-98aa-53d72b9fa3ca req-83f64a92-bbb6-4a31-a6b9-b996302a7dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a", "name": "network-vif-plugged", "status": "completed", "tag": "5a9cbab0-94b4-4948-a2da-c29b923b64da"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:16.671748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:37:16.684319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f3a94393-a0e8-4a81-98aa-53d72b9fa3ca req-83f64a92-bbb6-4a31-a6b9-b996302a7dcd service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:16.685407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f3a94393-a0e8-4a81-98aa-53d72b9fa3ca req-83f64a92-bbb6-4a31-a6b9-b996302a7dcd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:16.699132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f3a94393-a0e8-4a81-98aa-53d72b9fa3ca req-83f64a92-bbb6-4a31-a6b9-b996302a7dcd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:16.738298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-41fae267-30df-44f0-b239-92a485f2af52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:16.749066 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f3a94393-a0e8-4a81-98aa-53d72b9fa3ca req-83f64a92-bbb6-4a31-a6b9-b996302a7dcd service nova] Creating event network-vif-plugged:5a9cbab0-94b4-4948-a2da-c29b923b64da for instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a on n-h1-862964-3 Oct 29 01:37:16.757388 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-41fae267-30df-44f0-b239-92a485f2af52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1688 microversion: 2.1 time: 0.467323 Oct 29 01:37:16.761140 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-f3a94393-a0e8-4a81-98aa-53d72b9fa3ca req-83f64a92-bbb6-4a31-a6b9-b996302a7dcd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107951 Oct 29 01:37:16.763653 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2869/5979] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:37:16.780441 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3111/5980] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:16 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1688 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:16.827038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-41674e93-6851-43fc-8e1f-a136533b5f09 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:16.830452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-41674e93-6851-43fc-8e1f-a136533b5f09 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:16.855306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41674e93-6851-43fc-8e1f-a136533b5f09 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:16.857258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41674e93-6851-43fc-8e1f-a136533b5f09 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:16.858929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41674e93-6851-43fc-8e1f-a136533b5f09 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:16.861132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41674e93-6851-43fc-8e1f-a136533b5f09 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:16.863062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41674e93-6851-43fc-8e1f-a136533b5f09 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:16.863965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41674e93-6851-43fc-8e1f-a136533b5f09 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:17.246877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-41674e93-6851-43fc-8e1f-a136533b5f09 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:17.259492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-41674e93-6851-43fc-8e1f-a136533b5f09 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:17.266381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-41674e93-6851-43fc-8e1f-a136533b5f09 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:17.266381 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-41674e93-6851-43fc-8e1f-a136533b5f09 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1407 microversion: 2.20 time: 0.444517 Oct 29 01:37:17.266381 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2870/5981] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:37:16 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1407 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:37:17.788065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ed5a4115-df48-4d9c-a6e5-5ea728470a23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:17.788749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ed5a4115-df48-4d9c-a6e5-5ea728470a23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:17.799069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=8 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:37:17.806710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed5a4115-df48-4d9c-a6e5-5ea728470a23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:17.806710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed5a4115-df48-4d9c-a6e5-5ea728470a23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:17.806710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed5a4115-df48-4d9c-a6e5-5ea728470a23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:17.820355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed5a4115-df48-4d9c-a6e5-5ea728470a23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:17.821500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed5a4115-df48-4d9c-a6e5-5ea728470a23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:17.822252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed5a4115-df48-4d9c-a6e5-5ea728470a23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:18.158554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ed5a4115-df48-4d9c-a6e5-5ea728470a23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:18.179863 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ed5a4115-df48-4d9c-a6e5-5ea728470a23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1688 microversion: 2.1 time: 0.389067 Oct 29 01:37:18.182881 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3112/5982] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:17 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1688 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:18.291417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-782c086c-fcf2-4ef4-9e47-bd356d4fe60c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:18.292140 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-782c086c-fcf2-4ef4-9e47-bd356d4fe60c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:18.302310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-782c086c-fcf2-4ef4-9e47-bd356d4fe60c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:18.303733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-782c086c-fcf2-4ef4-9e47-bd356d4fe60c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:18.307380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-782c086c-fcf2-4ef4-9e47-bd356d4fe60c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:18.320599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-782c086c-fcf2-4ef4-9e47-bd356d4fe60c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:18.321481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-782c086c-fcf2-4ef4-9e47-bd356d4fe60c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:18.323410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-782c086c-fcf2-4ef4-9e47-bd356d4fe60c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:19.036791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-782c086c-fcf2-4ef4-9e47-bd356d4fe60c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:19.049429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-782c086c-fcf2-4ef4-9e47-bd356d4fe60c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:19.050658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-782c086c-fcf2-4ef4-9e47-bd356d4fe60c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:19.051823 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-782c086c-fcf2-4ef4-9e47-bd356d4fe60c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1407 microversion: 2.20 time: 0.764775 Oct 29 01:37:19.052401 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2871/5983] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:37:18 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1407 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:37:19.210155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0f378fba-b331-454c-ab1e-3ceb1c694176 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:19.211353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0f378fba-b331-454c-ab1e-3ceb1c694176 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:19.231654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f378fba-b331-454c-ab1e-3ceb1c694176 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:19.231654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f378fba-b331-454c-ab1e-3ceb1c694176 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:19.231654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f378fba-b331-454c-ab1e-3ceb1c694176 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:19.231654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f378fba-b331-454c-ab1e-3ceb1c694176 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:19.231654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f378fba-b331-454c-ab1e-3ceb1c694176 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:19.231654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f378fba-b331-454c-ab1e-3ceb1c694176 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:19.993615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0f378fba-b331-454c-ab1e-3ceb1c694176 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:20.017354 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0f378fba-b331-454c-ab1e-3ceb1c694176 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 0.812344 Oct 29 01:37:20.036530 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3113/5984] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:19 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:37:20.082357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-740569d1-b207-475c-88f9-1e83998882ba tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:20.083109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-740569d1-b207-475c-88f9-1e83998882ba tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:20.096114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-740569d1-b207-475c-88f9-1e83998882ba tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:20.098864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-740569d1-b207-475c-88f9-1e83998882ba tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:20.100174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-740569d1-b207-475c-88f9-1e83998882ba tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:20.101078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-740569d1-b207-475c-88f9-1e83998882ba tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:20.102691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-740569d1-b207-475c-88f9-1e83998882ba tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:20.104133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-740569d1-b207-475c-88f9-1e83998882ba tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:20.396224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-00c27911-29e2-445b-814b-04caf9a58831 req-2a1f6f3b-b2f6-49ce-a2e6-6c839a207926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c66a75-9fbd-4f0c-baf5-e19875095e42", "name": "network-vif-plugged", "status": "completed", "tag": "5ea23a70-144a-4d50-a1b1-6a74d325a5f1"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:20.434743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-00c27911-29e2-445b-814b-04caf9a58831 req-2a1f6f3b-b2f6-49ce-a2e6-6c839a207926 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:20.436008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-00c27911-29e2-445b-814b-04caf9a58831 req-2a1f6f3b-b2f6-49ce-a2e6-6c839a207926 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:20.436470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-00c27911-29e2-445b-814b-04caf9a58831 req-2a1f6f3b-b2f6-49ce-a2e6-6c839a207926 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:20.489138 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-00c27911-29e2-445b-814b-04caf9a58831 req-2a1f6f3b-b2f6-49ce-a2e6-6c839a207926 service nova] Creating event network-vif-plugged:5ea23a70-144a-4d50-a1b1-6a74d325a5f1 for instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 on n-h2-862964-3 Oct 29 01:37:20.506612 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-00c27911-29e2-445b-814b-04caf9a58831 req-2a1f6f3b-b2f6-49ce-a2e6-6c839a207926 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111889 Oct 29 01:37:20.507302 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3114/5985] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:37:21.043197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ea284914-120a-4792-8332-838279c1cee9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:21.043919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ea284914-120a-4792-8332-838279c1cee9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:21.069504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea284914-120a-4792-8332-838279c1cee9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:21.070144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea284914-120a-4792-8332-838279c1cee9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:21.070536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea284914-120a-4792-8332-838279c1cee9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:21.080621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea284914-120a-4792-8332-838279c1cee9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:21.086894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea284914-120a-4792-8332-838279c1cee9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:21.087530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea284914-120a-4792-8332-838279c1cee9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:21.335617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-740569d1-b207-475c-88f9-1e83998882ba tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:21.457852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-740569d1-b207-475c-88f9-1e83998882ba tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:21.459557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-740569d1-b207-475c-88f9-1e83998882ba tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:21.494339 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-740569d1-b207-475c-88f9-1e83998882ba tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1407 microversion: 2.20 time: 1.416847 Oct 29 01:37:21.544527 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2872/5986] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:37:20 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1407 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:37:21.692627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ea284914-120a-4792-8332-838279c1cee9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:21.712493 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ea284914-120a-4792-8332-838279c1cee9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 0.673997 Oct 29 01:37:21.724658 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3115/5987] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:21 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:22.582352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-be91ab43-32a6-4ee3-88b2-0b13f89edd7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:22.582352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-be91ab43-32a6-4ee3-88b2-0b13f89edd7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:22.611342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be91ab43-32a6-4ee3-88b2-0b13f89edd7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:22.612842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be91ab43-32a6-4ee3-88b2-0b13f89edd7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:22.614647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be91ab43-32a6-4ee3-88b2-0b13f89edd7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:22.620555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be91ab43-32a6-4ee3-88b2-0b13f89edd7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:22.621720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be91ab43-32a6-4ee3-88b2-0b13f89edd7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:22.627103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be91ab43-32a6-4ee3-88b2-0b13f89edd7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:22.757615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1b0ce8f5-7bd0-4f68-99bf-6cb24cbdcac5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:22.759255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1b0ce8f5-7bd0-4f68-99bf-6cb24cbdcac5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:22.780946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b0ce8f5-7bd0-4f68-99bf-6cb24cbdcac5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:22.784741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b0ce8f5-7bd0-4f68-99bf-6cb24cbdcac5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:22.793424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b0ce8f5-7bd0-4f68-99bf-6cb24cbdcac5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:22.799806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b0ce8f5-7bd0-4f68-99bf-6cb24cbdcac5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:22.799806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b0ce8f5-7bd0-4f68-99bf-6cb24cbdcac5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:22.799806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b0ce8f5-7bd0-4f68-99bf-6cb24cbdcac5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:24.463797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-be91ab43-32a6-4ee3-88b2-0b13f89edd7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:24.511887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1b0ce8f5-7bd0-4f68-99bf-6cb24cbdcac5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:24.525176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-be91ab43-32a6-4ee3-88b2-0b13f89edd7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:24.527296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-be91ab43-32a6-4ee3-88b2-0b13f89edd7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:24.555297 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1b0ce8f5-7bd0-4f68-99bf-6cb24cbdcac5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 1.807230 Oct 29 01:37:24.555917 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-be91ab43-32a6-4ee3-88b2-0b13f89edd7d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1407 microversion: 2.20 time: 1.985706 Oct 29 01:37:24.561652 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2873/5988] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:37:22 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1407 bytes in 1998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:37:24.579729 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3116/5989] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:22 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:25.599164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-27e09357-3fea-4ec2-abcb-17959960884d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:25.600620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6a277a6c-4f19-48f5-977e-e4a3a01d3c1f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:25.601340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-27e09357-3fea-4ec2-abcb-17959960884d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:25.601769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6a277a6c-4f19-48f5-977e-e4a3a01d3c1f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:25.657503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a277a6c-4f19-48f5-977e-e4a3a01d3c1f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:25.659389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27e09357-3fea-4ec2-abcb-17959960884d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:25.661312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27e09357-3fea-4ec2-abcb-17959960884d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:25.666367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a277a6c-4f19-48f5-977e-e4a3a01d3c1f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:25.666367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a277a6c-4f19-48f5-977e-e4a3a01d3c1f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:25.666751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27e09357-3fea-4ec2-abcb-17959960884d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:25.670926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a277a6c-4f19-48f5-977e-e4a3a01d3c1f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:25.671268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27e09357-3fea-4ec2-abcb-17959960884d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:25.673114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a277a6c-4f19-48f5-977e-e4a3a01d3c1f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:25.674054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27e09357-3fea-4ec2-abcb-17959960884d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:25.681491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a277a6c-4f19-48f5-977e-e4a3a01d3c1f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:25.681973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27e09357-3fea-4ec2-abcb-17959960884d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:26.370631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6a277a6c-4f19-48f5-977e-e4a3a01d3c1f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:26.400731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6a277a6c-4f19-48f5-977e-e4a3a01d3c1f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:26.417604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6a277a6c-4f19-48f5-977e-e4a3a01d3c1f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:26.417604 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6a277a6c-4f19-48f5-977e-e4a3a01d3c1f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1600 microversion: 2.20 time: 0.808642 Oct 29 01:37:26.417604 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3117/5990] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:37:25 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1600 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:37:26.455710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ed2d67b2-bd3a-4e64-8242-99d55a058c7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:26.456207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ed2d67b2-bd3a-4e64-8242-99d55a058c7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:26.505960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed2d67b2-bd3a-4e64-8242-99d55a058c7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:26.505960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed2d67b2-bd3a-4e64-8242-99d55a058c7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:26.521484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed2d67b2-bd3a-4e64-8242-99d55a058c7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:26.523037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed2d67b2-bd3a-4e64-8242-99d55a058c7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:26.526025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed2d67b2-bd3a-4e64-8242-99d55a058c7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:26.526717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ed2d67b2-bd3a-4e64-8242-99d55a058c7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:26.596467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-27e09357-3fea-4ec2-abcb-17959960884d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:26.605918 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-27e09357-3fea-4ec2-abcb-17959960884d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 1.018173 Oct 29 01:37:26.625594 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2874/5991] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:25 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:37:26.719605 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ed2d67b2-bd3a-4e64-8242-99d55a058c7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.271319 Oct 29 01:37:26.721639 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3118/5992] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Oct 29 01:37:26 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42/os-interface => generated 285 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:37:27.633610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ad3a398d-c5ec-4074-ba02-7e6790f1ac23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:27.635026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ad3a398d-c5ec-4074-ba02-7e6790f1ac23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:27.650667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad3a398d-c5ec-4074-ba02-7e6790f1ac23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:27.657622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad3a398d-c5ec-4074-ba02-7e6790f1ac23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:27.661892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad3a398d-c5ec-4074-ba02-7e6790f1ac23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:27.662678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad3a398d-c5ec-4074-ba02-7e6790f1ac23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:27.663167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad3a398d-c5ec-4074-ba02-7e6790f1ac23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:27.663602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad3a398d-c5ec-4074-ba02-7e6790f1ac23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:27.725649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-74da7d79-82d3-420d-952a-05ba470c3009 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '.version_select at 0x7f9d9781fc10>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:27.847106 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-74da7d79-82d3-420d-952a-05ba470c3009 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-218713555" status: 202 len: 0 microversion: 2.1 time: 0.125033 Oct 29 01:37:27.847554 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3119/5993] 10.222.0.26 () {58 vars in 1281 bytes} [Sat Oct 29 01:37:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-218713555 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:37:27.898913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3199ab86-e053-4beb-ae2c-a75a937ed4e4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'create', calling method: .version_select at 0x7f9d96e934c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-867993550", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPznbNNKLtCJUO+bH63gmQU2px72n3VVIE8Lfybw1olBqaBAsQRBnywxyl2HMIWgF1TCzKLdIMJJ7asu7t72OKAWWvOBwub8/QTJSD7VsxI+GfzNeNbVSSo5A3rAVYC89A=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:27.949332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-3199ab86-e053-4beb-ae2c-a75a937ed4e4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Getting quotas for project 2842ba05180046839fb5d064ad9132a1. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:37:27.969690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-3199ab86-e053-4beb-ae2c-a75a937ed4e4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Getting quotas for user c70e2b34406c4e11afd9471a09d9cfef and project 2842ba05180046839fb5d064ad9132a1. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:37:28.096346 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3199ab86-e053-4beb-ae2c-a75a937ed4e4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.202160 Oct 29 01:37:28.099259 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3120/5994] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:37:27 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:28.822996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ad3a398d-c5ec-4074-ba02-7e6790f1ac23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:28.836489 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ad3a398d-c5ec-4074-ba02-7e6790f1ac23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 1.208165 Oct 29 01:37:28.860907 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2875/5995] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:27 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:29.869289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a657732f-3600-48f1-94f4-1cf81e72f63f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:29.870711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a657732f-3600-48f1-94f4-1cf81e72f63f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:29.888077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a657732f-3600-48f1-94f4-1cf81e72f63f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:29.912819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a657732f-3600-48f1-94f4-1cf81e72f63f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:29.913897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a657732f-3600-48f1-94f4-1cf81e72f63f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:29.914920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a657732f-3600-48f1-94f4-1cf81e72f63f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:29.915569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a657732f-3600-48f1-94f4-1cf81e72f63f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:29.916210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a657732f-3600-48f1-94f4-1cf81e72f63f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:30.645462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-3582eb20-1a1c-4761-8baa-454e6213978d req-9dec33d7-e016-4035-837a-1fa21485a6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c66a75-9fbd-4f0c-baf5-e19875095e42", "tag": "5ea23a70-144a-4d50-a1b1-6a74d325a5f1"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:30.670937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3582eb20-1a1c-4761-8baa-454e6213978d req-9dec33d7-e016-4035-837a-1fa21485a6c6 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:30.675105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3582eb20-1a1c-4761-8baa-454e6213978d req-9dec33d7-e016-4035-837a-1fa21485a6c6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:30.679629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3582eb20-1a1c-4761-8baa-454e6213978d req-9dec33d7-e016-4035-837a-1fa21485a6c6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:30.722328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:37:30.726989 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-3582eb20-1a1c-4761-8baa-454e6213978d req-9dec33d7-e016-4035-837a-1fa21485a6c6 service nova] Creating event network-changed:5ea23a70-144a-4d50-a1b1-6a74d325a5f1 for instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 on n-h2-862964-3 Oct 29 01:37:30.758050 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-3582eb20-1a1c-4761-8baa-454e6213978d req-9dec33d7-e016-4035-837a-1fa21485a6c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108521 Oct 29 01:37:30.763846 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2876/5996] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:31.238512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a657732f-3600-48f1-94f4-1cf81e72f63f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:31.268709 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a657732f-3600-48f1-94f4-1cf81e72f63f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 1.404534 Oct 29 01:37:31.281940 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3121/5997] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:29 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:32.299159 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7a34b71b-c8ce-4ef8-b0a4-7e76c2805737 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:32.299796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7a34b71b-c8ce-4ef8-b0a4-7e76c2805737 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:32.331338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a34b71b-c8ce-4ef8-b0a4-7e76c2805737 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:32.331547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a34b71b-c8ce-4ef8-b0a4-7e76c2805737 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:32.332015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a34b71b-c8ce-4ef8-b0a4-7e76c2805737 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:32.337615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a34b71b-c8ce-4ef8-b0a4-7e76c2805737 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:32.338120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a34b71b-c8ce-4ef8-b0a4-7e76c2805737 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:32.338567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a34b71b-c8ce-4ef8-b0a4-7e76c2805737 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:32.769065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7a34b71b-c8ce-4ef8-b0a4-7e76c2805737 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:32.779295 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7a34b71b-c8ce-4ef8-b0a4-7e76c2805737 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 0.487520 Oct 29 01:37:32.801349 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2877/5998] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:32 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:33.812429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aefd8a0f-1e55-4e50-970a-370b6e2a6cc8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:33.813397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-aefd8a0f-1e55-4e50-970a-370b6e2a6cc8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:33.830569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aefd8a0f-1e55-4e50-970a-370b6e2a6cc8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:33.832572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aefd8a0f-1e55-4e50-970a-370b6e2a6cc8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:33.833414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aefd8a0f-1e55-4e50-970a-370b6e2a6cc8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:33.836178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aefd8a0f-1e55-4e50-970a-370b6e2a6cc8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:33.840277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aefd8a0f-1e55-4e50-970a-370b6e2a6cc8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:33.840966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aefd8a0f-1e55-4e50-970a-370b6e2a6cc8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:34.422830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-aefd8a0f-1e55-4e50-970a-370b6e2a6cc8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:34.446483 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aefd8a0f-1e55-4e50-970a-370b6e2a6cc8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 0.627470 Oct 29 01:37:34.449099 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3122/5999] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:33 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:35.473776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d14c8ced-6e8a-40c9-9d5f-f45b1e77ed24 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:35.475335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d14c8ced-6e8a-40c9-9d5f-f45b1e77ed24 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:35.492494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d14c8ced-6e8a-40c9-9d5f-f45b1e77ed24 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:35.493657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d14c8ced-6e8a-40c9-9d5f-f45b1e77ed24 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:35.494299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d14c8ced-6e8a-40c9-9d5f-f45b1e77ed24 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:35.497732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d14c8ced-6e8a-40c9-9d5f-f45b1e77ed24 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:35.500999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d14c8ced-6e8a-40c9-9d5f-f45b1e77ed24 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:35.502062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d14c8ced-6e8a-40c9-9d5f-f45b1e77ed24 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:36.256202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d14c8ced-6e8a-40c9-9d5f-f45b1e77ed24 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:36.271073 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d14c8ced-6e8a-40c9-9d5f-f45b1e77ed24 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 0.802528 Oct 29 01:37:36.272093 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2878/6000] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:35 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:37.302766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7ab8c18e-ad4c-43d8-82fb-6277d4a8b1b7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:37.303381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7ab8c18e-ad4c-43d8-82fb-6277d4a8b1b7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:37.329109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ab8c18e-ad4c-43d8-82fb-6277d4a8b1b7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:37.333004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ab8c18e-ad4c-43d8-82fb-6277d4a8b1b7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:37.333004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ab8c18e-ad4c-43d8-82fb-6277d4a8b1b7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:37.336417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ab8c18e-ad4c-43d8-82fb-6277d4a8b1b7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:37.337001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ab8c18e-ad4c-43d8-82fb-6277d4a8b1b7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:37.341258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7ab8c18e-ad4c-43d8-82fb-6277d4a8b1b7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:37.764136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7ab8c18e-ad4c-43d8-82fb-6277d4a8b1b7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:37.775419 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7ab8c18e-ad4c-43d8-82fb-6277d4a8b1b7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 0.476673 Oct 29 01:37:37.787598 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3123/6001] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:37 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:38.813839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6c029a82-4ba4-430f-8f12-8ae167a2a3e2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:38.815141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6c029a82-4ba4-430f-8f12-8ae167a2a3e2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:38.836524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6c029a82-4ba4-430f-8f12-8ae167a2a3e2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:38.841248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6c029a82-4ba4-430f-8f12-8ae167a2a3e2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:38.843792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6c029a82-4ba4-430f-8f12-8ae167a2a3e2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:38.849599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6c029a82-4ba4-430f-8f12-8ae167a2a3e2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:38.852935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6c029a82-4ba4-430f-8f12-8ae167a2a3e2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:38.854576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6c029a82-4ba4-430f-8f12-8ae167a2a3e2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:39.363104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6c029a82-4ba4-430f-8f12-8ae167a2a3e2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:39.376398 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6c029a82-4ba4-430f-8f12-8ae167a2a3e2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 0.568717 Oct 29 01:37:39.381382 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2879/6002] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:38 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:40.408194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9bbd3855-8a5e-4b21-bec3-500b39b2b789 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:40.409611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9bbd3855-8a5e-4b21-bec3-500b39b2b789 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:40.414291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:37:40.429831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bbd3855-8a5e-4b21-bec3-500b39b2b789 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:40.435010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bbd3855-8a5e-4b21-bec3-500b39b2b789 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:40.435010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bbd3855-8a5e-4b21-bec3-500b39b2b789 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:40.436182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bbd3855-8a5e-4b21-bec3-500b39b2b789 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:40.436914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bbd3855-8a5e-4b21-bec3-500b39b2b789 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:40.439879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bbd3855-8a5e-4b21-bec3-500b39b2b789 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:41.246108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9bbd3855-8a5e-4b21-bec3-500b39b2b789 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:41.256613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:37:41.275756 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9bbd3855-8a5e-4b21-bec3-500b39b2b789 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 0.873242 Oct 29 01:37:41.280523 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3124/6003] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:40 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:42.317607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-56eb5740-cd94-40de-8da5-cead41ce4f2f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:42.318918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-56eb5740-cd94-40de-8da5-cead41ce4f2f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:42.356304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56eb5740-cd94-40de-8da5-cead41ce4f2f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:42.357121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56eb5740-cd94-40de-8da5-cead41ce4f2f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:42.357817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56eb5740-cd94-40de-8da5-cead41ce4f2f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:42.360192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56eb5740-cd94-40de-8da5-cead41ce4f2f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:42.363024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56eb5740-cd94-40de-8da5-cead41ce4f2f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:42.364380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56eb5740-cd94-40de-8da5-cead41ce4f2f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:43.479116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-56eb5740-cd94-40de-8da5-cead41ce4f2f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:43.488882 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-56eb5740-cd94-40de-8da5-cead41ce4f2f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 1.182289 Oct 29 01:37:43.506640 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2880/6004] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:42 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:44.522787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5b778fe5-1cc7-4b28-b2c9-01034e931ce5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:44.523561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5b778fe5-1cc7-4b28-b2c9-01034e931ce5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:44.538545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b778fe5-1cc7-4b28-b2c9-01034e931ce5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:44.539115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b778fe5-1cc7-4b28-b2c9-01034e931ce5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:44.539691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b778fe5-1cc7-4b28-b2c9-01034e931ce5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:44.542378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b778fe5-1cc7-4b28-b2c9-01034e931ce5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:44.544227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b778fe5-1cc7-4b28-b2c9-01034e931ce5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:44.545794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b778fe5-1cc7-4b28-b2c9-01034e931ce5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:45.467844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5b778fe5-1cc7-4b28-b2c9-01034e931ce5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:45.476300 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5b778fe5-1cc7-4b28-b2c9-01034e931ce5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 0.957402 Oct 29 01:37:45.490555 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3125/6005] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:44 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:46.522538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-44ecec4a-ab2a-4575-915d-68aca4e675af tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:46.523297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-44ecec4a-ab2a-4575-915d-68aca4e675af tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:46.543126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44ecec4a-ab2a-4575-915d-68aca4e675af tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:46.548531 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44ecec4a-ab2a-4575-915d-68aca4e675af tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:46.555091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44ecec4a-ab2a-4575-915d-68aca4e675af tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:46.558449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44ecec4a-ab2a-4575-915d-68aca4e675af tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:46.565176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44ecec4a-ab2a-4575-915d-68aca4e675af tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:46.567346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44ecec4a-ab2a-4575-915d-68aca4e675af tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:47.576985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-44ecec4a-ab2a-4575-915d-68aca4e675af tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:47.585572 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-44ecec4a-ab2a-4575-915d-68aca4e675af tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 1.067293 Oct 29 01:37:47.588369 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2881/6006] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:46 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:48.614360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7e8e96ff-a63c-478d-87f4-6d1b7f29110e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:48.615182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7e8e96ff-a63c-478d-87f4-6d1b7f29110e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:48.622935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:37:48.643903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e8e96ff-a63c-478d-87f4-6d1b7f29110e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:48.644489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e8e96ff-a63c-478d-87f4-6d1b7f29110e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:48.649059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e8e96ff-a63c-478d-87f4-6d1b7f29110e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:48.650549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e8e96ff-a63c-478d-87f4-6d1b7f29110e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:48.653815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e8e96ff-a63c-478d-87f4-6d1b7f29110e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:48.654310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7e8e96ff-a63c-478d-87f4-6d1b7f29110e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:49.145287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7e8e96ff-a63c-478d-87f4-6d1b7f29110e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:49.156025 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7e8e96ff-a63c-478d-87f4-6d1b7f29110e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 0.545983 Oct 29 01:37:49.177991 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3126/6007] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:48 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:37:50.189228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-18cd0c99-530d-4d0a-afaa-2a908ff4f9cd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:50.193993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-18cd0c99-530d-4d0a-afaa-2a908ff4f9cd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:50.201923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=26 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:37:50.204798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18cd0c99-530d-4d0a-afaa-2a908ff4f9cd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:50.210695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18cd0c99-530d-4d0a-afaa-2a908ff4f9cd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:50.211844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18cd0c99-530d-4d0a-afaa-2a908ff4f9cd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:50.212893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18cd0c99-530d-4d0a-afaa-2a908ff4f9cd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:50.236319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18cd0c99-530d-4d0a-afaa-2a908ff4f9cd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:50.237073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-18cd0c99-530d-4d0a-afaa-2a908ff4f9cd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:50.803518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-18cd0c99-530d-4d0a-afaa-2a908ff4f9cd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:50.815564 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-18cd0c99-530d-4d0a-afaa-2a908ff4f9cd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 0.633017 Oct 29 01:37:50.831778 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2882/6008] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:50 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:51.844339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-56c13187-255f-499a-9cdd-fa6729398a30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:51.848061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-56c13187-255f-499a-9cdd-fa6729398a30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:51.856004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56c13187-255f-499a-9cdd-fa6729398a30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:51.856703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56c13187-255f-499a-9cdd-fa6729398a30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:51.857361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56c13187-255f-499a-9cdd-fa6729398a30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:51.858286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56c13187-255f-499a-9cdd-fa6729398a30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:51.859162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56c13187-255f-499a-9cdd-fa6729398a30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:51.859653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-56c13187-255f-499a-9cdd-fa6729398a30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:52.023718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-56c13187-255f-499a-9cdd-fa6729398a30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:52.034415 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-56c13187-255f-499a-9cdd-fa6729398a30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 0.194559 Oct 29 01:37:52.036202 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3127/6009] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:51 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:53.090977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a5163a2f-9019-422e-8f68-655bda20dfcc tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:53.092463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a5163a2f-9019-422e-8f68-655bda20dfcc tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:53.112115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a5163a2f-9019-422e-8f68-655bda20dfcc tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:53.115082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a5163a2f-9019-422e-8f68-655bda20dfcc tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:53.116353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a5163a2f-9019-422e-8f68-655bda20dfcc tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:53.119486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a5163a2f-9019-422e-8f68-655bda20dfcc tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:53.120254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a5163a2f-9019-422e-8f68-655bda20dfcc tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:53.121649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a5163a2f-9019-422e-8f68-655bda20dfcc tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:53.547726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a5163a2f-9019-422e-8f68-655bda20dfcc tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:53.559135 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a5163a2f-9019-422e-8f68-655bda20dfcc tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 0.486912 Oct 29 01:37:53.576100 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2883/6010] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:53 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:54.588282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-46e5295d-03c9-4ec4-a092-6ce36b0db6b6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:54.589732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-46e5295d-03c9-4ec4-a092-6ce36b0db6b6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:54.611670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46e5295d-03c9-4ec4-a092-6ce36b0db6b6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:54.614344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46e5295d-03c9-4ec4-a092-6ce36b0db6b6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:54.615485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46e5295d-03c9-4ec4-a092-6ce36b0db6b6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:54.658565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46e5295d-03c9-4ec4-a092-6ce36b0db6b6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:54.659078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46e5295d-03c9-4ec4-a092-6ce36b0db6b6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:54.659529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-46e5295d-03c9-4ec4-a092-6ce36b0db6b6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:55.074364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-46e5295d-03c9-4ec4-a092-6ce36b0db6b6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:55.084920 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-46e5295d-03c9-4ec4-a092-6ce36b0db6b6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1683 microversion: 2.1 time: 0.502435 Oct 29 01:37:55.102480 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3128/6011] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:54 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1683 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:56.116310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0fb80b27-c73f-49ce-8599-ee74514f9f23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:56.117611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0fb80b27-c73f-49ce-8599-ee74514f9f23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:56.131922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fb80b27-c73f-49ce-8599-ee74514f9f23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:56.132427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fb80b27-c73f-49ce-8599-ee74514f9f23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:56.140158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fb80b27-c73f-49ce-8599-ee74514f9f23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:56.140950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fb80b27-c73f-49ce-8599-ee74514f9f23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:56.144767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fb80b27-c73f-49ce-8599-ee74514f9f23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:56.149004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fb80b27-c73f-49ce-8599-ee74514f9f23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:56.546740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0fb80b27-c73f-49ce-8599-ee74514f9f23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:56.559317 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0fb80b27-c73f-49ce-8599-ee74514f9f23 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.447184 Oct 29 01:37:56.562239 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2884/6012] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:56 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:57.667777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5449d629-504e-4ef5-baa0-8394a40a6a64 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-558810950", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "f731f7ce-9376-466d-83fc-1b19a78f7659"}], "key_name": "tempest-TestNetworkAdvancedServerOps-867993550", "security_groups": [{"name": "tempest-secgroup-smoke-976208363"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:58.020477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-5449d629-504e-4ef5-baa0-8394a40a6a64 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] validate_networks() for [('f731f7ce-9376-466d-83fc-1b19a78f7659', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:37:58.805718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-09fa941b-e978-4b24-a50b-59ce9f3ff8b2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:58.806195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-09fa941b-e978-4b24-a50b-59ce9f3ff8b2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:37:58.818385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-09fa941b-e978-4b24-a50b-59ce9f3ff8b2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:58.818997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-09fa941b-e978-4b24-a50b-59ce9f3ff8b2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:58.830172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-09fa941b-e978-4b24-a50b-59ce9f3ff8b2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:37:58.832819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-09fa941b-e978-4b24-a50b-59ce9f3ff8b2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:37:58.835114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-09fa941b-e978-4b24-a50b-59ce9f3ff8b2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:37:58.836732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-09fa941b-e978-4b24-a50b-59ce9f3ff8b2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:00.052332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-09fa941b-e978-4b24-a50b-59ce9f3ff8b2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:00.083194 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-09fa941b-e978-4b24-a50b-59ce9f3ff8b2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 1.281711 Oct 29 01:38:00.084405 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2885/6013] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:37:58 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:00.281103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5449d629-504e-4ef5-baa0-8394a40a6a64 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:38:00.281735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5449d629-504e-4ef5-baa0-8394a40a6a64 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:38:00.282500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5449d629-504e-4ef5-baa0-8394a40a6a64 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:38:00.282925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5449d629-504e-4ef5-baa0-8394a40a6a64 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:38:00.283352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5449d629-504e-4ef5-baa0-8394a40a6a64 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:38:00.323544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5449d629-504e-4ef5-baa0-8394a40a6a64 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:00.324045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5449d629-504e-4ef5-baa0-8394a40a6a64 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:00.324588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5449d629-504e-4ef5-baa0-8394a40a6a64 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:00.325379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5449d629-504e-4ef5-baa0-8394a40a6a64 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:00.325863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5449d629-504e-4ef5-baa0-8394a40a6a64 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:00.326282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5449d629-504e-4ef5-baa0-8394a40a6a64 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:00.391853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-5449d629-504e-4ef5-baa0-8394a40a6a64 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Getting quotas for project 2842ba05180046839fb5d064ad9132a1. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:38:00.401880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-5449d629-504e-4ef5-baa0-8394a40a6a64 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Getting quotas for user c70e2b34406c4e11afd9471a09d9cfef and project 2842ba05180046839fb5d064ad9132a1. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:38:00.467254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5449d629-504e-4ef5-baa0-8394a40a6a64 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:38:00.472965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5449d629-504e-4ef5-baa0-8394a40a6a64 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:38:00.679042 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5449d629-504e-4ef5-baa0-8394a40a6a64 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.019224 Oct 29 01:38:00.687076 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3129/6014] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:37:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 3028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:38:00.904552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-a80c6b2a-0c52-40a3-886d-55c1ad84d57b req-657b767e-322f-43c2-9bd9-47bacb0ed6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a", "name": "network-vif-unplugged", "status": "completed", "tag": "5a9cbab0-94b4-4948-a2da-c29b923b64da"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:00.924947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a80c6b2a-0c52-40a3-886d-55c1ad84d57b req-657b767e-322f-43c2-9bd9-47bacb0ed6d0 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:00.926139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a80c6b2a-0c52-40a3-886d-55c1ad84d57b req-657b767e-322f-43c2-9bd9-47bacb0ed6d0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:00.927082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-a80c6b2a-0c52-40a3-886d-55c1ad84d57b req-657b767e-322f-43c2-9bd9-47bacb0ed6d0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:00.955112 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-a80c6b2a-0c52-40a3-886d-55c1ad84d57b req-657b767e-322f-43c2-9bd9-47bacb0ed6d0 service nova] Creating event network-vif-unplugged:5a9cbab0-94b4-4948-a2da-c29b923b64da for instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a on n-h1-862964-3 Oct 29 01:38:00.962587 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-a80c6b2a-0c52-40a3-886d-55c1ad84d57b req-657b767e-322f-43c2-9bd9-47bacb0ed6d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060187 Oct 29 01:38:00.965699 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3130/6015] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:38:01.130928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-04a804b8-482c-4d83-9e43-6419ca364197 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:01.138619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-04a804b8-482c-4d83-9e43-6419ca364197 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:01.338401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-04a804b8-482c-4d83-9e43-6419ca364197 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:01.352714 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-04a804b8-482c-4d83-9e43-6419ca364197 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1265 microversion: 2.1 time: 0.655339 Oct 29 01:38:01.353183 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2886/6016] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:00 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1265 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:02.383063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b6bce173-d0d3-44c4-8106-d9a5f20e2035 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:02.386113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b6bce173-d0d3-44c4-8106-d9a5f20e2035 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:02.525965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b6bce173-d0d3-44c4-8106-d9a5f20e2035 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:02.543495 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b6bce173-d0d3-44c4-8106-d9a5f20e2035 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1265 microversion: 2.1 time: 0.166031 Oct 29 01:38:02.543495 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3131/6017] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:02 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:03.579302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3f8a9eac-4d22-488d-829c-d4b200808e4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:03.580738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3f8a9eac-4d22-488d-829c-d4b200808e4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:03.660335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8a9eac-4d22-488d-829c-d4b200808e4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:03.667969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8a9eac-4d22-488d-829c-d4b200808e4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:03.668479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8a9eac-4d22-488d-829c-d4b200808e4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:03.681268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8a9eac-4d22-488d-829c-d4b200808e4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:03.681268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8a9eac-4d22-488d-829c-d4b200808e4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:03.681268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f8a9eac-4d22-488d-829c-d4b200808e4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:03.727452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=55 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:38:03.809199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3f8a9eac-4d22-488d-829c-d4b200808e4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:03.820278 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3f8a9eac-4d22-488d-829c-d4b200808e4a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1317 microversion: 2.1 time: 0.259518 Oct 29 01:38:03.821542 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2887/6018] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:03 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:03.835944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-57ddb61e-154f-4fdd-8b2b-7375a308d322 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:03.838342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-57ddb61e-154f-4fdd-8b2b-7375a308d322 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:03.858432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57ddb61e-154f-4fdd-8b2b-7375a308d322 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:03.861261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57ddb61e-154f-4fdd-8b2b-7375a308d322 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:03.861261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57ddb61e-154f-4fdd-8b2b-7375a308d322 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:03.861261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57ddb61e-154f-4fdd-8b2b-7375a308d322 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:03.861261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57ddb61e-154f-4fdd-8b2b-7375a308d322 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:03.861261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57ddb61e-154f-4fdd-8b2b-7375a308d322 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:04.219726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-57ddb61e-154f-4fdd-8b2b-7375a308d322 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:04.238643 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-57ddb61e-154f-4fdd-8b2b-7375a308d322 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.411546 Oct 29 01:38:04.241880 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3132/6019] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:03 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:04.284504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e48a346f-48e9-4d71-8403-a38823d3f5f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:04.286863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e48a346f-48e9-4d71-8403-a38823d3f5f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:04.310518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e48a346f-48e9-4d71-8403-a38823d3f5f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:04.312376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e48a346f-48e9-4d71-8403-a38823d3f5f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:04.313892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e48a346f-48e9-4d71-8403-a38823d3f5f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:04.316665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e48a346f-48e9-4d71-8403-a38823d3f5f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:04.317791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e48a346f-48e9-4d71-8403-a38823d3f5f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:04.318747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e48a346f-48e9-4d71-8403-a38823d3f5f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:04.847097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-45959df0-5f9f-4286-b9a6-6c3b99c28802 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:04.847906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-45959df0-5f9f-4286-b9a6-6c3b99c28802 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:04.859401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45959df0-5f9f-4286-b9a6-6c3b99c28802 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:04.859401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45959df0-5f9f-4286-b9a6-6c3b99c28802 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:04.859401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45959df0-5f9f-4286-b9a6-6c3b99c28802 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:04.860180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45959df0-5f9f-4286-b9a6-6c3b99c28802 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:04.861423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45959df0-5f9f-4286-b9a6-6c3b99c28802 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:04.862099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45959df0-5f9f-4286-b9a6-6c3b99c28802 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:05.085851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-45959df0-5f9f-4286-b9a6-6c3b99c28802 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:05.099061 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-45959df0-5f9f-4286-b9a6-6c3b99c28802 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1335 microversion: 2.1 time: 0.256865 Oct 29 01:38:05.100460 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3133/6020] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:04 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1335 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:05.173349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e48a346f-48e9-4d71-8403-a38823d3f5f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:05.200368 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e48a346f-48e9-4d71-8403-a38823d3f5f0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.935794 Oct 29 01:38:05.209298 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2888/6021] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:04 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:05.227670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9ae3e22f-3bc1-4ad0-97e3-c6339f51d73e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:05.228291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9ae3e22f-3bc1-4ad0-97e3-c6339f51d73e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:05.249832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ae3e22f-3bc1-4ad0-97e3-c6339f51d73e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:05.249832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ae3e22f-3bc1-4ad0-97e3-c6339f51d73e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:05.250110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ae3e22f-3bc1-4ad0-97e3-c6339f51d73e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:05.250695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ae3e22f-3bc1-4ad0-97e3-c6339f51d73e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:05.251351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ae3e22f-3bc1-4ad0-97e3-c6339f51d73e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:05.251954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ae3e22f-3bc1-4ad0-97e3-c6339f51d73e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:05.649420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9ae3e22f-3bc1-4ad0-97e3-c6339f51d73e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:05.663443 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9ae3e22f-3bc1-4ad0-97e3-c6339f51d73e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.442820 Oct 29 01:38:05.685093 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3134/6022] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:05 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:05.695679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c6167ef3-29bf-40d8-8ef2-b11d1c1eca58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:05.701509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c6167ef3-29bf-40d8-8ef2-b11d1c1eca58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:05.730567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6167ef3-29bf-40d8-8ef2-b11d1c1eca58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:05.734962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6167ef3-29bf-40d8-8ef2-b11d1c1eca58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:05.740859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6167ef3-29bf-40d8-8ef2-b11d1c1eca58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:05.741868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6167ef3-29bf-40d8-8ef2-b11d1c1eca58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:05.742524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6167ef3-29bf-40d8-8ef2-b11d1c1eca58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:05.743168 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6167ef3-29bf-40d8-8ef2-b11d1c1eca58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:06.028993 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c6167ef3-29bf-40d8-8ef2-b11d1c1eca58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.337640 Oct 29 01:38:06.030905 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2889/6023] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:38:05 2022] POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:38:06.039025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3e0a641e-3e53-435d-b76f-d81b9460916d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:06.039655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3e0a641e-3e53-435d-b76f-d81b9460916d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:06.052559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e0a641e-3e53-435d-b76f-d81b9460916d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:06.053077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e0a641e-3e53-435d-b76f-d81b9460916d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:06.055712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e0a641e-3e53-435d-b76f-d81b9460916d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:06.056690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e0a641e-3e53-435d-b76f-d81b9460916d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:06.057056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e0a641e-3e53-435d-b76f-d81b9460916d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:06.057534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e0a641e-3e53-435d-b76f-d81b9460916d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:06.136892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6f99dfc0-104a-4bfa-85a3-d22045f2aedb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:06.136892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6f99dfc0-104a-4bfa-85a3-d22045f2aedb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:06.167354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f99dfc0-104a-4bfa-85a3-d22045f2aedb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:06.167869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f99dfc0-104a-4bfa-85a3-d22045f2aedb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:06.168346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f99dfc0-104a-4bfa-85a3-d22045f2aedb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:06.169471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f99dfc0-104a-4bfa-85a3-d22045f2aedb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:06.169942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f99dfc0-104a-4bfa-85a3-d22045f2aedb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:06.170383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f99dfc0-104a-4bfa-85a3-d22045f2aedb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:06.565621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6f99dfc0-104a-4bfa-85a3-d22045f2aedb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:06.575668 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6f99dfc0-104a-4bfa-85a3-d22045f2aedb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1323 microversion: 2.1 time: 0.445462 Oct 29 01:38:06.581101 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2890/6024] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:06 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1323 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:06.646891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3e0a641e-3e53-435d-b76f-d81b9460916d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:06.663772 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3e0a641e-3e53-435d-b76f-d81b9460916d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1672 microversion: 2.1 time: 0.628613 Oct 29 01:38:06.685941 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3135/6025] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:06 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1672 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:07.605049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-771db518-c26b-4a66-bfe4-75068602de0c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:07.609860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-771db518-c26b-4a66-bfe4-75068602de0c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:07.650878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-771db518-c26b-4a66-bfe4-75068602de0c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:07.651500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-771db518-c26b-4a66-bfe4-75068602de0c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:07.652191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-771db518-c26b-4a66-bfe4-75068602de0c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:07.653180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-771db518-c26b-4a66-bfe4-75068602de0c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:07.661913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-771db518-c26b-4a66-bfe4-75068602de0c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:07.662724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-771db518-c26b-4a66-bfe4-75068602de0c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:07.692321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-71c539af-19a4-4ca1-9708-6b492f735f3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:07.693583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-71c539af-19a4-4ca1-9708-6b492f735f3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:07.712816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71c539af-19a4-4ca1-9708-6b492f735f3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:07.713355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71c539af-19a4-4ca1-9708-6b492f735f3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:07.713800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71c539af-19a4-4ca1-9708-6b492f735f3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:07.714737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71c539af-19a4-4ca1-9708-6b492f735f3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:07.715374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71c539af-19a4-4ca1-9708-6b492f735f3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:07.715979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-71c539af-19a4-4ca1-9708-6b492f735f3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:08.325353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-71c539af-19a4-4ca1-9708-6b492f735f3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:08.360869 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-71c539af-19a4-4ca1-9708-6b492f735f3a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1672 microversion: 2.1 time: 0.672293 Oct 29 01:38:08.381683 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3136/6026] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:07 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1672 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:08.429950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-771db518-c26b-4a66-bfe4-75068602de0c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:08.450755 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-771db518-c26b-4a66-bfe4-75068602de0c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1390 microversion: 2.1 time: 0.850346 Oct 29 01:38:08.458709 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2891/6027] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:07 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1390 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:08.861211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-cfd844ad-1444-4714-b734-7c30ea79bf38 req-80ffc6fe-06ba-48de-b51a-bc50d2384be4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2e1d1e-3097-4c13-8eb9-c32fb30d4857", "tag": "46e11602-6278-473b-906b-a860e498b401"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:08.887826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cfd844ad-1444-4714-b734-7c30ea79bf38 req-80ffc6fe-06ba-48de-b51a-bc50d2384be4 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:08.908654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cfd844ad-1444-4714-b734-7c30ea79bf38 req-80ffc6fe-06ba-48de-b51a-bc50d2384be4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:08.909186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cfd844ad-1444-4714-b734-7c30ea79bf38 req-80ffc6fe-06ba-48de-b51a-bc50d2384be4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:08.960552 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-cfd844ad-1444-4714-b734-7c30ea79bf38 req-80ffc6fe-06ba-48de-b51a-bc50d2384be4 service nova] Creating event network-changed:46e11602-6278-473b-906b-a860e498b401 for instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 on n-h1-862964-3 Oct 29 01:38:08.966261 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-cfd844ad-1444-4714-b734-7c30ea79bf38 req-80ffc6fe-06ba-48de-b51a-bc50d2384be4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109927 Oct 29 01:38:08.967851 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3137/6028] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:38:09.397424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-24977ad5-bb7c-4c21-afe4-6b1de500dd60 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:09.398254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-24977ad5-bb7c-4c21-afe4-6b1de500dd60 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:09.415280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24977ad5-bb7c-4c21-afe4-6b1de500dd60 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:09.423831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24977ad5-bb7c-4c21-afe4-6b1de500dd60 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:09.423831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24977ad5-bb7c-4c21-afe4-6b1de500dd60 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:09.423831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24977ad5-bb7c-4c21-afe4-6b1de500dd60 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:09.423831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24977ad5-bb7c-4c21-afe4-6b1de500dd60 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:09.423831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-24977ad5-bb7c-4c21-afe4-6b1de500dd60 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:09.498269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ef7f1717-b338-4e22-91b9-366d99cd924d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:09.503600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ef7f1717-b338-4e22-91b9-366d99cd924d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:09.553355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef7f1717-b338-4e22-91b9-366d99cd924d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:09.578230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef7f1717-b338-4e22-91b9-366d99cd924d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:09.578695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef7f1717-b338-4e22-91b9-366d99cd924d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:09.587053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef7f1717-b338-4e22-91b9-366d99cd924d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:09.587705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef7f1717-b338-4e22-91b9-366d99cd924d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:09.588161 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ef7f1717-b338-4e22-91b9-366d99cd924d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:10.293483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ef7f1717-b338-4e22-91b9-366d99cd924d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:10.314925 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ef7f1717-b338-4e22-91b9-366d99cd924d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1390 microversion: 2.1 time: 0.837324 Oct 29 01:38:10.334405 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3138/6029] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:09 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1390 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:10.359406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-24977ad5-bb7c-4c21-afe4-6b1de500dd60 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:10.385835 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-24977ad5-bb7c-4c21-afe4-6b1de500dd60 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.986308 Oct 29 01:38:10.387492 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2892/6030] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:09 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:10.418050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-28d115d4-1fee-4324-8768-75b0fd6f706e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:10.422854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-28d115d4-1fee-4324-8768-75b0fd6f706e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:10.441458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:38:10.444947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28d115d4-1fee-4324-8768-75b0fd6f706e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:10.446149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28d115d4-1fee-4324-8768-75b0fd6f706e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:10.448635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28d115d4-1fee-4324-8768-75b0fd6f706e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:10.462562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28d115d4-1fee-4324-8768-75b0fd6f706e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:10.465584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28d115d4-1fee-4324-8768-75b0fd6f706e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:10.475553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-28d115d4-1fee-4324-8768-75b0fd6f706e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:11.348000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-60445cc1-dcfb-4c6e-9340-67f43154e7ef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:11.348900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-60445cc1-dcfb-4c6e-9340-67f43154e7ef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:11.357028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:38:11.385337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60445cc1-dcfb-4c6e-9340-67f43154e7ef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:11.387786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60445cc1-dcfb-4c6e-9340-67f43154e7ef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:11.391289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60445cc1-dcfb-4c6e-9340-67f43154e7ef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:11.395449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60445cc1-dcfb-4c6e-9340-67f43154e7ef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:11.395956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60445cc1-dcfb-4c6e-9340-67f43154e7ef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:11.396447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60445cc1-dcfb-4c6e-9340-67f43154e7ef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:12.445781 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-28d115d4-1fee-4324-8768-75b0fd6f706e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action" status: 200 len: 324 microversion: 2.1 time: 2.032558 Oct 29 01:38:12.446829 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3139/6031] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:38:10 2022] POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action => generated 324 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:38:12.457340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fb519229-2aa7-41ca-acd5-a2af08178865 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:12.458318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fb519229-2aa7-41ca-acd5-a2af08178865 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:12.481469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb519229-2aa7-41ca-acd5-a2af08178865 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:12.482336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb519229-2aa7-41ca-acd5-a2af08178865 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:12.483586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb519229-2aa7-41ca-acd5-a2af08178865 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:12.484727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb519229-2aa7-41ca-acd5-a2af08178865 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:12.485400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb519229-2aa7-41ca-acd5-a2af08178865 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:12.486009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb519229-2aa7-41ca-acd5-a2af08178865 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:12.564660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=8 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:38:12.837554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-60445cc1-dcfb-4c6e-9340-67f43154e7ef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:12.855767 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-60445cc1-dcfb-4c6e-9340-67f43154e7ef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1390 microversion: 2.1 time: 1.515513 Oct 29 01:38:12.861616 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2893/6032] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:11 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1390 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:13.130315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fb519229-2aa7-41ca-acd5-a2af08178865 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:13.161386 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fb519229-2aa7-41ca-acd5-a2af08178865 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.704678 Oct 29 01:38:13.163807 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3140/6033] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:12 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:13.200041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-263f60d0-9da7-4ac1-ad95-efef39fb7f17 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:13.200656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-263f60d0-9da7-4ac1-ad95-efef39fb7f17 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:13.208678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-263f60d0-9da7-4ac1-ad95-efef39fb7f17 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:13.209477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-263f60d0-9da7-4ac1-ad95-efef39fb7f17 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:13.210567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-263f60d0-9da7-4ac1-ad95-efef39fb7f17 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:13.211966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-263f60d0-9da7-4ac1-ad95-efef39fb7f17 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:13.212602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-263f60d0-9da7-4ac1-ad95-efef39fb7f17 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:13.213221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-263f60d0-9da7-4ac1-ad95-efef39fb7f17 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:13.891847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-79bc1e52-0c79-442f-8b7b-2fcc2261917d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:13.893398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-79bc1e52-0c79-442f-8b7b-2fcc2261917d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:13.918099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79bc1e52-0c79-442f-8b7b-2fcc2261917d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:13.918843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79bc1e52-0c79-442f-8b7b-2fcc2261917d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:13.919485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79bc1e52-0c79-442f-8b7b-2fcc2261917d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:13.920407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79bc1e52-0c79-442f-8b7b-2fcc2261917d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:13.921208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79bc1e52-0c79-442f-8b7b-2fcc2261917d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:13.921813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79bc1e52-0c79-442f-8b7b-2fcc2261917d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:13.956490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-263f60d0-9da7-4ac1-ad95-efef39fb7f17 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:13.984233 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-263f60d0-9da7-4ac1-ad95-efef39fb7f17 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.787849 Oct 29 01:38:13.997984 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2894/6034] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:13 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:14.024761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1f0033a4-b461-462b-ac67-b64c8b7e76d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:14.025687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1f0033a4-b461-462b-ac67-b64c8b7e76d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:14.043767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f0033a4-b461-462b-ac67-b64c8b7e76d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:14.044535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f0033a4-b461-462b-ac67-b64c8b7e76d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:14.045200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f0033a4-b461-462b-ac67-b64c8b7e76d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:14.046636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f0033a4-b461-462b-ac67-b64c8b7e76d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:14.047281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f0033a4-b461-462b-ac67-b64c8b7e76d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:14.047889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f0033a4-b461-462b-ac67-b64c8b7e76d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:14.928846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-79bc1e52-0c79-442f-8b7b-2fcc2261917d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:14.937076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1f0033a4-b461-462b-ac67-b64c8b7e76d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:14.942775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=82 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:38:14.954905 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1f0033a4-b461-462b-ac67-b64c8b7e76d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.933962 Oct 29 01:38:14.958704 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2895/6035] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:14 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:14.989099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-70e6ff0d-d2db-4761-8c12-203f6c565af3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:14.990004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-70e6ff0d-d2db-4761-8c12-203f6c565af3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:14.991949 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-79bc1e52-0c79-442f-8b7b-2fcc2261917d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1390 microversion: 2.1 time: 1.089083 Oct 29 01:38:14.993624 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3141/6036] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:13 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1390 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:14.997346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70e6ff0d-d2db-4761-8c12-203f6c565af3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:14.998017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70e6ff0d-d2db-4761-8c12-203f6c565af3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:14.998617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70e6ff0d-d2db-4761-8c12-203f6c565af3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:15.000246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70e6ff0d-d2db-4761-8c12-203f6c565af3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:15.000870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70e6ff0d-d2db-4761-8c12-203f6c565af3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:15.001506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70e6ff0d-d2db-4761-8c12-203f6c565af3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:15.249672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-70e6ff0d-d2db-4761-8c12-203f6c565af3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:15.270420 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-70e6ff0d-d2db-4761-8c12-203f6c565af3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.276053 Oct 29 01:38:15.270420 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2896/6037] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:14 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:15.496941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5f00ae46-5d43-4d66-b83b-af0b9e3a9577 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1707015980", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "8568990a-4f98-461a-8f32-e20720daa4e5"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:15.659437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-5f00ae46-5d43-4d66-b83b-af0b9e3a9577 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] validate_networks() for [('8568990a-4f98-461a-8f32-e20720daa4e5', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:38:16.024737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-742bb551-9675-45b9-86e3-8b6db8f66786 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:16.027501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-742bb551-9675-45b9-86e3-8b6db8f66786 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:16.051547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-742bb551-9675-45b9-86e3-8b6db8f66786 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:16.052351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-742bb551-9675-45b9-86e3-8b6db8f66786 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:16.054065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-742bb551-9675-45b9-86e3-8b6db8f66786 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:16.054831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-742bb551-9675-45b9-86e3-8b6db8f66786 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:16.055307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-742bb551-9675-45b9-86e3-8b6db8f66786 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:16.055745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-742bb551-9675-45b9-86e3-8b6db8f66786 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:16.470427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-742bb551-9675-45b9-86e3-8b6db8f66786 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:16.484931 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-742bb551-9675-45b9-86e3-8b6db8f66786 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1390 microversion: 2.1 time: 0.465263 Oct 29 01:38:16.486983 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2897/6038] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:16 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1390 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:16.941143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5f00ae46-5d43-4d66-b83b-af0b9e3a9577 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:38:16.943356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5f00ae46-5d43-4d66-b83b-af0b9e3a9577 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:38:16.944095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5f00ae46-5d43-4d66-b83b-af0b9e3a9577 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:38:16.945463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5f00ae46-5d43-4d66-b83b-af0b9e3a9577 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:38:16.945944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-5f00ae46-5d43-4d66-b83b-af0b9e3a9577 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:38:16.988032 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f00ae46-5d43-4d66-b83b-af0b9e3a9577 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:16.988949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f00ae46-5d43-4d66-b83b-af0b9e3a9577 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:16.991324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f00ae46-5d43-4d66-b83b-af0b9e3a9577 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:16.993855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f00ae46-5d43-4d66-b83b-af0b9e3a9577 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:16.995718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f00ae46-5d43-4d66-b83b-af0b9e3a9577 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:16.996358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f00ae46-5d43-4d66-b83b-af0b9e3a9577 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:17.071949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-5f00ae46-5d43-4d66-b83b-af0b9e3a9577 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Getting quotas for project 238c2e0d9e0b48198767a357cff1a442. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:38:17.086813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-5f00ae46-5d43-4d66-b83b-af0b9e3a9577 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Getting quotas for user 9c097ba205f6453ba793dfb1d1876f3e and project 238c2e0d9e0b48198767a357cff1a442. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:38:17.128718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5f00ae46-5d43-4d66-b83b-af0b9e3a9577 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:38:17.131476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5f00ae46-5d43-4d66-b83b-af0b9e3a9577 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:38:17.384287 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5f00ae46-5d43-4d66-b83b-af0b9e3a9577 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.892078 Oct 29 01:38:17.386419 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3142/6039] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:38:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:38:17.398828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6012ba78-4800-4cc6-a0ee-74a1c3a829be tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:17.401568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6012ba78-4800-4cc6-a0ee-74a1c3a829be tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:17.512009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7f9f0cb1-fc39-4ef1-aef8-8eaea10d4160 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:17.512776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7f9f0cb1-fc39-4ef1-aef8-8eaea10d4160 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:17.537888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f9f0cb1-fc39-4ef1-aef8-8eaea10d4160 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:17.538603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f9f0cb1-fc39-4ef1-aef8-8eaea10d4160 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:17.539163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f9f0cb1-fc39-4ef1-aef8-8eaea10d4160 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:17.541251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f9f0cb1-fc39-4ef1-aef8-8eaea10d4160 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:17.542703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f9f0cb1-fc39-4ef1-aef8-8eaea10d4160 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:17.543894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f9f0cb1-fc39-4ef1-aef8-8eaea10d4160 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:17.652410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6012ba78-4800-4cc6-a0ee-74a1c3a829be tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:17.653830 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6012ba78-4800-4cc6-a0ee-74a1c3a829be tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1215 microversion: 2.1 time: 0.259408 Oct 29 01:38:17.669930 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2898/6040] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:17 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1215 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:17.684239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-f810bcc1-a22b-442b-91f5-d017bc78d467 req-64deea83-315f-496d-b86a-6f9e5f88566f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2e1d1e-3097-4c13-8eb9-c32fb30d4857", "name": "network-vif-plugged", "status": "completed", "tag": "46e11602-6278-473b-906b-a860e498b401"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:17.715904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f810bcc1-a22b-442b-91f5-d017bc78d467 req-64deea83-315f-496d-b86a-6f9e5f88566f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:17.717702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f810bcc1-a22b-442b-91f5-d017bc78d467 req-64deea83-315f-496d-b86a-6f9e5f88566f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:17.719324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-f810bcc1-a22b-442b-91f5-d017bc78d467 req-64deea83-315f-496d-b86a-6f9e5f88566f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:17.772832 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-f810bcc1-a22b-442b-91f5-d017bc78d467 req-64deea83-315f-496d-b86a-6f9e5f88566f service nova] Creating event network-vif-plugged:46e11602-6278-473b-906b-a860e498b401 for instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 on n-h1-862964-3 Oct 29 01:38:17.790188 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-f810bcc1-a22b-442b-91f5-d017bc78d467 req-64deea83-315f-496d-b86a-6f9e5f88566f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121280 Oct 29 01:38:17.792577 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2899/6041] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:38:17.965655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7f9f0cb1-fc39-4ef1-aef8-8eaea10d4160 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:17.974721 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7f9f0cb1-fc39-4ef1-aef8-8eaea10d4160 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1390 microversion: 2.1 time: 0.468179 Oct 29 01:38:17.984177 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3143/6042] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:17 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1390 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:18.679922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4a6dbd8d-6838-4be1-9337-9c2206078195 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:18.681281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4a6dbd8d-6838-4be1-9337-9c2206078195 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:18.870874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4a6dbd8d-6838-4be1-9337-9c2206078195 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:18.883402 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4a6dbd8d-6838-4be1-9337-9c2206078195 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1215 microversion: 2.1 time: 0.207112 Oct 29 01:38:18.889122 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2900/6043] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:18 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1215 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:18.999684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0ca42401-5016-4506-aa5f-8aa86c1678d5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:19.000401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0ca42401-5016-4506-aa5f-8aa86c1678d5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:19.019777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ca42401-5016-4506-aa5f-8aa86c1678d5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:19.021109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ca42401-5016-4506-aa5f-8aa86c1678d5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:19.021855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ca42401-5016-4506-aa5f-8aa86c1678d5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:19.023503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ca42401-5016-4506-aa5f-8aa86c1678d5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:19.025024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ca42401-5016-4506-aa5f-8aa86c1678d5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:19.026666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0ca42401-5016-4506-aa5f-8aa86c1678d5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:19.462079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0ca42401-5016-4506-aa5f-8aa86c1678d5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:19.473974 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0ca42401-5016-4506-aa5f-8aa86c1678d5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1390 microversion: 2.1 time: 0.478897 Oct 29 01:38:19.481461 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3144/6044] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:18 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1390 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:19.918036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-36e65c50-2d86-4a0b-bbc4-4e86404e8270 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:19.919465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-36e65c50-2d86-4a0b-bbc4-4e86404e8270 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:19.930771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e65c50-2d86-4a0b-bbc4-4e86404e8270 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:19.934818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e65c50-2d86-4a0b-bbc4-4e86404e8270 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:19.936169 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e65c50-2d86-4a0b-bbc4-4e86404e8270 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:19.940100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e65c50-2d86-4a0b-bbc4-4e86404e8270 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:19.941452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e65c50-2d86-4a0b-bbc4-4e86404e8270 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:19.942701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e65c50-2d86-4a0b-bbc4-4e86404e8270 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:20.085786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-36e65c50-2d86-4a0b-bbc4-4e86404e8270 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:20.100492 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-36e65c50-2d86-4a0b-bbc4-4e86404e8270 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1211 microversion: 2.1 time: 0.187246 Oct 29 01:38:20.101801 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2901/6045] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:19 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1211 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:20.505991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-be1b8184-676b-4309-9066-a5eb054e6d28 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:20.508955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-be1b8184-676b-4309-9066-a5eb054e6d28 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:20.527070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be1b8184-676b-4309-9066-a5eb054e6d28 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:20.528234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be1b8184-676b-4309-9066-a5eb054e6d28 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:20.528988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be1b8184-676b-4309-9066-a5eb054e6d28 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:20.533481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be1b8184-676b-4309-9066-a5eb054e6d28 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:20.534558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be1b8184-676b-4309-9066-a5eb054e6d28 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:20.535408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be1b8184-676b-4309-9066-a5eb054e6d28 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:20.853213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-be1b8184-676b-4309-9066-a5eb054e6d28 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:20.864913 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-be1b8184-676b-4309-9066-a5eb054e6d28 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1562 microversion: 2.1 time: 0.369745 Oct 29 01:38:20.867056 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3145/6046] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:20 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1562 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:20.896540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3b9f80e8-22fa-4657-9752-f459050c3c03 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:20.897652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3b9f80e8-22fa-4657-9752-f459050c3c03 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:20.900236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=46 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:38:20.907293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b9f80e8-22fa-4657-9752-f459050c3c03 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:20.908178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b9f80e8-22fa-4657-9752-f459050c3c03 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:20.908915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b9f80e8-22fa-4657-9752-f459050c3c03 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:20.909927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b9f80e8-22fa-4657-9752-f459050c3c03 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:20.911678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b9f80e8-22fa-4657-9752-f459050c3c03 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:20.912761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b9f80e8-22fa-4657-9752-f459050c3c03 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:21.132830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d7a14ba3-eba7-464b-a382-219a1a253977 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:21.133480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d7a14ba3-eba7-464b-a382-219a1a253977 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:21.140024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7a14ba3-eba7-464b-a382-219a1a253977 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:21.144661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7a14ba3-eba7-464b-a382-219a1a253977 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:21.146684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7a14ba3-eba7-464b-a382-219a1a253977 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:21.152265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7a14ba3-eba7-464b-a382-219a1a253977 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:21.153097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7a14ba3-eba7-464b-a382-219a1a253977 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:21.154000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7a14ba3-eba7-464b-a382-219a1a253977 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:21.313659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d7a14ba3-eba7-464b-a382-219a1a253977 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:21.326572 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d7a14ba3-eba7-464b-a382-219a1a253977 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1285 microversion: 2.1 time: 0.198090 Oct 29 01:38:21.334135 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3146/6047] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:21 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:21.465402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3b9f80e8-22fa-4657-9752-f459050c3c03 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:21.482152 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3b9f80e8-22fa-4657-9752-f459050c3c03 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1562 microversion: 2.1 time: 0.589378 Oct 29 01:38:21.485620 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2902/6048] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:20 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1562 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:22.353911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1aedc6c5-60bc-4e58-9e8d-fdcd210671f8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:22.355405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1aedc6c5-60bc-4e58-9e8d-fdcd210671f8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:22.370150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1aedc6c5-60bc-4e58-9e8d-fdcd210671f8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:22.371930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1aedc6c5-60bc-4e58-9e8d-fdcd210671f8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:22.371930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1aedc6c5-60bc-4e58-9e8d-fdcd210671f8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:22.375523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1aedc6c5-60bc-4e58-9e8d-fdcd210671f8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:22.393695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1aedc6c5-60bc-4e58-9e8d-fdcd210671f8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:22.397776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1aedc6c5-60bc-4e58-9e8d-fdcd210671f8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:22.885202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1aedc6c5-60bc-4e58-9e8d-fdcd210671f8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:22.902787 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1aedc6c5-60bc-4e58-9e8d-fdcd210671f8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1273 microversion: 2.1 time: 0.550481 Oct 29 01:38:22.903539 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3147/6049] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:22 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1273 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:23.931098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ad2e957a-1da5-4424-9b03-2d259c8ba3c4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:23.931710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ad2e957a-1da5-4424-9b03-2d259c8ba3c4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:23.944936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad2e957a-1da5-4424-9b03-2d259c8ba3c4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:23.945759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad2e957a-1da5-4424-9b03-2d259c8ba3c4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:23.946473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad2e957a-1da5-4424-9b03-2d259c8ba3c4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:23.947364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad2e957a-1da5-4424-9b03-2d259c8ba3c4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:23.949758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad2e957a-1da5-4424-9b03-2d259c8ba3c4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:23.950421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad2e957a-1da5-4424-9b03-2d259c8ba3c4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:24.347367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ad2e957a-1da5-4424-9b03-2d259c8ba3c4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:24.379476 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ad2e957a-1da5-4424-9b03-2d259c8ba3c4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1315 microversion: 2.1 time: 0.442180 Oct 29 01:38:24.387609 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2903/6050] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:23 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:25.412800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-75e466ce-d86c-492c-a360-ab094d702d59 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:25.422038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-75e466ce-d86c-492c-a360-ab094d702d59 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:25.426023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:38:25.433078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e466ce-d86c-492c-a360-ab094d702d59 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:25.434529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e466ce-d86c-492c-a360-ab094d702d59 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:25.435638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e466ce-d86c-492c-a360-ab094d702d59 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:25.437613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e466ce-d86c-492c-a360-ab094d702d59 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:25.438526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e466ce-d86c-492c-a360-ab094d702d59 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:25.439939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-75e466ce-d86c-492c-a360-ab094d702d59 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:25.852631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-75e466ce-d86c-492c-a360-ab094d702d59 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:25.868248 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-75e466ce-d86c-492c-a360-ab094d702d59 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1315 microversion: 2.1 time: 0.464006 Oct 29 01:38:25.868860 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3148/6051] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:25 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:26.526884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-1ee4fe2c-23cb-45f6-a09f-172d588a1d84 req-c0e5e13e-72d3-4f86-ae11-7fa549700533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15d269df-d652-4637-96bb-411abce6787f", "tag": "dfdd00c6-6619-4aa6-88d9-e56b00d741e5"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:26.560525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1ee4fe2c-23cb-45f6-a09f-172d588a1d84 req-c0e5e13e-72d3-4f86-ae11-7fa549700533 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:26.562799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1ee4fe2c-23cb-45f6-a09f-172d588a1d84 req-c0e5e13e-72d3-4f86-ae11-7fa549700533 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:26.563530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1ee4fe2c-23cb-45f6-a09f-172d588a1d84 req-c0e5e13e-72d3-4f86-ae11-7fa549700533 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:26.599917 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-1ee4fe2c-23cb-45f6-a09f-172d588a1d84 req-c0e5e13e-72d3-4f86-ae11-7fa549700533 service nova] Creating event network-changed:dfdd00c6-6619-4aa6-88d9-e56b00d741e5 for instance 15d269df-d652-4637-96bb-411abce6787f on n-h2-862964-3 Oct 29 01:38:26.606663 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-1ee4fe2c-23cb-45f6-a09f-172d588a1d84 req-c0e5e13e-72d3-4f86-ae11-7fa549700533 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091235 Oct 29 01:38:26.607647 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2904/6052] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:38:26.892394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aba34391-eda8-415e-922f-7ba604d44a22 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:26.893008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-aba34391-eda8-415e-922f-7ba604d44a22 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:26.908936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aba34391-eda8-415e-922f-7ba604d44a22 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:26.909465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aba34391-eda8-415e-922f-7ba604d44a22 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:26.909905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aba34391-eda8-415e-922f-7ba604d44a22 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:26.910623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aba34391-eda8-415e-922f-7ba604d44a22 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:26.911083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aba34391-eda8-415e-922f-7ba604d44a22 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:26.911581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aba34391-eda8-415e-922f-7ba604d44a22 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:27.028314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:38:27.112045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:38:27.295682 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-aba34391-eda8-415e-922f-7ba604d44a22 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:27.317061 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aba34391-eda8-415e-922f-7ba604d44a22 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1315 microversion: 2.1 time: 0.428957 Oct 29 01:38:27.341412 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3149/6053] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:26 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:28.346384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-54b042d8-8429-4e3b-8714-37c8266d8768 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:28.347196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-54b042d8-8429-4e3b-8714-37c8266d8768 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:28.356227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-de4c0c44-ec61-48ca-a546-094ff55902ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:28.360126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54b042d8-8429-4e3b-8714-37c8266d8768 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:28.367557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54b042d8-8429-4e3b-8714-37c8266d8768 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:28.368076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-de4c0c44-ec61-48ca-a546-094ff55902ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:28.368179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54b042d8-8429-4e3b-8714-37c8266d8768 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:28.368179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54b042d8-8429-4e3b-8714-37c8266d8768 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:28.368179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54b042d8-8429-4e3b-8714-37c8266d8768 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:28.368179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54b042d8-8429-4e3b-8714-37c8266d8768 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:28.402432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de4c0c44-ec61-48ca-a546-094ff55902ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:28.403107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de4c0c44-ec61-48ca-a546-094ff55902ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:28.404784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de4c0c44-ec61-48ca-a546-094ff55902ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:28.407225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de4c0c44-ec61-48ca-a546-094ff55902ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:28.409527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de4c0c44-ec61-48ca-a546-094ff55902ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:28.413128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de4c0c44-ec61-48ca-a546-094ff55902ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:28.793617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-de4c0c44-ec61-48ca-a546-094ff55902ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:28.803134 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-de4c0c44-ec61-48ca-a546-094ff55902ed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1562 microversion: 2.1 time: 0.457515 Oct 29 01:38:28.809943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-54b042d8-8429-4e3b-8714-37c8266d8768 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:28.824136 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3150/6054] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:28 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1562 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:28.843516 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-54b042d8-8429-4e3b-8714-37c8266d8768 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1315 microversion: 2.1 time: 0.482685 Oct 29 01:38:28.859731 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2905/6055] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:28 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:28.862422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-abc590a8-a9c3-4387-8bcc-0498520ff0a9 req-a03f8632-5ce0-45da-8e7d-02e3bd25d349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2e1d1e-3097-4c13-8eb9-c32fb30d4857", "tag": "46e11602-6278-473b-906b-a860e498b401"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:28.904424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-abc590a8-a9c3-4387-8bcc-0498520ff0a9 req-a03f8632-5ce0-45da-8e7d-02e3bd25d349 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:28.904915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-abc590a8-a9c3-4387-8bcc-0498520ff0a9 req-a03f8632-5ce0-45da-8e7d-02e3bd25d349 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:28.909529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-abc590a8-a9c3-4387-8bcc-0498520ff0a9 req-a03f8632-5ce0-45da-8e7d-02e3bd25d349 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:28.941238 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-abc590a8-a9c3-4387-8bcc-0498520ff0a9 req-a03f8632-5ce0-45da-8e7d-02e3bd25d349 service nova] Creating event network-changed:46e11602-6278-473b-906b-a860e498b401 for instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 on n-h1-862964-3 Oct 29 01:38:28.947164 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-abc590a8-a9c3-4387-8bcc-0498520ff0a9 req-a03f8632-5ce0-45da-8e7d-02e3bd25d349 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121790 Oct 29 01:38:28.949853 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3151/6056] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:38:29.875082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a3b8b93a-6209-46ef-98dc-0178c6fe0510 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:29.876778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a3b8b93a-6209-46ef-98dc-0178c6fe0510 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:29.892709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:38:29.899332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3b8b93a-6209-46ef-98dc-0178c6fe0510 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:29.902481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3b8b93a-6209-46ef-98dc-0178c6fe0510 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:29.903183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3b8b93a-6209-46ef-98dc-0178c6fe0510 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:29.904524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3b8b93a-6209-46ef-98dc-0178c6fe0510 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:29.905961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3b8b93a-6209-46ef-98dc-0178c6fe0510 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:29.907894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3b8b93a-6209-46ef-98dc-0178c6fe0510 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:29.986086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:38:30.460254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a3b8b93a-6209-46ef-98dc-0178c6fe0510 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:30.469728 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a3b8b93a-6209-46ef-98dc-0178c6fe0510 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1315 microversion: 2.1 time: 0.599474 Oct 29 01:38:30.470891 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2906/6057] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:29 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:30.672405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-29436415-a605-4176-b672-b0d2d66c0df9 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:30.672405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-29436415-a605-4176-b672-b0d2d66c0df9 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:30.678985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29436415-a605-4176-b672-b0d2d66c0df9 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:30.679476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29436415-a605-4176-b672-b0d2d66c0df9 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:30.679919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29436415-a605-4176-b672-b0d2d66c0df9 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:30.680630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29436415-a605-4176-b672-b0d2d66c0df9 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:30.681089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29436415-a605-4176-b672-b0d2d66c0df9 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:30.681544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29436415-a605-4176-b672-b0d2d66c0df9 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:30.712252 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-29436415-a605-4176-b672-b0d2d66c0df9 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42/ips" status: 200 len: 153 microversion: 2.20 time: 0.046595 Oct 29 01:38:30.720997 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3152/6058] 10.222.0.26 () {60 vars in 1289 bytes} [Sat Oct 29 01:38:30 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42/ips => generated 153 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:38:31.496288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3155f4b4-0c03-451c-aef2-e3b0915c8f5a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:31.496928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3155f4b4-0c03-451c-aef2-e3b0915c8f5a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:31.509085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3155f4b4-0c03-451c-aef2-e3b0915c8f5a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:31.517566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3155f4b4-0c03-451c-aef2-e3b0915c8f5a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:31.518356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3155f4b4-0c03-451c-aef2-e3b0915c8f5a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:31.519476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3155f4b4-0c03-451c-aef2-e3b0915c8f5a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:31.519963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3155f4b4-0c03-451c-aef2-e3b0915c8f5a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:31.520398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3155f4b4-0c03-451c-aef2-e3b0915c8f5a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:31.822678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3155f4b4-0c03-451c-aef2-e3b0915c8f5a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:31.831322 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3155f4b4-0c03-451c-aef2-e3b0915c8f5a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1315 microversion: 2.1 time: 0.339248 Oct 29 01:38:31.832105 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2907/6059] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:31 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:32.862884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0462d431-2ae0-4cea-b7a0-725da51abd5c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:32.866993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0462d431-2ae0-4cea-b7a0-725da51abd5c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:32.923630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0462d431-2ae0-4cea-b7a0-725da51abd5c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:32.924172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0462d431-2ae0-4cea-b7a0-725da51abd5c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:32.928608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0462d431-2ae0-4cea-b7a0-725da51abd5c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:32.929459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0462d431-2ae0-4cea-b7a0-725da51abd5c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:32.929950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0462d431-2ae0-4cea-b7a0-725da51abd5c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:32.930390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0462d431-2ae0-4cea-b7a0-725da51abd5c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:33.450696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0462d431-2ae0-4cea-b7a0-725da51abd5c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:33.465094 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0462d431-2ae0-4cea-b7a0-725da51abd5c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1315 microversion: 2.1 time: 0.613871 Oct 29 01:38:33.485200 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3153/6060] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:32 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1315 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:34.491540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f48824a5-0990-42bd-afee-be2a83b4166b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:34.492156 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f48824a5-0990-42bd-afee-be2a83b4166b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:34.511567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f48824a5-0990-42bd-afee-be2a83b4166b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:34.516020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f48824a5-0990-42bd-afee-be2a83b4166b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:34.516749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f48824a5-0990-42bd-afee-be2a83b4166b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:34.517785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f48824a5-0990-42bd-afee-be2a83b4166b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:34.519176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f48824a5-0990-42bd-afee-be2a83b4166b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:34.523238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f48824a5-0990-42bd-afee-be2a83b4166b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:34.775686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2d2abdfb-9898-459a-a3cd-93e8b98cd60a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:34.777015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2d2abdfb-9898-459a-a3cd-93e8b98cd60a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:34.794791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d2abdfb-9898-459a-a3cd-93e8b98cd60a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:34.797236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d2abdfb-9898-459a-a3cd-93e8b98cd60a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:34.797393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d2abdfb-9898-459a-a3cd-93e8b98cd60a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:34.801788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d2abdfb-9898-459a-a3cd-93e8b98cd60a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:34.802394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d2abdfb-9898-459a-a3cd-93e8b98cd60a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:34.808146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2d2abdfb-9898-459a-a3cd-93e8b98cd60a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:34.874627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-2d2abdfb-9898-459a-a3cd-93e8b98cd60a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lazy-loading 'flavor' on Instance uuid 49c66a75-9fbd-4f0c-baf5-e19875095e42 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:38:35.301695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f48824a5-0990-42bd-afee-be2a83b4166b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:35.301695 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f48824a5-0990-42bd-afee-be2a83b4166b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1315 microversion: 2.1 time: 0.603588 Oct 29 01:38:35.301695 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2908/6061] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:34 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:35.301695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-5b4c604b-3c81-45d9-bac3-a08fcd32c95c req-0db80c08-bb63-4f5b-9b39-ddebfe180729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d269df-d652-4637-96bb-411abce6787f", "name": "network-vif-plugged", "status": "completed", "tag": "dfdd00c6-6619-4aa6-88d9-e56b00d741e5"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:35.301695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5b4c604b-3c81-45d9-bac3-a08fcd32c95c req-0db80c08-bb63-4f5b-9b39-ddebfe180729 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:35.301695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5b4c604b-3c81-45d9-bac3-a08fcd32c95c req-0db80c08-bb63-4f5b-9b39-ddebfe180729 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:35.301695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5b4c604b-3c81-45d9-bac3-a08fcd32c95c req-0db80c08-bb63-4f5b-9b39-ddebfe180729 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:35.301695 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-5b4c604b-3c81-45d9-bac3-a08fcd32c95c req-0db80c08-bb63-4f5b-9b39-ddebfe180729 service nova] Creating event network-vif-plugged:dfdd00c6-6619-4aa6-88d9-e56b00d741e5 for instance 15d269df-d652-4637-96bb-411abce6787f on n-h2-862964-3 Oct 29 01:38:35.301695 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-5b4c604b-3c81-45d9-bac3-a08fcd32c95c req-0db80c08-bb63-4f5b-9b39-ddebfe180729 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036432 Oct 29 01:38:35.301695 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2909/6062] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:38:35.798856 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2d2abdfb-9898-459a-a3cd-93e8b98cd60a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "POST /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42/action" status: 202 len: 0 microversion: 2.20 time: 1.024039 Oct 29 01:38:35.802966 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3154/6063] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 29 01:38:34 2022] POST /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42/action => generated 0 bytes in 1032 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:38:35.812939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-67570cf5-ff78-428a-a486-1fe5ce936ae1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:35.813685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-67570cf5-ff78-428a-a486-1fe5ce936ae1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:35.828498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67570cf5-ff78-428a-a486-1fe5ce936ae1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:35.829022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67570cf5-ff78-428a-a486-1fe5ce936ae1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:35.829495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67570cf5-ff78-428a-a486-1fe5ce936ae1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:35.839800 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67570cf5-ff78-428a-a486-1fe5ce936ae1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:35.843973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67570cf5-ff78-428a-a486-1fe5ce936ae1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:35.844596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67570cf5-ff78-428a-a486-1fe5ce936ae1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:36.124523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6ab4a0fc-d318-4b86-a04c-2324c1a62bd8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:36.126151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6ab4a0fc-d318-4b86-a04c-2324c1a62bd8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:36.136474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ab4a0fc-d318-4b86-a04c-2324c1a62bd8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:36.136966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ab4a0fc-d318-4b86-a04c-2324c1a62bd8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:36.137626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ab4a0fc-d318-4b86-a04c-2324c1a62bd8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:36.138338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ab4a0fc-d318-4b86-a04c-2324c1a62bd8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:36.138977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ab4a0fc-d318-4b86-a04c-2324c1a62bd8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:36.139466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ab4a0fc-d318-4b86-a04c-2324c1a62bd8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:36.524169 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-67570cf5-ff78-428a-a486-1fe5ce936ae1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:36.548391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-67570cf5-ff78-428a-a486-1fe5ce936ae1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:36.550467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-67570cf5-ff78-428a-a486-1fe5ce936ae1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:36.552390 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-67570cf5-ff78-428a-a486-1fe5ce936ae1 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1725 microversion: 2.20 time: 0.746878 Oct 29 01:38:36.562671 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2910/6064] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:38:35 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1725 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:38:36.571335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6ab4a0fc-d318-4b86-a04c-2324c1a62bd8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:36.589550 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6ab4a0fc-d318-4b86-a04c-2324c1a62bd8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1315 microversion: 2.1 time: 0.471937 Oct 29 01:38:36.591945 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3155/6065] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:36 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:37.580897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-94b32f6b-f7c3-4aae-be13-084b0a93176b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:37.581768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-94b32f6b-f7c3-4aae-be13-084b0a93176b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:37.594678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94b32f6b-f7c3-4aae-be13-084b0a93176b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:37.595394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94b32f6b-f7c3-4aae-be13-084b0a93176b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:37.596600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94b32f6b-f7c3-4aae-be13-084b0a93176b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:37.602603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94b32f6b-f7c3-4aae-be13-084b0a93176b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:37.603350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94b32f6b-f7c3-4aae-be13-084b0a93176b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:37.604069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-94b32f6b-f7c3-4aae-be13-084b0a93176b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:37.615110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b3620a7b-da5f-4bd5-b76d-320834446c33 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:37.616267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b3620a7b-da5f-4bd5-b76d-320834446c33 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:37.643096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3620a7b-da5f-4bd5-b76d-320834446c33 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:37.643632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3620a7b-da5f-4bd5-b76d-320834446c33 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:37.644029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3620a7b-da5f-4bd5-b76d-320834446c33 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:37.644752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3620a7b-da5f-4bd5-b76d-320834446c33 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:37.645262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3620a7b-da5f-4bd5-b76d-320834446c33 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:37.645659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b3620a7b-da5f-4bd5-b76d-320834446c33 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:38.191594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b3620a7b-da5f-4bd5-b76d-320834446c33 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:38.211707 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b3620a7b-da5f-4bd5-b76d-320834446c33 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1502 microversion: 2.1 time: 0.600649 Oct 29 01:38:38.213004 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3156/6066] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:37 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1502 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:38.237310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7cfdd6de-9d2c-4dea-93c6-bfc0ab89b0c4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:38.250121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7cfdd6de-9d2c-4dea-93c6-bfc0ab89b0c4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:38.250616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7cfdd6de-9d2c-4dea-93c6-bfc0ab89b0c4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:38.251057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7cfdd6de-9d2c-4dea-93c6-bfc0ab89b0c4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:38.275005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-94b32f6b-f7c3-4aae-be13-084b0a93176b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:38.278841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7cfdd6de-9d2c-4dea-93c6-bfc0ab89b0c4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Going to try to stop instance {{(pid=121099) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 01:38:38.289830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-94b32f6b-f7c3-4aae-be13-084b0a93176b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:38.291843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-94b32f6b-f7c3-4aae-be13-084b0a93176b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:38.294856 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-94b32f6b-f7c3-4aae-be13-084b0a93176b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1725 microversion: 2.20 time: 0.717967 Oct 29 01:38:38.297034 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2911/6067] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:38:37 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1725 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:38:38.298678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:38:38.618454 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7cfdd6de-9d2c-4dea-93c6-bfc0ab89b0c4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f/action" status: 202 len: 0 microversion: 2.1 time: 0.385494 Oct 29 01:38:38.622364 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3157/6068] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:38:38 2022] POST /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:38:38.629914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aa78ef36-d465-435b-b92d-5029d80d801e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:38.630255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aa78ef36-d465-435b-b92d-5029d80d801e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:38.638220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa78ef36-d465-435b-b92d-5029d80d801e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:38.639013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa78ef36-d465-435b-b92d-5029d80d801e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:38.640070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa78ef36-d465-435b-b92d-5029d80d801e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:38.641033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa78ef36-d465-435b-b92d-5029d80d801e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:38.642063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa78ef36-d465-435b-b92d-5029d80d801e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:38.642734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa78ef36-d465-435b-b92d-5029d80d801e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:39.017613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aa78ef36-d465-435b-b92d-5029d80d801e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:39.028602 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aa78ef36-d465-435b-b92d-5029d80d801e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1512 microversion: 2.1 time: 0.404453 Oct 29 01:38:39.037657 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2912/6069] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:38 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1512 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:39.327691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e332aa30-e41a-40a7-be1c-776b2a8063bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:39.328944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e332aa30-e41a-40a7-be1c-776b2a8063bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:39.345600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e332aa30-e41a-40a7-be1c-776b2a8063bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:39.346102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e332aa30-e41a-40a7-be1c-776b2a8063bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:39.346557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e332aa30-e41a-40a7-be1c-776b2a8063bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:39.347527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e332aa30-e41a-40a7-be1c-776b2a8063bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:39.347995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e332aa30-e41a-40a7-be1c-776b2a8063bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:39.349193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e332aa30-e41a-40a7-be1c-776b2a8063bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:39.712382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e332aa30-e41a-40a7-be1c-776b2a8063bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:39.722708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e332aa30-e41a-40a7-be1c-776b2a8063bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:39.724662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e332aa30-e41a-40a7-be1c-776b2a8063bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:39.726147 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e332aa30-e41a-40a7-be1c-776b2a8063bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1725 microversion: 2.20 time: 0.403970 Oct 29 01:38:39.731802 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3158/6070] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:38:39 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1725 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:38:40.064527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e5b63d5a-56af-499f-ac97-12ed32745a42 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:40.064934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e5b63d5a-56af-499f-ac97-12ed32745a42 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:40.082538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e5b63d5a-56af-499f-ac97-12ed32745a42 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:40.083062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e5b63d5a-56af-499f-ac97-12ed32745a42 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:40.083523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e5b63d5a-56af-499f-ac97-12ed32745a42 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:40.084236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e5b63d5a-56af-499f-ac97-12ed32745a42 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:40.084611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e5b63d5a-56af-499f-ac97-12ed32745a42 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:40.085043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e5b63d5a-56af-499f-ac97-12ed32745a42 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:40.756192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b8c12f6b-6db2-4380-a673-1d92656bfdb2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:40.757514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b8c12f6b-6db2-4380-a673-1d92656bfdb2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:40.765713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8c12f6b-6db2-4380-a673-1d92656bfdb2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:40.769047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8c12f6b-6db2-4380-a673-1d92656bfdb2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:40.769047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8c12f6b-6db2-4380-a673-1d92656bfdb2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:40.769047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8c12f6b-6db2-4380-a673-1d92656bfdb2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:40.769047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8c12f6b-6db2-4380-a673-1d92656bfdb2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:40.769047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b8c12f6b-6db2-4380-a673-1d92656bfdb2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:40.973368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e5b63d5a-56af-499f-ac97-12ed32745a42 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:40.989751 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e5b63d5a-56af-499f-ac97-12ed32745a42 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1512 microversion: 2.1 time: 0.924223 Oct 29 01:38:40.996298 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2913/6071] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:40 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1512 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:41.192746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b8c12f6b-6db2-4380-a673-1d92656bfdb2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:41.201339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b8c12f6b-6db2-4380-a673-1d92656bfdb2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:41.203471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b8c12f6b-6db2-4380-a673-1d92656bfdb2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:41.204749 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b8c12f6b-6db2-4380-a673-1d92656bfdb2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1725 microversion: 2.20 time: 0.452812 Oct 29 01:38:41.205356 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3159/6072] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:38:40 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1725 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:38:42.009691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6e6e283c-724e-4436-8fba-1292cc2da35c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:42.010311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6e6e283c-724e-4436-8fba-1292cc2da35c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:42.020810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e6e283c-724e-4436-8fba-1292cc2da35c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:42.023064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e6e283c-724e-4436-8fba-1292cc2da35c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:42.034603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e6e283c-724e-4436-8fba-1292cc2da35c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:42.034603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e6e283c-724e-4436-8fba-1292cc2da35c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:42.034603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e6e283c-724e-4436-8fba-1292cc2da35c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:42.034603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e6e283c-724e-4436-8fba-1292cc2da35c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:42.232155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b865b51f-99b4-402c-993c-1162abe42349 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:42.232763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b865b51f-99b4-402c-993c-1162abe42349 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:42.241925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b865b51f-99b4-402c-993c-1162abe42349 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:42.242455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b865b51f-99b4-402c-993c-1162abe42349 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:42.242907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b865b51f-99b4-402c-993c-1162abe42349 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:42.244150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b865b51f-99b4-402c-993c-1162abe42349 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:42.244659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b865b51f-99b4-402c-993c-1162abe42349 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:42.245134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b865b51f-99b4-402c-993c-1162abe42349 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:42.329736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6e6e283c-724e-4436-8fba-1292cc2da35c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:42.356022 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6e6e283c-724e-4436-8fba-1292cc2da35c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1512 microversion: 2.1 time: 0.351286 Oct 29 01:38:42.356917 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2914/6073] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:42 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1512 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:42.650423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b865b51f-99b4-402c-993c-1162abe42349 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:42.663490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b865b51f-99b4-402c-993c-1162abe42349 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:42.668025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b865b51f-99b4-402c-993c-1162abe42349 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:42.671198 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b865b51f-99b4-402c-993c-1162abe42349 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1725 microversion: 2.20 time: 0.441788 Oct 29 01:38:42.673534 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3160/6074] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:38:42 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1725 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:38:43.386068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5a25dd57-0a38-49bd-895d-c2d341db7a01 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:43.387608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5a25dd57-0a38-49bd-895d-c2d341db7a01 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:43.403088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a25dd57-0a38-49bd-895d-c2d341db7a01 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:43.407863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a25dd57-0a38-49bd-895d-c2d341db7a01 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:43.408430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a25dd57-0a38-49bd-895d-c2d341db7a01 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:43.409967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a25dd57-0a38-49bd-895d-c2d341db7a01 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:43.410544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a25dd57-0a38-49bd-895d-c2d341db7a01 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:43.411303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a25dd57-0a38-49bd-895d-c2d341db7a01 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:43.703767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7cdced8f-f1b2-460a-876b-25d5b12bd703 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:43.708325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5a25dd57-0a38-49bd-895d-c2d341db7a01 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:43.709382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7cdced8f-f1b2-460a-876b-25d5b12bd703 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:43.731729 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5a25dd57-0a38-49bd-895d-c2d341db7a01 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1512 microversion: 2.1 time: 0.352324 Oct 29 01:38:43.747233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7cdced8f-f1b2-460a-876b-25d5b12bd703 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:43.748057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7cdced8f-f1b2-460a-876b-25d5b12bd703 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:43.748514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7cdced8f-f1b2-460a-876b-25d5b12bd703 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:43.753444 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2915/6075] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:43 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1512 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:43.765656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7cdced8f-f1b2-460a-876b-25d5b12bd703 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:43.772221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7cdced8f-f1b2-460a-876b-25d5b12bd703 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:43.772696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7cdced8f-f1b2-460a-876b-25d5b12bd703 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:44.068817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7cdced8f-f1b2-460a-876b-25d5b12bd703 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:44.080302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7cdced8f-f1b2-460a-876b-25d5b12bd703 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:44.082901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7cdced8f-f1b2-460a-876b-25d5b12bd703 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:44.084926 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7cdced8f-f1b2-460a-876b-25d5b12bd703 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1725 microversion: 2.20 time: 0.386359 Oct 29 01:38:44.090900 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3161/6076] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:38:43 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1725 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:38:44.760223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dbfd2506-66d5-4a17-be05-099fd04d8c03 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:44.760844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dbfd2506-66d5-4a17-be05-099fd04d8c03 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:44.769874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbfd2506-66d5-4a17-be05-099fd04d8c03 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:44.770367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbfd2506-66d5-4a17-be05-099fd04d8c03 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:44.770817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbfd2506-66d5-4a17-be05-099fd04d8c03 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:44.775025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbfd2506-66d5-4a17-be05-099fd04d8c03 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:44.775745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbfd2506-66d5-4a17-be05-099fd04d8c03 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:44.782513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbfd2506-66d5-4a17-be05-099fd04d8c03 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:45.114602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0a82e8cf-3454-4d54-9f86-5397204adf13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:45.115220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0a82e8cf-3454-4d54-9f86-5397204adf13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:45.129524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a82e8cf-3454-4d54-9f86-5397204adf13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:45.130046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a82e8cf-3454-4d54-9f86-5397204adf13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:45.130502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a82e8cf-3454-4d54-9f86-5397204adf13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:45.134751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a82e8cf-3454-4d54-9f86-5397204adf13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:45.135254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a82e8cf-3454-4d54-9f86-5397204adf13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:45.135703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a82e8cf-3454-4d54-9f86-5397204adf13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:45.484647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-dbfd2506-66d5-4a17-be05-099fd04d8c03 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:45.495889 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dbfd2506-66d5-4a17-be05-099fd04d8c03 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1512 microversion: 2.1 time: 0.739587 Oct 29 01:38:45.511642 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2916/6077] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:44 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1512 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:45.576854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0a82e8cf-3454-4d54-9f86-5397204adf13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:45.589586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0a82e8cf-3454-4d54-9f86-5397204adf13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:45.591306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0a82e8cf-3454-4d54-9f86-5397204adf13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:45.593630 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0a82e8cf-3454-4d54-9f86-5397204adf13 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1725 microversion: 2.20 time: 0.482126 Oct 29 01:38:45.595622 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3162/6078] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:38:45 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1725 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:38:46.531184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-22ad34d8-e0d0-4e26-af50-d8df805643e9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:46.531804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-22ad34d8-e0d0-4e26-af50-d8df805643e9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:46.539657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22ad34d8-e0d0-4e26-af50-d8df805643e9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:46.543358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22ad34d8-e0d0-4e26-af50-d8df805643e9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:46.544032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22ad34d8-e0d0-4e26-af50-d8df805643e9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:46.545536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22ad34d8-e0d0-4e26-af50-d8df805643e9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:46.546718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22ad34d8-e0d0-4e26-af50-d8df805643e9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:46.547302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22ad34d8-e0d0-4e26-af50-d8df805643e9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:46.626360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-da13b428-bac6-4427-8cc8-8f58027acc52 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:46.627528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-da13b428-bac6-4427-8cc8-8f58027acc52 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:46.645117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da13b428-bac6-4427-8cc8-8f58027acc52 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:46.649674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da13b428-bac6-4427-8cc8-8f58027acc52 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:46.650147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da13b428-bac6-4427-8cc8-8f58027acc52 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:46.650957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da13b428-bac6-4427-8cc8-8f58027acc52 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:46.651369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da13b428-bac6-4427-8cc8-8f58027acc52 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:46.651798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da13b428-bac6-4427-8cc8-8f58027acc52 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:46.996175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-22ad34d8-e0d0-4e26-af50-d8df805643e9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:47.007585 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-22ad34d8-e0d0-4e26-af50-d8df805643e9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1512 microversion: 2.1 time: 0.491228 Oct 29 01:38:47.025345 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2917/6079] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:46 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1512 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:47.180331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-da13b428-bac6-4427-8cc8-8f58027acc52 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:47.200692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-da13b428-bac6-4427-8cc8-8f58027acc52 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:47.207604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-da13b428-bac6-4427-8cc8-8f58027acc52 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:47.214980 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-da13b428-bac6-4427-8cc8-8f58027acc52 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1725 microversion: 2.20 time: 0.591322 Oct 29 01:38:47.219767 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3163/6080] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:38:46 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1725 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:38:48.246797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dde9009a-158f-47ce-8b7f-c77b3af89e10 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:48.248237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dde9009a-158f-47ce-8b7f-c77b3af89e10 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:48.273721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dde9009a-158f-47ce-8b7f-c77b3af89e10 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:48.274336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dde9009a-158f-47ce-8b7f-c77b3af89e10 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:48.274893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dde9009a-158f-47ce-8b7f-c77b3af89e10 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:48.282303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dde9009a-158f-47ce-8b7f-c77b3af89e10 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:48.282900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dde9009a-158f-47ce-8b7f-c77b3af89e10 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:48.284075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dde9009a-158f-47ce-8b7f-c77b3af89e10 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:48.429903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eed191cc-1437-481a-9a98-073b85681d49 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:48.432192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-eed191cc-1437-481a-9a98-073b85681d49 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:48.440189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eed191cc-1437-481a-9a98-073b85681d49 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:48.441288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eed191cc-1437-481a-9a98-073b85681d49 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:48.442483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eed191cc-1437-481a-9a98-073b85681d49 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:48.443499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eed191cc-1437-481a-9a98-073b85681d49 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:48.444265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eed191cc-1437-481a-9a98-073b85681d49 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:48.445064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eed191cc-1437-481a-9a98-073b85681d49 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:48.930405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dde9009a-158f-47ce-8b7f-c77b3af89e10 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:48.955957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dde9009a-158f-47ce-8b7f-c77b3af89e10 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:48.957664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dde9009a-158f-47ce-8b7f-c77b3af89e10 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:48.958892 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dde9009a-158f-47ce-8b7f-c77b3af89e10 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1746 microversion: 2.20 time: 0.716005 Oct 29 01:38:48.959530 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3164/6081] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:38:48 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1746 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:38:49.025409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-eed191cc-1437-481a-9a98-073b85681d49 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:49.044850 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-eed191cc-1437-481a-9a98-073b85681d49 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1512 microversion: 2.1 time: 1.009302 Oct 29 01:38:49.047377 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2918/6082] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:48 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1512 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:49.992994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-896ec325-d855-4709-a831-e0ff97e7a38c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:49.993674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-896ec325-d855-4709-a831-e0ff97e7a38c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:50.001446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-896ec325-d855-4709-a831-e0ff97e7a38c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:50.002285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-896ec325-d855-4709-a831-e0ff97e7a38c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:50.002401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-896ec325-d855-4709-a831-e0ff97e7a38c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:50.003252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-896ec325-d855-4709-a831-e0ff97e7a38c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:50.003716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-896ec325-d855-4709-a831-e0ff97e7a38c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:50.004149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-896ec325-d855-4709-a831-e0ff97e7a38c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:50.076791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ed2accca-6c8f-4300-b4a1-8e51568c442a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:50.078651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ed2accca-6c8f-4300-b4a1-8e51568c442a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:50.096539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed2accca-6c8f-4300-b4a1-8e51568c442a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:50.097047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed2accca-6c8f-4300-b4a1-8e51568c442a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:50.098706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed2accca-6c8f-4300-b4a1-8e51568c442a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:50.099723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed2accca-6c8f-4300-b4a1-8e51568c442a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:50.100289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed2accca-6c8f-4300-b4a1-8e51568c442a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:50.100998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed2accca-6c8f-4300-b4a1-8e51568c442a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:50.644681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-896ec325-d855-4709-a831-e0ff97e7a38c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:50.657787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-896ec325-d855-4709-a831-e0ff97e7a38c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:50.662753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-896ec325-d855-4709-a831-e0ff97e7a38c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:50.671066 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-896ec325-d855-4709-a831-e0ff97e7a38c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1746 microversion: 2.20 time: 0.677763 Oct 29 01:38:50.671066 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3165/6083] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:38:49 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1746 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:38:50.821339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ed2accca-6c8f-4300-b4a1-8e51568c442a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:50.836495 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ed2accca-6c8f-4300-b4a1-8e51568c442a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1512 microversion: 2.1 time: 0.762929 Oct 29 01:38:50.861597 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2919/6084] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:50 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1512 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:51.701299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-26086744-1ec9-403d-b299-b30589b1644d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:51.701948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-26086744-1ec9-403d-b299-b30589b1644d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:51.711055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26086744-1ec9-403d-b299-b30589b1644d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:51.711747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26086744-1ec9-403d-b299-b30589b1644d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:51.712314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26086744-1ec9-403d-b299-b30589b1644d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:51.713402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26086744-1ec9-403d-b299-b30589b1644d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:51.715631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26086744-1ec9-403d-b299-b30589b1644d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:51.716208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26086744-1ec9-403d-b299-b30589b1644d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:51.863417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0aeb6e5e-9da3-4bdb-8ac1-b73c051e7774 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:51.864612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0aeb6e5e-9da3-4bdb-8ac1-b73c051e7774 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:51.867483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=36 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:38:51.884796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0aeb6e5e-9da3-4bdb-8ac1-b73c051e7774 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:51.885320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0aeb6e5e-9da3-4bdb-8ac1-b73c051e7774 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:51.885758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0aeb6e5e-9da3-4bdb-8ac1-b73c051e7774 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:51.886669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0aeb6e5e-9da3-4bdb-8ac1-b73c051e7774 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:51.887305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0aeb6e5e-9da3-4bdb-8ac1-b73c051e7774 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:51.887909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0aeb6e5e-9da3-4bdb-8ac1-b73c051e7774 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:52.122337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-26086744-1ec9-403d-b299-b30589b1644d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:52.141443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-26086744-1ec9-403d-b299-b30589b1644d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:52.148695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-26086744-1ec9-403d-b299-b30589b1644d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:52.151095 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-26086744-1ec9-403d-b299-b30589b1644d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1746 microversion: 2.20 time: 0.459546 Oct 29 01:38:52.155603 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3166/6085] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:38:51 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1746 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:38:52.241659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0aeb6e5e-9da3-4bdb-8ac1-b73c051e7774 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:52.255277 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0aeb6e5e-9da3-4bdb-8ac1-b73c051e7774 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1512 microversion: 2.1 time: 0.395782 Oct 29 01:38:52.269561 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2920/6086] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:51 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1512 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:52.773611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4d2d18c2-8fa1-453b-9607-d9888935f419 req-9a9e8738-d324-45f2-ade3-c92fcca5d2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c66a75-9fbd-4f0c-baf5-e19875095e42", "name": "network-vif-plugged", "status": "completed", "tag": "5ea23a70-144a-4d50-a1b1-6a74d325a5f1"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:52.795816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4d2d18c2-8fa1-453b-9607-d9888935f419 req-9a9e8738-d324-45f2-ade3-c92fcca5d2e1 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:52.804445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4d2d18c2-8fa1-453b-9607-d9888935f419 req-9a9e8738-d324-45f2-ade3-c92fcca5d2e1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:52.805132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4d2d18c2-8fa1-453b-9607-d9888935f419 req-9a9e8738-d324-45f2-ade3-c92fcca5d2e1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:52.823006 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4d2d18c2-8fa1-453b-9607-d9888935f419 req-9a9e8738-d324-45f2-ade3-c92fcca5d2e1 service nova] Creating event network-vif-plugged:5ea23a70-144a-4d50-a1b1-6a74d325a5f1 for instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 on n-h2-862964-3 Oct 29 01:38:52.829945 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4d2d18c2-8fa1-453b-9607-d9888935f419 req-9a9e8738-d324-45f2-ade3-c92fcca5d2e1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061038 Oct 29 01:38:52.831747 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3167/6087] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:38:53.182630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e8fa5a7-7f3e-410f-b606-6ecf04a99dad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:53.186737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7e8fa5a7-7f3e-410f-b606-6ecf04a99dad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:53.207810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e8fa5a7-7f3e-410f-b606-6ecf04a99dad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:53.214142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e8fa5a7-7f3e-410f-b606-6ecf04a99dad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:53.214142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e8fa5a7-7f3e-410f-b606-6ecf04a99dad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:53.214142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e8fa5a7-7f3e-410f-b606-6ecf04a99dad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:53.214142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e8fa5a7-7f3e-410f-b606-6ecf04a99dad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:53.214142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7e8fa5a7-7f3e-410f-b606-6ecf04a99dad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:53.283775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8ef2cff6-290e-4b2a-9552-d881662fb96d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:53.284504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8ef2cff6-290e-4b2a-9552-d881662fb96d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:53.298265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ef2cff6-290e-4b2a-9552-d881662fb96d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:53.298764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ef2cff6-290e-4b2a-9552-d881662fb96d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:53.299209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ef2cff6-290e-4b2a-9552-d881662fb96d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:53.300107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ef2cff6-290e-4b2a-9552-d881662fb96d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:53.300616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ef2cff6-290e-4b2a-9552-d881662fb96d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:53.300993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ef2cff6-290e-4b2a-9552-d881662fb96d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:53.730984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7e8fa5a7-7f3e-410f-b606-6ecf04a99dad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:53.744501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7e8fa5a7-7f3e-410f-b606-6ecf04a99dad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:53.746076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7e8fa5a7-7f3e-410f-b606-6ecf04a99dad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:53.747261 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e8fa5a7-7f3e-410f-b606-6ecf04a99dad tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1746 microversion: 2.20 time: 0.571064 Oct 29 01:38:53.747826 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2921/6088] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:38:53 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1746 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:38:53.811758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8ef2cff6-290e-4b2a-9552-d881662fb96d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:53.835299 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8ef2cff6-290e-4b2a-9552-d881662fb96d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1512 microversion: 2.1 time: 0.558761 Oct 29 01:38:53.839133 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3168/6089] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:53 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1512 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:54.776390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4bf29e1a-f4cb-4775-8c3f-9b1bc82c59d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:54.778736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4bf29e1a-f4cb-4775-8c3f-9b1bc82c59d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:54.795295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4bf29e1a-f4cb-4775-8c3f-9b1bc82c59d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:54.799430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4bf29e1a-f4cb-4775-8c3f-9b1bc82c59d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:54.800201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4bf29e1a-f4cb-4775-8c3f-9b1bc82c59d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:54.802445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4bf29e1a-f4cb-4775-8c3f-9b1bc82c59d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:54.803152 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4bf29e1a-f4cb-4775-8c3f-9b1bc82c59d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:54.805291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4bf29e1a-f4cb-4775-8c3f-9b1bc82c59d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:54.861953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cab9cbfc-2060-4949-a598-603b0b628254 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:54.865363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cab9cbfc-2060-4949-a598-603b0b628254 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:54.878929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cab9cbfc-2060-4949-a598-603b0b628254 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:54.879421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cab9cbfc-2060-4949-a598-603b0b628254 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:54.884885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cab9cbfc-2060-4949-a598-603b0b628254 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:54.885755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cab9cbfc-2060-4949-a598-603b0b628254 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:54.886244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cab9cbfc-2060-4949-a598-603b0b628254 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:54.893198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cab9cbfc-2060-4949-a598-603b0b628254 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:55.256274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4bf29e1a-f4cb-4775-8c3f-9b1bc82c59d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:55.260812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cab9cbfc-2060-4949-a598-603b0b628254 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:55.268995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4bf29e1a-f4cb-4775-8c3f-9b1bc82c59d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:55.271100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4bf29e1a-f4cb-4775-8c3f-9b1bc82c59d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:55.272965 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4bf29e1a-f4cb-4775-8c3f-9b1bc82c59d2 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1741 microversion: 2.20 time: 0.501210 Oct 29 01:38:55.274310 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2922/6090] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:38:54 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1741 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:38:55.309627 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cab9cbfc-2060-4949-a598-603b0b628254 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1512 microversion: 2.1 time: 0.451116 Oct 29 01:38:55.310863 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3169/6091] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:54 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1512 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:56.310353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ff5dd79f-2f12-43c2-a32f-5bb9c9faad40 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:56.312480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ff5dd79f-2f12-43c2-a32f-5bb9c9faad40 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:56.336227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff5dd79f-2f12-43c2-a32f-5bb9c9faad40 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:56.336227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff5dd79f-2f12-43c2-a32f-5bb9c9faad40 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:56.336227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff5dd79f-2f12-43c2-a32f-5bb9c9faad40 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:56.344612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-88ef6196-4693-4f51-bac2-d75a4395e352 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:56.347747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff5dd79f-2f12-43c2-a32f-5bb9c9faad40 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:56.348264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff5dd79f-2f12-43c2-a32f-5bb9c9faad40 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:56.348715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ff5dd79f-2f12-43c2-a32f-5bb9c9faad40 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:56.349921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-88ef6196-4693-4f51-bac2-d75a4395e352 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:56.364543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=44 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:38:56.369942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88ef6196-4693-4f51-bac2-d75a4395e352 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:56.370813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88ef6196-4693-4f51-bac2-d75a4395e352 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:56.375732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88ef6196-4693-4f51-bac2-d75a4395e352 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:56.383583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88ef6196-4693-4f51-bac2-d75a4395e352 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:56.383583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88ef6196-4693-4f51-bac2-d75a4395e352 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:56.383583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88ef6196-4693-4f51-bac2-d75a4395e352 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:56.405558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:38:56.844024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ff5dd79f-2f12-43c2-a32f-5bb9c9faad40 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:56.857301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-88ef6196-4693-4f51-bac2-d75a4395e352 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:56.868452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ff5dd79f-2f12-43c2-a32f-5bb9c9faad40 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:56.869948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ff5dd79f-2f12-43c2-a32f-5bb9c9faad40 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:56.871153 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ff5dd79f-2f12-43c2-a32f-5bb9c9faad40 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1741 microversion: 2.20 time: 0.565938 Oct 29 01:38:56.881703 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2923/6092] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:38:56 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1741 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:38:56.881703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bbf0d850-f3cf-4f05-8bfc-6edeabfd1dbf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:56.883861 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-88ef6196-4693-4f51-bac2-d75a4395e352 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1512 microversion: 2.1 time: 0.545586 Oct 29 01:38:56.884636 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3170/6093] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:56 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1512 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:56.888833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bbf0d850-f3cf-4f05-8bfc-6edeabfd1dbf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:56.909218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbf0d850-f3cf-4f05-8bfc-6edeabfd1dbf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:56.909919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbf0d850-f3cf-4f05-8bfc-6edeabfd1dbf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:56.910534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbf0d850-f3cf-4f05-8bfc-6edeabfd1dbf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:56.911614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbf0d850-f3cf-4f05-8bfc-6edeabfd1dbf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:56.912410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbf0d850-f3cf-4f05-8bfc-6edeabfd1dbf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:56.912997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbf0d850-f3cf-4f05-8bfc-6edeabfd1dbf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:57.021477 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bbf0d850-f3cf-4f05-8bfc-6edeabfd1dbf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857/action" status: 200 len: 24573 microversion: 2.1 time: 0.147668 Oct 29 01:38:57.022514 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2924/6094] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:38:56 2022] POST /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857/action => generated 24573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:38:57.911126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7d4b9375-a769-4478-b872-749ee91c690a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:57.912607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7d4b9375-a769-4478-b872-749ee91c690a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:57.913242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ed9dd94a-34d8-44c1-a946-2a5a456fbdd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:57.914538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ed9dd94a-34d8-44c1-a946-2a5a456fbdd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:57.937069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d4b9375-a769-4478-b872-749ee91c690a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:57.938370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d4b9375-a769-4478-b872-749ee91c690a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:57.940760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed9dd94a-34d8-44c1-a946-2a5a456fbdd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:57.941573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d4b9375-a769-4478-b872-749ee91c690a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:57.944785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d4b9375-a769-4478-b872-749ee91c690a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:57.945592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d4b9375-a769-4478-b872-749ee91c690a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:57.949840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d4b9375-a769-4478-b872-749ee91c690a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:57.950184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed9dd94a-34d8-44c1-a946-2a5a456fbdd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:57.950919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed9dd94a-34d8-44c1-a946-2a5a456fbdd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:57.962590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed9dd94a-34d8-44c1-a946-2a5a456fbdd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:57.965953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed9dd94a-34d8-44c1-a946-2a5a456fbdd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:57.966696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed9dd94a-34d8-44c1-a946-2a5a456fbdd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:58.474908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7d4b9375-a769-4478-b872-749ee91c690a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:58.492726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7d4b9375-a769-4478-b872-749ee91c690a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:58.496538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7d4b9375-a769-4478-b872-749ee91c690a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:58.501084 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7d4b9375-a769-4478-b872-749ee91c690a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1741 microversion: 2.20 time: 0.603500 Oct 29 01:38:58.504539 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3171/6095] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:38:57 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1741 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:38:58.734470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ed9dd94a-34d8-44c1-a946-2a5a456fbdd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:58.746937 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ed9dd94a-34d8-44c1-a946-2a5a456fbdd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1512 microversion: 2.1 time: 0.842108 Oct 29 01:38:58.754469 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2925/6096] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:57 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1512 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:59.529048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-220f6ab8-5cd0-4fdb-ab56-1e34dca54cdc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:59.530412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-220f6ab8-5cd0-4fdb-ab56-1e34dca54cdc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:59.547122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-220f6ab8-5cd0-4fdb-ab56-1e34dca54cdc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:59.549110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-220f6ab8-5cd0-4fdb-ab56-1e34dca54cdc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:59.550790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-220f6ab8-5cd0-4fdb-ab56-1e34dca54cdc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:59.552098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-220f6ab8-5cd0-4fdb-ab56-1e34dca54cdc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:59.557093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-220f6ab8-5cd0-4fdb-ab56-1e34dca54cdc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:59.558146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-220f6ab8-5cd0-4fdb-ab56-1e34dca54cdc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:59.775195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b5228ab2-6190-45a4-bf96-8491d31cd6e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:59.775810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b5228ab2-6190-45a4-bf96-8491d31cd6e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:38:59.831164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5228ab2-6190-45a4-bf96-8491d31cd6e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:59.833018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5228ab2-6190-45a4-bf96-8491d31cd6e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:59.834041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5228ab2-6190-45a4-bf96-8491d31cd6e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:59.834895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5228ab2-6190-45a4-bf96-8491d31cd6e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:38:59.835586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5228ab2-6190-45a4-bf96-8491d31cd6e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:38:59.836396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5228ab2-6190-45a4-bf96-8491d31cd6e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:38:59.956279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-220f6ab8-5cd0-4fdb-ab56-1e34dca54cdc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:59.972972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-220f6ab8-5cd0-4fdb-ab56-1e34dca54cdc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:59.975252 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-220f6ab8-5cd0-4fdb-ab56-1e34dca54cdc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:59.977846 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-220f6ab8-5cd0-4fdb-ab56-1e34dca54cdc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1741 microversion: 2.20 time: 0.452751 Oct 29 01:38:59.978939 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3172/6097] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:38:59 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1741 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:00.279742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b5228ab2-6190-45a4-bf96-8491d31cd6e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:00.297010 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b5228ab2-6190-45a4-bf96-8491d31cd6e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1512 microversion: 2.1 time: 0.523536 Oct 29 01:39:00.298844 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2926/6098] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:38:59 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1512 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:39:01.011880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-252a02aa-8b65-4031-a84a-7e71fe294ec7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:01.014123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-252a02aa-8b65-4031-a84a-7e71fe294ec7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:01.030624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-252a02aa-8b65-4031-a84a-7e71fe294ec7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:01.032727 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-252a02aa-8b65-4031-a84a-7e71fe294ec7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:01.033395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-252a02aa-8b65-4031-a84a-7e71fe294ec7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:01.036923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-252a02aa-8b65-4031-a84a-7e71fe294ec7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:01.037619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-252a02aa-8b65-4031-a84a-7e71fe294ec7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:01.038193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-252a02aa-8b65-4031-a84a-7e71fe294ec7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:01.321557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e9cbe568-9c1c-4481-89c3-5d890ab348de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:01.322172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e9cbe568-9c1c-4481-89c3-5d890ab348de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:01.334554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9cbe568-9c1c-4481-89c3-5d890ab348de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:01.335298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9cbe568-9c1c-4481-89c3-5d890ab348de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:01.335888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9cbe568-9c1c-4481-89c3-5d890ab348de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:01.343895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9cbe568-9c1c-4481-89c3-5d890ab348de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:01.344750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9cbe568-9c1c-4481-89c3-5d890ab348de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:01.345478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e9cbe568-9c1c-4481-89c3-5d890ab348de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:01.395795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-252a02aa-8b65-4031-a84a-7e71fe294ec7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:01.412533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-252a02aa-8b65-4031-a84a-7e71fe294ec7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:01.422948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-252a02aa-8b65-4031-a84a-7e71fe294ec7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:01.427698 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-252a02aa-8b65-4031-a84a-7e71fe294ec7 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1741 microversion: 2.20 time: 0.417660 Oct 29 01:39:01.431376 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3173/6099] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:01 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1741 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:01.876738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e9cbe568-9c1c-4481-89c3-5d890ab348de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:01.888923 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e9cbe568-9c1c-4481-89c3-5d890ab348de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1512 microversion: 2.1 time: 0.571100 Oct 29 01:39:01.893240 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2927/6100] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:01 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1512 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:39:02.461022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-762d0ad7-db62-49dd-a675-421a65101e7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:02.468892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-762d0ad7-db62-49dd-a675-421a65101e7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:02.476067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-762d0ad7-db62-49dd-a675-421a65101e7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:02.477806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-762d0ad7-db62-49dd-a675-421a65101e7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:02.479606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-762d0ad7-db62-49dd-a675-421a65101e7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:02.483259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-762d0ad7-db62-49dd-a675-421a65101e7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:02.484064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-762d0ad7-db62-49dd-a675-421a65101e7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:02.487595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-762d0ad7-db62-49dd-a675-421a65101e7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:02.540016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:39:02.951990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ab580cbc-506d-48f9-9c8c-abc42ec32830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:02.952701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ab580cbc-506d-48f9-9c8c-abc42ec32830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:02.968604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab580cbc-506d-48f9-9c8c-abc42ec32830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:02.969130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab580cbc-506d-48f9-9c8c-abc42ec32830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:02.969602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab580cbc-506d-48f9-9c8c-abc42ec32830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:02.986892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab580cbc-506d-48f9-9c8c-abc42ec32830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:02.987402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab580cbc-506d-48f9-9c8c-abc42ec32830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:02.987852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab580cbc-506d-48f9-9c8c-abc42ec32830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:03.309692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-762d0ad7-db62-49dd-a675-421a65101e7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:03.326349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-762d0ad7-db62-49dd-a675-421a65101e7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:03.332622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-762d0ad7-db62-49dd-a675-421a65101e7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:03.340537 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-762d0ad7-db62-49dd-a675-421a65101e7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1741 microversion: 2.20 time: 0.884217 Oct 29 01:39:03.345544 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3174/6101] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:02 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1741 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:03.672770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ab580cbc-506d-48f9-9c8c-abc42ec32830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:03.686986 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ab580cbc-506d-48f9-9c8c-abc42ec32830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1512 microversion: 2.1 time: 0.738443 Oct 29 01:39:03.688133 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2928/6102] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:02 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1512 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:04.379337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e28ec3ff-5132-4094-8b64-acdc6492106a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:04.380081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e28ec3ff-5132-4094-8b64-acdc6492106a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:04.431513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e28ec3ff-5132-4094-8b64-acdc6492106a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:04.432103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e28ec3ff-5132-4094-8b64-acdc6492106a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:04.432557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e28ec3ff-5132-4094-8b64-acdc6492106a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:04.443082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e28ec3ff-5132-4094-8b64-acdc6492106a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:04.445286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e28ec3ff-5132-4094-8b64-acdc6492106a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:04.447279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e28ec3ff-5132-4094-8b64-acdc6492106a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:04.715782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ffd6dc7f-c17c-4ca9-a131-6d9cbd888751 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:04.716407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ffd6dc7f-c17c-4ca9-a131-6d9cbd888751 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:04.739154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ffd6dc7f-c17c-4ca9-a131-6d9cbd888751 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:04.739667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ffd6dc7f-c17c-4ca9-a131-6d9cbd888751 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:04.740118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ffd6dc7f-c17c-4ca9-a131-6d9cbd888751 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:04.740850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ffd6dc7f-c17c-4ca9-a131-6d9cbd888751 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:04.741367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ffd6dc7f-c17c-4ca9-a131-6d9cbd888751 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:04.741804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ffd6dc7f-c17c-4ca9-a131-6d9cbd888751 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:05.203714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e28ec3ff-5132-4094-8b64-acdc6492106a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:05.218537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e28ec3ff-5132-4094-8b64-acdc6492106a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:05.229007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e28ec3ff-5132-4094-8b64-acdc6492106a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:05.230332 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e28ec3ff-5132-4094-8b64-acdc6492106a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1741 microversion: 2.20 time: 0.855489 Oct 29 01:39:05.230888 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3175/6103] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:04 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1741 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:05.327630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ffd6dc7f-c17c-4ca9-a131-6d9cbd888751 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:05.341477 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ffd6dc7f-c17c-4ca9-a131-6d9cbd888751 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1489 microversion: 2.1 time: 0.626065 Oct 29 01:39:05.343721 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2929/6104] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:04 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1489 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:05.365914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f42c4d7c-9b5f-417a-8f46-0163539ebdcd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:05.368254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f42c4d7c-9b5f-417a-8f46-0163539ebdcd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:05.383909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f42c4d7c-9b5f-417a-8f46-0163539ebdcd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:05.385146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f42c4d7c-9b5f-417a-8f46-0163539ebdcd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:05.386918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f42c4d7c-9b5f-417a-8f46-0163539ebdcd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:05.388173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f42c4d7c-9b5f-417a-8f46-0163539ebdcd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:05.390216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f42c4d7c-9b5f-417a-8f46-0163539ebdcd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:05.391046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f42c4d7c-9b5f-417a-8f46-0163539ebdcd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:05.470477 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f42c4d7c-9b5f-417a-8f46-0163539ebdcd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action" status: 200 len: 178 microversion: 2.1 time: 0.108425 Oct 29 01:39:05.475607 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3176/6105] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:39:05 2022] POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action => generated 178 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:39:05.481197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fa6d32c5-dd53-49df-beae-19839cf866ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:05.481881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fa6d32c5-dd53-49df-beae-19839cf866ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:05.494397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa6d32c5-dd53-49df-beae-19839cf866ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:05.496219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa6d32c5-dd53-49df-beae-19839cf866ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:05.500026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa6d32c5-dd53-49df-beae-19839cf866ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:05.501639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa6d32c5-dd53-49df-beae-19839cf866ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:05.503982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa6d32c5-dd53-49df-beae-19839cf866ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:05.504518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa6d32c5-dd53-49df-beae-19839cf866ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:06.263436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f616c81d-a24d-4edd-b4a6-5c0b9e680611 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:06.264264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f616c81d-a24d-4edd-b4a6-5c0b9e680611 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:06.279352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f616c81d-a24d-4edd-b4a6-5c0b9e680611 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:06.289922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f616c81d-a24d-4edd-b4a6-5c0b9e680611 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:06.290642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f616c81d-a24d-4edd-b4a6-5c0b9e680611 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:06.291745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f616c81d-a24d-4edd-b4a6-5c0b9e680611 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:06.292369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f616c81d-a24d-4edd-b4a6-5c0b9e680611 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:06.296884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f616c81d-a24d-4edd-b4a6-5c0b9e680611 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:06.923322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fa6d32c5-dd53-49df-beae-19839cf866ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:06.935964 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fa6d32c5-dd53-49df-beae-19839cf866ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 1.455909 Oct 29 01:39:06.945058 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2930/6106] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:05 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:39:06.977668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-47f5a67a-4430-43a6-9a0c-a6ca12620e66 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:06.980626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-47f5a67a-4430-43a6-9a0c-a6ca12620e66 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:06.987667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47f5a67a-4430-43a6-9a0c-a6ca12620e66 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:06.988357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47f5a67a-4430-43a6-9a0c-a6ca12620e66 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:06.988959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47f5a67a-4430-43a6-9a0c-a6ca12620e66 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:06.989851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47f5a67a-4430-43a6-9a0c-a6ca12620e66 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:06.990454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47f5a67a-4430-43a6-9a0c-a6ca12620e66 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:06.991032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47f5a67a-4430-43a6-9a0c-a6ca12620e66 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:08.570143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f616c81d-a24d-4edd-b4a6-5c0b9e680611 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:08.584958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f616c81d-a24d-4edd-b4a6-5c0b9e680611 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:08.590334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f616c81d-a24d-4edd-b4a6-5c0b9e680611 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:08.598290 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f616c81d-a24d-4edd-b4a6-5c0b9e680611 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1741 microversion: 2.20 time: 2.340770 Oct 29 01:39:08.599528 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3177/6107] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:06 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1741 bytes in 2343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:08.603432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-47f5a67a-4430-43a6-9a0c-a6ca12620e66 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:08.613106 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-47f5a67a-4430-43a6-9a0c-a6ca12620e66 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 1.639855 Oct 29 01:39:08.625526 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2931/6108] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:06 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:08.646395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5f496d20-6dff-4bcc-b414-4770296aac1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:08.647358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5f496d20-6dff-4bcc-b414-4770296aac1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:08.660318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f496d20-6dff-4bcc-b414-4770296aac1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:08.667237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f496d20-6dff-4bcc-b414-4770296aac1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:08.667237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f496d20-6dff-4bcc-b414-4770296aac1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:08.667237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f496d20-6dff-4bcc-b414-4770296aac1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:08.667237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f496d20-6dff-4bcc-b414-4770296aac1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:08.667237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f496d20-6dff-4bcc-b414-4770296aac1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:09.605862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5f496d20-6dff-4bcc-b414-4770296aac1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:09.619791 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5f496d20-6dff-4bcc-b414-4770296aac1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.976801 Oct 29 01:39:09.620482 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3178/6109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:08 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:09.649744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1dae2baa-90d1-486b-8763-9101811174b0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:09.650373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1dae2baa-90d1-486b-8763-9101811174b0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:09.652971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6b6733cc-f809-409d-b02e-453bf17d4195 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:09.653629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6b6733cc-f809-409d-b02e-453bf17d4195 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:09.671869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b6733cc-f809-409d-b02e-453bf17d4195 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:09.671869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b6733cc-f809-409d-b02e-453bf17d4195 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:09.671869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b6733cc-f809-409d-b02e-453bf17d4195 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:09.671869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b6733cc-f809-409d-b02e-453bf17d4195 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:09.672427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b6733cc-f809-409d-b02e-453bf17d4195 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:09.672427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b6733cc-f809-409d-b02e-453bf17d4195 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:09.674326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dae2baa-90d1-486b-8763-9101811174b0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:09.676279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dae2baa-90d1-486b-8763-9101811174b0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:09.676806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dae2baa-90d1-486b-8763-9101811174b0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:09.685546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dae2baa-90d1-486b-8763-9101811174b0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:09.686253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dae2baa-90d1-486b-8763-9101811174b0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:09.687228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1dae2baa-90d1-486b-8763-9101811174b0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:10.505296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1dae2baa-90d1-486b-8763-9101811174b0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:10.531962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6b6733cc-f809-409d-b02e-453bf17d4195 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:10.542695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6b6733cc-f809-409d-b02e-453bf17d4195 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:10.544145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6b6733cc-f809-409d-b02e-453bf17d4195 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:10.544956 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1dae2baa-90d1-486b-8763-9101811174b0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.897932 Oct 29 01:39:10.555225 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6b6733cc-f809-409d-b02e-453bf17d4195 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1741 microversion: 2.20 time: 0.904617 Oct 29 01:39:10.559446 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3179/6110] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:09 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:10.573417 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2932/6111] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:09 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1741 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:10.858984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1acb6f88-a7ca-4eaa-9c08-184f99175054 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1305910298", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "8568990a-4f98-461a-8f32-e20720daa4e5"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:10.951268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-1acb6f88-a7ca-4eaa-9c08-184f99175054 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] validate_networks() for [('8568990a-4f98-461a-8f32-e20720daa4e5', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:39:11.590272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8e474eb3-dc95-4030-b482-5763999ab90b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:11.590879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8e474eb3-dc95-4030-b482-5763999ab90b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:11.595149 n-d-862964-3 devstack@n-api.service[121100]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:39:11.598560 n-d-862964-3 devstack@n-api.service[121100]: Sat Oct 29 01:39:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 (ip 10.222.0.26) !!! Oct 29 01:39:11.633871 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e474eb3-dc95-4030-b482-5763999ab90b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:11.634918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e474eb3-dc95-4030-b482-5763999ab90b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:11.638255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e474eb3-dc95-4030-b482-5763999ab90b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:11.639023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e474eb3-dc95-4030-b482-5763999ab90b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:11.639572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e474eb3-dc95-4030-b482-5763999ab90b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:11.640007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e474eb3-dc95-4030-b482-5763999ab90b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:13.306911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8e474eb3-dc95-4030-b482-5763999ab90b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:13.328191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8e474eb3-dc95-4030-b482-5763999ab90b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:13.341486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8e474eb3-dc95-4030-b482-5763999ab90b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:13.346332 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8e474eb3-dc95-4030-b482-5763999ab90b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1741 microversion: 2.20 time: 1.757406 Oct 29 01:39:13.363876 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2933/6112] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:11 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1741 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:13.381427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4d274d0c-d574-436e-9d7a-342581f007ef tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Action: 'create', calling method: .version_select at 0x7f9d9fd2faf0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-23884023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfH0DDu40LXoI23+/ijhIVP9S05P6bRWNztjUwv63oaptVVe0SVsielKgw4953K/bvigXtRPTj4xBwLAsbUZIFqbzMu24ThYYYIQYsCFA8nWEggNLRIJJZG6GrVxWyYtg=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:13.403238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-4d274d0c-d574-436e-9d7a-342581f007ef tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Getting quotas for project e1817f6a3cd04ebbaa07dd63934d2771. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:39:13.410828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-4d274d0c-d574-436e-9d7a-342581f007ef tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Getting quotas for user ab773592a5914fcda533047d8044c3dc and project e1817f6a3cd04ebbaa07dd63934d2771. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:39:13.528516 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4d274d0c-d574-436e-9d7a-342581f007ef tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.162629 Oct 29 01:39:13.528516 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2934/6113] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:39:13 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:39:13.886950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1acb6f88-a7ca-4eaa-9c08-184f99175054 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:39:13.887989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1acb6f88-a7ca-4eaa-9c08-184f99175054 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:39:13.888649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1acb6f88-a7ca-4eaa-9c08-184f99175054 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:39:13.889344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1acb6f88-a7ca-4eaa-9c08-184f99175054 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:39:13.889936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-1acb6f88-a7ca-4eaa-9c08-184f99175054 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:39:13.904854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1acb6f88-a7ca-4eaa-9c08-184f99175054 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:13.912202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1acb6f88-a7ca-4eaa-9c08-184f99175054 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:13.912202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1acb6f88-a7ca-4eaa-9c08-184f99175054 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:13.912202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1acb6f88-a7ca-4eaa-9c08-184f99175054 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:13.912202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1acb6f88-a7ca-4eaa-9c08-184f99175054 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:13.912202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1acb6f88-a7ca-4eaa-9c08-184f99175054 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:13.955495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-1acb6f88-a7ca-4eaa-9c08-184f99175054 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Getting quotas for project 238c2e0d9e0b48198767a357cff1a442. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:39:14.002151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-1acb6f88-a7ca-4eaa-9c08-184f99175054 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Getting quotas for user 9c097ba205f6453ba793dfb1d1876f3e and project 238c2e0d9e0b48198767a357cff1a442. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:39:14.049190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1acb6f88-a7ca-4eaa-9c08-184f99175054 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:39:14.063326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1acb6f88-a7ca-4eaa-9c08-184f99175054 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:39:14.261977 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1acb6f88-a7ca-4eaa-9c08-184f99175054 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.407996 Oct 29 01:39:14.271966 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3180/6114] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:39:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:39:14.277648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a648787a-1fa4-42b8-875b-b412902a6081 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:14.278637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a648787a-1fa4-42b8-875b-b412902a6081 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:14.384334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6dc81a05-9b77-4a8a-9de5-3e9ac4316b23 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:14.398895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6dc81a05-9b77-4a8a-9de5-3e9ac4316b23 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:14.420235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dc81a05-9b77-4a8a-9de5-3e9ac4316b23 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:14.421054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dc81a05-9b77-4a8a-9de5-3e9ac4316b23 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:14.423930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dc81a05-9b77-4a8a-9de5-3e9ac4316b23 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:14.426752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dc81a05-9b77-4a8a-9de5-3e9ac4316b23 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:14.430265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dc81a05-9b77-4a8a-9de5-3e9ac4316b23 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:14.430976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dc81a05-9b77-4a8a-9de5-3e9ac4316b23 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:14.521670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a648787a-1fa4-42b8-875b-b412902a6081 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:14.536225 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a648787a-1fa4-42b8-875b-b412902a6081 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1215 microversion: 2.1 time: 0.262701 Oct 29 01:39:14.539858 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2935/6115] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:14 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1215 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:14.862930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6dc81a05-9b77-4a8a-9de5-3e9ac4316b23 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:14.887335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6dc81a05-9b77-4a8a-9de5-3e9ac4316b23 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:14.890138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6dc81a05-9b77-4a8a-9de5-3e9ac4316b23 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:14.899918 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6dc81a05-9b77-4a8a-9de5-3e9ac4316b23 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1741 microversion: 2.20 time: 0.518278 Oct 29 01:39:14.900663 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3181/6116] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:14 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1741 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:15.565976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5ea89036-10ee-42b7-be59-9be28cd9429b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:15.566726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5ea89036-10ee-42b7-be59-9be28cd9429b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:15.936115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cecab1a9-1c82-4941-b46e-1b3d28c73411 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:15.937772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cecab1a9-1c82-4941-b46e-1b3d28c73411 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:15.952857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cecab1a9-1c82-4941-b46e-1b3d28c73411 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:15.960847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5ea89036-10ee-42b7-be59-9be28cd9429b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:15.973555 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5ea89036-10ee-42b7-be59-9be28cd9429b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1215 microversion: 2.1 time: 0.414743 Oct 29 01:39:15.974207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cecab1a9-1c82-4941-b46e-1b3d28c73411 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:15.974778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cecab1a9-1c82-4941-b46e-1b3d28c73411 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:15.976223 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2936/6117] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:15 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1215 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:15.976431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cecab1a9-1c82-4941-b46e-1b3d28c73411 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:15.976926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cecab1a9-1c82-4941-b46e-1b3d28c73411 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:15.977416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cecab1a9-1c82-4941-b46e-1b3d28c73411 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:16.506410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cecab1a9-1c82-4941-b46e-1b3d28c73411 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:16.541384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cecab1a9-1c82-4941-b46e-1b3d28c73411 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:16.552007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cecab1a9-1c82-4941-b46e-1b3d28c73411 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:16.555601 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cecab1a9-1c82-4941-b46e-1b3d28c73411 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1741 microversion: 2.20 time: 0.629064 Oct 29 01:39:16.570584 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3182/6118] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:15 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1741 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:39:17.000239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ad19636c-f792-4848-9f19-d86d21284727 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:17.001716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ad19636c-f792-4848-9f19-d86d21284727 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:17.030305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad19636c-f792-4848-9f19-d86d21284727 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:17.031511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad19636c-f792-4848-9f19-d86d21284727 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:17.034181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad19636c-f792-4848-9f19-d86d21284727 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:17.036049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad19636c-f792-4848-9f19-d86d21284727 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:17.037557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad19636c-f792-4848-9f19-d86d21284727 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:17.038237 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad19636c-f792-4848-9f19-d86d21284727 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:17.337525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ad19636c-f792-4848-9f19-d86d21284727 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:17.355935 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ad19636c-f792-4848-9f19-d86d21284727 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1211 microversion: 2.1 time: 0.360550 Oct 29 01:39:17.356539 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2937/6119] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:16 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1211 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:17.588171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c6714a7a-f4e8-4a4e-ab8d-2709c194b40a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:17.588723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c6714a7a-f4e8-4a4e-ab8d-2709c194b40a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:17.602911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6714a7a-f4e8-4a4e-ab8d-2709c194b40a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:17.603766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6714a7a-f4e8-4a4e-ab8d-2709c194b40a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:17.604392 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6714a7a-f4e8-4a4e-ab8d-2709c194b40a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:17.606232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6714a7a-f4e8-4a4e-ab8d-2709c194b40a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:17.607025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6714a7a-f4e8-4a4e-ab8d-2709c194b40a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:17.608965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c6714a7a-f4e8-4a4e-ab8d-2709c194b40a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:17.931246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c6714a7a-f4e8-4a4e-ab8d-2709c194b40a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:17.966022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c6714a7a-f4e8-4a4e-ab8d-2709c194b40a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:17.979853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c6714a7a-f4e8-4a4e-ab8d-2709c194b40a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:17.983924 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c6714a7a-f4e8-4a4e-ab8d-2709c194b40a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1741 microversion: 2.20 time: 0.399573 Oct 29 01:39:18.029337 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3183/6120] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:17 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1741 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:18.384796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-84f7143d-39eb-499c-8c56-e8bee3773e81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:18.386339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-84f7143d-39eb-499c-8c56-e8bee3773e81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:18.406469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84f7143d-39eb-499c-8c56-e8bee3773e81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:18.407302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84f7143d-39eb-499c-8c56-e8bee3773e81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:18.407905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84f7143d-39eb-499c-8c56-e8bee3773e81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:18.422429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84f7143d-39eb-499c-8c56-e8bee3773e81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:18.424220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84f7143d-39eb-499c-8c56-e8bee3773e81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:18.424870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84f7143d-39eb-499c-8c56-e8bee3773e81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:18.649587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-84f7143d-39eb-499c-8c56-e8bee3773e81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:18.662862 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-84f7143d-39eb-499c-8c56-e8bee3773e81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1285 microversion: 2.1 time: 0.286752 Oct 29 01:39:18.667905 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2938/6121] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:18 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1285 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:19.028062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c503447f-211b-4764-8377-9e9606dab0bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:19.032080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c503447f-211b-4764-8377-9e9606dab0bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:19.044958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c503447f-211b-4764-8377-9e9606dab0bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:19.045545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c503447f-211b-4764-8377-9e9606dab0bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:19.046114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c503447f-211b-4764-8377-9e9606dab0bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:19.047082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c503447f-211b-4764-8377-9e9606dab0bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:19.047539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c503447f-211b-4764-8377-9e9606dab0bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:19.047974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c503447f-211b-4764-8377-9e9606dab0bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:19.695691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c503447f-211b-4764-8377-9e9606dab0bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:19.703079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c225c87c-9a5c-475a-aa56-fa6ca498b17c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:19.705290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c225c87c-9a5c-475a-aa56-fa6ca498b17c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:19.718889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c503447f-211b-4764-8377-9e9606dab0bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:19.720433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c503447f-211b-4764-8377-9e9606dab0bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:19.721709 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c503447f-211b-4764-8377-9e9606dab0bc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1741 microversion: 2.20 time: 0.697602 Oct 29 01:39:19.733485 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3184/6122] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:19 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1741 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:19.733827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c225c87c-9a5c-475a-aa56-fa6ca498b17c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:19.742692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c225c87c-9a5c-475a-aa56-fa6ca498b17c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:19.743855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c225c87c-9a5c-475a-aa56-fa6ca498b17c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:19.750674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c225c87c-9a5c-475a-aa56-fa6ca498b17c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:19.753081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c225c87c-9a5c-475a-aa56-fa6ca498b17c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:19.756060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c225c87c-9a5c-475a-aa56-fa6ca498b17c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:19.940312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c225c87c-9a5c-475a-aa56-fa6ca498b17c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:19.947402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-83e43976-7c9b-41bc-ae39-ebe7487c6525 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1443060573", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "64966bb9-3f38-49ef-bfe1-02e668640735"}], "key_name": "tempest-TestNetworkBasicOps-23884023", "security_groups": [{"name": "tempest-secgroup-smoke-220069491"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:19.969530 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c225c87c-9a5c-475a-aa56-fa6ca498b17c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1273 microversion: 2.1 time: 0.280733 Oct 29 01:39:19.970737 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2939/6123] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:19 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1273 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:20.553565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-83e43976-7c9b-41bc-ae39-ebe7487c6525 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] validate_networks() for [('64966bb9-3f38-49ef-bfe1-02e668640735', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:39:20.758665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6f31e163-f716-43ac-8989-95c5c4cc7e2f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:20.759283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6f31e163-f716-43ac-8989-95c5c4cc7e2f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:20.771767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f31e163-f716-43ac-8989-95c5c4cc7e2f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:20.771767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f31e163-f716-43ac-8989-95c5c4cc7e2f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:20.775773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f31e163-f716-43ac-8989-95c5c4cc7e2f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:20.775773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f31e163-f716-43ac-8989-95c5c4cc7e2f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:20.775773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f31e163-f716-43ac-8989-95c5c4cc7e2f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:20.775773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6f31e163-f716-43ac-8989-95c5c4cc7e2f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:21.853419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-83e43976-7c9b-41bc-ae39-ebe7487c6525 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:39:21.853419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-83e43976-7c9b-41bc-ae39-ebe7487c6525 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:39:21.853419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-83e43976-7c9b-41bc-ae39-ebe7487c6525 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:39:21.853419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-83e43976-7c9b-41bc-ae39-ebe7487c6525 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:39:21.853419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-83e43976-7c9b-41bc-ae39-ebe7487c6525 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:39:21.870514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83e43976-7c9b-41bc-ae39-ebe7487c6525 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:21.880146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83e43976-7c9b-41bc-ae39-ebe7487c6525 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:21.880508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83e43976-7c9b-41bc-ae39-ebe7487c6525 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:21.888380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83e43976-7c9b-41bc-ae39-ebe7487c6525 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:21.893285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83e43976-7c9b-41bc-ae39-ebe7487c6525 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:21.894330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83e43976-7c9b-41bc-ae39-ebe7487c6525 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:21.961692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-83e43976-7c9b-41bc-ae39-ebe7487c6525 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Getting quotas for project e1817f6a3cd04ebbaa07dd63934d2771. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:39:21.968076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-83e43976-7c9b-41bc-ae39-ebe7487c6525 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Getting quotas for user ab773592a5914fcda533047d8044c3dc and project e1817f6a3cd04ebbaa07dd63934d2771. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:39:21.984677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-83e43976-7c9b-41bc-ae39-ebe7487c6525 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:39:21.987141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-83e43976-7c9b-41bc-ae39-ebe7487c6525 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:39:22.012679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6f31e163-f716-43ac-8989-95c5c4cc7e2f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:22.025101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6f31e163-f716-43ac-8989-95c5c4cc7e2f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:22.026917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6f31e163-f716-43ac-8989-95c5c4cc7e2f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:22.033300 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6f31e163-f716-43ac-8989-95c5c4cc7e2f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1741 microversion: 2.20 time: 1.279288 Oct 29 01:39:22.034525 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2940/6124] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:20 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1741 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:39:22.039354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-68e81b3e-b862-4851-92ed-a6cb4171cf78 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:22.045119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-68e81b3e-b862-4851-92ed-a6cb4171cf78 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:22.053002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:39:22.054816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68e81b3e-b862-4851-92ed-a6cb4171cf78 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:22.055469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68e81b3e-b862-4851-92ed-a6cb4171cf78 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:22.055917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68e81b3e-b862-4851-92ed-a6cb4171cf78 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:22.056682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68e81b3e-b862-4851-92ed-a6cb4171cf78 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:22.057145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68e81b3e-b862-4851-92ed-a6cb4171cf78 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:22.057756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68e81b3e-b862-4851-92ed-a6cb4171cf78 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:22.271308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-68e81b3e-b862-4851-92ed-a6cb4171cf78 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:22.286642 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-68e81b3e-b862-4851-92ed-a6cb4171cf78 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1315 microversion: 2.1 time: 0.250766 Oct 29 01:39:22.288819 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2941/6125] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:22 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:22.410454 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-83e43976-7c9b-41bc-ae39-ebe7487c6525 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.468372 Oct 29 01:39:22.414664 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3185/6126] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:39:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 2471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:39:22.425883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fdedb2b7-3c1b-4065-8c08-24b64545f8b8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:22.426767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fdedb2b7-3c1b-4065-8c08-24b64545f8b8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:23.026108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fdedb2b7-3c1b-4065-8c08-24b64545f8b8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:23.045031 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fdedb2b7-3c1b-4065-8c08-24b64545f8b8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 200 len: 1247 microversion: 2.1 time: 0.618092 Oct 29 01:39:23.045031 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2942/6127] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:22 2022] GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 1247 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:23.069716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c42ebc98-1191-4a37-a133-ea041eeeca34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:23.072456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c42ebc98-1191-4a37-a133-ea041eeeca34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:23.119210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c42ebc98-1191-4a37-a133-ea041eeeca34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:23.119210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c42ebc98-1191-4a37-a133-ea041eeeca34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:23.119210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c42ebc98-1191-4a37-a133-ea041eeeca34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:23.119210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c42ebc98-1191-4a37-a133-ea041eeeca34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:23.119210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c42ebc98-1191-4a37-a133-ea041eeeca34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:23.119210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c42ebc98-1191-4a37-a133-ea041eeeca34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:23.316780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-42fc097a-67a0-4918-8649-4bfa159e4048 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:23.317368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-42fc097a-67a0-4918-8649-4bfa159e4048 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:23.328611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42fc097a-67a0-4918-8649-4bfa159e4048 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:23.332590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42fc097a-67a0-4918-8649-4bfa159e4048 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:23.333293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42fc097a-67a0-4918-8649-4bfa159e4048 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:23.334221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42fc097a-67a0-4918-8649-4bfa159e4048 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:23.334838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42fc097a-67a0-4918-8649-4bfa159e4048 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:23.335418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42fc097a-67a0-4918-8649-4bfa159e4048 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:23.851045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c42ebc98-1191-4a37-a133-ea041eeeca34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:23.869090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c42ebc98-1191-4a37-a133-ea041eeeca34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:23.870834 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c42ebc98-1191-4a37-a133-ea041eeeca34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:23.872462 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c42ebc98-1191-4a37-a133-ea041eeeca34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1741 microversion: 2.20 time: 0.813897 Oct 29 01:39:23.873201 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3186/6128] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:23 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1741 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:24.025346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-42fc097a-67a0-4918-8649-4bfa159e4048 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:24.034843 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-42fc097a-67a0-4918-8649-4bfa159e4048 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1315 microversion: 2.1 time: 0.721794 Oct 29 01:39:24.035378 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2943/6129] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:23 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:39:24.066193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fb4e2023-8399-470c-a01a-076281313b3d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:24.067462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fb4e2023-8399-470c-a01a-076281313b3d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:24.227468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fb4e2023-8399-470c-a01a-076281313b3d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:24.234842 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fb4e2023-8399-470c-a01a-076281313b3d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 200 len: 1247 microversion: 2.1 time: 0.172679 Oct 29 01:39:24.242098 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3187/6130] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:24 2022] GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 1247 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:24.908828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-36e8a556-89f2-4900-b06d-488cb505cf9f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:24.910703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-36e8a556-89f2-4900-b06d-488cb505cf9f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:24.922075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e8a556-89f2-4900-b06d-488cb505cf9f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:24.922884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e8a556-89f2-4900-b06d-488cb505cf9f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:24.923635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e8a556-89f2-4900-b06d-488cb505cf9f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:24.924520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e8a556-89f2-4900-b06d-488cb505cf9f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:24.925136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e8a556-89f2-4900-b06d-488cb505cf9f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:24.926281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e8a556-89f2-4900-b06d-488cb505cf9f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:24.954965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:39:25.064314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bdc91549-4ad4-4cb0-a8dc-dd48b812e446 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:25.065149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bdc91549-4ad4-4cb0-a8dc-dd48b812e446 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:25.079846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdc91549-4ad4-4cb0-a8dc-dd48b812e446 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:25.082536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdc91549-4ad4-4cb0-a8dc-dd48b812e446 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:25.083929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdc91549-4ad4-4cb0-a8dc-dd48b812e446 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:25.086767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdc91549-4ad4-4cb0-a8dc-dd48b812e446 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:25.087424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdc91549-4ad4-4cb0-a8dc-dd48b812e446 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:25.088145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdc91549-4ad4-4cb0-a8dc-dd48b812e446 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:25.406383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-36e8a556-89f2-4900-b06d-488cb505cf9f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:25.445968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-36e8a556-89f2-4900-b06d-488cb505cf9f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:25.447714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-36e8a556-89f2-4900-b06d-488cb505cf9f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:25.454201 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-36e8a556-89f2-4900-b06d-488cb505cf9f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1741 microversion: 2.20 time: 0.555668 Oct 29 01:39:25.460806 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2944/6131] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:24 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1741 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:25.474960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f7dd4857-e8a3-403d-b4ed-b567df7b9b73 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:25.475905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f7dd4857-e8a3-403d-b4ed-b567df7b9b73 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:25.506345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7dd4857-e8a3-403d-b4ed-b567df7b9b73 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:25.511523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7dd4857-e8a3-403d-b4ed-b567df7b9b73 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:25.512301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7dd4857-e8a3-403d-b4ed-b567df7b9b73 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:25.526499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7dd4857-e8a3-403d-b4ed-b567df7b9b73 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:25.543914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7dd4857-e8a3-403d-b4ed-b567df7b9b73 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:25.544576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f7dd4857-e8a3-403d-b4ed-b567df7b9b73 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:25.755789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bdc91549-4ad4-4cb0-a8dc-dd48b812e446 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:25.770702 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bdc91549-4ad4-4cb0-a8dc-dd48b812e446 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1315 microversion: 2.1 time: 0.711588 Oct 29 01:39:25.785435 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3188/6132] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:25 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1315 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:39:25.975969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f7dd4857-e8a3-403d-b4ed-b567df7b9b73 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:25.992169 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f7dd4857-e8a3-403d-b4ed-b567df7b9b73 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 200 len: 1299 microversion: 2.1 time: 0.530051 Oct 29 01:39:25.994657 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2945/6133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:25 2022] GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 1299 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:26.355757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-c7c48e43-ed8e-459e-8e34-042284668765 req-6268e5ca-c6f0-435f-af40-5a18471ac92f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5403c28-467f-4f5c-a8ff-2423a31e8728", "tag": "03564455-9258-48f6-a2d8-a48711e36f62"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:26.379744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c7c48e43-ed8e-459e-8e34-042284668765 req-6268e5ca-c6f0-435f-af40-5a18471ac92f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:26.385048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c7c48e43-ed8e-459e-8e34-042284668765 req-6268e5ca-c6f0-435f-af40-5a18471ac92f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:26.385048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c7c48e43-ed8e-459e-8e34-042284668765 req-6268e5ca-c6f0-435f-af40-5a18471ac92f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:26.419566 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-c7c48e43-ed8e-459e-8e34-042284668765 req-6268e5ca-c6f0-435f-af40-5a18471ac92f service nova] Creating event network-changed:03564455-9258-48f6-a2d8-a48711e36f62 for instance a5403c28-467f-4f5c-a8ff-2423a31e8728 on n-h1-862964-3 Oct 29 01:39:26.425830 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-c7c48e43-ed8e-459e-8e34-042284668765 req-6268e5ca-c6f0-435f-af40-5a18471ac92f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074173 Oct 29 01:39:26.426889 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3189/6134] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:39:26.492503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-439a20d2-1ece-4ccb-a9b6-29090587ce39 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:26.495000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-439a20d2-1ece-4ccb-a9b6-29090587ce39 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:26.506057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-439a20d2-1ece-4ccb-a9b6-29090587ce39 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:26.506838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-439a20d2-1ece-4ccb-a9b6-29090587ce39 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:26.507988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-439a20d2-1ece-4ccb-a9b6-29090587ce39 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:26.508942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-439a20d2-1ece-4ccb-a9b6-29090587ce39 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:26.509997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-439a20d2-1ece-4ccb-a9b6-29090587ce39 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:26.510649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-439a20d2-1ece-4ccb-a9b6-29090587ce39 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:26.804843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3acc1bda-cf3f-4a2b-8fbe-0eaabb3c60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:26.805604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3acc1bda-cf3f-4a2b-8fbe-0eaabb3c60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:26.808593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:39:26.824492 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3acc1bda-cf3f-4a2b-8fbe-0eaabb3c60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:26.826660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3acc1bda-cf3f-4a2b-8fbe-0eaabb3c60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:26.828037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3acc1bda-cf3f-4a2b-8fbe-0eaabb3c60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:26.829125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3acc1bda-cf3f-4a2b-8fbe-0eaabb3c60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:26.831654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3acc1bda-cf3f-4a2b-8fbe-0eaabb3c60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:26.832939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3acc1bda-cf3f-4a2b-8fbe-0eaabb3c60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:26.996660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-439a20d2-1ece-4ccb-a9b6-29090587ce39 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:27.007089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-439a20d2-1ece-4ccb-a9b6-29090587ce39 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:27.008976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-439a20d2-1ece-4ccb-a9b6-29090587ce39 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:27.010800 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-439a20d2-1ece-4ccb-a9b6-29090587ce39 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1723 microversion: 2.20 time: 0.524160 Oct 29 01:39:27.023094 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2946/6135] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:26 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1723 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:27.042984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-faf36551-d2d5-40f6-8697-c73e92f782b5 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:27.043641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-faf36551-d2d5-40f6-8697-c73e92f782b5 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:27.057542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faf36551-d2d5-40f6-8697-c73e92f782b5 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:27.062026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faf36551-d2d5-40f6-8697-c73e92f782b5 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:27.062675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faf36551-d2d5-40f6-8697-c73e92f782b5 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:27.063586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faf36551-d2d5-40f6-8697-c73e92f782b5 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:27.064212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faf36551-d2d5-40f6-8697-c73e92f782b5 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:27.065803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faf36551-d2d5-40f6-8697-c73e92f782b5 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:27.234597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-faf36551-d2d5-40f6-8697-c73e92f782b5 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:27.247235 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-faf36551-d2d5-40f6-8697-c73e92f782b5 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 200 len: 1305 microversion: 2.1 time: 0.222881 Oct 29 01:39:27.247854 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2947/6136] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:27 2022] GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 1305 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:27.410564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3acc1bda-cf3f-4a2b-8fbe-0eaabb3c60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:27.431904 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3acc1bda-cf3f-4a2b-8fbe-0eaabb3c60f5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1315 microversion: 2.1 time: 0.625346 Oct 29 01:39:27.437641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9ce8069e-512b-4052-8a90-7f290cbbb9af tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:27.438065 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3190/6137] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:26 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:39:27.438562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9ce8069e-512b-4052-8a90-7f290cbbb9af tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:27.453919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9ce8069e-512b-4052-8a90-7f290cbbb9af tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:27.454976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9ce8069e-512b-4052-8a90-7f290cbbb9af tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:27.459985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9ce8069e-512b-4052-8a90-7f290cbbb9af tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:27.461724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9ce8069e-512b-4052-8a90-7f290cbbb9af tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:27.463972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9ce8069e-512b-4052-8a90-7f290cbbb9af tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:27.464772 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9ce8069e-512b-4052-8a90-7f290cbbb9af tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:27.788626 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9ce8069e-512b-4052-8a90-7f290cbbb9af tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1831 microversion: 2.1 time: 0.355469 Oct 29 01:39:27.790933 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2948/6138] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:27 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1831 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:27.828593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a3466b6b-ee82-454b-affa-ce2ae65f3bc1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:27.829885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a3466b6b-ee82-454b-affa-ce2ae65f3bc1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:27.837565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3466b6b-ee82-454b-affa-ce2ae65f3bc1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:27.838389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3466b6b-ee82-454b-affa-ce2ae65f3bc1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:27.839168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3466b6b-ee82-454b-affa-ce2ae65f3bc1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:27.840097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3466b6b-ee82-454b-affa-ce2ae65f3bc1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:27.840707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3466b6b-ee82-454b-affa-ce2ae65f3bc1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:27.841433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3466b6b-ee82-454b-affa-ce2ae65f3bc1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:28.050129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a3466b6b-ee82-454b-affa-ce2ae65f3bc1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:28.059634 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a3466b6b-ee82-454b-affa-ce2ae65f3bc1 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1680 microversion: 2.1 time: 0.235581 Oct 29 01:39:28.068513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f41625fb-2c6b-41f0-8c8d-90afe34042fa tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:28.071578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f41625fb-2c6b-41f0-8c8d-90afe34042fa tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:28.074332 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3191/6139] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:27 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1680 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:28.098093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f41625fb-2c6b-41f0-8c8d-90afe34042fa tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:28.098602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f41625fb-2c6b-41f0-8c8d-90afe34042fa tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:28.099183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f41625fb-2c6b-41f0-8c8d-90afe34042fa tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:28.099998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f41625fb-2c6b-41f0-8c8d-90afe34042fa tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:28.101072 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f41625fb-2c6b-41f0-8c8d-90afe34042fa tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:28.104959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f41625fb-2c6b-41f0-8c8d-90afe34042fa tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:28.194344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-be6f577c-b94a-4a57-93ce-7f8d10af249c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:28.196518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-be6f577c-b94a-4a57-93ce-7f8d10af249c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:28.203678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be6f577c-b94a-4a57-93ce-7f8d10af249c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:28.204470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be6f577c-b94a-4a57-93ce-7f8d10af249c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:28.205071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be6f577c-b94a-4a57-93ce-7f8d10af249c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:28.205962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be6f577c-b94a-4a57-93ce-7f8d10af249c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:28.206583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be6f577c-b94a-4a57-93ce-7f8d10af249c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:28.207159 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be6f577c-b94a-4a57-93ce-7f8d10af249c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:28.350718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f41625fb-2c6b-41f0-8c8d-90afe34042fa tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:28.361501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f41625fb-2c6b-41f0-8c8d-90afe34042fa tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:28.364041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f41625fb-2c6b-41f0-8c8d-90afe34042fa tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:28.365532 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f41625fb-2c6b-41f0-8c8d-90afe34042fa tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1723 microversion: 2.20 time: 0.328449 Oct 29 01:39:28.367283 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2949/6140] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:28 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:39:28.372557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-954e6221-9970-4503-89cc-e43020e894e9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:28.373492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-954e6221-9970-4503-89cc-e43020e894e9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:28.382817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-954e6221-9970-4503-89cc-e43020e894e9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:28.384137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-954e6221-9970-4503-89cc-e43020e894e9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:28.384861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-954e6221-9970-4503-89cc-e43020e894e9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:28.386471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-954e6221-9970-4503-89cc-e43020e894e9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:28.387702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-954e6221-9970-4503-89cc-e43020e894e9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:28.388945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-954e6221-9970-4503-89cc-e43020e894e9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:28.502731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-954e6221-9970-4503-89cc-e43020e894e9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:28.526736 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-954e6221-9970-4503-89cc-e43020e894e9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 200 len: 1305 microversion: 2.1 time: 0.158055 Oct 29 01:39:28.527950 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2950/6141] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:28 2022] GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 1305 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:28.533437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-80afb396-d6e1-4aee-b631-90951071f343 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:28.538739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-80afb396-d6e1-4aee-b631-90951071f343 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:28.555644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80afb396-d6e1-4aee-b631-90951071f343 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:28.556075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80afb396-d6e1-4aee-b631-90951071f343 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:28.556523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80afb396-d6e1-4aee-b631-90951071f343 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:28.557269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80afb396-d6e1-4aee-b631-90951071f343 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:28.557734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80afb396-d6e1-4aee-b631-90951071f343 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:28.558160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80afb396-d6e1-4aee-b631-90951071f343 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:28.907260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-80afb396-d6e1-4aee-b631-90951071f343 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:28.925683 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-80afb396-d6e1-4aee-b631-90951071f343 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1315 microversion: 2.1 time: 0.396116 Oct 29 01:39:28.928117 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2951/6142] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:28 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:29.395431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b79becc1-fc06-431c-b63f-825b47ab86b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:29.396307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b79becc1-fc06-431c-b63f-825b47ab86b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:29.404110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b79becc1-fc06-431c-b63f-825b47ab86b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:29.405516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b79becc1-fc06-431c-b63f-825b47ab86b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:29.406264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b79becc1-fc06-431c-b63f-825b47ab86b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:29.407170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b79becc1-fc06-431c-b63f-825b47ab86b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:29.407813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b79becc1-fc06-431c-b63f-825b47ab86b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:29.408620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b79becc1-fc06-431c-b63f-825b47ab86b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:29.731209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b79becc1-fc06-431c-b63f-825b47ab86b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:29.743247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b79becc1-fc06-431c-b63f-825b47ab86b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:29.753293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b79becc1-fc06-431c-b63f-825b47ab86b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:29.755830 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b79becc1-fc06-431c-b63f-825b47ab86b5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1723 microversion: 2.20 time: 0.363603 Oct 29 01:39:29.757979 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2952/6143] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:29 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1723 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:39:29.773983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-910baba4-bca8-4b21-acf6-3b39e55acd84 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:29.774815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-910baba4-bca8-4b21-acf6-3b39e55acd84 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:29.787470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-910baba4-bca8-4b21-acf6-3b39e55acd84 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:29.789828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-910baba4-bca8-4b21-acf6-3b39e55acd84 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:29.789828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-910baba4-bca8-4b21-acf6-3b39e55acd84 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:29.792110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-910baba4-bca8-4b21-acf6-3b39e55acd84 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:29.792915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-910baba4-bca8-4b21-acf6-3b39e55acd84 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:29.794077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-910baba4-bca8-4b21-acf6-3b39e55acd84 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:30.109658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-910baba4-bca8-4b21-acf6-3b39e55acd84 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:30.124545 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-910baba4-bca8-4b21-acf6-3b39e55acd84 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 200 len: 1372 microversion: 2.1 time: 0.364210 Oct 29 01:39:30.126169 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2953/6144] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:29 2022] GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 1372 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:30.132685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-440acefe-d4f8-4dcd-8005-c5c4421b11d6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:30.133702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-440acefe-d4f8-4dcd-8005-c5c4421b11d6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:30.142070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-440acefe-d4f8-4dcd-8005-c5c4421b11d6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:30.142894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-440acefe-d4f8-4dcd-8005-c5c4421b11d6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:30.143679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-440acefe-d4f8-4dcd-8005-c5c4421b11d6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:30.144767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-440acefe-d4f8-4dcd-8005-c5c4421b11d6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:30.145589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-440acefe-d4f8-4dcd-8005-c5c4421b11d6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:30.146228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-440acefe-d4f8-4dcd-8005-c5c4421b11d6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:30.250632 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-be6f577c-b94a-4a57-93ce-7f8d10af249c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857/action" status: 200 len: 32650 microversion: 2.1 time: 2.057955 Oct 29 01:39:30.252001 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3192/6145] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:39:28 2022] POST /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857/action => generated 32650 bytes in 2063 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:39:30.418669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cdbf1513-f48d-4b6d-8960-4fe7ba8f6449 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:30.418669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cdbf1513-f48d-4b6d-8960-4fe7ba8f6449 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:30.420690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-440acefe-d4f8-4dcd-8005-c5c4421b11d6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:30.424455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cdbf1513-f48d-4b6d-8960-4fe7ba8f6449 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:30.424948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cdbf1513-f48d-4b6d-8960-4fe7ba8f6449 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:30.426853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cdbf1513-f48d-4b6d-8960-4fe7ba8f6449 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:30.429867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cdbf1513-f48d-4b6d-8960-4fe7ba8f6449 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:30.429997 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-440acefe-d4f8-4dcd-8005-c5c4421b11d6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1315 microversion: 2.1 time: 0.302274 Oct 29 01:39:30.430499 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2954/6146] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:30 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:30.433795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cdbf1513-f48d-4b6d-8960-4fe7ba8f6449 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:30.434373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cdbf1513-f48d-4b6d-8960-4fe7ba8f6449 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:30.474212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cdbf1513-f48d-4b6d-8960-4fe7ba8f6449 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a77ce3edf2b84dbe904f4154a33e9ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88c5606c800429f9dc9092d3d02d20d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:30.486825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cdbf1513-f48d-4b6d-8960-4fe7ba8f6449 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] flavor_id is None. Assuming migration. {{(pid=121099) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 29 01:39:30.487377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cdbf1513-f48d-4b6d-8960-4fe7ba8f6449 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121099) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 01:39:30.699946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:39:30.788320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-870ee931-689c-4038-a25c-9f188c00ed7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:30.788941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-870ee931-689c-4038-a25c-9f188c00ed7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:30.801515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-870ee931-689c-4038-a25c-9f188c00ed7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:30.802247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-870ee931-689c-4038-a25c-9f188c00ed7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:30.802865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-870ee931-689c-4038-a25c-9f188c00ed7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:30.803798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-870ee931-689c-4038-a25c-9f188c00ed7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:30.806852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-870ee931-689c-4038-a25c-9f188c00ed7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:30.807462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-870ee931-689c-4038-a25c-9f188c00ed7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:30.952983 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cdbf1513-f48d-4b6d-8960-4fe7ba8f6449 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857/action" status: 202 len: 0 microversion: 2.1 time: 0.545180 Oct 29 01:39:30.954121 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3193/6147] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:39:30 2022] POST /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:39:30.970686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-67e2a291-7dbe-4184-b3a3-316c4b0d3733 req-57a6c742-52c7-41db-83db-ebb55975fe69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c66a75-9fbd-4f0c-baf5-e19875095e42", "name": "network-vif-unplugged", "status": "completed", "tag": "5ea23a70-144a-4d50-a1b1-6a74d325a5f1"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:30.981583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-67e2a291-7dbe-4184-b3a3-316c4b0d3733 req-57a6c742-52c7-41db-83db-ebb55975fe69 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:30.983294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-67e2a291-7dbe-4184-b3a3-316c4b0d3733 req-57a6c742-52c7-41db-83db-ebb55975fe69 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:30.984035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-67e2a291-7dbe-4184-b3a3-316c4b0d3733 req-57a6c742-52c7-41db-83db-ebb55975fe69 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:31.000455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.compute.server_external_events [req-67e2a291-7dbe-4184-b3a3-316c4b0d3733 req-57a6c742-52c7-41db-83db-ebb55975fe69 service nova] Unable to find a host for instance 49c66a75-9fbd-4f0c-baf5-e19875095e42. Dropping event network-vif-unplugged {{(pid=121099) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 29 01:39:31.002233 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-67e2a291-7dbe-4184-b3a3-316c4b0d3733 req-57a6c742-52c7-41db-83db-ebb55975fe69 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.046964 Oct 29 01:39:31.003648 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3194/6148] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 01:39:31.015837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-18d56fcf-50de-4168-b71d-8372363cd666 req-14b6b582-b32b-4aad-8775-e4c7c4567856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dbc4be2-8396-4d8f-9f31-7cf1423bf145", "tag": "25d49c2a-24b7-4c5a-8b70-8bb410658a2f"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:31.027329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-18d56fcf-50de-4168-b71d-8372363cd666 req-14b6b582-b32b-4aad-8775-e4c7c4567856 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:31.027914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-18d56fcf-50de-4168-b71d-8372363cd666 req-14b6b582-b32b-4aad-8775-e4c7c4567856 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:31.028442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-18d56fcf-50de-4168-b71d-8372363cd666 req-14b6b582-b32b-4aad-8775-e4c7c4567856 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:31.045225 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-18d56fcf-50de-4168-b71d-8372363cd666 req-14b6b582-b32b-4aad-8775-e4c7c4567856 service nova] Creating event network-changed:25d49c2a-24b7-4c5a-8b70-8bb410658a2f for instance 4dbc4be2-8396-4d8f-9f31-7cf1423bf145 on n-h2-862964-3 Oct 29 01:39:31.051337 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-18d56fcf-50de-4168-b71d-8372363cd666 req-14b6b582-b32b-4aad-8775-e4c7c4567856 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040337 Oct 29 01:39:31.052211 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3195/6149] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:39:31.059037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9c663a3d-21cf-4f34-8738-3b56821e7569 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:31.060248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9c663a3d-21cf-4f34-8738-3b56821e7569 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:31.069698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c663a3d-21cf-4f34-8738-3b56821e7569 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:31.074522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c663a3d-21cf-4f34-8738-3b56821e7569 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:31.074522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c663a3d-21cf-4f34-8738-3b56821e7569 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:31.075846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c663a3d-21cf-4f34-8738-3b56821e7569 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:31.076930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c663a3d-21cf-4f34-8738-3b56821e7569 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:31.077871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c663a3d-21cf-4f34-8738-3b56821e7569 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:31.209077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-870ee931-689c-4038-a25c-9f188c00ed7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:31.224595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-870ee931-689c-4038-a25c-9f188c00ed7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:31.229774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-870ee931-689c-4038-a25c-9f188c00ed7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:31.231285 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-870ee931-689c-4038-a25c-9f188c00ed7c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1666 microversion: 2.20 time: 0.448184 Oct 29 01:39:31.234003 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2955/6150] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:30 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1666 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:31.246811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-96e1db3c-d604-47cd-a262-a1ed0ccd63e3 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:31.250102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-96e1db3c-d604-47cd-a262-a1ed0ccd63e3 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:31.262414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96e1db3c-d604-47cd-a262-a1ed0ccd63e3 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:31.271095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96e1db3c-d604-47cd-a262-a1ed0ccd63e3 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:31.271095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96e1db3c-d604-47cd-a262-a1ed0ccd63e3 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:31.271095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96e1db3c-d604-47cd-a262-a1ed0ccd63e3 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:31.274317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96e1db3c-d604-47cd-a262-a1ed0ccd63e3 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:31.274925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96e1db3c-d604-47cd-a262-a1ed0ccd63e3 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:31.553292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9c663a3d-21cf-4f34-8738-3b56821e7569 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:31.566492 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9c663a3d-21cf-4f34-8738-3b56821e7569 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1689 microversion: 2.1 time: 0.512316 Oct 29 01:39:31.571208 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3196/6151] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:31 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1689 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:31.582624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9091420a-889a-4831-9823-c650f1299c2b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ae2738a-dbc4-4a7c-8525-f2d584530035"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:31.603465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9091420a-889a-4831-9823-c650f1299c2b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:31.612498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9091420a-889a-4831-9823-c650f1299c2b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:31.613260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9091420a-889a-4831-9823-c650f1299c2b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:31.614591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9091420a-889a-4831-9823-c650f1299c2b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:31.615796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9091420a-889a-4831-9823-c650f1299c2b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:31.616369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9091420a-889a-4831-9823-c650f1299c2b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:31.616925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9091420a-889a-4831-9823-c650f1299c2b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:31.647636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-96e1db3c-d604-47cd-a262-a1ed0ccd63e3 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:31.693498 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-96e1db3c-d604-47cd-a262-a1ed0ccd63e3 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 200 len: 1372 microversion: 2.1 time: 0.454638 Oct 29 01:39:31.703528 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2956/6152] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:31 2022] GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 1372 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:31.746651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0a65d350-a673-497e-8f49-fe0f49dc3ac0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:31.750346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0a65d350-a673-497e-8f49-fe0f49dc3ac0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:31.779597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a65d350-a673-497e-8f49-fe0f49dc3ac0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:31.783676 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a65d350-a673-497e-8f49-fe0f49dc3ac0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:31.787828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a65d350-a673-497e-8f49-fe0f49dc3ac0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:31.788611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a65d350-a673-497e-8f49-fe0f49dc3ac0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:31.789100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a65d350-a673-497e-8f49-fe0f49dc3ac0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:31.789932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a65d350-a673-497e-8f49-fe0f49dc3ac0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:31.930841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:39:32.077771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0a65d350-a673-497e-8f49-fe0f49dc3ac0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:32.115855 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0a65d350-a673-497e-8f49-fe0f49dc3ac0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1315 microversion: 2.1 time: 0.411032 Oct 29 01:39:32.130595 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2957/6153] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:31 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:32.592899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-73afeb69-9943-4c27-be5d-a9609facc678 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:32.593554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-73afeb69-9943-4c27-be5d-a9609facc678 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:32.600323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-73afeb69-9943-4c27-be5d-a9609facc678 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:32.600808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-73afeb69-9943-4c27-be5d-a9609facc678 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:32.601266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-73afeb69-9943-4c27-be5d-a9609facc678 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:32.601964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-73afeb69-9943-4c27-be5d-a9609facc678 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:32.602487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-73afeb69-9943-4c27-be5d-a9609facc678 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:32.602916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-73afeb69-9943-4c27-be5d-a9609facc678 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:32.749637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-73afeb69-9943-4c27-be5d-a9609facc678 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:32.757982 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-73afeb69-9943-4c27-be5d-a9609facc678 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1689 microversion: 2.1 time: 0.169068 Oct 29 01:39:32.758565 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2958/6154] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:32 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:39:32.763210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9a29c3f4-3774-4b7a-9e69-aa6597589248 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:32.763822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9a29c3f4-3774-4b7a-9e69-aa6597589248 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:32.776786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a29c3f4-3774-4b7a-9e69-aa6597589248 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:32.776939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a29c3f4-3774-4b7a-9e69-aa6597589248 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:32.777900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a29c3f4-3774-4b7a-9e69-aa6597589248 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:32.778313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a29c3f4-3774-4b7a-9e69-aa6597589248 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:32.778793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a29c3f4-3774-4b7a-9e69-aa6597589248 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:32.779235 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a29c3f4-3774-4b7a-9e69-aa6597589248 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:32.936995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9a29c3f4-3774-4b7a-9e69-aa6597589248 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:32.952678 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9a29c3f4-3774-4b7a-9e69-aa6597589248 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 200 len: 1372 microversion: 2.1 time: 0.189076 Oct 29 01:39:32.952678 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2959/6155] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:32 2022] GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:33.064686 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9091420a-889a-4831-9823-c650f1299c2b tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "POST /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.484947 Oct 29 01:39:33.065585 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3197/6156] 10.222.0.26 () {62 vars in 1364 bytes} [Sat Oct 29 01:39:31 2022] POST /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42/os-volume_attachments => generated 188 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:39:33.144561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-02467786-ac11-4e7a-a62f-78c050ce7353 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:33.145584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-02467786-ac11-4e7a-a62f-78c050ce7353 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:33.156835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=10 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:39:33.158791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02467786-ac11-4e7a-a62f-78c050ce7353 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:33.159746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02467786-ac11-4e7a-a62f-78c050ce7353 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:33.160195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02467786-ac11-4e7a-a62f-78c050ce7353 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:33.161670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02467786-ac11-4e7a-a62f-78c050ce7353 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:33.162144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02467786-ac11-4e7a-a62f-78c050ce7353 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:33.162607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-02467786-ac11-4e7a-a62f-78c050ce7353 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:33.239583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6d2498f1-a12b-4552-b981-1e55dd4106fe tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:33.240187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6d2498f1-a12b-4552-b981-1e55dd4106fe tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:33.247288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d2498f1-a12b-4552-b981-1e55dd4106fe tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:33.254012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d2498f1-a12b-4552-b981-1e55dd4106fe tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:33.254476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d2498f1-a12b-4552-b981-1e55dd4106fe tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:33.255356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d2498f1-a12b-4552-b981-1e55dd4106fe tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:33.255876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d2498f1-a12b-4552-b981-1e55dd4106fe tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:33.264588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d2498f1-a12b-4552-b981-1e55dd4106fe tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:33.412191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-02467786-ac11-4e7a-a62f-78c050ce7353 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:33.423609 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-02467786-ac11-4e7a-a62f-78c050ce7353 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1315 microversion: 2.1 time: 0.284305 Oct 29 01:39:33.424465 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2960/6157] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:33 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:33.783204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ae6199b5-0f98-4d63-96a6-67e82acf7900 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:33.783831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ae6199b5-0f98-4d63-96a6-67e82acf7900 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:33.790671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae6199b5-0f98-4d63-96a6-67e82acf7900 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:33.791160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae6199b5-0f98-4d63-96a6-67e82acf7900 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:33.791599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae6199b5-0f98-4d63-96a6-67e82acf7900 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:33.795422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae6199b5-0f98-4d63-96a6-67e82acf7900 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:33.796580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae6199b5-0f98-4d63-96a6-67e82acf7900 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:33.797044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae6199b5-0f98-4d63-96a6-67e82acf7900 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:33.800168 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:39:34.008179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ae6199b5-0f98-4d63-96a6-67e82acf7900 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:34.016348 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ae6199b5-0f98-4d63-96a6-67e82acf7900 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1689 microversion: 2.1 time: 0.238103 Oct 29 01:39:34.029821 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2961/6158] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:33 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1689 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:39:34.039283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-a1c835c8-b802-4692-911a-23dd3edde406 req-d53322dd-4373-4913-8cb8-e26fa8432db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5403c28-467f-4f5c-a8ff-2423a31e8728", "name": "network-vif-plugged", "status": "completed", "tag": "03564455-9258-48f6-a2d8-a48711e36f62"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:34.049437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a1c835c8-b802-4692-911a-23dd3edde406 req-d53322dd-4373-4913-8cb8-e26fa8432db3 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:34.050289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a1c835c8-b802-4692-911a-23dd3edde406 req-d53322dd-4373-4913-8cb8-e26fa8432db3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:34.051046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a1c835c8-b802-4692-911a-23dd3edde406 req-d53322dd-4373-4913-8cb8-e26fa8432db3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:34.051908 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6d2498f1-a12b-4552-b981-1e55dd4106fe tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "DELETE /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42/os-volume_attachments/7ae2738a-dbc4-4a7c-8525-f2d584530035" status: 202 len: 0 microversion: 2.20 time: 0.815734 Oct 29 01:39:34.054259 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3198/6159] 10.222.0.26 () {60 vars in 1457 bytes} [Sat Oct 29 01:39:33 2022] DELETE /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42/os-volume_attachments/7ae2738a-dbc4-4a7c-8525-f2d584530035 => generated 0 bytes in 820 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:39:34.059141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3acddbcd-5525-4ab5-9839-31fb491a20c8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:34.060048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3acddbcd-5525-4ab5-9839-31fb491a20c8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:34.066046 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-a1c835c8-b802-4692-911a-23dd3edde406 req-d53322dd-4373-4913-8cb8-e26fa8432db3 service nova] Creating event network-vif-plugged:03564455-9258-48f6-a2d8-a48711e36f62 for instance a5403c28-467f-4f5c-a8ff-2423a31e8728 on n-h1-862964-3 Oct 29 01:39:34.071707 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-a1c835c8-b802-4692-911a-23dd3edde406 req-d53322dd-4373-4913-8cb8-e26fa8432db3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040065 Oct 29 01:39:34.072323 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2962/6160] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:39:34.080677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3acddbcd-5525-4ab5-9839-31fb491a20c8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:34.081204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3acddbcd-5525-4ab5-9839-31fb491a20c8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:34.081657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3acddbcd-5525-4ab5-9839-31fb491a20c8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:34.082375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3acddbcd-5525-4ab5-9839-31fb491a20c8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:34.084308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3acddbcd-5525-4ab5-9839-31fb491a20c8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:34.084308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3acddbcd-5525-4ab5-9839-31fb491a20c8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:34.140378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ccd99e81-da37-4be2-81c4-fb377043ae12 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:34.142205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ccd99e81-da37-4be2-81c4-fb377043ae12 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:34.153580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ccd99e81-da37-4be2-81c4-fb377043ae12 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:34.154515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ccd99e81-da37-4be2-81c4-fb377043ae12 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:34.155190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ccd99e81-da37-4be2-81c4-fb377043ae12 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:34.156304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ccd99e81-da37-4be2-81c4-fb377043ae12 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:34.157292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ccd99e81-da37-4be2-81c4-fb377043ae12 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:34.158084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ccd99e81-da37-4be2-81c4-fb377043ae12 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:34.232347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=14 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:39:34.325636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ccd99e81-da37-4be2-81c4-fb377043ae12 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121100) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 01:39:34.411365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3acddbcd-5525-4ab5-9839-31fb491a20c8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:34.419124 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3acddbcd-5525-4ab5-9839-31fb491a20c8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 200 len: 1372 microversion: 2.1 time: 0.363760 Oct 29 01:39:34.419822 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3199/6161] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:34 2022] GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 1372 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:34.452206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1c7af1ad-887c-43f0-9e2e-c6b00e3ee4f7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:34.455259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1c7af1ad-887c-43f0-9e2e-c6b00e3ee4f7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:34.467338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c7af1ad-887c-43f0-9e2e-c6b00e3ee4f7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:34.469590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c7af1ad-887c-43f0-9e2e-c6b00e3ee4f7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:34.473570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c7af1ad-887c-43f0-9e2e-c6b00e3ee4f7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:34.477988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c7af1ad-887c-43f0-9e2e-c6b00e3ee4f7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:34.480309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c7af1ad-887c-43f0-9e2e-c6b00e3ee4f7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:34.485759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1c7af1ad-887c-43f0-9e2e-c6b00e3ee4f7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:34.795433 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ccd99e81-da37-4be2-81c4-fb377043ae12 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "POST /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42/action" status: 202 len: 0 microversion: 2.20 time: 0.661395 Oct 29 01:39:34.797763 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2963/6162] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 29 01:39:34 2022] POST /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42/action => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:39:34.812036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-383ffb49-fae5-49df-afda-583f80ba6ddc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:34.815151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-383ffb49-fae5-49df-afda-583f80ba6ddc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:34.824862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-383ffb49-fae5-49df-afda-583f80ba6ddc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:34.825806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-383ffb49-fae5-49df-afda-583f80ba6ddc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:34.826466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-383ffb49-fae5-49df-afda-583f80ba6ddc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:34.828120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-383ffb49-fae5-49df-afda-583f80ba6ddc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:34.828969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-383ffb49-fae5-49df-afda-583f80ba6ddc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:34.829621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-383ffb49-fae5-49df-afda-583f80ba6ddc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:34.837970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1c7af1ad-887c-43f0-9e2e-c6b00e3ee4f7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:34.848098 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1c7af1ad-887c-43f0-9e2e-c6b00e3ee4f7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1315 microversion: 2.1 time: 0.402140 Oct 29 01:39:34.865184 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3200/6163] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:34 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:35.044337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-99641a95-de93-498e-be8f-f27f311847d7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:35.044954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-99641a95-de93-498e-be8f-f27f311847d7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:35.067923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99641a95-de93-498e-be8f-f27f311847d7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:35.069881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99641a95-de93-498e-be8f-f27f311847d7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:35.071374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99641a95-de93-498e-be8f-f27f311847d7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:35.072882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99641a95-de93-498e-be8f-f27f311847d7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:35.075766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99641a95-de93-498e-be8f-f27f311847d7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:35.080537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99641a95-de93-498e-be8f-f27f311847d7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:35.633406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-383ffb49-fae5-49df-afda-583f80ba6ddc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:35.648417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-383ffb49-fae5-49df-afda-583f80ba6ddc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:35.650249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-383ffb49-fae5-49df-afda-583f80ba6ddc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:35.654584 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-383ffb49-fae5-49df-afda-583f80ba6ddc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1674 microversion: 2.20 time: 0.853553 Oct 29 01:39:35.656328 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2964/6164] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:34 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1674 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:39:35.663967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d2d12428-ebfa-4e5e-be93-77b88bb14ec7 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:35.669237 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d2d12428-ebfa-4e5e-be93-77b88bb14ec7 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:35.687227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2d12428-ebfa-4e5e-be93-77b88bb14ec7 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:35.687770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2d12428-ebfa-4e5e-be93-77b88bb14ec7 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:35.688219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2d12428-ebfa-4e5e-be93-77b88bb14ec7 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:35.688981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2d12428-ebfa-4e5e-be93-77b88bb14ec7 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:35.689688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2d12428-ebfa-4e5e-be93-77b88bb14ec7 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:35.691590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2d12428-ebfa-4e5e-be93-77b88bb14ec7 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:35.865723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-99641a95-de93-498e-be8f-f27f311847d7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:35.882107 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-99641a95-de93-498e-be8f-f27f311847d7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1689 microversion: 2.1 time: 0.841930 Oct 29 01:39:35.883226 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3201/6165] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:35 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1689 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:35.888093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-90af1bb3-db12-4b8e-9054-cff741931f8e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:35.898152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-90af1bb3-db12-4b8e-9054-cff741931f8e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:35.912862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90af1bb3-db12-4b8e-9054-cff741931f8e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:35.913642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90af1bb3-db12-4b8e-9054-cff741931f8e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:35.914282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90af1bb3-db12-4b8e-9054-cff741931f8e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:35.915010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90af1bb3-db12-4b8e-9054-cff741931f8e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:35.915475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90af1bb3-db12-4b8e-9054-cff741931f8e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:35.915910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-90af1bb3-db12-4b8e-9054-cff741931f8e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:36.419267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d2d12428-ebfa-4e5e-be93-77b88bb14ec7 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:36.428438 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d2d12428-ebfa-4e5e-be93-77b88bb14ec7 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 200 len: 1372 microversion: 2.1 time: 0.770818 Oct 29 01:39:36.435903 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2965/6166] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:35 2022] GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 1372 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:36.440369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-90af1bb3-db12-4b8e-9054-cff741931f8e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:36.450389 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-90af1bb3-db12-4b8e-9054-cff741931f8e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1315 microversion: 2.1 time: 0.565888 Oct 29 01:39:36.456290 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3202/6167] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:35 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:36.684859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0a3e57f2-b4ca-4df3-bb23-f282914e748f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:36.694995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0a3e57f2-b4ca-4df3-bb23-f282914e748f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:36.694995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a3e57f2-b4ca-4df3-bb23-f282914e748f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:36.694995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a3e57f2-b4ca-4df3-bb23-f282914e748f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:36.694995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a3e57f2-b4ca-4df3-bb23-f282914e748f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:36.695802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a3e57f2-b4ca-4df3-bb23-f282914e748f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:36.696465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a3e57f2-b4ca-4df3-bb23-f282914e748f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:36.697076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a3e57f2-b4ca-4df3-bb23-f282914e748f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:36.910660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f740498a-6b02-42f5-ab7c-47cf62cee05f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:36.910660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f740498a-6b02-42f5-ab7c-47cf62cee05f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:36.925738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f740498a-6b02-42f5-ab7c-47cf62cee05f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:36.932259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f740498a-6b02-42f5-ab7c-47cf62cee05f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:36.932259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f740498a-6b02-42f5-ab7c-47cf62cee05f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:36.932259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f740498a-6b02-42f5-ab7c-47cf62cee05f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:36.932259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f740498a-6b02-42f5-ab7c-47cf62cee05f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:36.932259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f740498a-6b02-42f5-ab7c-47cf62cee05f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:37.329252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0a3e57f2-b4ca-4df3-bb23-f282914e748f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:37.344774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0a3e57f2-b4ca-4df3-bb23-f282914e748f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:37.346340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0a3e57f2-b4ca-4df3-bb23-f282914e748f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:37.347823 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0a3e57f2-b4ca-4df3-bb23-f282914e748f tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1674 microversion: 2.20 time: 0.667790 Oct 29 01:39:37.366970 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2966/6168] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:36 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1674 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:37.372959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-d11eda2d-a58f-4dca-81a9-78508ef62ff9 req-47a162c2-daaa-4db0-8fd3-c1057a2546b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dbc4be2-8396-4d8f-9f31-7cf1423bf145", "name": "network-vif-plugged", "status": "completed", "tag": "25d49c2a-24b7-4c5a-8b70-8bb410658a2f"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:37.385575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d11eda2d-a58f-4dca-81a9-78508ef62ff9 req-47a162c2-daaa-4db0-8fd3-c1057a2546b4 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:37.387132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d11eda2d-a58f-4dca-81a9-78508ef62ff9 req-47a162c2-daaa-4db0-8fd3-c1057a2546b4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:37.387728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d11eda2d-a58f-4dca-81a9-78508ef62ff9 req-47a162c2-daaa-4db0-8fd3-c1057a2546b4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:37.408014 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-d11eda2d-a58f-4dca-81a9-78508ef62ff9 req-47a162c2-daaa-4db0-8fd3-c1057a2546b4 service nova] Creating event network-vif-plugged:25d49c2a-24b7-4c5a-8b70-8bb410658a2f for instance 4dbc4be2-8396-4d8f-9f31-7cf1423bf145 on n-h2-862964-3 Oct 29 01:39:37.418832 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-d11eda2d-a58f-4dca-81a9-78508ef62ff9 req-47a162c2-daaa-4db0-8fd3-c1057a2546b4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050055 Oct 29 01:39:37.419627 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2967/6169] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:39:37.456787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a685e494-81ac-4a12-9eb6-f7c3d3012049 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:37.457603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a685e494-81ac-4a12-9eb6-f7c3d3012049 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:37.464568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a685e494-81ac-4a12-9eb6-f7c3d3012049 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:37.465052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a685e494-81ac-4a12-9eb6-f7c3d3012049 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:37.465689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a685e494-81ac-4a12-9eb6-f7c3d3012049 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:37.466636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a685e494-81ac-4a12-9eb6-f7c3d3012049 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:37.467743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a685e494-81ac-4a12-9eb6-f7c3d3012049 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:37.469030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a685e494-81ac-4a12-9eb6-f7c3d3012049 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:37.775963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f740498a-6b02-42f5-ab7c-47cf62cee05f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:37.790364 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f740498a-6b02-42f5-ab7c-47cf62cee05f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1689 microversion: 2.1 time: 0.884789 Oct 29 01:39:37.792202 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3203/6170] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:36 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1689 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:37.797341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-48c7ed03-9573-486c-aa6b-3f30afa59c53 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:37.798366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-48c7ed03-9573-486c-aa6b-3f30afa59c53 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:37.806258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48c7ed03-9573-486c-aa6b-3f30afa59c53 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:37.807104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48c7ed03-9573-486c-aa6b-3f30afa59c53 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:37.807997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48c7ed03-9573-486c-aa6b-3f30afa59c53 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:37.808948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48c7ed03-9573-486c-aa6b-3f30afa59c53 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:37.809814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48c7ed03-9573-486c-aa6b-3f30afa59c53 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:37.810600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-48c7ed03-9573-486c-aa6b-3f30afa59c53 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:37.946231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a685e494-81ac-4a12-9eb6-f7c3d3012049 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:37.956668 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a685e494-81ac-4a12-9eb6-f7c3d3012049 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 200 len: 1372 microversion: 2.1 time: 0.506752 Oct 29 01:39:37.958118 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2968/6171] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:37 2022] GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 1372 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:39:38.382238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ec548443-5bb2-49f8-a318-d5913945040d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:38.382856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ec548443-5bb2-49f8-a318-d5913945040d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:38.389857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec548443-5bb2-49f8-a318-d5913945040d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:38.390624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec548443-5bb2-49f8-a318-d5913945040d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:38.391218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec548443-5bb2-49f8-a318-d5913945040d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:38.392176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec548443-5bb2-49f8-a318-d5913945040d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:38.392797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec548443-5bb2-49f8-a318-d5913945040d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:38.393544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ec548443-5bb2-49f8-a318-d5913945040d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:38.428106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-48c7ed03-9573-486c-aa6b-3f30afa59c53 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:38.438342 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-48c7ed03-9573-486c-aa6b-3f30afa59c53 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1503 microversion: 2.1 time: 0.644678 Oct 29 01:39:38.443398 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3204/6172] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:37 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1503 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:38.468715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bbc9e621-fe30-46cc-8899-0c654525ed26 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:38.471920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bbc9e621-fe30-46cc-8899-0c654525ed26 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:38.488009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbc9e621-fe30-46cc-8899-0c654525ed26 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:38.489140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbc9e621-fe30-46cc-8899-0c654525ed26 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:38.495053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbc9e621-fe30-46cc-8899-0c654525ed26 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:38.496189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbc9e621-fe30-46cc-8899-0c654525ed26 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:38.498048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbc9e621-fe30-46cc-8899-0c654525ed26 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:38.513398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbc9e621-fe30-46cc-8899-0c654525ed26 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:38.591699 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bbc9e621-fe30-46cc-8899-0c654525ed26 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728/action" status: 200 len: 14 microversion: 2.1 time: 0.125264 Oct 29 01:39:38.591699 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3205/6173] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:39:38 2022] POST /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:39:38.824029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0a68555c-e6fc-4196-a10f-07b241d24403 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:38.824747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0a68555c-e6fc-4196-a10f-07b241d24403 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:38.875647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a68555c-e6fc-4196-a10f-07b241d24403 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:38.887061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a68555c-e6fc-4196-a10f-07b241d24403 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:38.888140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a68555c-e6fc-4196-a10f-07b241d24403 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:38.890603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a68555c-e6fc-4196-a10f-07b241d24403 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:38.894362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a68555c-e6fc-4196-a10f-07b241d24403 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:38.898673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a68555c-e6fc-4196-a10f-07b241d24403 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:38.971541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ec548443-5bb2-49f8-a318-d5913945040d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:38.984215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ec548443-5bb2-49f8-a318-d5913945040d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:38.986969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ec548443-5bb2-49f8-a318-d5913945040d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:38.989340 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ec548443-5bb2-49f8-a318-d5913945040d tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 0.611136 Oct 29 01:39:39.005505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=9,nova_cell1:INSERT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:39:39.006412 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2969/6174] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:38 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:39.027616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-619e5b57-b900-424b-80ff-cafcb4f5b15d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:39.028717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-619e5b57-b900-424b-80ff-cafcb4f5b15d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:39.055383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-619e5b57-b900-424b-80ff-cafcb4f5b15d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:39.060304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-619e5b57-b900-424b-80ff-cafcb4f5b15d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:39.060891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-619e5b57-b900-424b-80ff-cafcb4f5b15d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:39.062798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-619e5b57-b900-424b-80ff-cafcb4f5b15d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:39.066623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-619e5b57-b900-424b-80ff-cafcb4f5b15d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:39.067426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-619e5b57-b900-424b-80ff-cafcb4f5b15d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:39.378549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0a68555c-e6fc-4196-a10f-07b241d24403 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:39.395351 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0a68555c-e6fc-4196-a10f-07b241d24403 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1689 microversion: 2.1 time: 0.575003 Oct 29 01:39:39.398888 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3206/6175] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:38 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1689 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:39.497852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-619e5b57-b900-424b-80ff-cafcb4f5b15d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:39.507906 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-619e5b57-b900-424b-80ff-cafcb4f5b15d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 200 len: 1372 microversion: 2.1 time: 0.500094 Oct 29 01:39:39.526078 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2970/6176] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:39 2022] GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 1372 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:39.603040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d40d2545-053c-43db-b9da-9e849e095eab tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:39.605784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d40d2545-053c-43db-b9da-9e849e095eab tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:39.619463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d40d2545-053c-43db-b9da-9e849e095eab tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:39.619960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d40d2545-053c-43db-b9da-9e849e095eab tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:39.620633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d40d2545-053c-43db-b9da-9e849e095eab tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:39.621384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d40d2545-053c-43db-b9da-9e849e095eab tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:39.621847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d40d2545-053c-43db-b9da-9e849e095eab tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:39.622279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d40d2545-053c-43db-b9da-9e849e095eab tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:39.700342 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d40d2545-053c-43db-b9da-9e849e095eab tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728/action" status: 200 len: 14 microversion: 2.1 time: 0.103034 Oct 29 01:39:39.701555 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3207/6177] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:39:39 2022] POST /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:39:40.027144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ccb29560-d254-44f5-9dd1-b58bb52709dc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:40.027763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ccb29560-d254-44f5-9dd1-b58bb52709dc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:40.035551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ccb29560-d254-44f5-9dd1-b58bb52709dc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:40.044706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ccb29560-d254-44f5-9dd1-b58bb52709dc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:40.045457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ccb29560-d254-44f5-9dd1-b58bb52709dc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:40.047369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ccb29560-d254-44f5-9dd1-b58bb52709dc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:40.049409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ccb29560-d254-44f5-9dd1-b58bb52709dc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:40.050064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ccb29560-d254-44f5-9dd1-b58bb52709dc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:40.241121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ccb29560-d254-44f5-9dd1-b58bb52709dc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:40.251611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ccb29560-d254-44f5-9dd1-b58bb52709dc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:40.253297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ccb29560-d254-44f5-9dd1-b58bb52709dc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:40.254587 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ccb29560-d254-44f5-9dd1-b58bb52709dc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 0.231759 Oct 29 01:39:40.255240 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2971/6178] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:40 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:40.428159 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ceb595e1-0a13-4b8f-a637-63ac77d10f07 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:40.428955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ceb595e1-0a13-4b8f-a637-63ac77d10f07 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:40.441909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ceb595e1-0a13-4b8f-a637-63ac77d10f07 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:40.442408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ceb595e1-0a13-4b8f-a637-63ac77d10f07 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:40.442909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ceb595e1-0a13-4b8f-a637-63ac77d10f07 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:40.444248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ceb595e1-0a13-4b8f-a637-63ac77d10f07 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:40.445043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ceb595e1-0a13-4b8f-a637-63ac77d10f07 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:40.445501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ceb595e1-0a13-4b8f-a637-63ac77d10f07 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:40.547196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dfa7b43e-6ece-4418-8f69-68a13e637345 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:40.549525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dfa7b43e-6ece-4418-8f69-68a13e637345 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:40.564011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dfa7b43e-6ece-4418-8f69-68a13e637345 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:40.564011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dfa7b43e-6ece-4418-8f69-68a13e637345 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:40.564011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dfa7b43e-6ece-4418-8f69-68a13e637345 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:40.567590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dfa7b43e-6ece-4418-8f69-68a13e637345 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:40.569091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dfa7b43e-6ece-4418-8f69-68a13e637345 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:40.571630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dfa7b43e-6ece-4418-8f69-68a13e637345 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:40.806694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ceb595e1-0a13-4b8f-a637-63ac77d10f07 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:40.823118 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ceb595e1-0a13-4b8f-a637-63ac77d10f07 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1694 microversion: 2.1 time: 0.402040 Oct 29 01:39:40.823961 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3208/6179] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:40 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1694 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:40.835928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-17763c82-6094-44c5-b8a4-30b82a8bc2c0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:40.845491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-17763c82-6094-44c5-b8a4-30b82a8bc2c0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:40.864717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17763c82-6094-44c5-b8a4-30b82a8bc2c0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:40.868886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17763c82-6094-44c5-b8a4-30b82a8bc2c0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:40.869576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17763c82-6094-44c5-b8a4-30b82a8bc2c0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:40.870502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17763c82-6094-44c5-b8a4-30b82a8bc2c0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:40.873085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17763c82-6094-44c5-b8a4-30b82a8bc2c0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:40.873976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17763c82-6094-44c5-b8a4-30b82a8bc2c0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:40.982872 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-17763c82-6094-44c5-b8a4-30b82a8bc2c0 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728/action" status: 200 len: 14 microversion: 2.1 time: 0.155709 Oct 29 01:39:40.987368 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3209/6180] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:39:40 2022] POST /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:39:41.288607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-11c0ae52-65b8-4d2a-a625-45c3e9c80b22 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:41.289373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-11c0ae52-65b8-4d2a-a625-45c3e9c80b22 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:41.330256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11c0ae52-65b8-4d2a-a625-45c3e9c80b22 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:41.330771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11c0ae52-65b8-4d2a-a625-45c3e9c80b22 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:41.331213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11c0ae52-65b8-4d2a-a625-45c3e9c80b22 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:41.331931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11c0ae52-65b8-4d2a-a625-45c3e9c80b22 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:41.334708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11c0ae52-65b8-4d2a-a625-45c3e9c80b22 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:41.341324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11c0ae52-65b8-4d2a-a625-45c3e9c80b22 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:41.350781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-dfa7b43e-6ece-4418-8f69-68a13e637345 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:41.361302 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dfa7b43e-6ece-4418-8f69-68a13e637345 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 200 len: 1544 microversion: 2.1 time: 0.823825 Oct 29 01:39:41.373202 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2972/6181] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:40 2022] GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 1544 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:41.387656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0b114bfb-434c-45d7-887d-9d2617697aa8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:41.388470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0b114bfb-434c-45d7-887d-9d2617697aa8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:41.396979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b114bfb-434c-45d7-887d-9d2617697aa8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:41.397914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b114bfb-434c-45d7-887d-9d2617697aa8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:41.399197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b114bfb-434c-45d7-887d-9d2617697aa8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:41.400789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b114bfb-434c-45d7-887d-9d2617697aa8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:41.401575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b114bfb-434c-45d7-887d-9d2617697aa8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:41.402190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b114bfb-434c-45d7-887d-9d2617697aa8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:41.708444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-11c0ae52-65b8-4d2a-a625-45c3e9c80b22 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:41.718044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-11c0ae52-65b8-4d2a-a625-45c3e9c80b22 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:41.733944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-11c0ae52-65b8-4d2a-a625-45c3e9c80b22 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:41.733944 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-11c0ae52-65b8-4d2a-a625-45c3e9c80b22 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 0.454493 Oct 29 01:39:41.733944 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3210/6182] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:41 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:41.789697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0b114bfb-434c-45d7-887d-9d2617697aa8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:41.803297 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0b114bfb-434c-45d7-887d-9d2617697aa8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 200 len: 1544 microversion: 2.1 time: 0.420922 Oct 29 01:39:41.805223 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2973/6183] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:41 2022] GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 1544 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:41.865059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dcf38e9f-aea3-4efa-9aab-9de122179971 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:41.866184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dcf38e9f-aea3-4efa-9aab-9de122179971 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:41.897213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcf38e9f-aea3-4efa-9aab-9de122179971 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:41.897706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcf38e9f-aea3-4efa-9aab-9de122179971 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:41.898143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcf38e9f-aea3-4efa-9aab-9de122179971 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:41.904907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcf38e9f-aea3-4efa-9aab-9de122179971 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:41.906358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcf38e9f-aea3-4efa-9aab-9de122179971 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:41.906978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcf38e9f-aea3-4efa-9aab-9de122179971 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:41.995326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c1575267-3ef3-439d-98cc-3b1159d8e9e9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:41.999342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c1575267-3ef3-439d-98cc-3b1159d8e9e9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:42.022759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1575267-3ef3-439d-98cc-3b1159d8e9e9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:42.025059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1575267-3ef3-439d-98cc-3b1159d8e9e9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:42.032228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1575267-3ef3-439d-98cc-3b1159d8e9e9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:42.034097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1575267-3ef3-439d-98cc-3b1159d8e9e9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:42.041040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1575267-3ef3-439d-98cc-3b1159d8e9e9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:42.041040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1575267-3ef3-439d-98cc-3b1159d8e9e9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:42.179740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-dcf38e9f-aea3-4efa-9aab-9de122179971 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:42.182880 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c1575267-3ef3-439d-98cc-3b1159d8e9e9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728/action" status: 200 len: 14 microversion: 2.1 time: 0.192204 Oct 29 01:39:42.185230 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2974/6184] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:39:41 2022] POST /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:39:42.189405 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dcf38e9f-aea3-4efa-9aab-9de122179971 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1694 microversion: 2.1 time: 0.334600 Oct 29 01:39:42.190732 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3211/6185] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:41 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1694 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:42.764657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-56b97c0d-77df-4af5-9d41-b480e4193f66 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:42.766200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-56b97c0d-77df-4af5-9d41-b480e4193f66 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:42.820222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56b97c0d-77df-4af5-9d41-b480e4193f66 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:42.821219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56b97c0d-77df-4af5-9d41-b480e4193f66 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:42.822541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56b97c0d-77df-4af5-9d41-b480e4193f66 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:42.824247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56b97c0d-77df-4af5-9d41-b480e4193f66 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:42.824999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56b97c0d-77df-4af5-9d41-b480e4193f66 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:42.825706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-56b97c0d-77df-4af5-9d41-b480e4193f66 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:43.198031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9cac08a7-6fc6-4393-8ff8-deaa6a6e8c58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:43.205437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9cac08a7-6fc6-4393-8ff8-deaa6a6e8c58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:43.207929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-56b97c0d-77df-4af5-9d41-b480e4193f66 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:43.224663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-56b97c0d-77df-4af5-9d41-b480e4193f66 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:43.230363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-56b97c0d-77df-4af5-9d41-b480e4193f66 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:43.234211 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-56b97c0d-77df-4af5-9d41-b480e4193f66 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 0.475018 Oct 29 01:39:43.240353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cac08a7-6fc6-4393-8ff8-deaa6a6e8c58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:43.240859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cac08a7-6fc6-4393-8ff8-deaa6a6e8c58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:43.241339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cac08a7-6fc6-4393-8ff8-deaa6a6e8c58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:43.241566 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2975/6186] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:42 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:43.242056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cac08a7-6fc6-4393-8ff8-deaa6a6e8c58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:43.242509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cac08a7-6fc6-4393-8ff8-deaa6a6e8c58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:43.253756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9cac08a7-6fc6-4393-8ff8-deaa6a6e8c58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:43.260782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1dd665b1-ccf9-49fe-9258-34d696bd0d99 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:43.261823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1dd665b1-ccf9-49fe-9258-34d696bd0d99 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:43.270651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1dd665b1-ccf9-49fe-9258-34d696bd0d99 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:43.282032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1dd665b1-ccf9-49fe-9258-34d696bd0d99 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:43.284102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1dd665b1-ccf9-49fe-9258-34d696bd0d99 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:43.285339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1dd665b1-ccf9-49fe-9258-34d696bd0d99 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:43.286031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1dd665b1-ccf9-49fe-9258-34d696bd0d99 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:43.286622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1dd665b1-ccf9-49fe-9258-34d696bd0d99 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:43.349687 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9cac08a7-6fc6-4393-8ff8-deaa6a6e8c58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728/action" status: 200 len: 14 microversion: 2.1 time: 0.158542 Oct 29 01:39:43.354144 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3212/6187] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:39:43 2022] POST /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:39:43.628126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1dd665b1-ccf9-49fe-9258-34d696bd0d99 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:43.638849 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1dd665b1-ccf9-49fe-9258-34d696bd0d99 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1694 microversion: 2.1 time: 0.394264 Oct 29 01:39:43.640037 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2976/6188] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:43 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1694 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:44.266244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6587136a-606d-4834-964d-d7f818aa33c5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:44.267600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6587136a-606d-4834-964d-d7f818aa33c5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:44.298108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6587136a-606d-4834-964d-d7f818aa33c5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:44.299739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6587136a-606d-4834-964d-d7f818aa33c5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:44.301718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6587136a-606d-4834-964d-d7f818aa33c5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:44.302625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6587136a-606d-4834-964d-d7f818aa33c5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:44.303756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6587136a-606d-4834-964d-d7f818aa33c5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:44.304350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6587136a-606d-4834-964d-d7f818aa33c5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:44.362983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-df210e55-2cd6-49d8-84c9-f68ffaf04811 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:44.370182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-df210e55-2cd6-49d8-84c9-f68ffaf04811 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:44.388577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df210e55-2cd6-49d8-84c9-f68ffaf04811 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:44.393985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df210e55-2cd6-49d8-84c9-f68ffaf04811 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:44.422153 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df210e55-2cd6-49d8-84c9-f68ffaf04811 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:44.423320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df210e55-2cd6-49d8-84c9-f68ffaf04811 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:44.424073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df210e55-2cd6-49d8-84c9-f68ffaf04811 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:44.425043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df210e55-2cd6-49d8-84c9-f68ffaf04811 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:44.510718 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-df210e55-2cd6-49d8-84c9-f68ffaf04811 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728/action" status: 200 len: 14 microversion: 2.1 time: 0.153313 Oct 29 01:39:44.541949 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2977/6189] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:39:44 2022] POST /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:39:44.670258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8a1d7a82-c461-4d9a-81e5-068e7b2c7fb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:44.671930 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8a1d7a82-c461-4d9a-81e5-068e7b2c7fb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:44.706277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a1d7a82-c461-4d9a-81e5-068e7b2c7fb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:44.707950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a1d7a82-c461-4d9a-81e5-068e7b2c7fb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:44.713296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a1d7a82-c461-4d9a-81e5-068e7b2c7fb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:44.715329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a1d7a82-c461-4d9a-81e5-068e7b2c7fb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:44.715957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a1d7a82-c461-4d9a-81e5-068e7b2c7fb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:44.716543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a1d7a82-c461-4d9a-81e5-068e7b2c7fb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:44.747015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6587136a-606d-4834-964d-d7f818aa33c5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:44.805937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6587136a-606d-4834-964d-d7f818aa33c5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:44.807919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6587136a-606d-4834-964d-d7f818aa33c5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:44.809542 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6587136a-606d-4834-964d-d7f818aa33c5 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 0.549273 Oct 29 01:39:44.815774 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3213/6190] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:44 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:45.416370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8a1d7a82-c461-4d9a-81e5-068e7b2c7fb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:45.426171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:39:45.444520 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8a1d7a82-c461-4d9a-81e5-068e7b2c7fb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1694 microversion: 2.1 time: 0.779748 Oct 29 01:39:45.448368 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2978/6191] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:44 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1694 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:45.555562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-afa11940-693c-401f-8c9f-5d471abb33d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:45.559429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-afa11940-693c-401f-8c9f-5d471abb33d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:45.581212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afa11940-693c-401f-8c9f-5d471abb33d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:45.586718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afa11940-693c-401f-8c9f-5d471abb33d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:45.591091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afa11940-693c-401f-8c9f-5d471abb33d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:45.592142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afa11940-693c-401f-8c9f-5d471abb33d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:45.594000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afa11940-693c-401f-8c9f-5d471abb33d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:45.595840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afa11940-693c-401f-8c9f-5d471abb33d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:45.685141 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-afa11940-693c-401f-8c9f-5d471abb33d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728/action" status: 200 len: 14 microversion: 2.1 time: 0.134393 Oct 29 01:39:45.691110 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3214/6192] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:39:45 2022] POST /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:39:45.845750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2cab59cf-0d13-4b03-8e66-d58c7ecf1036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:45.846566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2cab59cf-0d13-4b03-8e66-d58c7ecf1036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:45.866446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cab59cf-0d13-4b03-8e66-d58c7ecf1036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:45.878012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cab59cf-0d13-4b03-8e66-d58c7ecf1036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:45.878835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cab59cf-0d13-4b03-8e66-d58c7ecf1036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:45.882050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cab59cf-0d13-4b03-8e66-d58c7ecf1036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:45.882702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cab59cf-0d13-4b03-8e66-d58c7ecf1036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:45.890490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2cab59cf-0d13-4b03-8e66-d58c7ecf1036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:46.474637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3607c70f-1297-41d0-8d8f-0ad642b82286 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:46.475515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3607c70f-1297-41d0-8d8f-0ad642b82286 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:46.493237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3607c70f-1297-41d0-8d8f-0ad642b82286 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:46.494334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3607c70f-1297-41d0-8d8f-0ad642b82286 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:46.494334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3607c70f-1297-41d0-8d8f-0ad642b82286 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:46.495104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3607c70f-1297-41d0-8d8f-0ad642b82286 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:46.495577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3607c70f-1297-41d0-8d8f-0ad642b82286 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:46.496012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3607c70f-1297-41d0-8d8f-0ad642b82286 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:46.523120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2cab59cf-0d13-4b03-8e66-d58c7ecf1036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:46.533374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2cab59cf-0d13-4b03-8e66-d58c7ecf1036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:46.539837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2cab59cf-0d13-4b03-8e66-d58c7ecf1036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:46.543200 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2cab59cf-0d13-4b03-8e66-d58c7ecf1036 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 0.704227 Oct 29 01:39:46.549638 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2979/6193] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:45 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:46.698556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6d3dda59-c7a8-4045-9fd0-47a7305a3bf7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:46.701041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6d3dda59-c7a8-4045-9fd0-47a7305a3bf7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:46.717068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d3dda59-c7a8-4045-9fd0-47a7305a3bf7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:46.717943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d3dda59-c7a8-4045-9fd0-47a7305a3bf7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:46.718764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d3dda59-c7a8-4045-9fd0-47a7305a3bf7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:46.719690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d3dda59-c7a8-4045-9fd0-47a7305a3bf7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:46.719934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d3dda59-c7a8-4045-9fd0-47a7305a3bf7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:46.720358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d3dda59-c7a8-4045-9fd0-47a7305a3bf7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:46.827323 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6d3dda59-c7a8-4045-9fd0-47a7305a3bf7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728/action" status: 200 len: 14 microversion: 2.1 time: 0.131978 Oct 29 01:39:46.828226 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2980/6194] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:39:46 2022] POST /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:39:47.086232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3607c70f-1297-41d0-8d8f-0ad642b82286 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:47.105493 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3607c70f-1297-41d0-8d8f-0ad642b82286 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1694 microversion: 2.1 time: 0.634874 Oct 29 01:39:47.106104 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3215/6195] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:46 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1694 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:39:47.578221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2b1984d9-b6a3-4f0d-be0a-c6755253dd54 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:47.579055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2b1984d9-b6a3-4f0d-be0a-c6755253dd54 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:47.599014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b1984d9-b6a3-4f0d-be0a-c6755253dd54 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:47.601047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b1984d9-b6a3-4f0d-be0a-c6755253dd54 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:47.601527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b1984d9-b6a3-4f0d-be0a-c6755253dd54 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:47.603373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b1984d9-b6a3-4f0d-be0a-c6755253dd54 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:47.606059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b1984d9-b6a3-4f0d-be0a-c6755253dd54 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:47.606917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b1984d9-b6a3-4f0d-be0a-c6755253dd54 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:47.653427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4634729e-434b-4a52-bbc3-2feb0f5ab840 req-479e630e-913d-4085-993f-c82e605381ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dbc4be2-8396-4d8f-9f31-7cf1423bf145", "tag": "25d49c2a-24b7-4c5a-8b70-8bb410658a2f"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:47.703670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4634729e-434b-4a52-bbc3-2feb0f5ab840 req-479e630e-913d-4085-993f-c82e605381ea service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:47.704160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4634729e-434b-4a52-bbc3-2feb0f5ab840 req-479e630e-913d-4085-993f-c82e605381ea service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:47.704602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4634729e-434b-4a52-bbc3-2feb0f5ab840 req-479e630e-913d-4085-993f-c82e605381ea service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:47.761526 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4634729e-434b-4a52-bbc3-2feb0f5ab840 req-479e630e-913d-4085-993f-c82e605381ea service nova] Creating event network-changed:25d49c2a-24b7-4c5a-8b70-8bb410658a2f for instance 4dbc4be2-8396-4d8f-9f31-7cf1423bf145 on n-h2-862964-3 Oct 29 01:39:47.774364 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4634729e-434b-4a52-bbc3-2feb0f5ab840 req-479e630e-913d-4085-993f-c82e605381ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125246 Oct 29 01:39:47.778335 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3216/6196] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:39:47.842254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-04d7211e-fa06-43a1-af02-2df3cc1f7937 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:47.848447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-04d7211e-fa06-43a1-af02-2df3cc1f7937 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:47.873032 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04d7211e-fa06-43a1-af02-2df3cc1f7937 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:47.876180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04d7211e-fa06-43a1-af02-2df3cc1f7937 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:47.876791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04d7211e-fa06-43a1-af02-2df3cc1f7937 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:47.879552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04d7211e-fa06-43a1-af02-2df3cc1f7937 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:47.880196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04d7211e-fa06-43a1-af02-2df3cc1f7937 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:47.880873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-04d7211e-fa06-43a1-af02-2df3cc1f7937 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:47.951565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2b1984d9-b6a3-4f0d-be0a-c6755253dd54 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:47.968283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2b1984d9-b6a3-4f0d-be0a-c6755253dd54 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:47.972891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2b1984d9-b6a3-4f0d-be0a-c6755253dd54 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:47.977278 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2b1984d9-b6a3-4f0d-be0a-c6755253dd54 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 0.403579 Oct 29 01:39:47.978779 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2981/6197] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:47 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:48.021566 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-04d7211e-fa06-43a1-af02-2df3cc1f7937 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728/action" status: 200 len: 8208 microversion: 2.1 time: 0.185466 Oct 29 01:39:48.026872 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3217/6198] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:39:47 2022] POST /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728/action => generated 8208 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:48.033418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-57f14dc2-3d8a-4ea8-b4c2-e0c2350ec349 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:48.034139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-57f14dc2-3d8a-4ea8-b4c2-e0c2350ec349 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:48.052806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57f14dc2-3d8a-4ea8-b4c2-e0c2350ec349 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:48.053330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57f14dc2-3d8a-4ea8-b4c2-e0c2350ec349 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:48.053765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57f14dc2-3d8a-4ea8-b4c2-e0c2350ec349 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:48.064981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57f14dc2-3d8a-4ea8-b4c2-e0c2350ec349 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:48.065518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57f14dc2-3d8a-4ea8-b4c2-e0c2350ec349 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:48.065972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-57f14dc2-3d8a-4ea8-b4c2-e0c2350ec349 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:48.135502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-985d5f21-df48-4f17-9016-435eba5bc02e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:48.136979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-985d5f21-df48-4f17-9016-435eba5bc02e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:48.155972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-985d5f21-df48-4f17-9016-435eba5bc02e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:48.158560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-985d5f21-df48-4f17-9016-435eba5bc02e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:48.160384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-985d5f21-df48-4f17-9016-435eba5bc02e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:48.163247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-985d5f21-df48-4f17-9016-435eba5bc02e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:48.165875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-985d5f21-df48-4f17-9016-435eba5bc02e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:48.167087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-985d5f21-df48-4f17-9016-435eba5bc02e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:48.667456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-57f14dc2-3d8a-4ea8-b4c2-e0c2350ec349 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:48.681229 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-57f14dc2-3d8a-4ea8-b4c2-e0c2350ec349 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.651743 Oct 29 01:39:48.696912 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2982/6199] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:48 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:48.730071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a297ea0a-6016-4a0b-be44-09f30715c673 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:48.730692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a297ea0a-6016-4a0b-be44-09f30715c673 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:48.775142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a297ea0a-6016-4a0b-be44-09f30715c673 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:48.782148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a297ea0a-6016-4a0b-be44-09f30715c673 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:48.782627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a297ea0a-6016-4a0b-be44-09f30715c673 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:48.783422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a297ea0a-6016-4a0b-be44-09f30715c673 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:48.788479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a297ea0a-6016-4a0b-be44-09f30715c673 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:48.789001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a297ea0a-6016-4a0b-be44-09f30715c673 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:49.177264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-985d5f21-df48-4f17-9016-435eba5bc02e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:49.191562 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-985d5f21-df48-4f17-9016-435eba5bc02e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1694 microversion: 2.1 time: 1.060656 Oct 29 01:39:49.193191 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3218/6200] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:48 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1694 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:39:49.211734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a7ec4f2a-5eaf-4e81-9f08-3abf77733f6c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:49.221335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a7ec4f2a-5eaf-4e81-9f08-3abf77733f6c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:49.247367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7ec4f2a-5eaf-4e81-9f08-3abf77733f6c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:49.250751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7ec4f2a-5eaf-4e81-9f08-3abf77733f6c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:49.254133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7ec4f2a-5eaf-4e81-9f08-3abf77733f6c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:49.255103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7ec4f2a-5eaf-4e81-9f08-3abf77733f6c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:49.261099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7ec4f2a-5eaf-4e81-9f08-3abf77733f6c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:49.266642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a7ec4f2a-5eaf-4e81-9f08-3abf77733f6c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:49.828269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a297ea0a-6016-4a0b-be44-09f30715c673 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:49.844905 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a297ea0a-6016-4a0b-be44-09f30715c673 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 1.123928 Oct 29 01:39:49.848376 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2983/6201] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:48 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:49.866886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a7ec4f2a-5eaf-4e81-9f08-3abf77733f6c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:49.883757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-112289be-6265-4fdb-8fd8-bccc4572d67a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:49.884683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-112289be-6265-4fdb-8fd8-bccc4572d67a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:49.896444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a7ec4f2a-5eaf-4e81-9f08-3abf77733f6c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:49.914274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a7ec4f2a-5eaf-4e81-9f08-3abf77733f6c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:49.914274 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a7ec4f2a-5eaf-4e81-9f08-3abf77733f6c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 0.709695 Oct 29 01:39:49.917472 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3219/6202] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:49 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:49.937673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-112289be-6265-4fdb-8fd8-bccc4572d67a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:49.938470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-112289be-6265-4fdb-8fd8-bccc4572d67a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:49.942682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-112289be-6265-4fdb-8fd8-bccc4572d67a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:49.943777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-112289be-6265-4fdb-8fd8-bccc4572d67a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:49.944488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-112289be-6265-4fdb-8fd8-bccc4572d67a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:49.945903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-112289be-6265-4fdb-8fd8-bccc4572d67a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:50.220617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7011849e-64c2-4055-b917-de1bf672c6c3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:50.221931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7011849e-64c2-4055-b917-de1bf672c6c3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:50.237353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7011849e-64c2-4055-b917-de1bf672c6c3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:50.238174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7011849e-64c2-4055-b917-de1bf672c6c3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:50.241275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7011849e-64c2-4055-b917-de1bf672c6c3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:50.242248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7011849e-64c2-4055-b917-de1bf672c6c3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:50.242917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7011849e-64c2-4055-b917-de1bf672c6c3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:50.243577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7011849e-64c2-4055-b917-de1bf672c6c3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:51.390147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-112289be-6265-4fdb-8fd8-bccc4572d67a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:51.409338 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-112289be-6265-4fdb-8fd8-bccc4572d67a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 1.529561 Oct 29 01:39:51.409338 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2984/6203] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:49 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:51.425781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f6a7ef39-c8bb-4bef-b8d2-e58b39bfc185 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:51.426897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f6a7ef39-c8bb-4bef-b8d2-e58b39bfc185 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:51.440314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a7ef39-c8bb-4bef-b8d2-e58b39bfc185 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:51.442103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a7ef39-c8bb-4bef-b8d2-e58b39bfc185 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:51.443468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a7ef39-c8bb-4bef-b8d2-e58b39bfc185 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:51.445900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a7ef39-c8bb-4bef-b8d2-e58b39bfc185 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:51.447260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a7ef39-c8bb-4bef-b8d2-e58b39bfc185 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:51.448129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a7ef39-c8bb-4bef-b8d2-e58b39bfc185 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:51.557560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7011849e-64c2-4055-b917-de1bf672c6c3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:51.568891 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7011849e-64c2-4055-b917-de1bf672c6c3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1694 microversion: 2.1 time: 1.352878 Oct 29 01:39:51.591475 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3220/6204] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:50 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1694 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:51.604086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-42da1eb9-1c45-4b04-a40a-9f0e73cbc245 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:51.604709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-42da1eb9-1c45-4b04-a40a-9f0e73cbc245 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:51.615402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42da1eb9-1c45-4b04-a40a-9f0e73cbc245 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:51.621688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42da1eb9-1c45-4b04-a40a-9f0e73cbc245 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:51.622666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42da1eb9-1c45-4b04-a40a-9f0e73cbc245 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:51.624313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42da1eb9-1c45-4b04-a40a-9f0e73cbc245 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:51.628640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42da1eb9-1c45-4b04-a40a-9f0e73cbc245 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:51.630799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42da1eb9-1c45-4b04-a40a-9f0e73cbc245 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:52.003667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f6a7ef39-c8bb-4bef-b8d2-e58b39bfc185 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:52.013898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f6a7ef39-c8bb-4bef-b8d2-e58b39bfc185 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:52.016275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f6a7ef39-c8bb-4bef-b8d2-e58b39bfc185 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:52.017900 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f6a7ef39-c8bb-4bef-b8d2-e58b39bfc185 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 0.607472 Oct 29 01:39:52.019333 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2985/6205] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:51 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:52.451570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-42da1eb9-1c45-4b04-a40a-9f0e73cbc245 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:52.484354 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-42da1eb9-1c45-4b04-a40a-9f0e73cbc245 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.886932 Oct 29 01:39:52.490492 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3221/6206] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:51 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:52.518342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f1d3648d-4516-424c-b7b2-7d26800b3e6b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:52.519593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f1d3648d-4516-424c-b7b2-7d26800b3e6b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:52.526611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:39:52.528355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1d3648d-4516-424c-b7b2-7d26800b3e6b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:52.528936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1d3648d-4516-424c-b7b2-7d26800b3e6b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:52.531466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1d3648d-4516-424c-b7b2-7d26800b3e6b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:52.531466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1d3648d-4516-424c-b7b2-7d26800b3e6b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:52.531466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1d3648d-4516-424c-b7b2-7d26800b3e6b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:52.531466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f1d3648d-4516-424c-b7b2-7d26800b3e6b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:52.606456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-72bd4948-e35f-4ecd-b51c-125cd473f4fa tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:52.607065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-72bd4948-e35f-4ecd-b51c-125cd473f4fa tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:52.628741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72bd4948-e35f-4ecd-b51c-125cd473f4fa tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:52.629441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72bd4948-e35f-4ecd-b51c-125cd473f4fa tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:52.638367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72bd4948-e35f-4ecd-b51c-125cd473f4fa tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:52.638367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72bd4948-e35f-4ecd-b51c-125cd473f4fa tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:52.638367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72bd4948-e35f-4ecd-b51c-125cd473f4fa tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:52.638367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72bd4948-e35f-4ecd-b51c-125cd473f4fa tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:53.094965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-72bd4948-e35f-4ecd-b51c-125cd473f4fa tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:53.106920 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-72bd4948-e35f-4ecd-b51c-125cd473f4fa tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1694 microversion: 2.1 time: 0.505004 Oct 29 01:39:53.110488 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3222/6207] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:52 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1694 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:39:53.117060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9820038f-8a13-4b2b-82fd-5690b22ec868 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:53.118026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9820038f-8a13-4b2b-82fd-5690b22ec868 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:53.134304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9820038f-8a13-4b2b-82fd-5690b22ec868 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:53.136494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9820038f-8a13-4b2b-82fd-5690b22ec868 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:53.138619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9820038f-8a13-4b2b-82fd-5690b22ec868 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:53.140059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9820038f-8a13-4b2b-82fd-5690b22ec868 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:53.142147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9820038f-8a13-4b2b-82fd-5690b22ec868 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:53.143570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9820038f-8a13-4b2b-82fd-5690b22ec868 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:53.177009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f1d3648d-4516-424c-b7b2-7d26800b3e6b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Locking {{(pid=121100) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 29 01:39:53.433028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9820038f-8a13-4b2b-82fd-5690b22ec868 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:53.444039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9820038f-8a13-4b2b-82fd-5690b22ec868 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:53.445941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9820038f-8a13-4b2b-82fd-5690b22ec868 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:53.447507 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9820038f-8a13-4b2b-82fd-5690b22ec868 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 0.334595 Oct 29 01:39:53.448649 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3223/6208] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:53 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:53.480667 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f1d3648d-4516-424c-b7b2-7d26800b3e6b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.968847 Oct 29 01:39:53.481843 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2986/6209] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:39:52 2022] POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action => generated 0 bytes in 971 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:39:53.492542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cf247987-da94-4e62-ac82-751beb0759e7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:53.493184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cf247987-da94-4e62-ac82-751beb0759e7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:53.511436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf247987-da94-4e62-ac82-751beb0759e7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:53.523970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf247987-da94-4e62-ac82-751beb0759e7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:53.523970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf247987-da94-4e62-ac82-751beb0759e7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:53.523970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf247987-da94-4e62-ac82-751beb0759e7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:53.523970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf247987-da94-4e62-ac82-751beb0759e7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:53.523970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cf247987-da94-4e62-ac82-751beb0759e7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:53.881023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cf247987-da94-4e62-ac82-751beb0759e7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:53.898749 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cf247987-da94-4e62-ac82-751beb0759e7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.412314 Oct 29 01:39:53.905943 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3224/6210] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:53 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:53.932084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-87fadadf-f9a6-4834-81bc-b9ee46418f7e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:53.946922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87fadadf-f9a6-4834-81bc-b9ee46418f7e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:53.947851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87fadadf-f9a6-4834-81bc-b9ee46418f7e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:53.949527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87fadadf-f9a6-4834-81bc-b9ee46418f7e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:53.985356 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-87fadadf-f9a6-4834-81bc-b9ee46418f7e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] HTTP exception thrown: Instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a is locked Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-87fadadf-f9a6-4834-81bc-b9ee46418f7e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Request method failure captured: Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action HTTP/1.1 Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 15 Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIL7S5xF4168RL6JoFuUbcH6-3DDmyiCJ6R7rm4bgk2fiKECHpPWIxe8Sb6KFLzfaouBeUBjfCfEFAi0SDZDaQE_pKK3AEydGMSkKrcyZ-fr5rCFaKW-2JEPVH3EUDBGDA-y9zSVdN55YxOgNS3JW2ZCCkwPgvfmgUCIRXp7mDkobAQ Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 238c2e0d9e0b48198767a357cff1a442 Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerActionsTestJSON-45025787 Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/238c2e0d9e0b48198767a357cff1a442"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/238c2e0d9e0b48198767a357cff1a442"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/238c2e0d9e0b48198767a357cff1a442"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_238c2e0d9e0b48198767a357cff1a442", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerActionsTestJSON-45025787 Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 238c2e0d9e0b48198767a357cff1a442 Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerActionsTestJSON-45025787 Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerActionsTestJSON-45025787-project Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 9c097ba205f6453ba793dfb1d1876f3e Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerActionsTestJSON-45025787-project Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: {"os-stop": {}} Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a is locked Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a', 'body': {'os-stop': {}}} Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a is locked Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a is locked Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a is locked Oct 29 01:39:54.010132 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:39:54.017667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-87fadadf-f9a6-4834-81bc-b9ee46418f7e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Returning 409 to user: Instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a is locked {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:39:54.017667 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-87fadadf-f9a6-4834-81bc-b9ee46418f7e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action" status: 409 len: 107 microversion: 2.1 time: 0.085218 Oct 29 01:39:54.017667 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2987/6211] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:39:53 2022] POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action => generated 107 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:39:54.025778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f4ebf9c7-cd1e-41a9-b6ee-a5e6058622aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:54.026467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f4ebf9c7-cd1e-41a9-b6ee-a5e6058622aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:54.037407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4ebf9c7-cd1e-41a9-b6ee-a5e6058622aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:54.037911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4ebf9c7-cd1e-41a9-b6ee-a5e6058622aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:54.039309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4ebf9c7-cd1e-41a9-b6ee-a5e6058622aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:54.040025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4ebf9c7-cd1e-41a9-b6ee-a5e6058622aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:54.040496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4ebf9c7-cd1e-41a9-b6ee-a5e6058622aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:54.048021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4ebf9c7-cd1e-41a9-b6ee-a5e6058622aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:54.081248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:39:54.140112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-869eb83f-6511-41b4-9b44-7b72b3a3ed47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:54.141172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-869eb83f-6511-41b4-9b44-7b72b3a3ed47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:54.162466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-869eb83f-6511-41b4-9b44-7b72b3a3ed47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:54.196471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-869eb83f-6511-41b4-9b44-7b72b3a3ed47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:54.196471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-869eb83f-6511-41b4-9b44-7b72b3a3ed47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:54.196471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-869eb83f-6511-41b4-9b44-7b72b3a3ed47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:54.196471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-869eb83f-6511-41b4-9b44-7b72b3a3ed47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:54.196471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-869eb83f-6511-41b4-9b44-7b72b3a3ed47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:54.240889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f4ebf9c7-cd1e-41a9-b6ee-a5e6058622aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Unlocking {{(pid=121099) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 29 01:39:54.543094 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f4ebf9c7-cd1e-41a9-b6ee-a5e6058622aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.522824 Oct 29 01:39:54.544499 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3225/6212] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:39:54 2022] POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:39:54.550633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-23985cdc-332a-403c-8591-759f5ddd840c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:54.555988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-23985cdc-332a-403c-8591-759f5ddd840c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:54.575418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23985cdc-332a-403c-8591-759f5ddd840c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:54.576468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23985cdc-332a-403c-8591-759f5ddd840c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:54.579695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23985cdc-332a-403c-8591-759f5ddd840c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:54.580715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23985cdc-332a-403c-8591-759f5ddd840c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:54.583818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23985cdc-332a-403c-8591-759f5ddd840c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:54.584703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-23985cdc-332a-403c-8591-759f5ddd840c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:54.607341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-869eb83f-6511-41b4-9b44-7b72b3a3ed47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:54.618088 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-869eb83f-6511-41b4-9b44-7b72b3a3ed47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1694 microversion: 2.1 time: 0.483133 Oct 29 01:39:54.625207 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2988/6213] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:54 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1694 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:54.632552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8eb2d32f-6516-4f20-80aa-975bc0c08573 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:54.651167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8eb2d32f-6516-4f20-80aa-975bc0c08573 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:54.653647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8eb2d32f-6516-4f20-80aa-975bc0c08573 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:54.656336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8eb2d32f-6516-4f20-80aa-975bc0c08573 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:54.694751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8eb2d32f-6516-4f20-80aa-975bc0c08573 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Going to try to stop instance {{(pid=121100) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 01:39:54.910212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-23985cdc-332a-403c-8591-759f5ddd840c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:54.921289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-23985cdc-332a-403c-8591-759f5ddd840c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:54.923254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-23985cdc-332a-403c-8591-759f5ddd840c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:54.924712 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-23985cdc-332a-403c-8591-759f5ddd840c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 0.378831 Oct 29 01:39:54.952669 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3226/6214] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:54 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:54.999840 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8eb2d32f-6516-4f20-80aa-975bc0c08573 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.371840 Oct 29 01:39:55.005705 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2989/6215] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:39:54 2022] POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:39:55.023750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c67e8218-f479-4d6d-a1ad-16463392ba9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:55.023750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c67e8218-f479-4d6d-a1ad-16463392ba9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:55.044194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c67e8218-f479-4d6d-a1ad-16463392ba9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:55.044810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c67e8218-f479-4d6d-a1ad-16463392ba9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:55.045306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c67e8218-f479-4d6d-a1ad-16463392ba9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:55.048386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c67e8218-f479-4d6d-a1ad-16463392ba9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:55.049672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c67e8218-f479-4d6d-a1ad-16463392ba9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:55.052989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c67e8218-f479-4d6d-a1ad-16463392ba9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:55.475376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c67e8218-f479-4d6d-a1ad-16463392ba9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:55.488640 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c67e8218-f479-4d6d-a1ad-16463392ba9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1680 microversion: 2.1 time: 0.480007 Oct 29 01:39:55.522268 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3227/6216] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:55 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1680 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:55.653078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e3304017-1d11-49f3-becd-f9905064f59e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:55.654387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e3304017-1d11-49f3-becd-f9905064f59e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:55.678553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3304017-1d11-49f3-becd-f9905064f59e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:55.683759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3304017-1d11-49f3-becd-f9905064f59e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:55.685313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3304017-1d11-49f3-becd-f9905064f59e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:55.691356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3304017-1d11-49f3-becd-f9905064f59e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:55.694043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3304017-1d11-49f3-becd-f9905064f59e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:55.695181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e3304017-1d11-49f3-becd-f9905064f59e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:55.960293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-924e31dc-9ed9-4f18-99d2-4c66f047bd9c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:55.961094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-924e31dc-9ed9-4f18-99d2-4c66f047bd9c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:55.970222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-924e31dc-9ed9-4f18-99d2-4c66f047bd9c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:55.978960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-924e31dc-9ed9-4f18-99d2-4c66f047bd9c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:55.982599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-924e31dc-9ed9-4f18-99d2-4c66f047bd9c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:55.983424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-924e31dc-9ed9-4f18-99d2-4c66f047bd9c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:55.989543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-924e31dc-9ed9-4f18-99d2-4c66f047bd9c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:55.990155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-924e31dc-9ed9-4f18-99d2-4c66f047bd9c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:56.048724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e3304017-1d11-49f3-becd-f9905064f59e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:56.058659 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e3304017-1d11-49f3-becd-f9905064f59e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1694 microversion: 2.1 time: 0.411716 Oct 29 01:39:56.059925 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2990/6217] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:55 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1694 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:56.538073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-48d93e09-b34f-4791-8e57-774dcf8d4adf tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:56.538711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-48d93e09-b34f-4791-8e57-774dcf8d4adf tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:56.565595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48d93e09-b34f-4791-8e57-774dcf8d4adf tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:56.565595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48d93e09-b34f-4791-8e57-774dcf8d4adf tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:56.566052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48d93e09-b34f-4791-8e57-774dcf8d4adf tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:56.566799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48d93e09-b34f-4791-8e57-774dcf8d4adf tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:56.567265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48d93e09-b34f-4791-8e57-774dcf8d4adf tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:56.567700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48d93e09-b34f-4791-8e57-774dcf8d4adf tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:56.968079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-924e31dc-9ed9-4f18-99d2-4c66f047bd9c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:56.992808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-924e31dc-9ed9-4f18-99d2-4c66f047bd9c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:56.994375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-924e31dc-9ed9-4f18-99d2-4c66f047bd9c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:56.995679 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-924e31dc-9ed9-4f18-99d2-4c66f047bd9c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 1.039689 Oct 29 01:39:56.996273 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3228/6218] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:55 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:57.084073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2cc55e84-76a2-4786-8770-b4474cf69010 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:57.084732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2cc55e84-76a2-4786-8770-b4474cf69010 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:57.086867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=80 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:39:57.102400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cc55e84-76a2-4786-8770-b4474cf69010 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:57.102894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cc55e84-76a2-4786-8770-b4474cf69010 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:57.103577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cc55e84-76a2-4786-8770-b4474cf69010 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:57.106073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cc55e84-76a2-4786-8770-b4474cf69010 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:57.117747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cc55e84-76a2-4786-8770-b4474cf69010 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:57.118486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cc55e84-76a2-4786-8770-b4474cf69010 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:57.312098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-48d93e09-b34f-4791-8e57-774dcf8d4adf tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:57.322724 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-48d93e09-b34f-4791-8e57-774dcf8d4adf tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1680 microversion: 2.1 time: 0.797530 Oct 29 01:39:57.334436 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2991/6219] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:56 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1680 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:57.814509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7a1efdc9-e3fd-4c3e-8ff3-0bceaf20431e tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Action: 'create', calling method: .version_select at 0x7f9d9c79b160>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-848152334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBI9NSfATUz/3v/dr4ffO19fxLv3VKSaPCILoHWBUS0GTG7StSBJ6/UaVNDAkNs/JPGjfkEsn9dO2McK5EjNiMCJv97uW726X4H2ddbYo5GFXB6bIX10XbUXT/SsOu88Pg=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:57.832474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2cc55e84-76a2-4786-8770-b4474cf69010 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:57.841248 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2cc55e84-76a2-4786-8770-b4474cf69010 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1694 microversion: 2.1 time: 0.761000 Oct 29 01:39:57.843732 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3229/6220] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:57 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1694 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:57.847467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-7a1efdc9-e3fd-4c3e-8ff3-0bceaf20431e tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Getting quotas for project 37a06b4f54f84e3ca1ec465f31dd0127. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:39:57.854538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-7a1efdc9-e3fd-4c3e-8ff3-0bceaf20431e tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Getting quotas for user 98c91d05f467479f84d12f272c522fbf and project 37a06b4f54f84e3ca1ec465f31dd0127. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:39:57.997430 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7a1efdc9-e3fd-4c3e-8ff3-0bceaf20431e tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.598639 Oct 29 01:39:57.998315 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2992/6221] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:39:57 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:39:58.030263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-36a83289-afed-4b54-a5d8-5db193800e91 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:58.031503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-36a83289-afed-4b54-a5d8-5db193800e91 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:58.044645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36a83289-afed-4b54-a5d8-5db193800e91 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:58.048153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36a83289-afed-4b54-a5d8-5db193800e91 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:58.051920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36a83289-afed-4b54-a5d8-5db193800e91 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:58.052846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36a83289-afed-4b54-a5d8-5db193800e91 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:58.053517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36a83289-afed-4b54-a5d8-5db193800e91 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:58.056053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36a83289-afed-4b54-a5d8-5db193800e91 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:58.362162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-22cd2822-0cb6-449c-9ccd-a7a188da09f9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:58.363683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-22cd2822-0cb6-449c-9ccd-a7a188da09f9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:58.388665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22cd2822-0cb6-449c-9ccd-a7a188da09f9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:58.391750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22cd2822-0cb6-449c-9ccd-a7a188da09f9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:58.392395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22cd2822-0cb6-449c-9ccd-a7a188da09f9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:58.393510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22cd2822-0cb6-449c-9ccd-a7a188da09f9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:58.398539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22cd2822-0cb6-449c-9ccd-a7a188da09f9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:58.399188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22cd2822-0cb6-449c-9ccd-a7a188da09f9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:58.467237 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:39:58.866963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-36a83289-afed-4b54-a5d8-5db193800e91 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:58.875660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-36a83289-afed-4b54-a5d8-5db193800e91 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:58.881660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-36a83289-afed-4b54-a5d8-5db193800e91 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:58.883915 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-36a83289-afed-4b54-a5d8-5db193800e91 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 0.858095 Oct 29 01:39:58.886115 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3230/6222] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:58 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:39:58.893142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aa0985b0-a0bb-4ff7-bb6f-c8ada45ab136 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:58.900368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-aa0985b0-a0bb-4ff7-bb6f-c8ada45ab136 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:58.917764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa0985b0-a0bb-4ff7-bb6f-c8ada45ab136 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:58.929075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa0985b0-a0bb-4ff7-bb6f-c8ada45ab136 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:58.930189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa0985b0-a0bb-4ff7-bb6f-c8ada45ab136 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:58.931048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa0985b0-a0bb-4ff7-bb6f-c8ada45ab136 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:58.931637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa0985b0-a0bb-4ff7-bb6f-c8ada45ab136 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:58.932171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa0985b0-a0bb-4ff7-bb6f-c8ada45ab136 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:59.185575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-22cd2822-0cb6-449c-9ccd-a7a188da09f9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:59.195381 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-22cd2822-0cb6-449c-9ccd-a7a188da09f9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1680 microversion: 2.1 time: 0.837793 Oct 29 01:39:59.206080 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2993/6223] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:58 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1680 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:59.368044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-aa0985b0-a0bb-4ff7-bb6f-c8ada45ab136 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:59.389004 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aa0985b0-a0bb-4ff7-bb6f-c8ada45ab136 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1694 microversion: 2.1 time: 0.500107 Oct 29 01:39:59.393902 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3231/6224] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:39:58 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1694 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:59.922722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e90a4dd5-50bf-444b-9441-e348fd51e028 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:59.923424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e90a4dd5-50bf-444b-9441-e348fd51e028 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:39:59.942430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e90a4dd5-50bf-444b-9441-e348fd51e028 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:59.943267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e90a4dd5-50bf-444b-9441-e348fd51e028 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:59.943756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e90a4dd5-50bf-444b-9441-e348fd51e028 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:39:59.944509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e90a4dd5-50bf-444b-9441-e348fd51e028 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:39:59.944979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e90a4dd5-50bf-444b-9441-e348fd51e028 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:39:59.945440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e90a4dd5-50bf-444b-9441-e348fd51e028 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:00.227824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f6f099f4-eb19-40a1-9c92-0bcc5f65cd46 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:00.228465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f6f099f4-eb19-40a1-9c92-0bcc5f65cd46 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:00.237072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6f099f4-eb19-40a1-9c92-0bcc5f65cd46 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:00.237657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6f099f4-eb19-40a1-9c92-0bcc5f65cd46 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:00.243209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6f099f4-eb19-40a1-9c92-0bcc5f65cd46 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:00.250246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6f099f4-eb19-40a1-9c92-0bcc5f65cd46 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:00.250246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6f099f4-eb19-40a1-9c92-0bcc5f65cd46 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:00.250246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6f099f4-eb19-40a1-9c92-0bcc5f65cd46 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:00.628108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e90a4dd5-50bf-444b-9441-e348fd51e028 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:00.643135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e90a4dd5-50bf-444b-9441-e348fd51e028 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:00.645144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e90a4dd5-50bf-444b-9441-e348fd51e028 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:00.646649 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e90a4dd5-50bf-444b-9441-e348fd51e028 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 0.731399 Oct 29 01:40:00.652061 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2994/6225] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:39:59 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:40:00.670727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-55fcc605-4b90-4711-a4cc-16387b2d9fd5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:00.672071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-55fcc605-4b90-4711-a4cc-16387b2d9fd5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:00.693300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55fcc605-4b90-4711-a4cc-16387b2d9fd5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:00.693806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55fcc605-4b90-4711-a4cc-16387b2d9fd5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:00.694245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55fcc605-4b90-4711-a4cc-16387b2d9fd5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:00.694966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55fcc605-4b90-4711-a4cc-16387b2d9fd5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:00.695568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55fcc605-4b90-4711-a4cc-16387b2d9fd5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:00.696002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-55fcc605-4b90-4711-a4cc-16387b2d9fd5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:00.845532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f6f099f4-eb19-40a1-9c92-0bcc5f65cd46 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:00.854994 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f6f099f4-eb19-40a1-9c92-0bcc5f65cd46 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1680 microversion: 2.1 time: 0.631130 Oct 29 01:40:00.865690 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3232/6226] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:00 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1680 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:01.084008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-55fcc605-4b90-4711-a4cc-16387b2d9fd5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:01.099442 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-55fcc605-4b90-4711-a4cc-16387b2d9fd5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1694 microversion: 2.1 time: 0.445995 Oct 29 01:40:01.103770 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2995/6227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:00 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1694 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:01.683563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1caea201-4ea2-4b50-9c40-7eebd6aef1bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:01.684181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1caea201-4ea2-4b50-9c40-7eebd6aef1bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:01.696518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1caea201-4ea2-4b50-9c40-7eebd6aef1bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:01.697438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1caea201-4ea2-4b50-9c40-7eebd6aef1bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:01.700303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1caea201-4ea2-4b50-9c40-7eebd6aef1bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:01.701349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1caea201-4ea2-4b50-9c40-7eebd6aef1bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:01.703000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1caea201-4ea2-4b50-9c40-7eebd6aef1bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:01.711516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1caea201-4ea2-4b50-9c40-7eebd6aef1bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:01.893956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-90a232bf-d4d3-4084-933e-b4ac25ffb5bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:01.894994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-90a232bf-d4d3-4084-933e-b4ac25ffb5bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:01.911453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90a232bf-d4d3-4084-933e-b4ac25ffb5bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:01.912159 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90a232bf-d4d3-4084-933e-b4ac25ffb5bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:01.912784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90a232bf-d4d3-4084-933e-b4ac25ffb5bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:01.913612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90a232bf-d4d3-4084-933e-b4ac25ffb5bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:01.914192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90a232bf-d4d3-4084-933e-b4ac25ffb5bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:01.914735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90a232bf-d4d3-4084-933e-b4ac25ffb5bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:02.794482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-90a232bf-d4d3-4084-933e-b4ac25ffb5bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:02.810661 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-90a232bf-d4d3-4084-933e-b4ac25ffb5bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1680 microversion: 2.1 time: 0.920762 Oct 29 01:40:02.814350 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2996/6228] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:01 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1680 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:02.830685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1caea201-4ea2-4b50-9c40-7eebd6aef1bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:02.851827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1caea201-4ea2-4b50-9c40-7eebd6aef1bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:02.852924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d6cb9d9c-1ba2-4b2d-b3c3-d34f64aa1ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:02.853835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d6cb9d9c-1ba2-4b2d-b3c3-d34f64aa1ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:02.862408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1caea201-4ea2-4b50-9c40-7eebd6aef1bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:02.872472 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1caea201-4ea2-4b50-9c40-7eebd6aef1bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 1.195123 Oct 29 01:40:02.877611 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3233/6229] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:40:01 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:40:02.887539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6cb9d9c-1ba2-4b2d-b3c3-d34f64aa1ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:02.888391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6cb9d9c-1ba2-4b2d-b3c3-d34f64aa1ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:02.891695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6cb9d9c-1ba2-4b2d-b3c3-d34f64aa1ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:02.894411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6cb9d9c-1ba2-4b2d-b3c3-d34f64aa1ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:02.895159 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6cb9d9c-1ba2-4b2d-b3c3-d34f64aa1ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:02.897767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d6cb9d9c-1ba2-4b2d-b3c3-d34f64aa1ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:03.507196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d6cb9d9c-1ba2-4b2d-b3c3-d34f64aa1ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:03.520400 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d6cb9d9c-1ba2-4b2d-b3c3-d34f64aa1ad8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1694 microversion: 2.1 time: 0.704646 Oct 29 01:40:03.526250 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2997/6230] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:02 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1694 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:03.839943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f7be3bca-ecdd-42f6-87bf-a9c6488fcc77 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:03.842679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f7be3bca-ecdd-42f6-87bf-a9c6488fcc77 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:03.848776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7be3bca-ecdd-42f6-87bf-a9c6488fcc77 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:03.849309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7be3bca-ecdd-42f6-87bf-a9c6488fcc77 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:03.849921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7be3bca-ecdd-42f6-87bf-a9c6488fcc77 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:03.850786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7be3bca-ecdd-42f6-87bf-a9c6488fcc77 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:03.851779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7be3bca-ecdd-42f6-87bf-a9c6488fcc77 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:03.852370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7be3bca-ecdd-42f6-87bf-a9c6488fcc77 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:03.901698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-82a09927-08f0-4992-9cad-d602f2b9593e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:03.902328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-82a09927-08f0-4992-9cad-d602f2b9593e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:03.914831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82a09927-08f0-4992-9cad-d602f2b9593e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:03.915345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82a09927-08f0-4992-9cad-d602f2b9593e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:03.915793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82a09927-08f0-4992-9cad-d602f2b9593e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:03.916529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82a09927-08f0-4992-9cad-d602f2b9593e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:03.916995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82a09927-08f0-4992-9cad-d602f2b9593e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:03.917468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82a09927-08f0-4992-9cad-d602f2b9593e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:04.736235 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-82a09927-08f0-4992-9cad-d602f2b9593e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:04.749969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-82a09927-08f0-4992-9cad-d602f2b9593e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:04.762095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-82a09927-08f0-4992-9cad-d602f2b9593e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:04.763379 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-82a09927-08f0-4992-9cad-d602f2b9593e tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 0.866205 Oct 29 01:40:04.763969 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2998/6231] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:40:03 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:40:04.782224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1bfb3ac3-e567-4d7a-842f-8925a80db04e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:04.782834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1bfb3ac3-e567-4d7a-842f-8925a80db04e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:04.798348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bfb3ac3-e567-4d7a-842f-8925a80db04e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:04.803561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bfb3ac3-e567-4d7a-842f-8925a80db04e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:04.804171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bfb3ac3-e567-4d7a-842f-8925a80db04e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:04.804944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bfb3ac3-e567-4d7a-842f-8925a80db04e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:04.805766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bfb3ac3-e567-4d7a-842f-8925a80db04e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:04.806267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1bfb3ac3-e567-4d7a-842f-8925a80db04e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:04.976471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f7be3bca-ecdd-42f6-87bf-a9c6488fcc77 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:05.004902 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f7be3bca-ecdd-42f6-87bf-a9c6488fcc77 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1680 microversion: 2.1 time: 1.168055 Oct 29 01:40:05.007265 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3234/6232] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:03 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1680 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:05.143699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-55f85f68-918c-4ef3-b340-a94e8d636180 req-a3b7e5ce-30fd-4e2e-8548-2b32bf630cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2e1d1e-3097-4c13-8eb9-c32fb30d4857", "name": "network-vif-unplugged", "status": "completed", "tag": "46e11602-6278-473b-906b-a860e498b401"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:05.180189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-55f85f68-918c-4ef3-b340-a94e8d636180 req-a3b7e5ce-30fd-4e2e-8548-2b32bf630cd4 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:05.184354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-55f85f68-918c-4ef3-b340-a94e8d636180 req-a3b7e5ce-30fd-4e2e-8548-2b32bf630cd4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:05.186610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-55f85f68-918c-4ef3-b340-a94e8d636180 req-a3b7e5ce-30fd-4e2e-8548-2b32bf630cd4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:05.241278 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-55f85f68-918c-4ef3-b340-a94e8d636180 req-a3b7e5ce-30fd-4e2e-8548-2b32bf630cd4 service nova] Creating event network-vif-unplugged:46e11602-6278-473b-906b-a860e498b401 for instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 on n-h2-862964-3 Oct 29 01:40:05.251568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [req-55f85f68-918c-4ef3-b340-a94e8d636180 req-a3b7e5ce-30fd-4e2e-8548-2b32bf630cd4 service nova] Instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121099) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:40:05.273604 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-55f85f68-918c-4ef3-b340-a94e8d636180 req-a3b7e5ce-30fd-4e2e-8548-2b32bf630cd4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127892 Oct 29 01:40:05.277855 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3235/6233] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:40:05.283194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1bfb3ac3-e567-4d7a-842f-8925a80db04e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:05.294526 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1bfb3ac3-e567-4d7a-842f-8925a80db04e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1693 microversion: 2.1 time: 0.527079 Oct 29 01:40:05.295495 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 2999/6234] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:04 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1693 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:05.797440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6422eaec-a401-48dd-8023-a245bf5c0fee tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:05.799608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6422eaec-a401-48dd-8023-a245bf5c0fee tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:05.814024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6422eaec-a401-48dd-8023-a245bf5c0fee tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:05.814977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6422eaec-a401-48dd-8023-a245bf5c0fee tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:05.818343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6422eaec-a401-48dd-8023-a245bf5c0fee tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:05.822972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6422eaec-a401-48dd-8023-a245bf5c0fee tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:05.823639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6422eaec-a401-48dd-8023-a245bf5c0fee tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:05.824096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6422eaec-a401-48dd-8023-a245bf5c0fee tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:06.036419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a61aeb53-0fdc-48ad-a215-c4381850fdb1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:06.040017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a61aeb53-0fdc-48ad-a215-c4381850fdb1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:06.045813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a61aeb53-0fdc-48ad-a215-c4381850fdb1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:06.046527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a61aeb53-0fdc-48ad-a215-c4381850fdb1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:06.047148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a61aeb53-0fdc-48ad-a215-c4381850fdb1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:06.048077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a61aeb53-0fdc-48ad-a215-c4381850fdb1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:06.048869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a61aeb53-0fdc-48ad-a215-c4381850fdb1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:06.049480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a61aeb53-0fdc-48ad-a215-c4381850fdb1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:06.399084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6422eaec-a401-48dd-8023-a245bf5c0fee tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:06.456804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6422eaec-a401-48dd-8023-a245bf5c0fee tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:06.456804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6422eaec-a401-48dd-8023-a245bf5c0fee tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:06.456804 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6422eaec-a401-48dd-8023-a245bf5c0fee tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 0.622621 Oct 29 01:40:06.456804 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3236/6235] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:40:05 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:40:06.456804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e87f1914-9d79-4199-b156-45eed91d27d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:06.456804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e87f1914-9d79-4199-b156-45eed91d27d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:06.456804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e87f1914-9d79-4199-b156-45eed91d27d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:06.456804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e87f1914-9d79-4199-b156-45eed91d27d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:06.456804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e87f1914-9d79-4199-b156-45eed91d27d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:06.456804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e87f1914-9d79-4199-b156-45eed91d27d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:06.456804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e87f1914-9d79-4199-b156-45eed91d27d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:06.456804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e87f1914-9d79-4199-b156-45eed91d27d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:06.697599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a61aeb53-0fdc-48ad-a215-c4381850fdb1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:06.713255 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a61aeb53-0fdc-48ad-a215-c4381850fdb1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1657 microversion: 2.1 time: 0.681770 Oct 29 01:40:06.715260 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3000/6236] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:06 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1657 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:40:06.743949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0fa8cfd5-f23b-4eb7-adb2-6b12627a74a3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:06.753690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fa8cfd5-f23b-4eb7-adb2-6b12627a74a3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:06.754552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fa8cfd5-f23b-4eb7-adb2-6b12627a74a3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:06.755934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fa8cfd5-f23b-4eb7-adb2-6b12627a74a3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:06.810601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0fa8cfd5-f23b-4eb7-adb2-6b12627a74a3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Going to try to start instance {{(pid=121100) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 01:40:06.936607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e87f1914-9d79-4199-b156-45eed91d27d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:06.946682 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e87f1914-9d79-4199-b156-45eed91d27d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1693 microversion: 2.1 time: 0.522688 Oct 29 01:40:06.948359 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3237/6237] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:06 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1693 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:06.978886 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0fa8cfd5-f23b-4eb7-adb2-6b12627a74a3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.240681 Oct 29 01:40:07.002455 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3001/6238] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:40:06 2022] POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:40:07.013480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9bec1c20-eb5c-47e2-96b7-ff93dbef8989 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:07.017832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9bec1c20-eb5c-47e2-96b7-ff93dbef8989 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:07.026709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bec1c20-eb5c-47e2-96b7-ff93dbef8989 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:07.027896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bec1c20-eb5c-47e2-96b7-ff93dbef8989 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:07.031168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bec1c20-eb5c-47e2-96b7-ff93dbef8989 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:07.032409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bec1c20-eb5c-47e2-96b7-ff93dbef8989 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:07.035208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bec1c20-eb5c-47e2-96b7-ff93dbef8989 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:07.036031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9bec1c20-eb5c-47e2-96b7-ff93dbef8989 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:07.449386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8c35c050-b413-4d0f-862e-6a565f9fd233 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:07.450363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8c35c050-b413-4d0f-862e-6a565f9fd233 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:07.481839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c35c050-b413-4d0f-862e-6a565f9fd233 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:07.481839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c35c050-b413-4d0f-862e-6a565f9fd233 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:07.482237 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c35c050-b413-4d0f-862e-6a565f9fd233 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:07.488672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c35c050-b413-4d0f-862e-6a565f9fd233 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:07.491487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c35c050-b413-4d0f-862e-6a565f9fd233 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:07.496349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c35c050-b413-4d0f-862e-6a565f9fd233 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:07.576822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9bec1c20-eb5c-47e2-96b7-ff93dbef8989 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:07.585737 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9bec1c20-eb5c-47e2-96b7-ff93dbef8989 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1666 microversion: 2.1 time: 0.578859 Oct 29 01:40:07.589327 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3238/6239] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:07 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1666 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:07.614213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-50f2c7b3-120b-4bfc-b7ed-50f2fd3d6139 req-16751f1c-1b7c-4149-a41c-23e604d644de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2e1d1e-3097-4c13-8eb9-c32fb30d4857", "tag": "46e11602-6278-473b-906b-a860e498b401"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:07.627062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-50f2c7b3-120b-4bfc-b7ed-50f2fd3d6139 req-16751f1c-1b7c-4149-a41c-23e604d644de service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:07.627858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-50f2c7b3-120b-4bfc-b7ed-50f2fd3d6139 req-16751f1c-1b7c-4149-a41c-23e604d644de service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:07.628466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-50f2c7b3-120b-4bfc-b7ed-50f2fd3d6139 req-16751f1c-1b7c-4149-a41c-23e604d644de service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:07.665058 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-50f2c7b3-120b-4bfc-b7ed-50f2fd3d6139 req-16751f1c-1b7c-4149-a41c-23e604d644de service nova] Creating event network-changed:46e11602-6278-473b-906b-a860e498b401 for instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 on n-h2-862964-3 Oct 29 01:40:07.675741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [req-50f2c7b3-120b-4bfc-b7ed-50f2fd3d6139 req-16751f1c-1b7c-4149-a41c-23e604d644de service nova] Instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121099) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:40:07.693666 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-50f2c7b3-120b-4bfc-b7ed-50f2fd3d6139 req-16751f1c-1b7c-4149-a41c-23e604d644de service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102633 Oct 29 01:40:07.694537 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3239/6240] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:40:07.704691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-5dd16df7-560e-446d-8be4-5d50a6299dc2 req-f6fdb133-129e-4ec6-b4b2-891e6ce35d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c66a75-9fbd-4f0c-baf5-e19875095e42", "name": "network-vif-plugged", "status": "completed", "tag": "5ea23a70-144a-4d50-a1b1-6a74d325a5f1"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:07.717951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5dd16df7-560e-446d-8be4-5d50a6299dc2 req-f6fdb133-129e-4ec6-b4b2-891e6ce35d44 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:07.730742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5dd16df7-560e-446d-8be4-5d50a6299dc2 req-f6fdb133-129e-4ec6-b4b2-891e6ce35d44 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:07.731278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5dd16df7-560e-446d-8be4-5d50a6299dc2 req-f6fdb133-129e-4ec6-b4b2-891e6ce35d44 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:07.750442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:40:07.759289 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-5dd16df7-560e-446d-8be4-5d50a6299dc2 req-f6fdb133-129e-4ec6-b4b2-891e6ce35d44 service nova] Creating event network-vif-plugged:5ea23a70-144a-4d50-a1b1-6a74d325a5f1 for instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 on n-h2-862964-3 Oct 29 01:40:07.765958 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-5dd16df7-560e-446d-8be4-5d50a6299dc2 req-f6fdb133-129e-4ec6-b4b2-891e6ce35d44 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066979 Oct 29 01:40:07.767147 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3240/6241] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:40:07.865071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:40:07.977440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bf54a094-2575-4f53-abf4-6b45585e2bbf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:07.978447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bf54a094-2575-4f53-abf4-6b45585e2bbf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:07.999762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf54a094-2575-4f53-abf4-6b45585e2bbf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:08.000261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf54a094-2575-4f53-abf4-6b45585e2bbf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:08.001049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf54a094-2575-4f53-abf4-6b45585e2bbf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:08.001437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf54a094-2575-4f53-abf4-6b45585e2bbf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:08.035940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf54a094-2575-4f53-abf4-6b45585e2bbf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:08.036777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf54a094-2575-4f53-abf4-6b45585e2bbf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:08.318057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8c35c050-b413-4d0f-862e-6a565f9fd233 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:08.341681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8c35c050-b413-4d0f-862e-6a565f9fd233 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:08.348703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8c35c050-b413-4d0f-862e-6a565f9fd233 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:08.350873 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8c35c050-b413-4d0f-862e-6a565f9fd233 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 0.911883 Oct 29 01:40:08.372639 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3002/6242] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:40:07 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:40:08.612928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ce730f1f-f5d2-468b-a647-2c6df894acb7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:08.613803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ce730f1f-f5d2-468b-a647-2c6df894acb7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:08.633113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce730f1f-f5d2-468b-a647-2c6df894acb7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:08.634830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce730f1f-f5d2-468b-a647-2c6df894acb7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:08.636112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce730f1f-f5d2-468b-a647-2c6df894acb7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:08.638933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce730f1f-f5d2-468b-a647-2c6df894acb7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:08.640128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce730f1f-f5d2-468b-a647-2c6df894acb7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:08.644154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce730f1f-f5d2-468b-a647-2c6df894acb7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:08.871189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bf54a094-2575-4f53-abf4-6b45585e2bbf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:08.883294 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bf54a094-2575-4f53-abf4-6b45585e2bbf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1693 microversion: 2.1 time: 0.911834 Oct 29 01:40:08.885855 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3241/6243] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:07 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1693 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:09.387583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c27e7b68-2c05-4051-8d2a-97d0d6f3a408 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:09.388459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c27e7b68-2c05-4051-8d2a-97d0d6f3a408 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:09.403488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c27e7b68-2c05-4051-8d2a-97d0d6f3a408 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:09.404274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c27e7b68-2c05-4051-8d2a-97d0d6f3a408 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:09.404995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c27e7b68-2c05-4051-8d2a-97d0d6f3a408 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:09.405904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c27e7b68-2c05-4051-8d2a-97d0d6f3a408 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:09.407166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c27e7b68-2c05-4051-8d2a-97d0d6f3a408 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:09.412776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c27e7b68-2c05-4051-8d2a-97d0d6f3a408 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:09.944242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ce730f1f-f5d2-468b-a647-2c6df894acb7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:09.960998 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ce730f1f-f5d2-468b-a647-2c6df894acb7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1666 microversion: 2.1 time: 1.353751 Oct 29 01:40:09.963707 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3003/6244] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:08 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1666 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:09.970499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-063edec9-a451-41e1-86ea-ebbfdacb2dd2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:09.971453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-063edec9-a451-41e1-86ea-ebbfdacb2dd2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:09.980478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-063edec9-a451-41e1-86ea-ebbfdacb2dd2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:09.981268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-063edec9-a451-41e1-86ea-ebbfdacb2dd2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:09.981882 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-063edec9-a451-41e1-86ea-ebbfdacb2dd2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:09.982949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-063edec9-a451-41e1-86ea-ebbfdacb2dd2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:09.984253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-063edec9-a451-41e1-86ea-ebbfdacb2dd2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:09.984914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-063edec9-a451-41e1-86ea-ebbfdacb2dd2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:10.472283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-063edec9-a451-41e1-86ea-ebbfdacb2dd2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:10.492254 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-063edec9-a451-41e1-86ea-ebbfdacb2dd2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1693 microversion: 2.1 time: 0.524309 Oct 29 01:40:10.492909 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3004/6245] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:09 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1693 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:10.570667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c27e7b68-2c05-4051-8d2a-97d0d6f3a408 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:10.598648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c27e7b68-2c05-4051-8d2a-97d0d6f3a408 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:10.604337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c27e7b68-2c05-4051-8d2a-97d0d6f3a408 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:10.606099 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c27e7b68-2c05-4051-8d2a-97d0d6f3a408 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 1.223378 Oct 29 01:40:10.610091 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3242/6246] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:40:09 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:40:10.993701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ef41eaa6-9d3a-4ae8-a072-90b03e01fce4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:10.994522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ef41eaa6-9d3a-4ae8-a072-90b03e01fce4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:11.006269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef41eaa6-9d3a-4ae8-a072-90b03e01fce4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:11.011354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef41eaa6-9d3a-4ae8-a072-90b03e01fce4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:11.011822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef41eaa6-9d3a-4ae8-a072-90b03e01fce4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:11.012586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef41eaa6-9d3a-4ae8-a072-90b03e01fce4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:11.013058 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef41eaa6-9d3a-4ae8-a072-90b03e01fce4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:11.013551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef41eaa6-9d3a-4ae8-a072-90b03e01fce4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:11.517691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ef41eaa6-9d3a-4ae8-a072-90b03e01fce4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:11.520002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9c706656-a0a7-4b80-8c2e-59051a029f75 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:11.520635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9c706656-a0a7-4b80-8c2e-59051a029f75 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:11.531493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c706656-a0a7-4b80-8c2e-59051a029f75 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:11.531997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c706656-a0a7-4b80-8c2e-59051a029f75 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:11.532445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c706656-a0a7-4b80-8c2e-59051a029f75 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:11.533186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c706656-a0a7-4b80-8c2e-59051a029f75 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:11.535680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c706656-a0a7-4b80-8c2e-59051a029f75 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:11.536318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c706656-a0a7-4b80-8c2e-59051a029f75 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:11.552884 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ef41eaa6-9d3a-4ae8-a072-90b03e01fce4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1666 microversion: 2.1 time: 0.564494 Oct 29 01:40:11.553874 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3005/6247] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:10 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1666 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:11.638669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7c6551f2-0569-4ec9-b012-f8a3455479ea tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:11.639858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7c6551f2-0569-4ec9-b012-f8a3455479ea tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:11.647076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c6551f2-0569-4ec9-b012-f8a3455479ea tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:11.647575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c6551f2-0569-4ec9-b012-f8a3455479ea tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:11.648016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c6551f2-0569-4ec9-b012-f8a3455479ea tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:11.648845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c6551f2-0569-4ec9-b012-f8a3455479ea tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:11.649496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c6551f2-0569-4ec9-b012-f8a3455479ea tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:11.650100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c6551f2-0569-4ec9-b012-f8a3455479ea tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:11.907621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9c706656-a0a7-4b80-8c2e-59051a029f75 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:11.921134 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9c706656-a0a7-4b80-8c2e-59051a029f75 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1691 microversion: 2.1 time: 0.404433 Oct 29 01:40:11.922838 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3243/6248] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:11 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1691 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:11.934458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7c6551f2-0569-4ec9-b012-f8a3455479ea tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:11.946701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7c6551f2-0569-4ec9-b012-f8a3455479ea tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:11.949456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7c6551f2-0569-4ec9-b012-f8a3455479ea tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:11.951259 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7c6551f2-0569-4ec9-b012-f8a3455479ea tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 0.316309 Oct 29 01:40:11.983637 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3006/6249] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:40:11 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:40:12.589574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c3807dfe-cd63-4faf-9cec-9d58dad68e2d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:12.591789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c3807dfe-cd63-4faf-9cec-9d58dad68e2d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:12.602952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3807dfe-cd63-4faf-9cec-9d58dad68e2d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:12.604991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3807dfe-cd63-4faf-9cec-9d58dad68e2d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:12.607176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3807dfe-cd63-4faf-9cec-9d58dad68e2d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:12.608762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3807dfe-cd63-4faf-9cec-9d58dad68e2d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:12.614747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3807dfe-cd63-4faf-9cec-9d58dad68e2d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:12.614747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3807dfe-cd63-4faf-9cec-9d58dad68e2d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:12.950191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3c750a16-4cb7-42a1-be59-5eaa4f32b717 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:12.950191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3c750a16-4cb7-42a1-be59-5eaa4f32b717 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:12.960234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c750a16-4cb7-42a1-be59-5eaa4f32b717 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:12.965017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c750a16-4cb7-42a1-be59-5eaa4f32b717 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:12.965557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c750a16-4cb7-42a1-be59-5eaa4f32b717 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:12.966551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c750a16-4cb7-42a1-be59-5eaa4f32b717 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:12.967236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c750a16-4cb7-42a1-be59-5eaa4f32b717 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:12.967928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c750a16-4cb7-42a1-be59-5eaa4f32b717 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:13.004755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c3807dfe-cd63-4faf-9cec-9d58dad68e2d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:13.025147 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c3807dfe-cd63-4faf-9cec-9d58dad68e2d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.447644 Oct 29 01:40:13.043255 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3244/6250] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:12 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:13.052141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5c85b8bf-7185-4d29-99f0-4518e3c56758 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:13.052769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5c85b8bf-7185-4d29-99f0-4518e3c56758 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:13.059020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c85b8bf-7185-4d29-99f0-4518e3c56758 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:13.059521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c85b8bf-7185-4d29-99f0-4518e3c56758 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:13.059970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c85b8bf-7185-4d29-99f0-4518e3c56758 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:13.060676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c85b8bf-7185-4d29-99f0-4518e3c56758 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:13.062895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c85b8bf-7185-4d29-99f0-4518e3c56758 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:13.063348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c85b8bf-7185-4d29-99f0-4518e3c56758 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:13.572825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3c750a16-4cb7-42a1-be59-5eaa4f32b717 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:13.594175 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3c750a16-4cb7-42a1-be59-5eaa4f32b717 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1691 microversion: 2.1 time: 0.643347 Oct 29 01:40:13.598874 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3007/6251] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:12 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1691 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:40:13.611728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5cda7209-f1e8-4eac-9a16-bc793fa6582e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:13.619675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5cda7209-f1e8-4eac-9a16-bc793fa6582e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:13.650021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cda7209-f1e8-4eac-9a16-bc793fa6582e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:13.655480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cda7209-f1e8-4eac-9a16-bc793fa6582e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:13.660241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cda7209-f1e8-4eac-9a16-bc793fa6582e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:13.661733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cda7209-f1e8-4eac-9a16-bc793fa6582e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:13.662570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cda7209-f1e8-4eac-9a16-bc793fa6582e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:13.669592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5cda7209-f1e8-4eac-9a16-bc793fa6582e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:13.707046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5c85b8bf-7185-4d29-99f0-4518e3c56758 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:13.723015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5c85b8bf-7185-4d29-99f0-4518e3c56758 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:13.726679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5c85b8bf-7185-4d29-99f0-4518e3c56758 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:13.730185 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5c85b8bf-7185-4d29-99f0-4518e3c56758 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1732 microversion: 2.20 time: 0.685686 Oct 29 01:40:13.735243 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3245/6252] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:40:13 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1732 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:40:13.986077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5cda7209-f1e8-4eac-9a16-bc793fa6582e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:13.998235 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5cda7209-f1e8-4eac-9a16-bc793fa6582e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.398141 Oct 29 01:40:14.013459 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3008/6253] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:13 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:14.023743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b112de7e-ffa3-46bd-8ba7-7195fec8a570 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:14.024571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b112de7e-ffa3-46bd-8ba7-7195fec8a570 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:14.032043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b112de7e-ffa3-46bd-8ba7-7195fec8a570 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:14.032635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b112de7e-ffa3-46bd-8ba7-7195fec8a570 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:14.033133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b112de7e-ffa3-46bd-8ba7-7195fec8a570 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:14.034160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b112de7e-ffa3-46bd-8ba7-7195fec8a570 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:14.034695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b112de7e-ffa3-46bd-8ba7-7195fec8a570 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:14.035196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b112de7e-ffa3-46bd-8ba7-7195fec8a570 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:14.209347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b112de7e-ffa3-46bd-8ba7-7195fec8a570 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Unlocking {{(pid=121099) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 29 01:40:14.499864 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b112de7e-ffa3-46bd-8ba7-7195fec8a570 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.480075 Oct 29 01:40:14.506265 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3246/6254] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:40:14 2022] POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:40:14.513670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-302b657d-9934-4500-985d-15d1839af4be tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:14.515152 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-302b657d-9934-4500-985d-15d1839af4be tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:14.532940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-302b657d-9934-4500-985d-15d1839af4be tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:14.536199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-302b657d-9934-4500-985d-15d1839af4be tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:14.536657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-302b657d-9934-4500-985d-15d1839af4be tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:14.538219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-302b657d-9934-4500-985d-15d1839af4be tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:14.538700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-302b657d-9934-4500-985d-15d1839af4be tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:14.539137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-302b657d-9934-4500-985d-15d1839af4be tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:14.544105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:40:14.619811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-374d1e8f-bcb7-47e4-81b2-1f67d13ba9e4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:14.620663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-374d1e8f-bcb7-47e4-81b2-1f67d13ba9e4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:14.629687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-374d1e8f-bcb7-47e4-81b2-1f67d13ba9e4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:14.630446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-374d1e8f-bcb7-47e4-81b2-1f67d13ba9e4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:14.631203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-374d1e8f-bcb7-47e4-81b2-1f67d13ba9e4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:14.632755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-374d1e8f-bcb7-47e4-81b2-1f67d13ba9e4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:14.633413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-374d1e8f-bcb7-47e4-81b2-1f67d13ba9e4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:14.634282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-374d1e8f-bcb7-47e4-81b2-1f67d13ba9e4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:14.908626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-302b657d-9934-4500-985d-15d1839af4be tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:14.919283 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-302b657d-9934-4500-985d-15d1839af4be tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.410419 Oct 29 01:40:14.930338 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3009/6255] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:14 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:14.936721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-41d76d93-2a34-4cca-8e91-7d6d9452da20 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:14.937624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-41d76d93-2a34-4cca-8e91-7d6d9452da20 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:14.950638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41d76d93-2a34-4cca-8e91-7d6d9452da20 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:14.955518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41d76d93-2a34-4cca-8e91-7d6d9452da20 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:14.955518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41d76d93-2a34-4cca-8e91-7d6d9452da20 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:14.957390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41d76d93-2a34-4cca-8e91-7d6d9452da20 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:14.957967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41d76d93-2a34-4cca-8e91-7d6d9452da20 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:14.958437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41d76d93-2a34-4cca-8e91-7d6d9452da20 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:15.099211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-374d1e8f-bcb7-47e4-81b2-1f67d13ba9e4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:15.108982 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-374d1e8f-bcb7-47e4-81b2-1f67d13ba9e4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1688 microversion: 2.1 time: 0.493689 Oct 29 01:40:15.129606 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3247/6256] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:14 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1688 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:15.139950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6d16a2bb-d933-4ed0-ba2c-4b5d2cac0123 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:15.141317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6d16a2bb-d933-4ed0-ba2c-4b5d2cac0123 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:15.149353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d16a2bb-d933-4ed0-ba2c-4b5d2cac0123 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:15.153004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d16a2bb-d933-4ed0-ba2c-4b5d2cac0123 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:15.153004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d16a2bb-d933-4ed0-ba2c-4b5d2cac0123 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:15.153004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d16a2bb-d933-4ed0-ba2c-4b5d2cac0123 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:15.153004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d16a2bb-d933-4ed0-ba2c-4b5d2cac0123 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:15.153004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d16a2bb-d933-4ed0-ba2c-4b5d2cac0123 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:15.362390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-41d76d93-2a34-4cca-8e91-7d6d9452da20 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:15.372170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-41d76d93-2a34-4cca-8e91-7d6d9452da20 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:15.379057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-41d76d93-2a34-4cca-8e91-7d6d9452da20 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:15.379057 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-41d76d93-2a34-4cca-8e91-7d6d9452da20 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1719 microversion: 2.20 time: 0.444170 Oct 29 01:40:15.379057 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3010/6257] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:40:14 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1719 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:40:15.381054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4d1c1f9d-d8a1-4968-8671-fe513a2a5b85 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:15.381808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4d1c1f9d-d8a1-4968-8671-fe513a2a5b85 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:15.390476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d1c1f9d-d8a1-4968-8671-fe513a2a5b85 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:15.391026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d1c1f9d-d8a1-4968-8671-fe513a2a5b85 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:15.391897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d1c1f9d-d8a1-4968-8671-fe513a2a5b85 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:15.392809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d1c1f9d-d8a1-4968-8671-fe513a2a5b85 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:15.393525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d1c1f9d-d8a1-4968-8671-fe513a2a5b85 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:15.394144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4d1c1f9d-d8a1-4968-8671-fe513a2a5b85 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:15.533298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6d16a2bb-d933-4ed0-ba2c-4b5d2cac0123 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:15.544323 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6d16a2bb-d933-4ed0-ba2c-4b5d2cac0123 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.412258 Oct 29 01:40:15.545666 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3248/6258] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:15 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:15.568207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-349dc626-a577-4c8e-a6e6-792d55f67bdd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:15.568895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-349dc626-a577-4c8e-a6e6-792d55f67bdd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:15.575609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-349dc626-a577-4c8e-a6e6-792d55f67bdd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:15.576219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-349dc626-a577-4c8e-a6e6-792d55f67bdd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:15.576857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-349dc626-a577-4c8e-a6e6-792d55f67bdd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:15.577893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-349dc626-a577-4c8e-a6e6-792d55f67bdd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:15.578551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-349dc626-a577-4c8e-a6e6-792d55f67bdd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:15.578998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-349dc626-a577-4c8e-a6e6-792d55f67bdd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:15.805724 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4d1c1f9d-d8a1-4968-8671-fe513a2a5b85 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857/action" status: 202 len: 0 microversion: 2.1 time: 0.428388 Oct 29 01:40:15.806742 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3011/6259] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:40:15 2022] POST /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:40:15.829933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-917ed202-4ab1-44a9-8999-9c9a3a60a1c5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:15.830960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-917ed202-4ab1-44a9-8999-9c9a3a60a1c5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:15.838523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-917ed202-4ab1-44a9-8999-9c9a3a60a1c5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:15.839365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-917ed202-4ab1-44a9-8999-9c9a3a60a1c5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:15.839984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-917ed202-4ab1-44a9-8999-9c9a3a60a1c5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:15.840861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-917ed202-4ab1-44a9-8999-9c9a3a60a1c5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:15.841501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-917ed202-4ab1-44a9-8999-9c9a3a60a1c5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:15.842084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-917ed202-4ab1-44a9-8999-9c9a3a60a1c5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:15.971661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-349dc626-a577-4c8e-a6e6-792d55f67bdd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:15.979759 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-349dc626-a577-4c8e-a6e6-792d55f67bdd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.415629 Oct 29 01:40:15.994108 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3249/6260] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:15 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:16.007950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1be9522e-461b-4b64-a241-d38bc4293083 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:16.008877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1be9522e-461b-4b64-a241-d38bc4293083 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:16.019990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1be9522e-461b-4b64-a241-d38bc4293083 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:16.020847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1be9522e-461b-4b64-a241-d38bc4293083 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:16.021533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1be9522e-461b-4b64-a241-d38bc4293083 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:16.022496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1be9522e-461b-4b64-a241-d38bc4293083 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:16.023164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1be9522e-461b-4b64-a241-d38bc4293083 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:16.024097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1be9522e-461b-4b64-a241-d38bc4293083 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:16.196840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-917ed202-4ab1-44a9-8999-9c9a3a60a1c5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:16.208937 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-917ed202-4ab1-44a9-8999-9c9a3a60a1c5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1687 microversion: 2.1 time: 0.397206 Oct 29 01:40:16.212126 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3012/6261] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:15 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1687 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:16.282075 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1be9522e-461b-4b64-a241-d38bc4293083 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.280163 Oct 29 01:40:16.283700 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3250/6262] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:40:16 2022] POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:40:16.296850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bcebb306-7179-45b3-a430-c72449791f3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:16.298720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bcebb306-7179-45b3-a430-c72449791f3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:16.307451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bcebb306-7179-45b3-a430-c72449791f3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:16.308195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bcebb306-7179-45b3-a430-c72449791f3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:16.309374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bcebb306-7179-45b3-a430-c72449791f3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:16.309877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bcebb306-7179-45b3-a430-c72449791f3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:16.310502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bcebb306-7179-45b3-a430-c72449791f3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:16.311290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bcebb306-7179-45b3-a430-c72449791f3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:16.599938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bcebb306-7179-45b3-a430-c72449791f3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:16.615864 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bcebb306-7179-45b3-a430-c72449791f3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1675 microversion: 2.1 time: 0.323763 Oct 29 01:40:16.634913 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3013/6263] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:16 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1675 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:17.140340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-527da40a-aadc-4544-9509-75d7854e7d88 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-124385350-access_point-238845846", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "b3dc79a4-c470-40b6-a60c-4b12df271c03"}], "key_name": "tempest-TestSecurityGroupsBasicOps-848152334", "security_groups": [{"name": "tempest-secgroup_access--1026164967"}, {"name": "tempest-secgroup_general--1193791695"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:17.235780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-93ef1c97-2f20-4069-866c-16629c437d3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:17.236791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-93ef1c97-2f20-4069-866c-16629c437d3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:17.245634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93ef1c97-2f20-4069-866c-16629c437d3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:17.246457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93ef1c97-2f20-4069-866c-16629c437d3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:17.249900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93ef1c97-2f20-4069-866c-16629c437d3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:17.250877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93ef1c97-2f20-4069-866c-16629c437d3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:17.258090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93ef1c97-2f20-4069-866c-16629c437d3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:17.259110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93ef1c97-2f20-4069-866c-16629c437d3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:17.518252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-93ef1c97-2f20-4069-866c-16629c437d3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:17.532425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-527da40a-aadc-4544-9509-75d7854e7d88 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] validate_networks() for [('b3dc79a4-c470-40b6-a60c-4b12df271c03', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:40:17.540539 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-93ef1c97-2f20-4069-866c-16629c437d3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1687 microversion: 2.1 time: 0.310488 Oct 29 01:40:17.542025 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3014/6264] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:17 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1687 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:17.648056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-119affe0-99da-4654-b742-6426c424c2dd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:17.649684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-119affe0-99da-4654-b742-6426c424c2dd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:17.674722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-119affe0-99da-4654-b742-6426c424c2dd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:17.676360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-119affe0-99da-4654-b742-6426c424c2dd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:17.677790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-119affe0-99da-4654-b742-6426c424c2dd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:17.683034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-119affe0-99da-4654-b742-6426c424c2dd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:17.685634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-119affe0-99da-4654-b742-6426c424c2dd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:17.693621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-119affe0-99da-4654-b742-6426c424c2dd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:18.039073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-119affe0-99da-4654-b742-6426c424c2dd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:18.066222 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-119affe0-99da-4654-b742-6426c424c2dd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1655 microversion: 2.1 time: 0.423290 Oct 29 01:40:18.067731 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3015/6265] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:17 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1655 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:18.078896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-5eb975b0-af41-4c40-84cc-fa86e42e273a req-e52f5742-d26f-4e8c-94af-62db4f4808c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2e1d1e-3097-4c13-8eb9-c32fb30d4857", "name": "network-vif-plugged", "status": "completed", "tag": "46e11602-6278-473b-906b-a860e498b401"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:18.122090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5eb975b0-af41-4c40-84cc-fa86e42e273a req-e52f5742-d26f-4e8c-94af-62db4f4808c0 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:18.125013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5eb975b0-af41-4c40-84cc-fa86e42e273a req-e52f5742-d26f-4e8c-94af-62db4f4808c0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:18.127334 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5eb975b0-af41-4c40-84cc-fa86e42e273a req-e52f5742-d26f-4e8c-94af-62db4f4808c0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:18.164592 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-5eb975b0-af41-4c40-84cc-fa86e42e273a req-e52f5742-d26f-4e8c-94af-62db4f4808c0 service nova] Creating event network-vif-plugged:46e11602-6278-473b-906b-a860e498b401 for instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 on n-h2-862964-3 Oct 29 01:40:18.194092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [req-5eb975b0-af41-4c40-84cc-fa86e42e273a req-e52f5742-d26f-4e8c-94af-62db4f4808c0 service nova] Instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121100) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:40:18.213951 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-5eb975b0-af41-4c40-84cc-fa86e42e273a req-e52f5742-d26f-4e8c-94af-62db4f4808c0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144224 Oct 29 01:40:18.224440 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3016/6266] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:40:18.243002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-984efbca-9fcd-484e-8f25-feab429b3c44 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:18.245409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-984efbca-9fcd-484e-8f25-feab429b3c44 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:18.272001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-984efbca-9fcd-484e-8f25-feab429b3c44 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:18.272915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-984efbca-9fcd-484e-8f25-feab429b3c44 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:18.275165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-984efbca-9fcd-484e-8f25-feab429b3c44 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:18.276574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-984efbca-9fcd-484e-8f25-feab429b3c44 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:18.278555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-984efbca-9fcd-484e-8f25-feab429b3c44 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:18.279201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-984efbca-9fcd-484e-8f25-feab429b3c44 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:18.314910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-527da40a-aadc-4544-9509-75d7854e7d88 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:40:18.315564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-527da40a-aadc-4544-9509-75d7854e7d88 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:40:18.316191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-527da40a-aadc-4544-9509-75d7854e7d88 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:40:18.317631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-527da40a-aadc-4544-9509-75d7854e7d88 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:40:18.318640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-527da40a-aadc-4544-9509-75d7854e7d88 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:40:18.346855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-527da40a-aadc-4544-9509-75d7854e7d88 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:18.355044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-527da40a-aadc-4544-9509-75d7854e7d88 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:18.355044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-527da40a-aadc-4544-9509-75d7854e7d88 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:18.355044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-527da40a-aadc-4544-9509-75d7854e7d88 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:18.355044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-527da40a-aadc-4544-9509-75d7854e7d88 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:18.355044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-527da40a-aadc-4544-9509-75d7854e7d88 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:18.412231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-527da40a-aadc-4544-9509-75d7854e7d88 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Getting quotas for project 37a06b4f54f84e3ca1ec465f31dd0127. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:40:18.424638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-527da40a-aadc-4544-9509-75d7854e7d88 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Getting quotas for user 98c91d05f467479f84d12f272c522fbf and project 37a06b4f54f84e3ca1ec465f31dd0127. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:40:18.454626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-527da40a-aadc-4544-9509-75d7854e7d88 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:40:18.458801 n-d-862964-3 devstack@n-api.service[121099]: WARNING nova.utils [None req-527da40a-aadc-4544-9509-75d7854e7d88 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-124385350-access_point-238845846 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-124385350-acc Oct 29 01:40:18.461142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-527da40a-aadc-4544-9509-75d7854e7d88 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:40:18.648570 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-527da40a-aadc-4544-9509-75d7854e7d88 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.517279 Oct 29 01:40:18.657282 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3251/6267] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:40:17 2022] POST /compute/v2.1/servers => generated 458 bytes in 1527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:40:18.661867 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-984efbca-9fcd-484e-8f25-feab429b3c44 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.433194 Oct 29 01:40:18.662590 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3017/6268] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:40:18 2022] POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:40:18.663466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e7e0ef46-3eb7-45f2-9ebb-9fb808b1de3f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:18.667117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e7e0ef46-3eb7-45f2-9ebb-9fb808b1de3f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:18.674561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7e0ef46-3eb7-45f2-9ebb-9fb808b1de3f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:18.675362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7e0ef46-3eb7-45f2-9ebb-9fb808b1de3f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:18.676038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7e0ef46-3eb7-45f2-9ebb-9fb808b1de3f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:18.677601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7e0ef46-3eb7-45f2-9ebb-9fb808b1de3f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:18.678452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7e0ef46-3eb7-45f2-9ebb-9fb808b1de3f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:18.679096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e7e0ef46-3eb7-45f2-9ebb-9fb808b1de3f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:18.689346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-26a9ba2e-8b96-4acf-9bbe-af0275b1838a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:18.693335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-26a9ba2e-8b96-4acf-9bbe-af0275b1838a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:18.708353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26a9ba2e-8b96-4acf-9bbe-af0275b1838a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:18.709092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26a9ba2e-8b96-4acf-9bbe-af0275b1838a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:18.709819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26a9ba2e-8b96-4acf-9bbe-af0275b1838a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:18.711535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26a9ba2e-8b96-4acf-9bbe-af0275b1838a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:18.712146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26a9ba2e-8b96-4acf-9bbe-af0275b1838a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:18.715480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26a9ba2e-8b96-4acf-9bbe-af0275b1838a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:18.854971 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e7e0ef46-3eb7-45f2-9ebb-9fb808b1de3f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "POST /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145/action" status: 200 len: 24548 microversion: 2.1 time: 0.196259 Oct 29 01:40:18.859177 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3252/6269] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:40:18 2022] POST /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145/action => generated 24548 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:40:18.878949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7d8a97ae-877f-4dc8-85db-aaad11818429 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:18.883053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7d8a97ae-877f-4dc8-85db-aaad11818429 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:19.119243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7d8a97ae-877f-4dc8-85db-aaad11818429 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:19.128718 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7d8a97ae-877f-4dc8-85db-aaad11818429 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1292 microversion: 2.1 time: 0.267944 Oct 29 01:40:19.133601 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3253/6270] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:18 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1292 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:19.144086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4b58d5d4-6f20-481f-ac0b-5181d0c46267 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:19.146969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4b58d5d4-6f20-481f-ac0b-5181d0c46267 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:19.178802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b58d5d4-6f20-481f-ac0b-5181d0c46267 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:19.179685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b58d5d4-6f20-481f-ac0b-5181d0c46267 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:19.180333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b58d5d4-6f20-481f-ac0b-5181d0c46267 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:19.181614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b58d5d4-6f20-481f-ac0b-5181d0c46267 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:19.182305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b58d5d4-6f20-481f-ac0b-5181d0c46267 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:19.183148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b58d5d4-6f20-481f-ac0b-5181d0c46267 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:19.210666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-26a9ba2e-8b96-4acf-9bbe-af0275b1838a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:19.233005 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-26a9ba2e-8b96-4acf-9bbe-af0275b1838a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1687 microversion: 2.1 time: 0.556395 Oct 29 01:40:19.237899 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3018/6271] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:18 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1687 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:19.482093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4b58d5d4-6f20-481f-ac0b-5181d0c46267 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:19.492128 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4b58d5d4-6f20-481f-ac0b-5181d0c46267 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1662 microversion: 2.1 time: 0.356624 Oct 29 01:40:19.493665 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3254/6272] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:19 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1662 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:20.157886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b713a841-d7b3-4433-b33c-b34c30244b25 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:20.158510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b713a841-d7b3-4433-b33c-b34c30244b25 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:20.166113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b713a841-d7b3-4433-b33c-b34c30244b25 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:20.166823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b713a841-d7b3-4433-b33c-b34c30244b25 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:20.167610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b713a841-d7b3-4433-b33c-b34c30244b25 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:20.168312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b713a841-d7b3-4433-b33c-b34c30244b25 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:20.168770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b713a841-d7b3-4433-b33c-b34c30244b25 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:20.169340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b713a841-d7b3-4433-b33c-b34c30244b25 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:20.263408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bda339b2-9674-4acb-a02a-352880e5824d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:20.264026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bda339b2-9674-4acb-a02a-352880e5824d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:20.275301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bda339b2-9674-4acb-a02a-352880e5824d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:20.275812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bda339b2-9674-4acb-a02a-352880e5824d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:20.276402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b713a841-d7b3-4433-b33c-b34c30244b25 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:20.276614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bda339b2-9674-4acb-a02a-352880e5824d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:20.277544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bda339b2-9674-4acb-a02a-352880e5824d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:20.278152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bda339b2-9674-4acb-a02a-352880e5824d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:20.278760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bda339b2-9674-4acb-a02a-352880e5824d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:20.301550 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b713a841-d7b3-4433-b33c-b34c30244b25 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1296 microversion: 2.1 time: 0.137049 Oct 29 01:40:20.301550 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3019/6273] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:20 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1296 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:20.520165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-47480162-ef38-4b3a-991d-505f1a3a399f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:20.521617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-47480162-ef38-4b3a-991d-505f1a3a399f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:20.542253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47480162-ef38-4b3a-991d-505f1a3a399f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:20.543100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47480162-ef38-4b3a-991d-505f1a3a399f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:20.543778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47480162-ef38-4b3a-991d-505f1a3a399f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:20.544744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47480162-ef38-4b3a-991d-505f1a3a399f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:20.545917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47480162-ef38-4b3a-991d-505f1a3a399f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:20.546524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47480162-ef38-4b3a-991d-505f1a3a399f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:20.786520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bda339b2-9674-4acb-a02a-352880e5824d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:20.790255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:40:20.800434 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bda339b2-9674-4acb-a02a-352880e5824d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1687 microversion: 2.1 time: 0.540915 Oct 29 01:40:20.801023 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3255/6274] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:20 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1687 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:40:20.848157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-47480162-ef38-4b3a-991d-505f1a3a399f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:20.848157 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-47480162-ef38-4b3a-991d-505f1a3a399f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.328349 Oct 29 01:40:20.862128 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3020/6275] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:20 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:40:20.869696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-66dd8d16-07cf-4082-a442-fe3f19e94c4e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:20.870328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-66dd8d16-07cf-4082-a442-fe3f19e94c4e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:20.877326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66dd8d16-07cf-4082-a442-fe3f19e94c4e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:20.888696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66dd8d16-07cf-4082-a442-fe3f19e94c4e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:20.888696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66dd8d16-07cf-4082-a442-fe3f19e94c4e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:20.888696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66dd8d16-07cf-4082-a442-fe3f19e94c4e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:20.888696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66dd8d16-07cf-4082-a442-fe3f19e94c4e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:20.888696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66dd8d16-07cf-4082-a442-fe3f19e94c4e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:21.312049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7a8d449c-b403-4fe4-ac22-d7e7858ce9ab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:21.312975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7a8d449c-b403-4fe4-ac22-d7e7858ce9ab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:21.327922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a8d449c-b403-4fe4-ac22-d7e7858ce9ab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:21.328430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a8d449c-b403-4fe4-ac22-d7e7858ce9ab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:21.328872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a8d449c-b403-4fe4-ac22-d7e7858ce9ab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:21.331207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a8d449c-b403-4fe4-ac22-d7e7858ce9ab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:21.338961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a8d449c-b403-4fe4-ac22-d7e7858ce9ab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:21.338961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a8d449c-b403-4fe4-ac22-d7e7858ce9ab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:21.511407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7a8d449c-b403-4fe4-ac22-d7e7858ce9ab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:21.521894 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7a8d449c-b403-4fe4-ac22-d7e7858ce9ab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1344 microversion: 2.1 time: 0.213660 Oct 29 01:40:21.526190 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3021/6276] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:21 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1344 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:40:21.538154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-66dd8d16-07cf-4082-a442-fe3f19e94c4e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:21.548835 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-66dd8d16-07cf-4082-a442-fe3f19e94c4e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.683307 Oct 29 01:40:21.551354 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3256/6277] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:20 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:40:21.576617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f8a4db55-4c43-41f2-a87a-fad0c1c69d05 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:21.578591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f8a4db55-4c43-41f2-a87a-fad0c1c69d05 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:21.585018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8a4db55-4c43-41f2-a87a-fad0c1c69d05 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:21.585687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8a4db55-4c43-41f2-a87a-fad0c1c69d05 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:21.586452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8a4db55-4c43-41f2-a87a-fad0c1c69d05 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:21.587332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8a4db55-4c43-41f2-a87a-fad0c1c69d05 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:21.587943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8a4db55-4c43-41f2-a87a-fad0c1c69d05 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:21.588510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8a4db55-4c43-41f2-a87a-fad0c1c69d05 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:21.830024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-44ecdda1-7337-42ff-ad7a-3e20b697baf5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:21.830932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-44ecdda1-7337-42ff-ad7a-3e20b697baf5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:21.845676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44ecdda1-7337-42ff-ad7a-3e20b697baf5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:21.846961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44ecdda1-7337-42ff-ad7a-3e20b697baf5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:21.849895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44ecdda1-7337-42ff-ad7a-3e20b697baf5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:21.850825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44ecdda1-7337-42ff-ad7a-3e20b697baf5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:21.851461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44ecdda1-7337-42ff-ad7a-3e20b697baf5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:21.853520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-44ecdda1-7337-42ff-ad7a-3e20b697baf5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:22.582409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f8a4db55-4c43-41f2-a87a-fad0c1c69d05 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:22.591117 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f8a4db55-4c43-41f2-a87a-fad0c1c69d05 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 1.018387 Oct 29 01:40:22.596733 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3022/6278] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:21 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:22.603121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-45e86fed-5dcc-4be0-869f-13f72dde07d9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:22.607252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-45e86fed-5dcc-4be0-869f-13f72dde07d9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:22.631803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45e86fed-5dcc-4be0-869f-13f72dde07d9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:22.633948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-44ecdda1-7337-42ff-ad7a-3e20b697baf5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:22.634442 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45e86fed-5dcc-4be0-869f-13f72dde07d9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:22.638112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45e86fed-5dcc-4be0-869f-13f72dde07d9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:22.638112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45e86fed-5dcc-4be0-869f-13f72dde07d9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:22.638112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45e86fed-5dcc-4be0-869f-13f72dde07d9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:22.638112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45e86fed-5dcc-4be0-869f-13f72dde07d9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:22.649196 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-44ecdda1-7337-42ff-ad7a-3e20b697baf5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1687 microversion: 2.1 time: 0.820389 Oct 29 01:40:22.650086 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3257/6279] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:21 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1687 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:22.655114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b29d6530-f3ce-4658-bebf-782683a5f47c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:22.665496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b29d6530-f3ce-4658-bebf-782683a5f47c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:22.672457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b29d6530-f3ce-4658-bebf-782683a5f47c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:22.673739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b29d6530-f3ce-4658-bebf-782683a5f47c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:22.674176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b29d6530-f3ce-4658-bebf-782683a5f47c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:22.677430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:40:22.686313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b29d6530-f3ce-4658-bebf-782683a5f47c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:22.686860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b29d6530-f3ce-4658-bebf-782683a5f47c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:22.687298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b29d6530-f3ce-4658-bebf-782683a5f47c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:22.806168 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-45e86fed-5dcc-4be0-869f-13f72dde07d9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:22.817191 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-45e86fed-5dcc-4be0-869f-13f72dde07d9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1350 microversion: 2.1 time: 0.218868 Oct 29 01:40:22.819193 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3023/6280] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:22 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1350 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:23.085635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b29d6530-f3ce-4658-bebf-782683a5f47c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:23.096826 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b29d6530-f3ce-4658-bebf-782683a5f47c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.445444 Oct 29 01:40:23.098175 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3258/6281] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:22 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:23.119880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-608ff8d0-2272-4f44-9b65-0fa0025904d9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:23.120947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-608ff8d0-2272-4f44-9b65-0fa0025904d9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:23.129819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-608ff8d0-2272-4f44-9b65-0fa0025904d9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:23.130818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-608ff8d0-2272-4f44-9b65-0fa0025904d9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:23.131448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-608ff8d0-2272-4f44-9b65-0fa0025904d9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:23.137331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-eba5cb31-aa4a-41b3-815b-e2b7dd804914 req-7d477190-595f-45af-806f-9dfab49a0b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2e1d1e-3097-4c13-8eb9-c32fb30d4857", "name": "network-vif-unplugged", "status": "completed", "tag": "46e11602-6278-473b-906b-a860e498b401"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:23.142317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-608ff8d0-2272-4f44-9b65-0fa0025904d9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:23.144121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-608ff8d0-2272-4f44-9b65-0fa0025904d9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:23.146200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-608ff8d0-2272-4f44-9b65-0fa0025904d9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:23.157693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-eba5cb31-aa4a-41b3-815b-e2b7dd804914 req-7d477190-595f-45af-806f-9dfab49a0b0b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:23.158180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-eba5cb31-aa4a-41b3-815b-e2b7dd804914 req-7d477190-595f-45af-806f-9dfab49a0b0b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:23.161189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-eba5cb31-aa4a-41b3-815b-e2b7dd804914 req-7d477190-595f-45af-806f-9dfab49a0b0b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:23.188419 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-eba5cb31-aa4a-41b3-815b-e2b7dd804914 req-7d477190-595f-45af-806f-9dfab49a0b0b service nova] Creating event network-vif-unplugged:46e11602-6278-473b-906b-a860e498b401 for instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 on n-h1-862964-3 Oct 29 01:40:23.207604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [req-eba5cb31-aa4a-41b3-815b-e2b7dd804914 req-7d477190-595f-45af-806f-9dfab49a0b0b service nova] Instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121099) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:40:23.230418 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-eba5cb31-aa4a-41b3-815b-e2b7dd804914 req-7d477190-595f-45af-806f-9dfab49a0b0b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096815 Oct 29 01:40:23.232000 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3259/6282] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:40:23.680607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-608ff8d0-2272-4f44-9b65-0fa0025904d9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:23.681778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3d0a0090-bcc7-45ff-9e25-73605423ef92 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:23.682480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3d0a0090-bcc7-45ff-9e25-73605423ef92 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:23.691833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d0a0090-bcc7-45ff-9e25-73605423ef92 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:23.692443 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-608ff8d0-2272-4f44-9b65-0fa0025904d9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.576499 Oct 29 01:40:23.692589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d0a0090-bcc7-45ff-9e25-73605423ef92 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:23.692909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d0a0090-bcc7-45ff-9e25-73605423ef92 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:23.694274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d0a0090-bcc7-45ff-9e25-73605423ef92 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:23.694761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d0a0090-bcc7-45ff-9e25-73605423ef92 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:23.695241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3d0a0090-bcc7-45ff-9e25-73605423ef92 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:23.713367 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3024/6283] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:23 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:23.719380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-afafb742-7b08-479f-96aa-74e058101393 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:23.729697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-afafb742-7b08-479f-96aa-74e058101393 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:23.739812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:40:23.747677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afafb742-7b08-479f-96aa-74e058101393 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:23.749419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afafb742-7b08-479f-96aa-74e058101393 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:23.750126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afafb742-7b08-479f-96aa-74e058101393 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:23.751219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afafb742-7b08-479f-96aa-74e058101393 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:23.751931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afafb742-7b08-479f-96aa-74e058101393 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:23.753898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afafb742-7b08-479f-96aa-74e058101393 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:24.349536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3d0a0090-bcc7-45ff-9e25-73605423ef92 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:24.359450 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3d0a0090-bcc7-45ff-9e25-73605423ef92 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1687 microversion: 2.1 time: 0.682104 Oct 29 01:40:24.360808 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3260/6284] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:23 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1687 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:40:24.374659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e6348ab4-0210-462d-8786-ab64c89530a4 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:24.377912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e6348ab4-0210-462d-8786-ab64c89530a4 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:24.393167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6348ab4-0210-462d-8786-ab64c89530a4 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:24.393674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6348ab4-0210-462d-8786-ab64c89530a4 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:24.398383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6348ab4-0210-462d-8786-ab64c89530a4 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:24.399175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6348ab4-0210-462d-8786-ab64c89530a4 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:24.399660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6348ab4-0210-462d-8786-ab64c89530a4 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:24.400096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6348ab4-0210-462d-8786-ab64c89530a4 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:24.453206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-afafb742-7b08-479f-96aa-74e058101393 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:24.465759 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-afafb742-7b08-479f-96aa-74e058101393 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.750770 Oct 29 01:40:24.481426 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3025/6285] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:23 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:24.595023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e6348ab4-0210-462d-8786-ab64c89530a4 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:24.603579 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e6348ab4-0210-462d-8786-ab64c89530a4 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1350 microversion: 2.1 time: 0.240952 Oct 29 01:40:24.604398 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3261/6286] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:24 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1350 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:25.387143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-65e1fac8-947a-41b1-aba7-dc57221a005b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:25.391494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-65e1fac8-947a-41b1-aba7-dc57221a005b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:25.408127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65e1fac8-947a-41b1-aba7-dc57221a005b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:25.408628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65e1fac8-947a-41b1-aba7-dc57221a005b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:25.409351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65e1fac8-947a-41b1-aba7-dc57221a005b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:25.410254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65e1fac8-947a-41b1-aba7-dc57221a005b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:25.410915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65e1fac8-947a-41b1-aba7-dc57221a005b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:25.411666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65e1fac8-947a-41b1-aba7-dc57221a005b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:25.612993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-d5c985b4-f92d-411e-920e-f0f0eba5f826 req-8900af19-8393-4030-8538-51d54c17f6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2e1d1e-3097-4c13-8eb9-c32fb30d4857", "tag": "46e11602-6278-473b-906b-a860e498b401"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:25.640885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d5c985b4-f92d-411e-920e-f0f0eba5f826 req-8900af19-8393-4030-8538-51d54c17f6d7 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:25.642368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d5c985b4-f92d-411e-920e-f0f0eba5f826 req-8900af19-8393-4030-8538-51d54c17f6d7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:25.642993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d5c985b4-f92d-411e-920e-f0f0eba5f826 req-8900af19-8393-4030-8538-51d54c17f6d7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:25.668234 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-d5c985b4-f92d-411e-920e-f0f0eba5f826 req-8900af19-8393-4030-8538-51d54c17f6d7 service nova] Creating event network-changed:46e11602-6278-473b-906b-a860e498b401 for instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 on n-h1-862964-3 Oct 29 01:40:25.675809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [req-d5c985b4-f92d-411e-920e-f0f0eba5f826 req-8900af19-8393-4030-8538-51d54c17f6d7 service nova] Instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121099) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 01:40:25.688179 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-d5c985b4-f92d-411e-920e-f0f0eba5f826 req-8900af19-8393-4030-8538-51d54c17f6d7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080916 Oct 29 01:40:25.689243 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3262/6287] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:40:25.694808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f7e8c2eb-a4e5-49a6-951b-fbc457956195 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:25.695520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f7e8c2eb-a4e5-49a6-951b-fbc457956195 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:25.705372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7e8c2eb-a4e5-49a6-951b-fbc457956195 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:25.705372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7e8c2eb-a4e5-49a6-951b-fbc457956195 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:25.705372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7e8c2eb-a4e5-49a6-951b-fbc457956195 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:25.705372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7e8c2eb-a4e5-49a6-951b-fbc457956195 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:25.705372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7e8c2eb-a4e5-49a6-951b-fbc457956195 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:25.705775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7e8c2eb-a4e5-49a6-951b-fbc457956195 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:25.904131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-65e1fac8-947a-41b1-aba7-dc57221a005b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:25.921249 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-65e1fac8-947a-41b1-aba7-dc57221a005b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1687 microversion: 2.1 time: 0.539004 Oct 29 01:40:25.923444 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3026/6288] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:25 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1687 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:26.317019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f7e8c2eb-a4e5-49a6-951b-fbc457956195 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:26.343941 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f7e8c2eb-a4e5-49a6-951b-fbc457956195 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1470 microversion: 2.1 time: 0.650356 Oct 29 01:40:26.346750 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3263/6289] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:25 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1470 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:26.954434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b5e414ad-4eb9-4766-b44b-29414244b8e8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:26.954434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b5e414ad-4eb9-4766-b44b-29414244b8e8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:26.961936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5e414ad-4eb9-4766-b44b-29414244b8e8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:26.962425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5e414ad-4eb9-4766-b44b-29414244b8e8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:26.963048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5e414ad-4eb9-4766-b44b-29414244b8e8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:26.963920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5e414ad-4eb9-4766-b44b-29414244b8e8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:26.964383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5e414ad-4eb9-4766-b44b-29414244b8e8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:26.964814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5e414ad-4eb9-4766-b44b-29414244b8e8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:27.371113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-991d4246-fb43-44f7-a092-f0a4d871166d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:27.372661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-991d4246-fb43-44f7-a092-f0a4d871166d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:27.381700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b5e414ad-4eb9-4766-b44b-29414244b8e8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:27.397314 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b5e414ad-4eb9-4766-b44b-29414244b8e8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1687 microversion: 2.1 time: 0.451113 Oct 29 01:40:27.400802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-991d4246-fb43-44f7-a092-f0a4d871166d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:27.401892 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3027/6290] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:26 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1687 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:27.402673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-991d4246-fb43-44f7-a092-f0a4d871166d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:27.403360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-991d4246-fb43-44f7-a092-f0a4d871166d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:27.404731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-991d4246-fb43-44f7-a092-f0a4d871166d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:27.406030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-991d4246-fb43-44f7-a092-f0a4d871166d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:27.406772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-991d4246-fb43-44f7-a092-f0a4d871166d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:27.740205 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-991d4246-fb43-44f7-a092-f0a4d871166d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:27.761706 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-991d4246-fb43-44f7-a092-f0a4d871166d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1470 microversion: 2.1 time: 0.395152 Oct 29 01:40:27.782134 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3264/6291] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:27 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1470 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:40:28.023573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-24f2e97c-b5d9-45e3-b778-fb7091117302 req-7f922ddc-9b8e-458f-b63f-9c102fb50727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93de6bc3-3869-4da6-aab7-800addd62dfe", "tag": "67eaff49-cb1c-4c31-8124-a15fd8d313cf"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:28.046849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-24f2e97c-b5d9-45e3-b778-fb7091117302 req-7f922ddc-9b8e-458f-b63f-9c102fb50727 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:28.049835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-24f2e97c-b5d9-45e3-b778-fb7091117302 req-7f922ddc-9b8e-458f-b63f-9c102fb50727 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:28.050287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-24f2e97c-b5d9-45e3-b778-fb7091117302 req-7f922ddc-9b8e-458f-b63f-9c102fb50727 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:28.078162 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-24f2e97c-b5d9-45e3-b778-fb7091117302 req-7f922ddc-9b8e-458f-b63f-9c102fb50727 service nova] Creating event network-changed:67eaff49-cb1c-4c31-8124-a15fd8d313cf for instance 93de6bc3-3869-4da6-aab7-800addd62dfe on n-h1-862964-3 Oct 29 01:40:28.092831 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-24f2e97c-b5d9-45e3-b778-fb7091117302 req-7f922ddc-9b8e-458f-b63f-9c102fb50727 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072785 Oct 29 01:40:28.093983 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3028/6292] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:40:28.430006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c2999628-7d04-46db-b28c-a5efb38b8bb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:28.431336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c2999628-7d04-46db-b28c-a5efb38b8bb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:28.434815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:40:28.437011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:40:28.443703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2999628-7d04-46db-b28c-a5efb38b8bb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:28.444206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2999628-7d04-46db-b28c-a5efb38b8bb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:28.444640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2999628-7d04-46db-b28c-a5efb38b8bb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:28.445549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2999628-7d04-46db-b28c-a5efb38b8bb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:28.446167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2999628-7d04-46db-b28c-a5efb38b8bb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:28.446771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2999628-7d04-46db-b28c-a5efb38b8bb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:28.483434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-626364f2-9a47-4e61-813d-26ece4b62147 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1188685477", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "2d1e2427-ccf0-46a7-a645-cae2d349f968"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:28.556947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-626364f2-9a47-4e61-813d-26ece4b62147 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] validate_networks() for [('2d1e2427-ccf0-46a7-a645-cae2d349f968', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:40:28.686390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c2999628-7d04-46db-b28c-a5efb38b8bb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:28.696178 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c2999628-7d04-46db-b28c-a5efb38b8bb0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1687 microversion: 2.1 time: 0.270259 Oct 29 01:40:28.697093 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3265/6293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:28 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1687 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:28.808497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6578afe3-670e-4a53-9001-08377ec04361 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:28.809261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6578afe3-670e-4a53-9001-08377ec04361 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:28.823542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6578afe3-670e-4a53-9001-08377ec04361 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:28.825877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6578afe3-670e-4a53-9001-08377ec04361 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:28.826510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6578afe3-670e-4a53-9001-08377ec04361 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:28.828266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6578afe3-670e-4a53-9001-08377ec04361 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:28.828736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6578afe3-670e-4a53-9001-08377ec04361 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:28.829183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6578afe3-670e-4a53-9001-08377ec04361 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:29.082808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6578afe3-670e-4a53-9001-08377ec04361 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:29.091097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-626364f2-9a47-4e61-813d-26ece4b62147 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:40:29.091097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-626364f2-9a47-4e61-813d-26ece4b62147 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:40:29.091097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-626364f2-9a47-4e61-813d-26ece4b62147 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:40:29.091097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-626364f2-9a47-4e61-813d-26ece4b62147 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:40:29.093507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-626364f2-9a47-4e61-813d-26ece4b62147 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:40:29.100107 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6578afe3-670e-4a53-9001-08377ec04361 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1470 microversion: 2.1 time: 0.296065 Oct 29 01:40:29.116706 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3266/6294] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:28 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1470 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:40:29.131988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-626364f2-9a47-4e61-813d-26ece4b62147 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:29.132490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-626364f2-9a47-4e61-813d-26ece4b62147 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:29.132935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-626364f2-9a47-4e61-813d-26ece4b62147 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:29.134116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-626364f2-9a47-4e61-813d-26ece4b62147 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:29.134587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-626364f2-9a47-4e61-813d-26ece4b62147 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:29.138779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-626364f2-9a47-4e61-813d-26ece4b62147 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:29.181385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-626364f2-9a47-4e61-813d-26ece4b62147 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Getting quotas for project db565e2216be404ebae26f30b2ef2199. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:40:29.187379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-626364f2-9a47-4e61-813d-26ece4b62147 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Getting quotas for user 84d9aee15dd34a20bba11a5b550933d6 and project db565e2216be404ebae26f30b2ef2199. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:40:29.203600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-626364f2-9a47-4e61-813d-26ece4b62147 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:40:29.203724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-626364f2-9a47-4e61-813d-26ece4b62147 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:40:29.441417 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-626364f2-9a47-4e61-813d-26ece4b62147 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.964432 Oct 29 01:40:29.442940 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3029/6295] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:40:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:40:29.463715 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2d518bea-e00f-40fa-b4cc-043ad2ae696f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:29.464352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2d518bea-e00f-40fa-b4cc-043ad2ae696f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:29.471003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=8 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:40:29.548381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2d518bea-e00f-40fa-b4cc-043ad2ae696f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:29.555675 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2d518bea-e00f-40fa-b4cc-043ad2ae696f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1" status: 200 len: 1214 microversion: 2.1 time: 0.096381 Oct 29 01:40:29.556263 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3267/6296] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:29 2022] GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:29.722643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b464a5d0-9ffb-4fc1-a3c1-90e99753888e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:29.723265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b464a5d0-9ffb-4fc1-a3c1-90e99753888e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:29.731472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b464a5d0-9ffb-4fc1-a3c1-90e99753888e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:29.732195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b464a5d0-9ffb-4fc1-a3c1-90e99753888e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:29.732845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b464a5d0-9ffb-4fc1-a3c1-90e99753888e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:29.734596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b464a5d0-9ffb-4fc1-a3c1-90e99753888e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:29.735230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b464a5d0-9ffb-4fc1-a3c1-90e99753888e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:29.738943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b464a5d0-9ffb-4fc1-a3c1-90e99753888e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:29.942699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b464a5d0-9ffb-4fc1-a3c1-90e99753888e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:29.951850 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b464a5d0-9ffb-4fc1-a3c1-90e99753888e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1687 microversion: 2.1 time: 0.234386 Oct 29 01:40:29.953736 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3030/6297] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:29 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1687 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:30.126565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3a32ddb1-3735-4c9f-a45d-decc971eb84d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:30.128035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3a32ddb1-3735-4c9f-a45d-decc971eb84d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:30.142327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a32ddb1-3735-4c9f-a45d-decc971eb84d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:30.143184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a32ddb1-3735-4c9f-a45d-decc971eb84d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:30.143877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a32ddb1-3735-4c9f-a45d-decc971eb84d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:30.144826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a32ddb1-3735-4c9f-a45d-decc971eb84d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:30.145533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a32ddb1-3735-4c9f-a45d-decc971eb84d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:30.146365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a32ddb1-3735-4c9f-a45d-decc971eb84d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:30.405190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3a32ddb1-3735-4c9f-a45d-decc971eb84d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:30.427374 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3a32ddb1-3735-4c9f-a45d-decc971eb84d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1470 microversion: 2.1 time: 0.305898 Oct 29 01:40:30.429598 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3268/6298] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:30 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1470 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:30.580983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-887be6c5-71ce-473c-a13a-b13128367b99 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:30.584474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-887be6c5-71ce-473c-a13a-b13128367b99 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:30.979439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-12a1efdd-1f22-4c93-83e0-0a3d6f0ebcef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:30.979439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-12a1efdd-1f22-4c93-83e0-0a3d6f0ebcef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:30.990529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12a1efdd-1f22-4c93-83e0-0a3d6f0ebcef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:30.993040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12a1efdd-1f22-4c93-83e0-0a3d6f0ebcef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:30.993622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12a1efdd-1f22-4c93-83e0-0a3d6f0ebcef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:30.994466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12a1efdd-1f22-4c93-83e0-0a3d6f0ebcef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:30.999776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12a1efdd-1f22-4c93-83e0-0a3d6f0ebcef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:31.000563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-12a1efdd-1f22-4c93-83e0-0a3d6f0ebcef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:31.444510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-887be6c5-71ce-473c-a13a-b13128367b99 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:31.461296 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-887be6c5-71ce-473c-a13a-b13128367b99 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1" status: 200 len: 1214 microversion: 2.1 time: 0.883336 Oct 29 01:40:31.463748 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3031/6299] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:30 2022] GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1 => generated 1214 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:31.481491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c6f2362e-1388-4909-9eae-ed6c5b465db2 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:31.484128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c6f2362e-1388-4909-9eae-ed6c5b465db2 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:31.521580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f2362e-1388-4909-9eae-ed6c5b465db2 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:31.522071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f2362e-1388-4909-9eae-ed6c5b465db2 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:31.522510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f2362e-1388-4909-9eae-ed6c5b465db2 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:31.523219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f2362e-1388-4909-9eae-ed6c5b465db2 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:31.523676 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f2362e-1388-4909-9eae-ed6c5b465db2 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:31.524099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f2362e-1388-4909-9eae-ed6c5b465db2 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:31.852822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-12a1efdd-1f22-4c93-83e0-0a3d6f0ebcef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:31.861912 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-12a1efdd-1f22-4c93-83e0-0a3d6f0ebcef tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1687 microversion: 2.1 time: 0.888514 Oct 29 01:40:31.874403 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3269/6300] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:30 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1687 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:40:32.134614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c6f2362e-1388-4909-9eae-ed6c5b465db2 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:32.152395 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c6f2362e-1388-4909-9eae-ed6c5b465db2 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1470 microversion: 2.1 time: 0.685218 Oct 29 01:40:32.152395 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3032/6301] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:31 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1470 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:32.489546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-99240ca0-63d4-47ff-b8cc-df32055818e0 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:32.491463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-99240ca0-63d4-47ff-b8cc-df32055818e0 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:32.528935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99240ca0-63d4-47ff-b8cc-df32055818e0 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:32.529630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99240ca0-63d4-47ff-b8cc-df32055818e0 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:32.530225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99240ca0-63d4-47ff-b8cc-df32055818e0 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:32.533603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99240ca0-63d4-47ff-b8cc-df32055818e0 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:32.533603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99240ca0-63d4-47ff-b8cc-df32055818e0 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:32.533603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99240ca0-63d4-47ff-b8cc-df32055818e0 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:32.683040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-99240ca0-63d4-47ff-b8cc-df32055818e0 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:32.692292 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-99240ca0-63d4-47ff-b8cc-df32055818e0 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1" status: 200 len: 1266 microversion: 2.1 time: 0.207377 Oct 29 01:40:32.693577 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3270/6302] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:32 2022] GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:32.901405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-49da1676-0d0e-408e-8254-a41979edbb3a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:32.902402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-49da1676-0d0e-408e-8254-a41979edbb3a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:32.918204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49da1676-0d0e-408e-8254-a41979edbb3a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:32.919726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49da1676-0d0e-408e-8254-a41979edbb3a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:32.921094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49da1676-0d0e-408e-8254-a41979edbb3a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:32.923310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49da1676-0d0e-408e-8254-a41979edbb3a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:32.925073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49da1676-0d0e-408e-8254-a41979edbb3a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:32.936870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49da1676-0d0e-408e-8254-a41979edbb3a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:33.174524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-df2318ea-acd8-4d26-bb7a-b13f97a01a17 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:33.175143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-df2318ea-acd8-4d26-bb7a-b13f97a01a17 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:33.195160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df2318ea-acd8-4d26-bb7a-b13f97a01a17 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:33.195695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df2318ea-acd8-4d26-bb7a-b13f97a01a17 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:33.196145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df2318ea-acd8-4d26-bb7a-b13f97a01a17 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:33.196892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df2318ea-acd8-4d26-bb7a-b13f97a01a17 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:33.205750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df2318ea-acd8-4d26-bb7a-b13f97a01a17 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:33.206610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df2318ea-acd8-4d26-bb7a-b13f97a01a17 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:33.628070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-49da1676-0d0e-408e-8254-a41979edbb3a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:33.640308 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-49da1676-0d0e-408e-8254-a41979edbb3a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1680 microversion: 2.1 time: 0.742448 Oct 29 01:40:33.641190 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3033/6303] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:32 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1680 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:33.657088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-df2318ea-acd8-4d26-bb7a-b13f97a01a17 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:33.675962 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-df2318ea-acd8-4d26-bb7a-b13f97a01a17 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1470 microversion: 2.1 time: 0.505579 Oct 29 01:40:33.677852 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3271/6304] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:33 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1470 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:40:33.716107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2fb3866f-b828-49bf-8f08-08110738f323 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:33.716829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2fb3866f-b828-49bf-8f08-08110738f323 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:33.729010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fb3866f-b828-49bf-8f08-08110738f323 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:33.731154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fb3866f-b828-49bf-8f08-08110738f323 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:33.731821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fb3866f-b828-49bf-8f08-08110738f323 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:33.732736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fb3866f-b828-49bf-8f08-08110738f323 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:33.737981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fb3866f-b828-49bf-8f08-08110738f323 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:33.738675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fb3866f-b828-49bf-8f08-08110738f323 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:33.834304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2fb3866f-b828-49bf-8f08-08110738f323 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:33.849711 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2fb3866f-b828-49bf-8f08-08110738f323 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1" status: 200 len: 1272 microversion: 2.1 time: 0.137282 Oct 29 01:40:33.853580 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3034/6305] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:33 2022] GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1 => generated 1272 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:34.706514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f5fd1936-b543-492c-a501-f46655d8a041 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:34.707878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f5fd1936-b543-492c-a501-f46655d8a041 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:34.720270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5fd1936-b543-492c-a501-f46655d8a041 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:34.721625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5fd1936-b543-492c-a501-f46655d8a041 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:34.722286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5fd1936-b543-492c-a501-f46655d8a041 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:34.723760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5fd1936-b543-492c-a501-f46655d8a041 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:34.728915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5fd1936-b543-492c-a501-f46655d8a041 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:34.737460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5fd1936-b543-492c-a501-f46655d8a041 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:34.881472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c0af554c-f75c-499d-b794-93670d4ffd2a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:34.882083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c0af554c-f75c-499d-b794-93670d4ffd2a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:34.897894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0af554c-f75c-499d-b794-93670d4ffd2a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:34.899887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0af554c-f75c-499d-b794-93670d4ffd2a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:34.903902 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0af554c-f75c-499d-b794-93670d4ffd2a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:34.904925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0af554c-f75c-499d-b794-93670d4ffd2a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:34.907027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0af554c-f75c-499d-b794-93670d4ffd2a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:34.907485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0af554c-f75c-499d-b794-93670d4ffd2a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:35.008683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f5fd1936-b543-492c-a501-f46655d8a041 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:35.017590 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f5fd1936-b543-492c-a501-f46655d8a041 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1470 microversion: 2.1 time: 0.317444 Oct 29 01:40:35.034887 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3272/6306] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:34 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1470 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:35.181504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c0af554c-f75c-499d-b794-93670d4ffd2a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:35.193801 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c0af554c-f75c-499d-b794-93670d4ffd2a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1" status: 200 len: 1314 microversion: 2.1 time: 0.317315 Oct 29 01:40:35.199377 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3035/6307] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:34 2022] GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:35.267001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4b6e010f-1668-431b-bbe8-1889f40c38db req-8165403e-7685-4f74-8b41-e17a34623fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2e1d1e-3097-4c13-8eb9-c32fb30d4857", "name": "network-vif-plugged", "status": "completed", "tag": "46e11602-6278-473b-906b-a860e498b401"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:35.283500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4b6e010f-1668-431b-bbe8-1889f40c38db req-8165403e-7685-4f74-8b41-e17a34623fba service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:35.283983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4b6e010f-1668-431b-bbe8-1889f40c38db req-8165403e-7685-4f74-8b41-e17a34623fba service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:35.285912 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4b6e010f-1668-431b-bbe8-1889f40c38db req-8165403e-7685-4f74-8b41-e17a34623fba service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:35.307531 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4b6e010f-1668-431b-bbe8-1889f40c38db req-8165403e-7685-4f74-8b41-e17a34623fba service nova] Creating event network-vif-plugged:46e11602-6278-473b-906b-a860e498b401 for instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 on n-h1-862964-3 Oct 29 01:40:35.318865 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4b6e010f-1668-431b-bbe8-1889f40c38db req-8165403e-7685-4f74-8b41-e17a34623fba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.282394 Oct 29 01:40:35.320614 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3273/6308] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:40:36.042526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7ae15e8f-128f-4a2e-b869-fc307b7484d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:36.043166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7ae15e8f-128f-4a2e-b869-fc307b7484d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:36.053498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ae15e8f-128f-4a2e-b869-fc307b7484d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:36.053993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ae15e8f-128f-4a2e-b869-fc307b7484d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:36.054427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ae15e8f-128f-4a2e-b869-fc307b7484d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:36.055378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ae15e8f-128f-4a2e-b869-fc307b7484d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:36.056001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ae15e8f-128f-4a2e-b869-fc307b7484d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:36.056446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ae15e8f-128f-4a2e-b869-fc307b7484d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:36.203235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-5549ca10-1cb8-40fa-a2bc-b61c7106698d req-7ce4673a-ee8b-4409-a12d-9f43c5e27807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c04599-2299-4d14-99b7-0139d9e144b1", "tag": "42ef8e3a-686f-4a07-9d23-16f61b679983"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:36.246365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5549ca10-1cb8-40fa-a2bc-b61c7106698d req-7ce4673a-ee8b-4409-a12d-9f43c5e27807 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:36.246951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5549ca10-1cb8-40fa-a2bc-b61c7106698d req-7ce4673a-ee8b-4409-a12d-9f43c5e27807 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:36.247389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5549ca10-1cb8-40fa-a2bc-b61c7106698d req-7ce4673a-ee8b-4409-a12d-9f43c5e27807 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:36.282320 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-5549ca10-1cb8-40fa-a2bc-b61c7106698d req-7ce4673a-ee8b-4409-a12d-9f43c5e27807 service nova] Creating event network-changed:42ef8e3a-686f-4a07-9d23-16f61b679983 for instance e3c04599-2299-4d14-99b7-0139d9e144b1 on n-h2-862964-3 Oct 29 01:40:36.301616 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-5549ca10-1cb8-40fa-a2bc-b61c7106698d req-7ce4673a-ee8b-4409-a12d-9f43c5e27807 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103489 Oct 29 01:40:36.302840 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3274/6309] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:40:36.336441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bf9eddd1-f040-4286-9603-f9d14b107bfe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:36.337575 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bf9eddd1-f040-4286-9603-f9d14b107bfe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:36.347848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf9eddd1-f040-4286-9603-f9d14b107bfe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:36.348456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf9eddd1-f040-4286-9603-f9d14b107bfe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:36.348965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf9eddd1-f040-4286-9603-f9d14b107bfe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:36.349780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf9eddd1-f040-4286-9603-f9d14b107bfe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:36.350322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf9eddd1-f040-4286-9603-f9d14b107bfe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:36.350872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bf9eddd1-f040-4286-9603-f9d14b107bfe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:36.398821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:40:36.754046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7ae15e8f-128f-4a2e-b869-fc307b7484d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:36.795599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bf9eddd1-f040-4286-9603-f9d14b107bfe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:36.812334 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7ae15e8f-128f-4a2e-b869-fc307b7484d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1470 microversion: 2.1 time: 0.773933 Oct 29 01:40:36.825254 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bf9eddd1-f040-4286-9603-f9d14b107bfe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1" status: 200 len: 1314 microversion: 2.1 time: 0.515575 Oct 29 01:40:36.826221 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3036/6310] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:36 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1470 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:40:36.843608 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3275/6311] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:36 2022] GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1 => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:37.857890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3cb2bed0-de52-4f35-b3cf-299c1e004885 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:37.858989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f5f91b0-9c37-40f8-b49f-fb457adf3181 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:37.860764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1f5f91b0-9c37-40f8-b49f-fb457adf3181 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:37.861375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3cb2bed0-de52-4f35-b3cf-299c1e004885 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:37.883221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3cb2bed0-de52-4f35-b3cf-299c1e004885 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:37.883726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3cb2bed0-de52-4f35-b3cf-299c1e004885 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:37.884154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3cb2bed0-de52-4f35-b3cf-299c1e004885 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:37.884878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3cb2bed0-de52-4f35-b3cf-299c1e004885 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:37.889812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f5f91b0-9c37-40f8-b49f-fb457adf3181 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:37.890309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f5f91b0-9c37-40f8-b49f-fb457adf3181 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:37.891184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f5f91b0-9c37-40f8-b49f-fb457adf3181 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:37.895007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3cb2bed0-de52-4f35-b3cf-299c1e004885 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:37.895842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3cb2bed0-de52-4f35-b3cf-299c1e004885 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:37.897996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f5f91b0-9c37-40f8-b49f-fb457adf3181 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:37.898495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f5f91b0-9c37-40f8-b49f-fb457adf3181 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:37.900462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f5f91b0-9c37-40f8-b49f-fb457adf3181 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:38.227947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3cb2bed0-de52-4f35-b3cf-299c1e004885 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:38.243079 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3cb2bed0-de52-4f35-b3cf-299c1e004885 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1" status: 200 len: 1314 microversion: 2.1 time: 0.388935 Oct 29 01:40:38.244461 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3037/6312] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:37 2022] GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:38.283201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1f5f91b0-9c37-40f8-b49f-fb457adf3181 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:38.294374 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1f5f91b0-9c37-40f8-b49f-fb457adf3181 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1470 microversion: 2.1 time: 0.444954 Oct 29 01:40:38.311514 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3276/6313] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:37 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1470 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:39.271350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5d0468d5-26c4-40da-bc8c-0f5bde1ddab1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:39.272028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5d0468d5-26c4-40da-bc8c-0f5bde1ddab1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:39.274849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:40:39.280912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d0468d5-26c4-40da-bc8c-0f5bde1ddab1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:39.281995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d0468d5-26c4-40da-bc8c-0f5bde1ddab1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:39.282447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d0468d5-26c4-40da-bc8c-0f5bde1ddab1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:39.283161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d0468d5-26c4-40da-bc8c-0f5bde1ddab1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:39.283784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d0468d5-26c4-40da-bc8c-0f5bde1ddab1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:39.284769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d0468d5-26c4-40da-bc8c-0f5bde1ddab1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:39.321248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ad033f5f-d1ab-41f0-b6b2-9299e1cd78e0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:39.321945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ad033f5f-d1ab-41f0-b6b2-9299e1cd78e0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:39.330138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad033f5f-d1ab-41f0-b6b2-9299e1cd78e0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:39.334988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad033f5f-d1ab-41f0-b6b2-9299e1cd78e0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:39.336669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad033f5f-d1ab-41f0-b6b2-9299e1cd78e0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:39.339631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad033f5f-d1ab-41f0-b6b2-9299e1cd78e0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:39.339631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad033f5f-d1ab-41f0-b6b2-9299e1cd78e0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:39.339631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad033f5f-d1ab-41f0-b6b2-9299e1cd78e0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:39.493785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5d0468d5-26c4-40da-bc8c-0f5bde1ddab1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:39.504986 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5d0468d5-26c4-40da-bc8c-0f5bde1ddab1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1" status: 200 len: 1314 microversion: 2.1 time: 0.237403 Oct 29 01:40:39.505662 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3038/6314] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:39 2022] GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:39.571699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ad033f5f-d1ab-41f0-b6b2-9299e1cd78e0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:39.581206 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ad033f5f-d1ab-41f0-b6b2-9299e1cd78e0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1470 microversion: 2.1 time: 0.264121 Oct 29 01:40:39.582061 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3277/6315] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:39 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1470 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:40.533228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8d823bc3-bd0a-46a3-bef1-7fd6d10dcf6f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:40.534333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8d823bc3-bd0a-46a3-bef1-7fd6d10dcf6f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:40.548433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d823bc3-bd0a-46a3-bef1-7fd6d10dcf6f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:40.548569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d823bc3-bd0a-46a3-bef1-7fd6d10dcf6f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:40.549085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d823bc3-bd0a-46a3-bef1-7fd6d10dcf6f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:40.549893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d823bc3-bd0a-46a3-bef1-7fd6d10dcf6f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:40.550423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d823bc3-bd0a-46a3-bef1-7fd6d10dcf6f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:40.550935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d823bc3-bd0a-46a3-bef1-7fd6d10dcf6f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:40.603827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9fd08bc3-2621-4e4c-b898-e6d967aff796 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:40.605096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9fd08bc3-2621-4e4c-b898-e6d967aff796 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:40.613207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:40:40.617117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd08bc3-2621-4e4c-b898-e6d967aff796 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:40.617928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd08bc3-2621-4e4c-b898-e6d967aff796 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:40.618583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd08bc3-2621-4e4c-b898-e6d967aff796 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:40.619536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd08bc3-2621-4e4c-b898-e6d967aff796 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:40.621528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd08bc3-2621-4e4c-b898-e6d967aff796 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:40.622175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd08bc3-2621-4e4c-b898-e6d967aff796 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:40.799106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8d823bc3-bd0a-46a3-bef1-7fd6d10dcf6f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:40.812419 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8d823bc3-bd0a-46a3-bef1-7fd6d10dcf6f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1" status: 200 len: 1314 microversion: 2.1 time: 0.284285 Oct 29 01:40:40.814056 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3039/6316] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:40 2022] GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:40.875564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9fd08bc3-2621-4e4c-b898-e6d967aff796 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:40.901144 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9fd08bc3-2621-4e4c-b898-e6d967aff796 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1470 microversion: 2.1 time: 0.300693 Oct 29 01:40:40.902496 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3278/6317] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:40 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1470 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:41.011263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-6ed1cdfb-cc33-49f3-ab91-a74097ef50d3 req-d6c66d61-fb1d-4f8d-8db0-09f053439c69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93de6bc3-3869-4da6-aab7-800addd62dfe", "name": "network-vif-plugged", "status": "completed", "tag": "67eaff49-cb1c-4c31-8124-a15fd8d313cf"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:41.023251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6ed1cdfb-cc33-49f3-ab91-a74097ef50d3 req-d6c66d61-fb1d-4f8d-8db0-09f053439c69 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:41.023814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6ed1cdfb-cc33-49f3-ab91-a74097ef50d3 req-d6c66d61-fb1d-4f8d-8db0-09f053439c69 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:41.024331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6ed1cdfb-cc33-49f3-ab91-a74097ef50d3 req-d6c66d61-fb1d-4f8d-8db0-09f053439c69 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:41.039464 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-6ed1cdfb-cc33-49f3-ab91-a74097ef50d3 req-d6c66d61-fb1d-4f8d-8db0-09f053439c69 service nova] Creating event network-vif-plugged:67eaff49-cb1c-4c31-8124-a15fd8d313cf for instance 93de6bc3-3869-4da6-aab7-800addd62dfe on n-h1-862964-3 Oct 29 01:40:41.046022 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-6ed1cdfb-cc33-49f3-ab91-a74097ef50d3 req-d6c66d61-fb1d-4f8d-8db0-09f053439c69 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038082 Oct 29 01:40:41.053583 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3040/6318] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:40:41.859829 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-711c5dc2-d292-47c2-a767-e67450fe3eb1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:41.861124 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-711c5dc2-d292-47c2-a767-e67450fe3eb1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:41.868354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-711c5dc2-d292-47c2-a767-e67450fe3eb1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:41.868875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-711c5dc2-d292-47c2-a767-e67450fe3eb1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:41.869343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-711c5dc2-d292-47c2-a767-e67450fe3eb1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:41.870047 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-711c5dc2-d292-47c2-a767-e67450fe3eb1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:41.870513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-711c5dc2-d292-47c2-a767-e67450fe3eb1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:41.870940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-711c5dc2-d292-47c2-a767-e67450fe3eb1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:41.928389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4067bf06-50fd-4c91-b71e-aa3aead4aba8 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:41.929739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4067bf06-50fd-4c91-b71e-aa3aead4aba8 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:41.931825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:40:41.939022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4067bf06-50fd-4c91-b71e-aa3aead4aba8 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:41.939514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4067bf06-50fd-4c91-b71e-aa3aead4aba8 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:41.939947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4067bf06-50fd-4c91-b71e-aa3aead4aba8 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:41.940654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4067bf06-50fd-4c91-b71e-aa3aead4aba8 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:41.941102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4067bf06-50fd-4c91-b71e-aa3aead4aba8 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:41.941569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4067bf06-50fd-4c91-b71e-aa3aead4aba8 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:42.106641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-711c5dc2-d292-47c2-a767-e67450fe3eb1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:42.119974 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-711c5dc2-d292-47c2-a767-e67450fe3eb1 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1" status: 200 len: 1314 microversion: 2.1 time: 0.261950 Oct 29 01:40:42.133962 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3279/6319] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:41 2022] GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:42.150789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4067bf06-50fd-4c91-b71e-aa3aead4aba8 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:42.159512 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4067bf06-50fd-4c91-b71e-aa3aead4aba8 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1470 microversion: 2.1 time: 0.235764 Oct 29 01:40:42.160402 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3041/6320] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:41 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1470 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:40:42.478584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a3a3f1b8-cf36-46e2-9b20-eda2b9a14711 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-539376981", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7eaf4f6e-0b95-4e0a-80dd-a9470f73cce8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d488ed61-ddc0-4d3b-9833-017b49869cf3"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:42.544719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-a3a3f1b8-cf36-46e2-9b20-eda2b9a14711 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] validate_networks() for [('d488ed61-ddc0-4d3b-9833-017b49869cf3', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:40:42.971147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-a3a3f1b8-cf36-46e2-9b20-eda2b9a14711 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:40:42.973253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-a3a3f1b8-cf36-46e2-9b20-eda2b9a14711 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:40:42.973253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-a3a3f1b8-cf36-46e2-9b20-eda2b9a14711 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:40:42.973253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-a3a3f1b8-cf36-46e2-9b20-eda2b9a14711 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:40:42.973253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-a3a3f1b8-cf36-46e2-9b20-eda2b9a14711 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:40:42.982337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3a3f1b8-cf36-46e2-9b20-eda2b9a14711 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:42.983353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3a3f1b8-cf36-46e2-9b20-eda2b9a14711 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:42.984113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3a3f1b8-cf36-46e2-9b20-eda2b9a14711 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:42.984854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3a3f1b8-cf36-46e2-9b20-eda2b9a14711 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:42.985467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3a3f1b8-cf36-46e2-9b20-eda2b9a14711 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:42.986120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3a3f1b8-cf36-46e2-9b20-eda2b9a14711 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:43.006590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-a3a3f1b8-cf36-46e2-9b20-eda2b9a14711 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Getting quotas for project 37416a9397fa4c6dbd0bfe8dee191577. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:40:43.012320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-a3a3f1b8-cf36-46e2-9b20-eda2b9a14711 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Getting quotas for user 8b8f36d10fa340f784581a3cf9a15606 and project 37416a9397fa4c6dbd0bfe8dee191577. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:40:43.072162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a3a3f1b8-cf36-46e2-9b20-eda2b9a14711 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:40:43.074316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a3a3f1b8-cf36-46e2-9b20-eda2b9a14711 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7eaf4f6e-0b95-4e0a-80dd-a9470f73cce8',volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:40:43.144768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4a76e08e-6c58-4dd2-9bbb-4f80123bcfe5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:43.145486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4a76e08e-6c58-4dd2-9bbb-4f80123bcfe5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:43.152488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a76e08e-6c58-4dd2-9bbb-4f80123bcfe5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:43.152986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a76e08e-6c58-4dd2-9bbb-4f80123bcfe5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:43.153482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a76e08e-6c58-4dd2-9bbb-4f80123bcfe5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:43.154178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a76e08e-6c58-4dd2-9bbb-4f80123bcfe5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:43.154656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a76e08e-6c58-4dd2-9bbb-4f80123bcfe5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:43.155821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a76e08e-6c58-4dd2-9bbb-4f80123bcfe5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:43.297374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4a76e08e-6c58-4dd2-9bbb-4f80123bcfe5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:43.306131 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4a76e08e-6c58-4dd2-9bbb-4f80123bcfe5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1" status: 200 len: 1314 microversion: 2.1 time: 0.165540 Oct 29 01:40:43.307258 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3042/6321] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:43 2022] GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:40:43.313505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c1c256c9-5820-4e59-b8e4-5e6e579168f0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:43.314862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c1c256c9-5820-4e59-b8e4-5e6e579168f0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:43.322602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1c256c9-5820-4e59-b8e4-5e6e579168f0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:43.323377 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1c256c9-5820-4e59-b8e4-5e6e579168f0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:43.324048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1c256c9-5820-4e59-b8e4-5e6e579168f0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:43.324769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1c256c9-5820-4e59-b8e4-5e6e579168f0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:43.325550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1c256c9-5820-4e59-b8e4-5e6e579168f0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:43.325734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1c256c9-5820-4e59-b8e4-5e6e579168f0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:43.331546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:40:43.486476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c1c256c9-5820-4e59-b8e4-5e6e579168f0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:43.494331 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c1c256c9-5820-4e59-b8e4-5e6e579168f0 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1642 microversion: 2.1 time: 0.185780 Oct 29 01:40:43.494919 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3043/6322] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:43 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1642 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:43.500108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-982ad9bb-8020-400c-9f34-6f5380cfd8c5 req-defd9c93-243b-49e6-98e5-979b4b33c904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c04599-2299-4d14-99b7-0139d9e144b1", "name": "network-vif-plugged", "status": "completed", "tag": "42ef8e3a-686f-4a07-9d23-16f61b679983"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:43.509780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-982ad9bb-8020-400c-9f34-6f5380cfd8c5 req-defd9c93-243b-49e6-98e5-979b4b33c904 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:43.510259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-982ad9bb-8020-400c-9f34-6f5380cfd8c5 req-defd9c93-243b-49e6-98e5-979b4b33c904 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:43.510687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-982ad9bb-8020-400c-9f34-6f5380cfd8c5 req-defd9c93-243b-49e6-98e5-979b4b33c904 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:43.535910 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-982ad9bb-8020-400c-9f34-6f5380cfd8c5 req-defd9c93-243b-49e6-98e5-979b4b33c904 service nova] Creating event network-vif-plugged:42ef8e3a-686f-4a07-9d23-16f61b679983 for instance e3c04599-2299-4d14-99b7-0139d9e144b1 on n-h2-862964-3 Oct 29 01:40:43.542021 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-982ad9bb-8020-400c-9f34-6f5380cfd8c5 req-defd9c93-243b-49e6-98e5-979b4b33c904 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045920 Oct 29 01:40:43.542697 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3044/6323] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:40:43.550960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bff74ba0-3401-4708-b850-7978db2e1c79 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:43.550960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bff74ba0-3401-4708-b850-7978db2e1c79 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:43.556870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bff74ba0-3401-4708-b850-7978db2e1c79 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:43.557459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bff74ba0-3401-4708-b850-7978db2e1c79 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:43.557956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bff74ba0-3401-4708-b850-7978db2e1c79 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:43.558650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bff74ba0-3401-4708-b850-7978db2e1c79 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:43.559105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bff74ba0-3401-4708-b850-7978db2e1c79 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:43.559529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bff74ba0-3401-4708-b850-7978db2e1c79 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:43.673918 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a3a3f1b8-cf36-46e2-9b20-eda2b9a14711 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.199115 Oct 29 01:40:43.674932 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3280/6324] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:40:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:40:43.704885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f78227df-d1e9-41c0-b6f1-6ac73e9ea80a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:43.705540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f78227df-d1e9-41c0-b6f1-6ac73e9ea80a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:43.800409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f78227df-d1e9-41c0-b6f1-6ac73e9ea80a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:43.809631 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f78227df-d1e9-41c0-b6f1-6ac73e9ea80a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1056 microversion: 2.1 time: 0.118946 Oct 29 01:40:43.810528 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3281/6325] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:43 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1056 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:43.832560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bff74ba0-3401-4708-b850-7978db2e1c79 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:43.840988 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bff74ba0-3401-4708-b850-7978db2e1c79 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1642 microversion: 2.1 time: 0.296924 Oct 29 01:40:43.848341 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3045/6326] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:43 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1642 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:43.864853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-076aab5b-403d-4e8c-b339-fa67fa740a9a tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:43.865505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-076aab5b-403d-4e8c-b339-fa67fa740a9a tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:43.872455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-076aab5b-403d-4e8c-b339-fa67fa740a9a tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:43.872943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-076aab5b-403d-4e8c-b339-fa67fa740a9a tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:43.874152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-076aab5b-403d-4e8c-b339-fa67fa740a9a tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:43.875013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-076aab5b-403d-4e8c-b339-fa67fa740a9a tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:43.875574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-076aab5b-403d-4e8c-b339-fa67fa740a9a tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:43.877517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-076aab5b-403d-4e8c-b339-fa67fa740a9a tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:44.305017 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-076aab5b-403d-4e8c-b339-fa67fa740a9a tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1793 microversion: 2.1 time: 0.440042 Oct 29 01:40:44.309223 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3282/6327] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:43 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1793 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:44.338643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-116f91ec-a698-4254-b89e-9fe77601fb69 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:44.339356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-116f91ec-a698-4254-b89e-9fe77601fb69 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:44.350860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-116f91ec-a698-4254-b89e-9fe77601fb69 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:44.352704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-116f91ec-a698-4254-b89e-9fe77601fb69 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:44.352704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-116f91ec-a698-4254-b89e-9fe77601fb69 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:44.352704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-116f91ec-a698-4254-b89e-9fe77601fb69 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:44.353288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-116f91ec-a698-4254-b89e-9fe77601fb69 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:44.353972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-116f91ec-a698-4254-b89e-9fe77601fb69 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:44.651036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-116f91ec-a698-4254-b89e-9fe77601fb69 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:44.660279 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-116f91ec-a698-4254-b89e-9fe77601fb69 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1" status: 200 len: 1314 microversion: 2.1 time: 0.333322 Oct 29 01:40:44.660926 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3046/6328] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:44 2022] GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:44.834437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e33589ed-d5c6-41fb-97b8-c17073f20f07 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:44.835354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e33589ed-d5c6-41fb-97b8-c17073f20f07 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:44.899352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e33589ed-d5c6-41fb-97b8-c17073f20f07 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:44.910422 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e33589ed-d5c6-41fb-97b8-c17073f20f07 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1056 microversion: 2.1 time: 0.079733 Oct 29 01:40:44.911218 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3283/6329] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:44 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1056 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:45.684073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-881cf774-fc60-4544-850c-2b91a06dd6dc tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:45.685302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-881cf774-fc60-4544-850c-2b91a06dd6dc tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:45.693537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-881cf774-fc60-4544-850c-2b91a06dd6dc tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:45.694111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-881cf774-fc60-4544-850c-2b91a06dd6dc tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:45.694552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-881cf774-fc60-4544-850c-2b91a06dd6dc tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:45.695269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-881cf774-fc60-4544-850c-2b91a06dd6dc tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:45.695726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-881cf774-fc60-4544-850c-2b91a06dd6dc tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:45.696368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-881cf774-fc60-4544-850c-2b91a06dd6dc tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:45.910089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-881cf774-fc60-4544-850c-2b91a06dd6dc tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:45.922232 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-881cf774-fc60-4544-850c-2b91a06dd6dc tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1" status: 200 len: 1498 microversion: 2.1 time: 0.242134 Oct 29 01:40:45.922878 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3047/6330] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:45 2022] GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1 => generated 1498 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:45.939246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a4278198-3453-403a-b31b-afb3719baf19 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:45.940457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a4278198-3453-403a-b31b-afb3719baf19 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:45.948175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4278198-3453-403a-b31b-afb3719baf19 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:45.948751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4278198-3453-403a-b31b-afb3719baf19 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:45.949290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4278198-3453-403a-b31b-afb3719baf19 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:45.950068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4278198-3453-403a-b31b-afb3719baf19 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:45.950601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4278198-3453-403a-b31b-afb3719baf19 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:45.951104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a4278198-3453-403a-b31b-afb3719baf19 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:46.030621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a4278198-3453-403a-b31b-afb3719baf19 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:46.038759 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a4278198-3453-403a-b31b-afb3719baf19 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1154 microversion: 2.1 time: 0.108926 Oct 29 01:40:46.039448 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3284/6331] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:45 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1154 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:46.905999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-8010b3c2-bbcf-4a24-b392-36bf67e6e949 req-cc161b26-9a9e-4852-869f-ea6d3f72f8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93de6bc3-3869-4da6-aab7-800addd62dfe", "tag": "67eaff49-cb1c-4c31-8124-a15fd8d313cf"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:46.919447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8010b3c2-bbcf-4a24-b392-36bf67e6e949 req-cc161b26-9a9e-4852-869f-ea6d3f72f8d1 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:46.920174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8010b3c2-bbcf-4a24-b392-36bf67e6e949 req-cc161b26-9a9e-4852-869f-ea6d3f72f8d1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:46.921516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8010b3c2-bbcf-4a24-b392-36bf67e6e949 req-cc161b26-9a9e-4852-869f-ea6d3f72f8d1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:46.942489 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-8010b3c2-bbcf-4a24-b392-36bf67e6e949 req-cc161b26-9a9e-4852-869f-ea6d3f72f8d1 service nova] Creating event network-changed:67eaff49-cb1c-4c31-8124-a15fd8d313cf for instance 93de6bc3-3869-4da6-aab7-800addd62dfe on n-h1-862964-3 Oct 29 01:40:46.955581 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-8010b3c2-bbcf-4a24-b392-36bf67e6e949 req-cc161b26-9a9e-4852-869f-ea6d3f72f8d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052482 Oct 29 01:40:46.956677 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3048/6332] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:40:47.033022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e670528-d183-40a2-97cc-fea9c201a9cf tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:47.033552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e670528-d183-40a2-97cc-fea9c201a9cf tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:47.048749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e670528-d183-40a2-97cc-fea9c201a9cf tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:47.051093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e670528-d183-40a2-97cc-fea9c201a9cf tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:47.054493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e670528-d183-40a2-97cc-fea9c201a9cf tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:47.057283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e670528-d183-40a2-97cc-fea9c201a9cf tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:47.058190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e670528-d183-40a2-97cc-fea9c201a9cf tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:47.058655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e670528-d183-40a2-97cc-fea9c201a9cf tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:47.099856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eaac351f-5a0f-401d-b0e8-3a3944255445 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:47.100541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-eaac351f-5a0f-401d-b0e8-3a3944255445 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:47.107556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e670528-d183-40a2-97cc-fea9c201a9cf tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:40:47.121081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eaac351f-5a0f-401d-b0e8-3a3944255445 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:47.123446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eaac351f-5a0f-401d-b0e8-3a3944255445 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:47.123446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eaac351f-5a0f-401d-b0e8-3a3944255445 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:47.123446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eaac351f-5a0f-401d-b0e8-3a3944255445 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:47.123446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eaac351f-5a0f-401d-b0e8-3a3944255445 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:47.123806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eaac351f-5a0f-401d-b0e8-3a3944255445 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:47.280246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-eaac351f-5a0f-401d-b0e8-3a3944255445 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:47.292648 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-eaac351f-5a0f-401d-b0e8-3a3944255445 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1162 microversion: 2.1 time: 0.212756 Oct 29 01:40:47.310356 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3049/6333] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:47 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1162 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:47.572674 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8e670528-d183-40a2-97cc-fea9c201a9cf tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1" status: 204 len: 0 microversion: 2.1 time: 0.544862 Oct 29 01:40:47.574055 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3285/6334] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:40:47 2022] DELETE /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:40:47.603183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ddb5b376-4bf0-4208-b7a0-cd915047c7b9 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:47.604594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ddb5b376-4bf0-4208-b7a0-cd915047c7b9 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:47.620139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ddb5b376-4bf0-4208-b7a0-cd915047c7b9 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:47.621069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ddb5b376-4bf0-4208-b7a0-cd915047c7b9 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:47.622051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ddb5b376-4bf0-4208-b7a0-cd915047c7b9 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:47.623021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ddb5b376-4bf0-4208-b7a0-cd915047c7b9 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:47.623845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ddb5b376-4bf0-4208-b7a0-cd915047c7b9 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:47.624584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ddb5b376-4bf0-4208-b7a0-cd915047c7b9 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:48.057618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ddb5b376-4bf0-4208-b7a0-cd915047c7b9 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:48.075599 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ddb5b376-4bf0-4208-b7a0-cd915047c7b9 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1" status: 200 len: 1504 microversion: 2.1 time: 0.496630 Oct 29 01:40:48.077480 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3050/6335] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:47 2022] GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1 => generated 1504 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:48.319589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-351c77ec-9606-4e75-a5d6-dce0ba8c9ee5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:48.321177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-351c77ec-9606-4e75-a5d6-dce0ba8c9ee5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:48.327526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351c77ec-9606-4e75-a5d6-dce0ba8c9ee5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:48.328054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351c77ec-9606-4e75-a5d6-dce0ba8c9ee5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:48.328506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351c77ec-9606-4e75-a5d6-dce0ba8c9ee5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:48.329270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351c77ec-9606-4e75-a5d6-dce0ba8c9ee5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:48.329730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351c77ec-9606-4e75-a5d6-dce0ba8c9ee5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:48.330160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351c77ec-9606-4e75-a5d6-dce0ba8c9ee5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:48.442611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-351c77ec-9606-4e75-a5d6-dce0ba8c9ee5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:48.456208 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-351c77ec-9606-4e75-a5d6-dce0ba8c9ee5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1172 microversion: 2.1 time: 0.141077 Oct 29 01:40:48.456805 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3286/6336] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:48 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1172 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:49.118141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e30e7684-d4ba-48c2-8d72-291e8e81bec2 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:49.119059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e30e7684-d4ba-48c2-8d72-291e8e81bec2 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:49.127263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e30e7684-d4ba-48c2-8d72-291e8e81bec2 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:49.127939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e30e7684-d4ba-48c2-8d72-291e8e81bec2 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:49.128549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e30e7684-d4ba-48c2-8d72-291e8e81bec2 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:49.129588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e30e7684-d4ba-48c2-8d72-291e8e81bec2 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:49.130219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e30e7684-d4ba-48c2-8d72-291e8e81bec2 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:49.130802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e30e7684-d4ba-48c2-8d72-291e8e81bec2 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:49.416834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e30e7684-d4ba-48c2-8d72-291e8e81bec2 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:49.425472 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e30e7684-d4ba-48c2-8d72-291e8e81bec2 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1" status: 200 len: 1504 microversion: 2.1 time: 0.311553 Oct 29 01:40:49.428462 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3051/6337] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:49 2022] GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1 => generated 1504 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:49.495143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e2134fb9-4e78-4804-a89c-9f8132f5a249 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:49.498978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e2134fb9-4e78-4804-a89c-9f8132f5a249 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:49.522848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2134fb9-4e78-4804-a89c-9f8132f5a249 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:49.524046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2134fb9-4e78-4804-a89c-9f8132f5a249 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:49.527249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2134fb9-4e78-4804-a89c-9f8132f5a249 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:49.530323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2134fb9-4e78-4804-a89c-9f8132f5a249 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:49.532869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2134fb9-4e78-4804-a89c-9f8132f5a249 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:49.535796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2134fb9-4e78-4804-a89c-9f8132f5a249 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:49.832613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e2134fb9-4e78-4804-a89c-9f8132f5a249 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:49.844358 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e2134fb9-4e78-4804-a89c-9f8132f5a249 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1214 microversion: 2.1 time: 0.364915 Oct 29 01:40:49.845475 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3287/6338] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:49 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1214 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:49.964844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-6673a59b-6298-4580-9eb4-155282f4da08 req-67a4fcef-3b5d-4943-8a09-9d037184598f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c04599-2299-4d14-99b7-0139d9e144b1", "name": "network-vif-deleted", "tag": "42ef8e3a-686f-4a07-9d23-16f61b679983"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:49.975285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6673a59b-6298-4580-9eb4-155282f4da08 req-67a4fcef-3b5d-4943-8a09-9d037184598f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:49.975763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6673a59b-6298-4580-9eb4-155282f4da08 req-67a4fcef-3b5d-4943-8a09-9d037184598f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:49.976196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6673a59b-6298-4580-9eb4-155282f4da08 req-67a4fcef-3b5d-4943-8a09-9d037184598f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:49.990522 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-6673a59b-6298-4580-9eb4-155282f4da08 req-67a4fcef-3b5d-4943-8a09-9d037184598f service nova] Creating event network-vif-deleted:42ef8e3a-686f-4a07-9d23-16f61b679983 for instance e3c04599-2299-4d14-99b7-0139d9e144b1 on n-h2-862964-3 Oct 29 01:40:49.995587 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-6673a59b-6298-4580-9eb4-155282f4da08 req-67a4fcef-3b5d-4943-8a09-9d037184598f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034703 Oct 29 01:40:49.996749 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3052/6339] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:40:50.455022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2acf8e6f-1b5d-4b02-9f1b-e61f3087cde5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:50.456871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-26436aa1-22c9-4946-9de9-91c7c8893f11 req-13450c9f-ba9c-4115-b6b5-7c6f42239a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64cd489b-a35c-4e71-af41-eb2d5d22b082", "tag": "faf344df-307c-4c6c-b506-bc5a26cded44"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:50.462264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2acf8e6f-1b5d-4b02-9f1b-e61f3087cde5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:50.475781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2acf8e6f-1b5d-4b02-9f1b-e61f3087cde5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:50.477101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2acf8e6f-1b5d-4b02-9f1b-e61f3087cde5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:50.477101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2acf8e6f-1b5d-4b02-9f1b-e61f3087cde5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:50.481379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-26436aa1-22c9-4946-9de9-91c7c8893f11 req-13450c9f-ba9c-4115-b6b5-7c6f42239a5d service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:50.482072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-26436aa1-22c9-4946-9de9-91c7c8893f11 req-13450c9f-ba9c-4115-b6b5-7c6f42239a5d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:50.482345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-26436aa1-22c9-4946-9de9-91c7c8893f11 req-13450c9f-ba9c-4115-b6b5-7c6f42239a5d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:50.486551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2acf8e6f-1b5d-4b02-9f1b-e61f3087cde5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:50.487645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2acf8e6f-1b5d-4b02-9f1b-e61f3087cde5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:50.488578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2acf8e6f-1b5d-4b02-9f1b-e61f3087cde5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:50.503229 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-26436aa1-22c9-4946-9de9-91c7c8893f11 req-13450c9f-ba9c-4115-b6b5-7c6f42239a5d service nova] Creating event network-changed:faf344df-307c-4c6c-b506-bc5a26cded44 for instance 64cd489b-a35c-4e71-af41-eb2d5d22b082 on n-h1-862964-3 Oct 29 01:40:50.509992 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-26436aa1-22c9-4946-9de9-91c7c8893f11 req-13450c9f-ba9c-4115-b6b5-7c6f42239a5d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065438 Oct 29 01:40:50.510937 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3288/6340] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:40:50.551071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2acf8e6f-1b5d-4b02-9f1b-e61f3087cde5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:50.551577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2acf8e6f-1b5d-4b02-9f1b-e61f3087cde5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:50.552078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2acf8e6f-1b5d-4b02-9f1b-e61f3087cde5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:50.554160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-2acf8e6f-1b5d-4b02-9f1b-e61f3087cde5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lazy-loading 'fault' on Instance uuid e3c04599-2299-4d14-99b7-0139d9e144b1 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:40:50.654568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2acf8e6f-1b5d-4b02-9f1b-e61f3087cde5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:50.664421 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2acf8e6f-1b5d-4b02-9f1b-e61f3087cde5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1" status: 200 len: 1304 microversion: 2.1 time: 0.216041 Oct 29 01:40:50.665080 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3053/6341] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:50 2022] GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1 => generated 1304 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:50.873023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-85b540e2-fca4-4cac-b01e-9acd4f4fbe4b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:50.875288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-85b540e2-fca4-4cac-b01e-9acd4f4fbe4b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:50.885696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85b540e2-fca4-4cac-b01e-9acd4f4fbe4b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:50.886464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85b540e2-fca4-4cac-b01e-9acd4f4fbe4b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:50.886967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85b540e2-fca4-4cac-b01e-9acd4f4fbe4b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:50.888125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85b540e2-fca4-4cac-b01e-9acd4f4fbe4b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:50.888387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85b540e2-fca4-4cac-b01e-9acd4f4fbe4b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:50.889103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85b540e2-fca4-4cac-b01e-9acd4f4fbe4b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:51.145596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-85b540e2-fca4-4cac-b01e-9acd4f4fbe4b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:51.159612 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-85b540e2-fca4-4cac-b01e-9acd4f4fbe4b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1214 microversion: 2.1 time: 0.289827 Oct 29 01:40:51.161074 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3289/6342] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:50 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1214 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:51.692845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b176017a-ce2c-4070-9cd8-1cc2b7951ea4 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:51.693485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b176017a-ce2c-4070-9cd8-1cc2b7951ea4 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: e3c04599-2299-4d14-99b7-0139d9e144b1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:51.701638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b176017a-ce2c-4070-9cd8-1cc2b7951ea4 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:51.702307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b176017a-ce2c-4070-9cd8-1cc2b7951ea4 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:51.702768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b176017a-ce2c-4070-9cd8-1cc2b7951ea4 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:51.703488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b176017a-ce2c-4070-9cd8-1cc2b7951ea4 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:51.703994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b176017a-ce2c-4070-9cd8-1cc2b7951ea4 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:51.704419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b176017a-ce2c-4070-9cd8-1cc2b7951ea4 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:51.719843 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-b176017a-ce2c-4070-9cd8-1cc2b7951ea4 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] HTTP exception thrown: Instance e3c04599-2299-4d14-99b7-0139d9e144b1 could not be found. Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b176017a-ce2c-4070-9cd8-1cc2b7951ea4 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Request method failure captured: Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1 HTTP/1.1 Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXISJk2lib5ZPLKlB4iAmDeuEQSMs5L7xVsOxy5rkEb4KQaEFGj67_N9-KzmMKs08kIg8kQAYEy1fv9-avj9zyxBX-umxiPNGAAH8qQTU_pqxCiaUJfif8IlldAf8ihKEcxQt5Lkdkf3muzerNE8L2oTaYQxUKP5GAAMY_nkfGyrunew Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: db565e2216be404ebae26f30b2ef2199 Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-VolumesActionsTest-1542322320 Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db565e2216be404ebae26f30b2ef2199"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db565e2216be404ebae26f30b2ef2199"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db565e2216be404ebae26f30b2ef2199"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db565e2216be404ebae26f30b2ef2199", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-VolumesActionsTest-1542322320 Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: db565e2216be404ebae26f30b2ef2199 Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-VolumesActionsTest-1542322320 Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-VolumesActionsTest-1542322320-project Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 84d9aee15dd34a20bba11a5b550933d6 Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-VolumesActionsTest-1542322320-project Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance e3c04599-2299-4d14-99b7-0139d9e144b1 could not be found. Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'e3c04599-2299-4d14-99b7-0139d9e144b1'} Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3c04599-2299-4d14-99b7-0139d9e144b1 could not be found. Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3c04599-2299-4d14-99b7-0139d9e144b1 could not be found. Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:40:51.721904 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:40:51.726257 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:40:51.726257 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:40:51.726257 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:40:51.726257 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:40:51.726257 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:40:51.726257 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3c04599-2299-4d14-99b7-0139d9e144b1 could not be found. Oct 29 01:40:51.726257 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:40:51.726257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b176017a-ce2c-4070-9cd8-1cc2b7951ea4 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Returning 404 to user: Instance e3c04599-2299-4d14-99b7-0139d9e144b1 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:40:51.726257 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b176017a-ce2c-4070-9cd8-1cc2b7951ea4 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1" status: 404 len: 111 microversion: 2.1 time: 0.034915 Oct 29 01:40:51.726257 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3054/6343] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:51 2022] GET /compute/v2.1/servers/e3c04599-2299-4d14-99b7-0139d9e144b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:40:51.848019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0d5e7917-5ffd-48bd-b10f-648d800d235b tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-855921350", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "2d1e2427-ccf0-46a7-a645-cae2d349f968"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:51.907208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-0d5e7917-5ffd-48bd-b10f-648d800d235b tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] validate_networks() for [('2d1e2427-ccf0-46a7-a645-cae2d349f968', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:40:52.186783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bfe21f5f-4ab5-4985-a8db-cb08ce2338b5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:52.187758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bfe21f5f-4ab5-4985-a8db-cb08ce2338b5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:52.197976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfe21f5f-4ab5-4985-a8db-cb08ce2338b5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:52.198494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfe21f5f-4ab5-4985-a8db-cb08ce2338b5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:52.199104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfe21f5f-4ab5-4985-a8db-cb08ce2338b5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:52.199832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfe21f5f-4ab5-4985-a8db-cb08ce2338b5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:52.200285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfe21f5f-4ab5-4985-a8db-cb08ce2338b5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:52.200713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfe21f5f-4ab5-4985-a8db-cb08ce2338b5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:52.354639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0d5e7917-5ffd-48bd-b10f-648d800d235b tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:40:52.355111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0d5e7917-5ffd-48bd-b10f-648d800d235b tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:40:52.356007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0d5e7917-5ffd-48bd-b10f-648d800d235b tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:40:52.356401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0d5e7917-5ffd-48bd-b10f-648d800d235b tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:40:52.356838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-0d5e7917-5ffd-48bd-b10f-648d800d235b tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:40:52.370331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d5e7917-5ffd-48bd-b10f-648d800d235b tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:52.370821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d5e7917-5ffd-48bd-b10f-648d800d235b tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:52.382729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d5e7917-5ffd-48bd-b10f-648d800d235b tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:52.382729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d5e7917-5ffd-48bd-b10f-648d800d235b tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:52.382729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d5e7917-5ffd-48bd-b10f-648d800d235b tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:52.382729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d5e7917-5ffd-48bd-b10f-648d800d235b tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:52.385751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bfe21f5f-4ab5-4985-a8db-cb08ce2338b5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:52.394442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-0d5e7917-5ffd-48bd-b10f-648d800d235b tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Getting quotas for project db565e2216be404ebae26f30b2ef2199. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:40:52.397521 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bfe21f5f-4ab5-4985-a8db-cb08ce2338b5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1214 microversion: 2.1 time: 0.215072 Oct 29 01:40:52.400143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-0d5e7917-5ffd-48bd-b10f-648d800d235b tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Getting quotas for user 84d9aee15dd34a20bba11a5b550933d6 and project db565e2216be404ebae26f30b2ef2199. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:40:52.411320 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3055/6344] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:52 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1214 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:52.424309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0d5e7917-5ffd-48bd-b10f-648d800d235b tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:40:52.426851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0d5e7917-5ffd-48bd-b10f-648d800d235b tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:40:52.613192 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0d5e7917-5ffd-48bd-b10f-648d800d235b tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.769728 Oct 29 01:40:52.615824 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3290/6345] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:40:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:40:52.631706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-695d689d-9df7-4bf8-8b01-2daea3b5c0aa tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:52.632407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-695d689d-9df7-4bf8-8b01-2daea3b5c0aa tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:52.720483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-695d689d-9df7-4bf8-8b01-2daea3b5c0aa tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:52.732253 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-695d689d-9df7-4bf8-8b01-2daea3b5c0aa tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631" status: 200 len: 1213 microversion: 2.1 time: 0.107633 Oct 29 01:40:52.746408 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3056/6346] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:52 2022] GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631 => generated 1213 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:53.425906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-77f3066b-8cc2-4ad2-803a-fa6b17e770c5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:53.426840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-77f3066b-8cc2-4ad2-803a-fa6b17e770c5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:53.432969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77f3066b-8cc2-4ad2-803a-fa6b17e770c5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:53.433517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77f3066b-8cc2-4ad2-803a-fa6b17e770c5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:53.433948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77f3066b-8cc2-4ad2-803a-fa6b17e770c5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:53.434637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77f3066b-8cc2-4ad2-803a-fa6b17e770c5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:53.435094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77f3066b-8cc2-4ad2-803a-fa6b17e770c5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:53.435528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-77f3066b-8cc2-4ad2-803a-fa6b17e770c5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:53.578662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-77f3066b-8cc2-4ad2-803a-fa6b17e770c5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:53.587298 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-77f3066b-8cc2-4ad2-803a-fa6b17e770c5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1214 microversion: 2.1 time: 0.169119 Oct 29 01:40:53.587916 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3291/6347] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:53 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:53.760413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a8748d4d-d09c-4f57-9e22-6a940fcc8f1e tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:53.761230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a8748d4d-d09c-4f57-9e22-6a940fcc8f1e tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:53.769921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a8748d4d-d09c-4f57-9e22-6a940fcc8f1e tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:53.770399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a8748d4d-d09c-4f57-9e22-6a940fcc8f1e tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:53.770833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a8748d4d-d09c-4f57-9e22-6a940fcc8f1e tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:53.771525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a8748d4d-d09c-4f57-9e22-6a940fcc8f1e tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:53.771973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a8748d4d-d09c-4f57-9e22-6a940fcc8f1e tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:53.772411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a8748d4d-d09c-4f57-9e22-6a940fcc8f1e tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:53.849064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a8748d4d-d09c-4f57-9e22-6a940fcc8f1e tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:53.856846 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a8748d4d-d09c-4f57-9e22-6a940fcc8f1e tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631" status: 200 len: 1217 microversion: 2.1 time: 0.100450 Oct 29 01:40:53.857449 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3057/6348] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:53 2022] GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:54.611497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bbfb67a6-f4f1-42bc-93d7-32b102ef92ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:54.612810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bbfb67a6-f4f1-42bc-93d7-32b102ef92ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:54.619993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbfb67a6-f4f1-42bc-93d7-32b102ef92ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:54.620691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbfb67a6-f4f1-42bc-93d7-32b102ef92ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:54.621125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbfb67a6-f4f1-42bc-93d7-32b102ef92ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:54.621846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbfb67a6-f4f1-42bc-93d7-32b102ef92ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:54.622328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbfb67a6-f4f1-42bc-93d7-32b102ef92ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:54.622771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bbfb67a6-f4f1-42bc-93d7-32b102ef92ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:54.760554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bbfb67a6-f4f1-42bc-93d7-32b102ef92ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:54.769702 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bbfb67a6-f4f1-42bc-93d7-32b102ef92ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1202 microversion: 2.1 time: 0.163445 Oct 29 01:40:54.770298 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3292/6349] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:54 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:54.880571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e451c526-701a-4647-bfa1-6a18862516bb tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:54.881213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e451c526-701a-4647-bfa1-6a18862516bb tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:54.888368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e451c526-701a-4647-bfa1-6a18862516bb tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:54.889009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e451c526-701a-4647-bfa1-6a18862516bb tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:54.889479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e451c526-701a-4647-bfa1-6a18862516bb tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:54.890662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e451c526-701a-4647-bfa1-6a18862516bb tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:54.891306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e451c526-701a-4647-bfa1-6a18862516bb tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:54.891897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e451c526-701a-4647-bfa1-6a18862516bb tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:54.959926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e451c526-701a-4647-bfa1-6a18862516bb tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:54.967918 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e451c526-701a-4647-bfa1-6a18862516bb tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631" status: 200 len: 1265 microversion: 2.1 time: 0.091218 Oct 29 01:40:54.968505 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3058/6350] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:54 2022] GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:55.793851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e63fada-9416-4e09-bf1e-bd611c5acb9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:55.795237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e63fada-9416-4e09-bf1e-bd611c5acb9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:55.804933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e63fada-9416-4e09-bf1e-bd611c5acb9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:55.806465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e63fada-9416-4e09-bf1e-bd611c5acb9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:55.806465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e63fada-9416-4e09-bf1e-bd611c5acb9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:55.806651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e63fada-9416-4e09-bf1e-bd611c5acb9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:55.807218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e63fada-9416-4e09-bf1e-bd611c5acb9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:55.807982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e63fada-9416-4e09-bf1e-bd611c5acb9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:55.951388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8e63fada-9416-4e09-bf1e-bd611c5acb9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:55.960947 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8e63fada-9416-4e09-bf1e-bd611c5acb9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1202 microversion: 2.1 time: 0.171489 Oct 29 01:40:55.961552 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3293/6351] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:55 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1202 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:55.991212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ef1a1488-eec6-47be-ac6a-d21e4f5f733a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:55.992613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ef1a1488-eec6-47be-ac6a-d21e4f5f733a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:55.995586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:40:56.000582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef1a1488-eec6-47be-ac6a-d21e4f5f733a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:56.003395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef1a1488-eec6-47be-ac6a-d21e4f5f733a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:56.003395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef1a1488-eec6-47be-ac6a-d21e4f5f733a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:56.003395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef1a1488-eec6-47be-ac6a-d21e4f5f733a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:56.003395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef1a1488-eec6-47be-ac6a-d21e4f5f733a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:56.003395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ef1a1488-eec6-47be-ac6a-d21e4f5f733a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:56.149290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ef1a1488-eec6-47be-ac6a-d21e4f5f733a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:56.157352 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ef1a1488-eec6-47be-ac6a-d21e4f5f733a tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631" status: 200 len: 1313 microversion: 2.1 time: 0.170294 Oct 29 01:40:56.157967 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3059/6352] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:55 2022] GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:56.985819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6fa93d05-58a6-4a1f-9acb-e24703cc1e21 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:56.986442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6fa93d05-58a6-4a1f-9acb-e24703cc1e21 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:56.996338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fa93d05-58a6-4a1f-9acb-e24703cc1e21 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:56.996338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fa93d05-58a6-4a1f-9acb-e24703cc1e21 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:56.996338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fa93d05-58a6-4a1f-9acb-e24703cc1e21 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:56.996338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fa93d05-58a6-4a1f-9acb-e24703cc1e21 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:56.996338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fa93d05-58a6-4a1f-9acb-e24703cc1e21 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:56.996338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6fa93d05-58a6-4a1f-9acb-e24703cc1e21 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:57.018196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:40:57.102821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-a2e08c37-b642-4857-8fd5-08358e9ff159 req-abdeded2-0335-446b-a10a-e720043c7426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0dc4dc7-c79a-4935-a401-71725b778631", "tag": "27023b93-2e9a-466a-8ddd-3ff09eadee88"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:57.117557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a2e08c37-b642-4857-8fd5-08358e9ff159 req-abdeded2-0335-446b-a10a-e720043c7426 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:57.123789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a2e08c37-b642-4857-8fd5-08358e9ff159 req-abdeded2-0335-446b-a10a-e720043c7426 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:57.123789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a2e08c37-b642-4857-8fd5-08358e9ff159 req-abdeded2-0335-446b-a10a-e720043c7426 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:57.149641 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-a2e08c37-b642-4857-8fd5-08358e9ff159 req-abdeded2-0335-446b-a10a-e720043c7426 service nova] Creating event network-changed:27023b93-2e9a-466a-8ddd-3ff09eadee88 for instance a0dc4dc7-c79a-4935-a401-71725b778631 on n-h2-862964-3 Oct 29 01:40:57.156193 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-a2e08c37-b642-4857-8fd5-08358e9ff159 req-abdeded2-0335-446b-a10a-e720043c7426 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056204 Oct 29 01:40:57.156193 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3060/6353] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:40:57.161211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6fa93d05-58a6-4a1f-9acb-e24703cc1e21 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:57.169381 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6fa93d05-58a6-4a1f-9acb-e24703cc1e21 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1202 microversion: 2.1 time: 0.187843 Oct 29 01:40:57.169967 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3294/6354] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:56 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1202 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:57.183509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8f8af4d6-0a90-4112-a1ae-6b4d1a90c226 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:57.184356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8f8af4d6-0a90-4112-a1ae-6b4d1a90c226 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:57.191734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8f8af4d6-0a90-4112-a1ae-6b4d1a90c226 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:57.192398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8f8af4d6-0a90-4112-a1ae-6b4d1a90c226 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:57.192834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8f8af4d6-0a90-4112-a1ae-6b4d1a90c226 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:57.193561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8f8af4d6-0a90-4112-a1ae-6b4d1a90c226 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:57.194165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8f8af4d6-0a90-4112-a1ae-6b4d1a90c226 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:57.194593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8f8af4d6-0a90-4112-a1ae-6b4d1a90c226 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:57.353477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8f8af4d6-0a90-4112-a1ae-6b4d1a90c226 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:57.364177 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8f8af4d6-0a90-4112-a1ae-6b4d1a90c226 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631" status: 200 len: 1313 microversion: 2.1 time: 0.185011 Oct 29 01:40:57.365131 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3061/6355] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:57 2022] GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:58.193957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-19198032-50ed-49dd-ae2b-70d9bbee5820 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:58.194565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-19198032-50ed-49dd-ae2b-70d9bbee5820 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:58.197660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:40:58.202816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19198032-50ed-49dd-ae2b-70d9bbee5820 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:58.203469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19198032-50ed-49dd-ae2b-70d9bbee5820 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:58.203909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19198032-50ed-49dd-ae2b-70d9bbee5820 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:58.204616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19198032-50ed-49dd-ae2b-70d9bbee5820 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:58.205079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19198032-50ed-49dd-ae2b-70d9bbee5820 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:58.207115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19198032-50ed-49dd-ae2b-70d9bbee5820 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:58.343529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-19198032-50ed-49dd-ae2b-70d9bbee5820 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:58.351504 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-19198032-50ed-49dd-ae2b-70d9bbee5820 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1202 microversion: 2.1 time: 0.161384 Oct 29 01:40:58.352086 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3295/6356] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:58 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:40:58.387776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dbcce48b-abde-4180-a223-b27a46d58faa tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:58.388515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dbcce48b-abde-4180-a223-b27a46d58faa tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:58.395838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbcce48b-abde-4180-a223-b27a46d58faa tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:58.396407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbcce48b-abde-4180-a223-b27a46d58faa tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:58.396926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbcce48b-abde-4180-a223-b27a46d58faa tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:58.397728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbcce48b-abde-4180-a223-b27a46d58faa tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:58.398293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbcce48b-abde-4180-a223-b27a46d58faa tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:58.398813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dbcce48b-abde-4180-a223-b27a46d58faa tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:58.542552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-dbcce48b-abde-4180-a223-b27a46d58faa tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:58.551163 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dbcce48b-abde-4180-a223-b27a46d58faa tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631" status: 200 len: 1313 microversion: 2.1 time: 0.167389 Oct 29 01:40:58.551740 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3062/6357] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:58 2022] GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:59.375980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-32be56e9-157f-489a-8016-b29fad240b87 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:59.376663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-32be56e9-157f-489a-8016-b29fad240b87 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:59.382938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32be56e9-157f-489a-8016-b29fad240b87 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:59.383424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32be56e9-157f-489a-8016-b29fad240b87 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:59.383865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32be56e9-157f-489a-8016-b29fad240b87 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:59.384574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32be56e9-157f-489a-8016-b29fad240b87 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:59.385037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32be56e9-157f-489a-8016-b29fad240b87 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:59.385489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32be56e9-157f-489a-8016-b29fad240b87 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:59.527694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-32be56e9-157f-489a-8016-b29fad240b87 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:59.537531 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-32be56e9-157f-489a-8016-b29fad240b87 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1202 microversion: 2.1 time: 0.166236 Oct 29 01:40:59.538449 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3296/6358] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:59 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1202 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:59.575270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ebd90263-b1c3-47d5-8d1a-a7ff2df58a4f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:59.575887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ebd90263-b1c3-47d5-8d1a-a7ff2df58a4f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:40:59.583422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ebd90263-b1c3-47d5-8d1a-a7ff2df58a4f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:59.583909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ebd90263-b1c3-47d5-8d1a-a7ff2df58a4f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:59.584344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ebd90263-b1c3-47d5-8d1a-a7ff2df58a4f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:59.585037 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ebd90263-b1c3-47d5-8d1a-a7ff2df58a4f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:40:59.585519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ebd90263-b1c3-47d5-8d1a-a7ff2df58a4f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:40:59.585942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ebd90263-b1c3-47d5-8d1a-a7ff2df58a4f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:40:59.715130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ebd90263-b1c3-47d5-8d1a-a7ff2df58a4f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:59.717544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:40:59.725211 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ebd90263-b1c3-47d5-8d1a-a7ff2df58a4f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631" status: 200 len: 1313 microversion: 2.1 time: 0.153749 Oct 29 01:40:59.729289 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3063/6359] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:40:59 2022] GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:00.561015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f56e6aef-d59f-4ca9-989e-5dc7d4a4f06a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:00.561716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f56e6aef-d59f-4ca9-989e-5dc7d4a4f06a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:00.569187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f56e6aef-d59f-4ca9-989e-5dc7d4a4f06a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:00.569699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f56e6aef-d59f-4ca9-989e-5dc7d4a4f06a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:00.570135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f56e6aef-d59f-4ca9-989e-5dc7d4a4f06a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:00.570841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f56e6aef-d59f-4ca9-989e-5dc7d4a4f06a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:00.571302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f56e6aef-d59f-4ca9-989e-5dc7d4a4f06a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:00.571736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f56e6aef-d59f-4ca9-989e-5dc7d4a4f06a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:00.704057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f56e6aef-d59f-4ca9-989e-5dc7d4a4f06a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:00.712053 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f56e6aef-d59f-4ca9-989e-5dc7d4a4f06a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1202 microversion: 2.1 time: 0.154940 Oct 29 01:41:00.712646 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3297/6360] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:00 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:00.749865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-296d89cd-aa36-49d6-8aa8-5df1b0caa532 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:00.750623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-296d89cd-aa36-49d6-8aa8-5df1b0caa532 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:00.757742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-296d89cd-aa36-49d6-8aa8-5df1b0caa532 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:00.758208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-296d89cd-aa36-49d6-8aa8-5df1b0caa532 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:00.758640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-296d89cd-aa36-49d6-8aa8-5df1b0caa532 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:00.759324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-296d89cd-aa36-49d6-8aa8-5df1b0caa532 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:00.759774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-296d89cd-aa36-49d6-8aa8-5df1b0caa532 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:00.760195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-296d89cd-aa36-49d6-8aa8-5df1b0caa532 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:00.911212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-296d89cd-aa36-49d6-8aa8-5df1b0caa532 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:00.919499 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-296d89cd-aa36-49d6-8aa8-5df1b0caa532 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631" status: 200 len: 1313 microversion: 2.1 time: 0.174390 Oct 29 01:41:00.921425 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3064/6361] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:00 2022] GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:01.736079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-42aca9fc-561c-424f-89ec-081c88a905f1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:01.736705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-42aca9fc-561c-424f-89ec-081c88a905f1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:01.745626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42aca9fc-561c-424f-89ec-081c88a905f1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:01.748130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42aca9fc-561c-424f-89ec-081c88a905f1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:01.748130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42aca9fc-561c-424f-89ec-081c88a905f1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:01.748130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42aca9fc-561c-424f-89ec-081c88a905f1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:01.748892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42aca9fc-561c-424f-89ec-081c88a905f1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:01.749658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42aca9fc-561c-424f-89ec-081c88a905f1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:01.911416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-42aca9fc-561c-424f-89ec-081c88a905f1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:01.931089 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-42aca9fc-561c-424f-89ec-081c88a905f1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1202 microversion: 2.1 time: 0.191036 Oct 29 01:41:01.931089 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3298/6362] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:01 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1202 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:01.944892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8dd88fcf-713f-4027-b4ae-e50ad333eaf5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:01.946179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8dd88fcf-713f-4027-b4ae-e50ad333eaf5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:01.954768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8dd88fcf-713f-4027-b4ae-e50ad333eaf5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:01.958760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8dd88fcf-713f-4027-b4ae-e50ad333eaf5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:01.958760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8dd88fcf-713f-4027-b4ae-e50ad333eaf5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:01.958760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8dd88fcf-713f-4027-b4ae-e50ad333eaf5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:01.958760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8dd88fcf-713f-4027-b4ae-e50ad333eaf5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:01.958760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8dd88fcf-713f-4027-b4ae-e50ad333eaf5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:02.170710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8dd88fcf-713f-4027-b4ae-e50ad333eaf5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:02.183118 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8dd88fcf-713f-4027-b4ae-e50ad333eaf5 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631" status: 200 len: 1313 microversion: 2.1 time: 0.242086 Oct 29 01:41:02.184342 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3065/6363] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:01 2022] GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:02.949110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7b4db15c-c8cc-4354-9066-410c4c8aa0a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:02.949683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7b4db15c-c8cc-4354-9066-410c4c8aa0a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:02.952815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:41:02.953535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=16 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:41:02.957931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b4db15c-c8cc-4354-9066-410c4c8aa0a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:02.958425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b4db15c-c8cc-4354-9066-410c4c8aa0a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:02.961697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b4db15c-c8cc-4354-9066-410c4c8aa0a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:02.962916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b4db15c-c8cc-4354-9066-410c4c8aa0a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:02.962916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b4db15c-c8cc-4354-9066-410c4c8aa0a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:02.965190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7b4db15c-c8cc-4354-9066-410c4c8aa0a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:03.100744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7b4db15c-c8cc-4354-9066-410c4c8aa0a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:03.109274 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7b4db15c-c8cc-4354-9066-410c4c8aa0a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1202 microversion: 2.1 time: 0.163671 Oct 29 01:41:03.109946 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3299/6364] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:02 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1202 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:03.208522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0fa96815-a072-4bc2-892b-c9206a877a8c tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:03.209194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0fa96815-a072-4bc2-892b-c9206a877a8c tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:03.212481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:41:03.216912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fa96815-a072-4bc2-892b-c9206a877a8c tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:03.217456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fa96815-a072-4bc2-892b-c9206a877a8c tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:03.220650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fa96815-a072-4bc2-892b-c9206a877a8c tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:03.220650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fa96815-a072-4bc2-892b-c9206a877a8c tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:03.220650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fa96815-a072-4bc2-892b-c9206a877a8c tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:03.220650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0fa96815-a072-4bc2-892b-c9206a877a8c tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:03.282039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-45feff59-8ab3-453c-8a2d-485d9d4dfd9c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Action: 'create', calling method: .version_select at 0x7f9d96641d30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-896376741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuwdER9xHj4O+H7tGgBzXkrCurwyPSYYMhL1K+KSTx3ouXIQsni1W+w5FKDQ9Jqr4M5f1TwF4Q7rrdSWej+hlB5D4y0c8oNf3/WozipYw67cJzwngC0fHl414QeQGtUow=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:03.300968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-45feff59-8ab3-453c-8a2d-485d9d4dfd9c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Getting quotas for project e1817f6a3cd04ebbaa07dd63934d2771. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:41:03.306595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-45feff59-8ab3-453c-8a2d-485d9d4dfd9c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Getting quotas for user ab773592a5914fcda533047d8044c3dc and project e1817f6a3cd04ebbaa07dd63934d2771. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:41:03.414068 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-45feff59-8ab3-453c-8a2d-485d9d4dfd9c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.136945 Oct 29 01:41:03.414954 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3300/6365] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:41:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:41:03.628818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4e180256-edfd-40ea-a073-48148fdbe27b req-5c4a14d5-4b84-4baa-9f11-c0b50953c60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0dc4dc7-c79a-4935-a401-71725b778631", "name": "network-vif-plugged", "status": "completed", "tag": "27023b93-2e9a-466a-8ddd-3ff09eadee88"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:03.640380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4e180256-edfd-40ea-a073-48148fdbe27b req-5c4a14d5-4b84-4baa-9f11-c0b50953c60e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:03.641927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4e180256-edfd-40ea-a073-48148fdbe27b req-5c4a14d5-4b84-4baa-9f11-c0b50953c60e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:03.641927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4e180256-edfd-40ea-a073-48148fdbe27b req-5c4a14d5-4b84-4baa-9f11-c0b50953c60e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:03.654257 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4e180256-edfd-40ea-a073-48148fdbe27b req-5c4a14d5-4b84-4baa-9f11-c0b50953c60e service nova] Creating event network-vif-plugged:27023b93-2e9a-466a-8ddd-3ff09eadee88 for instance a0dc4dc7-c79a-4935-a401-71725b778631 on n-h2-862964-3 Oct 29 01:41:03.660206 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4e180256-edfd-40ea-a073-48148fdbe27b req-5c4a14d5-4b84-4baa-9f11-c0b50953c60e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037616 Oct 29 01:41:03.661214 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3301/6366] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:41:03.784081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0fa96815-a072-4bc2-892b-c9206a877a8c tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:03.793336 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0fa96815-a072-4bc2-892b-c9206a877a8c tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631" status: 200 len: 1313 microversion: 2.1 time: 0.588987 Oct 29 01:41:03.797248 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3066/6367] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:03 2022] GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631 => generated 1313 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:04.134736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d05962f6-77ae-4cdf-a42e-6866f784b770 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:04.135291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d05962f6-77ae-4cdf-a42e-6866f784b770 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:04.143723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d05962f6-77ae-4cdf-a42e-6866f784b770 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:04.144209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d05962f6-77ae-4cdf-a42e-6866f784b770 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:04.144644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d05962f6-77ae-4cdf-a42e-6866f784b770 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:04.145695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d05962f6-77ae-4cdf-a42e-6866f784b770 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:04.146305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d05962f6-77ae-4cdf-a42e-6866f784b770 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:04.146879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d05962f6-77ae-4cdf-a42e-6866f784b770 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:04.312427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d05962f6-77ae-4cdf-a42e-6866f784b770 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:04.335457 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d05962f6-77ae-4cdf-a42e-6866f784b770 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1202 microversion: 2.1 time: 0.201096 Oct 29 01:41:04.349309 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3302/6368] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:04 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1202 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:04.819026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-14a2d6d2-8de9-4c21-a8a6-c302ac908020 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:04.819704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-14a2d6d2-8de9-4c21-a8a6-c302ac908020 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:04.828314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-14a2d6d2-8de9-4c21-a8a6-c302ac908020 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:04.828975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-14a2d6d2-8de9-4c21-a8a6-c302ac908020 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:04.829535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-14a2d6d2-8de9-4c21-a8a6-c302ac908020 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:04.830318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-14a2d6d2-8de9-4c21-a8a6-c302ac908020 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:04.830878 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-14a2d6d2-8de9-4c21-a8a6-c302ac908020 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:04.831387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-14a2d6d2-8de9-4c21-a8a6-c302ac908020 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:05.024231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-14a2d6d2-8de9-4c21-a8a6-c302ac908020 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:05.033809 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-14a2d6d2-8de9-4c21-a8a6-c302ac908020 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631" status: 200 len: 1313 microversion: 2.1 time: 0.219116 Oct 29 01:41:05.034395 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3067/6369] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:04 2022] GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:05.363759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b86deb10-17ac-41f2-b7a4-739100ff6598 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:05.364400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b86deb10-17ac-41f2-b7a4-739100ff6598 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:05.373023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b86deb10-17ac-41f2-b7a4-739100ff6598 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:05.373804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b86deb10-17ac-41f2-b7a4-739100ff6598 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:05.382293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b86deb10-17ac-41f2-b7a4-739100ff6598 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:05.390911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b86deb10-17ac-41f2-b7a4-739100ff6598 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:05.391695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b86deb10-17ac-41f2-b7a4-739100ff6598 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:05.392495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b86deb10-17ac-41f2-b7a4-739100ff6598 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:05.570556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b86deb10-17ac-41f2-b7a4-739100ff6598 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:05.579034 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b86deb10-17ac-41f2-b7a4-739100ff6598 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1202 microversion: 2.1 time: 0.221452 Oct 29 01:41:05.579976 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3303/6370] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:05 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1202 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:06.020547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-76813bcb-aeec-4c15-a123-3072ccb156f5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:06.023420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-76813bcb-aeec-4c15-a123-3072ccb156f5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:06.034189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76813bcb-aeec-4c15-a123-3072ccb156f5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:06.034189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76813bcb-aeec-4c15-a123-3072ccb156f5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:06.034189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76813bcb-aeec-4c15-a123-3072ccb156f5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:06.034788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76813bcb-aeec-4c15-a123-3072ccb156f5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:06.035497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76813bcb-aeec-4c15-a123-3072ccb156f5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:06.036281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76813bcb-aeec-4c15-a123-3072ccb156f5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:06.059478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-517bdd8d-ab36-4c5f-941a-fd99297968fe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:06.060180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-517bdd8d-ab36-4c5f-941a-fd99297968fe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:06.069292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-517bdd8d-ab36-4c5f-941a-fd99297968fe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:06.069292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-517bdd8d-ab36-4c5f-941a-fd99297968fe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:06.069292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-517bdd8d-ab36-4c5f-941a-fd99297968fe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:06.069639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-517bdd8d-ab36-4c5f-941a-fd99297968fe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:06.070110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-517bdd8d-ab36-4c5f-941a-fd99297968fe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:06.071020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-517bdd8d-ab36-4c5f-941a-fd99297968fe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:06.137989 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-76813bcb-aeec-4c15-a123-3072ccb156f5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857/action" status: 200 len: 63211 microversion: 2.1 time: 0.121360 Oct 29 01:41:06.138707 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3068/6371] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:41:06 2022] POST /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857/action => generated 63211 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:41:06.211587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-517bdd8d-ab36-4c5f-941a-fd99297968fe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:06.221102 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-517bdd8d-ab36-4c5f-941a-fd99297968fe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631" status: 200 len: 1497 microversion: 2.1 time: 0.166569 Oct 29 01:41:06.221728 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3304/6372] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:06 2022] GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631 => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:41:06.448311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-529e1f0c-d6cc-49f3-bdb4-1e1994f25121 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-736022274", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "8de1e7c1-1df5-4e42-b04b-e00dc636aba7"}], "key_name": "tempest-TestNetworkBasicOps-896376741", "security_groups": [{"name": "tempest-secgroup-smoke-1204883573"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:06.564231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-529e1f0c-d6cc-49f3-bdb4-1e1994f25121 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] validate_networks() for [('8de1e7c1-1df5-4e42-b04b-e00dc636aba7', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:41:06.604347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f4f0bb3c-1000-45d8-bfa1-fc8ececc4653 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:06.604951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f4f0bb3c-1000-45d8-bfa1-fc8ececc4653 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:06.622314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4f0bb3c-1000-45d8-bfa1-fc8ececc4653 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:06.622314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4f0bb3c-1000-45d8-bfa1-fc8ececc4653 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:06.628821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4f0bb3c-1000-45d8-bfa1-fc8ececc4653 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:06.630836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4f0bb3c-1000-45d8-bfa1-fc8ececc4653 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:06.631702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4f0bb3c-1000-45d8-bfa1-fc8ececc4653 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:06.632441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f4f0bb3c-1000-45d8-bfa1-fc8ececc4653 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:06.909077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f4f0bb3c-1000-45d8-bfa1-fc8ececc4653 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:06.921488 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f4f0bb3c-1000-45d8-bfa1-fc8ececc4653 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1202 microversion: 2.1 time: 0.321074 Oct 29 01:41:06.931467 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3305/6373] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:06 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1202 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:41:06.956431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-e60ccad5-7cfd-43ef-accf-29f50b9ae1ff req-f899cb1d-497b-43a2-92dd-ffc49725737c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64cd489b-a35c-4e71-af41-eb2d5d22b082", "name": "network-vif-plugged", "status": "completed", "tag": "faf344df-307c-4c6c-b506-bc5a26cded44"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:06.972361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e60ccad5-7cfd-43ef-accf-29f50b9ae1ff req-f899cb1d-497b-43a2-92dd-ffc49725737c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:06.973125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e60ccad5-7cfd-43ef-accf-29f50b9ae1ff req-f899cb1d-497b-43a2-92dd-ffc49725737c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:06.973420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e60ccad5-7cfd-43ef-accf-29f50b9ae1ff req-f899cb1d-497b-43a2-92dd-ffc49725737c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:06.986039 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-e60ccad5-7cfd-43ef-accf-29f50b9ae1ff req-f899cb1d-497b-43a2-92dd-ffc49725737c service nova] Creating event network-vif-plugged:faf344df-307c-4c6c-b506-bc5a26cded44 for instance 64cd489b-a35c-4e71-af41-eb2d5d22b082 on n-h1-862964-3 Oct 29 01:41:07.004555 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-e60ccad5-7cfd-43ef-accf-29f50b9ae1ff req-f899cb1d-497b-43a2-92dd-ffc49725737c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052226 Oct 29 01:41:07.005797 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3306/6374] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:41:07.082907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-529e1f0c-d6cc-49f3-bdb4-1e1994f25121 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:41:07.083523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-529e1f0c-d6cc-49f3-bdb4-1e1994f25121 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:41:07.083783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-529e1f0c-d6cc-49f3-bdb4-1e1994f25121 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:41:07.084377 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-529e1f0c-d6cc-49f3-bdb4-1e1994f25121 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:41:07.084943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-529e1f0c-d6cc-49f3-bdb4-1e1994f25121 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:41:07.097430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-529e1f0c-d6cc-49f3-bdb4-1e1994f25121 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:07.098163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-529e1f0c-d6cc-49f3-bdb4-1e1994f25121 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:07.098917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-529e1f0c-d6cc-49f3-bdb4-1e1994f25121 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:07.099810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-529e1f0c-d6cc-49f3-bdb4-1e1994f25121 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:07.100432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-529e1f0c-d6cc-49f3-bdb4-1e1994f25121 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:07.102417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-529e1f0c-d6cc-49f3-bdb4-1e1994f25121 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:07.128478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-529e1f0c-d6cc-49f3-bdb4-1e1994f25121 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Getting quotas for project e1817f6a3cd04ebbaa07dd63934d2771. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:41:07.138888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-529e1f0c-d6cc-49f3-bdb4-1e1994f25121 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Getting quotas for user ab773592a5914fcda533047d8044c3dc and project e1817f6a3cd04ebbaa07dd63934d2771. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:41:07.163846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-529e1f0c-d6cc-49f3-bdb4-1e1994f25121 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:41:07.163846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-529e1f0c-d6cc-49f3-bdb4-1e1994f25121 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:41:07.228903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3afbbba6-d8aa-4934-a94a-7d49d01d7232 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:07.229781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3afbbba6-d8aa-4934-a94a-7d49d01d7232 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:07.241420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3afbbba6-d8aa-4934-a94a-7d49d01d7232 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:07.241846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3afbbba6-d8aa-4934-a94a-7d49d01d7232 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:07.242470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3afbbba6-d8aa-4934-a94a-7d49d01d7232 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:07.243188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3afbbba6-d8aa-4934-a94a-7d49d01d7232 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:07.243652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3afbbba6-d8aa-4934-a94a-7d49d01d7232 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:07.244223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3afbbba6-d8aa-4934-a94a-7d49d01d7232 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:07.274020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3afbbba6-d8aa-4934-a94a-7d49d01d7232 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:41:07.351007 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-529e1f0c-d6cc-49f3-bdb4-1e1994f25121 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.907526 Oct 29 01:41:07.353044 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3069/6375] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:41:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:41:07.365537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7c93e2ba-955a-4e40-b7ef-aad6251af838 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:07.366107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7c93e2ba-955a-4e40-b7ef-aad6251af838 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:07.435956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7c93e2ba-955a-4e40-b7ef-aad6251af838 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:07.444820 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7c93e2ba-955a-4e40-b7ef-aad6251af838 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6" status: 200 len: 1247 microversion: 2.1 time: 0.083806 Oct 29 01:41:07.445440 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3070/6376] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:07 2022] GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 => generated 1247 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:07.677468 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3afbbba6-d8aa-4934-a94a-7d49d01d7232 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631" status: 204 len: 0 microversion: 2.1 time: 0.452594 Oct 29 01:41:07.679028 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3307/6377] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:41:07 2022] DELETE /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:41:07.688036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-36e75713-d26a-44ba-8396-bab223660c42 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:07.689200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-36e75713-d26a-44ba-8396-bab223660c42 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:07.697433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e75713-d26a-44ba-8396-bab223660c42 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:07.698128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e75713-d26a-44ba-8396-bab223660c42 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:07.698565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e75713-d26a-44ba-8396-bab223660c42 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:07.699528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e75713-d26a-44ba-8396-bab223660c42 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:07.699992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e75713-d26a-44ba-8396-bab223660c42 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:07.700421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e75713-d26a-44ba-8396-bab223660c42 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:07.846023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-36e75713-d26a-44ba-8396-bab223660c42 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:07.854498 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-36e75713-d26a-44ba-8396-bab223660c42 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631" status: 200 len: 1503 microversion: 2.1 time: 0.171262 Oct 29 01:41:07.855114 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3071/6378] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:07 2022] GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:07.950180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81773ad5-04bc-4f43-93c1-32070cb9f155 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:07.950891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-81773ad5-04bc-4f43-93c1-32070cb9f155 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:07.964087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81773ad5-04bc-4f43-93c1-32070cb9f155 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:07.964580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81773ad5-04bc-4f43-93c1-32070cb9f155 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:07.965025 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81773ad5-04bc-4f43-93c1-32070cb9f155 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:07.965876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81773ad5-04bc-4f43-93c1-32070cb9f155 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:07.968397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81773ad5-04bc-4f43-93c1-32070cb9f155 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:07.968880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81773ad5-04bc-4f43-93c1-32070cb9f155 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:08.128219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-81773ad5-04bc-4f43-93c1-32070cb9f155 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:08.136787 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-81773ad5-04bc-4f43-93c1-32070cb9f155 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1202 microversion: 2.1 time: 0.190817 Oct 29 01:41:08.137446 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3308/6379] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:07 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1202 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:08.467407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-80311f7c-01b7-43ff-b68a-b0a84d5cc5aa tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:08.468135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-80311f7c-01b7-43ff-b68a-b0a84d5cc5aa tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:08.474520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80311f7c-01b7-43ff-b68a-b0a84d5cc5aa tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:08.475013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80311f7c-01b7-43ff-b68a-b0a84d5cc5aa tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:08.475456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80311f7c-01b7-43ff-b68a-b0a84d5cc5aa tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:08.476154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80311f7c-01b7-43ff-b68a-b0a84d5cc5aa tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:08.476617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80311f7c-01b7-43ff-b68a-b0a84d5cc5aa tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:08.477081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80311f7c-01b7-43ff-b68a-b0a84d5cc5aa tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:08.539024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-80311f7c-01b7-43ff-b68a-b0a84d5cc5aa tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:08.547405 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-80311f7c-01b7-43ff-b68a-b0a84d5cc5aa tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6" status: 200 len: 1251 microversion: 2.1 time: 0.083990 Oct 29 01:41:08.547985 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3072/6380] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:08 2022] GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 => generated 1251 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:08.878201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d81e3060-7eef-43be-81fb-7be5f6a92b95 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:08.878818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d81e3060-7eef-43be-81fb-7be5f6a92b95 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:08.887174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d81e3060-7eef-43be-81fb-7be5f6a92b95 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:08.889607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d81e3060-7eef-43be-81fb-7be5f6a92b95 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:08.889607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d81e3060-7eef-43be-81fb-7be5f6a92b95 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:08.889607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d81e3060-7eef-43be-81fb-7be5f6a92b95 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:08.889607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d81e3060-7eef-43be-81fb-7be5f6a92b95 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:08.890143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d81e3060-7eef-43be-81fb-7be5f6a92b95 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:09.032626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d81e3060-7eef-43be-81fb-7be5f6a92b95 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:09.040951 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d81e3060-7eef-43be-81fb-7be5f6a92b95 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631" status: 200 len: 1503 microversion: 2.1 time: 0.166901 Oct 29 01:41:09.041592 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3309/6381] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:08 2022] GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:09.160548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8bb83fa7-e430-4264-b2b5-843fbce55434 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:09.161296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8bb83fa7-e430-4264-b2b5-843fbce55434 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:09.168152 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8bb83fa7-e430-4264-b2b5-843fbce55434 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:09.168703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8bb83fa7-e430-4264-b2b5-843fbce55434 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:09.169083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8bb83fa7-e430-4264-b2b5-843fbce55434 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:09.169836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8bb83fa7-e430-4264-b2b5-843fbce55434 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:09.170299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8bb83fa7-e430-4264-b2b5-843fbce55434 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:09.170727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8bb83fa7-e430-4264-b2b5-843fbce55434 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:09.308779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8bb83fa7-e430-4264-b2b5-843fbce55434 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:09.317082 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8bb83fa7-e430-4264-b2b5-843fbce55434 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1389 microversion: 2.1 time: 0.160481 Oct 29 01:41:09.317699 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3073/6382] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:09 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1389 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:09.340555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0fac284b-6363-45b7-8f56-3374d89f72e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:09.341170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0fac284b-6363-45b7-8f56-3374d89f72e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:09.351410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fac284b-6363-45b7-8f56-3374d89f72e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:09.351410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fac284b-6363-45b7-8f56-3374d89f72e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:09.351410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fac284b-6363-45b7-8f56-3374d89f72e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:09.351410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fac284b-6363-45b7-8f56-3374d89f72e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:09.351410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fac284b-6363-45b7-8f56-3374d89f72e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:09.351410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0fac284b-6363-45b7-8f56-3374d89f72e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:09.490704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0fac284b-6363-45b7-8f56-3374d89f72e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:09.504023 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0fac284b-6363-45b7-8f56-3374d89f72e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1389 microversion: 2.1 time: 0.167204 Oct 29 01:41:09.518368 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3310/6383] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:09 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1389 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:09.532180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3c2682a5-caf1-4501-8d47-f2aeb71d504e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:09.532796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3c2682a5-caf1-4501-8d47-f2aeb71d504e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:09.539678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c2682a5-caf1-4501-8d47-f2aeb71d504e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:09.540439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c2682a5-caf1-4501-8d47-f2aeb71d504e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:09.540591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c2682a5-caf1-4501-8d47-f2aeb71d504e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:09.541514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c2682a5-caf1-4501-8d47-f2aeb71d504e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:09.542011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c2682a5-caf1-4501-8d47-f2aeb71d504e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:09.542594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c2682a5-caf1-4501-8d47-f2aeb71d504e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:09.571049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb4ef66b-0fa7-4a1a-bf91-68fb8733f435 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:09.572034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bb4ef66b-0fa7-4a1a-bf91-68fb8733f435 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:09.581462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb4ef66b-0fa7-4a1a-bf91-68fb8733f435 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:09.581951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb4ef66b-0fa7-4a1a-bf91-68fb8733f435 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:09.582379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb4ef66b-0fa7-4a1a-bf91-68fb8733f435 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:09.583290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb4ef66b-0fa7-4a1a-bf91-68fb8733f435 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:09.583884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb4ef66b-0fa7-4a1a-bf91-68fb8733f435 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:09.584490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb4ef66b-0fa7-4a1a-bf91-68fb8733f435 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:09.679355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bb4ef66b-0fa7-4a1a-bf91-68fb8733f435 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:09.683822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:41:09.689295 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bb4ef66b-0fa7-4a1a-bf91-68fb8733f435 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6" status: 200 len: 1243 microversion: 2.1 time: 0.121649 Oct 29 01:41:09.689895 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3311/6384] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:09 2022] GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 => generated 1243 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:09.721024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3c2682a5-caf1-4501-8d47-f2aeb71d504e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:09.730139 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3c2682a5-caf1-4501-8d47-f2aeb71d504e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1389 microversion: 2.1 time: 0.202534 Oct 29 01:41:09.731203 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3074/6385] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:09 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1389 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:09.756980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5897f496-4dde-4751-af6c-05b0d6e41f39 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:09.757636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5897f496-4dde-4751-af6c-05b0d6e41f39 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:09.769713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5897f496-4dde-4751-af6c-05b0d6e41f39 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:09.770199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5897f496-4dde-4751-af6c-05b0d6e41f39 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:09.770663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5897f496-4dde-4751-af6c-05b0d6e41f39 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:09.771638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5897f496-4dde-4751-af6c-05b0d6e41f39 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:09.772256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5897f496-4dde-4751-af6c-05b0d6e41f39 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:09.772845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5897f496-4dde-4751-af6c-05b0d6e41f39 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:09.809592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5897f496-4dde-4751-af6c-05b0d6e41f39 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:41:10.058961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-e6f6b7ed-e71d-4bf3-8a40-4558fa6fb7bb req-6847db9c-5962-4fa9-af44-df8436b97d57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0dc4dc7-c79a-4935-a401-71725b778631", "name": "network-vif-deleted", "tag": "27023b93-2e9a-466a-8ddd-3ff09eadee88"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:10.069693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e6f6b7ed-e71d-4bf3-8a40-4558fa6fb7bb req-6847db9c-5962-4fa9-af44-df8436b97d57 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:10.070172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e6f6b7ed-e71d-4bf3-8a40-4558fa6fb7bb req-6847db9c-5962-4fa9-af44-df8436b97d57 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:10.070613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e6f6b7ed-e71d-4bf3-8a40-4558fa6fb7bb req-6847db9c-5962-4fa9-af44-df8436b97d57 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:10.082485 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-e6f6b7ed-e71d-4bf3-8a40-4558fa6fb7bb req-6847db9c-5962-4fa9-af44-df8436b97d57 service nova] Creating event network-vif-deleted:27023b93-2e9a-466a-8ddd-3ff09eadee88 for instance a0dc4dc7-c79a-4935-a401-71725b778631 on n-h2-862964-3 Oct 29 01:41:10.096645 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-e6f6b7ed-e71d-4bf3-8a40-4558fa6fb7bb req-6847db9c-5962-4fa9-af44-df8436b97d57 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041344 Oct 29 01:41:10.097507 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3075/6386] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:41:10.103682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-96303360-7f05-440f-b87a-61b36a7009d8 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:10.103682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-96303360-7f05-440f-b87a-61b36a7009d8 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:10.110462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96303360-7f05-440f-b87a-61b36a7009d8 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:10.110917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96303360-7f05-440f-b87a-61b36a7009d8 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:10.111348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96303360-7f05-440f-b87a-61b36a7009d8 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:10.112037 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96303360-7f05-440f-b87a-61b36a7009d8 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:10.112490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96303360-7f05-440f-b87a-61b36a7009d8 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:10.112910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96303360-7f05-440f-b87a-61b36a7009d8 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:10.167886 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5897f496-4dde-4751-af6c-05b0d6e41f39 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "DELETE /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 204 len: 0 microversion: 2.1 time: 0.414573 Oct 29 01:41:10.168480 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3312/6387] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:41:09 2022] DELETE /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:41:10.178076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1124da05-1937-4c2d-99dd-bb2422d62227 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:10.178948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1124da05-1937-4c2d-99dd-bb2422d62227 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:10.186350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1124da05-1937-4c2d-99dd-bb2422d62227 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:10.187805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1124da05-1937-4c2d-99dd-bb2422d62227 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:10.188606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1124da05-1937-4c2d-99dd-bb2422d62227 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:10.189790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1124da05-1937-4c2d-99dd-bb2422d62227 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:10.190572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1124da05-1937-4c2d-99dd-bb2422d62227 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:10.191367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1124da05-1937-4c2d-99dd-bb2422d62227 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:10.200220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-96303360-7f05-440f-b87a-61b36a7009d8 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:10.217984 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-96303360-7f05-440f-b87a-61b36a7009d8 tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631" status: 200 len: 1461 microversion: 2.1 time: 0.119109 Oct 29 01:41:10.224195 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3076/6388] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:10 2022] GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631 => generated 1461 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:10.273050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fe4b12f4-af44-4cdd-9b61-80de159594cd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:10.275355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fe4b12f4-af44-4cdd-9b61-80de159594cd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:10.282711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe4b12f4-af44-4cdd-9b61-80de159594cd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:10.283455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe4b12f4-af44-4cdd-9b61-80de159594cd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:10.283935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe4b12f4-af44-4cdd-9b61-80de159594cd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:10.285611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe4b12f4-af44-4cdd-9b61-80de159594cd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:10.286264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe4b12f4-af44-4cdd-9b61-80de159594cd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:10.286888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fe4b12f4-af44-4cdd-9b61-80de159594cd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:10.374704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1124da05-1937-4c2d-99dd-bb2422d62227 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:10.384112 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1124da05-1937-4c2d-99dd-bb2422d62227 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1395 microversion: 2.1 time: 0.210174 Oct 29 01:41:10.384751 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3313/6389] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:10 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1395 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:41:10.604622 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fe4b12f4-af44-4cdd-9b61-80de159594cd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.335554 Oct 29 01:41:10.614696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-611cd7f6-64c1-48eb-81bf-b755e3337a02 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:10.615310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-611cd7f6-64c1-48eb-81bf-b755e3337a02 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:10.620192 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3077/6390] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:41:10 2022] POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:41:10.623769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-611cd7f6-64c1-48eb-81bf-b755e3337a02 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:10.625324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-611cd7f6-64c1-48eb-81bf-b755e3337a02 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:10.625324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-611cd7f6-64c1-48eb-81bf-b755e3337a02 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:10.625810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-611cd7f6-64c1-48eb-81bf-b755e3337a02 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:10.626825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-611cd7f6-64c1-48eb-81bf-b755e3337a02 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:10.627250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-611cd7f6-64c1-48eb-81bf-b755e3337a02 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:10.715161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-61bf7f15-e0fb-4cb4-b79f-cecf310cc722 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:10.716072 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-61bf7f15-e0fb-4cb4-b79f-cecf310cc722 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:10.726238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61bf7f15-e0fb-4cb4-b79f-cecf310cc722 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:10.726741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61bf7f15-e0fb-4cb4-b79f-cecf310cc722 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:10.727185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61bf7f15-e0fb-4cb4-b79f-cecf310cc722 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:10.727918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61bf7f15-e0fb-4cb4-b79f-cecf310cc722 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:10.728387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61bf7f15-e0fb-4cb4-b79f-cecf310cc722 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:10.728842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61bf7f15-e0fb-4cb4-b79f-cecf310cc722 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:10.849511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-611cd7f6-64c1-48eb-81bf-b755e3337a02 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:10.871321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-61bf7f15-e0fb-4cb4-b79f-cecf310cc722 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:10.885794 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-611cd7f6-64c1-48eb-81bf-b755e3337a02 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1672 microversion: 2.1 time: 0.273000 Oct 29 01:41:10.887076 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3314/6391] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:10 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1672 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:41:10.892990 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-61bf7f15-e0fb-4cb4-b79f-cecf310cc722 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6" status: 200 len: 1307 microversion: 2.1 time: 0.182444 Oct 29 01:41:10.893838 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3078/6392] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:10 2022] GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 => generated 1307 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:11.247950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5df05c0c-9d8b-4e02-97fa-181e86ce8c3f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:11.248561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5df05c0c-9d8b-4e02-97fa-181e86ce8c3f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:11.257177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df05c0c-9d8b-4e02-97fa-181e86ce8c3f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:11.257705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df05c0c-9d8b-4e02-97fa-181e86ce8c3f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:11.258111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df05c0c-9d8b-4e02-97fa-181e86ce8c3f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:11.258988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df05c0c-9d8b-4e02-97fa-181e86ce8c3f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:11.259440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df05c0c-9d8b-4e02-97fa-181e86ce8c3f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:11.259865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df05c0c-9d8b-4e02-97fa-181e86ce8c3f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:11.291911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df05c0c-9d8b-4e02-97fa-181e86ce8c3f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:11.292414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df05c0c-9d8b-4e02-97fa-181e86ce8c3f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:11.292844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5df05c0c-9d8b-4e02-97fa-181e86ce8c3f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:11.293332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-5df05c0c-9d8b-4e02-97fa-181e86ce8c3f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lazy-loading 'fault' on Instance uuid a0dc4dc7-c79a-4935-a401-71725b778631 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:41:11.335748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5df05c0c-9d8b-4e02-97fa-181e86ce8c3f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9aee15dd34a20bba11a5b550933d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db565e2216be404ebae26f30b2ef2199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:11.345547 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5df05c0c-9d8b-4e02-97fa-181e86ce8c3f tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631" status: 200 len: 1303 microversion: 2.1 time: 0.100932 Oct 29 01:41:11.348272 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3315/6393] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:11 2022] GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:11.408280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-47e7c9c1-2c01-4ff8-842f-96228ffa41d7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:11.409131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-47e7c9c1-2c01-4ff8-842f-96228ffa41d7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:11.419689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47e7c9c1-2c01-4ff8-842f-96228ffa41d7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:11.420323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47e7c9c1-2c01-4ff8-842f-96228ffa41d7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:11.421246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47e7c9c1-2c01-4ff8-842f-96228ffa41d7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:11.422338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47e7c9c1-2c01-4ff8-842f-96228ffa41d7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:11.422903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47e7c9c1-2c01-4ff8-842f-96228ffa41d7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:11.423550 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-47e7c9c1-2c01-4ff8-842f-96228ffa41d7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:11.587505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-47e7c9c1-2c01-4ff8-842f-96228ffa41d7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:11.597322 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-47e7c9c1-2c01-4ff8-842f-96228ffa41d7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1395 microversion: 2.1 time: 0.193636 Oct 29 01:41:11.598252 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3079/6394] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:11 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1395 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:11.919944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c1cef156-631b-4fa8-bf41-0ac6c5a6d6c9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:11.925842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e219c7e1-b960-4747-978a-abe668bcc6fa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:11.926458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e219c7e1-b960-4747-978a-abe668bcc6fa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:11.929665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c1cef156-631b-4fa8-bf41-0ac6c5a6d6c9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:11.934214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e219c7e1-b960-4747-978a-abe668bcc6fa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:11.934861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e219c7e1-b960-4747-978a-abe668bcc6fa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:11.935579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e219c7e1-b960-4747-978a-abe668bcc6fa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:11.936440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1cef156-631b-4fa8-bf41-0ac6c5a6d6c9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:11.936990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1cef156-631b-4fa8-bf41-0ac6c5a6d6c9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:11.937490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1cef156-631b-4fa8-bf41-0ac6c5a6d6c9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:11.937833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e219c7e1-b960-4747-978a-abe668bcc6fa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:11.938355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1cef156-631b-4fa8-bf41-0ac6c5a6d6c9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:11.938461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e219c7e1-b960-4747-978a-abe668bcc6fa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:11.939076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1cef156-631b-4fa8-bf41-0ac6c5a6d6c9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:11.939176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e219c7e1-b960-4747-978a-abe668bcc6fa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:11.939508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1cef156-631b-4fa8-bf41-0ac6c5a6d6c9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:12.303354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e219c7e1-b960-4747-978a-abe668bcc6fa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:12.315008 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e219c7e1-b960-4747-978a-abe668bcc6fa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1672 microversion: 2.1 time: 0.393814 Oct 29 01:41:12.316455 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3316/6395] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:11 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1672 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:12.322946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c1cef156-631b-4fa8-bf41-0ac6c5a6d6c9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:12.331306 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c1cef156-631b-4fa8-bf41-0ac6c5a6d6c9 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6" status: 200 len: 1373 microversion: 2.1 time: 0.415395 Oct 29 01:41:12.331869 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3080/6396] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:11 2022] GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 => generated 1373 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:12.369279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a0568299-71ec-4cbc-8c20-0c0c2ae18cbe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:12.369909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a0568299-71ec-4cbc-8c20-0c0c2ae18cbe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] [instance: a0dc4dc7-c79a-4935-a401-71725b778631] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:12.376972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0568299-71ec-4cbc-8c20-0c0c2ae18cbe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:12.377702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0568299-71ec-4cbc-8c20-0c0c2ae18cbe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:12.378284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0568299-71ec-4cbc-8c20-0c0c2ae18cbe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:12.379142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0568299-71ec-4cbc-8c20-0c0c2ae18cbe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:12.379740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0568299-71ec-4cbc-8c20-0c0c2ae18cbe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:12.389111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a0568299-71ec-4cbc-8c20-0c0c2ae18cbe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:12.396367 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-a0568299-71ec-4cbc-8c20-0c0c2ae18cbe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] HTTP exception thrown: Instance a0dc4dc7-c79a-4935-a401-71725b778631 could not be found. Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a0568299-71ec-4cbc-8c20-0c0c2ae18cbe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Request method failure captured: Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631 HTTP/1.1 Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXISJk2lib5ZPLKlB4iAmDeuEQSMs5L7xVsOxy5rkEb4KQaEFGj67_N9-KzmMKs08kIg8kQAYEy1fv9-avj9zyxBX-umxiPNGAAH8qQTU_pqxCiaUJfif8IlldAf8ihKEcxQt5Lkdkf3muzerNE8L2oTaYQxUKP5GAAMY_nkfGyrunew Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: db565e2216be404ebae26f30b2ef2199 Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-VolumesActionsTest-1542322320 Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db565e2216be404ebae26f30b2ef2199"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db565e2216be404ebae26f30b2ef2199"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db565e2216be404ebae26f30b2ef2199"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db565e2216be404ebae26f30b2ef2199", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-VolumesActionsTest-1542322320 Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: db565e2216be404ebae26f30b2ef2199 Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-VolumesActionsTest-1542322320 Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-VolumesActionsTest-1542322320-project Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 84d9aee15dd34a20bba11a5b550933d6 Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-VolumesActionsTest-1542322320-project Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance a0dc4dc7-c79a-4935-a401-71725b778631 could not be found. Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'a0dc4dc7-c79a-4935-a401-71725b778631'} Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0dc4dc7-c79a-4935-a401-71725b778631 could not be found. Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0dc4dc7-c79a-4935-a401-71725b778631 could not be found. Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:41:12.398280 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:12.402309 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:12.402309 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:41:12.402309 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:41:12.402309 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:41:12.402309 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:41:12.402309 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0dc4dc7-c79a-4935-a401-71725b778631 could not be found. Oct 29 01:41:12.402309 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:12.403823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a0568299-71ec-4cbc-8c20-0c0c2ae18cbe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] Returning 404 to user: Instance a0dc4dc7-c79a-4935-a401-71725b778631 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:41:12.404864 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a0568299-71ec-4cbc-8c20-0c0c2ae18cbe tempest-VolumesActionsTest-1542322320 tempest-VolumesActionsTest-1542322320-project] 10.222.0.26 "GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631" status: 404 len: 111 microversion: 2.1 time: 0.039660 Oct 29 01:41:12.405666 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3317/6397] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:12 2022] GET /compute/v2.1/servers/a0dc4dc7-c79a-4935-a401-71725b778631 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:41:12.563082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-0d9d0734-42fd-48b6-9a56-4d661991db0e req-725a34c7-3e8a-4801-8715-e7bd7ad1906e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ff1ca70-b641-4a85-8988-ebd6bccd2ec6", "tag": "cb5933ab-9db6-48b2-aed9-3422fd9e2671"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:12.574599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-0d9d0734-42fd-48b6-9a56-4d661991db0e req-725a34c7-3e8a-4801-8715-e7bd7ad1906e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:12.575887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-0d9d0734-42fd-48b6-9a56-4d661991db0e req-725a34c7-3e8a-4801-8715-e7bd7ad1906e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:12.576443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-0d9d0734-42fd-48b6-9a56-4d661991db0e req-725a34c7-3e8a-4801-8715-e7bd7ad1906e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:12.591544 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-0d9d0734-42fd-48b6-9a56-4d661991db0e req-725a34c7-3e8a-4801-8715-e7bd7ad1906e service nova] Creating event network-changed:cb5933ab-9db6-48b2-aed9-3422fd9e2671 for instance 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 on n-h2-862964-3 Oct 29 01:41:12.597720 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-0d9d0734-42fd-48b6-9a56-4d661991db0e req-725a34c7-3e8a-4801-8715-e7bd7ad1906e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038489 Oct 29 01:41:12.599338 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3081/6398] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:41:12.621842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-20d159e6-cdd9-42ae-a89a-ce7cb30de422 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:12.623040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-20d159e6-cdd9-42ae-a89a-ce7cb30de422 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:12.645437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20d159e6-cdd9-42ae-a89a-ce7cb30de422 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:12.646198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20d159e6-cdd9-42ae-a89a-ce7cb30de422 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:12.648414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20d159e6-cdd9-42ae-a89a-ce7cb30de422 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:12.650111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20d159e6-cdd9-42ae-a89a-ce7cb30de422 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:12.650788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20d159e6-cdd9-42ae-a89a-ce7cb30de422 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:12.652014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20d159e6-cdd9-42ae-a89a-ce7cb30de422 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:12.907016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-20d159e6-cdd9-42ae-a89a-ce7cb30de422 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:12.916214 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-20d159e6-cdd9-42ae-a89a-ce7cb30de422 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1395 microversion: 2.1 time: 0.298251 Oct 29 01:41:12.917034 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3318/6399] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:12 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1395 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:13.254102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-043b5200-64ba-4a61-99fc-c47d2b29980a req-ebd49f14-5b18-4ae8-a5a7-ad72731a692d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64cd489b-a35c-4e71-af41-eb2d5d22b082", "name": "network-vif-deleted", "tag": "faf344df-307c-4c6c-b506-bc5a26cded44"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:13.284578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-043b5200-64ba-4a61-99fc-c47d2b29980a req-ebd49f14-5b18-4ae8-a5a7-ad72731a692d service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:13.291184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-043b5200-64ba-4a61-99fc-c47d2b29980a req-ebd49f14-5b18-4ae8-a5a7-ad72731a692d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:13.291897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-043b5200-64ba-4a61-99fc-c47d2b29980a req-ebd49f14-5b18-4ae8-a5a7-ad72731a692d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:13.320382 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-043b5200-64ba-4a61-99fc-c47d2b29980a req-ebd49f14-5b18-4ae8-a5a7-ad72731a692d service nova] Creating event network-vif-deleted:faf344df-307c-4c6c-b506-bc5a26cded44 for instance 64cd489b-a35c-4e71-af41-eb2d5d22b082 on n-h1-862964-3 Oct 29 01:41:13.341590 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-043b5200-64ba-4a61-99fc-c47d2b29980a req-ebd49f14-5b18-4ae8-a5a7-ad72731a692d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092780 Oct 29 01:41:13.342616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-962486cc-7530-4843-a55e-99c2b6f1d2c2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:13.344588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-962486cc-7530-4843-a55e-99c2b6f1d2c2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:13.345446 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3082/6400] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:41:13.349037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:41:13.365365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9fe924be-54f9-402a-aab9-1df5818c5131 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:13.367020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9fe924be-54f9-402a-aab9-1df5818c5131 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:13.370366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-962486cc-7530-4843-a55e-99c2b6f1d2c2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:13.372198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-962486cc-7530-4843-a55e-99c2b6f1d2c2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:13.376000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-962486cc-7530-4843-a55e-99c2b6f1d2c2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:13.377077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-962486cc-7530-4843-a55e-99c2b6f1d2c2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:13.377813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-962486cc-7530-4843-a55e-99c2b6f1d2c2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:13.378458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-962486cc-7530-4843-a55e-99c2b6f1d2c2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:13.393626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9fe924be-54f9-402a-aab9-1df5818c5131 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:13.394416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9fe924be-54f9-402a-aab9-1df5818c5131 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:13.395009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9fe924be-54f9-402a-aab9-1df5818c5131 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:13.395901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9fe924be-54f9-402a-aab9-1df5818c5131 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:13.396662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9fe924be-54f9-402a-aab9-1df5818c5131 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:13.397277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9fe924be-54f9-402a-aab9-1df5818c5131 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:13.425873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:41:13.675814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-962486cc-7530-4843-a55e-99c2b6f1d2c2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:13.713365 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-962486cc-7530-4843-a55e-99c2b6f1d2c2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1677 microversion: 2.1 time: 0.371983 Oct 29 01:41:13.714175 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3319/6401] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:13 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1677 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:41:13.760992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9fe924be-54f9-402a-aab9-1df5818c5131 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:13.778095 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9fe924be-54f9-402a-aab9-1df5818c5131 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6" status: 200 len: 1373 microversion: 2.1 time: 0.426540 Oct 29 01:41:13.778656 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3083/6402] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:13 2022] GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 => generated 1373 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:13.943649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0e67e447-b89e-4cc4-b6c5-361ec59d1e9a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:13.944273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0e67e447-b89e-4cc4-b6c5-361ec59d1e9a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:13.951561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e67e447-b89e-4cc4-b6c5-361ec59d1e9a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:13.952458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e67e447-b89e-4cc4-b6c5-361ec59d1e9a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:13.953098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e67e447-b89e-4cc4-b6c5-361ec59d1e9a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:13.954017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e67e447-b89e-4cc4-b6c5-361ec59d1e9a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:13.954635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e67e447-b89e-4cc4-b6c5-361ec59d1e9a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:13.955232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0e67e447-b89e-4cc4-b6c5-361ec59d1e9a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:14.049952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0e67e447-b89e-4cc4-b6c5-361ec59d1e9a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:14.058623 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0e67e447-b89e-4cc4-b6c5-361ec59d1e9a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1187 microversion: 2.1 time: 0.122173 Oct 29 01:41:14.060985 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3320/6403] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:13 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1187 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:14.753095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5c83cbdd-e183-42b5-88df-eab252277ab5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:14.753709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5c83cbdd-e183-42b5-88df-eab252277ab5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:14.762319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c83cbdd-e183-42b5-88df-eab252277ab5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:14.762822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c83cbdd-e183-42b5-88df-eab252277ab5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:14.763434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c83cbdd-e183-42b5-88df-eab252277ab5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:14.764162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c83cbdd-e183-42b5-88df-eab252277ab5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:14.764622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c83cbdd-e183-42b5-88df-eab252277ab5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:14.765062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c83cbdd-e183-42b5-88df-eab252277ab5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:14.801215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bed8ec99-0d3d-4ec2-a5b2-adbead1f4e2f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:14.802693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bed8ec99-0d3d-4ec2-a5b2-adbead1f4e2f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:14.810059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bed8ec99-0d3d-4ec2-a5b2-adbead1f4e2f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:14.810885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bed8ec99-0d3d-4ec2-a5b2-adbead1f4e2f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:14.811586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bed8ec99-0d3d-4ec2-a5b2-adbead1f4e2f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:14.813265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bed8ec99-0d3d-4ec2-a5b2-adbead1f4e2f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:14.814118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bed8ec99-0d3d-4ec2-a5b2-adbead1f4e2f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:14.814760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bed8ec99-0d3d-4ec2-a5b2-adbead1f4e2f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:15.031484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5c83cbdd-e183-42b5-88df-eab252277ab5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:15.034540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bed8ec99-0d3d-4ec2-a5b2-adbead1f4e2f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:15.042825 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bed8ec99-0d3d-4ec2-a5b2-adbead1f4e2f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6" status: 200 len: 1373 microversion: 2.1 time: 0.245404 Oct 29 01:41:15.057190 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3321/6404] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:14 2022] GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 => generated 1373 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:41:15.057411 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5c83cbdd-e183-42b5-88df-eab252277ab5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.297348 Oct 29 01:41:15.057411 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3084/6405] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:14 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:15.083673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1d145ffd-aef6-48c6-9dcd-bf92640cba07 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:15.084291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1d145ffd-aef6-48c6-9dcd-bf92640cba07 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:15.091474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d145ffd-aef6-48c6-9dcd-bf92640cba07 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:15.091964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d145ffd-aef6-48c6-9dcd-bf92640cba07 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:15.092494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d145ffd-aef6-48c6-9dcd-bf92640cba07 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:15.093472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d145ffd-aef6-48c6-9dcd-bf92640cba07 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:15.094004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d145ffd-aef6-48c6-9dcd-bf92640cba07 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:15.094570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d145ffd-aef6-48c6-9dcd-bf92640cba07 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:15.158898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1d145ffd-aef6-48c6-9dcd-bf92640cba07 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:15.166877 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1d145ffd-aef6-48c6-9dcd-bf92640cba07 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1187 microversion: 2.1 time: 0.087559 Oct 29 01:41:15.167600 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3322/6406] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:15 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:16.082003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4c0fcd11-9171-4eb8-a6cd-a5a0f005042f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:16.082554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4c0fcd11-9171-4eb8-a6cd-a5a0f005042f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:16.092856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c0fcd11-9171-4eb8-a6cd-a5a0f005042f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:16.094015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c0fcd11-9171-4eb8-a6cd-a5a0f005042f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:16.096561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c0fcd11-9171-4eb8-a6cd-a5a0f005042f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:16.099966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c0fcd11-9171-4eb8-a6cd-a5a0f005042f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:16.100645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c0fcd11-9171-4eb8-a6cd-a5a0f005042f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:16.101299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c0fcd11-9171-4eb8-a6cd-a5a0f005042f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:16.192162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0b976c91-12d9-4169-9ad6-54029d254d86 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:16.193067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0b976c91-12d9-4169-9ad6-54029d254d86 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:16.205046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b976c91-12d9-4169-9ad6-54029d254d86 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:16.205596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b976c91-12d9-4169-9ad6-54029d254d86 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:16.206139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b976c91-12d9-4169-9ad6-54029d254d86 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:16.206783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b976c91-12d9-4169-9ad6-54029d254d86 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:16.207295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b976c91-12d9-4169-9ad6-54029d254d86 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:16.207729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b976c91-12d9-4169-9ad6-54029d254d86 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:16.306456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4c0fcd11-9171-4eb8-a6cd-a5a0f005042f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:16.322997 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4c0fcd11-9171-4eb8-a6cd-a5a0f005042f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6" status: 200 len: 1373 microversion: 2.1 time: 0.245877 Oct 29 01:41:16.326789 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3085/6407] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:16 2022] GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 => generated 1373 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:16.347287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0b976c91-12d9-4169-9ad6-54029d254d86 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:16.360351 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0b976c91-12d9-4169-9ad6-54029d254d86 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1187 microversion: 2.1 time: 0.173709 Oct 29 01:41:16.361392 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3323/6408] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:16 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1187 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:41:17.351738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-93dd90f7-07d6-4ce9-ac1c-87db87ef1c1e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:17.353179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-93dd90f7-07d6-4ce9-ac1c-87db87ef1c1e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:17.366516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:41:17.373896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93dd90f7-07d6-4ce9-ac1c-87db87ef1c1e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:17.377556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93dd90f7-07d6-4ce9-ac1c-87db87ef1c1e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:17.379127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93dd90f7-07d6-4ce9-ac1c-87db87ef1c1e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:17.382457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93dd90f7-07d6-4ce9-ac1c-87db87ef1c1e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:17.384013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93dd90f7-07d6-4ce9-ac1c-87db87ef1c1e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:17.387254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93dd90f7-07d6-4ce9-ac1c-87db87ef1c1e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:17.387475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7748ea79-41ed-4489-a716-24d9d1b6521f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:17.388130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7748ea79-41ed-4489-a716-24d9d1b6521f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:17.400825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7748ea79-41ed-4489-a716-24d9d1b6521f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:17.401356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7748ea79-41ed-4489-a716-24d9d1b6521f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:17.401806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7748ea79-41ed-4489-a716-24d9d1b6521f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:17.402544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7748ea79-41ed-4489-a716-24d9d1b6521f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:17.403012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7748ea79-41ed-4489-a716-24d9d1b6521f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:17.403449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7748ea79-41ed-4489-a716-24d9d1b6521f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:17.440510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:41:17.555615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7748ea79-41ed-4489-a716-24d9d1b6521f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:17.567275 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7748ea79-41ed-4489-a716-24d9d1b6521f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1187 microversion: 2.1 time: 0.183566 Oct 29 01:41:17.567870 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3324/6409] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:17 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1187 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:17.664735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-93dd90f7-07d6-4ce9-ac1c-87db87ef1c1e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:17.678813 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-93dd90f7-07d6-4ce9-ac1c-87db87ef1c1e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6" status: 200 len: 1373 microversion: 2.1 time: 0.331620 Oct 29 01:41:17.702179 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3086/6410] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:17 2022] GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 => generated 1373 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:18.595833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a41d0e67-1440-4d54-9f1b-d7272a029dd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:18.596447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a41d0e67-1440-4d54-9f1b-d7272a029dd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:18.603701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a41d0e67-1440-4d54-9f1b-d7272a029dd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:18.604645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a41d0e67-1440-4d54-9f1b-d7272a029dd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:18.605319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a41d0e67-1440-4d54-9f1b-d7272a029dd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:18.606327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a41d0e67-1440-4d54-9f1b-d7272a029dd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:18.606956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a41d0e67-1440-4d54-9f1b-d7272a029dd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:18.607532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a41d0e67-1440-4d54-9f1b-d7272a029dd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:18.675638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a41d0e67-1440-4d54-9f1b-d7272a029dd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:18.686086 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a41d0e67-1440-4d54-9f1b-d7272a029dd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1187 microversion: 2.1 time: 0.095034 Oct 29 01:41:18.686672 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3325/6411] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:18 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1187 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:18.703519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e7fbdd66-4716-44f8-a43a-afae8f358217 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:18.704947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e7fbdd66-4716-44f8-a43a-afae8f358217 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:18.713963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7fbdd66-4716-44f8-a43a-afae8f358217 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:18.715711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7fbdd66-4716-44f8-a43a-afae8f358217 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:18.720217 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7fbdd66-4716-44f8-a43a-afae8f358217 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:18.721697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7fbdd66-4716-44f8-a43a-afae8f358217 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:18.723568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7fbdd66-4716-44f8-a43a-afae8f358217 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:18.727138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7fbdd66-4716-44f8-a43a-afae8f358217 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:18.902644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e7fbdd66-4716-44f8-a43a-afae8f358217 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:18.915927 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e7fbdd66-4716-44f8-a43a-afae8f358217 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6" status: 200 len: 1373 microversion: 2.1 time: 0.216648 Oct 29 01:41:18.931429 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3087/6412] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:18 2022] GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 => generated 1373 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:19.520678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8ffbb313-689f-4471-add3-e0be718fe7d8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:19.522991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8ffbb313-689f-4471-add3-e0be718fe7d8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:19.529437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ffbb313-689f-4471-add3-e0be718fe7d8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:19.530163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ffbb313-689f-4471-add3-e0be718fe7d8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:19.530881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ffbb313-689f-4471-add3-e0be718fe7d8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:19.531864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ffbb313-689f-4471-add3-e0be718fe7d8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:19.532578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ffbb313-689f-4471-add3-e0be718fe7d8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:19.533007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ffbb313-689f-4471-add3-e0be718fe7d8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:19.576811 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8ffbb313-689f-4471-add3-e0be718fe7d8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061357 Oct 29 01:41:19.578580 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3326/6413] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 29 01:41:19 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:19.592655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-fb956600-8bef-4748-86fb-dbca4f84dce6 req-01208553-b405-43e5-a1e4-b0e9ea27ab56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff1ca70-b641-4a85-8988-ebd6bccd2ec6", "name": "network-vif-plugged", "status": "completed", "tag": "cb5933ab-9db6-48b2-aed9-3422fd9e2671"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:19.604569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-fb956600-8bef-4748-86fb-dbca4f84dce6 req-01208553-b405-43e5-a1e4-b0e9ea27ab56 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:19.605268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-fb956600-8bef-4748-86fb-dbca4f84dce6 req-01208553-b405-43e5-a1e4-b0e9ea27ab56 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:19.605622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-fb956600-8bef-4748-86fb-dbca4f84dce6 req-01208553-b405-43e5-a1e4-b0e9ea27ab56 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:19.620736 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-fb956600-8bef-4748-86fb-dbca4f84dce6 req-01208553-b405-43e5-a1e4-b0e9ea27ab56 service nova] Creating event network-vif-plugged:cb5933ab-9db6-48b2-aed9-3422fd9e2671 for instance 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 on n-h2-862964-3 Oct 29 01:41:19.629696 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-fb956600-8bef-4748-86fb-dbca4f84dce6 req-01208553-b405-43e5-a1e4-b0e9ea27ab56 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041597 Oct 29 01:41:19.630723 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3088/6414] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:41:19.663313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e8924117-8750-49b7-9a05-5bfa7175117a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:19.664796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e8924117-8750-49b7-9a05-5bfa7175117a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:19.673603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8924117-8750-49b7-9a05-5bfa7175117a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:19.675649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8924117-8750-49b7-9a05-5bfa7175117a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:19.675649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8924117-8750-49b7-9a05-5bfa7175117a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:19.675848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8924117-8750-49b7-9a05-5bfa7175117a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:19.676168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8924117-8750-49b7-9a05-5bfa7175117a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:19.676609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8924117-8750-49b7-9a05-5bfa7175117a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:19.681395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:41:19.716669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c345ea30-c770-4f6b-88c7-62cf0c781d0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:19.717792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c345ea30-c770-4f6b-88c7-62cf0c781d0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:19.718184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e8924117-8750-49b7-9a05-5bfa7175117a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:41:19.733296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c345ea30-c770-4f6b-88c7-62cf0c781d0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:19.734478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c345ea30-c770-4f6b-88c7-62cf0c781d0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:19.735740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c345ea30-c770-4f6b-88c7-62cf0c781d0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:19.738321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c345ea30-c770-4f6b-88c7-62cf0c781d0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:19.739504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c345ea30-c770-4f6b-88c7-62cf0c781d0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:19.741703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c345ea30-c770-4f6b-88c7-62cf0c781d0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:19.864880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c345ea30-c770-4f6b-88c7-62cf0c781d0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:19.868045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c345ea30-c770-4f6b-88c7-62cf0c781d0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:19.868877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c345ea30-c770-4f6b-88c7-62cf0c781d0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:19.871407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-c345ea30-c770-4f6b-88c7-62cf0c781d0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lazy-loading 'fault' on Instance uuid 64cd489b-a35c-4e71-af41-eb2d5d22b082 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:41:19.965011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c345ea30-c770-4f6b-88c7-62cf0c781d0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:19.980407 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c345ea30-c770-4f6b-88c7-62cf0c781d0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 200 len: 1146 microversion: 2.1 time: 0.271791 Oct 29 01:41:19.981296 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3089/6415] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:19 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 1146 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:41:19.993675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b9ea7c14-07c2-4804-9450-7478fb7eeb5b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:19.997918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b9ea7c14-07c2-4804-9450-7478fb7eeb5b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:20.013178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9ea7c14-07c2-4804-9450-7478fb7eeb5b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:20.017637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9ea7c14-07c2-4804-9450-7478fb7eeb5b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:20.019158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9ea7c14-07c2-4804-9450-7478fb7eeb5b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:20.020716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9ea7c14-07c2-4804-9450-7478fb7eeb5b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:20.023854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9ea7c14-07c2-4804-9450-7478fb7eeb5b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:20.024568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9ea7c14-07c2-4804-9450-7478fb7eeb5b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:20.255002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b9ea7c14-07c2-4804-9450-7478fb7eeb5b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:20.274354 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b9ea7c14-07c2-4804-9450-7478fb7eeb5b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6" status: 200 len: 1373 microversion: 2.1 time: 0.289783 Oct 29 01:41:20.278293 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3090/6416] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:19 2022] GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 => generated 1373 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:20.486283 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e8924117-8750-49b7-9a05-5bfa7175117a tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "DELETE /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 204 len: 0 microversion: 2.20 time: 0.825492 Oct 29 01:41:20.487312 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3327/6417] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:41:19 2022] DELETE /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 0 bytes in 829 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:41:20.495543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-87ba482c-0aa6-4b17-b3b9-481c177de930 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:20.496832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-87ba482c-0aa6-4b17-b3b9-481c177de930 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:20.508724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87ba482c-0aa6-4b17-b3b9-481c177de930 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:20.511818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87ba482c-0aa6-4b17-b3b9-481c177de930 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:20.512293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87ba482c-0aa6-4b17-b3b9-481c177de930 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:20.513071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87ba482c-0aa6-4b17-b3b9-481c177de930 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:20.513570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87ba482c-0aa6-4b17-b3b9-481c177de930 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:20.514001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87ba482c-0aa6-4b17-b3b9-481c177de930 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:20.748894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-87ba482c-0aa6-4b17-b3b9-481c177de930 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:20.760190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-87ba482c-0aa6-4b17-b3b9-481c177de930 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:20.761898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-87ba482c-0aa6-4b17-b3b9-481c177de930 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:20.763148 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-87ba482c-0aa6-4b17-b3b9-481c177de930 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1725 microversion: 2.20 time: 0.271581 Oct 29 01:41:20.764383 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3091/6418] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:41:20 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1725 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:41:21.007653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b28facc2-cb57-4312-8827-3c42373fc4e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:21.008880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b28facc2-cb57-4312-8827-3c42373fc4e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 64cd489b-a35c-4e71-af41-eb2d5d22b082] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:21.017580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b28facc2-cb57-4312-8827-3c42373fc4e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:21.018494 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b28facc2-cb57-4312-8827-3c42373fc4e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:21.019124 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b28facc2-cb57-4312-8827-3c42373fc4e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:21.019835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b28facc2-cb57-4312-8827-3c42373fc4e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:21.020410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b28facc2-cb57-4312-8827-3c42373fc4e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:21.021088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b28facc2-cb57-4312-8827-3c42373fc4e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:21.038633 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-b28facc2-cb57-4312-8827-3c42373fc4e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] HTTP exception thrown: Instance 64cd489b-a35c-4e71-af41-eb2d5d22b082 could not be found. Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b28facc2-cb57-4312-8827-3c42373fc4e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Request method failure captured: Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 HTTP/1.1 Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXISL1fYm1j7NXik3zsNtroj_Oy-crTrvQAeW5M-FwwtP3LsKgHXpuppTsI04rMuajP4UZsmStYeX1aQyWE5BokToP2AX7pO99qAjgwqGhP0Pb1MuaH07JyrTdqaWdL6Co3a2Gha0Gb4NOVY73erVtuC0neHUxTJ51YCufPzngi0azyM Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37416a9397fa4c6dbd0bfe8dee191577", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-TestVolumeBootPattern-743321222 Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8b8f36d10fa340f784581a3cf9a15606 Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 64cd489b-a35c-4e71-af41-eb2d5d22b082 could not be found. Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '64cd489b-a35c-4e71-af41-eb2d5d22b082'} Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64cd489b-a35c-4e71-af41-eb2d5d22b082 could not be found. Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64cd489b-a35c-4e71-af41-eb2d5d22b082 could not be found. Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:41:21.040767 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:21.044636 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:21.044636 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:41:21.044636 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:41:21.044636 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:41:21.044636 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:41:21.044636 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64cd489b-a35c-4e71-af41-eb2d5d22b082 could not be found. Oct 29 01:41:21.044636 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:21.047615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b28facc2-cb57-4312-8827-3c42373fc4e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Returning 404 to user: Instance 64cd489b-a35c-4e71-af41-eb2d5d22b082 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:41:21.048895 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b28facc2-cb57-4312-8827-3c42373fc4e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082" status: 404 len: 111 microversion: 2.1 time: 0.045945 Oct 29 01:41:21.049792 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3328/6419] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:21 2022] GET /compute/v2.1/servers/64cd489b-a35c-4e71-af41-eb2d5d22b082 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:41:21.302284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5085b819-331f-4500-847d-f9b0969ccf89 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:21.303306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5085b819-331f-4500-847d-f9b0969ccf89 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:21.314184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5085b819-331f-4500-847d-f9b0969ccf89 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:21.316590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5085b819-331f-4500-847d-f9b0969ccf89 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:21.318764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5085b819-331f-4500-847d-f9b0969ccf89 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:21.319753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5085b819-331f-4500-847d-f9b0969ccf89 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:21.321677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5085b819-331f-4500-847d-f9b0969ccf89 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:21.324352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5085b819-331f-4500-847d-f9b0969ccf89 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:21.530492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5085b819-331f-4500-847d-f9b0969ccf89 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:21.543907 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5085b819-331f-4500-847d-f9b0969ccf89 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6" status: 200 len: 1373 microversion: 2.1 time: 0.245674 Oct 29 01:41:21.544522 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3092/6420] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:21 2022] GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 => generated 1373 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:21.789529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4c2e2032-60ef-423d-a013-7bb2bdec2548 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:21.790125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4c2e2032-60ef-423d-a013-7bb2bdec2548 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:21.803149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c2e2032-60ef-423d-a013-7bb2bdec2548 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:21.803744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c2e2032-60ef-423d-a013-7bb2bdec2548 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:21.804268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c2e2032-60ef-423d-a013-7bb2bdec2548 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:21.805053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c2e2032-60ef-423d-a013-7bb2bdec2548 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:21.805614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c2e2032-60ef-423d-a013-7bb2bdec2548 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:21.806112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c2e2032-60ef-423d-a013-7bb2bdec2548 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:22.091764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4c2e2032-60ef-423d-a013-7bb2bdec2548 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:22.105596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4c2e2032-60ef-423d-a013-7bb2bdec2548 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:22.112613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4c2e2032-60ef-423d-a013-7bb2bdec2548 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:22.126819 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4c2e2032-60ef-423d-a013-7bb2bdec2548 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1725 microversion: 2.20 time: 0.341227 Oct 29 01:41:22.146686 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3329/6421] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:41:21 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1725 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:41:22.574072 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-78ef6c52-5c40-4411-a5a0-ea397d39634a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:22.575999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-78ef6c52-5c40-4411-a5a0-ea397d39634a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:22.600647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-78ef6c52-5c40-4411-a5a0-ea397d39634a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:22.602769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-78ef6c52-5c40-4411-a5a0-ea397d39634a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:22.607226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-78ef6c52-5c40-4411-a5a0-ea397d39634a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:22.609568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-78ef6c52-5c40-4411-a5a0-ea397d39634a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:22.611170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-78ef6c52-5c40-4411-a5a0-ea397d39634a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:22.612148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-78ef6c52-5c40-4411-a5a0-ea397d39634a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:22.926012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-78ef6c52-5c40-4411-a5a0-ea397d39634a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:22.939263 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-78ef6c52-5c40-4411-a5a0-ea397d39634a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6" status: 200 len: 1545 microversion: 2.1 time: 0.369846 Oct 29 01:41:22.940068 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3093/6422] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:22 2022] GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 => generated 1545 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:22.964972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-351df86b-987d-46cf-bd9d-69f3ba15f0b6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:22.965930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-351df86b-987d-46cf-bd9d-69f3ba15f0b6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:22.972586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:41:22.974671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351df86b-987d-46cf-bd9d-69f3ba15f0b6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:22.975162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351df86b-987d-46cf-bd9d-69f3ba15f0b6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:22.975772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351df86b-987d-46cf-bd9d-69f3ba15f0b6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:22.976653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351df86b-987d-46cf-bd9d-69f3ba15f0b6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:22.977332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351df86b-987d-46cf-bd9d-69f3ba15f0b6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:22.977921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351df86b-987d-46cf-bd9d-69f3ba15f0b6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:23.161454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0b72841d-bf35-41e4-b742-8b2176549c34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:23.162877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0b72841d-bf35-41e4-b742-8b2176549c34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:23.174194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b72841d-bf35-41e4-b742-8b2176549c34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:23.179150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b72841d-bf35-41e4-b742-8b2176549c34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:23.180109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b72841d-bf35-41e4-b742-8b2176549c34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:23.181034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b72841d-bf35-41e4-b742-8b2176549c34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:23.181681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b72841d-bf35-41e4-b742-8b2176549c34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:23.182406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b72841d-bf35-41e4-b742-8b2176549c34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:23.210448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-351df86b-987d-46cf-bd9d-69f3ba15f0b6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:23.240008 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-351df86b-987d-46cf-bd9d-69f3ba15f0b6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6" status: 200 len: 1545 microversion: 2.1 time: 0.278806 Oct 29 01:41:23.246013 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3330/6423] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:22 2022] GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 => generated 1545 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:23.599257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0b72841d-bf35-41e4-b742-8b2176549c34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:23.615626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0b72841d-bf35-41e4-b742-8b2176549c34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:23.620403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0b72841d-bf35-41e4-b742-8b2176549c34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:23.622066 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0b72841d-bf35-41e4-b742-8b2176549c34 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1725 microversion: 2.20 time: 0.466192 Oct 29 01:41:23.623231 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3094/6424] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:41:23 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1725 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:41:24.523650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-722470eb-cf8b-4af8-98ac-9a5614ac13a7 req-8ee77dbe-940d-42b9-b040-fcd3f0a645e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c66a75-9fbd-4f0c-baf5-e19875095e42", "name": "network-vif-deleted", "tag": "5ea23a70-144a-4d50-a1b1-6a74d325a5f1"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:24.523650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-722470eb-cf8b-4af8-98ac-9a5614ac13a7 req-8ee77dbe-940d-42b9-b040-fcd3f0a645e1 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:24.523650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-722470eb-cf8b-4af8-98ac-9a5614ac13a7 req-8ee77dbe-940d-42b9-b040-fcd3f0a645e1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:24.523650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-722470eb-cf8b-4af8-98ac-9a5614ac13a7 req-8ee77dbe-940d-42b9-b040-fcd3f0a645e1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:24.550690 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-722470eb-cf8b-4af8-98ac-9a5614ac13a7 req-8ee77dbe-940d-42b9-b040-fcd3f0a645e1 service nova] Creating event network-vif-deleted:5ea23a70-144a-4d50-a1b1-6a74d325a5f1 for instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 on n-h2-862964-3 Oct 29 01:41:24.555092 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-722470eb-cf8b-4af8-98ac-9a5614ac13a7 req-8ee77dbe-940d-42b9-b040-fcd3f0a645e1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060404 Oct 29 01:41:24.566267 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3331/6425] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:41:24.652150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c7df14db-fd9d-47b2-856a-db4ebba27d41 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:24.654240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c7df14db-fd9d-47b2-856a-db4ebba27d41 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:24.672943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7df14db-fd9d-47b2-856a-db4ebba27d41 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:24.682713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7df14db-fd9d-47b2-856a-db4ebba27d41 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:24.683288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7df14db-fd9d-47b2-856a-db4ebba27d41 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:24.684133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7df14db-fd9d-47b2-856a-db4ebba27d41 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:24.684756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7df14db-fd9d-47b2-856a-db4ebba27d41 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:24.685282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7df14db-fd9d-47b2-856a-db4ebba27d41 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:24.818609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c7df14db-fd9d-47b2-856a-db4ebba27d41 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:24.836691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c7df14db-fd9d-47b2-856a-db4ebba27d41 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:24.838895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c7df14db-fd9d-47b2-856a-db4ebba27d41 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:24.840695 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c7df14db-fd9d-47b2-856a-db4ebba27d41 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1366 microversion: 2.20 time: 0.192384 Oct 29 01:41:24.841871 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3095/6426] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:41:24 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:41:25.872001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ada3c63d-34b9-49bc-b50c-f86d4afddabc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:25.872809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ada3c63d-34b9-49bc-b50c-f86d4afddabc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:25.882811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ada3c63d-34b9-49bc-b50c-f86d4afddabc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:25.883363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ada3c63d-34b9-49bc-b50c-f86d4afddabc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:25.883808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ada3c63d-34b9-49bc-b50c-f86d4afddabc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:25.884522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ada3c63d-34b9-49bc-b50c-f86d4afddabc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:25.884981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ada3c63d-34b9-49bc-b50c-f86d4afddabc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:25.885445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ada3c63d-34b9-49bc-b50c-f86d4afddabc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:25.933556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ada3c63d-34b9-49bc-b50c-f86d4afddabc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:25.934058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ada3c63d-34b9-49bc-b50c-f86d4afddabc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:25.934504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ada3c63d-34b9-49bc-b50c-f86d4afddabc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:25.934971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-ada3c63d-34b9-49bc-b50c-f86d4afddabc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lazy-loading 'fault' on Instance uuid 49c66a75-9fbd-4f0c-baf5-e19875095e42 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:41:26.026360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ada3c63d-34b9-49bc-b50c-f86d4afddabc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:26.041033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ada3c63d-34b9-49bc-b50c-f86d4afddabc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:26.047310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ada3c63d-34b9-49bc-b50c-f86d4afddabc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0265e8a9ea3040429b5f00c409b58b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55774814073449bf962d219e4a1b3b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:26.052436 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ada3c63d-34b9-49bc-b50c-f86d4afddabc tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 200 len: 1371 microversion: 2.20 time: 0.182699 Oct 29 01:41:26.053728 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3332/6427] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:41:25 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:41:27.085993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9dee1ffe-5a8c-4541-98e7-7686f0991276 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:27.086617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9dee1ffe-5a8c-4541-98e7-7686f0991276 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:27.106671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dee1ffe-5a8c-4541-98e7-7686f0991276 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:27.107543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dee1ffe-5a8c-4541-98e7-7686f0991276 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:27.109737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dee1ffe-5a8c-4541-98e7-7686f0991276 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:27.110663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dee1ffe-5a8c-4541-98e7-7686f0991276 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:27.111228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dee1ffe-5a8c-4541-98e7-7686f0991276 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:27.111829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9dee1ffe-5a8c-4541-98e7-7686f0991276 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:27.149666 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-9dee1ffe-5a8c-4541-98e7-7686f0991276 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] HTTP exception thrown: Instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 could not be found. Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9dee1ffe-5a8c-4541-98e7-7686f0991276 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Request method failure captured: Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 HTTP/1.1 Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIJ7UD26DtcasJQPddXyLcsnMwEWA673JNIdYzdsjXQ-niI3JmDmwDpfNKGaUg2B3bw2aDLTnu1FgPzlWmnWMkA3Y_PA92B7B4r9UDctR58mgU8Vm8Hk1l6IUQeU2jvzZioG5VOJi_SaQpFbYY3L5zjUMtFIeAK1jrjmdhNxLVbHpzM Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 55774814073449bf962d219e4a1b3b5e Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-742246682 Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55774814073449bf962d219e4a1b3b5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/55774814073449bf962d219e4a1b3b5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55774814073449bf962d219e4a1b3b5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_55774814073449bf962d219e4a1b3b5e", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AttachVolumeShelveTestJSON-742246682 Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 55774814073449bf962d219e4a1b3b5e Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-742246682 Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AttachVolumeShelveTestJSON-742246682-project Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 0265e8a9ea3040429b5f00c409b58b32 Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AttachVolumeShelveTestJSON-742246682-project Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 could not be found. Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '49c66a75-9fbd-4f0c-baf5-e19875095e42'} Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 could not be found. Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 could not be found. Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:27.157853 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:41:27.164562 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:27.164562 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:27.164562 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:41:27.164562 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:41:27.164562 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:41:27.164562 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:41:27.164562 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 could not be found. Oct 29 01:41:27.164562 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:27.164562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9dee1ffe-5a8c-4541-98e7-7686f0991276 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Returning 404 to user: Instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:41:27.166004 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9dee1ffe-5a8c-4541-98e7-7686f0991276 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 404 len: 111 microversion: 2.20 time: 0.089055 Oct 29 01:41:27.167205 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3096/6428] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:41:27 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:41:27.177524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6873af20-3979-404b-a31f-167c0be72309 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '.version_select at 0x7f9d965cb550>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:27.287912 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6873af20-3979-404b-a31f-167c0be72309 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2053370307" status: 204 len: 0 microversion: 2.20 time: 0.115342 Oct 29 01:41:27.291264 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3333/6429] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 29 01:41:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2053370307 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:41:28.854127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cd314a8d-ef49-4c64-a9e9-5f5fef8ad022 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:28.855497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cd314a8d-ef49-4c64-a9e9-5f5fef8ad022 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:28.867225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:41:28.874842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd314a8d-ef49-4c64-a9e9-5f5fef8ad022 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:28.881198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd314a8d-ef49-4c64-a9e9-5f5fef8ad022 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:28.882066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd314a8d-ef49-4c64-a9e9-5f5fef8ad022 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:28.883892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd314a8d-ef49-4c64-a9e9-5f5fef8ad022 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:28.886875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd314a8d-ef49-4c64-a9e9-5f5fef8ad022 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:28.887547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd314a8d-ef49-4c64-a9e9-5f5fef8ad022 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:29.203588 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cd314a8d-ef49-4c64-a9e9-5f5fef8ad022 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1831 microversion: 2.1 time: 0.353729 Oct 29 01:41:29.209716 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3097/6430] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:28 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1831 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:31.947436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-85c7790b-4670-4862-90c2-016823763ba0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:31.948429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-85c7790b-4670-4862-90c2-016823763ba0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:31.966837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-35d7b03d-6a27-425d-b35c-a868eec71097 req-2ff75059-d772-4f59-80ee-658014ac127e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2e1d1e-3097-4c13-8eb9-c32fb30d4857", "tag": "46e11602-6278-473b-906b-a860e498b401"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:31.971819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85c7790b-4670-4862-90c2-016823763ba0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:31.976788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85c7790b-4670-4862-90c2-016823763ba0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:31.985368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85c7790b-4670-4862-90c2-016823763ba0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:31.989663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85c7790b-4670-4862-90c2-016823763ba0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:31.992792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85c7790b-4670-4862-90c2-016823763ba0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:31.995201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85c7790b-4670-4862-90c2-016823763ba0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:32.016750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-35d7b03d-6a27-425d-b35c-a868eec71097 req-2ff75059-d772-4f59-80ee-658014ac127e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:32.017441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-35d7b03d-6a27-425d-b35c-a868eec71097 req-2ff75059-d772-4f59-80ee-658014ac127e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:32.017911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-35d7b03d-6a27-425d-b35c-a868eec71097 req-2ff75059-d772-4f59-80ee-658014ac127e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:32.065374 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-35d7b03d-6a27-425d-b35c-a868eec71097 req-2ff75059-d772-4f59-80ee-658014ac127e service nova] Creating event network-changed:46e11602-6278-473b-906b-a860e498b401 for instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 on n-h1-862964-3 Oct 29 01:41:32.084799 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-35d7b03d-6a27-425d-b35c-a868eec71097 req-2ff75059-d772-4f59-80ee-658014ac127e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121572 Oct 29 01:41:32.089377 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3098/6431] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:41:32.195917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-85c7790b-4670-4862-90c2-016823763ba0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:41:32.906936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-44333eba-52db-4f4d-a7e9-aa18c51d789c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-44736018", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bbe0fd45-4700-4296-a7b6-c674d1c0771d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d488ed61-ddc0-4d3b-9833-017b49869cf3"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:32.970945 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-85c7790b-4670-4862-90c2-016823763ba0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 204 len: 0 microversion: 2.1 time: 1.033906 Oct 29 01:41:32.974837 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3334/6432] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:41:31 2022] DELETE /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:41:32.986184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2e8c7187-19c5-4e2a-b772-adf273973281 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:32.990452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2e8c7187-19c5-4e2a-b772-adf273973281 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:33.011204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e8c7187-19c5-4e2a-b772-adf273973281 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:33.012902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e8c7187-19c5-4e2a-b772-adf273973281 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:33.014818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e8c7187-19c5-4e2a-b772-adf273973281 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:33.016186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e8c7187-19c5-4e2a-b772-adf273973281 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:33.018635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e8c7187-19c5-4e2a-b772-adf273973281 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:33.019336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e8c7187-19c5-4e2a-b772-adf273973281 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:33.078775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-44333eba-52db-4f4d-a7e9-aa18c51d789c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] validate_networks() for [('d488ed61-ddc0-4d3b-9833-017b49869cf3', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:41:33.584807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2e8c7187-19c5-4e2a-b772-adf273973281 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:33.605069 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2e8c7187-19c5-4e2a-b772-adf273973281 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1686 microversion: 2.1 time: 0.626697 Oct 29 01:41:33.610293 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3335/6433] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:32 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1686 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:41:34.163109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-44333eba-52db-4f4d-a7e9-aa18c51d789c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:41:34.164133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-44333eba-52db-4f4d-a7e9-aa18c51d789c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:41:34.164832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-44333eba-52db-4f4d-a7e9-aa18c51d789c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:41:34.165492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-44333eba-52db-4f4d-a7e9-aa18c51d789c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:41:34.166202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-44333eba-52db-4f4d-a7e9-aa18c51d789c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:41:34.188732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44333eba-52db-4f4d-a7e9-aa18c51d789c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:34.198403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44333eba-52db-4f4d-a7e9-aa18c51d789c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:34.198976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44333eba-52db-4f4d-a7e9-aa18c51d789c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:34.199813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44333eba-52db-4f4d-a7e9-aa18c51d789c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:34.200288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44333eba-52db-4f4d-a7e9-aa18c51d789c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:34.200713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-44333eba-52db-4f4d-a7e9-aa18c51d789c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:34.259510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-44333eba-52db-4f4d-a7e9-aa18c51d789c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Getting quotas for project 37416a9397fa4c6dbd0bfe8dee191577. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:41:34.267147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-44333eba-52db-4f4d-a7e9-aa18c51d789c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Getting quotas for user 8b8f36d10fa340f784581a3cf9a15606 and project 37416a9397fa4c6dbd0bfe8dee191577. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:41:34.444738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-44333eba-52db-4f4d-a7e9-aa18c51d789c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:41:34.447657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-44333eba-52db-4f4d-a7e9-aa18c51d789c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bbe0fd45-4700-4296-a7b6-c674d1c0771d',volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:41:34.640553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-39a8c60d-1ef6-4b69-86f0-2b33e645a796 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:34.641246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-39a8c60d-1ef6-4b69-86f0-2b33e645a796 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:34.660397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39a8c60d-1ef6-4b69-86f0-2b33e645a796 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:34.663098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39a8c60d-1ef6-4b69-86f0-2b33e645a796 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:34.663098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39a8c60d-1ef6-4b69-86f0-2b33e645a796 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:34.663098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39a8c60d-1ef6-4b69-86f0-2b33e645a796 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:34.664034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39a8c60d-1ef6-4b69-86f0-2b33e645a796 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:34.664666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39a8c60d-1ef6-4b69-86f0-2b33e645a796 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:35.223954 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-44333eba-52db-4f4d-a7e9-aa18c51d789c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.321918 Oct 29 01:41:35.235253 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3099/6434] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:41:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:41:35.288964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1e7cd9f5-8dc7-43c2-be99-7dfb9016c205 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:35.297303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1e7cd9f5-8dc7-43c2-be99-7dfb9016c205 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:35.403802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-39a8c60d-1ef6-4b69-86f0-2b33e645a796 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:35.419538 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-39a8c60d-1ef6-4b69-86f0-2b33e645a796 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1686 microversion: 2.1 time: 0.781281 Oct 29 01:41:35.439287 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3336/6435] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:34 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1686 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:35.462466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1e7cd9f5-8dc7-43c2-be99-7dfb9016c205 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:35.473570 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1e7cd9f5-8dc7-43c2-be99-7dfb9016c205 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1055 microversion: 2.1 time: 0.228941 Oct 29 01:41:35.474593 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3100/6436] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:35 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1055 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:41:36.073391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cfebeaad-b480-4497-861a-4e960aa334bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:36.074103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cfebeaad-b480-4497-861a-4e960aa334bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:36.087557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfebeaad-b480-4497-861a-4e960aa334bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:36.095894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfebeaad-b480-4497-861a-4e960aa334bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:36.096965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfebeaad-b480-4497-861a-4e960aa334bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:36.099145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfebeaad-b480-4497-861a-4e960aa334bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:36.099692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfebeaad-b480-4497-861a-4e960aa334bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:36.100351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cfebeaad-b480-4497-861a-4e960aa334bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:36.151852 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-cfebeaad-b480-4497-861a-4e960aa334bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] HTTP exception thrown: Instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 could not be found. Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cfebeaad-b480-4497-861a-4e960aa334bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Request method failure captured: Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 HTTP/1.1 Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIJ7UD26DtcasJQPddXyLcsnMwEWA673JNIdYzdsjXQ-niI3JmDmwDpfNKGaUg2B3bw2aDLTnu1FgPzlWmnWMkA3Y_PA92B7B4r9UDctR58mgU8Vm8Hk1l6IUQeU2jvzZioG5VOJi_SaQpFbYY3L5zjUMtFIeAK1jrjmdhNxLVbHpzM Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 55774814073449bf962d219e4a1b3b5e Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-742246682 Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55774814073449bf962d219e4a1b3b5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/55774814073449bf962d219e4a1b3b5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55774814073449bf962d219e4a1b3b5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_55774814073449bf962d219e4a1b3b5e", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeShelveTestJSON-742246682 Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 55774814073449bf962d219e4a1b3b5e Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-742246682 Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AttachVolumeShelveTestJSON-742246682-project Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 0265e8a9ea3040429b5f00c409b58b32 Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeShelveTestJSON-742246682-project Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 could not be found. Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '49c66a75-9fbd-4f0c-baf5-e19875095e42'} Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 could not be found. Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:41:36.158301 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:41:36.163251 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 could not be found. Oct 29 01:41:36.163251 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:36.163251 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:41:36.163251 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:36.163251 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:36.163251 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:41:36.163251 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:41:36.163251 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:41:36.163251 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:41:36.163251 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 could not be found. Oct 29 01:41:36.163251 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:36.173998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cfebeaad-b480-4497-861a-4e960aa334bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Returning 404 to user: Instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:41:36.173998 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cfebeaad-b480-4497-861a-4e960aa334bb tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "DELETE /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 404 len: 111 microversion: 2.20 time: 0.103826 Oct 29 01:41:36.184590 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3337/6437] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:41:36 2022] DELETE /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:41:36.192436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-76e72322-990e-4f71-94c3-0f5bc06b3ba8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:36.193454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-76e72322-990e-4f71-94c3-0f5bc06b3ba8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: 49c66a75-9fbd-4f0c-baf5-e19875095e42] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:36.218658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76e72322-990e-4f71-94c3-0f5bc06b3ba8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:36.226295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76e72322-990e-4f71-94c3-0f5bc06b3ba8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:36.227073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76e72322-990e-4f71-94c3-0f5bc06b3ba8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:36.227485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76e72322-990e-4f71-94c3-0f5bc06b3ba8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:36.234902 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76e72322-990e-4f71-94c3-0f5bc06b3ba8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:36.235394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76e72322-990e-4f71-94c3-0f5bc06b3ba8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:36.273924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-9014ad42-ab7a-44f4-b3a9-95d374214811 req-38d1e6a2-614b-4df5-9114-52f8c7ce4303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2e1d1e-3097-4c13-8eb9-c32fb30d4857", "name": "network-vif-deleted", "tag": "46e11602-6278-473b-906b-a860e498b401"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:36.289944 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-76e72322-990e-4f71-94c3-0f5bc06b3ba8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] HTTP exception thrown: Instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 could not be found. Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-76e72322-990e-4f71-94c3-0f5bc06b3ba8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Request method failure captured: Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 HTTP/1.1 Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIJ7UD26DtcasJQPddXyLcsnMwEWA673JNIdYzdsjXQ-niI3JmDmwDpfNKGaUg2B3bw2aDLTnu1FgPzlWmnWMkA3Y_PA92B7B4r9UDctR58mgU8Vm8Hk1l6IUQeU2jvzZioG5VOJi_SaQpFbYY3L5zjUMtFIeAK1jrjmdhNxLVbHpzM Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 55774814073449bf962d219e4a1b3b5e Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-742246682 Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55774814073449bf962d219e4a1b3b5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/55774814073449bf962d219e4a1b3b5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55774814073449bf962d219e4a1b3b5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_55774814073449bf962d219e4a1b3b5e", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AttachVolumeShelveTestJSON-742246682 Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 55774814073449bf962d219e4a1b3b5e Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-742246682 Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AttachVolumeShelveTestJSON-742246682-project Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 0265e8a9ea3040429b5f00c409b58b32 Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AttachVolumeShelveTestJSON-742246682-project Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 could not be found. Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '49c66a75-9fbd-4f0c-baf5-e19875095e42'} Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 could not be found. Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 could not be found. Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:36.295415 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:41:36.300237 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:36.300237 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:36.300237 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:41:36.300237 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:41:36.300237 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:41:36.300237 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:41:36.300237 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 could not be found. Oct 29 01:41:36.300237 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:36.306108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-76e72322-990e-4f71-94c3-0f5bc06b3ba8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Returning 404 to user: Instance 49c66a75-9fbd-4f0c-baf5-e19875095e42 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:41:36.306968 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-76e72322-990e-4f71-94c3-0f5bc06b3ba8 tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42" status: 404 len: 111 microversion: 2.20 time: 0.119093 Oct 29 01:41:36.310994 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3101/6438] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:41:36 2022] GET /compute/v2.1/servers/49c66a75-9fbd-4f0c-baf5-e19875095e42 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:41:36.325746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9014ad42-ab7a-44f4-b3a9-95d374214811 req-38d1e6a2-614b-4df5-9114-52f8c7ce4303 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:36.329214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9014ad42-ab7a-44f4-b3a9-95d374214811 req-38d1e6a2-614b-4df5-9114-52f8c7ce4303 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:36.334652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-9014ad42-ab7a-44f4-b3a9-95d374214811 req-38d1e6a2-614b-4df5-9114-52f8c7ce4303 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:36.397740 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-9014ad42-ab7a-44f4-b3a9-95d374214811 req-38d1e6a2-614b-4df5-9114-52f8c7ce4303 service nova] Creating event network-vif-deleted:46e11602-6278-473b-906b-a860e498b401 for instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 on n-h1-862964-3 Oct 29 01:41:36.417338 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-9014ad42-ab7a-44f4-b3a9-95d374214811 req-38d1e6a2-614b-4df5-9114-52f8c7ce4303 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152075 Oct 29 01:41:36.424382 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3338/6439] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:41:36.447115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-510454dc-d78b-42ce-8b33-f2cca0d5a80c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:36.447732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-510454dc-d78b-42ce-8b33-f2cca0d5a80c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:36.455385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-510454dc-d78b-42ce-8b33-f2cca0d5a80c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:36.455879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-510454dc-d78b-42ce-8b33-f2cca0d5a80c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:36.456352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-510454dc-d78b-42ce-8b33-f2cca0d5a80c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:36.457063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-510454dc-d78b-42ce-8b33-f2cca0d5a80c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:36.457570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-510454dc-d78b-42ce-8b33-f2cca0d5a80c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:36.457999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-510454dc-d78b-42ce-8b33-f2cca0d5a80c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:36.503585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd19fa2c-2106-48e7-9c7f-9976af44eed7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:36.508962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bd19fa2c-2106-48e7-9c7f-9976af44eed7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:36.571477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bd19fa2c-2106-48e7-9c7f-9976af44eed7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:36.581619 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bd19fa2c-2106-48e7-9c7f-9976af44eed7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1055 microversion: 2.1 time: 0.082471 Oct 29 01:41:36.582421 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3339/6440] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:36 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1055 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:41:36.701010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-510454dc-d78b-42ce-8b33-f2cca0d5a80c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:36.712281 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-510454dc-d78b-42ce-8b33-f2cca0d5a80c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1501 microversion: 2.1 time: 0.269634 Oct 29 01:41:36.734958 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3102/6441] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:36 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1501 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:37.607305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0d166cc9-bc4c-4590-bf3e-5032673645cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:37.609177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0d166cc9-bc4c-4590-bf3e-5032673645cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:37.627841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d166cc9-bc4c-4590-bf3e-5032673645cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:37.628677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d166cc9-bc4c-4590-bf3e-5032673645cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:37.629116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d166cc9-bc4c-4590-bf3e-5032673645cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:37.629846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d166cc9-bc4c-4590-bf3e-5032673645cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:37.630299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d166cc9-bc4c-4590-bf3e-5032673645cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:37.630749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0d166cc9-bc4c-4590-bf3e-5032673645cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:37.738559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0d166cc9-bc4c-4590-bf3e-5032673645cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:37.747541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c244fa3b-43a4-4d7b-a727-21bdcc6e1bed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:37.750049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c244fa3b-43a4-4d7b-a727-21bdcc6e1bed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:37.763795 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0d166cc9-bc4c-4590-bf3e-5032673645cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1105 microversion: 2.1 time: 0.158894 Oct 29 01:41:37.764682 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3340/6442] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:37 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1105 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:37.769130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c244fa3b-43a4-4d7b-a727-21bdcc6e1bed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:37.770717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c244fa3b-43a4-4d7b-a727-21bdcc6e1bed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:37.772204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c244fa3b-43a4-4d7b-a727-21bdcc6e1bed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:37.773607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c244fa3b-43a4-4d7b-a727-21bdcc6e1bed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:37.779768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c244fa3b-43a4-4d7b-a727-21bdcc6e1bed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:37.780500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c244fa3b-43a4-4d7b-a727-21bdcc6e1bed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:37.833375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c244fa3b-43a4-4d7b-a727-21bdcc6e1bed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:37.834384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c244fa3b-43a4-4d7b-a727-21bdcc6e1bed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:37.835012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c244fa3b-43a4-4d7b-a727-21bdcc6e1bed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:37.835623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-c244fa3b-43a4-4d7b-a727-21bdcc6e1bed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lazy-loading 'fault' on Instance uuid 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:41:37.953590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c244fa3b-43a4-4d7b-a727-21bdcc6e1bed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:37.956476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:41:37.961948 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c244fa3b-43a4-4d7b-a727-21bdcc6e1bed tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 200 len: 1355 microversion: 2.1 time: 0.219281 Oct 29 01:41:37.986587 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3103/6443] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:37 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 1355 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:38.790585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd946f67-bddc-4fa6-ac91-2268eb7cbf4c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:38.799123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bd946f67-bddc-4fa6-ac91-2268eb7cbf4c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:38.824255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd946f67-bddc-4fa6-ac91-2268eb7cbf4c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:38.825857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd946f67-bddc-4fa6-ac91-2268eb7cbf4c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:38.825857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd946f67-bddc-4fa6-ac91-2268eb7cbf4c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:38.828079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd946f67-bddc-4fa6-ac91-2268eb7cbf4c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:38.828834 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd946f67-bddc-4fa6-ac91-2268eb7cbf4c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:38.830514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd946f67-bddc-4fa6-ac91-2268eb7cbf4c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:38.949830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bd946f67-bddc-4fa6-ac91-2268eb7cbf4c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:38.961696 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bd946f67-bddc-4fa6-ac91-2268eb7cbf4c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1097 microversion: 2.1 time: 0.176264 Oct 29 01:41:38.962877 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3341/6444] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:38 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1097 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:38.996434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-250a5a2c-7314-4c6e-bc1d-724ec9f8f523 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:38.998314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-250a5a2c-7314-4c6e-bc1d-724ec9f8f523 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:39.011009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-250a5a2c-7314-4c6e-bc1d-724ec9f8f523 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:39.011510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-250a5a2c-7314-4c6e-bc1d-724ec9f8f523 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:39.011960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-250a5a2c-7314-4c6e-bc1d-724ec9f8f523 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:39.012685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-250a5a2c-7314-4c6e-bc1d-724ec9f8f523 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:39.013182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-250a5a2c-7314-4c6e-bc1d-724ec9f8f523 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:39.013979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-250a5a2c-7314-4c6e-bc1d-724ec9f8f523 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:39.029354 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-250a5a2c-7314-4c6e-bc1d-724ec9f8f523 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] HTTP exception thrown: Instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 could not be found. Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-250a5a2c-7314-4c6e-bc1d-724ec9f8f523 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Request method failure captured: Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 HTTP/1.1 Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXILJPg9Teh04-xrfpejfETyHRBlSuOio40kYpBC7b_6HCncBaKOEtwakgsRFaHKUUVodh217xaKH9_jXg1fYudvg1KG6UvSVte3n5sImSaOZIiyh3V5b8dvECLF6tMPuqqNu5Tyyb2L7G4A-k4CbTXuNsP0CgTWtsdXxylpF7mJbiNI Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 2842ba05180046839fb5d064ad9132a1 Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1405101352 Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2842ba05180046839fb5d064ad9132a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2842ba05180046839fb5d064ad9132a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2842ba05180046839fb5d064ad9132a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2842ba05180046839fb5d064ad9132a1", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1405101352 Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 2842ba05180046839fb5d064ad9132a1 Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1405101352 Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TestNetworkAdvancedServerOps-1405101352-project Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: c70e2b34406c4e11afd9471a09d9cfef Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1405101352-project Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 could not be found. Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '2c2e1d1e-3097-4c13-8eb9-c32fb30d4857'} Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 could not be found. Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 could not be found. Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:39.032557 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:41:39.036720 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:39.036720 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:39.036720 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:41:39.036720 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:41:39.036720 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:41:39.036720 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:41:39.036720 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 could not be found. Oct 29 01:41:39.036720 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:39.039367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-250a5a2c-7314-4c6e-bc1d-724ec9f8f523 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Returning 404 to user: Instance 2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:41:39.044511 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-250a5a2c-7314-4c6e-bc1d-724ec9f8f523 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857" status: 404 len: 111 microversion: 2.1 time: 0.050467 Oct 29 01:41:39.047108 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3104/6445] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:38 2022] GET /compute/v2.1/servers/2c2e1d1e-3097-4c13-8eb9-c32fb30d4857 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:41:39.991547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-820b94fe-033c-47a8-86c9-48b67863742e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:39.997466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-820b94fe-033c-47a8-86c9-48b67863742e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:40.010286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-820b94fe-033c-47a8-86c9-48b67863742e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:40.011105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-820b94fe-033c-47a8-86c9-48b67863742e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:40.011758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-820b94fe-033c-47a8-86c9-48b67863742e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:40.012708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-820b94fe-033c-47a8-86c9-48b67863742e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:40.013408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-820b94fe-033c-47a8-86c9-48b67863742e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:40.014045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-820b94fe-033c-47a8-86c9-48b67863742e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:40.125638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-820b94fe-033c-47a8-86c9-48b67863742e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:40.136121 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-820b94fe-033c-47a8-86c9-48b67863742e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1097 microversion: 2.1 time: 0.152233 Oct 29 01:41:40.142316 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3342/6446] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:39 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1097 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:41.168695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e14305fb-4665-4c7e-8e50-edc99460ecab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:41.170043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e14305fb-4665-4c7e-8e50-edc99460ecab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:41.206494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e14305fb-4665-4c7e-8e50-edc99460ecab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:41.207017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e14305fb-4665-4c7e-8e50-edc99460ecab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:41.214357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e14305fb-4665-4c7e-8e50-edc99460ecab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:41.215575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e14305fb-4665-4c7e-8e50-edc99460ecab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:41.225947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e14305fb-4665-4c7e-8e50-edc99460ecab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:41.226770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e14305fb-4665-4c7e-8e50-edc99460ecab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:41.324782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e14305fb-4665-4c7e-8e50-edc99460ecab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:41.337375 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e14305fb-4665-4c7e-8e50-edc99460ecab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1153 microversion: 2.1 time: 0.172567 Oct 29 01:41:41.338595 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3105/6447] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:41 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1153 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:41:42.363725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b0f19d08-fd69-42aa-b55f-ae9df6b4bb51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:42.364336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b0f19d08-fd69-42aa-b55f-ae9df6b4bb51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:42.390999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0f19d08-fd69-42aa-b55f-ae9df6b4bb51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:42.399315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0f19d08-fd69-42aa-b55f-ae9df6b4bb51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:42.402322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0f19d08-fd69-42aa-b55f-ae9df6b4bb51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:42.407673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0f19d08-fd69-42aa-b55f-ae9df6b4bb51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:42.408374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0f19d08-fd69-42aa-b55f-ae9df6b4bb51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:42.409078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0f19d08-fd69-42aa-b55f-ae9df6b4bb51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:42.715259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b0f19d08-fd69-42aa-b55f-ae9df6b4bb51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:42.733674 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b0f19d08-fd69-42aa-b55f-ae9df6b4bb51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1171 microversion: 2.1 time: 0.374865 Oct 29 01:41:42.738657 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3343/6448] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:42 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1171 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:42.924612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5505a247-a258-4fe3-9e8c-410e174d16ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:42.926862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5505a247-a258-4fe3-9e8c-410e174d16ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:42.942238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5505a247-a258-4fe3-9e8c-410e174d16ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:42.951943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5505a247-a258-4fe3-9e8c-410e174d16ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:42.957469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5505a247-a258-4fe3-9e8c-410e174d16ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:42.958424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5505a247-a258-4fe3-9e8c-410e174d16ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:42.961980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5505a247-a258-4fe3-9e8c-410e174d16ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:42.972690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5505a247-a258-4fe3-9e8c-410e174d16ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:43.055471 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-5505a247-a258-4fe3-9e8c-410e174d16ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] HTTP exception thrown: Instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 could not be found. Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5505a247-a258-4fe3-9e8c-410e174d16ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Request method failure captured: Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 HTTP/1.1 Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIJ7UD26DtcasJQPddXyLcsnMwEWA673JNIdYzdsjXQ-niI3JmDmwDpfNKGaUg2B3bw2aDLTnu1FgPzlWmnWMkA3Y_PA92B7B4r9UDctR58mgU8Vm8Hk1l6IUQeU2jvzZioG5VOJi_SaQpFbYY3L5zjUMtFIeAK1jrjmdhNxLVbHpzM Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 55774814073449bf962d219e4a1b3b5e Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-742246682 Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55774814073449bf962d219e4a1b3b5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/55774814073449bf962d219e4a1b3b5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55774814073449bf962d219e4a1b3b5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_55774814073449bf962d219e4a1b3b5e", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-AttachVolumeShelveTestJSON-742246682 Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 55774814073449bf962d219e4a1b3b5e Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-742246682 Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-AttachVolumeShelveTestJSON-742246682-project Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 0265e8a9ea3040429b5f00c409b58b32 Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-AttachVolumeShelveTestJSON-742246682-project Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 could not be found. Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'db08ce62-9806-4b5e-90e6-ca4fe64a2885'} Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 could not be found. Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:41:43.057801 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:41:43.063075 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 could not be found. Oct 29 01:41:43.063075 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:43.063075 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:41:43.063075 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:43.063075 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:43.063075 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:41:43.063075 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:41:43.063075 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:41:43.063075 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:41:43.063075 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 could not be found. Oct 29 01:41:43.063075 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:41:43.065889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5505a247-a258-4fe3-9e8c-410e174d16ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Returning 404 to user: Instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:41:43.067139 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5505a247-a258-4fe3-9e8c-410e174d16ce tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "DELETE /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 404 len: 111 microversion: 2.20 time: 0.147010 Oct 29 01:41:43.069277 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3106/6449] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 29 01:41:42 2022] DELETE /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:41:43.077075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1e99f1b3-3743-4265-b911-464f66d5564c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:43.079368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1e99f1b3-3743-4265-b911-464f66d5564c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] [instance: db08ce62-9806-4b5e-90e6-ca4fe64a2885] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:43.098641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e99f1b3-3743-4265-b911-464f66d5564c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:43.099145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e99f1b3-3743-4265-b911-464f66d5564c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:43.099613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e99f1b3-3743-4265-b911-464f66d5564c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:43.100336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e99f1b3-3743-4265-b911-464f66d5564c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:43.100795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e99f1b3-3743-4265-b911-464f66d5564c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:43.101249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e99f1b3-3743-4265-b911-464f66d5564c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:43.138904 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-1e99f1b3-3743-4265-b911-464f66d5564c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] HTTP exception thrown: Instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 could not be found. Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1e99f1b3-3743-4265-b911-464f66d5564c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Request method failure captured: Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 HTTP/1.1 Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIJ7UD26DtcasJQPddXyLcsnMwEWA673JNIdYzdsjXQ-niI3JmDmwDpfNKGaUg2B3bw2aDLTnu1FgPzlWmnWMkA3Y_PA92B7B4r9UDctR58mgU8Vm8Hk1l6IUQeU2jvzZioG5VOJi_SaQpFbYY3L5zjUMtFIeAK1jrjmdhNxLVbHpzM Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 55774814073449bf962d219e4a1b3b5e Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-742246682 Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55774814073449bf962d219e4a1b3b5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/55774814073449bf962d219e4a1b3b5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55774814073449bf962d219e4a1b3b5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_55774814073449bf962d219e4a1b3b5e", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-AttachVolumeShelveTestJSON-742246682 Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 55774814073449bf962d219e4a1b3b5e Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-742246682 Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-AttachVolumeShelveTestJSON-742246682-project Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 0265e8a9ea3040429b5f00c409b58b32 Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-AttachVolumeShelveTestJSON-742246682-project Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 could not be found. Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'db08ce62-9806-4b5e-90e6-ca4fe64a2885'} Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 could not be found. Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 could not be found. Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:43.141387 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:41:43.145766 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:43.145766 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:41:43.145766 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:41:43.145766 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:41:43.145766 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:41:43.145766 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:41:43.145766 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 could not be found. Oct 29 01:41:43.145766 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:41:43.145766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1e99f1b3-3743-4265-b911-464f66d5564c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] Returning 404 to user: Instance db08ce62-9806-4b5e-90e6-ca4fe64a2885 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:41:43.145766 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1e99f1b3-3743-4265-b911-464f66d5564c tempest-AttachVolumeShelveTestJSON-742246682 tempest-AttachVolumeShelveTestJSON-742246682-project] 10.222.0.26 "GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885" status: 404 len: 111 microversion: 2.20 time: 0.070246 Oct 29 01:41:43.158891 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3344/6450] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 29 01:41:43 2022] GET /compute/v2.1/servers/db08ce62-9806-4b5e-90e6-ca4fe64a2885 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:41:43.772214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f6192b18-5787-415d-8364-cb7c424d288c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:43.773301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f6192b18-5787-415d-8364-cb7c424d288c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:43.787218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6192b18-5787-415d-8364-cb7c424d288c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:43.792530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6192b18-5787-415d-8364-cb7c424d288c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:43.795577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6192b18-5787-415d-8364-cb7c424d288c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:43.798726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6192b18-5787-415d-8364-cb7c424d288c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:43.801142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6192b18-5787-415d-8364-cb7c424d288c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:43.801817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6192b18-5787-415d-8364-cb7c424d288c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:44.077993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f6192b18-5787-415d-8364-cb7c424d288c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:44.094334 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f6192b18-5787-415d-8364-cb7c424d288c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1171 microversion: 2.1 time: 0.327827 Oct 29 01:41:44.102766 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3107/6451] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:43 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1171 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:45.127070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-06b92751-2494-4f1d-858e-3d95eb893ce1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:45.127973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-06b92751-2494-4f1d-858e-3d95eb893ce1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:45.173918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06b92751-2494-4f1d-858e-3d95eb893ce1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:45.174466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06b92751-2494-4f1d-858e-3d95eb893ce1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:45.174922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06b92751-2494-4f1d-858e-3d95eb893ce1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:45.175662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06b92751-2494-4f1d-858e-3d95eb893ce1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:45.176128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06b92751-2494-4f1d-858e-3d95eb893ce1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:45.184799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-06b92751-2494-4f1d-858e-3d95eb893ce1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:45.264421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:41:46.075974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-06b92751-2494-4f1d-858e-3d95eb893ce1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:46.092732 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-06b92751-2494-4f1d-858e-3d95eb893ce1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1213 microversion: 2.1 time: 0.967667 Oct 29 01:41:46.098197 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3345/6452] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:45 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1213 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:47.130525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8cfa5cf9-fb95-4a11-89cb-9060225b992c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:47.131916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8cfa5cf9-fb95-4a11-89cb-9060225b992c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:47.145439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:41:47.157990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:41:47.161745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfa5cf9-fb95-4a11-89cb-9060225b992c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:47.164529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfa5cf9-fb95-4a11-89cb-9060225b992c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:47.166242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfa5cf9-fb95-4a11-89cb-9060225b992c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:47.169498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfa5cf9-fb95-4a11-89cb-9060225b992c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:47.170712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfa5cf9-fb95-4a11-89cb-9060225b992c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:47.172777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8cfa5cf9-fb95-4a11-89cb-9060225b992c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:47.960011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8cfa5cf9-fb95-4a11-89cb-9060225b992c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:47.975544 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8cfa5cf9-fb95-4a11-89cb-9060225b992c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1213 microversion: 2.1 time: 0.852454 Oct 29 01:41:47.976208 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3108/6453] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:47 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1213 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:48.738364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b2e32ed9-b20e-4ef5-a31a-4b3baa91a4ea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '.version_select at 0x7f9d969e3d30>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:48.756666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:41:48.862810 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b2e32ed9-b20e-4ef5-a31a-4b3baa91a4ea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-867993550" status: 202 len: 0 microversion: 2.1 time: 0.129858 Oct 29 01:41:48.863523 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3346/6454] 10.222.0.26 () {58 vars in 1281 bytes} [Sat Oct 29 01:41:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-867993550 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:41:48.904827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5f70447a-892b-4531-958f-7949519b3913 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'create', calling method: .version_select at 0x7f9d9c1f03a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1805215031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZRlPSw5s4s5ZGmriODJP8ZOS+MqOEmZr2gzXk3XJ9tHuUqI4qmU3MS/TgLqvVjMKQrTVqK7IKB7HTdn8h0/SBv0MGC3tq46zxZ+/vpOdj23WnElVQbNK+44jwO8lnECw=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:48.960850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-5f70447a-892b-4531-958f-7949519b3913 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Getting quotas for project 2842ba05180046839fb5d064ad9132a1. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:41:48.972715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-5f70447a-892b-4531-958f-7949519b3913 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Getting quotas for user c70e2b34406c4e11afd9471a09d9cfef and project 2842ba05180046839fb5d064ad9132a1. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:41:49.001365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-95adb244-e160-4e87-96fe-a3c1cef8f441 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:49.002160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-95adb244-e160-4e87-96fe-a3c1cef8f441 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:49.013802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95adb244-e160-4e87-96fe-a3c1cef8f441 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:49.017940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95adb244-e160-4e87-96fe-a3c1cef8f441 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:49.018700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95adb244-e160-4e87-96fe-a3c1cef8f441 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:49.020228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95adb244-e160-4e87-96fe-a3c1cef8f441 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:49.023009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95adb244-e160-4e87-96fe-a3c1cef8f441 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:49.026508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-95adb244-e160-4e87-96fe-a3c1cef8f441 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:49.081951 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5f70447a-892b-4531-958f-7949519b3913 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.180939 Oct 29 01:41:49.082719 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3109/6455] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:41:48 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:41:49.395478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-95adb244-e160-4e87-96fe-a3c1cef8f441 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:49.404686 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-95adb244-e160-4e87-96fe-a3c1cef8f441 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1213 microversion: 2.1 time: 0.407294 Oct 29 01:41:49.413343 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3347/6456] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:48 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1213 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:49.508658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-b58f2424-6c0d-4139-b2b6-0b22fc5020e5 req-567471c9-5814-4610-a60d-d9447bc503ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7235711a-0845-4384-8655-1e95349a5c06", "tag": "8eac01f3-d247-4549-82a0-75e0364fa3e0"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:49.575633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b58f2424-6c0d-4139-b2b6-0b22fc5020e5 req-567471c9-5814-4610-a60d-d9447bc503ee service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:49.583028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b58f2424-6c0d-4139-b2b6-0b22fc5020e5 req-567471c9-5814-4610-a60d-d9447bc503ee service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:49.592046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b58f2424-6c0d-4139-b2b6-0b22fc5020e5 req-567471c9-5814-4610-a60d-d9447bc503ee service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:49.624177 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-b58f2424-6c0d-4139-b2b6-0b22fc5020e5 req-567471c9-5814-4610-a60d-d9447bc503ee service nova] Creating event network-changed:8eac01f3-d247-4549-82a0-75e0364fa3e0 for instance 7235711a-0845-4384-8655-1e95349a5c06 on n-h1-862964-3 Oct 29 01:41:49.636391 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-b58f2424-6c0d-4139-b2b6-0b22fc5020e5 req-567471c9-5814-4610-a60d-d9447bc503ee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141028 Oct 29 01:41:49.644743 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3110/6457] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:41:50.445894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f8f8152-efbc-428d-9cf5-4cfc2a1155dc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:50.445894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1f8f8152-efbc-428d-9cf5-4cfc2a1155dc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:50.456565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f8f8152-efbc-428d-9cf5-4cfc2a1155dc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:50.458196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f8f8152-efbc-428d-9cf5-4cfc2a1155dc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:50.460327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f8f8152-efbc-428d-9cf5-4cfc2a1155dc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:50.461445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f8f8152-efbc-428d-9cf5-4cfc2a1155dc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:50.462991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f8f8152-efbc-428d-9cf5-4cfc2a1155dc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:50.464717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f8f8152-efbc-428d-9cf5-4cfc2a1155dc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:51.135776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1f8f8152-efbc-428d-9cf5-4cfc2a1155dc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:51.153301 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1f8f8152-efbc-428d-9cf5-4cfc2a1155dc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1213 microversion: 2.1 time: 0.719569 Oct 29 01:41:51.166753 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3348/6458] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:50 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1213 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:52.188491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-50bfe636-8be3-4c2b-9ce9-c140dc497d38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:52.189211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-50bfe636-8be3-4c2b-9ce9-c140dc497d38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:52.201488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50bfe636-8be3-4c2b-9ce9-c140dc497d38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:52.201985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50bfe636-8be3-4c2b-9ce9-c140dc497d38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:52.202521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50bfe636-8be3-4c2b-9ce9-c140dc497d38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:52.203484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50bfe636-8be3-4c2b-9ce9-c140dc497d38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:52.203960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50bfe636-8be3-4c2b-9ce9-c140dc497d38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:52.204390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-50bfe636-8be3-4c2b-9ce9-c140dc497d38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:52.516427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-50bfe636-8be3-4c2b-9ce9-c140dc497d38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:52.527248 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-50bfe636-8be3-4c2b-9ce9-c140dc497d38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1213 microversion: 2.1 time: 0.344140 Oct 29 01:41:52.530301 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3111/6459] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:52 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1213 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:53.553584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5b92d76e-4aa8-44a2-8008-d50d7f0b6d46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:53.554870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5b92d76e-4aa8-44a2-8008-d50d7f0b6d46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:53.566613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:41:53.568722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b92d76e-4aa8-44a2-8008-d50d7f0b6d46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:53.571200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b92d76e-4aa8-44a2-8008-d50d7f0b6d46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:53.572426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b92d76e-4aa8-44a2-8008-d50d7f0b6d46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:53.573844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b92d76e-4aa8-44a2-8008-d50d7f0b6d46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:53.574597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b92d76e-4aa8-44a2-8008-d50d7f0b6d46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:53.575293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b92d76e-4aa8-44a2-8008-d50d7f0b6d46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:53.770169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5b92d76e-4aa8-44a2-8008-d50d7f0b6d46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:53.779521 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5b92d76e-4aa8-44a2-8008-d50d7f0b6d46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1213 microversion: 2.1 time: 0.230177 Oct 29 01:41:53.784233 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3349/6460] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:53 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1213 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:54.809718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6b00f61c-3bd3-41a0-92f5-b69a8d371863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:54.810138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6b00f61c-3bd3-41a0-92f5-b69a8d371863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:54.818304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b00f61c-3bd3-41a0-92f5-b69a8d371863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:54.819070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b00f61c-3bd3-41a0-92f5-b69a8d371863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:54.819672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b00f61c-3bd3-41a0-92f5-b69a8d371863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:54.820713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b00f61c-3bd3-41a0-92f5-b69a8d371863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:54.821685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b00f61c-3bd3-41a0-92f5-b69a8d371863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:54.822290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b00f61c-3bd3-41a0-92f5-b69a8d371863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:55.001608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6b00f61c-3bd3-41a0-92f5-b69a8d371863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:55.009963 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6b00f61c-3bd3-41a0-92f5-b69a8d371863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1201 microversion: 2.1 time: 0.208764 Oct 29 01:41:55.028957 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3112/6461] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:54 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1201 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:55.959382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-de1e8819-485b-4ab1-9608-9a31e61f3d2c tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Action: 'create', calling method: .version_select at 0x7f9d9661b280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1088310919"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:56.041251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5c6ca234-d360-4451-bb78-6ac07855dd68 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:56.042140 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5c6ca234-d360-4451-bb78-6ac07855dd68 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:56.057653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c6ca234-d360-4451-bb78-6ac07855dd68 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:56.058165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c6ca234-d360-4451-bb78-6ac07855dd68 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:56.058615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c6ca234-d360-4451-bb78-6ac07855dd68 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:56.059342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c6ca234-d360-4451-bb78-6ac07855dd68 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:56.059810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c6ca234-d360-4451-bb78-6ac07855dd68 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:56.060245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5c6ca234-d360-4451-bb78-6ac07855dd68 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:56.263384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5c6ca234-d360-4451-bb78-6ac07855dd68 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:56.275170 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5c6ca234-d360-4451-bb78-6ac07855dd68 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1201 microversion: 2.1 time: 0.239069 Oct 29 01:41:56.289187 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3113/6462] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:56 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1201 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:41:56.823668 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-de1e8819-485b-4ab1-9608-9a31e61f3d2c tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.001071 Oct 29 01:41:56.825659 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3350/6463] 10.222.0.26 () {60 vars in 1155 bytes} [Sat Oct 29 01:41:55 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1003 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 29 01:41:56.838799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-999faee5-536a-411c-926a-354a1ed3b0ce tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d97229160>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:56.967359 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-999faee5-536a-411c-926a-354a1ed3b0ce tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730" status: 200 len: 345 microversion: 2.1 time: 0.132405 Oct 29 01:41:56.968864 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3114/6464] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:41:56 2022] GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730 => generated 345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:41:57.334200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-67b79e4c-5623-422c-8636-106a6bdfabd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:57.334200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-67b79e4c-5623-422c-8636-106a6bdfabd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:57.342244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-67b79e4c-5623-422c-8636-106a6bdfabd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:57.349774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-67b79e4c-5623-422c-8636-106a6bdfabd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:57.350238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-67b79e4c-5623-422c-8636-106a6bdfabd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:57.351000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-67b79e4c-5623-422c-8636-106a6bdfabd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:57.351475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-67b79e4c-5623-422c-8636-106a6bdfabd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:57.351916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-67b79e4c-5623-422c-8636-106a6bdfabd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:57.571296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-67b79e4c-5623-422c-8636-106a6bdfabd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:57.587071 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-67b79e4c-5623-422c-8636-106a6bdfabd1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1201 microversion: 2.1 time: 0.275202 Oct 29 01:41:57.589473 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3351/6465] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:57 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1201 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:57.984262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-867ecdfc-696c-48e3-860f-4ae537ab79ec tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d96a573a0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:58.068897 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-867ecdfc-696c-48e3-860f-4ae537ab79ec tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730" status: 200 len: 345 microversion: 2.1 time: 0.090698 Oct 29 01:41:58.073961 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3115/6466] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:41:57 2022] GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730 => generated 345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:41:58.620275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bed2e9e5-5161-40b9-9379-f80a1f84fc61 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:58.621633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bed2e9e5-5161-40b9-9379-f80a1f84fc61 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:41:58.649466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bed2e9e5-5161-40b9-9379-f80a1f84fc61 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:58.653950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bed2e9e5-5161-40b9-9379-f80a1f84fc61 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:58.655010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bed2e9e5-5161-40b9-9379-f80a1f84fc61 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:58.671878 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bed2e9e5-5161-40b9-9379-f80a1f84fc61 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:41:58.673230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bed2e9e5-5161-40b9-9379-f80a1f84fc61 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:41:58.673929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bed2e9e5-5161-40b9-9379-f80a1f84fc61 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:41:59.082066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:41:59.087725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1783eb3e-3bd3-4a82-bbac-eb3b9b76945e tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d9fe5fee0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:59.143526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bed2e9e5-5161-40b9-9379-f80a1f84fc61 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:59.158320 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bed2e9e5-5161-40b9-9379-f80a1f84fc61 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1201 microversion: 2.1 time: 0.541997 Oct 29 01:41:59.174145 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3352/6467] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:41:58 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1201 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:59.249828 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1783eb3e-3bd3-4a82-bbac-eb3b9b76945e tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730" status: 200 len: 346 microversion: 2.1 time: 0.168763 Oct 29 01:41:59.259349 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3116/6468] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:41:59 2022] GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730 => generated 346 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:41:59.273430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8927a577-d781-44da-b552-09f230956884 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Action: 'create', calling method: .version_select at 0x7f9d9661b310>, body: {"snapshot": {"volume_id": "543da027-2ad3-4be7-9592-9369d8fcb730", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1828436228"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:59.938638 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8927a577-d781-44da-b552-09f230956884 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.672051 Oct 29 01:41:59.940495 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3353/6469] 10.222.0.26 () {60 vars in 1162 bytes} [Sat Oct 29 01:41:59 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:41:59.951458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-57ca091c-ebb0-477f-9556-a6d0bd81f566 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d97bc4820>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:00.012663 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-57ca091c-ebb0-477f-9556-a6d0bd81f566 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96" status: 200 len: 287 microversion: 2.1 time: 0.065080 Oct 29 01:42:00.013625 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3117/6470] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 29 01:41:59 2022] GET /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:00.026519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f60d4238-b726-4142-9728-98a4a9eeec83 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d97d79670>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:00.086526 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f60d4238-b726-4142-9728-98a4a9eeec83 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.064138 Oct 29 01:42:00.087323 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3354/6471] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Oct 29 01:42:00 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:00.100161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-36f143d8-5ce4-43f2-870d-7da3d157a3f1 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d97135670>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:00.148656 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-36f143d8-5ce4-43f2-870d-7da3d157a3f1 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96" status: 200 len: 287 microversion: 2.1 time: 0.053888 Oct 29 01:42:00.149404 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3118/6472] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 29 01:42:00 2022] GET /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:00.185890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f80849d2-cc2c-423f-86a9-b560dd22fa6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:00.187509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f80849d2-cc2c-423f-86a9-b560dd22fa6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:00.201649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f80849d2-cc2c-423f-86a9-b560dd22fa6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:00.203135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f80849d2-cc2c-423f-86a9-b560dd22fa6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:00.206266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f80849d2-cc2c-423f-86a9-b560dd22fa6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:00.207284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f80849d2-cc2c-423f-86a9-b560dd22fa6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:00.207970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f80849d2-cc2c-423f-86a9-b560dd22fa6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:00.210102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f80849d2-cc2c-423f-86a9-b560dd22fa6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:00.925127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f80849d2-cc2c-423f-86a9-b560dd22fa6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:00.938285 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f80849d2-cc2c-423f-86a9-b560dd22fa6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1201 microversion: 2.1 time: 0.757646 Oct 29 01:42:00.939430 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3355/6473] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:00 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1201 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:01.162609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5d90756b-a954-469b-b2af-38d1ae905c7b tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d9fe5f9d0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:01.225053 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5d90756b-a954-469b-b2af-38d1ae905c7b tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96" status: 200 len: 287 microversion: 2.1 time: 0.064950 Oct 29 01:42:01.225053 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3119/6474] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 29 01:42:01 2022] GET /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:01.893342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a89d225f-ea60-45fd-b23d-768c8253c822 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:01.902854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a89d225f-ea60-45fd-b23d-768c8253c822 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:01.902854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a89d225f-ea60-45fd-b23d-768c8253c822 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:01.902854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a89d225f-ea60-45fd-b23d-768c8253c822 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:01.903349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a89d225f-ea60-45fd-b23d-768c8253c822 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:01.904039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a89d225f-ea60-45fd-b23d-768c8253c822 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:01.904719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a89d225f-ea60-45fd-b23d-768c8253c822 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:01.905725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a89d225f-ea60-45fd-b23d-768c8253c822 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:01.939668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a89d225f-ea60-45fd-b23d-768c8253c822 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:42:01.967588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-41baca64-b97c-42e9-af83-1bd58cca3199 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:01.969690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-41baca64-b97c-42e9-af83-1bd58cca3199 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:01.971733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:42:01.991095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41baca64-b97c-42e9-af83-1bd58cca3199 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:01.993620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41baca64-b97c-42e9-af83-1bd58cca3199 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:01.994308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41baca64-b97c-42e9-af83-1bd58cca3199 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:02.000369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41baca64-b97c-42e9-af83-1bd58cca3199 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:02.001203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41baca64-b97c-42e9-af83-1bd58cca3199 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:02.004686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-41baca64-b97c-42e9-af83-1bd58cca3199 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:02.295247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-41baca64-b97c-42e9-af83-1bd58cca3199 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:02.305066 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-41baca64-b97c-42e9-af83-1bd58cca3199 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1201 microversion: 2.1 time: 0.343521 Oct 29 01:42:02.305685 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3120/6475] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:01 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1201 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:02.311296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2e98130d-8f7d-4f23-ad8d-146759c677cb tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d972299d0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:02.358304 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2e98130d-8f7d-4f23-ad8d-146759c677cb tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96" status: 200 len: 287 microversion: 2.1 time: 0.050482 Oct 29 01:42:02.359124 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3121/6476] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 29 01:42:02 2022] GET /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:02.376302 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a89d225f-ea60-45fd-b23d-768c8253c822 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6" status: 204 len: 0 microversion: 2.1 time: 0.485585 Oct 29 01:42:02.379857 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3356/6477] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:42:01 2022] DELETE /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:42:02.392268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ac1e85a1-fbb8-4d98-99aa-b0ff3377277e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:02.395145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ac1e85a1-fbb8-4d98-99aa-b0ff3377277e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:02.426929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac1e85a1-fbb8-4d98-99aa-b0ff3377277e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:02.429358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac1e85a1-fbb8-4d98-99aa-b0ff3377277e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:02.431674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac1e85a1-fbb8-4d98-99aa-b0ff3377277e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:02.432607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac1e85a1-fbb8-4d98-99aa-b0ff3377277e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:02.433730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac1e85a1-fbb8-4d98-99aa-b0ff3377277e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:02.435071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac1e85a1-fbb8-4d98-99aa-b0ff3377277e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:02.773921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ac1e85a1-fbb8-4d98-99aa-b0ff3377277e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:02.787622 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ac1e85a1-fbb8-4d98-99aa-b0ff3377277e tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6" status: 200 len: 1551 microversion: 2.1 time: 0.404615 Oct 29 01:42:02.793195 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3122/6478] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:02 2022] GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 => generated 1551 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:03.345618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c0172e99-8f3a-4f65-b969-3839634ca8b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:03.348123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c0172e99-8f3a-4f65-b969-3839634ca8b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:03.358041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0172e99-8f3a-4f65-b969-3839634ca8b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:03.358041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0172e99-8f3a-4f65-b969-3839634ca8b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:03.358041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0172e99-8f3a-4f65-b969-3839634ca8b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:03.358300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0172e99-8f3a-4f65-b969-3839634ca8b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:03.359246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0172e99-8f3a-4f65-b969-3839634ca8b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:03.360363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c0172e99-8f3a-4f65-b969-3839634ca8b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:03.373411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ba9ca0d8-929f-4233-93eb-a239fc0a2c6f tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d97229430>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:03.434459 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ba9ca0d8-929f-4233-93eb-a239fc0a2c6f tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96" status: 200 len: 288 microversion: 2.1 time: 0.065853 Oct 29 01:42:03.435060 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3123/6479] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 29 01:42:03 2022] GET /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96 => generated 288 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:03.447570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6dfe4bd4-5274-47ee-8c71-266ec399a1dc tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d96fcd3a0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:03.684830 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6dfe4bd4-5274-47ee-8c71-266ec399a1dc tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96" status: 202 len: 0 microversion: 2.1 time: 0.241427 Oct 29 01:42:03.685435 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3124/6480] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Oct 29 01:42:03 2022] DELETE /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:42:03.697508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2058a479-2482-463a-971b-71674f0420af tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2031307332", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "0d66c4b1-6711-475e-88ce-0d9ce411fb25"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1805215031", "security_groups": [{"name": "tempest-secgroup-smoke-639781886"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:03.719610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c0172e99-8f3a-4f65-b969-3839634ca8b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:03.728352 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c0172e99-8f3a-4f65-b969-3839634ca8b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1201 microversion: 2.1 time: 0.402514 Oct 29 01:42:03.732949 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3357/6481] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:03 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1201 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:03.747415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f431a0bc-e0ec-4054-8f4d-1f11272b7098 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d967731f0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:03.845913 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f431a0bc-e0ec-4054-8f4d-1f11272b7098 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96" status: 200 len: 287 microversion: 2.1 time: 0.112662 Oct 29 01:42:03.847796 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3358/6482] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 29 01:42:03 2022] GET /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96 => generated 287 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:03.859101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4f333399-d5f8-4bdf-baf9-8f5d3715733f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:03.860586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4f333399-d5f8-4bdf-baf9-8f5d3715733f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:03.867752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f333399-d5f8-4bdf-baf9-8f5d3715733f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:03.868636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f333399-d5f8-4bdf-baf9-8f5d3715733f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:03.869369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f333399-d5f8-4bdf-baf9-8f5d3715733f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:03.870291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f333399-d5f8-4bdf-baf9-8f5d3715733f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:03.870989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f333399-d5f8-4bdf-baf9-8f5d3715733f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:03.871605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f333399-d5f8-4bdf-baf9-8f5d3715733f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:04.097953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-2058a479-2482-463a-971b-71674f0420af tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] validate_networks() for [('0d66c4b1-6711-475e-88ce-0d9ce411fb25', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:42:04.646077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4f333399-d5f8-4bdf-baf9-8f5d3715733f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:04.654633 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4f333399-d5f8-4bdf-baf9-8f5d3715733f tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6" status: 200 len: 1551 microversion: 2.1 time: 0.805448 Oct 29 01:42:04.662947 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3359/6483] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:03 2022] GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 => generated 1551 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:04.758391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5f1ee618-1816-45c4-bb74-9912b0490862 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:04.760970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5f1ee618-1816-45c4-bb74-9912b0490862 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:04.766337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f1ee618-1816-45c4-bb74-9912b0490862 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:04.767282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f1ee618-1816-45c4-bb74-9912b0490862 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:04.767961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f1ee618-1816-45c4-bb74-9912b0490862 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:04.769360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f1ee618-1816-45c4-bb74-9912b0490862 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:04.770083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f1ee618-1816-45c4-bb74-9912b0490862 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:04.770787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f1ee618-1816-45c4-bb74-9912b0490862 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:06.007592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5f1ee618-1816-45c4-bb74-9912b0490862 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:06.018286 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5f1ee618-1816-45c4-bb74-9912b0490862 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1201 microversion: 2.1 time: 1.263717 Oct 29 01:42:06.033909 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3360/6484] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:04 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1201 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:42:06.033909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3d0f660a-e9a5-48c1-872e-d8c5f7bf121b tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d9661b280>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:06.148379 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3d0f660a-e9a5-48c1-872e-d8c5f7bf121b tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96" status: 200 len: 287 microversion: 2.1 time: 0.125539 Oct 29 01:42:06.149360 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3361/6485] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 29 01:42:06 2022] GET /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96 => generated 287 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:06.345339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-2058a479-2482-463a-971b-71674f0420af tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:42:06.347069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-2058a479-2482-463a-971b-71674f0420af tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:42:06.347069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-2058a479-2482-463a-971b-71674f0420af tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:42:06.347069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-2058a479-2482-463a-971b-71674f0420af tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:42:06.347359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-2058a479-2482-463a-971b-71674f0420af tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:42:06.372915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-d8426023-e58b-4cb0-a7a9-889229bf4ee7 req-de75e16d-f515-42ea-a74b-66c197c71c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff1ca70-b641-4a85-8988-ebd6bccd2ec6", "name": "network-vif-deleted", "tag": "cb5933ab-9db6-48b2-aed9-3422fd9e2671"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:06.375145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2058a479-2482-463a-971b-71674f0420af tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:06.375643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2058a479-2482-463a-971b-71674f0420af tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:06.376085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2058a479-2482-463a-971b-71674f0420af tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:06.377013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2058a479-2482-463a-971b-71674f0420af tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:06.377604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2058a479-2482-463a-971b-71674f0420af tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:06.378086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2058a479-2482-463a-971b-71674f0420af tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:06.397488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d8426023-e58b-4cb0-a7a9-889229bf4ee7 req-de75e16d-f515-42ea-a74b-66c197c71c45 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:06.398306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d8426023-e58b-4cb0-a7a9-889229bf4ee7 req-de75e16d-f515-42ea-a74b-66c197c71c45 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:06.398962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d8426023-e58b-4cb0-a7a9-889229bf4ee7 req-de75e16d-f515-42ea-a74b-66c197c71c45 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:06.419580 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-d8426023-e58b-4cb0-a7a9-889229bf4ee7 req-de75e16d-f515-42ea-a74b-66c197c71c45 service nova] Creating event network-vif-deleted:cb5933ab-9db6-48b2-aed9-3422fd9e2671 for instance 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 on n-h2-862964-3 Oct 29 01:42:06.431843 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-d8426023-e58b-4cb0-a7a9-889229bf4ee7 req-de75e16d-f515-42ea-a74b-66c197c71c45 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281028 Oct 29 01:42:06.432804 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3362/6486] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:06.471198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4d34e63e-3d2d-4c9a-b93d-225ad42ae2ac tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:06.475720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4d34e63e-3d2d-4c9a-b93d-225ad42ae2ac tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:06.478069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-2058a479-2482-463a-971b-71674f0420af tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Getting quotas for project 2842ba05180046839fb5d064ad9132a1. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:42:06.502654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d34e63e-3d2d-4c9a-b93d-225ad42ae2ac tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:06.506283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d34e63e-3d2d-4c9a-b93d-225ad42ae2ac tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:06.507520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d34e63e-3d2d-4c9a-b93d-225ad42ae2ac tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:06.509189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d34e63e-3d2d-4c9a-b93d-225ad42ae2ac tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:06.523499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d34e63e-3d2d-4c9a-b93d-225ad42ae2ac tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:06.524004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-2058a479-2482-463a-971b-71674f0420af tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Getting quotas for user c70e2b34406c4e11afd9471a09d9cfef and project 2842ba05180046839fb5d064ad9132a1. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:42:06.534868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d34e63e-3d2d-4c9a-b93d-225ad42ae2ac tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:06.597739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2058a479-2482-463a-971b-71674f0420af tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:42:06.608182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2058a479-2482-463a-971b-71674f0420af tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:42:06.620006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d34e63e-3d2d-4c9a-b93d-225ad42ae2ac tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:06.622418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d34e63e-3d2d-4c9a-b93d-225ad42ae2ac tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:06.625551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d34e63e-3d2d-4c9a-b93d-225ad42ae2ac tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:06.626275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-4d34e63e-3d2d-4c9a-b93d-225ad42ae2ac tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lazy-loading 'fault' on Instance uuid 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:42:06.823045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4d34e63e-3d2d-4c9a-b93d-225ad42ae2ac tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:06.840710 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4d34e63e-3d2d-4c9a-b93d-225ad42ae2ac tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6" status: 200 len: 1337 microversion: 2.1 time: 0.398379 Oct 29 01:42:06.855862 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3363/6487] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:06 2022] GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 => generated 1337 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:07.060192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3188dccc-59a3-49ad-abf5-c93c9db25929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:07.061503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3188dccc-59a3-49ad-abf5-c93c9db25929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:07.072583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3188dccc-59a3-49ad-abf5-c93c9db25929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:07.073904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3188dccc-59a3-49ad-abf5-c93c9db25929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:07.074519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3188dccc-59a3-49ad-abf5-c93c9db25929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:07.075442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3188dccc-59a3-49ad-abf5-c93c9db25929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:07.078479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3188dccc-59a3-49ad-abf5-c93c9db25929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:07.080165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3188dccc-59a3-49ad-abf5-c93c9db25929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:07.146230 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2058a479-2482-463a-971b-71674f0420af tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.448730 Oct 29 01:42:07.156740 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3125/6488] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:42:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 3465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:42:07.189270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6e38b26e-6ccc-4824-b6e3-554e54f2b86d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:07.189944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6e38b26e-6ccc-4824-b6e3-554e54f2b86d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:07.525918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6e38b26e-6ccc-4824-b6e3-554e54f2b86d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:07.525918 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6e38b26e-6ccc-4824-b6e3-554e54f2b86d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1267 microversion: 2.1 time: 0.256138 Oct 29 01:42:07.525918 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3126/6489] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:07 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1267 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:07.525918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-137e5d2b-4b4f-44f6-9da2-b2da31e513e2 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d96fa0c10>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:07.525918 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-137e5d2b-4b4f-44f6-9da2-b2da31e513e2 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96" status: 200 len: 287 microversion: 2.1 time: 0.079114 Oct 29 01:42:07.525918 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3127/6490] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 29 01:42:07 2022] GET /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96 => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:07.663016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3188dccc-59a3-49ad-abf5-c93c9db25929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:07.673334 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3188dccc-59a3-49ad-abf5-c93c9db25929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1201 microversion: 2.1 time: 0.629570 Oct 29 01:42:07.674465 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3364/6491] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:07 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1201 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:07.872906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2b10ccd3-079b-41e6-b69d-18201fdff2d4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:07.873689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2b10ccd3-079b-41e6-b69d-18201fdff2d4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:07.890915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b10ccd3-079b-41e6-b69d-18201fdff2d4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:07.891652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b10ccd3-079b-41e6-b69d-18201fdff2d4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:07.892200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b10ccd3-079b-41e6-b69d-18201fdff2d4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:07.893185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b10ccd3-079b-41e6-b69d-18201fdff2d4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:07.895049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b10ccd3-079b-41e6-b69d-18201fdff2d4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:07.897128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b10ccd3-079b-41e6-b69d-18201fdff2d4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:07.957631 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-2b10ccd3-079b-41e6-b69d-18201fdff2d4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] HTTP exception thrown: Instance 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 could not be found. Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2b10ccd3-079b-41e6-b69d-18201fdff2d4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Request method failure captured: Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 HTTP/1.1 Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIQsVu2mso_3kv_o0mGADjWM2Bg1UuEqJVFu774uKP2WdC0nr-Np0zE08G54LAEaqvux0Aas8l9DeXQZAAj7XDW-kDA8BmUR5dn2ryhzAECpHLeKUuKN3aTegfCoeWIUqIJV7FrqkONpr-52FX-UQZ_7rv3Eai6qrJuam-lgP5A58RY Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: e1817f6a3cd04ebbaa07dd63934d2771 Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TestNetworkBasicOps-1986281729 Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1817f6a3cd04ebbaa07dd63934d2771"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e1817f6a3cd04ebbaa07dd63934d2771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1817f6a3cd04ebbaa07dd63934d2771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e1817f6a3cd04ebbaa07dd63934d2771", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TestNetworkBasicOps-1986281729 Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: e1817f6a3cd04ebbaa07dd63934d2771 Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TestNetworkBasicOps-1986281729 Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TestNetworkBasicOps-1986281729-project Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: ab773592a5914fcda533047d8044c3dc Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TestNetworkBasicOps-1986281729-project Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 could not be found. Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '0ff1ca70-b641-4a85-8988-ebd6bccd2ec6'} Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 could not be found. Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 could not be found. Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:07.959498 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:07.964601 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:07.964601 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:42:07.964601 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:42:07.964601 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:42:07.964601 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:42:07.964601 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 could not be found. Oct 29 01:42:07.964601 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:07.985939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2b10ccd3-079b-41e6-b69d-18201fdff2d4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Returning 404 to user: Instance 0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:42:07.988492 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2b10ccd3-079b-41e6-b69d-18201fdff2d4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6" status: 404 len: 111 microversion: 2.1 time: 0.120096 Oct 29 01:42:07.990994 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3128/6492] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:07 2022] GET /compute/v2.1/servers/0ff1ca70-b641-4a85-8988-ebd6bccd2ec6 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:42:08.328242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e9358578-47bf-4cab-9bc2-260f82bcb4da tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '.version_select at 0x7f9d97d79c10>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:08.446602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c01c848e-00df-4668-ab35-fd418b485540 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:08.447665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c01c848e-00df-4668-ab35-fd418b485540 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:08.512660 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e9358578-47bf-4cab-9bc2-260f82bcb4da tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-896376741" status: 202 len: 0 microversion: 2.1 time: 0.188777 Oct 29 01:42:08.513818 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3365/6493] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Oct 29 01:42:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-896376741 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:42:08.527997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-08f6dbbf-1965-4a3c-8a47-ae048d2c25f1 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d9796fdc0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:08.546529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c01c848e-00df-4668-ab35-fd418b485540 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:08.560315 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c01c848e-00df-4668-ab35-fd418b485540 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1267 microversion: 2.1 time: 0.117447 Oct 29 01:42:08.563013 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3129/6494] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:08 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1267 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:42:08.586949 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-08f6dbbf-1965-4a3c-8a47-ae048d2c25f1 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] HTTP exception thrown: Snapshot dc04fb78-e612-4dfd-9e0a-bf3b666f1b96 could not be found. Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-08f6dbbf-1965-4a3c-8a47-ae048d2c25f1 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Request method failure captured: Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96 HTTP/1.1 Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXITj2HMTp40RmDmhGdjkYQ-cKAKdDFFg4cu_CM39uFf3fvJBxTB8lexDYoM16flkedtl9U7cronkH12cJHhOoMyKY1gB29LqOMWwqqCoXEcaeJC2BfWSITc8q1uoGH3YkTjj095DflB8U4NeK7eQP87O63gRGSknijw8nBhsp-4K4mU Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 70b14ffaea644d5aa4d78833b27630b0 Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-753058327 Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/70b14ffaea644d5aa4d78833b27630b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/70b14ffaea644d5aa4d78833b27630b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/70b14ffaea644d5aa4d78833b27630b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_70b14ffaea644d5aa4d78833b27630b0", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-VolumesSnapshotsTestJSON-753058327 Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 70b14ffaea644d5aa4d78833b27630b0 Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-753058327 Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-VolumesSnapshotsTestJSON-753058327-project Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 42545d36c9c947e0927d20af5006a6c6 Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-VolumesSnapshotsTestJSON-753058327-project Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: method: Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: exception: Snapshot dc04fb78-e612-4dfd-9e0a-bf3b666f1b96 could not be found. Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'dc04fb78-e612-4dfd-9e0a-bf3b666f1b96'} Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot dc04fb78-e612-4dfd-9e0a-bf3b666f1b96 could not be found. (HTTP 404) (Request-ID: req-f0378b9e-387a-44da-9e3d-978ddf081f72) Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 01:42:08.601358 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot dc04fb78-e612-4dfd-9e0a-bf3b666f1b96 could not be found. Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot dc04fb78-e612-4dfd-9e0a-bf3b666f1b96 could not be found. Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot dc04fb78-e612-4dfd-9e0a-bf3b666f1b96 could not be found. Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-08f6dbbf-1965-4a3c-8a47-ae048d2c25f1 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Returning 404 to user: Snapshot dc04fb78-e612-4dfd-9e0a-bf3b666f1b96 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-08f6dbbf-1965-4a3c-8a47-ae048d2c25f1 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96" status: 404 len: 111 microversion: 2.1 time: 0.083833 Oct 29 01:42:08.612925 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3366/6495] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 29 01:42:08 2022] GET /compute/v2.1/os-snapshots/dc04fb78-e612-4dfd-9e0a-bf3b666f1b96 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:42:08.615570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-026429d0-1b56-4567-b64c-9cfab1381f87 req-1f97e283-35e4-4bcf-b800-c01646728047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7235711a-0845-4384-8655-1e95349a5c06", "name": "network-vif-plugged", "status": "completed", "tag": "8eac01f3-d247-4549-82a0-75e0364fa3e0"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:08.626383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-83b6f48b-ae52-41ac-ae60-a47d0a7a1154 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d96add940>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:08.634851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-026429d0-1b56-4567-b64c-9cfab1381f87 req-1f97e283-35e4-4bcf-b800-c01646728047 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:08.635335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-026429d0-1b56-4567-b64c-9cfab1381f87 req-1f97e283-35e4-4bcf-b800-c01646728047 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:08.636892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-026429d0-1b56-4567-b64c-9cfab1381f87 req-1f97e283-35e4-4bcf-b800-c01646728047 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:08.724104 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-026429d0-1b56-4567-b64c-9cfab1381f87 req-1f97e283-35e4-4bcf-b800-c01646728047 service nova] Creating event network-vif-plugged:8eac01f3-d247-4549-82a0-75e0364fa3e0 for instance 7235711a-0845-4384-8655-1e95349a5c06 on n-h1-862964-3 Oct 29 01:42:08.734675 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-026429d0-1b56-4567-b64c-9cfab1381f87 req-1f97e283-35e4-4bcf-b800-c01646728047 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129775 Oct 29 01:42:08.735757 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3130/6496] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:08.750246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c8da67f4-0086-44e8-8812-ff582d78e790 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:08.754618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c8da67f4-0086-44e8-8812-ff582d78e790 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:08.769689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8da67f4-0086-44e8-8812-ff582d78e790 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:08.770347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8da67f4-0086-44e8-8812-ff582d78e790 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:08.770898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8da67f4-0086-44e8-8812-ff582d78e790 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:08.771638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8da67f4-0086-44e8-8812-ff582d78e790 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:08.778704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8da67f4-0086-44e8-8812-ff582d78e790 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:08.778704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c8da67f4-0086-44e8-8812-ff582d78e790 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:08.950296 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-83b6f48b-ae52-41ac-ae60-a47d0a7a1154 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730" status: 202 len: 0 microversion: 2.1 time: 0.324892 Oct 29 01:42:08.952303 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3367/6497] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 29 01:42:08 2022] DELETE /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:42:08.961426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-78345aaa-cabf-4e01-8178-ff0673baa15f tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d9661b3a0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:09.098910 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-78345aaa-cabf-4e01-8178-ff0673baa15f tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730" status: 200 len: 345 microversion: 2.1 time: 0.142167 Oct 29 01:42:09.099798 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3368/6498] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:42:08 2022] GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730 => generated 345 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:42:09.430942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c8da67f4-0086-44e8-8812-ff582d78e790 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:09.440566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=66 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:42:09.448294 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c8da67f4-0086-44e8-8812-ff582d78e790 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1201 microversion: 2.1 time: 0.711249 Oct 29 01:42:09.449374 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3131/6499] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:08 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1201 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:09.586664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d46f381b-efd1-43ec-b5fc-481fc64fd835 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:09.587605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d46f381b-efd1-43ec-b5fc-481fc64fd835 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:09.605707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d46f381b-efd1-43ec-b5fc-481fc64fd835 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:09.615092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d46f381b-efd1-43ec-b5fc-481fc64fd835 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:09.615092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d46f381b-efd1-43ec-b5fc-481fc64fd835 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:09.615092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d46f381b-efd1-43ec-b5fc-481fc64fd835 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:09.615092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d46f381b-efd1-43ec-b5fc-481fc64fd835 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:09.615533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d46f381b-efd1-43ec-b5fc-481fc64fd835 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:09.886250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d46f381b-efd1-43ec-b5fc-481fc64fd835 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:09.914595 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d46f381b-efd1-43ec-b5fc-481fc64fd835 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1263 microversion: 2.1 time: 0.333808 Oct 29 01:42:09.915581 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3369/6500] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:09 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1263 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:10.116041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8fd9917c-5473-407d-aa83-5882733129c5 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d96a57dc0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:10.256285 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8fd9917c-5473-407d-aa83-5882733129c5 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730" status: 200 len: 345 microversion: 2.1 time: 0.144847 Oct 29 01:42:10.260006 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3132/6501] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:42:10 2022] GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730 => generated 345 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:10.472427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7c3528c5-b8b4-4873-be86-76420ac2225e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:10.474054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7c3528c5-b8b4-4873-be86-76420ac2225e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:10.489887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c3528c5-b8b4-4873-be86-76420ac2225e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:10.493516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c3528c5-b8b4-4873-be86-76420ac2225e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:10.494417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c3528c5-b8b4-4873-be86-76420ac2225e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:10.496737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c3528c5-b8b4-4873-be86-76420ac2225e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:10.499917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c3528c5-b8b4-4873-be86-76420ac2225e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:10.500759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7c3528c5-b8b4-4873-be86-76420ac2225e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:10.950934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-abc0a4fc-48d0-4964-abb7-fd603b7f5b45 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:10.951584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-abc0a4fc-48d0-4964-abb7-fd603b7f5b45 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:10.970756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abc0a4fc-48d0-4964-abb7-fd603b7f5b45 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:10.971253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abc0a4fc-48d0-4964-abb7-fd603b7f5b45 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:10.971402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7c3528c5-b8b4-4873-be86-76420ac2225e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:10.971828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abc0a4fc-48d0-4964-abb7-fd603b7f5b45 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:10.978394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abc0a4fc-48d0-4964-abb7-fd603b7f5b45 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:10.978888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abc0a4fc-48d0-4964-abb7-fd603b7f5b45 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:10.979331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-abc0a4fc-48d0-4964-abb7-fd603b7f5b45 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:10.994541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:42:11.007855 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7c3528c5-b8b4-4873-be86-76420ac2225e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1201 microversion: 2.1 time: 0.538282 Oct 29 01:42:11.012605 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3370/6502] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:10 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1201 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:11.133578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-abc0a4fc-48d0-4964-abb7-fd603b7f5b45 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:11.144504 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-abc0a4fc-48d0-4964-abb7-fd603b7f5b45 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1327 microversion: 2.1 time: 0.198681 Oct 29 01:42:11.145249 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3133/6503] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:10 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1327 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:42:11.277016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-afcaf55e-a299-4b54-a29b-ddb5ff37d166 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d9660a670>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:11.426713 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-afcaf55e-a299-4b54-a29b-ddb5ff37d166 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730" status: 200 len: 345 microversion: 2.1 time: 0.154082 Oct 29 01:42:11.427780 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3371/6504] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:42:11 2022] GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730 => generated 345 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:12.043149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2966a6af-3716-4b6e-a7fa-3e2036c42bc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:12.043380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2966a6af-3716-4b6e-a7fa-3e2036c42bc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:12.059696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2966a6af-3716-4b6e-a7fa-3e2036c42bc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:12.060220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2966a6af-3716-4b6e-a7fa-3e2036c42bc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:12.060637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2966a6af-3716-4b6e-a7fa-3e2036c42bc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:12.073383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2966a6af-3716-4b6e-a7fa-3e2036c42bc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:12.073854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2966a6af-3716-4b6e-a7fa-3e2036c42bc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:12.074306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2966a6af-3716-4b6e-a7fa-3e2036c42bc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:12.178475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c4a9229d-e6c6-42ae-8862-edb71f5a6dea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:12.179323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c4a9229d-e6c6-42ae-8862-edb71f5a6dea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:12.200230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4a9229d-e6c6-42ae-8862-edb71f5a6dea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:12.203320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4a9229d-e6c6-42ae-8862-edb71f5a6dea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:12.206249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4a9229d-e6c6-42ae-8862-edb71f5a6dea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:12.210066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4a9229d-e6c6-42ae-8862-edb71f5a6dea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:12.210758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4a9229d-e6c6-42ae-8862-edb71f5a6dea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:12.212470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4a9229d-e6c6-42ae-8862-edb71f5a6dea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:12.445659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c4a9229d-e6c6-42ae-8862-edb71f5a6dea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:12.457827 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c4a9229d-e6c6-42ae-8862-edb71f5a6dea tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1325 microversion: 2.1 time: 0.284527 Oct 29 01:42:12.471006 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3372/6505] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:12 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1325 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:12.484841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3c189f84-73e8-4c6c-aef8-dbdb705205d8 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d96add0d0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:12.599285 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3c189f84-73e8-4c6c-aef8-dbdb705205d8 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730" status: 200 len: 345 microversion: 2.1 time: 0.121947 Oct 29 01:42:12.599945 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3373/6506] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:42:12 2022] GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730 => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:12.607306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2966a6af-3716-4b6e-a7fa-3e2036c42bc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:12.620953 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2966a6af-3716-4b6e-a7fa-3e2036c42bc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1389 microversion: 2.1 time: 0.583232 Oct 29 01:42:12.621982 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3134/6507] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:12 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1389 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:12.667737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0db9165c-1a84-48e4-aab2-d8851b2b0066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:12.668546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0db9165c-1a84-48e4-aab2-d8851b2b0066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:12.676559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0db9165c-1a84-48e4-aab2-d8851b2b0066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:12.677141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0db9165c-1a84-48e4-aab2-d8851b2b0066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:12.677704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0db9165c-1a84-48e4-aab2-d8851b2b0066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:12.678601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0db9165c-1a84-48e4-aab2-d8851b2b0066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:12.679323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0db9165c-1a84-48e4-aab2-d8851b2b0066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:12.679800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0db9165c-1a84-48e4-aab2-d8851b2b0066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:13.089231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0db9165c-1a84-48e4-aab2-d8851b2b0066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:13.101508 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0db9165c-1a84-48e4-aab2-d8851b2b0066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1389 microversion: 2.1 time: 0.456265 Oct 29 01:42:13.102342 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3374/6508] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:12 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1389 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:13.126794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3c08765c-ca13-499a-95e6-35dd149cb93c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:13.142648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3c08765c-ca13-499a-95e6-35dd149cb93c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:13.142648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c08765c-ca13-499a-95e6-35dd149cb93c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:13.142648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c08765c-ca13-499a-95e6-35dd149cb93c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:13.142648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c08765c-ca13-499a-95e6-35dd149cb93c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:13.142648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c08765c-ca13-499a-95e6-35dd149cb93c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:13.144464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c08765c-ca13-499a-95e6-35dd149cb93c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:13.145135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c08765c-ca13-499a-95e6-35dd149cb93c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:13.484436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3c08765c-ca13-499a-95e6-35dd149cb93c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:13.488320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-22da37eb-76bf-439a-9bc7-6e06dedc7450 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:13.489087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-22da37eb-76bf-439a-9bc7-6e06dedc7450 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:13.498719 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3c08765c-ca13-499a-95e6-35dd149cb93c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1389 microversion: 2.1 time: 0.375109 Oct 29 01:42:13.501254 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3135/6509] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:13 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1389 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:13.502828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22da37eb-76bf-439a-9bc7-6e06dedc7450 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:13.503691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22da37eb-76bf-439a-9bc7-6e06dedc7450 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:13.506626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22da37eb-76bf-439a-9bc7-6e06dedc7450 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:13.507530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22da37eb-76bf-439a-9bc7-6e06dedc7450 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:13.510109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22da37eb-76bf-439a-9bc7-6e06dedc7450 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:13.510815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-22da37eb-76bf-439a-9bc7-6e06dedc7450 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:13.536564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dde8873b-8357-4055-a58b-8afb5b478bc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:13.537140 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dde8873b-8357-4055-a58b-8afb5b478bc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:13.559972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dde8873b-8357-4055-a58b-8afb5b478bc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:13.563626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dde8873b-8357-4055-a58b-8afb5b478bc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:13.563626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dde8873b-8357-4055-a58b-8afb5b478bc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:13.564002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dde8873b-8357-4055-a58b-8afb5b478bc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:13.565772 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dde8873b-8357-4055-a58b-8afb5b478bc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:13.566227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dde8873b-8357-4055-a58b-8afb5b478bc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:13.650263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dde8873b-8357-4055-a58b-8afb5b478bc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:42:14.158084 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dde8873b-8357-4055-a58b-8afb5b478bc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 204 len: 0 microversion: 2.1 time: 0.632798 Oct 29 01:42:14.158796 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3136/6510] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:42:13 2022] DELETE /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:42:14.168381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e2b904aa-6d36-491e-87d4-4053e9cb0aaf tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d9fe5fd30>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:14.176642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-22da37eb-76bf-439a-9bc7-6e06dedc7450 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:14.196559 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-22da37eb-76bf-439a-9bc7-6e06dedc7450 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1392 microversion: 2.1 time: 0.702486 Oct 29 01:42:14.197762 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3375/6511] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:13 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1392 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:42:14.205729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7a21b150-3b00-49c1-8ddb-4033403b454f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:14.209919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7a21b150-3b00-49c1-8ddb-4033403b454f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:14.233014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a21b150-3b00-49c1-8ddb-4033403b454f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:14.233014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a21b150-3b00-49c1-8ddb-4033403b454f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:14.233014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a21b150-3b00-49c1-8ddb-4033403b454f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:14.233014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a21b150-3b00-49c1-8ddb-4033403b454f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:14.233014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a21b150-3b00-49c1-8ddb-4033403b454f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:14.233014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a21b150-3b00-49c1-8ddb-4033403b454f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:14.250346 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-e2b904aa-6d36-491e-87d4-4053e9cb0aaf tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] HTTP exception thrown: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e2b904aa-6d36-491e-87d4-4053e9cb0aaf tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Request method failure captured: Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730 HTTP/1.1 Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXITj2HMTp40RmDmhGdjkYQ-cKAKdDFFg4cu_CM39uFf3fvJBxTB8lexDYoM16flkedtl9U7cronkH12cJHhOoMyKY1gB29LqOMWwqqCoXEcaeJC2BfWSITc8q1uoGH3YkTjj095DflB8U4NeK7eQP87O63gRGSknijw8nBhsp-4K4mU Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 70b14ffaea644d5aa4d78833b27630b0 Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-753058327 Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/70b14ffaea644d5aa4d78833b27630b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/70b14ffaea644d5aa4d78833b27630b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/70b14ffaea644d5aa4d78833b27630b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_70b14ffaea644d5aa4d78833b27630b0", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-VolumesSnapshotsTestJSON-753058327 Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 70b14ffaea644d5aa4d78833b27630b0 Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-753058327 Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-VolumesSnapshotsTestJSON-753058327-project Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 42545d36c9c947e0927d20af5006a6c6 Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-VolumesSnapshotsTestJSON-753058327-project Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: exception: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '543da027-2ad3-4be7-9592-9369d8fcb730'} Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. (HTTP 404) (Request-ID: req-f0dd8030-37e5-4513-bb45-753733ce8d6c) Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 01:42:14.252430 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e2b904aa-6d36-491e-87d4-4053e9cb0aaf tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Returning 404 to user: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e2b904aa-6d36-491e-87d4-4053e9cb0aaf tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730" status: 404 len: 109 microversion: 2.1 time: 0.093643 Oct 29 01:42:14.259696 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3137/6512] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:42:14 2022] GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:42:14.269358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d783c881-d967-481a-bc19-a1981b79161b tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d96fab430>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:14.336600 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-d783c881-d967-481a-bc19-a1981b79161b tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] HTTP exception thrown: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d783c881-d967-481a-bc19-a1981b79161b tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Request method failure captured: Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730 HTTP/1.1 Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXITj2HMTp40RmDmhGdjkYQ-cKAKdDFFg4cu_CM39uFf3fvJBxTB8lexDYoM16flkedtl9U7cronkH12cJHhOoMyKY1gB29LqOMWwqqCoXEcaeJC2BfWSITc8q1uoGH3YkTjj095DflB8U4NeK7eQP87O63gRGSknijw8nBhsp-4K4mU Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 70b14ffaea644d5aa4d78833b27630b0 Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-753058327 Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/70b14ffaea644d5aa4d78833b27630b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/70b14ffaea644d5aa4d78833b27630b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/70b14ffaea644d5aa4d78833b27630b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_70b14ffaea644d5aa4d78833b27630b0", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-VolumesSnapshotsTestJSON-753058327 Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 70b14ffaea644d5aa4d78833b27630b0 Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-753058327 Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-VolumesSnapshotsTestJSON-753058327-project Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 42545d36c9c947e0927d20af5006a6c6 Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-VolumesSnapshotsTestJSON-753058327-project Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: exception: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '543da027-2ad3-4be7-9592-9369d8fcb730'} Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. (HTTP 404) (Request-ID: req-733f6beb-ab22-48ea-91e9-ef39be3eac2f) Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 01:42:14.337599 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d783c881-d967-481a-bc19-a1981b79161b tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Returning 404 to user: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d783c881-d967-481a-bc19-a1981b79161b tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730" status: 404 len: 109 microversion: 2.1 time: 0.073839 Oct 29 01:42:14.342027 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3138/6513] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 29 01:42:14 2022] DELETE /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:42:14.348080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-34cfdca1-a552-4176-a7b7-beb24ebc9b08 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Calling method '.version_select at 0x7f9d971b29d0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:14.402638 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-34cfdca1-a552-4176-a7b7-beb24ebc9b08 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] HTTP exception thrown: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-34cfdca1-a552-4176-a7b7-beb24ebc9b08 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Request method failure captured: Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730 HTTP/1.1 Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXITj2HMTp40RmDmhGdjkYQ-cKAKdDFFg4cu_CM39uFf3fvJBxTB8lexDYoM16flkedtl9U7cronkH12cJHhOoMyKY1gB29LqOMWwqqCoXEcaeJC2BfWSITc8q1uoGH3YkTjj095DflB8U4NeK7eQP87O63gRGSknijw8nBhsp-4K4mU Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 70b14ffaea644d5aa4d78833b27630b0 Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-753058327 Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/70b14ffaea644d5aa4d78833b27630b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/70b14ffaea644d5aa4d78833b27630b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/70b14ffaea644d5aa4d78833b27630b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_70b14ffaea644d5aa4d78833b27630b0", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-VolumesSnapshotsTestJSON-753058327 Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 70b14ffaea644d5aa4d78833b27630b0 Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-753058327 Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-VolumesSnapshotsTestJSON-753058327-project Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 42545d36c9c947e0927d20af5006a6c6 Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-VolumesSnapshotsTestJSON-753058327-project Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: exception: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '543da027-2ad3-4be7-9592-9369d8fcb730'} Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. (HTTP 404) (Request-ID: req-ff245312-c7e7-48ca-9990-77ecceed9cf1) Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 01:42:14.404612 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-34cfdca1-a552-4176-a7b7-beb24ebc9b08 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] Returning 404 to user: Volume 543da027-2ad3-4be7-9592-9369d8fcb730 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-34cfdca1-a552-4176-a7b7-beb24ebc9b08 tempest-VolumesSnapshotsTestJSON-753058327 tempest-VolumesSnapshotsTestJSON-753058327-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730" status: 404 len: 109 microversion: 2.1 time: 0.062219 Oct 29 01:42:14.408478 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3139/6514] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:42:14 2022] GET /compute/v2.1/os-volumes/543da027-2ad3-4be7-9592-9369d8fcb730 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:42:14.434350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4dc0f0f4-d987-4a3d-9b1a-2fe997e1b8db tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:14.434977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4dc0f0f4-d987-4a3d-9b1a-2fe997e1b8db tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:14.449904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dc0f0f4-d987-4a3d-9b1a-2fe997e1b8db tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:14.450413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dc0f0f4-d987-4a3d-9b1a-2fe997e1b8db tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:14.455018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dc0f0f4-d987-4a3d-9b1a-2fe997e1b8db tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:14.456032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dc0f0f4-d987-4a3d-9b1a-2fe997e1b8db tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:14.463702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dc0f0f4-d987-4a3d-9b1a-2fe997e1b8db tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:14.464667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dc0f0f4-d987-4a3d-9b1a-2fe997e1b8db tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:14.530133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4dc0f0f4-d987-4a3d-9b1a-2fe997e1b8db tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:42:14.656644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7a21b150-3b00-49c1-8ddb-4033403b454f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:14.666203 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7a21b150-3b00-49c1-8ddb-4033403b454f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1395 microversion: 2.1 time: 0.466992 Oct 29 01:42:14.671599 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3376/6515] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:14 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1395 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:15.090725 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4dc0f0f4-d987-4a3d-9b1a-2fe997e1b8db tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 204 len: 0 microversion: 2.1 time: 0.659976 Oct 29 01:42:15.092568 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3140/6516] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:42:14 2022] DELETE /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:42:15.101843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-26088e26-44d3-47df-b098-87b9b559a49d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:15.104628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-26088e26-44d3-47df-b098-87b9b559a49d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:15.115608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26088e26-44d3-47df-b098-87b9b559a49d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:15.116121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26088e26-44d3-47df-b098-87b9b559a49d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:15.116569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26088e26-44d3-47df-b098-87b9b559a49d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:15.119448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26088e26-44d3-47df-b098-87b9b559a49d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:15.120164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26088e26-44d3-47df-b098-87b9b559a49d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:15.127953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26088e26-44d3-47df-b098-87b9b559a49d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:15.493349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-34472aea-2989-4b14-9498-8b5813a53cc8 req-4d5bc39e-ea3d-440c-9fc9-04b02cff8269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dbc4be2-8396-4d8f-9f31-7cf1423bf145", "tag": "25d49c2a-24b7-4c5a-8b70-8bb410658a2f"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:15.513189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-34472aea-2989-4b14-9498-8b5813a53cc8 req-4d5bc39e-ea3d-440c-9fc9-04b02cff8269 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:15.518949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-34472aea-2989-4b14-9498-8b5813a53cc8 req-4d5bc39e-ea3d-440c-9fc9-04b02cff8269 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:15.522386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-34472aea-2989-4b14-9498-8b5813a53cc8 req-4d5bc39e-ea3d-440c-9fc9-04b02cff8269 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:15.566516 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-34472aea-2989-4b14-9498-8b5813a53cc8 req-4d5bc39e-ea3d-440c-9fc9-04b02cff8269 service nova] Creating event network-changed:25d49c2a-24b7-4c5a-8b70-8bb410658a2f for instance 4dbc4be2-8396-4d8f-9f31-7cf1423bf145 on n-h2-862964-3 Oct 29 01:42:15.583967 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-34472aea-2989-4b14-9498-8b5813a53cc8 req-4d5bc39e-ea3d-440c-9fc9-04b02cff8269 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.910791 Oct 29 01:42:15.584966 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3377/6517] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:15.595716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6efcc068-6ede-4e95-9fba-98164a08eef6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:15.597204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6efcc068-6ede-4e95-9fba-98164a08eef6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:15.618480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6efcc068-6ede-4e95-9fba-98164a08eef6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:15.618480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6efcc068-6ede-4e95-9fba-98164a08eef6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:15.618480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6efcc068-6ede-4e95-9fba-98164a08eef6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:15.619650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6efcc068-6ede-4e95-9fba-98164a08eef6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:15.621587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6efcc068-6ede-4e95-9fba-98164a08eef6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:15.622325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6efcc068-6ede-4e95-9fba-98164a08eef6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:15.634146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-26088e26-44d3-47df-b098-87b9b559a49d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:15.646359 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-26088e26-44d3-47df-b098-87b9b559a49d tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 200 len: 1669 microversion: 2.1 time: 0.548914 Oct 29 01:42:15.662548 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3141/6518] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:15 2022] GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 1669 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:15.710222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-35b57bc9-0638-4a7b-8d31-a4ffe4a6a149 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:15.720657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-35b57bc9-0638-4a7b-8d31-a4ffe4a6a149 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:15.739711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35b57bc9-0638-4a7b-8d31-a4ffe4a6a149 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:15.742484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35b57bc9-0638-4a7b-8d31-a4ffe4a6a149 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:15.744026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35b57bc9-0638-4a7b-8d31-a4ffe4a6a149 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:15.745061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35b57bc9-0638-4a7b-8d31-a4ffe4a6a149 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:15.747046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35b57bc9-0638-4a7b-8d31-a4ffe4a6a149 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:15.749041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-35b57bc9-0638-4a7b-8d31-a4ffe4a6a149 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:16.416270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:42:16.813211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-35b57bc9-0638-4a7b-8d31-a4ffe4a6a149 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:16.830681 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-35b57bc9-0638-4a7b-8d31-a4ffe4a6a149 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1395 microversion: 2.1 time: 1.137346 Oct 29 01:42:16.831599 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3142/6519] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:15 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1395 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:42:16.838459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6efcc068-6ede-4e95-9fba-98164a08eef6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:16.847300 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6efcc068-6ede-4e95-9fba-98164a08eef6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1392 microversion: 2.1 time: 1.260921 Oct 29 01:42:16.857548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-fd94874b-f58f-4ef2-b206-2cfd5a72e914 req-73c28d23-abf0-4f87-8dd5-cbab6fc1b349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3984ece4-66ac-4c11-b414-0c1f4d76a410", "tag": "2edce355-2eeb-46eb-af8e-5a803adc036a"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:16.857679 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3378/6520] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:15 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1392 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:16.862344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-fd94874b-f58f-4ef2-b206-2cfd5a72e914 req-73c28d23-abf0-4f87-8dd5-cbab6fc1b349 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:16.871536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6ad52b1d-94a7-4e61-9ea5-a35424c60638 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:16.872179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6ad52b1d-94a7-4e61-9ea5-a35424c60638 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:16.876556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-fd94874b-f58f-4ef2-b206-2cfd5a72e914 req-73c28d23-abf0-4f87-8dd5-cbab6fc1b349 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:16.878113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-fd94874b-f58f-4ef2-b206-2cfd5a72e914 req-73c28d23-abf0-4f87-8dd5-cbab6fc1b349 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:16.892623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ad52b1d-94a7-4e61-9ea5-a35424c60638 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:16.893135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ad52b1d-94a7-4e61-9ea5-a35424c60638 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:16.893600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ad52b1d-94a7-4e61-9ea5-a35424c60638 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:16.895097 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-fd94874b-f58f-4ef2-b206-2cfd5a72e914 req-73c28d23-abf0-4f87-8dd5-cbab6fc1b349 service nova] Creating event network-changed:2edce355-2eeb-46eb-af8e-5a803adc036a for instance 3984ece4-66ac-4c11-b414-0c1f4d76a410 on n-h2-862964-3 Oct 29 01:42:16.896023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ad52b1d-94a7-4e61-9ea5-a35424c60638 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:16.900100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ad52b1d-94a7-4e61-9ea5-a35424c60638 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:16.901052 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-fd94874b-f58f-4ef2-b206-2cfd5a72e914 req-73c28d23-abf0-4f87-8dd5-cbab6fc1b349 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068023 Oct 29 01:42:16.901882 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3143/6521] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:16.902012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6ad52b1d-94a7-4e61-9ea5-a35424c60638 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:17.392708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6ad52b1d-94a7-4e61-9ea5-a35424c60638 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:17.409488 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6ad52b1d-94a7-4e61-9ea5-a35424c60638 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 200 len: 1669 microversion: 2.1 time: 0.547702 Oct 29 01:42:17.409488 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3379/6522] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:16 2022] GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 1669 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:17.733976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-2d8b9dc8-7bf6-4b18-a454-84103b58f7aa req-c8f4bb11-ebd1-468a-80c2-4fa96093cd24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7235711a-0845-4384-8655-1e95349a5c06", "name": "network-vif-deleted", "tag": "8eac01f3-d247-4549-82a0-75e0364fa3e0"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:17.830125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2d8b9dc8-7bf6-4b18-a454-84103b58f7aa req-c8f4bb11-ebd1-468a-80c2-4fa96093cd24 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:17.830125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2d8b9dc8-7bf6-4b18-a454-84103b58f7aa req-c8f4bb11-ebd1-468a-80c2-4fa96093cd24 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:17.839096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2d8b9dc8-7bf6-4b18-a454-84103b58f7aa req-c8f4bb11-ebd1-468a-80c2-4fa96093cd24 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:17.866286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-09c972d1-8812-426b-a931-df6d690c25e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:17.873325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-09c972d1-8812-426b-a931-df6d690c25e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:17.997292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09c972d1-8812-426b-a931-df6d690c25e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:18.004396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09c972d1-8812-426b-a931-df6d690c25e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:18.013685 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-2d8b9dc8-7bf6-4b18-a454-84103b58f7aa req-c8f4bb11-ebd1-468a-80c2-4fa96093cd24 service nova] Creating event network-vif-deleted:8eac01f3-d247-4549-82a0-75e0364fa3e0 for instance 7235711a-0845-4384-8655-1e95349a5c06 on n-h1-862964-3 Oct 29 01:42:18.014107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09c972d1-8812-426b-a931-df6d690c25e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:18.016984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09c972d1-8812-426b-a931-df6d690c25e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:18.018832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09c972d1-8812-426b-a931-df6d690c25e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:18.021057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-09c972d1-8812-426b-a931-df6d690c25e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:18.030001 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-2d8b9dc8-7bf6-4b18-a454-84103b58f7aa req-c8f4bb11-ebd1-468a-80c2-4fa96093cd24 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.322770 Oct 29 01:42:18.035247 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3144/6523] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:18.087362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-17b64538-eaa1-4177-948c-6d8105ca969a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:18.111234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-17b64538-eaa1-4177-948c-6d8105ca969a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:18.131538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17b64538-eaa1-4177-948c-6d8105ca969a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:18.133735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17b64538-eaa1-4177-948c-6d8105ca969a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:18.134989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17b64538-eaa1-4177-948c-6d8105ca969a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:18.137631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17b64538-eaa1-4177-948c-6d8105ca969a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:18.138142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17b64538-eaa1-4177-948c-6d8105ca969a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:18.141410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17b64538-eaa1-4177-948c-6d8105ca969a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:18.552377 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=10 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:42:18.648575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-17b64538-eaa1-4177-948c-6d8105ca969a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:18.664951 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-17b64538-eaa1-4177-948c-6d8105ca969a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1392 microversion: 2.1 time: 0.627155 Oct 29 01:42:18.665588 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3145/6524] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:18 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1392 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:18.677401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b7cf7e45-0ec9-4f64-ba71-f27ee3a12128 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:18.680279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b7cf7e45-0ec9-4f64-ba71-f27ee3a12128 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:18.693935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7cf7e45-0ec9-4f64-ba71-f27ee3a12128 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:18.694628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7cf7e45-0ec9-4f64-ba71-f27ee3a12128 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:18.695231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7cf7e45-0ec9-4f64-ba71-f27ee3a12128 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:18.696102 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7cf7e45-0ec9-4f64-ba71-f27ee3a12128 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:18.696824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7cf7e45-0ec9-4f64-ba71-f27ee3a12128 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:18.697913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7cf7e45-0ec9-4f64-ba71-f27ee3a12128 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:18.712296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-09c972d1-8812-426b-a931-df6d690c25e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:18.723187 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-09c972d1-8812-426b-a931-df6d690c25e3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1353 microversion: 2.1 time: 0.867092 Oct 29 01:42:18.723784 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3380/6525] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:17 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1353 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:18.747081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6a46a5fc-631b-4046-8d40-248f07930e6c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:18.747722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6a46a5fc-631b-4046-8d40-248f07930e6c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:18.772743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a46a5fc-631b-4046-8d40-248f07930e6c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:18.773283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a46a5fc-631b-4046-8d40-248f07930e6c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:18.773731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a46a5fc-631b-4046-8d40-248f07930e6c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:18.774460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a46a5fc-631b-4046-8d40-248f07930e6c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:18.774926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a46a5fc-631b-4046-8d40-248f07930e6c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:18.775353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a46a5fc-631b-4046-8d40-248f07930e6c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:18.967575 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6a46a5fc-631b-4046-8d40-248f07930e6c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:18.991769 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6a46a5fc-631b-4046-8d40-248f07930e6c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 200 len: 1602 microversion: 2.1 time: 0.262058 Oct 29 01:42:18.996147 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3381/6526] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:18 2022] GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 1602 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:19.023287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b7cf7e45-0ec9-4f64-ba71-f27ee3a12128 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:19.035398 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b7cf7e45-0ec9-4f64-ba71-f27ee3a12128 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.367864 Oct 29 01:42:19.038150 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3146/6527] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:18 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:19.068910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6f28ee83-4c05-41dc-8f2c-01c99be25c04 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:19.069336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6f28ee83-4c05-41dc-8f2c-01c99be25c04 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:19.087534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f28ee83-4c05-41dc-8f2c-01c99be25c04 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:19.088227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f28ee83-4c05-41dc-8f2c-01c99be25c04 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:19.089597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f28ee83-4c05-41dc-8f2c-01c99be25c04 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:19.090340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f28ee83-4c05-41dc-8f2c-01c99be25c04 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:19.094186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f28ee83-4c05-41dc-8f2c-01c99be25c04 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:19.094708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f28ee83-4c05-41dc-8f2c-01c99be25c04 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:19.384693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6f28ee83-4c05-41dc-8f2c-01c99be25c04 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:19.409434 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6f28ee83-4c05-41dc-8f2c-01c99be25c04 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.345098 Oct 29 01:42:19.409434 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3382/6528] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:19 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:19.442672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-85de6a65-1be9-4490-ab5f-e96c9f240a52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:19.446551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-85de6a65-1be9-4490-ab5f-e96c9f240a52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:19.458505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-85de6a65-1be9-4490-ab5f-e96c9f240a52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:19.459001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-85de6a65-1be9-4490-ab5f-e96c9f240a52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:19.459455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-85de6a65-1be9-4490-ab5f-e96c9f240a52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:19.469270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-85de6a65-1be9-4490-ab5f-e96c9f240a52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:19.469855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-85de6a65-1be9-4490-ab5f-e96c9f240a52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:19.471121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-85de6a65-1be9-4490-ab5f-e96c9f240a52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:19.691951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d0ce5d52-712d-4cf9-81f5-881e15c4c38e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:19.692955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d0ce5d52-712d-4cf9-81f5-881e15c4c38e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:19.709762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0ce5d52-712d-4cf9-81f5-881e15c4c38e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:19.714202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0ce5d52-712d-4cf9-81f5-881e15c4c38e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:19.716144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0ce5d52-712d-4cf9-81f5-881e15c4c38e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:19.720038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0ce5d52-712d-4cf9-81f5-881e15c4c38e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:19.720818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0ce5d52-712d-4cf9-81f5-881e15c4c38e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:19.723407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0ce5d52-712d-4cf9-81f5-881e15c4c38e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:19.785196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-85de6a65-1be9-4490-ab5f-e96c9f240a52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:19.799605 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-85de6a65-1be9-4490-ab5f-e96c9f240a52 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.369353 Oct 29 01:42:19.823528 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3147/6529] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:19 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:19.837262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a217d7bf-e6c6-4818-b4d2-b95856f9cad1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:19.842215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a217d7bf-e6c6-4818-b4d2-b95856f9cad1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:19.855122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a217d7bf-e6c6-4818-b4d2-b95856f9cad1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:19.859034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a217d7bf-e6c6-4818-b4d2-b95856f9cad1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:19.860799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a217d7bf-e6c6-4818-b4d2-b95856f9cad1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:19.868436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a217d7bf-e6c6-4818-b4d2-b95856f9cad1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:19.870502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a217d7bf-e6c6-4818-b4d2-b95856f9cad1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:19.871732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a217d7bf-e6c6-4818-b4d2-b95856f9cad1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:20.080551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a217d7bf-e6c6-4818-b4d2-b95856f9cad1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:20.091807 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a217d7bf-e6c6-4818-b4d2-b95856f9cad1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1186 microversion: 2.1 time: 0.266845 Oct 29 01:42:20.107543 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3148/6530] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:19 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1186 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:20.107543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b1ef0f64-b9bf-49f1-94dc-742fd4e5a4f2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:20.107543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b1ef0f64-b9bf-49f1-94dc-742fd4e5a4f2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:20.116494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1ef0f64-b9bf-49f1-94dc-742fd4e5a4f2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:20.122647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1ef0f64-b9bf-49f1-94dc-742fd4e5a4f2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:20.122647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1ef0f64-b9bf-49f1-94dc-742fd4e5a4f2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:20.122647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1ef0f64-b9bf-49f1-94dc-742fd4e5a4f2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:20.122989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1ef0f64-b9bf-49f1-94dc-742fd4e5a4f2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:20.123936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b1ef0f64-b9bf-49f1-94dc-742fd4e5a4f2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:20.342450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d0ce5d52-712d-4cf9-81f5-881e15c4c38e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:20.357393 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d0ce5d52-712d-4cf9-81f5-881e15c4c38e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1392 microversion: 2.1 time: 0.667825 Oct 29 01:42:20.361564 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3383/6531] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:19 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1392 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:20.370763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3e6670f2-bf4f-4612-803d-3d4d54a7d778 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:20.371659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3e6670f2-bf4f-4612-803d-3d4d54a7d778 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:20.385749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e6670f2-bf4f-4612-803d-3d4d54a7d778 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:20.391802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e6670f2-bf4f-4612-803d-3d4d54a7d778 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:20.392684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e6670f2-bf4f-4612-803d-3d4d54a7d778 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:20.393875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e6670f2-bf4f-4612-803d-3d4d54a7d778 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:20.394531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e6670f2-bf4f-4612-803d-3d4d54a7d778 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:20.395349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e6670f2-bf4f-4612-803d-3d4d54a7d778 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:20.580071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3e6670f2-bf4f-4612-803d-3d4d54a7d778 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:20.596889 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3e6670f2-bf4f-4612-803d-3d4d54a7d778 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 200 len: 1332 microversion: 2.1 time: 0.233907 Oct 29 01:42:20.597785 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3384/6532] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:20 2022] GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 1332 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:20.686932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b1ef0f64-b9bf-49f1-94dc-742fd4e5a4f2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:20.696333 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b1ef0f64-b9bf-49f1-94dc-742fd4e5a4f2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.602059 Oct 29 01:42:20.700479 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3149/6533] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:20 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:20.707491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-2b8ceeec-06de-492f-bce3-e56c8497f26d req-f682868a-f1f2-46e2-80af-8e9382a4bacb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dbc4be2-8396-4d8f-9f31-7cf1423bf145", "name": "network-vif-deleted", "tag": "25d49c2a-24b7-4c5a-8b70-8bb410658a2f"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:20.734971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2b8ceeec-06de-492f-bce3-e56c8497f26d req-f682868a-f1f2-46e2-80af-8e9382a4bacb service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:20.735859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2b8ceeec-06de-492f-bce3-e56c8497f26d req-f682868a-f1f2-46e2-80af-8e9382a4bacb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:20.736516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2b8ceeec-06de-492f-bce3-e56c8497f26d req-f682868a-f1f2-46e2-80af-8e9382a4bacb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:20.767312 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-2b8ceeec-06de-492f-bce3-e56c8497f26d req-f682868a-f1f2-46e2-80af-8e9382a4bacb service nova] Creating event network-vif-deleted:25d49c2a-24b7-4c5a-8b70-8bb410658a2f for instance 4dbc4be2-8396-4d8f-9f31-7cf1423bf145 on n-h2-862964-3 Oct 29 01:42:20.780005 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-2b8ceeec-06de-492f-bce3-e56c8497f26d req-f682868a-f1f2-46e2-80af-8e9382a4bacb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076412 Oct 29 01:42:20.781790 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3150/6534] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:20.909552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3871116a-01d8-4753-afe4-99ca97e7690d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1112356030", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "8568990a-4f98-461a-8f32-e20720daa4e5"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:21.002795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-3871116a-01d8-4753-afe4-99ca97e7690d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] validate_networks() for [('8568990a-4f98-461a-8f32-e20720daa4e5', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:42:21.063028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c2d704c2-c57a-4d56-84c8-b985988c5e71 tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] Action: 'create', calling method: .version_select at 0x7f9d9661b790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-633140001", "metadata": {"Type": "work"}}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:22.008385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3871116a-01d8-4753-afe4-99ca97e7690d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:42:22.008916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3871116a-01d8-4753-afe4-99ca97e7690d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:42:22.009302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3871116a-01d8-4753-afe4-99ca97e7690d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:42:22.009755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3871116a-01d8-4753-afe4-99ca97e7690d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:42:22.010383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-3871116a-01d8-4753-afe4-99ca97e7690d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:42:22.023750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3871116a-01d8-4753-afe4-99ca97e7690d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:22.038049 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c2d704c2-c57a-4d56-84c8-b985988c5e71 tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.438880 Oct 29 01:42:22.038592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3871116a-01d8-4753-afe4-99ca97e7690d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:22.039016 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3385/6535] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 29 01:42:20 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1440 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 29 01:42:22.039213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3871116a-01d8-4753-afe4-99ca97e7690d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:22.042235 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3871116a-01d8-4753-afe4-99ca97e7690d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:22.042848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3871116a-01d8-4753-afe4-99ca97e7690d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:22.043294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3871116a-01d8-4753-afe4-99ca97e7690d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:22.043662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b6f9d28c-e464-4d11-b38d-59c15affef0a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:22.044276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b6f9d28c-e464-4d11-b38d-59c15affef0a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:22.058923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6f9d28c-e464-4d11-b38d-59c15affef0a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:22.060267 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6f9d28c-e464-4d11-b38d-59c15affef0a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:22.060763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6f9d28c-e464-4d11-b38d-59c15affef0a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:22.061995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6f9d28c-e464-4d11-b38d-59c15affef0a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:22.062667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6f9d28c-e464-4d11-b38d-59c15affef0a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:22.063364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6f9d28c-e464-4d11-b38d-59c15affef0a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:22.067163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:42:22.093097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-3871116a-01d8-4753-afe4-99ca97e7690d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Getting quotas for project 238c2e0d9e0b48198767a357cff1a442. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:42:22.103755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-3871116a-01d8-4753-afe4-99ca97e7690d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Getting quotas for user 9c097ba205f6453ba793dfb1d1876f3e and project 238c2e0d9e0b48198767a357cff1a442. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:42:22.141809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b6f9d28c-e464-4d11-b38d-59c15affef0a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:22.147295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3871116a-01d8-4753-afe4-99ca97e7690d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:42:22.152471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3871116a-01d8-4753-afe4-99ca97e7690d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:42:22.153707 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b6f9d28c-e464-4d11-b38d-59c15affef0a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1186 microversion: 2.1 time: 0.112051 Oct 29 01:42:22.154792 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3386/6536] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:22 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1186 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:22.174138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a904a445-21c3-4f0b-8ae0-ee8516e1ba6b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:22.175685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a904a445-21c3-4f0b-8ae0-ee8516e1ba6b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:22.190761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a904a445-21c3-4f0b-8ae0-ee8516e1ba6b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:22.191734 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a904a445-21c3-4f0b-8ae0-ee8516e1ba6b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:22.194870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a904a445-21c3-4f0b-8ae0-ee8516e1ba6b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:22.198118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a904a445-21c3-4f0b-8ae0-ee8516e1ba6b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:22.198118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a904a445-21c3-4f0b-8ae0-ee8516e1ba6b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:22.198118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a904a445-21c3-4f0b-8ae0-ee8516e1ba6b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:22.313015 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3871116a-01d8-4753-afe4-99ca97e7690d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.410532 Oct 29 01:42:22.316829 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3151/6537] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:42:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:42:22.329079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ace93c17-d419-4c05-a1b2-29dd352ce8fd tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-555048471", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "91a701ed-dfa3-4d69-83b9-0c3a112a1c91"}], "key_name": "tempest-TestSecurityGroupsBasicOps-848152334", "security_groups": []}, "os:scheduler_hints": {"different_host": ["93de6bc3-3869-4da6-aab7-800addd62dfe"]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:22.414449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-ace93c17-d419-4c05-a1b2-29dd352ce8fd tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] validate_networks() for [('91a701ed-dfa3-4d69-83b9-0c3a112a1c91', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:42:22.618785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a904a445-21c3-4f0b-8ae0-ee8516e1ba6b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:22.634549 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a904a445-21c3-4f0b-8ae0-ee8516e1ba6b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1392 microversion: 2.1 time: 0.477431 Oct 29 01:42:22.635887 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3387/6538] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:22 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1392 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:22.668829 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c66110d7-e10e-4109-b978-fe04bd07f5fc tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:22.670326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c66110d7-e10e-4109-b978-fe04bd07f5fc tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: 4dbc4be2-8396-4d8f-9f31-7cf1423bf145] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:22.695753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c66110d7-e10e-4109-b978-fe04bd07f5fc tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:22.698131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c66110d7-e10e-4109-b978-fe04bd07f5fc tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:22.700400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c66110d7-e10e-4109-b978-fe04bd07f5fc tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:22.701576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c66110d7-e10e-4109-b978-fe04bd07f5fc tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:22.702011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c66110d7-e10e-4109-b978-fe04bd07f5fc tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:22.707249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c66110d7-e10e-4109-b978-fe04bd07f5fc tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:22.753657 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-c66110d7-e10e-4109-b978-fe04bd07f5fc tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] HTTP exception thrown: Instance 4dbc4be2-8396-4d8f-9f31-7cf1423bf145 could not be found. Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c66110d7-e10e-4109-b978-fe04bd07f5fc tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Request method failure captured: Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 HTTP/1.1 Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIQsVu2mso_3kv_o0mGADjWM2Bg1UuEqJVFu774uKP2WdC0nr-Np0zE08G54LAEaqvux0Aas8l9DeXQZAAj7XDW-kDA8BmUR5dn2ryhzAECpHLeKUuKN3aTegfCoeWIUqIJV7FrqkONpr-52FX-UQZ_7rv3Eai6qrJuam-lgP5A58RY Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: e1817f6a3cd04ebbaa07dd63934d2771 Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-TestNetworkBasicOps-1986281729 Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1817f6a3cd04ebbaa07dd63934d2771"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e1817f6a3cd04ebbaa07dd63934d2771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1817f6a3cd04ebbaa07dd63934d2771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e1817f6a3cd04ebbaa07dd63934d2771", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-TestNetworkBasicOps-1986281729 Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: e1817f6a3cd04ebbaa07dd63934d2771 Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-TestNetworkBasicOps-1986281729 Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-TestNetworkBasicOps-1986281729-project Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: ab773592a5914fcda533047d8044c3dc Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-TestNetworkBasicOps-1986281729-project Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 4dbc4be2-8396-4d8f-9f31-7cf1423bf145 could not be found. Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '4dbc4be2-8396-4d8f-9f31-7cf1423bf145'} Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dbc4be2-8396-4d8f-9f31-7cf1423bf145 could not be found. Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dbc4be2-8396-4d8f-9f31-7cf1423bf145 could not be found. Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:22.760043 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:22.766342 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:22.766342 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:42:22.766342 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:42:22.766342 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:42:22.766342 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:42:22.766342 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dbc4be2-8396-4d8f-9f31-7cf1423bf145 could not be found. Oct 29 01:42:22.766342 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:22.769200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c66110d7-e10e-4109-b978-fe04bd07f5fc tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Returning 404 to user: Instance 4dbc4be2-8396-4d8f-9f31-7cf1423bf145 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:42:22.771205 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c66110d7-e10e-4109-b978-fe04bd07f5fc tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145" status: 404 len: 111 microversion: 2.1 time: 0.133438 Oct 29 01:42:22.773515 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3388/6539] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:22 2022] GET /compute/v2.1/servers/4dbc4be2-8396-4d8f-9f31-7cf1423bf145 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:42:22.779783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6cbde287-d856-4f3f-8652-53ffd3ec50bf tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] Calling method '.version_select at 0x7f9d965cb550>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:23.180049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ace93c17-d419-4c05-a1b2-29dd352ce8fd tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:42:23.180502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ace93c17-d419-4c05-a1b2-29dd352ce8fd tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:42:23.180942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ace93c17-d419-4c05-a1b2-29dd352ce8fd tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:42:23.181808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ace93c17-d419-4c05-a1b2-29dd352ce8fd tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:42:23.182425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-ace93c17-d419-4c05-a1b2-29dd352ce8fd tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:42:23.195452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ace93c17-d419-4c05-a1b2-29dd352ce8fd tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:23.196204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ace93c17-d419-4c05-a1b2-29dd352ce8fd tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:23.196819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ace93c17-d419-4c05-a1b2-29dd352ce8fd tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:23.197844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ace93c17-d419-4c05-a1b2-29dd352ce8fd tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:23.198760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ace93c17-d419-4c05-a1b2-29dd352ce8fd tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:23.199364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ace93c17-d419-4c05-a1b2-29dd352ce8fd tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:23.217701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:42:23.245694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-ace93c17-d419-4c05-a1b2-29dd352ce8fd tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Getting quotas for project 37a06b4f54f84e3ca1ec465f31dd0127. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:42:23.256680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-ace93c17-d419-4c05-a1b2-29dd352ce8fd tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Getting quotas for user 98c91d05f467479f84d12f272c522fbf and project 37a06b4f54f84e3ca1ec465f31dd0127. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:42:23.270635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ace93c17-d419-4c05-a1b2-29dd352ce8fd tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:42:23.272985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ace93c17-d419-4c05-a1b2-29dd352ce8fd tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:42:23.388215 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6cbde287-d856-4f3f-8652-53ffd3ec50bf tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9" status: 200 len: 352 microversion: 2.1 time: 0.613188 Oct 29 01:42:23.397600 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3389/6540] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:42:22 2022] GET /compute/v2.1/os-volumes/5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9 => generated 352 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:23.404237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7cafd90c-bb83-4f7e-8a4c-a2e9abb187c7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:23.405176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7cafd90c-bb83-4f7e-8a4c-a2e9abb187c7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:23.462053 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ace93c17-d419-4c05-a1b2-29dd352ce8fd tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.141079 Oct 29 01:42:23.464914 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3152/6541] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:42:22 2022] POST /compute/v2.1/servers => generated 361 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:42:23.477056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1097bc6d-544b-40df-8ce6-528006418a43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:23.478399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1097bc6d-544b-40df-8ce6-528006418a43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:23.506343 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1097bc6d-544b-40df-8ce6-528006418a43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:23.509895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1097bc6d-544b-40df-8ce6-528006418a43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:23.509895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1097bc6d-544b-40df-8ce6-528006418a43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:23.514250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1097bc6d-544b-40df-8ce6-528006418a43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:23.515547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1097bc6d-544b-40df-8ce6-528006418a43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:23.523321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1097bc6d-544b-40df-8ce6-528006418a43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:23.532455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7cafd90c-bb83-4f7e-8a4c-a2e9abb187c7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:23.581968 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7cafd90c-bb83-4f7e-8a4c-a2e9abb187c7 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1215 microversion: 2.1 time: 0.182052 Oct 29 01:42:23.586131 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3390/6542] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:23 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1215 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:23.599526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-72524f4b-6f7e-43d1-8553-a67c66e2144a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '.version_select at 0x7f9d96a21f70>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:23.700658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1097bc6d-544b-40df-8ce6-528006418a43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:23.710007 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1097bc6d-544b-40df-8ce6-528006418a43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1186 microversion: 2.1 time: 0.243443 Oct 29 01:42:23.713394 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3153/6543] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:23 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1186 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:23.722963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fda235b0-1464-4c14-b9a1-9403a37aa87d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:23.723586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fda235b0-1464-4c14-b9a1-9403a37aa87d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:23.796997 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-72524f4b-6f7e-43d1-8553-a67c66e2144a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-23884023" status: 202 len: 0 microversion: 2.1 time: 0.209273 Oct 29 01:42:23.798730 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3391/6544] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 29 01:42:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-23884023 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:42:23.813501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e502dee0-c5bf-43fe-a0fd-1fe23f7cae8b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:23.813501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e502dee0-c5bf-43fe-a0fd-1fe23f7cae8b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:23.814497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fda235b0-1464-4c14-b9a1-9403a37aa87d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:23.814598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e502dee0-c5bf-43fe-a0fd-1fe23f7cae8b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:23.814808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e502dee0-c5bf-43fe-a0fd-1fe23f7cae8b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:23.815454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e502dee0-c5bf-43fe-a0fd-1fe23f7cae8b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:23.816597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e502dee0-c5bf-43fe-a0fd-1fe23f7cae8b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:23.817251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e502dee0-c5bf-43fe-a0fd-1fe23f7cae8b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:23.817832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e502dee0-c5bf-43fe-a0fd-1fe23f7cae8b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:23.836125 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fda235b0-1464-4c14-b9a1-9403a37aa87d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1240 microversion: 2.1 time: 0.120953 Oct 29 01:42:23.836736 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3154/6545] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:23 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1240 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:24.036500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-811a191a-3e26-4d14-8cc9-3eebcd3c556e req-5a4a803c-0414-4051-b2d1-e3b6cc7930b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3984ece4-66ac-4c11-b414-0c1f4d76a410", "name": "network-vif-plugged", "status": "completed", "tag": "2edce355-2eeb-46eb-af8e-5a803adc036a"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:24.054041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-811a191a-3e26-4d14-8cc9-3eebcd3c556e req-5a4a803c-0414-4051-b2d1-e3b6cc7930b1 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:24.054774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-811a191a-3e26-4d14-8cc9-3eebcd3c556e req-5a4a803c-0414-4051-b2d1-e3b6cc7930b1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:24.055494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-811a191a-3e26-4d14-8cc9-3eebcd3c556e req-5a4a803c-0414-4051-b2d1-e3b6cc7930b1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:24.070792 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-811a191a-3e26-4d14-8cc9-3eebcd3c556e req-5a4a803c-0414-4051-b2d1-e3b6cc7930b1 service nova] Creating event network-vif-plugged:2edce355-2eeb-46eb-af8e-5a803adc036a for instance 3984ece4-66ac-4c11-b414-0c1f4d76a410 on n-h2-862964-3 Oct 29 01:42:24.078046 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-811a191a-3e26-4d14-8cc9-3eebcd3c556e req-5a4a803c-0414-4051-b2d1-e3b6cc7930b1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046257 Oct 29 01:42:24.079499 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3155/6546] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:42:24.407802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e2c0b082-ef56-4e7b-b2ad-60662ddd7c86 tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] Calling method '.version_select at 0x7f9d9fe5fc10>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:24.482387 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e2c0b082-ef56-4e7b-b2ad-60662ddd7c86 tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9" status: 200 len: 353 microversion: 2.1 time: 0.083855 Oct 29 01:42:24.482966 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3156/6547] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:42:24 2022] GET /compute/v2.1/os-volumes/5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:42:24.495839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ccb67aa8-18d5-4fa6-94f3-773f8db86030 tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] Calling method '.version_select at 0x7f9d9ffa0820>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:24.563331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e502dee0-c5bf-43fe-a0fd-1fe23f7cae8b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:24.574122 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e502dee0-c5bf-43fe-a0fd-1fe23f7cae8b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1392 microversion: 2.1 time: 0.774101 Oct 29 01:42:24.582725 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3392/6548] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:23 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1392 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:24.620780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6feea087-7e8d-485b-a86d-e59c37601d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:24.620780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6feea087-7e8d-485b-a86d-e59c37601d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:24.620780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6feea087-7e8d-485b-a86d-e59c37601d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:24.620780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6feea087-7e8d-485b-a86d-e59c37601d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:24.620780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6feea087-7e8d-485b-a86d-e59c37601d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:24.620780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6feea087-7e8d-485b-a86d-e59c37601d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:24.620780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6feea087-7e8d-485b-a86d-e59c37601d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:24.620780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6feea087-7e8d-485b-a86d-e59c37601d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:24.624585 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ccb67aa8-18d5-4fa6-94f3-773f8db86030 tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9" status: 200 len: 353 microversion: 2.1 time: 0.131935 Oct 29 01:42:24.632376 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3157/6549] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:42:24 2022] GET /compute/v2.1/os-volumes/5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9 => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:24.641414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-99bbcce4-cead-4e49-876e-c6b0a623032a tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] Calling method '.version_select at 0x7f9d9ff233a0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:24.758816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6feea087-7e8d-485b-a86d-e59c37601d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:24.769620 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6feea087-7e8d-485b-a86d-e59c37601d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1219 microversion: 2.1 time: 0.163945 Oct 29 01:42:24.770998 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3393/6550] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:24 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1219 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:42:24.786317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4b58c753-a120-4f4c-8e3e-53fc28e1900e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:24.790855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4b58c753-a120-4f4c-8e3e-53fc28e1900e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:24.803177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b58c753-a120-4f4c-8e3e-53fc28e1900e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:24.804075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b58c753-a120-4f4c-8e3e-53fc28e1900e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:24.804740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b58c753-a120-4f4c-8e3e-53fc28e1900e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:24.806686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b58c753-a120-4f4c-8e3e-53fc28e1900e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:24.807406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b58c753-a120-4f4c-8e3e-53fc28e1900e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:24.808076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b58c753-a120-4f4c-8e3e-53fc28e1900e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:24.905381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4b58c753-a120-4f4c-8e3e-53fc28e1900e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:24.910744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:42:24.923630 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4b58c753-a120-4f4c-8e3e-53fc28e1900e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1186 microversion: 2.1 time: 0.147462 Oct 29 01:42:24.931406 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3394/6551] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:24 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1186 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:24.936729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5154ec68-87b7-4968-97b5-0fa743785bab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:24.937398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5154ec68-87b7-4968-97b5-0fa743785bab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:24.946053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5154ec68-87b7-4968-97b5-0fa743785bab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:24.948872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5154ec68-87b7-4968-97b5-0fa743785bab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:24.949689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5154ec68-87b7-4968-97b5-0fa743785bab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:24.950817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5154ec68-87b7-4968-97b5-0fa743785bab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:24.951491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5154ec68-87b7-4968-97b5-0fa743785bab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:24.952705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5154ec68-87b7-4968-97b5-0fa743785bab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:25.079409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5154ec68-87b7-4968-97b5-0fa743785bab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:25.091309 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5154ec68-87b7-4968-97b5-0fa743785bab tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1244 microversion: 2.1 time: 0.164957 Oct 29 01:42:25.091933 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3395/6552] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:24 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1244 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:25.610888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-277cdaff-5c07-4256-8892-83210ff5cf0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:25.612844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-277cdaff-5c07-4256-8892-83210ff5cf0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:25.628515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-277cdaff-5c07-4256-8892-83210ff5cf0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:25.629736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-277cdaff-5c07-4256-8892-83210ff5cf0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:25.631101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-277cdaff-5c07-4256-8892-83210ff5cf0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:25.632369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-277cdaff-5c07-4256-8892-83210ff5cf0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:25.633642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-277cdaff-5c07-4256-8892-83210ff5cf0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:25.636460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-277cdaff-5c07-4256-8892-83210ff5cf0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:25.898924 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-99bbcce4-cead-4e49-876e-c6b0a623032a tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9" status: 202 len: 0 microversion: 2.1 time: 1.257155 Oct 29 01:42:25.898924 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3158/6553] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 29 01:42:24 2022] DELETE /compute/v2.1/os-volumes/5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9 => generated 0 bytes in 1258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:42:25.903434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-93fdc203-22b2-43ae-a534-1365ec0c572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:25.904255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-93fdc203-22b2-43ae-a534-1365ec0c572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:25.916280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93fdc203-22b2-43ae-a534-1365ec0c572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:25.916783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93fdc203-22b2-43ae-a534-1365ec0c572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:25.917248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93fdc203-22b2-43ae-a534-1365ec0c572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:25.918308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93fdc203-22b2-43ae-a534-1365ec0c572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:25.918962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93fdc203-22b2-43ae-a534-1365ec0c572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:25.919586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-93fdc203-22b2-43ae-a534-1365ec0c572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:26.050386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-277cdaff-5c07-4256-8892-83210ff5cf0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:26.061145 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-277cdaff-5c07-4256-8892-83210ff5cf0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1392 microversion: 2.1 time: 0.457693 Oct 29 01:42:26.062308 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3396/6554] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:25 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1392 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:26.067841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-93fdc203-22b2-43ae-a534-1365ec0c572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:26.069242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-914a05b2-5598-40de-8774-d77ed4712602 tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] Calling method '.version_select at 0x7f9d966a4af0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:26.077717 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-93fdc203-22b2-43ae-a534-1365ec0c572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1267 microversion: 2.1 time: 0.181635 Oct 29 01:42:26.097942 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3159/6555] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:25 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:26.105824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2a587bb5-3ad2-4a4a-af61-ea9aaf5ce71c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:26.141714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2a587bb5-3ad2-4a4a-af61-ea9aaf5ce71c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:26.148920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a587bb5-3ad2-4a4a-af61-ea9aaf5ce71c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:26.150184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a587bb5-3ad2-4a4a-af61-ea9aaf5ce71c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:26.164645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a587bb5-3ad2-4a4a-af61-ea9aaf5ce71c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:26.182076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a587bb5-3ad2-4a4a-af61-ea9aaf5ce71c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:26.182076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a587bb5-3ad2-4a4a-af61-ea9aaf5ce71c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:26.182076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a587bb5-3ad2-4a4a-af61-ea9aaf5ce71c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:26.241538 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-914a05b2-5598-40de-8774-d77ed4712602 tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9" status: 200 len: 352 microversion: 2.1 time: 0.177804 Oct 29 01:42:26.246437 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3397/6556] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:42:26 2022] GET /compute/v2.1/os-volumes/5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9 => generated 352 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:26.254941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4b098cdd-f320-4e75-89d2-69fd6796472b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:26.256750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4b098cdd-f320-4e75-89d2-69fd6796472b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:26.274728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a587bb5-3ad2-4a4a-af61-ea9aaf5ce71c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:26.277422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a587bb5-3ad2-4a4a-af61-ea9aaf5ce71c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:26.279342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2a587bb5-3ad2-4a4a-af61-ea9aaf5ce71c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:26.284402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-2a587bb5-3ad2-4a4a-af61-ea9aaf5ce71c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lazy-loading 'fault' on Instance uuid 7235711a-0845-4384-8655-1e95349a5c06 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:42:26.299221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b098cdd-f320-4e75-89d2-69fd6796472b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:26.300906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b098cdd-f320-4e75-89d2-69fd6796472b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:26.302551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b098cdd-f320-4e75-89d2-69fd6796472b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:26.305253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b098cdd-f320-4e75-89d2-69fd6796472b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:26.305795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b098cdd-f320-4e75-89d2-69fd6796472b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:26.306238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b098cdd-f320-4e75-89d2-69fd6796472b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:26.426169 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2a587bb5-3ad2-4a4a-af61-ea9aaf5ce71c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:26.445321 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2a587bb5-3ad2-4a4a-af61-ea9aaf5ce71c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 200 len: 1191 microversion: 2.1 time: 0.338020 Oct 29 01:42:26.466094 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3160/6557] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:26 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 1191 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:26.488991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4b098cdd-f320-4e75-89d2-69fd6796472b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:26.502119 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4b098cdd-f320-4e75-89d2-69fd6796472b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1236 microversion: 2.1 time: 0.258414 Oct 29 01:42:26.505250 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3398/6558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:26 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1236 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:27.090865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-557adf6b-95f6-47f7-b0be-943082c63053 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:27.091560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-557adf6b-95f6-47f7-b0be-943082c63053 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:27.111496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f62e9b8c-ce7e-4148-bf0c-1f47b33bb2f1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:27.114761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f62e9b8c-ce7e-4148-bf0c-1f47b33bb2f1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:27.117817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:42:27.122895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-557adf6b-95f6-47f7-b0be-943082c63053 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:27.125649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-557adf6b-95f6-47f7-b0be-943082c63053 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:27.132494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-557adf6b-95f6-47f7-b0be-943082c63053 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:27.133545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-557adf6b-95f6-47f7-b0be-943082c63053 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:27.135292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f62e9b8c-ce7e-4148-bf0c-1f47b33bb2f1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:27.136515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-557adf6b-95f6-47f7-b0be-943082c63053 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:27.142105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-557adf6b-95f6-47f7-b0be-943082c63053 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:27.143706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f62e9b8c-ce7e-4148-bf0c-1f47b33bb2f1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:27.145974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f62e9b8c-ce7e-4148-bf0c-1f47b33bb2f1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:27.147052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f62e9b8c-ce7e-4148-bf0c-1f47b33bb2f1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:27.149297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f62e9b8c-ce7e-4148-bf0c-1f47b33bb2f1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:27.149905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f62e9b8c-ce7e-4148-bf0c-1f47b33bb2f1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:27.388950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f62e9b8c-ce7e-4148-bf0c-1f47b33bb2f1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:27.401092 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f62e9b8c-ce7e-4148-bf0c-1f47b33bb2f1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1275 microversion: 2.1 time: 0.294725 Oct 29 01:42:27.420713 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3399/6559] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:27 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1275 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:27.427258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fbd96812-e7f8-4f3c-8d75-cdeff8fa2284 tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] Calling method '.version_select at 0x7f9d96a03820>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:27.524045 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fbd96812-e7f8-4f3c-8d75-cdeff8fa2284 tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9" status: 200 len: 352 microversion: 2.1 time: 0.109060 Oct 29 01:42:27.532114 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3400/6560] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:42:27 2022] GET /compute/v2.1/os-volumes/5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9 => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:27.539850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7d75ca58-1de3-4d75-8d31-e36233f49f25 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:27.541685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7d75ca58-1de3-4d75-8d31-e36233f49f25 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 7235711a-0845-4384-8655-1e95349a5c06] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:27.588750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d75ca58-1de3-4d75-8d31-e36233f49f25 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:27.589697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d75ca58-1de3-4d75-8d31-e36233f49f25 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:27.593561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d75ca58-1de3-4d75-8d31-e36233f49f25 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:27.594689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d75ca58-1de3-4d75-8d31-e36233f49f25 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:27.597240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d75ca58-1de3-4d75-8d31-e36233f49f25 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:27.600049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7d75ca58-1de3-4d75-8d31-e36233f49f25 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:27.639852 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-7d75ca58-1de3-4d75-8d31-e36233f49f25 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] HTTP exception thrown: Instance 7235711a-0845-4384-8655-1e95349a5c06 could not be found. Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7d75ca58-1de3-4d75-8d31-e36233f49f25 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Request method failure captured: Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 HTTP/1.1 Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXISL1fYm1j7NXik3zsNtroj_Oy-crTrvQAeW5M-FwwtP3LsKgHXpuppTsI04rMuajP4UZsmStYeX1aQyWE5BokToP2AX7pO99qAjgwqGhP0Pb1MuaH07JyrTdqaWdL6Co3a2Gha0Gb4NOVY73erVtuC0neHUxTJ51YCufPzngi0azyM Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37416a9397fa4c6dbd0bfe8dee191577", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-TestVolumeBootPattern-743321222 Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8b8f36d10fa340f784581a3cf9a15606 Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 7235711a-0845-4384-8655-1e95349a5c06 could not be found. Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '7235711a-0845-4384-8655-1e95349a5c06'} Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7235711a-0845-4384-8655-1e95349a5c06 could not be found. Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7235711a-0845-4384-8655-1e95349a5c06 could not be found. Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:27.641629 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:27.649247 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:27.649247 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:42:27.649247 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:42:27.649247 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:42:27.649247 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:42:27.649247 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7235711a-0845-4384-8655-1e95349a5c06 could not be found. Oct 29 01:42:27.649247 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:27.649247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7d75ca58-1de3-4d75-8d31-e36233f49f25 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Returning 404 to user: Instance 7235711a-0845-4384-8655-1e95349a5c06 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:42:27.649247 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7d75ca58-1de3-4d75-8d31-e36233f49f25 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06" status: 404 len: 111 microversion: 2.1 time: 0.108970 Oct 29 01:42:27.657547 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3401/6561] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:27 2022] GET /compute/v2.1/servers/7235711a-0845-4384-8655-1e95349a5c06 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:42:27.699778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d0c6346f-d8e8-4511-9c1a-f2f82824bf58 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:27.700422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d0c6346f-d8e8-4511-9c1a-f2f82824bf58 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:27.726656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0c6346f-d8e8-4511-9c1a-f2f82824bf58 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:27.727309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0c6346f-d8e8-4511-9c1a-f2f82824bf58 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:27.730176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0c6346f-d8e8-4511-9c1a-f2f82824bf58 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:27.731069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0c6346f-d8e8-4511-9c1a-f2f82824bf58 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:27.731648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0c6346f-d8e8-4511-9c1a-f2f82824bf58 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:27.734278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d0c6346f-d8e8-4511-9c1a-f2f82824bf58 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:27.801034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-557adf6b-95f6-47f7-b0be-943082c63053 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:27.831520 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-557adf6b-95f6-47f7-b0be-943082c63053 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1564 microversion: 2.1 time: 0.731923 Oct 29 01:42:27.849322 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3161/6562] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:27 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1564 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:27.859351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-80fbab4a-9c14-4036-9ac5-ad344212de54 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:27.863787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-80fbab4a-9c14-4036-9ac5-ad344212de54 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:27.890915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80fbab4a-9c14-4036-9ac5-ad344212de54 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:27.891718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80fbab4a-9c14-4036-9ac5-ad344212de54 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:27.892470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80fbab4a-9c14-4036-9ac5-ad344212de54 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:27.893669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80fbab4a-9c14-4036-9ac5-ad344212de54 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:27.894315 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80fbab4a-9c14-4036-9ac5-ad344212de54 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:27.894911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-80fbab4a-9c14-4036-9ac5-ad344212de54 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:28.038358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d0c6346f-d8e8-4511-9c1a-f2f82824bf58 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:28.096670 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d0c6346f-d8e8-4511-9c1a-f2f82824bf58 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1300 microversion: 2.1 time: 0.424383 Oct 29 01:42:28.114663 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3402/6563] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:27 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1300 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:28.333398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-80fbab4a-9c14-4036-9ac5-ad344212de54 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:28.343237 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-80fbab4a-9c14-4036-9ac5-ad344212de54 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1564 microversion: 2.1 time: 0.488443 Oct 29 01:42:28.359725 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3162/6564] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:27 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1564 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:28.429169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ccd2fb7e-be4c-4596-bafe-a526f11eed84 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:28.429772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ccd2fb7e-be4c-4596-bafe-a526f11eed84 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:28.443211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccd2fb7e-be4c-4596-bafe-a526f11eed84 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:28.448484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccd2fb7e-be4c-4596-bafe-a526f11eed84 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:28.448484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccd2fb7e-be4c-4596-bafe-a526f11eed84 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:28.448484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccd2fb7e-be4c-4596-bafe-a526f11eed84 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:28.448484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccd2fb7e-be4c-4596-bafe-a526f11eed84 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:28.448484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ccd2fb7e-be4c-4596-bafe-a526f11eed84 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:28.542906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-385ad73b-4981-4fd2-bfa7-ceca89609706 tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] Calling method '.version_select at 0x7f9d970fe700>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:28.600131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ccd2fb7e-be4c-4596-bafe-a526f11eed84 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:28.615556 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ccd2fb7e-be4c-4596-bafe-a526f11eed84 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1273 microversion: 2.1 time: 0.190796 Oct 29 01:42:28.634429 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3403/6565] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:28 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1273 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:28.734930 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-385ad73b-4981-4fd2-bfa7-ceca89609706 tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9" status: 200 len: 352 microversion: 2.1 time: 0.199587 Oct 29 01:42:28.735516 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3163/6566] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:42:28 2022] GET /compute/v2.1/os-volumes/5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9 => generated 352 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:42:29.130309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-60453f60-2278-4c52-bcde-dab494b6fbc1 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:29.130973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-60453f60-2278-4c52-bcde-dab494b6fbc1 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:29.143559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60453f60-2278-4c52-bcde-dab494b6fbc1 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:29.144066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60453f60-2278-4c52-bcde-dab494b6fbc1 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:29.144511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60453f60-2278-4c52-bcde-dab494b6fbc1 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:29.145560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60453f60-2278-4c52-bcde-dab494b6fbc1 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:29.146249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60453f60-2278-4c52-bcde-dab494b6fbc1 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:29.147833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60453f60-2278-4c52-bcde-dab494b6fbc1 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:29.308747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-60453f60-2278-4c52-bcde-dab494b6fbc1 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:29.321345 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-60453f60-2278-4c52-bcde-dab494b6fbc1 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1298 microversion: 2.1 time: 0.195357 Oct 29 01:42:29.335786 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3404/6567] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:29 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1298 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:29.645639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9416958e-5c86-4af5-a716-efabf68f1da2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:29.646261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9416958e-5c86-4af5-a716-efabf68f1da2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:29.666649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9416958e-5c86-4af5-a716-efabf68f1da2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:29.666649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9416958e-5c86-4af5-a716-efabf68f1da2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:29.666649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9416958e-5c86-4af5-a716-efabf68f1da2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:29.666649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9416958e-5c86-4af5-a716-efabf68f1da2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:29.666649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9416958e-5c86-4af5-a716-efabf68f1da2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:29.666649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9416958e-5c86-4af5-a716-efabf68f1da2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:29.749588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-84b80db5-0a90-4f06-8c99-cf1d00ba8579 tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] Calling method '.version_select at 0x7f9d965cbca0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:29.860989 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-84b80db5-0a90-4f06-8c99-cf1d00ba8579 tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9" status: 200 len: 352 microversion: 2.1 time: 0.115776 Oct 29 01:42:29.868728 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3405/6568] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:42:29 2022] GET /compute/v2.1/os-volumes/5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9 => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:42:30.311259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9416958e-5c86-4af5-a716-efabf68f1da2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:30.334354 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9416958e-5c86-4af5-a716-efabf68f1da2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1315 microversion: 2.1 time: 0.689436 Oct 29 01:42:30.339474 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3164/6569] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:29 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1315 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:30.357714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5983d9b8-4560-4b50-a35e-1d1c985e31b9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:30.358611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5983d9b8-4560-4b50-a35e-1d1c985e31b9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:30.389423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5983d9b8-4560-4b50-a35e-1d1c985e31b9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:30.390989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5983d9b8-4560-4b50-a35e-1d1c985e31b9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:30.390989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5983d9b8-4560-4b50-a35e-1d1c985e31b9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:30.391769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5983d9b8-4560-4b50-a35e-1d1c985e31b9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:30.392242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5983d9b8-4560-4b50-a35e-1d1c985e31b9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:30.392681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5983d9b8-4560-4b50-a35e-1d1c985e31b9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:30.637681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5983d9b8-4560-4b50-a35e-1d1c985e31b9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:30.654016 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5983d9b8-4560-4b50-a35e-1d1c985e31b9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1298 microversion: 2.1 time: 0.300625 Oct 29 01:42:30.654997 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3406/6570] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:30 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1298 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:30.890912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-49520d2b-7a34-42be-8727-f2dd1e4c0cc6 tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] Calling method '.version_select at 0x7f9d96a6bf70>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:30.958672 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-49520d2b-7a34-42be-8727-f2dd1e4c0cc6 tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] HTTP exception thrown: Volume 5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9 could not be found. Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-49520d2b-7a34-42be-8727-f2dd1e4c0cc6 tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] Request method failure captured: Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/os-volumes/5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9 HTTP/1.1 Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIT8fmd4rNkZtazFmj8eaJVDXc3XwFUGNp1g2mkxnqTKDCIKC8pZgmfVyf0cupsWmNXCneOQ7WmT4abRuwJegorKnoOVnNwOeAxrscRY5IaAv-BrQ0W1Jpig9GFhQ-d7cuFrG5y8Q6cbbazs-rlJD5fqbg73puD_PD7TRwbCaeml-Ek Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: fc5950aed60e4d3ba2b3cd3ce2734bf8 Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-VolumesGetTestJSON-2136701119 Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fc5950aed60e4d3ba2b3cd3ce2734bf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fc5950aed60e4d3ba2b3cd3ce2734bf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fc5950aed60e4d3ba2b3cd3ce2734bf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fc5950aed60e4d3ba2b3cd3ce2734bf8", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-VolumesGetTestJSON-2136701119 Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: fc5950aed60e4d3ba2b3cd3ce2734bf8 Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-VolumesGetTestJSON-2136701119 Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-VolumesGetTestJSON-2136701119-project Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 2b92644f0d3c45afac903ca9fcf32f77 Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-VolumesGetTestJSON-2136701119-project Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: method: Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: exception: Volume 5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9 could not be found. Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9'} Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9 could not be found. (HTTP 404) (Request-ID: req-f2a4786a-392d-498e-b0b3-f4d69321ed49) Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 01:42:30.961781 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9 could not be found. Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9 could not be found. Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9 could not be found. Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-49520d2b-7a34-42be-8727-f2dd1e4c0cc6 tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] Returning 404 to user: Volume 5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:42:30.965848 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-49520d2b-7a34-42be-8727-f2dd1e4c0cc6 tempest-VolumesGetTestJSON-2136701119 tempest-VolumesGetTestJSON-2136701119-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9" status: 404 len: 109 microversion: 2.1 time: 0.090365 Oct 29 01:42:30.970977 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3165/6571] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:42:30 2022] GET /compute/v2.1/os-volumes/5ff0baf4-026e-4aa2-98e9-1f47e5c7a1e9 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:42:31.368482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5c0d98ab-b028-4d16-8a93-4d848a524103 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:31.369099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5c0d98ab-b028-4d16-8a93-4d848a524103 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:31.385296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c0d98ab-b028-4d16-8a93-4d848a524103 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:31.385796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c0d98ab-b028-4d16-8a93-4d848a524103 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:31.386241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c0d98ab-b028-4d16-8a93-4d848a524103 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:31.386947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c0d98ab-b028-4d16-8a93-4d848a524103 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:31.387694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c0d98ab-b028-4d16-8a93-4d848a524103 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:31.393592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5c0d98ab-b028-4d16-8a93-4d848a524103 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:31.679156 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-301a93b9-3e15-41b9-9213-e747255365cc tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:31.680556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-301a93b9-3e15-41b9-9213-e747255365cc tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:31.694462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-301a93b9-3e15-41b9-9213-e747255365cc tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:31.694894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-301a93b9-3e15-41b9-9213-e747255365cc tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:31.696802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-301a93b9-3e15-41b9-9213-e747255365cc tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:31.700456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-301a93b9-3e15-41b9-9213-e747255365cc tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:31.701138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-301a93b9-3e15-41b9-9213-e747255365cc tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:31.701774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-301a93b9-3e15-41b9-9213-e747255365cc tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:31.960574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5c0d98ab-b028-4d16-8a93-4d848a524103 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:31.973264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-301a93b9-3e15-41b9-9213-e747255365cc tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:31.979361 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5c0d98ab-b028-4d16-8a93-4d848a524103 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1315 microversion: 2.1 time: 0.608494 Oct 29 01:42:31.981695 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3407/6572] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:31 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:31.984627 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-301a93b9-3e15-41b9-9213-e747255365cc tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1298 microversion: 2.1 time: 0.310195 Oct 29 01:42:32.002128 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3166/6573] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:31 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1298 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:42:32.541299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-0b312582-219a-46b3-a805-ab43df152da4 req-f6421ffb-5184-4cd8-ad4a-b988ea7948aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "668a76a8-4f1e-4946-8695-eb5f9ba4a704", "tag": "94dd50fc-be65-46ab-a9ce-871ff90fc121"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:32.567422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-0b312582-219a-46b3-a805-ab43df152da4 req-f6421ffb-5184-4cd8-ad4a-b988ea7948aa service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:32.568169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-0b312582-219a-46b3-a805-ab43df152da4 req-f6421ffb-5184-4cd8-ad4a-b988ea7948aa service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:32.570113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-0b312582-219a-46b3-a805-ab43df152da4 req-f6421ffb-5184-4cd8-ad4a-b988ea7948aa service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:32.602999 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-0b312582-219a-46b3-a805-ab43df152da4 req-f6421ffb-5184-4cd8-ad4a-b988ea7948aa service nova] Creating event network-changed:94dd50fc-be65-46ab-a9ce-871ff90fc121 for instance 668a76a8-4f1e-4946-8695-eb5f9ba4a704 on n-h2-862964-3 Oct 29 01:42:32.629115 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-0b312582-219a-46b3-a805-ab43df152da4 req-f6421ffb-5184-4cd8-ad4a-b988ea7948aa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091460 Oct 29 01:42:32.631251 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3408/6574] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:33.004947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9004c3df-838f-44ba-af66-5d8460a5e431 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:33.020900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9004c3df-838f-44ba-af66-5d8460a5e431 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:33.021079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f11d2e73-12bd-42b1-ba1f-9fe1e5b9fadf tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:33.021079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f11d2e73-12bd-42b1-ba1f-9fe1e5b9fadf tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:33.031454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f11d2e73-12bd-42b1-ba1f-9fe1e5b9fadf tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:33.031975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f11d2e73-12bd-42b1-ba1f-9fe1e5b9fadf tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:33.039735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f11d2e73-12bd-42b1-ba1f-9fe1e5b9fadf tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:33.040833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9004c3df-838f-44ba-af66-5d8460a5e431 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:33.041886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f11d2e73-12bd-42b1-ba1f-9fe1e5b9fadf tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:33.044075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9004c3df-838f-44ba-af66-5d8460a5e431 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:33.044706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9004c3df-838f-44ba-af66-5d8460a5e431 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:33.044869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f11d2e73-12bd-42b1-ba1f-9fe1e5b9fadf tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:33.045374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f11d2e73-12bd-42b1-ba1f-9fe1e5b9fadf tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:33.050261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9004c3df-838f-44ba-af66-5d8460a5e431 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:33.051620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9004c3df-838f-44ba-af66-5d8460a5e431 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:33.053414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9004c3df-838f-44ba-af66-5d8460a5e431 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:33.215884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:42:33.576627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:42:33.612200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f11d2e73-12bd-42b1-ba1f-9fe1e5b9fadf tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:33.635812 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f11d2e73-12bd-42b1-ba1f-9fe1e5b9fadf tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1298 microversion: 2.1 time: 0.627383 Oct 29 01:42:33.640741 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3409/6575] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:33 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1298 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:42:33.645870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4e16a828-c322-43c3-ac5d-a0f9986b0798 req-ca773562-7c5b-4385-a3ce-3e438473880d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aae9e686-e9f8-4288-a0ed-aa4cc6bc3586", "tag": "9b8d4881-ed32-412b-8288-7e124a76fa7c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:33.670483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4e16a828-c322-43c3-ac5d-a0f9986b0798 req-ca773562-7c5b-4385-a3ce-3e438473880d service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:33.671617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4e16a828-c322-43c3-ac5d-a0f9986b0798 req-ca773562-7c5b-4385-a3ce-3e438473880d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:33.672062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4e16a828-c322-43c3-ac5d-a0f9986b0798 req-ca773562-7c5b-4385-a3ce-3e438473880d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:33.688146 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4e16a828-c322-43c3-ac5d-a0f9986b0798 req-ca773562-7c5b-4385-a3ce-3e438473880d service nova] Creating event network-changed:9b8d4881-ed32-412b-8288-7e124a76fa7c for instance aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 on n-h2-862964-3 Oct 29 01:42:33.697316 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4e16a828-c322-43c3-ac5d-a0f9986b0798 req-ca773562-7c5b-4385-a3ce-3e438473880d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051624 Oct 29 01:42:33.697316 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3410/6576] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:33.830613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=14 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:42:34.336745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9004c3df-838f-44ba-af66-5d8460a5e431 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:34.355390 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9004c3df-838f-44ba-af66-5d8460a5e431 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1315 microversion: 2.1 time: 1.354248 Oct 29 01:42:34.360010 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3167/6577] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:32 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1315 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:34.666052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f8c8a157-430a-44e6-ad80-d72c3b2dfdc9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:34.666817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f8c8a157-430a-44e6-ad80-d72c3b2dfdc9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:34.692717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8c8a157-430a-44e6-ad80-d72c3b2dfdc9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:34.695928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8c8a157-430a-44e6-ad80-d72c3b2dfdc9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:34.698093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8c8a157-430a-44e6-ad80-d72c3b2dfdc9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:34.701636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8c8a157-430a-44e6-ad80-d72c3b2dfdc9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:34.702864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8c8a157-430a-44e6-ad80-d72c3b2dfdc9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:34.704447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8c8a157-430a-44e6-ad80-d72c3b2dfdc9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:35.017120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f8c8a157-430a-44e6-ad80-d72c3b2dfdc9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:35.038656 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f8c8a157-430a-44e6-ad80-d72c3b2dfdc9 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1298 microversion: 2.1 time: 0.376435 Oct 29 01:42:35.052869 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3411/6578] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:34 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1298 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:35.386473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5f54787a-72f1-4fde-8123-aa1064a5ec0c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:35.387132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5f54787a-72f1-4fde-8123-aa1064a5ec0c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:35.413501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f54787a-72f1-4fde-8123-aa1064a5ec0c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:35.414003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f54787a-72f1-4fde-8123-aa1064a5ec0c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:35.414441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f54787a-72f1-4fde-8123-aa1064a5ec0c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:35.415150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f54787a-72f1-4fde-8123-aa1064a5ec0c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:35.415605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f54787a-72f1-4fde-8123-aa1064a5ec0c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:35.416029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5f54787a-72f1-4fde-8123-aa1064a5ec0c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:35.600629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5f54787a-72f1-4fde-8123-aa1064a5ec0c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:35.610336 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5f54787a-72f1-4fde-8123-aa1064a5ec0c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1315 microversion: 2.1 time: 0.229273 Oct 29 01:42:35.611366 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3168/6579] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:35 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:36.067294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-674dd45e-bf7a-4201-b55f-69d0928a5f13 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:36.068941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-674dd45e-bf7a-4201-b55f-69d0928a5f13 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:36.082788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-674dd45e-bf7a-4201-b55f-69d0928a5f13 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:36.086814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-674dd45e-bf7a-4201-b55f-69d0928a5f13 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:36.087589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-674dd45e-bf7a-4201-b55f-69d0928a5f13 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:36.088907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-674dd45e-bf7a-4201-b55f-69d0928a5f13 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:36.092227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-674dd45e-bf7a-4201-b55f-69d0928a5f13 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:36.095274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-674dd45e-bf7a-4201-b55f-69d0928a5f13 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:36.126028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6b4e6d79-54a5-4f6d-b73f-4b102a31b822 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:36.126651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6b4e6d79-54a5-4f6d-b73f-4b102a31b822 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:36.138078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b4e6d79-54a5-4f6d-b73f-4b102a31b822 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:36.139077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b4e6d79-54a5-4f6d-b73f-4b102a31b822 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:36.141414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b4e6d79-54a5-4f6d-b73f-4b102a31b822 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:36.142921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b4e6d79-54a5-4f6d-b73f-4b102a31b822 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:36.144913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b4e6d79-54a5-4f6d-b73f-4b102a31b822 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:36.145883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6b4e6d79-54a5-4f6d-b73f-4b102a31b822 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:36.450914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-674dd45e-bf7a-4201-b55f-69d0928a5f13 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:36.459777 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-674dd45e-bf7a-4201-b55f-69d0928a5f13 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1298 microversion: 2.1 time: 0.399015 Oct 29 01:42:36.463975 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3412/6580] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:36 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1298 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:36.475804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-50b0ab7e-1c51-494e-9c3a-9cfc4de9b59a req-abea67be-014b-4be1-b2be-433580de50e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3984ece4-66ac-4c11-b414-0c1f4d76a410", "tag": "2edce355-2eeb-46eb-af8e-5a803adc036a"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:36.507784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-50b0ab7e-1c51-494e-9c3a-9cfc4de9b59a req-abea67be-014b-4be1-b2be-433580de50e0 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:36.513794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-50b0ab7e-1c51-494e-9c3a-9cfc4de9b59a req-abea67be-014b-4be1-b2be-433580de50e0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:36.515843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-50b0ab7e-1c51-494e-9c3a-9cfc4de9b59a req-abea67be-014b-4be1-b2be-433580de50e0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:36.554895 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-50b0ab7e-1c51-494e-9c3a-9cfc4de9b59a req-abea67be-014b-4be1-b2be-433580de50e0 service nova] Creating event network-changed:2edce355-2eeb-46eb-af8e-5a803adc036a for instance 3984ece4-66ac-4c11-b414-0c1f4d76a410 on n-h2-862964-3 Oct 29 01:42:36.574248 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-50b0ab7e-1c51-494e-9c3a-9cfc4de9b59a req-abea67be-014b-4be1-b2be-433580de50e0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107884 Oct 29 01:42:36.580285 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3413/6581] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:36.637882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-66a4cc17-087b-462a-84de-b3ba42e6f4e3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:36.638600 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-66a4cc17-087b-462a-84de-b3ba42e6f4e3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:36.651748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66a4cc17-087b-462a-84de-b3ba42e6f4e3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:36.652255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66a4cc17-087b-462a-84de-b3ba42e6f4e3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:36.652702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66a4cc17-087b-462a-84de-b3ba42e6f4e3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:36.653674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66a4cc17-087b-462a-84de-b3ba42e6f4e3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:36.654144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66a4cc17-087b-462a-84de-b3ba42e6f4e3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:36.656098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-66a4cc17-087b-462a-84de-b3ba42e6f4e3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:36.714017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6b4e6d79-54a5-4f6d-b73f-4b102a31b822 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:36.723338 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6b4e6d79-54a5-4f6d-b73f-4b102a31b822 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1564 microversion: 2.1 time: 0.602148 Oct 29 01:42:36.740103 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3169/6582] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:36 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1564 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:37.070948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-66a4cc17-087b-462a-84de-b3ba42e6f4e3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:37.085667 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-66a4cc17-087b-462a-84de-b3ba42e6f4e3 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1315 microversion: 2.1 time: 0.453331 Oct 29 01:42:37.102689 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3414/6583] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:36 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:37.493667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-66eaa7a6-8354-4092-b9e7-f779d60fc848 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:37.494527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-66eaa7a6-8354-4092-b9e7-f779d60fc848 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:37.502862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66eaa7a6-8354-4092-b9e7-f779d60fc848 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:37.503652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66eaa7a6-8354-4092-b9e7-f779d60fc848 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:37.504280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66eaa7a6-8354-4092-b9e7-f779d60fc848 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:37.505213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66eaa7a6-8354-4092-b9e7-f779d60fc848 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:37.508115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66eaa7a6-8354-4092-b9e7-f779d60fc848 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:37.508854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66eaa7a6-8354-4092-b9e7-f779d60fc848 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:37.907213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-66eaa7a6-8354-4092-b9e7-f779d60fc848 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:37.915540 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-66eaa7a6-8354-4092-b9e7-f779d60fc848 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1298 microversion: 2.1 time: 0.428229 Oct 29 01:42:37.929238 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3170/6584] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:37 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1298 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:38.116413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-14c33377-b300-4136-9ff3-73c2b6e48758 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:38.117431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-14c33377-b300-4136-9ff3-73c2b6e48758 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:38.129217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14c33377-b300-4136-9ff3-73c2b6e48758 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:38.131457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14c33377-b300-4136-9ff3-73c2b6e48758 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:38.131989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14c33377-b300-4136-9ff3-73c2b6e48758 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:38.133832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14c33377-b300-4136-9ff3-73c2b6e48758 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:38.140719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14c33377-b300-4136-9ff3-73c2b6e48758 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:38.143278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14c33377-b300-4136-9ff3-73c2b6e48758 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:38.489232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-14c33377-b300-4136-9ff3-73c2b6e48758 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:38.498311 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-14c33377-b300-4136-9ff3-73c2b6e48758 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1315 microversion: 2.1 time: 0.388119 Oct 29 01:42:38.499519 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3415/6585] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:38 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:38.943779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ce243dab-aa0f-4b30-a770-dc9daccaf58a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:38.945813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ce243dab-aa0f-4b30-a770-dc9daccaf58a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:38.988292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce243dab-aa0f-4b30-a770-dc9daccaf58a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:38.989530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce243dab-aa0f-4b30-a770-dc9daccaf58a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:38.990247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce243dab-aa0f-4b30-a770-dc9daccaf58a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:38.992157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce243dab-aa0f-4b30-a770-dc9daccaf58a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:38.993063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce243dab-aa0f-4b30-a770-dc9daccaf58a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:38.993691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce243dab-aa0f-4b30-a770-dc9daccaf58a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:39.192085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ce243dab-aa0f-4b30-a770-dc9daccaf58a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:39.203882 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ce243dab-aa0f-4b30-a770-dc9daccaf58a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1298 microversion: 2.1 time: 0.266642 Oct 29 01:42:39.204477 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3171/6586] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:38 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1298 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:39.539974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-caf76c91-d821-4ead-8896-67616d5b4653 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:39.541310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-caf76c91-d821-4ead-8896-67616d5b4653 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:39.549766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-caf76c91-d821-4ead-8896-67616d5b4653 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:39.550905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-caf76c91-d821-4ead-8896-67616d5b4653 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:39.551700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-caf76c91-d821-4ead-8896-67616d5b4653 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:39.552865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-caf76c91-d821-4ead-8896-67616d5b4653 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:39.553620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-caf76c91-d821-4ead-8896-67616d5b4653 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:39.554752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-caf76c91-d821-4ead-8896-67616d5b4653 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:39.921828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-caf76c91-d821-4ead-8896-67616d5b4653 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:39.932720 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-caf76c91-d821-4ead-8896-67616d5b4653 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1315 microversion: 2.1 time: 0.412545 Oct 29 01:42:39.933974 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3416/6587] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:39 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:40.228298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cd1aac0a-4d3a-4658-a9ff-cc15ffe459f5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:40.228973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cd1aac0a-4d3a-4658-a9ff-cc15ffe459f5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:40.250525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd1aac0a-4d3a-4658-a9ff-cc15ffe459f5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:40.251039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd1aac0a-4d3a-4658-a9ff-cc15ffe459f5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:40.251486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd1aac0a-4d3a-4658-a9ff-cc15ffe459f5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:40.252214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd1aac0a-4d3a-4658-a9ff-cc15ffe459f5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:40.252679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd1aac0a-4d3a-4658-a9ff-cc15ffe459f5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:40.253106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd1aac0a-4d3a-4658-a9ff-cc15ffe459f5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:40.309012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-d9e3d1cc-8b84-4cd2-b920-a4d33fe943bf req-476f1f22-f275-47a8-9ad8-09ad4094e747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae9e686-e9f8-4288-a0ed-aa4cc6bc3586", "name": "network-vif-plugged", "status": "completed", "tag": "9b8d4881-ed32-412b-8288-7e124a76fa7c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:40.336040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d9e3d1cc-8b84-4cd2-b920-a4d33fe943bf req-476f1f22-f275-47a8-9ad8-09ad4094e747 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:40.336599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d9e3d1cc-8b84-4cd2-b920-a4d33fe943bf req-476f1f22-f275-47a8-9ad8-09ad4094e747 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:40.337041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d9e3d1cc-8b84-4cd2-b920-a4d33fe943bf req-476f1f22-f275-47a8-9ad8-09ad4094e747 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:40.351632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:42:40.364841 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-d9e3d1cc-8b84-4cd2-b920-a4d33fe943bf req-476f1f22-f275-47a8-9ad8-09ad4094e747 service nova] Creating event network-vif-plugged:9b8d4881-ed32-412b-8288-7e124a76fa7c for instance aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 on n-h2-862964-3 Oct 29 01:42:40.371536 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-d9e3d1cc-8b84-4cd2-b920-a4d33fe943bf req-476f1f22-f275-47a8-9ad8-09ad4094e747 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066348 Oct 29 01:42:40.372747 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3417/6588] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:42:40.457821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cd1aac0a-4d3a-4658-a9ff-cc15ffe459f5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:40.472947 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cd1aac0a-4d3a-4658-a9ff-cc15ffe459f5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1298 microversion: 2.1 time: 0.247650 Oct 29 01:42:40.474731 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3172/6589] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:40 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1298 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:40.962147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2fba6fea-5cb9-42a8-81d7-1c9d5f9404c6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:40.963143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2fba6fea-5cb9-42a8-81d7-1c9d5f9404c6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:40.989753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fba6fea-5cb9-42a8-81d7-1c9d5f9404c6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:40.993543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fba6fea-5cb9-42a8-81d7-1c9d5f9404c6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:40.995676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fba6fea-5cb9-42a8-81d7-1c9d5f9404c6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:40.997748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fba6fea-5cb9-42a8-81d7-1c9d5f9404c6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:41.000521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fba6fea-5cb9-42a8-81d7-1c9d5f9404c6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:41.000975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fba6fea-5cb9-42a8-81d7-1c9d5f9404c6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:41.389768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2fba6fea-5cb9-42a8-81d7-1c9d5f9404c6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:41.406547 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2fba6fea-5cb9-42a8-81d7-1c9d5f9404c6 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1315 microversion: 2.1 time: 0.449067 Oct 29 01:42:41.409225 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3418/6590] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:40 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:41.496275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b6aa608f-05db-43e9-b4df-50545e0af2ca tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:41.496871 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b6aa608f-05db-43e9-b4df-50545e0af2ca tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:41.526184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6aa608f-05db-43e9-b4df-50545e0af2ca tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:41.530381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6aa608f-05db-43e9-b4df-50545e0af2ca tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:41.531065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6aa608f-05db-43e9-b4df-50545e0af2ca tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:41.532799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6aa608f-05db-43e9-b4df-50545e0af2ca tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:41.533515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6aa608f-05db-43e9-b4df-50545e0af2ca tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:41.535377 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6aa608f-05db-43e9-b4df-50545e0af2ca tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:41.737967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b6aa608f-05db-43e9-b4df-50545e0af2ca tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:41.751726 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b6aa608f-05db-43e9-b4df-50545e0af2ca tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1298 microversion: 2.1 time: 0.259543 Oct 29 01:42:41.767667 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3173/6591] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:41 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1298 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:42.435646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0a1b989d-4bfd-4be9-90cd-8f4bd7f574ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:42.436256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0a1b989d-4bfd-4be9-90cd-8f4bd7f574ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:42.467155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a1b989d-4bfd-4be9-90cd-8f4bd7f574ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:42.467155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a1b989d-4bfd-4be9-90cd-8f4bd7f574ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:42.467155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a1b989d-4bfd-4be9-90cd-8f4bd7f574ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:42.467155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a1b989d-4bfd-4be9-90cd-8f4bd7f574ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:42.467155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a1b989d-4bfd-4be9-90cd-8f4bd7f574ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:42.467155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a1b989d-4bfd-4be9-90cd-8f4bd7f574ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:42.780554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1c36aca9-b954-4b4b-b6dc-1579e904ef72 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:42.790026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1c36aca9-b954-4b4b-b6dc-1579e904ef72 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:42.810809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c36aca9-b954-4b4b-b6dc-1579e904ef72 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:42.820432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c36aca9-b954-4b4b-b6dc-1579e904ef72 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:42.825455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c36aca9-b954-4b4b-b6dc-1579e904ef72 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:42.829557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c36aca9-b954-4b4b-b6dc-1579e904ef72 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:42.830365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c36aca9-b954-4b4b-b6dc-1579e904ef72 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:42.831956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1c36aca9-b954-4b4b-b6dc-1579e904ef72 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:42.893082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0a1b989d-4bfd-4be9-90cd-8f4bd7f574ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:42.919513 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0a1b989d-4bfd-4be9-90cd-8f4bd7f574ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1315 microversion: 2.1 time: 0.483081 Oct 29 01:42:42.920178 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3419/6592] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:42 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:43.112503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1c36aca9-b954-4b4b-b6dc-1579e904ef72 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:43.139262 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1c36aca9-b954-4b4b-b6dc-1579e904ef72 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1298 microversion: 2.1 time: 0.363343 Oct 29 01:42:43.142308 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3174/6593] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:42 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1298 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:43.956402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7357cd84-ffc8-4e96-b9ae-fa253b636d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:43.956402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7357cd84-ffc8-4e96-b9ae-fa253b636d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:43.962972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7357cd84-ffc8-4e96-b9ae-fa253b636d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:43.963485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7357cd84-ffc8-4e96-b9ae-fa253b636d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:43.964169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7357cd84-ffc8-4e96-b9ae-fa253b636d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:43.964903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7357cd84-ffc8-4e96-b9ae-fa253b636d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:43.965611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7357cd84-ffc8-4e96-b9ae-fa253b636d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:43.966818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7357cd84-ffc8-4e96-b9ae-fa253b636d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:44.165425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cf0d30d7-3d51-4965-aa8d-1870f064c6ae tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:44.166537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cf0d30d7-3d51-4965-aa8d-1870f064c6ae tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:44.177232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf0d30d7-3d51-4965-aa8d-1870f064c6ae tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:44.177983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf0d30d7-3d51-4965-aa8d-1870f064c6ae tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:44.178603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf0d30d7-3d51-4965-aa8d-1870f064c6ae tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:44.179704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf0d30d7-3d51-4965-aa8d-1870f064c6ae tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:44.180322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf0d30d7-3d51-4965-aa8d-1870f064c6ae tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:44.180907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf0d30d7-3d51-4965-aa8d-1870f064c6ae tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:44.221278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:42:44.382826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cf0d30d7-3d51-4965-aa8d-1870f064c6ae tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:44.391266 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cf0d30d7-3d51-4965-aa8d-1870f064c6ae tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1298 microversion: 2.1 time: 0.231096 Oct 29 01:42:44.391891 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3175/6594] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:44 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1298 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:44.394390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7357cd84-ffc8-4e96-b9ae-fa253b636d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:44.399196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-3e4ebdaa-251a-4cf7-a9f0-19888ea387ee req-2fde83f6-984a-48c3-b67d-cdacdb8433f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "668a76a8-4f1e-4946-8695-eb5f9ba4a704", "name": "network-vif-plugged", "status": "completed", "tag": "94dd50fc-be65-46ab-a9ce-871ff90fc121"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:44.418945 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7357cd84-ffc8-4e96-b9ae-fa253b636d3b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1502 microversion: 2.1 time: 0.476907 Oct 29 01:42:44.426164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3e4ebdaa-251a-4cf7-a9f0-19888ea387ee req-2fde83f6-984a-48c3-b67d-cdacdb8433f6 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:44.430724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3e4ebdaa-251a-4cf7-a9f0-19888ea387ee req-2fde83f6-984a-48c3-b67d-cdacdb8433f6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:44.432484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3e4ebdaa-251a-4cf7-a9f0-19888ea387ee req-2fde83f6-984a-48c3-b67d-cdacdb8433f6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:44.434464 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3420/6595] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:43 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1502 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:44.456410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3b69704d-2ac4-4e4a-b3fd-c22699b0831c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:44.456972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3b69704d-2ac4-4e4a-b3fd-c22699b0831c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:44.464042 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-3e4ebdaa-251a-4cf7-a9f0-19888ea387ee req-2fde83f6-984a-48c3-b67d-cdacdb8433f6 service nova] Creating event network-vif-plugged:94dd50fc-be65-46ab-a9ce-871ff90fc121 for instance 668a76a8-4f1e-4946-8695-eb5f9ba4a704 on n-h2-862964-3 Oct 29 01:42:44.474774 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-3e4ebdaa-251a-4cf7-a9f0-19888ea387ee req-2fde83f6-984a-48c3-b67d-cdacdb8433f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079056 Oct 29 01:42:44.475824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b69704d-2ac4-4e4a-b3fd-c22699b0831c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:44.476330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b69704d-2ac4-4e4a-b3fd-c22699b0831c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:44.476482 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3176/6596] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:44.479683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b69704d-2ac4-4e4a-b3fd-c22699b0831c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:44.481869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b69704d-2ac4-4e4a-b3fd-c22699b0831c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:44.482911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b69704d-2ac4-4e4a-b3fd-c22699b0831c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:44.485749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b69704d-2ac4-4e4a-b3fd-c22699b0831c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:44.744965 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.network.security_group_api [None req-3b69704d-2ac4-4e4a-b3fd-c22699b0831c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Removing security group 72d1b564-0558-4635-a846-753a6dab048f from port 9b8d4881-ed32-412b-8288-7e124a76fa7c Oct 29 01:42:45.418665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-22d0da3b-5b09-49cb-8802-55d7baff2b9d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:45.420081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-22d0da3b-5b09-49cb-8802-55d7baff2b9d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:45.427958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22d0da3b-5b09-49cb-8802-55d7baff2b9d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:45.428718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22d0da3b-5b09-49cb-8802-55d7baff2b9d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:45.429365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22d0da3b-5b09-49cb-8802-55d7baff2b9d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:45.430356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22d0da3b-5b09-49cb-8802-55d7baff2b9d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:45.430971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22d0da3b-5b09-49cb-8802-55d7baff2b9d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:45.431557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-22d0da3b-5b09-49cb-8802-55d7baff2b9d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:45.664599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-22d0da3b-5b09-49cb-8802-55d7baff2b9d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:45.684042 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-22d0da3b-5b09-49cb-8802-55d7baff2b9d tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1298 microversion: 2.1 time: 0.270539 Oct 29 01:42:45.684990 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3177/6597] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:45 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1298 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:42:46.015622 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3b69704d-2ac4-4e4a-b3fd-c22699b0831c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586/action" status: 202 len: 0 microversion: 2.1 time: 1.571109 Oct 29 01:42:46.017715 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3421/6598] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:42:44 2022] POST /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586/action => generated 0 bytes in 1574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:42:46.028104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b5193cc2-8b82-4110-9bf2-4b0aa26bf426 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:46.029047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b5193cc2-8b82-4110-9bf2-4b0aa26bf426 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:46.050671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5193cc2-8b82-4110-9bf2-4b0aa26bf426 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:46.053862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5193cc2-8b82-4110-9bf2-4b0aa26bf426 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:46.063763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-09359f61-7c3e-4fcb-a832-56f896c628d7 req-5d2504ba-560e-4606-aed1-5e7224c12b78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aae9e686-e9f8-4288-a0ed-aa4cc6bc3586", "tag": "9b8d4881-ed32-412b-8288-7e124a76fa7c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:46.070957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5193cc2-8b82-4110-9bf2-4b0aa26bf426 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:46.074448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5193cc2-8b82-4110-9bf2-4b0aa26bf426 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:46.084897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5193cc2-8b82-4110-9bf2-4b0aa26bf426 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:46.085432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5193cc2-8b82-4110-9bf2-4b0aa26bf426 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:46.105355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-09359f61-7c3e-4fcb-a832-56f896c628d7 req-5d2504ba-560e-4606-aed1-5e7224c12b78 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:46.109104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-09359f61-7c3e-4fcb-a832-56f896c628d7 req-5d2504ba-560e-4606-aed1-5e7224c12b78 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:46.113198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-09359f61-7c3e-4fcb-a832-56f896c628d7 req-5d2504ba-560e-4606-aed1-5e7224c12b78 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:46.158201 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-09359f61-7c3e-4fcb-a832-56f896c628d7 req-5d2504ba-560e-4606-aed1-5e7224c12b78 service nova] Creating event network-changed:9b8d4881-ed32-412b-8288-7e124a76fa7c for instance aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 on n-h2-862964-3 Oct 29 01:42:46.180452 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-09359f61-7c3e-4fcb-a832-56f896c628d7 req-5d2504ba-560e-4606-aed1-5e7224c12b78 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120542 Oct 29 01:42:46.185251 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3422/6599] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:42:46.487457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b5193cc2-8b82-4110-9bf2-4b0aa26bf426 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:46.504799 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b5193cc2-8b82-4110-9bf2-4b0aa26bf426 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1460 microversion: 2.1 time: 0.482838 Oct 29 01:42:46.506813 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3178/6600] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:46 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1460 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:46.538891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f5f3c9e9-2d39-40e9-ad0b-93a31eeb3e9a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:46.540039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f5f3c9e9-2d39-40e9-ad0b-93a31eeb3e9a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:46.560859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5f3c9e9-2d39-40e9-ad0b-93a31eeb3e9a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:46.561758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5f3c9e9-2d39-40e9-ad0b-93a31eeb3e9a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:46.562208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5f3c9e9-2d39-40e9-ad0b-93a31eeb3e9a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:46.562935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5f3c9e9-2d39-40e9-ad0b-93a31eeb3e9a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:46.568554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5f3c9e9-2d39-40e9-ad0b-93a31eeb3e9a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:46.572637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5f3c9e9-2d39-40e9-ad0b-93a31eeb3e9a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:46.710476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-75231163-b415-44f2-a03a-7f7f173939b3 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:46.712548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-75231163-b415-44f2-a03a-7f7f173939b3 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:46.722162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-75231163-b415-44f2-a03a-7f7f173939b3 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:46.723233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-75231163-b415-44f2-a03a-7f7f173939b3 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:46.723952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-75231163-b415-44f2-a03a-7f7f173939b3 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:46.725303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-75231163-b415-44f2-a03a-7f7f173939b3 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:46.726030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-75231163-b415-44f2-a03a-7f7f173939b3 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:46.726888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-75231163-b415-44f2-a03a-7f7f173939b3 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:46.925067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-75231163-b415-44f2-a03a-7f7f173939b3 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:46.935947 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-75231163-b415-44f2-a03a-7f7f173939b3 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1471 microversion: 2.1 time: 0.229343 Oct 29 01:42:46.960316 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3179/6601] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:46 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1471 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:46.982252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-927787f7-f70a-4e41-85cd-4cceaaf001d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:46.982252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-927787f7-f70a-4e41-85cd-4cceaaf001d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:46.991154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-927787f7-f70a-4e41-85cd-4cceaaf001d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:46.992279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-927787f7-f70a-4e41-85cd-4cceaaf001d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:46.992989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-927787f7-f70a-4e41-85cd-4cceaaf001d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:46.993898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-927787f7-f70a-4e41-85cd-4cceaaf001d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:46.994523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-927787f7-f70a-4e41-85cd-4cceaaf001d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:46.995115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-927787f7-f70a-4e41-85cd-4cceaaf001d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:47.223906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-927787f7-f70a-4e41-85cd-4cceaaf001d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:47.238187 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-927787f7-f70a-4e41-85cd-4cceaaf001d7 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1471 microversion: 2.1 time: 0.268889 Oct 29 01:42:47.239040 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3180/6602] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:46 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1471 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:47.266889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f0774298-107a-47ff-8f12-d900e8a53557 tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:47.273055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f0774298-107a-47ff-8f12-d900e8a53557 tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:47.274326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0774298-107a-47ff-8f12-d900e8a53557 tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:47.275010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0774298-107a-47ff-8f12-d900e8a53557 tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:47.275617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0774298-107a-47ff-8f12-d900e8a53557 tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:47.276559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0774298-107a-47ff-8f12-d900e8a53557 tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:47.277237 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0774298-107a-47ff-8f12-d900e8a53557 tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:47.277826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0774298-107a-47ff-8f12-d900e8a53557 tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:47.448074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f5f3c9e9-2d39-40e9-ad0b-93a31eeb3e9a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:47.475363 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f5f3c9e9-2d39-40e9-ad0b-93a31eeb3e9a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.943223 Oct 29 01:42:47.481586 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3423/6603] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:46 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:47.513654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-715ec7c5-2bfc-4f43-838e-b141868800aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:47.517937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-715ec7c5-2bfc-4f43-838e-b141868800aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:47.528496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-715ec7c5-2bfc-4f43-838e-b141868800aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:47.529486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-715ec7c5-2bfc-4f43-838e-b141868800aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:47.530286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-715ec7c5-2bfc-4f43-838e-b141868800aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:47.531319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-715ec7c5-2bfc-4f43-838e-b141868800aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:47.532050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-715ec7c5-2bfc-4f43-838e-b141868800aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:47.532709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-715ec7c5-2bfc-4f43-838e-b141868800aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:47.596983 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f0774298-107a-47ff-8f12-d900e8a53557 tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1622 microversion: 2.1 time: 0.332166 Oct 29 01:42:47.597671 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3181/6604] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:47 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1622 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:47.624446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-25b2a6fd-626e-4f50-b217-6d399d7240b5 tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:47.626379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-25b2a6fd-626e-4f50-b217-6d399d7240b5 tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:47.648185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-25b2a6fd-626e-4f50-b217-6d399d7240b5 tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:47.648185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-25b2a6fd-626e-4f50-b217-6d399d7240b5 tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:47.648185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-25b2a6fd-626e-4f50-b217-6d399d7240b5 tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:47.656212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-25b2a6fd-626e-4f50-b217-6d399d7240b5 tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:47.658821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-25b2a6fd-626e-4f50-b217-6d399d7240b5 tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:47.662430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-25b2a6fd-626e-4f50-b217-6d399d7240b5 tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:48.074788 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-25b2a6fd-626e-4f50-b217-6d399d7240b5 tempest-TestSecurityGroupsBasicOps-70155715 tempest-TestSecurityGroupsBasicOps-70155715-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1912 microversion: 2.1 time: 0.454275 Oct 29 01:42:48.075399 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3182/6605] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:47 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1912 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:42:48.119808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-715ec7c5-2bfc-4f43-838e-b141868800aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:48.126315 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-715ec7c5-2bfc-4f43-838e-b141868800aa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.618121 Oct 29 01:42:48.131574 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3424/6606] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:47 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:48.159326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-73cb8cd2-7eda-4ce6-81d6-d21cb2b4b8d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:48.164710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-73cb8cd2-7eda-4ce6-81d6-d21cb2b4b8d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:48.172678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-73cb8cd2-7eda-4ce6-81d6-d21cb2b4b8d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:48.173378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-73cb8cd2-7eda-4ce6-81d6-d21cb2b4b8d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:48.174552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-73cb8cd2-7eda-4ce6-81d6-d21cb2b4b8d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:48.175521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-73cb8cd2-7eda-4ce6-81d6-d21cb2b4b8d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:48.177052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-73cb8cd2-7eda-4ce6-81d6-d21cb2b4b8d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:48.177736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-73cb8cd2-7eda-4ce6-81d6-d21cb2b4b8d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:48.330750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dbe67767-3289-434b-99e8-a9675fa7cd83 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:48.333473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dbe67767-3289-434b-99e8-a9675fa7cd83 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:48.356677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbe67767-3289-434b-99e8-a9675fa7cd83 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:48.357320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbe67767-3289-434b-99e8-a9675fa7cd83 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:48.359857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbe67767-3289-434b-99e8-a9675fa7cd83 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:48.360659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbe67767-3289-434b-99e8-a9675fa7cd83 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:48.361136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbe67767-3289-434b-99e8-a9675fa7cd83 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:48.361610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dbe67767-3289-434b-99e8-a9675fa7cd83 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:48.440965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dbe67767-3289-434b-99e8-a9675fa7cd83 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:42:48.447944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-73cb8cd2-7eda-4ce6-81d6-d21cb2b4b8d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:48.462529 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-73cb8cd2-7eda-4ce6-81d6-d21cb2b4b8d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.308367 Oct 29 01:42:48.463821 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3183/6607] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:48 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:48.487289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c6236616-0ee4-46f2-8116-e94de9105cbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:48.488840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c6236616-0ee4-46f2-8116-e94de9105cbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:48.501352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6236616-0ee4-46f2-8116-e94de9105cbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:48.502155 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6236616-0ee4-46f2-8116-e94de9105cbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:48.502785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6236616-0ee4-46f2-8116-e94de9105cbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:48.503715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6236616-0ee4-46f2-8116-e94de9105cbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:48.504367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6236616-0ee4-46f2-8116-e94de9105cbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:48.504983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6236616-0ee4-46f2-8116-e94de9105cbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:48.803463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c6236616-0ee4-46f2-8116-e94de9105cbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:48.839745 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c6236616-0ee4-46f2-8116-e94de9105cbd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.352165 Oct 29 01:42:48.841353 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3184/6608] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:48 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:48.857144 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dbe67767-3289-434b-99e8-a9675fa7cd83 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "DELETE /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 204 len: 0 microversion: 2.1 time: 0.530865 Oct 29 01:42:48.867661 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3425/6609] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:42:48 2022] DELETE /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:42:48.874280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6ccb40fa-9621-474c-b609-bb38e923baed tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:48.881796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6ccb40fa-9621-474c-b609-bb38e923baed tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:48.891454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ccb40fa-9621-474c-b609-bb38e923baed tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:48.894470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ccb40fa-9621-474c-b609-bb38e923baed tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:48.894470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ccb40fa-9621-474c-b609-bb38e923baed tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:48.894470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ccb40fa-9621-474c-b609-bb38e923baed tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:48.894470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ccb40fa-9621-474c-b609-bb38e923baed tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:48.894470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ccb40fa-9621-474c-b609-bb38e923baed tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:48.984530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0e2459be-8bba-47fa-9459-181574cc56db tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Action: 'create', calling method: .version_select at 0x7f9d96f26ca0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-988473739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQE+LWuoSfDRJBOi4Kd+6d2TGzCdOaTy0oCW1UItgJDonkRSmFRiSA4KIAI0KWBAUs4Wi7V0UgIMArwl0UM3yUaNRE17WCNEAYqOGEwVK0WysT1I8WQrXy8IHNyje+wTQ=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:49.007259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-0e2459be-8bba-47fa-9459-181574cc56db tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Getting quotas for project e1817f6a3cd04ebbaa07dd63934d2771. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:42:49.028443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6ccb40fa-9621-474c-b609-bb38e923baed tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:49.031071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-0e2459be-8bba-47fa-9459-181574cc56db tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Getting quotas for user ab773592a5914fcda533047d8044c3dc and project e1817f6a3cd04ebbaa07dd63934d2771. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:42:49.039296 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6ccb40fa-9621-474c-b609-bb38e923baed tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1477 microversion: 2.1 time: 0.168652 Oct 29 01:42:49.040094 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3185/6610] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:48 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1477 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:49.180566 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0e2459be-8bba-47fa-9459-181574cc56db tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.201209 Oct 29 01:42:49.181658 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3426/6611] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:42:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:49.187074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0230066b-7b1e-4d07-93d6-2418b8280234 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-711202902", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "8568990a-4f98-461a-8f32-e20720daa4e5"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:49.271557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-0230066b-7b1e-4d07-93d6-2418b8280234 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] validate_networks() for [('8568990a-4f98-461a-8f32-e20720daa4e5', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:42:49.899982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-0230066b-7b1e-4d07-93d6-2418b8280234 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:42:49.900518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-0230066b-7b1e-4d07-93d6-2418b8280234 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:42:49.900933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-0230066b-7b1e-4d07-93d6-2418b8280234 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:42:49.901441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-0230066b-7b1e-4d07-93d6-2418b8280234 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:42:49.901881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-0230066b-7b1e-4d07-93d6-2418b8280234 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:42:49.915507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0230066b-7b1e-4d07-93d6-2418b8280234 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:49.915507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0230066b-7b1e-4d07-93d6-2418b8280234 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:49.915507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0230066b-7b1e-4d07-93d6-2418b8280234 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:49.920313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0230066b-7b1e-4d07-93d6-2418b8280234 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:49.922982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0230066b-7b1e-4d07-93d6-2418b8280234 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:49.923448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0230066b-7b1e-4d07-93d6-2418b8280234 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:49.966753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-0230066b-7b1e-4d07-93d6-2418b8280234 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Getting quotas for project 238c2e0d9e0b48198767a357cff1a442. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:42:49.987470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-0230066b-7b1e-4d07-93d6-2418b8280234 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Getting quotas for user 9c097ba205f6453ba793dfb1d1876f3e and project 238c2e0d9e0b48198767a357cff1a442. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:42:50.024364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0230066b-7b1e-4d07-93d6-2418b8280234 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:42:50.032155 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0230066b-7b1e-4d07-93d6-2418b8280234 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:42:50.064006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f1cdcaea-f101-431e-8201-0c9eac06d21a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:50.065069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f1cdcaea-f101-431e-8201-0c9eac06d21a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:50.085693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1cdcaea-f101-431e-8201-0c9eac06d21a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:50.086195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1cdcaea-f101-431e-8201-0c9eac06d21a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:50.093301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1cdcaea-f101-431e-8201-0c9eac06d21a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:50.094220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1cdcaea-f101-431e-8201-0c9eac06d21a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:50.094712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1cdcaea-f101-431e-8201-0c9eac06d21a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:50.095160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f1cdcaea-f101-431e-8201-0c9eac06d21a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:50.234897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f1cdcaea-f101-431e-8201-0c9eac06d21a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:50.248133 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f1cdcaea-f101-431e-8201-0c9eac06d21a tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1477 microversion: 2.1 time: 0.188946 Oct 29 01:42:50.254333 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3427/6612] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:50 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1477 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:42:50.278165 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0230066b-7b1e-4d07-93d6-2418b8280234 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.092159 Oct 29 01:42:50.278165 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3186/6613] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:42:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:42:50.298728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9fb45478-35db-41ce-b491-b46a1b1d887a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:50.300217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9fb45478-35db-41ce-b491-b46a1b1d887a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:50.396926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9fb45478-35db-41ce-b491-b46a1b1d887a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:50.406405 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9fb45478-35db-41ce-b491-b46a1b1d887a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1214 microversion: 2.1 time: 0.120949 Oct 29 01:42:50.408061 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3428/6614] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:50 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:51.283044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-71a89703-dba7-4951-b777-2ec29562dc0c tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:51.285333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-71a89703-dba7-4951-b777-2ec29562dc0c tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:51.296106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71a89703-dba7-4951-b777-2ec29562dc0c tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:51.297060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71a89703-dba7-4951-b777-2ec29562dc0c tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:51.302282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71a89703-dba7-4951-b777-2ec29562dc0c tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:51.302282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71a89703-dba7-4951-b777-2ec29562dc0c tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:51.302282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71a89703-dba7-4951-b777-2ec29562dc0c tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:51.302282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-71a89703-dba7-4951-b777-2ec29562dc0c tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:51.422726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-71a89703-dba7-4951-b777-2ec29562dc0c tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:51.426017 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-71a89703-dba7-4951-b777-2ec29562dc0c tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1477 microversion: 2.1 time: 0.149531 Oct 29 01:42:51.426622 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3187/6615] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:51 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1477 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:51.441688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3b4e2ecd-d9f2-44d6-9c03-7e9498638bd8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:51.441688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3b4e2ecd-d9f2-44d6-9c03-7e9498638bd8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:51.604639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3b4e2ecd-d9f2-44d6-9c03-7e9498638bd8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:51.622978 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3b4e2ecd-d9f2-44d6-9c03-7e9498638bd8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1214 microversion: 2.1 time: 0.194003 Oct 29 01:42:51.625762 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3429/6616] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:51 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1214 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:42:51.639265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-1cd54a6a-204c-4062-ac46-e3c02583b880 req-0bb475d2-0dfd-4500-8979-e20cf8a8cb1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "668a76a8-4f1e-4946-8695-eb5f9ba4a704", "name": "network-vif-deleted", "tag": "94dd50fc-be65-46ab-a9ce-871ff90fc121"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:51.665452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1cd54a6a-204c-4062-ac46-e3c02583b880 req-0bb475d2-0dfd-4500-8979-e20cf8a8cb1f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:51.666054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1cd54a6a-204c-4062-ac46-e3c02583b880 req-0bb475d2-0dfd-4500-8979-e20cf8a8cb1f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:51.666594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1cd54a6a-204c-4062-ac46-e3c02583b880 req-0bb475d2-0dfd-4500-8979-e20cf8a8cb1f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:51.828040 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-1cd54a6a-204c-4062-ac46-e3c02583b880 req-0bb475d2-0dfd-4500-8979-e20cf8a8cb1f service nova] Creating event network-vif-deleted:94dd50fc-be65-46ab-a9ce-871ff90fc121 for instance 668a76a8-4f1e-4946-8695-eb5f9ba4a704 on n-h2-862964-3 Oct 29 01:42:51.828040 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-1cd54a6a-204c-4062-ac46-e3c02583b880 req-0bb475d2-0dfd-4500-8979-e20cf8a8cb1f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062800 Oct 29 01:42:51.828040 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3188/6617] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:52.452883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0a7dda60-f638-4166-91ef-e9b8c9adf449 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:52.454511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0a7dda60-f638-4166-91ef-e9b8c9adf449 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:52.464937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a7dda60-f638-4166-91ef-e9b8c9adf449 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:52.465893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a7dda60-f638-4166-91ef-e9b8c9adf449 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:52.466345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a7dda60-f638-4166-91ef-e9b8c9adf449 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:52.467198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a7dda60-f638-4166-91ef-e9b8c9adf449 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:52.468593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a7dda60-f638-4166-91ef-e9b8c9adf449 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:52.469350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a7dda60-f638-4166-91ef-e9b8c9adf449 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:52.509741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a7dda60-f638-4166-91ef-e9b8c9adf449 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:52.510540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a7dda60-f638-4166-91ef-e9b8c9adf449 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:52.511209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a7dda60-f638-4166-91ef-e9b8c9adf449 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:52.511875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-0a7dda60-f638-4166-91ef-e9b8c9adf449 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lazy-loading 'fault' on Instance uuid 668a76a8-4f1e-4946-8695-eb5f9ba4a704 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:42:52.643807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0a7dda60-f638-4166-91ef-e9b8c9adf449 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:52.655662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6bda32bb-3f2e-4d76-978a-c1d3cb717155 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:52.657634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6bda32bb-3f2e-4d76-978a-c1d3cb717155 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:52.676756 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0a7dda60-f638-4166-91ef-e9b8c9adf449 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 200 len: 1330 microversion: 2.1 time: 0.221841 Oct 29 01:42:52.676756 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3430/6618] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:52 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 1330 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:52.691803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bda32bb-3f2e-4d76-978a-c1d3cb717155 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:52.693222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bda32bb-3f2e-4d76-978a-c1d3cb717155 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:52.693679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bda32bb-3f2e-4d76-978a-c1d3cb717155 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:52.694605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bda32bb-3f2e-4d76-978a-c1d3cb717155 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:52.695073 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bda32bb-3f2e-4d76-978a-c1d3cb717155 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:52.695504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bda32bb-3f2e-4d76-978a-c1d3cb717155 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:52.776233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6bda32bb-3f2e-4d76-978a-c1d3cb717155 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:52.787334 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6bda32bb-3f2e-4d76-978a-c1d3cb717155 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1210 microversion: 2.1 time: 0.141276 Oct 29 01:42:52.796216 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3189/6619] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:52 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1210 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:53.701456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9de3843a-d4d3-4a23-a574-9f82f2ede1be tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:53.702943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9de3843a-d4d3-4a23-a574-9f82f2ede1be tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 668a76a8-4f1e-4946-8695-eb5f9ba4a704] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:53.711498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9de3843a-d4d3-4a23-a574-9f82f2ede1be tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:53.712507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9de3843a-d4d3-4a23-a574-9f82f2ede1be tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:53.713131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9de3843a-d4d3-4a23-a574-9f82f2ede1be tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:53.714061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9de3843a-d4d3-4a23-a574-9f82f2ede1be tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:53.715002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9de3843a-d4d3-4a23-a574-9f82f2ede1be tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:53.716191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9de3843a-d4d3-4a23-a574-9f82f2ede1be tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:53.741647 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-9de3843a-d4d3-4a23-a574-9f82f2ede1be tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] HTTP exception thrown: Instance 668a76a8-4f1e-4946-8695-eb5f9ba4a704 could not be found. Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9de3843a-d4d3-4a23-a574-9f82f2ede1be tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Request method failure captured: Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 HTTP/1.1 Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIRqG4l6AqlULmAlGNCOODs5duhwVrrA5-26DH7vUyGmRWilXWLxMWnpL8x37ztfzpTQJ9CQfj9A1Hy8b2Z3OtcNdFm-2OD0jAOOLzN_BrupJb4Cp2W2F8nPclrp4I4kSIzgKRJFvlENt59j-FGj4iv2oq3trNZkVzvPw2lxjCy8vO8 Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 37a06b4f54f84e3ca1ec465f31dd0127 Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-124385350 Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37a06b4f54f84e3ca1ec465f31dd0127"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37a06b4f54f84e3ca1ec465f31dd0127"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37a06b4f54f84e3ca1ec465f31dd0127"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37a06b4f54f84e3ca1ec465f31dd0127", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-TestSecurityGroupsBasicOps-124385350 Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 37a06b4f54f84e3ca1ec465f31dd0127 Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-124385350 Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-TestSecurityGroupsBasicOps-124385350-project Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 98c91d05f467479f84d12f272c522fbf Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-TestSecurityGroupsBasicOps-124385350-project Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 668a76a8-4f1e-4946-8695-eb5f9ba4a704 could not be found. Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '668a76a8-4f1e-4946-8695-eb5f9ba4a704'} Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 668a76a8-4f1e-4946-8695-eb5f9ba4a704 could not be found. Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 668a76a8-4f1e-4946-8695-eb5f9ba4a704 could not be found. Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:42:53.757603 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:53.774018 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:42:53.774018 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:42:53.774018 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:42:53.774018 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:42:53.774018 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:42:53.774018 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 668a76a8-4f1e-4946-8695-eb5f9ba4a704 could not be found. Oct 29 01:42:53.774018 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:42:53.774018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9de3843a-d4d3-4a23-a574-9f82f2ede1be tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Returning 404 to user: Instance 668a76a8-4f1e-4946-8695-eb5f9ba4a704 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:42:53.774018 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9de3843a-d4d3-4a23-a574-9f82f2ede1be tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704" status: 404 len: 111 microversion: 2.1 time: 0.063160 Oct 29 01:42:53.774018 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3431/6620] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:53 2022] GET /compute/v2.1/servers/668a76a8-4f1e-4946-8695-eb5f9ba4a704 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:42:53.810489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6941d36c-c102-4d87-8b7d-97c32d971b1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:53.811205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6941d36c-c102-4d87-8b7d-97c32d971b1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:53.827744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6941d36c-c102-4d87-8b7d-97c32d971b1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:53.828312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6941d36c-c102-4d87-8b7d-97c32d971b1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:53.833134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6941d36c-c102-4d87-8b7d-97c32d971b1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:53.833134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6941d36c-c102-4d87-8b7d-97c32d971b1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:53.833134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6941d36c-c102-4d87-8b7d-97c32d971b1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:53.833134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6941d36c-c102-4d87-8b7d-97c32d971b1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:53.850196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-36422aff-10d8-4808-bb99-2c777964b21b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-401720224", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "31ad81de-e7c8-4260-98f2-c4d66d2185e2"}], "key_name": "tempest-TestNetworkBasicOps-988473739", "security_groups": [{"name": "tempest-secgroup-smoke-450948765"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:54.117673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6941d36c-c102-4d87-8b7d-97c32d971b1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:54.126090 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6941d36c-c102-4d87-8b7d-97c32d971b1a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1274 microversion: 2.1 time: 0.319532 Oct 29 01:42:54.129918 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3190/6621] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:53 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1274 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:54.235352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-36422aff-10d8-4808-bb99-2c777964b21b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] validate_networks() for [('31ad81de-e7c8-4260-98f2-c4d66d2185e2', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:42:55.161488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-08f46515-9e88-42e9-9790-3a3125967f15 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:55.162148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-08f46515-9e88-42e9-9790-3a3125967f15 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:55.164970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:42:55.169960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08f46515-9e88-42e9-9790-3a3125967f15 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:55.170450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08f46515-9e88-42e9-9790-3a3125967f15 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:55.171467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08f46515-9e88-42e9-9790-3a3125967f15 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:55.172179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08f46515-9e88-42e9-9790-3a3125967f15 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:55.172811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08f46515-9e88-42e9-9790-3a3125967f15 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:55.173435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-08f46515-9e88-42e9-9790-3a3125967f15 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:55.303271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-08f46515-9e88-42e9-9790-3a3125967f15 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:55.323308 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-08f46515-9e88-42e9-9790-3a3125967f15 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1272 microversion: 2.1 time: 0.165247 Oct 29 01:42:55.337376 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3191/6622] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:55 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1272 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:42:55.599006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-36422aff-10d8-4808-bb99-2c777964b21b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:42:55.599531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-36422aff-10d8-4808-bb99-2c777964b21b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:42:55.600279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-36422aff-10d8-4808-bb99-2c777964b21b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:42:55.601248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-36422aff-10d8-4808-bb99-2c777964b21b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:42:55.602103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-36422aff-10d8-4808-bb99-2c777964b21b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:42:55.628061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36422aff-10d8-4808-bb99-2c777964b21b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:55.631340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36422aff-10d8-4808-bb99-2c777964b21b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:55.632033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36422aff-10d8-4808-bb99-2c777964b21b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:55.633737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36422aff-10d8-4808-bb99-2c777964b21b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:55.635889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36422aff-10d8-4808-bb99-2c777964b21b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:55.636901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36422aff-10d8-4808-bb99-2c777964b21b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:55.678439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-36422aff-10d8-4808-bb99-2c777964b21b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Getting quotas for project e1817f6a3cd04ebbaa07dd63934d2771. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:42:55.689791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-36422aff-10d8-4808-bb99-2c777964b21b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Getting quotas for user ab773592a5914fcda533047d8044c3dc and project e1817f6a3cd04ebbaa07dd63934d2771. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:42:55.714129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-36422aff-10d8-4808-bb99-2c777964b21b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:42:55.717881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-36422aff-10d8-4808-bb99-2c777964b21b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:42:55.777544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:42:55.900614 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-36422aff-10d8-4808-bb99-2c777964b21b tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.054630 Oct 29 01:42:55.915859 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3432/6623] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:42:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 2070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:42:55.917475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-44620bd4-e637-4ee6-a7bd-d78db8530962 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:55.918368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-44620bd4-e637-4ee6-a7bd-d78db8530962 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:56.106500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-44620bd4-e637-4ee6-a7bd-d78db8530962 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:56.115142 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-44620bd4-e637-4ee6-a7bd-d78db8530962 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 200 len: 1247 microversion: 2.1 time: 0.203247 Oct 29 01:42:56.127588 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3192/6624] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:55 2022] GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 1247 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:42:56.352151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-773a4457-0c5e-4baa-8e99-0ccfd38642ac tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:56.352729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-773a4457-0c5e-4baa-8e99-0ccfd38642ac tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:56.375417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-773a4457-0c5e-4baa-8e99-0ccfd38642ac tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:56.375930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-773a4457-0c5e-4baa-8e99-0ccfd38642ac tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:56.381994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-773a4457-0c5e-4baa-8e99-0ccfd38642ac tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:56.401400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-773a4457-0c5e-4baa-8e99-0ccfd38642ac tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:56.403076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-773a4457-0c5e-4baa-8e99-0ccfd38642ac tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:56.404499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-773a4457-0c5e-4baa-8e99-0ccfd38642ac tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:56.814345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-773a4457-0c5e-4baa-8e99-0ccfd38642ac tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:56.833677 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-773a4457-0c5e-4baa-8e99-0ccfd38642ac tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1314 microversion: 2.1 time: 0.486739 Oct 29 01:42:56.835167 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3433/6625] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:56 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:57.157275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a819bf8e-ddec-4b0c-b809-1367f529a8fd tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:57.159269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a819bf8e-ddec-4b0c-b809-1367f529a8fd tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:57.249751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a819bf8e-ddec-4b0c-b809-1367f529a8fd tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:57.258988 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a819bf8e-ddec-4b0c-b809-1367f529a8fd tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 200 len: 1247 microversion: 2.1 time: 0.116935 Oct 29 01:42:57.260699 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3193/6626] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:57 2022] GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 1247 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:57.863137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e4158668-dcf4-414f-ae94-95aa8bc31d9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:57.864586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e4158668-dcf4-414f-ae94-95aa8bc31d9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:57.896243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4158668-dcf4-414f-ae94-95aa8bc31d9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:57.896761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4158668-dcf4-414f-ae94-95aa8bc31d9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:57.900974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4158668-dcf4-414f-ae94-95aa8bc31d9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:57.905425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4158668-dcf4-414f-ae94-95aa8bc31d9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:57.907145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4158668-dcf4-414f-ae94-95aa8bc31d9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:57.908805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4158668-dcf4-414f-ae94-95aa8bc31d9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:58.298269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0c95318c-00ae-4dbb-8ff2-48f7c3175e43 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:58.299545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0c95318c-00ae-4dbb-8ff2-48f7c3175e43 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:58.315786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c95318c-00ae-4dbb-8ff2-48f7c3175e43 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:58.319470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c95318c-00ae-4dbb-8ff2-48f7c3175e43 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:58.320527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c95318c-00ae-4dbb-8ff2-48f7c3175e43 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:58.322104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c95318c-00ae-4dbb-8ff2-48f7c3175e43 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:58.325657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c95318c-00ae-4dbb-8ff2-48f7c3175e43 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:58.331941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c95318c-00ae-4dbb-8ff2-48f7c3175e43 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:58.849498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0c95318c-00ae-4dbb-8ff2-48f7c3175e43 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:58.860380 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0c95318c-00ae-4dbb-8ff2-48f7c3175e43 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 200 len: 1251 microversion: 2.1 time: 0.575325 Oct 29 01:42:58.861406 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3194/6627] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:58 2022] GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 1251 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:59.023294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e4158668-dcf4-414f-ae94-95aa8bc31d9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:42:59.042571 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e4158668-dcf4-414f-ae94-95aa8bc31d9d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1314 microversion: 2.1 time: 1.184007 Oct 29 01:42:59.043819 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3434/6628] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:57 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1314 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:42:59.562682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-a65966c4-2cdf-4596-ba35-c14d639cde36 req-a118df06-0985-4081-8fbb-a77983277f1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de1df712-231f-4de9-9023-66fab316b565", "tag": "a19b3137-5978-4142-9ac1-161c59e7ec6b"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:42:59.584190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a65966c4-2cdf-4596-ba35-c14d639cde36 req-a118df06-0985-4081-8fbb-a77983277f1f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:59.585068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a65966c4-2cdf-4596-ba35-c14d639cde36 req-a118df06-0985-4081-8fbb-a77983277f1f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:59.586171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a65966c4-2cdf-4596-ba35-c14d639cde36 req-a118df06-0985-4081-8fbb-a77983277f1f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:59.633901 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-a65966c4-2cdf-4596-ba35-c14d639cde36 req-a118df06-0985-4081-8fbb-a77983277f1f service nova] Creating event network-changed:a19b3137-5978-4142-9ac1-161c59e7ec6b for instance de1df712-231f-4de9-9023-66fab316b565 on n-h1-862964-3 Oct 29 01:42:59.647560 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-a65966c4-2cdf-4596-ba35-c14d639cde36 req-a118df06-0985-4081-8fbb-a77983277f1f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090880 Oct 29 01:42:59.650623 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3195/6629] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:42:59.885700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eaf2ee14-8dff-4d6a-8c1e-9152e7c7edb6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:42:59.886614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eaf2ee14-8dff-4d6a-8c1e-9152e7c7edb6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:42:59.899026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eaf2ee14-8dff-4d6a-8c1e-9152e7c7edb6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:59.910082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eaf2ee14-8dff-4d6a-8c1e-9152e7c7edb6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:59.914462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eaf2ee14-8dff-4d6a-8c1e-9152e7c7edb6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:42:59.915282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eaf2ee14-8dff-4d6a-8c1e-9152e7c7edb6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:42:59.915983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eaf2ee14-8dff-4d6a-8c1e-9152e7c7edb6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:42:59.916439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eaf2ee14-8dff-4d6a-8c1e-9152e7c7edb6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:00.069190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4fa33baa-62b5-478d-b52f-7164e2ce30d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:00.070112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4fa33baa-62b5-478d-b52f-7164e2ce30d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:00.073898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:00.088222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fa33baa-62b5-478d-b52f-7164e2ce30d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:00.089581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fa33baa-62b5-478d-b52f-7164e2ce30d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:00.090772 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fa33baa-62b5-478d-b52f-7164e2ce30d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:00.093631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fa33baa-62b5-478d-b52f-7164e2ce30d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:00.094448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fa33baa-62b5-478d-b52f-7164e2ce30d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:00.098229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4fa33baa-62b5-478d-b52f-7164e2ce30d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:00.109680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eaf2ee14-8dff-4d6a-8c1e-9152e7c7edb6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:00.123048 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eaf2ee14-8dff-4d6a-8c1e-9152e7c7edb6 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 200 len: 1299 microversion: 2.1 time: 0.241431 Oct 29 01:43:00.137966 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3435/6630] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:42:59 2022] GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 1299 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:00.452907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4fa33baa-62b5-478d-b52f-7164e2ce30d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:00.452907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:00.463180 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4fa33baa-62b5-478d-b52f-7164e2ce30d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1314 microversion: 2.1 time: 0.398793 Oct 29 01:43:00.467681 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3196/6631] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:00 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:01.153074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a00e1788-8524-46cf-af19-70f2e06be628 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:01.158665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a00e1788-8524-46cf-af19-70f2e06be628 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:01.166051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a00e1788-8524-46cf-af19-70f2e06be628 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:01.167109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a00e1788-8524-46cf-af19-70f2e06be628 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:01.167571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a00e1788-8524-46cf-af19-70f2e06be628 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:01.168524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a00e1788-8524-46cf-af19-70f2e06be628 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:01.169287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a00e1788-8524-46cf-af19-70f2e06be628 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:01.169875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a00e1788-8524-46cf-af19-70f2e06be628 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:01.262359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a00e1788-8524-46cf-af19-70f2e06be628 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:01.271112 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a00e1788-8524-46cf-af19-70f2e06be628 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 200 len: 1305 microversion: 2.1 time: 0.125855 Oct 29 01:43:01.271909 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3436/6632] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:01 2022] GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 1305 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:01.496153 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-67c0ca28-1bf2-4265-8873-3551eee8fbae tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:01.497598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-67c0ca28-1bf2-4265-8873-3551eee8fbae tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:01.505725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67c0ca28-1bf2-4265-8873-3551eee8fbae tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:01.506441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67c0ca28-1bf2-4265-8873-3551eee8fbae tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:01.507078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67c0ca28-1bf2-4265-8873-3551eee8fbae tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:01.508377 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67c0ca28-1bf2-4265-8873-3551eee8fbae tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:01.509313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67c0ca28-1bf2-4265-8873-3551eee8fbae tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:01.509974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-67c0ca28-1bf2-4265-8873-3551eee8fbae tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:01.885570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-67c0ca28-1bf2-4265-8873-3551eee8fbae tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:01.905401 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-67c0ca28-1bf2-4265-8873-3551eee8fbae tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1314 microversion: 2.1 time: 0.409719 Oct 29 01:43:01.905401 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3197/6633] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:01 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:02.296603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-130442fc-87ef-408b-993e-766a782b35cf tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:02.297304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-130442fc-87ef-408b-993e-766a782b35cf tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:02.305414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-130442fc-87ef-408b-993e-766a782b35cf tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:02.307762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-130442fc-87ef-408b-993e-766a782b35cf tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:02.308585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-130442fc-87ef-408b-993e-766a782b35cf tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:02.309561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-130442fc-87ef-408b-993e-766a782b35cf tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:02.311114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-130442fc-87ef-408b-993e-766a782b35cf tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:02.311815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-130442fc-87ef-408b-993e-766a782b35cf tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:02.596103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-130442fc-87ef-408b-993e-766a782b35cf tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:02.603148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:02.609422 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-130442fc-87ef-408b-993e-766a782b35cf tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 200 len: 1372 microversion: 2.1 time: 0.316155 Oct 29 01:43:02.614117 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3437/6634] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:02 2022] GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 1372 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:02.930007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-770b6c3d-4100-4f55-b71c-8c66d218b051 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:02.931313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-770b6c3d-4100-4f55-b71c-8c66d218b051 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:02.940625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-770b6c3d-4100-4f55-b71c-8c66d218b051 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:02.943293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-770b6c3d-4100-4f55-b71c-8c66d218b051 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:02.943969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-770b6c3d-4100-4f55-b71c-8c66d218b051 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:02.944976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-770b6c3d-4100-4f55-b71c-8c66d218b051 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:02.945548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-770b6c3d-4100-4f55-b71c-8c66d218b051 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:02.946047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-770b6c3d-4100-4f55-b71c-8c66d218b051 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:03.387597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-770b6c3d-4100-4f55-b71c-8c66d218b051 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:03.402315 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-770b6c3d-4100-4f55-b71c-8c66d218b051 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1314 microversion: 2.1 time: 0.474678 Oct 29 01:43:03.402941 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3198/6635] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:02 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:03.634672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-513a9373-4578-49cc-b60d-eb31ab15c22a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:03.635988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-513a9373-4578-49cc-b60d-eb31ab15c22a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:03.652923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-513a9373-4578-49cc-b60d-eb31ab15c22a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:03.656744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-513a9373-4578-49cc-b60d-eb31ab15c22a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:03.657911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-513a9373-4578-49cc-b60d-eb31ab15c22a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:03.659306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-513a9373-4578-49cc-b60d-eb31ab15c22a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:03.659946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-513a9373-4578-49cc-b60d-eb31ab15c22a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:03.662741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-513a9373-4578-49cc-b60d-eb31ab15c22a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:03.714867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e87d48a-94fc-46ce-a0f8-129583bf1359 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:03.719077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e87d48a-94fc-46ce-a0f8-129583bf1359 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:03.735273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e87d48a-94fc-46ce-a0f8-129583bf1359 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:03.737721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e87d48a-94fc-46ce-a0f8-129583bf1359 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:03.737721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e87d48a-94fc-46ce-a0f8-129583bf1359 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:03.740477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e87d48a-94fc-46ce-a0f8-129583bf1359 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:03.741926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e87d48a-94fc-46ce-a0f8-129583bf1359 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:03.744374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e87d48a-94fc-46ce-a0f8-129583bf1359 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:03.849793 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8e87d48a-94fc-46ce-a0f8-129583bf1359 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410/action" status: 200 len: 24562 microversion: 2.1 time: 0.649205 Oct 29 01:43:03.857147 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3438/6636] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:43:03 2022] POST /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410/action => generated 24562 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:43:03.926703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-513a9373-4578-49cc-b60d-eb31ab15c22a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:03.939082 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-513a9373-4578-49cc-b60d-eb31ab15c22a tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 200 len: 1372 microversion: 2.1 time: 0.308166 Oct 29 01:43:03.940865 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3199/6637] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:03 2022] GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 1372 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:04.028967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-5abdfbb4-eedd-4a26-b165-c2f9f0d976d1 req-60892422-42fc-446b-a765-46e4406afbdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e333fe7e-b42e-4135-900a-1c977f223617", "tag": "75f73836-8254-485f-a3cb-2b63990c10cf"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:04.054435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5abdfbb4-eedd-4a26-b165-c2f9f0d976d1 req-60892422-42fc-446b-a765-46e4406afbdc service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:04.055275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5abdfbb4-eedd-4a26-b165-c2f9f0d976d1 req-60892422-42fc-446b-a765-46e4406afbdc service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:04.057010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5abdfbb4-eedd-4a26-b165-c2f9f0d976d1 req-60892422-42fc-446b-a765-46e4406afbdc service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:04.117359 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-5abdfbb4-eedd-4a26-b165-c2f9f0d976d1 req-60892422-42fc-446b-a765-46e4406afbdc service nova] Creating event network-changed:75f73836-8254-485f-a3cb-2b63990c10cf for instance e333fe7e-b42e-4135-900a-1c977f223617 on n-h2-862964-3 Oct 29 01:43:04.127781 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-5abdfbb4-eedd-4a26-b165-c2f9f0d976d1 req-60892422-42fc-446b-a765-46e4406afbdc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103135 Oct 29 01:43:04.130344 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3439/6638] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:43:04.418303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d2eb9e71-7685-474f-b814-df62524e869b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:04.419023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d2eb9e71-7685-474f-b814-df62524e869b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:04.426709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-905115cd-9b0d-491e-b4ec-d55d0dfebeef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:04.428282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-905115cd-9b0d-491e-b4ec-d55d0dfebeef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:04.438565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2eb9e71-7685-474f-b814-df62524e869b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:04.440903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2eb9e71-7685-474f-b814-df62524e869b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:04.441404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2eb9e71-7685-474f-b814-df62524e869b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:04.442387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2eb9e71-7685-474f-b814-df62524e869b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:04.445615 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-905115cd-9b0d-491e-b4ec-d55d0dfebeef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:04.446110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-905115cd-9b0d-491e-b4ec-d55d0dfebeef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:04.446547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-905115cd-9b0d-491e-b4ec-d55d0dfebeef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:04.447341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-905115cd-9b0d-491e-b4ec-d55d0dfebeef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:04.447714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-905115cd-9b0d-491e-b4ec-d55d0dfebeef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:04.448140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-905115cd-9b0d-491e-b4ec-d55d0dfebeef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:04.453503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2eb9e71-7685-474f-b814-df62524e869b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:04.454397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2eb9e71-7685-474f-b814-df62524e869b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:04.512941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d2eb9e71-7685-474f-b814-df62524e869b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:43:04.760135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-905115cd-9b0d-491e-b4ec-d55d0dfebeef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:04.785391 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-905115cd-9b0d-491e-b4ec-d55d0dfebeef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1314 microversion: 2.1 time: 0.363282 Oct 29 01:43:04.790358 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3440/6639] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:04 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:04.891176 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d2eb9e71-7685-474f-b814-df62524e869b tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 204 len: 0 microversion: 2.1 time: 0.471473 Oct 29 01:43:04.891176 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3200/6640] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:43:04 2022] DELETE /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:43:04.898219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-de72ea91-e80d-40f0-89e7-af291fdb6c68 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:04.898952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-de72ea91-e80d-40f0-89e7-af291fdb6c68 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:04.906257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de72ea91-e80d-40f0-89e7-af291fdb6c68 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:04.906851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de72ea91-e80d-40f0-89e7-af291fdb6c68 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:04.907371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de72ea91-e80d-40f0-89e7-af291fdb6c68 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:04.908157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de72ea91-e80d-40f0-89e7-af291fdb6c68 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:04.908782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de72ea91-e80d-40f0-89e7-af291fdb6c68 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:04.909237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de72ea91-e80d-40f0-89e7-af291fdb6c68 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:04.965293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-58bf3ae6-7d1a-44d1-98ac-9ec745dd7cc1 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:04.969212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-58bf3ae6-7d1a-44d1-98ac-9ec745dd7cc1 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:04.985573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58bf3ae6-7d1a-44d1-98ac-9ec745dd7cc1 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:04.990023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58bf3ae6-7d1a-44d1-98ac-9ec745dd7cc1 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:04.994979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58bf3ae6-7d1a-44d1-98ac-9ec745dd7cc1 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:04.994979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58bf3ae6-7d1a-44d1-98ac-9ec745dd7cc1 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:05.001555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58bf3ae6-7d1a-44d1-98ac-9ec745dd7cc1 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:05.003744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58bf3ae6-7d1a-44d1-98ac-9ec745dd7cc1 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:05.240890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-de72ea91-e80d-40f0-89e7-af291fdb6c68 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:05.244824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-58bf3ae6-7d1a-44d1-98ac-9ec745dd7cc1 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:05.261082 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-de72ea91-e80d-40f0-89e7-af291fdb6c68 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1767 microversion: 2.1 time: 0.368920 Oct 29 01:43:05.264512 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-58bf3ae6-7d1a-44d1-98ac-9ec745dd7cc1 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 200 len: 1372 microversion: 2.1 time: 0.303449 Oct 29 01:43:05.273037 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3441/6641] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:04 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1767 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:05.280926 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3201/6642] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:04 2022] GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 1372 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:05.808834 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9ba74c8b-7b52-4180-ab77-9990623dfc6f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:05.809489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9ba74c8b-7b52-4180-ab77-9990623dfc6f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:05.817768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:05.819134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=14 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:05.821079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ba74c8b-7b52-4180-ab77-9990623dfc6f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:05.821969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ba74c8b-7b52-4180-ab77-9990623dfc6f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:05.822688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ba74c8b-7b52-4180-ab77-9990623dfc6f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:05.824002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ba74c8b-7b52-4180-ab77-9990623dfc6f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:05.824746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ba74c8b-7b52-4180-ab77-9990623dfc6f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:05.825437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ba74c8b-7b52-4180-ab77-9990623dfc6f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:06.025992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9ba74c8b-7b52-4180-ab77-9990623dfc6f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:06.037530 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9ba74c8b-7b52-4180-ab77-9990623dfc6f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1314 microversion: 2.1 time: 0.232675 Oct 29 01:43:06.038126 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3442/6643] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:05 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:06.162413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-c5f10757-eafa-4b8e-81be-97bafe3bc84d req-fbfe5bad-79fb-423b-b777-88e7eeedf848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93de6bc3-3869-4da6-aab7-800addd62dfe", "tag": "67eaff49-cb1c-4c31-8124-a15fd8d313cf"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:06.180683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c5f10757-eafa-4b8e-81be-97bafe3bc84d req-fbfe5bad-79fb-423b-b777-88e7eeedf848 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:06.180683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c5f10757-eafa-4b8e-81be-97bafe3bc84d req-fbfe5bad-79fb-423b-b777-88e7eeedf848 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:06.180683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-c5f10757-eafa-4b8e-81be-97bafe3bc84d req-fbfe5bad-79fb-423b-b777-88e7eeedf848 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:06.189173 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-c5f10757-eafa-4b8e-81be-97bafe3bc84d req-fbfe5bad-79fb-423b-b777-88e7eeedf848 service nova] Creating event network-changed:67eaff49-cb1c-4c31-8124-a15fd8d313cf for instance 93de6bc3-3869-4da6-aab7-800addd62dfe on n-h1-862964-3 Oct 29 01:43:06.196752 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-c5f10757-eafa-4b8e-81be-97bafe3bc84d req-fbfe5bad-79fb-423b-b777-88e7eeedf848 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037997 Oct 29 01:43:06.199511 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3202/6644] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:43:06.288311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80184e50-3d99-4813-8c68-17d63b04fd06 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:06.290604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-80184e50-3d99-4813-8c68-17d63b04fd06 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:06.296666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-11e11fbc-8222-4e37-8983-7b386d001176 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:06.297435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-11e11fbc-8222-4e37-8983-7b386d001176 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:06.297556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80184e50-3d99-4813-8c68-17d63b04fd06 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:06.298232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80184e50-3d99-4813-8c68-17d63b04fd06 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:06.299058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80184e50-3d99-4813-8c68-17d63b04fd06 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:06.300102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80184e50-3d99-4813-8c68-17d63b04fd06 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:06.300864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80184e50-3d99-4813-8c68-17d63b04fd06 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:06.302265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80184e50-3d99-4813-8c68-17d63b04fd06 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:06.313589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-11e11fbc-8222-4e37-8983-7b386d001176 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:06.314084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-11e11fbc-8222-4e37-8983-7b386d001176 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:06.314527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-11e11fbc-8222-4e37-8983-7b386d001176 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:06.315240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-11e11fbc-8222-4e37-8983-7b386d001176 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:06.315691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-11e11fbc-8222-4e37-8983-7b386d001176 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:06.316115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-11e11fbc-8222-4e37-8983-7b386d001176 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:06.590211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-80184e50-3d99-4813-8c68-17d63b04fd06 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:06.599390 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-80184e50-3d99-4813-8c68-17d63b04fd06 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 200 len: 1372 microversion: 2.1 time: 0.315463 Oct 29 01:43:06.600002 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3443/6645] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:06 2022] GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 1372 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:06.823242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-11e11fbc-8222-4e37-8983-7b386d001176 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:06.834884 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-11e11fbc-8222-4e37-8983-7b386d001176 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1767 microversion: 2.1 time: 0.542697 Oct 29 01:43:06.835688 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3203/6646] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:06 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1767 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:07.069794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b2ed5841-ef29-4d7c-8e17-97aa1fd3572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:07.071678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b2ed5841-ef29-4d7c-8e17-97aa1fd3572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:07.088035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b2ed5841-ef29-4d7c-8e17-97aa1fd3572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:07.089420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b2ed5841-ef29-4d7c-8e17-97aa1fd3572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:07.090456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b2ed5841-ef29-4d7c-8e17-97aa1fd3572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:07.091948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b2ed5841-ef29-4d7c-8e17-97aa1fd3572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:07.093777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b2ed5841-ef29-4d7c-8e17-97aa1fd3572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:07.095713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b2ed5841-ef29-4d7c-8e17-97aa1fd3572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:07.434784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b2ed5841-ef29-4d7c-8e17-97aa1fd3572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:07.491644 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b2ed5841-ef29-4d7c-8e17-97aa1fd3572f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1314 microversion: 2.1 time: 0.431569 Oct 29 01:43:07.516996 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3444/6647] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:07 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:07.625586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ae4f7d8c-877a-40c8-91b2-744ccda32ad4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:07.626219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ae4f7d8c-877a-40c8-91b2-744ccda32ad4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:07.628856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=10 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:07.651571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae4f7d8c-877a-40c8-91b2-744ccda32ad4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:07.651571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae4f7d8c-877a-40c8-91b2-744ccda32ad4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:07.651571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae4f7d8c-877a-40c8-91b2-744ccda32ad4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:07.651571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae4f7d8c-877a-40c8-91b2-744ccda32ad4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:07.653370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae4f7d8c-877a-40c8-91b2-744ccda32ad4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:07.655424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ae4f7d8c-877a-40c8-91b2-744ccda32ad4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:07.723977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-5a406237-55a5-4e3a-8efd-a78676d766c5 req-29ea6929-cec2-4d72-8cab-091b8e65ae63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93de6bc3-3869-4da6-aab7-800addd62dfe", "name": "network-vif-deleted", "tag": "67eaff49-cb1c-4c31-8124-a15fd8d313cf"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:07.737082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5a406237-55a5-4e3a-8efd-a78676d766c5 req-29ea6929-cec2-4d72-8cab-091b8e65ae63 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:07.738023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5a406237-55a5-4e3a-8efd-a78676d766c5 req-29ea6929-cec2-4d72-8cab-091b8e65ae63 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:07.738710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5a406237-55a5-4e3a-8efd-a78676d766c5 req-29ea6929-cec2-4d72-8cab-091b8e65ae63 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:07.752733 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-5a406237-55a5-4e3a-8efd-a78676d766c5 req-29ea6929-cec2-4d72-8cab-091b8e65ae63 service nova] Creating event network-vif-deleted:67eaff49-cb1c-4c31-8124-a15fd8d313cf for instance 93de6bc3-3869-4da6-aab7-800addd62dfe on n-h1-862964-3 Oct 29 01:43:07.762763 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-5a406237-55a5-4e3a-8efd-a78676d766c5 req-29ea6929-cec2-4d72-8cab-091b8e65ae63 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047931 Oct 29 01:43:07.763630 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3445/6648] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:43:07.862160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3ae301a2-342e-4c1a-841a-5086564ad2a5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:07.862904 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3ae301a2-342e-4c1a-841a-5086564ad2a5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:07.879015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ae301a2-342e-4c1a-841a-5086564ad2a5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:07.879655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ae301a2-342e-4c1a-841a-5086564ad2a5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:07.880318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ae301a2-342e-4c1a-841a-5086564ad2a5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:07.882237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ae301a2-342e-4c1a-841a-5086564ad2a5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:07.882751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ae301a2-342e-4c1a-841a-5086564ad2a5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:07.883189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ae301a2-342e-4c1a-841a-5086564ad2a5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:07.935926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ae4f7d8c-877a-40c8-91b2-744ccda32ad4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:07.956615 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ae4f7d8c-877a-40c8-91b2-744ccda32ad4 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 200 len: 1372 microversion: 2.1 time: 0.333372 Oct 29 01:43:07.958618 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3204/6649] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:07 2022] GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 1372 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:08.081632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3ae301a2-342e-4c1a-841a-5086564ad2a5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:08.089926 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3ae301a2-342e-4c1a-841a-5086564ad2a5 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1528 microversion: 2.1 time: 0.233327 Oct 29 01:43:08.113184 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3446/6650] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:07 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1528 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:08.229515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-a67c31ef-c79f-4e16-9f06-689b60c5665d req-e794ed0c-4de8-4fc3-aa9a-85f2e77af73f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1df712-231f-4de9-9023-66fab316b565", "name": "network-vif-plugged", "status": "completed", "tag": "a19b3137-5978-4142-9ac1-161c59e7ec6b"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:08.281663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a67c31ef-c79f-4e16-9f06-689b60c5665d req-e794ed0c-4de8-4fc3-aa9a-85f2e77af73f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:08.282618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a67c31ef-c79f-4e16-9f06-689b60c5665d req-e794ed0c-4de8-4fc3-aa9a-85f2e77af73f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:08.283727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a67c31ef-c79f-4e16-9f06-689b60c5665d req-e794ed0c-4de8-4fc3-aa9a-85f2e77af73f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:08.307743 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-a67c31ef-c79f-4e16-9f06-689b60c5665d req-e794ed0c-4de8-4fc3-aa9a-85f2e77af73f service nova] Creating event network-vif-plugged:a19b3137-5978-4142-9ac1-161c59e7ec6b for instance de1df712-231f-4de9-9023-66fab316b565 on n-h1-862964-3 Oct 29 01:43:08.331654 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-a67c31ef-c79f-4e16-9f06-689b60c5665d req-e794ed0c-4de8-4fc3-aa9a-85f2e77af73f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116735 Oct 29 01:43:08.343579 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3205/6651] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:43:08.529308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8ad94759-d76e-4ff7-a763-a14342bed604 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:08.530761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8ad94759-d76e-4ff7-a763-a14342bed604 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:08.549936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ad94759-d76e-4ff7-a763-a14342bed604 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:08.549936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ad94759-d76e-4ff7-a763-a14342bed604 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:08.549936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ad94759-d76e-4ff7-a763-a14342bed604 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:08.549936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ad94759-d76e-4ff7-a763-a14342bed604 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:08.549936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ad94759-d76e-4ff7-a763-a14342bed604 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:08.549936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8ad94759-d76e-4ff7-a763-a14342bed604 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:08.719004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8ad94759-d76e-4ff7-a763-a14342bed604 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:08.727812 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8ad94759-d76e-4ff7-a763-a14342bed604 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1314 microversion: 2.1 time: 0.202566 Oct 29 01:43:08.728408 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3447/6652] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:08 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:08.984893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cf1f61fd-4a6c-4366-b66c-22e17b66e784 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:08.985591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cf1f61fd-4a6c-4366-b66c-22e17b66e784 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:08.992057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf1f61fd-4a6c-4366-b66c-22e17b66e784 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:08.992548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf1f61fd-4a6c-4366-b66c-22e17b66e784 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:08.992987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf1f61fd-4a6c-4366-b66c-22e17b66e784 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:08.993727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf1f61fd-4a6c-4366-b66c-22e17b66e784 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:08.994185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf1f61fd-4a6c-4366-b66c-22e17b66e784 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:08.994609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf1f61fd-4a6c-4366-b66c-22e17b66e784 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:09.122998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-431d0e5a-93d9-484c-8301-223c664f01c6 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:09.123733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-431d0e5a-93d9-484c-8301-223c664f01c6 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:09.130716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-431d0e5a-93d9-484c-8301-223c664f01c6 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:09.131446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-431d0e5a-93d9-484c-8301-223c664f01c6 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:09.132065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-431d0e5a-93d9-484c-8301-223c664f01c6 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:09.133098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-431d0e5a-93d9-484c-8301-223c664f01c6 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:09.133731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-431d0e5a-93d9-484c-8301-223c664f01c6 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:09.134314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-431d0e5a-93d9-484c-8301-223c664f01c6 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:09.144982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cf1f61fd-4a6c-4366-b66c-22e17b66e784 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:09.153361 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cf1f61fd-4a6c-4366-b66c-22e17b66e784 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 200 len: 1372 microversion: 2.1 time: 0.174424 Oct 29 01:43:09.169185 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3206/6653] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:08 2022] GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:09.184793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-431d0e5a-93d9-484c-8301-223c664f01c6 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:09.185309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-431d0e5a-93d9-484c-8301-223c664f01c6 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:09.185742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-431d0e5a-93d9-484c-8301-223c664f01c6 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:09.186304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-431d0e5a-93d9-484c-8301-223c664f01c6 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lazy-loading 'fault' on Instance uuid 93de6bc3-3869-4da6-aab7-800addd62dfe {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:43:09.232277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-431d0e5a-93d9-484c-8301-223c664f01c6 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c91d05f467479f84d12f272c522fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a06b4f54f84e3ca1ec465f31dd0127', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:09.242374 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-431d0e5a-93d9-484c-8301-223c664f01c6 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 200 len: 1382 microversion: 2.1 time: 0.123407 Oct 29 01:43:09.243404 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3448/6654] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:09 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 1382 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:09.752623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ac6bd991-09ea-4e3f-b92f-6c951d55500e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:09.753265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ac6bd991-09ea-4e3f-b92f-6c951d55500e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:09.759250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac6bd991-09ea-4e3f-b92f-6c951d55500e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:09.759734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac6bd991-09ea-4e3f-b92f-6c951d55500e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:09.760168 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac6bd991-09ea-4e3f-b92f-6c951d55500e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:09.760854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac6bd991-09ea-4e3f-b92f-6c951d55500e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:09.761337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac6bd991-09ea-4e3f-b92f-6c951d55500e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:09.761762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac6bd991-09ea-4e3f-b92f-6c951d55500e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:09.942548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ac6bd991-09ea-4e3f-b92f-6c951d55500e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:09.955293 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ac6bd991-09ea-4e3f-b92f-6c951d55500e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1314 microversion: 2.1 time: 0.207226 Oct 29 01:43:09.963577 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3207/6655] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:09 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:10.184898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c4058185-5854-4aaf-a79d-fb941a782d11 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:10.189348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c4058185-5854-4aaf-a79d-fb941a782d11 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:10.204430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4058185-5854-4aaf-a79d-fb941a782d11 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:10.205228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4058185-5854-4aaf-a79d-fb941a782d11 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:10.206240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4058185-5854-4aaf-a79d-fb941a782d11 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:10.207163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4058185-5854-4aaf-a79d-fb941a782d11 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:10.208058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4058185-5854-4aaf-a79d-fb941a782d11 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:10.208907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4058185-5854-4aaf-a79d-fb941a782d11 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:10.268092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-82af2f36-0aba-4238-a305-5987d0bbbb90 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:10.268804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-82af2f36-0aba-4238-a305-5987d0bbbb90 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] [instance: 93de6bc3-3869-4da6-aab7-800addd62dfe] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:10.279254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82af2f36-0aba-4238-a305-5987d0bbbb90 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:10.281309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82af2f36-0aba-4238-a305-5987d0bbbb90 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:10.281923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82af2f36-0aba-4238-a305-5987d0bbbb90 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:10.286023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82af2f36-0aba-4238-a305-5987d0bbbb90 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:10.286584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82af2f36-0aba-4238-a305-5987d0bbbb90 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:10.287031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-82af2f36-0aba-4238-a305-5987d0bbbb90 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:10.310001 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-82af2f36-0aba-4238-a305-5987d0bbbb90 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] HTTP exception thrown: Instance 93de6bc3-3869-4da6-aab7-800addd62dfe could not be found. Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-82af2f36-0aba-4238-a305-5987d0bbbb90 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Request method failure captured: Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe HTTP/1.1 Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIRqG4l6AqlULmAlGNCOODs5duhwVrrA5-26DH7vUyGmRWilXWLxMWnpL8x37ztfzpTQJ9CQfj9A1Hy8b2Z3OtcNdFm-2OD0jAOOLzN_BrupJb4Cp2W2F8nPclrp4I4kSIzgKRJFvlENt59j-FGj4iv2oq3trNZkVzvPw2lxjCy8vO8 Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 37a06b4f54f84e3ca1ec465f31dd0127 Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-124385350 Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37a06b4f54f84e3ca1ec465f31dd0127"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37a06b4f54f84e3ca1ec465f31dd0127"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37a06b4f54f84e3ca1ec465f31dd0127"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37a06b4f54f84e3ca1ec465f31dd0127", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TestSecurityGroupsBasicOps-124385350 Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 37a06b4f54f84e3ca1ec465f31dd0127 Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-124385350 Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TestSecurityGroupsBasicOps-124385350-project Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 98c91d05f467479f84d12f272c522fbf Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TestSecurityGroupsBasicOps-124385350-project Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 93de6bc3-3869-4da6-aab7-800addd62dfe could not be found. Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '93de6bc3-3869-4da6-aab7-800addd62dfe'} Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93de6bc3-3869-4da6-aab7-800addd62dfe could not be found. Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93de6bc3-3869-4da6-aab7-800addd62dfe could not be found. Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:43:10.312387 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:43:10.318341 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:43:10.318341 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:43:10.318341 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:43:10.318341 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:43:10.318341 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:43:10.318341 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93de6bc3-3869-4da6-aab7-800addd62dfe could not be found. Oct 29 01:43:10.318341 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:43:10.320661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-82af2f36-0aba-4238-a305-5987d0bbbb90 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Returning 404 to user: Instance 93de6bc3-3869-4da6-aab7-800addd62dfe could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:43:10.322423 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-82af2f36-0aba-4238-a305-5987d0bbbb90 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe" status: 404 len: 111 microversion: 2.1 time: 0.057795 Oct 29 01:43:10.330891 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3208/6656] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:10 2022] GET /compute/v2.1/servers/93de6bc3-3869-4da6-aab7-800addd62dfe => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:43:10.410527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c4058185-5854-4aaf-a79d-fb941a782d11 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:10.424738 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c4058185-5854-4aaf-a79d-fb941a782d11 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 200 len: 1372 microversion: 2.1 time: 0.249144 Oct 29 01:43:10.425924 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3449/6657] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:10 2022] GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 1372 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:10.542516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-d998861e-17e7-4bdf-b8ad-2feabf572106 req-00776e61-a894-401c-be5c-819143425fcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e333fe7e-b42e-4135-900a-1c977f223617", "name": "network-vif-plugged", "status": "completed", "tag": "75f73836-8254-485f-a3cb-2b63990c10cf"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:10.556618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d998861e-17e7-4bdf-b8ad-2feabf572106 req-00776e61-a894-401c-be5c-819143425fcf service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:10.557105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d998861e-17e7-4bdf-b8ad-2feabf572106 req-00776e61-a894-401c-be5c-819143425fcf service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:10.557565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-d998861e-17e7-4bdf-b8ad-2feabf572106 req-00776e61-a894-401c-be5c-819143425fcf service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:10.576870 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-d998861e-17e7-4bdf-b8ad-2feabf572106 req-00776e61-a894-401c-be5c-819143425fcf service nova] Creating event network-vif-plugged:75f73836-8254-485f-a3cb-2b63990c10cf for instance e333fe7e-b42e-4135-900a-1c977f223617 on n-h2-862964-3 Oct 29 01:43:10.584927 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-d998861e-17e7-4bdf-b8ad-2feabf572106 req-00776e61-a894-401c-be5c-819143425fcf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043511 Oct 29 01:43:10.592564 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3209/6658] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:43:10.978506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ad106724-944e-4271-b083-d31a47d9d066 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:10.979222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ad106724-944e-4271-b083-d31a47d9d066 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:10.986370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad106724-944e-4271-b083-d31a47d9d066 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:10.986941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad106724-944e-4271-b083-d31a47d9d066 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:10.987453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad106724-944e-4271-b083-d31a47d9d066 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:10.988261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad106724-944e-4271-b083-d31a47d9d066 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:10.988853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad106724-944e-4271-b083-d31a47d9d066 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:10.989566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad106724-944e-4271-b083-d31a47d9d066 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:11.184233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ad106724-944e-4271-b083-d31a47d9d066 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:11.194948 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ad106724-944e-4271-b083-d31a47d9d066 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1502 microversion: 2.1 time: 0.220124 Oct 29 01:43:11.209783 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3450/6659] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:10 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1502 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:11.221744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c0ab3700-8c26-4882-8e6f-612c3fd6234d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:11.222998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c0ab3700-8c26-4882-8e6f-612c3fd6234d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:11.230601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0ab3700-8c26-4882-8e6f-612c3fd6234d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:11.231536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0ab3700-8c26-4882-8e6f-612c3fd6234d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:11.231989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0ab3700-8c26-4882-8e6f-612c3fd6234d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:11.233106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0ab3700-8c26-4882-8e6f-612c3fd6234d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:11.233847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0ab3700-8c26-4882-8e6f-612c3fd6234d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:11.234290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0ab3700-8c26-4882-8e6f-612c3fd6234d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:11.449148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-15e07e1c-981b-49b8-9375-c849a5fef133 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:11.450166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-15e07e1c-981b-49b8-9375-c849a5fef133 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:11.456940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15e07e1c-981b-49b8-9375-c849a5fef133 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:11.457552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15e07e1c-981b-49b8-9375-c849a5fef133 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:11.458055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15e07e1c-981b-49b8-9375-c849a5fef133 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:11.459058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15e07e1c-981b-49b8-9375-c849a5fef133 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:11.459592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15e07e1c-981b-49b8-9375-c849a5fef133 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:11.460289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-15e07e1c-981b-49b8-9375-c849a5fef133 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:11.540209 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c0ab3700-8c26-4882-8e6f-612c3fd6234d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565/action" status: 202 len: 0 microversion: 2.1 time: 0.323844 Oct 29 01:43:11.541346 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3210/6660] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:43:11 2022] POST /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:43:11.552654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3b34707a-5810-4bfe-bae2-4bc6527e0593 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:11.554562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3b34707a-5810-4bfe-bae2-4bc6527e0593 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:11.568808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b34707a-5810-4bfe-bae2-4bc6527e0593 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:11.569451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b34707a-5810-4bfe-bae2-4bc6527e0593 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:11.570057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b34707a-5810-4bfe-bae2-4bc6527e0593 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:11.571311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b34707a-5810-4bfe-bae2-4bc6527e0593 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:11.572626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b34707a-5810-4bfe-bae2-4bc6527e0593 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:11.573409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3b34707a-5810-4bfe-bae2-4bc6527e0593 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:11.718837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-15e07e1c-981b-49b8-9375-c849a5fef133 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:11.727903 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-15e07e1c-981b-49b8-9375-c849a5fef133 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 200 len: 1372 microversion: 2.1 time: 0.282378 Oct 29 01:43:11.729433 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3451/6661] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:11 2022] GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 1372 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:11.787528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3b34707a-5810-4bfe-bae2-4bc6527e0593 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:11.796798 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3b34707a-5810-4bfe-bae2-4bc6527e0593 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1507 microversion: 2.1 time: 0.250573 Oct 29 01:43:11.798137 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3211/6662] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:11 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:12.757034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b23c89ca-f099-4e5d-8149-d253b56655eb tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:12.757688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b23c89ca-f099-4e5d-8149-d253b56655eb tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:12.766399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b23c89ca-f099-4e5d-8149-d253b56655eb tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:12.767001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b23c89ca-f099-4e5d-8149-d253b56655eb tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:12.767359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b23c89ca-f099-4e5d-8149-d253b56655eb tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:12.768070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b23c89ca-f099-4e5d-8149-d253b56655eb tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:12.769343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b23c89ca-f099-4e5d-8149-d253b56655eb tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:12.773460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b23c89ca-f099-4e5d-8149-d253b56655eb tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:12.822551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-68073203-c83c-4858-9d98-8ec778b0436c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:12.823186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-68073203-c83c-4858-9d98-8ec778b0436c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:12.841596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68073203-c83c-4858-9d98-8ec778b0436c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:12.842573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68073203-c83c-4858-9d98-8ec778b0436c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:12.846595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68073203-c83c-4858-9d98-8ec778b0436c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:12.847570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68073203-c83c-4858-9d98-8ec778b0436c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:12.848212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68073203-c83c-4858-9d98-8ec778b0436c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:12.848809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68073203-c83c-4858-9d98-8ec778b0436c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:13.140570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b23c89ca-f099-4e5d-8149-d253b56655eb tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:13.158137 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b23c89ca-f099-4e5d-8149-d253b56655eb tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 200 len: 1544 microversion: 2.1 time: 0.405040 Oct 29 01:43:13.159345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-68073203-c83c-4858-9d98-8ec778b0436c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:13.168244 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-68073203-c83c-4858-9d98-8ec778b0436c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1487 microversion: 2.1 time: 0.349602 Oct 29 01:43:13.172903 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3212/6664] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:12 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1487 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:13.173297 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3452/6664] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:12 2022] GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 1544 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:13.189056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7ea518c4-5022-46af-ae83-96619816f020 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:13.197698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-79a03c7c-94c1-4e80-be06-b5a6eb2f072d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:13.201655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-79a03c7c-94c1-4e80-be06-b5a6eb2f072d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:13.202700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7ea518c4-5022-46af-ae83-96619816f020 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:13.216312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79a03c7c-94c1-4e80-be06-b5a6eb2f072d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:13.219060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ea518c4-5022-46af-ae83-96619816f020 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:13.219938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79a03c7c-94c1-4e80-be06-b5a6eb2f072d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:13.220558 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79a03c7c-94c1-4e80-be06-b5a6eb2f072d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:13.221542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79a03c7c-94c1-4e80-be06-b5a6eb2f072d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:13.222524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ea518c4-5022-46af-ae83-96619816f020 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:13.228282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79a03c7c-94c1-4e80-be06-b5a6eb2f072d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:13.229228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ea518c4-5022-46af-ae83-96619816f020 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:13.229854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79a03c7c-94c1-4e80-be06-b5a6eb2f072d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:13.230821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ea518c4-5022-46af-ae83-96619816f020 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:13.232640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ea518c4-5022-46af-ae83-96619816f020 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:13.233723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ea518c4-5022-46af-ae83-96619816f020 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:13.310798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:13.329288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-79a03c7c-94c1-4e80-be06-b5a6eb2f072d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lazy-loading 'flavor' on Instance uuid de1df712-231f-4de9-9023-66fab316b565 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:43:13.606551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7ea518c4-5022-46af-ae83-96619816f020 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:13.619731 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7ea518c4-5022-46af-ae83-96619816f020 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 200 len: 1544 microversion: 2.1 time: 0.431020 Oct 29 01:43:13.620559 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3213/6665] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:13 2022] GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 1544 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:13.738292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:14.067767 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-79a03c7c-94c1-4e80-be06-b5a6eb2f072d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565/action" status: 202 len: 0 microversion: 2.1 time: 0.873593 Oct 29 01:43:14.070297 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3453/6666] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:43:13 2022] POST /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565/action => generated 0 bytes in 877 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:43:14.079675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cf9e4027-7496-46d3-bb61-050c2f7ada2b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:14.080053 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cf9e4027-7496-46d3-bb61-050c2f7ada2b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:14.094712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf9e4027-7496-46d3-bb61-050c2f7ada2b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:14.095496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf9e4027-7496-46d3-bb61-050c2f7ada2b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:14.098046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf9e4027-7496-46d3-bb61-050c2f7ada2b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:14.099082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf9e4027-7496-46d3-bb61-050c2f7ada2b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:14.101890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf9e4027-7496-46d3-bb61-050c2f7ada2b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:14.102510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf9e4027-7496-46d3-bb61-050c2f7ada2b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:14.718521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cf9e4027-7496-46d3-bb61-050c2f7ada2b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:14.734130 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cf9e4027-7496-46d3-bb61-050c2f7ada2b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1493 microversion: 2.1 time: 0.659476 Oct 29 01:43:14.735178 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3214/6667] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:14 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1493 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:15.761915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-49142c46-6828-4f0e-aa81-baa9da78e5d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:15.763367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-49142c46-6828-4f0e-aa81-baa9da78e5d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:15.792777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49142c46-6828-4f0e-aa81-baa9da78e5d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:15.793466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49142c46-6828-4f0e-aa81-baa9da78e5d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:15.794006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49142c46-6828-4f0e-aa81-baa9da78e5d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:15.794933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49142c46-6828-4f0e-aa81-baa9da78e5d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:15.796154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49142c46-6828-4f0e-aa81-baa9da78e5d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:15.796882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49142c46-6828-4f0e-aa81-baa9da78e5d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:16.571224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-49142c46-6828-4f0e-aa81-baa9da78e5d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:16.581436 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-49142c46-6828-4f0e-aa81-baa9da78e5d8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1514 microversion: 2.1 time: 0.824962 Oct 29 01:43:16.592499 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3454/6668] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:15 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1514 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:16.732278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cdf9c4a3-0588-4967-a6f6-2170ed729680 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] Calling method '.version_select at 0x7f9d96a34160>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:16.862008 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cdf9c4a3-0588-4967-a6f6-2170ed729680 tempest-TestSecurityGroupsBasicOps-124385350 tempest-TestSecurityGroupsBasicOps-124385350-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-848152334" status: 202 len: 0 microversion: 2.1 time: 0.139486 Oct 29 01:43:16.870387 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3215/6669] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:43:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-848152334 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:43:17.616675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-819909a6-76ef-4b6e-98ef-10e9200b514a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:17.618542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-819909a6-76ef-4b6e-98ef-10e9200b514a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:17.628276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-819909a6-76ef-4b6e-98ef-10e9200b514a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:17.629075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-819909a6-76ef-4b6e-98ef-10e9200b514a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:17.629710 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-819909a6-76ef-4b6e-98ef-10e9200b514a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:17.630797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-819909a6-76ef-4b6e-98ef-10e9200b514a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:17.631591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-819909a6-76ef-4b6e-98ef-10e9200b514a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:17.632186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-819909a6-76ef-4b6e-98ef-10e9200b514a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:17.870927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-819909a6-76ef-4b6e-98ef-10e9200b514a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:17.883145 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-819909a6-76ef-4b6e-98ef-10e9200b514a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1514 microversion: 2.1 time: 0.270224 Oct 29 01:43:17.885297 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3455/6670] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:17 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1514 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:17.999258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-a5d8dc48-f802-4069-8deb-8199837c750d req-e42d3766-2f6d-4b63-9e92-190d6445ba2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e333fe7e-b42e-4135-900a-1c977f223617", "tag": "75f73836-8254-485f-a3cb-2b63990c10cf"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:18.019572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a5d8dc48-f802-4069-8deb-8199837c750d req-e42d3766-2f6d-4b63-9e92-190d6445ba2b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:18.020072 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a5d8dc48-f802-4069-8deb-8199837c750d req-e42d3766-2f6d-4b63-9e92-190d6445ba2b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:18.020515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a5d8dc48-f802-4069-8deb-8199837c750d req-e42d3766-2f6d-4b63-9e92-190d6445ba2b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:18.035595 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-a5d8dc48-f802-4069-8deb-8199837c750d req-e42d3766-2f6d-4b63-9e92-190d6445ba2b service nova] Creating event network-changed:75f73836-8254-485f-a3cb-2b63990c10cf for instance e333fe7e-b42e-4135-900a-1c977f223617 on n-h2-862964-3 Oct 29 01:43:18.043757 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-a5d8dc48-f802-4069-8deb-8199837c750d req-e42d3766-2f6d-4b63-9e92-190d6445ba2b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050436 Oct 29 01:43:18.044614 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3216/6671] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:43:18.129098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aa4a130e-2154-4499-a77e-9c4ba6f74dda tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1125766673", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2d4bdc78-b43f-4e2d-a082-61c221e2ed26", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d488ed61-ddc0-4d3b-9833-017b49869cf3"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:18.273100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-aa4a130e-2154-4499-a77e-9c4ba6f74dda tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] validate_networks() for [('d488ed61-ddc0-4d3b-9833-017b49869cf3', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:43:18.913547 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-651b7742-ae80-402c-a2d1-48fe829080d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:18.926306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-651b7742-ae80-402c-a2d1-48fe829080d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:18.937122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-651b7742-ae80-402c-a2d1-48fe829080d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:18.938246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-651b7742-ae80-402c-a2d1-48fe829080d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:18.939314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-651b7742-ae80-402c-a2d1-48fe829080d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:18.940218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-651b7742-ae80-402c-a2d1-48fe829080d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:18.940846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-651b7742-ae80-402c-a2d1-48fe829080d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:18.941668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-651b7742-ae80-402c-a2d1-48fe829080d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:19.311889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-aa4a130e-2154-4499-a77e-9c4ba6f74dda tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:43:19.312480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-aa4a130e-2154-4499-a77e-9c4ba6f74dda tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:43:19.313414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-aa4a130e-2154-4499-a77e-9c4ba6f74dda tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:43:19.314086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-aa4a130e-2154-4499-a77e-9c4ba6f74dda tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:43:19.314602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-aa4a130e-2154-4499-a77e-9c4ba6f74dda tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:43:19.325699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa4a130e-2154-4499-a77e-9c4ba6f74dda tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:19.326781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa4a130e-2154-4499-a77e-9c4ba6f74dda tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:19.328099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa4a130e-2154-4499-a77e-9c4ba6f74dda tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:19.329146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa4a130e-2154-4499-a77e-9c4ba6f74dda tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:19.329923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa4a130e-2154-4499-a77e-9c4ba6f74dda tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:19.330586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa4a130e-2154-4499-a77e-9c4ba6f74dda tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:19.353898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-aa4a130e-2154-4499-a77e-9c4ba6f74dda tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Getting quotas for project 37416a9397fa4c6dbd0bfe8dee191577. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:43:19.361096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-aa4a130e-2154-4499-a77e-9c4ba6f74dda tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Getting quotas for user 8b8f36d10fa340f784581a3cf9a15606 and project 37416a9397fa4c6dbd0bfe8dee191577. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:43:19.380221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-aa4a130e-2154-4499-a77e-9c4ba6f74dda tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:43:19.383779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-aa4a130e-2154-4499-a77e-9c4ba6f74dda tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2d4bdc78-b43f-4e2d-a082-61c221e2ed26',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:43:19.387032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-651b7742-ae80-402c-a2d1-48fe829080d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:19.402605 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-651b7742-ae80-402c-a2d1-48fe829080d2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1514 microversion: 2.1 time: 0.498296 Oct 29 01:43:19.403202 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3217/6672] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:18 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1514 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:19.544134 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aa4a130e-2154-4499-a77e-9c4ba6f74dda tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.419214 Oct 29 01:43:19.545708 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3456/6673] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:43:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:43:19.557623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cfeadaf4-87cf-41b5-ab27-36c738a4e103 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:19.558207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cfeadaf4-87cf-41b5-ab27-36c738a4e103 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:19.628598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cfeadaf4-87cf-41b5-ab27-36c738a4e103 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:19.657723 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cfeadaf4-87cf-41b5-ab27-36c738a4e103 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1057 microversion: 2.1 time: 0.101854 Oct 29 01:43:19.665016 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3218/6674] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:19 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1057 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:19.977591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-56f1c5cc-ddc4-458c-8c64-a2b330767d19 req-aaf91e55-a879-495f-b607-ebdd4dff7985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1df712-231f-4de9-9023-66fab316b565", "name": "network-vif-plugged", "status": "completed", "tag": "a19b3137-5978-4142-9ac1-161c59e7ec6b"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:19.995643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-56f1c5cc-ddc4-458c-8c64-a2b330767d19 req-aaf91e55-a879-495f-b607-ebdd4dff7985 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:19.997848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-56f1c5cc-ddc4-458c-8c64-a2b330767d19 req-aaf91e55-a879-495f-b607-ebdd4dff7985 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:19.998338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-56f1c5cc-ddc4-458c-8c64-a2b330767d19 req-aaf91e55-a879-495f-b607-ebdd4dff7985 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:20.019745 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-56f1c5cc-ddc4-458c-8c64-a2b330767d19 req-aaf91e55-a879-495f-b607-ebdd4dff7985 service nova] Creating event network-vif-plugged:a19b3137-5978-4142-9ac1-161c59e7ec6b for instance de1df712-231f-4de9-9023-66fab316b565 on n-h1-862964-3 Oct 29 01:43:20.026288 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-56f1c5cc-ddc4-458c-8c64-a2b330767d19 req-aaf91e55-a879-495f-b607-ebdd4dff7985 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053703 Oct 29 01:43:20.032690 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3457/6675] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:43:20.429758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-91c30820-c30b-4337-bb2c-c21aee8d222a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:20.430372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-91c30820-c30b-4337-bb2c-c21aee8d222a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:20.439420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91c30820-c30b-4337-bb2c-c21aee8d222a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:20.439901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91c30820-c30b-4337-bb2c-c21aee8d222a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:20.440554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91c30820-c30b-4337-bb2c-c21aee8d222a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:20.441641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91c30820-c30b-4337-bb2c-c21aee8d222a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:20.442678 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91c30820-c30b-4337-bb2c-c21aee8d222a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:20.443254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-91c30820-c30b-4337-bb2c-c21aee8d222a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:20.629262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-91c30820-c30b-4337-bb2c-c21aee8d222a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:20.639258 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-91c30820-c30b-4337-bb2c-c21aee8d222a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1509 microversion: 2.1 time: 0.213351 Oct 29 01:43:20.640082 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3219/6676] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:20 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1509 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:20.685908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5163293b-e1c1-4086-bbdb-944f0e83cd9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:20.685908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5163293b-e1c1-4086-bbdb-944f0e83cd9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:20.693958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5163293b-e1c1-4086-bbdb-944f0e83cd9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:20.694486 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5163293b-e1c1-4086-bbdb-944f0e83cd9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:20.694925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5163293b-e1c1-4086-bbdb-944f0e83cd9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:20.695692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5163293b-e1c1-4086-bbdb-944f0e83cd9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:20.696244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5163293b-e1c1-4086-bbdb-944f0e83cd9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:20.696735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5163293b-e1c1-4086-bbdb-944f0e83cd9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:20.776924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5163293b-e1c1-4086-bbdb-944f0e83cd9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:20.785713 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5163293b-e1c1-4086-bbdb-944f0e83cd9d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1061 microversion: 2.1 time: 0.107792 Oct 29 01:43:20.786308 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3458/6677] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:20 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1061 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:21.668142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f3cf3bc5-3098-4b3a-93c3-2e109e14d612 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:21.668706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f3cf3bc5-3098-4b3a-93c3-2e109e14d612 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:21.678081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3cf3bc5-3098-4b3a-93c3-2e109e14d612 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:21.678911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3cf3bc5-3098-4b3a-93c3-2e109e14d612 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:21.679859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3cf3bc5-3098-4b3a-93c3-2e109e14d612 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:21.681252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3cf3bc5-3098-4b3a-93c3-2e109e14d612 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:21.682358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3cf3bc5-3098-4b3a-93c3-2e109e14d612 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:21.683262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3cf3bc5-3098-4b3a-93c3-2e109e14d612 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:21.810117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aa9784a8-a18f-4c88-a9b0-06e74fc4d552 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:21.812251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-aa9784a8-a18f-4c88-a9b0-06e74fc4d552 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:21.834207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa9784a8-a18f-4c88-a9b0-06e74fc4d552 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:21.835810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa9784a8-a18f-4c88-a9b0-06e74fc4d552 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:21.836601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa9784a8-a18f-4c88-a9b0-06e74fc4d552 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:21.840327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa9784a8-a18f-4c88-a9b0-06e74fc4d552 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:21.845693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa9784a8-a18f-4c88-a9b0-06e74fc4d552 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:21.846279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aa9784a8-a18f-4c88-a9b0-06e74fc4d552 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:21.930121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f3cf3bc5-3098-4b3a-93c3-2e109e14d612 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:21.945207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-aa9784a8-a18f-4c88-a9b0-06e74fc4d552 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:21.949071 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f3cf3bc5-3098-4b3a-93c3-2e109e14d612 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1509 microversion: 2.1 time: 0.282755 Oct 29 01:43:21.949071 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3220/6678] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:21 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1509 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:21.965814 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aa9784a8-a18f-4c88-a9b0-06e74fc4d552 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1109 microversion: 2.1 time: 0.160690 Oct 29 01:43:21.966698 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3459/6679] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:21 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1109 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:22.977141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-555add9b-fa20-411b-a9e0-0819362a1127 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:22.978181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-555add9b-fa20-411b-a9e0-0819362a1127 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:22.992068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1b35cc9d-fc44-4f7e-b290-4f0d51317adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:22.994213 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1b35cc9d-fc44-4f7e-b290-4f0d51317adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:23.003158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b35cc9d-fc44-4f7e-b290-4f0d51317adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:23.004117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b35cc9d-fc44-4f7e-b290-4f0d51317adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:23.004809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b35cc9d-fc44-4f7e-b290-4f0d51317adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:23.005903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b35cc9d-fc44-4f7e-b290-4f0d51317adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:23.012263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-555add9b-fa20-411b-a9e0-0819362a1127 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:23.012263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-555add9b-fa20-411b-a9e0-0819362a1127 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:23.012263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-555add9b-fa20-411b-a9e0-0819362a1127 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:23.016379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-555add9b-fa20-411b-a9e0-0819362a1127 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:23.017612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-555add9b-fa20-411b-a9e0-0819362a1127 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:23.020996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b35cc9d-fc44-4f7e-b290-4f0d51317adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:23.022087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1b35cc9d-fc44-4f7e-b290-4f0d51317adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:23.024304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-555add9b-fa20-411b-a9e0-0819362a1127 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:23.255731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1b35cc9d-fc44-4f7e-b290-4f0d51317adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:23.270835 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1b35cc9d-fc44-4f7e-b290-4f0d51317adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1127 microversion: 2.1 time: 0.281782 Oct 29 01:43:23.288170 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3460/6680] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:22 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1127 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:23.436829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-555add9b-fa20-411b-a9e0-0819362a1127 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:23.451990 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-555add9b-fa20-411b-a9e0-0819362a1127 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1509 microversion: 2.1 time: 0.478990 Oct 29 01:43:23.453996 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3221/6681] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:22 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1509 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:24.313192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d64b0abc-e398-49cc-96e4-53c3745f637a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:24.313622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d64b0abc-e398-49cc-96e4-53c3745f637a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:24.327033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d64b0abc-e398-49cc-96e4-53c3745f637a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:24.327540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d64b0abc-e398-49cc-96e4-53c3745f637a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:24.327995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d64b0abc-e398-49cc-96e4-53c3745f637a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:24.330090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d64b0abc-e398-49cc-96e4-53c3745f637a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:24.331638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d64b0abc-e398-49cc-96e4-53c3745f637a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:24.332088 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d64b0abc-e398-49cc-96e4-53c3745f637a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:24.483838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7ad1d757-9102-40f3-ba6a-3e98b507cc2a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:24.485929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7ad1d757-9102-40f3-ba6a-3e98b507cc2a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:24.519283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ad1d757-9102-40f3-ba6a-3e98b507cc2a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:24.520246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ad1d757-9102-40f3-ba6a-3e98b507cc2a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:24.521821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ad1d757-9102-40f3-ba6a-3e98b507cc2a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:24.522945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ad1d757-9102-40f3-ba6a-3e98b507cc2a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:24.536145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ad1d757-9102-40f3-ba6a-3e98b507cc2a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:24.538093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ad1d757-9102-40f3-ba6a-3e98b507cc2a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:24.996550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d64b0abc-e398-49cc-96e4-53c3745f637a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:25.008542 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d64b0abc-e398-49cc-96e4-53c3745f637a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.700939 Oct 29 01:43:25.016442 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3461/6682] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:24 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:25.267172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7ad1d757-9102-40f3-ba6a-3e98b507cc2a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:25.288721 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7ad1d757-9102-40f3-ba6a-3e98b507cc2a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1509 microversion: 2.1 time: 0.811863 Oct 29 01:43:25.292590 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3222/6683] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:24 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1509 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:25.831473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-827d525a-2bdf-4a23-80f1-78c85a365045 req-ff74abff-c1df-43ea-99a1-544fc8fbc352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7511379-4e9b-42ac-b0cb-5d36bdc57833", "tag": "675e73c0-ab5f-49f9-992c-d4e6fee042ae"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:25.862511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-827d525a-2bdf-4a23-80f1-78c85a365045 req-ff74abff-c1df-43ea-99a1-544fc8fbc352 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:25.863008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-827d525a-2bdf-4a23-80f1-78c85a365045 req-ff74abff-c1df-43ea-99a1-544fc8fbc352 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:25.874161 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-827d525a-2bdf-4a23-80f1-78c85a365045 req-ff74abff-c1df-43ea-99a1-544fc8fbc352 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:25.918375 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-827d525a-2bdf-4a23-80f1-78c85a365045 req-ff74abff-c1df-43ea-99a1-544fc8fbc352 service nova] Creating event network-changed:675e73c0-ab5f-49f9-992c-d4e6fee042ae for instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 on n-h1-862964-3 Oct 29 01:43:25.944784 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-827d525a-2bdf-4a23-80f1-78c85a365045 req-ff74abff-c1df-43ea-99a1-544fc8fbc352 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117877 Oct 29 01:43:25.947211 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3462/6684] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:43:26.038904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-becf24e0-e1fd-406f-bb1b-8be4e6f9045e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:26.039529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-becf24e0-e1fd-406f-bb1b-8be4e6f9045e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:26.042466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:26.060704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-becf24e0-e1fd-406f-bb1b-8be4e6f9045e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:26.065781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-becf24e0-e1fd-406f-bb1b-8be4e6f9045e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:26.066222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-becf24e0-e1fd-406f-bb1b-8be4e6f9045e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:26.067010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-becf24e0-e1fd-406f-bb1b-8be4e6f9045e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:26.067746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-becf24e0-e1fd-406f-bb1b-8be4e6f9045e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:26.068187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-becf24e0-e1fd-406f-bb1b-8be4e6f9045e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:26.321091 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-41919967-dbd9-4f70-9436-015b7b8d5859 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:26.322068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-41919967-dbd9-4f70-9436-015b7b8d5859 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:26.330985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41919967-dbd9-4f70-9436-015b7b8d5859 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:26.331472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41919967-dbd9-4f70-9436-015b7b8d5859 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:26.331935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41919967-dbd9-4f70-9436-015b7b8d5859 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:26.332671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41919967-dbd9-4f70-9436-015b7b8d5859 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:26.333130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41919967-dbd9-4f70-9436-015b7b8d5859 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:26.336508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41919967-dbd9-4f70-9436-015b7b8d5859 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:26.433978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-becf24e0-e1fd-406f-bb1b-8be4e6f9045e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:26.443319 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-becf24e0-e1fd-406f-bb1b-8be4e6f9045e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.408594 Oct 29 01:43:26.456312 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3223/6685] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:26 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:27.061921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-41919967-dbd9-4f70-9436-015b7b8d5859 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:27.094481 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-41919967-dbd9-4f70-9436-015b7b8d5859 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1509 microversion: 2.1 time: 0.761776 Oct 29 01:43:27.095151 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3463/6686] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:26 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1509 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:27.489935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fc358b76-9336-41c2-9553-36cc7f5b58d2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:27.491506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fc358b76-9336-41c2-9553-36cc7f5b58d2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:27.508941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc358b76-9336-41c2-9553-36cc7f5b58d2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:27.529134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc358b76-9336-41c2-9553-36cc7f5b58d2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:27.530549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc358b76-9336-41c2-9553-36cc7f5b58d2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:27.543176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc358b76-9336-41c2-9553-36cc7f5b58d2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:27.547091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc358b76-9336-41c2-9553-36cc7f5b58d2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:27.548006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fc358b76-9336-41c2-9553-36cc7f5b58d2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:28.004639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fc358b76-9336-41c2-9553-36cc7f5b58d2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:28.013233 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fc358b76-9336-41c2-9553-36cc7f5b58d2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.531573 Oct 29 01:43:28.026488 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3224/6687] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:27 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:28.136233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9d77838e-a145-4036-b452-74e80e7198de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:28.144928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9d77838e-a145-4036-b452-74e80e7198de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:28.150412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=76 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:28.161511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d77838e-a145-4036-b452-74e80e7198de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:28.163635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d77838e-a145-4036-b452-74e80e7198de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:28.164635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d77838e-a145-4036-b452-74e80e7198de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:28.169144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d77838e-a145-4036-b452-74e80e7198de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:28.170199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d77838e-a145-4036-b452-74e80e7198de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:28.172218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d77838e-a145-4036-b452-74e80e7198de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:28.519818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9d77838e-a145-4036-b452-74e80e7198de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:28.551086 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9d77838e-a145-4036-b452-74e80e7198de tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1509 microversion: 2.1 time: 0.400699 Oct 29 01:43:28.551086 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3464/6688] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:28 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1509 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:29.071342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-982c7ba6-ae33-49a0-87d1-207b1fd87705 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:29.072704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-982c7ba6-ae33-49a0-87d1-207b1fd87705 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:29.092974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-982c7ba6-ae33-49a0-87d1-207b1fd87705 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:29.092974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-982c7ba6-ae33-49a0-87d1-207b1fd87705 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:29.092974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-982c7ba6-ae33-49a0-87d1-207b1fd87705 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:29.092974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-982c7ba6-ae33-49a0-87d1-207b1fd87705 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:29.093706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-982c7ba6-ae33-49a0-87d1-207b1fd87705 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:29.094329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-982c7ba6-ae33-49a0-87d1-207b1fd87705 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:29.325819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-982c7ba6-ae33-49a0-87d1-207b1fd87705 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:29.337905 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-982c7ba6-ae33-49a0-87d1-207b1fd87705 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.272030 Oct 29 01:43:29.338512 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3225/6689] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:29 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:29.572472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9ac44f8e-83cf-44d1-a3f7-3879ff46cc4f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:29.578409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9ac44f8e-83cf-44d1-a3f7-3879ff46cc4f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:29.588674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:29.589790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:29.591947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ac44f8e-83cf-44d1-a3f7-3879ff46cc4f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:29.593924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ac44f8e-83cf-44d1-a3f7-3879ff46cc4f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:29.594925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ac44f8e-83cf-44d1-a3f7-3879ff46cc4f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:29.595898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ac44f8e-83cf-44d1-a3f7-3879ff46cc4f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:29.599974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ac44f8e-83cf-44d1-a3f7-3879ff46cc4f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:29.601472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ac44f8e-83cf-44d1-a3f7-3879ff46cc4f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:29.834694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9ac44f8e-83cf-44d1-a3f7-3879ff46cc4f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:29.848904 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9ac44f8e-83cf-44d1-a3f7-3879ff46cc4f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1509 microversion: 2.1 time: 0.285053 Oct 29 01:43:29.863209 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3465/6690] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:29 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1509 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:30.374323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-29326c1d-f1f7-41f0-b57e-3b33daa39aea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:30.388950 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-29326c1d-f1f7-41f0-b57e-3b33daa39aea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:30.392834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:30.410318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29326c1d-f1f7-41f0-b57e-3b33daa39aea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:30.417523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29326c1d-f1f7-41f0-b57e-3b33daa39aea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:30.417523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29326c1d-f1f7-41f0-b57e-3b33daa39aea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:30.417523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29326c1d-f1f7-41f0-b57e-3b33daa39aea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:30.417523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29326c1d-f1f7-41f0-b57e-3b33daa39aea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:30.417523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29326c1d-f1f7-41f0-b57e-3b33daa39aea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:30.887491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7966b45e-a08c-4f6f-bc8e-fc8a35d4c57a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:30.888538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-29326c1d-f1f7-41f0-b57e-3b33daa39aea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:30.888694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7966b45e-a08c-4f6f-bc8e-fc8a35d4c57a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:30.903963 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-29326c1d-f1f7-41f0-b57e-3b33daa39aea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.534405 Oct 29 01:43:30.906149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7966b45e-a08c-4f6f-bc8e-fc8a35d4c57a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:30.907328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7966b45e-a08c-4f6f-bc8e-fc8a35d4c57a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:30.907556 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3226/6691] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:30 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:30.908473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7966b45e-a08c-4f6f-bc8e-fc8a35d4c57a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:30.909989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7966b45e-a08c-4f6f-bc8e-fc8a35d4c57a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:30.910676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7966b45e-a08c-4f6f-bc8e-fc8a35d4c57a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:30.911319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7966b45e-a08c-4f6f-bc8e-fc8a35d4c57a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:31.348092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7966b45e-a08c-4f6f-bc8e-fc8a35d4c57a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:31.364138 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7966b45e-a08c-4f6f-bc8e-fc8a35d4c57a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1509 microversion: 2.1 time: 0.476634 Oct 29 01:43:31.364138 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3466/6692] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:30 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1509 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:31.955431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8c722959-fe8b-404f-aa3a-33af9a29b7a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:31.956939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8c722959-fe8b-404f-aa3a-33af9a29b7a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:32.002733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c722959-fe8b-404f-aa3a-33af9a29b7a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:32.003597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c722959-fe8b-404f-aa3a-33af9a29b7a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:32.005749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c722959-fe8b-404f-aa3a-33af9a29b7a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:32.007116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c722959-fe8b-404f-aa3a-33af9a29b7a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:32.008313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c722959-fe8b-404f-aa3a-33af9a29b7a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:32.012873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8c722959-fe8b-404f-aa3a-33af9a29b7a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:32.396542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8c722959-fe8b-404f-aa3a-33af9a29b7a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:32.432302 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8c722959-fe8b-404f-aa3a-33af9a29b7a8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.503968 Oct 29 01:43:32.433579 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3227/6693] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:31 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:32.442699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3a03d291-a4bd-4b40-bf74-a99f6b3486e5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:32.444069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3a03d291-a4bd-4b40-bf74-a99f6b3486e5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:32.453980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a03d291-a4bd-4b40-bf74-a99f6b3486e5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:32.455122 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a03d291-a4bd-4b40-bf74-a99f6b3486e5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:32.457051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a03d291-a4bd-4b40-bf74-a99f6b3486e5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:32.457988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a03d291-a4bd-4b40-bf74-a99f6b3486e5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:32.460000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a03d291-a4bd-4b40-bf74-a99f6b3486e5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:32.461435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3a03d291-a4bd-4b40-bf74-a99f6b3486e5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:32.579324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7a271deb-6f89-4b21-a342-b573e64d678d tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-2021787862", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "8527d325-33cf-4fbc-bdc2-baa841b18d21"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:32.695594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-7a271deb-6f89-4b21-a342-b573e64d678d tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] validate_networks() for [('8527d325-33cf-4fbc-bdc2-baa841b18d21', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:43:32.733382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3a03d291-a4bd-4b40-bf74-a99f6b3486e5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:32.743464 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3a03d291-a4bd-4b40-bf74-a99f6b3486e5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1509 microversion: 2.1 time: 0.308135 Oct 29 01:43:32.749072 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3228/6694] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:32 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1509 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:33.469277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bfe7f5f3-c433-4c59-a989-cff6e8dbb2ca tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:33.469923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bfe7f5f3-c433-4c59-a989-cff6e8dbb2ca tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:33.478662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfe7f5f3-c433-4c59-a989-cff6e8dbb2ca tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:33.492404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfe7f5f3-c433-4c59-a989-cff6e8dbb2ca tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:33.493219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfe7f5f3-c433-4c59-a989-cff6e8dbb2ca tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:33.494428 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfe7f5f3-c433-4c59-a989-cff6e8dbb2ca tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:33.496248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfe7f5f3-c433-4c59-a989-cff6e8dbb2ca tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:33.496952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfe7f5f3-c433-4c59-a989-cff6e8dbb2ca tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:33.701754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7a271deb-6f89-4b21-a342-b573e64d678d tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:43:33.702777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7a271deb-6f89-4b21-a342-b573e64d678d tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:43:33.703317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7a271deb-6f89-4b21-a342-b573e64d678d tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:43:33.704055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7a271deb-6f89-4b21-a342-b573e64d678d tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:43:33.704707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-7a271deb-6f89-4b21-a342-b573e64d678d tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:43:33.714883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a271deb-6f89-4b21-a342-b573e64d678d tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:33.715467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a271deb-6f89-4b21-a342-b573e64d678d tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:33.715982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a271deb-6f89-4b21-a342-b573e64d678d tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:33.716825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a271deb-6f89-4b21-a342-b573e64d678d tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:33.717840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a271deb-6f89-4b21-a342-b573e64d678d tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:33.718418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7a271deb-6f89-4b21-a342-b573e64d678d tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:33.738563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bfe7f5f3-c433-4c59-a989-cff6e8dbb2ca tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:33.744431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-7a271deb-6f89-4b21-a342-b573e64d678d tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Getting quotas for project 8f3b9a58277d448e919118acab484963. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:43:33.746479 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bfe7f5f3-c433-4c59-a989-cff6e8dbb2ca tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.288300 Oct 29 01:43:33.747330 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3229/6695] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:33 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:33.751524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-7a271deb-6f89-4b21-a342-b573e64d678d tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Getting quotas for user a1064057756b4122914be361bd62708f and project 8f3b9a58277d448e919118acab484963. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:43:33.766227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7a271deb-6f89-4b21-a342-b573e64d678d tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:43:33.769366 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7a271deb-6f89-4b21-a342-b573e64d678d tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:43:33.773730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2807aeae-9968-4b69-a85a-bfdcece773bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:33.774289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2807aeae-9968-4b69-a85a-bfdcece773bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:33.780292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2807aeae-9968-4b69-a85a-bfdcece773bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:33.780784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2807aeae-9968-4b69-a85a-bfdcece773bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:33.781256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2807aeae-9968-4b69-a85a-bfdcece773bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:33.782032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2807aeae-9968-4b69-a85a-bfdcece773bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:33.782492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2807aeae-9968-4b69-a85a-bfdcece773bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:33.782917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2807aeae-9968-4b69-a85a-bfdcece773bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:33.929839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2807aeae-9968-4b69-a85a-bfdcece773bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:33.930791 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2807aeae-9968-4b69-a85a-bfdcece773bd tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1509 microversion: 2.1 time: 0.160304 Oct 29 01:43:33.931642 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3230/6696] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:33 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:34.079095 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7a271deb-6f89-4b21-a342-b573e64d678d tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.758499 Oct 29 01:43:34.080459 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3467/6697] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:43:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:43:34.092076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-508b7f8b-1b01-4d2a-a821-c26a84817ce6 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:34.093845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-508b7f8b-1b01-4d2a-a821-c26a84817ce6 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:34.222742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-508b7f8b-1b01-4d2a-a821-c26a84817ce6 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:34.230105 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-508b7f8b-1b01-4d2a-a821-c26a84817ce6 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1215 microversion: 2.1 time: 0.142269 Oct 29 01:43:34.252393 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3231/6698] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:34 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:34.772508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6d109234-f327-4174-affe-722acb19898b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:34.773293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6d109234-f327-4174-affe-722acb19898b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:34.784564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d109234-f327-4174-affe-722acb19898b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:34.785389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d109234-f327-4174-affe-722acb19898b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:34.786054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d109234-f327-4174-affe-722acb19898b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:34.788502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d109234-f327-4174-affe-722acb19898b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:34.789334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d109234-f327-4174-affe-722acb19898b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:34.791677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6d109234-f327-4174-affe-722acb19898b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:34.956445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-49a06666-cde2-4081-b33c-5131347ea115 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:34.957062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-49a06666-cde2-4081-b33c-5131347ea115 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:34.974084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49a06666-cde2-4081-b33c-5131347ea115 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:34.977451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49a06666-cde2-4081-b33c-5131347ea115 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:34.978113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49a06666-cde2-4081-b33c-5131347ea115 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:34.979045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49a06666-cde2-4081-b33c-5131347ea115 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:34.979670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49a06666-cde2-4081-b33c-5131347ea115 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:34.981738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49a06666-cde2-4081-b33c-5131347ea115 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:35.044539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6d109234-f327-4174-affe-722acb19898b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:35.061917 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6d109234-f327-4174-affe-722acb19898b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.294498 Oct 29 01:43:35.062530 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3468/6699] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:34 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:35.218510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-49a06666-cde2-4081-b33c-5131347ea115 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:35.228697 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-49a06666-cde2-4081-b33c-5131347ea115 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1509 microversion: 2.1 time: 0.276450 Oct 29 01:43:35.229739 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3232/6700] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:34 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1509 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:35.261706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0901155f-da9a-4bc0-9603-c0460c741bab tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:35.262728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0901155f-da9a-4bc0-9603-c0460c741bab tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:35.377453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0901155f-da9a-4bc0-9603-c0460c741bab tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:35.387992 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0901155f-da9a-4bc0-9603-c0460c741bab tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1215 microversion: 2.1 time: 0.128664 Oct 29 01:43:35.401184 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3469/6701] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:35 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1215 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:36.087995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9d03aa0b-9684-4c47-95ac-3230720dbc59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:36.088632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9d03aa0b-9684-4c47-95ac-3230720dbc59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:36.111339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d03aa0b-9684-4c47-95ac-3230720dbc59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:36.112468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d03aa0b-9684-4c47-95ac-3230720dbc59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:36.115449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d03aa0b-9684-4c47-95ac-3230720dbc59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:36.115449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d03aa0b-9684-4c47-95ac-3230720dbc59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:36.115449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d03aa0b-9684-4c47-95ac-3230720dbc59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:36.115449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d03aa0b-9684-4c47-95ac-3230720dbc59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:36.265455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b0bc6614-5dea-42f9-b778-3b503eed49ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:36.266808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b0bc6614-5dea-42f9-b778-3b503eed49ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:36.275990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0bc6614-5dea-42f9-b778-3b503eed49ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:36.278516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0bc6614-5dea-42f9-b778-3b503eed49ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:36.281839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0bc6614-5dea-42f9-b778-3b503eed49ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:36.282175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0bc6614-5dea-42f9-b778-3b503eed49ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:36.282794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0bc6614-5dea-42f9-b778-3b503eed49ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:36.283388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0bc6614-5dea-42f9-b778-3b503eed49ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:36.412651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9d03aa0b-9684-4c47-95ac-3230720dbc59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:36.426985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:36.446913 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9d03aa0b-9684-4c47-95ac-3230720dbc59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.346794 Oct 29 01:43:36.471437 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3233/6702] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:36 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:36.488476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-564b1855-5976-458f-8947-1eeae67c5d5f tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:36.489515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-564b1855-5976-458f-8947-1eeae67c5d5f tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:36.521062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-564b1855-5976-458f-8947-1eeae67c5d5f tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:36.523954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-564b1855-5976-458f-8947-1eeae67c5d5f tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:36.523954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-564b1855-5976-458f-8947-1eeae67c5d5f tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:36.523954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-564b1855-5976-458f-8947-1eeae67c5d5f tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:36.523954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-564b1855-5976-458f-8947-1eeae67c5d5f tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:36.540180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-564b1855-5976-458f-8947-1eeae67c5d5f tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:36.550323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b0bc6614-5dea-42f9-b778-3b503eed49ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:36.573491 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b0bc6614-5dea-42f9-b778-3b503eed49ce tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1509 microversion: 2.1 time: 0.316611 Oct 29 01:43:36.574653 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3470/6703] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:36 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1509 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:36.646763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-564b1855-5976-458f-8947-1eeae67c5d5f tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:36.662329 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-564b1855-5976-458f-8947-1eeae67c5d5f tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1211 microversion: 2.1 time: 0.188653 Oct 29 01:43:36.680202 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3234/6704] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:36 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1211 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:37.483954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b0d7bb64-cb12-4a6c-ae4c-4909f2716e36 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:37.485087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b0d7bb64-cb12-4a6c-ae4c-4909f2716e36 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:37.492099 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0d7bb64-cb12-4a6c-ae4c-4909f2716e36 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:37.493060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0d7bb64-cb12-4a6c-ae4c-4909f2716e36 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:37.493767 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0d7bb64-cb12-4a6c-ae4c-4909f2716e36 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:37.494704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0d7bb64-cb12-4a6c-ae4c-4909f2716e36 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:37.495887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0d7bb64-cb12-4a6c-ae4c-4909f2716e36 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:37.497839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b0d7bb64-cb12-4a6c-ae4c-4909f2716e36 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:37.602398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-afe47a50-5929-4099-9ee8-2b391591cad4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:37.603844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-afe47a50-5929-4099-9ee8-2b391591cad4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:37.621267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afe47a50-5929-4099-9ee8-2b391591cad4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:37.626899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afe47a50-5929-4099-9ee8-2b391591cad4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:37.629174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afe47a50-5929-4099-9ee8-2b391591cad4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:37.630153 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afe47a50-5929-4099-9ee8-2b391591cad4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:37.632119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afe47a50-5929-4099-9ee8-2b391591cad4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:37.639695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afe47a50-5929-4099-9ee8-2b391591cad4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:37.863369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b0d7bb64-cb12-4a6c-ae4c-4909f2716e36 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:37.881670 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b0d7bb64-cb12-4a6c-ae4c-4909f2716e36 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.407432 Oct 29 01:43:37.883069 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3471/6705] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:37 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:37.905966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-84f9ac43-e0a0-48dc-8e7b-3c675a3990a7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:37.905966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-84f9ac43-e0a0-48dc-8e7b-3c675a3990a7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:37.918574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84f9ac43-e0a0-48dc-8e7b-3c675a3990a7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:37.919224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84f9ac43-e0a0-48dc-8e7b-3c675a3990a7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:37.919762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84f9ac43-e0a0-48dc-8e7b-3c675a3990a7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:37.921533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84f9ac43-e0a0-48dc-8e7b-3c675a3990a7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:37.922383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84f9ac43-e0a0-48dc-8e7b-3c675a3990a7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:37.923350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84f9ac43-e0a0-48dc-8e7b-3c675a3990a7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:38.057496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-afe47a50-5929-4099-9ee8-2b391591cad4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:38.071051 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-afe47a50-5929-4099-9ee8-2b391591cad4 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1509 microversion: 2.1 time: 0.475166 Oct 29 01:43:38.073354 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3235/6706] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:37 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1509 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:38.094335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-84f9ac43-e0a0-48dc-8e7b-3c675a3990a7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:38.111693 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-84f9ac43-e0a0-48dc-8e7b-3c675a3990a7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1275 microversion: 2.1 time: 0.226575 Oct 29 01:43:38.112354 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3472/6707] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:37 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1275 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:38.915025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c6f5457e-e929-4cd4-b5d2-3d8e5dd56faf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:38.915650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c6f5457e-e929-4cd4-b5d2-3d8e5dd56faf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:38.949966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f5457e-e929-4cd4-b5d2-3d8e5dd56faf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:38.957207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f5457e-e929-4cd4-b5d2-3d8e5dd56faf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:38.959638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f5457e-e929-4cd4-b5d2-3d8e5dd56faf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:38.960574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f5457e-e929-4cd4-b5d2-3d8e5dd56faf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:38.962391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f5457e-e929-4cd4-b5d2-3d8e5dd56faf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:38.966173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c6f5457e-e929-4cd4-b5d2-3d8e5dd56faf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:39.117728 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f5432d0-7f15-4c09-af67-b141acac7990 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:39.118364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1f5432d0-7f15-4c09-af67-b141acac7990 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:39.141607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f5432d0-7f15-4c09-af67-b141acac7990 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:39.141607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f5432d0-7f15-4c09-af67-b141acac7990 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:39.141607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f5432d0-7f15-4c09-af67-b141acac7990 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:39.141607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f5432d0-7f15-4c09-af67-b141acac7990 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:39.141607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f5432d0-7f15-4c09-af67-b141acac7990 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:39.141607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f5432d0-7f15-4c09-af67-b141acac7990 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:39.429261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c6f5457e-e929-4cd4-b5d2-3d8e5dd56faf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:39.440708 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c6f5457e-e929-4cd4-b5d2-3d8e5dd56faf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.538295 Oct 29 01:43:39.473344 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3236/6708] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:38 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:39.473344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ab274ffc-0c23-4955-965a-9523466aaf6b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:39.473344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ab274ffc-0c23-4955-965a-9523466aaf6b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:39.479148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab274ffc-0c23-4955-965a-9523466aaf6b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:39.484218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab274ffc-0c23-4955-965a-9523466aaf6b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:39.484218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab274ffc-0c23-4955-965a-9523466aaf6b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:39.484218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab274ffc-0c23-4955-965a-9523466aaf6b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:39.484218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab274ffc-0c23-4955-965a-9523466aaf6b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:39.484218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab274ffc-0c23-4955-965a-9523466aaf6b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:39.518712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1f5432d0-7f15-4c09-af67-b141acac7990 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:39.535999 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1f5432d0-7f15-4c09-af67-b141acac7990 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1509 microversion: 2.1 time: 0.438409 Oct 29 01:43:39.553289 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3473/6709] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:39 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1509 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:39.791789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ab274ffc-0c23-4955-965a-9523466aaf6b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:39.798053 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ab274ffc-0c23-4955-965a-9523466aaf6b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1315 microversion: 2.1 time: 0.354695 Oct 29 01:43:39.809522 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3237/6710] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:39 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:40.467038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1881a4c8-40a8-4461-8096-ec182b4462cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:40.468546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1881a4c8-40a8-4461-8096-ec182b4462cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:40.475695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1881a4c8-40a8-4461-8096-ec182b4462cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:40.476177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1881a4c8-40a8-4461-8096-ec182b4462cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:40.478992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1881a4c8-40a8-4461-8096-ec182b4462cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:40.478992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1881a4c8-40a8-4461-8096-ec182b4462cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:40.478992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1881a4c8-40a8-4461-8096-ec182b4462cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:40.478992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1881a4c8-40a8-4461-8096-ec182b4462cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:40.483985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:40.564082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d7340266-b2ca-49b6-8550-0c61c568b21f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:40.565453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d7340266-b2ca-49b6-8550-0c61c568b21f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:40.578177 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7340266-b2ca-49b6-8550-0c61c568b21f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:40.578891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7340266-b2ca-49b6-8550-0c61c568b21f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:40.579484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7340266-b2ca-49b6-8550-0c61c568b21f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:40.580519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7340266-b2ca-49b6-8550-0c61c568b21f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:40.581130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7340266-b2ca-49b6-8550-0c61c568b21f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:40.581865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7340266-b2ca-49b6-8550-0c61c568b21f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:40.902443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1881a4c8-40a8-4461-8096-ec182b4462cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:40.916266 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1881a4c8-40a8-4461-8096-ec182b4462cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.453006 Oct 29 01:43:40.930040 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3474/6711] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:40 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:40.941694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-85e870d1-a41e-4122-9f67-ff34304d0f17 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:40.943509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-85e870d1-a41e-4122-9f67-ff34304d0f17 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:40.954268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85e870d1-a41e-4122-9f67-ff34304d0f17 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:40.954939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85e870d1-a41e-4122-9f67-ff34304d0f17 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:40.955794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85e870d1-a41e-4122-9f67-ff34304d0f17 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:40.956833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85e870d1-a41e-4122-9f67-ff34304d0f17 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:40.957993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85e870d1-a41e-4122-9f67-ff34304d0f17 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:40.958917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-85e870d1-a41e-4122-9f67-ff34304d0f17 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:41.310285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d7340266-b2ca-49b6-8550-0c61c568b21f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:41.331858 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d7340266-b2ca-49b6-8550-0c61c568b21f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1509 microversion: 2.1 time: 0.772400 Oct 29 01:43:41.355472 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3238/6712] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:40 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1509 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:41.477459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-85e870d1-a41e-4122-9f67-ff34304d0f17 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:41.495398 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-85e870d1-a41e-4122-9f67-ff34304d0f17 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1315 microversion: 2.1 time: 0.563524 Oct 29 01:43:41.497486 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3475/6713] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:40 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:41.635329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-2c2fca45-5536-4fd9-ae53-9b988a865358 req-5c8d3f54-4d2e-40cd-a749-683101f2fa58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "548bfbb3-44d9-439b-8961-49a31cb98d3a", "tag": "1b03c813-184d-4b07-b7e8-b8d30701d5ad"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:41.664826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2c2fca45-5536-4fd9-ae53-9b988a865358 req-5c8d3f54-4d2e-40cd-a749-683101f2fa58 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:41.665749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2c2fca45-5536-4fd9-ae53-9b988a865358 req-5c8d3f54-4d2e-40cd-a749-683101f2fa58 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:41.671929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2c2fca45-5536-4fd9-ae53-9b988a865358 req-5c8d3f54-4d2e-40cd-a749-683101f2fa58 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:41.684653 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-2c2fca45-5536-4fd9-ae53-9b988a865358 req-5c8d3f54-4d2e-40cd-a749-683101f2fa58 service nova] Creating event network-changed:1b03c813-184d-4b07-b7e8-b8d30701d5ad for instance 548bfbb3-44d9-439b-8961-49a31cb98d3a on n-h1-862964-3 Oct 29 01:43:41.691096 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-2c2fca45-5536-4fd9-ae53-9b988a865358 req-5c8d3f54-4d2e-40cd-a749-683101f2fa58 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063153 Oct 29 01:43:41.691886 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3239/6714] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:43:41.946449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-366c5d1a-da62-4c85-8293-74f5b276705d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:41.947294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-366c5d1a-da62-4c85-8293-74f5b276705d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:41.959148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-366c5d1a-da62-4c85-8293-74f5b276705d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:41.959906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-366c5d1a-da62-4c85-8293-74f5b276705d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:41.960484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-366c5d1a-da62-4c85-8293-74f5b276705d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:41.961563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-366c5d1a-da62-4c85-8293-74f5b276705d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:41.962168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-366c5d1a-da62-4c85-8293-74f5b276705d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:41.962751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-366c5d1a-da62-4c85-8293-74f5b276705d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:42.182895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-366c5d1a-da62-4c85-8293-74f5b276705d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:42.193048 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-366c5d1a-da62-4c85-8293-74f5b276705d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.250332 Oct 29 01:43:42.193803 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3476/6715] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:41 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:42.364719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f9cdc32f-3690-4230-9ff3-37d886cd01a8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:42.367868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f9cdc32f-3690-4230-9ff3-37d886cd01a8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:42.381750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9cdc32f-3690-4230-9ff3-37d886cd01a8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:42.382167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9cdc32f-3690-4230-9ff3-37d886cd01a8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:42.382615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9cdc32f-3690-4230-9ff3-37d886cd01a8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:42.384652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9cdc32f-3690-4230-9ff3-37d886cd01a8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:42.385147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9cdc32f-3690-4230-9ff3-37d886cd01a8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:42.385821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9cdc32f-3690-4230-9ff3-37d886cd01a8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:42.527304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-33c4e4af-b1e9-42df-9e2d-cef7734d2792 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:42.527919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-33c4e4af-b1e9-42df-9e2d-cef7734d2792 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:42.540344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33c4e4af-b1e9-42df-9e2d-cef7734d2792 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:42.541201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33c4e4af-b1e9-42df-9e2d-cef7734d2792 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:42.541766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33c4e4af-b1e9-42df-9e2d-cef7734d2792 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:42.542764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33c4e4af-b1e9-42df-9e2d-cef7734d2792 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:42.543332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33c4e4af-b1e9-42df-9e2d-cef7734d2792 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:42.544002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33c4e4af-b1e9-42df-9e2d-cef7734d2792 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:42.561885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f9cdc32f-3690-4230-9ff3-37d886cd01a8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:42.576455 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f9cdc32f-3690-4230-9ff3-37d886cd01a8 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1506 microversion: 2.1 time: 0.217008 Oct 29 01:43:42.592750 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3240/6716] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:42 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:42.704184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-33c4e4af-b1e9-42df-9e2d-cef7734d2792 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:42.712848 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-33c4e4af-b1e9-42df-9e2d-cef7734d2792 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1315 microversion: 2.1 time: 0.192608 Oct 29 01:43:42.713464 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3477/6717] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:42 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:42.800841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-766a380b-ea26-4399-aa68-7141e80f27fb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:42.801642 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-766a380b-ea26-4399-aa68-7141e80f27fb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:42.811953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-766a380b-ea26-4399-aa68-7141e80f27fb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:42.813013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-766a380b-ea26-4399-aa68-7141e80f27fb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:42.813681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-766a380b-ea26-4399-aa68-7141e80f27fb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:42.815032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-766a380b-ea26-4399-aa68-7141e80f27fb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:42.815883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-766a380b-ea26-4399-aa68-7141e80f27fb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:42.816600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-766a380b-ea26-4399-aa68-7141e80f27fb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:42.973366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-766a380b-ea26-4399-aa68-7141e80f27fb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:42.982703 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-766a380b-ea26-4399-aa68-7141e80f27fb tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1683 microversion: 2.1 time: 0.187324 Oct 29 01:43:42.983659 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3241/6718] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:42 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:43.111401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-18155c28-8671-4496-8b8a-4f3c7cec7121 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:43.113665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-18155c28-8671-4496-8b8a-4f3c7cec7121 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:43.119928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18155c28-8671-4496-8b8a-4f3c7cec7121 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:43.120416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18155c28-8671-4496-8b8a-4f3c7cec7121 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:43.120855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18155c28-8671-4496-8b8a-4f3c7cec7121 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:43.121596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18155c28-8671-4496-8b8a-4f3c7cec7121 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:43.122046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18155c28-8671-4496-8b8a-4f3c7cec7121 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:43.122485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-18155c28-8671-4496-8b8a-4f3c7cec7121 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:43.192968 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-18155c28-8671-4496-8b8a-4f3c7cec7121 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410/action" status: 200 len: 32637 microversion: 2.1 time: 0.085325 Oct 29 01:43:43.193667 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3478/6719] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:43:43 2022] POST /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410/action => generated 32637 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:43:43.218497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-40665bc7-1c4d-4eaf-a69e-4a9d6e049ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:43.219307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-40665bc7-1c4d-4eaf-a69e-4a9d6e049ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:43.226345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40665bc7-1c4d-4eaf-a69e-4a9d6e049ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:43.226872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40665bc7-1c4d-4eaf-a69e-4a9d6e049ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:43.227365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40665bc7-1c4d-4eaf-a69e-4a9d6e049ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:43.228115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40665bc7-1c4d-4eaf-a69e-4a9d6e049ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:43.228571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40665bc7-1c4d-4eaf-a69e-4a9d6e049ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:43.229027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-40665bc7-1c4d-4eaf-a69e-4a9d6e049ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:43.394609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-40665bc7-1c4d-4eaf-a69e-4a9d6e049ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:43.402954 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-40665bc7-1c4d-4eaf-a69e-4a9d6e049ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.189119 Oct 29 01:43:43.403566 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3242/6720] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:43 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:43.601813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f3389442-99fe-4f05-bea6-05a33307fd98 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:43.602426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f3389442-99fe-4f05-bea6-05a33307fd98 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:43.610633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3389442-99fe-4f05-bea6-05a33307fd98 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:43.611195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3389442-99fe-4f05-bea6-05a33307fd98 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:43.611677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3389442-99fe-4f05-bea6-05a33307fd98 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:43.613287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3389442-99fe-4f05-bea6-05a33307fd98 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:43.613287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3389442-99fe-4f05-bea6-05a33307fd98 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:43.613488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3389442-99fe-4f05-bea6-05a33307fd98 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:43.725690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8a038613-4f59-4257-8d39-2d90660bdbaa tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:43.732415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8a038613-4f59-4257-8d39-2d90660bdbaa tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:43.734947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:43.740384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a038613-4f59-4257-8d39-2d90660bdbaa tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:43.741303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a038613-4f59-4257-8d39-2d90660bdbaa tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:43.742087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a038613-4f59-4257-8d39-2d90660bdbaa tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:43.743102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a038613-4f59-4257-8d39-2d90660bdbaa tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:43.743562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a038613-4f59-4257-8d39-2d90660bdbaa tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:43.744181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a038613-4f59-4257-8d39-2d90660bdbaa tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:43.790790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f3389442-99fe-4f05-bea6-05a33307fd98 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:43.804171 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f3389442-99fe-4f05-bea6-05a33307fd98 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1506 microversion: 2.1 time: 0.206082 Oct 29 01:43:43.805217 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3243/6721] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:43 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1506 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:43.810450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2b6787a2-19fc-477f-a403-d6467d73215b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:43.812596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2b6787a2-19fc-477f-a403-d6467d73215b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:43.822089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b6787a2-19fc-477f-a403-d6467d73215b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:43.822873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b6787a2-19fc-477f-a403-d6467d73215b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:43.823727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b6787a2-19fc-477f-a403-d6467d73215b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:43.827397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b6787a2-19fc-477f-a403-d6467d73215b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:43.828045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b6787a2-19fc-477f-a403-d6467d73215b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:43.828863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b6787a2-19fc-477f-a403-d6467d73215b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:44.016303 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8a038613-4f59-4257-8d39-2d90660bdbaa tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1834 microversion: 2.1 time: 0.666784 Oct 29 01:43:44.037090 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3479/6722] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:43 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1834 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:44.054751 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2b6787a2-19fc-477f-a403-d6467d73215b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:44.064983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c2fc4b2c-3605-4b61-8030-1560075d3571 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:44.065373 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2b6787a2-19fc-477f-a403-d6467d73215b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1315 microversion: 2.1 time: 0.258657 Oct 29 01:43:44.065888 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3244/6723] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:43 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:44.068971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c2fc4b2c-3605-4b61-8030-1560075d3571 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:44.078815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2fc4b2c-3605-4b61-8030-1560075d3571 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:44.079532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2fc4b2c-3605-4b61-8030-1560075d3571 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:44.080043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2fc4b2c-3605-4b61-8030-1560075d3571 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:44.080819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2fc4b2c-3605-4b61-8030-1560075d3571 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:44.081550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2fc4b2c-3605-4b61-8030-1560075d3571 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:44.082184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c2fc4b2c-3605-4b61-8030-1560075d3571 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:44.119220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-c2fc4b2c-3605-4b61-8030-1560075d3571 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lazy-loading 'flavor' on Instance uuid 3984ece4-66ac-4c11-b414-0c1f4d76a410 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:43:44.137108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c2fc4b2c-3605-4b61-8030-1560075d3571 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Going to try to live migrate instance to another host {{(pid=121099) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 01:43:44.430375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-26188af4-a279-4b84-b419-062a3000aaa4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:44.437016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-26188af4-a279-4b84-b419-062a3000aaa4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:44.437016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:44.440661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26188af4-a279-4b84-b419-062a3000aaa4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:44.441231 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26188af4-a279-4b84-b419-062a3000aaa4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:44.442213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26188af4-a279-4b84-b419-062a3000aaa4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:44.443451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26188af4-a279-4b84-b419-062a3000aaa4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:44.444092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26188af4-a279-4b84-b419-062a3000aaa4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:44.444706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-26188af4-a279-4b84-b419-062a3000aaa4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:44.618657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-26188af4-a279-4b84-b419-062a3000aaa4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:44.626565 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-26188af4-a279-4b84-b419-062a3000aaa4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.201891 Oct 29 01:43:44.627353 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3245/6724] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:44 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:44.831665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cb5f549b-e85e-4db0-b39a-06606c175241 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:44.832310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cb5f549b-e85e-4db0-b39a-06606c175241 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:44.840245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb5f549b-e85e-4db0-b39a-06606c175241 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:44.840961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb5f549b-e85e-4db0-b39a-06606c175241 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:44.841446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb5f549b-e85e-4db0-b39a-06606c175241 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:44.842667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb5f549b-e85e-4db0-b39a-06606c175241 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:44.843281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb5f549b-e85e-4db0-b39a-06606c175241 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:44.843994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb5f549b-e85e-4db0-b39a-06606c175241 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:45.020720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cb5f549b-e85e-4db0-b39a-06606c175241 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:45.036477 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cb5f549b-e85e-4db0-b39a-06606c175241 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 200 len: 1509 microversion: 2.1 time: 0.207785 Oct 29 01:43:45.037070 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3246/6725] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:44 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:45.074609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8a2c5923-8de5-43a2-930c-b7150b8c1151 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:45.075436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8a2c5923-8de5-43a2-930c-b7150b8c1151 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:45.088215 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a2c5923-8de5-43a2-930c-b7150b8c1151 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:45.088715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a2c5923-8de5-43a2-930c-b7150b8c1151 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:45.089325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a2c5923-8de5-43a2-930c-b7150b8c1151 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:45.090787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a2c5923-8de5-43a2-930c-b7150b8c1151 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:45.092939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a2c5923-8de5-43a2-930c-b7150b8c1151 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:45.093852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a2c5923-8de5-43a2-930c-b7150b8c1151 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:45.243206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8a2c5923-8de5-43a2-930c-b7150b8c1151 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:45.257434 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8a2c5923-8de5-43a2-930c-b7150b8c1151 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.187538 Oct 29 01:43:45.258359 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3247/6726] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:45 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:45.262995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-36d920ee-a499-40f4-ab32-528c0ebbd3f8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:45.263602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-36d920ee-a499-40f4-ab32-528c0ebbd3f8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:45.272136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36d920ee-a499-40f4-ab32-528c0ebbd3f8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:45.272630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36d920ee-a499-40f4-ab32-528c0ebbd3f8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:45.273070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36d920ee-a499-40f4-ab32-528c0ebbd3f8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:45.273914 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36d920ee-a499-40f4-ab32-528c0ebbd3f8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:45.274380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36d920ee-a499-40f4-ab32-528c0ebbd3f8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:45.274807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36d920ee-a499-40f4-ab32-528c0ebbd3f8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:45.385996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=8 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:45.500251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-36d920ee-a499-40f4-ab32-528c0ebbd3f8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:45.525939 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-36d920ee-a499-40f4-ab32-528c0ebbd3f8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1315 microversion: 2.1 time: 0.266407 Oct 29 01:43:45.528020 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3248/6727] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:45 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:45.534589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6897ef9f-2e7a-4441-962a-c6d90789228e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:45.535923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6897ef9f-2e7a-4441-962a-c6d90789228e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:45.546037 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6897ef9f-2e7a-4441-962a-c6d90789228e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:45.546902 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6897ef9f-2e7a-4441-962a-c6d90789228e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:45.547467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6897ef9f-2e7a-4441-962a-c6d90789228e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:45.548020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6897ef9f-2e7a-4441-962a-c6d90789228e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:45.548666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6897ef9f-2e7a-4441-962a-c6d90789228e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:45.549277 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6897ef9f-2e7a-4441-962a-c6d90789228e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:45.759245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6897ef9f-2e7a-4441-962a-c6d90789228e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:45.772121 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6897ef9f-2e7a-4441-962a-c6d90789228e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.242775 Oct 29 01:43:45.785324 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3249/6728] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:45 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:45.790954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-36e22515-767d-4d5d-957b-585aed229d03 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:45.791732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-36e22515-767d-4d5d-957b-585aed229d03 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:45.799743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e22515-767d-4d5d-957b-585aed229d03 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:45.800253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e22515-767d-4d5d-957b-585aed229d03 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:45.800691 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e22515-767d-4d5d-957b-585aed229d03 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:45.801417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e22515-767d-4d5d-957b-585aed229d03 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:45.801873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e22515-767d-4d5d-957b-585aed229d03 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:45.802510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36e22515-767d-4d5d-957b-585aed229d03 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:45.952378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-36e22515-767d-4d5d-957b-585aed229d03 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:45.964299 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-36e22515-767d-4d5d-957b-585aed229d03 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.190088 Oct 29 01:43:45.964893 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3250/6729] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:45 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:45.970580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f6679db9-9dd4-48d2-834b-546e6e8a7cd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:45.971626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f6679db9-9dd4-48d2-834b-546e6e8a7cd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:45.978609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6679db9-9dd4-48d2-834b-546e6e8a7cd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:45.978949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6679db9-9dd4-48d2-834b-546e6e8a7cd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:45.979553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6679db9-9dd4-48d2-834b-546e6e8a7cd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:45.980803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6679db9-9dd4-48d2-834b-546e6e8a7cd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:45.981851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6679db9-9dd4-48d2-834b-546e6e8a7cd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:45.982503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6679db9-9dd4-48d2-834b-546e6e8a7cd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:45.986406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:46.131479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f6679db9-9dd4-48d2-834b-546e6e8a7cd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:46.139772 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f6679db9-9dd4-48d2-834b-546e6e8a7cd5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.173008 Oct 29 01:43:46.140301 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3251/6730] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:45 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:46.158291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-ec055801-3bec-41f0-b5e4-7c80431f1f98 req-cdbbc5e8-9fc4-439c-9b86-234ba1467420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1df712-231f-4de9-9023-66fab316b565", "name": "network-vif-unplugged", "status": "completed", "tag": "a19b3137-5978-4142-9ac1-161c59e7ec6b"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:46.168775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ec055801-3bec-41f0-b5e4-7c80431f1f98 req-cdbbc5e8-9fc4-439c-9b86-234ba1467420 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:46.169243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ec055801-3bec-41f0-b5e4-7c80431f1f98 req-cdbbc5e8-9fc4-439c-9b86-234ba1467420 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:46.169685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ec055801-3bec-41f0-b5e4-7c80431f1f98 req-cdbbc5e8-9fc4-439c-9b86-234ba1467420 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:46.190914 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-ec055801-3bec-41f0-b5e4-7c80431f1f98 req-cdbbc5e8-9fc4-439c-9b86-234ba1467420 service nova] Creating event network-vif-unplugged:a19b3137-5978-4142-9ac1-161c59e7ec6b for instance de1df712-231f-4de9-9023-66fab316b565 on n-h1-862964-3 Oct 29 01:43:46.204191 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-ec055801-3bec-41f0-b5e4-7c80431f1f98 req-cdbbc5e8-9fc4-439c-9b86-234ba1467420 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062433 Oct 29 01:43:46.204909 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3252/6731] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:43:46.210558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4c044c3c-b6f2-4f5f-b82e-21e7f9cfb582 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:46.211219 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4c044c3c-b6f2-4f5f-b82e-21e7f9cfb582 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:46.217048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c044c3c-b6f2-4f5f-b82e-21e7f9cfb582 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:46.217876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c044c3c-b6f2-4f5f-b82e-21e7f9cfb582 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:46.218330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c044c3c-b6f2-4f5f-b82e-21e7f9cfb582 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:46.219040 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c044c3c-b6f2-4f5f-b82e-21e7f9cfb582 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:46.219699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c044c3c-b6f2-4f5f-b82e-21e7f9cfb582 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:46.220136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c044c3c-b6f2-4f5f-b82e-21e7f9cfb582 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:46.407423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4c044c3c-b6f2-4f5f-b82e-21e7f9cfb582 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:46.415461 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4c044c3c-b6f2-4f5f-b82e-21e7f9cfb582 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.209350 Oct 29 01:43:46.416045 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3253/6732] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:46 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:46.441634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a7af056e-2b27-4cb4-a967-9774a23b6800 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:46.448160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7af056e-2b27-4cb4-a967-9774a23b6800 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:46.448653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7af056e-2b27-4cb4-a967-9774a23b6800 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:46.449092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7af056e-2b27-4cb4-a967-9774a23b6800 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:46.478097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a7af056e-2b27-4cb4-a967-9774a23b6800 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Going to try to stop instance {{(pid=121100) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 01:43:46.763149 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a7af056e-2b27-4cb4-a967-9774a23b6800 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.323684 Oct 29 01:43:46.765072 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3254/6733] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:43:46 2022] POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:43:46.773600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ceaf9841-f4dd-463e-a2af-a8f0ec2d9fba tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:46.777582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ceaf9841-f4dd-463e-a2af-a8f0ec2d9fba tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:46.794731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ceaf9841-f4dd-463e-a2af-a8f0ec2d9fba tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:46.795763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ceaf9841-f4dd-463e-a2af-a8f0ec2d9fba tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:46.796224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ceaf9841-f4dd-463e-a2af-a8f0ec2d9fba tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:46.796957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ceaf9841-f4dd-463e-a2af-a8f0ec2d9fba tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:46.797474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ceaf9841-f4dd-463e-a2af-a8f0ec2d9fba tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:46.798039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ceaf9841-f4dd-463e-a2af-a8f0ec2d9fba tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:47.013225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ceaf9841-f4dd-463e-a2af-a8f0ec2d9fba tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:47.021905 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ceaf9841-f4dd-463e-a2af-a8f0ec2d9fba tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1315 microversion: 2.1 time: 0.255243 Oct 29 01:43:47.022730 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3255/6734] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:46 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:47.043719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7b801bfd-186b-44d9-9555-696f52012279 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:47.044396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7b801bfd-186b-44d9-9555-696f52012279 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:47.051616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b801bfd-186b-44d9-9555-696f52012279 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:47.052324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b801bfd-186b-44d9-9555-696f52012279 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:47.052821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b801bfd-186b-44d9-9555-696f52012279 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:47.053635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b801bfd-186b-44d9-9555-696f52012279 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:47.057185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b801bfd-186b-44d9-9555-696f52012279 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:47.057185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7b801bfd-186b-44d9-9555-696f52012279 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:47.527638 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7b801bfd-186b-44d9-9555-696f52012279 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:47.541330 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7b801bfd-186b-44d9-9555-696f52012279 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1680 microversion: 2.1 time: 0.502909 Oct 29 01:43:47.541983 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3256/6735] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:47 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1680 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:47.548382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9e4961ae-d5d0-40b3-9a80-b599e61ee676 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:47.549246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9e4961ae-d5d0-40b3-9a80-b599e61ee676 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:47.556898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e4961ae-d5d0-40b3-9a80-b599e61ee676 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:47.557996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e4961ae-d5d0-40b3-9a80-b599e61ee676 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:47.558849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e4961ae-d5d0-40b3-9a80-b599e61ee676 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:47.560017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e4961ae-d5d0-40b3-9a80-b599e61ee676 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:47.560641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e4961ae-d5d0-40b3-9a80-b599e61ee676 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:47.561402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e4961ae-d5d0-40b3-9a80-b599e61ee676 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:48.098824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9e4961ae-d5d0-40b3-9a80-b599e61ee676 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:48.110513 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9e4961ae-d5d0-40b3-9a80-b599e61ee676 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.565065 Oct 29 01:43:48.110513 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3257/6736] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:47 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:48.114815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e904bb71-b34b-448d-bbd3-a75ed5b9fc41 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:48.118285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e904bb71-b34b-448d-bbd3-a75ed5b9fc41 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:48.194598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e904bb71-b34b-448d-bbd3-a75ed5b9fc41 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:48.195391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e904bb71-b34b-448d-bbd3-a75ed5b9fc41 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:48.200220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e904bb71-b34b-448d-bbd3-a75ed5b9fc41 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:48.201262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e904bb71-b34b-448d-bbd3-a75ed5b9fc41 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:48.202684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e904bb71-b34b-448d-bbd3-a75ed5b9fc41 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:48.203154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e904bb71-b34b-448d-bbd3-a75ed5b9fc41 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:48.414895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e904bb71-b34b-448d-bbd3-a75ed5b9fc41 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:48.424488 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e904bb71-b34b-448d-bbd3-a75ed5b9fc41 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1315 microversion: 2.1 time: 0.313979 Oct 29 01:43:48.425077 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3258/6737] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:48 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:48.571439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-be9da06d-f686-499f-ba94-7f571ab63808 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:48.572138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-be9da06d-f686-499f-ba94-7f571ab63808 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:48.578797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be9da06d-f686-499f-ba94-7f571ab63808 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:48.579275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be9da06d-f686-499f-ba94-7f571ab63808 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:48.580430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be9da06d-f686-499f-ba94-7f571ab63808 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:48.580654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be9da06d-f686-499f-ba94-7f571ab63808 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:48.581184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be9da06d-f686-499f-ba94-7f571ab63808 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:48.581712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be9da06d-f686-499f-ba94-7f571ab63808 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:48.603384 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c2fc4b2c-3605-4b61-8030-1560075d3571 tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410/action" status: 202 len: 0 microversion: 2.1 time: 4.543979 Oct 29 01:43:48.603384 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3480/6738] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:43:44 2022] POST /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410/action => generated 0 bytes in 4546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:43:48.611412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-db0db696-9e04-4740-b199-e5809139b084 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:48.612244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-db0db696-9e04-4740-b199-e5809139b084 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:48.625077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db0db696-9e04-4740-b199-e5809139b084 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:48.625482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db0db696-9e04-4740-b199-e5809139b084 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:48.625931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db0db696-9e04-4740-b199-e5809139b084 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:48.626645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db0db696-9e04-4740-b199-e5809139b084 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:48.629348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db0db696-9e04-4740-b199-e5809139b084 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:48.630258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db0db696-9e04-4740-b199-e5809139b084 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:48.844552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-be9da06d-f686-499f-ba94-7f571ab63808 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:48.857019 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-be9da06d-f686-499f-ba94-7f571ab63808 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1680 microversion: 2.1 time: 0.290441 Oct 29 01:43:48.860148 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3259/6739] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:48 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1680 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:48.906221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-db0db696-9e04-4740-b199-e5809139b084 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:48.913898 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-db0db696-9e04-4740-b199-e5809139b084 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1693 microversion: 2.1 time: 0.306197 Oct 29 01:43:48.914503 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3481/6740] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:48 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1693 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:49.137294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-510a2fdc-53de-4d85-90ba-fc77c6375942 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:49.137918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-510a2fdc-53de-4d85-90ba-fc77c6375942 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:49.146232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-510a2fdc-53de-4d85-90ba-fc77c6375942 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:49.148008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-510a2fdc-53de-4d85-90ba-fc77c6375942 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:49.152643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-510a2fdc-53de-4d85-90ba-fc77c6375942 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:49.152643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-510a2fdc-53de-4d85-90ba-fc77c6375942 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:49.152643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-510a2fdc-53de-4d85-90ba-fc77c6375942 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:49.152643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-510a2fdc-53de-4d85-90ba-fc77c6375942 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:49.397545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-510a2fdc-53de-4d85-90ba-fc77c6375942 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:49.406568 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-510a2fdc-53de-4d85-90ba-fc77c6375942 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.278509 Oct 29 01:43:49.417342 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3260/6741] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:49 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:49.449384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-99d61a93-cdec-45ff-a882-9dc43c50af82 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:49.450367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-99d61a93-cdec-45ff-a882-9dc43c50af82 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:49.461130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99d61a93-cdec-45ff-a882-9dc43c50af82 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:49.461700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99d61a93-cdec-45ff-a882-9dc43c50af82 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:49.462138 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99d61a93-cdec-45ff-a882-9dc43c50af82 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:49.463022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99d61a93-cdec-45ff-a882-9dc43c50af82 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:49.463770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99d61a93-cdec-45ff-a882-9dc43c50af82 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:49.464353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-99d61a93-cdec-45ff-a882-9dc43c50af82 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:49.625937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-99d61a93-cdec-45ff-a882-9dc43c50af82 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:49.635760 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-99d61a93-cdec-45ff-a882-9dc43c50af82 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1315 microversion: 2.1 time: 0.190350 Oct 29 01:43:49.636362 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3482/6742] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:49 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:49.883653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9a10e156-e0f3-429f-a05a-2630f8d6b2ec tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:49.884605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9a10e156-e0f3-429f-a05a-2630f8d6b2ec tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:49.891665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a10e156-e0f3-429f-a05a-2630f8d6b2ec tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:49.892378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a10e156-e0f3-429f-a05a-2630f8d6b2ec tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:49.892987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a10e156-e0f3-429f-a05a-2630f8d6b2ec tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:49.894022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a10e156-e0f3-429f-a05a-2630f8d6b2ec tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:49.894500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a10e156-e0f3-429f-a05a-2630f8d6b2ec tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:49.895010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a10e156-e0f3-429f-a05a-2630f8d6b2ec tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:49.947542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-32e893aa-1766-4b6b-acfb-8fa33e7eb2a0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:49.949192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-32e893aa-1766-4b6b-acfb-8fa33e7eb2a0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:49.958085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32e893aa-1766-4b6b-acfb-8fa33e7eb2a0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:49.958897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32e893aa-1766-4b6b-acfb-8fa33e7eb2a0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:49.959522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32e893aa-1766-4b6b-acfb-8fa33e7eb2a0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:49.960487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32e893aa-1766-4b6b-acfb-8fa33e7eb2a0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:49.961743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32e893aa-1766-4b6b-acfb-8fa33e7eb2a0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:49.966869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-32e893aa-1766-4b6b-acfb-8fa33e7eb2a0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:50.111415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9a10e156-e0f3-429f-a05a-2630f8d6b2ec tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:50.147467 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9a10e156-e0f3-429f-a05a-2630f8d6b2ec tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1680 microversion: 2.1 time: 0.267717 Oct 29 01:43:50.152128 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3261/6743] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:49 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1680 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:50.216657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-32e893aa-1766-4b6b-acfb-8fa33e7eb2a0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:50.230669 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-32e893aa-1766-4b6b-acfb-8fa33e7eb2a0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1693 microversion: 2.1 time: 0.289614 Oct 29 01:43:50.231431 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3483/6744] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:49 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1693 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:50.283259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-8d8ad20f-c6d9-4f89-8e2d-3d985d2f3472 req-e022d0e6-0762-4b29-9749-518fcbc52f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "548bfbb3-44d9-439b-8961-49a31cb98d3a", "name": "network-vif-plugged", "status": "completed", "tag": "1b03c813-184d-4b07-b7e8-b8d30701d5ad"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:50.296378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8d8ad20f-c6d9-4f89-8e2d-3d985d2f3472 req-e022d0e6-0762-4b29-9749-518fcbc52f01 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:50.297810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8d8ad20f-c6d9-4f89-8e2d-3d985d2f3472 req-e022d0e6-0762-4b29-9749-518fcbc52f01 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:50.298457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8d8ad20f-c6d9-4f89-8e2d-3d985d2f3472 req-e022d0e6-0762-4b29-9749-518fcbc52f01 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:50.316193 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-8d8ad20f-c6d9-4f89-8e2d-3d985d2f3472 req-e022d0e6-0762-4b29-9749-518fcbc52f01 service nova] Creating event network-vif-plugged:1b03c813-184d-4b07-b7e8-b8d30701d5ad for instance 548bfbb3-44d9-439b-8961-49a31cb98d3a on n-h1-862964-3 Oct 29 01:43:50.322521 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-8d8ad20f-c6d9-4f89-8e2d-3d985d2f3472 req-e022d0e6-0762-4b29-9749-518fcbc52f01 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042474 Oct 29 01:43:50.323148 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3262/6745] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:43:50.362770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a33f4ca5-da35-45b9-aaf4-0bd28a9ef2ab tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:50.365898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a33f4ca5-da35-45b9-aaf4-0bd28a9ef2ab tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:50.372560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a33f4ca5-da35-45b9-aaf4-0bd28a9ef2ab tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:50.373408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a33f4ca5-da35-45b9-aaf4-0bd28a9ef2ab tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:50.374754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a33f4ca5-da35-45b9-aaf4-0bd28a9ef2ab tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:50.375952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a33f4ca5-da35-45b9-aaf4-0bd28a9ef2ab tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:50.376518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a33f4ca5-da35-45b9-aaf4-0bd28a9ef2ab tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:50.377214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a33f4ca5-da35-45b9-aaf4-0bd28a9ef2ab tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:50.432513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b79b8f02-3398-48e2-be1c-801af6a65f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:50.433245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b79b8f02-3398-48e2-be1c-801af6a65f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:50.441078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b79b8f02-3398-48e2-be1c-801af6a65f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:50.441895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b79b8f02-3398-48e2-be1c-801af6a65f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:50.442495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b79b8f02-3398-48e2-be1c-801af6a65f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:50.445413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b79b8f02-3398-48e2-be1c-801af6a65f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:50.446116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b79b8f02-3398-48e2-be1c-801af6a65f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:50.447039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b79b8f02-3398-48e2-be1c-801af6a65f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:50.448370 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a33f4ca5-da35-45b9-aaf4-0bd28a9ef2ab tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "POST /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617/action" status: 200 len: 24571 microversion: 2.1 time: 0.090069 Oct 29 01:43:50.449190 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3484/6746] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:43:50 2022] POST /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617/action => generated 24571 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:43:50.477487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-253cd532-e8ce-4a18-b362-c24d95f44140 req-0e0e24e6-0767-49ce-bf31-da84c2c3c8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3984ece4-66ac-4c11-b414-0c1f4d76a410", "name": "network-vif-unplugged", "status": "completed", "tag": "2edce355-2eeb-46eb-af8e-5a803adc036a"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:50.495084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-253cd532-e8ce-4a18-b362-c24d95f44140 req-0e0e24e6-0767-49ce-bf31-da84c2c3c8dd service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:50.495579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-253cd532-e8ce-4a18-b362-c24d95f44140 req-0e0e24e6-0767-49ce-bf31-da84c2c3c8dd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:50.496026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-253cd532-e8ce-4a18-b362-c24d95f44140 req-0e0e24e6-0767-49ce-bf31-da84c2c3c8dd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:50.510242 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-253cd532-e8ce-4a18-b362-c24d95f44140 req-0e0e24e6-0767-49ce-bf31-da84c2c3c8dd service nova] Creating event network-vif-unplugged:2edce355-2eeb-46eb-af8e-5a803adc036a for instance 3984ece4-66ac-4c11-b414-0c1f4d76a410 on n-h2-862964-3 Oct 29 01:43:50.518898 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-253cd532-e8ce-4a18-b362-c24d95f44140 req-0e0e24e6-0767-49ce-bf31-da84c2c3c8dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047472 Oct 29 01:43:50.520073 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3485/6747] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:43:50.668148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f18c6bb8-d293-4740-b017-905613593bf8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:50.669457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f18c6bb8-d293-4740-b017-905613593bf8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:50.690536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f18c6bb8-d293-4740-b017-905613593bf8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:50.692521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f18c6bb8-d293-4740-b017-905613593bf8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:50.694209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f18c6bb8-d293-4740-b017-905613593bf8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:50.700555 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f18c6bb8-d293-4740-b017-905613593bf8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:50.701378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f18c6bb8-d293-4740-b017-905613593bf8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:50.703537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f18c6bb8-d293-4740-b017-905613593bf8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:50.752534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b79b8f02-3398-48e2-be1c-801af6a65f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:50.762730 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b79b8f02-3398-48e2-be1c-801af6a65f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.334296 Oct 29 01:43:50.763678 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3263/6748] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:50 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:50.966679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f18c6bb8-d293-4740-b017-905613593bf8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:50.976962 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f18c6bb8-d293-4740-b017-905613593bf8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1315 microversion: 2.1 time: 0.318715 Oct 29 01:43:50.978431 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3486/6749] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:50 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:51.181832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5a4dbf88-b12f-4bb9-92d2-c5367f53ad81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:51.183165 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5a4dbf88-b12f-4bb9-92d2-c5367f53ad81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:51.204177 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a4dbf88-b12f-4bb9-92d2-c5367f53ad81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:51.204696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a4dbf88-b12f-4bb9-92d2-c5367f53ad81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:51.205184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a4dbf88-b12f-4bb9-92d2-c5367f53ad81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:51.205899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a4dbf88-b12f-4bb9-92d2-c5367f53ad81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:51.206357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a4dbf88-b12f-4bb9-92d2-c5367f53ad81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:51.206830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5a4dbf88-b12f-4bb9-92d2-c5367f53ad81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:51.262172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2fea5d0b-9e8c-400c-9d67-b0403c04c16b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:51.263029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2fea5d0b-9e8c-400c-9d67-b0403c04c16b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:51.283436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fea5d0b-9e8c-400c-9d67-b0403c04c16b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:51.284843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fea5d0b-9e8c-400c-9d67-b0403c04c16b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:51.290333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fea5d0b-9e8c-400c-9d67-b0403c04c16b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:51.290333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fea5d0b-9e8c-400c-9d67-b0403c04c16b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:51.290333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fea5d0b-9e8c-400c-9d67-b0403c04c16b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:51.290333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fea5d0b-9e8c-400c-9d67-b0403c04c16b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:51.459944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5a4dbf88-b12f-4bb9-92d2-c5367f53ad81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:51.468384 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5a4dbf88-b12f-4bb9-92d2-c5367f53ad81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1680 microversion: 2.1 time: 0.291293 Oct 29 01:43:51.474240 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3264/6750] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:51 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1680 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:51.534876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2fea5d0b-9e8c-400c-9d67-b0403c04c16b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:51.545961 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2fea5d0b-9e8c-400c-9d67-b0403c04c16b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1693 microversion: 2.1 time: 0.288978 Oct 29 01:43:51.547366 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3487/6751] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:51 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1693 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:51.786932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bbaae6bf-fd1a-4fa5-8feb-4fb1cc2b7d1e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:51.787541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bbaae6bf-fd1a-4fa5-8feb-4fb1cc2b7d1e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:51.793776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbaae6bf-fd1a-4fa5-8feb-4fb1cc2b7d1e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:51.794569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbaae6bf-fd1a-4fa5-8feb-4fb1cc2b7d1e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:51.795234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbaae6bf-fd1a-4fa5-8feb-4fb1cc2b7d1e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:51.796349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbaae6bf-fd1a-4fa5-8feb-4fb1cc2b7d1e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:51.796999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbaae6bf-fd1a-4fa5-8feb-4fb1cc2b7d1e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:51.797607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbaae6bf-fd1a-4fa5-8feb-4fb1cc2b7d1e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:51.987603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bbaae6bf-fd1a-4fa5-8feb-4fb1cc2b7d1e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:52.000792 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bbaae6bf-fd1a-4fa5-8feb-4fb1cc2b7d1e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.217651 Oct 29 01:43:52.001795 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3265/6752] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:51 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:52.021199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-887a6c22-91ea-40c6-b35f-163ce227aaed tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:52.021824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-887a6c22-91ea-40c6-b35f-163ce227aaed tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:52.028528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-887a6c22-91ea-40c6-b35f-163ce227aaed tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:52.029236 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-887a6c22-91ea-40c6-b35f-163ce227aaed tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:52.029785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-887a6c22-91ea-40c6-b35f-163ce227aaed tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:52.030747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-887a6c22-91ea-40c6-b35f-163ce227aaed tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:52.031208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-887a6c22-91ea-40c6-b35f-163ce227aaed tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:52.031637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-887a6c22-91ea-40c6-b35f-163ce227aaed tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:52.242531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-887a6c22-91ea-40c6-b35f-163ce227aaed tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:52.262463 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-887a6c22-91ea-40c6-b35f-163ce227aaed tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1315 microversion: 2.1 time: 0.253402 Oct 29 01:43:52.262463 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3488/6753] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:51 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:52.495402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-39f836ca-e2f7-45d3-bfe3-510eb5937d7c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:52.496523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-39f836ca-e2f7-45d3-bfe3-510eb5937d7c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:52.511156 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39f836ca-e2f7-45d3-bfe3-510eb5937d7c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:52.511923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39f836ca-e2f7-45d3-bfe3-510eb5937d7c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:52.513791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39f836ca-e2f7-45d3-bfe3-510eb5937d7c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:52.515294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39f836ca-e2f7-45d3-bfe3-510eb5937d7c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:52.515798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39f836ca-e2f7-45d3-bfe3-510eb5937d7c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:52.516275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-39f836ca-e2f7-45d3-bfe3-510eb5937d7c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:52.536051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-83a4a518-8c97-4d3a-a8ae-846f51c1b75c req-d84489ee-0bd2-4518-a9c0-9904c7783e44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3984ece4-66ac-4c11-b414-0c1f4d76a410", "tag": "2edce355-2eeb-46eb-af8e-5a803adc036a"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:52.550577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-83a4a518-8c97-4d3a-a8ae-846f51c1b75c req-d84489ee-0bd2-4518-a9c0-9904c7783e44 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:52.551424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-83a4a518-8c97-4d3a-a8ae-846f51c1b75c req-d84489ee-0bd2-4518-a9c0-9904c7783e44 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:52.551962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-83a4a518-8c97-4d3a-a8ae-846f51c1b75c req-d84489ee-0bd2-4518-a9c0-9904c7783e44 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:52.591787 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-83a4a518-8c97-4d3a-a8ae-846f51c1b75c req-d84489ee-0bd2-4518-a9c0-9904c7783e44 service nova] Creating event network-changed:2edce355-2eeb-46eb-af8e-5a803adc036a for instance 3984ece4-66ac-4c11-b414-0c1f4d76a410 on n-h2-862964-3 Oct 29 01:43:52.604521 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-83a4a518-8c97-4d3a-a8ae-846f51c1b75c req-d84489ee-0bd2-4518-a9c0-9904c7783e44 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071622 Oct 29 01:43:52.612327 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3489/6754] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:43:52.614148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f1302f3-7021-48a3-8522-90a5b6df0424 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:52.615440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1f1302f3-7021-48a3-8522-90a5b6df0424 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:52.622288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f1302f3-7021-48a3-8522-90a5b6df0424 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:52.622917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f1302f3-7021-48a3-8522-90a5b6df0424 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:52.623794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f1302f3-7021-48a3-8522-90a5b6df0424 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:52.626085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f1302f3-7021-48a3-8522-90a5b6df0424 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:52.626679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f1302f3-7021-48a3-8522-90a5b6df0424 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:52.627277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f1302f3-7021-48a3-8522-90a5b6df0424 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:52.701558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-39f836ca-e2f7-45d3-bfe3-510eb5937d7c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:52.715386 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-39f836ca-e2f7-45d3-bfe3-510eb5937d7c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1680 microversion: 2.1 time: 0.224450 Oct 29 01:43:52.716066 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3266/6755] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:52 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1680 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:52.836712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1f1302f3-7021-48a3-8522-90a5b6df0424 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:52.845909 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1f1302f3-7021-48a3-8522-90a5b6df0424 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1693 microversion: 2.1 time: 0.238327 Oct 29 01:43:52.846504 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3490/6756] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:52 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1693 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:53.024114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-17493d17-d56b-4f87-806c-ab28a477a92e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:53.024689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-17493d17-d56b-4f87-806c-ab28a477a92e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:53.032148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17493d17-d56b-4f87-806c-ab28a477a92e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:53.032632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17493d17-d56b-4f87-806c-ab28a477a92e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:53.033262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17493d17-d56b-4f87-806c-ab28a477a92e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:53.034115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17493d17-d56b-4f87-806c-ab28a477a92e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:53.035246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17493d17-d56b-4f87-806c-ab28a477a92e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:53.036093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17493d17-d56b-4f87-806c-ab28a477a92e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:53.231246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-17493d17-d56b-4f87-806c-ab28a477a92e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:53.240624 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-17493d17-d56b-4f87-806c-ab28a477a92e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.220505 Oct 29 01:43:53.241433 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3267/6757] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:53 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:53.275585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8b9687b8-a697-4951-a205-ea8d67cf08b5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:53.276132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8b9687b8-a697-4951-a205-ea8d67cf08b5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:53.287105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b9687b8-a697-4951-a205-ea8d67cf08b5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:53.287105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b9687b8-a697-4951-a205-ea8d67cf08b5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:53.287105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b9687b8-a697-4951-a205-ea8d67cf08b5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:53.287105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b9687b8-a697-4951-a205-ea8d67cf08b5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:53.287105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b9687b8-a697-4951-a205-ea8d67cf08b5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:53.287105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8b9687b8-a697-4951-a205-ea8d67cf08b5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:53.291965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:53.466680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8b9687b8-a697-4951-a205-ea8d67cf08b5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:53.476124 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8b9687b8-a697-4951-a205-ea8d67cf08b5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1503 microversion: 2.1 time: 0.204255 Oct 29 01:43:53.476720 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3491/6758] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:53 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1503 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:53.500770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aedaf5fb-459e-4d51-abe5-8582e3f8aca9 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:53.502577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aedaf5fb-459e-4d51-abe5-8582e3f8aca9 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:53.512197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aedaf5fb-459e-4d51-abe5-8582e3f8aca9 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:53.512889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aedaf5fb-459e-4d51-abe5-8582e3f8aca9 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:53.514507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aedaf5fb-459e-4d51-abe5-8582e3f8aca9 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:53.518008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aedaf5fb-459e-4d51-abe5-8582e3f8aca9 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:53.519425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aedaf5fb-459e-4d51-abe5-8582e3f8aca9 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:53.520113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aedaf5fb-459e-4d51-abe5-8582e3f8aca9 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:53.526755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:53.676367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aedaf5fb-459e-4d51-abe5-8582e3f8aca9 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:53.685295 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aedaf5fb-459e-4d51-abe5-8582e3f8aca9 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1503 microversion: 2.1 time: 0.188456 Oct 29 01:43:53.688011 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3268/6759] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:53 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:53.711095 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-79d5ac4a-dcd1-4bd6-822a-454697acc759 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:53.711636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-79d5ac4a-dcd1-4bd6-822a-454697acc759 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:53.719925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79d5ac4a-dcd1-4bd6-822a-454697acc759 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:53.720630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79d5ac4a-dcd1-4bd6-822a-454697acc759 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:53.721071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79d5ac4a-dcd1-4bd6-822a-454697acc759 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:53.721832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79d5ac4a-dcd1-4bd6-822a-454697acc759 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:53.724524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79d5ac4a-dcd1-4bd6-822a-454697acc759 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:53.726056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79d5ac4a-dcd1-4bd6-822a-454697acc759 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:53.740827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9a88d4f4-cc80-410e-8e6a-b67a52ec3052 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:53.742835 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9a88d4f4-cc80-410e-8e6a-b67a52ec3052 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:53.754211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a88d4f4-cc80-410e-8e6a-b67a52ec3052 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:53.754333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-79d5ac4a-dcd1-4bd6-822a-454697acc759 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lazy-loading 'flavor' on Instance uuid 548bfbb3-44d9-439b-8961-49a31cb98d3a {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:43:53.755367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a88d4f4-cc80-410e-8e6a-b67a52ec3052 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:53.756148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a88d4f4-cc80-410e-8e6a-b67a52ec3052 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:53.757481 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a88d4f4-cc80-410e-8e6a-b67a52ec3052 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:53.759816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a88d4f4-cc80-410e-8e6a-b67a52ec3052 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:53.760378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9a88d4f4-cc80-410e-8e6a-b67a52ec3052 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:53.931115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9a88d4f4-cc80-410e-8e6a-b67a52ec3052 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:53.961136 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9a88d4f4-cc80-410e-8e6a-b67a52ec3052 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1680 microversion: 2.1 time: 0.224845 Oct 29 01:43:53.978208 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3269/6760] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:53 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1680 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:53.990564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c17b6625-fe29-4e94-bd31-f397e54c6581 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:53.990564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c17b6625-fe29-4e94-bd31-f397e54c6581 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:54.004108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c17b6625-fe29-4e94-bd31-f397e54c6581 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:54.004666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c17b6625-fe29-4e94-bd31-f397e54c6581 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:54.005116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c17b6625-fe29-4e94-bd31-f397e54c6581 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:54.005866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c17b6625-fe29-4e94-bd31-f397e54c6581 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:54.006330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c17b6625-fe29-4e94-bd31-f397e54c6581 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:54.006762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c17b6625-fe29-4e94-bd31-f397e54c6581 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:54.110264 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-79d5ac4a-dcd1-4bd6-822a-454697acc759 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "POST /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a/action" status: 202 len: 0 microversion: 2.1 time: 0.403649 Oct 29 01:43:54.111757 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3492/6761] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:43:53 2022] POST /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:43:54.125060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-49f40fd2-eeda-4b21-a1a9-04288d25add0 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:54.126117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-49f40fd2-eeda-4b21-a1a9-04288d25add0 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:54.134394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49f40fd2-eeda-4b21-a1a9-04288d25add0 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:54.135071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49f40fd2-eeda-4b21-a1a9-04288d25add0 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:54.135706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49f40fd2-eeda-4b21-a1a9-04288d25add0 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:54.136823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49f40fd2-eeda-4b21-a1a9-04288d25add0 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:54.137470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49f40fd2-eeda-4b21-a1a9-04288d25add0 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:54.138320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49f40fd2-eeda-4b21-a1a9-04288d25add0 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:54.228194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c17b6625-fe29-4e94-bd31-f397e54c6581 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:54.239874 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c17b6625-fe29-4e94-bd31-f397e54c6581 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1693 microversion: 2.1 time: 0.260467 Oct 29 01:43:54.240471 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3270/6762] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:53 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1693 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:54.266668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a1548493-b2b6-444c-87fc-507e1f8aef38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:54.269928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a1548493-b2b6-444c-87fc-507e1f8aef38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:54.282615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1548493-b2b6-444c-87fc-507e1f8aef38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:54.283132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1548493-b2b6-444c-87fc-507e1f8aef38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:54.283580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1548493-b2b6-444c-87fc-507e1f8aef38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:54.284432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1548493-b2b6-444c-87fc-507e1f8aef38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:54.284774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1548493-b2b6-444c-87fc-507e1f8aef38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:54.285229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1548493-b2b6-444c-87fc-507e1f8aef38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:54.336489 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-49f40fd2-eeda-4b21-a1a9-04288d25add0 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:54.346777 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-49f40fd2-eeda-4b21-a1a9-04288d25add0 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1511 microversion: 2.1 time: 0.230799 Oct 29 01:43:54.362577 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3493/6763] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:54 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:54.484954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a1548493-b2b6-444c-87fc-507e1f8aef38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:54.494434 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a1548493-b2b6-444c-87fc-507e1f8aef38 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.234436 Oct 29 01:43:54.496986 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3271/6764] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:54 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:54.990813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7921ea04-57de-414d-9221-871ccb132e67 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:54.992075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7921ea04-57de-414d-9221-871ccb132e67 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:55.000788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7921ea04-57de-414d-9221-871ccb132e67 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:55.001308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7921ea04-57de-414d-9221-871ccb132e67 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:55.003638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7921ea04-57de-414d-9221-871ccb132e67 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:55.003638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7921ea04-57de-414d-9221-871ccb132e67 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:55.003638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7921ea04-57de-414d-9221-871ccb132e67 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:55.003638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7921ea04-57de-414d-9221-871ccb132e67 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:55.191292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7921ea04-57de-414d-9221-871ccb132e67 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:55.205491 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7921ea04-57de-414d-9221-871ccb132e67 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1680 microversion: 2.1 time: 0.217990 Oct 29 01:43:55.211621 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3494/6765] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:54 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1680 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:55.272062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-be89b068-fd61-43e9-9b01-8a26f8cf8ce0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:55.273713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-be89b068-fd61-43e9-9b01-8a26f8cf8ce0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:55.277594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:43:55.282911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be89b068-fd61-43e9-9b01-8a26f8cf8ce0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:55.285831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be89b068-fd61-43e9-9b01-8a26f8cf8ce0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:55.286332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be89b068-fd61-43e9-9b01-8a26f8cf8ce0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:55.287383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be89b068-fd61-43e9-9b01-8a26f8cf8ce0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:55.287965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be89b068-fd61-43e9-9b01-8a26f8cf8ce0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:55.288405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be89b068-fd61-43e9-9b01-8a26f8cf8ce0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:55.374295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8d8f24dc-ab63-49fc-ac18-26c183e85438 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:55.375616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8d8f24dc-ab63-49fc-ac18-26c183e85438 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:55.388195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d8f24dc-ab63-49fc-ac18-26c183e85438 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:55.390307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d8f24dc-ab63-49fc-ac18-26c183e85438 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:55.391639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d8f24dc-ab63-49fc-ac18-26c183e85438 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:55.394958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d8f24dc-ab63-49fc-ac18-26c183e85438 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:55.396697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d8f24dc-ab63-49fc-ac18-26c183e85438 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:55.397521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8d8f24dc-ab63-49fc-ac18-26c183e85438 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:55.468794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-be89b068-fd61-43e9-9b01-8a26f8cf8ce0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:55.478253 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-be89b068-fd61-43e9-9b01-8a26f8cf8ce0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1693 microversion: 2.1 time: 0.210120 Oct 29 01:43:55.479411 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3272/6766] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:55 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1693 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:55.526271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9d1703da-40dc-4f20-87a1-a653ccd40dd9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:55.527132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9d1703da-40dc-4f20-87a1-a653ccd40dd9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:55.537513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d1703da-40dc-4f20-87a1-a653ccd40dd9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:55.538599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d1703da-40dc-4f20-87a1-a653ccd40dd9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:55.539985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d1703da-40dc-4f20-87a1-a653ccd40dd9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:55.542543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d1703da-40dc-4f20-87a1-a653ccd40dd9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:55.544294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d1703da-40dc-4f20-87a1-a653ccd40dd9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:55.545600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d1703da-40dc-4f20-87a1-a653ccd40dd9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:55.614712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8d8f24dc-ab63-49fc-ac18-26c183e85438 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:55.633748 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8d8f24dc-ab63-49fc-ac18-26c183e85438 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1494 microversion: 2.1 time: 0.257480 Oct 29 01:43:55.635010 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3495/6767] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:55 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1494 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:55.660057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-351a9a05-5f4c-4081-9e98-bed1d6edcd74 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:55.660896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-351a9a05-5f4c-4081-9e98-bed1d6edcd74 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:55.673061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351a9a05-5f4c-4081-9e98-bed1d6edcd74 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:55.674690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351a9a05-5f4c-4081-9e98-bed1d6edcd74 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:55.675137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351a9a05-5f4c-4081-9e98-bed1d6edcd74 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:55.675862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351a9a05-5f4c-4081-9e98-bed1d6edcd74 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:55.676324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351a9a05-5f4c-4081-9e98-bed1d6edcd74 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:55.676753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-351a9a05-5f4c-4081-9e98-bed1d6edcd74 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:55.770312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9d1703da-40dc-4f20-87a1-a653ccd40dd9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:55.779196 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9d1703da-40dc-4f20-87a1-a653ccd40dd9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.257023 Oct 29 01:43:55.779930 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3273/6768] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:55 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:55.948019 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-351a9a05-5f4c-4081-9e98-bed1d6edcd74 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "POST /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a/action" status: 202 len: 0 microversion: 2.1 time: 0.291806 Oct 29 01:43:55.949043 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3496/6769] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:43:55 2022] POST /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:43:55.965572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3c830ed4-6594-4b26-a6a7-e2aa54a0aab8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:55.968663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3c830ed4-6594-4b26-a6a7-e2aa54a0aab8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:55.978083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c830ed4-6594-4b26-a6a7-e2aa54a0aab8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:55.978819 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c830ed4-6594-4b26-a6a7-e2aa54a0aab8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:55.979425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c830ed4-6594-4b26-a6a7-e2aa54a0aab8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:55.980383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c830ed4-6594-4b26-a6a7-e2aa54a0aab8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:55.981011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c830ed4-6594-4b26-a6a7-e2aa54a0aab8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:55.982006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c830ed4-6594-4b26-a6a7-e2aa54a0aab8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:56.167570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3c830ed4-6594-4b26-a6a7-e2aa54a0aab8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:56.177748 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3c830ed4-6594-4b26-a6a7-e2aa54a0aab8 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1500 microversion: 2.1 time: 0.221090 Oct 29 01:43:56.178956 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3274/6770] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:55 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1500 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:56.236587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-41859f0e-404e-4c4c-9ae2-ea49b0efc282 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:56.239761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-41859f0e-404e-4c4c-9ae2-ea49b0efc282 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:56.257190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41859f0e-404e-4c4c-9ae2-ea49b0efc282 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:56.258144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41859f0e-404e-4c4c-9ae2-ea49b0efc282 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:56.259077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41859f0e-404e-4c4c-9ae2-ea49b0efc282 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:56.260974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41859f0e-404e-4c4c-9ae2-ea49b0efc282 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:56.261956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41859f0e-404e-4c4c-9ae2-ea49b0efc282 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:56.262637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-41859f0e-404e-4c4c-9ae2-ea49b0efc282 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:56.471851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-41859f0e-404e-4c4c-9ae2-ea49b0efc282 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:56.483847 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-41859f0e-404e-4c4c-9ae2-ea49b0efc282 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1680 microversion: 2.1 time: 0.254039 Oct 29 01:43:56.484765 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3497/6771] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:56 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1680 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:56.503100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aac8011b-4669-4f6e-a981-fcf4804f5710 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:56.503707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aac8011b-4669-4f6e-a981-fcf4804f5710 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:56.511455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aac8011b-4669-4f6e-a981-fcf4804f5710 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:56.512207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aac8011b-4669-4f6e-a981-fcf4804f5710 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:56.512889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aac8011b-4669-4f6e-a981-fcf4804f5710 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:56.514422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aac8011b-4669-4f6e-a981-fcf4804f5710 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:56.515084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aac8011b-4669-4f6e-a981-fcf4804f5710 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:56.515807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aac8011b-4669-4f6e-a981-fcf4804f5710 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:56.765822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aac8011b-4669-4f6e-a981-fcf4804f5710 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:56.774504 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aac8011b-4669-4f6e-a981-fcf4804f5710 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1693 microversion: 2.1 time: 0.275534 Oct 29 01:43:56.775819 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3275/6772] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:56 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1693 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:56.802611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1faa3bdc-69f9-47a9-a958-f5d9b2dae262 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:56.803254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1faa3bdc-69f9-47a9-a958-f5d9b2dae262 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:56.810365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1faa3bdc-69f9-47a9-a958-f5d9b2dae262 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:56.811889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1faa3bdc-69f9-47a9-a958-f5d9b2dae262 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:56.812416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1faa3bdc-69f9-47a9-a958-f5d9b2dae262 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:56.813142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1faa3bdc-69f9-47a9-a958-f5d9b2dae262 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:56.813821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1faa3bdc-69f9-47a9-a958-f5d9b2dae262 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:56.814275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1faa3bdc-69f9-47a9-a958-f5d9b2dae262 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:56.979010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1faa3bdc-69f9-47a9-a958-f5d9b2dae262 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:56.986872 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1faa3bdc-69f9-47a9-a958-f5d9b2dae262 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.188515 Oct 29 01:43:56.987449 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3498/6773] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:56 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:57.204025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c7ede4e0-8f08-49af-ae99-f117923c96f1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:57.204711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c7ede4e0-8f08-49af-ae99-f117923c96f1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:57.213855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7ede4e0-8f08-49af-ae99-f117923c96f1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:57.214415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7ede4e0-8f08-49af-ae99-f117923c96f1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:57.214852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7ede4e0-8f08-49af-ae99-f117923c96f1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:57.216035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7ede4e0-8f08-49af-ae99-f117923c96f1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:57.217037 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7ede4e0-8f08-49af-ae99-f117923c96f1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:57.217700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7ede4e0-8f08-49af-ae99-f117923c96f1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:57.387867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c7ede4e0-8f08-49af-ae99-f117923c96f1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:57.401039 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c7ede4e0-8f08-49af-ae99-f117923c96f1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1500 microversion: 2.1 time: 0.202133 Oct 29 01:43:57.402546 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3276/6774] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:57 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1500 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:57.511177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-08661c13-82de-482e-9123-dc7901050445 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:57.511780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-08661c13-82de-482e-9123-dc7901050445 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:57.520770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08661c13-82de-482e-9123-dc7901050445 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:57.521356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08661c13-82de-482e-9123-dc7901050445 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:57.521794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08661c13-82de-482e-9123-dc7901050445 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:57.522643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08661c13-82de-482e-9123-dc7901050445 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:57.523168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08661c13-82de-482e-9123-dc7901050445 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:57.523623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08661c13-82de-482e-9123-dc7901050445 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:57.706249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-08661c13-82de-482e-9123-dc7901050445 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:57.715385 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-08661c13-82de-482e-9123-dc7901050445 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1657 microversion: 2.1 time: 0.208778 Oct 29 01:43:57.716465 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3499/6775] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:57 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1657 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:57.753805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-807208d7-be8b-47ba-aa31-bdb331abea91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:57.763506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-807208d7-be8b-47ba-aa31-bdb331abea91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:57.764201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-807208d7-be8b-47ba-aa31-bdb331abea91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:57.764933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-807208d7-be8b-47ba-aa31-bdb331abea91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:57.796158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-807208d7-be8b-47ba-aa31-bdb331abea91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Going to try to start instance {{(pid=121100) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 01:43:57.799798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-24e83b69-b6df-469e-902f-3d128fcbd471 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:57.800759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-24e83b69-b6df-469e-902f-3d128fcbd471 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:57.807475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24e83b69-b6df-469e-902f-3d128fcbd471 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:57.808553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24e83b69-b6df-469e-902f-3d128fcbd471 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:57.809076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24e83b69-b6df-469e-902f-3d128fcbd471 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:57.810161 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24e83b69-b6df-469e-902f-3d128fcbd471 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:57.810887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24e83b69-b6df-469e-902f-3d128fcbd471 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:57.811516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24e83b69-b6df-469e-902f-3d128fcbd471 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:57.993308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-24e83b69-b6df-469e-902f-3d128fcbd471 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:58.002374 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-24e83b69-b6df-469e-902f-3d128fcbd471 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1693 microversion: 2.1 time: 0.206535 Oct 29 01:43:58.002982 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3500/6776] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:57 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1693 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:58.017306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c78710e3-302d-47ec-aeac-97323cb6e4ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:58.017306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c78710e3-302d-47ec-aeac-97323cb6e4ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:58.020763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c78710e3-302d-47ec-aeac-97323cb6e4ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:58.021523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c78710e3-302d-47ec-aeac-97323cb6e4ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:58.022195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c78710e3-302d-47ec-aeac-97323cb6e4ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:58.023215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c78710e3-302d-47ec-aeac-97323cb6e4ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:58.023565 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-807208d7-be8b-47ba-aa31-bdb331abea91 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.273556 Oct 29 01:43:58.024292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c78710e3-302d-47ec-aeac-97323cb6e4ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:58.025003 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3277/6777] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:43:57 2022] POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:43:58.025358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c78710e3-302d-47ec-aeac-97323cb6e4ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:58.051605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e00753d1-3247-42a0-a7ec-50cfd265f42f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:58.052455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e00753d1-3247-42a0-a7ec-50cfd265f42f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:58.071348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e00753d1-3247-42a0-a7ec-50cfd265f42f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:58.074614 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e00753d1-3247-42a0-a7ec-50cfd265f42f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:58.077175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e00753d1-3247-42a0-a7ec-50cfd265f42f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:58.078164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e00753d1-3247-42a0-a7ec-50cfd265f42f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:58.081057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e00753d1-3247-42a0-a7ec-50cfd265f42f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:58.082283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e00753d1-3247-42a0-a7ec-50cfd265f42f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:58.256402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c78710e3-302d-47ec-aeac-97323cb6e4ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:58.267229 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c78710e3-302d-47ec-aeac-97323cb6e4ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.259544 Oct 29 01:43:58.298438 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3501/6778] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:58 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:58.333478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e00753d1-3247-42a0-a7ec-50cfd265f42f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:58.345118 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e00753d1-3247-42a0-a7ec-50cfd265f42f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1666 microversion: 2.1 time: 0.307632 Oct 29 01:43:58.346597 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3278/6779] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:58 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1666 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:58.429023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f5013345-a6ab-4f0d-9266-a360a9c96afc tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:58.429899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f5013345-a6ab-4f0d-9266-a360a9c96afc tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:58.438929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5013345-a6ab-4f0d-9266-a360a9c96afc tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:58.439984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5013345-a6ab-4f0d-9266-a360a9c96afc tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:58.440816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5013345-a6ab-4f0d-9266-a360a9c96afc tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:58.441687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5013345-a6ab-4f0d-9266-a360a9c96afc tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:58.442171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5013345-a6ab-4f0d-9266-a360a9c96afc tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:58.442784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5013345-a6ab-4f0d-9266-a360a9c96afc tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:58.633575 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f5013345-a6ab-4f0d-9266-a360a9c96afc tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:58.645409 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f5013345-a6ab-4f0d-9266-a360a9c96afc tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1503 microversion: 2.1 time: 0.221395 Oct 29 01:43:58.646350 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3502/6780] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:58 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1503 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:58.674167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6bb3b7bb-ef93-4ef0-8281-f8b23c4f6f20 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:43:58.674884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6bb3b7bb-ef93-4ef0-8281-f8b23c4f6f20 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:58.681733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bb3b7bb-ef93-4ef0-8281-f8b23c4f6f20 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:58.682507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bb3b7bb-ef93-4ef0-8281-f8b23c4f6f20 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:58.683178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bb3b7bb-ef93-4ef0-8281-f8b23c4f6f20 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:58.684001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bb3b7bb-ef93-4ef0-8281-f8b23c4f6f20 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:58.684569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bb3b7bb-ef93-4ef0-8281-f8b23c4f6f20 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:58.685107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bb3b7bb-ef93-4ef0-8281-f8b23c4f6f20 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:58.716278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-6bb3b7bb-ef93-4ef0-8281-f8b23c4f6f20 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lazy-loading 'flavor' on Instance uuid 548bfbb3-44d9-439b-8961-49a31cb98d3a {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:43:59.033591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7dc51643-8227-491c-9245-d48ff6c9d5fe tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:59.034387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7dc51643-8227-491c-9245-d48ff6c9d5fe tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:59.040628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc51643-8227-491c-9245-d48ff6c9d5fe tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:59.041967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc51643-8227-491c-9245-d48ff6c9d5fe tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:59.043017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc51643-8227-491c-9245-d48ff6c9d5fe tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:59.043764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc51643-8227-491c-9245-d48ff6c9d5fe tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:59.044396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc51643-8227-491c-9245-d48ff6c9d5fe tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:59.044828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7dc51643-8227-491c-9245-d48ff6c9d5fe tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:59.092305 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6bb3b7bb-ef93-4ef0-8281-f8b23c4f6f20 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "POST /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a/action" status: 202 len: 0 microversion: 2.1 time: 0.425496 Oct 29 01:43:59.094429 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3279/6781] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:43:58 2022] POST /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:43:59.102460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-10424910-0a27-4ea2-8dbe-d796b872f251 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:59.108577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-10424910-0a27-4ea2-8dbe-d796b872f251 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:59.122276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10424910-0a27-4ea2-8dbe-d796b872f251 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:59.123055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10424910-0a27-4ea2-8dbe-d796b872f251 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:59.124848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10424910-0a27-4ea2-8dbe-d796b872f251 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:59.126634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10424910-0a27-4ea2-8dbe-d796b872f251 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:59.127707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10424910-0a27-4ea2-8dbe-d796b872f251 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:59.128393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-10424910-0a27-4ea2-8dbe-d796b872f251 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:59.260910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7dc51643-8227-491c-9245-d48ff6c9d5fe tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:59.271473 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7dc51643-8227-491c-9245-d48ff6c9d5fe tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1693 microversion: 2.1 time: 0.242520 Oct 29 01:43:59.272070 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3503/6782] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:59 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1693 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:43:59.324619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a926cede-20a9-4370-b631-e2b240286216 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:59.330437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-10424910-0a27-4ea2-8dbe-d796b872f251 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:59.334853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a926cede-20a9-4370-b631-e2b240286216 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:59.343449 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-10424910-0a27-4ea2-8dbe-d796b872f251 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1511 microversion: 2.1 time: 0.245032 Oct 29 01:43:59.345732 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3280/6783] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:59 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1511 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:59.353327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a926cede-20a9-4370-b631-e2b240286216 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:59.353814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a926cede-20a9-4370-b631-e2b240286216 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:59.354335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a926cede-20a9-4370-b631-e2b240286216 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:59.355304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a926cede-20a9-4370-b631-e2b240286216 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:59.355739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a926cede-20a9-4370-b631-e2b240286216 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:59.356253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a926cede-20a9-4370-b631-e2b240286216 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:59.373792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-19250506-2e90-450a-ace2-60bc6fdec3e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:43:59.374448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-19250506-2e90-450a-ace2-60bc6fdec3e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:43:59.380635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19250506-2e90-450a-ace2-60bc6fdec3e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:59.381124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19250506-2e90-450a-ace2-60bc6fdec3e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:59.381586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19250506-2e90-450a-ace2-60bc6fdec3e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:59.382540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19250506-2e90-450a-ace2-60bc6fdec3e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:43:59.382996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19250506-2e90-450a-ace2-60bc6fdec3e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:43:59.383674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-19250506-2e90-450a-ace2-60bc6fdec3e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:43:59.566805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a926cede-20a9-4370-b631-e2b240286216 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:59.575022 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a926cede-20a9-4370-b631-e2b240286216 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1169 microversion: 2.1 time: 0.255484 Oct 29 01:43:59.578365 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3504/6784] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:59 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1169 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:43:59.580090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-19250506-2e90-450a-ace2-60bc6fdec3e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:43:59.588013 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-19250506-2e90-450a-ace2-60bc6fdec3e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1666 microversion: 2.1 time: 0.218289 Oct 29 01:43:59.591229 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3281/6785] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:43:59 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1666 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:00.298030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-215d9c8c-5aa8-4608-9616-39b509378a2c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:00.298637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-215d9c8c-5aa8-4608-9616-39b509378a2c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:00.300677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:44:00.305750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-215d9c8c-5aa8-4608-9616-39b509378a2c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:00.306230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-215d9c8c-5aa8-4608-9616-39b509378a2c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:00.306865 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-215d9c8c-5aa8-4608-9616-39b509378a2c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:00.307745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-215d9c8c-5aa8-4608-9616-39b509378a2c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:00.308198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-215d9c8c-5aa8-4608-9616-39b509378a2c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:00.308624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-215d9c8c-5aa8-4608-9616-39b509378a2c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:00.313594 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:44:00.369143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d217406-8b57-4547-9daf-c60db35dcff1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:00.369841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7d217406-8b57-4547-9daf-c60db35dcff1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:00.379502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d217406-8b57-4547-9daf-c60db35dcff1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:00.380056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d217406-8b57-4547-9daf-c60db35dcff1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:00.380524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d217406-8b57-4547-9daf-c60db35dcff1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:00.381269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d217406-8b57-4547-9daf-c60db35dcff1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:00.381907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d217406-8b57-4547-9daf-c60db35dcff1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:00.382514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d217406-8b57-4547-9daf-c60db35dcff1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:00.400682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:44:00.513957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-215d9c8c-5aa8-4608-9616-39b509378a2c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:00.525871 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-215d9c8c-5aa8-4608-9616-39b509378a2c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1693 microversion: 2.1 time: 0.232343 Oct 29 01:44:00.526836 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3505/6786] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:00 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1693 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:00.565454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7d217406-8b57-4547-9daf-c60db35dcff1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:00.575157 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7d217406-8b57-4547-9daf-c60db35dcff1 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1511 microversion: 2.1 time: 0.210012 Oct 29 01:44:00.575737 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3282/6787] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:00 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1511 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:00.598915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9210150f-4ddb-4e3c-9fcc-b9b13be33049 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:00.599539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9210150f-4ddb-4e3c-9fcc-b9b13be33049 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:00.605719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9210150f-4ddb-4e3c-9fcc-b9b13be33049 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:00.606485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9210150f-4ddb-4e3c-9fcc-b9b13be33049 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:00.607068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9210150f-4ddb-4e3c-9fcc-b9b13be33049 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:00.607782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9210150f-4ddb-4e3c-9fcc-b9b13be33049 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:00.608276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9210150f-4ddb-4e3c-9fcc-b9b13be33049 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:00.608987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9210150f-4ddb-4e3c-9fcc-b9b13be33049 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:00.614315 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-81933688-86af-461a-ab55-3d0dc21d2b28 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:00.614936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-81933688-86af-461a-ab55-3d0dc21d2b28 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:00.622247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81933688-86af-461a-ab55-3d0dc21d2b28 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:00.624157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81933688-86af-461a-ab55-3d0dc21d2b28 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:00.624157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81933688-86af-461a-ab55-3d0dc21d2b28 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:00.625834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81933688-86af-461a-ab55-3d0dc21d2b28 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:00.626453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81933688-86af-461a-ab55-3d0dc21d2b28 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:00.626885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81933688-86af-461a-ab55-3d0dc21d2b28 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:00.831126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9210150f-4ddb-4e3c-9fcc-b9b13be33049 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:00.840917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-81933688-86af-461a-ab55-3d0dc21d2b28 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:00.847824 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-81933688-86af-461a-ab55-3d0dc21d2b28 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.235016 Oct 29 01:44:00.847931 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9210150f-4ddb-4e3c-9fcc-b9b13be33049 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1203 microversion: 2.1 time: 0.251123 Oct 29 01:44:00.847931 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3506/6788] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:00 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1203 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:00.862142 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3283/6789] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:00 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:00.876332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-945ec905-b5d5-4968-931d-04babc0b92bb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:00.876940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-945ec905-b5d5-4968-931d-04babc0b92bb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:00.883256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-945ec905-b5d5-4968-931d-04babc0b92bb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:00.883743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-945ec905-b5d5-4968-931d-04babc0b92bb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:00.884176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-945ec905-b5d5-4968-931d-04babc0b92bb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:00.884876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-945ec905-b5d5-4968-931d-04babc0b92bb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:00.885368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-945ec905-b5d5-4968-931d-04babc0b92bb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:00.885984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-945ec905-b5d5-4968-931d-04babc0b92bb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:01.055584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-945ec905-b5d5-4968-931d-04babc0b92bb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:01.064602 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-945ec905-b5d5-4968-931d-04babc0b92bb tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.192248 Oct 29 01:44:01.077086 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3507/6790] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:00 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:01.093970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-089b46d7-411e-4875-a6f9-f1f3d851be1d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:01.097675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-089b46d7-411e-4875-a6f9-f1f3d851be1d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:01.101319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-089b46d7-411e-4875-a6f9-f1f3d851be1d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:01.101836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-089b46d7-411e-4875-a6f9-f1f3d851be1d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:01.102460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-089b46d7-411e-4875-a6f9-f1f3d851be1d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:01.103682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-089b46d7-411e-4875-a6f9-f1f3d851be1d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:01.104521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-089b46d7-411e-4875-a6f9-f1f3d851be1d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:01.105110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-089b46d7-411e-4875-a6f9-f1f3d851be1d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:01.255163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-089b46d7-411e-4875-a6f9-f1f3d851be1d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:01.264000 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-089b46d7-411e-4875-a6f9-f1f3d851be1d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.174969 Oct 29 01:44:01.265712 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3284/6791] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:01 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:01.287799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-afc77cc9-075a-49b5-98fc-2d777356670c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:01.288671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-afc77cc9-075a-49b5-98fc-2d777356670c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:01.294917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afc77cc9-075a-49b5-98fc-2d777356670c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:01.295707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afc77cc9-075a-49b5-98fc-2d777356670c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:01.296581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afc77cc9-075a-49b5-98fc-2d777356670c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:01.297424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afc77cc9-075a-49b5-98fc-2d777356670c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:01.297952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afc77cc9-075a-49b5-98fc-2d777356670c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:01.298655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afc77cc9-075a-49b5-98fc-2d777356670c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:01.442631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-afc77cc9-075a-49b5-98fc-2d777356670c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:01.451431 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-afc77cc9-075a-49b5-98fc-2d777356670c tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.167625 Oct 29 01:44:01.452062 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3508/6792] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:01 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:01.474271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8deb9e44-21a8-4b97-a148-4eb10fd4967f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:01.474886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8deb9e44-21a8-4b97-a148-4eb10fd4967f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:01.482175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8deb9e44-21a8-4b97-a148-4eb10fd4967f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:01.482956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8deb9e44-21a8-4b97-a148-4eb10fd4967f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:01.484188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8deb9e44-21a8-4b97-a148-4eb10fd4967f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:01.485356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8deb9e44-21a8-4b97-a148-4eb10fd4967f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:01.485958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8deb9e44-21a8-4b97-a148-4eb10fd4967f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:01.486655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8deb9e44-21a8-4b97-a148-4eb10fd4967f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:01.550850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9def2317-67fd-4a8a-8e67-ac59f9b97a47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:01.555226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9def2317-67fd-4a8a-8e67-ac59f9b97a47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:01.559375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9def2317-67fd-4a8a-8e67-ac59f9b97a47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:01.559959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9def2317-67fd-4a8a-8e67-ac59f9b97a47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:01.560525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9def2317-67fd-4a8a-8e67-ac59f9b97a47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:01.561444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9def2317-67fd-4a8a-8e67-ac59f9b97a47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:01.562151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9def2317-67fd-4a8a-8e67-ac59f9b97a47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:01.562656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9def2317-67fd-4a8a-8e67-ac59f9b97a47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:01.677190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8deb9e44-21a8-4b97-a148-4eb10fd4967f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:01.694676 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8deb9e44-21a8-4b97-a148-4eb10fd4967f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.224177 Oct 29 01:44:01.695470 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3285/6793] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:01 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:01.704566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-17cf270a-78f5-453a-89d5-f266e050cbe4 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:01.705398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-17cf270a-78f5-453a-89d5-f266e050cbe4 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:01.713079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17cf270a-78f5-453a-89d5-f266e050cbe4 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:01.713618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17cf270a-78f5-453a-89d5-f266e050cbe4 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:01.714060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17cf270a-78f5-453a-89d5-f266e050cbe4 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:01.714774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17cf270a-78f5-453a-89d5-f266e050cbe4 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:01.715244 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17cf270a-78f5-453a-89d5-f266e050cbe4 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:01.715675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17cf270a-78f5-453a-89d5-f266e050cbe4 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:01.781589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9def2317-67fd-4a8a-8e67-ac59f9b97a47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:01.795233 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9def2317-67fd-4a8a-8e67-ac59f9b97a47 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1693 microversion: 2.1 time: 0.248440 Oct 29 01:44:01.805972 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3509/6794] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:01 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1693 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:01.813415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8c147fc5-01dd-4905-aad1-d783ca98c371 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:01.814168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8c147fc5-01dd-4905-aad1-d783ca98c371 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:01.822989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c147fc5-01dd-4905-aad1-d783ca98c371 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:01.824748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c147fc5-01dd-4905-aad1-d783ca98c371 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:01.825232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c147fc5-01dd-4905-aad1-d783ca98c371 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:01.827125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c147fc5-01dd-4905-aad1-d783ca98c371 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:01.827812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c147fc5-01dd-4905-aad1-d783ca98c371 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:01.828257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c147fc5-01dd-4905-aad1-d783ca98c371 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:01.855458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-8c147fc5-01dd-4905-aad1-d783ca98c371 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lazy-loading 'flavor' on Instance uuid 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:44:01.894688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-17cf270a-78f5-453a-89d5-f266e050cbe4 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:01.902887 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-17cf270a-78f5-453a-89d5-f266e050cbe4 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1494 microversion: 2.1 time: 0.206518 Oct 29 01:44:01.904292 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3286/6795] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:01 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1494 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:01.909910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-70cfd23b-87c6-4231-91d5-6b3854634195 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:01.910593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-70cfd23b-87c6-4231-91d5-6b3854634195 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:01.917195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70cfd23b-87c6-4231-91d5-6b3854634195 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:01.925663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70cfd23b-87c6-4231-91d5-6b3854634195 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:01.925663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70cfd23b-87c6-4231-91d5-6b3854634195 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:01.925663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70cfd23b-87c6-4231-91d5-6b3854634195 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:01.925663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70cfd23b-87c6-4231-91d5-6b3854634195 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:01.925663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-70cfd23b-87c6-4231-91d5-6b3854634195 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:02.091028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-70cfd23b-87c6-4231-91d5-6b3854634195 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:02.101400 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-70cfd23b-87c6-4231-91d5-6b3854634195 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1203 microversion: 2.1 time: 0.195357 Oct 29 01:44:02.102020 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3287/6796] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:01 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1203 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:02.107675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d5166847-ee9e-47a0-91ee-ccea6eb1ee42 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:02.109199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d5166847-ee9e-47a0-91ee-ccea6eb1ee42 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:02.118629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5166847-ee9e-47a0-91ee-ccea6eb1ee42 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:02.119282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5166847-ee9e-47a0-91ee-ccea6eb1ee42 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:02.119809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5166847-ee9e-47a0-91ee-ccea6eb1ee42 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:02.120804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5166847-ee9e-47a0-91ee-ccea6eb1ee42 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:02.121557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5166847-ee9e-47a0-91ee-ccea6eb1ee42 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:02.122412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d5166847-ee9e-47a0-91ee-ccea6eb1ee42 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:02.471203 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8c147fc5-01dd-4905-aad1-d783ca98c371 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.663785 Oct 29 01:44:02.471982 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3510/6797] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:44:01 2022] POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:44:02.480666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-47e99096-d3d7-45af-9c25-87c4b1136fd2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:02.481634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-47e99096-d3d7-45af-9c25-87c4b1136fd2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:02.488172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47e99096-d3d7-45af-9c25-87c4b1136fd2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:02.488669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47e99096-d3d7-45af-9c25-87c4b1136fd2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:02.489111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47e99096-d3d7-45af-9c25-87c4b1136fd2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:02.489856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47e99096-d3d7-45af-9c25-87c4b1136fd2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:02.490311 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47e99096-d3d7-45af-9c25-87c4b1136fd2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:02.490740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-47e99096-d3d7-45af-9c25-87c4b1136fd2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:02.530099 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d5166847-ee9e-47a0-91ee-ccea6eb1ee42 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "POST /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a/action" status: 202 len: 0 microversion: 2.1 time: 0.426744 Oct 29 01:44:02.537875 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3288/6798] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:44:02 2022] POST /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:44:02.547726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6e20f58b-6bd9-4f53-88e9-58f8157c82fa tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:02.548460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6e20f58b-6bd9-4f53-88e9-58f8157c82fa tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:02.558276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e20f58b-6bd9-4f53-88e9-58f8157c82fa tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:02.558781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e20f58b-6bd9-4f53-88e9-58f8157c82fa tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:02.559220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e20f58b-6bd9-4f53-88e9-58f8157c82fa tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:02.559931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e20f58b-6bd9-4f53-88e9-58f8157c82fa tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:02.560458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e20f58b-6bd9-4f53-88e9-58f8157c82fa tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:02.560836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e20f58b-6bd9-4f53-88e9-58f8157c82fa tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:02.685683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-47e99096-d3d7-45af-9c25-87c4b1136fd2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:02.695608 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-47e99096-d3d7-45af-9c25-87c4b1136fd2 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1678 microversion: 2.1 time: 0.219264 Oct 29 01:44:02.696372 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3511/6799] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:02 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1678 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:02.743572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6e20f58b-6bd9-4f53-88e9-58f8157c82fa tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:02.761052 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6e20f58b-6bd9-4f53-88e9-58f8157c82fa tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1500 microversion: 2.1 time: 0.217451 Oct 29 01:44:02.761916 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3289/6800] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:02 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1500 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:02.820613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e0ad7d7f-1b79-4f99-b3fa-d0a46a8bc94d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:02.821764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e0ad7d7f-1b79-4f99-b3fa-d0a46a8bc94d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:02.830877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0ad7d7f-1b79-4f99-b3fa-d0a46a8bc94d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:02.831765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0ad7d7f-1b79-4f99-b3fa-d0a46a8bc94d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:02.832284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0ad7d7f-1b79-4f99-b3fa-d0a46a8bc94d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:02.833078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0ad7d7f-1b79-4f99-b3fa-d0a46a8bc94d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:02.833725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0ad7d7f-1b79-4f99-b3fa-d0a46a8bc94d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:02.834374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0ad7d7f-1b79-4f99-b3fa-d0a46a8bc94d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:03.075905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e0ad7d7f-1b79-4f99-b3fa-d0a46a8bc94d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:03.089438 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e0ad7d7f-1b79-4f99-b3fa-d0a46a8bc94d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1693 microversion: 2.1 time: 0.273179 Oct 29 01:44:03.090611 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3512/6801] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:02 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1693 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:03.128094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-021954f4-989f-4272-abcc-c55ec3fc3466 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:03.128804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-021954f4-989f-4272-abcc-c55ec3fc3466 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:03.135613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-021954f4-989f-4272-abcc-c55ec3fc3466 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:03.136101 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-021954f4-989f-4272-abcc-c55ec3fc3466 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:03.136593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-021954f4-989f-4272-abcc-c55ec3fc3466 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:03.137329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-021954f4-989f-4272-abcc-c55ec3fc3466 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:03.137784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-021954f4-989f-4272-abcc-c55ec3fc3466 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:03.138209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-021954f4-989f-4272-abcc-c55ec3fc3466 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:03.351477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-021954f4-989f-4272-abcc-c55ec3fc3466 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:03.361932 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-021954f4-989f-4272-abcc-c55ec3fc3466 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1203 microversion: 2.1 time: 0.238600 Oct 29 01:44:03.373193 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3290/6802] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:03 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1203 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:03.720618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-14aac7c8-748b-4ce2-833c-018c9804ac30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:03.722116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-14aac7c8-748b-4ce2-833c-018c9804ac30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:03.729634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14aac7c8-748b-4ce2-833c-018c9804ac30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:03.730126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14aac7c8-748b-4ce2-833c-018c9804ac30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:03.730599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14aac7c8-748b-4ce2-833c-018c9804ac30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:03.731289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14aac7c8-748b-4ce2-833c-018c9804ac30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:03.731751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14aac7c8-748b-4ce2-833c-018c9804ac30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:03.732367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-14aac7c8-748b-4ce2-833c-018c9804ac30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:03.788148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fa8557d7-d620-4279-9cb9-018f1d31ecd7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:03.788870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fa8557d7-d620-4279-9cb9-018f1d31ecd7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:03.795679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa8557d7-d620-4279-9cb9-018f1d31ecd7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:03.800913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa8557d7-d620-4279-9cb9-018f1d31ecd7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:03.800913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa8557d7-d620-4279-9cb9-018f1d31ecd7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:03.800913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa8557d7-d620-4279-9cb9-018f1d31ecd7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:03.800913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa8557d7-d620-4279-9cb9-018f1d31ecd7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:03.800913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa8557d7-d620-4279-9cb9-018f1d31ecd7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:03.944362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-14aac7c8-748b-4ce2-833c-018c9804ac30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:03.958669 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-14aac7c8-748b-4ce2-833c-018c9804ac30 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1661 microversion: 2.1 time: 0.242921 Oct 29 01:44:03.959255 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3513/6803] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:03 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1661 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:03.982851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9e64d485-f0cd-48e9-a5df-623e9387626e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:03.983929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9e64d485-f0cd-48e9-a5df-623e9387626e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:03.990234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e64d485-f0cd-48e9-a5df-623e9387626e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:03.990723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e64d485-f0cd-48e9-a5df-623e9387626e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:03.991161 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e64d485-f0cd-48e9-a5df-623e9387626e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:03.991876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e64d485-f0cd-48e9-a5df-623e9387626e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:03.992320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e64d485-f0cd-48e9-a5df-623e9387626e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:03.993175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9e64d485-f0cd-48e9-a5df-623e9387626e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:03.996020 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fa8557d7-d620-4279-9cb9-018f1d31ecd7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:04.004790 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fa8557d7-d620-4279-9cb9-018f1d31ecd7 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1500 microversion: 2.1 time: 0.220621 Oct 29 01:44:04.017772 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3291/6804] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:03 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1500 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:04.115341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-078017cb-8b8f-40e3-afa7-89006c816b90 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:04.116093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-078017cb-8b8f-40e3-afa7-89006c816b90 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:04.122568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-078017cb-8b8f-40e3-afa7-89006c816b90 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:04.123121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-078017cb-8b8f-40e3-afa7-89006c816b90 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:04.123809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-078017cb-8b8f-40e3-afa7-89006c816b90 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:04.125886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-078017cb-8b8f-40e3-afa7-89006c816b90 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:04.126411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-078017cb-8b8f-40e3-afa7-89006c816b90 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:04.126911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-078017cb-8b8f-40e3-afa7-89006c816b90 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:04.216458 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9e64d485-f0cd-48e9-a5df-623e9387626e tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.237756 Oct 29 01:44:04.217450 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3514/6805] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:44:03 2022] POST /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:44:04.226531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-59a57eb4-bf94-480f-84a6-c6661d77dc74 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:04.229839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-59a57eb4-bf94-480f-84a6-c6661d77dc74 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:04.237701 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a57eb4-bf94-480f-84a6-c6661d77dc74 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:04.238457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a57eb4-bf94-480f-84a6-c6661d77dc74 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:04.239042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a57eb4-bf94-480f-84a6-c6661d77dc74 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:04.239933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a57eb4-bf94-480f-84a6-c6661d77dc74 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:04.240560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a57eb4-bf94-480f-84a6-c6661d77dc74 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:04.241132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a57eb4-bf94-480f-84a6-c6661d77dc74 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:04.382745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-078017cb-8b8f-40e3-afa7-89006c816b90 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:04.391538 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-078017cb-8b8f-40e3-afa7-89006c816b90 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1683 microversion: 2.1 time: 0.280000 Oct 29 01:44:04.398302 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3292/6806] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:04 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1683 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:04.403510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f5192b9f-4668-4aa1-acd8-32a7991a9863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:04.407413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f5192b9f-4668-4aa1-acd8-32a7991a9863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:04.424781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5192b9f-4668-4aa1-acd8-32a7991a9863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:04.425621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5192b9f-4668-4aa1-acd8-32a7991a9863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:04.427415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5192b9f-4668-4aa1-acd8-32a7991a9863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:04.431071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5192b9f-4668-4aa1-acd8-32a7991a9863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:04.431789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5192b9f-4668-4aa1-acd8-32a7991a9863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:04.432436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f5192b9f-4668-4aa1-acd8-32a7991a9863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:04.476824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-59a57eb4-bf94-480f-84a6-c6661d77dc74 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:04.486240 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-59a57eb4-bf94-480f-84a6-c6661d77dc74 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1667 microversion: 2.1 time: 0.263677 Oct 29 01:44:04.487327 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3515/6807] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:04 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1667 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:04.506244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d8268374-c6b4-421c-af9d-5729aea443cf tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:04.507920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d8268374-c6b4-421c-af9d-5729aea443cf tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:04.523813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8268374-c6b4-421c-af9d-5729aea443cf tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:04.524578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8268374-c6b4-421c-af9d-5729aea443cf tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:04.525041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8268374-c6b4-421c-af9d-5729aea443cf tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:04.526006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8268374-c6b4-421c-af9d-5729aea443cf tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:04.526622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8268374-c6b4-421c-af9d-5729aea443cf tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:04.527217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8268374-c6b4-421c-af9d-5729aea443cf tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:04.679991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f5192b9f-4668-4aa1-acd8-32a7991a9863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:04.689054 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f5192b9f-4668-4aa1-acd8-32a7991a9863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1203 microversion: 2.1 time: 0.289328 Oct 29 01:44:04.690003 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3293/6808] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:04 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1203 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:04.830199 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d8268374-c6b4-421c-af9d-5729aea443cf tempest-TestNetworkAdvancedServerOps-1566893934 tempest-TestNetworkAdvancedServerOps-1566893934-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1834 microversion: 2.1 time: 0.341502 Oct 29 01:44:04.831972 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3516/6809] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:04 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1834 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:04.854802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-06b79daa-a67b-45a6-a29d-e4da33eb2326 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:04.855643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-06b79daa-a67b-45a6-a29d-e4da33eb2326 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:04.863274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06b79daa-a67b-45a6-a29d-e4da33eb2326 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:04.863761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06b79daa-a67b-45a6-a29d-e4da33eb2326 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:04.864192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06b79daa-a67b-45a6-a29d-e4da33eb2326 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:04.865079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06b79daa-a67b-45a6-a29d-e4da33eb2326 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:04.865720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06b79daa-a67b-45a6-a29d-e4da33eb2326 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:04.866314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-06b79daa-a67b-45a6-a29d-e4da33eb2326 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:05.030285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1f8c5567-2481-4f36-9bde-6cd1e7e7fcf5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:05.031769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1f8c5567-2481-4f36-9bde-6cd1e7e7fcf5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:05.041864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f8c5567-2481-4f36-9bde-6cd1e7e7fcf5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:05.042359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f8c5567-2481-4f36-9bde-6cd1e7e7fcf5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:05.045074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f8c5567-2481-4f36-9bde-6cd1e7e7fcf5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:05.045074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f8c5567-2481-4f36-9bde-6cd1e7e7fcf5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:05.045074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f8c5567-2481-4f36-9bde-6cd1e7e7fcf5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:05.045074 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1f8c5567-2481-4f36-9bde-6cd1e7e7fcf5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:05.126154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-06b79daa-a67b-45a6-a29d-e4da33eb2326 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:05.134985 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-06b79daa-a67b-45a6-a29d-e4da33eb2326 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1683 microversion: 2.1 time: 0.284157 Oct 29 01:44:05.137883 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3294/6810] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:04 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1683 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:05.283613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1f8c5567-2481-4f36-9bde-6cd1e7e7fcf5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:05.292731 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1f8c5567-2481-4f36-9bde-6cd1e7e7fcf5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1503 microversion: 2.1 time: 0.266604 Oct 29 01:44:05.293571 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3517/6811] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:05 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1503 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:05.318409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7ad1a1a3-f29f-4ad0-88b6-8b896cce6586 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:05.319136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7ad1a1a3-f29f-4ad0-88b6-8b896cce6586 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:05.325440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ad1a1a3-f29f-4ad0-88b6-8b896cce6586 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:05.325920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ad1a1a3-f29f-4ad0-88b6-8b896cce6586 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:05.326535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ad1a1a3-f29f-4ad0-88b6-8b896cce6586 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:05.328021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ad1a1a3-f29f-4ad0-88b6-8b896cce6586 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:05.328657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ad1a1a3-f29f-4ad0-88b6-8b896cce6586 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:05.329270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7ad1a1a3-f29f-4ad0-88b6-8b896cce6586 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:05.356098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7ad1a1a3-f29f-4ad0-88b6-8b896cce6586 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:44:05.513079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-851ba7de-c6c9-43e3-b07d-28ae1a48e899 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:05.513079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-851ba7de-c6c9-43e3-b07d-28ae1a48e899 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:05.519389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-851ba7de-c6c9-43e3-b07d-28ae1a48e899 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:05.520134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-851ba7de-c6c9-43e3-b07d-28ae1a48e899 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:05.520737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-851ba7de-c6c9-43e3-b07d-28ae1a48e899 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:05.521660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-851ba7de-c6c9-43e3-b07d-28ae1a48e899 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:05.522309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-851ba7de-c6c9-43e3-b07d-28ae1a48e899 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:05.523067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-851ba7de-c6c9-43e3-b07d-28ae1a48e899 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:05.666042 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7ad1a1a3-f29f-4ad0-88b6-8b896cce6586 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "DELETE /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 204 len: 0 microversion: 2.1 time: 0.353004 Oct 29 01:44:05.666690 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3295/6812] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:44:05 2022] DELETE /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:44:05.677211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6bba8a61-6152-4fcc-9f2a-ec4ed2c0a88b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:05.677940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6bba8a61-6152-4fcc-9f2a-ec4ed2c0a88b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:05.688033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bba8a61-6152-4fcc-9f2a-ec4ed2c0a88b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:05.692179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bba8a61-6152-4fcc-9f2a-ec4ed2c0a88b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:05.692179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bba8a61-6152-4fcc-9f2a-ec4ed2c0a88b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:05.692179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bba8a61-6152-4fcc-9f2a-ec4ed2c0a88b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:05.692179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bba8a61-6152-4fcc-9f2a-ec4ed2c0a88b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:05.692179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6bba8a61-6152-4fcc-9f2a-ec4ed2c0a88b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:05.694163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:44:05.902815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-851ba7de-c6c9-43e3-b07d-28ae1a48e899 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:05.915116 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-851ba7de-c6c9-43e3-b07d-28ae1a48e899 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1667 microversion: 2.1 time: 0.408952 Oct 29 01:44:05.916226 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3518/6813] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:05 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1667 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:05.923404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e6ec23fa-98e1-441d-8c06-23720a097f52 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:05.924210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e6ec23fa-98e1-441d-8c06-23720a097f52 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:05.931318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6bba8a61-6152-4fcc-9f2a-ec4ed2c0a88b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:05.935190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6ec23fa-98e1-441d-8c06-23720a097f52 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:05.935997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6ec23fa-98e1-441d-8c06-23720a097f52 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:05.936662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6ec23fa-98e1-441d-8c06-23720a097f52 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:05.937925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6ec23fa-98e1-441d-8c06-23720a097f52 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:05.938582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6ec23fa-98e1-441d-8c06-23720a097f52 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:05.939704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6ec23fa-98e1-441d-8c06-23720a097f52 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:05.942184 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6bba8a61-6152-4fcc-9f2a-ec4ed2c0a88b tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1509 microversion: 2.1 time: 0.270108 Oct 29 01:44:05.942928 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3296/6814] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:05 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1509 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:05.946987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:44:06.148796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e6ec23fa-98e1-441d-8c06-23720a097f52 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:06.148796 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e6ec23fa-98e1-441d-8c06-23720a097f52 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1203 microversion: 2.1 time: 0.185863 Oct 29 01:44:06.148796 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3519/6815] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:05 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1203 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:06.941092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eb6e9762-3f75-4eaf-a30a-d64cc0151f58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:06.941855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-eb6e9762-3f75-4eaf-a30a-d64cc0151f58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:06.949025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb6e9762-3f75-4eaf-a30a-d64cc0151f58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:06.949533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb6e9762-3f75-4eaf-a30a-d64cc0151f58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:06.949974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb6e9762-3f75-4eaf-a30a-d64cc0151f58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:06.950669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb6e9762-3f75-4eaf-a30a-d64cc0151f58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:06.951124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb6e9762-3f75-4eaf-a30a-d64cc0151f58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:06.951549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb6e9762-3f75-4eaf-a30a-d64cc0151f58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:06.968540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-17e4d568-b117-42fc-aedf-00e8bd5e32bd tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:06.985716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-17e4d568-b117-42fc-aedf-00e8bd5e32bd tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:06.993632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17e4d568-b117-42fc-aedf-00e8bd5e32bd tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:06.994125 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17e4d568-b117-42fc-aedf-00e8bd5e32bd tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:06.994988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17e4d568-b117-42fc-aedf-00e8bd5e32bd tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:06.995432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17e4d568-b117-42fc-aedf-00e8bd5e32bd tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:06.995897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17e4d568-b117-42fc-aedf-00e8bd5e32bd tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:06.996328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17e4d568-b117-42fc-aedf-00e8bd5e32bd tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:07.162120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-eb6e9762-3f75-4eaf-a30a-d64cc0151f58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:07.170006 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-eb6e9762-3f75-4eaf-a30a-d64cc0151f58 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1667 microversion: 2.1 time: 0.233534 Oct 29 01:44:07.170584 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3297/6816] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:06 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1667 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:07.176363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9d23e233-1706-4f64-b294-8f38b156cc8f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:07.176977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9d23e233-1706-4f64-b294-8f38b156cc8f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:07.182906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d23e233-1706-4f64-b294-8f38b156cc8f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:07.183423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d23e233-1706-4f64-b294-8f38b156cc8f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:07.183880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d23e233-1706-4f64-b294-8f38b156cc8f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:07.184563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d23e233-1706-4f64-b294-8f38b156cc8f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:07.185017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d23e233-1706-4f64-b294-8f38b156cc8f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:07.185472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9d23e233-1706-4f64-b294-8f38b156cc8f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:07.187755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-17e4d568-b117-42fc-aedf-00e8bd5e32bd tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:07.196455 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-17e4d568-b117-42fc-aedf-00e8bd5e32bd tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1509 microversion: 2.1 time: 0.232404 Oct 29 01:44:07.197385 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3520/6817] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:06 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:07.299234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2b1f3798-f206-4219-9fdb-57442e5ea9c4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:07.302172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2b1f3798-f206-4219-9fdb-57442e5ea9c4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:07.310358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b1f3798-f206-4219-9fdb-57442e5ea9c4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:07.311242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b1f3798-f206-4219-9fdb-57442e5ea9c4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:07.312610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b1f3798-f206-4219-9fdb-57442e5ea9c4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:07.321268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b1f3798-f206-4219-9fdb-57442e5ea9c4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:07.321268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b1f3798-f206-4219-9fdb-57442e5ea9c4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:07.321268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2b1f3798-f206-4219-9fdb-57442e5ea9c4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:07.376281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9d23e233-1706-4f64-b294-8f38b156cc8f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:07.386410 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2b1f3798-f206-4219-9fdb-57442e5ea9c4 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410/action" status: 200 len: 38353 microversion: 2.1 time: 0.092848 Oct 29 01:44:07.396584 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3521/6818] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:44:07 2022] POST /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410/action => generated 38353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:44:07.396739 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9d23e233-1706-4f64-b294-8f38b156cc8f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1203 microversion: 2.1 time: 0.220578 Oct 29 01:44:07.396739 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3298/6819] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:07 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1203 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:08.197304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f8bf09be-1a13-49af-bfea-0a2685b8316b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:08.198628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f8bf09be-1a13-49af-bfea-0a2685b8316b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:08.207721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8bf09be-1a13-49af-bfea-0a2685b8316b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:08.208464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8bf09be-1a13-49af-bfea-0a2685b8316b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:08.209080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8bf09be-1a13-49af-bfea-0a2685b8316b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:08.210097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8bf09be-1a13-49af-bfea-0a2685b8316b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:08.210708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8bf09be-1a13-49af-bfea-0a2685b8316b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:08.211289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f8bf09be-1a13-49af-bfea-0a2685b8316b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:08.222482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e554d6fc-2a30-487c-9ca1-c69137cb9af3 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:08.223477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e554d6fc-2a30-487c-9ca1-c69137cb9af3 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:08.234324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e554d6fc-2a30-487c-9ca1-c69137cb9af3 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:08.234753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e554d6fc-2a30-487c-9ca1-c69137cb9af3 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:08.235922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e554d6fc-2a30-487c-9ca1-c69137cb9af3 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:08.236747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e554d6fc-2a30-487c-9ca1-c69137cb9af3 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:08.237839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e554d6fc-2a30-487c-9ca1-c69137cb9af3 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:08.238524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e554d6fc-2a30-487c-9ca1-c69137cb9af3 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:08.407239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e554d6fc-2a30-487c-9ca1-c69137cb9af3 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:08.417185 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e554d6fc-2a30-487c-9ca1-c69137cb9af3 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1509 microversion: 2.1 time: 0.201092 Oct 29 01:44:08.419211 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3299/6820] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:08 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:08.435508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fd97003c-2918-4e0f-9ae6-91e37d78e991 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:08.436124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fd97003c-2918-4e0f-9ae6-91e37d78e991 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:08.455970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd97003c-2918-4e0f-9ae6-91e37d78e991 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:08.456442 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd97003c-2918-4e0f-9ae6-91e37d78e991 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:08.458843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd97003c-2918-4e0f-9ae6-91e37d78e991 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:08.459575 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd97003c-2918-4e0f-9ae6-91e37d78e991 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:08.460043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd97003c-2918-4e0f-9ae6-91e37d78e991 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:08.460474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fd97003c-2918-4e0f-9ae6-91e37d78e991 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:08.704971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f8bf09be-1a13-49af-bfea-0a2685b8316b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:08.713715 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f8bf09be-1a13-49af-bfea-0a2685b8316b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1667 microversion: 2.1 time: 0.521527 Oct 29 01:44:08.714308 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3522/6821] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:08 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1667 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:08.719529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-172d19f2-042f-45ce-a6ff-77912f6f07db tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:08.720026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-172d19f2-042f-45ce-a6ff-77912f6f07db tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:08.726541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-172d19f2-042f-45ce-a6ff-77912f6f07db tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:08.727083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-172d19f2-042f-45ce-a6ff-77912f6f07db tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:08.727524 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-172d19f2-042f-45ce-a6ff-77912f6f07db tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:08.728228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-172d19f2-042f-45ce-a6ff-77912f6f07db tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:08.728687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-172d19f2-042f-45ce-a6ff-77912f6f07db tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:08.731978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-172d19f2-042f-45ce-a6ff-77912f6f07db tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:08.736799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fd97003c-2918-4e0f-9ae6-91e37d78e991 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:08.745843 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fd97003c-2918-4e0f-9ae6-91e37d78e991 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1203 microversion: 2.1 time: 0.325439 Oct 29 01:44:08.746749 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3300/6822] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:08 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1203 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:08.752874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-4772fe0f-7e2e-457e-8c77-e64fb2444500 req-8ff39c31-e8a9-4931-ae5a-5618422bcaa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3984ece4-66ac-4c11-b414-0c1f4d76a410", "tag": "2edce355-2eeb-46eb-af8e-5a803adc036a"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:08.766003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4772fe0f-7e2e-457e-8c77-e64fb2444500 req-8ff39c31-e8a9-4931-ae5a-5618422bcaa5 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:08.766630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4772fe0f-7e2e-457e-8c77-e64fb2444500 req-8ff39c31-e8a9-4931-ae5a-5618422bcaa5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:08.767191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4772fe0f-7e2e-457e-8c77-e64fb2444500 req-8ff39c31-e8a9-4931-ae5a-5618422bcaa5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:08.769503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-172d19f2-042f-45ce-a6ff-77912f6f07db tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:44:08.779331 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-4772fe0f-7e2e-457e-8c77-e64fb2444500 req-8ff39c31-e8a9-4931-ae5a-5618422bcaa5 service nova] Creating event network-changed:2edce355-2eeb-46eb-af8e-5a803adc036a for instance 3984ece4-66ac-4c11-b414-0c1f4d76a410 on n-h1-862964-3 Oct 29 01:44:08.785059 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-4772fe0f-7e2e-457e-8c77-e64fb2444500 req-8ff39c31-e8a9-4931-ae5a-5618422bcaa5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036508 Oct 29 01:44:08.785932 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3301/6823] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:44:09.106818 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-172d19f2-042f-45ce-a6ff-77912f6f07db tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 204 len: 0 microversion: 2.1 time: 0.390861 Oct 29 01:44:09.111623 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3523/6824] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:44:08 2022] DELETE /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:44:09.120966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cf6b75e1-8248-4221-9f29-c53049d215e7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:09.121759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cf6b75e1-8248-4221-9f29-c53049d215e7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:09.134476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf6b75e1-8248-4221-9f29-c53049d215e7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:09.134974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf6b75e1-8248-4221-9f29-c53049d215e7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:09.135413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf6b75e1-8248-4221-9f29-c53049d215e7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:09.136130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf6b75e1-8248-4221-9f29-c53049d215e7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:09.136583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf6b75e1-8248-4221-9f29-c53049d215e7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:09.137005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cf6b75e1-8248-4221-9f29-c53049d215e7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:09.397420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cf6b75e1-8248-4221-9f29-c53049d215e7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:09.408065 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cf6b75e1-8248-4221-9f29-c53049d215e7 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1689 microversion: 2.1 time: 0.294380 Oct 29 01:44:09.409936 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3302/6825] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:09 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1689 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:09.444094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-add4ea2f-f2f2-450c-b756-1b3e70dbf334 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:09.444962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-add4ea2f-f2f2-450c-b756-1b3e70dbf334 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:09.470501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-add4ea2f-f2f2-450c-b756-1b3e70dbf334 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:09.470501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-add4ea2f-f2f2-450c-b756-1b3e70dbf334 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:09.470501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-add4ea2f-f2f2-450c-b756-1b3e70dbf334 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:09.470501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-add4ea2f-f2f2-450c-b756-1b3e70dbf334 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:09.470501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-add4ea2f-f2f2-450c-b756-1b3e70dbf334 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:09.470501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-add4ea2f-f2f2-450c-b756-1b3e70dbf334 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:09.670283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-add4ea2f-f2f2-450c-b756-1b3e70dbf334 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:09.683115 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-add4ea2f-f2f2-450c-b756-1b3e70dbf334 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1509 microversion: 2.1 time: 0.243935 Oct 29 01:44:09.708173 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3524/6826] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:09 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1509 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:09.740560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-531b7c8c-0a67-4856-9906-061685f39315 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:09.741524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-531b7c8c-0a67-4856-9906-061685f39315 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:09.748939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-531b7c8c-0a67-4856-9906-061685f39315 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:09.752091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-531b7c8c-0a67-4856-9906-061685f39315 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:09.754216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-531b7c8c-0a67-4856-9906-061685f39315 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:09.755221 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-531b7c8c-0a67-4856-9906-061685f39315 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:09.756014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-531b7c8c-0a67-4856-9906-061685f39315 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:09.756613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-531b7c8c-0a67-4856-9906-061685f39315 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:09.783024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-afde0f79-219f-4d69-bfd4-f95d7a5b6ac7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:09.783958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-afde0f79-219f-4d69-bfd4-f95d7a5b6ac7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:09.798907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afde0f79-219f-4d69-bfd4-f95d7a5b6ac7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:09.799304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afde0f79-219f-4d69-bfd4-f95d7a5b6ac7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:09.799875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afde0f79-219f-4d69-bfd4-f95d7a5b6ac7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:09.800707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afde0f79-219f-4d69-bfd4-f95d7a5b6ac7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:09.802769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afde0f79-219f-4d69-bfd4-f95d7a5b6ac7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:09.803596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afde0f79-219f-4d69-bfd4-f95d7a5b6ac7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:10.043611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-531b7c8c-0a67-4856-9906-061685f39315 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:10.061434 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-531b7c8c-0a67-4856-9906-061685f39315 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.321733 Oct 29 01:44:10.064155 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3303/6827] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:09 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:10.076674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-578f711a-01cd-4afc-860b-fa610c8f00c4 req-f3aa67da-b559-4ec3-85fd-d5e3cbfb0c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "548bfbb3-44d9-439b-8961-49a31cb98d3a", "name": "network-vif-deleted", "tag": "1b03c813-184d-4b07-b7e8-b8d30701d5ad"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:10.102856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-578f711a-01cd-4afc-860b-fa610c8f00c4 req-f3aa67da-b559-4ec3-85fd-d5e3cbfb0c42 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:10.106129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-578f711a-01cd-4afc-860b-fa610c8f00c4 req-f3aa67da-b559-4ec3-85fd-d5e3cbfb0c42 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:10.106129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-578f711a-01cd-4afc-860b-fa610c8f00c4 req-f3aa67da-b559-4ec3-85fd-d5e3cbfb0c42 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:10.136365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-afde0f79-219f-4d69-bfd4-f95d7a5b6ac7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:10.145747 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-578f711a-01cd-4afc-860b-fa610c8f00c4 req-f3aa67da-b559-4ec3-85fd-d5e3cbfb0c42 service nova] Creating event network-vif-deleted:1b03c813-184d-4b07-b7e8-b8d30701d5ad for instance 548bfbb3-44d9-439b-8961-49a31cb98d3a on n-h1-862964-3 Oct 29 01:44:10.148784 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-afde0f79-219f-4d69-bfd4-f95d7a5b6ac7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1203 microversion: 2.1 time: 0.380036 Oct 29 01:44:10.158933 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3525/6828] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:09 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1203 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:10.181608 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-578f711a-01cd-4afc-860b-fa610c8f00c4 req-f3aa67da-b559-4ec3-85fd-d5e3cbfb0c42 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113494 Oct 29 01:44:10.182236 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3304/6829] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:44:10.183465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-821db9a3-808b-48d5-91f3-1bf598c20639 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:10.185121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-821db9a3-808b-48d5-91f3-1bf598c20639 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:10.194353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-821db9a3-808b-48d5-91f3-1bf598c20639 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:10.194850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-821db9a3-808b-48d5-91f3-1bf598c20639 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:10.195284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-821db9a3-808b-48d5-91f3-1bf598c20639 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:10.196154 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-821db9a3-808b-48d5-91f3-1bf598c20639 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:10.196612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-821db9a3-808b-48d5-91f3-1bf598c20639 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:10.197039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-821db9a3-808b-48d5-91f3-1bf598c20639 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:10.434859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6ac639cf-e3c7-49bf-bbfe-65c9342569f2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:10.441715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6ac639cf-e3c7-49bf-bbfe-65c9342569f2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:10.448463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ac639cf-e3c7-49bf-bbfe-65c9342569f2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:10.448961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ac639cf-e3c7-49bf-bbfe-65c9342569f2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:10.449500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ac639cf-e3c7-49bf-bbfe-65c9342569f2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:10.450525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ac639cf-e3c7-49bf-bbfe-65c9342569f2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:10.451252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ac639cf-e3c7-49bf-bbfe-65c9342569f2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:10.451682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ac639cf-e3c7-49bf-bbfe-65c9342569f2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:10.598314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-821db9a3-808b-48d5-91f3-1bf598c20639 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:10.610156 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-821db9a3-808b-48d5-91f3-1bf598c20639 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1670 microversion: 2.1 time: 0.443512 Oct 29 01:44:10.611157 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3526/6830] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:10 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1670 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:10.636939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a9473622-1315-4693-aa8e-5a30fc515a73 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:10.638065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a9473622-1315-4693-aa8e-5a30fc515a73 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:10.647178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9473622-1315-4693-aa8e-5a30fc515a73 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:10.647964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9473622-1315-4693-aa8e-5a30fc515a73 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:10.648654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9473622-1315-4693-aa8e-5a30fc515a73 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:10.649658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9473622-1315-4693-aa8e-5a30fc515a73 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:10.650559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9473622-1315-4693-aa8e-5a30fc515a73 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:10.651226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9473622-1315-4693-aa8e-5a30fc515a73 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:10.694783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a9473622-1315-4693-aa8e-5a30fc515a73 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:44:10.701701 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.compute.api [None req-a9473622-1315-4693-aa8e-5a30fc515a73 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Working on deleting snapshot 0e35905c-13c8-446b-bb01-5ea44e756a5d from shelved instance... Oct 29 01:44:10.869337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6ac639cf-e3c7-49bf-bbfe-65c9342569f2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:10.882908 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6ac639cf-e3c7-49bf-bbfe-65c9342569f2 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 200 len: 1689 microversion: 2.1 time: 0.452413 Oct 29 01:44:10.883946 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3305/6831] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:10 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 1689 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:10.888708 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4e006449-3a2c-497f-85c6-bd312649cef5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:10.889427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4e006449-3a2c-497f-85c6-bd312649cef5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:10.896838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e006449-3a2c-497f-85c6-bd312649cef5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:10.897432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e006449-3a2c-497f-85c6-bd312649cef5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:10.897938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e006449-3a2c-497f-85c6-bd312649cef5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:10.898731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e006449-3a2c-497f-85c6-bd312649cef5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:10.899267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e006449-3a2c-497f-85c6-bd312649cef5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:10.899697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e006449-3a2c-497f-85c6-bd312649cef5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:10.958911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e006449-3a2c-497f-85c6-bd312649cef5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:10.960267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e006449-3a2c-497f-85c6-bd312649cef5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:10.960468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e006449-3a2c-497f-85c6-bd312649cef5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:10.960940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-4e006449-3a2c-497f-85c6-bd312649cef5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lazy-loading 'fault' on Instance uuid 548bfbb3-44d9-439b-8961-49a31cb98d3a {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:44:11.037240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4e006449-3a2c-497f-85c6-bd312649cef5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1064057756b4122914be361bd62708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3b9a58277d448e919118acab484963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:11.056496 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4e006449-3a2c-497f-85c6-bd312649cef5 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 200 len: 1305 microversion: 2.1 time: 0.167964 Oct 29 01:44:11.056496 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3306/6832] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:10 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 1305 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:11.184089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0c323965-4e33-4d75-a15e-0c05e5dbe6f7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:11.184715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0c323965-4e33-4d75-a15e-0c05e5dbe6f7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:11.191776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c323965-4e33-4d75-a15e-0c05e5dbe6f7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:11.192294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c323965-4e33-4d75-a15e-0c05e5dbe6f7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:11.193022 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c323965-4e33-4d75-a15e-0c05e5dbe6f7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:11.194105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c323965-4e33-4d75-a15e-0c05e5dbe6f7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:11.194432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c323965-4e33-4d75-a15e-0c05e5dbe6f7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:11.195265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c323965-4e33-4d75-a15e-0c05e5dbe6f7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:11.350414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0c323965-4e33-4d75-a15e-0c05e5dbe6f7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:11.371064 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0c323965-4e33-4d75-a15e-0c05e5dbe6f7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1203 microversion: 2.1 time: 0.190815 Oct 29 01:44:11.376807 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3307/6833] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:11 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1203 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:11.907672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b2950a03-d846-417c-896e-44100500cb0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:11.908802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b2950a03-d846-417c-896e-44100500cb0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: 3984ece4-66ac-4c11-b414-0c1f4d76a410] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:11.921558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2950a03-d846-417c-896e-44100500cb0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:11.921558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2950a03-d846-417c-896e-44100500cb0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:11.921558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2950a03-d846-417c-896e-44100500cb0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:11.921558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2950a03-d846-417c-896e-44100500cb0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:11.921558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2950a03-d846-417c-896e-44100500cb0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:11.921558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2950a03-d846-417c-896e-44100500cb0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:11.938097 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-b2950a03-d846-417c-896e-44100500cb0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] HTTP exception thrown: Instance 3984ece4-66ac-4c11-b414-0c1f4d76a410 could not be found. Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b2950a03-d846-417c-896e-44100500cb0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Request method failure captured: Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 HTTP/1.1 Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXILJPg9Teh04-xrfpejfETyHRBlSuOio40kYpBC7b_6HCncBaKOEtwakgsRFaHKUUVodh217xaKH9_jXg1fYudvg1KG6UvSVte3n5sImSaOZIiyh3V5b8dvECLF6tMPuqqNu5Tyyb2L7G4A-k4CbTXuNsP0CgTWtsdXxylpF7mJbiNI Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 2842ba05180046839fb5d064ad9132a1 Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1405101352 Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2842ba05180046839fb5d064ad9132a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2842ba05180046839fb5d064ad9132a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2842ba05180046839fb5d064ad9132a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2842ba05180046839fb5d064ad9132a1", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1405101352 Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 2842ba05180046839fb5d064ad9132a1 Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1405101352 Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TestNetworkAdvancedServerOps-1405101352-project Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: c70e2b34406c4e11afd9471a09d9cfef Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1405101352-project Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 3984ece4-66ac-4c11-b414-0c1f4d76a410 could not be found. Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '3984ece4-66ac-4c11-b414-0c1f4d76a410'} Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3984ece4-66ac-4c11-b414-0c1f4d76a410 could not be found. Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3984ece4-66ac-4c11-b414-0c1f4d76a410 could not be found. Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:11.940325 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:11.945446 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:11.945446 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:11.945446 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:11.945446 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:11.945446 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:44:11.945446 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:44:11.945446 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3984ece4-66ac-4c11-b414-0c1f4d76a410 could not be found. Oct 29 01:44:11.945446 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:11.945446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b2950a03-d846-417c-896e-44100500cb0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Returning 404 to user: Instance 3984ece4-66ac-4c11-b414-0c1f4d76a410 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:44:11.945446 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b2950a03-d846-417c-896e-44100500cb0e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410" status: 404 len: 111 microversion: 2.1 time: 0.041043 Oct 29 01:44:11.945446 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3308/6834] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:11 2022] GET /compute/v2.1/servers/3984ece4-66ac-4c11-b414-0c1f4d76a410 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:44:12.077390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2b46ea13-4014-4eb3-b249-e353aca2b035 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:12.078080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2b46ea13-4014-4eb3-b249-e353aca2b035 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] [instance: 548bfbb3-44d9-439b-8961-49a31cb98d3a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:12.084643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b46ea13-4014-4eb3-b249-e353aca2b035 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:12.085135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b46ea13-4014-4eb3-b249-e353aca2b035 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:12.085608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b46ea13-4014-4eb3-b249-e353aca2b035 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:12.086317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b46ea13-4014-4eb3-b249-e353aca2b035 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:12.086778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b46ea13-4014-4eb3-b249-e353aca2b035 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:12.087406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b46ea13-4014-4eb3-b249-e353aca2b035 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:12.104230 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-2b46ea13-4014-4eb3-b249-e353aca2b035 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] HTTP exception thrown: Instance 548bfbb3-44d9-439b-8961-49a31cb98d3a could not be found. Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2b46ea13-4014-4eb3-b249-e353aca2b035 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Request method failure captured: Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a HTTP/1.1 Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIU_3xs2Z-xhc4u-ssK6mx73S1UmPZSB1uJxFijuPLqz2Z1ka8Re7W_SyIElQHAZ4CJDEi6ZdkwHAOZUpSPqpBTb828RtJjl9qpoW7ZtBfzKXn2-YJBU1Ovj9lx2MKTG1fZG_rP1DkDdeL2C-dRKB_feDxRT2ydWLDqxwp3ccFJ3ETQ Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 8f3b9a58277d448e919118acab484963 Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TestServerAdvancedOps-1072227019 Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f3b9a58277d448e919118acab484963"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8f3b9a58277d448e919118acab484963"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f3b9a58277d448e919118acab484963"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8f3b9a58277d448e919118acab484963", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TestServerAdvancedOps-1072227019 Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 8f3b9a58277d448e919118acab484963 Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TestServerAdvancedOps-1072227019 Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TestServerAdvancedOps-1072227019-project Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: a1064057756b4122914be361bd62708f Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TestServerAdvancedOps-1072227019-project Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 548bfbb3-44d9-439b-8961-49a31cb98d3a could not be found. Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '548bfbb3-44d9-439b-8961-49a31cb98d3a'} Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 548bfbb3-44d9-439b-8961-49a31cb98d3a could not be found. Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 548bfbb3-44d9-439b-8961-49a31cb98d3a could not be found. Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:12.106081 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:12.113074 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:12.113074 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:12.113074 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:12.113074 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:44:12.113074 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:44:12.113074 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 548bfbb3-44d9-439b-8961-49a31cb98d3a could not be found. Oct 29 01:44:12.113074 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:12.113074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2b46ea13-4014-4eb3-b249-e353aca2b035 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] Returning 404 to user: Instance 548bfbb3-44d9-439b-8961-49a31cb98d3a could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:44:12.113074 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2b46ea13-4014-4eb3-b249-e353aca2b035 tempest-TestServerAdvancedOps-1072227019 tempest-TestServerAdvancedOps-1072227019-project] 10.222.0.26 "GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a" status: 404 len: 111 microversion: 2.1 time: 0.034364 Oct 29 01:44:12.113074 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3309/6835] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:12 2022] GET /compute/v2.1/servers/548bfbb3-44d9-439b-8961-49a31cb98d3a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:44:12.260873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-bbaf9d80-7449-4bee-b4b4-2b9a4dba69ce req-77ca01ee-e86c-43e4-917b-9e28501d3594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3984ece4-66ac-4c11-b414-0c1f4d76a410", "name": "network-vif-deleted", "tag": "2edce355-2eeb-46eb-af8e-5a803adc036a"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:12.272771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-bbaf9d80-7449-4bee-b4b4-2b9a4dba69ce req-77ca01ee-e86c-43e4-917b-9e28501d3594 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:12.283082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-bbaf9d80-7449-4bee-b4b4-2b9a4dba69ce req-77ca01ee-e86c-43e4-917b-9e28501d3594 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:12.283082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-bbaf9d80-7449-4bee-b4b4-2b9a4dba69ce req-77ca01ee-e86c-43e4-917b-9e28501d3594 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:12.288540 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-bbaf9d80-7449-4bee-b4b4-2b9a4dba69ce req-77ca01ee-e86c-43e4-917b-9e28501d3594 service nova] Creating event network-vif-deleted:2edce355-2eeb-46eb-af8e-5a803adc036a for instance 3984ece4-66ac-4c11-b414-0c1f4d76a410 on n-h1-862964-3 Oct 29 01:44:12.294689 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-bbaf9d80-7449-4bee-b4b4-2b9a4dba69ce req-77ca01ee-e86c-43e4-917b-9e28501d3594 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040514 Oct 29 01:44:12.295777 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3310/6836] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:44:12.333536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-a90db310-ec22-4f5d-bd75-0071eef67aec req-008eb16d-5c82-4430-8a3b-e6d3796a13fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7511379-4e9b-42ac-b0cb-5d36bdc57833", "name": "network-vif-plugged", "status": "completed", "tag": "675e73c0-ab5f-49f9-992c-d4e6fee042ae"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:12.346685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a90db310-ec22-4f5d-bd75-0071eef67aec req-008eb16d-5c82-4430-8a3b-e6d3796a13fc service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:12.347478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a90db310-ec22-4f5d-bd75-0071eef67aec req-008eb16d-5c82-4430-8a3b-e6d3796a13fc service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:12.347915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a90db310-ec22-4f5d-bd75-0071eef67aec req-008eb16d-5c82-4430-8a3b-e6d3796a13fc service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:12.359844 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-a90db310-ec22-4f5d-bd75-0071eef67aec req-008eb16d-5c82-4430-8a3b-e6d3796a13fc service nova] Creating event network-vif-plugged:675e73c0-ab5f-49f9-992c-d4e6fee042ae for instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 on n-h1-862964-3 Oct 29 01:44:12.365051 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-a90db310-ec22-4f5d-bd75-0071eef67aec req-008eb16d-5c82-4430-8a3b-e6d3796a13fc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041709 Oct 29 01:44:12.371537 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3311/6837] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:44:12.397381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-96326ec6-2754-43ad-bdf3-c49e81194c09 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:12.398084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-96326ec6-2754-43ad-bdf3-c49e81194c09 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:12.404485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96326ec6-2754-43ad-bdf3-c49e81194c09 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:12.406180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96326ec6-2754-43ad-bdf3-c49e81194c09 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:12.406180 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96326ec6-2754-43ad-bdf3-c49e81194c09 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:12.406856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96326ec6-2754-43ad-bdf3-c49e81194c09 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:12.407313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96326ec6-2754-43ad-bdf3-c49e81194c09 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:12.407945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-96326ec6-2754-43ad-bdf3-c49e81194c09 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:12.508384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a9473622-1315-4693-aa8e-5a30fc515a73 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Doing local delete in cell 584133c9-70d9-4dbd-88ec-66308eedb7a2(cell1) {{(pid=121099) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 29 01:44:12.520326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9473622-1315-4693-aa8e-5a30fc515a73 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:12.521544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9473622-1315-4693-aa8e-5a30fc515a73 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:12.522362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a9473622-1315-4693-aa8e-5a30fc515a73 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:12.523024 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.compute.api [None req-a9473622-1315-4693-aa8e-5a30fc515a73 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 29 01:44:12.537540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-a9473622-1315-4693-aa8e-5a30fc515a73 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] deallocate_for_instance() {{(pid=121099) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 29 01:44:12.761299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-96326ec6-2754-43ad-bdf3-c49e81194c09 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:12.778169 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-96326ec6-2754-43ad-bdf3-c49e81194c09 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1203 microversion: 2.1 time: 0.383817 Oct 29 01:44:12.779918 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3312/6838] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:12 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1203 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:13.396569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-a9473622-1315-4693-aa8e-5a30fc515a73 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Updating instance_info_cache with network_info: [] {{(pid=121099) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 01:44:13.805015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d720638f-230c-408e-91a7-8f1bd66ac8ac tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:13.806814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d720638f-230c-408e-91a7-8f1bd66ac8ac tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:13.816915 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d720638f-230c-408e-91a7-8f1bd66ac8ac tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:13.817453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d720638f-230c-408e-91a7-8f1bd66ac8ac tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:13.820989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d720638f-230c-408e-91a7-8f1bd66ac8ac tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:13.821947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d720638f-230c-408e-91a7-8f1bd66ac8ac tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:13.823688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d720638f-230c-408e-91a7-8f1bd66ac8ac tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:13.825652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d720638f-230c-408e-91a7-8f1bd66ac8ac tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:14.108900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d720638f-230c-408e-91a7-8f1bd66ac8ac tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:14.120663 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d720638f-230c-408e-91a7-8f1bd66ac8ac tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1203 microversion: 2.1 time: 0.318473 Oct 29 01:44:14.121665 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3313/6839] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:13 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1203 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:14.350920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-1b3d958a-77b8-43ca-9da0-deb5389b5846 req-f3e06e4b-996e-4f89-84ee-64f071c5f9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1df712-231f-4de9-9023-66fab316b565", "name": "network-vif-deleted", "tag": "a19b3137-5978-4142-9ac1-161c59e7ec6b"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:14.370271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1b3d958a-77b8-43ca-9da0-deb5389b5846 req-f3e06e4b-996e-4f89-84ee-64f071c5f9e3 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:14.371229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1b3d958a-77b8-43ca-9da0-deb5389b5846 req-f3e06e4b-996e-4f89-84ee-64f071c5f9e3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:14.371870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-1b3d958a-77b8-43ca-9da0-deb5389b5846 req-f3e06e4b-996e-4f89-84ee-64f071c5f9e3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:14.389675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.compute.server_external_events [req-1b3d958a-77b8-43ca-9da0-deb5389b5846 req-f3e06e4b-996e-4f89-84ee-64f071c5f9e3 service nova] Unable to find a host for instance de1df712-231f-4de9-9023-66fab316b565. Dropping event network-vif-deleted {{(pid=121100) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 29 01:44:14.391278 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-1b3d958a-77b8-43ca-9da0-deb5389b5846 req-f3e06e4b-996e-4f89-84ee-64f071c5f9e3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.044666 Oct 29 01:44:14.392744 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3314/6840] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 01:44:14.523192 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a9473622-1315-4693-aa8e-5a30fc515a73 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "DELETE /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 204 len: 0 microversion: 2.1 time: 3.890488 Oct 29 01:44:14.526943 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3527/6841] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:44:10 2022] DELETE /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 0 bytes in 3892 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:44:14.539317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-054b6a7f-f535-4f62-9c00-2efd207ede7d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:14.539961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-054b6a7f-f535-4f62-9c00-2efd207ede7d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: de1df712-231f-4de9-9023-66fab316b565] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:14.548104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-054b6a7f-f535-4f62-9c00-2efd207ede7d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:14.548925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-054b6a7f-f535-4f62-9c00-2efd207ede7d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:14.549582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-054b6a7f-f535-4f62-9c00-2efd207ede7d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:14.550971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-054b6a7f-f535-4f62-9c00-2efd207ede7d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:14.551656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-054b6a7f-f535-4f62-9c00-2efd207ede7d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:14.552288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-054b6a7f-f535-4f62-9c00-2efd207ede7d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:14.570607 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-054b6a7f-f535-4f62-9c00-2efd207ede7d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] HTTP exception thrown: Instance de1df712-231f-4de9-9023-66fab316b565 could not be found. Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-054b6a7f-f535-4f62-9c00-2efd207ede7d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Request method failure captured: Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 HTTP/1.1 Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIL7S5xF4168RL6JoFuUbcH6-3DDmyiCJ6R7rm4bgk2fiKECHpPWIxe8Sb6KFLzfaouBeUBjfCfEFAi0SDZDaQE_pKK3AEydGMSkKrcyZ-fr5rCFaKW-2JEPVH3EUDBGDA-y9zSVdN55YxOgNS3JW2ZCCkwPgvfmgUCIRXp7mDkobAQ Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 238c2e0d9e0b48198767a357cff1a442 Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerActionsTestJSON-45025787 Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/238c2e0d9e0b48198767a357cff1a442"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/238c2e0d9e0b48198767a357cff1a442"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/238c2e0d9e0b48198767a357cff1a442"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_238c2e0d9e0b48198767a357cff1a442", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerActionsTestJSON-45025787 Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 238c2e0d9e0b48198767a357cff1a442 Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerActionsTestJSON-45025787 Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerActionsTestJSON-45025787-project Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 9c097ba205f6453ba793dfb1d1876f3e Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerActionsTestJSON-45025787-project Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance de1df712-231f-4de9-9023-66fab316b565 could not be found. Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'de1df712-231f-4de9-9023-66fab316b565'} Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de1df712-231f-4de9-9023-66fab316b565 could not be found. Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de1df712-231f-4de9-9023-66fab316b565 could not be found. Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:14.572554 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:14.578407 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:14.578407 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:14.578407 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:14.578407 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:44:14.578407 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:44:14.578407 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de1df712-231f-4de9-9023-66fab316b565 could not be found. Oct 29 01:44:14.578407 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:14.579948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-054b6a7f-f535-4f62-9c00-2efd207ede7d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Returning 404 to user: Instance de1df712-231f-4de9-9023-66fab316b565 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:44:14.581121 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-054b6a7f-f535-4f62-9c00-2efd207ede7d tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565" status: 404 len: 111 microversion: 2.1 time: 0.052198 Oct 29 01:44:14.582306 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3315/6842] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:14 2022] GET /compute/v2.1/servers/de1df712-231f-4de9-9023-66fab316b565 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:44:14.590889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-dcaceb33-e8c1-4114-b1e2-15293f4f1307 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:14.595198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dcaceb33-e8c1-4114-b1e2-15293f4f1307 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:14.600477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcaceb33-e8c1-4114-b1e2-15293f4f1307 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:14.601292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcaceb33-e8c1-4114-b1e2-15293f4f1307 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:14.601861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcaceb33-e8c1-4114-b1e2-15293f4f1307 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:14.602692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcaceb33-e8c1-4114-b1e2-15293f4f1307 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:14.603561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcaceb33-e8c1-4114-b1e2-15293f4f1307 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:14.605518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-dcaceb33-e8c1-4114-b1e2-15293f4f1307 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:14.611721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:44:14.644443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-dcaceb33-e8c1-4114-b1e2-15293f4f1307 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:44:15.146264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-aa405362-910f-482b-b967-8a6930437adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:15.147069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-aa405362-910f-482b-b967-8a6930437adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:15.154224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa405362-910f-482b-b967-8a6930437adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:15.154725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa405362-910f-482b-b967-8a6930437adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:15.155744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa405362-910f-482b-b967-8a6930437adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:15.156939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa405362-910f-482b-b967-8a6930437adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:15.157639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa405362-910f-482b-b967-8a6930437adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:15.158082 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-aa405362-910f-482b-b967-8a6930437adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:15.174703 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-dcaceb33-e8c1-4114-b1e2-15293f4f1307 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "DELETE /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 204 len: 0 microversion: 2.1 time: 0.588073 Oct 29 01:44:15.175302 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3528/6843] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:44:14 2022] DELETE /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:44:15.185914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5404d7e1-4daa-498e-806a-04ebe23423ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:15.187517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5404d7e1-4daa-498e-806a-04ebe23423ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:15.194592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5404d7e1-4daa-498e-806a-04ebe23423ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:15.195306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5404d7e1-4daa-498e-806a-04ebe23423ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:15.195908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5404d7e1-4daa-498e-806a-04ebe23423ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:15.196827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5404d7e1-4daa-498e-806a-04ebe23423ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:15.197546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5404d7e1-4daa-498e-806a-04ebe23423ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:15.198274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5404d7e1-4daa-498e-806a-04ebe23423ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:15.344649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5404d7e1-4daa-498e-806a-04ebe23423ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:15.360509 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5404d7e1-4daa-498e-806a-04ebe23423ad tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1466 microversion: 2.1 time: 0.178940 Oct 29 01:44:15.361541 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3529/6844] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:15 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1466 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:15.391565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-aa405362-910f-482b-b967-8a6930437adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:15.399791 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-aa405362-910f-482b-b967-8a6930437adf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1391 microversion: 2.1 time: 0.257589 Oct 29 01:44:15.400361 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3316/6845] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:15 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1391 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:15.423284 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e03e1ea3-8a05-45aa-aa81-244a03448e95 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:15.423940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e03e1ea3-8a05-45aa-aa81-244a03448e95 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:15.431109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e03e1ea3-8a05-45aa-aa81-244a03448e95 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:15.431604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e03e1ea3-8a05-45aa-aa81-244a03448e95 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:15.432193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e03e1ea3-8a05-45aa-aa81-244a03448e95 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:15.432742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e03e1ea3-8a05-45aa-aa81-244a03448e95 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:15.433355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e03e1ea3-8a05-45aa-aa81-244a03448e95 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:15.433639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e03e1ea3-8a05-45aa-aa81-244a03448e95 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:15.649560 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e03e1ea3-8a05-45aa-aa81-244a03448e95 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:15.657751 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e03e1ea3-8a05-45aa-aa81-244a03448e95 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1391 microversion: 2.1 time: 0.238554 Oct 29 01:44:15.658354 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3530/6846] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:15 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1391 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:15.680855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b9be828b-af67-4c07-80ad-1fedc815c1a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:15.681001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b9be828b-af67-4c07-80ad-1fedc815c1a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:15.688399 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9be828b-af67-4c07-80ad-1fedc815c1a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:15.688888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9be828b-af67-4c07-80ad-1fedc815c1a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:15.689378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9be828b-af67-4c07-80ad-1fedc815c1a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:15.690083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9be828b-af67-4c07-80ad-1fedc815c1a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:15.690536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9be828b-af67-4c07-80ad-1fedc815c1a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:15.690962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9be828b-af67-4c07-80ad-1fedc815c1a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:15.835012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b9be828b-af67-4c07-80ad-1fedc815c1a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:15.837595 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:44:15.845242 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b9be828b-af67-4c07-80ad-1fedc815c1a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1391 microversion: 2.1 time: 0.168602 Oct 29 01:44:15.845814 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3317/6847] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:15 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:15.930930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5febe1f4-0330-4e61-9e40-2ad2cca6b12a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:15.931439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5febe1f4-0330-4e61-9e40-2ad2cca6b12a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:15.953618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5febe1f4-0330-4e61-9e40-2ad2cca6b12a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:15.953618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5febe1f4-0330-4e61-9e40-2ad2cca6b12a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:15.953618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5febe1f4-0330-4e61-9e40-2ad2cca6b12a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:15.953618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5febe1f4-0330-4e61-9e40-2ad2cca6b12a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:15.953618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5febe1f4-0330-4e61-9e40-2ad2cca6b12a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:15.953618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5febe1f4-0330-4e61-9e40-2ad2cca6b12a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:15.995037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5febe1f4-0330-4e61-9e40-2ad2cca6b12a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:44:16.384415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ab644244-c256-471e-8236-ed0f7f2f03e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:16.385668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ab644244-c256-471e-8236-ed0f7f2f03e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:16.393285 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5febe1f4-0330-4e61-9e40-2ad2cca6b12a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 204 len: 0 microversion: 2.1 time: 0.465688 Oct 29 01:44:16.393453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:44:16.394954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab644244-c256-471e-8236-ed0f7f2f03e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:16.395409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab644244-c256-471e-8236-ed0f7f2f03e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:16.395812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab644244-c256-471e-8236-ed0f7f2f03e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:16.396199 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3531/6848] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:44:15 2022] DELETE /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:44:16.400569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab644244-c256-471e-8236-ed0f7f2f03e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:16.401048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab644244-c256-471e-8236-ed0f7f2f03e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:16.401521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab644244-c256-471e-8236-ed0f7f2f03e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:16.407533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-37bcd181-38f2-4204-b305-3eec2be1bd04 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:16.408680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-37bcd181-38f2-4204-b305-3eec2be1bd04 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:16.416069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37bcd181-38f2-4204-b305-3eec2be1bd04 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:16.416563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37bcd181-38f2-4204-b305-3eec2be1bd04 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:16.417003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37bcd181-38f2-4204-b305-3eec2be1bd04 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:16.417742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37bcd181-38f2-4204-b305-3eec2be1bd04 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:16.418196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37bcd181-38f2-4204-b305-3eec2be1bd04 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:16.418627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-37bcd181-38f2-4204-b305-3eec2be1bd04 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:16.546030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ab644244-c256-471e-8236-ed0f7f2f03e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:16.562433 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ab644244-c256-471e-8236-ed0f7f2f03e1 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1466 microversion: 2.1 time: 0.175777 Oct 29 01:44:16.562433 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3318/6849] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:16 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1466 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:16.637356 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-37bcd181-38f2-4204-b305-3eec2be1bd04 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:16.642516 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-37bcd181-38f2-4204-b305-3eec2be1bd04 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1397 microversion: 2.1 time: 0.241564 Oct 29 01:44:16.643133 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3532/6850] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:16 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1397 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:17.441514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d990a121-a185-4725-9949-5e38ee48feab tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '.version_select at 0x7f9d96914e50>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:17.542854 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d990a121-a185-4725-9949-5e38ee48feab tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1805215031" status: 202 len: 0 microversion: 2.1 time: 0.106614 Oct 29 01:44:17.545203 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3319/6851] 10.222.0.26 () {58 vars in 1284 bytes} [Sat Oct 29 01:44:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1805215031 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:44:17.576677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-04bcdf3b-41d3-420d-a525-de0cc06a8ff8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'create', calling method: .version_select at 0x7f9d979573a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1909159424", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8sL2URrPvfHd/F2/7WP+7pGTMRDMSlBGxrw7ubZy/PFAxGVj9GJEa1OBFZktJiqg5O3ts+VYTMKDql78K2B/Do9YWFFuAyqy7WC51CdclNhq7hEhyMSSgRGCAHoo8UIQ=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:17.595209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-04bcdf3b-41d3-420d-a525-de0cc06a8ff8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Getting quotas for project 2842ba05180046839fb5d064ad9132a1. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:44:17.602389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dc42584d-6c48-4f4b-a313-d338a803aa44 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:17.602389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dc42584d-6c48-4f4b-a313-d338a803aa44 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:17.602626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-04bcdf3b-41d3-420d-a525-de0cc06a8ff8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Getting quotas for user c70e2b34406c4e11afd9471a09d9cfef and project 2842ba05180046839fb5d064ad9132a1. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:44:17.605689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dc42584d-6c48-4f4b-a313-d338a803aa44 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:17.606237 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dc42584d-6c48-4f4b-a313-d338a803aa44 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:17.606672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dc42584d-6c48-4f4b-a313-d338a803aa44 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:17.607723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dc42584d-6c48-4f4b-a313-d338a803aa44 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:17.609335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dc42584d-6c48-4f4b-a313-d338a803aa44 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:17.610117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dc42584d-6c48-4f4b-a313-d338a803aa44 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:17.707031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-dc42584d-6c48-4f4b-a313-d338a803aa44 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:17.715064 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dc42584d-6c48-4f4b-a313-d338a803aa44 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1466 microversion: 2.1 time: 0.123064 Oct 29 01:44:17.715641 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3320/6852] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:17 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1466 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:17.721980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a9bcd0ad-7455-4858-8dcc-8ad46a6cda10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:17.722597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a9bcd0ad-7455-4858-8dcc-8ad46a6cda10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:17.729039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a9bcd0ad-7455-4858-8dcc-8ad46a6cda10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:17.729636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a9bcd0ad-7455-4858-8dcc-8ad46a6cda10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:17.730160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a9bcd0ad-7455-4858-8dcc-8ad46a6cda10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:17.730863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a9bcd0ad-7455-4858-8dcc-8ad46a6cda10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:17.731319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a9bcd0ad-7455-4858-8dcc-8ad46a6cda10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:17.731785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a9bcd0ad-7455-4858-8dcc-8ad46a6cda10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:17.735985 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-04bcdf3b-41d3-420d-a525-de0cc06a8ff8 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.165074 Oct 29 01:44:17.736609 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3533/6853] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:44:17 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:44:17.896261 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a9bcd0ad-7455-4858-8dcc-8ad46a6cda10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:17.919846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-e4e35533-4eaf-4f53-aaa3-59cc7c5ca7d0 req-6b25b0d0-6f16-4844-8852-baad44b42193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae9e686-e9f8-4288-a0ed-aa4cc6bc3586", "name": "network-vif-deleted", "tag": "9b8d4881-ed32-412b-8288-7e124a76fa7c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:17.932697 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a9bcd0ad-7455-4858-8dcc-8ad46a6cda10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1397 microversion: 2.1 time: 0.215158 Oct 29 01:44:17.934551 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3321/6854] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:17 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1397 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:17.939487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e4e35533-4eaf-4f53-aaa3-59cc7c5ca7d0 req-6b25b0d0-6f16-4844-8852-baad44b42193 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:17.941180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e4e35533-4eaf-4f53-aaa3-59cc7c5ca7d0 req-6b25b0d0-6f16-4844-8852-baad44b42193 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:17.944131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-e4e35533-4eaf-4f53-aaa3-59cc7c5ca7d0 req-6b25b0d0-6f16-4844-8852-baad44b42193 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:17.981947 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-e4e35533-4eaf-4f53-aaa3-59cc7c5ca7d0 req-6b25b0d0-6f16-4844-8852-baad44b42193 service nova] Creating event network-vif-deleted:9b8d4881-ed32-412b-8288-7e124a76fa7c for instance aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 on n-h2-862964-3 Oct 29 01:44:17.995616 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-e4e35533-4eaf-4f53-aaa3-59cc7c5ca7d0 req-6b25b0d0-6f16-4844-8852-baad44b42193 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081774 Oct 29 01:44:17.997826 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3534/6855] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:44:18.740339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0a575f17-c2c9-436c-bd2b-6b13a2a171ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:18.741092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0a575f17-c2c9-436c-bd2b-6b13a2a171ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:18.748400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a575f17-c2c9-436c-bd2b-6b13a2a171ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:18.748928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a575f17-c2c9-436c-bd2b-6b13a2a171ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:18.750115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a575f17-c2c9-436c-bd2b-6b13a2a171ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:18.750970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a575f17-c2c9-436c-bd2b-6b13a2a171ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:18.751455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a575f17-c2c9-436c-bd2b-6b13a2a171ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:18.751857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a575f17-c2c9-436c-bd2b-6b13a2a171ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:18.786986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a575f17-c2c9-436c-bd2b-6b13a2a171ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:18.787749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a575f17-c2c9-436c-bd2b-6b13a2a171ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:18.788344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a575f17-c2c9-436c-bd2b-6b13a2a171ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:18.788961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-0a575f17-c2c9-436c-bd2b-6b13a2a171ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lazy-loading 'fault' on Instance uuid aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:44:18.900436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0a575f17-c2c9-436c-bd2b-6b13a2a171ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:18.912084 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0a575f17-c2c9-436c-bd2b-6b13a2a171ef tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 200 len: 1305 microversion: 2.1 time: 0.175481 Oct 29 01:44:18.915724 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3322/6856] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:18 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 1305 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:18.924941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-6dc1ab13-f0f2-4784-8662-5d01af422566 req-c7fb487d-b0ac-435e-b0ff-1c3f4e6ab567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7511379-4e9b-42ac-b0cb-5d36bdc57833", "name": "network-vif-deleted", "tag": "675e73c0-ab5f-49f9-992c-d4e6fee042ae"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:18.940130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6dc1ab13-f0f2-4784-8662-5d01af422566 req-c7fb487d-b0ac-435e-b0ff-1c3f4e6ab567 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:18.940613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6dc1ab13-f0f2-4784-8662-5d01af422566 req-c7fb487d-b0ac-435e-b0ff-1c3f4e6ab567 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:18.941052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6dc1ab13-f0f2-4784-8662-5d01af422566 req-c7fb487d-b0ac-435e-b0ff-1c3f4e6ab567 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:18.957709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c7fe20de-6f84-46a1-9f77-ff5b861d838b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:18.957950 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-6dc1ab13-f0f2-4784-8662-5d01af422566 req-c7fb487d-b0ac-435e-b0ff-1c3f4e6ab567 service nova] Creating event network-vif-deleted:675e73c0-ab5f-49f9-992c-d4e6fee042ae for instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 on n-h1-862964-3 Oct 29 01:44:18.959207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c7fe20de-6f84-46a1-9f77-ff5b861d838b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:18.967191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7fe20de-6f84-46a1-9f77-ff5b861d838b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:18.968358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7fe20de-6f84-46a1-9f77-ff5b861d838b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:18.969041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7fe20de-6f84-46a1-9f77-ff5b861d838b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:18.969771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7fe20de-6f84-46a1-9f77-ff5b861d838b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:18.970436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7fe20de-6f84-46a1-9f77-ff5b861d838b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:18.971787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c7fe20de-6f84-46a1-9f77-ff5b861d838b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:18.976562 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-6dc1ab13-f0f2-4784-8662-5d01af422566 req-c7fb487d-b0ac-435e-b0ff-1c3f4e6ab567 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055532 Oct 29 01:44:18.977268 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3535/6857] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:44:19.066516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c7fe20de-6f84-46a1-9f77-ff5b861d838b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:19.076098 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c7fe20de-6f84-46a1-9f77-ff5b861d838b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1355 microversion: 2.1 time: 0.123265 Oct 29 01:44:19.076696 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3323/6858] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:18 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1355 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:19.945899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ca1ea4ff-1bb4-41eb-8b71-e3c39cb8d886 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:19.946764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ca1ea4ff-1bb4-41eb-8b71-e3c39cb8d886 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: aae9e686-e9f8-4288-a0ed-aa4cc6bc3586] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:19.957378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca1ea4ff-1bb4-41eb-8b71-e3c39cb8d886 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:19.966889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca1ea4ff-1bb4-41eb-8b71-e3c39cb8d886 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:19.966889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca1ea4ff-1bb4-41eb-8b71-e3c39cb8d886 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:19.966889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca1ea4ff-1bb4-41eb-8b71-e3c39cb8d886 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:19.966889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca1ea4ff-1bb4-41eb-8b71-e3c39cb8d886 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:19.966889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca1ea4ff-1bb4-41eb-8b71-e3c39cb8d886 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:19.979911 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-ca1ea4ff-1bb4-41eb-8b71-e3c39cb8d886 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] HTTP exception thrown: Instance aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 could not be found. Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ca1ea4ff-1bb4-41eb-8b71-e3c39cb8d886 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Request method failure captured: Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 HTTP/1.1 Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIL7S5xF4168RL6JoFuUbcH6-3DDmyiCJ6R7rm4bgk2fiKECHpPWIxe8Sb6KFLzfaouBeUBjfCfEFAi0SDZDaQE_pKK3AEydGMSkKrcyZ-fr5rCFaKW-2JEPVH3EUDBGDA-y9zSVdN55YxOgNS3JW2ZCCkwPgvfmgUCIRXp7mDkobAQ Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 238c2e0d9e0b48198767a357cff1a442 Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerActionsTestJSON-45025787 Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/238c2e0d9e0b48198767a357cff1a442"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/238c2e0d9e0b48198767a357cff1a442"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/238c2e0d9e0b48198767a357cff1a442"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_238c2e0d9e0b48198767a357cff1a442", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerActionsTestJSON-45025787 Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 238c2e0d9e0b48198767a357cff1a442 Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerActionsTestJSON-45025787 Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerActionsTestJSON-45025787-project Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 9c097ba205f6453ba793dfb1d1876f3e Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerActionsTestJSON-45025787-project Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 could not be found. Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'aae9e686-e9f8-4288-a0ed-aa4cc6bc3586'} Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 could not be found. Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 could not be found. Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:19.981905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:19.987246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:19.987246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:19.987246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:19.987246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:44:19.987246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:44:19.987246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 could not be found. Oct 29 01:44:19.987246 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:19.989718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ca1ea4ff-1bb4-41eb-8b71-e3c39cb8d886 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Returning 404 to user: Instance aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:44:19.990668 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ca1ea4ff-1bb4-41eb-8b71-e3c39cb8d886 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586" status: 404 len: 111 microversion: 2.1 time: 0.050018 Oct 29 01:44:19.991459 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3536/6859] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:19 2022] GET /compute/v2.1/servers/aae9e686-e9f8-4288-a0ed-aa4cc6bc3586 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:44:20.001239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3ad3808d-137a-4b68-b5af-bdc9adbfcaf5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:20.003048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3ad3808d-137a-4b68-b5af-bdc9adbfcaf5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:20.010884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3ad3808d-137a-4b68-b5af-bdc9adbfcaf5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:20.011368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3ad3808d-137a-4b68-b5af-bdc9adbfcaf5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:20.011993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3ad3808d-137a-4b68-b5af-bdc9adbfcaf5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:20.012736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3ad3808d-137a-4b68-b5af-bdc9adbfcaf5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:20.013225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3ad3808d-137a-4b68-b5af-bdc9adbfcaf5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:20.014067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3ad3808d-137a-4b68-b5af-bdc9adbfcaf5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:20.042687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3ad3808d-137a-4b68-b5af-bdc9adbfcaf5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:44:20.100119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5a2d42d5-0953-442f-80ae-0aa17f9d97ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:20.100733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5a2d42d5-0953-442f-80ae-0aa17f9d97ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:20.103846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:44:20.107346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a2d42d5-0953-442f-80ae-0aa17f9d97ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:20.107828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a2d42d5-0953-442f-80ae-0aa17f9d97ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:20.109183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a2d42d5-0953-442f-80ae-0aa17f9d97ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:20.110030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a2d42d5-0953-442f-80ae-0aa17f9d97ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:20.110498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a2d42d5-0953-442f-80ae-0aa17f9d97ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:20.110927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5a2d42d5-0953-442f-80ae-0aa17f9d97ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:20.206640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5a2d42d5-0953-442f-80ae-0aa17f9d97ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:20.215948 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5a2d42d5-0953-442f-80ae-0aa17f9d97ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1188 microversion: 2.1 time: 0.119543 Oct 29 01:44:20.216738 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3537/6860] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:20 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1188 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:20.426290 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3ad3808d-137a-4b68-b5af-bdc9adbfcaf5 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 204 len: 0 microversion: 2.1 time: 0.430441 Oct 29 01:44:20.433443 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3324/6861] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:44:19 2022] DELETE /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:44:20.439698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-51ffdd17-7174-4f8f-94fb-87999a40180f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:20.440323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-51ffdd17-7174-4f8f-94fb-87999a40180f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:20.447890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51ffdd17-7174-4f8f-94fb-87999a40180f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:20.448508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51ffdd17-7174-4f8f-94fb-87999a40180f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:20.448955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51ffdd17-7174-4f8f-94fb-87999a40180f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:20.449742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51ffdd17-7174-4f8f-94fb-87999a40180f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:20.450211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51ffdd17-7174-4f8f-94fb-87999a40180f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:20.450668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51ffdd17-7174-4f8f-94fb-87999a40180f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:20.695168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-51ffdd17-7174-4f8f-94fb-87999a40180f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:20.704559 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-51ffdd17-7174-4f8f-94fb-87999a40180f tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1509 microversion: 2.1 time: 0.269934 Oct 29 01:44:20.705289 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3538/6862] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:20 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1509 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:21.242133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-43491641-ff41-448c-abda-1da3f90dc307 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:21.243790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-43491641-ff41-448c-abda-1da3f90dc307 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:21.252551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43491641-ff41-448c-abda-1da3f90dc307 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:21.253251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43491641-ff41-448c-abda-1da3f90dc307 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:21.253832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43491641-ff41-448c-abda-1da3f90dc307 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:21.254576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43491641-ff41-448c-abda-1da3f90dc307 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:21.255204 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43491641-ff41-448c-abda-1da3f90dc307 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:21.255662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-43491641-ff41-448c-abda-1da3f90dc307 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:21.330474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-43491641-ff41-448c-abda-1da3f90dc307 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:21.342915 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-43491641-ff41-448c-abda-1da3f90dc307 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1188 microversion: 2.1 time: 0.104036 Oct 29 01:44:21.344950 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3325/6863] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:21 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1188 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:21.731289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c3f85bdb-0011-4dc3-adaa-655238b40036 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:21.732076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c3f85bdb-0011-4dc3-adaa-655238b40036 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:21.746703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3f85bdb-0011-4dc3-adaa-655238b40036 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:21.747204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3f85bdb-0011-4dc3-adaa-655238b40036 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:21.747643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3f85bdb-0011-4dc3-adaa-655238b40036 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:21.748352 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3f85bdb-0011-4dc3-adaa-655238b40036 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:21.749001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3f85bdb-0011-4dc3-adaa-655238b40036 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:21.749331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3f85bdb-0011-4dc3-adaa-655238b40036 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:21.897371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c3f85bdb-0011-4dc3-adaa-655238b40036 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:21.915350 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c3f85bdb-0011-4dc3-adaa-655238b40036 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1509 microversion: 2.1 time: 0.191011 Oct 29 01:44:21.916483 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3539/6864] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:21 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:22.370260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c02280c-68a4-4398-b258-262094acdeb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:22.371036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9c02280c-68a4-4398-b258-262094acdeb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:22.381581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c02280c-68a4-4398-b258-262094acdeb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:22.382407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c02280c-68a4-4398-b258-262094acdeb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:22.383111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c02280c-68a4-4398-b258-262094acdeb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:22.384084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c02280c-68a4-4398-b258-262094acdeb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:22.384618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c02280c-68a4-4398-b258-262094acdeb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:22.385183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c02280c-68a4-4398-b258-262094acdeb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:22.511666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9c02280c-68a4-4398-b258-262094acdeb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:22.531804 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9c02280c-68a4-4398-b258-262094acdeb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1188 microversion: 2.1 time: 0.168368 Oct 29 01:44:22.550782 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3326/6865] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:22 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1188 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:22.943885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-19c58ebd-372f-4371-8f02-a07fd2bbc672 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:22.944508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-19c58ebd-372f-4371-8f02-a07fd2bbc672 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:22.964790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19c58ebd-372f-4371-8f02-a07fd2bbc672 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:22.965744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19c58ebd-372f-4371-8f02-a07fd2bbc672 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:22.966511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19c58ebd-372f-4371-8f02-a07fd2bbc672 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:22.967457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19c58ebd-372f-4371-8f02-a07fd2bbc672 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:22.968244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19c58ebd-372f-4371-8f02-a07fd2bbc672 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:22.968931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-19c58ebd-372f-4371-8f02-a07fd2bbc672 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:23.503256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-42f8610e-3d25-4a46-ae8b-faaf49f6e7bd req-76159097-a927-4c1f-936f-6c5747ed88e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5403c28-467f-4f5c-a8ff-2423a31e8728", "name": "network-vif-deleted", "tag": "03564455-9258-48f6-a2d8-a48711e36f62"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:23.506338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-19c58ebd-372f-4371-8f02-a07fd2bbc672 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:23.519998 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-19c58ebd-372f-4371-8f02-a07fd2bbc672 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1509 microversion: 2.1 time: 0.580919 Oct 29 01:44:23.521436 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3540/6866] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:22 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1509 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:23.524798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-42f8610e-3d25-4a46-ae8b-faaf49f6e7bd req-76159097-a927-4c1f-936f-6c5747ed88e2 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:23.527834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-42f8610e-3d25-4a46-ae8b-faaf49f6e7bd req-76159097-a927-4c1f-936f-6c5747ed88e2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:23.528302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-42f8610e-3d25-4a46-ae8b-faaf49f6e7bd req-76159097-a927-4c1f-936f-6c5747ed88e2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:23.559061 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-42f8610e-3d25-4a46-ae8b-faaf49f6e7bd req-76159097-a927-4c1f-936f-6c5747ed88e2 service nova] Creating event network-vif-deleted:03564455-9258-48f6-a2d8-a48711e36f62 for instance a5403c28-467f-4f5c-a8ff-2423a31e8728 on n-h1-862964-3 Oct 29 01:44:23.562982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-58015fd6-bf34-427e-a14a-f431104af359 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:23.565463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-58015fd6-bf34-427e-a14a-f431104af359 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:23.578253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58015fd6-bf34-427e-a14a-f431104af359 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:23.579396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58015fd6-bf34-427e-a14a-f431104af359 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:23.580257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58015fd6-bf34-427e-a14a-f431104af359 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:23.581259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58015fd6-bf34-427e-a14a-f431104af359 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:23.582945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58015fd6-bf34-427e-a14a-f431104af359 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:23.583688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58015fd6-bf34-427e-a14a-f431104af359 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:23.595363 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-42f8610e-3d25-4a46-ae8b-faaf49f6e7bd req-76159097-a927-4c1f-936f-6c5747ed88e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097327 Oct 29 01:44:23.595983 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3327/6867] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:44:23.688306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-58015fd6-bf34-427e-a14a-f431104af359 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:23.708829 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-58015fd6-bf34-427e-a14a-f431104af359 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1188 microversion: 2.1 time: 0.153045 Oct 29 01:44:23.730472 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3541/6868] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:23 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1188 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:24.552850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4dc8c66b-934a-44a5-9735-68a1a4bf4f81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:24.556428 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4dc8c66b-934a-44a5-9735-68a1a4bf4f81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:24.579099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dc8c66b-934a-44a5-9735-68a1a4bf4f81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:24.579928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dc8c66b-934a-44a5-9735-68a1a4bf4f81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:24.580584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dc8c66b-934a-44a5-9735-68a1a4bf4f81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:24.581808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dc8c66b-934a-44a5-9735-68a1a4bf4f81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:24.582617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dc8c66b-934a-44a5-9735-68a1a4bf4f81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:24.583336 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dc8c66b-934a-44a5-9735-68a1a4bf4f81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:24.647796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dc8c66b-934a-44a5-9735-68a1a4bf4f81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:24.648697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dc8c66b-934a-44a5-9735-68a1a4bf4f81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:24.649144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4dc8c66b-934a-44a5-9735-68a1a4bf4f81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:24.649651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-4dc8c66b-934a-44a5-9735-68a1a4bf4f81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lazy-loading 'fault' on Instance uuid a5403c28-467f-4f5c-a8ff-2423a31e8728 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:44:24.737980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4dc8c66b-934a-44a5-9735-68a1a4bf4f81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:24.745658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b5ee5c0f-cf8d-4dfe-9e47-0946533bddc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:24.745658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b5ee5c0f-cf8d-4dfe-9e47-0946533bddc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:24.747173 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4dc8c66b-934a-44a5-9735-68a1a4bf4f81 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 200 len: 1305 microversion: 2.1 time: 0.202827 Oct 29 01:44:24.761697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5ee5c0f-cf8d-4dfe-9e47-0946533bddc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:24.761697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5ee5c0f-cf8d-4dfe-9e47-0946533bddc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:24.761697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5ee5c0f-cf8d-4dfe-9e47-0946533bddc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:24.761697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5ee5c0f-cf8d-4dfe-9e47-0946533bddc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:24.761697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5ee5c0f-cf8d-4dfe-9e47-0946533bddc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:24.761697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b5ee5c0f-cf8d-4dfe-9e47-0946533bddc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:24.762586 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3328/6869] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:24 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 1305 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:24.854117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b5ee5c0f-cf8d-4dfe-9e47-0946533bddc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:24.863452 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b5ee5c0f-cf8d-4dfe-9e47-0946533bddc7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1188 microversion: 2.1 time: 0.124320 Oct 29 01:44:24.864357 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3542/6870] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:24 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1188 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:25.774414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f573f360-2a59-41a9-b838-7a7b4b9a9871 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:25.775730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f573f360-2a59-41a9-b838-7a7b4b9a9871 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: a5403c28-467f-4f5c-a8ff-2423a31e8728] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:25.790321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f573f360-2a59-41a9-b838-7a7b4b9a9871 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:25.791187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f573f360-2a59-41a9-b838-7a7b4b9a9871 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:25.791935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f573f360-2a59-41a9-b838-7a7b4b9a9871 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:25.792885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f573f360-2a59-41a9-b838-7a7b4b9a9871 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:25.793465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f573f360-2a59-41a9-b838-7a7b4b9a9871 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:25.793981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f573f360-2a59-41a9-b838-7a7b4b9a9871 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:25.815299 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-f573f360-2a59-41a9-b838-7a7b4b9a9871 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] HTTP exception thrown: Instance a5403c28-467f-4f5c-a8ff-2423a31e8728 could not be found. Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f573f360-2a59-41a9-b838-7a7b4b9a9871 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Request method failure captured: Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 HTTP/1.1 Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIL7S5xF4168RL6JoFuUbcH6-3DDmyiCJ6R7rm4bgk2fiKECHpPWIxe8Sb6KFLzfaouBeUBjfCfEFAi0SDZDaQE_pKK3AEydGMSkKrcyZ-fr5rCFaKW-2JEPVH3EUDBGDA-y9zSVdN55YxOgNS3JW2ZCCkwPgvfmgUCIRXp7mDkobAQ Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 238c2e0d9e0b48198767a357cff1a442 Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerActionsTestJSON-45025787 Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/238c2e0d9e0b48198767a357cff1a442"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/238c2e0d9e0b48198767a357cff1a442"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/238c2e0d9e0b48198767a357cff1a442"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_238c2e0d9e0b48198767a357cff1a442", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerActionsTestJSON-45025787 Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 238c2e0d9e0b48198767a357cff1a442 Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerActionsTestJSON-45025787 Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerActionsTestJSON-45025787-project Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 9c097ba205f6453ba793dfb1d1876f3e Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerActionsTestJSON-45025787-project Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance a5403c28-467f-4f5c-a8ff-2423a31e8728 could not be found. Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'a5403c28-467f-4f5c-a8ff-2423a31e8728'} Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5403c28-467f-4f5c-a8ff-2423a31e8728 could not be found. Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5403c28-467f-4f5c-a8ff-2423a31e8728 could not be found. Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:25.826846 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:25.831153 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:25.831153 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:25.831153 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:25.831153 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:44:25.831153 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:44:25.831153 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5403c28-467f-4f5c-a8ff-2423a31e8728 could not be found. Oct 29 01:44:25.831153 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:25.838841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f573f360-2a59-41a9-b838-7a7b4b9a9871 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Returning 404 to user: Instance a5403c28-467f-4f5c-a8ff-2423a31e8728 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:44:25.840172 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f573f360-2a59-41a9-b838-7a7b4b9a9871 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728" status: 404 len: 111 microversion: 2.1 time: 0.069684 Oct 29 01:44:25.840961 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3329/6871] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:25 2022] GET /compute/v2.1/servers/a5403c28-467f-4f5c-a8ff-2423a31e8728 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:44:25.850041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7762d332-29bc-4434-845a-c43bf3e2139b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:25.850598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7762d332-29bc-4434-845a-c43bf3e2139b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:25.869573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7762d332-29bc-4434-845a-c43bf3e2139b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:25.872930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7762d332-29bc-4434-845a-c43bf3e2139b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:25.872930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7762d332-29bc-4434-845a-c43bf3e2139b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:25.872930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7762d332-29bc-4434-845a-c43bf3e2139b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:25.872930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7762d332-29bc-4434-845a-c43bf3e2139b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:25.872930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7762d332-29bc-4434-845a-c43bf3e2139b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:25.886823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2f694152-1bc3-4ca3-a212-7c988bfeab3f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:25.888379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2f694152-1bc3-4ca3-a212-7c988bfeab3f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:25.913414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f694152-1bc3-4ca3-a212-7c988bfeab3f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:25.925532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7762d332-29bc-4434-845a-c43bf3e2139b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:44:25.934164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f694152-1bc3-4ca3-a212-7c988bfeab3f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:25.934164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f694152-1bc3-4ca3-a212-7c988bfeab3f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:25.934164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f694152-1bc3-4ca3-a212-7c988bfeab3f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:25.934164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f694152-1bc3-4ca3-a212-7c988bfeab3f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:25.935600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f694152-1bc3-4ca3-a212-7c988bfeab3f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:25.979915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:44:26.110395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f694152-1bc3-4ca3-a212-7c988bfeab3f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:26.111312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f694152-1bc3-4ca3-a212-7c988bfeab3f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:26.112076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2f694152-1bc3-4ca3-a212-7c988bfeab3f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:26.112761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-2f694152-1bc3-4ca3-a212-7c988bfeab3f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lazy-loading 'fault' on Instance uuid d7511379-4e9b-42ac-b0cb-5d36bdc57833 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:44:26.299366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2f694152-1bc3-4ca3-a212-7c988bfeab3f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:26.312237 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2f694152-1bc3-4ca3-a212-7c988bfeab3f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 200 len: 1147 microversion: 2.1 time: 0.428302 Oct 29 01:44:26.314424 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3330/6872] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:25 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 1147 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:26.323467 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7762d332-29bc-4434-845a-c43bf3e2139b tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "DELETE /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 204 len: 0 microversion: 2.1 time: 0.477026 Oct 29 01:44:26.327983 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3543/6873] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:44:25 2022] DELETE /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:44:26.336866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5e970d68-5e20-4f91-b5d6-9355c7bd1601 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:26.338749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5e970d68-5e20-4f91-b5d6-9355c7bd1601 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:26.353166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e970d68-5e20-4f91-b5d6-9355c7bd1601 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:26.354747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e970d68-5e20-4f91-b5d6-9355c7bd1601 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:26.359439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e970d68-5e20-4f91-b5d6-9355c7bd1601 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:26.360358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e970d68-5e20-4f91-b5d6-9355c7bd1601 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:26.360946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e970d68-5e20-4f91-b5d6-9355c7bd1601 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:26.361538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e970d68-5e20-4f91-b5d6-9355c7bd1601 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:27.339746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2058a1e4-bb64-4269-a128-54cfad2a6b15 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:27.340634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2058a1e4-bb64-4269-a128-54cfad2a6b15 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:27.362323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2058a1e4-bb64-4269-a128-54cfad2a6b15 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:27.365726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2058a1e4-bb64-4269-a128-54cfad2a6b15 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:27.367950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2058a1e4-bb64-4269-a128-54cfad2a6b15 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:27.373705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2058a1e4-bb64-4269-a128-54cfad2a6b15 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:27.375169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2058a1e4-bb64-4269-a128-54cfad2a6b15 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:27.378718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2058a1e4-bb64-4269-a128-54cfad2a6b15 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:27.387114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5e970d68-5e20-4f91-b5d6-9355c7bd1601 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:27.402163 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5e970d68-5e20-4f91-b5d6-9355c7bd1601 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1495 microversion: 2.1 time: 1.067017 Oct 29 01:44:27.403277 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3331/6874] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:26 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1495 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:27.426019 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-2058a1e4-bb64-4269-a128-54cfad2a6b15 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] HTTP exception thrown: Instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 could not be found. Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2058a1e4-bb64-4269-a128-54cfad2a6b15 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Request method failure captured: Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 HTTP/1.1 Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXISL1fYm1j7NXik3zsNtroj_Oy-crTrvQAeW5M-FwwtP3LsKgHXpuppTsI04rMuajP4UZsmStYeX1aQyWE5BokToP2AX7pO99qAjgwqGhP0Pb1MuaH07JyrTdqaWdL6Co3a2Gha0Gb4NOVY73erVtuC0neHUxTJ51YCufPzngi0azyM Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37416a9397fa4c6dbd0bfe8dee191577", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-TestVolumeBootPattern-743321222 Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8b8f36d10fa340f784581a3cf9a15606 Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 could not be found. Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'd7511379-4e9b-42ac-b0cb-5d36bdc57833'} Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 could not be found. Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 could not be found. Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:27.434773 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:27.442874 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:27.442874 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:27.442874 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:27.442874 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:44:27.442874 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:44:27.442874 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 could not be found. Oct 29 01:44:27.442874 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:27.445062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2058a1e4-bb64-4269-a128-54cfad2a6b15 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Returning 404 to user: Instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:44:27.446417 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2058a1e4-bb64-4269-a128-54cfad2a6b15 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 404 len: 111 microversion: 2.1 time: 0.111785 Oct 29 01:44:27.450434 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3544/6875] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:27 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:44:28.441295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3cefaf69-27c9-42d0-b962-a2ed5aab1830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:28.445120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3cefaf69-27c9-42d0-b962-a2ed5aab1830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:28.472987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3cefaf69-27c9-42d0-b962-a2ed5aab1830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:28.473911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3cefaf69-27c9-42d0-b962-a2ed5aab1830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:28.486545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3cefaf69-27c9-42d0-b962-a2ed5aab1830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:28.487860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3cefaf69-27c9-42d0-b962-a2ed5aab1830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:28.489954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3cefaf69-27c9-42d0-b962-a2ed5aab1830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:28.490526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3cefaf69-27c9-42d0-b962-a2ed5aab1830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:28.875749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3cefaf69-27c9-42d0-b962-a2ed5aab1830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:28.897426 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3cefaf69-27c9-42d0-b962-a2ed5aab1830 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1453 microversion: 2.1 time: 0.464757 Oct 29 01:44:28.916754 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3332/6876] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:28 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1453 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:29.179348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-2847d53a-3127-4852-b022-1ebf9ddf107f req-c9e89c31-faea-49cb-8daf-f36014b3885a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d269df-d652-4637-96bb-411abce6787f", "name": "network-vif-deleted", "tag": "dfdd00c6-6619-4aa6-88d9-e56b00d741e5"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:29.210918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:44:29.234623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2847d53a-3127-4852-b022-1ebf9ddf107f req-c9e89c31-faea-49cb-8daf-f36014b3885a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:29.238782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2847d53a-3127-4852-b022-1ebf9ddf107f req-c9e89c31-faea-49cb-8daf-f36014b3885a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:29.239340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2847d53a-3127-4852-b022-1ebf9ddf107f req-c9e89c31-faea-49cb-8daf-f36014b3885a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:29.271071 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-2847d53a-3127-4852-b022-1ebf9ddf107f req-c9e89c31-faea-49cb-8daf-f36014b3885a service nova] Creating event network-vif-deleted:dfdd00c6-6619-4aa6-88d9-e56b00d741e5 for instance 15d269df-d652-4637-96bb-411abce6787f on n-h2-862964-3 Oct 29 01:44:29.277438 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-2847d53a-3127-4852-b022-1ebf9ddf107f req-c9e89c31-faea-49cb-8daf-f36014b3885a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106270 Oct 29 01:44:29.278475 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3545/6877] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:44:29.926335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d8a71919-dfd4-46f2-943b-d45b05b404b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:29.926970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d8a71919-dfd4-46f2-943b-d45b05b404b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:29.956441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8a71919-dfd4-46f2-943b-d45b05b404b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:29.957314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8a71919-dfd4-46f2-943b-d45b05b404b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:29.958397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8a71919-dfd4-46f2-943b-d45b05b404b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:29.959315 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8a71919-dfd4-46f2-943b-d45b05b404b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:29.960995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8a71919-dfd4-46f2-943b-d45b05b404b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:29.961698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8a71919-dfd4-46f2-943b-d45b05b404b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:30.127124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8a71919-dfd4-46f2-943b-d45b05b404b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:30.127675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8a71919-dfd4-46f2-943b-d45b05b404b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:30.128214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8a71919-dfd4-46f2-943b-d45b05b404b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:30.128685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-d8a71919-dfd4-46f2-943b-d45b05b404b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lazy-loading 'fault' on Instance uuid 15d269df-d652-4637-96bb-411abce6787f {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:44:30.253388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d8a71919-dfd4-46f2-943b-d45b05b404b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:30.256344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:44:30.277537 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d8a71919-dfd4-46f2-943b-d45b05b404b9 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 200 len: 1305 microversion: 2.1 time: 0.357404 Oct 29 01:44:30.281223 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3333/6878] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:29 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 1305 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:30.307974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a76bd728-b69d-4a26-8803-3b84203c2816 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:30.311018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a76bd728-b69d-4a26-8803-3b84203c2816 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:30.339514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a76bd728-b69d-4a26-8803-3b84203c2816 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:30.340022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a76bd728-b69d-4a26-8803-3b84203c2816 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:30.340475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a76bd728-b69d-4a26-8803-3b84203c2816 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:30.341429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a76bd728-b69d-4a26-8803-3b84203c2816 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:30.341695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a76bd728-b69d-4a26-8803-3b84203c2816 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:30.342128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a76bd728-b69d-4a26-8803-3b84203c2816 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:30.466871 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a76bd728-b69d-4a26-8803-3b84203c2816 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "POST /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617/action" status: 200 len: 32637 microversion: 2.1 time: 0.166027 Oct 29 01:44:30.468215 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3546/6879] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:44:30 2022] POST /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617/action => generated 32637 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:44:31.320241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e41059ba-6820-4ece-8afa-b271d4f5f011 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:31.321756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e41059ba-6820-4ece-8afa-b271d4f5f011 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 15d269df-d652-4637-96bb-411abce6787f] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:31.350026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e41059ba-6820-4ece-8afa-b271d4f5f011 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:31.350552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e41059ba-6820-4ece-8afa-b271d4f5f011 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:31.350988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e41059ba-6820-4ece-8afa-b271d4f5f011 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:31.351706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e41059ba-6820-4ece-8afa-b271d4f5f011 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:31.352162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e41059ba-6820-4ece-8afa-b271d4f5f011 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:31.352578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e41059ba-6820-4ece-8afa-b271d4f5f011 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:31.371991 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-e41059ba-6820-4ece-8afa-b271d4f5f011 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] HTTP exception thrown: Instance 15d269df-d652-4637-96bb-411abce6787f could not be found. Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e41059ba-6820-4ece-8afa-b271d4f5f011 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Request method failure captured: Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f HTTP/1.1 Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIL7S5xF4168RL6JoFuUbcH6-3DDmyiCJ6R7rm4bgk2fiKECHpPWIxe8Sb6KFLzfaouBeUBjfCfEFAi0SDZDaQE_pKK3AEydGMSkKrcyZ-fr5rCFaKW-2JEPVH3EUDBGDA-y9zSVdN55YxOgNS3JW2ZCCkwPgvfmgUCIRXp7mDkobAQ Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 238c2e0d9e0b48198767a357cff1a442 Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerActionsTestJSON-45025787 Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/238c2e0d9e0b48198767a357cff1a442"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/238c2e0d9e0b48198767a357cff1a442"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/238c2e0d9e0b48198767a357cff1a442"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_238c2e0d9e0b48198767a357cff1a442", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerActionsTestJSON-45025787 Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 238c2e0d9e0b48198767a357cff1a442 Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerActionsTestJSON-45025787 Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerActionsTestJSON-45025787-project Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 9c097ba205f6453ba793dfb1d1876f3e Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerActionsTestJSON-45025787-project Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 15d269df-d652-4637-96bb-411abce6787f could not be found. Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '15d269df-d652-4637-96bb-411abce6787f'} Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d269df-d652-4637-96bb-411abce6787f could not be found. Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d269df-d652-4637-96bb-411abce6787f could not be found. Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:31.374362 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:31.379075 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:31.379075 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:31.379075 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:31.379075 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:44:31.379075 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:44:31.379075 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d269df-d652-4637-96bb-411abce6787f could not be found. Oct 29 01:44:31.379075 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:44:31.380949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e41059ba-6820-4ece-8afa-b271d4f5f011 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Returning 404 to user: Instance 15d269df-d652-4637-96bb-411abce6787f could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:44:31.382691 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e41059ba-6820-4ece-8afa-b271d4f5f011 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f" status: 404 len: 111 microversion: 2.1 time: 0.069703 Oct 29 01:44:31.384120 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3334/6880] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:31 2022] GET /compute/v2.1/servers/15d269df-d652-4637-96bb-411abce6787f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:44:31.395181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3bb76e19-8996-496e-a591-bc1765722907 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:31.396582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3bb76e19-8996-496e-a591-bc1765722907 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:31.417357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3bb76e19-8996-496e-a591-bc1765722907 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:31.422626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3bb76e19-8996-496e-a591-bc1765722907 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:31.423380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3bb76e19-8996-496e-a591-bc1765722907 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:31.424328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3bb76e19-8996-496e-a591-bc1765722907 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:31.425911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3bb76e19-8996-496e-a591-bc1765722907 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:31.426576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3bb76e19-8996-496e-a591-bc1765722907 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:31.523463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3bb76e19-8996-496e-a591-bc1765722907 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:44:31.946722 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3bb76e19-8996-496e-a591-bc1765722907 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 204 len: 0 microversion: 2.1 time: 0.558028 Oct 29 01:44:31.953289 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3547/6881] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:44:31 2022] DELETE /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:44:31.961742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bbe6549f-e577-4ec8-a4d1-fe69754b5597 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:31.962641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bbe6549f-e577-4ec8-a4d1-fe69754b5597 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:32.009657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbe6549f-e577-4ec8-a4d1-fe69754b5597 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:32.009657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbe6549f-e577-4ec8-a4d1-fe69754b5597 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:32.009657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbe6549f-e577-4ec8-a4d1-fe69754b5597 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:32.009657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbe6549f-e577-4ec8-a4d1-fe69754b5597 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:32.009657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbe6549f-e577-4ec8-a4d1-fe69754b5597 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:32.009657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbe6549f-e577-4ec8-a4d1-fe69754b5597 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:32.091568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-05058994-5e28-4b4f-9bbe-ed043828e951 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:32.092191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-05058994-5e28-4b4f-9bbe-ed043828e951 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:32.104219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05058994-5e28-4b4f-9bbe-ed043828e951 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:32.108700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05058994-5e28-4b4f-9bbe-ed043828e951 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:32.108700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05058994-5e28-4b4f-9bbe-ed043828e951 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:32.108700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05058994-5e28-4b4f-9bbe-ed043828e951 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:32.115332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05058994-5e28-4b4f-9bbe-ed043828e951 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:32.115924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05058994-5e28-4b4f-9bbe-ed043828e951 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:32.161609 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-05058994-5e28-4b4f-9bbe-ed043828e951 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] HTTP exception thrown: Instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 could not be found. Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-05058994-5e28-4b4f-9bbe-ed043828e951 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Request method failure captured: Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 HTTP/1.1 Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXISL1fYm1j7NXik3zsNtroj_Oy-crTrvQAeW5M-FwwtP3LsKgHXpuppTsI04rMuajP4UZsmStYeX1aQyWE5BokToP2AX7pO99qAjgwqGhP0Pb1MuaH07JyrTdqaWdL6Co3a2Gha0Gb4NOVY73erVtuC0neHUxTJ51YCufPzngi0azyM Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37416a9397fa4c6dbd0bfe8dee191577", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-TestVolumeBootPattern-743321222 Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8b8f36d10fa340f784581a3cf9a15606 Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 could not be found. Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'd7511379-4e9b-42ac-b0cb-5d36bdc57833'} Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 could not be found. Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:44:32.175961 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:44:32.180974 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 could not be found. Oct 29 01:44:32.180974 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:32.180974 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:32.180974 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:32.180974 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:32.180974 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:32.180974 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:32.180974 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:44:32.180974 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:44:32.180974 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 could not be found. Oct 29 01:44:32.180974 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:32.180974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-05058994-5e28-4b4f-9bbe-ed043828e951 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Returning 404 to user: Instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:44:32.180974 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-05058994-5e28-4b4f-9bbe-ed043828e951 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 404 len: 111 microversion: 2.1 time: 0.082521 Oct 29 01:44:32.180974 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3548/6882] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:44:32 2022] DELETE /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:44:32.188900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9d8c850b-f423-4586-8b27-dfe9acb6b4ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:32.193513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9d8c850b-f423-4586-8b27-dfe9acb6b4ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d7511379-4e9b-42ac-b0cb-5d36bdc57833] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:32.214175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d8c850b-f423-4586-8b27-dfe9acb6b4ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:32.214698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d8c850b-f423-4586-8b27-dfe9acb6b4ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:32.215771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d8c850b-f423-4586-8b27-dfe9acb6b4ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:32.216512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d8c850b-f423-4586-8b27-dfe9acb6b4ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:32.217043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d8c850b-f423-4586-8b27-dfe9acb6b4ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:32.217659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d8c850b-f423-4586-8b27-dfe9acb6b4ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:32.255592 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-9d8c850b-f423-4586-8b27-dfe9acb6b4ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] HTTP exception thrown: Instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 could not be found. Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9d8c850b-f423-4586-8b27-dfe9acb6b4ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Request method failure captured: Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 HTTP/1.1 Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXISL1fYm1j7NXik3zsNtroj_Oy-crTrvQAeW5M-FwwtP3LsKgHXpuppTsI04rMuajP4UZsmStYeX1aQyWE5BokToP2AX7pO99qAjgwqGhP0Pb1MuaH07JyrTdqaWdL6Co3a2Gha0Gb4NOVY73erVtuC0neHUxTJ51YCufPzngi0azyM Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37416a9397fa4c6dbd0bfe8dee191577", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-TestVolumeBootPattern-743321222 Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8b8f36d10fa340f784581a3cf9a15606 Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 could not be found. Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'd7511379-4e9b-42ac-b0cb-5d36bdc57833'} Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 could not be found. Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 could not be found. Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:32.257623 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:32.267868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:32.267868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:32.267868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:32.267868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:44:32.267868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:44:32.267868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 could not be found. Oct 29 01:44:32.267868 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:32.267868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9d8c850b-f423-4586-8b27-dfe9acb6b4ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Returning 404 to user: Instance d7511379-4e9b-42ac-b0cb-5d36bdc57833 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:44:32.267868 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9d8c850b-f423-4586-8b27-dfe9acb6b4ad tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833" status: 404 len: 111 microversion: 2.1 time: 0.083326 Oct 29 01:44:32.267868 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3549/6883] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:32 2022] GET /compute/v2.1/servers/d7511379-4e9b-42ac-b0cb-5d36bdc57833 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:44:32.822546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bbe6549f-e577-4ec8-a4d1-fe69754b5597 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:32.840968 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bbe6549f-e577-4ec8-a4d1-fe69754b5597 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1676 microversion: 2.1 time: 0.879313 Oct 29 01:44:32.843481 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3335/6884] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:31 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1676 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:33.475970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-694129a7-756f-4298-b6cc-8af7f24e9969 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:33.476504 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-694129a7-756f-4298-b6cc-8af7f24e9969 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:33.497914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-694129a7-756f-4298-b6cc-8af7f24e9969 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:33.518695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-694129a7-756f-4298-b6cc-8af7f24e9969 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:33.519458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-694129a7-756f-4298-b6cc-8af7f24e9969 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:33.540334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-694129a7-756f-4298-b6cc-8af7f24e9969 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:33.540844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-694129a7-756f-4298-b6cc-8af7f24e9969 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:33.541336 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-694129a7-756f-4298-b6cc-8af7f24e9969 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:33.562964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-2f2fc4f6-c69c-4f6f-827c-cf0ec5491d70 req-26c1b2b4-17c9-4824-be4b-0612a5ac29f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e333fe7e-b42e-4135-900a-1c977f223617", "tag": "75f73836-8254-485f-a3cb-2b63990c10cf"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:33.627479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2f2fc4f6-c69c-4f6f-827c-cf0ec5491d70 req-26c1b2b4-17c9-4824-be4b-0612a5ac29f4 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:33.629142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2f2fc4f6-c69c-4f6f-827c-cf0ec5491d70 req-26c1b2b4-17c9-4824-be4b-0612a5ac29f4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:33.634323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2f2fc4f6-c69c-4f6f-827c-cf0ec5491d70 req-26c1b2b4-17c9-4824-be4b-0612a5ac29f4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:33.661754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-694129a7-756f-4298-b6cc-8af7f24e9969 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:44:33.698738 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-2f2fc4f6-c69c-4f6f-827c-cf0ec5491d70 req-26c1b2b4-17c9-4824-be4b-0612a5ac29f4 service nova] Creating event network-changed:75f73836-8254-485f-a3cb-2b63990c10cf for instance e333fe7e-b42e-4135-900a-1c977f223617 on n-h2-862964-3 Oct 29 01:44:33.722577 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-2f2fc4f6-c69c-4f6f-827c-cf0ec5491d70 req-26c1b2b4-17c9-4824-be4b-0612a5ac29f4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164852 Oct 29 01:44:33.726898 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3336/6885] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:44:33.874854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-52fb046a-0d04-453d-9bc9-3dc1fc88bffa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:33.876458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-52fb046a-0d04-453d-9bc9-3dc1fc88bffa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:33.897478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52fb046a-0d04-453d-9bc9-3dc1fc88bffa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:33.903704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52fb046a-0d04-453d-9bc9-3dc1fc88bffa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:33.906818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52fb046a-0d04-453d-9bc9-3dc1fc88bffa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:33.909105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52fb046a-0d04-453d-9bc9-3dc1fc88bffa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:33.914723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52fb046a-0d04-453d-9bc9-3dc1fc88bffa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:33.916568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52fb046a-0d04-453d-9bc9-3dc1fc88bffa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:34.071764 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-694129a7-756f-4298-b6cc-8af7f24e9969 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 204 len: 0 microversion: 2.1 time: 0.599323 Oct 29 01:44:34.072564 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3550/6886] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:44:33 2022] DELETE /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:44:34.081956 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0f989da3-bc65-4a25-b8af-11f03589b261 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:34.088005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0f989da3-bc65-4a25-b8af-11f03589b261 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:34.107270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f989da3-bc65-4a25-b8af-11f03589b261 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:34.107777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f989da3-bc65-4a25-b8af-11f03589b261 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:34.108288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f989da3-bc65-4a25-b8af-11f03589b261 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:34.117298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f989da3-bc65-4a25-b8af-11f03589b261 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:34.118113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f989da3-bc65-4a25-b8af-11f03589b261 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:34.118721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0f989da3-bc65-4a25-b8af-11f03589b261 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:35.704977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0f989da3-bc65-4a25-b8af-11f03589b261 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:35.725098 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0f989da3-bc65-4a25-b8af-11f03589b261 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 200 len: 1669 microversion: 2.1 time: 1.647902 Oct 29 01:44:35.730296 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3551/6887] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:34 2022] GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 1669 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:35.806475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-52fb046a-0d04-453d-9bc9-3dc1fc88bffa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:35.825034 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-52fb046a-0d04-453d-9bc9-3dc1fc88bffa tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1676 microversion: 2.1 time: 1.956668 Oct 29 01:44:35.828156 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3337/6888] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:33 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1676 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:36.759135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0bbc51f5-8654-46f1-9a7c-8d24ef1c2875 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:36.762861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0bbc51f5-8654-46f1-9a7c-8d24ef1c2875 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:36.784588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0bbc51f5-8654-46f1-9a7c-8d24ef1c2875 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:36.791102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0bbc51f5-8654-46f1-9a7c-8d24ef1c2875 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:36.791598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0bbc51f5-8654-46f1-9a7c-8d24ef1c2875 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:36.792351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0bbc51f5-8654-46f1-9a7c-8d24ef1c2875 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:36.802363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0bbc51f5-8654-46f1-9a7c-8d24ef1c2875 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:36.802836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0bbc51f5-8654-46f1-9a7c-8d24ef1c2875 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:36.854685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-61cef634-0d18-46ea-9b92-fd97c97ef37a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:36.855311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-61cef634-0d18-46ea-9b92-fd97c97ef37a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:36.874446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61cef634-0d18-46ea-9b92-fd97c97ef37a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:36.874965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61cef634-0d18-46ea-9b92-fd97c97ef37a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:36.877391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61cef634-0d18-46ea-9b92-fd97c97ef37a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:36.877391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61cef634-0d18-46ea-9b92-fd97c97ef37a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:36.879592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61cef634-0d18-46ea-9b92-fd97c97ef37a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:36.880049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-61cef634-0d18-46ea-9b92-fd97c97ef37a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:37.084318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-61cef634-0d18-46ea-9b92-fd97c97ef37a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:37.094359 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-61cef634-0d18-46ea-9b92-fd97c97ef37a tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1608 microversion: 2.1 time: 0.245134 Oct 29 01:44:37.098293 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3338/6889] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:36 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1608 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:37.724860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-62cdf4ce-7703-42c3-81f7-5ab18ce0d72f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1026642779", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "3ca47a98-0347-4a68-a909-29b50913f113"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1909159424", "security_groups": [{"name": "tempest-secgroup-smoke-1196460652"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:37.942159 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0bbc51f5-8654-46f1-9a7c-8d24ef1c2875 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:37.995046 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0bbc51f5-8654-46f1-9a7c-8d24ef1c2875 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 200 len: 1669 microversion: 2.1 time: 1.239910 Oct 29 01:44:37.996486 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3552/6890] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:36 2022] GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 1669 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:38.003655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-031ac01c-2db5-4298-97ed-79972d74e32a req-a3f3ba52-50d3-4258-8de3-b013ba22b84c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e333fe7e-b42e-4135-900a-1c977f223617", "name": "network-vif-deleted", "tag": "75f73836-8254-485f-a3cb-2b63990c10cf"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:38.021248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-031ac01c-2db5-4298-97ed-79972d74e32a req-a3f3ba52-50d3-4258-8de3-b013ba22b84c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:38.021462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-031ac01c-2db5-4298-97ed-79972d74e32a req-a3f3ba52-50d3-4258-8de3-b013ba22b84c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:38.022149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-031ac01c-2db5-4298-97ed-79972d74e32a req-a3f3ba52-50d3-4258-8de3-b013ba22b84c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:38.044122 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-031ac01c-2db5-4298-97ed-79972d74e32a req-a3f3ba52-50d3-4258-8de3-b013ba22b84c service nova] Creating event network-vif-deleted:75f73836-8254-485f-a3cb-2b63990c10cf for instance e333fe7e-b42e-4135-900a-1c977f223617 on n-h2-862964-3 Oct 29 01:44:38.065372 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-031ac01c-2db5-4298-97ed-79972d74e32a req-a3f3ba52-50d3-4258-8de3-b013ba22b84c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065409 Oct 29 01:44:38.066216 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3553/6891] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:44:38.128396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-62cdf4ce-7703-42c3-81f7-5ab18ce0d72f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] validate_networks() for [('3ca47a98-0347-4a68-a909-29b50913f113', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:44:38.160562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aec48855-8e5d-470b-b113-a3643359c970 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:38.161398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-aec48855-8e5d-470b-b113-a3643359c970 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:38.201467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aec48855-8e5d-470b-b113-a3643359c970 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:38.206321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aec48855-8e5d-470b-b113-a3643359c970 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:38.209143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aec48855-8e5d-470b-b113-a3643359c970 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:38.212998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aec48855-8e5d-470b-b113-a3643359c970 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:38.214610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aec48855-8e5d-470b-b113-a3643359c970 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:38.215436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aec48855-8e5d-470b-b113-a3643359c970 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:38.492685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-aec48855-8e5d-470b-b113-a3643359c970 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:38.521835 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aec48855-8e5d-470b-b113-a3643359c970 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1608 microversion: 2.1 time: 0.379379 Oct 29 01:44:38.522815 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3554/6892] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:38 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1608 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:39.001313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-62cdf4ce-7703-42c3-81f7-5ab18ce0d72f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:44:39.001750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-62cdf4ce-7703-42c3-81f7-5ab18ce0d72f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:44:39.002274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-62cdf4ce-7703-42c3-81f7-5ab18ce0d72f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:44:39.002749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-62cdf4ce-7703-42c3-81f7-5ab18ce0d72f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:44:39.003188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-62cdf4ce-7703-42c3-81f7-5ab18ce0d72f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:44:39.023891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d35575be-f8f8-40a5-b08d-f7c68b35ce5c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:39.024513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d35575be-f8f8-40a5-b08d-f7c68b35ce5c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:39.046969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-62cdf4ce-7703-42c3-81f7-5ab18ce0d72f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:39.055525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d35575be-f8f8-40a5-b08d-f7c68b35ce5c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:39.055680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-62cdf4ce-7703-42c3-81f7-5ab18ce0d72f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:39.055680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-62cdf4ce-7703-42c3-81f7-5ab18ce0d72f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:39.055862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d35575be-f8f8-40a5-b08d-f7c68b35ce5c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:39.055967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-62cdf4ce-7703-42c3-81f7-5ab18ce0d72f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:39.059305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d35575be-f8f8-40a5-b08d-f7c68b35ce5c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:39.065527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-62cdf4ce-7703-42c3-81f7-5ab18ce0d72f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:39.081244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d35575be-f8f8-40a5-b08d-f7c68b35ce5c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:39.085278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-62cdf4ce-7703-42c3-81f7-5ab18ce0d72f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:39.087965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d35575be-f8f8-40a5-b08d-f7c68b35ce5c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:39.088510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d35575be-f8f8-40a5-b08d-f7c68b35ce5c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:39.167831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-62cdf4ce-7703-42c3-81f7-5ab18ce0d72f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Getting quotas for project 2842ba05180046839fb5d064ad9132a1. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:44:39.187185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-62cdf4ce-7703-42c3-81f7-5ab18ce0d72f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Getting quotas for user c70e2b34406c4e11afd9471a09d9cfef and project 2842ba05180046839fb5d064ad9132a1. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:44:39.196721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d35575be-f8f8-40a5-b08d-f7c68b35ce5c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:39.197567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d35575be-f8f8-40a5-b08d-f7c68b35ce5c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:39.198415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d35575be-f8f8-40a5-b08d-f7c68b35ce5c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:39.199076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-d35575be-f8f8-40a5-b08d-f7c68b35ce5c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lazy-loading 'fault' on Instance uuid e333fe7e-b42e-4135-900a-1c977f223617 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:44:39.228065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-62cdf4ce-7703-42c3-81f7-5ab18ce0d72f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:44:39.237468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-62cdf4ce-7703-42c3-81f7-5ab18ce0d72f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:44:39.328991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d35575be-f8f8-40a5-b08d-f7c68b35ce5c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab773592a5914fcda533047d8044c3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1817f6a3cd04ebbaa07dd63934d2771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:39.347443 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d35575be-f8f8-40a5-b08d-f7c68b35ce5c tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 200 len: 1337 microversion: 2.1 time: 0.322291 Oct 29 01:44:39.360757 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3555/6893] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:39 2022] GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 1337 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:39.575507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9b009422-bd26-453d-8fb4-87776ef03627 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:39.583309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9b009422-bd26-453d-8fb4-87776ef03627 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:39.584114 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-62cdf4ce-7703-42c3-81f7-5ab18ce0d72f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.863403 Oct 29 01:44:39.584777 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3339/6894] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:44:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:44:39.585566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b009422-bd26-453d-8fb4-87776ef03627 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:39.586290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b009422-bd26-453d-8fb4-87776ef03627 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:39.586902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b009422-bd26-453d-8fb4-87776ef03627 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:39.589891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b009422-bd26-453d-8fb4-87776ef03627 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:39.591433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b009422-bd26-453d-8fb4-87776ef03627 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:39.592573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b009422-bd26-453d-8fb4-87776ef03627 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:39.611811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d39e7ce-7dd5-48c8-af74-007caeff8bcf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:39.621205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7d39e7ce-7dd5-48c8-af74-007caeff8bcf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:39.747357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b009422-bd26-453d-8fb4-87776ef03627 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:39.748388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b009422-bd26-453d-8fb4-87776ef03627 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:39.749335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b009422-bd26-453d-8fb4-87776ef03627 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:39.751589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-9b009422-bd26-453d-8fb4-87776ef03627 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lazy-loading 'fault' on Instance uuid 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:44:39.794057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7d39e7ce-7dd5-48c8-af74-007caeff8bcf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:39.812002 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7d39e7ce-7dd5-48c8-af74-007caeff8bcf tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1267 microversion: 2.1 time: 0.213309 Oct 29 01:44:39.820592 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3340/6895] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:39 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:39.987261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9b009422-bd26-453d-8fb4-87776ef03627 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c097ba205f6453ba793dfb1d1876f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238c2e0d9e0b48198767a357cff1a442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:40.027186 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9b009422-bd26-453d-8fb4-87776ef03627 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 200 len: 1328 microversion: 2.1 time: 0.468610 Oct 29 01:44:40.031036 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3556/6896] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:39 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 1328 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:40.109460 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-e281626c-cf3c-49a5-83fc-3a3c9af932ec req-d1dcf5b1-1d0d-4448-b484-87349014367e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a", "name": "network-vif-deleted", "tag": "5a9cbab0-94b4-4948-a2da-c29b923b64da"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:40.129229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e281626c-cf3c-49a5-83fc-3a3c9af932ec req-d1dcf5b1-1d0d-4448-b484-87349014367e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:40.130052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e281626c-cf3c-49a5-83fc-3a3c9af932ec req-d1dcf5b1-1d0d-4448-b484-87349014367e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:40.132881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e281626c-cf3c-49a5-83fc-3a3c9af932ec req-d1dcf5b1-1d0d-4448-b484-87349014367e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:40.151813 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-e281626c-cf3c-49a5-83fc-3a3c9af932ec req-d1dcf5b1-1d0d-4448-b484-87349014367e service nova] Creating event network-vif-deleted:5a9cbab0-94b4-4948-a2da-c29b923b64da for instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a on n-h1-862964-3 Oct 29 01:44:40.161054 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-e281626c-cf3c-49a5-83fc-3a3c9af932ec req-d1dcf5b1-1d0d-4448-b484-87349014367e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058102 Oct 29 01:44:40.166146 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3341/6897] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:44:40.389814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-49d5a249-494e-48bb-8bf4-d630dff4dd87 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:40.390858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-49d5a249-494e-48bb-8bf4-d630dff4dd87 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] [instance: e333fe7e-b42e-4135-900a-1c977f223617] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:40.414363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49d5a249-494e-48bb-8bf4-d630dff4dd87 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:40.416371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49d5a249-494e-48bb-8bf4-d630dff4dd87 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:40.418202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49d5a249-494e-48bb-8bf4-d630dff4dd87 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:40.424353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49d5a249-494e-48bb-8bf4-d630dff4dd87 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:40.424953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49d5a249-494e-48bb-8bf4-d630dff4dd87 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:40.425902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49d5a249-494e-48bb-8bf4-d630dff4dd87 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:40.514126 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-49d5a249-494e-48bb-8bf4-d630dff4dd87 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] HTTP exception thrown: Instance e333fe7e-b42e-4135-900a-1c977f223617 could not be found. Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-49d5a249-494e-48bb-8bf4-d630dff4dd87 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Request method failure captured: Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 HTTP/1.1 Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIQsVu2mso_3kv_o0mGADjWM2Bg1UuEqJVFu774uKP2WdC0nr-Np0zE08G54LAEaqvux0Aas8l9DeXQZAAj7XDW-kDA8BmUR5dn2ryhzAECpHLeKUuKN3aTegfCoeWIUqIJV7FrqkONpr-52FX-UQZ_7rv3Eai6qrJuam-lgP5A58RY Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: e1817f6a3cd04ebbaa07dd63934d2771 Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-TestNetworkBasicOps-1986281729 Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1817f6a3cd04ebbaa07dd63934d2771"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e1817f6a3cd04ebbaa07dd63934d2771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e1817f6a3cd04ebbaa07dd63934d2771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e1817f6a3cd04ebbaa07dd63934d2771", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-TestNetworkBasicOps-1986281729 Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: e1817f6a3cd04ebbaa07dd63934d2771 Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-TestNetworkBasicOps-1986281729 Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-TestNetworkBasicOps-1986281729-project Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: ab773592a5914fcda533047d8044c3dc Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-TestNetworkBasicOps-1986281729-project Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance e333fe7e-b42e-4135-900a-1c977f223617 could not be found. Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'e333fe7e-b42e-4135-900a-1c977f223617'} Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e333fe7e-b42e-4135-900a-1c977f223617 could not be found. Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e333fe7e-b42e-4135-900a-1c977f223617 could not be found. Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:40.518243 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:40.526929 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:40.526929 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:40.526929 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:40.526929 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:44:40.526929 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:44:40.526929 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e333fe7e-b42e-4135-900a-1c977f223617 could not be found. Oct 29 01:44:40.526929 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:40.529806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-49d5a249-494e-48bb-8bf4-d630dff4dd87 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Returning 404 to user: Instance e333fe7e-b42e-4135-900a-1c977f223617 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:44:40.530987 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-49d5a249-494e-48bb-8bf4-d630dff4dd87 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617" status: 404 len: 111 microversion: 2.1 time: 0.145573 Oct 29 01:44:40.531593 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3557/6898] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:40 2022] GET /compute/v2.1/servers/e333fe7e-b42e-4135-900a-1c977f223617 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:44:40.853899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ac14a966-5c78-4ac2-b783-9318cd59639d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:40.855304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ac14a966-5c78-4ac2-b783-9318cd59639d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:41.011645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ac14a966-5c78-4ac2-b783-9318cd59639d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:41.021674 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ac14a966-5c78-4ac2-b783-9318cd59639d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1267 microversion: 2.1 time: 0.175883 Oct 29 01:44:41.034111 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3342/6899] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:40 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:41.060304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-29570e36-e1dd-4d65-bf76-56be592e0381 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:41.064933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-29570e36-e1dd-4d65-bf76-56be592e0381 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] [instance: 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:41.096163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29570e36-e1dd-4d65-bf76-56be592e0381 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:41.099847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b3749c95-3205-4bac-965b-5dda40aeaec8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] Calling method '.version_select at 0x7f9d9693b040>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:41.103561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29570e36-e1dd-4d65-bf76-56be592e0381 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:41.112827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29570e36-e1dd-4d65-bf76-56be592e0381 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:41.112827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29570e36-e1dd-4d65-bf76-56be592e0381 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:41.112827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29570e36-e1dd-4d65-bf76-56be592e0381 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:41.112827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-29570e36-e1dd-4d65-bf76-56be592e0381 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:41.183200 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-29570e36-e1dd-4d65-bf76-56be592e0381 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] HTTP exception thrown: Instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a could not be found. Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-29570e36-e1dd-4d65-bf76-56be592e0381 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Request method failure captured: Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a HTTP/1.1 Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIL7S5xF4168RL6JoFuUbcH6-3DDmyiCJ6R7rm4bgk2fiKECHpPWIxe8Sb6KFLzfaouBeUBjfCfEFAi0SDZDaQE_pKK3AEydGMSkKrcyZ-fr5rCFaKW-2JEPVH3EUDBGDA-y9zSVdN55YxOgNS3JW2ZCCkwPgvfmgUCIRXp7mDkobAQ Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 238c2e0d9e0b48198767a357cff1a442 Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerActionsTestJSON-45025787 Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/238c2e0d9e0b48198767a357cff1a442"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/238c2e0d9e0b48198767a357cff1a442"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/238c2e0d9e0b48198767a357cff1a442"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_238c2e0d9e0b48198767a357cff1a442", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerActionsTestJSON-45025787 Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 238c2e0d9e0b48198767a357cff1a442 Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerActionsTestJSON-45025787 Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerActionsTestJSON-45025787-project Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 9c097ba205f6453ba793dfb1d1876f3e Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerActionsTestJSON-45025787-project Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a could not be found. Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a'} Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a could not be found. Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a could not be found. Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:44:41.185644 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:41.191598 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:44:41.191598 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:44:41.191598 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:44:41.191598 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:44:41.191598 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:44:41.191598 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a could not be found. Oct 29 01:44:41.191598 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:44:41.204660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-29570e36-e1dd-4d65-bf76-56be592e0381 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Returning 404 to user: Instance 6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:44:41.206681 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-29570e36-e1dd-4d65-bf76-56be592e0381 tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a" status: 404 len: 111 microversion: 2.1 time: 0.150488 Oct 29 01:44:41.210332 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3558/6900] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:41 2022] GET /compute/v2.1/servers/6be2f3d5-86d9-47fb-aa4e-5ea88f748f7a => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:44:41.226898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d2679c7f-2368-416e-8e85-c65fa28c84ae tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] Calling method '.version_select at 0x7f9d9feeaca0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:41.280092 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b3749c95-3205-4bac-965b-5dda40aeaec8 tempest-TestNetworkBasicOps-1986281729 tempest-TestNetworkBasicOps-1986281729-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-988473739" status: 202 len: 0 microversion: 2.1 time: 0.188197 Oct 29 01:44:41.292918 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3343/6901] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Oct 29 01:44:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-988473739 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:44:41.420337 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d2679c7f-2368-416e-8e85-c65fa28c84ae tempest-ServerActionsTestJSON-45025787 tempest-ServerActionsTestJSON-45025787-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-789054541" status: 202 len: 0 microversion: 2.1 time: 0.200212 Oct 29 01:44:41.420337 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3559/6902] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 29 01:44:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-789054541 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:44:42.051161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-74d9c45c-dc57-472d-a9a6-69d9d5b5c410 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:42.055964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-74d9c45c-dc57-472d-a9a6-69d9d5b5c410 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:42.075019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-74d9c45c-dc57-472d-a9a6-69d9d5b5c410 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:42.082422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-74d9c45c-dc57-472d-a9a6-69d9d5b5c410 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:42.087224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-74d9c45c-dc57-472d-a9a6-69d9d5b5c410 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:42.088496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-74d9c45c-dc57-472d-a9a6-69d9d5b5c410 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:42.089996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-74d9c45c-dc57-472d-a9a6-69d9d5b5c410 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:42.093951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-74d9c45c-dc57-472d-a9a6-69d9d5b5c410 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:42.337252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-74d9c45c-dc57-472d-a9a6-69d9d5b5c410 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:42.376682 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-74d9c45c-dc57-472d-a9a6-69d9d5b5c410 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1263 microversion: 2.1 time: 0.330503 Oct 29 01:44:42.379643 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3344/6903] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:42 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1263 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:43.403960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-51d08e74-2d08-494f-83f8-62d5cc0ac4cc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:43.405198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-51d08e74-2d08-494f-83f8-62d5cc0ac4cc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:43.425587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51d08e74-2d08-494f-83f8-62d5cc0ac4cc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:43.426428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51d08e74-2d08-494f-83f8-62d5cc0ac4cc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:43.427048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51d08e74-2d08-494f-83f8-62d5cc0ac4cc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:43.432086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51d08e74-2d08-494f-83f8-62d5cc0ac4cc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:43.432758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51d08e74-2d08-494f-83f8-62d5cc0ac4cc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:43.433538 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-51d08e74-2d08-494f-83f8-62d5cc0ac4cc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:43.899621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-51d08e74-2d08-494f-83f8-62d5cc0ac4cc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:43.912402 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-51d08e74-2d08-494f-83f8-62d5cc0ac4cc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1327 microversion: 2.1 time: 0.511058 Oct 29 01:44:43.934811 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3560/6904] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:43 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1327 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:44.940712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e7a7e94d-df88-48b3-8255-daea6287aec6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:44.941467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e7a7e94d-df88-48b3-8255-daea6287aec6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:44.952162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7a7e94d-df88-48b3-8255-daea6287aec6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:44.952884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7a7e94d-df88-48b3-8255-daea6287aec6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:44.953361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7a7e94d-df88-48b3-8255-daea6287aec6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:44.958143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7a7e94d-df88-48b3-8255-daea6287aec6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:44.961431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7a7e94d-df88-48b3-8255-daea6287aec6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:44.962087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e7a7e94d-df88-48b3-8255-daea6287aec6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:45.211994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e7a7e94d-df88-48b3-8255-daea6287aec6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:45.229213 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e7a7e94d-df88-48b3-8255-daea6287aec6 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1325 microversion: 2.1 time: 0.288814 Oct 29 01:44:45.234029 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3345/6905] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:44 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1325 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:46.260341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-072dba1c-385f-4648-8249-9f029daf3535 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:46.260955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-072dba1c-385f-4648-8249-9f029daf3535 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:46.275220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-072dba1c-385f-4648-8249-9f029daf3535 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:46.275640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-072dba1c-385f-4648-8249-9f029daf3535 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:46.276271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-072dba1c-385f-4648-8249-9f029daf3535 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:46.277132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-072dba1c-385f-4648-8249-9f029daf3535 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:46.277775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-072dba1c-385f-4648-8249-9f029daf3535 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:46.278345 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-072dba1c-385f-4648-8249-9f029daf3535 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:46.330079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:44:46.659731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-072dba1c-385f-4648-8249-9f029daf3535 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:46.677371 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-072dba1c-385f-4648-8249-9f029daf3535 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1325 microversion: 2.1 time: 0.420817 Oct 29 01:44:46.677980 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3561/6906] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:46 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1325 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:47.713654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a3c423de-0d14-4742-a8cd-47004974b61b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:47.714271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a3c423de-0d14-4742-a8cd-47004974b61b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:47.717524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:44:47.737303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3c423de-0d14-4742-a8cd-47004974b61b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:47.737900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3c423de-0d14-4742-a8cd-47004974b61b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:47.738352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3c423de-0d14-4742-a8cd-47004974b61b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:47.742186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3c423de-0d14-4742-a8cd-47004974b61b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:47.745144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3c423de-0d14-4742-a8cd-47004974b61b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:47.747083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3c423de-0d14-4742-a8cd-47004974b61b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:48.232541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3a5072a6-608e-486c-83e4-6f84db70e6e4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:48.241653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a5072a6-608e-486c-83e4-6f84db70e6e4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:48.242312 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a5072a6-608e-486c-83e4-6f84db70e6e4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:48.251959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a5072a6-608e-486c-83e4-6f84db70e6e4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:48.251959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a5072a6-608e-486c-83e4-6f84db70e6e4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:48.251959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a5072a6-608e-486c-83e4-6f84db70e6e4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:48.251959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3a5072a6-608e-486c-83e4-6f84db70e6e4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:48.291526 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3a5072a6-608e-486c-83e4-6f84db70e6e4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.375041 Oct 29 01:44:48.293423 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3562/6907] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Oct 29 01:44:47 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:44:48.395060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a3c423de-0d14-4742-a8cd-47004974b61b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:48.410101 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a3c423de-0d14-4742-a8cd-47004974b61b tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1393 microversion: 2.1 time: 0.698866 Oct 29 01:44:48.415987 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3346/6908] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:47 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1393 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:48.466980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-58cd84bf-0927-4481-8400-6c8fe6d358d9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1069224405", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "availability_zone": "nova:n-h1-862964-3", "networks": [{"uuid": "65c4daac-3fe2-4754-8e2b-5a085d320c1e"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:48.561927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-58cd84bf-0927-4481-8400-6c8fe6d358d9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] validate_networks() for [('65c4daac-3fe2-4754-8e2b-5a085d320c1e', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:44:49.443913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e381df58-51ff-48cc-88fe-ede85e02608d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:49.445919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e381df58-51ff-48cc-88fe-ede85e02608d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:49.465064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:44:49.469050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e381df58-51ff-48cc-88fe-ede85e02608d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:49.470251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e381df58-51ff-48cc-88fe-ede85e02608d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:49.471689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e381df58-51ff-48cc-88fe-ede85e02608d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:49.472673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e381df58-51ff-48cc-88fe-ede85e02608d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:49.473355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e381df58-51ff-48cc-88fe-ede85e02608d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:49.477764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e381df58-51ff-48cc-88fe-ede85e02608d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:51.017604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=10 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:44:51.089390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e381df58-51ff-48cc-88fe-ede85e02608d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:51.104237 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e381df58-51ff-48cc-88fe-ede85e02608d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1393 microversion: 2.1 time: 1.665520 Oct 29 01:44:51.104926 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3347/6909] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:49 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1393 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:51.270853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-58cd84bf-0927-4481-8400-6c8fe6d358d9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:44:51.270853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-58cd84bf-0927-4481-8400-6c8fe6d358d9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:44:51.270853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-58cd84bf-0927-4481-8400-6c8fe6d358d9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:44:51.270853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-58cd84bf-0927-4481-8400-6c8fe6d358d9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:44:51.270853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-58cd84bf-0927-4481-8400-6c8fe6d358d9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:44:51.295950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58cd84bf-0927-4481-8400-6c8fe6d358d9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:51.296805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58cd84bf-0927-4481-8400-6c8fe6d358d9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:51.298726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58cd84bf-0927-4481-8400-6c8fe6d358d9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:51.301257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58cd84bf-0927-4481-8400-6c8fe6d358d9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:51.302210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58cd84bf-0927-4481-8400-6c8fe6d358d9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:51.302909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-58cd84bf-0927-4481-8400-6c8fe6d358d9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:51.370327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-58cd84bf-0927-4481-8400-6c8fe6d358d9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Getting quotas for project d2d4825b0688430192af39abe94de27d. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:44:51.381229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-58cd84bf-0927-4481-8400-6c8fe6d358d9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Getting quotas for user e5ffc7c6dd3d4f90967076b917a959e1 and project d2d4825b0688430192af39abe94de27d. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:44:51.422020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-58cd84bf-0927-4481-8400-6c8fe6d358d9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:44:51.425633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-58cd84bf-0927-4481-8400-6c8fe6d358d9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:44:51.608975 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-58cd84bf-0927-4481-8400-6c8fe6d358d9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.145271 Oct 29 01:44:51.612023 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3563/6910] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:44:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:44:51.621566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7e3262d9-90bf-410c-848c-364543af98ee tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:51.622331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7e3262d9-90bf-410c-848c-364543af98ee tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:51.994235 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7e3262d9-90bf-410c-848c-364543af98ee tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1329 microversion: 2.1 time: 0.376898 Oct 29 01:44:52.018379 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3348/6911] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:51 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1329 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:52.154573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-43c586dd-f904-4526-be44-8ab0b7bc6c3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:52.159331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-43c586dd-f904-4526-be44-8ab0b7bc6c3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:52.187227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43c586dd-f904-4526-be44-8ab0b7bc6c3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:52.188857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43c586dd-f904-4526-be44-8ab0b7bc6c3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:52.194321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43c586dd-f904-4526-be44-8ab0b7bc6c3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:52.199606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43c586dd-f904-4526-be44-8ab0b7bc6c3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:52.201775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43c586dd-f904-4526-be44-8ab0b7bc6c3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:52.207034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43c586dd-f904-4526-be44-8ab0b7bc6c3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:52.694687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-43c586dd-f904-4526-be44-8ab0b7bc6c3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:52.704335 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-43c586dd-f904-4526-be44-8ab0b7bc6c3d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1393 microversion: 2.1 time: 0.564773 Oct 29 01:44:52.704937 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3564/6912] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:52 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1393 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:53.083527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-150f459b-587d-4685-91c1-f8316e90d3a9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:53.084171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-150f459b-587d-4685-91c1-f8316e90d3a9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:53.368538 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-150f459b-587d-4685-91c1-f8316e90d3a9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1329 microversion: 2.1 time: 0.323086 Oct 29 01:44:53.371546 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3349/6913] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:53 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1329 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:53.698460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-84028ead-05dc-46f8-927b-f40f317a3b80 req-0450d006-52df-4c6f-984b-9d00633fe38f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9fdb471-31f0-4205-b0ce-a0296c7ca672", "tag": "d75377b7-049b-4dfd-80a5-5b02950d2cf5"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:44:53.728007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:44:53.730282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-84028ead-05dc-46f8-927b-f40f317a3b80 req-0450d006-52df-4c6f-984b-9d00633fe38f service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:53.731172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-84028ead-05dc-46f8-927b-f40f317a3b80 req-0450d006-52df-4c6f-984b-9d00633fe38f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:53.731778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-84028ead-05dc-46f8-927b-f40f317a3b80 req-0450d006-52df-4c6f-984b-9d00633fe38f service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:53.734596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-190a3799-672b-48dc-9689-2897994e058e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:53.735488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-190a3799-672b-48dc-9689-2897994e058e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:53.749824 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-84028ead-05dc-46f8-927b-f40f317a3b80 req-0450d006-52df-4c6f-984b-9d00633fe38f service nova] Creating event network-changed:d75377b7-049b-4dfd-80a5-5b02950d2cf5 for instance a9fdb471-31f0-4205-b0ce-a0296c7ca672 on n-h1-862964-3 Oct 29 01:44:53.758858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-190a3799-672b-48dc-9689-2897994e058e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:53.760813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-190a3799-672b-48dc-9689-2897994e058e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:53.765248 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-190a3799-672b-48dc-9689-2897994e058e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:53.766272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-190a3799-672b-48dc-9689-2897994e058e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:53.770975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-190a3799-672b-48dc-9689-2897994e058e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:53.771852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-190a3799-672b-48dc-9689-2897994e058e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:53.772944 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-84028ead-05dc-46f8-927b-f40f317a3b80 req-0450d006-52df-4c6f-984b-9d00633fe38f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079852 Oct 29 01:44:53.774007 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3565/6914] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:44:54.400616 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d9b84d33-57c3-4362-887e-72c2e2ff747b tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:54.401745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d9b84d33-57c3-4362-887e-72c2e2ff747b tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:54.418677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9b84d33-57c3-4362-887e-72c2e2ff747b tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:54.419157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9b84d33-57c3-4362-887e-72c2e2ff747b tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:54.427008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9b84d33-57c3-4362-887e-72c2e2ff747b tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:54.428092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9b84d33-57c3-4362-887e-72c2e2ff747b tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:54.428984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9b84d33-57c3-4362-887e-72c2e2ff747b tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:54.435275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9b84d33-57c3-4362-887e-72c2e2ff747b tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:54.988413 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d9b84d33-57c3-4362-887e-72c2e2ff747b tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1346 microversion: 2.1 time: 0.593643 Oct 29 01:44:55.005623 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3566/6915] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:54 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1346 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:55.346416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-190a3799-672b-48dc-9689-2897994e058e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:55.383214 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-190a3799-672b-48dc-9689-2897994e058e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1393 microversion: 2.1 time: 1.643963 Oct 29 01:44:55.390337 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3350/6916] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:53 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1393 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:56.027422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bdcd53a4-e3a6-44ed-8be2-170a8f7679ad tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:56.028719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bdcd53a4-e3a6-44ed-8be2-170a8f7679ad tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:56.042143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdcd53a4-e3a6-44ed-8be2-170a8f7679ad tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:56.043033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdcd53a4-e3a6-44ed-8be2-170a8f7679ad tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:56.043686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdcd53a4-e3a6-44ed-8be2-170a8f7679ad tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:56.047078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdcd53a4-e3a6-44ed-8be2-170a8f7679ad tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:56.047817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdcd53a4-e3a6-44ed-8be2-170a8f7679ad tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:56.048535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdcd53a4-e3a6-44ed-8be2-170a8f7679ad tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:56.233940 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bdcd53a4-e3a6-44ed-8be2-170a8f7679ad tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1416 microversion: 2.1 time: 0.209458 Oct 29 01:44:56.237405 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3567/6917] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:56 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1416 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:56.421222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-51ff05ed-7b64-447b-996f-03950fb98e01 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:56.421222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-51ff05ed-7b64-447b-996f-03950fb98e01 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:56.431144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51ff05ed-7b64-447b-996f-03950fb98e01 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:56.431831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51ff05ed-7b64-447b-996f-03950fb98e01 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:56.432506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51ff05ed-7b64-447b-996f-03950fb98e01 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:56.433467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51ff05ed-7b64-447b-996f-03950fb98e01 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:56.434086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51ff05ed-7b64-447b-996f-03950fb98e01 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:56.435319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51ff05ed-7b64-447b-996f-03950fb98e01 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:57.143169 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-51ff05ed-7b64-447b-996f-03950fb98e01 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:57.166366 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-51ff05ed-7b64-447b-996f-03950fb98e01 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1393 microversion: 2.1 time: 0.754767 Oct 29 01:44:57.167743 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3351/6918] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:56 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1393 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:57.266927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0639d1dd-9b3e-45da-ba9c-c8c6628d6544 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:57.268730 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0639d1dd-9b3e-45da-ba9c-c8c6628d6544 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:57.303187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0639d1dd-9b3e-45da-ba9c-c8c6628d6544 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:57.312067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0639d1dd-9b3e-45da-ba9c-c8c6628d6544 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:57.314076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0639d1dd-9b3e-45da-ba9c-c8c6628d6544 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:57.317430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0639d1dd-9b3e-45da-ba9c-c8c6628d6544 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:57.326038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0639d1dd-9b3e-45da-ba9c-c8c6628d6544 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:57.326038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0639d1dd-9b3e-45da-ba9c-c8c6628d6544 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:57.416354 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0639d1dd-9b3e-45da-ba9c-c8c6628d6544 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1422 microversion: 2.1 time: 0.155145 Oct 29 01:44:57.425766 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3568/6919] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:57 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1422 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:58.195006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-90ed1575-b17d-49b8-afae-c40414ecb390 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:58.196161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-90ed1575-b17d-49b8-afae-c40414ecb390 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:58.206109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90ed1575-b17d-49b8-afae-c40414ecb390 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:58.207080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90ed1575-b17d-49b8-afae-c40414ecb390 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:58.207836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90ed1575-b17d-49b8-afae-c40414ecb390 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:58.217246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90ed1575-b17d-49b8-afae-c40414ecb390 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:58.221832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90ed1575-b17d-49b8-afae-c40414ecb390 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:58.233433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-90ed1575-b17d-49b8-afae-c40414ecb390 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:58.443543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3b731ad3-ef09-492a-ba3f-2dd98bb3c6ec tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:58.446210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3b731ad3-ef09-492a-ba3f-2dd98bb3c6ec tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:58.456692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b731ad3-ef09-492a-ba3f-2dd98bb3c6ec tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:58.462631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b731ad3-ef09-492a-ba3f-2dd98bb3c6ec tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:58.463375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b731ad3-ef09-492a-ba3f-2dd98bb3c6ec tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:58.464282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b731ad3-ef09-492a-ba3f-2dd98bb3c6ec tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:58.464917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b731ad3-ef09-492a-ba3f-2dd98bb3c6ec tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:58.471784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b731ad3-ef09-492a-ba3f-2dd98bb3c6ec tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:58.612792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-90ed1575-b17d-49b8-afae-c40414ecb390 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:44:58.633218 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-90ed1575-b17d-49b8-afae-c40414ecb390 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1393 microversion: 2.1 time: 0.444813 Oct 29 01:44:58.636583 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3352/6920] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:58 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1393 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:44:58.693916 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3b731ad3-ef09-492a-ba3f-2dd98bb3c6ec tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1464 microversion: 2.1 time: 0.253160 Oct 29 01:44:58.710572 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3569/6921] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:58 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1464 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:44:59.690921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5720a579-39ed-439d-b58a-be841c4d53c9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:59.696604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5720a579-39ed-439d-b58a-be841c4d53c9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:59.720855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9ef798b2-fe6a-4a0a-8b8f-a31c78b65c52 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:44:59.722409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9ef798b2-fe6a-4a0a-8b8f-a31c78b65c52 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:44:59.741849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ef798b2-fe6a-4a0a-8b8f-a31c78b65c52 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:59.741849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ef798b2-fe6a-4a0a-8b8f-a31c78b65c52 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:59.741849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ef798b2-fe6a-4a0a-8b8f-a31c78b65c52 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:59.741849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ef798b2-fe6a-4a0a-8b8f-a31c78b65c52 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:59.741849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ef798b2-fe6a-4a0a-8b8f-a31c78b65c52 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:59.741849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ef798b2-fe6a-4a0a-8b8f-a31c78b65c52 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:59.744171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5720a579-39ed-439d-b58a-be841c4d53c9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:59.744690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5720a579-39ed-439d-b58a-be841c4d53c9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:59.745137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5720a579-39ed-439d-b58a-be841c4d53c9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:44:59.745880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5720a579-39ed-439d-b58a-be841c4d53c9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:44:59.746345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5720a579-39ed-439d-b58a-be841c4d53c9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:44:59.746774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5720a579-39ed-439d-b58a-be841c4d53c9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:00.112610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5720a579-39ed-439d-b58a-be841c4d53c9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:00.137596 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5720a579-39ed-439d-b58a-be841c4d53c9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1393 microversion: 2.1 time: 0.477384 Oct 29 01:45:00.159494 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3353/6922] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:59 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1393 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:45:00.161656 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9ef798b2-fe6a-4a0a-8b8f-a31c78b65c52 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1464 microversion: 2.1 time: 0.444314 Oct 29 01:45:00.181829 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3570/6923] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:44:59 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1464 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:01.176063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b2c115c9-ccea-480f-9efa-353e84acad19 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:01.176585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b2c115c9-ccea-480f-9efa-353e84acad19 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:01.194858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2c115c9-ccea-480f-9efa-353e84acad19 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:01.194858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2c115c9-ccea-480f-9efa-353e84acad19 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:01.194858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2c115c9-ccea-480f-9efa-353e84acad19 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:01.194858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2c115c9-ccea-480f-9efa-353e84acad19 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:01.194858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2c115c9-ccea-480f-9efa-353e84acad19 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:01.195706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b2c115c9-ccea-480f-9efa-353e84acad19 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:01.213362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-db582acd-528a-48ec-8b20-77d564cb3b85 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:01.215664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-db582acd-528a-48ec-8b20-77d564cb3b85 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:01.225268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db582acd-528a-48ec-8b20-77d564cb3b85 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:01.226135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db582acd-528a-48ec-8b20-77d564cb3b85 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:01.226739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db582acd-528a-48ec-8b20-77d564cb3b85 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:01.227621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db582acd-528a-48ec-8b20-77d564cb3b85 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:01.228589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db582acd-528a-48ec-8b20-77d564cb3b85 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:01.229208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db582acd-528a-48ec-8b20-77d564cb3b85 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:01.337418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:01.407262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:01.464758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b2c115c9-ccea-480f-9efa-353e84acad19 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:01.476278 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b2c115c9-ccea-480f-9efa-353e84acad19 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1393 microversion: 2.1 time: 0.304517 Oct 29 01:45:01.490834 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3354/6924] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:01 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1393 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:01.550312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-3e4ba77a-31dc-410a-90e3-fbf59eb4e8f0 req-c5f0c41e-818d-4067-971f-e7034a5378c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19086576-f662-4bd2-bf34-222c9b4669ac", "tag": "9bbb7a5b-b7e3-4bae-ac99-9d5fbc06c2d7"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:45:01.564937 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-db582acd-528a-48ec-8b20-77d564cb3b85 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1464 microversion: 2.1 time: 0.352873 Oct 29 01:45:01.566784 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3571/6925] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:01 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1464 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:01.585765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3e4ba77a-31dc-410a-90e3-fbf59eb4e8f0 req-c5f0c41e-818d-4067-971f-e7034a5378c9 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:01.586964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3e4ba77a-31dc-410a-90e3-fbf59eb4e8f0 req-c5f0c41e-818d-4067-971f-e7034a5378c9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:01.587777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3e4ba77a-31dc-410a-90e3-fbf59eb4e8f0 req-c5f0c41e-818d-4067-971f-e7034a5378c9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:01.619777 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-3e4ba77a-31dc-410a-90e3-fbf59eb4e8f0 req-c5f0c41e-818d-4067-971f-e7034a5378c9 service nova] Creating event network-changed:9bbb7a5b-b7e3-4bae-ac99-9d5fbc06c2d7 for instance 19086576-f662-4bd2-bf34-222c9b4669ac on n-h1-862964-3 Oct 29 01:45:01.629490 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-3e4ba77a-31dc-410a-90e3-fbf59eb4e8f0 req-c5f0c41e-818d-4067-971f-e7034a5378c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087334 Oct 29 01:45:01.631751 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3355/6926] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:45:02.506474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b94ced10-b41d-447a-a798-804ae254ddfc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:02.507103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b94ced10-b41d-447a-a798-804ae254ddfc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:02.528115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b94ced10-b41d-447a-a798-804ae254ddfc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:02.529820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b94ced10-b41d-447a-a798-804ae254ddfc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:02.533174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b94ced10-b41d-447a-a798-804ae254ddfc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:02.538424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b94ced10-b41d-447a-a798-804ae254ddfc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:02.539608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b94ced10-b41d-447a-a798-804ae254ddfc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:02.540422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b94ced10-b41d-447a-a798-804ae254ddfc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:02.566326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-13bb7ed4-c09c-4afe-908d-c40bf38e54fe req-8a03c880-7765-46b0-bbe7-93ab5d2d817a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9fdb471-31f0-4205-b0ce-a0296c7ca672", "name": "network-vif-plugged", "status": "completed", "tag": "d75377b7-049b-4dfd-80a5-5b02950d2cf5"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:45:02.580775 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-13bb7ed4-c09c-4afe-908d-c40bf38e54fe req-8a03c880-7765-46b0-bbe7-93ab5d2d817a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:02.581567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-13bb7ed4-c09c-4afe-908d-c40bf38e54fe req-8a03c880-7765-46b0-bbe7-93ab5d2d817a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:02.582017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-13bb7ed4-c09c-4afe-908d-c40bf38e54fe req-8a03c880-7765-46b0-bbe7-93ab5d2d817a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:02.613505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=84 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:02.620386 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-13bb7ed4-c09c-4afe-908d-c40bf38e54fe req-8a03c880-7765-46b0-bbe7-93ab5d2d817a service nova] Creating event network-vif-plugged:d75377b7-049b-4dfd-80a5-5b02950d2cf5 for instance a9fdb471-31f0-4205-b0ce-a0296c7ca672 on n-h1-862964-3 Oct 29 01:45:02.657456 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-13bb7ed4-c09c-4afe-908d-c40bf38e54fe req-8a03c880-7765-46b0-bbe7-93ab5d2d817a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099124 Oct 29 01:45:02.660271 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3356/6927] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:45:02.674803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eb722d08-1c9b-47f1-8b0f-5cc853131ea2 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:02.675554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-eb722d08-1c9b-47f1-8b0f-5cc853131ea2 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:02.689695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb722d08-1c9b-47f1-8b0f-5cc853131ea2 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:02.690128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb722d08-1c9b-47f1-8b0f-5cc853131ea2 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:02.690586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb722d08-1c9b-47f1-8b0f-5cc853131ea2 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:02.695964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb722d08-1c9b-47f1-8b0f-5cc853131ea2 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:02.696462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb722d08-1c9b-47f1-8b0f-5cc853131ea2 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:02.696919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-eb722d08-1c9b-47f1-8b0f-5cc853131ea2 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:02.955576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b94ced10-b41d-447a-a798-804ae254ddfc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:02.980473 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b94ced10-b41d-447a-a798-804ae254ddfc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1393 microversion: 2.1 time: 0.477808 Oct 29 01:45:03.001248 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3572/6928] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:02 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1393 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:03.043161 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-eb722d08-1c9b-47f1-8b0f-5cc853131ea2 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1464 microversion: 2.1 time: 0.381436 Oct 29 01:45:03.044115 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3357/6929] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:02 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1464 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:04.013893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e9ddde20-49d5-4e51-bffe-088a1795e19e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:04.017739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e9ddde20-49d5-4e51-bffe-088a1795e19e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:04.035197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9ddde20-49d5-4e51-bffe-088a1795e19e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:04.035964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9ddde20-49d5-4e51-bffe-088a1795e19e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:04.037293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9ddde20-49d5-4e51-bffe-088a1795e19e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:04.038266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9ddde20-49d5-4e51-bffe-088a1795e19e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:04.039796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9ddde20-49d5-4e51-bffe-088a1795e19e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:04.040630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9ddde20-49d5-4e51-bffe-088a1795e19e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:04.070362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5055e058-c3a7-474b-9250-60a5712aa342 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:04.071543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5055e058-c3a7-474b-9250-60a5712aa342 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:04.079874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=4 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:04.083600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5055e058-c3a7-474b-9250-60a5712aa342 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:04.084479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5055e058-c3a7-474b-9250-60a5712aa342 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:04.085117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5055e058-c3a7-474b-9250-60a5712aa342 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:04.086166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5055e058-c3a7-474b-9250-60a5712aa342 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:04.091804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5055e058-c3a7-474b-9250-60a5712aa342 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:04.091804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5055e058-c3a7-474b-9250-60a5712aa342 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:04.397469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e9ddde20-49d5-4e51-bffe-088a1795e19e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:04.405903 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e9ddde20-49d5-4e51-bffe-088a1795e19e tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1393 microversion: 2.1 time: 0.399856 Oct 29 01:45:04.406490 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3573/6930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:04 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1393 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:04.470228 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5055e058-c3a7-474b-9250-60a5712aa342 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1464 microversion: 2.1 time: 0.404712 Oct 29 01:45:04.472014 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3358/6931] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:04 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1464 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:05.434024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-888ebe37-97e7-4acf-8cb9-2d95fe49888d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:05.435556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-888ebe37-97e7-4acf-8cb9-2d95fe49888d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:05.453975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-888ebe37-97e7-4acf-8cb9-2d95fe49888d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:05.454645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-888ebe37-97e7-4acf-8cb9-2d95fe49888d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:05.455169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-888ebe37-97e7-4acf-8cb9-2d95fe49888d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:05.456111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-888ebe37-97e7-4acf-8cb9-2d95fe49888d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:05.456646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-888ebe37-97e7-4acf-8cb9-2d95fe49888d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:05.457383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-888ebe37-97e7-4acf-8cb9-2d95fe49888d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:05.497958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a7c4ee46-09c0-4355-bab6-ca93524e3b49 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:05.499288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a7c4ee46-09c0-4355-bab6-ca93524e3b49 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:05.520421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7c4ee46-09c0-4355-bab6-ca93524e3b49 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:05.521461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7c4ee46-09c0-4355-bab6-ca93524e3b49 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:05.522111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7c4ee46-09c0-4355-bab6-ca93524e3b49 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:05.523029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7c4ee46-09c0-4355-bab6-ca93524e3b49 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:05.523661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7c4ee46-09c0-4355-bab6-ca93524e3b49 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:05.547876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a7c4ee46-09c0-4355-bab6-ca93524e3b49 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:05.811664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-888ebe37-97e7-4acf-8cb9-2d95fe49888d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:05.812903 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-888ebe37-97e7-4acf-8cb9-2d95fe49888d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1393 microversion: 2.1 time: 0.384452 Oct 29 01:45:05.816339 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3574/6932] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:05 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1393 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:05.917486 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a7c4ee46-09c0-4355-bab6-ca93524e3b49 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1464 microversion: 2.1 time: 0.424814 Oct 29 01:45:05.920704 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3359/6933] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:05 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1464 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:06.847950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d90a2d6a-2db5-4a49-8ada-6a6fba5462da tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:06.856930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d90a2d6a-2db5-4a49-8ada-6a6fba5462da tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:06.882596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d90a2d6a-2db5-4a49-8ada-6a6fba5462da tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:06.885004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d90a2d6a-2db5-4a49-8ada-6a6fba5462da tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:06.885756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d90a2d6a-2db5-4a49-8ada-6a6fba5462da tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:06.887464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d90a2d6a-2db5-4a49-8ada-6a6fba5462da tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:06.888503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d90a2d6a-2db5-4a49-8ada-6a6fba5462da tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:06.890228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d90a2d6a-2db5-4a49-8ada-6a6fba5462da tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:06.950045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-616bd988-9e6c-4cf9-93ed-ed012453368a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:06.951540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-616bd988-9e6c-4cf9-93ed-ed012453368a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:06.978184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-616bd988-9e6c-4cf9-93ed-ed012453368a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:06.981939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-616bd988-9e6c-4cf9-93ed-ed012453368a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:06.986170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-616bd988-9e6c-4cf9-93ed-ed012453368a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:06.990556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-616bd988-9e6c-4cf9-93ed-ed012453368a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:06.993021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-616bd988-9e6c-4cf9-93ed-ed012453368a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:06.993872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-616bd988-9e6c-4cf9-93ed-ed012453368a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:07.252499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d90a2d6a-2db5-4a49-8ada-6a6fba5462da tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:07.287383 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d90a2d6a-2db5-4a49-8ada-6a6fba5462da tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1565 microversion: 2.1 time: 0.443639 Oct 29 01:45:07.308667 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3575/6934] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:06 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1565 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:07.330875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0a8f4e08-1e3a-40d3-adaf-dbb7ffbdc187 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:07.331948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0a8f4e08-1e3a-40d3-adaf-dbb7ffbdc187 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:07.341307 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a8f4e08-1e3a-40d3-adaf-dbb7ffbdc187 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:07.342222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a8f4e08-1e3a-40d3-adaf-dbb7ffbdc187 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:07.343338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a8f4e08-1e3a-40d3-adaf-dbb7ffbdc187 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:07.344247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a8f4e08-1e3a-40d3-adaf-dbb7ffbdc187 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:07.344876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a8f4e08-1e3a-40d3-adaf-dbb7ffbdc187 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:07.345523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0a8f4e08-1e3a-40d3-adaf-dbb7ffbdc187 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:07.367191 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-616bd988-9e6c-4cf9-93ed-ed012453368a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1464 microversion: 2.1 time: 0.410048 Oct 29 01:45:07.370220 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3360/6935] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:06 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1464 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:45:07.945265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0a8f4e08-1e3a-40d3-adaf-dbb7ffbdc187 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:08.008610 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0a8f4e08-1e3a-40d3-adaf-dbb7ffbdc187 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1565 microversion: 2.1 time: 0.669795 Oct 29 01:45:08.013773 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3576/6936] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:07 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1565 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:08.397657 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-88b240e3-0be0-4d95-8334-f050fe6cdeb6 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:08.399125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-88b240e3-0be0-4d95-8334-f050fe6cdeb6 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:08.416688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88b240e3-0be0-4d95-8334-f050fe6cdeb6 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:08.417260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88b240e3-0be0-4d95-8334-f050fe6cdeb6 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:08.425141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88b240e3-0be0-4d95-8334-f050fe6cdeb6 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:08.425141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88b240e3-0be0-4d95-8334-f050fe6cdeb6 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:08.425141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88b240e3-0be0-4d95-8334-f050fe6cdeb6 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:08.425141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-88b240e3-0be0-4d95-8334-f050fe6cdeb6 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:08.865761 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-88b240e3-0be0-4d95-8334-f050fe6cdeb6 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1464 microversion: 2.1 time: 0.472164 Oct 29 01:45:08.879343 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3361/6937] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:08 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1464 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:09.909534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5b8b40b1-1121-4552-9f0a-ed0c732cb855 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:09.912438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5b8b40b1-1121-4552-9f0a-ed0c732cb855 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:09.939249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b8b40b1-1121-4552-9f0a-ed0c732cb855 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:09.942487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b8b40b1-1121-4552-9f0a-ed0c732cb855 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:09.943129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b8b40b1-1121-4552-9f0a-ed0c732cb855 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:09.944382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b8b40b1-1121-4552-9f0a-ed0c732cb855 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:09.947033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b8b40b1-1121-4552-9f0a-ed0c732cb855 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:09.947563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5b8b40b1-1121-4552-9f0a-ed0c732cb855 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:10.632781 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5b8b40b1-1121-4552-9f0a-ed0c732cb855 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1464 microversion: 2.1 time: 0.729224 Oct 29 01:45:10.652597 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3577/6938] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:09 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1464 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:11.421791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-abd61b68-82d1-45ef-a7dc-64132fa5cea7 req-4023d7a2-1a93-49b1-a23e-65a9032d2369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19086576-f662-4bd2-bf34-222c9b4669ac", "name": "network-vif-plugged", "status": "completed", "tag": "9bbb7a5b-b7e3-4bae-ac99-9d5fbc06c2d7"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:45:11.433613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-abd61b68-82d1-45ef-a7dc-64132fa5cea7 req-4023d7a2-1a93-49b1-a23e-65a9032d2369 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:11.434457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-abd61b68-82d1-45ef-a7dc-64132fa5cea7 req-4023d7a2-1a93-49b1-a23e-65a9032d2369 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:11.435114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-abd61b68-82d1-45ef-a7dc-64132fa5cea7 req-4023d7a2-1a93-49b1-a23e-65a9032d2369 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:11.449821 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-abd61b68-82d1-45ef-a7dc-64132fa5cea7 req-4023d7a2-1a93-49b1-a23e-65a9032d2369 service nova] Creating event network-vif-plugged:9bbb7a5b-b7e3-4bae-ac99-9d5fbc06c2d7 for instance 19086576-f662-4bd2-bf34-222c9b4669ac on n-h1-862964-3 Oct 29 01:45:11.456623 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-abd61b68-82d1-45ef-a7dc-64132fa5cea7 req-4023d7a2-1a93-49b1-a23e-65a9032d2369 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038466 Oct 29 01:45:11.457966 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3362/6939] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:45:11.671697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0bbd5e4e-4f22-4281-8d07-d7199055f2e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:11.672395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0bbd5e4e-4f22-4281-8d07-d7199055f2e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:11.680422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0bbd5e4e-4f22-4281-8d07-d7199055f2e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:11.680960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0bbd5e4e-4f22-4281-8d07-d7199055f2e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:11.681612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0bbd5e4e-4f22-4281-8d07-d7199055f2e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:11.682502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0bbd5e4e-4f22-4281-8d07-d7199055f2e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:11.683008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0bbd5e4e-4f22-4281-8d07-d7199055f2e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:11.683589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0bbd5e4e-4f22-4281-8d07-d7199055f2e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:12.032031 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0bbd5e4e-4f22-4281-8d07-d7199055f2e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1464 microversion: 2.1 time: 0.367769 Oct 29 01:45:12.061493 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3578/6940] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:11 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1464 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:13.070607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-86cc143e-bb27-4fd7-b306-364c6e52bd4a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:13.071315 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-86cc143e-bb27-4fd7-b306-364c6e52bd4a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:13.113498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86cc143e-bb27-4fd7-b306-364c6e52bd4a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:13.114145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86cc143e-bb27-4fd7-b306-364c6e52bd4a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:13.114592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86cc143e-bb27-4fd7-b306-364c6e52bd4a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:13.118780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86cc143e-bb27-4fd7-b306-364c6e52bd4a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:13.119265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86cc143e-bb27-4fd7-b306-364c6e52bd4a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:13.119705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86cc143e-bb27-4fd7-b306-364c6e52bd4a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:13.601849 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-86cc143e-bb27-4fd7-b306-364c6e52bd4a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1464 microversion: 2.1 time: 0.537150 Oct 29 01:45:13.603473 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3363/6941] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:13 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1464 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:14.350719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-26fa0866-290b-4fbb-9bdb-f73f61ce859f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:14.351222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-26fa0866-290b-4fbb-9bdb-f73f61ce859f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:14.367115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26fa0866-290b-4fbb-9bdb-f73f61ce859f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:14.367729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26fa0866-290b-4fbb-9bdb-f73f61ce859f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:14.368264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26fa0866-290b-4fbb-9bdb-f73f61ce859f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:14.369390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26fa0866-290b-4fbb-9bdb-f73f61ce859f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:14.370070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26fa0866-290b-4fbb-9bdb-f73f61ce859f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:14.371118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26fa0866-290b-4fbb-9bdb-f73f61ce859f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:14.400881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-2d1ad13f-5552-4a8b-9153-8f36817070de req-c882e74f-ccdd-475c-9cab-7aa04b6086bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9fdb471-31f0-4205-b0ce-a0296c7ca672", "tag": "d75377b7-049b-4dfd-80a5-5b02950d2cf5"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:45:14.435578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2d1ad13f-5552-4a8b-9153-8f36817070de req-c882e74f-ccdd-475c-9cab-7aa04b6086bb service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:14.440329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2d1ad13f-5552-4a8b-9153-8f36817070de req-c882e74f-ccdd-475c-9cab-7aa04b6086bb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:14.441077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2d1ad13f-5552-4a8b-9153-8f36817070de req-c882e74f-ccdd-475c-9cab-7aa04b6086bb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:14.484273 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-2d1ad13f-5552-4a8b-9153-8f36817070de req-c882e74f-ccdd-475c-9cab-7aa04b6086bb service nova] Creating event network-changed:d75377b7-049b-4dfd-80a5-5b02950d2cf5 for instance a9fdb471-31f0-4205-b0ce-a0296c7ca672 on n-h1-862964-3 Oct 29 01:45:14.497884 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-2d1ad13f-5552-4a8b-9153-8f36817070de req-c882e74f-ccdd-475c-9cab-7aa04b6086bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105396 Oct 29 01:45:14.500506 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3364/6942] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:45:14.629474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-03de2cc3-d0fe-4e26-9211-8f92ec5f72fe tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:14.630242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-03de2cc3-d0fe-4e26-9211-8f92ec5f72fe tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:14.664093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03de2cc3-d0fe-4e26-9211-8f92ec5f72fe tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:14.669240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03de2cc3-d0fe-4e26-9211-8f92ec5f72fe tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:14.671559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03de2cc3-d0fe-4e26-9211-8f92ec5f72fe tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:14.673662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03de2cc3-d0fe-4e26-9211-8f92ec5f72fe tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:14.676201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03de2cc3-d0fe-4e26-9211-8f92ec5f72fe tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:14.676876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-03de2cc3-d0fe-4e26-9211-8f92ec5f72fe tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:14.816596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-26fa0866-290b-4fbb-9bdb-f73f61ce859f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:14.835585 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-26fa0866-290b-4fbb-9bdb-f73f61ce859f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1565 microversion: 2.1 time: 0.489197 Oct 29 01:45:14.853023 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3579/6943] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:14 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1565 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:15.244415 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-03de2cc3-d0fe-4e26-9211-8f92ec5f72fe tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1648 microversion: 2.1 time: 0.621176 Oct 29 01:45:15.258715 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3365/6944] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:14 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1648 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:45:15.291781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-62d9ef41-dd37-4e9c-865f-4e41d20d5c33 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:15.293040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-62d9ef41-dd37-4e9c-865f-4e41d20d5c33 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:15.309296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62d9ef41-dd37-4e9c-865f-4e41d20d5c33 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:15.309875 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62d9ef41-dd37-4e9c-865f-4e41d20d5c33 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:15.310326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62d9ef41-dd37-4e9c-865f-4e41d20d5c33 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:15.311662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62d9ef41-dd37-4e9c-865f-4e41d20d5c33 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:15.312270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62d9ef41-dd37-4e9c-865f-4e41d20d5c33 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:15.312964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-62d9ef41-dd37-4e9c-865f-4e41d20d5c33 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:15.337065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:15.957685 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-62d9ef41-dd37-4e9c-865f-4e41d20d5c33 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1648 microversion: 2.1 time: 0.671609 Oct 29 01:45:15.959744 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3580/6945] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:15 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1648 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:15.988470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-54300b55-ca44-433e-b41d-aeee9d0bd817 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:15.989003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-54300b55-ca44-433e-b41d-aeee9d0bd817 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:16.007282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54300b55-ca44-433e-b41d-aeee9d0bd817 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:16.007799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54300b55-ca44-433e-b41d-aeee9d0bd817 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:16.009397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54300b55-ca44-433e-b41d-aeee9d0bd817 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:16.010148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54300b55-ca44-433e-b41d-aeee9d0bd817 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:16.013361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54300b55-ca44-433e-b41d-aeee9d0bd817 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:16.013846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-54300b55-ca44-433e-b41d-aeee9d0bd817 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:16.535151 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-54300b55-ca44-433e-b41d-aeee9d0bd817 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1648 microversion: 2.1 time: 0.551496 Oct 29 01:45:16.537668 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3366/6946] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:15 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1648 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:16.766573 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c919d1e-5686-4d7c-809e-c1855673c718 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1656369978", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "availability_zone": "nova:n-h2-862964-3", "networks": [{"uuid": "65c4daac-3fe2-4754-8e2b-5a085d320c1e"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:45:16.814774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9b5c0c04-77ce-4b5e-96a2-925871ffb978 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1915525862", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "38d2ee1e-fb7b-4b0d-9648-40fdddc152a0"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:45:16.905883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-9c919d1e-5686-4d7c-809e-c1855673c718 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] validate_networks() for [('65c4daac-3fe2-4754-8e2b-5a085d320c1e', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:45:16.914758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-9b5c0c04-77ce-4b5e-96a2-925871ffb978 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] validate_networks() for [('38d2ee1e-fb7b-4b0d-9648-40fdddc152a0', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:45:17.882250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-9c919d1e-5686-4d7c-809e-c1855673c718 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:45:17.882834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-9c919d1e-5686-4d7c-809e-c1855673c718 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:45:17.887655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-9c919d1e-5686-4d7c-809e-c1855673c718 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:45:17.888103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-9c919d1e-5686-4d7c-809e-c1855673c718 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:45:17.888530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-9c919d1e-5686-4d7c-809e-c1855673c718 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:45:17.930765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c919d1e-5686-4d7c-809e-c1855673c718 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:17.931851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c919d1e-5686-4d7c-809e-c1855673c718 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:17.944971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c919d1e-5686-4d7c-809e-c1855673c718 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:17.946487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c919d1e-5686-4d7c-809e-c1855673c718 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:17.947145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c919d1e-5686-4d7c-809e-c1855673c718 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:17.947769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c919d1e-5686-4d7c-809e-c1855673c718 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:17.989166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9b5c0c04-77ce-4b5e-96a2-925871ffb978 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:45:17.990231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9b5c0c04-77ce-4b5e-96a2-925871ffb978 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:45:17.991176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9b5c0c04-77ce-4b5e-96a2-925871ffb978 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:45:17.992103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9b5c0c04-77ce-4b5e-96a2-925871ffb978 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:45:17.992896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9b5c0c04-77ce-4b5e-96a2-925871ffb978 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:45:18.002520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-9c919d1e-5686-4d7c-809e-c1855673c718 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Getting quotas for project d2d4825b0688430192af39abe94de27d. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:45:18.020106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b5c0c04-77ce-4b5e-96a2-925871ffb978 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:18.023748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b5c0c04-77ce-4b5e-96a2-925871ffb978 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:18.023748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b5c0c04-77ce-4b5e-96a2-925871ffb978 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:18.023748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b5c0c04-77ce-4b5e-96a2-925871ffb978 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:18.024257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b5c0c04-77ce-4b5e-96a2-925871ffb978 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:18.028206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9b5c0c04-77ce-4b5e-96a2-925871ffb978 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:18.037519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-9c919d1e-5686-4d7c-809e-c1855673c718 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Getting quotas for user e5ffc7c6dd3d4f90967076b917a959e1 and project d2d4825b0688430192af39abe94de27d. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:45:18.067393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-9b5c0c04-77ce-4b5e-96a2-925871ffb978 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Getting quotas for project 4c075d007b8249628a076224d1fcdc7d. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:45:18.089331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-9b5c0c04-77ce-4b5e-96a2-925871ffb978 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Getting quotas for user adf8274a2d4c4890a0c585f3b533757e and project 4c075d007b8249628a076224d1fcdc7d. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:45:18.115683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9c919d1e-5686-4d7c-809e-c1855673c718 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:45:18.118310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9c919d1e-5686-4d7c-809e-c1855673c718 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:45:18.120498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9b5c0c04-77ce-4b5e-96a2-925871ffb978 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:45:18.130191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9b5c0c04-77ce-4b5e-96a2-925871ffb978 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:45:18.326224 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9b5c0c04-77ce-4b5e-96a2-925871ffb978 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.759199 Oct 29 01:45:18.331250 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3581/6947] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:45:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:45:18.352071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cb6f2c56-2db0-47b3-9935-8de69d59b074 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:18.353288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cb6f2c56-2db0-47b3-9935-8de69d59b074 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:18.407300 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9c919d1e-5686-4d7c-809e-c1855673c718 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.644253 Oct 29 01:45:18.410973 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3367/6948] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:45:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:45:18.433238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-968f89b7-84bc-4f64-ba21-47d796c57f95 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:18.435379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-968f89b7-84bc-4f64-ba21-47d796c57f95 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:18.689703 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-968f89b7-84bc-4f64-ba21-47d796c57f95 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1329 microversion: 2.1 time: 0.265224 Oct 29 01:45:18.694073 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3368/6949] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:18 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1329 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:18.753993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cb6f2c56-2db0-47b3-9935-8de69d59b074 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:18.776382 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cb6f2c56-2db0-47b3-9935-8de69d59b074 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1217 microversion: 2.1 time: 0.435626 Oct 29 01:45:18.776382 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3582/6950] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:18 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1217 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:19.720790 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f3cb1c36-7a0c-4372-a086-b86c0307bbe9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:19.722382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f3cb1c36-7a0c-4372-a086-b86c0307bbe9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:19.725685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:19.830879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0dd49408-0874-4a12-a735-c0a01fb380f5 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:19.832230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0dd49408-0874-4a12-a735-c0a01fb380f5 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:19.864943 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f3cb1c36-7a0c-4372-a086-b86c0307bbe9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1329 microversion: 2.1 time: 0.148408 Oct 29 01:45:19.865773 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3369/6951] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:19 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1329 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:45:19.946318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0dd49408-0874-4a12-a735-c0a01fb380f5 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:19.956108 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0dd49408-0874-4a12-a735-c0a01fb380f5 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1217 microversion: 2.1 time: 0.149424 Oct 29 01:45:19.958420 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3583/6952] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:19 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:20.890287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b7c0f203-85fc-456f-b253-0fcda83d2940 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:20.891658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b7c0f203-85fc-456f-b253-0fcda83d2940 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:20.899278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7c0f203-85fc-456f-b253-0fcda83d2940 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:20.900151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7c0f203-85fc-456f-b253-0fcda83d2940 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:20.900824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7c0f203-85fc-456f-b253-0fcda83d2940 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:20.901884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7c0f203-85fc-456f-b253-0fcda83d2940 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:20.902572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7c0f203-85fc-456f-b253-0fcda83d2940 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:20.903254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b7c0f203-85fc-456f-b253-0fcda83d2940 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:20.999886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-785ac04c-3fc2-4b2a-8589-f811f5961c97 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:21.002157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-785ac04c-3fc2-4b2a-8589-f811f5961c97 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:21.015448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-785ac04c-3fc2-4b2a-8589-f811f5961c97 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:21.015947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-785ac04c-3fc2-4b2a-8589-f811f5961c97 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:21.019414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-785ac04c-3fc2-4b2a-8589-f811f5961c97 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:21.019414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-785ac04c-3fc2-4b2a-8589-f811f5961c97 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:21.019414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-785ac04c-3fc2-4b2a-8589-f811f5961c97 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:21.019414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-785ac04c-3fc2-4b2a-8589-f811f5961c97 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:21.034531 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b7c0f203-85fc-456f-b253-0fcda83d2940 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1338 microversion: 2.1 time: 0.147118 Oct 29 01:45:21.039025 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3370/6953] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:20 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1338 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:21.156667 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-785ac04c-3fc2-4b2a-8589-f811f5961c97 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:21.166247 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-785ac04c-3fc2-4b2a-8589-f811f5961c97 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1221 microversion: 2.1 time: 0.189476 Oct 29 01:45:21.167184 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3584/6954] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:20 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1221 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:22.075913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b10bd50e-0004-4d8a-99d9-5186d4bb6aaa tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:22.076802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b10bd50e-0004-4d8a-99d9-5186d4bb6aaa tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:22.084585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b10bd50e-0004-4d8a-99d9-5186d4bb6aaa tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:22.085344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b10bd50e-0004-4d8a-99d9-5186d4bb6aaa tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:22.085963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b10bd50e-0004-4d8a-99d9-5186d4bb6aaa tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:22.086665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b10bd50e-0004-4d8a-99d9-5186d4bb6aaa tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:22.087279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b10bd50e-0004-4d8a-99d9-5186d4bb6aaa tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:22.087897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b10bd50e-0004-4d8a-99d9-5186d4bb6aaa tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:22.197198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e428202b-2d52-4b64-a36d-29336f744a5c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:22.198421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e428202b-2d52-4b64-a36d-29336f744a5c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:22.213181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e428202b-2d52-4b64-a36d-29336f744a5c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:22.215862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e428202b-2d52-4b64-a36d-29336f744a5c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:22.216512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e428202b-2d52-4b64-a36d-29336f744a5c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:22.218171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e428202b-2d52-4b64-a36d-29336f744a5c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:22.218825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e428202b-2d52-4b64-a36d-29336f744a5c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:22.219422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e428202b-2d52-4b64-a36d-29336f744a5c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:22.223289 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b10bd50e-0004-4d8a-99d9-5186d4bb6aaa tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1424 microversion: 2.1 time: 0.150766 Oct 29 01:45:22.224427 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3371/6955] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:22 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1424 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:22.702122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e428202b-2d52-4b64-a36d-29336f744a5c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:22.710871 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e428202b-2d52-4b64-a36d-29336f744a5c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1269 microversion: 2.1 time: 0.518096 Oct 29 01:45:22.711760 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3585/6956] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:22 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1269 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:45:23.266924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c9cd1d77-654b-4894-8179-8d1ab6f61f83 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:23.267744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c9cd1d77-654b-4894-8179-8d1ab6f61f83 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:23.287225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9cd1d77-654b-4894-8179-8d1ab6f61f83 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:23.290485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9cd1d77-654b-4894-8179-8d1ab6f61f83 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:23.291167 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9cd1d77-654b-4894-8179-8d1ab6f61f83 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:23.294841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9cd1d77-654b-4894-8179-8d1ab6f61f83 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:23.296154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9cd1d77-654b-4894-8179-8d1ab6f61f83 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:23.296672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c9cd1d77-654b-4894-8179-8d1ab6f61f83 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:23.486311 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c9cd1d77-654b-4894-8179-8d1ab6f61f83 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1422 microversion: 2.1 time: 0.223302 Oct 29 01:45:23.487798 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3372/6957] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:23 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1422 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:23.738348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e49ab839-6ee5-4aa4-8dca-e0f87d863993 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:23.740749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e49ab839-6ee5-4aa4-8dca-e0f87d863993 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:23.761459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e49ab839-6ee5-4aa4-8dca-e0f87d863993 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:23.762401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e49ab839-6ee5-4aa4-8dca-e0f87d863993 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:23.762999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e49ab839-6ee5-4aa4-8dca-e0f87d863993 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:23.765168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e49ab839-6ee5-4aa4-8dca-e0f87d863993 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:23.766226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e49ab839-6ee5-4aa4-8dca-e0f87d863993 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:23.766840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e49ab839-6ee5-4aa4-8dca-e0f87d863993 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:23.866784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e49ab839-6ee5-4aa4-8dca-e0f87d863993 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:23.882913 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e49ab839-6ee5-4aa4-8dca-e0f87d863993 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1275 microversion: 2.1 time: 0.151436 Oct 29 01:45:23.883661 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3586/6958] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:23 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:24.511898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e01280f9-60b0-482d-a5db-d56089977857 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:24.513367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e01280f9-60b0-482d-a5db-d56089977857 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:24.524707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e01280f9-60b0-482d-a5db-d56089977857 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:24.525567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e01280f9-60b0-482d-a5db-d56089977857 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:24.530740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e01280f9-60b0-482d-a5db-d56089977857 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:24.531847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e01280f9-60b0-482d-a5db-d56089977857 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:24.532729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e01280f9-60b0-482d-a5db-d56089977857 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:24.533532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e01280f9-60b0-482d-a5db-d56089977857 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:24.921256 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e01280f9-60b0-482d-a5db-d56089977857 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1464 microversion: 2.1 time: 0.410514 Oct 29 01:45:24.927325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-21ffd070-c540-4d8d-ba40-1d20f1f49490 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:24.927959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-21ffd070-c540-4d8d-ba40-1d20f1f49490 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:24.929192 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3373/6959] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:24 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1464 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:24.936906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21ffd070-c540-4d8d-ba40-1d20f1f49490 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:24.937731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21ffd070-c540-4d8d-ba40-1d20f1f49490 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:24.938363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21ffd070-c540-4d8d-ba40-1d20f1f49490 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:24.939313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21ffd070-c540-4d8d-ba40-1d20f1f49490 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:24.940229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21ffd070-c540-4d8d-ba40-1d20f1f49490 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:24.940849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-21ffd070-c540-4d8d-ba40-1d20f1f49490 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:25.252454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-21ffd070-c540-4d8d-ba40-1d20f1f49490 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:25.262999 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-21ffd070-c540-4d8d-ba40-1d20f1f49490 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1317 microversion: 2.1 time: 0.354060 Oct 29 01:45:25.269599 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3587/6960] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:24 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:25.547712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-3e342887-9c98-41ae-9d23-adee578c2113 req-53b8479f-74e1-4795-a779-60f074b005c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a076fb9-bfde-4c94-9329-8a67e01ff99b", "tag": "ed5ca89c-e0fc-40b9-89c6-99ab48c21449"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:45:25.558599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3e342887-9c98-41ae-9d23-adee578c2113 req-53b8479f-74e1-4795-a779-60f074b005c1 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:25.559488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3e342887-9c98-41ae-9d23-adee578c2113 req-53b8479f-74e1-4795-a779-60f074b005c1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:25.560089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3e342887-9c98-41ae-9d23-adee578c2113 req-53b8479f-74e1-4795-a779-60f074b005c1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:25.582007 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-3e342887-9c98-41ae-9d23-adee578c2113 req-53b8479f-74e1-4795-a779-60f074b005c1 service nova] Creating event network-changed:ed5ca89c-e0fc-40b9-89c6-99ab48c21449 for instance 2a076fb9-bfde-4c94-9329-8a67e01ff99b on n-h2-862964-3 Oct 29 01:45:25.591020 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-3e342887-9c98-41ae-9d23-adee578c2113 req-53b8479f-74e1-4795-a779-60f074b005c1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046655 Oct 29 01:45:25.592971 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3374/6961] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:45:25.956506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-17428d4a-25b4-4eab-8267-168f9232f78e tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:25.957122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-17428d4a-25b4-4eab-8267-168f9232f78e tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:25.964050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17428d4a-25b4-4eab-8267-168f9232f78e tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:25.964541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17428d4a-25b4-4eab-8267-168f9232f78e tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:25.965067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17428d4a-25b4-4eab-8267-168f9232f78e tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:25.965719 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17428d4a-25b4-4eab-8267-168f9232f78e tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:25.966182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17428d4a-25b4-4eab-8267-168f9232f78e tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:25.966611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-17428d4a-25b4-4eab-8267-168f9232f78e tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:26.183225 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-17428d4a-25b4-4eab-8267-168f9232f78e tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1464 microversion: 2.1 time: 0.230591 Oct 29 01:45:26.196750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-e0fb0f77-c192-4162-bb80-8d3c12d0dfe4 req-7a13ebc6-7882-41da-bc04-a8e02b7365ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "553d9e36-ec89-4e8e-8858-4c3d771ee57a", "tag": "517bc126-5058-47e1-956c-710d5bc270b6"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:45:26.202820 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3588/6962] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:25 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1464 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:26.208335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e0fb0f77-c192-4162-bb80-8d3c12d0dfe4 req-7a13ebc6-7882-41da-bc04-a8e02b7365ba service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:26.208933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e0fb0f77-c192-4162-bb80-8d3c12d0dfe4 req-7a13ebc6-7882-41da-bc04-a8e02b7365ba service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:26.209546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e0fb0f77-c192-4162-bb80-8d3c12d0dfe4 req-7a13ebc6-7882-41da-bc04-a8e02b7365ba service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:26.221940 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-e0fb0f77-c192-4162-bb80-8d3c12d0dfe4 req-7a13ebc6-7882-41da-bc04-a8e02b7365ba service nova] Creating event network-changed:517bc126-5058-47e1-956c-710d5bc270b6 for instance 553d9e36-ec89-4e8e-8858-4c3d771ee57a on n-h2-862964-3 Oct 29 01:45:26.227196 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-e0fb0f77-c192-4162-bb80-8d3c12d0dfe4 req-7a13ebc6-7882-41da-bc04-a8e02b7365ba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035644 Oct 29 01:45:26.228246 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3375/6963] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:45:26.291752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-edc363c1-3b14-45b2-85d5-9bc2c1eb04b1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:26.292749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-edc363c1-3b14-45b2-85d5-9bc2c1eb04b1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:26.299870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:26.301754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edc363c1-3b14-45b2-85d5-9bc2c1eb04b1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:26.302453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edc363c1-3b14-45b2-85d5-9bc2c1eb04b1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:26.303122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edc363c1-3b14-45b2-85d5-9bc2c1eb04b1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:26.304204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edc363c1-3b14-45b2-85d5-9bc2c1eb04b1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:26.304681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edc363c1-3b14-45b2-85d5-9bc2c1eb04b1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:26.305202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-edc363c1-3b14-45b2-85d5-9bc2c1eb04b1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:26.619048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-edc363c1-3b14-45b2-85d5-9bc2c1eb04b1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:26.629561 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-edc363c1-3b14-45b2-85d5-9bc2c1eb04b1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1317 microversion: 2.1 time: 0.342477 Oct 29 01:45:26.630548 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3589/6964] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:26 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:27.209702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d36698dc-13da-4532-8335-0e7ad430ce36 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:27.210925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d36698dc-13da-4532-8335-0e7ad430ce36 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:27.217659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d36698dc-13da-4532-8335-0e7ad430ce36 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:27.218149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d36698dc-13da-4532-8335-0e7ad430ce36 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:27.218589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d36698dc-13da-4532-8335-0e7ad430ce36 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:27.219297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d36698dc-13da-4532-8335-0e7ad430ce36 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:27.219763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d36698dc-13da-4532-8335-0e7ad430ce36 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:27.220193 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d36698dc-13da-4532-8335-0e7ad430ce36 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:27.378694 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d36698dc-13da-4532-8335-0e7ad430ce36 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1464 microversion: 2.1 time: 0.173879 Oct 29 01:45:27.382963 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3376/6965] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:27 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1464 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:27.654510 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fb5ae474-f51f-4dc4-9290-0234e1bc79a6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:27.655805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fb5ae474-f51f-4dc4-9290-0234e1bc79a6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:27.668270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb5ae474-f51f-4dc4-9290-0234e1bc79a6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:27.675049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb5ae474-f51f-4dc4-9290-0234e1bc79a6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:27.675049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb5ae474-f51f-4dc4-9290-0234e1bc79a6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:27.675049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb5ae474-f51f-4dc4-9290-0234e1bc79a6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:27.675049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb5ae474-f51f-4dc4-9290-0234e1bc79a6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:27.675387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fb5ae474-f51f-4dc4-9290-0234e1bc79a6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:27.855269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fb5ae474-f51f-4dc4-9290-0234e1bc79a6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:27.868922 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fb5ae474-f51f-4dc4-9290-0234e1bc79a6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1317 microversion: 2.1 time: 0.219101 Oct 29 01:45:27.870190 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3590/6966] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:27 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:28.407572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0ecbeb9b-2992-4a2d-90e6-91e44b1554a3 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:28.408106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0ecbeb9b-2992-4a2d-90e6-91e44b1554a3 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:28.410074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:28.415764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ecbeb9b-2992-4a2d-90e6-91e44b1554a3 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:28.416247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ecbeb9b-2992-4a2d-90e6-91e44b1554a3 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:28.416901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ecbeb9b-2992-4a2d-90e6-91e44b1554a3 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:28.417633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ecbeb9b-2992-4a2d-90e6-91e44b1554a3 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:28.418089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ecbeb9b-2992-4a2d-90e6-91e44b1554a3 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:28.418514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ecbeb9b-2992-4a2d-90e6-91e44b1554a3 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:28.580292 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0ecbeb9b-2992-4a2d-90e6-91e44b1554a3 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1464 microversion: 2.1 time: 0.176588 Oct 29 01:45:28.581372 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3377/6967] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:28 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1464 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:28.893664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4f9cf7fe-4e10-43fb-9caa-d76d1d38515c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:28.895068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4f9cf7fe-4e10-43fb-9caa-d76d1d38515c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:28.897007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:28.902804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f9cf7fe-4e10-43fb-9caa-d76d1d38515c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:28.903291 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f9cf7fe-4e10-43fb-9caa-d76d1d38515c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:28.905116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f9cf7fe-4e10-43fb-9caa-d76d1d38515c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:28.905264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f9cf7fe-4e10-43fb-9caa-d76d1d38515c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:28.905718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f9cf7fe-4e10-43fb-9caa-d76d1d38515c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:28.906149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f9cf7fe-4e10-43fb-9caa-d76d1d38515c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:29.206083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4f9cf7fe-4e10-43fb-9caa-d76d1d38515c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:29.214804 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4f9cf7fe-4e10-43fb-9caa-d76d1d38515c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1317 microversion: 2.1 time: 0.325365 Oct 29 01:45:29.216211 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3591/6968] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:28 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:29.612732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9c5d480b-7256-4d9f-bb1c-9fc66195f39a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:29.621720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9c5d480b-7256-4d9f-bb1c-9fc66195f39a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:29.636350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c5d480b-7256-4d9f-bb1c-9fc66195f39a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:29.638398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c5d480b-7256-4d9f-bb1c-9fc66195f39a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:29.638913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c5d480b-7256-4d9f-bb1c-9fc66195f39a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:29.641512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c5d480b-7256-4d9f-bb1c-9fc66195f39a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:29.642164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c5d480b-7256-4d9f-bb1c-9fc66195f39a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:29.642590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9c5d480b-7256-4d9f-bb1c-9fc66195f39a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:29.787795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:29.798270 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9c5d480b-7256-4d9f-bb1c-9fc66195f39a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1464 microversion: 2.1 time: 0.193346 Oct 29 01:45:29.799190 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3378/6969] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:29 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1464 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:30.240411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-57d560e2-57ff-41fd-989a-0e4532d3a00e tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:30.241003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-57d560e2-57ff-41fd-989a-0e4532d3a00e tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:30.243050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=10 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:30.248797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57d560e2-57ff-41fd-989a-0e4532d3a00e tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:30.249332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57d560e2-57ff-41fd-989a-0e4532d3a00e tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:30.249768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57d560e2-57ff-41fd-989a-0e4532d3a00e tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:30.250464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57d560e2-57ff-41fd-989a-0e4532d3a00e tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:30.250918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57d560e2-57ff-41fd-989a-0e4532d3a00e tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:30.251505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57d560e2-57ff-41fd-989a-0e4532d3a00e tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:30.445901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-57d560e2-57ff-41fd-989a-0e4532d3a00e tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:30.455505 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-57d560e2-57ff-41fd-989a-0e4532d3a00e tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1317 microversion: 2.1 time: 0.219514 Oct 29 01:45:30.464919 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3592/6970] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:30 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:30.823581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0ddf5c66-fc95-47d0-91b7-21456b37f10b tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:30.828893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0ddf5c66-fc95-47d0-91b7-21456b37f10b tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:30.830837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=10 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:30.834289 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ddf5c66-fc95-47d0-91b7-21456b37f10b tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:30.835228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ddf5c66-fc95-47d0-91b7-21456b37f10b tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:30.835671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ddf5c66-fc95-47d0-91b7-21456b37f10b tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:30.836381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ddf5c66-fc95-47d0-91b7-21456b37f10b tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:30.836897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ddf5c66-fc95-47d0-91b7-21456b37f10b tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:30.837510 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0ddf5c66-fc95-47d0-91b7-21456b37f10b tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:30.998847 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0ddf5c66-fc95-47d0-91b7-21456b37f10b tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1464 microversion: 2.1 time: 0.179879 Oct 29 01:45:30.999440 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3379/6971] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:30 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1464 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:31.493365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-36dc7927-0bff-4f27-bc8e-fea3532ead0f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:31.493981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-36dc7927-0bff-4f27-bc8e-fea3532ead0f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:31.502959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36dc7927-0bff-4f27-bc8e-fea3532ead0f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:31.503759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36dc7927-0bff-4f27-bc8e-fea3532ead0f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:31.504360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36dc7927-0bff-4f27-bc8e-fea3532ead0f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:31.507376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36dc7927-0bff-4f27-bc8e-fea3532ead0f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:31.507376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36dc7927-0bff-4f27-bc8e-fea3532ead0f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:31.507376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36dc7927-0bff-4f27-bc8e-fea3532ead0f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:31.789256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-36dc7927-0bff-4f27-bc8e-fea3532ead0f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:31.801809 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-36dc7927-0bff-4f27-bc8e-fea3532ead0f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1317 microversion: 2.1 time: 0.314262 Oct 29 01:45:31.803071 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3593/6972] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:31 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:32.024674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a3a54dbb-20f5-43e8-a797-dcdc6501a5f6 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:32.026757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a3a54dbb-20f5-43e8-a797-dcdc6501a5f6 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:32.044438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3a54dbb-20f5-43e8-a797-dcdc6501a5f6 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:32.045723 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3a54dbb-20f5-43e8-a797-dcdc6501a5f6 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:32.046356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3a54dbb-20f5-43e8-a797-dcdc6501a5f6 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:32.047366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3a54dbb-20f5-43e8-a797-dcdc6501a5f6 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:32.047991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3a54dbb-20f5-43e8-a797-dcdc6501a5f6 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:32.048599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a3a54dbb-20f5-43e8-a797-dcdc6501a5f6 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:32.211436 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a3a54dbb-20f5-43e8-a797-dcdc6501a5f6 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1464 microversion: 2.1 time: 0.192063 Oct 29 01:45:32.212023 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3380/6973] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:32 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1464 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:32.827079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-57542eac-66e0-4c90-be93-894cad05c9d4 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:32.827892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-57542eac-66e0-4c90-be93-894cad05c9d4 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:32.835954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57542eac-66e0-4c90-be93-894cad05c9d4 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:32.836761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57542eac-66e0-4c90-be93-894cad05c9d4 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:32.837531 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57542eac-66e0-4c90-be93-894cad05c9d4 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:32.838254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57542eac-66e0-4c90-be93-894cad05c9d4 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:32.838846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57542eac-66e0-4c90-be93-894cad05c9d4 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:32.839295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-57542eac-66e0-4c90-be93-894cad05c9d4 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:33.130974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-57542eac-66e0-4c90-be93-894cad05c9d4 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:33.144175 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-57542eac-66e0-4c90-be93-894cad05c9d4 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1317 microversion: 2.1 time: 0.320388 Oct 29 01:45:33.145431 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3594/6974] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:32 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:33.211685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6c641d7a-d0f0-4cf1-ae92-123802eedc4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1048023882", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1a7014b6-e0a2-4f22-bd6b-db2a71223b05", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d488ed61-ddc0-4d3b-9833-017b49869cf3"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:45:33.237058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8c8e19a0-881d-4bb0-8b9d-44c4be8a4e26 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:33.237755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8c8e19a0-881d-4bb0-8b9d-44c4be8a4e26 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:33.253289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c8e19a0-881d-4bb0-8b9d-44c4be8a4e26 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:33.254598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c8e19a0-881d-4bb0-8b9d-44c4be8a4e26 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:33.255054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c8e19a0-881d-4bb0-8b9d-44c4be8a4e26 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:33.255796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c8e19a0-881d-4bb0-8b9d-44c4be8a4e26 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:33.256263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c8e19a0-881d-4bb0-8b9d-44c4be8a4e26 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:33.256695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8c8e19a0-881d-4bb0-8b9d-44c4be8a4e26 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:33.347860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-6c641d7a-d0f0-4cf1-ae92-123802eedc4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] validate_networks() for [('d488ed61-ddc0-4d3b-9833-017b49869cf3', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:45:33.596795 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8c8e19a0-881d-4bb0-8b9d-44c4be8a4e26 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1464 microversion: 2.1 time: 0.365065 Oct 29 01:45:33.597423 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3595/6975] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:33 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1464 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:33.609185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-f9b6d667-dafc-4baa-af52-cec22c4b26f4 req-2868d8bd-8f80-4097-a1bb-12451deb52ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a076fb9-bfde-4c94-9329-8a67e01ff99b", "name": "network-vif-plugged", "status": "completed", "tag": "ed5ca89c-e0fc-40b9-89c6-99ab48c21449"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:45:33.632532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f9b6d667-dafc-4baa-af52-cec22c4b26f4 req-2868d8bd-8f80-4097-a1bb-12451deb52ce service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:33.637803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f9b6d667-dafc-4baa-af52-cec22c4b26f4 req-2868d8bd-8f80-4097-a1bb-12451deb52ce service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:33.638401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f9b6d667-dafc-4baa-af52-cec22c4b26f4 req-2868d8bd-8f80-4097-a1bb-12451deb52ce service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:33.675043 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-f9b6d667-dafc-4baa-af52-cec22c4b26f4 req-2868d8bd-8f80-4097-a1bb-12451deb52ce service nova] Creating event network-vif-plugged:ed5ca89c-e0fc-40b9-89c6-99ab48c21449 for instance 2a076fb9-bfde-4c94-9329-8a67e01ff99b on n-h2-862964-3 Oct 29 01:45:33.694699 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-f9b6d667-dafc-4baa-af52-cec22c4b26f4 req-2868d8bd-8f80-4097-a1bb-12451deb52ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093352 Oct 29 01:45:33.698950 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3596/6976] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:45:34.152716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-6c641d7a-d0f0-4cf1-ae92-123802eedc4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:45:34.153811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-6c641d7a-d0f0-4cf1-ae92-123802eedc4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:45:34.156927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-6c641d7a-d0f0-4cf1-ae92-123802eedc4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:45:34.156927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-6c641d7a-d0f0-4cf1-ae92-123802eedc4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:45:34.157402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-6c641d7a-d0f0-4cf1-ae92-123802eedc4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:45:34.167768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5433846e-faf9-451b-9d05-38398da31ff6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:34.169380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5433846e-faf9-451b-9d05-38398da31ff6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:34.189220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5433846e-faf9-451b-9d05-38398da31ff6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:34.190609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5433846e-faf9-451b-9d05-38398da31ff6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:34.191822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5433846e-faf9-451b-9d05-38398da31ff6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:34.194853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5433846e-faf9-451b-9d05-38398da31ff6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:34.195860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5433846e-faf9-451b-9d05-38398da31ff6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:34.196456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5433846e-faf9-451b-9d05-38398da31ff6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:34.199197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6c641d7a-d0f0-4cf1-ae92-123802eedc4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:34.199702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6c641d7a-d0f0-4cf1-ae92-123802eedc4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:34.200160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6c641d7a-d0f0-4cf1-ae92-123802eedc4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:34.200911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6c641d7a-d0f0-4cf1-ae92-123802eedc4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:34.201683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6c641d7a-d0f0-4cf1-ae92-123802eedc4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:34.202208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6c641d7a-d0f0-4cf1-ae92-123802eedc4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:34.258567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-6c641d7a-d0f0-4cf1-ae92-123802eedc4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Getting quotas for project 37416a9397fa4c6dbd0bfe8dee191577. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:45:34.273264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-6c641d7a-d0f0-4cf1-ae92-123802eedc4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Getting quotas for user 8b8f36d10fa340f784581a3cf9a15606 and project 37416a9397fa4c6dbd0bfe8dee191577. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:45:34.397179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6c641d7a-d0f0-4cf1-ae92-123802eedc4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:45:34.400679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6c641d7a-d0f0-4cf1-ae92-123802eedc4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1a7014b6-e0a2-4f22-bd6b-db2a71223b05',volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:45:34.571055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5433846e-faf9-451b-9d05-38398da31ff6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:34.580954 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5433846e-faf9-451b-9d05-38398da31ff6 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1317 microversion: 2.1 time: 0.417841 Oct 29 01:45:34.582652 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3597/6977] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:34 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:45:34.625275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2e840277-d432-4a1c-8577-86ce871dcb0a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:34.626390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2e840277-d432-4a1c-8577-86ce871dcb0a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:34.641736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e840277-d432-4a1c-8577-86ce871dcb0a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:34.642485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e840277-d432-4a1c-8577-86ce871dcb0a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:34.643109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e840277-d432-4a1c-8577-86ce871dcb0a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:34.643834 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e840277-d432-4a1c-8577-86ce871dcb0a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:34.644294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e840277-d432-4a1c-8577-86ce871dcb0a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:34.644720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e840277-d432-4a1c-8577-86ce871dcb0a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:34.944401 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2e840277-d432-4a1c-8577-86ce871dcb0a tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1464 microversion: 2.1 time: 0.306740 Oct 29 01:45:34.944401 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3598/6978] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:34 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1464 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:35.001437 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6c641d7a-d0f0-4cf1-ae92-123802eedc4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.787307 Oct 29 01:45:35.002434 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3381/6979] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:45:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:45:35.015566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-272c0480-6b64-4b2b-bb06-b0bc428c04a6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:35.017104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-272c0480-6b64-4b2b-bb06-b0bc428c04a6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:35.101782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-272c0480-6b64-4b2b-bb06-b0bc428c04a6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:35.111389 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-272c0480-6b64-4b2b-bb06-b0bc428c04a6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1071 microversion: 2.1 time: 0.101563 Oct 29 01:45:35.112685 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3599/6980] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:35 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1071 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:35.610753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ebc7e8a4-4c07-4552-a90b-05f2d76f630c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:35.613054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ebc7e8a4-4c07-4552-a90b-05f2d76f630c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:35.622757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ebc7e8a4-4c07-4552-a90b-05f2d76f630c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:35.624923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ebc7e8a4-4c07-4552-a90b-05f2d76f630c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:35.625670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ebc7e8a4-4c07-4552-a90b-05f2d76f630c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:35.639717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ebc7e8a4-4c07-4552-a90b-05f2d76f630c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:35.639717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ebc7e8a4-4c07-4552-a90b-05f2d76f630c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:35.639717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ebc7e8a4-4c07-4552-a90b-05f2d76f630c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:35.952888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-561ef1f3-a015-4a98-a956-89ce67451346 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:35.953790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-561ef1f3-a015-4a98-a956-89ce67451346 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:35.966241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-561ef1f3-a015-4a98-a956-89ce67451346 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:35.969305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-561ef1f3-a015-4a98-a956-89ce67451346 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:35.969922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-561ef1f3-a015-4a98-a956-89ce67451346 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:35.971680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-561ef1f3-a015-4a98-a956-89ce67451346 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:35.975736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-561ef1f3-a015-4a98-a956-89ce67451346 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:35.976540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-561ef1f3-a015-4a98-a956-89ce67451346 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:36.289590 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-561ef1f3-a015-4a98-a956-89ce67451346 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1649 microversion: 2.1 time: 0.339813 Oct 29 01:45:36.289993 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3600/6981] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:35 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1649 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:45:36.298718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-468c3598-0512-47bc-a7a4-3d072e91f5de tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:36.303906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-468c3598-0512-47bc-a7a4-3d072e91f5de tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:36.409286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-468c3598-0512-47bc-a7a4-3d072e91f5de tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:36.418842 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-468c3598-0512-47bc-a7a4-3d072e91f5de tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1071 microversion: 2.1 time: 0.126003 Oct 29 01:45:36.419811 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3601/6982] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:36 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1071 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:36.425949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-854cb55f-3aab-4766-adcb-7cf8c1ea8cd5 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:36.426901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-854cb55f-3aab-4766-adcb-7cf8c1ea8cd5 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:36.434120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-854cb55f-3aab-4766-adcb-7cf8c1ea8cd5 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:36.434916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-854cb55f-3aab-4766-adcb-7cf8c1ea8cd5 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:36.436286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-854cb55f-3aab-4766-adcb-7cf8c1ea8cd5 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:36.437851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-854cb55f-3aab-4766-adcb-7cf8c1ea8cd5 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:36.438539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-854cb55f-3aab-4766-adcb-7cf8c1ea8cd5 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:36.439623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-854cb55f-3aab-4766-adcb-7cf8c1ea8cd5 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:36.481436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:36.499724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ebc7e8a4-4c07-4552-a90b-05f2d76f630c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:36.508773 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ebc7e8a4-4c07-4552-a90b-05f2d76f630c tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1317 microversion: 2.1 time: 0.907299 Oct 29 01:45:36.521791 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3382/6983] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:35 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1317 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:36.646762 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-854cb55f-3aab-4766-adcb-7cf8c1ea8cd5 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1649 microversion: 2.1 time: 0.224681 Oct 29 01:45:36.647747 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3602/6984] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:36 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1649 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:36.672804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5ff88520-28eb-4ebd-ae4c-a9f00d9b4877 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:36.674227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5ff88520-28eb-4ebd-ae4c-a9f00d9b4877 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:36.681306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ff88520-28eb-4ebd-ae4c-a9f00d9b4877 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:36.682052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ff88520-28eb-4ebd-ae4c-a9f00d9b4877 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:36.682655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ff88520-28eb-4ebd-ae4c-a9f00d9b4877 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:36.683549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ff88520-28eb-4ebd-ae4c-a9f00d9b4877 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:36.684265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ff88520-28eb-4ebd-ae4c-a9f00d9b4877 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:36.684850 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ff88520-28eb-4ebd-ae4c-a9f00d9b4877 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:36.871013 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5ff88520-28eb-4ebd-ae4c-a9f00d9b4877 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1649 microversion: 2.1 time: 0.203207 Oct 29 01:45:36.871844 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3383/6985] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:36 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1649 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:36.899533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-60eb0dbc-8e39-459e-ab0f-92a52c88dc25 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:36.899533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-60eb0dbc-8e39-459e-ab0f-92a52c88dc25 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:36.907949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60eb0dbc-8e39-459e-ab0f-92a52c88dc25 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:36.911272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60eb0dbc-8e39-459e-ab0f-92a52c88dc25 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:36.911272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60eb0dbc-8e39-459e-ab0f-92a52c88dc25 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:36.911272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60eb0dbc-8e39-459e-ab0f-92a52c88dc25 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:36.911272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60eb0dbc-8e39-459e-ab0f-92a52c88dc25 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:36.911272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-60eb0dbc-8e39-459e-ab0f-92a52c88dc25 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:36.942735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-60eb0dbc-8e39-459e-ab0f-92a52c88dc25 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:45:37.446438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9237cb09-94e3-4eb0-9fb5-4f11734c9ede tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:37.447188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9237cb09-94e3-4eb0-9fb5-4f11734c9ede tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:37.455249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9237cb09-94e3-4eb0-9fb5-4f11734c9ede tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:37.455991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9237cb09-94e3-4eb0-9fb5-4f11734c9ede tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:37.456686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9237cb09-94e3-4eb0-9fb5-4f11734c9ede tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:37.457521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9237cb09-94e3-4eb0-9fb5-4f11734c9ede tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:37.458113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9237cb09-94e3-4eb0-9fb5-4f11734c9ede tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:37.458644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9237cb09-94e3-4eb0-9fb5-4f11734c9ede tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:37.527172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9237cb09-94e3-4eb0-9fb5-4f11734c9ede tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:37.536974 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9237cb09-94e3-4eb0-9fb5-4f11734c9ede tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1113 microversion: 2.1 time: 0.094246 Oct 29 01:45:37.537682 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3384/6986] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:37 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1113 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:45:37.542654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-87478ee8-0aa2-4966-b5ee-3ba9e76df15f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:37.543255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-87478ee8-0aa2-4966-b5ee-3ba9e76df15f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:37.553017 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87478ee8-0aa2-4966-b5ee-3ba9e76df15f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:37.554160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87478ee8-0aa2-4966-b5ee-3ba9e76df15f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:37.554588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87478ee8-0aa2-4966-b5ee-3ba9e76df15f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:37.555501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87478ee8-0aa2-4966-b5ee-3ba9e76df15f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:37.555963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87478ee8-0aa2-4966-b5ee-3ba9e76df15f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:37.556389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-87478ee8-0aa2-4966-b5ee-3ba9e76df15f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:37.747822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-87478ee8-0aa2-4966-b5ee-3ba9e76df15f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:37.762005 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-87478ee8-0aa2-4966-b5ee-3ba9e76df15f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1317 microversion: 2.1 time: 0.223011 Oct 29 01:45:37.763143 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3385/6987] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:37 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:37.785029 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-60eb0dbc-8e39-459e-ab0f-92a52c88dc25 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "DELETE /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 204 len: 0 microversion: 2.1 time: 0.889660 Oct 29 01:45:37.786052 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3603/6988] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:45:36 2022] DELETE /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 0 bytes in 891 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:45:37.798802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-be642d5a-23fc-4f62-8614-2b6bf0caafc5 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:37.798919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-be642d5a-23fc-4f62-8614-2b6bf0caafc5 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:37.808694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be642d5a-23fc-4f62-8614-2b6bf0caafc5 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:37.809224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be642d5a-23fc-4f62-8614-2b6bf0caafc5 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:37.809674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be642d5a-23fc-4f62-8614-2b6bf0caafc5 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:37.810392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be642d5a-23fc-4f62-8614-2b6bf0caafc5 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:37.821013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be642d5a-23fc-4f62-8614-2b6bf0caafc5 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:37.821687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-be642d5a-23fc-4f62-8614-2b6bf0caafc5 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:38.075447 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-be642d5a-23fc-4f62-8614-2b6bf0caafc5 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1655 microversion: 2.1 time: 0.281260 Oct 29 01:45:38.077176 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3386/6989] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:37 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1655 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:38.353022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-092a04c2-df7b-4bf4-8e9d-63ed81c63d35 req-f7bf769a-694b-4fca-bf51-d9d9516e7f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "553d9e36-ec89-4e8e-8858-4c3d771ee57a", "name": "network-vif-plugged", "status": "completed", "tag": "517bc126-5058-47e1-956c-710d5bc270b6"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:45:38.399634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-092a04c2-df7b-4bf4-8e9d-63ed81c63d35 req-f7bf769a-694b-4fca-bf51-d9d9516e7f28 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:38.401300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-092a04c2-df7b-4bf4-8e9d-63ed81c63d35 req-f7bf769a-694b-4fca-bf51-d9d9516e7f28 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:38.401822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-092a04c2-df7b-4bf4-8e9d-63ed81c63d35 req-f7bf769a-694b-4fca-bf51-d9d9516e7f28 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:38.423498 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-092a04c2-df7b-4bf4-8e9d-63ed81c63d35 req-f7bf769a-694b-4fca-bf51-d9d9516e7f28 service nova] Creating event network-vif-plugged:517bc126-5058-47e1-956c-710d5bc270b6 for instance 553d9e36-ec89-4e8e-8858-4c3d771ee57a on n-h2-862964-3 Oct 29 01:45:38.428592 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-092a04c2-df7b-4bf4-8e9d-63ed81c63d35 req-f7bf769a-694b-4fca-bf51-d9d9516e7f28 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.395439 Oct 29 01:45:38.433374 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3604/6990] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:45:38.641197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9acb2dc9-c140-4e3a-b2ee-b17962594da3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:38.642365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9acb2dc9-c140-4e3a-b2ee-b17962594da3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:38.658063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9acb2dc9-c140-4e3a-b2ee-b17962594da3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:38.658980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9acb2dc9-c140-4e3a-b2ee-b17962594da3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:38.659697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9acb2dc9-c140-4e3a-b2ee-b17962594da3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:38.660620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9acb2dc9-c140-4e3a-b2ee-b17962594da3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:38.661296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9acb2dc9-c140-4e3a-b2ee-b17962594da3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:38.669223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9acb2dc9-c140-4e3a-b2ee-b17962594da3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:38.788898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f51ef6f7-d064-4885-8140-688066ef9fab tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:38.790337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f51ef6f7-d064-4885-8140-688066ef9fab tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:38.797434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9acb2dc9-c140-4e3a-b2ee-b17962594da3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:38.807017 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9acb2dc9-c140-4e3a-b2ee-b17962594da3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1177 microversion: 2.1 time: 0.249493 Oct 29 01:45:38.808132 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3387/6991] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:38 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1177 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:38.816505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f51ef6f7-d064-4885-8140-688066ef9fab tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:38.818474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f51ef6f7-d064-4885-8140-688066ef9fab tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:38.819121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f51ef6f7-d064-4885-8140-688066ef9fab tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:38.821472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f51ef6f7-d064-4885-8140-688066ef9fab tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:38.822295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f51ef6f7-d064-4885-8140-688066ef9fab tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:38.822919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f51ef6f7-d064-4885-8140-688066ef9fab tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:39.098818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f93ad999-7ae0-4815-bc9e-7edc3d7e6215 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:39.099737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f93ad999-7ae0-4815-bc9e-7edc3d7e6215 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:39.110679 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f93ad999-7ae0-4815-bc9e-7edc3d7e6215 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:39.112079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f93ad999-7ae0-4815-bc9e-7edc3d7e6215 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:39.116511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f93ad999-7ae0-4815-bc9e-7edc3d7e6215 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:39.117717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f93ad999-7ae0-4815-bc9e-7edc3d7e6215 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:39.118365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f93ad999-7ae0-4815-bc9e-7edc3d7e6215 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:39.118981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f93ad999-7ae0-4815-bc9e-7edc3d7e6215 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:39.176708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f51ef6f7-d064-4885-8140-688066ef9fab tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:39.199055 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f51ef6f7-d064-4885-8140-688066ef9fab tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1317 microversion: 2.1 time: 0.410021 Oct 29 01:45:39.199893 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3605/6992] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:38 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:39.470679 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f93ad999-7ae0-4815-bc9e-7edc3d7e6215 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1655 microversion: 2.1 time: 0.376902 Oct 29 01:45:39.471299 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3388/6993] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:39 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1655 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:45:39.831472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4513b7af-e5db-45de-9092-a07d37b1681d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:39.834623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4513b7af-e5db-45de-9092-a07d37b1681d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:39.879997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4513b7af-e5db-45de-9092-a07d37b1681d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:39.879997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4513b7af-e5db-45de-9092-a07d37b1681d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:39.879997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4513b7af-e5db-45de-9092-a07d37b1681d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:39.879997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4513b7af-e5db-45de-9092-a07d37b1681d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:39.879997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4513b7af-e5db-45de-9092-a07d37b1681d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:39.880414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4513b7af-e5db-45de-9092-a07d37b1681d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:40.170296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4513b7af-e5db-45de-9092-a07d37b1681d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:40.192844 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4513b7af-e5db-45de-9092-a07d37b1681d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1187 microversion: 2.1 time: 0.364326 Oct 29 01:45:40.202462 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3606/6994] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:39 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1187 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:40.219125 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5bf7b16b-a2cc-41d6-ac88-c6bf1d9097c1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:40.219858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5bf7b16b-a2cc-41d6-ac88-c6bf1d9097c1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:40.258590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bf7b16b-a2cc-41d6-ac88-c6bf1d9097c1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:40.261629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bf7b16b-a2cc-41d6-ac88-c6bf1d9097c1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:40.265007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bf7b16b-a2cc-41d6-ac88-c6bf1d9097c1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:40.269744 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bf7b16b-a2cc-41d6-ac88-c6bf1d9097c1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:40.270247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bf7b16b-a2cc-41d6-ac88-c6bf1d9097c1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:40.270700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bf7b16b-a2cc-41d6-ac88-c6bf1d9097c1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:40.499156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-148df3fc-abe0-4dbd-9bb7-d6bfe1b30a21 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:40.500083 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-148df3fc-abe0-4dbd-9bb7-d6bfe1b30a21 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:40.533619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-148df3fc-abe0-4dbd-9bb7-d6bfe1b30a21 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:40.534359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-148df3fc-abe0-4dbd-9bb7-d6bfe1b30a21 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:40.540144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-148df3fc-abe0-4dbd-9bb7-d6bfe1b30a21 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:40.543337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-148df3fc-abe0-4dbd-9bb7-d6bfe1b30a21 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:40.545784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-148df3fc-abe0-4dbd-9bb7-d6bfe1b30a21 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:40.546842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-148df3fc-abe0-4dbd-9bb7-d6bfe1b30a21 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:40.769012 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-148df3fc-abe0-4dbd-9bb7-d6bfe1b30a21 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1613 microversion: 2.1 time: 0.274821 Oct 29 01:45:40.772596 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3607/6995] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:40 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1613 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:45:40.783718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-20e84dd9-2e1d-4bf1-88db-c5c93a1883d1 req-2ddb6aef-3252-4191-8451-8b24b2ee5af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a076fb9-bfde-4c94-9329-8a67e01ff99b", "name": "network-vif-deleted", "tag": "ed5ca89c-e0fc-40b9-89c6-99ab48c21449"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:45:40.818439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5bf7b16b-a2cc-41d6-ac88-c6bf1d9097c1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:40.828764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-20e84dd9-2e1d-4bf1-88db-c5c93a1883d1 req-2ddb6aef-3252-4191-8451-8b24b2ee5af9 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:40.828764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-20e84dd9-2e1d-4bf1-88db-c5c93a1883d1 req-2ddb6aef-3252-4191-8451-8b24b2ee5af9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:40.843142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-20e84dd9-2e1d-4bf1-88db-c5c93a1883d1 req-2ddb6aef-3252-4191-8451-8b24b2ee5af9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:40.845425 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5bf7b16b-a2cc-41d6-ac88-c6bf1d9097c1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1317 microversion: 2.1 time: 0.617526 Oct 29 01:45:40.849232 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3389/6996] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:40 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:40.867734 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-20e84dd9-2e1d-4bf1-88db-c5c93a1883d1 req-2ddb6aef-3252-4191-8451-8b24b2ee5af9 service nova] Creating event network-vif-deleted:ed5ca89c-e0fc-40b9-89c6-99ab48c21449 for instance 2a076fb9-bfde-4c94-9329-8a67e01ff99b on n-h2-862964-3 Oct 29 01:45:40.876126 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-20e84dd9-2e1d-4bf1-88db-c5c93a1883d1 req-2ddb6aef-3252-4191-8451-8b24b2ee5af9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101908 Oct 29 01:45:40.876934 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3608/6997] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:45:41.218351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d17d72c9-8b27-4c72-b9b0-e911d42cb9e4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:41.219741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d17d72c9-8b27-4c72-b9b0-e911d42cb9e4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:41.240737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d17d72c9-8b27-4c72-b9b0-e911d42cb9e4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:41.241721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d17d72c9-8b27-4c72-b9b0-e911d42cb9e4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:41.247385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d17d72c9-8b27-4c72-b9b0-e911d42cb9e4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:41.254068 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d17d72c9-8b27-4c72-b9b0-e911d42cb9e4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:41.255162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d17d72c9-8b27-4c72-b9b0-e911d42cb9e4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:41.255978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d17d72c9-8b27-4c72-b9b0-e911d42cb9e4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:41.405373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d17d72c9-8b27-4c72-b9b0-e911d42cb9e4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:41.414573 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d17d72c9-8b27-4c72-b9b0-e911d42cb9e4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1187 microversion: 2.1 time: 0.200094 Oct 29 01:45:41.433818 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3390/6998] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:41 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1187 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:41.802879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bfac75e5-cd09-4e66-8605-e7fcf86aac80 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:41.804090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bfac75e5-cd09-4e66-8605-e7fcf86aac80 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:41.815346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfac75e5-cd09-4e66-8605-e7fcf86aac80 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:41.815842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfac75e5-cd09-4e66-8605-e7fcf86aac80 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:41.829081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfac75e5-cd09-4e66-8605-e7fcf86aac80 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:41.830176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfac75e5-cd09-4e66-8605-e7fcf86aac80 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:41.830886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfac75e5-cd09-4e66-8605-e7fcf86aac80 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:41.832001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfac75e5-cd09-4e66-8605-e7fcf86aac80 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:41.875110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f67dd0c3-d6c6-43b5-b9f1-fe822ea577e1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:41.877067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f67dd0c3-d6c6-43b5-b9f1-fe822ea577e1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:41.892520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f67dd0c3-d6c6-43b5-b9f1-fe822ea577e1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:41.893385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f67dd0c3-d6c6-43b5-b9f1-fe822ea577e1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:41.896543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f67dd0c3-d6c6-43b5-b9f1-fe822ea577e1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:41.897635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f67dd0c3-d6c6-43b5-b9f1-fe822ea577e1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:41.898230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f67dd0c3-d6c6-43b5-b9f1-fe822ea577e1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:41.901341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f67dd0c3-d6c6-43b5-b9f1-fe822ea577e1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:41.911649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfac75e5-cd09-4e66-8605-e7fcf86aac80 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:41.912723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfac75e5-cd09-4e66-8605-e7fcf86aac80 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:41.913403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bfac75e5-cd09-4e66-8605-e7fcf86aac80 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:41.914221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-bfac75e5-cd09-4e66-8605-e7fcf86aac80 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lazy-loading 'fault' on Instance uuid 2a076fb9-bfde-4c94-9329-8a67e01ff99b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:45:42.018914 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bfac75e5-cd09-4e66-8605-e7fcf86aac80 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 200 len: 1454 microversion: 2.1 time: 0.220272 Oct 29 01:45:42.021237 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3609/6999] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:41 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 1454 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:42.441297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0138f58e-16a6-45d6-9159-d1ddb094cdf1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:42.441995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0138f58e-16a6-45d6-9159-d1ddb094cdf1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:42.464030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0138f58e-16a6-45d6-9159-d1ddb094cdf1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:42.466541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0138f58e-16a6-45d6-9159-d1ddb094cdf1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:42.466541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0138f58e-16a6-45d6-9159-d1ddb094cdf1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:42.466541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0138f58e-16a6-45d6-9159-d1ddb094cdf1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:42.471277 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0138f58e-16a6-45d6-9159-d1ddb094cdf1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:42.471827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0138f58e-16a6-45d6-9159-d1ddb094cdf1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:42.954392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f67dd0c3-d6c6-43b5-b9f1-fe822ea577e1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:42.958497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0138f58e-16a6-45d6-9159-d1ddb094cdf1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:42.969685 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0138f58e-16a6-45d6-9159-d1ddb094cdf1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1229 microversion: 2.1 time: 0.530663 Oct 29 01:45:42.970866 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3610/7000] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:42 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1229 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:45:42.992084 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f67dd0c3-d6c6-43b5-b9f1-fe822ea577e1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1506 microversion: 2.1 time: 1.114673 Oct 29 01:45:42.993781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-54cffd7c-6d38-46b4-8980-99df050959a5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:45:42.994535 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3391/7001] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:41 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1506 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:42.999136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-54cffd7c-6d38-46b4-8980-99df050959a5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:43.007419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54cffd7c-6d38-46b4-8980-99df050959a5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:43.008459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54cffd7c-6d38-46b4-8980-99df050959a5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:43.009137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54cffd7c-6d38-46b4-8980-99df050959a5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:43.010131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54cffd7c-6d38-46b4-8980-99df050959a5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:43.010811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54cffd7c-6d38-46b4-8980-99df050959a5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:43.012029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-54cffd7c-6d38-46b4-8980-99df050959a5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:43.037467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f4571713-01bc-41b0-9fb2-ef06e383883d tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:43.038372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f4571713-01bc-41b0-9fb2-ef06e383883d tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:43.052195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4571713-01bc-41b0-9fb2-ef06e383883d tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:43.053084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4571713-01bc-41b0-9fb2-ef06e383883d tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:43.055830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4571713-01bc-41b0-9fb2-ef06e383883d tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:43.057978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4571713-01bc-41b0-9fb2-ef06e383883d tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:43.058599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4571713-01bc-41b0-9fb2-ef06e383883d tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:43.059181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f4571713-01bc-41b0-9fb2-ef06e383883d tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:43.102875 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f4571713-01bc-41b0-9fb2-ef06e383883d tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a/ips" status: 200 len: 109 microversion: 2.1 time: 0.079283 Oct 29 01:45:43.103808 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3392/7002] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 29 01:45:43 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a/ips => generated 109 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:45:43.108848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d1ddcb9d-06a3-4cf4-8772-df1ecb590c66 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:43.109778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d1ddcb9d-06a3-4cf4-8772-df1ecb590c66 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 2a076fb9-bfde-4c94-9329-8a67e01ff99b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:43.116499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d1ddcb9d-06a3-4cf4-8772-df1ecb590c66 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:43.117368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d1ddcb9d-06a3-4cf4-8772-df1ecb590c66 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:43.118045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d1ddcb9d-06a3-4cf4-8772-df1ecb590c66 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:43.119015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d1ddcb9d-06a3-4cf4-8772-df1ecb590c66 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:43.119699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d1ddcb9d-06a3-4cf4-8772-df1ecb590c66 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:43.120374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d1ddcb9d-06a3-4cf4-8772-df1ecb590c66 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:43.140678 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-54cffd7c-6d38-46b4-8980-99df050959a5 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672/action" status: 200 len: 24574 microversion: 2.1 time: 0.168313 Oct 29 01:45:43.141801 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3611/7003] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:45:42 2022] POST /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672/action => generated 24574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:45:43.157845 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-d1ddcb9d-06a3-4cf4-8772-df1ecb590c66 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] HTTP exception thrown: Instance 2a076fb9-bfde-4c94-9329-8a67e01ff99b could not be found. Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d1ddcb9d-06a3-4cf4-8772-df1ecb590c66 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Request method failure captured: Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b HTTP/1.1 Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIWPz962mdHtc9XHyrAcVXHdJFghbYsIvDNTvo_IjlCVwM1TaGMeiSHCaV_bQZ5iNmpH1fsGIhn5WBF5gAgU1s0Nc-ReXLhTwfg1EddZKmimCtnj80-XT6LRGK2tqYr3veKXUqO3-oYgEQXjMy28r4qaPNnBy9n8lud_iOSGF5L6CsU Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: d2d4825b0688430192af39abe94de27d Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TestServerMultinode-887480614 Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2d4825b0688430192af39abe94de27d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d2d4825b0688430192af39abe94de27d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2d4825b0688430192af39abe94de27d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d2d4825b0688430192af39abe94de27d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TestServerMultinode-887480614 Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: d2d4825b0688430192af39abe94de27d Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TestServerMultinode-887480614 Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TestServerMultinode-887480614-project-admin Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: e5ffc7c6dd3d4f90967076b917a959e1 Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TestServerMultinode-887480614-project-admin Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 2a076fb9-bfde-4c94-9329-8a67e01ff99b could not be found. Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '2a076fb9-bfde-4c94-9329-8a67e01ff99b'} Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a076fb9-bfde-4c94-9329-8a67e01ff99b could not be found. Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a076fb9-bfde-4c94-9329-8a67e01ff99b could not be found. Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:45:43.159698 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:45:43.164619 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:45:43.164619 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:45:43.164619 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:45:43.164619 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:45:43.164619 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:45:43.164619 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a076fb9-bfde-4c94-9329-8a67e01ff99b could not be found. Oct 29 01:45:43.164619 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:45:43.169672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d1ddcb9d-06a3-4cf4-8772-df1ecb590c66 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Returning 404 to user: Instance 2a076fb9-bfde-4c94-9329-8a67e01ff99b could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:45:43.169672 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d1ddcb9d-06a3-4cf4-8772-df1ecb590c66 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b" status: 404 len: 111 microversion: 2.1 time: 0.062561 Oct 29 01:45:43.169672 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3393/7004] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:43 2022] GET /compute/v2.1/servers/2a076fb9-bfde-4c94-9329-8a67e01ff99b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:45:43.170797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e3f7a7c5-046d-49a3-9a75-bfd72dff6531 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:43.170797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e3f7a7c5-046d-49a3-9a75-bfd72dff6531 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:43.188654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3f7a7c5-046d-49a3-9a75-bfd72dff6531 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:43.189773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8000c086-9e9d-408f-a6c6-5672600f82e4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:43.193904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8000c086-9e9d-408f-a6c6-5672600f82e4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:43.196937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3f7a7c5-046d-49a3-9a75-bfd72dff6531 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:43.197683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3f7a7c5-046d-49a3-9a75-bfd72dff6531 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:43.201851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3f7a7c5-046d-49a3-9a75-bfd72dff6531 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:43.203963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3f7a7c5-046d-49a3-9a75-bfd72dff6531 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:43.204528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e3f7a7c5-046d-49a3-9a75-bfd72dff6531 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:43.214785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8000c086-9e9d-408f-a6c6-5672600f82e4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:43.215431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8000c086-9e9d-408f-a6c6-5672600f82e4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:43.215992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8000c086-9e9d-408f-a6c6-5672600f82e4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:43.218665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8000c086-9e9d-408f-a6c6-5672600f82e4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:43.219434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8000c086-9e9d-408f-a6c6-5672600f82e4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:43.220769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8000c086-9e9d-408f-a6c6-5672600f82e4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:43.270203 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e3f7a7c5-046d-49a3-9a75-bfd72dff6531 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a/ips" status: 200 len: 109 microversion: 2.1 time: 0.117770 Oct 29 01:45:43.272197 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3612/7005] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 29 01:45:43 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a/ips => generated 109 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:45:43.276227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8000c086-9e9d-408f-a6c6-5672600f82e4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:45:43.282915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-db8a417c-cc07-4087-b206-efeca1fa3b9f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:43.283802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-db8a417c-cc07-4087-b206-efeca1fa3b9f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:43.316340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db8a417c-cc07-4087-b206-efeca1fa3b9f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:43.317856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db8a417c-cc07-4087-b206-efeca1fa3b9f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:43.319500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db8a417c-cc07-4087-b206-efeca1fa3b9f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:43.322228 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db8a417c-cc07-4087-b206-efeca1fa3b9f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:43.323707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db8a417c-cc07-4087-b206-efeca1fa3b9f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:43.325777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db8a417c-cc07-4087-b206-efeca1fa3b9f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:43.383785 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-db8a417c-cc07-4087-b206-efeca1fa3b9f tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a/ips/tempest-ServerAddressesTestJSON-1985101928-network" status: 200 len: 94 microversion: 2.1 time: 0.105157 Oct 29 01:45:43.385069 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3613/7006] 10.222.0.26 () {58 vars in 1401 bytes} [Sat Oct 29 01:45:43 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a/ips/tempest-ServerAddressesTestJSON-1985101928-network => generated 94 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:45:43.398439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-39528129-e892-474e-9db7-888bdd023bfa tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:43.399702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-39528129-e892-474e-9db7-888bdd023bfa tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:43.406622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39528129-e892-474e-9db7-888bdd023bfa tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:43.407472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39528129-e892-474e-9db7-888bdd023bfa tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:43.408135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39528129-e892-474e-9db7-888bdd023bfa tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:43.409085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39528129-e892-474e-9db7-888bdd023bfa tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:43.409855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39528129-e892-474e-9db7-888bdd023bfa tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:43.410501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-39528129-e892-474e-9db7-888bdd023bfa tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:43.479694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-39528129-e892-474e-9db7-888bdd023bfa tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:45:43.670883 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8000c086-9e9d-408f-a6c6-5672600f82e4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "DELETE /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 204 len: 0 microversion: 2.1 time: 0.496327 Oct 29 01:45:43.671499 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3394/7007] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:45:43 2022] DELETE /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:45:43.680151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-153a7a3e-5335-4636-b955-9e7c0f5cade4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:43.681120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-153a7a3e-5335-4636-b955-9e7c0f5cade4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:43.696099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-153a7a3e-5335-4636-b955-9e7c0f5cade4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:43.696864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-153a7a3e-5335-4636-b955-9e7c0f5cade4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:43.697526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-153a7a3e-5335-4636-b955-9e7c0f5cade4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:43.698448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-153a7a3e-5335-4636-b955-9e7c0f5cade4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:43.699093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-153a7a3e-5335-4636-b955-9e7c0f5cade4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:43.699703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-153a7a3e-5335-4636-b955-9e7c0f5cade4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:43.781444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:43.877916 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-39528129-e892-474e-9db7-888bdd023bfa tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "DELETE /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 204 len: 0 microversion: 2.1 time: 0.483044 Oct 29 01:45:43.879369 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3614/7008] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:45:43 2022] DELETE /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:45:43.890853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1a5552c4-f71d-4920-b6d5-a007989af055 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:43.894883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1a5552c4-f71d-4920-b6d5-a007989af055 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:43.912867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a5552c4-f71d-4920-b6d5-a007989af055 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:43.913395 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a5552c4-f71d-4920-b6d5-a007989af055 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:43.914190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a5552c4-f71d-4920-b6d5-a007989af055 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:43.914545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a5552c4-f71d-4920-b6d5-a007989af055 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:43.915004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a5552c4-f71d-4920-b6d5-a007989af055 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:43.915434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a5552c4-f71d-4920-b6d5-a007989af055 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:43.980211 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-153a7a3e-5335-4636-b955-9e7c0f5cade4 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1654 microversion: 2.1 time: 0.304037 Oct 29 01:45:43.980801 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3395/7009] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:43 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1654 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:45:44.001831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-458797f9-d237-47b7-9180-da34f1c415c6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:44.002370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-458797f9-d237-47b7-9180-da34f1c415c6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:44.008703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-458797f9-d237-47b7-9180-da34f1c415c6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:44.009494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-458797f9-d237-47b7-9180-da34f1c415c6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:44.010116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-458797f9-d237-47b7-9180-da34f1c415c6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:44.010995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-458797f9-d237-47b7-9180-da34f1c415c6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:44.011623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-458797f9-d237-47b7-9180-da34f1c415c6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:44.012252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-458797f9-d237-47b7-9180-da34f1c415c6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:44.197262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-458797f9-d237-47b7-9180-da34f1c415c6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:44.209465 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-458797f9-d237-47b7-9180-da34f1c415c6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1229 microversion: 2.1 time: 0.212748 Oct 29 01:45:44.225550 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3396/7010] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:43 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1229 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:44.274970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1a5552c4-f71d-4920-b6d5-a007989af055 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:44.296120 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1a5552c4-f71d-4920-b6d5-a007989af055 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1512 microversion: 2.1 time: 0.409716 Oct 29 01:45:44.313905 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3615/7011] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:43 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1512 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:44.943350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-35828d63-32ed-4f18-b7c4-d6c697485d0c req-3def8309-0269-46e8-9e3f-7ddee5163efe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73da8296-b0b1-4378-b763-e307fb2cfee1", "tag": "95214dad-1a07-41ae-9304-917a7c26ff93"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:45:44.960619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:44.963501 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:44.967881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-35828d63-32ed-4f18-b7c4-d6c697485d0c req-3def8309-0269-46e8-9e3f-7ddee5163efe service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:44.968515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-35828d63-32ed-4f18-b7c4-d6c697485d0c req-3def8309-0269-46e8-9e3f-7ddee5163efe service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:44.968797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-35828d63-32ed-4f18-b7c4-d6c697485d0c req-3def8309-0269-46e8-9e3f-7ddee5163efe service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:44.992695 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-35828d63-32ed-4f18-b7c4-d6c697485d0c req-3def8309-0269-46e8-9e3f-7ddee5163efe service nova] Creating event network-changed:95214dad-1a07-41ae-9304-917a7c26ff93 for instance 73da8296-b0b1-4378-b763-e307fb2cfee1 on n-h1-862964-3 Oct 29 01:45:45.004834 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-35828d63-32ed-4f18-b7c4-d6c697485d0c req-3def8309-0269-46e8-9e3f-7ddee5163efe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065437 Oct 29 01:45:45.005550 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3397/7012] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:45:45.013432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c4d6ea9e-0158-49c1-8983-e7ee4f39a434 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:45.013432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c4d6ea9e-0158-49c1-8983-e7ee4f39a434 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:45.032136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4d6ea9e-0158-49c1-8983-e7ee4f39a434 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:45.034143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4d6ea9e-0158-49c1-8983-e7ee4f39a434 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:45.037540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4d6ea9e-0158-49c1-8983-e7ee4f39a434 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:45.042561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4d6ea9e-0158-49c1-8983-e7ee4f39a434 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:45.042561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4d6ea9e-0158-49c1-8983-e7ee4f39a434 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:45.042561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c4d6ea9e-0158-49c1-8983-e7ee4f39a434 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:45.235693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-343b453b-0118-4838-8ea8-332e01c1d08e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:45.239405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-343b453b-0118-4838-8ea8-332e01c1d08e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:45.251868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-343b453b-0118-4838-8ea8-332e01c1d08e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:45.254259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-343b453b-0118-4838-8ea8-332e01c1d08e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:45.258466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-343b453b-0118-4838-8ea8-332e01c1d08e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:45.260206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-343b453b-0118-4838-8ea8-332e01c1d08e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:45.264480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-343b453b-0118-4838-8ea8-332e01c1d08e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:45.265824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-343b453b-0118-4838-8ea8-332e01c1d08e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:45.957906 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c4d6ea9e-0158-49c1-8983-e7ee4f39a434 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1654 microversion: 2.1 time: 0.956297 Oct 29 01:45:45.960516 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3616/7013] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:45 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1654 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:45.973480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d7437f9a-c788-476a-b759-b9ea4629e9d2 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:45.974634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d7437f9a-c788-476a-b759-b9ea4629e9d2 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:45.992547 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7437f9a-c788-476a-b759-b9ea4629e9d2 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:45.993055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7437f9a-c788-476a-b759-b9ea4629e9d2 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:45.995897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7437f9a-c788-476a-b759-b9ea4629e9d2 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:45.996720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7437f9a-c788-476a-b759-b9ea4629e9d2 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:45.997250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7437f9a-c788-476a-b759-b9ea4629e9d2 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:46.004476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7437f9a-c788-476a-b759-b9ea4629e9d2 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:46.060134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:46.105337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-343b453b-0118-4838-8ea8-332e01c1d08e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:46.133328 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-343b453b-0118-4838-8ea8-332e01c1d08e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1229 microversion: 2.1 time: 0.887497 Oct 29 01:45:46.133328 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3398/7014] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:45 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1229 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:46.398610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d7437f9a-c788-476a-b759-b9ea4629e9d2 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:46.414984 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d7437f9a-c788-476a-b759-b9ea4629e9d2 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1512 microversion: 2.1 time: 0.452998 Oct 29 01:45:46.415786 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3617/7015] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:45 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1512 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:46.799952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-2f605e41-ad5e-4e7e-bae2-c1942b7d2a2c req-d74759c2-0c26-4f98-abfa-0c61e32dde53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19086576-f662-4bd2-bf34-222c9b4669ac", "name": "network-vif-deleted", "tag": "9bbb7a5b-b7e3-4bae-ac99-9d5fbc06c2d7"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:45:46.830890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2f605e41-ad5e-4e7e-bae2-c1942b7d2a2c req-d74759c2-0c26-4f98-abfa-0c61e32dde53 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:46.830890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2f605e41-ad5e-4e7e-bae2-c1942b7d2a2c req-d74759c2-0c26-4f98-abfa-0c61e32dde53 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:46.830890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2f605e41-ad5e-4e7e-bae2-c1942b7d2a2c req-d74759c2-0c26-4f98-abfa-0c61e32dde53 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:46.843488 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-2f605e41-ad5e-4e7e-bae2-c1942b7d2a2c req-d74759c2-0c26-4f98-abfa-0c61e32dde53 service nova] Creating event network-vif-deleted:9bbb7a5b-b7e3-4bae-ac99-9d5fbc06c2d7 for instance 19086576-f662-4bd2-bf34-222c9b4669ac on n-h1-862964-3 Oct 29 01:45:46.850234 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-2f605e41-ad5e-4e7e-bae2-c1942b7d2a2c req-d74759c2-0c26-4f98-abfa-0c61e32dde53 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056942 Oct 29 01:45:46.851521 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3399/7016] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:45:46.990522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d34bbfbb-03dd-4149-8200-a4de57d73755 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:46.991425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d34bbfbb-03dd-4149-8200-a4de57d73755 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:46.994517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:47.019180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d34bbfbb-03dd-4149-8200-a4de57d73755 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:47.020913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d34bbfbb-03dd-4149-8200-a4de57d73755 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:47.021623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d34bbfbb-03dd-4149-8200-a4de57d73755 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:47.022657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d34bbfbb-03dd-4149-8200-a4de57d73755 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:47.023361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d34bbfbb-03dd-4149-8200-a4de57d73755 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:47.024003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d34bbfbb-03dd-4149-8200-a4de57d73755 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:47.150929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c0adc244-136c-4324-9650-f97ac051c21b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:47.155524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c0adc244-136c-4324-9650-f97ac051c21b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:47.173506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0adc244-136c-4324-9650-f97ac051c21b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:47.174602 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d34bbfbb-03dd-4149-8200-a4de57d73755 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1449 microversion: 2.1 time: 0.188303 Oct 29 01:45:47.175123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0adc244-136c-4324-9650-f97ac051c21b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:47.175874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0adc244-136c-4324-9650-f97ac051c21b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:47.178100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0adc244-136c-4324-9650-f97ac051c21b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:47.180297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0adc244-136c-4324-9650-f97ac051c21b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:47.181057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c0adc244-136c-4324-9650-f97ac051c21b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:47.189758 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3618/7017] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:46 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1449 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:47.409129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c0adc244-136c-4324-9650-f97ac051c21b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:47.418891 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c0adc244-136c-4324-9650-f97ac051c21b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1229 microversion: 2.1 time: 0.273365 Oct 29 01:45:47.419469 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3400/7018] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:47 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1229 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:47.438626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-db9afd25-c380-4cd4-8e19-908bb70cdcd1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:47.439240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-db9afd25-c380-4cd4-8e19-908bb70cdcd1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:47.446093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db9afd25-c380-4cd4-8e19-908bb70cdcd1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:47.446574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db9afd25-c380-4cd4-8e19-908bb70cdcd1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:47.447061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db9afd25-c380-4cd4-8e19-908bb70cdcd1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:47.447776 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db9afd25-c380-4cd4-8e19-908bb70cdcd1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:47.448230 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db9afd25-c380-4cd4-8e19-908bb70cdcd1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:47.448654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-db9afd25-c380-4cd4-8e19-908bb70cdcd1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:47.537135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-db9afd25-c380-4cd4-8e19-908bb70cdcd1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf8274a2d4c4890a0c585f3b533757e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c075d007b8249628a076224d1fcdc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:47.548986 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-db9afd25-c380-4cd4-8e19-908bb70cdcd1 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 200 len: 1302 microversion: 2.1 time: 0.114290 Oct 29 01:45:47.556476 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3619/7019] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:47 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 1302 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:48.202512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-17a24a1b-8b88-4be8-b082-c4f70f256209 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:48.203138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-17a24a1b-8b88-4be8-b082-c4f70f256209 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:48.217967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17a24a1b-8b88-4be8-b082-c4f70f256209 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:48.219210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17a24a1b-8b88-4be8-b082-c4f70f256209 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:48.219874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17a24a1b-8b88-4be8-b082-c4f70f256209 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:48.220780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17a24a1b-8b88-4be8-b082-c4f70f256209 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:48.224292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17a24a1b-8b88-4be8-b082-c4f70f256209 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:48.225027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17a24a1b-8b88-4be8-b082-c4f70f256209 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:48.277627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17a24a1b-8b88-4be8-b082-c4f70f256209 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:48.278129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17a24a1b-8b88-4be8-b082-c4f70f256209 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:48.278607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-17a24a1b-8b88-4be8-b082-c4f70f256209 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:48.279070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-17a24a1b-8b88-4be8-b082-c4f70f256209 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lazy-loading 'fault' on Instance uuid 19086576-f662-4bd2-bf34-222c9b4669ac {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:45:48.348370 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-17a24a1b-8b88-4be8-b082-c4f70f256209 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 200 len: 1454 microversion: 2.1 time: 0.150513 Oct 29 01:45:48.361879 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3401/7020] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:48 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:48.442567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5dbcd621-2c9c-487b-81fd-c9fd58322afe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:48.443997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5dbcd621-2c9c-487b-81fd-c9fd58322afe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:48.454028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5dbcd621-2c9c-487b-81fd-c9fd58322afe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:48.454028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5dbcd621-2c9c-487b-81fd-c9fd58322afe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:48.454028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5dbcd621-2c9c-487b-81fd-c9fd58322afe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:48.454028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5dbcd621-2c9c-487b-81fd-c9fd58322afe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:48.454028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5dbcd621-2c9c-487b-81fd-c9fd58322afe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:48.455287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5dbcd621-2c9c-487b-81fd-c9fd58322afe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:48.578505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-83b9d14b-1bc6-49b4-bd52-7798a905f499 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:48.578932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-83b9d14b-1bc6-49b4-bd52-7798a905f499 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] [instance: 553d9e36-ec89-4e8e-8858-4c3d771ee57a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:48.590725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83b9d14b-1bc6-49b4-bd52-7798a905f499 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:48.591253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83b9d14b-1bc6-49b4-bd52-7798a905f499 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:48.592103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83b9d14b-1bc6-49b4-bd52-7798a905f499 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:48.594035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83b9d14b-1bc6-49b4-bd52-7798a905f499 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:48.595922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83b9d14b-1bc6-49b4-bd52-7798a905f499 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:48.597759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83b9d14b-1bc6-49b4-bd52-7798a905f499 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:48.615616 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-83b9d14b-1bc6-49b4-bd52-7798a905f499 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] HTTP exception thrown: Instance 553d9e36-ec89-4e8e-8858-4c3d771ee57a could not be found. Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-83b9d14b-1bc6-49b4-bd52-7798a905f499 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Request method failure captured: Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a HTTP/1.1 Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIWs_JIqHg5_wOy-xcsjmh4iThuZRxu0KQLSWoU9D3F8Zb_9dKOC_OWGxWm_VMpvCRQGbrpyim3Ek5Y5190JTvpKY6EE8-t4uijdQuz_A0eEofNezfPM28qaN1qje9OVMPcqqsZXS8BlTNyyo-fxrmoaFP1jB-JzMfT8VnaAA4OzRkA Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 4c075d007b8249628a076224d1fcdc7d Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerAddressesTestJSON-1405216405 Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c075d007b8249628a076224d1fcdc7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4c075d007b8249628a076224d1fcdc7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c075d007b8249628a076224d1fcdc7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4c075d007b8249628a076224d1fcdc7d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerAddressesTestJSON-1405216405 Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 4c075d007b8249628a076224d1fcdc7d Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1405216405 Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerAddressesTestJSON-1405216405-project Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: adf8274a2d4c4890a0c585f3b533757e Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerAddressesTestJSON-1405216405-project Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 553d9e36-ec89-4e8e-8858-4c3d771ee57a could not be found. Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '553d9e36-ec89-4e8e-8858-4c3d771ee57a'} Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 553d9e36-ec89-4e8e-8858-4c3d771ee57a could not be found. Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 553d9e36-ec89-4e8e-8858-4c3d771ee57a could not be found. Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:45:48.617438 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:45:48.621884 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:45:48.621884 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:45:48.621884 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:45:48.621884 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:45:48.621884 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:45:48.621884 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 553d9e36-ec89-4e8e-8858-4c3d771ee57a could not be found. Oct 29 01:45:48.621884 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:45:48.621884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-83b9d14b-1bc6-49b4-bd52-7798a905f499 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] Returning 404 to user: Instance 553d9e36-ec89-4e8e-8858-4c3d771ee57a could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:45:48.621884 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-83b9d14b-1bc6-49b4-bd52-7798a905f499 tempest-ServerAddressesTestJSON-1405216405 tempest-ServerAddressesTestJSON-1405216405-project] 10.222.0.26 "GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a" status: 404 len: 111 microversion: 2.1 time: 0.044797 Oct 29 01:45:48.624370 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3402/7021] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:48 2022] GET /compute/v2.1/servers/553d9e36-ec89-4e8e-8858-4c3d771ee57a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:45:48.664670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5dbcd621-2c9c-487b-81fd-c9fd58322afe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:48.671997 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5dbcd621-2c9c-487b-81fd-c9fd58322afe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1217 microversion: 2.1 time: 0.233323 Oct 29 01:45:48.677250 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3620/7022] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:48 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1217 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:48.882925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-cc181e69-9309-40b9-bf51-cc3c5ed42de4 req-383d0336-6a19-46a2-9da4-97a236005da9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "553d9e36-ec89-4e8e-8858-4c3d771ee57a", "name": "network-vif-deleted", "tag": "517bc126-5058-47e1-956c-710d5bc270b6"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:45:48.896957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-cc181e69-9309-40b9-bf51-cc3c5ed42de4 req-383d0336-6a19-46a2-9da4-97a236005da9 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:48.897672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-cc181e69-9309-40b9-bf51-cc3c5ed42de4 req-383d0336-6a19-46a2-9da4-97a236005da9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:48.909682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-cc181e69-9309-40b9-bf51-cc3c5ed42de4 req-383d0336-6a19-46a2-9da4-97a236005da9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:48.955964 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-cc181e69-9309-40b9-bf51-cc3c5ed42de4 req-383d0336-6a19-46a2-9da4-97a236005da9 service nova] Creating event network-vif-deleted:517bc126-5058-47e1-956c-710d5bc270b6 for instance 553d9e36-ec89-4e8e-8858-4c3d771ee57a on n-h2-862964-3 Oct 29 01:45:48.965997 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-cc181e69-9309-40b9-bf51-cc3c5ed42de4 req-383d0336-6a19-46a2-9da4-97a236005da9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099616 Oct 29 01:45:48.965997 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3403/7023] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:45:49.376770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bc7fe27d-0520-4235-ab5f-a7f99f8fe4e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:49.378050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bc7fe27d-0520-4235-ab5f-a7f99f8fe4e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] [instance: 19086576-f662-4bd2-bf34-222c9b4669ac] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:49.393742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc7fe27d-0520-4235-ab5f-a7f99f8fe4e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:49.394498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc7fe27d-0520-4235-ab5f-a7f99f8fe4e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:49.395123 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc7fe27d-0520-4235-ab5f-a7f99f8fe4e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:49.396020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc7fe27d-0520-4235-ab5f-a7f99f8fe4e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:49.396703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc7fe27d-0520-4235-ab5f-a7f99f8fe4e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:49.397139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bc7fe27d-0520-4235-ab5f-a7f99f8fe4e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:49.412457 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-bc7fe27d-0520-4235-ab5f-a7f99f8fe4e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] HTTP exception thrown: Instance 19086576-f662-4bd2-bf34-222c9b4669ac could not be found. Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bc7fe27d-0520-4235-ab5f-a7f99f8fe4e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Request method failure captured: Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac HTTP/1.1 Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIWPz962mdHtc9XHyrAcVXHdJFghbYsIvDNTvo_IjlCVwM1TaGMeiSHCaV_bQZ5iNmpH1fsGIhn5WBF5gAgU1s0Nc-ReXLhTwfg1EddZKmimCtnj80-XT6LRGK2tqYr3veKXUqO3-oYgEQXjMy28r4qaPNnBy9n8lud_iOSGF5L6CsU Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: d2d4825b0688430192af39abe94de27d Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-TestServerMultinode-887480614 Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2d4825b0688430192af39abe94de27d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d2d4825b0688430192af39abe94de27d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2d4825b0688430192af39abe94de27d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d2d4825b0688430192af39abe94de27d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-TestServerMultinode-887480614 Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: d2d4825b0688430192af39abe94de27d Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-TestServerMultinode-887480614 Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-TestServerMultinode-887480614-project-admin Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: e5ffc7c6dd3d4f90967076b917a959e1 Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-TestServerMultinode-887480614-project-admin Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 19086576-f662-4bd2-bf34-222c9b4669ac could not be found. Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '19086576-f662-4bd2-bf34-222c9b4669ac'} Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19086576-f662-4bd2-bf34-222c9b4669ac could not be found. Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19086576-f662-4bd2-bf34-222c9b4669ac could not be found. Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:45:49.414391 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:45:49.423346 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:45:49.423346 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:45:49.423346 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:45:49.423346 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:45:49.423346 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:45:49.423346 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19086576-f662-4bd2-bf34-222c9b4669ac could not be found. Oct 29 01:45:49.423346 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:45:49.423346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bc7fe27d-0520-4235-ab5f-a7f99f8fe4e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] Returning 404 to user: Instance 19086576-f662-4bd2-bf34-222c9b4669ac could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:45:49.423346 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bc7fe27d-0520-4235-ab5f-a7f99f8fe4e9 tempest-TestServerMultinode-887480614 tempest-TestServerMultinode-887480614-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac" status: 404 len: 111 microversion: 2.1 time: 0.044253 Oct 29 01:45:49.423346 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3621/7024] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:49 2022] GET /compute/v2.1/servers/19086576-f662-4bd2-bf34-222c9b4669ac => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:45:49.697821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a4f8fdca-ee0f-47ca-a7fd-d716bf42a99e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:49.699368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a4f8fdca-ee0f-47ca-a7fd-d716bf42a99e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:49.719115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4f8fdca-ee0f-47ca-a7fd-d716bf42a99e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:49.719645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4f8fdca-ee0f-47ca-a7fd-d716bf42a99e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:49.720091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4f8fdca-ee0f-47ca-a7fd-d716bf42a99e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:49.720811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4f8fdca-ee0f-47ca-a7fd-d716bf42a99e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:49.721300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4f8fdca-ee0f-47ca-a7fd-d716bf42a99e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:49.721729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4f8fdca-ee0f-47ca-a7fd-d716bf42a99e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:50.046097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a4f8fdca-ee0f-47ca-a7fd-d716bf42a99e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:50.061550 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a4f8fdca-ee0f-47ca-a7fd-d716bf42a99e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1217 microversion: 2.1 time: 0.368660 Oct 29 01:45:50.063785 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3404/7025] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:49 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1217 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:51.095445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ecaae7d1-9dd6-49bd-aac0-33d919afa160 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:51.097193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ecaae7d1-9dd6-49bd-aac0-33d919afa160 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:51.116778 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ecaae7d1-9dd6-49bd-aac0-33d919afa160 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:51.118588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ecaae7d1-9dd6-49bd-aac0-33d919afa160 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:51.118588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ecaae7d1-9dd6-49bd-aac0-33d919afa160 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:51.119811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ecaae7d1-9dd6-49bd-aac0-33d919afa160 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:51.120519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ecaae7d1-9dd6-49bd-aac0-33d919afa160 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:51.121286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ecaae7d1-9dd6-49bd-aac0-33d919afa160 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:51.497276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ecaae7d1-9dd6-49bd-aac0-33d919afa160 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:51.512813 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ecaae7d1-9dd6-49bd-aac0-33d919afa160 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1217 microversion: 2.1 time: 0.425861 Oct 29 01:45:51.548534 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3622/7026] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:51 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1217 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:52.540288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5fccb292-7fc0-488b-ac41-01b335ae76ed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:52.541026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5fccb292-7fc0-488b-ac41-01b335ae76ed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:52.552847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:52.563980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fccb292-7fc0-488b-ac41-01b335ae76ed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:52.569848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fccb292-7fc0-488b-ac41-01b335ae76ed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:52.572355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fccb292-7fc0-488b-ac41-01b335ae76ed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:52.573416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fccb292-7fc0-488b-ac41-01b335ae76ed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:52.574241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fccb292-7fc0-488b-ac41-01b335ae76ed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:52.577786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5fccb292-7fc0-488b-ac41-01b335ae76ed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:52.988321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5fccb292-7fc0-488b-ac41-01b335ae76ed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:53.003236 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5fccb292-7fc0-488b-ac41-01b335ae76ed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1217 microversion: 2.1 time: 0.466595 Oct 29 01:45:53.023753 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3405/7027] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:52 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1217 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:54.027529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f0184d9b-fa94-414e-953f-791b284692fb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:54.028972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f0184d9b-fa94-414e-953f-791b284692fb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:54.047553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0184d9b-fa94-414e-953f-791b284692fb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:54.048359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0184d9b-fa94-414e-953f-791b284692fb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:54.049209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0184d9b-fa94-414e-953f-791b284692fb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:54.050098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0184d9b-fa94-414e-953f-791b284692fb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:54.050725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0184d9b-fa94-414e-953f-791b284692fb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:54.051587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f0184d9b-fa94-414e-953f-791b284692fb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:54.980780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f0184d9b-fa94-414e-953f-791b284692fb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:55.035353 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f0184d9b-fa94-414e-953f-791b284692fb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1217 microversion: 2.1 time: 1.002688 Oct 29 01:45:55.065532 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3623/7028] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:54 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1217 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:56.066729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-527f0cc4-e0b7-417b-abe1-90c5f1083204 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:56.067372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-527f0cc4-e0b7-417b-abe1-90c5f1083204 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:56.086794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-527f0cc4-e0b7-417b-abe1-90c5f1083204 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:56.087302 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-527f0cc4-e0b7-417b-abe1-90c5f1083204 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:56.087758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-527f0cc4-e0b7-417b-abe1-90c5f1083204 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:56.088490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-527f0cc4-e0b7-417b-abe1-90c5f1083204 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:56.088956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-527f0cc4-e0b7-417b-abe1-90c5f1083204 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:56.089421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-527f0cc4-e0b7-417b-abe1-90c5f1083204 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:56.372404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-527f0cc4-e0b7-417b-abe1-90c5f1083204 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:56.401825 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-527f0cc4-e0b7-417b-abe1-90c5f1083204 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1217 microversion: 2.1 time: 0.339020 Oct 29 01:45:56.403271 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3406/7029] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:56 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1217 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:57.438126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d9493b49-27d3-4bac-9506-684861874602 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:57.439862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d9493b49-27d3-4bac-9506-684861874602 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:57.451908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:45:57.458446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9493b49-27d3-4bac-9506-684861874602 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:57.460210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9493b49-27d3-4bac-9506-684861874602 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:57.461580 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9493b49-27d3-4bac-9506-684861874602 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:57.466347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9493b49-27d3-4bac-9506-684861874602 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:57.467266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9493b49-27d3-4bac-9506-684861874602 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:57.468010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d9493b49-27d3-4bac-9506-684861874602 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:58.049335 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d9493b49-27d3-4bac-9506-684861874602 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:58.060166 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d9493b49-27d3-4bac-9506-684861874602 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1217 microversion: 2.1 time: 0.633475 Oct 29 01:45:58.074950 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3624/7030] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:57 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1217 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:45:59.087337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-60f9e82c-6e4b-44df-a945-4f1824e7c2ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:45:59.094532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-60f9e82c-6e4b-44df-a945-4f1824e7c2ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:45:59.113089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60f9e82c-6e4b-44df-a945-4f1824e7c2ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:59.113745 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60f9e82c-6e4b-44df-a945-4f1824e7c2ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:59.114899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60f9e82c-6e4b-44df-a945-4f1824e7c2ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:59.115750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60f9e82c-6e4b-44df-a945-4f1824e7c2ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:59.118578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60f9e82c-6e4b-44df-a945-4f1824e7c2ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:59.119495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-60f9e82c-6e4b-44df-a945-4f1824e7c2ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:59.218565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-70bbb16b-741e-4754-bd4a-eca370dfc94b req-71a216a5-52a3-45ef-b53b-62804b48c3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73da8296-b0b1-4378-b763-e307fb2cfee1", "name": "network-vif-plugged", "status": "completed", "tag": "95214dad-1a07-41ae-9304-917a7c26ff93"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:45:59.246585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-70bbb16b-741e-4754-bd4a-eca370dfc94b req-71a216a5-52a3-45ef-b53b-62804b48c3b1 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:45:59.248564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-70bbb16b-741e-4754-bd4a-eca370dfc94b req-71a216a5-52a3-45ef-b53b-62804b48c3b1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:45:59.254136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-70bbb16b-741e-4754-bd4a-eca370dfc94b req-71a216a5-52a3-45ef-b53b-62804b48c3b1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:45:59.274331 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-70bbb16b-741e-4754-bd4a-eca370dfc94b req-71a216a5-52a3-45ef-b53b-62804b48c3b1 service nova] Creating event network-vif-plugged:95214dad-1a07-41ae-9304-917a7c26ff93 for instance 73da8296-b0b1-4378-b763-e307fb2cfee1 on n-h1-862964-3 Oct 29 01:45:59.290457 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-70bbb16b-741e-4754-bd4a-eca370dfc94b req-71a216a5-52a3-45ef-b53b-62804b48c3b1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080824 Oct 29 01:45:59.291197 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3625/7031] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 29 01:45:59.516030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-60f9e82c-6e4b-44df-a945-4f1824e7c2ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:45:59.541609 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-60f9e82c-6e4b-44df-a945-4f1824e7c2ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1217 microversion: 2.1 time: 0.458753 Oct 29 01:45:59.542769 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3407/7032] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:45:59 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1217 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:00.572027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3b6a0b76-f907-46ff-a1cc-612cb693bb83 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:00.582657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3b6a0b76-f907-46ff-a1cc-612cb693bb83 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:00.597247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b6a0b76-f907-46ff-a1cc-612cb693bb83 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:00.597247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b6a0b76-f907-46ff-a1cc-612cb693bb83 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:00.597247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b6a0b76-f907-46ff-a1cc-612cb693bb83 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:00.597247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b6a0b76-f907-46ff-a1cc-612cb693bb83 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:00.597247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b6a0b76-f907-46ff-a1cc-612cb693bb83 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:00.597699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3b6a0b76-f907-46ff-a1cc-612cb693bb83 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:01.108150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3b6a0b76-f907-46ff-a1cc-612cb693bb83 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:01.121496 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3b6a0b76-f907-46ff-a1cc-612cb693bb83 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1217 microversion: 2.1 time: 0.556400 Oct 29 01:46:01.138124 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3626/7033] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:00 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1217 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:02.157697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e4faf8bc-cbdc-4c93-b537-382ad3ead8bb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:02.163640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e4faf8bc-cbdc-4c93-b537-382ad3ead8bb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:02.172131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4faf8bc-cbdc-4c93-b537-382ad3ead8bb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:02.172922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4faf8bc-cbdc-4c93-b537-382ad3ead8bb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:02.173824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4faf8bc-cbdc-4c93-b537-382ad3ead8bb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:02.174720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4faf8bc-cbdc-4c93-b537-382ad3ead8bb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:02.175351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4faf8bc-cbdc-4c93-b537-382ad3ead8bb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:02.176087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e4faf8bc-cbdc-4c93-b537-382ad3ead8bb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:02.648602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e4faf8bc-cbdc-4c93-b537-382ad3ead8bb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:02.661828 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e4faf8bc-cbdc-4c93-b537-382ad3ead8bb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1405 microversion: 2.1 time: 0.511845 Oct 29 01:46:02.701537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-79f6a4d9-68c1-4b49-a598-d49d507d72c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:02.703265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-79f6a4d9-68c1-4b49-a598-d49d507d72c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:02.705726 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3408/7034] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:02 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1405 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:02.711544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79f6a4d9-68c1-4b49-a598-d49d507d72c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:02.712416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79f6a4d9-68c1-4b49-a598-d49d507d72c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:02.713349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79f6a4d9-68c1-4b49-a598-d49d507d72c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:02.715774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79f6a4d9-68c1-4b49-a598-d49d507d72c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:02.715774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79f6a4d9-68c1-4b49-a598-d49d507d72c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:02.716661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79f6a4d9-68c1-4b49-a598-d49d507d72c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:03.173983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-79f6a4d9-68c1-4b49-a598-d49d507d72c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:03.187640 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-79f6a4d9-68c1-4b49-a598-d49d507d72c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1405 microversion: 2.1 time: 0.496488 Oct 29 01:46:03.201419 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3627/7035] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:02 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1405 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:03.218108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2d1b00e1-fd87-438e-b169-e2186e84c1de tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-511910983"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:03.220517 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2d1b00e1-fd87-438e-b169-e2186e84c1de tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:03.229951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d1b00e1-fd87-438e-b169-e2186e84c1de tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:03.229951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d1b00e1-fd87-438e-b169-e2186e84c1de tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:03.229951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d1b00e1-fd87-438e-b169-e2186e84c1de tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:03.233733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d1b00e1-fd87-438e-b169-e2186e84c1de tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:03.234406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d1b00e1-fd87-438e-b169-e2186e84c1de tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:03.234867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d1b00e1-fd87-438e-b169-e2186e84c1de tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:03.456581 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.compute.api [None req-2d1b00e1-fd87-438e-b169-e2186e84c1de tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Attempting to quiesce instance before volume snapshot. Oct 29 01:46:03.521989 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.compute.api [None req-2d1b00e1-fd87-438e-b169-e2186e84c1de tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 29 01:46:03.800982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2d1b00e1-fd87-438e-b169-e2186e84c1de tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Creating snapshot from volume 1a7014b6-e0a2-4f22-bd6b-db2a71223b05. {{(pid=121100) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 29 01:46:06.441281 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2d1b00e1-fd87-438e-b169-e2186e84c1de tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "POST /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1/action" status: 202 len: 0 microversion: 2.1 time: 3.228934 Oct 29 01:46:06.443303 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3409/7036] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:46:03 2022] POST /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1/action => generated 0 bytes in 3232 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 01:46:08.902176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-38c3780e-b078-4fe4-8d2a-6aecb300adcd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1840994352", "imageRef": "b539e56e-e712-4bcb-839e-c38b0780c45f", "flavorRef": "452", "networks": [{"uuid": "d488ed61-ddc0-4d3b-9833-017b49869cf3"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:09.000439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-38c3780e-b078-4fe4-8d2a-6aecb300adcd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] validate_networks() for [('d488ed61-ddc0-4d3b-9833-017b49869cf3', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:46:10.546748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-38c3780e-b078-4fe4-8d2a-6aecb300adcd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:46:10.549971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-38c3780e-b078-4fe4-8d2a-6aecb300adcd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:46:10.549971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-38c3780e-b078-4fe4-8d2a-6aecb300adcd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:46:10.549971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-38c3780e-b078-4fe4-8d2a-6aecb300adcd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:46:10.549971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-38c3780e-b078-4fe4-8d2a-6aecb300adcd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:46:10.568838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38c3780e-b078-4fe4-8d2a-6aecb300adcd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:10.569850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38c3780e-b078-4fe4-8d2a-6aecb300adcd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:10.570549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38c3780e-b078-4fe4-8d2a-6aecb300adcd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:10.572458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38c3780e-b078-4fe4-8d2a-6aecb300adcd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:10.573315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38c3780e-b078-4fe4-8d2a-6aecb300adcd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:10.574003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-38c3780e-b078-4fe4-8d2a-6aecb300adcd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:10.625591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-38c3780e-b078-4fe4-8d2a-6aecb300adcd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Getting quotas for project 37416a9397fa4c6dbd0bfe8dee191577. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:46:10.632970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-38c3780e-b078-4fe4-8d2a-6aecb300adcd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Getting quotas for user 8b8f36d10fa340f784581a3cf9a15606 and project 37416a9397fa4c6dbd0bfe8dee191577. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:46:10.660507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-38c3780e-b078-4fe4-8d2a-6aecb300adcd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:46:10.664485 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-38c3780e-b078-4fe4-8d2a-6aecb300adcd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='fc8867e3-e673-4f42-93d1-e9265e6cb1dd',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:46:10.940594 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-38c3780e-b078-4fe4-8d2a-6aecb300adcd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.044501 Oct 29 01:46:10.942960 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3628/7037] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:46:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:46:10.957410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f6c07cc5-7344-4240-90c9-2080c928bef9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:10.958402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f6c07cc5-7344-4240-90c9-2080c928bef9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:11.214136 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f6c07cc5-7344-4240-90c9-2080c928bef9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:11.225696 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f6c07cc5-7344-4240-90c9-2080c928bef9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1230 microversion: 2.1 time: 0.273612 Oct 29 01:46:11.237515 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3410/7038] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:10 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1230 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:12.258898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a9fbc569-10f5-4671-8770-43e6ba718164 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:12.260672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a9fbc569-10f5-4671-8770-43e6ba718164 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:12.440416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a9fbc569-10f5-4671-8770-43e6ba718164 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:12.446100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b41178fd-3542-4ac0-8d47-78d1c315d381 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Action: 'create', calling method: .version_select at 0x7f9d9695e790>, body: {"keypair": {"name": "tempest-TestServerBasicOps-400162276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhnvEeA2vSmxlIMux4fqz9jhg3Lko0H/jcjGE33XfIGgn6Sbr098++9GXnJtcIxbxef8IMNvorCrP/dyuEpukf97zYYZHDjITbBMLNs6zyQGuKABdwwXMN+yIXpbjkTnQ=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:12.463883 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a9fbc569-10f5-4671-8770-43e6ba718164 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1230 microversion: 2.1 time: 0.203057 Oct 29 01:46:12.467541 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3411/7039] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:12 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1230 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:12.498898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b41178fd-3542-4ac0-8d47-78d1c315d381 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Getting quotas for project 9b4de4292db14d31bb9496569c083433. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:46:12.536105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b41178fd-3542-4ac0-8d47-78d1c315d381 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Getting quotas for user 7a39c840d5324ac19096e7c133e85da7 and project 9b4de4292db14d31bb9496569c083433. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:46:12.702022 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b41178fd-3542-4ac0-8d47-78d1c315d381 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.611711 Oct 29 01:46:12.709699 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3629/7040] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:46:12 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:46:13.492564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c26ddf5f-2c22-4497-80f7-a13f43d93e02 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:13.493255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c26ddf5f-2c22-4497-80f7-a13f43d93e02 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:13.509293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c26ddf5f-2c22-4497-80f7-a13f43d93e02 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:13.509293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c26ddf5f-2c22-4497-80f7-a13f43d93e02 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:13.509293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c26ddf5f-2c22-4497-80f7-a13f43d93e02 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:13.509293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c26ddf5f-2c22-4497-80f7-a13f43d93e02 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:13.509293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c26ddf5f-2c22-4497-80f7-a13f43d93e02 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:13.509293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c26ddf5f-2c22-4497-80f7-a13f43d93e02 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:13.635609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c26ddf5f-2c22-4497-80f7-a13f43d93e02 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:13.651220 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c26ddf5f-2c22-4497-80f7-a13f43d93e02 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1282 microversion: 2.1 time: 0.158512 Oct 29 01:46:13.651913 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3412/7041] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:13 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:13.652341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:13.657497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:13.669985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:13.670607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:13.671059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:13.674278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:13.674278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:13.674278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:13.830219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:46:13.831048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:46:13.832743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:46:13.833909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:46:13.834696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:46:14.152642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:14.164881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:14.165410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:14.165855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:14.166567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:14.167208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:14.167806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:14.223456 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a8d1e7f9-429c-4745-a391-5f9576f70da3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672/action" status: 202 len: 1138 microversion: 2.1 time: 0.578496 Oct 29 01:46:14.224419 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3630/7042] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:46:13 2022] POST /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672/action => generated 1138 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 29 01:46:14.247883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-092b009b-9f3e-4f50-ab15-cfbaf9feebca tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:14.249784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-092b009b-9f3e-4f50-ab15-cfbaf9feebca tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:14.258218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-092b009b-9f3e-4f50-ab15-cfbaf9feebca tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:14.259144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-092b009b-9f3e-4f50-ab15-cfbaf9feebca tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:14.260113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-092b009b-9f3e-4f50-ab15-cfbaf9feebca tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:14.261034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-092b009b-9f3e-4f50-ab15-cfbaf9feebca tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:14.276345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-092b009b-9f3e-4f50-ab15-cfbaf9feebca tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:14.277384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-092b009b-9f3e-4f50-ab15-cfbaf9feebca tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:14.311830 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:46:14.796648 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-092b009b-9f3e-4f50-ab15-cfbaf9feebca tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:14.810297 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-092b009b-9f3e-4f50-ab15-cfbaf9feebca tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1693 microversion: 2.1 time: 0.567332 Oct 29 01:46:14.810923 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3413/7043] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:14 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1693 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:14.827408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a4e0f3d3-7430-4e5f-b7e4-527098b5eb28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:14.828057 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a4e0f3d3-7430-4e5f-b7e4-527098b5eb28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:14.843650 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4e0f3d3-7430-4e5f-b7e4-527098b5eb28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:14.844173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4e0f3d3-7430-4e5f-b7e4-527098b5eb28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:14.844313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b6d30074-5a88-4b0e-8bea-5937b153f325 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-313759078", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:14.851314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4e0f3d3-7430-4e5f-b7e4-527098b5eb28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:14.852512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4e0f3d3-7430-4e5f-b7e4-527098b5eb28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:14.853415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4e0f3d3-7430-4e5f-b7e4-527098b5eb28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:14.854226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4e0f3d3-7430-4e5f-b7e4-527098b5eb28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:15.025769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-b6d30074-5a88-4b0e-8bea-5937b153f325 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] validate_networks() for [('dd57cfc3-8101-436c-856e-5c76944d1e54', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:46:15.212849 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a4e0f3d3-7430-4e5f-b7e4-527098b5eb28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:15.222927 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a4e0f3d3-7430-4e5f-b7e4-527098b5eb28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1300 microversion: 2.1 time: 0.410697 Oct 29 01:46:15.241251 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3414/7044] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:14 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1300 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:15.837876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f9f588aa-60ef-45f3-a22d-7bc2fc69419d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:15.838815 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f9f588aa-60ef-45f3-a22d-7bc2fc69419d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:15.847245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9f588aa-60ef-45f3-a22d-7bc2fc69419d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:15.847764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9f588aa-60ef-45f3-a22d-7bc2fc69419d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:15.848220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9f588aa-60ef-45f3-a22d-7bc2fc69419d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:15.849426 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9f588aa-60ef-45f3-a22d-7bc2fc69419d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:15.850083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9f588aa-60ef-45f3-a22d-7bc2fc69419d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:15.850727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f9f588aa-60ef-45f3-a22d-7bc2fc69419d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:16.317474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f9f588aa-60ef-45f3-a22d-7bc2fc69419d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:16.334899 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f9f588aa-60ef-45f3-a22d-7bc2fc69419d tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1693 microversion: 2.1 time: 0.501710 Oct 29 01:46:16.335142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b6d30074-5a88-4b0e-8bea-5937b153f325 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:46:16.335582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b6d30074-5a88-4b0e-8bea-5937b153f325 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:46:16.335854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b6d30074-5a88-4b0e-8bea-5937b153f325 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:46:16.336266 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b6d30074-5a88-4b0e-8bea-5937b153f325 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:46:16.336694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-b6d30074-5a88-4b0e-8bea-5937b153f325 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:46:16.342189 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3415/7045] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:15 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1693 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:16.353320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-58801bd8-6311-40ff-b1d4-0ff3408d7e75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:16.366566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-58801bd8-6311-40ff-b1d4-0ff3408d7e75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:16.368043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6d30074-5a88-4b0e-8bea-5937b153f325 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:16.373077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6d30074-5a88-4b0e-8bea-5937b153f325 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:16.373077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6d30074-5a88-4b0e-8bea-5937b153f325 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:16.373077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6d30074-5a88-4b0e-8bea-5937b153f325 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:16.373077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6d30074-5a88-4b0e-8bea-5937b153f325 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:16.373077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6d30074-5a88-4b0e-8bea-5937b153f325 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:16.386188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58801bd8-6311-40ff-b1d4-0ff3408d7e75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:16.387018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58801bd8-6311-40ff-b1d4-0ff3408d7e75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:16.387664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58801bd8-6311-40ff-b1d4-0ff3408d7e75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:16.389420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58801bd8-6311-40ff-b1d4-0ff3408d7e75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:16.390325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58801bd8-6311-40ff-b1d4-0ff3408d7e75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:16.395154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-58801bd8-6311-40ff-b1d4-0ff3408d7e75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:16.413001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b6d30074-5a88-4b0e-8bea-5937b153f325 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Getting quotas for project 5451841ce3564e4d9a77cdac41619273. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:46:16.423751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-b6d30074-5a88-4b0e-8bea-5937b153f325 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Getting quotas for user f55bc7f1dee2477abb53f91d5ad58d3a and project 5451841ce3564e4d9a77cdac41619273. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:46:16.455757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b6d30074-5a88-4b0e-8bea-5937b153f325 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:46:16.467151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b6d30074-5a88-4b0e-8bea-5937b153f325 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:46:16.647087 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b6d30074-5a88-4b0e-8bea-5937b153f325 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.976002 Oct 29 01:46:16.654757 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3631/7046] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:46:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:46:16.659812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eeb390ec-262d-4d96-a7e0-ea6c4102385b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:16.660428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eeb390ec-262d-4d96-a7e0-ea6c4102385b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:16.711570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-58801bd8-6311-40ff-b1d4-0ff3408d7e75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:16.723090 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-58801bd8-6311-40ff-b1d4-0ff3408d7e75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1300 microversion: 2.1 time: 0.379170 Oct 29 01:46:16.724045 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3416/7047] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:16 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1300 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:16.799297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eeb390ec-262d-4d96-a7e0-ea6c4102385b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:16.809648 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eeb390ec-262d-4d96-a7e0-ea6c4102385b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1221 microversion: 2.1 time: 0.153700 Oct 29 01:46:16.811702 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3632/7048] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:16 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1221 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:16.917948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-86616211-2189-44dd-a498-3284e793181c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-127943030", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:17.066488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-86616211-2189-44dd-a498-3284e793181c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] validate_networks() for [('dd57cfc3-8101-436c-856e-5c76944d1e54', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:46:17.362429 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bee2d8c1-47ae-45da-9d04-6768a8621808 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:17.363914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bee2d8c1-47ae-45da-9d04-6768a8621808 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:17.379419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bee2d8c1-47ae-45da-9d04-6768a8621808 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:17.381295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bee2d8c1-47ae-45da-9d04-6768a8621808 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:17.384103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bee2d8c1-47ae-45da-9d04-6768a8621808 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:17.386519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bee2d8c1-47ae-45da-9d04-6768a8621808 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:17.392193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bee2d8c1-47ae-45da-9d04-6768a8621808 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:17.392964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bee2d8c1-47ae-45da-9d04-6768a8621808 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:17.400748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:46:17.999788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bee2d8c1-47ae-45da-9d04-6768a8621808 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:18.011644 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bee2d8c1-47ae-45da-9d04-6768a8621808 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1693 microversion: 2.1 time: 0.651663 Oct 29 01:46:18.013027 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3633/7049] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:17 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1693 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:18.020458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-928454265", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-400162276", "security_groups": [{"name": "tempest-secgroup-smoke-1495625054"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "c3bfc194-6b52-4798-84f7-0ccdba295cec"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:18.387060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] validate_networks() for [('c3bfc194-6b52-4798-84f7-0ccdba295cec', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:46:18.641329 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-86616211-2189-44dd-a498-3284e793181c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:46:18.641866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-86616211-2189-44dd-a498-3284e793181c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:46:18.642208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-86616211-2189-44dd-a498-3284e793181c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:46:18.642636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-86616211-2189-44dd-a498-3284e793181c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:46:18.644058 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-86616211-2189-44dd-a498-3284e793181c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:46:18.680686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86616211-2189-44dd-a498-3284e793181c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:18.681324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86616211-2189-44dd-a498-3284e793181c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:18.682634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86616211-2189-44dd-a498-3284e793181c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:18.693143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86616211-2189-44dd-a498-3284e793181c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:18.702601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86616211-2189-44dd-a498-3284e793181c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:18.702926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86616211-2189-44dd-a498-3284e793181c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:18.741810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-86616211-2189-44dd-a498-3284e793181c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Getting quotas for project 5451841ce3564e4d9a77cdac41619273. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:46:18.752483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-86616211-2189-44dd-a498-3284e793181c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Getting quotas for user f55bc7f1dee2477abb53f91d5ad58d3a and project 5451841ce3564e4d9a77cdac41619273. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:46:18.773778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-86616211-2189-44dd-a498-3284e793181c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:46:18.776658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-86616211-2189-44dd-a498-3284e793181c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:46:18.886886 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-86616211-2189-44dd-a498-3284e793181c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.987857 Oct 29 01:46:18.887935 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3417/7050] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:46:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 1990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:46:18.892840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b5acac2e-ad4d-4918-9659-0f8cc5769986 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:18.893710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b5acac2e-ad4d-4918-9659-0f8cc5769986 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:18.902006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5acac2e-ad4d-4918-9659-0f8cc5769986 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:18.904314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5acac2e-ad4d-4918-9659-0f8cc5769986 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:18.904314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5acac2e-ad4d-4918-9659-0f8cc5769986 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:18.904513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5acac2e-ad4d-4918-9659-0f8cc5769986 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:18.905050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5acac2e-ad4d-4918-9659-0f8cc5769986 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:18.905708 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b5acac2e-ad4d-4918-9659-0f8cc5769986 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:19.708230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b5acac2e-ad4d-4918-9659-0f8cc5769986 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:19.733124 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b5acac2e-ad4d-4918-9659-0f8cc5769986 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.843665 Oct 29 01:46:19.737033 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3418/7051] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:18 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:19.743864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-53d4da60-0162-42cd-8b47-32b2a6d3695f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:19.745578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-53d4da60-0162-42cd-8b47-32b2a6d3695f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:19.906445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Getting quotas for project 9b4de4292db14d31bb9496569c083433. Resources: dict_keys(['metadata_items']) {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:46:19.929773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Getting quotas for user 7a39c840d5324ac19096e7c133e85da7 and project 9b4de4292db14d31bb9496569c083433. Resources: dict_keys(['metadata_items']) {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:46:19.984328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:46:19.988545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:46:19.989061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:46:19.989536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:46:19.989965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:46:20.009422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-53d4da60-0162-42cd-8b47-32b2a6d3695f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:20.013455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:20.014389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:20.019515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:20.019515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:20.019515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:20.019515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:20.023004 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-53d4da60-0162-42cd-8b47-32b2a6d3695f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1221 microversion: 2.1 time: 0.286793 Oct 29 01:46:20.023654 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3419/7052] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:19 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1221 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:20.061000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-27114b20-2b02-455f-ab14-25c94fd461e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:20.062725 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-27114b20-2b02-455f-ab14-25c94fd461e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:20.067382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Getting quotas for project 9b4de4292db14d31bb9496569c083433. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:46:20.083794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27114b20-2b02-455f-ab14-25c94fd461e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:20.084136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Getting quotas for user 7a39c840d5324ac19096e7c133e85da7 and project 9b4de4292db14d31bb9496569c083433. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:46:20.084439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27114b20-2b02-455f-ab14-25c94fd461e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:20.084907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27114b20-2b02-455f-ab14-25c94fd461e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:20.088281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27114b20-2b02-455f-ab14-25c94fd461e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:20.088803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27114b20-2b02-455f-ab14-25c94fd461e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:20.089321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27114b20-2b02-455f-ab14-25c94fd461e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:20.109896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:46:20.112354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:46:20.303376 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9ba0128a-66c6-43dd-bf26-b7914d3858c3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.287958 Oct 29 01:46:20.304746 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3634/7053] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:46:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 2290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:46:20.316571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e22dbd0-bece-4f15-8cdd-43c3b7991426 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:20.317573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e22dbd0-bece-4f15-8cdd-43c3b7991426 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:20.417344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-27114b20-2b02-455f-ab14-25c94fd461e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:20.435577 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-27114b20-2b02-455f-ab14-25c94fd461e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1693 microversion: 2.1 time: 0.402804 Oct 29 01:46:20.442354 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3420/7054] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:20 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1693 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:20.508482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-5f2fb70a-a093-46d0-a158-c879680f4e1e req-7746577f-3ed0-4c7d-b2cd-13222730b647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d38796c0-9ae5-4bd1-8a93-99fe19e96e13", "tag": "c9fe9b9a-c8ae-49e6-9968-17e49688a5e7"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:20.543893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5f2fb70a-a093-46d0-a158-c879680f4e1e req-7746577f-3ed0-4c7d-b2cd-13222730b647 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:20.550925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5f2fb70a-a093-46d0-a158-c879680f4e1e req-7746577f-3ed0-4c7d-b2cd-13222730b647 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:20.550925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5f2fb70a-a093-46d0-a158-c879680f4e1e req-7746577f-3ed0-4c7d-b2cd-13222730b647 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:20.576365 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-5f2fb70a-a093-46d0-a158-c879680f4e1e req-7746577f-3ed0-4c7d-b2cd-13222730b647 service nova] Creating event network-changed:c9fe9b9a-c8ae-49e6-9968-17e49688a5e7 for instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 on n-h2-862964-3 Oct 29 01:46:20.589702 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-5f2fb70a-a093-46d0-a158-c879680f4e1e req-7746577f-3ed0-4c7d-b2cd-13222730b647 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085133 Oct 29 01:46:20.590335 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3421/7055] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:46:20.601795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8e22dbd0-bece-4f15-8cdd-43c3b7991426 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:20.611520 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8e22dbd0-bece-4f15-8cdd-43c3b7991426 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1301 microversion: 2.1 time: 0.299167 Oct 29 01:46:20.633761 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3635/7056] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:20 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1301 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:20.759926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1cc9c0e8-eea4-4308-b66a-4fbf9d1c2c2e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:20.761276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1cc9c0e8-eea4-4308-b66a-4fbf9d1c2c2e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:20.770572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cc9c0e8-eea4-4308-b66a-4fbf9d1c2c2e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:20.772900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cc9c0e8-eea4-4308-b66a-4fbf9d1c2c2e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:20.773505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cc9c0e8-eea4-4308-b66a-4fbf9d1c2c2e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:20.774446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cc9c0e8-eea4-4308-b66a-4fbf9d1c2c2e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:20.781317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cc9c0e8-eea4-4308-b66a-4fbf9d1c2c2e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:20.781722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1cc9c0e8-eea4-4308-b66a-4fbf9d1c2c2e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:21.011450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1cc9c0e8-eea4-4308-b66a-4fbf9d1c2c2e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:21.020620 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1cc9c0e8-eea4-4308-b66a-4fbf9d1c2c2e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.266041 Oct 29 01:46:21.021318 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3422/7057] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:20 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:21.051894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8cdd6ecc-3b46-455e-9604-f9e1feecf769 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:21.053293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8cdd6ecc-3b46-455e-9604-f9e1feecf769 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:21.081021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cdd6ecc-3b46-455e-9604-f9e1feecf769 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:21.081894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cdd6ecc-3b46-455e-9604-f9e1feecf769 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:21.084871 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cdd6ecc-3b46-455e-9604-f9e1feecf769 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:21.085856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cdd6ecc-3b46-455e-9604-f9e1feecf769 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:21.087652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cdd6ecc-3b46-455e-9604-f9e1feecf769 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:21.089261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8cdd6ecc-3b46-455e-9604-f9e1feecf769 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:21.252664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8cdd6ecc-3b46-455e-9604-f9e1feecf769 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:21.271499 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8cdd6ecc-3b46-455e-9604-f9e1feecf769 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1217 microversion: 2.1 time: 0.225818 Oct 29 01:46:21.285053 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3636/7058] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:21 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1217 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:21.484319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-52121b1c-cc0f-4a07-8275-d75fefa86c1f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:21.484643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-52121b1c-cc0f-4a07-8275-d75fefa86c1f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:21.512625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52121b1c-cc0f-4a07-8275-d75fefa86c1f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:21.512625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52121b1c-cc0f-4a07-8275-d75fefa86c1f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:21.512625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52121b1c-cc0f-4a07-8275-d75fefa86c1f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:21.518089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52121b1c-cc0f-4a07-8275-d75fefa86c1f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:21.519030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52121b1c-cc0f-4a07-8275-d75fefa86c1f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:21.519706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-52121b1c-cc0f-4a07-8275-d75fefa86c1f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:21.651908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d739ecf2-3e7b-451d-9b49-ca80cee32b59 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:21.652907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d739ecf2-3e7b-451d-9b49-ca80cee32b59 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:21.782212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d739ecf2-3e7b-451d-9b49-ca80cee32b59 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:21.803580 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d739ecf2-3e7b-451d-9b49-ca80cee32b59 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1301 microversion: 2.1 time: 0.167147 Oct 29 01:46:21.804460 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3637/7059] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:21 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1301 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:22.022456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-52121b1c-cc0f-4a07-8275-d75fefa86c1f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:22.038691 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-52121b1c-cc0f-4a07-8275-d75fefa86c1f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1693 microversion: 2.1 time: 0.567540 Oct 29 01:46:22.039134 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3423/7060] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:21 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1693 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:22.062992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ab29d9e8-e8d8-4a16-879e-82ca8f4fbbf3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:22.064716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ab29d9e8-e8d8-4a16-879e-82ca8f4fbbf3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:22.066927 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:46:22.106340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab29d9e8-e8d8-4a16-879e-82ca8f4fbbf3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:22.107598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab29d9e8-e8d8-4a16-879e-82ca8f4fbbf3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:22.108259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab29d9e8-e8d8-4a16-879e-82ca8f4fbbf3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:22.109343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab29d9e8-e8d8-4a16-879e-82ca8f4fbbf3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:22.110078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab29d9e8-e8d8-4a16-879e-82ca8f4fbbf3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:22.110940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ab29d9e8-e8d8-4a16-879e-82ca8f4fbbf3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:22.305303 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-edb46642-8d6a-4050-8030-777a6e5ce1a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:22.306286 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-edb46642-8d6a-4050-8030-777a6e5ce1a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:22.319313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edb46642-8d6a-4050-8030-777a6e5ce1a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:22.320643 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edb46642-8d6a-4050-8030-777a6e5ce1a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:22.321883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edb46642-8d6a-4050-8030-777a6e5ce1a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:22.343747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edb46642-8d6a-4050-8030-777a6e5ce1a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:22.343747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edb46642-8d6a-4050-8030-777a6e5ce1a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:22.343747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edb46642-8d6a-4050-8030-777a6e5ce1a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:22.580148 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-edb46642-8d6a-4050-8030-777a6e5ce1a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:22.594506 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-edb46642-8d6a-4050-8030-777a6e5ce1a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1281 microversion: 2.1 time: 0.291122 Oct 29 01:46:22.606795 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3424/7061] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:22 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1281 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:22.609989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ab29d9e8-e8d8-4a16-879e-82ca8f4fbbf3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:22.622225 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ab29d9e8-e8d8-4a16-879e-82ca8f4fbbf3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.564143 Oct 29 01:46:22.625184 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3638/7062] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:22 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:22.843956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b6db4cee-9f74-4f8f-b1f5-70f23aa7e8b6 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:22.844724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b6db4cee-9f74-4f8f-b1f5-70f23aa7e8b6 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:22.859104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6db4cee-9f74-4f8f-b1f5-70f23aa7e8b6 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:22.859615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6db4cee-9f74-4f8f-b1f5-70f23aa7e8b6 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:22.860069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6db4cee-9f74-4f8f-b1f5-70f23aa7e8b6 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:22.865879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6db4cee-9f74-4f8f-b1f5-70f23aa7e8b6 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:22.866584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6db4cee-9f74-4f8f-b1f5-70f23aa7e8b6 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:22.867054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6db4cee-9f74-4f8f-b1f5-70f23aa7e8b6 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:22.971092 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-f76326df-0ad5-4c15-9b00-3eafcfdcb89a req-6f08faa5-d14d-4c44-87e3-0e14b3a27ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4beaf925-018a-47ce-810e-b53329fe86a0", "tag": "10522071-aa4f-4b20-854c-677dc5abf590"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:22.974217 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b6db4cee-9f74-4f8f-b1f5-70f23aa7e8b6 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:22.991755 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b6db4cee-9f74-4f8f-b1f5-70f23aa7e8b6 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1297 microversion: 2.1 time: 0.159428 Oct 29 01:46:22.993067 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3425/7063] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:22 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1297 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:23.013832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f76326df-0ad5-4c15-9b00-3eafcfdcb89a req-6f08faa5-d14d-4c44-87e3-0e14b3a27ae2 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:23.014655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f76326df-0ad5-4c15-9b00-3eafcfdcb89a req-6f08faa5-d14d-4c44-87e3-0e14b3a27ae2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:23.015104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-f76326df-0ad5-4c15-9b00-3eafcfdcb89a req-6f08faa5-d14d-4c44-87e3-0e14b3a27ae2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:23.027860 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-f76326df-0ad5-4c15-9b00-3eafcfdcb89a req-6f08faa5-d14d-4c44-87e3-0e14b3a27ae2 service nova] Creating event network-changed:10522071-aa4f-4b20-854c-677dc5abf590 for instance 4beaf925-018a-47ce-810e-b53329fe86a0 on n-h2-862964-3 Oct 29 01:46:23.033606 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-f76326df-0ad5-4c15-9b00-3eafcfdcb89a req-6f08faa5-d14d-4c44-87e3-0e14b3a27ae2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075169 Oct 29 01:46:23.034463 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3639/7064] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:46:23.077346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-36b0feb3-02e6-4372-b7d9-3c8ac5a58183 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:23.078246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-36b0feb3-02e6-4372-b7d9-3c8ac5a58183 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:23.088612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:46:23.094038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36b0feb3-02e6-4372-b7d9-3c8ac5a58183 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:23.095450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36b0feb3-02e6-4372-b7d9-3c8ac5a58183 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:23.096171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36b0feb3-02e6-4372-b7d9-3c8ac5a58183 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:23.097138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36b0feb3-02e6-4372-b7d9-3c8ac5a58183 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:23.097805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36b0feb3-02e6-4372-b7d9-3c8ac5a58183 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:23.098461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36b0feb3-02e6-4372-b7d9-3c8ac5a58183 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:23.342280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-36b0feb3-02e6-4372-b7d9-3c8ac5a58183 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:23.355707 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-36b0feb3-02e6-4372-b7d9-3c8ac5a58183 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1693 microversion: 2.1 time: 0.286628 Oct 29 01:46:23.374072 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3426/7065] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:23 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1693 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:23.621703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-caa132e8-e93b-42fb-a943-75cec479168c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:23.623234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-caa132e8-e93b-42fb-a943-75cec479168c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:23.631073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-caa132e8-e93b-42fb-a943-75cec479168c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:23.631571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-caa132e8-e93b-42fb-a943-75cec479168c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:23.632147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-caa132e8-e93b-42fb-a943-75cec479168c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:23.632862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-caa132e8-e93b-42fb-a943-75cec479168c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:23.633511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-caa132e8-e93b-42fb-a943-75cec479168c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:23.633971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-caa132e8-e93b-42fb-a943-75cec479168c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:23.650543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d03b4fe3-59b2-48ea-a102-9021136ec4b7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:23.651197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d03b4fe3-59b2-48ea-a102-9021136ec4b7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:23.659317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d03b4fe3-59b2-48ea-a102-9021136ec4b7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:23.659839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d03b4fe3-59b2-48ea-a102-9021136ec4b7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:23.660294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d03b4fe3-59b2-48ea-a102-9021136ec4b7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:23.661250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d03b4fe3-59b2-48ea-a102-9021136ec4b7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:23.661793 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d03b4fe3-59b2-48ea-a102-9021136ec4b7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:23.662244 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d03b4fe3-59b2-48ea-a102-9021136ec4b7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:23.741329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-caa132e8-e93b-42fb-a943-75cec479168c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:23.751623 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-caa132e8-e93b-42fb-a943-75cec479168c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1279 microversion: 2.1 time: 0.135215 Oct 29 01:46:23.752920 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3640/7066] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:23 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1279 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:23.915421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d03b4fe3-59b2-48ea-a102-9021136ec4b7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:23.925771 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d03b4fe3-59b2-48ea-a102-9021136ec4b7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.280365 Oct 29 01:46:23.926729 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3427/7067] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:23 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:24.017960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-611ed299-87ef-4725-b0b2-dc9d09947c31 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:24.018632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-611ed299-87ef-4725-b0b2-dc9d09947c31 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:24.025848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-611ed299-87ef-4725-b0b2-dc9d09947c31 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:24.026599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-611ed299-87ef-4725-b0b2-dc9d09947c31 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:24.027259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-611ed299-87ef-4725-b0b2-dc9d09947c31 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:24.028242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-611ed299-87ef-4725-b0b2-dc9d09947c31 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:24.029592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-611ed299-87ef-4725-b0b2-dc9d09947c31 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:24.030388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-611ed299-87ef-4725-b0b2-dc9d09947c31 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:24.164134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-611ed299-87ef-4725-b0b2-dc9d09947c31 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:24.176227 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-611ed299-87ef-4725-b0b2-dc9d09947c31 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1361 microversion: 2.1 time: 0.161962 Oct 29 01:46:24.191103 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3641/7068] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:24 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:24.384934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-785653c0-f597-4c50-9845-3a330f380bbd tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:24.386271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-785653c0-f597-4c50-9845-3a330f380bbd tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:24.396724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-785653c0-f597-4c50-9845-3a330f380bbd tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:24.404611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-785653c0-f597-4c50-9845-3a330f380bbd tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:24.413391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-785653c0-f597-4c50-9845-3a330f380bbd tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:24.414695 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-785653c0-f597-4c50-9845-3a330f380bbd tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:24.415430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-785653c0-f597-4c50-9845-3a330f380bbd tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:24.416119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-785653c0-f597-4c50-9845-3a330f380bbd tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:24.636572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-785653c0-f597-4c50-9845-3a330f380bbd tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:24.645103 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-785653c0-f597-4c50-9845-3a330f380bbd tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1693 microversion: 2.1 time: 0.264719 Oct 29 01:46:24.645711 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3428/7069] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:24 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1693 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:24.778374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-61919e5e-3123-4ded-8633-82ba74e17ecc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:24.779253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-61919e5e-3123-4ded-8633-82ba74e17ecc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:24.786737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61919e5e-3123-4ded-8633-82ba74e17ecc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:24.787532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61919e5e-3123-4ded-8633-82ba74e17ecc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:24.788087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61919e5e-3123-4ded-8633-82ba74e17ecc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:24.788851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61919e5e-3123-4ded-8633-82ba74e17ecc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:24.789561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61919e5e-3123-4ded-8633-82ba74e17ecc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:24.790060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-61919e5e-3123-4ded-8633-82ba74e17ecc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:24.950736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-84c021da-14d0-4633-a8b7-d07666a5a51e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:24.952372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-84c021da-14d0-4633-a8b7-d07666a5a51e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:24.961179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84c021da-14d0-4633-a8b7-d07666a5a51e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:24.961936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84c021da-14d0-4633-a8b7-d07666a5a51e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:24.962772 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84c021da-14d0-4633-a8b7-d07666a5a51e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:24.963502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84c021da-14d0-4633-a8b7-d07666a5a51e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:24.964009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84c021da-14d0-4633-a8b7-d07666a5a51e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:24.964605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-84c021da-14d0-4633-a8b7-d07666a5a51e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:25.097178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-61919e5e-3123-4ded-8633-82ba74e17ecc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:25.108379 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-61919e5e-3123-4ded-8633-82ba74e17ecc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1321 microversion: 2.1 time: 0.332809 Oct 29 01:46:25.109241 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3642/7070] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:24 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:25.201078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-27b90ebc-08eb-40e3-8911-a84194cd11b2 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:25.201833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-27b90ebc-08eb-40e3-8911-a84194cd11b2 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:25.208264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27b90ebc-08eb-40e3-8911-a84194cd11b2 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:25.208836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27b90ebc-08eb-40e3-8911-a84194cd11b2 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:25.209302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27b90ebc-08eb-40e3-8911-a84194cd11b2 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:25.210069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27b90ebc-08eb-40e3-8911-a84194cd11b2 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:25.210596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27b90ebc-08eb-40e3-8911-a84194cd11b2 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:25.211024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-27b90ebc-08eb-40e3-8911-a84194cd11b2 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:25.252146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-84c021da-14d0-4633-a8b7-d07666a5a51e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:25.262001 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-84c021da-14d0-4633-a8b7-d07666a5a51e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.315785 Oct 29 01:46:25.263768 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3429/7071] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:24 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:25.301817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-27b90ebc-08eb-40e3-8911-a84194cd11b2 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:25.306151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-2ecc822a-4a60-4355-8eb6-945182cc9b09 req-c3892df8-ec4f-429a-9153-e6b46a8879e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "838282d2-04eb-4006-9639-daafacf292bd", "tag": "220aea55-6ffc-4d99-bd7b-8a42548c0464"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:25.311347 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-27b90ebc-08eb-40e3-8911-a84194cd11b2 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1359 microversion: 2.1 time: 0.114988 Oct 29 01:46:25.321910 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3643/7072] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:25 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1359 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:25.330151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2ecc822a-4a60-4355-8eb6-945182cc9b09 req-c3892df8-ec4f-429a-9153-e6b46a8879e5 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:25.330647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2ecc822a-4a60-4355-8eb6-945182cc9b09 req-c3892df8-ec4f-429a-9153-e6b46a8879e5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:25.331093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2ecc822a-4a60-4355-8eb6-945182cc9b09 req-c3892df8-ec4f-429a-9153-e6b46a8879e5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:25.351889 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-2ecc822a-4a60-4355-8eb6-945182cc9b09 req-c3892df8-ec4f-429a-9153-e6b46a8879e5 service nova] Creating event network-changed:220aea55-6ffc-4d99-bd7b-8a42548c0464 for instance 838282d2-04eb-4006-9639-daafacf292bd on n-h1-862964-3 Oct 29 01:46:25.358365 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-2ecc822a-4a60-4355-8eb6-945182cc9b09 req-c3892df8-ec4f-429a-9153-e6b46a8879e5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056353 Oct 29 01:46:25.359417 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3430/7073] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:46:25.670685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-af2452a0-6fd6-401e-84a6-114ca3e3bb0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:25.671404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-af2452a0-6fd6-401e-84a6-114ca3e3bb0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:25.677919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af2452a0-6fd6-401e-84a6-114ca3e3bb0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:25.678407 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af2452a0-6fd6-401e-84a6-114ca3e3bb0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:25.679607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af2452a0-6fd6-401e-84a6-114ca3e3bb0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:25.680982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af2452a0-6fd6-401e-84a6-114ca3e3bb0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:25.681481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af2452a0-6fd6-401e-84a6-114ca3e3bb0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:25.681968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af2452a0-6fd6-401e-84a6-114ca3e3bb0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:25.862814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-af2452a0-6fd6-401e-84a6-114ca3e3bb0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:25.870621 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-af2452a0-6fd6-401e-84a6-114ca3e3bb0a tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1693 microversion: 2.1 time: 0.204005 Oct 29 01:46:25.871216 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3644/7074] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:25 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1693 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:26.133774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bbc41736-390e-4eeb-a25a-34e28c50b79a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:26.134512 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bbc41736-390e-4eeb-a25a-34e28c50b79a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:26.141479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbc41736-390e-4eeb-a25a-34e28c50b79a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:26.141980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbc41736-390e-4eeb-a25a-34e28c50b79a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:26.142427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbc41736-390e-4eeb-a25a-34e28c50b79a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:26.143130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbc41736-390e-4eeb-a25a-34e28c50b79a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:26.143598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbc41736-390e-4eeb-a25a-34e28c50b79a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:26.144033 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbc41736-390e-4eeb-a25a-34e28c50b79a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:26.287687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e60eccb7-656a-4f1c-90a5-856c996ba440 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:26.288314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e60eccb7-656a-4f1c-90a5-856c996ba440 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:26.296589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e60eccb7-656a-4f1c-90a5-856c996ba440 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:26.298057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e60eccb7-656a-4f1c-90a5-856c996ba440 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:26.298518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e60eccb7-656a-4f1c-90a5-856c996ba440 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:26.299713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e60eccb7-656a-4f1c-90a5-856c996ba440 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:26.299713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e60eccb7-656a-4f1c-90a5-856c996ba440 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:26.300133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e60eccb7-656a-4f1c-90a5-856c996ba440 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:26.456783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bbc41736-390e-4eeb-a25a-34e28c50b79a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:26.470843 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bbc41736-390e-4eeb-a25a-34e28c50b79a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1321 microversion: 2.1 time: 0.342340 Oct 29 01:46:26.472117 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3431/7075] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:26 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:26.480576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ce4607ec-d4a0-44e5-a60b-dbf6bac1e029 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:26.485805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ce4607ec-d4a0-44e5-a60b-dbf6bac1e029 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:26.492564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce4607ec-d4a0-44e5-a60b-dbf6bac1e029 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:26.493465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce4607ec-d4a0-44e5-a60b-dbf6bac1e029 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:26.494365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce4607ec-d4a0-44e5-a60b-dbf6bac1e029 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:26.495385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce4607ec-d4a0-44e5-a60b-dbf6bac1e029 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:26.496088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce4607ec-d4a0-44e5-a60b-dbf6bac1e029 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:26.496630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce4607ec-d4a0-44e5-a60b-dbf6bac1e029 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:26.563595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e60eccb7-656a-4f1c-90a5-856c996ba440 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:26.575159 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e60eccb7-656a-4f1c-90a5-856c996ba440 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.291670 Oct 29 01:46:26.577717 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3645/7076] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:26 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:26.834085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ce4607ec-d4a0-44e5-a60b-dbf6bac1e029 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:26.836795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:46:26.846686 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ce4607ec-d4a0-44e5-a60b-dbf6bac1e029 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1427 microversion: 2.1 time: 0.372802 Oct 29 01:46:26.873856 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3432/7077] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:26 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1427 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:26.895949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5f03dfb6-ed07-42c7-b370-74101707dcf3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:26.896528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5f03dfb6-ed07-42c7-b370-74101707dcf3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:26.908665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f03dfb6-ed07-42c7-b370-74101707dcf3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:26.908665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f03dfb6-ed07-42c7-b370-74101707dcf3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:26.908665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f03dfb6-ed07-42c7-b370-74101707dcf3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:26.908665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f03dfb6-ed07-42c7-b370-74101707dcf3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:26.908665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f03dfb6-ed07-42c7-b370-74101707dcf3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:26.908665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f03dfb6-ed07-42c7-b370-74101707dcf3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:27.136672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5f03dfb6-ed07-42c7-b370-74101707dcf3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:27.149107 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5f03dfb6-ed07-42c7-b370-74101707dcf3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1699 microversion: 2.1 time: 0.257415 Oct 29 01:46:27.150273 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3646/7078] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:26 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1699 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:27.462488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-7c7459ce-b9a3-41d6-9f43-64b83f52e332 req-0f6d0a2a-da52-43cb-a9be-1cb4c4505f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c350c1d-73f3-486a-b0db-62b11cb9e94b", "tag": "e6dfa47d-bb94-49fc-b30b-ddd42ba7e60c"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:27.481810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7c7459ce-b9a3-41d6-9f43-64b83f52e332 req-0f6d0a2a-da52-43cb-a9be-1cb4c4505f36 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:27.488337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7c7459ce-b9a3-41d6-9f43-64b83f52e332 req-0f6d0a2a-da52-43cb-a9be-1cb4c4505f36 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:27.488337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7c7459ce-b9a3-41d6-9f43-64b83f52e332 req-0f6d0a2a-da52-43cb-a9be-1cb4c4505f36 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:27.495729 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-7c7459ce-b9a3-41d6-9f43-64b83f52e332 req-0f6d0a2a-da52-43cb-a9be-1cb4c4505f36 service nova] Creating event network-changed:e6dfa47d-bb94-49fc-b30b-ddd42ba7e60c for instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b on n-h1-862964-3 Oct 29 01:46:27.501892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e9adfdec-b63b-42c5-830f-c84afb125d43 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:27.502365 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-7c7459ce-b9a3-41d6-9f43-64b83f52e332 req-0f6d0a2a-da52-43cb-a9be-1cb4c4505f36 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046208 Oct 29 01:46:27.502490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e9adfdec-b63b-42c5-830f-c84afb125d43 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:27.503560 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3433/7079] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:46:27.511735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9adfdec-b63b-42c5-830f-c84afb125d43 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:27.511735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9adfdec-b63b-42c5-830f-c84afb125d43 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:27.518279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9adfdec-b63b-42c5-830f-c84afb125d43 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:27.519654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9adfdec-b63b-42c5-830f-c84afb125d43 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:27.520612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9adfdec-b63b-42c5-830f-c84afb125d43 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:27.521053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e9adfdec-b63b-42c5-830f-c84afb125d43 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:27.600664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b9859937-d293-4d84-b01d-021bcaf648fe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:27.601628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b9859937-d293-4d84-b01d-021bcaf648fe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:27.608366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9859937-d293-4d84-b01d-021bcaf648fe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:27.608912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9859937-d293-4d84-b01d-021bcaf648fe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:27.609459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9859937-d293-4d84-b01d-021bcaf648fe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:27.610279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9859937-d293-4d84-b01d-021bcaf648fe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:27.610765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9859937-d293-4d84-b01d-021bcaf648fe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:27.611216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9859937-d293-4d84-b01d-021bcaf648fe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:27.704961 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e9adfdec-b63b-42c5-830f-c84afb125d43 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:27.713479 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e9adfdec-b63b-42c5-830f-c84afb125d43 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1321 microversion: 2.1 time: 0.218709 Oct 29 01:46:27.714314 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3647/7080] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:27 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:27.772296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b9859937-d293-4d84-b01d-021bcaf648fe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:27.780483 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b9859937-d293-4d84-b01d-021bcaf648fe tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.184817 Oct 29 01:46:27.781072 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3434/7081] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:27 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:27.875934 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-42c36293-24ce-476a-bde4-fdc7aae95b9b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:27.876550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-42c36293-24ce-476a-bde4-fdc7aae95b9b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:27.882595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42c36293-24ce-476a-bde4-fdc7aae95b9b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:27.883078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42c36293-24ce-476a-bde4-fdc7aae95b9b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:27.883518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42c36293-24ce-476a-bde4-fdc7aae95b9b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:27.884207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42c36293-24ce-476a-bde4-fdc7aae95b9b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:27.884664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42c36293-24ce-476a-bde4-fdc7aae95b9b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:27.885090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-42c36293-24ce-476a-bde4-fdc7aae95b9b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:28.031344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-42c36293-24ce-476a-bde4-fdc7aae95b9b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:28.039631 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-42c36293-24ce-476a-bde4-fdc7aae95b9b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1427 microversion: 2.1 time: 0.167641 Oct 29 01:46:28.047912 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3648/7082] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:27 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1427 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:28.176794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c14a7400-08a2-41e2-b7c4-73197adc7f33 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:28.177484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c14a7400-08a2-41e2-b7c4-73197adc7f33 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:28.185092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c14a7400-08a2-41e2-b7c4-73197adc7f33 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:28.185734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c14a7400-08a2-41e2-b7c4-73197adc7f33 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:28.186201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c14a7400-08a2-41e2-b7c4-73197adc7f33 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:28.187025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c14a7400-08a2-41e2-b7c4-73197adc7f33 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:28.187502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c14a7400-08a2-41e2-b7c4-73197adc7f33 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:28.187947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c14a7400-08a2-41e2-b7c4-73197adc7f33 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:28.345803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c14a7400-08a2-41e2-b7c4-73197adc7f33 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:28.353760 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c14a7400-08a2-41e2-b7c4-73197adc7f33 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1699 microversion: 2.1 time: 0.180932 Oct 29 01:46:28.354362 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3435/7083] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:28 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1699 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:28.739678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4c18c246-a755-4460-82b9-095cfa449844 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:28.740330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4c18c246-a755-4460-82b9-095cfa449844 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:28.746939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c18c246-a755-4460-82b9-095cfa449844 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:28.750498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c18c246-a755-4460-82b9-095cfa449844 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:28.750498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c18c246-a755-4460-82b9-095cfa449844 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:28.750498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c18c246-a755-4460-82b9-095cfa449844 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:28.750498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c18c246-a755-4460-82b9-095cfa449844 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:28.750498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c18c246-a755-4460-82b9-095cfa449844 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:28.805699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4ac1b69d-2216-4064-a7b5-41655d1986f0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:28.806458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4ac1b69d-2216-4064-a7b5-41655d1986f0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:28.809942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:46:28.815690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ac1b69d-2216-4064-a7b5-41655d1986f0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:28.816306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ac1b69d-2216-4064-a7b5-41655d1986f0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:28.817247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ac1b69d-2216-4064-a7b5-41655d1986f0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:28.818275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ac1b69d-2216-4064-a7b5-41655d1986f0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:28.819218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ac1b69d-2216-4064-a7b5-41655d1986f0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:28.819872 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4ac1b69d-2216-4064-a7b5-41655d1986f0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:28.946016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4c18c246-a755-4460-82b9-095cfa449844 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:28.956530 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4c18c246-a755-4460-82b9-095cfa449844 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1321 microversion: 2.1 time: 0.220873 Oct 29 01:46:28.967321 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3649/7084] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:28 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:29.010943 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4ac1b69d-2216-4064-a7b5-41655d1986f0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:29.021706 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4ac1b69d-2216-4064-a7b5-41655d1986f0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.220091 Oct 29 01:46:29.022289 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3436/7085] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:28 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:29.065295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9f7b2141-ddbb-4f3f-89fe-9b233d49a44c tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:29.065910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9f7b2141-ddbb-4f3f-89fe-9b233d49a44c tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:29.074923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f7b2141-ddbb-4f3f-89fe-9b233d49a44c tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:29.082762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f7b2141-ddbb-4f3f-89fe-9b233d49a44c tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:29.082762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f7b2141-ddbb-4f3f-89fe-9b233d49a44c tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:29.082762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f7b2141-ddbb-4f3f-89fe-9b233d49a44c tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:29.082762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f7b2141-ddbb-4f3f-89fe-9b233d49a44c tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:29.082762 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9f7b2141-ddbb-4f3f-89fe-9b233d49a44c tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:29.246880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9f7b2141-ddbb-4f3f-89fe-9b233d49a44c tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:29.255847 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9f7b2141-ddbb-4f3f-89fe-9b233d49a44c tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1427 microversion: 2.1 time: 0.194814 Oct 29 01:46:29.256538 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3650/7086] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:29 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1427 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:29.378993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ed46e9f6-056a-42c3-9449-849d57182c4c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:29.379622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ed46e9f6-056a-42c3-9449-849d57182c4c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:29.386472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed46e9f6-056a-42c3-9449-849d57182c4c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:29.386992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed46e9f6-056a-42c3-9449-849d57182c4c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:29.387441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed46e9f6-056a-42c3-9449-849d57182c4c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:29.388182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed46e9f6-056a-42c3-9449-849d57182c4c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:29.389270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed46e9f6-056a-42c3-9449-849d57182c4c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:29.389727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ed46e9f6-056a-42c3-9449-849d57182c4c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:29.659070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ed46e9f6-056a-42c3-9449-849d57182c4c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:29.699342 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ed46e9f6-056a-42c3-9449-849d57182c4c tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1699 microversion: 2.1 time: 0.324333 Oct 29 01:46:29.705669 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3437/7087] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:29 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1699 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:29.982818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-45084442-4b80-4fa7-8ea7-59df5eca9dc6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:29.983766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-45084442-4b80-4fa7-8ea7-59df5eca9dc6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:29.990861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45084442-4b80-4fa7-8ea7-59df5eca9dc6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:29.991390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45084442-4b80-4fa7-8ea7-59df5eca9dc6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:29.992037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45084442-4b80-4fa7-8ea7-59df5eca9dc6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:29.992861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45084442-4b80-4fa7-8ea7-59df5eca9dc6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:29.993389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45084442-4b80-4fa7-8ea7-59df5eca9dc6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:29.993995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45084442-4b80-4fa7-8ea7-59df5eca9dc6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:30.040718 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:46:30.047034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0c11fe70-35bf-4c35-81b6-33b3a9317ca4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:30.047668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0c11fe70-35bf-4c35-81b6-33b3a9317ca4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:30.050528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=12 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:46:30.055452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c11fe70-35bf-4c35-81b6-33b3a9317ca4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:30.056822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c11fe70-35bf-4c35-81b6-33b3a9317ca4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:30.056822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c11fe70-35bf-4c35-81b6-33b3a9317ca4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:30.057235 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c11fe70-35bf-4c35-81b6-33b3a9317ca4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:30.057685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c11fe70-35bf-4c35-81b6-33b3a9317ca4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:30.058134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c11fe70-35bf-4c35-81b6-33b3a9317ca4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:30.527427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-45084442-4b80-4fa7-8ea7-59df5eca9dc6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:30.536756 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-45084442-4b80-4fa7-8ea7-59df5eca9dc6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1321 microversion: 2.1 time: 0.558701 Oct 29 01:46:30.543033 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3651/7088] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:29 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1321 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:30.543033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-79a36681-4831-43e6-b76e-4fb04fa4a869 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:30.543033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-79a36681-4831-43e6-b76e-4fb04fa4a869 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:30.549969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79a36681-4831-43e6-b76e-4fb04fa4a869 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:30.550466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79a36681-4831-43e6-b76e-4fb04fa4a869 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:30.550909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79a36681-4831-43e6-b76e-4fb04fa4a869 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:30.551807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79a36681-4831-43e6-b76e-4fb04fa4a869 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:30.552394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79a36681-4831-43e6-b76e-4fb04fa4a869 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:30.552945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-79a36681-4831-43e6-b76e-4fb04fa4a869 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:30.585083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0c11fe70-35bf-4c35-81b6-33b3a9317ca4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:30.594997 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0c11fe70-35bf-4c35-81b6-33b3a9317ca4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.553101 Oct 29 01:46:30.595826 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3438/7089] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:30 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:30.713426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-79a36681-4831-43e6-b76e-4fb04fa4a869 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:30.722118 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-79a36681-4831-43e6-b76e-4fb04fa4a869 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1427 microversion: 2.1 time: 0.183627 Oct 29 01:46:30.722710 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3652/7090] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:30 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1427 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:30.730697 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2b35be8e-9f22-469e-8acf-5859b67f38fc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:30.731331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2b35be8e-9f22-469e-8acf-5859b67f38fc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:30.739416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b35be8e-9f22-469e-8acf-5859b67f38fc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:30.739958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b35be8e-9f22-469e-8acf-5859b67f38fc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:30.740464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b35be8e-9f22-469e-8acf-5859b67f38fc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:30.741207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b35be8e-9f22-469e-8acf-5859b67f38fc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:30.741747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b35be8e-9f22-469e-8acf-5859b67f38fc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:30.742220 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2b35be8e-9f22-469e-8acf-5859b67f38fc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:30.901103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2b35be8e-9f22-469e-8acf-5859b67f38fc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:30.910450 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2b35be8e-9f22-469e-8acf-5859b67f38fc tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1699 microversion: 2.1 time: 0.184027 Oct 29 01:46:30.911501 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3439/7091] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:30 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1699 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:30.963578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-73c9c7b9-6ab8-4402-99e7-640cf6188db1 req-47876531-50fb-4f91-91b4-739aa09e9a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9fdb471-31f0-4205-b0ce-a0296c7ca672", "name": "network-vif-unplugged", "status": "completed", "tag": "d75377b7-049b-4dfd-80a5-5b02950d2cf5"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:30.974444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-73c9c7b9-6ab8-4402-99e7-640cf6188db1 req-47876531-50fb-4f91-91b4-739aa09e9a44 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:30.975026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-73c9c7b9-6ab8-4402-99e7-640cf6188db1 req-47876531-50fb-4f91-91b4-739aa09e9a44 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:30.975537 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-73c9c7b9-6ab8-4402-99e7-640cf6188db1 req-47876531-50fb-4f91-91b4-739aa09e9a44 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:30.979605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:46:30.988333 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-73c9c7b9-6ab8-4402-99e7-640cf6188db1 req-47876531-50fb-4f91-91b4-739aa09e9a44 service nova] Creating event network-vif-unplugged:d75377b7-049b-4dfd-80a5-5b02950d2cf5 for instance a9fdb471-31f0-4205-b0ce-a0296c7ca672 on n-h1-862964-3 Oct 29 01:46:30.993547 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-73c9c7b9-6ab8-4402-99e7-640cf6188db1 req-47876531-50fb-4f91-91b4-739aa09e9a44 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035228 Oct 29 01:46:30.994197 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3653/7092] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:46:31.564539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ab6a53a9-7083-4a5c-82f6-03e94df6b07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:31.565224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ab6a53a9-7083-4a5c-82f6-03e94df6b07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:31.572585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab6a53a9-7083-4a5c-82f6-03e94df6b07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:31.573083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab6a53a9-7083-4a5c-82f6-03e94df6b07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:31.573558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab6a53a9-7083-4a5c-82f6-03e94df6b07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:31.574266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab6a53a9-7083-4a5c-82f6-03e94df6b07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:31.574738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab6a53a9-7083-4a5c-82f6-03e94df6b07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:31.575174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ab6a53a9-7083-4a5c-82f6-03e94df6b07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:31.619052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b6e7a3eb-45f1-45ca-a8e0-a606aeeab799 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:31.620520 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b6e7a3eb-45f1-45ca-a8e0-a606aeeab799 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:31.630287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6e7a3eb-45f1-45ca-a8e0-a606aeeab799 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:31.631082 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6e7a3eb-45f1-45ca-a8e0-a606aeeab799 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:31.635688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6e7a3eb-45f1-45ca-a8e0-a606aeeab799 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:31.635688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6e7a3eb-45f1-45ca-a8e0-a606aeeab799 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:31.635688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6e7a3eb-45f1-45ca-a8e0-a606aeeab799 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:31.635688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b6e7a3eb-45f1-45ca-a8e0-a606aeeab799 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:31.794133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ab6a53a9-7083-4a5c-82f6-03e94df6b07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:31.799112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=32 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:46:31.804354 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ab6a53a9-7083-4a5c-82f6-03e94df6b07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1321 microversion: 2.1 time: 0.244914 Oct 29 01:46:31.805175 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3440/7093] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:31 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:31.811287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5bae04da-3162-4109-852a-68f11b2a98dc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:31.812142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5bae04da-3162-4109-852a-68f11b2a98dc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:31.820272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bae04da-3162-4109-852a-68f11b2a98dc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:31.820909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bae04da-3162-4109-852a-68f11b2a98dc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:31.821802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bae04da-3162-4109-852a-68f11b2a98dc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:31.822545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bae04da-3162-4109-852a-68f11b2a98dc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:31.823116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bae04da-3162-4109-852a-68f11b2a98dc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:31.823635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5bae04da-3162-4109-852a-68f11b2a98dc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:31.836802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b6e7a3eb-45f1-45ca-a8e0-a606aeeab799 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:31.845879 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b6e7a3eb-45f1-45ca-a8e0-a606aeeab799 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.230979 Oct 29 01:46:31.849193 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3654/7094] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:31 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:31.940962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-63114f71-97b3-4dc4-bc10-d309286ac719 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:31.941642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-63114f71-97b3-4dc4-bc10-d309286ac719 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:31.948279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63114f71-97b3-4dc4-bc10-d309286ac719 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:31.952363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63114f71-97b3-4dc4-bc10-d309286ac719 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:31.952363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63114f71-97b3-4dc4-bc10-d309286ac719 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:31.952363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63114f71-97b3-4dc4-bc10-d309286ac719 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:31.952363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63114f71-97b3-4dc4-bc10-d309286ac719 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:31.952363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-63114f71-97b3-4dc4-bc10-d309286ac719 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:31.981317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5bae04da-3162-4109-852a-68f11b2a98dc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:31.985779 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5bae04da-3162-4109-852a-68f11b2a98dc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1427 microversion: 2.1 time: 0.179089 Oct 29 01:46:31.986369 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3441/7095] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:31 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1427 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:32.118038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-63114f71-97b3-4dc4-bc10-d309286ac719 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:32.124533 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-63114f71-97b3-4dc4-bc10-d309286ac719 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1699 microversion: 2.1 time: 0.187803 Oct 29 01:46:32.125117 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3655/7096] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:31 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1699 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:32.828865 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d4f2eb02-be32-40ed-90a2-400a1bb34772 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:32.829561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d4f2eb02-be32-40ed-90a2-400a1bb34772 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:32.836768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4f2eb02-be32-40ed-90a2-400a1bb34772 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:32.837311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4f2eb02-be32-40ed-90a2-400a1bb34772 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:32.837769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4f2eb02-be32-40ed-90a2-400a1bb34772 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:32.838493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4f2eb02-be32-40ed-90a2-400a1bb34772 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:32.838970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4f2eb02-be32-40ed-90a2-400a1bb34772 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:32.839410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d4f2eb02-be32-40ed-90a2-400a1bb34772 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:32.875359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c5c15aa5-88bc-4db3-b459-0d47c9bf5d2b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:32.876029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c5c15aa5-88bc-4db3-b459-0d47c9bf5d2b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:32.888104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5c15aa5-88bc-4db3-b459-0d47c9bf5d2b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:32.888602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5c15aa5-88bc-4db3-b459-0d47c9bf5d2b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:32.889036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5c15aa5-88bc-4db3-b459-0d47c9bf5d2b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:32.891167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5c15aa5-88bc-4db3-b459-0d47c9bf5d2b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:32.891716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5c15aa5-88bc-4db3-b459-0d47c9bf5d2b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:32.892321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5c15aa5-88bc-4db3-b459-0d47c9bf5d2b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:33.069258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d4f2eb02-be32-40ed-90a2-400a1bb34772 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:33.079421 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d4f2eb02-be32-40ed-90a2-400a1bb34772 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1321 microversion: 2.1 time: 0.254733 Oct 29 01:46:33.080594 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3442/7097] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:32 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:33.096546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a73a9e44-7dd1-4a9b-ae23-826cc45d22e4 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:33.097687 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a73a9e44-7dd1-4a9b-ae23-826cc45d22e4 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:33.107202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a73a9e44-7dd1-4a9b-ae23-826cc45d22e4 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:33.108282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a73a9e44-7dd1-4a9b-ae23-826cc45d22e4 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:33.109963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a73a9e44-7dd1-4a9b-ae23-826cc45d22e4 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:33.110896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a73a9e44-7dd1-4a9b-ae23-826cc45d22e4 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:33.111553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a73a9e44-7dd1-4a9b-ae23-826cc45d22e4 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:33.112195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a73a9e44-7dd1-4a9b-ae23-826cc45d22e4 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:33.192606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c5c15aa5-88bc-4db3-b459-0d47c9bf5d2b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:33.201257 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c5c15aa5-88bc-4db3-b459-0d47c9bf5d2b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.334395 Oct 29 01:46:33.207679 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3656/7098] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:32 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:33.212426 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-63ff462d-73f7-4d13-8def-962b242a4592 req-e81b4179-e550-44ce-8af4-d7e37c82994c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4beaf925-018a-47ce-810e-b53329fe86a0", "name": "network-vif-plugged", "status": "completed", "tag": "10522071-aa4f-4b20-854c-677dc5abf590"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:33.227760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-63ff462d-73f7-4d13-8def-962b242a4592 req-e81b4179-e550-44ce-8af4-d7e37c82994c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:33.228571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-63ff462d-73f7-4d13-8def-962b242a4592 req-e81b4179-e550-44ce-8af4-d7e37c82994c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:33.229199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-63ff462d-73f7-4d13-8def-962b242a4592 req-e81b4179-e550-44ce-8af4-d7e37c82994c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:33.255003 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-63ff462d-73f7-4d13-8def-962b242a4592 req-e81b4179-e550-44ce-8af4-d7e37c82994c service nova] Creating event network-vif-plugged:10522071-aa4f-4b20-854c-677dc5abf590 for instance 4beaf925-018a-47ce-810e-b53329fe86a0 on n-h2-862964-3 Oct 29 01:46:33.255003 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-63ff462d-73f7-4d13-8def-962b242a4592 req-e81b4179-e550-44ce-8af4-d7e37c82994c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048199 Oct 29 01:46:33.255003 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3657/7099] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:46:33.260950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-98525b43-9329-41b8-adc9-4aab1308bc36 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:33.261917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-98525b43-9329-41b8-adc9-4aab1308bc36 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:33.268985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98525b43-9329-41b8-adc9-4aab1308bc36 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:33.269509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98525b43-9329-41b8-adc9-4aab1308bc36 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:33.269949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98525b43-9329-41b8-adc9-4aab1308bc36 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:33.270795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98525b43-9329-41b8-adc9-4aab1308bc36 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:33.271260 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98525b43-9329-41b8-adc9-4aab1308bc36 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:33.271807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98525b43-9329-41b8-adc9-4aab1308bc36 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:33.307618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a73a9e44-7dd1-4a9b-ae23-826cc45d22e4 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:33.318662 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a73a9e44-7dd1-4a9b-ae23-826cc45d22e4 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1427 microversion: 2.1 time: 0.236718 Oct 29 01:46:33.319564 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3443/7100] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:33 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1427 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:33.479132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-98525b43-9329-41b8-adc9-4aab1308bc36 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:33.490489 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-98525b43-9329-41b8-adc9-4aab1308bc36 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1699 microversion: 2.1 time: 0.234268 Oct 29 01:46:33.491510 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3658/7101] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:33 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1699 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:34.106833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-044f7de0-6458-42fd-a60b-b558b006aba5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:34.107758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-044f7de0-6458-42fd-a60b-b558b006aba5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:34.115896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-044f7de0-6458-42fd-a60b-b558b006aba5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:34.116593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-044f7de0-6458-42fd-a60b-b558b006aba5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:34.117126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-044f7de0-6458-42fd-a60b-b558b006aba5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:34.118060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-044f7de0-6458-42fd-a60b-b558b006aba5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:34.118543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-044f7de0-6458-42fd-a60b-b558b006aba5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:34.118993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-044f7de0-6458-42fd-a60b-b558b006aba5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:34.224974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4e4d9de7-d7c6-46b3-b396-317f3fedd584 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:34.226548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4e4d9de7-d7c6-46b3-b396-317f3fedd584 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:34.236326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e4d9de7-d7c6-46b3-b396-317f3fedd584 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:34.238452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e4d9de7-d7c6-46b3-b396-317f3fedd584 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:34.239145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e4d9de7-d7c6-46b3-b396-317f3fedd584 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:34.240241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e4d9de7-d7c6-46b3-b396-317f3fedd584 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:34.240898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e4d9de7-d7c6-46b3-b396-317f3fedd584 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:34.241559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4e4d9de7-d7c6-46b3-b396-317f3fedd584 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:34.283120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-044f7de0-6458-42fd-a60b-b558b006aba5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:34.293537 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-044f7de0-6458-42fd-a60b-b558b006aba5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1321 microversion: 2.1 time: 0.190214 Oct 29 01:46:34.309974 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3444/7102] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:34 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:34.345360 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8e33253e-f712-4553-91be-20e0f55366f3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:34.346046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8e33253e-f712-4553-91be-20e0f55366f3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:34.354104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e33253e-f712-4553-91be-20e0f55366f3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:34.354619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e33253e-f712-4553-91be-20e0f55366f3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:34.355104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e33253e-f712-4553-91be-20e0f55366f3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:34.355866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e33253e-f712-4553-91be-20e0f55366f3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:34.356341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e33253e-f712-4553-91be-20e0f55366f3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:34.357067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e33253e-f712-4553-91be-20e0f55366f3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:34.426582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4e4d9de7-d7c6-46b3-b396-317f3fedd584 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:34.434060 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4e4d9de7-d7c6-46b3-b396-317f3fedd584 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.213172 Oct 29 01:46:34.434867 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3659/7103] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:34 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:34.515639 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-87642b18-3f3b-4282-b78d-9c691d54642f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:34.516294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-87642b18-3f3b-4282-b78d-9c691d54642f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:34.522133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8e33253e-f712-4553-91be-20e0f55366f3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:34.523596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87642b18-3f3b-4282-b78d-9c691d54642f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:34.524110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87642b18-3f3b-4282-b78d-9c691d54642f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:34.524610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87642b18-3f3b-4282-b78d-9c691d54642f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:34.525353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87642b18-3f3b-4282-b78d-9c691d54642f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:34.526006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87642b18-3f3b-4282-b78d-9c691d54642f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:34.526433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-87642b18-3f3b-4282-b78d-9c691d54642f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:34.538924 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8e33253e-f712-4553-91be-20e0f55366f3 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1427 microversion: 2.1 time: 0.197338 Oct 29 01:46:34.538924 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3445/7104] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:34 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1427 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:34.668838 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-87642b18-3f3b-4282-b78d-9c691d54642f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:34.676869 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-87642b18-3f3b-4282-b78d-9c691d54642f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1684 microversion: 2.1 time: 0.165980 Oct 29 01:46:34.677486 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3660/7105] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:34 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:35.269471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-b7b2a4fb-d49b-411a-a50c-909b59af13be req-a632538c-722e-4581-93a0-dbd10eaa945e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9fdb471-31f0-4205-b0ce-a0296c7ca672", "name": "network-vif-plugged", "status": "completed", "tag": "d75377b7-049b-4dfd-80a5-5b02950d2cf5"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:35.280912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b7b2a4fb-d49b-411a-a50c-909b59af13be req-a632538c-722e-4581-93a0-dbd10eaa945e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:35.281476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b7b2a4fb-d49b-411a-a50c-909b59af13be req-a632538c-722e-4581-93a0-dbd10eaa945e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:35.282646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b7b2a4fb-d49b-411a-a50c-909b59af13be req-a632538c-722e-4581-93a0-dbd10eaa945e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:35.296011 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-b7b2a4fb-d49b-411a-a50c-909b59af13be req-a632538c-722e-4581-93a0-dbd10eaa945e service nova] Creating event network-vif-plugged:d75377b7-049b-4dfd-80a5-5b02950d2cf5 for instance a9fdb471-31f0-4205-b0ce-a0296c7ca672 on n-h1-862964-3 Oct 29 01:46:35.301488 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-b7b2a4fb-d49b-411a-a50c-909b59af13be req-a632538c-722e-4581-93a0-dbd10eaa945e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036742 Oct 29 01:46:35.303067 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3446/7106] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:46:35.319361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ca7308f9-3fc4-4058-9647-ab7f3b3ad938 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:35.319998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ca7308f9-3fc4-4058-9647-ab7f3b3ad938 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:35.328355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca7308f9-3fc4-4058-9647-ab7f3b3ad938 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:35.329096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca7308f9-3fc4-4058-9647-ab7f3b3ad938 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:35.329570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca7308f9-3fc4-4058-9647-ab7f3b3ad938 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:35.330273 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca7308f9-3fc4-4058-9647-ab7f3b3ad938 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:35.330737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca7308f9-3fc4-4058-9647-ab7f3b3ad938 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:35.331167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca7308f9-3fc4-4058-9647-ab7f3b3ad938 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:35.468449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-98a91b67-80bb-41b7-be08-1c7fd55d4e26 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:35.468449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-98a91b67-80bb-41b7-be08-1c7fd55d4e26 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:35.469075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98a91b67-80bb-41b7-be08-1c7fd55d4e26 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:35.469822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98a91b67-80bb-41b7-be08-1c7fd55d4e26 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:35.470533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98a91b67-80bb-41b7-be08-1c7fd55d4e26 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:35.471742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98a91b67-80bb-41b7-be08-1c7fd55d4e26 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:35.472397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98a91b67-80bb-41b7-be08-1c7fd55d4e26 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:35.473176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-98a91b67-80bb-41b7-be08-1c7fd55d4e26 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:35.492981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ca7308f9-3fc4-4058-9647-ab7f3b3ad938 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:35.503366 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ca7308f9-3fc4-4058-9647-ab7f3b3ad938 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1321 microversion: 2.1 time: 0.187996 Oct 29 01:46:35.510143 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3661/7107] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:35 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:35.561769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ebd44efc-a2c1-4798-a28e-9924bbf4f044 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:35.562810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ebd44efc-a2c1-4798-a28e-9924bbf4f044 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:35.581209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebd44efc-a2c1-4798-a28e-9924bbf4f044 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:35.581748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebd44efc-a2c1-4798-a28e-9924bbf4f044 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:35.582410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebd44efc-a2c1-4798-a28e-9924bbf4f044 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:35.583146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebd44efc-a2c1-4798-a28e-9924bbf4f044 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:35.583574 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebd44efc-a2c1-4798-a28e-9924bbf4f044 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:35.584097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebd44efc-a2c1-4798-a28e-9924bbf4f044 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:35.692541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-98a91b67-80bb-41b7-be08-1c7fd55d4e26 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:35.705482 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-98a91b67-80bb-41b7-be08-1c7fd55d4e26 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.249639 Oct 29 01:46:35.706650 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3447/7108] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:35 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:35.774573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ebd44efc-a2c1-4798-a28e-9924bbf4f044 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:35.786195 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ebd44efc-a2c1-4798-a28e-9924bbf4f044 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1427 microversion: 2.1 time: 0.228660 Oct 29 01:46:35.787268 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3662/7109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:35 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1427 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:36.538475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5919fa98-184c-450f-9c7e-1e77b7f58c7a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:36.539239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5919fa98-184c-450f-9c7e-1e77b7f58c7a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:36.551732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5919fa98-184c-450f-9c7e-1e77b7f58c7a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:36.555161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5919fa98-184c-450f-9c7e-1e77b7f58c7a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:36.555161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5919fa98-184c-450f-9c7e-1e77b7f58c7a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:36.555161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5919fa98-184c-450f-9c7e-1e77b7f58c7a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:36.555161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5919fa98-184c-450f-9c7e-1e77b7f58c7a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:36.555161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5919fa98-184c-450f-9c7e-1e77b7f58c7a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:36.727932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4b4a0086-d419-487f-91dc-c3cf2ff33938 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:36.728546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4b4a0086-d419-487f-91dc-c3cf2ff33938 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:36.738139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b4a0086-d419-487f-91dc-c3cf2ff33938 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:36.738685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b4a0086-d419-487f-91dc-c3cf2ff33938 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:36.742163 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5919fa98-184c-450f-9c7e-1e77b7f58c7a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:36.742640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b4a0086-d419-487f-91dc-c3cf2ff33938 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:36.742640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b4a0086-d419-487f-91dc-c3cf2ff33938 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:36.742640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b4a0086-d419-487f-91dc-c3cf2ff33938 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:36.742640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4b4a0086-d419-487f-91dc-c3cf2ff33938 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:36.749959 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5919fa98-184c-450f-9c7e-1e77b7f58c7a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1321 microversion: 2.1 time: 0.221454 Oct 29 01:46:36.750636 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3448/7110] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:36 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:36.810894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f2a73776-a4f8-4cfd-bf9f-47002dc1b331 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:36.812334 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f2a73776-a4f8-4cfd-bf9f-47002dc1b331 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:36.818843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2a73776-a4f8-4cfd-bf9f-47002dc1b331 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:36.819463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2a73776-a4f8-4cfd-bf9f-47002dc1b331 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:36.820131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2a73776-a4f8-4cfd-bf9f-47002dc1b331 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:36.822099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2a73776-a4f8-4cfd-bf9f-47002dc1b331 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:36.823483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2a73776-a4f8-4cfd-bf9f-47002dc1b331 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:36.824305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f2a73776-a4f8-4cfd-bf9f-47002dc1b331 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:36.937120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4b4a0086-d419-487f-91dc-c3cf2ff33938 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:36.945428 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4b4a0086-d419-487f-91dc-c3cf2ff33938 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.221337 Oct 29 01:46:36.946033 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3663/7111] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:36 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:36.992906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f2a73776-a4f8-4cfd-bf9f-47002dc1b331 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:37.001327 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f2a73776-a4f8-4cfd-bf9f-47002dc1b331 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1427 microversion: 2.1 time: 0.194317 Oct 29 01:46:37.002018 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3449/7112] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:36 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1427 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:37.662075 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-6c88c195-2678-4176-91f4-6f385b8d3a7e req-c18155d4-fd06-4b93-accc-9bf8764dbcb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838282d2-04eb-4006-9639-daafacf292bd", "name": "network-vif-plugged", "status": "completed", "tag": "220aea55-6ffc-4d99-bd7b-8a42548c0464"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:37.673255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6c88c195-2678-4176-91f4-6f385b8d3a7e req-c18155d4-fd06-4b93-accc-9bf8764dbcb1 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:37.673675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6c88c195-2678-4176-91f4-6f385b8d3a7e req-c18155d4-fd06-4b93-accc-9bf8764dbcb1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:37.674121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6c88c195-2678-4176-91f4-6f385b8d3a7e req-c18155d4-fd06-4b93-accc-9bf8764dbcb1 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:37.685977 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-6c88c195-2678-4176-91f4-6f385b8d3a7e req-c18155d4-fd06-4b93-accc-9bf8764dbcb1 service nova] Creating event network-vif-plugged:220aea55-6ffc-4d99-bd7b-8a42548c0464 for instance 838282d2-04eb-4006-9639-daafacf292bd on n-h1-862964-3 Oct 29 01:46:37.691907 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-6c88c195-2678-4176-91f4-6f385b8d3a7e req-c18155d4-fd06-4b93-accc-9bf8764dbcb1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033639 Oct 29 01:46:37.692612 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3664/7113] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:46:37.779077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e2ffe3dd-ea14-467b-9fda-f761969fb07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:37.781649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e2ffe3dd-ea14-467b-9fda-f761969fb07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:37.789760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2ffe3dd-ea14-467b-9fda-f761969fb07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:37.790515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2ffe3dd-ea14-467b-9fda-f761969fb07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:37.791181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2ffe3dd-ea14-467b-9fda-f761969fb07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:37.792104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2ffe3dd-ea14-467b-9fda-f761969fb07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:37.792848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2ffe3dd-ea14-467b-9fda-f761969fb07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:37.793721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e2ffe3dd-ea14-467b-9fda-f761969fb07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:37.970055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-481bae85-cbc7-446d-a3b1-5a6e0d7127ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:37.970843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-481bae85-cbc7-446d-a3b1-5a6e0d7127ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:37.978511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-481bae85-cbc7-446d-a3b1-5a6e0d7127ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:37.979033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-481bae85-cbc7-446d-a3b1-5a6e0d7127ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:37.981954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-481bae85-cbc7-446d-a3b1-5a6e0d7127ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:37.981954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-481bae85-cbc7-446d-a3b1-5a6e0d7127ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:37.981954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-481bae85-cbc7-446d-a3b1-5a6e0d7127ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:37.981954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-481bae85-cbc7-446d-a3b1-5a6e0d7127ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:37.987999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e2ffe3dd-ea14-467b-9fda-f761969fb07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:37.990403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:46:37.996665 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e2ffe3dd-ea14-467b-9fda-f761969fb07d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1321 microversion: 2.1 time: 0.223969 Oct 29 01:46:37.997273 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3450/7114] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:37 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:38.025260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-66fb81c7-b02d-405c-9da4-288668609b57 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:38.025834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-66fb81c7-b02d-405c-9da4-288668609b57 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:38.032939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66fb81c7-b02d-405c-9da4-288668609b57 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:38.033474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66fb81c7-b02d-405c-9da4-288668609b57 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:38.033931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66fb81c7-b02d-405c-9da4-288668609b57 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:38.034680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66fb81c7-b02d-405c-9da4-288668609b57 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:38.035250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66fb81c7-b02d-405c-9da4-288668609b57 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:38.035726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66fb81c7-b02d-405c-9da4-288668609b57 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:38.198262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-481bae85-cbc7-446d-a3b1-5a6e0d7127ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:38.207615 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-481bae85-cbc7-446d-a3b1-5a6e0d7127ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.243368 Oct 29 01:46:38.221800 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3665/7115] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:37 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:38.236324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-66fb81c7-b02d-405c-9da4-288668609b57 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:38.246612 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-66fb81c7-b02d-405c-9da4-288668609b57 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1427 microversion: 2.1 time: 0.224357 Oct 29 01:46:38.254521 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3451/7116] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:38 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1427 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:39.020033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0b3ef344-064b-4ca2-bbd2-667643f5cc29 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:39.020672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0b3ef344-064b-4ca2-bbd2-667643f5cc29 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:39.027708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b3ef344-064b-4ca2-bbd2-667643f5cc29 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:39.028324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b3ef344-064b-4ca2-bbd2-667643f5cc29 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:39.028770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b3ef344-064b-4ca2-bbd2-667643f5cc29 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:39.029557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b3ef344-064b-4ca2-bbd2-667643f5cc29 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:39.030576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b3ef344-064b-4ca2-bbd2-667643f5cc29 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:39.031007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0b3ef344-064b-4ca2-bbd2-667643f5cc29 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:39.184424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0b3ef344-064b-4ca2-bbd2-667643f5cc29 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:39.184424 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0b3ef344-064b-4ca2-bbd2-667643f5cc29 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1321 microversion: 2.1 time: 0.165195 Oct 29 01:46:39.184424 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3666/7117] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:39 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:39.234366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1ba89377-862a-4dd8-b553-0861dd0a66d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:39.234896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1ba89377-862a-4dd8-b553-0861dd0a66d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:39.242690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ba89377-862a-4dd8-b553-0861dd0a66d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:39.243191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ba89377-862a-4dd8-b553-0861dd0a66d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:39.243712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ba89377-862a-4dd8-b553-0861dd0a66d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:39.244427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ba89377-862a-4dd8-b553-0861dd0a66d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:39.244904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ba89377-862a-4dd8-b553-0861dd0a66d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:39.245373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ba89377-862a-4dd8-b553-0861dd0a66d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:39.270367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-264efce3-6898-4ce4-8b9b-e2dbb15c47df tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:39.271156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-264efce3-6898-4ce4-8b9b-e2dbb15c47df tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:39.277369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-264efce3-6898-4ce4-8b9b-e2dbb15c47df tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:39.277856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-264efce3-6898-4ce4-8b9b-e2dbb15c47df tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:39.278296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-264efce3-6898-4ce4-8b9b-e2dbb15c47df tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:39.278995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-264efce3-6898-4ce4-8b9b-e2dbb15c47df tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:39.279451 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-264efce3-6898-4ce4-8b9b-e2dbb15c47df tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:39.279881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-264efce3-6898-4ce4-8b9b-e2dbb15c47df tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:39.465634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1ba89377-862a-4dd8-b553-0861dd0a66d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:39.476828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-264efce3-6898-4ce4-8b9b-e2dbb15c47df tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:39.489732 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1ba89377-862a-4dd8-b553-0861dd0a66d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.258419 Oct 29 01:46:39.501338 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3452/7118] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:39 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:39.501558 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-264efce3-6898-4ce4-8b9b-e2dbb15c47df tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1427 microversion: 2.1 time: 0.230811 Oct 29 01:46:39.501558 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3667/7119] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:39 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1427 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:39.711920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-cc673fd1-e81e-43d2-8387-75364be64b48 req-1a55fadc-21a2-4429-ad3c-a4fae5e1c0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c350c1d-73f3-486a-b0db-62b11cb9e94b", "name": "network-vif-plugged", "status": "completed", "tag": "e6dfa47d-bb94-49fc-b30b-ddd42ba7e60c"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:39.722473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-cc673fd1-e81e-43d2-8387-75364be64b48 req-1a55fadc-21a2-4429-ad3c-a4fae5e1c0a9 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:39.722966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-cc673fd1-e81e-43d2-8387-75364be64b48 req-1a55fadc-21a2-4429-ad3c-a4fae5e1c0a9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:39.723653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-cc673fd1-e81e-43d2-8387-75364be64b48 req-1a55fadc-21a2-4429-ad3c-a4fae5e1c0a9 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:39.736333 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-cc673fd1-e81e-43d2-8387-75364be64b48 req-1a55fadc-21a2-4429-ad3c-a4fae5e1c0a9 service nova] Creating event network-vif-plugged:e6dfa47d-bb94-49fc-b30b-ddd42ba7e60c for instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b on n-h1-862964-3 Oct 29 01:46:39.743432 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-cc673fd1-e81e-43d2-8387-75364be64b48 req-1a55fadc-21a2-4429-ad3c-a4fae5e1c0a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034170 Oct 29 01:46:39.743432 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3453/7120] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:46:40.207141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6cbe0d22-ebd2-4b25-84c6-2589b019bd42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:40.207691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6cbe0d22-ebd2-4b25-84c6-2589b019bd42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:40.215631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cbe0d22-ebd2-4b25-84c6-2589b019bd42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:40.216127 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cbe0d22-ebd2-4b25-84c6-2589b019bd42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:40.216570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cbe0d22-ebd2-4b25-84c6-2589b019bd42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:40.217296 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cbe0d22-ebd2-4b25-84c6-2589b019bd42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:40.217788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cbe0d22-ebd2-4b25-84c6-2589b019bd42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:40.218223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cbe0d22-ebd2-4b25-84c6-2589b019bd42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:40.356747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6cbe0d22-ebd2-4b25-84c6-2589b019bd42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:40.366065 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6cbe0d22-ebd2-4b25-84c6-2589b019bd42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1516 microversion: 2.1 time: 0.163047 Oct 29 01:46:40.366685 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3668/7121] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:40 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:40.391417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-044062cd-f6f0-440d-8c5f-e55993038f42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:40.393900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-044062cd-f6f0-440d-8c5f-e55993038f42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:40.400365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-044062cd-f6f0-440d-8c5f-e55993038f42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:40.400868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-044062cd-f6f0-440d-8c5f-e55993038f42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:40.401356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-044062cd-f6f0-440d-8c5f-e55993038f42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:40.402078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-044062cd-f6f0-440d-8c5f-e55993038f42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:40.402565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-044062cd-f6f0-440d-8c5f-e55993038f42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:40.403010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-044062cd-f6f0-440d-8c5f-e55993038f42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:40.428416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-044062cd-f6f0-440d-8c5f-e55993038f42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lazy-loading 'flavor' on Instance uuid 838282d2-04eb-4006-9639-daafacf292bd {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:46:40.513738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7781a780-2aec-4457-82ba-b422ccf23601 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:40.514274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7781a780-2aec-4457-82ba-b422ccf23601 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:40.521065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7781a780-2aec-4457-82ba-b422ccf23601 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:40.521606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7781a780-2aec-4457-82ba-b422ccf23601 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:40.522041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7781a780-2aec-4457-82ba-b422ccf23601 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:40.522742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7781a780-2aec-4457-82ba-b422ccf23601 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:40.523196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7781a780-2aec-4457-82ba-b422ccf23601 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:40.523619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7781a780-2aec-4457-82ba-b422ccf23601 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:40.665034 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7781a780-2aec-4457-82ba-b422ccf23601 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:40.673760 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7781a780-2aec-4457-82ba-b422ccf23601 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.163938 Oct 29 01:46:40.674627 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3669/7122] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:40 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:40.681388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c863f801-5e17-4e05-838a-f5e91c3c5e77 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:40.682297 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c863f801-5e17-4e05-838a-f5e91c3c5e77 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:40.687491 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-044062cd-f6f0-440d-8c5f-e55993038f42 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "POST /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd/action" status: 200 len: 32 microversion: 2.1 time: 0.301194 Oct 29 01:46:40.688117 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3454/7123] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:46:40 2022] POST /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd/action => generated 32 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:46:40.696808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c863f801-5e17-4e05-838a-f5e91c3c5e77 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:40.704897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c863f801-5e17-4e05-838a-f5e91c3c5e77 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:40.704897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c863f801-5e17-4e05-838a-f5e91c3c5e77 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:40.704897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c863f801-5e17-4e05-838a-f5e91c3c5e77 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:40.704897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c863f801-5e17-4e05-838a-f5e91c3c5e77 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:40.704897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c863f801-5e17-4e05-838a-f5e91c3c5e77 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:40.705541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4516509f-5f18-4525-90e0-7b89eeb2ac48 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:40.705541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4516509f-5f18-4525-90e0-7b89eeb2ac48 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:40.708739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4516509f-5f18-4525-90e0-7b89eeb2ac48 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:40.709343 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4516509f-5f18-4525-90e0-7b89eeb2ac48 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:40.709854 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4516509f-5f18-4525-90e0-7b89eeb2ac48 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:40.710743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4516509f-5f18-4525-90e0-7b89eeb2ac48 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:40.711241 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4516509f-5f18-4525-90e0-7b89eeb2ac48 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:40.711742 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4516509f-5f18-4525-90e0-7b89eeb2ac48 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:40.932826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c863f801-5e17-4e05-838a-f5e91c3c5e77 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:40.940439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4516509f-5f18-4525-90e0-7b89eeb2ac48 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:40.942170 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c863f801-5e17-4e05-838a-f5e91c3c5e77 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1427 microversion: 2.1 time: 0.266727 Oct 29 01:46:40.942980 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3670/7124] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:40 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1427 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:40.949710 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4516509f-5f18-4525-90e0-7b89eeb2ac48 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.254761 Oct 29 01:46:40.950419 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3455/7125] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:40 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:41.700545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7f4b15a8-7e45-4dfa-95e3-fe4df85db1ce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:41.701192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7f4b15a8-7e45-4dfa-95e3-fe4df85db1ce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:41.709900 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f4b15a8-7e45-4dfa-95e3-fe4df85db1ce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:41.710397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f4b15a8-7e45-4dfa-95e3-fe4df85db1ce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:41.710832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f4b15a8-7e45-4dfa-95e3-fe4df85db1ce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:41.711905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f4b15a8-7e45-4dfa-95e3-fe4df85db1ce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:41.712543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f4b15a8-7e45-4dfa-95e3-fe4df85db1ce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:41.712977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7f4b15a8-7e45-4dfa-95e3-fe4df85db1ce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:41.887019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7f4b15a8-7e45-4dfa-95e3-fe4df85db1ce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:41.889339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:46:41.896048 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7f4b15a8-7e45-4dfa-95e3-fe4df85db1ce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.199956 Oct 29 01:46:41.896615 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3671/7126] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:41 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:41.969309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c256e3f2-76d5-4c6f-b291-bff26673f1c7 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:41.970382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c256e3f2-76d5-4c6f-b291-bff26673f1c7 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:41.979264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4d5e89fc-ae4c-441d-8e63-65a60e430f01 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:41.979883 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4d5e89fc-ae4c-441d-8e63-65a60e430f01 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:41.986936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d5e89fc-ae4c-441d-8e63-65a60e430f01 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:41.987781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d5e89fc-ae4c-441d-8e63-65a60e430f01 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:41.988427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d5e89fc-ae4c-441d-8e63-65a60e430f01 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:41.990327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d5e89fc-ae4c-441d-8e63-65a60e430f01 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:41.991016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c256e3f2-76d5-4c6f-b291-bff26673f1c7 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:41.991353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d5e89fc-ae4c-441d-8e63-65a60e430f01 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:41.991522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c256e3f2-76d5-4c6f-b291-bff26673f1c7 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:41.992072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4d5e89fc-ae4c-441d-8e63-65a60e430f01 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:41.992346 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c256e3f2-76d5-4c6f-b291-bff26673f1c7 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:41.993309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c256e3f2-76d5-4c6f-b291-bff26673f1c7 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:41.994986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c256e3f2-76d5-4c6f-b291-bff26673f1c7 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:41.995969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c256e3f2-76d5-4c6f-b291-bff26673f1c7 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:42.226253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4d5e89fc-ae4c-441d-8e63-65a60e430f01 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:42.236799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c256e3f2-76d5-4c6f-b291-bff26673f1c7 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:42.237774 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4d5e89fc-ae4c-441d-8e63-65a60e430f01 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.262144 Oct 29 01:46:42.239721 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3672/7127] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:41 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:42.245771 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c256e3f2-76d5-4c6f-b291-bff26673f1c7 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1608 microversion: 2.1 time: 0.281792 Oct 29 01:46:42.246359 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3456/7128] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:41 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1608 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:42.269372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ea2cddaf-81ff-48ce-8094-1b8fbd44711b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:42.270130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ea2cddaf-81ff-48ce-8094-1b8fbd44711b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:42.277854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea2cddaf-81ff-48ce-8094-1b8fbd44711b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:42.278353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea2cddaf-81ff-48ce-8094-1b8fbd44711b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:42.278929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea2cddaf-81ff-48ce-8094-1b8fbd44711b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:42.279965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea2cddaf-81ff-48ce-8094-1b8fbd44711b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:42.281480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea2cddaf-81ff-48ce-8094-1b8fbd44711b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:42.282378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea2cddaf-81ff-48ce-8094-1b8fbd44711b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:42.430098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ea2cddaf-81ff-48ce-8094-1b8fbd44711b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:42.437957 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ea2cddaf-81ff-48ce-8094-1b8fbd44711b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1608 microversion: 2.1 time: 0.172740 Oct 29 01:46:42.438532 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3673/7129] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:42 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1608 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:42.460685 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1ef49416-7b94-40b4-8576-7bc43e84db9d tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:42.461348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1ef49416-7b94-40b4-8576-7bc43e84db9d tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:42.467677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ef49416-7b94-40b4-8576-7bc43e84db9d tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:42.469090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ef49416-7b94-40b4-8576-7bc43e84db9d tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:42.469724 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ef49416-7b94-40b4-8576-7bc43e84db9d tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:42.470447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ef49416-7b94-40b4-8576-7bc43e84db9d tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:42.470922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ef49416-7b94-40b4-8576-7bc43e84db9d tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:42.471362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1ef49416-7b94-40b4-8576-7bc43e84db9d tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:42.619645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1ef49416-7b94-40b4-8576-7bc43e84db9d tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:42.628435 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1ef49416-7b94-40b4-8576-7bc43e84db9d tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1608 microversion: 2.1 time: 0.171554 Oct 29 01:46:42.628966 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3457/7130] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:42 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1608 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:42.921764 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-84058fca-1110-47b8-9c43-b3f0cd29f5ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:42.922434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-84058fca-1110-47b8-9c43-b3f0cd29f5ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:42.929998 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84058fca-1110-47b8-9c43-b3f0cd29f5ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:42.940393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84058fca-1110-47b8-9c43-b3f0cd29f5ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:42.940393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84058fca-1110-47b8-9c43-b3f0cd29f5ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:42.940393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84058fca-1110-47b8-9c43-b3f0cd29f5ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:42.940393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84058fca-1110-47b8-9c43-b3f0cd29f5ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:42.940393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84058fca-1110-47b8-9c43-b3f0cd29f5ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:43.081447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-84058fca-1110-47b8-9c43-b3f0cd29f5ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:43.089309 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-84058fca-1110-47b8-9c43-b3f0cd29f5ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.171697 Oct 29 01:46:43.089892 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3674/7131] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:42 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:43.263410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0b3e1b13-2848-4f22-81ea-8848dff9b8fe tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:43.264035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0b3e1b13-2848-4f22-81ea-8848dff9b8fe tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:43.271978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b3e1b13-2848-4f22-81ea-8848dff9b8fe tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:43.272476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b3e1b13-2848-4f22-81ea-8848dff9b8fe tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:43.272926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b3e1b13-2848-4f22-81ea-8848dff9b8fe tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:43.273921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b3e1b13-2848-4f22-81ea-8848dff9b8fe tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:43.274413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b3e1b13-2848-4f22-81ea-8848dff9b8fe tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:43.282158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0b3e1b13-2848-4f22-81ea-8848dff9b8fe tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:43.427879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0b3e1b13-2848-4f22-81ea-8848dff9b8fe tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:43.436490 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0b3e1b13-2848-4f22-81ea-8848dff9b8fe tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.176941 Oct 29 01:46:43.438219 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3458/7132] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:43 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:44.112773 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cb020580-b306-4032-b574-04a3114dc2c8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:44.113410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cb020580-b306-4032-b574-04a3114dc2c8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:44.120350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb020580-b306-4032-b574-04a3114dc2c8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:44.120822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb020580-b306-4032-b574-04a3114dc2c8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:44.121308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb020580-b306-4032-b574-04a3114dc2c8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:44.122000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb020580-b306-4032-b574-04a3114dc2c8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:44.122459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb020580-b306-4032-b574-04a3114dc2c8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:44.122888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb020580-b306-4032-b574-04a3114dc2c8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:44.298803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cb020580-b306-4032-b574-04a3114dc2c8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:44.306923 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cb020580-b306-4032-b574-04a3114dc2c8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.198869 Oct 29 01:46:44.307507 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3675/7133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:44 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:44.460091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b26d19b7-2368-408f-a056-baf9370c9053 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:44.460753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b26d19b7-2368-408f-a056-baf9370c9053 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:44.467933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b26d19b7-2368-408f-a056-baf9370c9053 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:44.468606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b26d19b7-2368-408f-a056-baf9370c9053 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:44.469186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b26d19b7-2368-408f-a056-baf9370c9053 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:44.469891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b26d19b7-2368-408f-a056-baf9370c9053 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:44.470414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b26d19b7-2368-408f-a056-baf9370c9053 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:44.470839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b26d19b7-2368-408f-a056-baf9370c9053 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:44.629513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b26d19b7-2368-408f-a056-baf9370c9053 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:44.637806 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b26d19b7-2368-408f-a056-baf9370c9053 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.181521 Oct 29 01:46:44.638434 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3459/7134] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:44 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:45.152876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-d8e83914-d77d-4945-9d5e-460f9ec98dd1 req-a72cd7cd-7c2a-48d4-8d1e-329a6cc9ebc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c350c1d-73f3-486a-b0db-62b11cb9e94b", "tag": "e6dfa47d-bb94-49fc-b30b-ddd42ba7e60c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:46:45.164447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d8e83914-d77d-4945-9d5e-460f9ec98dd1 req-a72cd7cd-7c2a-48d4-8d1e-329a6cc9ebc8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:45.164936 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d8e83914-d77d-4945-9d5e-460f9ec98dd1 req-a72cd7cd-7c2a-48d4-8d1e-329a6cc9ebc8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:45.165405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d8e83914-d77d-4945-9d5e-460f9ec98dd1 req-a72cd7cd-7c2a-48d4-8d1e-329a6cc9ebc8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:45.180962 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-d8e83914-d77d-4945-9d5e-460f9ec98dd1 req-a72cd7cd-7c2a-48d4-8d1e-329a6cc9ebc8 service nova] Creating event network-changed:e6dfa47d-bb94-49fc-b30b-ddd42ba7e60c for instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b on n-h1-862964-3 Oct 29 01:46:45.186199 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-d8e83914-d77d-4945-9d5e-460f9ec98dd1 req-a72cd7cd-7c2a-48d4-8d1e-329a6cc9ebc8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037349 Oct 29 01:46:45.186842 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3676/7135] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:46:45.332041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-556b667b-8a79-4d6b-9d3a-2b73420bbb06 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:45.333074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-556b667b-8a79-4d6b-9d3a-2b73420bbb06 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:45.339497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-556b667b-8a79-4d6b-9d3a-2b73420bbb06 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:45.340089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-556b667b-8a79-4d6b-9d3a-2b73420bbb06 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:45.340712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-556b667b-8a79-4d6b-9d3a-2b73420bbb06 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:45.341483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-556b667b-8a79-4d6b-9d3a-2b73420bbb06 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:45.342039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-556b667b-8a79-4d6b-9d3a-2b73420bbb06 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:45.342564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-556b667b-8a79-4d6b-9d3a-2b73420bbb06 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:45.600624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-556b667b-8a79-4d6b-9d3a-2b73420bbb06 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:45.610745 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-556b667b-8a79-4d6b-9d3a-2b73420bbb06 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.283465 Oct 29 01:46:45.621544 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3460/7136] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:45 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:45.661653 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e8c1d671-58df-4405-a265-9e195ee35db9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:45.662360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e8c1d671-58df-4405-a265-9e195ee35db9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:45.678168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8c1d671-58df-4405-a265-9e195ee35db9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:45.678675 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8c1d671-58df-4405-a265-9e195ee35db9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:45.679151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8c1d671-58df-4405-a265-9e195ee35db9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:45.679970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8c1d671-58df-4405-a265-9e195ee35db9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:45.680360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8c1d671-58df-4405-a265-9e195ee35db9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:45.680770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e8c1d671-58df-4405-a265-9e195ee35db9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:45.926120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e8c1d671-58df-4405-a265-9e195ee35db9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:45.941234 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e8c1d671-58df-4405-a265-9e195ee35db9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.283788 Oct 29 01:46:45.941875 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3677/7137] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:45 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:46.635464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4117e6c8-b87b-4f32-a641-900e85874380 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:46.638953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4117e6c8-b87b-4f32-a641-900e85874380 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:46.645396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4117e6c8-b87b-4f32-a641-900e85874380 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:46.645896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4117e6c8-b87b-4f32-a641-900e85874380 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:46.646348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4117e6c8-b87b-4f32-a641-900e85874380 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:46.647062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4117e6c8-b87b-4f32-a641-900e85874380 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:46.647530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4117e6c8-b87b-4f32-a641-900e85874380 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:46.647970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4117e6c8-b87b-4f32-a641-900e85874380 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:46.787571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4117e6c8-b87b-4f32-a641-900e85874380 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:46.795547 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4117e6c8-b87b-4f32-a641-900e85874380 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.164351 Oct 29 01:46:46.796135 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3461/7138] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:46 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:46.965970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3812466b-f5e8-4f3b-b76c-ca5c67132981 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:46.969255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3812466b-f5e8-4f3b-b76c-ca5c67132981 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:46.975322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3812466b-f5e8-4f3b-b76c-ca5c67132981 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:46.975812 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3812466b-f5e8-4f3b-b76c-ca5c67132981 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:46.976357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3812466b-f5e8-4f3b-b76c-ca5c67132981 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:46.977054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3812466b-f5e8-4f3b-b76c-ca5c67132981 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:46.977577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3812466b-f5e8-4f3b-b76c-ca5c67132981 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:46.978000 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3812466b-f5e8-4f3b-b76c-ca5c67132981 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:47.122372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3812466b-f5e8-4f3b-b76c-ca5c67132981 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:47.132586 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3812466b-f5e8-4f3b-b76c-ca5c67132981 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.170562 Oct 29 01:46:47.133265 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3678/7139] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:46 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:46:47.824263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-77508811-8db3-4614-aaf8-9c69a28964da tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:47.825027 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-77508811-8db3-4614-aaf8-9c69a28964da tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:47.835404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77508811-8db3-4614-aaf8-9c69a28964da tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:47.835910 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77508811-8db3-4614-aaf8-9c69a28964da tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:47.836357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77508811-8db3-4614-aaf8-9c69a28964da tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:47.837085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77508811-8db3-4614-aaf8-9c69a28964da tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:47.837590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77508811-8db3-4614-aaf8-9c69a28964da tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:47.838028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77508811-8db3-4614-aaf8-9c69a28964da tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:47.994133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-77508811-8db3-4614-aaf8-9c69a28964da tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:48.003265 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-77508811-8db3-4614-aaf8-9c69a28964da tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.183547 Oct 29 01:46:48.004092 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3462/7140] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:47 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:48.156856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e738cc2e-95e9-49eb-8968-a3732624278b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:48.157578 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e738cc2e-95e9-49eb-8968-a3732624278b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:48.165757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e738cc2e-95e9-49eb-8968-a3732624278b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:48.166355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e738cc2e-95e9-49eb-8968-a3732624278b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:48.168980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e738cc2e-95e9-49eb-8968-a3732624278b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:48.168980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e738cc2e-95e9-49eb-8968-a3732624278b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:48.168980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e738cc2e-95e9-49eb-8968-a3732624278b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:48.168980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e738cc2e-95e9-49eb-8968-a3732624278b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:48.313898 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e738cc2e-95e9-49eb-8968-a3732624278b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:48.322430 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e738cc2e-95e9-49eb-8968-a3732624278b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.170349 Oct 29 01:46:48.323014 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3679/7141] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:48 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:49.028050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e1bc095b-3c4d-4403-965c-ce6362478bb2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:49.029462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e1bc095b-3c4d-4403-965c-ce6362478bb2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:49.037754 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1bc095b-3c4d-4403-965c-ce6362478bb2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:49.038266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1bc095b-3c4d-4403-965c-ce6362478bb2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:49.038716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1bc095b-3c4d-4403-965c-ce6362478bb2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:49.039441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1bc095b-3c4d-4403-965c-ce6362478bb2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:49.039929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1bc095b-3c4d-4403-965c-ce6362478bb2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:49.040353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1bc095b-3c4d-4403-965c-ce6362478bb2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:49.186705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e1bc095b-3c4d-4403-965c-ce6362478bb2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:49.194787 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e1bc095b-3c4d-4403-965c-ce6362478bb2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.170962 Oct 29 01:46:49.195359 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3463/7142] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:49 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:49.346969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9c61b76f-fb75-4ec4-8550-4afe562292d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:49.347777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9c61b76f-fb75-4ec4-8550-4afe562292d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:49.355281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c61b76f-fb75-4ec4-8550-4afe562292d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:49.355765 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c61b76f-fb75-4ec4-8550-4afe562292d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:49.356212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c61b76f-fb75-4ec4-8550-4afe562292d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:49.356902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c61b76f-fb75-4ec4-8550-4afe562292d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:49.357432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c61b76f-fb75-4ec4-8550-4afe562292d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:49.363686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9c61b76f-fb75-4ec4-8550-4afe562292d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:49.495084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9c61b76f-fb75-4ec4-8550-4afe562292d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:49.504299 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9c61b76f-fb75-4ec4-8550-4afe562292d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.162012 Oct 29 01:46:49.504888 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3680/7143] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:49 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:50.219416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0cf20fc4-24c0-4909-8d29-98cf577ac9b6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:50.219958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0cf20fc4-24c0-4909-8d29-98cf577ac9b6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:50.227351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cf20fc4-24c0-4909-8d29-98cf577ac9b6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:50.227893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cf20fc4-24c0-4909-8d29-98cf577ac9b6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:50.228334 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cf20fc4-24c0-4909-8d29-98cf577ac9b6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:50.229063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cf20fc4-24c0-4909-8d29-98cf577ac9b6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:50.229586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cf20fc4-24c0-4909-8d29-98cf577ac9b6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:50.230076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0cf20fc4-24c0-4909-8d29-98cf577ac9b6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:50.366485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0cf20fc4-24c0-4909-8d29-98cf577ac9b6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:50.374884 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0cf20fc4-24c0-4909-8d29-98cf577ac9b6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.159347 Oct 29 01:46:50.375631 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3464/7144] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:50 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:50.527969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4f3f2ab8-56b2-4f9a-966f-b867aa08887d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:50.528741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4f3f2ab8-56b2-4f9a-966f-b867aa08887d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:50.536711 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f3f2ab8-56b2-4f9a-966f-b867aa08887d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:50.537223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f3f2ab8-56b2-4f9a-966f-b867aa08887d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:50.537669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f3f2ab8-56b2-4f9a-966f-b867aa08887d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:50.538372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f3f2ab8-56b2-4f9a-966f-b867aa08887d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:50.538837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f3f2ab8-56b2-4f9a-966f-b867aa08887d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:50.539268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4f3f2ab8-56b2-4f9a-966f-b867aa08887d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:50.991603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4f3f2ab8-56b2-4f9a-966f-b867aa08887d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:51.000699 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4f3f2ab8-56b2-4f9a-966f-b867aa08887d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.476585 Oct 29 01:46:51.001306 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3681/7145] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:50 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:51.398472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c4292d46-f9af-4139-8f11-9ffae3320075 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:51.399096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c4292d46-f9af-4139-8f11-9ffae3320075 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:51.407126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4292d46-f9af-4139-8f11-9ffae3320075 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:51.407757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4292d46-f9af-4139-8f11-9ffae3320075 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:51.408282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4292d46-f9af-4139-8f11-9ffae3320075 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:51.409110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4292d46-f9af-4139-8f11-9ffae3320075 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:51.409773 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4292d46-f9af-4139-8f11-9ffae3320075 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:51.410311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4292d46-f9af-4139-8f11-9ffae3320075 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:51.558938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c4292d46-f9af-4139-8f11-9ffae3320075 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:51.564522 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c4292d46-f9af-4139-8f11-9ffae3320075 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.169919 Oct 29 01:46:51.565119 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3465/7146] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:51 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:52.025509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-adc6fcf5-f07d-4511-87bf-ac6801fbe7e7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:52.026116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-adc6fcf5-f07d-4511-87bf-ac6801fbe7e7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:52.034694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adc6fcf5-f07d-4511-87bf-ac6801fbe7e7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:52.035452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adc6fcf5-f07d-4511-87bf-ac6801fbe7e7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:52.036057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adc6fcf5-f07d-4511-87bf-ac6801fbe7e7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:52.037891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adc6fcf5-f07d-4511-87bf-ac6801fbe7e7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:52.038404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adc6fcf5-f07d-4511-87bf-ac6801fbe7e7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:52.038867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-adc6fcf5-f07d-4511-87bf-ac6801fbe7e7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:52.236019 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-adc6fcf5-f07d-4511-87bf-ac6801fbe7e7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:52.246679 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-adc6fcf5-f07d-4511-87bf-ac6801fbe7e7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.226538 Oct 29 01:46:52.247265 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3682/7147] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:52 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:52.595155 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-313f5571-7249-42b8-b47a-b8e6dfa030a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:52.595784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-313f5571-7249-42b8-b47a-b8e6dfa030a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:52.602862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-313f5571-7249-42b8-b47a-b8e6dfa030a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:52.603393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-313f5571-7249-42b8-b47a-b8e6dfa030a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:52.603806 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-313f5571-7249-42b8-b47a-b8e6dfa030a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:52.604514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-313f5571-7249-42b8-b47a-b8e6dfa030a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:52.604994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-313f5571-7249-42b8-b47a-b8e6dfa030a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:52.605486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-313f5571-7249-42b8-b47a-b8e6dfa030a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:52.608164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:46:52.741553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-313f5571-7249-42b8-b47a-b8e6dfa030a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:52.749729 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-313f5571-7249-42b8-b47a-b8e6dfa030a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.159310 Oct 29 01:46:52.756917 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3466/7148] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:52 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:53.271969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d1942dfc-ef9b-4550-8168-931ac280cd5f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:53.272597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d1942dfc-ef9b-4550-8168-931ac280cd5f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:53.279644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1942dfc-ef9b-4550-8168-931ac280cd5f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:53.280136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1942dfc-ef9b-4550-8168-931ac280cd5f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:53.280611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1942dfc-ef9b-4550-8168-931ac280cd5f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:53.282113 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1942dfc-ef9b-4550-8168-931ac280cd5f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:53.282332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1942dfc-ef9b-4550-8168-931ac280cd5f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:53.282766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d1942dfc-ef9b-4550-8168-931ac280cd5f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:53.420530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d1942dfc-ef9b-4550-8168-931ac280cd5f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:53.429060 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d1942dfc-ef9b-4550-8168-931ac280cd5f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.161065 Oct 29 01:46:53.429658 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3683/7149] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:53 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:53.772964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5d259720-c88d-43c9-b784-dd7d39f6b254 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:53.773645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5d259720-c88d-43c9-b784-dd7d39f6b254 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:53.780633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d259720-c88d-43c9-b784-dd7d39f6b254 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:53.781334 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d259720-c88d-43c9-b784-dd7d39f6b254 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:53.781809 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d259720-c88d-43c9-b784-dd7d39f6b254 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:53.782583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d259720-c88d-43c9-b784-dd7d39f6b254 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:53.783009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d259720-c88d-43c9-b784-dd7d39f6b254 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:53.783505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5d259720-c88d-43c9-b784-dd7d39f6b254 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:53.918988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5d259720-c88d-43c9-b784-dd7d39f6b254 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:53.927686 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5d259720-c88d-43c9-b784-dd7d39f6b254 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.159098 Oct 29 01:46:53.928272 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3467/7150] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:53 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:54.454134 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-621638fb-9a17-4d90-99ec-0b87b17a77c1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:54.454756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-621638fb-9a17-4d90-99ec-0b87b17a77c1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:54.458103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=92 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:46:54.463495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-621638fb-9a17-4d90-99ec-0b87b17a77c1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:54.463986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-621638fb-9a17-4d90-99ec-0b87b17a77c1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:54.464425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-621638fb-9a17-4d90-99ec-0b87b17a77c1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:54.465140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-621638fb-9a17-4d90-99ec-0b87b17a77c1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:54.465619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-621638fb-9a17-4d90-99ec-0b87b17a77c1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:54.466049 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-621638fb-9a17-4d90-99ec-0b87b17a77c1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:54.607821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-621638fb-9a17-4d90-99ec-0b87b17a77c1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:54.616900 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-621638fb-9a17-4d90-99ec-0b87b17a77c1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.166939 Oct 29 01:46:54.618740 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3684/7151] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:54 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:54.951567 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-51ce2746-c317-4a7c-9fc1-61c3611543cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:54.952191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-51ce2746-c317-4a7c-9fc1-61c3611543cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:54.955142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=84 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:46:54.960021 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51ce2746-c317-4a7c-9fc1-61c3611543cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:54.960555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51ce2746-c317-4a7c-9fc1-61c3611543cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:54.961325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51ce2746-c317-4a7c-9fc1-61c3611543cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:54.962183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51ce2746-c317-4a7c-9fc1-61c3611543cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:54.962183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51ce2746-c317-4a7c-9fc1-61c3611543cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:54.963225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-51ce2746-c317-4a7c-9fc1-61c3611543cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:55.105249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-51ce2746-c317-4a7c-9fc1-61c3611543cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:55.113990 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-51ce2746-c317-4a7c-9fc1-61c3611543cb tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.166384 Oct 29 01:46:55.115942 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3468/7152] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:54 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:55.640023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8f2caf0c-7586-4e22-a195-19fb66109413 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:55.641412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8f2caf0c-7586-4e22-a195-19fb66109413 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:55.648329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f2caf0c-7586-4e22-a195-19fb66109413 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:55.648817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f2caf0c-7586-4e22-a195-19fb66109413 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:55.649289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f2caf0c-7586-4e22-a195-19fb66109413 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:55.650021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f2caf0c-7586-4e22-a195-19fb66109413 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:55.650483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f2caf0c-7586-4e22-a195-19fb66109413 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:55.650932 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f2caf0c-7586-4e22-a195-19fb66109413 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:55.812143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8f2caf0c-7586-4e22-a195-19fb66109413 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:55.822513 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8f2caf0c-7586-4e22-a195-19fb66109413 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.186396 Oct 29 01:46:55.823104 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3685/7153] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:55 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:56.136973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e26deac3-e470-4357-9b39-6678fbe2bfbc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:56.137629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e26deac3-e470-4357-9b39-6678fbe2bfbc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:56.144577 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e26deac3-e470-4357-9b39-6678fbe2bfbc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:56.148313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e26deac3-e470-4357-9b39-6678fbe2bfbc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:56.148313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e26deac3-e470-4357-9b39-6678fbe2bfbc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:56.148313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e26deac3-e470-4357-9b39-6678fbe2bfbc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:56.148313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e26deac3-e470-4357-9b39-6678fbe2bfbc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:56.148313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e26deac3-e470-4357-9b39-6678fbe2bfbc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:56.286999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e26deac3-e470-4357-9b39-6678fbe2bfbc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:56.294812 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e26deac3-e470-4357-9b39-6678fbe2bfbc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.161820 Oct 29 01:46:56.295390 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3469/7154] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:56 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:56.847053 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a41256f0-90ae-4e30-9513-66b2890d643d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:56.847704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a41256f0-90ae-4e30-9513-66b2890d643d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:56.854361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a41256f0-90ae-4e30-9513-66b2890d643d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:56.860672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a41256f0-90ae-4e30-9513-66b2890d643d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:56.860672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a41256f0-90ae-4e30-9513-66b2890d643d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:56.860672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a41256f0-90ae-4e30-9513-66b2890d643d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:56.860672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a41256f0-90ae-4e30-9513-66b2890d643d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:56.860672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a41256f0-90ae-4e30-9513-66b2890d643d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:56.998861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a41256f0-90ae-4e30-9513-66b2890d643d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:57.012752 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a41256f0-90ae-4e30-9513-66b2890d643d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.170178 Oct 29 01:46:57.013435 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3686/7155] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:56 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:57.318920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2e979186-76ca-47a1-a91d-b3472fdf982b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:57.319694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2e979186-76ca-47a1-a91d-b3472fdf982b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:57.327438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e979186-76ca-47a1-a91d-b3472fdf982b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:57.327932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e979186-76ca-47a1-a91d-b3472fdf982b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:57.328383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e979186-76ca-47a1-a91d-b3472fdf982b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:57.329675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e979186-76ca-47a1-a91d-b3472fdf982b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:57.330149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e979186-76ca-47a1-a91d-b3472fdf982b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:57.330622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2e979186-76ca-47a1-a91d-b3472fdf982b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:57.480688 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2e979186-76ca-47a1-a91d-b3472fdf982b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:57.489686 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2e979186-76ca-47a1-a91d-b3472fdf982b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.174555 Oct 29 01:46:57.490420 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3470/7156] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:57 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:58.038029 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b82871d9-e961-47f7-9794-da92f073440e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:58.039110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b82871d9-e961-47f7-9794-da92f073440e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:58.046536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b82871d9-e961-47f7-9794-da92f073440e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:58.047020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b82871d9-e961-47f7-9794-da92f073440e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:58.048930 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b82871d9-e961-47f7-9794-da92f073440e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:58.049679 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b82871d9-e961-47f7-9794-da92f073440e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:58.050141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b82871d9-e961-47f7-9794-da92f073440e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:58.050598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b82871d9-e961-47f7-9794-da92f073440e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:58.195397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b82871d9-e961-47f7-9794-da92f073440e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:58.206425 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b82871d9-e961-47f7-9794-da92f073440e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.172774 Oct 29 01:46:58.207327 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3687/7157] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:58 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:58.522613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d2be318b-11dd-461e-abf9-22a226533576 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:58.526634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d2be318b-11dd-461e-abf9-22a226533576 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:58.545556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2be318b-11dd-461e-abf9-22a226533576 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:58.546079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2be318b-11dd-461e-abf9-22a226533576 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:58.546542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2be318b-11dd-461e-abf9-22a226533576 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:58.547299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2be318b-11dd-461e-abf9-22a226533576 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:58.548749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2be318b-11dd-461e-abf9-22a226533576 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:58.549468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d2be318b-11dd-461e-abf9-22a226533576 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:58.701107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d2be318b-11dd-461e-abf9-22a226533576 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:58.712052 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d2be318b-11dd-461e-abf9-22a226533576 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.202059 Oct 29 01:46:58.712897 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3471/7158] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:58 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:59.231953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ec1007f0-152f-41b9-8e3c-7f4f9949c283 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:59.232740 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ec1007f0-152f-41b9-8e3c-7f4f9949c283 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:59.241018 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec1007f0-152f-41b9-8e3c-7f4f9949c283 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:59.241550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec1007f0-152f-41b9-8e3c-7f4f9949c283 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:59.241994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec1007f0-152f-41b9-8e3c-7f4f9949c283 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:59.242874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec1007f0-152f-41b9-8e3c-7f4f9949c283 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:59.243338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec1007f0-152f-41b9-8e3c-7f4f9949c283 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:59.243760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ec1007f0-152f-41b9-8e3c-7f4f9949c283 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:59.396250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ec1007f0-152f-41b9-8e3c-7f4f9949c283 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:59.410817 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ec1007f0-152f-41b9-8e3c-7f4f9949c283 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.182968 Oct 29 01:46:59.411463 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3688/7159] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:59 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:46:59.736869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-afe3aac5-4fb8-4b1f-8faf-4c3bf279a859 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:46:59.737623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-afe3aac5-4fb8-4b1f-8faf-4c3bf279a859 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:46:59.744918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afe3aac5-4fb8-4b1f-8faf-4c3bf279a859 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:59.745461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afe3aac5-4fb8-4b1f-8faf-4c3bf279a859 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:59.746138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afe3aac5-4fb8-4b1f-8faf-4c3bf279a859 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:59.747055 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afe3aac5-4fb8-4b1f-8faf-4c3bf279a859 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:46:59.747533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afe3aac5-4fb8-4b1f-8faf-4c3bf279a859 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:46:59.747981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-afe3aac5-4fb8-4b1f-8faf-4c3bf279a859 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:46:59.896709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-afe3aac5-4fb8-4b1f-8faf-4c3bf279a859 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:46:59.905335 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-afe3aac5-4fb8-4b1f-8faf-4c3bf279a859 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.172735 Oct 29 01:46:59.912500 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3472/7160] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:46:59 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:00.435991 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-70a851c5-b283-464e-942f-7e55af79d900 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:00.437731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-70a851c5-b283-464e-942f-7e55af79d900 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:00.444885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70a851c5-b283-464e-942f-7e55af79d900 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:00.445406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70a851c5-b283-464e-942f-7e55af79d900 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:00.445854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70a851c5-b283-464e-942f-7e55af79d900 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:00.446564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70a851c5-b283-464e-942f-7e55af79d900 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:00.447415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70a851c5-b283-464e-942f-7e55af79d900 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:00.447851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70a851c5-b283-464e-942f-7e55af79d900 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:00.450648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:47:00.596702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-70a851c5-b283-464e-942f-7e55af79d900 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:00.605196 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-70a851c5-b283-464e-942f-7e55af79d900 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.173140 Oct 29 01:47:00.605840 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3689/7161] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:00 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:00.929545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e96211cd-4273-44e3-9a4f-9f2c5f6d9620 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:00.930371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e96211cd-4273-44e3-9a4f-9f2c5f6d9620 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:00.937692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e96211cd-4273-44e3-9a4f-9f2c5f6d9620 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:00.938689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e96211cd-4273-44e3-9a4f-9f2c5f6d9620 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:00.939150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e96211cd-4273-44e3-9a4f-9f2c5f6d9620 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:00.939871 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e96211cd-4273-44e3-9a4f-9f2c5f6d9620 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:00.940376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e96211cd-4273-44e3-9a4f-9f2c5f6d9620 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:00.940821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e96211cd-4273-44e3-9a4f-9f2c5f6d9620 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:01.093433 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e96211cd-4273-44e3-9a4f-9f2c5f6d9620 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:01.103553 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e96211cd-4273-44e3-9a4f-9f2c5f6d9620 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.177792 Oct 29 01:47:01.104162 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3473/7162] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:00 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:01.630153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e6c201c1-8959-4d1d-a469-18e1f688be8f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:01.630852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e6c201c1-8959-4d1d-a469-18e1f688be8f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:01.638389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6c201c1-8959-4d1d-a469-18e1f688be8f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:01.642317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6c201c1-8959-4d1d-a469-18e1f688be8f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:01.642317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6c201c1-8959-4d1d-a469-18e1f688be8f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:01.642317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6c201c1-8959-4d1d-a469-18e1f688be8f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:01.642317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6c201c1-8959-4d1d-a469-18e1f688be8f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:01.642317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e6c201c1-8959-4d1d-a469-18e1f688be8f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:01.795648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e6c201c1-8959-4d1d-a469-18e1f688be8f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:01.805700 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e6c201c1-8959-4d1d-a469-18e1f688be8f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.179713 Oct 29 01:47:01.820626 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3690/7163] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:01 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:02.129998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-708fd65f-566d-4299-bb1a-3fac6ab1ee51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:02.131284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-708fd65f-566d-4299-bb1a-3fac6ab1ee51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:02.140406 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-708fd65f-566d-4299-bb1a-3fac6ab1ee51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:02.140908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-708fd65f-566d-4299-bb1a-3fac6ab1ee51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:02.142846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-708fd65f-566d-4299-bb1a-3fac6ab1ee51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:02.144124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-708fd65f-566d-4299-bb1a-3fac6ab1ee51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:02.144295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-708fd65f-566d-4299-bb1a-3fac6ab1ee51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:02.145249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-708fd65f-566d-4299-bb1a-3fac6ab1ee51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:02.290786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-708fd65f-566d-4299-bb1a-3fac6ab1ee51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:02.300867 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-708fd65f-566d-4299-bb1a-3fac6ab1ee51 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1342 microversion: 2.1 time: 0.176715 Oct 29 01:47:02.301766 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3474/7164] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:02 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1342 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:02.831337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aef838bd-3ab1-49f4-a759-6b0c761b10a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:02.831939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-aef838bd-3ab1-49f4-a759-6b0c761b10a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:02.841828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aef838bd-3ab1-49f4-a759-6b0c761b10a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:02.842331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aef838bd-3ab1-49f4-a759-6b0c761b10a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:02.842903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aef838bd-3ab1-49f4-a759-6b0c761b10a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:02.843627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aef838bd-3ab1-49f4-a759-6b0c761b10a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:02.844119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aef838bd-3ab1-49f4-a759-6b0c761b10a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:02.844544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aef838bd-3ab1-49f4-a759-6b0c761b10a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:02.985685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-aef838bd-3ab1-49f4-a759-6b0c761b10a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:02.995203 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aef838bd-3ab1-49f4-a759-6b0c761b10a1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.168735 Oct 29 01:47:02.995943 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3691/7165] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:02 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:03.326114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6886b9f2-3653-4bdb-97c9-293a44304714 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:03.326755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6886b9f2-3653-4bdb-97c9-293a44304714 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:03.333926 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6886b9f2-3653-4bdb-97c9-293a44304714 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:03.334430 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6886b9f2-3653-4bdb-97c9-293a44304714 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:03.334893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6886b9f2-3653-4bdb-97c9-293a44304714 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:03.335605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6886b9f2-3653-4bdb-97c9-293a44304714 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:03.336079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6886b9f2-3653-4bdb-97c9-293a44304714 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:03.336660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6886b9f2-3653-4bdb-97c9-293a44304714 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:03.484226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6886b9f2-3653-4bdb-97c9-293a44304714 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:03.492979 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6886b9f2-3653-4bdb-97c9-293a44304714 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1388 microversion: 2.1 time: 0.171295 Oct 29 01:47:03.493662 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3475/7166] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:03 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1388 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:04.021747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5e1d9145-9c68-4c27-a18e-28bbc5a31456 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:04.021747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5e1d9145-9c68-4c27-a18e-28bbc5a31456 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:04.029380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e1d9145-9c68-4c27-a18e-28bbc5a31456 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:04.029876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e1d9145-9c68-4c27-a18e-28bbc5a31456 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:04.030318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e1d9145-9c68-4c27-a18e-28bbc5a31456 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:04.031221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e1d9145-9c68-4c27-a18e-28bbc5a31456 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:04.032129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e1d9145-9c68-4c27-a18e-28bbc5a31456 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:04.032918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5e1d9145-9c68-4c27-a18e-28bbc5a31456 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:04.187920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5e1d9145-9c68-4c27-a18e-28bbc5a31456 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:04.197859 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5e1d9145-9c68-4c27-a18e-28bbc5a31456 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.182792 Oct 29 01:47:04.198472 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3692/7167] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:04 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:04.519249 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1f85f0b7-e961-4b43-8c77-9fd39ac69d17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:04.519893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1f85f0b7-e961-4b43-8c77-9fd39ac69d17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:04.541548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f85f0b7-e961-4b43-8c77-9fd39ac69d17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:04.542061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f85f0b7-e961-4b43-8c77-9fd39ac69d17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:04.542520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f85f0b7-e961-4b43-8c77-9fd39ac69d17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:04.543239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f85f0b7-e961-4b43-8c77-9fd39ac69d17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:04.543711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f85f0b7-e961-4b43-8c77-9fd39ac69d17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:04.544154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1f85f0b7-e961-4b43-8c77-9fd39ac69d17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:04.712548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1f85f0b7-e961-4b43-8c77-9fd39ac69d17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:04.720908 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1f85f0b7-e961-4b43-8c77-9fd39ac69d17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1376 microversion: 2.1 time: 0.206223 Oct 29 01:47:04.721529 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3476/7168] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:04 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1376 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:05.223759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-015ac5c6-c376-4668-8692-8a67504b971f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:05.224320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-015ac5c6-c376-4668-8692-8a67504b971f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:05.231589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-015ac5c6-c376-4668-8692-8a67504b971f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:05.232071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-015ac5c6-c376-4668-8692-8a67504b971f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:05.232509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-015ac5c6-c376-4668-8692-8a67504b971f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:05.233244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-015ac5c6-c376-4668-8692-8a67504b971f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:05.233703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-015ac5c6-c376-4668-8692-8a67504b971f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:05.234129 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-015ac5c6-c376-4668-8692-8a67504b971f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:05.376678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-015ac5c6-c376-4668-8692-8a67504b971f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:05.384819 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-015ac5c6-c376-4668-8692-8a67504b971f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.165633 Oct 29 01:47:05.385460 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3693/7169] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:05 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:05.745479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-de787afe-9e29-4123-b16d-f483f2554328 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:05.746105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-de787afe-9e29-4123-b16d-f483f2554328 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:05.753405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de787afe-9e29-4123-b16d-f483f2554328 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:05.753920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de787afe-9e29-4123-b16d-f483f2554328 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:05.754600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de787afe-9e29-4123-b16d-f483f2554328 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:05.755093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de787afe-9e29-4123-b16d-f483f2554328 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:05.755565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de787afe-9e29-4123-b16d-f483f2554328 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:05.756035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de787afe-9e29-4123-b16d-f483f2554328 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:05.890265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-de787afe-9e29-4123-b16d-f483f2554328 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:05.899539 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-de787afe-9e29-4123-b16d-f483f2554328 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1376 microversion: 2.1 time: 0.158292 Oct 29 01:47:05.900195 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3477/7170] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:05 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1376 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:06.414801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-08d24664-7dc1-435d-bf3c-701a2e668b2a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:06.415408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-08d24664-7dc1-435d-bf3c-701a2e668b2a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:06.423434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08d24664-7dc1-435d-bf3c-701a2e668b2a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:06.423861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08d24664-7dc1-435d-bf3c-701a2e668b2a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:06.424295 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08d24664-7dc1-435d-bf3c-701a2e668b2a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:06.424981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08d24664-7dc1-435d-bf3c-701a2e668b2a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:06.425468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08d24664-7dc1-435d-bf3c-701a2e668b2a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:06.425894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08d24664-7dc1-435d-bf3c-701a2e668b2a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:06.564171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-08d24664-7dc1-435d-bf3c-701a2e668b2a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:06.571719 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-08d24664-7dc1-435d-bf3c-701a2e668b2a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.160945 Oct 29 01:47:06.572565 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3694/7171] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:06 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:06.924281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-97c0f0ca-de75-491f-972f-8e143b2abb7b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:06.925077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-97c0f0ca-de75-491f-972f-8e143b2abb7b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:06.932046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97c0f0ca-de75-491f-972f-8e143b2abb7b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:06.932554 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97c0f0ca-de75-491f-972f-8e143b2abb7b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:06.933005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97c0f0ca-de75-491f-972f-8e143b2abb7b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:06.933749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97c0f0ca-de75-491f-972f-8e143b2abb7b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:06.934222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97c0f0ca-de75-491f-972f-8e143b2abb7b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:06.934664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97c0f0ca-de75-491f-972f-8e143b2abb7b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:07.082529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-97c0f0ca-de75-491f-972f-8e143b2abb7b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:07.090731 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-97c0f0ca-de75-491f-972f-8e143b2abb7b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1376 microversion: 2.1 time: 0.171783 Oct 29 01:47:07.091344 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3478/7172] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:06 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1376 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:07.595914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-78699ddc-6480-49af-abde-8f555f436ecd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:07.596527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-78699ddc-6480-49af-abde-8f555f436ecd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:07.603694 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78699ddc-6480-49af-abde-8f555f436ecd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:07.604234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78699ddc-6480-49af-abde-8f555f436ecd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:07.604649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78699ddc-6480-49af-abde-8f555f436ecd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:07.605643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78699ddc-6480-49af-abde-8f555f436ecd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:07.606103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78699ddc-6480-49af-abde-8f555f436ecd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:07.606526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-78699ddc-6480-49af-abde-8f555f436ecd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:07.749373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-78699ddc-6480-49af-abde-8f555f436ecd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:07.757819 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-78699ddc-6480-49af-abde-8f555f436ecd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.166261 Oct 29 01:47:07.758412 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3695/7173] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:07 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:08.114437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a92ef659-b78f-4675-a678-224bfa08f690 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:08.115104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a92ef659-b78f-4675-a678-224bfa08f690 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:08.122084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a92ef659-b78f-4675-a678-224bfa08f690 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:08.122584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a92ef659-b78f-4675-a678-224bfa08f690 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:08.123035 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a92ef659-b78f-4675-a678-224bfa08f690 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:08.123743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a92ef659-b78f-4675-a678-224bfa08f690 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:08.124214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a92ef659-b78f-4675-a678-224bfa08f690 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:08.124656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a92ef659-b78f-4675-a678-224bfa08f690 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:08.260307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a92ef659-b78f-4675-a678-224bfa08f690 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:08.268981 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a92ef659-b78f-4675-a678-224bfa08f690 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1376 microversion: 2.1 time: 0.158579 Oct 29 01:47:08.271871 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3479/7174] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:08 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1376 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:08.782347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-da4c7521-0dc5-4a13-9a79-c330eaf36439 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:08.783220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-da4c7521-0dc5-4a13-9a79-c330eaf36439 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:08.792258 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da4c7521-0dc5-4a13-9a79-c330eaf36439 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:08.792935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da4c7521-0dc5-4a13-9a79-c330eaf36439 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:08.793665 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da4c7521-0dc5-4a13-9a79-c330eaf36439 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:08.794479 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da4c7521-0dc5-4a13-9a79-c330eaf36439 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:08.795051 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da4c7521-0dc5-4a13-9a79-c330eaf36439 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:08.795508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da4c7521-0dc5-4a13-9a79-c330eaf36439 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:08.945306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-da4c7521-0dc5-4a13-9a79-c330eaf36439 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:08.959227 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-da4c7521-0dc5-4a13-9a79-c330eaf36439 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.175553 Oct 29 01:47:08.959227 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3696/7175] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:08 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:09.292407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-edeaf17e-9d4a-4b86-ada6-3ca48cd77943 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:09.293043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-edeaf17e-9d4a-4b86-ada6-3ca48cd77943 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:09.301177 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edeaf17e-9d4a-4b86-ada6-3ca48cd77943 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:09.301918 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edeaf17e-9d4a-4b86-ada6-3ca48cd77943 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:09.302206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edeaf17e-9d4a-4b86-ada6-3ca48cd77943 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:09.302912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edeaf17e-9d4a-4b86-ada6-3ca48cd77943 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:09.303392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edeaf17e-9d4a-4b86-ada6-3ca48cd77943 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:09.303840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-edeaf17e-9d4a-4b86-ada6-3ca48cd77943 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:09.442168 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-edeaf17e-9d4a-4b86-ada6-3ca48cd77943 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:09.450479 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-edeaf17e-9d4a-4b86-ada6-3ca48cd77943 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1376 microversion: 2.1 time: 0.162196 Oct 29 01:47:09.451052 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3480/7176] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:09 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1376 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:09.991135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e54a5e96-fde5-4891-bd88-792798ba6821 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:09.991135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e54a5e96-fde5-4891-bd88-792798ba6821 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:09.991135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e54a5e96-fde5-4891-bd88-792798ba6821 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:09.991135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e54a5e96-fde5-4891-bd88-792798ba6821 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:09.991135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e54a5e96-fde5-4891-bd88-792798ba6821 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:09.991135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e54a5e96-fde5-4891-bd88-792798ba6821 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:09.991135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e54a5e96-fde5-4891-bd88-792798ba6821 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:09.991135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e54a5e96-fde5-4891-bd88-792798ba6821 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:10.141106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e54a5e96-fde5-4891-bd88-792798ba6821 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:10.149454 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e54a5e96-fde5-4891-bd88-792798ba6821 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1522 microversion: 2.1 time: 0.175410 Oct 29 01:47:10.151239 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3697/7177] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:09 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:10.474736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c4fdb66e-9d3b-414a-9536-5d067a38d29a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:10.475515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c4fdb66e-9d3b-414a-9536-5d067a38d29a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:10.482623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4fdb66e-9d3b-414a-9536-5d067a38d29a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:10.483135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4fdb66e-9d3b-414a-9536-5d067a38d29a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:10.483571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4fdb66e-9d3b-414a-9536-5d067a38d29a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:10.484272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4fdb66e-9d3b-414a-9536-5d067a38d29a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:10.484831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4fdb66e-9d3b-414a-9536-5d067a38d29a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:10.485560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4fdb66e-9d3b-414a-9536-5d067a38d29a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:10.624886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c4fdb66e-9d3b-414a-9536-5d067a38d29a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:10.633569 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c4fdb66e-9d3b-414a-9536-5d067a38d29a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1376 microversion: 2.1 time: 0.162824 Oct 29 01:47:10.634180 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3481/7178] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:10 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1376 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:11.172122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6cbdb352-4739-4c38-ba26-3ba9af9d2e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:11.173691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6cbdb352-4739-4c38-ba26-3ba9af9d2e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:11.180033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cbdb352-4739-4c38-ba26-3ba9af9d2e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:11.180519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cbdb352-4739-4c38-ba26-3ba9af9d2e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:11.180962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cbdb352-4739-4c38-ba26-3ba9af9d2e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:11.181681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cbdb352-4739-4c38-ba26-3ba9af9d2e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:11.182140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cbdb352-4739-4c38-ba26-3ba9af9d2e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:11.182569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6cbdb352-4739-4c38-ba26-3ba9af9d2e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:11.324418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6cbdb352-4739-4c38-ba26-3ba9af9d2e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:11.332659 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6cbdb352-4739-4c38-ba26-3ba9af9d2e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1502 microversion: 2.1 time: 0.164521 Oct 29 01:47:11.333387 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3698/7179] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:11 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:11.355312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a6c11e7f-8fe2-45b8-b81a-c7d7e4a743d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:11.355935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a6c11e7f-8fe2-45b8-b81a-c7d7e4a743d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:11.362434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6c11e7f-8fe2-45b8-b81a-c7d7e4a743d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:11.362929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6c11e7f-8fe2-45b8-b81a-c7d7e4a743d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:11.363382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6c11e7f-8fe2-45b8-b81a-c7d7e4a743d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:11.364084 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6c11e7f-8fe2-45b8-b81a-c7d7e4a743d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:11.364736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6c11e7f-8fe2-45b8-b81a-c7d7e4a743d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:11.365120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6c11e7f-8fe2-45b8-b81a-c7d7e4a743d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:11.501964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a6c11e7f-8fe2-45b8-b81a-c7d7e4a743d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:11.504335 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=100 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:47:11.511218 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a6c11e7f-8fe2-45b8-b81a-c7d7e4a743d9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1516 microversion: 2.1 time: 0.159694 Oct 29 01:47:11.511820 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3482/7180] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:11 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:11.535038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ecd7a2fb-b90c-416f-92b3-3aa4015e7d68 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:11.538292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ecd7a2fb-b90c-416f-92b3-3aa4015e7d68 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 269dd093-a3b5-46b1-9458-f23d5dfe8b00] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:11.544230 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-ecd7a2fb-b90c-416f-92b3-3aa4015e7d68 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] HTTP exception thrown: Instance 269dd093-a3b5-46b1-9458-f23d5dfe8b00 could not be found. Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ecd7a2fb-b90c-416f-92b3-3aa4015e7d68 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Request method failure captured: Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/269dd093-a3b5-46b1-9458-f23d5dfe8b00/action HTTP/1.1 Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 14 Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIXmiZLUHgQf8g1eJ6FTBPxQ6yYPldRikhV_PrG4adbgTywoIFdTTQzzYLYf7Q8nmXrU6gBy4lrdKLe1DFugXfCor48tp4KGalaxBeYPZ8OxWzZX_lUSaO5EmAsCxBcqfg03LezTH1BrcAZy2EOgD8GUlBMhab57UUVT2uqh6jpD5os Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 5451841ce3564e4d9a77cdac41619273 Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5451841ce3564e4d9a77cdac41619273", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 5451841ce3564e4d9a77cdac41619273 Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerRescueNegativeTestJSON-1825472559-project Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f55bc7f1dee2477abb53f91d5ad58d3a Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1825472559-project Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: {"rescue": {}} Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 269dd093-a3b5-46b1-9458-f23d5dfe8b00 could not be found. Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '269dd093-a3b5-46b1-9458-f23d5dfe8b00', 'body': {'rescue': {}}} Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 269dd093-a3b5-46b1-9458-f23d5dfe8b00 could not be found. Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 269dd093-a3b5-46b1-9458-f23d5dfe8b00 could not be found. Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:11.562130 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:11.569081 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:47:11.569081 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:47:11.569081 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:47:11.569081 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:47:11.569081 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 269dd093-a3b5-46b1-9458-f23d5dfe8b00 could not be found. Oct 29 01:47:11.569081 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:11.569081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ecd7a2fb-b90c-416f-92b3-3aa4015e7d68 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Returning 404 to user: Instance 269dd093-a3b5-46b1-9458-f23d5dfe8b00 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:47:11.569081 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ecd7a2fb-b90c-416f-92b3-3aa4015e7d68 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "POST /compute/v2.1/servers/269dd093-a3b5-46b1-9458-f23d5dfe8b00/action" status: 404 len: 111 microversion: 2.1 time: 0.033349 Oct 29 01:47:11.569081 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3699/7181] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:47:11 2022] POST /compute/v2.1/servers/269dd093-a3b5-46b1-9458-f23d5dfe8b00/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:47:11.585887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7c042777-86b6-4a22-85d4-f5f416289e94 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:11.585887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7c042777-86b6-4a22-85d4-f5f416289e94 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:11.585887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c042777-86b6-4a22-85d4-f5f416289e94 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:11.585887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c042777-86b6-4a22-85d4-f5f416289e94 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:11.585887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c042777-86b6-4a22-85d4-f5f416289e94 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:11.585887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c042777-86b6-4a22-85d4-f5f416289e94 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:11.585887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c042777-86b6-4a22-85d4-f5f416289e94 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:11.585887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c042777-86b6-4a22-85d4-f5f416289e94 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:11.659254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e965ea36-2ef2-4ea6-8e70-83927183a49c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:11.659866 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e965ea36-2ef2-4ea6-8e70-83927183a49c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:11.666851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e965ea36-2ef2-4ea6-8e70-83927183a49c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:11.667334 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e965ea36-2ef2-4ea6-8e70-83927183a49c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:11.667837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e965ea36-2ef2-4ea6-8e70-83927183a49c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:11.668527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e965ea36-2ef2-4ea6-8e70-83927183a49c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:11.668983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e965ea36-2ef2-4ea6-8e70-83927183a49c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:11.669435 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e965ea36-2ef2-4ea6-8e70-83927183a49c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:11.742679 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7c042777-86b6-4a22-85d4-f5f416289e94 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "POST /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0/action" status: 202 len: 0 microversion: 2.1 time: 0.171596 Oct 29 01:47:11.743579 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3483/7182] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:47:11 2022] POST /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:47:11.753646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f01ab9f2-264b-43cb-8116-a1791037154a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:11.754761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f01ab9f2-264b-43cb-8116-a1791037154a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:11.762267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f01ab9f2-264b-43cb-8116-a1791037154a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:11.763200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f01ab9f2-264b-43cb-8116-a1791037154a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:11.764034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f01ab9f2-264b-43cb-8116-a1791037154a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:11.765079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f01ab9f2-264b-43cb-8116-a1791037154a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:11.765816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f01ab9f2-264b-43cb-8116-a1791037154a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:11.766844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f01ab9f2-264b-43cb-8116-a1791037154a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:11.872100 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e965ea36-2ef2-4ea6-8e70-83927183a49c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:11.885461 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e965ea36-2ef2-4ea6-8e70-83927183a49c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1376 microversion: 2.1 time: 0.231857 Oct 29 01:47:11.887045 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3700/7183] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:11 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1376 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:47:11.947750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f01ab9f2-264b-43cb-8116-a1791037154a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:11.956707 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f01ab9f2-264b-43cb-8116-a1791037154a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1521 microversion: 2.1 time: 0.207206 Oct 29 01:47:11.956707 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3484/7184] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:11 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:12.912766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3ee82c09-2166-4d01-a251-69c00e18eb49 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:12.914067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3ee82c09-2166-4d01-a251-69c00e18eb49 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:12.921036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ee82c09-2166-4d01-a251-69c00e18eb49 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:12.921554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ee82c09-2166-4d01-a251-69c00e18eb49 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:12.921999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ee82c09-2166-4d01-a251-69c00e18eb49 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:12.923304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ee82c09-2166-4d01-a251-69c00e18eb49 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:12.924023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ee82c09-2166-4d01-a251-69c00e18eb49 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:12.924459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3ee82c09-2166-4d01-a251-69c00e18eb49 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:12.979972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-027a2e9e-e258-45e0-99cf-86937a5b78ee tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:12.981011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-027a2e9e-e258-45e0-99cf-86937a5b78ee tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:12.989114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-027a2e9e-e258-45e0-99cf-86937a5b78ee tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:12.989760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-027a2e9e-e258-45e0-99cf-86937a5b78ee tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:12.990663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-027a2e9e-e258-45e0-99cf-86937a5b78ee tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:12.991760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-027a2e9e-e258-45e0-99cf-86937a5b78ee tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:12.992321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-027a2e9e-e258-45e0-99cf-86937a5b78ee tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:12.992979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-027a2e9e-e258-45e0-99cf-86937a5b78ee tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:13.109518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3ee82c09-2166-4d01-a251-69c00e18eb49 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:13.118478 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3ee82c09-2166-4d01-a251-69c00e18eb49 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1376 microversion: 2.1 time: 0.209617 Oct 29 01:47:13.119127 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3701/7185] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:12 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1376 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:13.154747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-027a2e9e-e258-45e0-99cf-86937a5b78ee tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:13.162697 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-027a2e9e-e258-45e0-99cf-86937a5b78ee tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1501 microversion: 2.1 time: 0.186689 Oct 29 01:47:13.163277 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3485/7186] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:12 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1501 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:47:13.186059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6f9c001b-5d95-49b5-9dd1-cf0945fc6b6f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:13.189681 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6f9c001b-5d95-49b5-9dd1-cf0945fc6b6f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:13.196482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f9c001b-5d95-49b5-9dd1-cf0945fc6b6f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:13.197250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f9c001b-5d95-49b5-9dd1-cf0945fc6b6f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:13.197697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f9c001b-5d95-49b5-9dd1-cf0945fc6b6f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:13.198400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f9c001b-5d95-49b5-9dd1-cf0945fc6b6f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:13.198860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f9c001b-5d95-49b5-9dd1-cf0945fc6b6f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:13.199318 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6f9c001b-5d95-49b5-9dd1-cf0945fc6b6f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:13.222626 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-6f9c001b-5d95-49b5-9dd1-cf0945fc6b6f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lazy-loading 'flavor' on Instance uuid 4beaf925-018a-47ce-810e-b53329fe86a0 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:47:13.234690 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-6f9c001b-5d95-49b5-9dd1-cf0945fc6b6f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] HTTP exception thrown: Cannot 'rescue' instance 4beaf925-018a-47ce-810e-b53329fe86a0 while it is in vm_state paused Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6f9c001b-5d95-49b5-9dd1-cf0945fc6b6f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Request method failure captured: Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0/action HTTP/1.1 Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 14 Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIXmiZLUHgQf8g1eJ6FTBPxQ6yYPldRikhV_PrG4adbgTywoIFdTTQzzYLYf7Q8nmXrU6gBy4lrdKLe1DFugXfCor48tp4KGalaxBeYPZ8OxWzZX_lUSaO5EmAsCxBcqfg03LezTH1BrcAZy2EOgD8GUlBMhab57UUVT2uqh6jpD5os Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 5451841ce3564e4d9a77cdac41619273 Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5451841ce3564e4d9a77cdac41619273", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 5451841ce3564e4d9a77cdac41619273 Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerRescueNegativeTestJSON-1825472559-project Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f55bc7f1dee2477abb53f91d5ad58d3a Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1825472559-project Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: {"rescue": {}} Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: exception: Cannot 'rescue' instance 4beaf925-018a-47ce-810e-b53329fe86a0 while it is in vm_state paused Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '4beaf925-018a-47ce-810e-b53329fe86a0', 'body': {'rescue': {}}} Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4beaf925-018a-47ce-810e-b53329fe86a0 in vm_state paused. Cannot rescue while the instance is in this state. Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 4beaf925-018a-47ce-810e-b53329fe86a0 while it is in vm_state paused Oct 29 01:47:13.236967 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:13.242884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:47:13.242884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:13.242884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:13.242884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:47:13.242884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:47:13.242884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:47:13.242884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:47:13.242884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 4beaf925-018a-47ce-810e-b53329fe86a0 while it is in vm_state paused Oct 29 01:47:13.242884 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:13.242884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6f9c001b-5d95-49b5-9dd1-cf0945fc6b6f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Returning 409 to user: Cannot 'rescue' instance 4beaf925-018a-47ce-810e-b53329fe86a0 while it is in vm_state paused {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:47:13.242884 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6f9c001b-5d95-49b5-9dd1-cf0945fc6b6f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "POST /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0/action" status: 409 len: 144 microversion: 2.1 time: 0.056899 Oct 29 01:47:13.242884 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3702/7187] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:47:13 2022] POST /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0/action => generated 144 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 29 01:47:13.247555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-de173e07-ac55-4c3a-b3c0-305fa5241a1b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:13.248113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-de173e07-ac55-4c3a-b3c0-305fa5241a1b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:13.255156 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de173e07-ac55-4c3a-b3c0-305fa5241a1b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:13.255667 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de173e07-ac55-4c3a-b3c0-305fa5241a1b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:13.256124 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de173e07-ac55-4c3a-b3c0-305fa5241a1b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:13.256894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de173e07-ac55-4c3a-b3c0-305fa5241a1b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:13.257623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de173e07-ac55-4c3a-b3c0-305fa5241a1b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:13.258078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-de173e07-ac55-4c3a-b3c0-305fa5241a1b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:13.485486 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-de173e07-ac55-4c3a-b3c0-305fa5241a1b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "POST /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0/action" status: 202 len: 0 microversion: 2.1 time: 0.241518 Oct 29 01:47:13.486373 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3486/7188] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:47:13 2022] POST /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:47:13.494465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f9dc5530-e2b3-4ed2-b94e-1785bdf09397 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:13.495222 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f9dc5530-e2b3-4ed2-b94e-1785bdf09397 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:13.502573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9dc5530-e2b3-4ed2-b94e-1785bdf09397 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:13.509847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9dc5530-e2b3-4ed2-b94e-1785bdf09397 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:13.509847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9dc5530-e2b3-4ed2-b94e-1785bdf09397 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:13.509847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9dc5530-e2b3-4ed2-b94e-1785bdf09397 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:13.509847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9dc5530-e2b3-4ed2-b94e-1785bdf09397 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:13.509847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f9dc5530-e2b3-4ed2-b94e-1785bdf09397 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:13.658549 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f9dc5530-e2b3-4ed2-b94e-1785bdf09397 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:13.666447 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f9dc5530-e2b3-4ed2-b94e-1785bdf09397 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1508 microversion: 2.1 time: 0.175961 Oct 29 01:47:13.667042 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3703/7189] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:13 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:47:14.144109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5290b465-7f9d-4331-a8f1-6e0efa5aa145 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:14.144834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5290b465-7f9d-4331-a8f1-6e0efa5aa145 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:14.152589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5290b465-7f9d-4331-a8f1-6e0efa5aa145 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:14.153094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5290b465-7f9d-4331-a8f1-6e0efa5aa145 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:14.153576 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5290b465-7f9d-4331-a8f1-6e0efa5aa145 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:14.154331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5290b465-7f9d-4331-a8f1-6e0efa5aa145 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:14.154804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5290b465-7f9d-4331-a8f1-6e0efa5aa145 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:14.155422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5290b465-7f9d-4331-a8f1-6e0efa5aa145 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:14.300198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5290b465-7f9d-4331-a8f1-6e0efa5aa145 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:14.308591 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5290b465-7f9d-4331-a8f1-6e0efa5aa145 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1376 microversion: 2.1 time: 0.169592 Oct 29 01:47:14.309197 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3487/7190] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:14 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1376 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:14.691303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6b865fea-208e-4c33-8d63-84a978699fb2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:14.692005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6b865fea-208e-4c33-8d63-84a978699fb2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:14.699372 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b865fea-208e-4c33-8d63-84a978699fb2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:14.699863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b865fea-208e-4c33-8d63-84a978699fb2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:14.700310 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b865fea-208e-4c33-8d63-84a978699fb2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:14.701041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b865fea-208e-4c33-8d63-84a978699fb2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:14.701583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b865fea-208e-4c33-8d63-84a978699fb2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:14.702016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6b865fea-208e-4c33-8d63-84a978699fb2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:14.837941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6b865fea-208e-4c33-8d63-84a978699fb2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:14.846912 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6b865fea-208e-4c33-8d63-84a978699fb2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1516 microversion: 2.1 time: 0.160136 Oct 29 01:47:14.847511 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3704/7191] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:14 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:15.331603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-faa992ce-43e5-49e0-8efa-7eec01603530 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:15.332229 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-faa992ce-43e5-49e0-8efa-7eec01603530 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:15.339324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faa992ce-43e5-49e0-8efa-7eec01603530 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:15.340074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faa992ce-43e5-49e0-8efa-7eec01603530 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:15.341034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faa992ce-43e5-49e0-8efa-7eec01603530 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:15.341482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faa992ce-43e5-49e0-8efa-7eec01603530 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:15.341966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faa992ce-43e5-49e0-8efa-7eec01603530 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:15.342416 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-faa992ce-43e5-49e0-8efa-7eec01603530 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:15.487106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-faa992ce-43e5-49e0-8efa-7eec01603530 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:15.495085 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-faa992ce-43e5-49e0-8efa-7eec01603530 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1376 microversion: 2.1 time: 0.167638 Oct 29 01:47:15.495702 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3488/7192] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:15 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:15.631086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-591f02eb-93bd-45e2-9502-24b53f50336d req-992fb545-3219-4683-b9a9-3a2da1aac86c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d38796c0-9ae5-4bd1-8a93-99fe19e96e13", "name": "network-vif-plugged", "status": "completed", "tag": "c9fe9b9a-c8ae-49e6-9968-17e49688a5e7"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:15.636820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-591f02eb-93bd-45e2-9502-24b53f50336d req-992fb545-3219-4683-b9a9-3a2da1aac86c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:15.637337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-591f02eb-93bd-45e2-9502-24b53f50336d req-992fb545-3219-4683-b9a9-3a2da1aac86c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:15.637958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-591f02eb-93bd-45e2-9502-24b53f50336d req-992fb545-3219-4683-b9a9-3a2da1aac86c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:15.650528 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-591f02eb-93bd-45e2-9502-24b53f50336d req-992fb545-3219-4683-b9a9-3a2da1aac86c service nova] Creating event network-vif-plugged:c9fe9b9a-c8ae-49e6-9968-17e49688a5e7 for instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 on n-h2-862964-3 Oct 29 01:47:15.656742 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-591f02eb-93bd-45e2-9502-24b53f50336d req-992fb545-3219-4683-b9a9-3a2da1aac86c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033831 Oct 29 01:47:15.658010 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3705/7193] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:47:16.523350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-690d4fb2-9167-45db-8e7f-f317b2ce30b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:16.524083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-690d4fb2-9167-45db-8e7f-f317b2ce30b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:16.532183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-690d4fb2-9167-45db-8e7f-f317b2ce30b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:16.532777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-690d4fb2-9167-45db-8e7f-f317b2ce30b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:16.533110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-690d4fb2-9167-45db-8e7f-f317b2ce30b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:16.533862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-690d4fb2-9167-45db-8e7f-f317b2ce30b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:16.534331 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-690d4fb2-9167-45db-8e7f-f317b2ce30b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:16.534769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-690d4fb2-9167-45db-8e7f-f317b2ce30b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:16.676669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-690d4fb2-9167-45db-8e7f-f317b2ce30b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:16.685512 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-690d4fb2-9167-45db-8e7f-f317b2ce30b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1376 microversion: 2.1 time: 0.169899 Oct 29 01:47:16.687952 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3489/7194] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:16 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1376 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:17.711171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2fd68bc9-3be8-4162-802c-f663854baf05 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:17.714237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2fd68bc9-3be8-4162-802c-f663854baf05 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:17.719430 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fd68bc9-3be8-4162-802c-f663854baf05 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:17.720033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fd68bc9-3be8-4162-802c-f663854baf05 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:17.720576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fd68bc9-3be8-4162-802c-f663854baf05 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:17.721409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fd68bc9-3be8-4162-802c-f663854baf05 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:17.722315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fd68bc9-3be8-4162-802c-f663854baf05 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:17.722845 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2fd68bc9-3be8-4162-802c-f663854baf05 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:17.845925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-83a1dc72-9c34-4b2f-a701-04f2b060da17 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:17.848720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-83a1dc72-9c34-4b2f-a701-04f2b060da17 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:17.856997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a1dc72-9c34-4b2f-a701-04f2b060da17 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:17.857756 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a1dc72-9c34-4b2f-a701-04f2b060da17 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:17.858392 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a1dc72-9c34-4b2f-a701-04f2b060da17 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:17.859287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a1dc72-9c34-4b2f-a701-04f2b060da17 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:17.859920 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a1dc72-9c34-4b2f-a701-04f2b060da17 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:17.860455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a1dc72-9c34-4b2f-a701-04f2b060da17 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:17.888462 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-83a1dc72-9c34-4b2f-a701-04f2b060da17 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lazy-loading 'flavor' on Instance uuid 4beaf925-018a-47ce-810e-b53329fe86a0 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:47:17.891518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2fd68bc9-3be8-4162-802c-f663854baf05 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:17.900114 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2fd68bc9-3be8-4162-802c-f663854baf05 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1564 microversion: 2.1 time: 0.194533 Oct 29 01:47:17.917177 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3706/7195] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:17 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1564 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:17.930042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-05c892a6-da43-456f-a638-03bc2785aacd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:17.930660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-05c892a6-da43-456f-a638-03bc2785aacd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:17.938937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05c892a6-da43-456f-a638-03bc2785aacd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:17.939438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05c892a6-da43-456f-a638-03bc2785aacd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:17.939890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05c892a6-da43-456f-a638-03bc2785aacd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:17.941098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05c892a6-da43-456f-a638-03bc2785aacd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:17.941914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05c892a6-da43-456f-a638-03bc2785aacd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:17.942066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-05c892a6-da43-456f-a638-03bc2785aacd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:17.958825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=100 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:47:18.093409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-05c892a6-da43-456f-a638-03bc2785aacd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:18.103048 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-05c892a6-da43-456f-a638-03bc2785aacd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1564 microversion: 2.1 time: 0.176851 Oct 29 01:47:18.104144 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3707/7196] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:17 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1564 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:18.194563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-83417b2c-f796-4d53-bb6b-974c0b8c5a0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:18.195153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-83417b2c-f796-4d53-bb6b-974c0b8c5a0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:18.201666 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83417b2c-f796-4d53-bb6b-974c0b8c5a0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:18.202190 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83417b2c-f796-4d53-bb6b-974c0b8c5a0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:18.202640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83417b2c-f796-4d53-bb6b-974c0b8c5a0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:18.203342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83417b2c-f796-4d53-bb6b-974c0b8c5a0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:18.203806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83417b2c-f796-4d53-bb6b-974c0b8c5a0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:18.204237 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83417b2c-f796-4d53-bb6b-974c0b8c5a0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:18.231320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-83417b2c-f796-4d53-bb6b-974c0b8c5a0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:47:18.331797 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-83a1dc72-9c34-4b2f-a701-04f2b060da17 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "POST /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0/action" status: 200 len: 32 microversion: 2.1 time: 0.489330 Oct 29 01:47:18.332435 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3490/7197] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:47:17 2022] POST /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0/action => generated 32 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:47:18.342293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-affda1e4-9621-4165-8cfb-654457df8d86 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:18.342931 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-affda1e4-9621-4165-8cfb-654457df8d86 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:18.349774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-affda1e4-9621-4165-8cfb-654457df8d86 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:18.352297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-affda1e4-9621-4165-8cfb-654457df8d86 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:18.352297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-affda1e4-9621-4165-8cfb-654457df8d86 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:18.352297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-affda1e4-9621-4165-8cfb-654457df8d86 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:18.352297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-affda1e4-9621-4165-8cfb-654457df8d86 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:18.352297 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-affda1e4-9621-4165-8cfb-654457df8d86 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:18.504569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-affda1e4-9621-4165-8cfb-654457df8d86 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:18.515656 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-affda1e4-9621-4165-8cfb-654457df8d86 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1522 microversion: 2.1 time: 0.177384 Oct 29 01:47:18.518630 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3491/7198] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:18 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:47:18.687382 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-83417b2c-f796-4d53-bb6b-974c0b8c5a0d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 204 len: 0 microversion: 2.1 time: 0.499824 Oct 29 01:47:18.687993 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3708/7199] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:47:18 2022] DELETE /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:47:18.696486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-df7f15db-9ed9-4c6e-ae9b-f3e52912beb1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:18.700470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-df7f15db-9ed9-4c6e-ae9b-f3e52912beb1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:18.703478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df7f15db-9ed9-4c6e-ae9b-f3e52912beb1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:18.703992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df7f15db-9ed9-4c6e-ae9b-f3e52912beb1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:18.704489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df7f15db-9ed9-4c6e-ae9b-f3e52912beb1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:18.705225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df7f15db-9ed9-4c6e-ae9b-f3e52912beb1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:18.705703 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df7f15db-9ed9-4c6e-ae9b-f3e52912beb1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:18.706145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-df7f15db-9ed9-4c6e-ae9b-f3e52912beb1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:18.854359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-df7f15db-9ed9-4c6e-ae9b-f3e52912beb1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:18.864007 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-df7f15db-9ed9-4c6e-ae9b-f3e52912beb1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1570 microversion: 2.1 time: 0.171403 Oct 29 01:47:18.864592 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3492/7200] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:18 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:19.546541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f5898469-78c0-4cf5-a72b-916e867f0c1c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:19.552298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f5898469-78c0-4cf5-a72b-916e867f0c1c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:19.554723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5898469-78c0-4cf5-a72b-916e867f0c1c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:19.555202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5898469-78c0-4cf5-a72b-916e867f0c1c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:19.555636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5898469-78c0-4cf5-a72b-916e867f0c1c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:19.556321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5898469-78c0-4cf5-a72b-916e867f0c1c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:19.556770 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5898469-78c0-4cf5-a72b-916e867f0c1c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:19.557223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f5898469-78c0-4cf5-a72b-916e867f0c1c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:19.717353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f5898469-78c0-4cf5-a72b-916e867f0c1c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:19.726539 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f5898469-78c0-4cf5-a72b-916e867f0c1c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1522 microversion: 2.1 time: 0.184161 Oct 29 01:47:19.727134 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3709/7201] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:19 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:19.888704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-357a9122-7f71-4787-aead-7167e41188ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:19.889484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-357a9122-7f71-4787-aead-7167e41188ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:19.899422 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-357a9122-7f71-4787-aead-7167e41188ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:19.899962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-357a9122-7f71-4787-aead-7167e41188ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:19.901791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-357a9122-7f71-4787-aead-7167e41188ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:19.901791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-357a9122-7f71-4787-aead-7167e41188ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:19.901791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-357a9122-7f71-4787-aead-7167e41188ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:19.905386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-357a9122-7f71-4787-aead-7167e41188ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:20.057409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-357a9122-7f71-4787-aead-7167e41188ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:20.066746 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-357a9122-7f71-4787-aead-7167e41188ba tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1570 microversion: 2.1 time: 0.182153 Oct 29 01:47:20.067389 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3493/7202] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:19 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:20.754918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b86eefbb-b73c-431b-a7d3-893fde08d390 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:20.755566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b86eefbb-b73c-431b-a7d3-893fde08d390 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:20.762477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b86eefbb-b73c-431b-a7d3-893fde08d390 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:20.762959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b86eefbb-b73c-431b-a7d3-893fde08d390 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:20.763394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b86eefbb-b73c-431b-a7d3-893fde08d390 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:20.764089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b86eefbb-b73c-431b-a7d3-893fde08d390 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:20.764627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b86eefbb-b73c-431b-a7d3-893fde08d390 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:20.765055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b86eefbb-b73c-431b-a7d3-893fde08d390 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:20.933889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b86eefbb-b73c-431b-a7d3-893fde08d390 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:20.945365 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b86eefbb-b73c-431b-a7d3-893fde08d390 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1522 microversion: 2.1 time: 0.195508 Oct 29 01:47:20.948693 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3710/7203] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:20 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:47:21.091191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-24c1c39b-ad69-4a98-b4f4-0e54ed316c56 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:21.092227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-24c1c39b-ad69-4a98-b4f4-0e54ed316c56 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:21.107526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24c1c39b-ad69-4a98-b4f4-0e54ed316c56 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:21.107526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24c1c39b-ad69-4a98-b4f4-0e54ed316c56 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:21.107526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24c1c39b-ad69-4a98-b4f4-0e54ed316c56 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:21.107526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24c1c39b-ad69-4a98-b4f4-0e54ed316c56 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:21.107526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24c1c39b-ad69-4a98-b4f4-0e54ed316c56 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:21.107526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-24c1c39b-ad69-4a98-b4f4-0e54ed316c56 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:21.194630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-9e2d7f5d-43de-4382-b659-ab486f2a2077 req-ecc3739c-9355-4c26-98d1-1de00750295d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d38796c0-9ae5-4bd1-8a93-99fe19e96e13", "name": "network-vif-deleted", "tag": "c9fe9b9a-c8ae-49e6-9968-17e49688a5e7"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:21.209104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-24c1c39b-ad69-4a98-b4f4-0e54ed316c56 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:21.209799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9e2d7f5d-43de-4382-b659-ab486f2a2077 req-ecc3739c-9355-4c26-98d1-1de00750295d service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:21.210513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9e2d7f5d-43de-4382-b659-ab486f2a2077 req-ecc3739c-9355-4c26-98d1-1de00750295d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:21.211028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-9e2d7f5d-43de-4382-b659-ab486f2a2077 req-ecc3739c-9355-4c26-98d1-1de00750295d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:21.217308 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-24c1c39b-ad69-4a98-b4f4-0e54ed316c56 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1528 microversion: 2.1 time: 0.130047 Oct 29 01:47:21.217896 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3711/7204] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:21 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1528 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:21.224406 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-9e2d7f5d-43de-4382-b659-ab486f2a2077 req-ecc3739c-9355-4c26-98d1-1de00750295d service nova] Creating event network-vif-deleted:c9fe9b9a-c8ae-49e6-9968-17e49688a5e7 for instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 on n-h2-862964-3 Oct 29 01:47:21.230536 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-9e2d7f5d-43de-4382-b659-ab486f2a2077 req-ecc3739c-9355-4c26-98d1-1de00750295d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211031 Oct 29 01:47:21.231209 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3494/7205] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:47:21.977872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-810e54d3-3687-4233-b1df-64b7fba54ec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:21.979293 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-810e54d3-3687-4233-b1df-64b7fba54ec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:21.988737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-810e54d3-3687-4233-b1df-64b7fba54ec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:21.989495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-810e54d3-3687-4233-b1df-64b7fba54ec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:21.989942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-810e54d3-3687-4233-b1df-64b7fba54ec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:21.990662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-810e54d3-3687-4233-b1df-64b7fba54ec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:21.991146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-810e54d3-3687-4233-b1df-64b7fba54ec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:21.991550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-810e54d3-3687-4233-b1df-64b7fba54ec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:22.146289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-810e54d3-3687-4233-b1df-64b7fba54ec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:22.155592 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-810e54d3-3687-4233-b1df-64b7fba54ec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1522 microversion: 2.1 time: 0.183496 Oct 29 01:47:22.156238 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3712/7206] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:21 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:22.242192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-15af595c-444f-4708-a77a-d0808dfa2dff tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:22.242832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-15af595c-444f-4708-a77a-d0808dfa2dff tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:22.250166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15af595c-444f-4708-a77a-d0808dfa2dff tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:22.250716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15af595c-444f-4708-a77a-d0808dfa2dff tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:22.251442 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15af595c-444f-4708-a77a-d0808dfa2dff tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:22.252398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15af595c-444f-4708-a77a-d0808dfa2dff tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:22.253116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15af595c-444f-4708-a77a-d0808dfa2dff tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:22.253924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-15af595c-444f-4708-a77a-d0808dfa2dff tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:22.322735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-15af595c-444f-4708-a77a-d0808dfa2dff tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:22.331750 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-15af595c-444f-4708-a77a-d0808dfa2dff tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1361 microversion: 2.1 time: 0.093218 Oct 29 01:47:22.333040 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3495/7207] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:22 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1361 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:23.182054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e63e0ef1-10b7-47a7-9193-e7e55d25e185 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:23.182589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e63e0ef1-10b7-47a7-9193-e7e55d25e185 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:23.189610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e63e0ef1-10b7-47a7-9193-e7e55d25e185 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:23.190116 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e63e0ef1-10b7-47a7-9193-e7e55d25e185 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:23.191038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e63e0ef1-10b7-47a7-9193-e7e55d25e185 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:23.191941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e63e0ef1-10b7-47a7-9193-e7e55d25e185 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:23.192346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e63e0ef1-10b7-47a7-9193-e7e55d25e185 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:23.192780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e63e0ef1-10b7-47a7-9193-e7e55d25e185 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:23.336153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e63e0ef1-10b7-47a7-9193-e7e55d25e185 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:23.344054 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e63e0ef1-10b7-47a7-9193-e7e55d25e185 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1522 microversion: 2.1 time: 0.165917 Oct 29 01:47:23.344634 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3713/7208] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:23 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:23.357585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a6481ce1-d610-408a-9609-4644e7735098 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:23.361975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a6481ce1-d610-408a-9609-4644e7735098 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:23.365525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6481ce1-d610-408a-9609-4644e7735098 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:23.366032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6481ce1-d610-408a-9609-4644e7735098 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:23.366490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6481ce1-d610-408a-9609-4644e7735098 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:23.367280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6481ce1-d610-408a-9609-4644e7735098 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:23.367757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6481ce1-d610-408a-9609-4644e7735098 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:23.368202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a6481ce1-d610-408a-9609-4644e7735098 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:23.371201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:47:23.437365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a6481ce1-d610-408a-9609-4644e7735098 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:23.447698 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a6481ce1-d610-408a-9609-4644e7735098 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1361 microversion: 2.1 time: 0.093796 Oct 29 01:47:23.448622 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3496/7209] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:23 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1361 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:24.368611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-688b6e46-b64b-470e-8188-7ce232ad1db7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:24.369415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-688b6e46-b64b-470e-8188-7ce232ad1db7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:24.376544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-688b6e46-b64b-470e-8188-7ce232ad1db7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:24.377040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-688b6e46-b64b-470e-8188-7ce232ad1db7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:24.377508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-688b6e46-b64b-470e-8188-7ce232ad1db7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:24.378937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-688b6e46-b64b-470e-8188-7ce232ad1db7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:24.379505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-688b6e46-b64b-470e-8188-7ce232ad1db7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:24.379941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-688b6e46-b64b-470e-8188-7ce232ad1db7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:24.472210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e249c8d2-567a-48e2-903e-29dd12efbb6a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:24.472987 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e249c8d2-567a-48e2-903e-29dd12efbb6a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:24.481098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e249c8d2-567a-48e2-903e-29dd12efbb6a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:24.490373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e249c8d2-567a-48e2-903e-29dd12efbb6a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:24.490373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e249c8d2-567a-48e2-903e-29dd12efbb6a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:24.490373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e249c8d2-567a-48e2-903e-29dd12efbb6a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:24.490373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e249c8d2-567a-48e2-903e-29dd12efbb6a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:24.490373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e249c8d2-567a-48e2-903e-29dd12efbb6a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:24.533721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-688b6e46-b64b-470e-8188-7ce232ad1db7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:24.542799 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-688b6e46-b64b-470e-8188-7ce232ad1db7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1522 microversion: 2.1 time: 0.178069 Oct 29 01:47:24.557823 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3714/7210] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:24 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:24.575803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e249c8d2-567a-48e2-903e-29dd12efbb6a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:24.585209 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e249c8d2-567a-48e2-903e-29dd12efbb6a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1361 microversion: 2.1 time: 0.116970 Oct 29 01:47:24.585901 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3497/7211] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:24 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1361 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:47:25.568606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2852077e-9717-4dad-a983-f9dbc40b3b24 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:25.569248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2852077e-9717-4dad-a983-f9dbc40b3b24 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:25.572162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:47:25.577186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2852077e-9717-4dad-a983-f9dbc40b3b24 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:25.577698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2852077e-9717-4dad-a983-f9dbc40b3b24 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:25.578096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2852077e-9717-4dad-a983-f9dbc40b3b24 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:25.578798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2852077e-9717-4dad-a983-f9dbc40b3b24 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:25.579250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2852077e-9717-4dad-a983-f9dbc40b3b24 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:25.579676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2852077e-9717-4dad-a983-f9dbc40b3b24 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:25.609571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-680a2395-5a2a-4432-887a-d9af839326fc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:25.610298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-680a2395-5a2a-4432-887a-d9af839326fc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:25.618450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=60 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:47:25.620637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-680a2395-5a2a-4432-887a-d9af839326fc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:25.621226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-680a2395-5a2a-4432-887a-d9af839326fc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:25.621851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-680a2395-5a2a-4432-887a-d9af839326fc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:25.622618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-680a2395-5a2a-4432-887a-d9af839326fc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:25.623239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-680a2395-5a2a-4432-887a-d9af839326fc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:25.623740 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-680a2395-5a2a-4432-887a-d9af839326fc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:25.706634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-680a2395-5a2a-4432-887a-d9af839326fc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:25.720417 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-680a2395-5a2a-4432-887a-d9af839326fc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 200 len: 1361 microversion: 2.1 time: 0.110784 Oct 29 01:47:25.733695 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3498/7212] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:25 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 1361 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:47:25.760380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2852077e-9717-4dad-a983-f9dbc40b3b24 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:25.768385 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2852077e-9717-4dad-a983-f9dbc40b3b24 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1522 microversion: 2.1 time: 0.204807 Oct 29 01:47:25.769000 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3715/7213] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:25 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:26.739862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b25ec658-3622-4065-b9db-91307b330bb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:26.740732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b25ec658-3622-4065-b9db-91307b330bb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:26.748707 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b25ec658-3622-4065-b9db-91307b330bb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:26.752375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b25ec658-3622-4065-b9db-91307b330bb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:26.752375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b25ec658-3622-4065-b9db-91307b330bb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:26.752375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b25ec658-3622-4065-b9db-91307b330bb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:26.752375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b25ec658-3622-4065-b9db-91307b330bb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:26.752375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b25ec658-3622-4065-b9db-91307b330bb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:26.770643 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-b25ec658-3622-4065-b9db-91307b330bb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] HTTP exception thrown: Instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 could not be found. Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b25ec658-3622-4065-b9db-91307b330bb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Request method failure captured: Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 HTTP/1.1 Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXISL1fYm1j7NXik3zsNtroj_Oy-crTrvQAeW5M-FwwtP3LsKgHXpuppTsI04rMuajP4UZsmStYeX1aQyWE5BokToP2AX7pO99qAjgwqGhP0Pb1MuaH07JyrTdqaWdL6Co3a2Gha0Gb4NOVY73erVtuC0neHUxTJ51YCufPzngi0azyM Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37416a9397fa4c6dbd0bfe8dee191577", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TestVolumeBootPattern-743321222 Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 8b8f36d10fa340f784581a3cf9a15606 Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 could not be found. Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'd38796c0-9ae5-4bd1-8a93-99fe19e96e13'} Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 could not be found. Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 could not be found. Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:47:26.772777 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:26.778983 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:26.778983 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:47:26.778983 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:47:26.778983 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:47:26.778983 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:47:26.778983 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 could not be found. Oct 29 01:47:26.778983 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:26.778983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b25ec658-3622-4065-b9db-91307b330bb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Returning 404 to user: Instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:47:26.778983 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b25ec658-3622-4065-b9db-91307b330bb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 404 len: 111 microversion: 2.1 time: 0.039356 Oct 29 01:47:26.781907 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3499/7214] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:26 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:47:26.792058 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c98babae-44f6-4719-ba57-88dc71e4e333 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:26.793608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c98babae-44f6-4719-ba57-88dc71e4e333 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:26.802133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c98babae-44f6-4719-ba57-88dc71e4e333 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:26.802943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c98babae-44f6-4719-ba57-88dc71e4e333 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:26.803583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c98babae-44f6-4719-ba57-88dc71e4e333 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:26.804495 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c98babae-44f6-4719-ba57-88dc71e4e333 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:26.805126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c98babae-44f6-4719-ba57-88dc71e4e333 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:26.805751 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c98babae-44f6-4719-ba57-88dc71e4e333 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:26.952789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c98babae-44f6-4719-ba57-88dc71e4e333 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:26.963271 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c98babae-44f6-4719-ba57-88dc71e4e333 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1522 microversion: 2.1 time: 0.175120 Oct 29 01:47:26.964118 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3716/7215] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:26 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:27.986164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f8c9e538-ce2a-475e-a477-9e45487e505f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:27.986969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f8c9e538-ce2a-475e-a477-9e45487e505f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:27.995600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8c9e538-ce2a-475e-a477-9e45487e505f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:27.996179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8c9e538-ce2a-475e-a477-9e45487e505f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:27.996700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8c9e538-ce2a-475e-a477-9e45487e505f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:27.997538 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8c9e538-ce2a-475e-a477-9e45487e505f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:27.998110 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8c9e538-ce2a-475e-a477-9e45487e505f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:27.998618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f8c9e538-ce2a-475e-a477-9e45487e505f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:28.140698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f8c9e538-ce2a-475e-a477-9e45487e505f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:28.165676 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f8c9e538-ce2a-475e-a477-9e45487e505f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1522 microversion: 2.1 time: 0.183395 Oct 29 01:47:28.181411 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3500/7216] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:27 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:29.191973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3dfaebb2-b1b0-4e70-9d9c-e2a0b4be37e3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:29.193584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3dfaebb2-b1b0-4e70-9d9c-e2a0b4be37e3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:29.203507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3dfaebb2-b1b0-4e70-9d9c-e2a0b4be37e3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:29.204576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3dfaebb2-b1b0-4e70-9d9c-e2a0b4be37e3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:29.205285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3dfaebb2-b1b0-4e70-9d9c-e2a0b4be37e3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:29.219254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3dfaebb2-b1b0-4e70-9d9c-e2a0b4be37e3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:29.224325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3dfaebb2-b1b0-4e70-9d9c-e2a0b4be37e3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:29.225217 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3dfaebb2-b1b0-4e70-9d9c-e2a0b4be37e3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:29.421010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3dfaebb2-b1b0-4e70-9d9c-e2a0b4be37e3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:29.430546 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3dfaebb2-b1b0-4e70-9d9c-e2a0b4be37e3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1522 microversion: 2.1 time: 0.244865 Oct 29 01:47:29.432926 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3717/7217] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:29 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:30.466467 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-13647800-2907-4cb6-af5f-cda180cc05a7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:30.467482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-13647800-2907-4cb6-af5f-cda180cc05a7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:30.477600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13647800-2907-4cb6-af5f-cda180cc05a7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:30.479684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13647800-2907-4cb6-af5f-cda180cc05a7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:30.479684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13647800-2907-4cb6-af5f-cda180cc05a7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:30.479684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13647800-2907-4cb6-af5f-cda180cc05a7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:30.480019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13647800-2907-4cb6-af5f-cda180cc05a7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:30.480279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13647800-2907-4cb6-af5f-cda180cc05a7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:30.633457 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-13647800-2907-4cb6-af5f-cda180cc05a7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:30.641983 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-13647800-2907-4cb6-af5f-cda180cc05a7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1522 microversion: 2.1 time: 0.183133 Oct 29 01:47:30.642552 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3501/7218] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:30 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:31.666115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c17bd06b-5c5a-4304-bd80-7736b91bb79e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:31.666996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c17bd06b-5c5a-4304-bd80-7736b91bb79e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:31.674357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c17bd06b-5c5a-4304-bd80-7736b91bb79e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:31.683914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c17bd06b-5c5a-4304-bd80-7736b91bb79e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:31.683914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c17bd06b-5c5a-4304-bd80-7736b91bb79e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:31.683914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c17bd06b-5c5a-4304-bd80-7736b91bb79e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:31.683914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c17bd06b-5c5a-4304-bd80-7736b91bb79e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:31.683914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c17bd06b-5c5a-4304-bd80-7736b91bb79e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:31.827800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c17bd06b-5c5a-4304-bd80-7736b91bb79e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:31.841656 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c17bd06b-5c5a-4304-bd80-7736b91bb79e tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1522 microversion: 2.1 time: 0.179372 Oct 29 01:47:31.842660 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3718/7219] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:31 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:32.247134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b63588ee-3db8-4e64-980e-33472264b12c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:32.247862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b63588ee-3db8-4e64-980e-33472264b12c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:32.256266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b63588ee-3db8-4e64-980e-33472264b12c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:32.256856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b63588ee-3db8-4e64-980e-33472264b12c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:32.257410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b63588ee-3db8-4e64-980e-33472264b12c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:32.258223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b63588ee-3db8-4e64-980e-33472264b12c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:32.258861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b63588ee-3db8-4e64-980e-33472264b12c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:32.259357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b63588ee-3db8-4e64-980e-33472264b12c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:32.286437 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b63588ee-3db8-4e64-980e-33472264b12c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:47:32.563461 n-d-862964-3 devstack@n-api.service[121100]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:47:32.563777 n-d-862964-3 devstack@n-api.service[121100]: Sat Oct 29 01:47:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 (ip 10.222.0.26) !!! Oct 29 01:47:32.653136 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b63588ee-3db8-4e64-980e-33472264b12c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "DELETE /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 204 len: 0 microversion: 2.1 time: 0.409483 Oct 29 01:47:32.654344 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3502/7220] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:47:32 2022] DELETE /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:47:32.665405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2ba82173-23b9-4ceb-9594-90cf5e921aa3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:32.666072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2ba82173-23b9-4ceb-9594-90cf5e921aa3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:32.672841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ba82173-23b9-4ceb-9594-90cf5e921aa3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:32.677903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ba82173-23b9-4ceb-9594-90cf5e921aa3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:32.677903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ba82173-23b9-4ceb-9594-90cf5e921aa3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:32.677903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ba82173-23b9-4ceb-9594-90cf5e921aa3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:32.677903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ba82173-23b9-4ceb-9594-90cf5e921aa3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:32.677903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ba82173-23b9-4ceb-9594-90cf5e921aa3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:32.817457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2ba82173-23b9-4ceb-9594-90cf5e921aa3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:32.824192 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2ba82173-23b9-4ceb-9594-90cf5e921aa3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1411 microversion: 2.1 time: 0.165585 Oct 29 01:47:32.824982 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3719/7221] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:32 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1411 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:32.867016 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1a8d9eed-a5f9-4987-9efb-68d912e6fc82 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:32.868128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1a8d9eed-a5f9-4987-9efb-68d912e6fc82 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:32.875370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a8d9eed-a5f9-4987-9efb-68d912e6fc82 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:32.876262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a8d9eed-a5f9-4987-9efb-68d912e6fc82 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:32.877000 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a8d9eed-a5f9-4987-9efb-68d912e6fc82 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:32.877574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a8d9eed-a5f9-4987-9efb-68d912e6fc82 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:32.878998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a8d9eed-a5f9-4987-9efb-68d912e6fc82 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:32.879677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a8d9eed-a5f9-4987-9efb-68d912e6fc82 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:33.024332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1a8d9eed-a5f9-4987-9efb-68d912e6fc82 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:33.042066 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1a8d9eed-a5f9-4987-9efb-68d912e6fc82 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1522 microversion: 2.1 time: 0.179637 Oct 29 01:47:33.047065 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3503/7222] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:32 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:33.848313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-be8c4290-e753-4934-96c2-640b9ad6bd00 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:33.848938 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-be8c4290-e753-4934-96c2-640b9ad6bd00 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:33.857771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be8c4290-e753-4934-96c2-640b9ad6bd00 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:33.858265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be8c4290-e753-4934-96c2-640b9ad6bd00 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:33.858712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be8c4290-e753-4934-96c2-640b9ad6bd00 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:33.859421 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be8c4290-e753-4934-96c2-640b9ad6bd00 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:33.859887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be8c4290-e753-4934-96c2-640b9ad6bd00 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:33.860319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be8c4290-e753-4934-96c2-640b9ad6bd00 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:34.006590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-be8c4290-e753-4934-96c2-640b9ad6bd00 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:34.014638 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-be8c4290-e753-4934-96c2-640b9ad6bd00 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1411 microversion: 2.1 time: 0.170669 Oct 29 01:47:34.017133 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3720/7223] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:33 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1411 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:34.067493 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9bd69c95-3a63-4f80-9164-a3cdd3560c9c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:34.068050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9bd69c95-3a63-4f80-9164-a3cdd3560c9c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:34.075743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9bd69c95-3a63-4f80-9164-a3cdd3560c9c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:34.076246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9bd69c95-3a63-4f80-9164-a3cdd3560c9c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:34.076729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9bd69c95-3a63-4f80-9164-a3cdd3560c9c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:34.077478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9bd69c95-3a63-4f80-9164-a3cdd3560c9c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:34.077964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9bd69c95-3a63-4f80-9164-a3cdd3560c9c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:34.078383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9bd69c95-3a63-4f80-9164-a3cdd3560c9c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:34.223706 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9bd69c95-3a63-4f80-9164-a3cdd3560c9c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:34.233784 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9bd69c95-3a63-4f80-9164-a3cdd3560c9c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1502 microversion: 2.1 time: 0.170858 Oct 29 01:47:34.241989 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3504/7224] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:34 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1502 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:34.259851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1fafbd03-aec1-4c91-8ba0-a7299e1f2bdc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ac93f97-28e7-4a2e-aae0-3f7600bc7df7"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:34.262496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1fafbd03-aec1-4c91-8ba0-a7299e1f2bdc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:34.270105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fafbd03-aec1-4c91-8ba0-a7299e1f2bdc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:34.270599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fafbd03-aec1-4c91-8ba0-a7299e1f2bdc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:34.271103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fafbd03-aec1-4c91-8ba0-a7299e1f2bdc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:34.280725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fafbd03-aec1-4c91-8ba0-a7299e1f2bdc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:34.280725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fafbd03-aec1-4c91-8ba0-a7299e1f2bdc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:34.280725 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1fafbd03-aec1-4c91-8ba0-a7299e1f2bdc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:34.297977 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-1fafbd03-aec1-4c91-8ba0-a7299e1f2bdc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] HTTP exception thrown: Cannot 'attach_volume' instance 4beaf925-018a-47ce-810e-b53329fe86a0 while it is in vm_state rescued Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1fafbd03-aec1-4c91-8ba0-a7299e1f2bdc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Request method failure captured: Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0/os-volume_attachments HTTP/1.1 Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 74 Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIXmiZLUHgQf8g1eJ6FTBPxQ6yYPldRikhV_PrG4adbgTywoIFdTTQzzYLYf7Q8nmXrU6gBy4lrdKLe1DFugXfCor48tp4KGalaxBeYPZ8OxWzZX_lUSaO5EmAsCxBcqfg03LezTH1BrcAZy2EOgD8GUlBMhab57UUVT2uqh6jpD5os Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 5451841ce3564e4d9a77cdac41619273 Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5451841ce3564e4d9a77cdac41619273", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 5451841ce3564e4d9a77cdac41619273 Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerRescueNegativeTestJSON-1825472559-project Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f55bc7f1dee2477abb53f91d5ad58d3a Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1825472559-project Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: {"volumeAttachment": {"volumeId": "6ac93f97-28e7-4a2e-aae0-3f7600bc7df7"}} Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: exception: Cannot 'attach_volume' instance 4beaf925-018a-47ce-810e-b53329fe86a0 while it is in vm_state rescued Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'server_id': '4beaf925-018a-47ce-810e-b53329fe86a0', 'body': {'volumeAttachment': {'volumeId': '6ac93f97-28e7-4a2e-aae0-3f7600bc7df7'}}} Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4beaf925-018a-47ce-810e-b53329fe86a0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 29 01:47:34.299576 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 01:47:34.304189 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 01:47:34.304189 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 01:47:34.304189 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4beaf925-018a-47ce-810e-b53329fe86a0 while it is in vm_state rescued Oct 29 01:47:34.304189 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:34.304189 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:47:34.304189 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:34.304189 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:34.304189 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:47:34.304189 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:47:34.304189 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:47:34.304189 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:47:34.304189 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4beaf925-018a-47ce-810e-b53329fe86a0 while it is in vm_state rescued Oct 29 01:47:34.304189 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:34.304189 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1fafbd03-aec1-4c91-8ba0-a7299e1f2bdc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Returning 409 to user: Cannot 'attach_volume' instance 4beaf925-018a-47ce-810e-b53329fe86a0 while it is in vm_state rescued {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:47:34.304189 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1fafbd03-aec1-4c91-8ba0-a7299e1f2bdc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "POST /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046065 Oct 29 01:47:34.304189 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3721/7225] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 29 01:47:34 2022] POST /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:47:34.310160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-65069a6d-ea90-45aa-9dd4-0a7def5434af tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:34.310718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-65069a6d-ea90-45aa-9dd4-0a7def5434af tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:34.316860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65069a6d-ea90-45aa-9dd4-0a7def5434af tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:34.317414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65069a6d-ea90-45aa-9dd4-0a7def5434af tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:34.320833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65069a6d-ea90-45aa-9dd4-0a7def5434af tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:34.320833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65069a6d-ea90-45aa-9dd4-0a7def5434af tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:34.320833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65069a6d-ea90-45aa-9dd4-0a7def5434af tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:34.320833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65069a6d-ea90-45aa-9dd4-0a7def5434af tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:34.530789 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-65069a6d-ea90-45aa-9dd4-0a7def5434af tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "POST /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0/action" status: 202 len: 0 microversion: 2.1 time: 0.218936 Oct 29 01:47:34.541828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d8fe21a4-70f6-4d22-82c7-90a2b1e99adb tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:34.542746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d8fe21a4-70f6-4d22-82c7-90a2b1e99adb tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:34.544663 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3505/7226] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:47:34 2022] POST /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:47:34.549703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8fe21a4-70f6-4d22-82c7-90a2b1e99adb tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:34.551279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8fe21a4-70f6-4d22-82c7-90a2b1e99adb tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:34.552063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8fe21a4-70f6-4d22-82c7-90a2b1e99adb tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:34.552880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8fe21a4-70f6-4d22-82c7-90a2b1e99adb tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:34.553427 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8fe21a4-70f6-4d22-82c7-90a2b1e99adb tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:34.554072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d8fe21a4-70f6-4d22-82c7-90a2b1e99adb tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:34.876891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d8fe21a4-70f6-4d22-82c7-90a2b1e99adb tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:34.883672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:47:34.890883 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d8fe21a4-70f6-4d22-82c7-90a2b1e99adb tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1510 microversion: 2.1 time: 0.353659 Oct 29 01:47:34.891736 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3722/7227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:34 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1510 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:35.038630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e122d916-3faa-4e51-b8ed-6db5d8d0f345 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:35.040118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e122d916-3faa-4e51-b8ed-6db5d8d0f345 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:35.052162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e122d916-3faa-4e51-b8ed-6db5d8d0f345 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:35.053602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e122d916-3faa-4e51-b8ed-6db5d8d0f345 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:35.055630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e122d916-3faa-4e51-b8ed-6db5d8d0f345 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:35.056714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e122d916-3faa-4e51-b8ed-6db5d8d0f345 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:35.057480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e122d916-3faa-4e51-b8ed-6db5d8d0f345 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:35.058098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e122d916-3faa-4e51-b8ed-6db5d8d0f345 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:35.342892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e122d916-3faa-4e51-b8ed-6db5d8d0f345 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:35.368306 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e122d916-3faa-4e51-b8ed-6db5d8d0f345 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1411 microversion: 2.1 time: 0.332620 Oct 29 01:47:35.382253 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3506/7228] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:35 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1411 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:35.457847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-6954edd0-b1c1-4826-8c17-53f7b3893882 req-629ce0c0-504b-45c2-ab06-71f747cc8335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73da8296-b0b1-4378-b763-e307fb2cfee1", "name": "network-vif-deleted", "tag": "95214dad-1a07-41ae-9304-917a7c26ff93"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:35.470947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6954edd0-b1c1-4826-8c17-53f7b3893882 req-629ce0c0-504b-45c2-ab06-71f747cc8335 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:35.472225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6954edd0-b1c1-4826-8c17-53f7b3893882 req-629ce0c0-504b-45c2-ab06-71f747cc8335 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:35.472598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6954edd0-b1c1-4826-8c17-53f7b3893882 req-629ce0c0-504b-45c2-ab06-71f747cc8335 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:35.484083 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-6954edd0-b1c1-4826-8c17-53f7b3893882 req-629ce0c0-504b-45c2-ab06-71f747cc8335 service nova] Creating event network-vif-deleted:95214dad-1a07-41ae-9304-917a7c26ff93 for instance 73da8296-b0b1-4378-b763-e307fb2cfee1 on n-h1-862964-3 Oct 29 01:47:35.489470 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-6954edd0-b1c1-4826-8c17-53f7b3893882 req-629ce0c0-504b-45c2-ab06-71f747cc8335 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035596 Oct 29 01:47:35.490272 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3723/7229] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:47:35.915564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8971212e-e5b2-4e06-8d3c-fa09ce7a0892 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:35.916199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8971212e-e5b2-4e06-8d3c-fa09ce7a0892 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:35.923251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8971212e-e5b2-4e06-8d3c-fa09ce7a0892 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:35.923758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8971212e-e5b2-4e06-8d3c-fa09ce7a0892 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:35.924267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8971212e-e5b2-4e06-8d3c-fa09ce7a0892 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:35.924997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8971212e-e5b2-4e06-8d3c-fa09ce7a0892 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:35.925544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8971212e-e5b2-4e06-8d3c-fa09ce7a0892 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:35.925999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8971212e-e5b2-4e06-8d3c-fa09ce7a0892 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:36.088551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8971212e-e5b2-4e06-8d3c-fa09ce7a0892 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:36.097685 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8971212e-e5b2-4e06-8d3c-fa09ce7a0892 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1510 microversion: 2.1 time: 0.185567 Oct 29 01:47:36.098461 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3507/7230] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:35 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:36.395511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd799108-b6aa-4658-a19c-2804f3dc3dce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:36.396223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bd799108-b6aa-4658-a19c-2804f3dc3dce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:36.403868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd799108-b6aa-4658-a19c-2804f3dc3dce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:36.404371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd799108-b6aa-4658-a19c-2804f3dc3dce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:36.404807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd799108-b6aa-4658-a19c-2804f3dc3dce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:36.407548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd799108-b6aa-4658-a19c-2804f3dc3dce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:36.408214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd799108-b6aa-4658-a19c-2804f3dc3dce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:36.408829 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd799108-b6aa-4658-a19c-2804f3dc3dce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:36.482505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bd799108-b6aa-4658-a19c-2804f3dc3dce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:36.494894 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bd799108-b6aa-4658-a19c-2804f3dc3dce tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1202 microversion: 2.1 time: 0.104232 Oct 29 01:47:36.495706 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3724/7231] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:36 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1202 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:37.121739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0a4bdd7c-05c9-4cf3-9fad-ab82cd84b595 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:37.122474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0a4bdd7c-05c9-4cf3-9fad-ab82cd84b595 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:37.130693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a4bdd7c-05c9-4cf3-9fad-ab82cd84b595 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:37.131287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a4bdd7c-05c9-4cf3-9fad-ab82cd84b595 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:37.131820 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a4bdd7c-05c9-4cf3-9fad-ab82cd84b595 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:37.132626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a4bdd7c-05c9-4cf3-9fad-ab82cd84b595 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:37.133736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a4bdd7c-05c9-4cf3-9fad-ab82cd84b595 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:37.134364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0a4bdd7c-05c9-4cf3-9fad-ab82cd84b595 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:37.522668 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8f4a8112-3223-4ed3-873f-eb7bb62ba1c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:37.523839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8f4a8112-3223-4ed3-873f-eb7bb62ba1c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:37.531654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f4a8112-3223-4ed3-873f-eb7bb62ba1c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:37.532149 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f4a8112-3223-4ed3-873f-eb7bb62ba1c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:37.532788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f4a8112-3223-4ed3-873f-eb7bb62ba1c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:37.534887 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f4a8112-3223-4ed3-873f-eb7bb62ba1c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:37.535542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f4a8112-3223-4ed3-873f-eb7bb62ba1c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:37.536152 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8f4a8112-3223-4ed3-873f-eb7bb62ba1c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:37.650810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8f4a8112-3223-4ed3-873f-eb7bb62ba1c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:37.660972 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8f4a8112-3223-4ed3-873f-eb7bb62ba1c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1202 microversion: 2.1 time: 0.140763 Oct 29 01:47:37.661597 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3725/7232] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:37 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1202 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:47:37.672783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-0a4bdd7c-05c9-4cf3-9fad-ab82cd84b595 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:37.682979 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0a4bdd7c-05c9-4cf3-9fad-ab82cd84b595 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1510 microversion: 2.1 time: 0.565651 Oct 29 01:47:37.686518 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3508/7233] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:37 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1510 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:38.684052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aaf72f53-a9bc-4273-929c-8ceaad67cb10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:38.685096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-aaf72f53-a9bc-4273-929c-8ceaad67cb10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:38.695833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaf72f53-a9bc-4273-929c-8ceaad67cb10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:38.697945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaf72f53-a9bc-4273-929c-8ceaad67cb10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:38.698798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaf72f53-a9bc-4273-929c-8ceaad67cb10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:38.700410 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaf72f53-a9bc-4273-929c-8ceaad67cb10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:38.701033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaf72f53-a9bc-4273-929c-8ceaad67cb10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:38.701614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aaf72f53-a9bc-4273-929c-8ceaad67cb10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:38.714114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d847a8d8-2141-4320-8532-9bba35030590 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:38.715765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d847a8d8-2141-4320-8532-9bba35030590 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:38.727263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d847a8d8-2141-4320-8532-9bba35030590 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:38.728516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d847a8d8-2141-4320-8532-9bba35030590 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:38.729319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d847a8d8-2141-4320-8532-9bba35030590 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:38.730361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d847a8d8-2141-4320-8532-9bba35030590 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:38.731320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d847a8d8-2141-4320-8532-9bba35030590 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:38.732212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d847a8d8-2141-4320-8532-9bba35030590 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:38.807493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-aaf72f53-a9bc-4273-929c-8ceaad67cb10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:38.816274 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aaf72f53-a9bc-4273-929c-8ceaad67cb10 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1202 microversion: 2.1 time: 0.135956 Oct 29 01:47:38.822911 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3726/7234] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:38 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1202 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:38.923208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d847a8d8-2141-4320-8532-9bba35030590 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:38.932524 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d847a8d8-2141-4320-8532-9bba35030590 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1516 microversion: 2.1 time: 0.226096 Oct 29 01:47:38.933378 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3509/7235] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:38 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1516 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:39.847856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9fb1e0eb-a459-4b23-a157-e07eb0bc4fec tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:39.853449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9fb1e0eb-a459-4b23-a157-e07eb0bc4fec tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:39.856901 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fb1e0eb-a459-4b23-a157-e07eb0bc4fec tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:39.857423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fb1e0eb-a459-4b23-a157-e07eb0bc4fec tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:39.857867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fb1e0eb-a459-4b23-a157-e07eb0bc4fec tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:39.858623 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fb1e0eb-a459-4b23-a157-e07eb0bc4fec tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:39.859090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fb1e0eb-a459-4b23-a157-e07eb0bc4fec tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:39.859525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fb1e0eb-a459-4b23-a157-e07eb0bc4fec tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:39.932960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9fb1e0eb-a459-4b23-a157-e07eb0bc4fec tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:39.941313 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9fb1e0eb-a459-4b23-a157-e07eb0bc4fec tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1202 microversion: 2.1 time: 0.098088 Oct 29 01:47:39.943529 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3727/7236] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:39 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1202 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:40.964056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9e79aa06-d9e3-4d5b-8ae5-cde2849ee798 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:40.965061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9e79aa06-d9e3-4d5b-8ae5-cde2849ee798 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:40.973065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e79aa06-d9e3-4d5b-8ae5-cde2849ee798 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:40.973616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e79aa06-d9e3-4d5b-8ae5-cde2849ee798 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:40.974070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e79aa06-d9e3-4d5b-8ae5-cde2849ee798 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:40.974783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e79aa06-d9e3-4d5b-8ae5-cde2849ee798 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:40.975258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e79aa06-d9e3-4d5b-8ae5-cde2849ee798 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:40.975698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e79aa06-d9e3-4d5b-8ae5-cde2849ee798 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:41.008352 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e79aa06-d9e3-4d5b-8ae5-cde2849ee798 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:41.008768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e79aa06-d9e3-4d5b-8ae5-cde2849ee798 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:41.009375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e79aa06-d9e3-4d5b-8ae5-cde2849ee798 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:41.009767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-9e79aa06-d9e3-4d5b-8ae5-cde2849ee798 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lazy-loading 'fault' on Instance uuid 73da8296-b0b1-4378-b763-e307fb2cfee1 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:47:41.012582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:47:41.080233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9e79aa06-d9e3-4d5b-8ae5-cde2849ee798 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:41.091792 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9e79aa06-d9e3-4d5b-8ae5-cde2849ee798 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 200 len: 1207 microversion: 2.1 time: 0.131233 Oct 29 01:47:41.101093 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3510/7237] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:40 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 1207 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:41.702283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-67cf007e-ab32-4216-97bf-2b3a7e9d99e4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Action: 'create', calling method: .version_select at 0x7f9d9677e280>, body: {"keypair": {"name": "tempest-keypair-379566104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYasBCwfmFCuiO2jqtHmVkMcvISHcp+nW9bi4MTRnXLJuJOEE7MB6wdx2qOHd4caVzfvXLTJ6Z940OuuBS6btjEmowRbyY1fbjh22RzHh6nwI+boHI1lIDOZzp5AKnu2g=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:41.719614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-67cf007e-ab32-4216-97bf-2b3a7e9d99e4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Getting quotas for project 5451841ce3564e4d9a77cdac41619273. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:47:41.726344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-67cf007e-ab32-4216-97bf-2b3a7e9d99e4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Getting quotas for user f55bc7f1dee2477abb53f91d5ad58d3a and project 5451841ce3564e4d9a77cdac41619273. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:47:41.821298 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-67cf007e-ab32-4216-97bf-2b3a7e9d99e4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.122421 Oct 29 01:47:41.822330 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3728/7238] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:47:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:47:42.120468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dedbe989-cd4f-480d-8185-51f67bf5268f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:42.121761 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dedbe989-cd4f-480d-8185-51f67bf5268f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:42.130404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dedbe989-cd4f-480d-8185-51f67bf5268f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:42.131161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dedbe989-cd4f-480d-8185-51f67bf5268f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:42.131912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dedbe989-cd4f-480d-8185-51f67bf5268f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:42.132813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dedbe989-cd4f-480d-8185-51f67bf5268f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:42.133500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dedbe989-cd4f-480d-8185-51f67bf5268f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:42.134106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dedbe989-cd4f-480d-8185-51f67bf5268f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:42.154912 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-dedbe989-cd4f-480d-8185-51f67bf5268f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] HTTP exception thrown: Instance 73da8296-b0b1-4378-b763-e307fb2cfee1 could not be found. Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dedbe989-cd4f-480d-8185-51f67bf5268f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Request method failure captured: Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 HTTP/1.1 Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXISL1fYm1j7NXik3zsNtroj_Oy-crTrvQAeW5M-FwwtP3LsKgHXpuppTsI04rMuajP4UZsmStYeX1aQyWE5BokToP2AX7pO99qAjgwqGhP0Pb1MuaH07JyrTdqaWdL6Co3a2Gha0Gb4NOVY73erVtuC0neHUxTJ51YCufPzngi0azyM Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37416a9397fa4c6dbd0bfe8dee191577", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TestVolumeBootPattern-743321222 Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 8b8f36d10fa340f784581a3cf9a15606 Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 73da8296-b0b1-4378-b763-e307fb2cfee1 could not be found. Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '73da8296-b0b1-4378-b763-e307fb2cfee1'} Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73da8296-b0b1-4378-b763-e307fb2cfee1 could not be found. Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73da8296-b0b1-4378-b763-e307fb2cfee1 could not be found. Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:47:42.156480 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:42.162860 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:42.162860 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:47:42.162860 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:47:42.162860 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:47:42.162860 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:47:42.162860 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73da8296-b0b1-4378-b763-e307fb2cfee1 could not be found. Oct 29 01:47:42.162860 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:42.162860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dedbe989-cd4f-480d-8185-51f67bf5268f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Returning 404 to user: Instance 73da8296-b0b1-4378-b763-e307fb2cfee1 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:47:42.162860 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dedbe989-cd4f-480d-8185-51f67bf5268f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 404 len: 111 microversion: 2.1 time: 0.041571 Oct 29 01:47:42.162860 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3511/7239] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:42 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:47:44.289443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e103fd32-2027-4188-a265-faf42b895111 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-582630017", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd57cfc3-8101-436c-856e-5c76944d1e54"}], "security_groups": [{"name": "tempest-securitygroup--1944999170"}], "key_name": "tempest-keypair-379566104", "user_data": "}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:44.345612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8bb7384f-ed90-4b46-aa16-a69462d71607 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:44.346107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8bb7384f-ed90-4b46-aa16-a69462d71607 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:44.354551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8bb7384f-ed90-4b46-aa16-a69462d71607 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:44.355308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8bb7384f-ed90-4b46-aa16-a69462d71607 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:44.355534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8bb7384f-ed90-4b46-aa16-a69462d71607 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:44.356592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8bb7384f-ed90-4b46-aa16-a69462d71607 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:44.357071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8bb7384f-ed90-4b46-aa16-a69462d71607 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:44.357582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8bb7384f-ed90-4b46-aa16-a69462d71607 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:44.387251 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-8bb7384f-ed90-4b46-aa16-a69462d71607 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] HTTP exception thrown: Instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 could not be found. Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8bb7384f-ed90-4b46-aa16-a69462d71607 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Request method failure captured: Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 HTTP/1.1 Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXISL1fYm1j7NXik3zsNtroj_Oy-crTrvQAeW5M-FwwtP3LsKgHXpuppTsI04rMuajP4UZsmStYeX1aQyWE5BokToP2AX7pO99qAjgwqGhP0Pb1MuaH07JyrTdqaWdL6Co3a2Gha0Gb4NOVY73erVtuC0neHUxTJ51YCufPzngi0azyM Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37416a9397fa4c6dbd0bfe8dee191577", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TestVolumeBootPattern-743321222 Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 8b8f36d10fa340f784581a3cf9a15606 Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 could not be found. Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'd38796c0-9ae5-4bd1-8a93-99fe19e96e13'} Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 could not be found. Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:47:44.388869 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:47:44.393917 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 could not be found. Oct 29 01:47:44.393917 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:44.393917 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:47:44.393917 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:44.393917 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:44.393917 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:47:44.393917 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:47:44.393917 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:47:44.393917 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:47:44.393917 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 could not be found. Oct 29 01:47:44.393917 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:44.393917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8bb7384f-ed90-4b46-aa16-a69462d71607 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Returning 404 to user: Instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:47:44.393917 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8bb7384f-ed90-4b46-aa16-a69462d71607 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 404 len: 111 microversion: 2.1 time: 0.054034 Oct 29 01:47:44.393917 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3512/7240] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:47:44 2022] DELETE /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:47:44.400185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-48db4485-647d-41ed-bc30-fabfa8773fb8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:44.400890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-48db4485-647d-41ed-bc30-fabfa8773fb8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: d38796c0-9ae5-4bd1-8a93-99fe19e96e13] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:44.407372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48db4485-647d-41ed-bc30-fabfa8773fb8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:44.407893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48db4485-647d-41ed-bc30-fabfa8773fb8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:44.408411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48db4485-647d-41ed-bc30-fabfa8773fb8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:44.409805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48db4485-647d-41ed-bc30-fabfa8773fb8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:44.410301 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48db4485-647d-41ed-bc30-fabfa8773fb8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:44.410763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-48db4485-647d-41ed-bc30-fabfa8773fb8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:44.426952 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-48db4485-647d-41ed-bc30-fabfa8773fb8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] HTTP exception thrown: Instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 could not be found. Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-48db4485-647d-41ed-bc30-fabfa8773fb8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Request method failure captured: Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 HTTP/1.1 Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXISL1fYm1j7NXik3zsNtroj_Oy-crTrvQAeW5M-FwwtP3LsKgHXpuppTsI04rMuajP4UZsmStYeX1aQyWE5BokToP2AX7pO99qAjgwqGhP0Pb1MuaH07JyrTdqaWdL6Co3a2Gha0Gb4NOVY73erVtuC0neHUxTJ51YCufPzngi0azyM Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37416a9397fa4c6dbd0bfe8dee191577", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TestVolumeBootPattern-743321222 Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 8b8f36d10fa340f784581a3cf9a15606 Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 could not be found. Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'd38796c0-9ae5-4bd1-8a93-99fe19e96e13'} Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 could not be found. Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 could not be found. Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:47:44.428592 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:44.433202 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:44.433202 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:47:44.433202 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:47:44.433202 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:47:44.433202 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:47:44.433202 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 could not be found. Oct 29 01:47:44.433202 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:44.433202 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-48db4485-647d-41ed-bc30-fabfa8773fb8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Returning 404 to user: Instance d38796c0-9ae5-4bd1-8a93-99fe19e96e13 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:47:44.433202 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-48db4485-647d-41ed-bc30-fabfa8773fb8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13" status: 404 len: 111 microversion: 2.1 time: 0.034393 Oct 29 01:47:44.433202 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3513/7241] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:44 2022] GET /compute/v2.1/servers/d38796c0-9ae5-4bd1-8a93-99fe19e96e13 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:47:44.440989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-e103fd32-2027-4188-a265-faf42b895111 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] validate_networks() for [('dd57cfc3-8101-436c-856e-5c76944d1e54', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:47:44.898464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e103fd32-2027-4188-a265-faf42b895111 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:47:44.899098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e103fd32-2027-4188-a265-faf42b895111 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:47:44.899967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e103fd32-2027-4188-a265-faf42b895111 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:47:44.900550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e103fd32-2027-4188-a265-faf42b895111 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:47:44.901283 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-e103fd32-2027-4188-a265-faf42b895111 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:47:44.912286 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e103fd32-2027-4188-a265-faf42b895111 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:44.913442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e103fd32-2027-4188-a265-faf42b895111 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:44.914183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e103fd32-2027-4188-a265-faf42b895111 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:44.915303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e103fd32-2027-4188-a265-faf42b895111 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:44.916218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e103fd32-2027-4188-a265-faf42b895111 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:44.916860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e103fd32-2027-4188-a265-faf42b895111 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:44.941746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-e103fd32-2027-4188-a265-faf42b895111 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Getting quotas for project 5451841ce3564e4d9a77cdac41619273. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:47:44.948737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-e103fd32-2027-4188-a265-faf42b895111 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Getting quotas for user f55bc7f1dee2477abb53f91d5ad58d3a and project 5451841ce3564e4d9a77cdac41619273. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:47:44.964784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e103fd32-2027-4188-a265-faf42b895111 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:47:44.967481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e103fd32-2027-4188-a265-faf42b895111 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:47:45.113146 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e103fd32-2027-4188-a265-faf42b895111 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.828589 Oct 29 01:47:45.113873 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3729/7242] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:47:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:47:45.125916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9d42c350-f6e5-4c7c-b00c-571dac6e7595 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:45.126539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9d42c350-f6e5-4c7c-b00c-571dac6e7595 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:45.186042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9d42c350-f6e5-4c7c-b00c-571dac6e7595 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:45.193371 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9d42c350-f6e5-4c7c-b00c-571dac6e7595 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1244 microversion: 2.1 time: 0.072093 Oct 29 01:47:45.199233 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3514/7243] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:45 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1244 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:45.497658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5561dee4-0ed9-41f4-86d7-ed67ecdd86c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:45.498174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5561dee4-0ed9-41f4-86d7-ed67ecdd86c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:45.505714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5561dee4-0ed9-41f4-86d7-ed67ecdd86c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:45.506204 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5561dee4-0ed9-41f4-86d7-ed67ecdd86c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:45.506654 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5561dee4-0ed9-41f4-86d7-ed67ecdd86c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:45.507355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5561dee4-0ed9-41f4-86d7-ed67ecdd86c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:45.507814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5561dee4-0ed9-41f4-86d7-ed67ecdd86c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:45.508272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5561dee4-0ed9-41f4-86d7-ed67ecdd86c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:45.522101 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-5561dee4-0ed9-41f4-86d7-ed67ecdd86c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] HTTP exception thrown: Instance 73da8296-b0b1-4378-b763-e307fb2cfee1 could not be found. Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5561dee4-0ed9-41f4-86d7-ed67ecdd86c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Request method failure captured: Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 HTTP/1.1 Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXISL1fYm1j7NXik3zsNtroj_Oy-crTrvQAeW5M-FwwtP3LsKgHXpuppTsI04rMuajP4UZsmStYeX1aQyWE5BokToP2AX7pO99qAjgwqGhP0Pb1MuaH07JyrTdqaWdL6Co3a2Gha0Gb4NOVY73erVtuC0neHUxTJ51YCufPzngi0azyM Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37416a9397fa4c6dbd0bfe8dee191577", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-TestVolumeBootPattern-743321222 Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8b8f36d10fa340f784581a3cf9a15606 Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 73da8296-b0b1-4378-b763-e307fb2cfee1 could not be found. Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '73da8296-b0b1-4378-b763-e307fb2cfee1'} Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73da8296-b0b1-4378-b763-e307fb2cfee1 could not be found. Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:47:45.523859 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:47:45.537982 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73da8296-b0b1-4378-b763-e307fb2cfee1 could not be found. Oct 29 01:47:45.537982 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:45.537982 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:47:45.537982 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:45.537982 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:45.537982 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:47:45.537982 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:47:45.537982 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:47:45.537982 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:47:45.537982 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73da8296-b0b1-4378-b763-e307fb2cfee1 could not be found. Oct 29 01:47:45.537982 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:47:45.537982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5561dee4-0ed9-41f4-86d7-ed67ecdd86c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Returning 404 to user: Instance 73da8296-b0b1-4378-b763-e307fb2cfee1 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:47:45.537982 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5561dee4-0ed9-41f4-86d7-ed67ecdd86c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "DELETE /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 404 len: 111 microversion: 2.1 time: 0.032988 Oct 29 01:47:45.537982 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3730/7244] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:47:45 2022] DELETE /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:47:45.539760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-541ed7de-c9b8-4a2b-b8e9-b38321493066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:45.539760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-541ed7de-c9b8-4a2b-b8e9-b38321493066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 73da8296-b0b1-4378-b763-e307fb2cfee1] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:45.545895 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-541ed7de-c9b8-4a2b-b8e9-b38321493066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:45.546417 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-541ed7de-c9b8-4a2b-b8e9-b38321493066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:45.547154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-541ed7de-c9b8-4a2b-b8e9-b38321493066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:45.547811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-541ed7de-c9b8-4a2b-b8e9-b38321493066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:45.548283 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-541ed7de-c9b8-4a2b-b8e9-b38321493066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:45.548760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-541ed7de-c9b8-4a2b-b8e9-b38321493066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:45.562580 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-541ed7de-c9b8-4a2b-b8e9-b38321493066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] HTTP exception thrown: Instance 73da8296-b0b1-4378-b763-e307fb2cfee1 could not be found. Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-541ed7de-c9b8-4a2b-b8e9-b38321493066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Request method failure captured: Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 HTTP/1.1 Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXISL1fYm1j7NXik3zsNtroj_Oy-crTrvQAeW5M-FwwtP3LsKgHXpuppTsI04rMuajP4UZsmStYeX1aQyWE5BokToP2AX7pO99qAjgwqGhP0Pb1MuaH07JyrTdqaWdL6Co3a2Gha0Gb4NOVY73erVtuC0neHUxTJ51YCufPzngi0azyM Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37416a9397fa4c6dbd0bfe8dee191577", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TestVolumeBootPattern-743321222 Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 8b8f36d10fa340f784581a3cf9a15606 Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 73da8296-b0b1-4378-b763-e307fb2cfee1 could not be found. Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '73da8296-b0b1-4378-b763-e307fb2cfee1'} Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73da8296-b0b1-4378-b763-e307fb2cfee1 could not be found. Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73da8296-b0b1-4378-b763-e307fb2cfee1 could not be found. Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:47:45.564152 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:45.570456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:47:45.570456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:47:45.570456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:47:45.570456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:47:45.570456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:47:45.570456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73da8296-b0b1-4378-b763-e307fb2cfee1 could not be found. Oct 29 01:47:45.570456 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:47:45.570456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-541ed7de-c9b8-4a2b-b8e9-b38321493066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Returning 404 to user: Instance 73da8296-b0b1-4378-b763-e307fb2cfee1 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:47:45.570456 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-541ed7de-c9b8-4a2b-b8e9-b38321493066 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1" status: 404 len: 111 microversion: 2.1 time: 0.035233 Oct 29 01:47:45.570456 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3515/7245] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:45 2022] GET /compute/v2.1/servers/73da8296-b0b1-4378-b763-e307fb2cfee1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:47:45.661071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9328c1a5-8ecb-4227-b83c-56b35bf2d14c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Action: 'create', calling method: .version_select at 0x7f9d9662c160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-161758843", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYV4HTlgahFVukUFPm842f2UGUhrY94PGTLOP+tN58w8AqbF+RvIvvdEhzEPCYD7RnvRTbwaGsInGvqjVScgY0jYBVZfV4i1oVkhpplL6mxZaYeVC0JscoJahWRvymFaw=="}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:45.677855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-9328c1a5-8ecb-4227-b83c-56b35bf2d14c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Getting quotas for project 37416a9397fa4c6dbd0bfe8dee191577. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:47:45.683834 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-9328c1a5-8ecb-4227-b83c-56b35bf2d14c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Getting quotas for user 8b8f36d10fa340f784581a3cf9a15606 and project 37416a9397fa4c6dbd0bfe8dee191577. Resources: {'key_pairs'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:47:45.764055 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9328c1a5-8ecb-4227-b83c-56b35bf2d14c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.107022 Oct 29 01:47:45.770454 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3731/7246] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:47:45 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:47:46.217682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-42a44b51-e659-483b-bc19-792f3aa42fc4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:46.218323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-42a44b51-e659-483b-bc19-792f3aa42fc4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:46.225127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42a44b51-e659-483b-bc19-792f3aa42fc4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:46.225797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42a44b51-e659-483b-bc19-792f3aa42fc4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:46.226320 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42a44b51-e659-483b-bc19-792f3aa42fc4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:46.227059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42a44b51-e659-483b-bc19-792f3aa42fc4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:46.227607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42a44b51-e659-483b-bc19-792f3aa42fc4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:46.228030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-42a44b51-e659-483b-bc19-792f3aa42fc4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:46.301602 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-42a44b51-e659-483b-bc19-792f3aa42fc4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:46.311010 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-42a44b51-e659-483b-bc19-792f3aa42fc4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1248 microversion: 2.1 time: 0.097279 Oct 29 01:47:46.312546 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3516/7247] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:46 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1248 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:47.337460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f7efb3db-5509-42a0-8c94-a43d69d3d7a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:47.338023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f7efb3db-5509-42a0-8c94-a43d69d3d7a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:47.344628 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7efb3db-5509-42a0-8c94-a43d69d3d7a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:47.345119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7efb3db-5509-42a0-8c94-a43d69d3d7a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:47.345592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7efb3db-5509-42a0-8c94-a43d69d3d7a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:47.346303 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7efb3db-5509-42a0-8c94-a43d69d3d7a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:47.346811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7efb3db-5509-42a0-8c94-a43d69d3d7a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:47.347279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7efb3db-5509-42a0-8c94-a43d69d3d7a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:47.433625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f7efb3db-5509-42a0-8c94-a43d69d3d7a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:47.442337 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f7efb3db-5509-42a0-8c94-a43d69d3d7a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1296 microversion: 2.1 time: 0.110030 Oct 29 01:47:47.442932 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3732/7248] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:47 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1296 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:48.466630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ca0a9b35-a142-428a-8b14-c976fa9246fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:48.467881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ca0a9b35-a142-428a-8b14-c976fa9246fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:48.475998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca0a9b35-a142-428a-8b14-c976fa9246fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:48.476784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca0a9b35-a142-428a-8b14-c976fa9246fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:48.477471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca0a9b35-a142-428a-8b14-c976fa9246fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:48.478393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca0a9b35-a142-428a-8b14-c976fa9246fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:48.479045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca0a9b35-a142-428a-8b14-c976fa9246fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:48.479669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ca0a9b35-a142-428a-8b14-c976fa9246fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:48.562935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ca0a9b35-a142-428a-8b14-c976fa9246fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:48.571249 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ca0a9b35-a142-428a-8b14-c976fa9246fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1302 microversion: 2.1 time: 0.108474 Oct 29 01:47:48.572097 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3517/7249] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:48 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1302 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:49.595885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e572a76b-9d31-4bdc-b29f-c3c3b4ca3a10 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:49.597587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e572a76b-9d31-4bdc-b29f-c3c3b4ca3a10 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:49.610364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e572a76b-9d31-4bdc-b29f-c3c3b4ca3a10 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:49.610848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e572a76b-9d31-4bdc-b29f-c3c3b4ca3a10 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:49.615348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e572a76b-9d31-4bdc-b29f-c3c3b4ca3a10 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:49.616610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e572a76b-9d31-4bdc-b29f-c3c3b4ca3a10 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:49.617274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e572a76b-9d31-4bdc-b29f-c3c3b4ca3a10 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:49.620850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e572a76b-9d31-4bdc-b29f-c3c3b4ca3a10 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:49.812120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e572a76b-9d31-4bdc-b29f-c3c3b4ca3a10 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:49.826259 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e572a76b-9d31-4bdc-b29f-c3c3b4ca3a10 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1370 microversion: 2.1 time: 0.233641 Oct 29 01:47:49.828697 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3733/7250] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:49 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1370 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:49.867890 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-3b425345-94e8-4a94-9a44-f2cc7f5352a4 req-b6be1464-f1b0-43ff-a0cd-b1b06f0b8038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22acca4a-6973-408b-95e3-f159dd6afc2c", "tag": "f0268529-ea8b-4a3d-a9df-1fab1e33d488"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:49.900410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3b425345-94e8-4a94-9a44-f2cc7f5352a4 req-b6be1464-f1b0-43ff-a0cd-b1b06f0b8038 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:49.903769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3b425345-94e8-4a94-9a44-f2cc7f5352a4 req-b6be1464-f1b0-43ff-a0cd-b1b06f0b8038 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:49.903769 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-3b425345-94e8-4a94-9a44-f2cc7f5352a4 req-b6be1464-f1b0-43ff-a0cd-b1b06f0b8038 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:49.948289 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-3b425345-94e8-4a94-9a44-f2cc7f5352a4 req-b6be1464-f1b0-43ff-a0cd-b1b06f0b8038 service nova] Creating event network-changed:f0268529-ea8b-4a3d-a9df-1fab1e33d488 for instance 22acca4a-6973-408b-95e3-f159dd6afc2c on n-h2-862964-3 Oct 29 01:47:49.955472 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-3b425345-94e8-4a94-9a44-f2cc7f5352a4 req-b6be1464-f1b0-43ff-a0cd-b1b06f0b8038 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091015 Oct 29 01:47:49.956990 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3518/7251] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:47:50.854967 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9fd8a9ee-b82b-46c5-8bcd-179bb63fb359 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:50.855598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9fd8a9ee-b82b-46c5-8bcd-179bb63fb359 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:50.863210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd8a9ee-b82b-46c5-8bcd-179bb63fb359 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:50.863693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd8a9ee-b82b-46c5-8bcd-179bb63fb359 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:50.864131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd8a9ee-b82b-46c5-8bcd-179bb63fb359 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:50.864821 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd8a9ee-b82b-46c5-8bcd-179bb63fb359 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:50.865299 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd8a9ee-b82b-46c5-8bcd-179bb63fb359 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:50.865729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9fd8a9ee-b82b-46c5-8bcd-179bb63fb359 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:51.017235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9fd8a9ee-b82b-46c5-8bcd-179bb63fb359 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:51.027478 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9fd8a9ee-b82b-46c5-8bcd-179bb63fb359 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1370 microversion: 2.1 time: 0.176461 Oct 29 01:47:51.028636 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3734/7252] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:50 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:52.053386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-76f750f1-dbaa-44be-8842-9a4435247a7f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:52.054029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-76f750f1-dbaa-44be-8842-9a4435247a7f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:52.060367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76f750f1-dbaa-44be-8842-9a4435247a7f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:52.061129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76f750f1-dbaa-44be-8842-9a4435247a7f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:52.061626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76f750f1-dbaa-44be-8842-9a4435247a7f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:52.062354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76f750f1-dbaa-44be-8842-9a4435247a7f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:52.062832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76f750f1-dbaa-44be-8842-9a4435247a7f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:52.063275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-76f750f1-dbaa-44be-8842-9a4435247a7f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:52.208580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-76f750f1-dbaa-44be-8842-9a4435247a7f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:52.216819 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-76f750f1-dbaa-44be-8842-9a4435247a7f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1370 microversion: 2.1 time: 0.169448 Oct 29 01:47:52.217435 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3519/7253] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:52 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:53.240973 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-53b419e9-c18f-4c10-b755-4bfeca4b0d28 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:53.241907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-53b419e9-c18f-4c10-b755-4bfeca4b0d28 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:53.250080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53b419e9-c18f-4c10-b755-4bfeca4b0d28 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:53.251090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53b419e9-c18f-4c10-b755-4bfeca4b0d28 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:53.251750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53b419e9-c18f-4c10-b755-4bfeca4b0d28 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:53.252758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53b419e9-c18f-4c10-b755-4bfeca4b0d28 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:53.253631 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53b419e9-c18f-4c10-b755-4bfeca4b0d28 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:53.254301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-53b419e9-c18f-4c10-b755-4bfeca4b0d28 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:53.436500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-53b419e9-c18f-4c10-b755-4bfeca4b0d28 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:53.445708 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-53b419e9-c18f-4c10-b755-4bfeca4b0d28 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1370 microversion: 2.1 time: 0.209718 Oct 29 01:47:53.446296 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3735/7254] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:53 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1370 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:54.219777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d9c97c06-cbc5-40e3-b1cb-35ffd329fd46 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:54.220294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d9c97c06-cbc5-40e3-b1cb-35ffd329fd46 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:54.227788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9c97c06-cbc5-40e3-b1cb-35ffd329fd46 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:54.228526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9c97c06-cbc5-40e3-b1cb-35ffd329fd46 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:54.228981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9c97c06-cbc5-40e3-b1cb-35ffd329fd46 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:54.229741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9c97c06-cbc5-40e3-b1cb-35ffd329fd46 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:54.230214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9c97c06-cbc5-40e3-b1cb-35ffd329fd46 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:54.230652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9c97c06-cbc5-40e3-b1cb-35ffd329fd46 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:54.261964 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d9c97c06-cbc5-40e3-b1cb-35ffd329fd46 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.046237 Oct 29 01:47:54.269094 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3520/7255] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Oct 29 01:47:54 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b/os-server-password => generated 116 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:47:54.470012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-72831be0-7a39-4f46-8175-2b6cba781993 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:54.470657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-72831be0-7a39-4f46-8175-2b6cba781993 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:54.479073 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72831be0-7a39-4f46-8175-2b6cba781993 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:54.479919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72831be0-7a39-4f46-8175-2b6cba781993 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:54.480425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72831be0-7a39-4f46-8175-2b6cba781993 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:54.481131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72831be0-7a39-4f46-8175-2b6cba781993 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:54.481811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72831be0-7a39-4f46-8175-2b6cba781993 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:54.482824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-72831be0-7a39-4f46-8175-2b6cba781993 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:54.646894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-72831be0-7a39-4f46-8175-2b6cba781993 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:54.655123 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-72831be0-7a39-4f46-8175-2b6cba781993 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1370 microversion: 2.1 time: 0.188894 Oct 29 01:47:54.655914 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3736/7256] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:54 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:55.678581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bb808407-5d3c-4201-9120-005825f683be tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:55.679844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bb808407-5d3c-4201-9120-005825f683be tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:55.685623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:47:55.689466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb808407-5d3c-4201-9120-005825f683be tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:55.690864 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb808407-5d3c-4201-9120-005825f683be tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:55.691670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb808407-5d3c-4201-9120-005825f683be tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:55.692621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb808407-5d3c-4201-9120-005825f683be tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:55.693317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb808407-5d3c-4201-9120-005825f683be tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:55.693944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bb808407-5d3c-4201-9120-005825f683be tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:55.872728 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bb808407-5d3c-4201-9120-005825f683be tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:55.891763 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bb808407-5d3c-4201-9120-005825f683be tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1370 microversion: 2.1 time: 0.217186 Oct 29 01:47:55.897300 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3521/7257] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:55 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1370 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:56.916921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-45dc264b-2547-40e9-976f-3bdd06af4f47 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:56.918674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-45dc264b-2547-40e9-976f-3bdd06af4f47 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:56.932304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:47:56.934469 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=14 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:47:56.935444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:47:56.937437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45dc264b-2547-40e9-976f-3bdd06af4f47 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:56.938234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45dc264b-2547-40e9-976f-3bdd06af4f47 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:56.939090 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45dc264b-2547-40e9-976f-3bdd06af4f47 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:56.939941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45dc264b-2547-40e9-976f-3bdd06af4f47 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:56.941331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45dc264b-2547-40e9-976f-3bdd06af4f47 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:56.942009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-45dc264b-2547-40e9-976f-3bdd06af4f47 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:57.091194 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-45dc264b-2547-40e9-976f-3bdd06af4f47 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:57.101558 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-45dc264b-2547-40e9-976f-3bdd06af4f47 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1370 microversion: 2.1 time: 0.189543 Oct 29 01:47:57.102619 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3737/7258] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:56 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:57.772413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-fc69fefd-752e-4f22-92e9-1a4cb8b3d0d8 req-9f33555e-e120-40d3-a654-ad828b6ac1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22acca4a-6973-408b-95e3-f159dd6afc2c", "name": "network-vif-plugged", "status": "completed", "tag": "f0268529-ea8b-4a3d-a9df-1fab1e33d488"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:47:57.784965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:47:57.784965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-fc69fefd-752e-4f22-92e9-1a4cb8b3d0d8 req-9f33555e-e120-40d3-a654-ad828b6ac1fd service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:57.785330 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-fc69fefd-752e-4f22-92e9-1a4cb8b3d0d8 req-9f33555e-e120-40d3-a654-ad828b6ac1fd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:57.785622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-fc69fefd-752e-4f22-92e9-1a4cb8b3d0d8 req-9f33555e-e120-40d3-a654-ad828b6ac1fd service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:57.797945 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-fc69fefd-752e-4f22-92e9-1a4cb8b3d0d8 req-9f33555e-e120-40d3-a654-ad828b6ac1fd service nova] Creating event network-vif-plugged:f0268529-ea8b-4a3d-a9df-1fab1e33d488 for instance 22acca4a-6973-408b-95e3-f159dd6afc2c on n-h2-862964-3 Oct 29 01:47:57.804110 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-fc69fefd-752e-4f22-92e9-1a4cb8b3d0d8 req-9f33555e-e120-40d3-a654-ad828b6ac1fd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036150 Oct 29 01:47:57.811138 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3522/7259] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:47:58.127160 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f981e42a-3f0d-4b57-b2ab-96d47565f67f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:58.128065 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f981e42a-3f0d-4b57-b2ab-96d47565f67f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:58.135965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f981e42a-3f0d-4b57-b2ab-96d47565f67f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:58.136539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f981e42a-3f0d-4b57-b2ab-96d47565f67f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:58.137054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f981e42a-3f0d-4b57-b2ab-96d47565f67f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:58.137861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f981e42a-3f0d-4b57-b2ab-96d47565f67f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:58.138411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f981e42a-3f0d-4b57-b2ab-96d47565f67f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:58.138915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f981e42a-3f0d-4b57-b2ab-96d47565f67f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:58.297609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f981e42a-3f0d-4b57-b2ab-96d47565f67f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:58.309973 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f981e42a-3f0d-4b57-b2ab-96d47565f67f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1370 microversion: 2.1 time: 0.187954 Oct 29 01:47:58.311433 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3738/7260] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:58 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:47:59.342361 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c4beb762-f294-4f9b-a42e-959b83a286fd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:47:59.343075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c4beb762-f294-4f9b-a42e-959b83a286fd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:47:59.353108 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4beb762-f294-4f9b-a42e-959b83a286fd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:59.353632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4beb762-f294-4f9b-a42e-959b83a286fd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:59.354087 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4beb762-f294-4f9b-a42e-959b83a286fd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:59.354802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4beb762-f294-4f9b-a42e-959b83a286fd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:47:59.355270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4beb762-f294-4f9b-a42e-959b83a286fd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:47:59.355720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4beb762-f294-4f9b-a42e-959b83a286fd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:47:59.521139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c4beb762-f294-4f9b-a42e-959b83a286fd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:47:59.535144 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c4beb762-f294-4f9b-a42e-959b83a286fd tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1370 microversion: 2.1 time: 0.198022 Oct 29 01:47:59.550559 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3523/7261] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:47:59 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:00.559735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ea895fd5-6537-4ea9-a375-dbb427beb759 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:00.560357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ea895fd5-6537-4ea9-a375-dbb427beb759 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:00.567873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea895fd5-6537-4ea9-a375-dbb427beb759 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:00.568703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea895fd5-6537-4ea9-a375-dbb427beb759 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:00.569601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea895fd5-6537-4ea9-a375-dbb427beb759 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:00.570309 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea895fd5-6537-4ea9-a375-dbb427beb759 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:00.570766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea895fd5-6537-4ea9-a375-dbb427beb759 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:00.571191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ea895fd5-6537-4ea9-a375-dbb427beb759 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:00.714644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ea895fd5-6537-4ea9-a375-dbb427beb759 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:00.723113 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ea895fd5-6537-4ea9-a375-dbb427beb759 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1565 microversion: 2.1 time: 0.167209 Oct 29 01:48:00.724099 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3739/7262] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:00 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:00.746655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e1f59530-24c6-4066-8e11-75405df437d4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:00.747339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e1f59530-24c6-4066-8e11-75405df437d4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:00.755449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1f59530-24c6-4066-8e11-75405df437d4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:00.756271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1f59530-24c6-4066-8e11-75405df437d4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:00.756968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1f59530-24c6-4066-8e11-75405df437d4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:00.757944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1f59530-24c6-4066-8e11-75405df437d4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:00.758647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1f59530-24c6-4066-8e11-75405df437d4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:00.759345 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e1f59530-24c6-4066-8e11-75405df437d4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:00.847624 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e1f59530-24c6-4066-8e11-75405df437d4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104873 Oct 29 01:48:00.849194 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3524/7263] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:48:00 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:48:02.818093 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-88eeae4e-dcb8-43ff-bb2d-921c78140c1b req-475e8332-0f2b-4475-a540-a05c910bbfeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22acca4a-6973-408b-95e3-f159dd6afc2c", "tag": "f0268529-ea8b-4a3d-a9df-1fab1e33d488"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:48:02.830843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-88eeae4e-dcb8-43ff-bb2d-921c78140c1b req-475e8332-0f2b-4475-a540-a05c910bbfeb service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:02.833446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-88eeae4e-dcb8-43ff-bb2d-921c78140c1b req-475e8332-0f2b-4475-a540-a05c910bbfeb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:02.834158 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-88eeae4e-dcb8-43ff-bb2d-921c78140c1b req-475e8332-0f2b-4475-a540-a05c910bbfeb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:02.849882 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-88eeae4e-dcb8-43ff-bb2d-921c78140c1b req-475e8332-0f2b-4475-a540-a05c910bbfeb service nova] Creating event network-changed:f0268529-ea8b-4a3d-a9df-1fab1e33d488 for instance 22acca4a-6973-408b-95e3-f159dd6afc2c on n-h2-862964-3 Oct 29 01:48:02.858240 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-88eeae4e-dcb8-43ff-bb2d-921c78140c1b req-475e8332-0f2b-4475-a540-a05c910bbfeb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044167 Oct 29 01:48:02.859481 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3740/7264] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:48:18.347121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=5 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:48:18.348126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=53 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:48:18.351934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-efe3b0b2-a930-4062-80a4-cb66c2de6480 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2129551471", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-161758843", "security_groups": [{"name": "tempest-secgroup-smoke-707530340"}], "block_device_mapping_v2": [{"uuid": "17d4820e-fd2f-45f5-a2f4-832db1f1cfe0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d488ed61-ddc0-4d3b-9833-017b49869cf3"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:48:18.471154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-efe3b0b2-a930-4062-80a4-cb66c2de6480 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] validate_networks() for [('d488ed61-ddc0-4d3b-9833-017b49869cf3', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:48:18.949063 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-efe3b0b2-a930-4062-80a4-cb66c2de6480 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:48:18.951026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-efe3b0b2-a930-4062-80a4-cb66c2de6480 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:48:18.951630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-efe3b0b2-a930-4062-80a4-cb66c2de6480 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:48:18.952126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-efe3b0b2-a930-4062-80a4-cb66c2de6480 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:48:18.952844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-efe3b0b2-a930-4062-80a4-cb66c2de6480 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:48:18.967600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-efe3b0b2-a930-4062-80a4-cb66c2de6480 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:18.968121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-efe3b0b2-a930-4062-80a4-cb66c2de6480 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:18.968750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-efe3b0b2-a930-4062-80a4-cb66c2de6480 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:18.969551 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-efe3b0b2-a930-4062-80a4-cb66c2de6480 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:18.970024 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-efe3b0b2-a930-4062-80a4-cb66c2de6480 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:18.970596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-efe3b0b2-a930-4062-80a4-cb66c2de6480 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:18.989749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-efe3b0b2-a930-4062-80a4-cb66c2de6480 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Getting quotas for project 37416a9397fa4c6dbd0bfe8dee191577. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:48:18.996130 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-efe3b0b2-a930-4062-80a4-cb66c2de6480 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Getting quotas for user 8b8f36d10fa340f784581a3cf9a15606 and project 37416a9397fa4c6dbd0bfe8dee191577. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:48:19.053937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-efe3b0b2-a930-4062-80a4-cb66c2de6480 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:48:19.057284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-efe3b0b2-a930-4062-80a4-cb66c2de6480 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='17d4820e-fd2f-45f5-a2f4-832db1f1cfe0',volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:48:19.495591 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-efe3b0b2-a930-4062-80a4-cb66c2de6480 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.150599 Oct 29 01:48:19.496967 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3525/7265] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:48:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:48:19.506825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=7 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:48:19.507641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=81 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:48:19.518644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-39a33708-ef05-47cb-9934-f214943b5ea7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:19.519440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-39a33708-ef05-47cb-9934-f214943b5ea7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:19.580231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-39a33708-ef05-47cb-9934-f214943b5ea7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:19.587833 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-39a33708-ef05-47cb-9934-f214943b5ea7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1094 microversion: 2.1 time: 0.082829 Oct 29 01:48:19.588426 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3741/7266] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:19 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:48:20.612159 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7c524717-228b-4126-befb-02473afa7977 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:20.612962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7c524717-228b-4126-befb-02473afa7977 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:20.621478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c524717-228b-4126-befb-02473afa7977 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:20.621975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c524717-228b-4126-befb-02473afa7977 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:20.622424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c524717-228b-4126-befb-02473afa7977 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:20.623171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c524717-228b-4126-befb-02473afa7977 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:20.623640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c524717-228b-4126-befb-02473afa7977 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:20.624078 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7c524717-228b-4126-befb-02473afa7977 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:20.704208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7c524717-228b-4126-befb-02473afa7977 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:20.713419 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7c524717-228b-4126-befb-02473afa7977 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1144 microversion: 2.1 time: 0.105199 Oct 29 01:48:20.714015 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3526/7267] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:20 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1144 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:48:21.738347 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-50c8c2c9-eb0e-44c0-b038-2c9146e7a055 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:21.740022 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-50c8c2c9-eb0e-44c0-b038-2c9146e7a055 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:21.752167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50c8c2c9-eb0e-44c0-b038-2c9146e7a055 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:21.752902 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50c8c2c9-eb0e-44c0-b038-2c9146e7a055 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:21.753382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50c8c2c9-eb0e-44c0-b038-2c9146e7a055 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:21.757760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50c8c2c9-eb0e-44c0-b038-2c9146e7a055 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:21.757760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50c8c2c9-eb0e-44c0-b038-2c9146e7a055 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:21.757760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-50c8c2c9-eb0e-44c0-b038-2c9146e7a055 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:21.844245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-50c8c2c9-eb0e-44c0-b038-2c9146e7a055 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:21.853020 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-50c8c2c9-eb0e-44c0-b038-2c9146e7a055 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1200 microversion: 2.1 time: 0.119196 Oct 29 01:48:21.853683 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3742/7268] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:21 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1200 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:22.878280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9b46175d-1aaa-4caa-adc2-37f51a9db5c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:22.878836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9b46175d-1aaa-4caa-adc2-37f51a9db5c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:22.888178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b46175d-1aaa-4caa-adc2-37f51a9db5c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:22.889015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b46175d-1aaa-4caa-adc2-37f51a9db5c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:22.889666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b46175d-1aaa-4caa-adc2-37f51a9db5c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:22.890844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b46175d-1aaa-4caa-adc2-37f51a9db5c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:22.891310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b46175d-1aaa-4caa-adc2-37f51a9db5c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:22.892225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9b46175d-1aaa-4caa-adc2-37f51a9db5c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:23.162098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9b46175d-1aaa-4caa-adc2-37f51a9db5c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:23.170738 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9b46175d-1aaa-4caa-adc2-37f51a9db5c4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1277 microversion: 2.1 time: 0.296381 Oct 29 01:48:23.171344 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3527/7269] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:22 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1277 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:23.747891 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-694c7694-da78-466a-a9b0-45cb1cb5c245 req-3db33e2c-4862-4724-a6cf-3c7f6d33b199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ce139ca-0135-40eb-9654-26157715fc1a", "tag": "15bc45ae-29c8-43ba-b356-ec2e6195d44f"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:48:23.760698 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-694c7694-da78-466a-a9b0-45cb1cb5c245 req-3db33e2c-4862-4724-a6cf-3c7f6d33b199 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:23.761289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-694c7694-da78-466a-a9b0-45cb1cb5c245 req-3db33e2c-4862-4724-a6cf-3c7f6d33b199 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:23.761978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-694c7694-da78-466a-a9b0-45cb1cb5c245 req-3db33e2c-4862-4724-a6cf-3c7f6d33b199 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:23.776462 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-694c7694-da78-466a-a9b0-45cb1cb5c245 req-3db33e2c-4862-4724-a6cf-3c7f6d33b199 service nova] Creating event network-changed:15bc45ae-29c8-43ba-b356-ec2e6195d44f for instance 1ce139ca-0135-40eb-9654-26157715fc1a on n-h1-862964-3 Oct 29 01:48:23.784384 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-694c7694-da78-466a-a9b0-45cb1cb5c245 req-3db33e2c-4862-4724-a6cf-3c7f6d33b199 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040888 Oct 29 01:48:23.785716 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3743/7270] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:48:24.197746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a00d11e7-6ab6-4618-85de-abea357cc672 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:24.199270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a00d11e7-6ab6-4618-85de-abea357cc672 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:24.206646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a00d11e7-6ab6-4618-85de-abea357cc672 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:24.207404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a00d11e7-6ab6-4618-85de-abea357cc672 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:24.208036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a00d11e7-6ab6-4618-85de-abea357cc672 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:24.208949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a00d11e7-6ab6-4618-85de-abea357cc672 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:24.209626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a00d11e7-6ab6-4618-85de-abea357cc672 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:24.210254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a00d11e7-6ab6-4618-85de-abea357cc672 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:24.466333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a00d11e7-6ab6-4618-85de-abea357cc672 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:24.477744 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a00d11e7-6ab6-4618-85de-abea357cc672 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1277 microversion: 2.1 time: 0.284120 Oct 29 01:48:24.479241 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3528/7271] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:24 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1277 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:25.502417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4a625a4c-123f-4fba-bcbb-04d12bd233e7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:25.503117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4a625a4c-123f-4fba-bcbb-04d12bd233e7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:25.511177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a625a4c-123f-4fba-bcbb-04d12bd233e7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:25.511677 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a625a4c-123f-4fba-bcbb-04d12bd233e7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:25.512114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a625a4c-123f-4fba-bcbb-04d12bd233e7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:25.512818 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a625a4c-123f-4fba-bcbb-04d12bd233e7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:25.513305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a625a4c-123f-4fba-bcbb-04d12bd233e7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:25.514013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4a625a4c-123f-4fba-bcbb-04d12bd233e7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:25.667582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4a625a4c-123f-4fba-bcbb-04d12bd233e7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:25.677359 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4a625a4c-123f-4fba-bcbb-04d12bd233e7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1277 microversion: 2.1 time: 0.179080 Oct 29 01:48:25.678215 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3744/7272] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:25 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:26.702957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-77b8b1e6-f007-4c86-900e-a901007fabc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:26.703582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-77b8b1e6-f007-4c86-900e-a901007fabc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:26.711427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77b8b1e6-f007-4c86-900e-a901007fabc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:26.712326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77b8b1e6-f007-4c86-900e-a901007fabc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:26.713105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77b8b1e6-f007-4c86-900e-a901007fabc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:26.714052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77b8b1e6-f007-4c86-900e-a901007fabc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:26.714531 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77b8b1e6-f007-4c86-900e-a901007fabc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:26.715197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-77b8b1e6-f007-4c86-900e-a901007fabc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:26.871721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-77b8b1e6-f007-4c86-900e-a901007fabc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:26.879641 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-77b8b1e6-f007-4c86-900e-a901007fabc2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1277 microversion: 2.1 time: 0.180890 Oct 29 01:48:26.884010 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3529/7273] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:26 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:27.906009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-49e97795-d1c5-40b8-b4be-0e04dab6621f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:27.906867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-49e97795-d1c5-40b8-b4be-0e04dab6621f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:27.918242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49e97795-d1c5-40b8-b4be-0e04dab6621f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:27.918732 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49e97795-d1c5-40b8-b4be-0e04dab6621f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:27.919432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49e97795-d1c5-40b8-b4be-0e04dab6621f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:27.920444 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49e97795-d1c5-40b8-b4be-0e04dab6621f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:27.921203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49e97795-d1c5-40b8-b4be-0e04dab6621f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:27.921768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-49e97795-d1c5-40b8-b4be-0e04dab6621f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:28.100185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-49e97795-d1c5-40b8-b4be-0e04dab6621f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:28.110278 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-49e97795-d1c5-40b8-b4be-0e04dab6621f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1277 microversion: 2.1 time: 0.208200 Oct 29 01:48:28.125221 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3745/7274] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:27 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1277 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:29.135105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5e00d30b-9cbc-4464-b3f3-c4fbe3013827 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:29.135748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5e00d30b-9cbc-4464-b3f3-c4fbe3013827 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:29.138489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:48:29.139211 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:48:29.144160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e00d30b-9cbc-4464-b3f3-c4fbe3013827 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:29.150881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e00d30b-9cbc-4464-b3f3-c4fbe3013827 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:29.150881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e00d30b-9cbc-4464-b3f3-c4fbe3013827 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:29.150881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e00d30b-9cbc-4464-b3f3-c4fbe3013827 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:29.150881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e00d30b-9cbc-4464-b3f3-c4fbe3013827 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:29.150881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5e00d30b-9cbc-4464-b3f3-c4fbe3013827 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:29.288389 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5e00d30b-9cbc-4464-b3f3-c4fbe3013827 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:29.296921 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5e00d30b-9cbc-4464-b3f3-c4fbe3013827 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1265 microversion: 2.1 time: 0.166092 Oct 29 01:48:29.298093 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3530/7275] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:29 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:30.322925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2e483a9e-27d7-4da6-8d24-d9cf33bfb2c3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:30.323817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2e483a9e-27d7-4da6-8d24-d9cf33bfb2c3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:30.328847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:48:30.332445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e483a9e-27d7-4da6-8d24-d9cf33bfb2c3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:30.332941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e483a9e-27d7-4da6-8d24-d9cf33bfb2c3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:30.333409 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e483a9e-27d7-4da6-8d24-d9cf33bfb2c3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:30.334117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e483a9e-27d7-4da6-8d24-d9cf33bfb2c3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:30.334608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e483a9e-27d7-4da6-8d24-d9cf33bfb2c3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:30.335035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e483a9e-27d7-4da6-8d24-d9cf33bfb2c3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:30.485919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2e483a9e-27d7-4da6-8d24-d9cf33bfb2c3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:30.494599 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2e483a9e-27d7-4da6-8d24-d9cf33bfb2c3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1265 microversion: 2.1 time: 0.177173 Oct 29 01:48:30.495266 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3746/7276] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:30 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:31.518123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d376eeb1-857d-4ff9-8576-d2de57ac98bc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:31.518831 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d376eeb1-857d-4ff9-8576-d2de57ac98bc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:31.527106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d376eeb1-857d-4ff9-8576-d2de57ac98bc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:31.527609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d376eeb1-857d-4ff9-8576-d2de57ac98bc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:31.528061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d376eeb1-857d-4ff9-8576-d2de57ac98bc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:31.528779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d376eeb1-857d-4ff9-8576-d2de57ac98bc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:31.529276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d376eeb1-857d-4ff9-8576-d2de57ac98bc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:31.529719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d376eeb1-857d-4ff9-8576-d2de57ac98bc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:31.670836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d376eeb1-857d-4ff9-8576-d2de57ac98bc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:31.679633 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d376eeb1-857d-4ff9-8576-d2de57ac98bc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1265 microversion: 2.1 time: 0.165551 Oct 29 01:48:31.680773 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3531/7277] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:31 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:48:32.703911 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ac7dab21-5881-43c5-b8ec-ed2755b9670a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:32.704460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ac7dab21-5881-43c5-b8ec-ed2755b9670a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:32.712031 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac7dab21-5881-43c5-b8ec-ed2755b9670a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:32.715172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac7dab21-5881-43c5-b8ec-ed2755b9670a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:32.715172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac7dab21-5881-43c5-b8ec-ed2755b9670a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:32.715172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac7dab21-5881-43c5-b8ec-ed2755b9670a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:32.715172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac7dab21-5881-43c5-b8ec-ed2755b9670a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:32.715172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ac7dab21-5881-43c5-b8ec-ed2755b9670a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:32.857854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ac7dab21-5881-43c5-b8ec-ed2755b9670a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:32.866455 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ac7dab21-5881-43c5-b8ec-ed2755b9670a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1265 microversion: 2.1 time: 0.166515 Oct 29 01:48:32.867146 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3747/7278] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:32 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:33.891138 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ee47c5f0-76b1-45dc-9dda-bae49aa35ce0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:33.891762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ee47c5f0-76b1-45dc-9dda-bae49aa35ce0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:33.900455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee47c5f0-76b1-45dc-9dda-bae49aa35ce0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:33.900977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee47c5f0-76b1-45dc-9dda-bae49aa35ce0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:33.901655 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee47c5f0-76b1-45dc-9dda-bae49aa35ce0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:33.902466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee47c5f0-76b1-45dc-9dda-bae49aa35ce0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:33.902939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee47c5f0-76b1-45dc-9dda-bae49aa35ce0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:33.903384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee47c5f0-76b1-45dc-9dda-bae49aa35ce0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:34.052617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ee47c5f0-76b1-45dc-9dda-bae49aa35ce0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:34.061147 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ee47c5f0-76b1-45dc-9dda-bae49aa35ce0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1265 microversion: 2.1 time: 0.173903 Oct 29 01:48:34.061768 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3532/7279] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:33 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:35.084436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3baedf83-4717-4040-89d1-829a96ac14a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:35.085193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3baedf83-4717-4040-89d1-829a96ac14a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:35.093121 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3baedf83-4717-4040-89d1-829a96ac14a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:35.093726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3baedf83-4717-4040-89d1-829a96ac14a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:35.094248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3baedf83-4717-4040-89d1-829a96ac14a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:35.094968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3baedf83-4717-4040-89d1-829a96ac14a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:35.095432 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3baedf83-4717-4040-89d1-829a96ac14a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:35.095919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3baedf83-4717-4040-89d1-829a96ac14a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:35.232960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3baedf83-4717-4040-89d1-829a96ac14a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:35.241020 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3baedf83-4717-4040-89d1-829a96ac14a5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1265 microversion: 2.1 time: 0.160502 Oct 29 01:48:35.241574 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3748/7280] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:35 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:35.511045 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d8c9f9c-1d9b-426b-a122-d8ded48b4b69 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:48:35.513503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7d8c9f9c-1d9b-426b-a122-d8ded48b4b69 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:35.520133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d8c9f9c-1d9b-426b-a122-d8ded48b4b69 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:35.520630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d8c9f9c-1d9b-426b-a122-d8ded48b4b69 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:35.521079 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d8c9f9c-1d9b-426b-a122-d8ded48b4b69 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:35.521824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d8c9f9c-1d9b-426b-a122-d8ded48b4b69 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:35.522294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d8c9f9c-1d9b-426b-a122-d8ded48b4b69 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:35.522732 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d8c9f9c-1d9b-426b-a122-d8ded48b4b69 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:35.644103 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7d8c9f9c-1d9b-426b-a122-d8ded48b4b69 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "POST /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672/action" status: 200 len: 40144 microversion: 2.1 time: 0.339148 Oct 29 01:48:35.644866 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3533/7281] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:48:35 2022] POST /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672/action => generated 40144 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:48:36.264798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-80dd68a4-54bd-43a5-acc7-4a9efeb3aa50 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:36.265483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-80dd68a4-54bd-43a5-acc7-4a9efeb3aa50 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:36.273069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80dd68a4-54bd-43a5-acc7-4a9efeb3aa50 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:36.273877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80dd68a4-54bd-43a5-acc7-4a9efeb3aa50 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:36.278864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80dd68a4-54bd-43a5-acc7-4a9efeb3aa50 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:36.278864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80dd68a4-54bd-43a5-acc7-4a9efeb3aa50 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:36.278864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80dd68a4-54bd-43a5-acc7-4a9efeb3aa50 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:36.278864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-80dd68a4-54bd-43a5-acc7-4a9efeb3aa50 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:36.830176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-80dd68a4-54bd-43a5-acc7-4a9efeb3aa50 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:36.838271 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-80dd68a4-54bd-43a5-acc7-4a9efeb3aa50 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1265 microversion: 2.1 time: 0.577194 Oct 29 01:48:36.838862 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3749/7282] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:36 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1265 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:37.098652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0e3177bc-65b6-4252-9372-899aa19234ad tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:37.103258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0e3177bc-65b6-4252-9372-899aa19234ad tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:37.103418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-82e5aeec-0518-4701-9c81-347a4d8cd73e req-784eadfb-04e2-4dc6-8c69-20dd1d944f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9fdb471-31f0-4205-b0ce-a0296c7ca672", "tag": "d75377b7-049b-4dfd-80a5-5b02950d2cf5"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:48:37.108071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e3177bc-65b6-4252-9372-899aa19234ad tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:37.108569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e3177bc-65b6-4252-9372-899aa19234ad tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:37.109070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e3177bc-65b6-4252-9372-899aa19234ad tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:37.109822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e3177bc-65b6-4252-9372-899aa19234ad tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:37.110281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e3177bc-65b6-4252-9372-899aa19234ad tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:37.110718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0e3177bc-65b6-4252-9372-899aa19234ad tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:37.112369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-82e5aeec-0518-4701-9c81-347a4d8cd73e req-784eadfb-04e2-4dc6-8c69-20dd1d944f38 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:37.112957 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-82e5aeec-0518-4701-9c81-347a4d8cd73e req-784eadfb-04e2-4dc6-8c69-20dd1d944f38 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:37.113527 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-82e5aeec-0518-4701-9c81-347a4d8cd73e req-784eadfb-04e2-4dc6-8c69-20dd1d944f38 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:37.127364 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-82e5aeec-0518-4701-9c81-347a4d8cd73e req-784eadfb-04e2-4dc6-8c69-20dd1d944f38 service nova] Creating event network-changed:d75377b7-049b-4dfd-80a5-5b02950d2cf5 for instance a9fdb471-31f0-4205-b0ce-a0296c7ca672 on n-h1-862964-3 Oct 29 01:48:37.133581 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-82e5aeec-0518-4701-9c81-347a4d8cd73e req-784eadfb-04e2-4dc6-8c69-20dd1d944f38 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036949 Oct 29 01:48:37.135160 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3750/7283] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:48:37.139439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0e3177bc-65b6-4252-9372-899aa19234ad tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:48:37.510602 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0e3177bc-65b6-4252-9372-899aa19234ad tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 204 len: 0 microversion: 2.1 time: 0.416229 Oct 29 01:48:37.511233 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3534/7284] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:48:37 2022] DELETE /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:48:37.523641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f6d1b96b-d058-4a55-9849-11c47ec1c6d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:37.524599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f6d1b96b-d058-4a55-9849-11c47ec1c6d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:37.532804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6d1b96b-d058-4a55-9849-11c47ec1c6d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:37.533373 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6d1b96b-d058-4a55-9849-11c47ec1c6d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:37.534001 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6d1b96b-d058-4a55-9849-11c47ec1c6d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:37.534772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6d1b96b-d058-4a55-9849-11c47ec1c6d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:37.535301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6d1b96b-d058-4a55-9849-11c47ec1c6d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:37.535713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6d1b96b-d058-4a55-9849-11c47ec1c6d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:37.686980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f6d1b96b-d058-4a55-9849-11c47ec1c6d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:37.695013 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f6d1b96b-d058-4a55-9849-11c47ec1c6d9 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1690 microversion: 2.1 time: 0.176292 Oct 29 01:48:37.695866 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3751/7285] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:37 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:37.863374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f363fd39-e6f3-42bb-bee6-470628752e6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:37.864533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f363fd39-e6f3-42bb-bee6-470628752e6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:37.872366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f363fd39-e6f3-42bb-bee6-470628752e6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:37.872894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f363fd39-e6f3-42bb-bee6-470628752e6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:37.873385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f363fd39-e6f3-42bb-bee6-470628752e6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:37.874126 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f363fd39-e6f3-42bb-bee6-470628752e6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:37.874637 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f363fd39-e6f3-42bb-bee6-470628752e6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:37.875103 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f363fd39-e6f3-42bb-bee6-470628752e6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:38.020610 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f363fd39-e6f3-42bb-bee6-470628752e6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:38.031433 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f363fd39-e6f3-42bb-bee6-470628752e6d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1265 microversion: 2.1 time: 0.172623 Oct 29 01:48:38.045182 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3535/7286] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:37 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:38.720491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9458c731-9fd2-46b7-8f71-2b09b25c0540 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:38.721103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9458c731-9fd2-46b7-8f71-2b09b25c0540 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:38.730041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9458c731-9fd2-46b7-8f71-2b09b25c0540 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:38.730857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9458c731-9fd2-46b7-8f71-2b09b25c0540 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:38.731417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9458c731-9fd2-46b7-8f71-2b09b25c0540 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:38.732133 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9458c731-9fd2-46b7-8f71-2b09b25c0540 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:38.732741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9458c731-9fd2-46b7-8f71-2b09b25c0540 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:38.733191 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9458c731-9fd2-46b7-8f71-2b09b25c0540 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:38.873338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9458c731-9fd2-46b7-8f71-2b09b25c0540 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:38.881809 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9458c731-9fd2-46b7-8f71-2b09b25c0540 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1690 microversion: 2.1 time: 0.165233 Oct 29 01:48:38.882467 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3752/7287] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:38 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:39.055160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-99b824e6-c851-4682-a4c5-089ca16e2e74 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:39.055846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-99b824e6-c851-4682-a4c5-089ca16e2e74 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:39.063582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99b824e6-c851-4682-a4c5-089ca16e2e74 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:39.064089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99b824e6-c851-4682-a4c5-089ca16e2e74 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:39.064593 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99b824e6-c851-4682-a4c5-089ca16e2e74 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:39.065264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99b824e6-c851-4682-a4c5-089ca16e2e74 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:39.071281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99b824e6-c851-4682-a4c5-089ca16e2e74 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:39.071281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99b824e6-c851-4682-a4c5-089ca16e2e74 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:39.300836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-99b824e6-c851-4682-a4c5-089ca16e2e74 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:39.309527 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-99b824e6-c851-4682-a4c5-089ca16e2e74 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1265 microversion: 2.1 time: 0.258278 Oct 29 01:48:39.310116 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3536/7288] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:39 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:39.666910 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-df0fa839-6a8b-4545-b35a-83855df6ff66 req-25a6430c-522d-4649-95c4-75f844142d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9fdb471-31f0-4205-b0ce-a0296c7ca672", "name": "network-vif-deleted", "tag": "d75377b7-049b-4dfd-80a5-5b02950d2cf5"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:48:39.680153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-df0fa839-6a8b-4545-b35a-83855df6ff66 req-25a6430c-522d-4649-95c4-75f844142d40 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:39.680634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-df0fa839-6a8b-4545-b35a-83855df6ff66 req-25a6430c-522d-4649-95c4-75f844142d40 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:39.681300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-df0fa839-6a8b-4545-b35a-83855df6ff66 req-25a6430c-522d-4649-95c4-75f844142d40 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:39.693830 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-df0fa839-6a8b-4545-b35a-83855df6ff66 req-25a6430c-522d-4649-95c4-75f844142d40 service nova] Creating event network-vif-deleted:d75377b7-049b-4dfd-80a5-5b02950d2cf5 for instance a9fdb471-31f0-4205-b0ce-a0296c7ca672 on n-h1-862964-3 Oct 29 01:48:39.709951 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-df0fa839-6a8b-4545-b35a-83855df6ff66 req-25a6430c-522d-4649-95c4-75f844142d40 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036880 Oct 29 01:48:39.709951 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3753/7289] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:48:39.908258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4c422270-58b8-417e-818d-9572762d7b39 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:39.908893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4c422270-58b8-417e-818d-9572762d7b39 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:39.915272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c422270-58b8-417e-818d-9572762d7b39 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:39.915774 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c422270-58b8-417e-818d-9572762d7b39 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:39.916824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c422270-58b8-417e-818d-9572762d7b39 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:39.917803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c422270-58b8-417e-818d-9572762d7b39 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:39.918285 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c422270-58b8-417e-818d-9572762d7b39 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:39.918731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c422270-58b8-417e-818d-9572762d7b39 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:39.987791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4c422270-58b8-417e-818d-9572762d7b39 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:39.996130 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4c422270-58b8-417e-818d-9572762d7b39 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1352 microversion: 2.1 time: 0.092309 Oct 29 01:48:39.996718 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3537/7290] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:39 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:40.224602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-ebda0c50-038d-45a7-9e9e-ce1c8b09ff2c req-b78892bf-9dcd-4191-a9c5-51065168ce24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce139ca-0135-40eb-9654-26157715fc1a", "name": "network-vif-plugged", "status": "completed", "tag": "15bc45ae-29c8-43ba-b356-ec2e6195d44f"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:48:40.236532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ebda0c50-038d-45a7-9e9e-ce1c8b09ff2c req-b78892bf-9dcd-4191-a9c5-51065168ce24 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:40.237007 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ebda0c50-038d-45a7-9e9e-ce1c8b09ff2c req-b78892bf-9dcd-4191-a9c5-51065168ce24 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:40.237474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ebda0c50-038d-45a7-9e9e-ce1c8b09ff2c req-b78892bf-9dcd-4191-a9c5-51065168ce24 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:40.249656 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-ebda0c50-038d-45a7-9e9e-ce1c8b09ff2c req-b78892bf-9dcd-4191-a9c5-51065168ce24 service nova] Creating event network-vif-plugged:15bc45ae-29c8-43ba-b356-ec2e6195d44f for instance 1ce139ca-0135-40eb-9654-26157715fc1a on n-h1-862964-3 Oct 29 01:48:40.254573 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-ebda0c50-038d-45a7-9e9e-ce1c8b09ff2c req-b78892bf-9dcd-4191-a9c5-51065168ce24 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033956 Oct 29 01:48:40.255194 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3754/7291] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:48:40.334323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a1e4b4e6-36ae-40b1-9bc6-a85a8f24bcb7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:40.335197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a1e4b4e6-36ae-40b1-9bc6-a85a8f24bcb7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:40.346957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1e4b4e6-36ae-40b1-9bc6-a85a8f24bcb7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:40.346957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1e4b4e6-36ae-40b1-9bc6-a85a8f24bcb7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:40.346957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1e4b4e6-36ae-40b1-9bc6-a85a8f24bcb7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:40.346957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1e4b4e6-36ae-40b1-9bc6-a85a8f24bcb7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:40.346957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1e4b4e6-36ae-40b1-9bc6-a85a8f24bcb7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:40.347472 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a1e4b4e6-36ae-40b1-9bc6-a85a8f24bcb7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:40.547646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a1e4b4e6-36ae-40b1-9bc6-a85a8f24bcb7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:40.555749 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a1e4b4e6-36ae-40b1-9bc6-a85a8f24bcb7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1265 microversion: 2.1 time: 0.226726 Oct 29 01:48:40.556459 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3538/7292] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:40 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:41.020636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c5f168be-1e3a-4510-b248-483a22a1753f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:41.021314 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c5f168be-1e3a-4510-b248-483a22a1753f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:41.027761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5f168be-1e3a-4510-b248-483a22a1753f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:41.028254 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5f168be-1e3a-4510-b248-483a22a1753f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:41.028703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5f168be-1e3a-4510-b248-483a22a1753f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:41.029436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5f168be-1e3a-4510-b248-483a22a1753f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:41.029897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5f168be-1e3a-4510-b248-483a22a1753f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:41.030319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5f168be-1e3a-4510-b248-483a22a1753f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:41.065530 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5f168be-1e3a-4510-b248-483a22a1753f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:41.066040 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5f168be-1e3a-4510-b248-483a22a1753f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:41.066478 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5f168be-1e3a-4510-b248-483a22a1753f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:41.066924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-c5f168be-1e3a-4510-b248-483a22a1753f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lazy-loading 'fault' on Instance uuid a9fdb471-31f0-4205-b0ce-a0296c7ca672 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:48:41.113587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c5f168be-1e3a-4510-b248-483a22a1753f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70e2b34406c4e11afd9471a09d9cfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2842ba05180046839fb5d064ad9132a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:41.124802 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c5f168be-1e3a-4510-b248-483a22a1753f tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 200 len: 1357 microversion: 2.1 time: 0.106124 Oct 29 01:48:41.124802 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3755/7293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:41 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 1357 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:41.579738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dba7ce90-32c5-465c-9ee5-64c853071323 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:41.580278 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dba7ce90-32c5-465c-9ee5-64c853071323 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:41.587453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dba7ce90-32c5-465c-9ee5-64c853071323 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:41.596594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dba7ce90-32c5-465c-9ee5-64c853071323 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:41.596594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dba7ce90-32c5-465c-9ee5-64c853071323 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:41.596594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dba7ce90-32c5-465c-9ee5-64c853071323 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:41.596594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dba7ce90-32c5-465c-9ee5-64c853071323 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:41.596594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dba7ce90-32c5-465c-9ee5-64c853071323 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:41.735586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-dba7ce90-32c5-465c-9ee5-64c853071323 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:41.743817 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dba7ce90-32c5-465c-9ee5-64c853071323 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1265 microversion: 2.1 time: 0.168541 Oct 29 01:48:41.744426 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3539/7294] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:41 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:42.146377 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e4eb51b7-0930-4cc9-ad96-d3d95a6787e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:42.147112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e4eb51b7-0930-4cc9-ad96-d3d95a6787e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] [instance: a9fdb471-31f0-4205-b0ce-a0296c7ca672] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:42.154763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4eb51b7-0930-4cc9-ad96-d3d95a6787e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:42.155275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4eb51b7-0930-4cc9-ad96-d3d95a6787e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:42.155722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4eb51b7-0930-4cc9-ad96-d3d95a6787e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:42.156473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4eb51b7-0930-4cc9-ad96-d3d95a6787e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:42.156937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4eb51b7-0930-4cc9-ad96-d3d95a6787e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:42.157393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e4eb51b7-0930-4cc9-ad96-d3d95a6787e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:42.172268 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-e4eb51b7-0930-4cc9-ad96-d3d95a6787e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] HTTP exception thrown: Instance a9fdb471-31f0-4205-b0ce-a0296c7ca672 could not be found. Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e4eb51b7-0930-4cc9-ad96-d3d95a6787e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Request method failure captured: Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 HTTP/1.1 Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXILJPg9Teh04-xrfpejfETyHRBlSuOio40kYpBC7b_6HCncBaKOEtwakgsRFaHKUUVodh217xaKH9_jXg1fYudvg1KG6UvSVte3n5sImSaOZIiyh3V5b8dvECLF6tMPuqqNu5Tyyb2L7G4A-k4CbTXuNsP0CgTWtsdXxylpF7mJbiNI Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 2842ba05180046839fb5d064ad9132a1 Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1405101352 Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2842ba05180046839fb5d064ad9132a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2842ba05180046839fb5d064ad9132a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2842ba05180046839fb5d064ad9132a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2842ba05180046839fb5d064ad9132a1", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1405101352 Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 2842ba05180046839fb5d064ad9132a1 Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1405101352 Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-TestNetworkAdvancedServerOps-1405101352-project Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: c70e2b34406c4e11afd9471a09d9cfef Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1405101352-project Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance a9fdb471-31f0-4205-b0ce-a0296c7ca672 could not be found. Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'a9fdb471-31f0-4205-b0ce-a0296c7ca672'} Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9fdb471-31f0-4205-b0ce-a0296c7ca672 could not be found. Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9fdb471-31f0-4205-b0ce-a0296c7ca672 could not be found. Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:48:42.174181 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:48:42.180633 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:48:42.180633 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:48:42.180633 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:48:42.180633 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:48:42.180633 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:48:42.180633 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:48:42.180633 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9fdb471-31f0-4205-b0ce-a0296c7ca672 could not be found. Oct 29 01:48:42.180633 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:48:42.180633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e4eb51b7-0930-4cc9-ad96-d3d95a6787e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Returning 404 to user: Instance a9fdb471-31f0-4205-b0ce-a0296c7ca672 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:48:42.180633 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e4eb51b7-0930-4cc9-ad96-d3d95a6787e0 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672" status: 404 len: 111 microversion: 2.1 time: 0.033422 Oct 29 01:48:42.180633 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3756/7295] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:42 2022] GET /compute/v2.1/servers/a9fdb471-31f0-4205-b0ce-a0296c7ca672 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:48:42.770960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9416f1fc-7b44-44f7-b067-5135e136ecb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:42.772682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9416f1fc-7b44-44f7-b067-5135e136ecb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:42.784834 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9416f1fc-7b44-44f7-b067-5135e136ecb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:42.785868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9416f1fc-7b44-44f7-b067-5135e136ecb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:42.786785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9416f1fc-7b44-44f7-b067-5135e136ecb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:42.788140 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9416f1fc-7b44-44f7-b067-5135e136ecb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:42.789185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9416f1fc-7b44-44f7-b067-5135e136ecb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:42.790083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9416f1fc-7b44-44f7-b067-5135e136ecb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:43.014256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9416f1fc-7b44-44f7-b067-5135e136ecb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:43.018448 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:48:43.023382 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9416f1fc-7b44-44f7-b067-5135e136ecb9 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1453 microversion: 2.1 time: 0.258679 Oct 29 01:48:43.024001 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3540/7296] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:42 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1453 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:43.049275 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b28f2e21-bc3c-46b5-85f3-187d7176baa8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:43.049977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b28f2e21-bc3c-46b5-85f3-187d7176baa8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:48:43.056079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b28f2e21-bc3c-46b5-85f3-187d7176baa8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:43.056566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b28f2e21-bc3c-46b5-85f3-187d7176baa8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:43.057004 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b28f2e21-bc3c-46b5-85f3-187d7176baa8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:43.057745 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b28f2e21-bc3c-46b5-85f3-187d7176baa8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:43.058198 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b28f2e21-bc3c-46b5-85f3-187d7176baa8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:43.058621 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b28f2e21-bc3c-46b5-85f3-187d7176baa8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:43.237854 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b28f2e21-bc3c-46b5-85f3-187d7176baa8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:48:43.245692 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b28f2e21-bc3c-46b5-85f3-187d7176baa8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1453 microversion: 2.1 time: 0.200907 Oct 29 01:48:43.246250 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3757/7297] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:48:43 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1453 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:48:47.258652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-b9ea2483-f219-4fbb-a5bb-f5a835abe71d req-ac333a82-c565-42ae-9349-d0d3467788f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ce139ca-0135-40eb-9654-26157715fc1a", "tag": "15bc45ae-29c8-43ba-b356-ec2e6195d44f"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:48:47.277298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b9ea2483-f219-4fbb-a5bb-f5a835abe71d req-ac333a82-c565-42ae-9349-d0d3467788f0 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:48:47.279639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b9ea2483-f219-4fbb-a5bb-f5a835abe71d req-ac333a82-c565-42ae-9349-d0d3467788f0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:48:47.280160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b9ea2483-f219-4fbb-a5bb-f5a835abe71d req-ac333a82-c565-42ae-9349-d0d3467788f0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:48:47.304422 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-b9ea2483-f219-4fbb-a5bb-f5a835abe71d req-ac333a82-c565-42ae-9349-d0d3467788f0 service nova] Creating event network-changed:15bc45ae-29c8-43ba-b356-ec2e6195d44f for instance 1ce139ca-0135-40eb-9654-26157715fc1a on n-h1-862964-3 Oct 29 01:48:47.314577 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-b9ea2483-f219-4fbb-a5bb-f5a835abe71d req-ac333a82-c565-42ae-9349-d0d3467788f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240505 Oct 29 01:48:47.315617 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3541/7298] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:48:47.561569 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a9f8bbd0-c39d-4502-af4f-7b3b6ac569d3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] Calling method '.version_select at 0x7f9d9695ed30>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:48:47.666067 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a9f8bbd0-c39d-4502-af4f-7b3b6ac569d3 tempest-TestNetworkAdvancedServerOps-1405101352 tempest-TestNetworkAdvancedServerOps-1405101352-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1909159424" status: 202 len: 0 microversion: 2.1 time: 0.109485 Oct 29 01:48:47.667613 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3758/7299] 10.222.0.26 () {58 vars in 1284 bytes} [Sat Oct 29 01:48:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1909159424 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:49:07.675265 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:49:07.680014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8d89a4bf-c775-4b3a-9853-87156786a914 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a8e9d2a-5be9-420e-bd8a-d84938929686"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:49:07.682535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8d89a4bf-c775-4b3a-9853-87156786a914 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:07.690222 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d89a4bf-c775-4b3a-9853-87156786a914 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:07.690720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d89a4bf-c775-4b3a-9853-87156786a914 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:07.691175 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d89a4bf-c775-4b3a-9853-87156786a914 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:07.691925 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d89a4bf-c775-4b3a-9853-87156786a914 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:07.692519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d89a4bf-c775-4b3a-9853-87156786a914 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:07.692970 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8d89a4bf-c775-4b3a-9853-87156786a914 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:08.506842 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8d89a4bf-c775-4b3a-9853-87156786a914 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "POST /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834437 Oct 29 01:49:08.507508 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3542/7300] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 29 01:49:07 2022] POST /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-volume_attachments => generated 194 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:49:20.770130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e2024bde-2e5e-49a8-9443-8d207da563e2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:49:20.773207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e2024bde-2e5e-49a8-9443-8d207da563e2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:20.778994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=78 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:49:20.778994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:49:20.783863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2024bde-2e5e-49a8-9443-8d207da563e2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:20.784350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2024bde-2e5e-49a8-9443-8d207da563e2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:20.784797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2024bde-2e5e-49a8-9443-8d207da563e2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:20.785614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2024bde-2e5e-49a8-9443-8d207da563e2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:20.786077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2024bde-2e5e-49a8-9443-8d207da563e2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:20.786505 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e2024bde-2e5e-49a8-9443-8d207da563e2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:20.809221 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-e2024bde-2e5e-49a8-9443-8d207da563e2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lazy-loading 'flavor' on Instance uuid 22acca4a-6973-408b-95e3-f159dd6afc2c {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:49:21.416787 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e2024bde-2e5e-49a8-9443-8d207da563e2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "POST /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/action" status: 200 len: 32 microversion: 2.1 time: 0.650748 Oct 29 01:49:21.417684 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3759/7301] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:49:20 2022] POST /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/action => generated 32 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:49:21.426558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:49:21.427455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:49:21.431566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-625041b3-c92c-4eb3-8400-943384038659 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:21.432286 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-625041b3-c92c-4eb3-8400-943384038659 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:21.440362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-625041b3-c92c-4eb3-8400-943384038659 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:21.440879 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-625041b3-c92c-4eb3-8400-943384038659 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:21.441357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-625041b3-c92c-4eb3-8400-943384038659 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:21.442077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-625041b3-c92c-4eb3-8400-943384038659 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:21.442557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-625041b3-c92c-4eb3-8400-943384038659 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:21.442999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-625041b3-c92c-4eb3-8400-943384038659 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:21.693095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-625041b3-c92c-4eb3-8400-943384038659 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:21.703898 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-625041b3-c92c-4eb3-8400-943384038659 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1736 microversion: 2.1 time: 0.279809 Oct 29 01:49:21.704521 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3543/7302] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:21 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1736 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:22.731030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1cfbe30d-c1d0-4e75-a74c-19e4932b1e68 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:22.731931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1cfbe30d-c1d0-4e75-a74c-19e4932b1e68 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:22.738328 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cfbe30d-c1d0-4e75-a74c-19e4932b1e68 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:22.738809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cfbe30d-c1d0-4e75-a74c-19e4932b1e68 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:22.739249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cfbe30d-c1d0-4e75-a74c-19e4932b1e68 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:22.739943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cfbe30d-c1d0-4e75-a74c-19e4932b1e68 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:22.740399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cfbe30d-c1d0-4e75-a74c-19e4932b1e68 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:22.740828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1cfbe30d-c1d0-4e75-a74c-19e4932b1e68 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:22.907211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1cfbe30d-c1d0-4e75-a74c-19e4932b1e68 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:22.922886 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1cfbe30d-c1d0-4e75-a74c-19e4932b1e68 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1736 microversion: 2.1 time: 0.196999 Oct 29 01:49:22.923502 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3760/7303] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:22 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:23.949940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b8f31192-f395-4875-acde-20830ca281a0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:23.950496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b8f31192-f395-4875-acde-20830ca281a0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:23.958304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8f31192-f395-4875-acde-20830ca281a0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:23.958839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8f31192-f395-4875-acde-20830ca281a0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:23.959291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8f31192-f395-4875-acde-20830ca281a0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:23.959997 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8f31192-f395-4875-acde-20830ca281a0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:23.960470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8f31192-f395-4875-acde-20830ca281a0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:23.960908 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8f31192-f395-4875-acde-20830ca281a0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:24.097580 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b8f31192-f395-4875-acde-20830ca281a0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:24.105906 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b8f31192-f395-4875-acde-20830ca281a0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1736 microversion: 2.1 time: 0.160714 Oct 29 01:49:24.106506 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3544/7304] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:23 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:25.131567 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-74db9d0e-a56e-421a-ad49-1b508a8bb339 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:25.132225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-74db9d0e-a56e-421a-ad49-1b508a8bb339 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:25.141649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74db9d0e-a56e-421a-ad49-1b508a8bb339 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:25.142147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74db9d0e-a56e-421a-ad49-1b508a8bb339 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:25.142592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74db9d0e-a56e-421a-ad49-1b508a8bb339 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:25.143301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74db9d0e-a56e-421a-ad49-1b508a8bb339 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:25.143772 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74db9d0e-a56e-421a-ad49-1b508a8bb339 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:25.144203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-74db9d0e-a56e-421a-ad49-1b508a8bb339 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:25.281814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-74db9d0e-a56e-421a-ad49-1b508a8bb339 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:25.290542 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-74db9d0e-a56e-421a-ad49-1b508a8bb339 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1736 microversion: 2.1 time: 0.164168 Oct 29 01:49:25.291148 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3761/7305] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:25 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:26.315008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f0db0d40-6b53-44ab-adf5-728ebab6f3f8 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:26.315784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f0db0d40-6b53-44ab-adf5-728ebab6f3f8 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:26.323281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0db0d40-6b53-44ab-adf5-728ebab6f3f8 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:26.323896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0db0d40-6b53-44ab-adf5-728ebab6f3f8 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:26.324351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0db0d40-6b53-44ab-adf5-728ebab6f3f8 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:26.325354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0db0d40-6b53-44ab-adf5-728ebab6f3f8 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:26.325894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0db0d40-6b53-44ab-adf5-728ebab6f3f8 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:26.326367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f0db0d40-6b53-44ab-adf5-728ebab6f3f8 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:26.461051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f0db0d40-6b53-44ab-adf5-728ebab6f3f8 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:26.469708 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f0db0d40-6b53-44ab-adf5-728ebab6f3f8 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1736 microversion: 2.1 time: 0.159191 Oct 29 01:49:26.470338 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3545/7306] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:26 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:27.494272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2247f7a3-13d6-4869-9e5e-d4d7c1da154b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:27.494882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2247f7a3-13d6-4869-9e5e-d4d7c1da154b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:27.502376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2247f7a3-13d6-4869-9e5e-d4d7c1da154b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:27.502859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2247f7a3-13d6-4869-9e5e-d4d7c1da154b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:27.503294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2247f7a3-13d6-4869-9e5e-d4d7c1da154b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:27.503986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2247f7a3-13d6-4869-9e5e-d4d7c1da154b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:27.504517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2247f7a3-13d6-4869-9e5e-d4d7c1da154b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:27.504941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2247f7a3-13d6-4869-9e5e-d4d7c1da154b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:27.649358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2247f7a3-13d6-4869-9e5e-d4d7c1da154b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:27.658018 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2247f7a3-13d6-4869-9e5e-d4d7c1da154b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1736 microversion: 2.1 time: 0.167722 Oct 29 01:49:27.658617 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3762/7307] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:27 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:28.681713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-545fca1b-228e-4ae3-859a-9db9836ac907 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:28.682412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-545fca1b-228e-4ae3-859a-9db9836ac907 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:28.690492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-545fca1b-228e-4ae3-859a-9db9836ac907 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:28.690988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-545fca1b-228e-4ae3-859a-9db9836ac907 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:28.691440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-545fca1b-228e-4ae3-859a-9db9836ac907 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:28.692143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-545fca1b-228e-4ae3-859a-9db9836ac907 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:28.692612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-545fca1b-228e-4ae3-859a-9db9836ac907 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:28.693047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-545fca1b-228e-4ae3-859a-9db9836ac907 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:28.832684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-545fca1b-228e-4ae3-859a-9db9836ac907 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:28.841527 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-545fca1b-228e-4ae3-859a-9db9836ac907 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1736 microversion: 2.1 time: 0.163808 Oct 29 01:49:28.842117 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3546/7308] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:28 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:29.866473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9257a74a-3a06-4b20-b609-0331d1ca0b25 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:29.867115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9257a74a-3a06-4b20-b609-0331d1ca0b25 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:29.873905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9257a74a-3a06-4b20-b609-0331d1ca0b25 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:29.876992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9257a74a-3a06-4b20-b609-0331d1ca0b25 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:29.876992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9257a74a-3a06-4b20-b609-0331d1ca0b25 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:29.876992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9257a74a-3a06-4b20-b609-0331d1ca0b25 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:29.876992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9257a74a-3a06-4b20-b609-0331d1ca0b25 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:29.876992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9257a74a-3a06-4b20-b609-0331d1ca0b25 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:30.007455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9257a74a-3a06-4b20-b609-0331d1ca0b25 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:30.016702 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9257a74a-3a06-4b20-b609-0331d1ca0b25 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1736 microversion: 2.1 time: 0.153723 Oct 29 01:49:30.017459 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3763/7309] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:29 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:31.040954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f508fc7a-05df-44bc-9775-3276a73a9737 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:31.042012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f508fc7a-05df-44bc-9775-3276a73a9737 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:31.049327 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f508fc7a-05df-44bc-9775-3276a73a9737 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:31.049833 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f508fc7a-05df-44bc-9775-3276a73a9737 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:31.050299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f508fc7a-05df-44bc-9775-3276a73a9737 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:31.051018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f508fc7a-05df-44bc-9775-3276a73a9737 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:31.051492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f508fc7a-05df-44bc-9775-3276a73a9737 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:31.051941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f508fc7a-05df-44bc-9775-3276a73a9737 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:31.194466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f508fc7a-05df-44bc-9775-3276a73a9737 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:31.203225 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f508fc7a-05df-44bc-9775-3276a73a9737 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1736 microversion: 2.1 time: 0.166274 Oct 29 01:49:31.204341 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3547/7310] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:31 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:32.228208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bae16304-9f86-4c08-9b31-bbe9dd603e2d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:32.228824 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bae16304-9f86-4c08-9b31-bbe9dd603e2d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:32.236340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bae16304-9f86-4c08-9b31-bbe9dd603e2d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:32.239255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bae16304-9f86-4c08-9b31-bbe9dd603e2d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:32.239255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bae16304-9f86-4c08-9b31-bbe9dd603e2d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:32.239255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bae16304-9f86-4c08-9b31-bbe9dd603e2d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:32.239255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bae16304-9f86-4c08-9b31-bbe9dd603e2d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:32.239255 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bae16304-9f86-4c08-9b31-bbe9dd603e2d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:32.373145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bae16304-9f86-4c08-9b31-bbe9dd603e2d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:32.381644 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bae16304-9f86-4c08-9b31-bbe9dd603e2d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1736 microversion: 2.1 time: 0.157277 Oct 29 01:49:32.383932 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3764/7311] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:32 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:33.405951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ac01ab6d-0dc9-4c72-84e7-d83d2b56fb41 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:33.406582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ac01ab6d-0dc9-4c72-84e7-d83d2b56fb41 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:33.413738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac01ab6d-0dc9-4c72-84e7-d83d2b56fb41 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:33.414304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac01ab6d-0dc9-4c72-84e7-d83d2b56fb41 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:33.416939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac01ab6d-0dc9-4c72-84e7-d83d2b56fb41 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:33.416939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac01ab6d-0dc9-4c72-84e7-d83d2b56fb41 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:33.416939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac01ab6d-0dc9-4c72-84e7-d83d2b56fb41 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:33.416939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ac01ab6d-0dc9-4c72-84e7-d83d2b56fb41 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:33.568452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ac01ab6d-0dc9-4c72-84e7-d83d2b56fb41 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:33.577258 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ac01ab6d-0dc9-4c72-84e7-d83d2b56fb41 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1736 microversion: 2.1 time: 0.175287 Oct 29 01:49:33.580553 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3548/7312] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:33 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:34.602461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-195c700f-c9e6-49a2-9b37-b8522781e7cf tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:34.603992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-195c700f-c9e6-49a2-9b37-b8522781e7cf tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:34.614742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-195c700f-c9e6-49a2-9b37-b8522781e7cf tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:34.615239 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-195c700f-c9e6-49a2-9b37-b8522781e7cf tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:34.615687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-195c700f-c9e6-49a2-9b37-b8522781e7cf tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:34.616436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-195c700f-c9e6-49a2-9b37-b8522781e7cf tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:34.616903 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-195c700f-c9e6-49a2-9b37-b8522781e7cf tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:34.617396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-195c700f-c9e6-49a2-9b37-b8522781e7cf tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:34.753787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-195c700f-c9e6-49a2-9b37-b8522781e7cf tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:34.762246 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-195c700f-c9e6-49a2-9b37-b8522781e7cf tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1736 microversion: 2.1 time: 0.163706 Oct 29 01:49:34.762922 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3765/7313] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:34 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:35.786816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d7e8609b-0c1f-46ed-8352-73e695f6caa9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:35.787659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d7e8609b-0c1f-46ed-8352-73e695f6caa9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:35.794405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7e8609b-0c1f-46ed-8352-73e695f6caa9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:35.797253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7e8609b-0c1f-46ed-8352-73e695f6caa9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:35.797253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7e8609b-0c1f-46ed-8352-73e695f6caa9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:35.797253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7e8609b-0c1f-46ed-8352-73e695f6caa9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:35.797253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7e8609b-0c1f-46ed-8352-73e695f6caa9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:35.797253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d7e8609b-0c1f-46ed-8352-73e695f6caa9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:35.939271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d7e8609b-0c1f-46ed-8352-73e695f6caa9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:35.948303 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d7e8609b-0c1f-46ed-8352-73e695f6caa9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1736 microversion: 2.1 time: 0.165995 Oct 29 01:49:35.949088 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3549/7314] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:35 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:36.973856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-70aa01be-d6ba-4374-9c7f-887ca1bdeba3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:36.974800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-70aa01be-d6ba-4374-9c7f-887ca1bdeba3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:36.981401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70aa01be-d6ba-4374-9c7f-887ca1bdeba3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:36.981959 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70aa01be-d6ba-4374-9c7f-887ca1bdeba3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:36.983247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70aa01be-d6ba-4374-9c7f-887ca1bdeba3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:36.985398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70aa01be-d6ba-4374-9c7f-887ca1bdeba3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:36.986069 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70aa01be-d6ba-4374-9c7f-887ca1bdeba3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:36.987324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70aa01be-d6ba-4374-9c7f-887ca1bdeba3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:37.128294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-70aa01be-d6ba-4374-9c7f-887ca1bdeba3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:37.136998 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-70aa01be-d6ba-4374-9c7f-887ca1bdeba3 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1736 microversion: 2.1 time: 0.168181 Oct 29 01:49:37.137653 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3766/7315] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:36 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:38.162139 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c867fa07-f943-4efb-a5b6-c58aedb4d5c0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:38.162828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c867fa07-f943-4efb-a5b6-c58aedb4d5c0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:38.169497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c867fa07-f943-4efb-a5b6-c58aedb4d5c0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:38.172689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c867fa07-f943-4efb-a5b6-c58aedb4d5c0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:38.172689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c867fa07-f943-4efb-a5b6-c58aedb4d5c0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:38.172689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c867fa07-f943-4efb-a5b6-c58aedb4d5c0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:38.172689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c867fa07-f943-4efb-a5b6-c58aedb4d5c0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:38.172689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c867fa07-f943-4efb-a5b6-c58aedb4d5c0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:38.306624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c867fa07-f943-4efb-a5b6-c58aedb4d5c0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:38.315039 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c867fa07-f943-4efb-a5b6-c58aedb4d5c0 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1736 microversion: 2.1 time: 0.157470 Oct 29 01:49:38.315698 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3550/7316] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:38 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:39.339330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2299dd69-8088-4ea1-8e91-4f247660ce36 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:39.339981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2299dd69-8088-4ea1-8e91-4f247660ce36 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:39.346919 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2299dd69-8088-4ea1-8e91-4f247660ce36 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:39.347989 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2299dd69-8088-4ea1-8e91-4f247660ce36 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:39.348470 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2299dd69-8088-4ea1-8e91-4f247660ce36 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:39.349182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2299dd69-8088-4ea1-8e91-4f247660ce36 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:39.349645 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2299dd69-8088-4ea1-8e91-4f247660ce36 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:39.350071 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2299dd69-8088-4ea1-8e91-4f247660ce36 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:39.487418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2299dd69-8088-4ea1-8e91-4f247660ce36 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:39.496538 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2299dd69-8088-4ea1-8e91-4f247660ce36 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1736 microversion: 2.1 time: 0.161130 Oct 29 01:49:39.497129 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3767/7317] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:39 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:40.523384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-81a50a6e-8f8a-442f-b143-3dbb6488b21b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:40.524071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-81a50a6e-8f8a-442f-b143-3dbb6488b21b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:40.531494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81a50a6e-8f8a-442f-b143-3dbb6488b21b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:40.532281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81a50a6e-8f8a-442f-b143-3dbb6488b21b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:40.533179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81a50a6e-8f8a-442f-b143-3dbb6488b21b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:40.533712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81a50a6e-8f8a-442f-b143-3dbb6488b21b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:40.534209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81a50a6e-8f8a-442f-b143-3dbb6488b21b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:40.534647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81a50a6e-8f8a-442f-b143-3dbb6488b21b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:40.685556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-81a50a6e-8f8a-442f-b143-3dbb6488b21b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:40.695352 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-81a50a6e-8f8a-442f-b143-3dbb6488b21b tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1716 microversion: 2.1 time: 0.177749 Oct 29 01:49:40.695931 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3551/7318] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:40 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1716 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:40.817322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d6492e63-fe90-49c0-a1ca-199640b5fd3a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:40.817929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d6492e63-fe90-49c0-a1ca-199640b5fd3a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:40.825316 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6492e63-fe90-49c0-a1ca-199640b5fd3a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:40.825801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6492e63-fe90-49c0-a1ca-199640b5fd3a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:40.826243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6492e63-fe90-49c0-a1ca-199640b5fd3a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:40.826958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6492e63-fe90-49c0-a1ca-199640b5fd3a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:40.827484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6492e63-fe90-49c0-a1ca-199640b5fd3a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:40.827949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6492e63-fe90-49c0-a1ca-199640b5fd3a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:40.912756 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-d6492e63-fe90-49c0-a1ca-199640b5fd3a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] HTTP exception thrown: Cannot 'detach_volume' instance 22acca4a-6973-408b-95e3-f159dd6afc2c while it is in vm_state rescued Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d6492e63-fe90-49c0-a1ca-199640b5fd3a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Request method failure captured: Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-volume_attachments/3a8e9d2a-5be9-420e-bd8a-d84938929686 HTTP/1.1 Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIXmiZLUHgQf8g1eJ6FTBPxQ6yYPldRikhV_PrG4adbgTywoIFdTTQzzYLYf7Q8nmXrU6gBy4lrdKLe1DFugXfCor48tp4KGalaxBeYPZ8OxWzZX_lUSaO5EmAsCxBcqfg03LezTH1BrcAZy2EOgD8GUlBMhab57UUVT2uqh6jpD5os Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 5451841ce3564e4d9a77cdac41619273 Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5451841ce3564e4d9a77cdac41619273", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 5451841ce3564e4d9a77cdac41619273 Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerRescueNegativeTestJSON-1825472559-project Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f55bc7f1dee2477abb53f91d5ad58d3a Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1825472559-project Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: exception: Cannot 'detach_volume' instance 22acca4a-6973-408b-95e3-f159dd6afc2c while it is in vm_state rescued Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'server_id': '22acca4a-6973-408b-95e3-f159dd6afc2c', 'id': '3a8e9d2a-5be9-420e-bd8a-d84938929686'} Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 22acca4a-6973-408b-95e3-f159dd6afc2c in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 22acca4a-6973-408b-95e3-f159dd6afc2c while it is in vm_state rescued Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:49:40.914416 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:49:40.919905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:49:40.919905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:49:40.919905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:49:40.919905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:49:40.919905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 22acca4a-6973-408b-95e3-f159dd6afc2c while it is in vm_state rescued Oct 29 01:49:40.919905 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:49:40.919905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d6492e63-fe90-49c0-a1ca-199640b5fd3a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Returning 409 to user: Cannot 'detach_volume' instance 22acca4a-6973-408b-95e3-f159dd6afc2c while it is in vm_state rescued {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:49:40.919905 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d6492e63-fe90-49c0-a1ca-199640b5fd3a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "DELETE /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-volume_attachments/3a8e9d2a-5be9-420e-bd8a-d84938929686" status: 409 len: 152 microversion: 2.1 time: 0.102825 Oct 29 01:49:40.919905 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3768/7319] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 29 01:49:40 2022] DELETE /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-volume_attachments/3a8e9d2a-5be9-420e-bd8a-d84938929686 => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:49:40.925091 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cc4ef645-d553-425e-9f74-906fbb0dcb98 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:49:40.925675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cc4ef645-d553-425e-9f74-906fbb0dcb98 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:40.932526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc4ef645-d553-425e-9f74-906fbb0dcb98 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:40.933095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc4ef645-d553-425e-9f74-906fbb0dcb98 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:40.933560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc4ef645-d553-425e-9f74-906fbb0dcb98 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:40.934276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc4ef645-d553-425e-9f74-906fbb0dcb98 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:40.934752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc4ef645-d553-425e-9f74-906fbb0dcb98 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:40.935206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cc4ef645-d553-425e-9f74-906fbb0dcb98 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:41.159194 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cc4ef645-d553-425e-9f74-906fbb0dcb98 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "POST /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/action" status: 202 len: 0 microversion: 2.1 time: 0.237870 Oct 29 01:49:41.163716 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3552/7320] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:49:40 2022] POST /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:49:41.169247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4de15b91-465a-4c0a-8549-427156bf5d5c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:41.169848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4de15b91-465a-4c0a-8549-427156bf5d5c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:41.176026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4de15b91-465a-4c0a-8549-427156bf5d5c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:41.176499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4de15b91-465a-4c0a-8549-427156bf5d5c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:41.176943 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4de15b91-465a-4c0a-8549-427156bf5d5c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:41.177863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4de15b91-465a-4c0a-8549-427156bf5d5c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:41.178545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4de15b91-465a-4c0a-8549-427156bf5d5c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:41.178983 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4de15b91-465a-4c0a-8549-427156bf5d5c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:41.344758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4de15b91-465a-4c0a-8549-427156bf5d5c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:41.353912 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4de15b91-465a-4c0a-8549-427156bf5d5c tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1724 microversion: 2.1 time: 0.188586 Oct 29 01:49:41.354495 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3769/7321] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:41 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:42.378181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3ee3fa90-3b35-413d-9620-445a0eb21f5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:42.378967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3ee3fa90-3b35-413d-9620-445a0eb21f5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:42.386351 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3ee3fa90-3b35-413d-9620-445a0eb21f5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:42.386934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3ee3fa90-3b35-413d-9620-445a0eb21f5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:42.387412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3ee3fa90-3b35-413d-9620-445a0eb21f5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:42.389178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3ee3fa90-3b35-413d-9620-445a0eb21f5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:42.389673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3ee3fa90-3b35-413d-9620-445a0eb21f5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:42.390123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3ee3fa90-3b35-413d-9620-445a0eb21f5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:42.533763 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3ee3fa90-3b35-413d-9620-445a0eb21f5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:42.543145 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3ee3fa90-3b35-413d-9620-445a0eb21f5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1724 microversion: 2.1 time: 0.170072 Oct 29 01:49:42.544379 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3553/7322] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:42 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:43.570044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-763a2678-5ad0-46c3-896d-ea00d7c3757a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:43.570880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-763a2678-5ad0-46c3-896d-ea00d7c3757a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:43.581128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-763a2678-5ad0-46c3-896d-ea00d7c3757a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:43.581753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-763a2678-5ad0-46c3-896d-ea00d7c3757a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:43.582461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-763a2678-5ad0-46c3-896d-ea00d7c3757a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:43.583437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-763a2678-5ad0-46c3-896d-ea00d7c3757a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:43.584642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-763a2678-5ad0-46c3-896d-ea00d7c3757a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:43.585302 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-763a2678-5ad0-46c3-896d-ea00d7c3757a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:43.733624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-763a2678-5ad0-46c3-896d-ea00d7c3757a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:43.742211 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-763a2678-5ad0-46c3-896d-ea00d7c3757a tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1724 microversion: 2.1 time: 0.178094 Oct 29 01:49:43.742797 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3770/7323] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:43 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:49:44.766429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d25abcae-fc2c-466d-b5f4-228d9b802650 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:44.767059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d25abcae-fc2c-466d-b5f4-228d9b802650 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:44.774410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d25abcae-fc2c-466d-b5f4-228d9b802650 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:44.774913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d25abcae-fc2c-466d-b5f4-228d9b802650 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:44.775366 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d25abcae-fc2c-466d-b5f4-228d9b802650 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:44.776109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d25abcae-fc2c-466d-b5f4-228d9b802650 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:44.776582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d25abcae-fc2c-466d-b5f4-228d9b802650 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:44.777026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d25abcae-fc2c-466d-b5f4-228d9b802650 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:44.908209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d25abcae-fc2c-466d-b5f4-228d9b802650 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:49:44.917477 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d25abcae-fc2c-466d-b5f4-228d9b802650 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1730 microversion: 2.1 time: 0.155099 Oct 29 01:49:44.918692 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3554/7324] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:49:44 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:49:44.940035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b47bd9e8-9f0e-4001-bca5-8b19e7cd90e2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:49:44.940566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b47bd9e8-9f0e-4001-bca5-8b19e7cd90e2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:49:44.947606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b47bd9e8-9f0e-4001-bca5-8b19e7cd90e2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:44.948096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b47bd9e8-9f0e-4001-bca5-8b19e7cd90e2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:44.950815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b47bd9e8-9f0e-4001-bca5-8b19e7cd90e2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:44.950815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b47bd9e8-9f0e-4001-bca5-8b19e7cd90e2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:44.950815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b47bd9e8-9f0e-4001-bca5-8b19e7cd90e2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:44.950815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b47bd9e8-9f0e-4001-bca5-8b19e7cd90e2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:45.030405 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b47bd9e8-9f0e-4001-bca5-8b19e7cd90e2 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094198 Oct 29 01:49:45.034686 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3771/7325] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 29 01:49:44 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:49:46.363258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-dc1324fd-6b38-4991-b1e1-2c019c75990d req-f2933872-9928-4c7c-880a-ec93869fa865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22acca4a-6973-408b-95e3-f159dd6afc2c", "tag": "f0268529-ea8b-4a3d-a9df-1fab1e33d488"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:49:46.374628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-dc1324fd-6b38-4991-b1e1-2c019c75990d req-f2933872-9928-4c7c-880a-ec93869fa865 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:46.375226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-dc1324fd-6b38-4991-b1e1-2c019c75990d req-f2933872-9928-4c7c-880a-ec93869fa865 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:46.375681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-dc1324fd-6b38-4991-b1e1-2c019c75990d req-f2933872-9928-4c7c-880a-ec93869fa865 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:46.387810 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-dc1324fd-6b38-4991-b1e1-2c019c75990d req-f2933872-9928-4c7c-880a-ec93869fa865 service nova] Creating event network-changed:f0268529-ea8b-4a3d-a9df-1fab1e33d488 for instance 22acca4a-6973-408b-95e3-f159dd6afc2c on n-h2-862964-3 Oct 29 01:49:46.393070 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-dc1324fd-6b38-4991-b1e1-2c019c75990d req-f2933872-9928-4c7c-880a-ec93869fa865 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033783 Oct 29 01:49:46.393727 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3555/7326] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:49:48.409011 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-eab12fad-8e9d-4490-b061-f3990db588d3 req-8d126b36-28e0-47a2-97ba-14cfe8689bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22acca4a-6973-408b-95e3-f159dd6afc2c", "tag": "f0268529-ea8b-4a3d-a9df-1fab1e33d488"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:49:48.420039 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-eab12fad-8e9d-4490-b061-f3990db588d3 req-8d126b36-28e0-47a2-97ba-14cfe8689bf7 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:49:48.420561 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-eab12fad-8e9d-4490-b061-f3990db588d3 req-8d126b36-28e0-47a2-97ba-14cfe8689bf7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:49:48.421096 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-eab12fad-8e9d-4490-b061-f3990db588d3 req-8d126b36-28e0-47a2-97ba-14cfe8689bf7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:49:48.433738 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-eab12fad-8e9d-4490-b061-f3990db588d3 req-8d126b36-28e0-47a2-97ba-14cfe8689bf7 service nova] Creating event network-changed:f0268529-ea8b-4a3d-a9df-1fab1e33d488 for instance 22acca4a-6973-408b-95e3-f159dd6afc2c on n-h2-862964-3 Oct 29 01:49:48.438981 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-eab12fad-8e9d-4490-b061-f3990db588d3 req-8d126b36-28e0-47a2-97ba-14cfe8689bf7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034812 Oct 29 01:49:48.439584 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3772/7327] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:50:28.744974 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=26 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:50:28.745853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:50:28.749988 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-34201422-7633-458a-a52b-f51d244028ad tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2103069508", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "ce11f055-49de-4753-8e4f-bd88746d6fc1"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:50:28.804770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-34201422-7633-458a-a52b-f51d244028ad tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] validate_networks() for [('ce11f055-49de-4753-8e4f-bd88746d6fc1', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:50:29.170647 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-34201422-7633-458a-a52b-f51d244028ad tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:50:29.171094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-34201422-7633-458a-a52b-f51d244028ad tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:50:29.171588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-34201422-7633-458a-a52b-f51d244028ad tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:50:29.172015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-34201422-7633-458a-a52b-f51d244028ad tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:50:29.172445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-34201422-7633-458a-a52b-f51d244028ad tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:50:29.182762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34201422-7633-458a-a52b-f51d244028ad tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:29.183257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34201422-7633-458a-a52b-f51d244028ad tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:29.183741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34201422-7633-458a-a52b-f51d244028ad tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:29.184492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34201422-7633-458a-a52b-f51d244028ad tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:29.184964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34201422-7633-458a-a52b-f51d244028ad tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:29.185436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-34201422-7633-458a-a52b-f51d244028ad tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:29.202353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-34201422-7633-458a-a52b-f51d244028ad tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Getting quotas for project fb7c458477cc4d71a48f4ec5a26cd5fb. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:50:29.207588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-34201422-7633-458a-a52b-f51d244028ad tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Getting quotas for user 287462f4874545a4855566877dc72034 and project fb7c458477cc4d71a48f4ec5a26cd5fb. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:50:29.219786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-34201422-7633-458a-a52b-f51d244028ad tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:50:29.222349 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-34201422-7633-458a-a52b-f51d244028ad tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:50:29.334548 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-34201422-7633-458a-a52b-f51d244028ad tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591593 Oct 29 01:50:29.335135 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3556/7328] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:50:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:50:29.345411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=28 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:50:29.346240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:50:29.351557 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4ec8d9ef-3728-4646-b4d2-6a41421d42a1 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:29.352294 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4ec8d9ef-3728-4646-b4d2-6a41421d42a1 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:29.406892 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4ec8d9ef-3728-4646-b4d2-6a41421d42a1 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:29.415490 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4ec8d9ef-3728-4646-b4d2-6a41421d42a1 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1219 microversion: 2.1 time: 0.072928 Oct 29 01:50:29.416068 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3773/7329] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:29 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:50:30.440162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-329b54d9-4cc6-4113-9843-65176bc3caa6 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:30.440803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-329b54d9-4cc6-4113-9843-65176bc3caa6 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:30.495137 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-329b54d9-4cc6-4113-9843-65176bc3caa6 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:30.502127 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-329b54d9-4cc6-4113-9843-65176bc3caa6 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1219 microversion: 2.1 time: 0.066876 Oct 29 01:50:30.502696 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3557/7330] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:30 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:31.526199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7c9aa36a-fc19-4008-8839-dd05340db84e tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:31.527365 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7c9aa36a-fc19-4008-8839-dd05340db84e tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:31.583063 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7c9aa36a-fc19-4008-8839-dd05340db84e tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:31.590429 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7c9aa36a-fc19-4008-8839-dd05340db84e tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1219 microversion: 2.1 time: 0.068599 Oct 29 01:50:31.591004 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3774/7331] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:31 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:32.613842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9e5ba42f-7965-4ec4-acbf-d00cf6435c21 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:32.614473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9e5ba42f-7965-4ec4-acbf-d00cf6435c21 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:32.674543 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9e5ba42f-7965-4ec4-acbf-d00cf6435c21 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:32.681037 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9e5ba42f-7965-4ec4-acbf-d00cf6435c21 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1219 microversion: 2.1 time: 0.071065 Oct 29 01:50:32.681645 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3558/7332] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:32 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:33.704787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f7cc1962-ef46-41d2-9cb3-bef5e7dde935 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:33.710940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a715dccd-3203-4f21-8a81-9f9da796d2fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:33.711649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a715dccd-3203-4f21-8a81-9f9da796d2fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:33.713460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f7cc1962-ef46-41d2-9cb3-bef5e7dde935 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:33.721243 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7cc1962-ef46-41d2-9cb3-bef5e7dde935 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:33.721949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7cc1962-ef46-41d2-9cb3-bef5e7dde935 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:33.722448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7cc1962-ef46-41d2-9cb3-bef5e7dde935 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:33.722973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a715dccd-3203-4f21-8a81-9f9da796d2fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:33.723313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7cc1962-ef46-41d2-9cb3-bef5e7dde935 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:33.723480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a715dccd-3203-4f21-8a81-9f9da796d2fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:33.723868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7cc1962-ef46-41d2-9cb3-bef5e7dde935 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:33.724147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a715dccd-3203-4f21-8a81-9f9da796d2fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:33.724945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a715dccd-3203-4f21-8a81-9f9da796d2fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:33.725112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f7cc1962-ef46-41d2-9cb3-bef5e7dde935 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:33.725414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a715dccd-3203-4f21-8a81-9f9da796d2fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:33.725862 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a715dccd-3203-4f21-8a81-9f9da796d2fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:33.792227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f7cc1962-ef46-41d2-9cb3-bef5e7dde935 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:33.800432 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f7cc1962-ef46-41d2-9cb3-bef5e7dde935 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1223 microversion: 2.1 time: 0.099958 Oct 29 01:50:33.801103 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3775/7333] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:33 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:33.827692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-a715dccd-3203-4f21-8a81-9f9da796d2fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lazy-loading 'services' on Instance uuid 22acca4a-6973-408b-95e3-f159dd6afc2c {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:50:34.040290 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a715dccd-3203-4f21-8a81-9f9da796d2fc tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "DELETE /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-volume_attachments/3a8e9d2a-5be9-420e-bd8a-d84938929686" status: 202 len: 0 microversion: 2.1 time: 0.333634 Oct 29 01:50:34.040901 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3559/7334] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 29 01:50:33 2022] DELETE /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-volume_attachments/3a8e9d2a-5be9-420e-bd8a-d84938929686 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:50:34.050079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-30a25db6-017e-4c5b-ae54-db4ce2596291 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:34.052415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-30a25db6-017e-4c5b-ae54-db4ce2596291 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:34.058542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30a25db6-017e-4c5b-ae54-db4ce2596291 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:34.059027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30a25db6-017e-4c5b-ae54-db4ce2596291 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:34.059474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30a25db6-017e-4c5b-ae54-db4ce2596291 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:34.060157 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30a25db6-017e-4c5b-ae54-db4ce2596291 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:34.060610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30a25db6-017e-4c5b-ae54-db4ce2596291 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:34.061038 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30a25db6-017e-4c5b-ae54-db4ce2596291 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:34.091301 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-30a25db6-017e-4c5b-ae54-db4ce2596291 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045170 Oct 29 01:50:34.091917 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3776/7335] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:50:34 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:50:34.825557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ee563375-811f-40b6-a548-e9aac5c07aea tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:34.826582 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ee563375-811f-40b6-a548-e9aac5c07aea tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:34.833235 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee563375-811f-40b6-a548-e9aac5c07aea tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:34.837780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee563375-811f-40b6-a548-e9aac5c07aea tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:34.837780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee563375-811f-40b6-a548-e9aac5c07aea tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:34.837780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee563375-811f-40b6-a548-e9aac5c07aea tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:34.837780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee563375-811f-40b6-a548-e9aac5c07aea tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:34.837780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ee563375-811f-40b6-a548-e9aac5c07aea tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:34.906674 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ee563375-811f-40b6-a548-e9aac5c07aea tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:34.915315 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ee563375-811f-40b6-a548-e9aac5c07aea tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1223 microversion: 2.1 time: 0.094948 Oct 29 01:50:34.918059 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3560/7336] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:34 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:35.104338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-953430ff-fdc4-421d-a7bc-c9263662a9a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:35.106635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-953430ff-fdc4-421d-a7bc-c9263662a9a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:35.113808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-953430ff-fdc4-421d-a7bc-c9263662a9a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:35.114343 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-953430ff-fdc4-421d-a7bc-c9263662a9a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:35.114787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-953430ff-fdc4-421d-a7bc-c9263662a9a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:35.115516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-953430ff-fdc4-421d-a7bc-c9263662a9a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:35.116178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-953430ff-fdc4-421d-a7bc-c9263662a9a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:35.116606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-953430ff-fdc4-421d-a7bc-c9263662a9a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:35.151974 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-953430ff-fdc4-421d-a7bc-c9263662a9a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052336 Oct 29 01:50:35.152556 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3777/7337] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:50:35 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:50:35.938230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7a1bc343-d738-49df-9474-e1393071e5ae tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:35.939113 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7a1bc343-d738-49df-9474-e1393071e5ae tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:35.946490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a1bc343-d738-49df-9474-e1393071e5ae tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:35.947267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a1bc343-d738-49df-9474-e1393071e5ae tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:35.947600 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a1bc343-d738-49df-9474-e1393071e5ae tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:35.948321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a1bc343-d738-49df-9474-e1393071e5ae tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:35.948802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a1bc343-d738-49df-9474-e1393071e5ae tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:35.949415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7a1bc343-d738-49df-9474-e1393071e5ae tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:36.044585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7a1bc343-d738-49df-9474-e1393071e5ae tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:36.055547 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7a1bc343-d738-49df-9474-e1393071e5ae tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1279 microversion: 2.1 time: 0.121499 Oct 29 01:50:36.059098 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3561/7338] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:35 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1279 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:36.166894 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c8ddae61-61e5-49d3-b24e-37dd81324356 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:36.171886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c8ddae61-61e5-49d3-b24e-37dd81324356 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:36.181362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8ddae61-61e5-49d3-b24e-37dd81324356 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:36.182263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8ddae61-61e5-49d3-b24e-37dd81324356 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:36.183844 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8ddae61-61e5-49d3-b24e-37dd81324356 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:36.184781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8ddae61-61e5-49d3-b24e-37dd81324356 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:36.185884 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8ddae61-61e5-49d3-b24e-37dd81324356 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:36.186500 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c8ddae61-61e5-49d3-b24e-37dd81324356 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:36.220928 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c8ddae61-61e5-49d3-b24e-37dd81324356 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059853 Oct 29 01:50:36.221542 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3778/7339] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:50:36 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:50:37.082238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fea50f55-bb7a-470d-83e1-955814949423 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:37.083140 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fea50f55-bb7a-470d-83e1-955814949423 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:37.089998 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fea50f55-bb7a-470d-83e1-955814949423 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:37.090503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fea50f55-bb7a-470d-83e1-955814949423 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:37.090954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fea50f55-bb7a-470d-83e1-955814949423 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:37.091672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fea50f55-bb7a-470d-83e1-955814949423 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:37.092149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fea50f55-bb7a-470d-83e1-955814949423 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:37.092589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fea50f55-bb7a-470d-83e1-955814949423 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:37.236974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-af78ef86-f8e1-4fbe-9348-b6756853d433 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:37.239686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-af78ef86-f8e1-4fbe-9348-b6756853d433 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:37.253553 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af78ef86-f8e1-4fbe-9348-b6756853d433 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:37.254397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af78ef86-f8e1-4fbe-9348-b6756853d433 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:37.255607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af78ef86-f8e1-4fbe-9348-b6756853d433 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:37.256324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af78ef86-f8e1-4fbe-9348-b6756853d433 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:37.256783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af78ef86-f8e1-4fbe-9348-b6756853d433 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:37.257250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af78ef86-f8e1-4fbe-9348-b6756853d433 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:37.302510 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-af78ef86-f8e1-4fbe-9348-b6756853d433 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071544 Oct 29 01:50:37.303948 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3779/7340] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:50:37 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:50:37.361529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fea50f55-bb7a-470d-83e1-955814949423 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:37.370637 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fea50f55-bb7a-470d-83e1-955814949423 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1319 microversion: 2.1 time: 0.292623 Oct 29 01:50:37.373249 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3562/7341] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:37 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:37.955622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-c7e26e5a-4482-414b-b90b-4cd084cc3b0a req-aff3f04c-968d-4fe1-8010-2359628cf730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90d7f8cf-e7f4-46cb-adeb-8de5c26e5705", "tag": "8c5af379-5f85-441a-a27b-ff57aefddae8"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:50:37.966656 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c7e26e5a-4482-414b-b90b-4cd084cc3b0a req-aff3f04c-968d-4fe1-8010-2359628cf730 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:37.969564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c7e26e5a-4482-414b-b90b-4cd084cc3b0a req-aff3f04c-968d-4fe1-8010-2359628cf730 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:37.969564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c7e26e5a-4482-414b-b90b-4cd084cc3b0a req-aff3f04c-968d-4fe1-8010-2359628cf730 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:37.980847 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-c7e26e5a-4482-414b-b90b-4cd084cc3b0a req-aff3f04c-968d-4fe1-8010-2359628cf730 service nova] Creating event network-changed:8c5af379-5f85-441a-a27b-ff57aefddae8 for instance 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 on n-h2-862964-3 Oct 29 01:50:37.987159 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-c7e26e5a-4482-414b-b90b-4cd084cc3b0a req-aff3f04c-968d-4fe1-8010-2359628cf730 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036048 Oct 29 01:50:37.987877 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3780/7342] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:50:38.315901 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-68a51f9d-fb3c-4dde-b228-232b73cb68a7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:38.318210 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-68a51f9d-fb3c-4dde-b228-232b73cb68a7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:38.325279 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68a51f9d-fb3c-4dde-b228-232b73cb68a7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:38.326048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68a51f9d-fb3c-4dde-b228-232b73cb68a7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:38.326509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68a51f9d-fb3c-4dde-b228-232b73cb68a7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:38.327238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68a51f9d-fb3c-4dde-b228-232b73cb68a7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:38.327716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68a51f9d-fb3c-4dde-b228-232b73cb68a7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:38.328161 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-68a51f9d-fb3c-4dde-b228-232b73cb68a7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:38.360150 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-68a51f9d-fb3c-4dde-b228-232b73cb68a7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048442 Oct 29 01:50:38.360745 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3563/7343] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:50:38 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:50:38.397008 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f6bf23a1-7f13-4332-b5af-06d34fb9abf2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:38.397880 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f6bf23a1-7f13-4332-b5af-06d34fb9abf2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:38.404804 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6bf23a1-7f13-4332-b5af-06d34fb9abf2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:38.405411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6bf23a1-7f13-4332-b5af-06d34fb9abf2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:38.405918 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6bf23a1-7f13-4332-b5af-06d34fb9abf2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:38.406684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6bf23a1-7f13-4332-b5af-06d34fb9abf2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:38.407220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6bf23a1-7f13-4332-b5af-06d34fb9abf2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:38.407736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6bf23a1-7f13-4332-b5af-06d34fb9abf2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:38.947454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f6bf23a1-7f13-4332-b5af-06d34fb9abf2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:38.955481 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f6bf23a1-7f13-4332-b5af-06d34fb9abf2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1319 microversion: 2.1 time: 0.563252 Oct 29 01:50:38.956057 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3781/7344] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:38 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1319 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:39.372149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e447e11e-0d1a-4ced-adf8-1efd0d69d7a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:39.374442 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e447e11e-0d1a-4ced-adf8-1efd0d69d7a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:39.376936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:50:39.382560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e447e11e-0d1a-4ced-adf8-1efd0d69d7a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:39.383663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e447e11e-0d1a-4ced-adf8-1efd0d69d7a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:39.383663 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e447e11e-0d1a-4ced-adf8-1efd0d69d7a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:39.384332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e447e11e-0d1a-4ced-adf8-1efd0d69d7a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:39.384805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e447e11e-0d1a-4ced-adf8-1efd0d69d7a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:39.385273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e447e11e-0d1a-4ced-adf8-1efd0d69d7a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:39.415431 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e447e11e-0d1a-4ced-adf8-1efd0d69d7a4 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047284 Oct 29 01:50:39.415991 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3564/7345] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 29 01:50:39 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:50:39.493447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ae3a1f2b-c9cd-4859-8d5a-b122f54e8bb1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:50:39.495793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ae3a1f2b-c9cd-4859-8d5a-b122f54e8bb1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:39.502879 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae3a1f2b-c9cd-4859-8d5a-b122f54e8bb1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:39.503361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae3a1f2b-c9cd-4859-8d5a-b122f54e8bb1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:39.503801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae3a1f2b-c9cd-4859-8d5a-b122f54e8bb1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:39.504490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae3a1f2b-c9cd-4859-8d5a-b122f54e8bb1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:39.504945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae3a1f2b-c9cd-4859-8d5a-b122f54e8bb1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:39.505439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae3a1f2b-c9cd-4859-8d5a-b122f54e8bb1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:39.533081 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-ae3a1f2b-c9cd-4859-8d5a-b122f54e8bb1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] HTTP exception thrown: Cannot 'reboot' instance 838282d2-04eb-4006-9639-daafacf292bd while it is in vm_state rescued Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ae3a1f2b-c9cd-4859-8d5a-b122f54e8bb1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Request method failure captured: Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd/action HTTP/1.1 Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 28 Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIXmiZLUHgQf8g1eJ6FTBPxQ6yYPldRikhV_PrG4adbgTywoIFdTTQzzYLYf7Q8nmXrU6gBy4lrdKLe1DFugXfCor48tp4KGalaxBeYPZ8OxWzZX_lUSaO5EmAsCxBcqfg03LezTH1BrcAZy2EOgD8GUlBMhab57UUVT2uqh6jpD5os Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 5451841ce3564e4d9a77cdac41619273 Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5451841ce3564e4d9a77cdac41619273", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 5451841ce3564e4d9a77cdac41619273 Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServerRescueNegativeTestJSON-1825472559-project Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: f55bc7f1dee2477abb53f91d5ad58d3a Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1825472559-project Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: {"reboot": {"type": "HARD"}} Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: exception: Cannot 'reboot' instance 838282d2-04eb-4006-9639-daafacf292bd while it is in vm_state rescued Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '838282d2-04eb-4006-9639-daafacf292bd', 'body': {'reboot': {'type': 'HARD'}}} Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 838282d2-04eb-4006-9639-daafacf292bd in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 01:50:39.534787 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 01:50:39.542487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 838282d2-04eb-4006-9639-daafacf292bd while it is in vm_state rescued Oct 29 01:50:39.542487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:50:39.542487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:50:39.542487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:50:39.542487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:50:39.542487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:50:39.542487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:50:39.542487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:50:39.542487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:50:39.542487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 838282d2-04eb-4006-9639-daafacf292bd while it is in vm_state rescued Oct 29 01:50:39.542487 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:50:39.542487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ae3a1f2b-c9cd-4859-8d5a-b122f54e8bb1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Returning 409 to user: Cannot 'reboot' instance 838282d2-04eb-4006-9639-daafacf292bd while it is in vm_state rescued {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:50:39.542487 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ae3a1f2b-c9cd-4859-8d5a-b122f54e8bb1 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "POST /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd/action" status: 409 len: 145 microversion: 2.1 time: 0.047006 Oct 29 01:50:39.542487 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3782/7346] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:50:39 2022] POST /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd/action => generated 145 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:50:39.547207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0bd20eee-521e-40ef-b986-c222abb06591 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:50:39.550018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0bd20eee-521e-40ef-b986-c222abb06591 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:39.556450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0bd20eee-521e-40ef-b986-c222abb06591 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:39.556953 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0bd20eee-521e-40ef-b986-c222abb06591 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:39.557434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0bd20eee-521e-40ef-b986-c222abb06591 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:39.558144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0bd20eee-521e-40ef-b986-c222abb06591 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:39.558615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0bd20eee-521e-40ef-b986-c222abb06591 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:39.559060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0bd20eee-521e-40ef-b986-c222abb06591 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:39.585446 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-0bd20eee-521e-40ef-b986-c222abb06591 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] HTTP exception thrown: Cannot 'rebuild' instance 838282d2-04eb-4006-9639-daafacf292bd while it is in vm_state rescued Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0bd20eee-521e-40ef-b986-c222abb06591 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Request method failure captured: Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd/action HTTP/1.1 Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 65 Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIXmiZLUHgQf8g1eJ6FTBPxQ6yYPldRikhV_PrG4adbgTywoIFdTTQzzYLYf7Q8nmXrU6gBy4lrdKLe1DFugXfCor48tp4KGalaxBeYPZ8OxWzZX_lUSaO5EmAsCxBcqfg03LezTH1BrcAZy2EOgD8GUlBMhab57UUVT2uqh6jpD5os Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 5451841ce3564e4d9a77cdac41619273 Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5451841ce3564e4d9a77cdac41619273", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 5451841ce3564e4d9a77cdac41619273 Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerRescueNegativeTestJSON-1825472559-project Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: f55bc7f1dee2477abb53f91d5ad58d3a Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1825472559-project Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: {"rebuild": {"imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a"}} Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: exception: Cannot 'rebuild' instance 838282d2-04eb-4006-9639-daafacf292bd while it is in vm_state rescued Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '838282d2-04eb-4006-9639-daafacf292bd', 'body': {'rebuild': {'imageRef': '99205ec5-992b-4d3c-9bcd-04eb4b06191a'}}} Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 838282d2-04eb-4006-9639-daafacf292bd in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:50:39.587238 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 838282d2-04eb-4006-9639-daafacf292bd while it is in vm_state rescued Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 838282d2-04eb-4006-9639-daafacf292bd while it is in vm_state rescued Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0bd20eee-521e-40ef-b986-c222abb06591 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Returning 409 to user: Cannot 'rebuild' instance 838282d2-04eb-4006-9639-daafacf292bd while it is in vm_state rescued {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0bd20eee-521e-40ef-b986-c222abb06591 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "POST /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd/action" status: 409 len: 146 microversion: 2.1 time: 0.045444 Oct 29 01:50:39.592532 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3565/7347] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:50:39 2022] POST /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd/action => generated 146 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 29 01:50:39.598202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-248e2b9e-1e68-4f4c-8dd6-e8487d721718 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:39.598726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-248e2b9e-1e68-4f4c-8dd6-e8487d721718 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:39.605868 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-248e2b9e-1e68-4f4c-8dd6-e8487d721718 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:39.606348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-248e2b9e-1e68-4f4c-8dd6-e8487d721718 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:39.606783 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-248e2b9e-1e68-4f4c-8dd6-e8487d721718 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:39.607493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-248e2b9e-1e68-4f4c-8dd6-e8487d721718 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:39.607946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-248e2b9e-1e68-4f4c-8dd6-e8487d721718 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:39.608369 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-248e2b9e-1e68-4f4c-8dd6-e8487d721718 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:39.635147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-248e2b9e-1e68-4f4c-8dd6-e8487d721718 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:50:39.915025 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-248e2b9e-1e68-4f4c-8dd6-e8487d721718 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "DELETE /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 204 len: 0 microversion: 2.1 time: 0.320294 Oct 29 01:50:39.915581 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3783/7348] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:50:39 2022] DELETE /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:50:39.923654 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-745d404e-b856-47c4-9249-6b25f19ec2ca tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:39.924275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-745d404e-b856-47c4-9249-6b25f19ec2ca tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:39.930829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-745d404e-b856-47c4-9249-6b25f19ec2ca tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:39.931323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-745d404e-b856-47c4-9249-6b25f19ec2ca tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:39.931771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-745d404e-b856-47c4-9249-6b25f19ec2ca tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:39.932474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-745d404e-b856-47c4-9249-6b25f19ec2ca tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:39.932938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-745d404e-b856-47c4-9249-6b25f19ec2ca tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:39.933404 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-745d404e-b856-47c4-9249-6b25f19ec2ca tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:39.978896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d6b69150-f500-42c2-99a0-a149fd00f07c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:39.979597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d6b69150-f500-42c2-99a0-a149fd00f07c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:39.985795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b69150-f500-42c2-99a0-a149fd00f07c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:39.986278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b69150-f500-42c2-99a0-a149fd00f07c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:39.986792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b69150-f500-42c2-99a0-a149fd00f07c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:39.987624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b69150-f500-42c2-99a0-a149fd00f07c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:39.988097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b69150-f500-42c2-99a0-a149fd00f07c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:39.988508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6b69150-f500-42c2-99a0-a149fd00f07c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:40.116328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-745d404e-b856-47c4-9249-6b25f19ec2ca tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:40.124527 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-745d404e-b856-47c4-9249-6b25f19ec2ca tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1690 microversion: 2.1 time: 0.204752 Oct 29 01:50:40.125114 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3566/7349] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:39 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1690 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:40.160853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d6b69150-f500-42c2-99a0-a149fd00f07c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:40.169415 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d6b69150-f500-42c2-99a0-a149fd00f07c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1319 microversion: 2.1 time: 0.194978 Oct 29 01:50:40.169921 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3784/7350] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:39 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:50:41.150061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4e43b9a9-1708-4023-b9d3-16651bb95e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:41.150694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4e43b9a9-1708-4023-b9d3-16651bb95e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:41.157658 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e43b9a9-1708-4023-b9d3-16651bb95e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:41.158155 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e43b9a9-1708-4023-b9d3-16651bb95e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:41.158611 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e43b9a9-1708-4023-b9d3-16651bb95e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:41.159312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e43b9a9-1708-4023-b9d3-16651bb95e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:41.159785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e43b9a9-1708-4023-b9d3-16651bb95e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:41.160225 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e43b9a9-1708-4023-b9d3-16651bb95e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:41.191933 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bdba2129-8007-4768-976b-f2581c3e1ef0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:41.192565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bdba2129-8007-4768-976b-f2581c3e1ef0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:41.200120 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdba2129-8007-4768-976b-f2581c3e1ef0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:41.200611 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdba2129-8007-4768-976b-f2581c3e1ef0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:41.201533 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdba2129-8007-4768-976b-f2581c3e1ef0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:41.202276 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdba2129-8007-4768-976b-f2581c3e1ef0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:41.202741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdba2129-8007-4768-976b-f2581c3e1ef0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:41.203195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bdba2129-8007-4768-976b-f2581c3e1ef0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:41.347385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4e43b9a9-1708-4023-b9d3-16651bb95e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:41.356736 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4e43b9a9-1708-4023-b9d3-16651bb95e9d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1690 microversion: 2.1 time: 0.210966 Oct 29 01:50:41.357344 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3567/7351] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:41 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1690 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:41.377137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bdba2129-8007-4768-976b-f2581c3e1ef0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:41.385993 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bdba2129-8007-4768-976b-f2581c3e1ef0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1319 microversion: 2.1 time: 0.197946 Oct 29 01:50:41.386618 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3785/7352] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:41 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:50:42.380338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3627b53a-295f-41ce-974d-01783d349dfa tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:42.381711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3627b53a-295f-41ce-974d-01783d349dfa tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:42.388800 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3627b53a-295f-41ce-974d-01783d349dfa tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:42.389337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3627b53a-295f-41ce-974d-01783d349dfa tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:42.389795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3627b53a-295f-41ce-974d-01783d349dfa tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:42.390508 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3627b53a-295f-41ce-974d-01783d349dfa tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:42.390981 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3627b53a-295f-41ce-974d-01783d349dfa tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:42.391424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3627b53a-295f-41ce-974d-01783d349dfa tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:42.414037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81679ed7-ead4-49b1-95ad-ada973c2ee11 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:42.414651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-81679ed7-ead4-49b1-95ad-ada973c2ee11 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:42.416830 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:50:42.422613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81679ed7-ead4-49b1-95ad-ada973c2ee11 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:42.423135 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81679ed7-ead4-49b1-95ad-ada973c2ee11 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:42.423573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81679ed7-ead4-49b1-95ad-ada973c2ee11 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:42.424288 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81679ed7-ead4-49b1-95ad-ada973c2ee11 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:42.424743 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81679ed7-ead4-49b1-95ad-ada973c2ee11 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:42.425187 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81679ed7-ead4-49b1-95ad-ada973c2ee11 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:42.581764 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3627b53a-295f-41ce-974d-01783d349dfa tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:42.589655 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3627b53a-295f-41ce-974d-01783d349dfa tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1690 microversion: 2.1 time: 0.213181 Oct 29 01:50:42.590238 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3568/7353] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:42 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1690 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:42.605279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-81679ed7-ead4-49b1-95ad-ada973c2ee11 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:42.612935 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-81679ed7-ead4-49b1-95ad-ada973c2ee11 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1319 microversion: 2.1 time: 0.202822 Oct 29 01:50:42.613576 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3786/7354] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:42 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:50:43.613258 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-32fa2aa2-3508-4dc7-8189-913b82fd1934 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:43.613893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-32fa2aa2-3508-4dc7-8189-913b82fd1934 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:43.615860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=10 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:50:43.621734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32fa2aa2-3508-4dc7-8189-913b82fd1934 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:43.622240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32fa2aa2-3508-4dc7-8189-913b82fd1934 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:43.622698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32fa2aa2-3508-4dc7-8189-913b82fd1934 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:43.623489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32fa2aa2-3508-4dc7-8189-913b82fd1934 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:43.623961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32fa2aa2-3508-4dc7-8189-913b82fd1934 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:43.624471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-32fa2aa2-3508-4dc7-8189-913b82fd1934 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:43.636970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-35361ee0-7059-44c7-a30c-3006071c44c3 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:43.637613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-35361ee0-7059-44c7-a30c-3006071c44c3 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:43.644491 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35361ee0-7059-44c7-a30c-3006071c44c3 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:43.644968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35361ee0-7059-44c7-a30c-3006071c44c3 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:43.645428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35361ee0-7059-44c7-a30c-3006071c44c3 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:43.646769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35361ee0-7059-44c7-a30c-3006071c44c3 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:43.647183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35361ee0-7059-44c7-a30c-3006071c44c3 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:43.647876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-35361ee0-7059-44c7-a30c-3006071c44c3 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:43.829240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-32fa2aa2-3508-4dc7-8189-913b82fd1934 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:43.836171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-35361ee0-7059-44c7-a30c-3006071c44c3 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:43.837430 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-32fa2aa2-3508-4dc7-8189-913b82fd1934 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1690 microversion: 2.1 time: 0.228170 Oct 29 01:50:43.838131 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3569/7355] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:43 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1690 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:43.843977 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-35361ee0-7059-44c7-a30c-3006071c44c3 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1319 microversion: 2.1 time: 0.210857 Oct 29 01:50:43.844551 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3787/7356] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:43 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:44.861606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5ac88879-b747-42c3-9c4d-d7a6aea3d7d6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:44.862232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5ac88879-b747-42c3-9c4d-d7a6aea3d7d6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:44.865860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4c7ce264-f0bc-4fac-b625-c114392580cd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:44.866468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4c7ce264-f0bc-4fac-b625-c114392580cd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:44.869813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ac88879-b747-42c3-9c4d-d7a6aea3d7d6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:44.870339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ac88879-b747-42c3-9c4d-d7a6aea3d7d6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:44.870791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ac88879-b747-42c3-9c4d-d7a6aea3d7d6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:44.871499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ac88879-b747-42c3-9c4d-d7a6aea3d7d6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:44.871968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ac88879-b747-42c3-9c4d-d7a6aea3d7d6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:44.872409 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ac88879-b747-42c3-9c4d-d7a6aea3d7d6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:44.873202 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c7ce264-f0bc-4fac-b625-c114392580cd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:44.873672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c7ce264-f0bc-4fac-b625-c114392580cd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:44.874106 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c7ce264-f0bc-4fac-b625-c114392580cd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:44.874799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c7ce264-f0bc-4fac-b625-c114392580cd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:44.875250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c7ce264-f0bc-4fac-b625-c114392580cd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:44.875671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4c7ce264-f0bc-4fac-b625-c114392580cd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:45.116368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5ac88879-b747-42c3-9c4d-d7a6aea3d7d6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:45.125522 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5ac88879-b747-42c3-9c4d-d7a6aea3d7d6 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1690 microversion: 2.1 time: 0.267660 Oct 29 01:50:45.134919 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3570/7357] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:44 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1690 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:45.154400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-4c7ce264-f0bc-4fac-b625-c114392580cd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:45.163542 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4c7ce264-f0bc-4fac-b625-c114392580cd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1319 microversion: 2.1 time: 0.301617 Oct 29 01:50:45.164252 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3788/7358] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:44 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:50:45.966894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-052d2bf6-0871-4667-a734-8ac41a527e1a req-e9c904ba-a248-4877-afc3-b53a17edaf3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22acca4a-6973-408b-95e3-f159dd6afc2c", "name": "network-vif-deleted", "tag": "f0268529-ea8b-4a3d-a9df-1fab1e33d488"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:50:45.977486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-052d2bf6-0871-4667-a734-8ac41a527e1a req-e9c904ba-a248-4877-afc3-b53a17edaf3e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:45.977986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-052d2bf6-0871-4667-a734-8ac41a527e1a req-e9c904ba-a248-4877-afc3-b53a17edaf3e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:45.978443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-052d2bf6-0871-4667-a734-8ac41a527e1a req-e9c904ba-a248-4877-afc3-b53a17edaf3e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:45.990266 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-052d2bf6-0871-4667-a734-8ac41a527e1a req-e9c904ba-a248-4877-afc3-b53a17edaf3e service nova] Creating event network-vif-deleted:f0268529-ea8b-4a3d-a9df-1fab1e33d488 for instance 22acca4a-6973-408b-95e3-f159dd6afc2c on n-h2-862964-3 Oct 29 01:50:45.995383 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-052d2bf6-0871-4667-a734-8ac41a527e1a req-e9c904ba-a248-4877-afc3-b53a17edaf3e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032255 Oct 29 01:50:45.995988 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3571/7359] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:50:46.150935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6803ff31-2199-434b-9336-5739595d4d90 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:46.151551 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6803ff31-2199-434b-9336-5739595d4d90 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:46.159625 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6803ff31-2199-434b-9336-5739595d4d90 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:46.159982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6803ff31-2199-434b-9336-5739595d4d90 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:46.160431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6803ff31-2199-434b-9336-5739595d4d90 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:46.161140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6803ff31-2199-434b-9336-5739595d4d90 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:46.161659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6803ff31-2199-434b-9336-5739595d4d90 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:46.167799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6803ff31-2199-434b-9336-5739595d4d90 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:46.188271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-59b530ce-4b37-4e60-bde0-520606101bce tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:46.188994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-59b530ce-4b37-4e60-bde0-520606101bce tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:46.196945 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59b530ce-4b37-4e60-bde0-520606101bce tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:46.202128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59b530ce-4b37-4e60-bde0-520606101bce tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:46.202128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59b530ce-4b37-4e60-bde0-520606101bce tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:46.202128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59b530ce-4b37-4e60-bde0-520606101bce tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:46.202128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59b530ce-4b37-4e60-bde0-520606101bce tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:46.202128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-59b530ce-4b37-4e60-bde0-520606101bce tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:46.249447 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6803ff31-2199-434b-9336-5739595d4d90 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:46.258485 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6803ff31-2199-434b-9336-5739595d4d90 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1329 microversion: 2.1 time: 0.112399 Oct 29 01:50:46.259612 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3789/7360] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:46 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1329 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:46.371123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-59b530ce-4b37-4e60-bde0-520606101bce tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:46.379383 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-59b530ce-4b37-4e60-bde0-520606101bce tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1319 microversion: 2.1 time: 0.195287 Oct 29 01:50:46.380168 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3572/7361] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:46 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:46.625861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-2d2abf6d-cade-464e-ba88-2067fc899f38 req-757bed6a-c5c2-44fd-ac5b-6a2c0415cda0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d7f8cf-e7f4-46cb-adeb-8de5c26e5705", "name": "network-vif-plugged", "status": "completed", "tag": "8c5af379-5f85-441a-a27b-ff57aefddae8"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:50:46.639203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2d2abf6d-cade-464e-ba88-2067fc899f38 req-757bed6a-c5c2-44fd-ac5b-6a2c0415cda0 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:46.639695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2d2abf6d-cade-464e-ba88-2067fc899f38 req-757bed6a-c5c2-44fd-ac5b-6a2c0415cda0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:46.640542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-2d2abf6d-cade-464e-ba88-2067fc899f38 req-757bed6a-c5c2-44fd-ac5b-6a2c0415cda0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:46.659471 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-2d2abf6d-cade-464e-ba88-2067fc899f38 req-757bed6a-c5c2-44fd-ac5b-6a2c0415cda0 service nova] Creating event network-vif-plugged:8c5af379-5f85-441a-a27b-ff57aefddae8 for instance 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 on n-h2-862964-3 Oct 29 01:50:46.667686 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-2d2abf6d-cade-464e-ba88-2067fc899f38 req-757bed6a-c5c2-44fd-ac5b-6a2c0415cda0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115542 Oct 29 01:50:46.669222 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3790/7362] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:50:47.282474 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-916a05f4-143e-4f66-b35a-5d5cab507af5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:47.283030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-916a05f4-143e-4f66-b35a-5d5cab507af5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:47.290500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-916a05f4-143e-4f66-b35a-5d5cab507af5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:47.291011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-916a05f4-143e-4f66-b35a-5d5cab507af5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:47.291470 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-916a05f4-143e-4f66-b35a-5d5cab507af5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:47.292226 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-916a05f4-143e-4f66-b35a-5d5cab507af5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:47.292911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-916a05f4-143e-4f66-b35a-5d5cab507af5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:47.293384 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-916a05f4-143e-4f66-b35a-5d5cab507af5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:47.329527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-916a05f4-143e-4f66-b35a-5d5cab507af5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:47.330296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-916a05f4-143e-4f66-b35a-5d5cab507af5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:47.330996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-916a05f4-143e-4f66-b35a-5d5cab507af5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:47.331689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-916a05f4-143e-4f66-b35a-5d5cab507af5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lazy-loading 'fault' on Instance uuid 22acca4a-6973-408b-95e3-f159dd6afc2c {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:50:47.375109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-916a05f4-143e-4f66-b35a-5d5cab507af5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:47.383580 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-916a05f4-143e-4f66-b35a-5d5cab507af5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 200 len: 1334 microversion: 2.1 time: 0.105179 Oct 29 01:50:47.384224 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3573/7363] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:47 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 1334 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:47.402982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-be550a9e-63da-4e8c-8ab1-ecaf30c8ed29 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:47.403810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-be550a9e-63da-4e8c-8ab1-ecaf30c8ed29 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:47.411114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be550a9e-63da-4e8c-8ab1-ecaf30c8ed29 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:47.411593 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be550a9e-63da-4e8c-8ab1-ecaf30c8ed29 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:47.412027 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be550a9e-63da-4e8c-8ab1-ecaf30c8ed29 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:47.412714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be550a9e-63da-4e8c-8ab1-ecaf30c8ed29 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:47.413211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be550a9e-63da-4e8c-8ab1-ecaf30c8ed29 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:47.413635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-be550a9e-63da-4e8c-8ab1-ecaf30c8ed29 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:47.433233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:50:47.553581 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-be550a9e-63da-4e8c-8ab1-ecaf30c8ed29 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:47.561838 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-be550a9e-63da-4e8c-8ab1-ecaf30c8ed29 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1319 microversion: 2.1 time: 0.163917 Oct 29 01:50:47.562423 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3791/7364] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:47 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:48.407198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b9cc2a33-a192-4229-a9ae-5baca4bbdec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:48.407857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b9cc2a33-a192-4229-a9ae-5baca4bbdec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 22acca4a-6973-408b-95e3-f159dd6afc2c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:48.416052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9cc2a33-a192-4229-a9ae-5baca4bbdec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:48.416863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9cc2a33-a192-4229-a9ae-5baca4bbdec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:48.417364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9cc2a33-a192-4229-a9ae-5baca4bbdec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:48.418064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9cc2a33-a192-4229-a9ae-5baca4bbdec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:48.418542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9cc2a33-a192-4229-a9ae-5baca4bbdec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:48.418982 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b9cc2a33-a192-4229-a9ae-5baca4bbdec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:48.432913 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-b9cc2a33-a192-4229-a9ae-5baca4bbdec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] HTTP exception thrown: Instance 22acca4a-6973-408b-95e3-f159dd6afc2c could not be found. Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b9cc2a33-a192-4229-a9ae-5baca4bbdec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Request method failure captured: Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c HTTP/1.1 Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIXmiZLUHgQf8g1eJ6FTBPxQ6yYPldRikhV_PrG4adbgTywoIFdTTQzzYLYf7Q8nmXrU6gBy4lrdKLe1DFugXfCor48tp4KGalaxBeYPZ8OxWzZX_lUSaO5EmAsCxBcqfg03LezTH1BrcAZy2EOgD8GUlBMhab57UUVT2uqh6jpD5os Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 5451841ce3564e4d9a77cdac41619273 Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5451841ce3564e4d9a77cdac41619273", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 5451841ce3564e4d9a77cdac41619273 Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerRescueNegativeTestJSON-1825472559-project Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: f55bc7f1dee2477abb53f91d5ad58d3a Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1825472559-project Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 22acca4a-6973-408b-95e3-f159dd6afc2c could not be found. Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '22acca4a-6973-408b-95e3-f159dd6afc2c'} Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22acca4a-6973-408b-95e3-f159dd6afc2c could not be found. Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22acca4a-6973-408b-95e3-f159dd6afc2c could not be found. Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:50:48.434608 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:50:48.440412 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:50:48.440412 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:50:48.440412 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:50:48.440412 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:50:48.440412 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:50:48.440412 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:50:48.440412 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22acca4a-6973-408b-95e3-f159dd6afc2c could not be found. Oct 29 01:50:48.440412 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:50:48.440412 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b9cc2a33-a192-4229-a9ae-5baca4bbdec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Returning 404 to user: Instance 22acca4a-6973-408b-95e3-f159dd6afc2c could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:50:48.440412 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b9cc2a33-a192-4229-a9ae-5baca4bbdec5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c" status: 404 len: 111 microversion: 2.1 time: 0.032831 Oct 29 01:50:48.440412 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3574/7365] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:48 2022] GET /compute/v2.1/servers/22acca4a-6973-408b-95e3-f159dd6afc2c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:50:48.444990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8af0ea35-100a-4dc8-ae50-645e01df28c5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '.version_select at 0x7f9d96677a60>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:48.547225 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8af0ea35-100a-4dc8-ae50-645e01df28c5 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-379566104" status: 202 len: 0 microversion: 2.1 time: 0.100954 Oct 29 01:50:48.547225 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3792/7366] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 29 01:50:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-379566104 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:50:48.585385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3d6e4a47-e35a-4a6a-b7c0-591d8fd052b2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:48.586588 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3d6e4a47-e35a-4a6a-b7c0-591d8fd052b2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:48.592690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d6e4a47-e35a-4a6a-b7c0-591d8fd052b2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:48.594451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d6e4a47-e35a-4a6a-b7c0-591d8fd052b2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:48.594451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d6e4a47-e35a-4a6a-b7c0-591d8fd052b2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:48.594451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d6e4a47-e35a-4a6a-b7c0-591d8fd052b2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:48.594796 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d6e4a47-e35a-4a6a-b7c0-591d8fd052b2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:48.595239 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3d6e4a47-e35a-4a6a-b7c0-591d8fd052b2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:48.732295 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3d6e4a47-e35a-4a6a-b7c0-591d8fd052b2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:48.735877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:50:48.740490 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3d6e4a47-e35a-4a6a-b7c0-591d8fd052b2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1319 microversion: 2.1 time: 0.159179 Oct 29 01:50:48.741055 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3575/7367] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:48 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:50:49.768183 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1d1b66a7-6b45-4d9e-85a9-9a40362f1573 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:49.770197 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1d1b66a7-6b45-4d9e-85a9-9a40362f1573 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:49.779147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d1b66a7-6b45-4d9e-85a9-9a40362f1573 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:49.784897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d1b66a7-6b45-4d9e-85a9-9a40362f1573 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:49.784897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d1b66a7-6b45-4d9e-85a9-9a40362f1573 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:49.784897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d1b66a7-6b45-4d9e-85a9-9a40362f1573 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:49.784897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d1b66a7-6b45-4d9e-85a9-9a40362f1573 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:49.784897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d1b66a7-6b45-4d9e-85a9-9a40362f1573 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:50.002359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1d1b66a7-6b45-4d9e-85a9-9a40362f1573 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:50.011682 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1d1b66a7-6b45-4d9e-85a9-9a40362f1573 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1509 microversion: 2.1 time: 0.251811 Oct 29 01:50:50.012519 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3793/7368] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:49 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1509 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:56.076535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-33209f21-29a7-4080-ad39-8f79c02fc5e9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:56.077052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-33209f21-29a7-4080-ad39-8f79c02fc5e9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:56.086594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-33209f21-29a7-4080-ad39-8f79c02fc5e9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:56.087376 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-33209f21-29a7-4080-ad39-8f79c02fc5e9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:56.088111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-33209f21-29a7-4080-ad39-8f79c02fc5e9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:56.089094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-33209f21-29a7-4080-ad39-8f79c02fc5e9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:56.089883 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-33209f21-29a7-4080-ad39-8f79c02fc5e9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:56.090455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-33209f21-29a7-4080-ad39-8f79c02fc5e9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:56.118739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-33209f21-29a7-4080-ad39-8f79c02fc5e9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:50:56.420110 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-33209f21-29a7-4080-ad39-8f79c02fc5e9 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "DELETE /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 204 len: 0 microversion: 2.1 time: 0.347903 Oct 29 01:50:56.420714 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3576/7369] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:50:56 2022] DELETE /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:50:56.431384 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6aae6c9b-e472-4c2d-a30a-49e9be6e3927 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:56.432009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6aae6c9b-e472-4c2d-a30a-49e9be6e3927 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:56.439463 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6aae6c9b-e472-4c2d-a30a-49e9be6e3927 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:56.439945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6aae6c9b-e472-4c2d-a30a-49e9be6e3927 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:56.440513 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6aae6c9b-e472-4c2d-a30a-49e9be6e3927 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:56.441251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6aae6c9b-e472-4c2d-a30a-49e9be6e3927 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:56.441921 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6aae6c9b-e472-4c2d-a30a-49e9be6e3927 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:56.442554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6aae6c9b-e472-4c2d-a30a-49e9be6e3927 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:56.595842 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6aae6c9b-e472-4c2d-a30a-49e9be6e3927 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:56.604579 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6aae6c9b-e472-4c2d-a30a-49e9be6e3927 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1508 microversion: 2.1 time: 0.179625 Oct 29 01:50:56.605186 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3794/7370] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:56 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:57.628609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8845b4cb-0c11-44a1-b141-3a05824dd290 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:57.629779 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8845b4cb-0c11-44a1-b141-3a05824dd290 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:57.637043 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8845b4cb-0c11-44a1-b141-3a05824dd290 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:57.637726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8845b4cb-0c11-44a1-b141-3a05824dd290 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:57.638183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8845b4cb-0c11-44a1-b141-3a05824dd290 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:57.638980 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8845b4cb-0c11-44a1-b141-3a05824dd290 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:57.639544 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8845b4cb-0c11-44a1-b141-3a05824dd290 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:57.639986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8845b4cb-0c11-44a1-b141-3a05824dd290 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:57.775644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8845b4cb-0c11-44a1-b141-3a05824dd290 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:57.784197 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8845b4cb-0c11-44a1-b141-3a05824dd290 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1508 microversion: 2.1 time: 0.159903 Oct 29 01:50:57.784789 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3577/7371] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:57 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:58.809391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ad4977d7-3278-44b5-bd2f-9af31336c66f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:50:58.809391 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ad4977d7-3278-44b5-bd2f-9af31336c66f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:50:58.816978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad4977d7-3278-44b5-bd2f-9af31336c66f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:58.817646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad4977d7-3278-44b5-bd2f-9af31336c66f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:58.818013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad4977d7-3278-44b5-bd2f-9af31336c66f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:58.818702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad4977d7-3278-44b5-bd2f-9af31336c66f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:58.819274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad4977d7-3278-44b5-bd2f-9af31336c66f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:58.820850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad4977d7-3278-44b5-bd2f-9af31336c66f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:59.032014 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ad4977d7-3278-44b5-bd2f-9af31336c66f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:50:59.040928 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ad4977d7-3278-44b5-bd2f-9af31336c66f tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1508 microversion: 2.1 time: 0.237069 Oct 29 01:50:59.041566 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3795/7372] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:50:58 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:50:59.561081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-b2c68c43-3898-45c0-894c-f54ebcc2df44 req-903c4ac8-be62-458a-8149-23cb892549de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838282d2-04eb-4006-9639-daafacf292bd", "name": "network-vif-deleted", "tag": "220aea55-6ffc-4d99-bd7b-8a42548c0464"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:50:59.567434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:50:59.574798 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b2c68c43-3898-45c0-894c-f54ebcc2df44 req-903c4ac8-be62-458a-8149-23cb892549de service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:50:59.576519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b2c68c43-3898-45c0-894c-f54ebcc2df44 req-903c4ac8-be62-458a-8149-23cb892549de service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:50:59.576519 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-b2c68c43-3898-45c0-894c-f54ebcc2df44 req-903c4ac8-be62-458a-8149-23cb892549de service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:50:59.589313 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-b2c68c43-3898-45c0-894c-f54ebcc2df44 req-903c4ac8-be62-458a-8149-23cb892549de service nova] Creating event network-vif-deleted:220aea55-6ffc-4d99-bd7b-8a42548c0464 for instance 838282d2-04eb-4006-9639-daafacf292bd on n-h1-862964-3 Oct 29 01:50:59.596015 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-b2c68c43-3898-45c0-894c-f54ebcc2df44 req-903c4ac8-be62-458a-8149-23cb892549de service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038857 Oct 29 01:50:59.599144 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3578/7373] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:51:00.064585 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3e905fc1-3fe3-477e-bc5b-a6bc4b630498 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:00.065229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-3e905fc1-3fe3-477e-bc5b-a6bc4b630498 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:00.067282 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:51:00.073264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e905fc1-3fe3-477e-bc5b-a6bc4b630498 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:00.073693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e905fc1-3fe3-477e-bc5b-a6bc4b630498 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:00.074132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e905fc1-3fe3-477e-bc5b-a6bc4b630498 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:00.074827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e905fc1-3fe3-477e-bc5b-a6bc4b630498 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:00.075278 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e905fc1-3fe3-477e-bc5b-a6bc4b630498 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:00.075699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e905fc1-3fe3-477e-bc5b-a6bc4b630498 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:00.109907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e905fc1-3fe3-477e-bc5b-a6bc4b630498 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:00.110465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e905fc1-3fe3-477e-bc5b-a6bc4b630498 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:00.111136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-3e905fc1-3fe3-477e-bc5b-a6bc4b630498 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:00.111598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-3e905fc1-3fe3-477e-bc5b-a6bc4b630498 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lazy-loading 'fault' on Instance uuid 838282d2-04eb-4006-9639-daafacf292bd {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:51:00.165508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-3e905fc1-3fe3-477e-bc5b-a6bc4b630498 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:00.174143 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3e905fc1-3fe3-477e-bc5b-a6bc4b630498 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 200 len: 1311 microversion: 2.1 time: 0.113512 Oct 29 01:51:00.179550 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3796/7374] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:00 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:01.205801 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4e498702-ab22-4eda-8ddc-4cfa67a5fed7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:01.206521 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4e498702-ab22-4eda-8ddc-4cfa67a5fed7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 838282d2-04eb-4006-9639-daafacf292bd] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:01.214233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e498702-ab22-4eda-8ddc-4cfa67a5fed7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:01.214946 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e498702-ab22-4eda-8ddc-4cfa67a5fed7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:01.215443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e498702-ab22-4eda-8ddc-4cfa67a5fed7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:01.216160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e498702-ab22-4eda-8ddc-4cfa67a5fed7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:01.216792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e498702-ab22-4eda-8ddc-4cfa67a5fed7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:01.217271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4e498702-ab22-4eda-8ddc-4cfa67a5fed7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:01.232047 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-4e498702-ab22-4eda-8ddc-4cfa67a5fed7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] HTTP exception thrown: Instance 838282d2-04eb-4006-9639-daafacf292bd could not be found. Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4e498702-ab22-4eda-8ddc-4cfa67a5fed7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Request method failure captured: Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd HTTP/1.1 Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIXmiZLUHgQf8g1eJ6FTBPxQ6yYPldRikhV_PrG4adbgTywoIFdTTQzzYLYf7Q8nmXrU6gBy4lrdKLe1DFugXfCor48tp4KGalaxBeYPZ8OxWzZX_lUSaO5EmAsCxBcqfg03LezTH1BrcAZy2EOgD8GUlBMhab57UUVT2uqh6jpD5os Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 5451841ce3564e4d9a77cdac41619273 Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5451841ce3564e4d9a77cdac41619273", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 5451841ce3564e4d9a77cdac41619273 Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerRescueNegativeTestJSON-1825472559-project Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: f55bc7f1dee2477abb53f91d5ad58d3a Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1825472559-project Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 838282d2-04eb-4006-9639-daafacf292bd could not be found. Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '838282d2-04eb-4006-9639-daafacf292bd'} Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 838282d2-04eb-4006-9639-daafacf292bd could not be found. Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 838282d2-04eb-4006-9639-daafacf292bd could not be found. Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:51:01.233851 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:51:01.240228 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:51:01.240228 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:51:01.240228 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:51:01.240228 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:51:01.240228 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:51:01.240228 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:51:01.240228 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 838282d2-04eb-4006-9639-daafacf292bd could not be found. Oct 29 01:51:01.240228 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:51:01.240228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4e498702-ab22-4eda-8ddc-4cfa67a5fed7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Returning 404 to user: Instance 838282d2-04eb-4006-9639-daafacf292bd could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:51:01.240228 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4e498702-ab22-4eda-8ddc-4cfa67a5fed7 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd" status: 404 len: 111 microversion: 2.1 time: 0.034945 Oct 29 01:51:01.240228 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3579/7375] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:01 2022] GET /compute/v2.1/servers/838282d2-04eb-4006-9639-daafacf292bd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:51:01.245378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-318f090b-8020-47ee-bccc-528c48587c1d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:01.249899 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-318f090b-8020-47ee-bccc-528c48587c1d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:01.249899 n-d-862964-3 devstack@n-api.service[121099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:51:01.249899 n-d-862964-3 devstack@n-api.service[121099]: Sat Oct 29 01:51:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 (ip 10.222.0.26) !!! Oct 29 01:51:01.257970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-318f090b-8020-47ee-bccc-528c48587c1d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:01.258449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-318f090b-8020-47ee-bccc-528c48587c1d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:01.259502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-318f090b-8020-47ee-bccc-528c48587c1d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:01.260215 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-318f090b-8020-47ee-bccc-528c48587c1d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:01.260674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-318f090b-8020-47ee-bccc-528c48587c1d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:01.261131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-318f090b-8020-47ee-bccc-528c48587c1d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:01.291457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-318f090b-8020-47ee-bccc-528c48587c1d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:51:02.412366 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-318f090b-8020-47ee-bccc-528c48587c1d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 204 len: 0 microversion: 2.1 time: 1.171820 Oct 29 01:51:02.412984 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3797/7376] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:51:01 2022] DELETE /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 0 bytes in 1173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:51:02.435563 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-054ae59b-a739-4cf4-a8a1-089f15944c5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:02.436963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-054ae59b-a739-4cf4-a8a1-089f15944c5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:02.439569 n-d-862964-3 devstack@n-api.service[121100]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:51:02.439727 n-d-862964-3 devstack@n-api.service[121100]: Sat Oct 29 01:51:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 (ip 10.222.0.26) !!! Oct 29 01:51:02.457990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-054ae59b-a739-4cf4-a8a1-089f15944c5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:02.457990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-054ae59b-a739-4cf4-a8a1-089f15944c5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:02.457990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-054ae59b-a739-4cf4-a8a1-089f15944c5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:02.457990 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-054ae59b-a739-4cf4-a8a1-089f15944c5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:02.458496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-054ae59b-a739-4cf4-a8a1-089f15944c5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:02.458853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-054ae59b-a739-4cf4-a8a1-089f15944c5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:02.612326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-054ae59b-a739-4cf4-a8a1-089f15944c5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:02.621471 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-054ae59b-a739-4cf4-a8a1-089f15944c5d tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1522 microversion: 2.1 time: 0.202953 Oct 29 01:51:02.622246 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3580/7377] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:02 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:03.646473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fa9bbd69-ae7f-4a6f-bb2b-757c00925063 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:03.647161 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fa9bbd69-ae7f-4a6f-bb2b-757c00925063 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:03.656739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa9bbd69-ae7f-4a6f-bb2b-757c00925063 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:03.657342 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa9bbd69-ae7f-4a6f-bb2b-757c00925063 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:03.657733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa9bbd69-ae7f-4a6f-bb2b-757c00925063 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:03.658483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa9bbd69-ae7f-4a6f-bb2b-757c00925063 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:03.658984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa9bbd69-ae7f-4a6f-bb2b-757c00925063 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:03.659482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fa9bbd69-ae7f-4a6f-bb2b-757c00925063 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:03.793917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fa9bbd69-ae7f-4a6f-bb2b-757c00925063 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:03.801915 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fa9bbd69-ae7f-4a6f-bb2b-757c00925063 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1522 microversion: 2.1 time: 0.159959 Oct 29 01:51:03.802498 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3798/7378] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:03 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:04.827083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ce03ceda-c9ec-4f2c-b36e-e4845d22a250 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:04.827788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ce03ceda-c9ec-4f2c-b36e-e4845d22a250 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:04.835051 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce03ceda-c9ec-4f2c-b36e-e4845d22a250 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:04.835504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce03ceda-c9ec-4f2c-b36e-e4845d22a250 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:04.835958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce03ceda-c9ec-4f2c-b36e-e4845d22a250 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:04.836668 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce03ceda-c9ec-4f2c-b36e-e4845d22a250 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:04.837342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce03ceda-c9ec-4f2c-b36e-e4845d22a250 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:04.837967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ce03ceda-c9ec-4f2c-b36e-e4845d22a250 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:04.974993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ce03ceda-c9ec-4f2c-b36e-e4845d22a250 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:04.983715 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ce03ceda-c9ec-4f2c-b36e-e4845d22a250 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1522 microversion: 2.1 time: 0.160998 Oct 29 01:51:04.984290 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3581/7379] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:04 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:06.008809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-59a77de4-c3c1-4842-8add-982ac349df96 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:06.011462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-59a77de4-c3c1-4842-8add-982ac349df96 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:06.018193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a77de4-c3c1-4842-8add-982ac349df96 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:06.018793 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a77de4-c3c1-4842-8add-982ac349df96 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:06.019338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a77de4-c3c1-4842-8add-982ac349df96 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:06.020131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a77de4-c3c1-4842-8add-982ac349df96 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:06.020689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a77de4-c3c1-4842-8add-982ac349df96 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:06.021287 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-59a77de4-c3c1-4842-8add-982ac349df96 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:06.160130 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-59a77de4-c3c1-4842-8add-982ac349df96 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:06.169031 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-59a77de4-c3c1-4842-8add-982ac349df96 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1522 microversion: 2.1 time: 0.164714 Oct 29 01:51:06.170405 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3799/7380] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:06 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:51:06.751626 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-8576d20e-3890-457d-961e-8be7d24af7d4 req-3eff2ae7-2d0f-4871-b17d-7be6358a07f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4beaf925-018a-47ce-810e-b53329fe86a0", "name": "network-vif-deleted", "tag": "10522071-aa4f-4b20-854c-677dc5abf590"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:51:06.764318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8576d20e-3890-457d-961e-8be7d24af7d4 req-3eff2ae7-2d0f-4871-b17d-7be6358a07f6 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:06.764861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8576d20e-3890-457d-961e-8be7d24af7d4 req-3eff2ae7-2d0f-4871-b17d-7be6358a07f6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:06.765418 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-8576d20e-3890-457d-961e-8be7d24af7d4 req-3eff2ae7-2d0f-4871-b17d-7be6358a07f6 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:06.777515 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-8576d20e-3890-457d-961e-8be7d24af7d4 req-3eff2ae7-2d0f-4871-b17d-7be6358a07f6 service nova] Creating event network-vif-deleted:10522071-aa4f-4b20-854c-677dc5abf590 for instance 4beaf925-018a-47ce-810e-b53329fe86a0 on n-h2-862964-3 Oct 29 01:51:06.782578 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-8576d20e-3890-457d-961e-8be7d24af7d4 req-3eff2ae7-2d0f-4871-b17d-7be6358a07f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036244 Oct 29 01:51:06.783179 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3582/7381] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:51:07.199151 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2e94bdd4-8599-40eb-aa89-54f782bbf0ba tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:07.199787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2e94bdd4-8599-40eb-aa89-54f782bbf0ba tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:07.207163 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e94bdd4-8599-40eb-aa89-54f782bbf0ba tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:07.209915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e94bdd4-8599-40eb-aa89-54f782bbf0ba tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:07.209915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e94bdd4-8599-40eb-aa89-54f782bbf0ba tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:07.209915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e94bdd4-8599-40eb-aa89-54f782bbf0ba tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:07.209915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e94bdd4-8599-40eb-aa89-54f782bbf0ba tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:07.210397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e94bdd4-8599-40eb-aa89-54f782bbf0ba tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:07.242851 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e94bdd4-8599-40eb-aa89-54f782bbf0ba tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:07.244112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e94bdd4-8599-40eb-aa89-54f782bbf0ba tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:07.244466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2e94bdd4-8599-40eb-aa89-54f782bbf0ba tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:07.244909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-2e94bdd4-8599-40eb-aa89-54f782bbf0ba tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lazy-loading 'fault' on Instance uuid 4beaf925-018a-47ce-810e-b53329fe86a0 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:51:07.592761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2e94bdd4-8599-40eb-aa89-54f782bbf0ba tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f55bc7f1dee2477abb53f91d5ad58d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5451841ce3564e4d9a77cdac41619273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:07.600765 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2e94bdd4-8599-40eb-aa89-54f782bbf0ba tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 200 len: 1311 microversion: 2.1 time: 0.406769 Oct 29 01:51:07.601373 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3800/7382] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:07 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 1311 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:08.628955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-83a793e3-3096-4285-9fa4-7776bf052620 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:08.629712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-83a793e3-3096-4285-9fa4-7776bf052620 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] [instance: 4beaf925-018a-47ce-810e-b53329fe86a0] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:08.636324 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a793e3-3096-4285-9fa4-7776bf052620 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:08.636825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a793e3-3096-4285-9fa4-7776bf052620 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:08.637305 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a793e3-3096-4285-9fa4-7776bf052620 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:08.638013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a793e3-3096-4285-9fa4-7776bf052620 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:08.638484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a793e3-3096-4285-9fa4-7776bf052620 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:08.638924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-83a793e3-3096-4285-9fa4-7776bf052620 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:08.653324 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-83a793e3-3096-4285-9fa4-7776bf052620 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] HTTP exception thrown: Instance 4beaf925-018a-47ce-810e-b53329fe86a0 could not be found. Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-83a793e3-3096-4285-9fa4-7776bf052620 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Request method failure captured: Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 HTTP/1.1 Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIXmiZLUHgQf8g1eJ6FTBPxQ6yYPldRikhV_PrG4adbgTywoIFdTTQzzYLYf7Q8nmXrU6gBy4lrdKLe1DFugXfCor48tp4KGalaxBeYPZ8OxWzZX_lUSaO5EmAsCxBcqfg03LezTH1BrcAZy2EOgD8GUlBMhab57UUVT2uqh6jpD5os Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 5451841ce3564e4d9a77cdac41619273 Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5451841ce3564e4d9a77cdac41619273"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5451841ce3564e4d9a77cdac41619273", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 5451841ce3564e4d9a77cdac41619273 Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1825472559 Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServerRescueNegativeTestJSON-1825472559-project Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: f55bc7f1dee2477abb53f91d5ad58d3a Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1825472559-project Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 4beaf925-018a-47ce-810e-b53329fe86a0 could not be found. Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '4beaf925-018a-47ce-810e-b53329fe86a0'} Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4beaf925-018a-47ce-810e-b53329fe86a0 could not be found. Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4beaf925-018a-47ce-810e-b53329fe86a0 could not be found. Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:51:08.655006 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:51:08.660528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:51:08.660528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:51:08.660528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:51:08.660528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:51:08.660528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:51:08.660528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:51:08.660528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4beaf925-018a-47ce-810e-b53329fe86a0 could not be found. Oct 29 01:51:08.660528 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:51:08.660528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-83a793e3-3096-4285-9fa4-7776bf052620 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] Returning 404 to user: Instance 4beaf925-018a-47ce-810e-b53329fe86a0 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:51:08.660528 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-83a793e3-3096-4285-9fa4-7776bf052620 tempest-ServerRescueNegativeTestJSON-1825472559 tempest-ServerRescueNegativeTestJSON-1825472559-project] 10.222.0.26 "GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0" status: 404 len: 111 microversion: 2.1 time: 0.032709 Oct 29 01:51:08.660528 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3583/7383] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:08 2022] GET /compute/v2.1/servers/4beaf925-018a-47ce-810e-b53329fe86a0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:51:12.217546 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ca792baf-79c6-4bab-a8dc-56239c0b253b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:12.218939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ca792baf-79c6-4bab-a8dc-56239c0b253b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:12.231897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca792baf-79c6-4bab-a8dc-56239c0b253b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:12.231897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca792baf-79c6-4bab-a8dc-56239c0b253b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:12.232257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca792baf-79c6-4bab-a8dc-56239c0b253b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:12.234177 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca792baf-79c6-4bab-a8dc-56239c0b253b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:12.234360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca792baf-79c6-4bab-a8dc-56239c0b253b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:12.235171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ca792baf-79c6-4bab-a8dc-56239c0b253b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:12.268867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ca792baf-79c6-4bab-a8dc-56239c0b253b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:51:12.646830 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ca792baf-79c6-4bab-a8dc-56239c0b253b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 204 len: 0 microversion: 2.1 time: 0.619769 Oct 29 01:51:12.647381 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3801/7384] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:51:12 2022] DELETE /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 0 bytes in 621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:51:12.655972 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dde951b0-f1e5-489a-aebf-63765942617e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:12.656581 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dde951b0-f1e5-489a-aebf-63765942617e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:12.663760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dde951b0-f1e5-489a-aebf-63765942617e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:12.664257 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dde951b0-f1e5-489a-aebf-63765942617e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:12.665435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dde951b0-f1e5-489a-aebf-63765942617e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:12.667565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dde951b0-f1e5-489a-aebf-63765942617e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:12.668747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dde951b0-f1e5-489a-aebf-63765942617e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:12.669247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dde951b0-f1e5-489a-aebf-63765942617e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:12.813372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-dde951b0-f1e5-489a-aebf-63765942617e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:12.821356 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dde951b0-f1e5-489a-aebf-63765942617e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1577 microversion: 2.1 time: 0.169405 Oct 29 01:51:12.822006 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3584/7385] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:12 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:51:13.845972 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0991b69a-d4ed-493e-be84-e002b24d5e8c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:13.846670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0991b69a-d4ed-493e-be84-e002b24d5e8c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:13.854519 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0991b69a-d4ed-493e-be84-e002b24d5e8c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:13.855023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0991b69a-d4ed-493e-be84-e002b24d5e8c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:13.855437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0991b69a-d4ed-493e-be84-e002b24d5e8c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:13.856136 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0991b69a-d4ed-493e-be84-e002b24d5e8c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:13.856588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0991b69a-d4ed-493e-be84-e002b24d5e8c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:13.857006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0991b69a-d4ed-493e-be84-e002b24d5e8c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:14.007985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0991b69a-d4ed-493e-be84-e002b24d5e8c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:14.017056 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0991b69a-d4ed-493e-be84-e002b24d5e8c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1577 microversion: 2.1 time: 0.175219 Oct 29 01:51:14.017670 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3802/7386] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:13 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:14.515154 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-898cbefc-c745-4bb9-8ab0-e1d86a8ef90d tempest-ExtensionsTest-294270355 tempest-ExtensionsTest-294270355-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:14.518138 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-898cbefc-c745-4bb9-8ab0-e1d86a8ef90d tempest-ExtensionsTest-294270355 tempest-ExtensionsTest-294270355-project] 10.222.0.26 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.129660 Oct 29 01:51:14.518721 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3585/7387] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Oct 29 01:51:14 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:51:14.528642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b3b2dfff-3c54-4ff5-8de7-f4a45b8e5a3f tempest-ExtensionsTest-294270355 tempest-ExtensionsTest-294270355-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:14.530634 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b3b2dfff-3c54-4ff5-8de7-f4a45b8e5a3f tempest-ExtensionsTest-294270355 tempest-ExtensionsTest-294270355-project] 10.222.0.26 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006842 Oct 29 01:51:14.531185 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3803/7388] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Oct 29 01:51:14 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:51:15.041112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fb0ec68e-0543-4979-8772-4b5d3adf8c9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:15.042765 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fb0ec68e-0543-4979-8772-4b5d3adf8c9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:15.049388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb0ec68e-0543-4979-8772-4b5d3adf8c9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:15.049975 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb0ec68e-0543-4979-8772-4b5d3adf8c9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:15.050506 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb0ec68e-0543-4979-8772-4b5d3adf8c9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:15.051387 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb0ec68e-0543-4979-8772-4b5d3adf8c9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:15.051955 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb0ec68e-0543-4979-8772-4b5d3adf8c9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:15.052921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fb0ec68e-0543-4979-8772-4b5d3adf8c9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:15.274767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fb0ec68e-0543-4979-8772-4b5d3adf8c9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:15.287164 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fb0ec68e-0543-4979-8772-4b5d3adf8c9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1577 microversion: 2.1 time: 0.251099 Oct 29 01:51:15.301179 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3586/7389] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:15 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1577 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:15.552503 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-6e2447d2-279e-484f-ab40-7369c27c56b8 req-2990221f-a131-48c8-ab37-76c73108a694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce139ca-0135-40eb-9654-26157715fc1a", "name": "network-vif-deleted", "tag": "15bc45ae-29c8-43ba-b356-ec2e6195d44f"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:51:15.580632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6e2447d2-279e-484f-ab40-7369c27c56b8 req-2990221f-a131-48c8-ab37-76c73108a694 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:15.581630 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6e2447d2-279e-484f-ab40-7369c27c56b8 req-2990221f-a131-48c8-ab37-76c73108a694 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:15.582081 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6e2447d2-279e-484f-ab40-7369c27c56b8 req-2990221f-a131-48c8-ab37-76c73108a694 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:15.608293 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-6e2447d2-279e-484f-ab40-7369c27c56b8 req-2990221f-a131-48c8-ab37-76c73108a694 service nova] Creating event network-vif-deleted:15bc45ae-29c8-43ba-b356-ec2e6195d44f for instance 1ce139ca-0135-40eb-9654-26157715fc1a on n-h1-862964-3 Oct 29 01:51:15.619364 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-6e2447d2-279e-484f-ab40-7369c27c56b8 req-2990221f-a131-48c8-ab37-76c73108a694 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074331 Oct 29 01:51:15.620325 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3804/7390] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:51:16.312116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-79c379bc-d8f7-4203-8c84-2811028b7a4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:16.313935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-79c379bc-d8f7-4203-8c84-2811028b7a4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:16.320893 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79c379bc-d8f7-4203-8c84-2811028b7a4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:16.321770 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79c379bc-d8f7-4203-8c84-2811028b7a4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:16.322434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79c379bc-d8f7-4203-8c84-2811028b7a4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:16.323354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79c379bc-d8f7-4203-8c84-2811028b7a4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:16.324010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79c379bc-d8f7-4203-8c84-2811028b7a4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:16.324631 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-79c379bc-d8f7-4203-8c84-2811028b7a4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:16.402985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-79c379bc-d8f7-4203-8c84-2811028b7a4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:16.412279 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-79c379bc-d8f7-4203-8c84-2811028b7a4a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1225 microversion: 2.1 time: 0.104421 Oct 29 01:51:16.413598 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3587/7391] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:16 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:17.077378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-01020210-b19c-41ee-a7fc-449a8c896738 tempest-QuotasTestJSON-2028558593 tempest-QuotasTestJSON-2028558593-project] Calling method '.version_select at 0x7f9d96582040>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:17.132926 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-01020210-b19c-41ee-a7fc-449a8c896738 tempest-QuotasTestJSON-2028558593 tempest-QuotasTestJSON-2028558593-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/0d04d2dede0a4a4eb63e52b21aff6814/defaults" status: 200 len: 371 microversion: 2.1 time: 0.181550 Oct 29 01:51:17.133655 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3805/7392] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 29 01:51:16 2022] GET /compute/v2.1/os-quota-sets/0d04d2dede0a4a4eb63e52b21aff6814/defaults => generated 371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:51:17.146028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c7024174-a68c-4aea-b1aa-52e1a1c70199 tempest-QuotasTestJSON-2028558593 tempest-QuotasTestJSON-2028558593-project] Calling method '.version_select at 0x7f9d97e5f3a0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:17.231867 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c7024174-a68c-4aea-b1aa-52e1a1c70199 tempest-QuotasTestJSON-2028558593 tempest-QuotasTestJSON-2028558593-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/0d04d2dede0a4a4eb63e52b21aff6814" status: 200 len: 371 microversion: 2.1 time: 0.089796 Oct 29 01:51:17.232528 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3588/7393] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 29 01:51:17 2022] GET /compute/v2.1/os-quota-sets/0d04d2dede0a4a4eb63e52b21aff6814 => generated 371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:51:17.247556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cfb3b138-20dd-43cd-8961-1aaff1eaff99 tempest-QuotasTestJSON-2028558593 tempest-QuotasTestJSON-2028558593-project] Calling method '.version_select at 0x7f9d966e3820>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:17.317279 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cfb3b138-20dd-43cd-8961-1aaff1eaff99 tempest-QuotasTestJSON-2028558593 tempest-QuotasTestJSON-2028558593-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/0d04d2dede0a4a4eb63e52b21aff6814/defaults" status: 200 len: 371 microversion: 2.1 time: 0.074764 Oct 29 01:51:17.318295 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3806/7394] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 29 01:51:17 2022] GET /compute/v2.1/os-quota-sets/0d04d2dede0a4a4eb63e52b21aff6814/defaults => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:51:17.332571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1b781310-2a2e-4f58-9a0a-d9984a5288a9 tempest-QuotasTestJSON-2028558593 tempest-QuotasTestJSON-2028558593-project] Calling method '.version_select at 0x7f9d97a9eee0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:17.333144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c3cd2e08-39b9-4332-9827-a2cf086f2917 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d47fb2e5-7452-403b-a500-166701958f00", "device": "/dev/sdb"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:51:17.335455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c3cd2e08-39b9-4332-9827-a2cf086f2917 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:17.341817 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3cd2e08-39b9-4332-9827-a2cf086f2917 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:17.342346 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3cd2e08-39b9-4332-9827-a2cf086f2917 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:17.342790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3cd2e08-39b9-4332-9827-a2cf086f2917 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:17.343484 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3cd2e08-39b9-4332-9827-a2cf086f2917 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:17.343941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3cd2e08-39b9-4332-9827-a2cf086f2917 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:17.344583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c3cd2e08-39b9-4332-9827-a2cf086f2917 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:17.407873 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1b781310-2a2e-4f58-9a0a-d9984a5288a9 tempest-QuotasTestJSON-2028558593 tempest-QuotasTestJSON-2028558593-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/0d04d2dede0a4a4eb63e52b21aff6814" status: 200 len: 371 microversion: 2.1 time: 0.079081 Oct 29 01:51:17.408504 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3589/7395] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 29 01:51:17 2022] GET /compute/v2.1/os-quota-sets/0d04d2dede0a4a4eb63e52b21aff6814 => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:51:17.420860 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-08c2b942-3c22-4bba-8361-fb1ef84975c0 tempest-QuotasTestJSON-2028558593 tempest-QuotasTestJSON-2028558593-project] Calling method '.version_select at 0x7f9d97e79670>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:17.503925 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-08c2b942-3c22-4bba-8361-fb1ef84975c0 tempest-QuotasTestJSON-2028558593 tempest-QuotasTestJSON-2028558593-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/0d04d2dede0a4a4eb63e52b21aff6814?user_id=61fc0b62b59248119d49f7469fc6e1b4" status: 200 len: 371 microversion: 2.1 time: 0.086854 Oct 29 01:51:17.504545 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3590/7396] 10.222.0.26 () {58 vars in 1323 bytes} [Sat Oct 29 01:51:17 2022] GET /compute/v2.1/os-quota-sets/0d04d2dede0a4a4eb63e52b21aff6814?user_id=61fc0b62b59248119d49f7469fc6e1b4 => generated 371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:51:17.509969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e087597d-d443-4f4d-a866-b7f0136f30f4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:17.513272 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e087597d-d443-4f4d-a866-b7f0136f30f4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:17.518393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e087597d-d443-4f4d-a866-b7f0136f30f4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:17.523466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e087597d-d443-4f4d-a866-b7f0136f30f4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:17.523466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e087597d-d443-4f4d-a866-b7f0136f30f4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:17.523466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e087597d-d443-4f4d-a866-b7f0136f30f4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:17.523466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e087597d-d443-4f4d-a866-b7f0136f30f4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:17.523466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e087597d-d443-4f4d-a866-b7f0136f30f4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:17.600251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e087597d-d443-4f4d-a866-b7f0136f30f4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:17.609819 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e087597d-d443-4f4d-a866-b7f0136f30f4 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1225 microversion: 2.1 time: 0.104132 Oct 29 01:51:17.610424 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3591/7397] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:17 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:17.999068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:51:18.196140 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c3cd2e08-39b9-4332-9827-a2cf086f2917 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "POST /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.866743 Oct 29 01:51:18.198459 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3807/7398] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 29 01:51:17 2022] POST /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705/os-volume_attachments => generated 194 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:51:18.635134 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bc533b0e-ac4a-4034-a107-0dde44baf863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:18.636455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bc533b0e-ac4a-4034-a107-0dde44baf863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:18.648857 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc533b0e-ac4a-4034-a107-0dde44baf863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:18.649760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc533b0e-ac4a-4034-a107-0dde44baf863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:18.651823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc533b0e-ac4a-4034-a107-0dde44baf863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:18.653312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc533b0e-ac4a-4034-a107-0dde44baf863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:18.654380 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc533b0e-ac4a-4034-a107-0dde44baf863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:18.655337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bc533b0e-ac4a-4034-a107-0dde44baf863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:18.731028 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bc533b0e-ac4a-4034-a107-0dde44baf863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:18.739069 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bc533b0e-ac4a-4034-a107-0dde44baf863 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1225 microversion: 2.1 time: 0.109123 Oct 29 01:51:18.739653 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3592/7399] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:18 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:19.764523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2cb1bbcc-a940-47d0-b4fc-f018047d5468 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:19.765248 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2cb1bbcc-a940-47d0-b4fc-f018047d5468 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:19.772846 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cb1bbcc-a940-47d0-b4fc-f018047d5468 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:19.773362 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cb1bbcc-a940-47d0-b4fc-f018047d5468 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:19.773805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cb1bbcc-a940-47d0-b4fc-f018047d5468 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:19.774506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cb1bbcc-a940-47d0-b4fc-f018047d5468 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:19.775563 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cb1bbcc-a940-47d0-b4fc-f018047d5468 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:19.775992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cb1bbcc-a940-47d0-b4fc-f018047d5468 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:19.840706 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2cb1bbcc-a940-47d0-b4fc-f018047d5468 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:19.848883 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2cb1bbcc-a940-47d0-b4fc-f018047d5468 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1225 microversion: 2.1 time: 0.090362 Oct 29 01:51:19.849493 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3808/7400] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:19 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:20.873334 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-95b72bcf-918c-4ea2-bf51-a690e33527f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:20.874421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-95b72bcf-918c-4ea2-bf51-a690e33527f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:20.882179 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95b72bcf-918c-4ea2-bf51-a690e33527f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:20.886232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95b72bcf-918c-4ea2-bf51-a690e33527f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:20.886232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95b72bcf-918c-4ea2-bf51-a690e33527f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:20.886232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95b72bcf-918c-4ea2-bf51-a690e33527f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:20.886232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95b72bcf-918c-4ea2-bf51-a690e33527f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:20.886232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95b72bcf-918c-4ea2-bf51-a690e33527f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:20.921298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95b72bcf-918c-4ea2-bf51-a690e33527f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:20.921812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95b72bcf-918c-4ea2-bf51-a690e33527f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:20.922270 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-95b72bcf-918c-4ea2-bf51-a690e33527f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:20.922794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-95b72bcf-918c-4ea2-bf51-a690e33527f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lazy-loading 'fault' on Instance uuid 1ce139ca-0135-40eb-9654-26157715fc1a {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:51:21.000354 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-95b72bcf-918c-4ea2-bf51-a690e33527f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:21.013442 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-95b72bcf-918c-4ea2-bf51-a690e33527f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 200 len: 1230 microversion: 2.1 time: 0.144440 Oct 29 01:51:21.032704 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3593/7401] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:20 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 1230 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:51:22.039889 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4bc722f8-38c4-4b1a-8b5f-0d37294b1a75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:22.041321 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-4bc722f8-38c4-4b1a-8b5f-0d37294b1a75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:22.050852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bc722f8-38c4-4b1a-8b5f-0d37294b1a75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:22.051670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bc722f8-38c4-4b1a-8b5f-0d37294b1a75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:22.052453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bc722f8-38c4-4b1a-8b5f-0d37294b1a75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:22.053457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bc722f8-38c4-4b1a-8b5f-0d37294b1a75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:22.054141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bc722f8-38c4-4b1a-8b5f-0d37294b1a75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:22.054813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-4bc722f8-38c4-4b1a-8b5f-0d37294b1a75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-4bc722f8-38c4-4b1a-8b5f-0d37294b1a75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] HTTP exception thrown: Instance 1ce139ca-0135-40eb-9654-26157715fc1a could not be found. Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4bc722f8-38c4-4b1a-8b5f-0d37294b1a75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Request method failure captured: Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a HTTP/1.1 Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXISL1fYm1j7NXik3zsNtroj_Oy-crTrvQAeW5M-FwwtP3LsKgHXpuppTsI04rMuajP4UZsmStYeX1aQyWE5BokToP2AX7pO99qAjgwqGhP0Pb1MuaH07JyrTdqaWdL6Co3a2Gha0Gb4NOVY73erVtuC0neHUxTJ51YCufPzngi0azyM Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37416a9397fa4c6dbd0bfe8dee191577", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-TestVolumeBootPattern-743321222 Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8b8f36d10fa340f784581a3cf9a15606 Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 1ce139ca-0135-40eb-9654-26157715fc1a could not be found. Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '1ce139ca-0135-40eb-9654-26157715fc1a'} Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce139ca-0135-40eb-9654-26157715fc1a could not be found. Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:51:22.081263 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:51:22.092146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce139ca-0135-40eb-9654-26157715fc1a could not be found. Oct 29 01:51:22.092146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:51:22.092146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:51:22.092146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:51:22.092146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:51:22.092146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:51:22.092146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:51:22.092146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:51:22.092146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:51:22.092146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce139ca-0135-40eb-9654-26157715fc1a could not be found. Oct 29 01:51:22.092146 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:51:22.092146 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4bc722f8-38c4-4b1a-8b5f-0d37294b1a75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Returning 404 to user: Instance 1ce139ca-0135-40eb-9654-26157715fc1a could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:51:22.092146 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4bc722f8-38c4-4b1a-8b5f-0d37294b1a75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 404 len: 111 microversion: 2.1 time: 0.044705 Oct 29 01:51:22.092146 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3809/7402] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:22 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:51:22.214309 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4c125d18-5b1d-4b48-a8b3-4b996cabc8d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1983532172", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-161758843", "security_groups": [{"name": "tempest-secgroup-smoke-707530340"}], "block_device_mapping_v2": [{"uuid": "17d4820e-fd2f-45f5-a2f4-832db1f1cfe0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d488ed61-ddc0-4d3b-9833-017b49869cf3"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:51:22.335792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-4c125d18-5b1d-4b48-a8b3-4b996cabc8d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] validate_networks() for [('d488ed61-ddc0-4d3b-9833-017b49869cf3', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:51:22.755583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-4c125d18-5b1d-4b48-a8b3-4b996cabc8d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:51:22.756060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-4c125d18-5b1d-4b48-a8b3-4b996cabc8d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:51:22.756552 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-4c125d18-5b1d-4b48-a8b3-4b996cabc8d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:51:22.756979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-4c125d18-5b1d-4b48-a8b3-4b996cabc8d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:51:22.757444 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-4c125d18-5b1d-4b48-a8b3-4b996cabc8d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:51:22.766712 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c125d18-5b1d-4b48-a8b3-4b996cabc8d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:22.767216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c125d18-5b1d-4b48-a8b3-4b996cabc8d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:22.767675 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c125d18-5b1d-4b48-a8b3-4b996cabc8d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:22.768434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c125d18-5b1d-4b48-a8b3-4b996cabc8d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:22.768909 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c125d18-5b1d-4b48-a8b3-4b996cabc8d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:22.769385 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4c125d18-5b1d-4b48-a8b3-4b996cabc8d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:22.787281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-4c125d18-5b1d-4b48-a8b3-4b996cabc8d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Getting quotas for project 37416a9397fa4c6dbd0bfe8dee191577. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:51:22.793413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-4c125d18-5b1d-4b48-a8b3-4b996cabc8d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Getting quotas for user 8b8f36d10fa340f784581a3cf9a15606 and project 37416a9397fa4c6dbd0bfe8dee191577. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:51:22.855334 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4c125d18-5b1d-4b48-a8b3-4b996cabc8d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:51:22.857569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4c125d18-5b1d-4b48-a8b3-4b996cabc8d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='17d4820e-fd2f-45f5-a2f4-832db1f1cfe0',volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:51:23.174782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-39dbfb41-0168-4988-abce-74661a6bf28e tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] Calling method '.version_select at 0x7f9d96582e50>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:23.224418 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-39dbfb41-0168-4988-abce-74661a6bf28e tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8550c5fc-7502-43c7-9a2a-ca08c4c5e951" status: 200 len: 350 microversion: 2.1 time: 0.053462 Oct 29 01:51:23.225119 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3810/7403] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:51:23 2022] GET /compute/v2.1/os-volumes/8550c5fc-7502-43c7-9a2a-ca08c4c5e951 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:51:23.235645 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4c125d18-5b1d-4b48-a8b3-4b996cabc8d1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.025969 Oct 29 01:51:23.242598 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3594/7404] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:51:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:51:23.249208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d120cc87-0ffd-4c5f-90a4-2f4086c428e2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:23.249861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d120cc87-0ffd-4c5f-90a4-2f4086c428e2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:23.319790 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d120cc87-0ffd-4c5f-90a4-2f4086c428e2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:23.332354 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d120cc87-0ffd-4c5f-90a4-2f4086c428e2 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1094 microversion: 2.1 time: 0.086948 Oct 29 01:51:23.333962 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3811/7405] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:23 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:51:24.357461 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-dd7deba7-62c2-4bcb-86ec-c5871e0f2269 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:24.363150 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-dd7deba7-62c2-4bcb-86ec-c5871e0f2269 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:24.364572 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dd7deba7-62c2-4bcb-86ec-c5871e0f2269 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:24.365071 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dd7deba7-62c2-4bcb-86ec-c5871e0f2269 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:24.365542 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dd7deba7-62c2-4bcb-86ec-c5871e0f2269 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:24.366246 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dd7deba7-62c2-4bcb-86ec-c5871e0f2269 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:24.366715 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dd7deba7-62c2-4bcb-86ec-c5871e0f2269 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:24.367158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-dd7deba7-62c2-4bcb-86ec-c5871e0f2269 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:24.432963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-dd7deba7-62c2-4bcb-86ec-c5871e0f2269 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:24.441309 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-dd7deba7-62c2-4bcb-86ec-c5871e0f2269 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1144 microversion: 2.1 time: 0.089195 Oct 29 01:51:24.443420 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3595/7406] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:24 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:25.468756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0688f361-46a4-4177-82c9-52247259f8ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:25.469382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0688f361-46a4-4177-82c9-52247259f8ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:25.476852 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0688f361-46a4-4177-82c9-52247259f8ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:25.477404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0688f361-46a4-4177-82c9-52247259f8ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:25.477876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0688f361-46a4-4177-82c9-52247259f8ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:25.478617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0688f361-46a4-4177-82c9-52247259f8ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:25.479070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0688f361-46a4-4177-82c9-52247259f8ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:25.479529 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0688f361-46a4-4177-82c9-52247259f8ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:25.579234 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0688f361-46a4-4177-82c9-52247259f8ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:25.587246 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0688f361-46a4-4177-82c9-52247259f8ae tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1200 microversion: 2.1 time: 0.122509 Oct 29 01:51:25.588446 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3812/7407] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:25 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1200 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:26.117197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1817d009-bb86-451b-8ec3-3f85844529d2 tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] Calling method '.version_select at 0x7f9d97d22280>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:26.180690 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1817d009-bb86-451b-8ec3-3f85844529d2 tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3c076ab7-f8f2-4e20-a805-8a339cfdf26c" status: 200 len: 350 microversion: 2.1 time: 0.068461 Oct 29 01:51:26.183007 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3596/7408] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:51:26 2022] GET /compute/v2.1/os-volumes/3c076ab7-f8f2-4e20-a805-8a339cfdf26c => generated 350 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:51:26.613536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-30fcac12-d07c-45d3-8893-a64a101673e1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:26.613536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-30fcac12-d07c-45d3-8893-a64a101673e1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:26.621358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30fcac12-d07c-45d3-8893-a64a101673e1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:26.630080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30fcac12-d07c-45d3-8893-a64a101673e1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:26.632565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30fcac12-d07c-45d3-8893-a64a101673e1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:26.632968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30fcac12-d07c-45d3-8893-a64a101673e1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:26.633753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30fcac12-d07c-45d3-8893-a64a101673e1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:26.634269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-30fcac12-d07c-45d3-8893-a64a101673e1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:26.910400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-30fcac12-d07c-45d3-8893-a64a101673e1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:26.918867 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-30fcac12-d07c-45d3-8893-a64a101673e1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1277 microversion: 2.1 time: 0.311805 Oct 29 01:51:26.919725 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3813/7409] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:26 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1277 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:51:27.628209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-aab5ef51-d270-478c-8b97-982a294a7e62 req-e7de4e42-8be5-4f6d-96ad-b2010134f55c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe4dd02-cca8-4d99-ac6a-fde00c1b297b", "tag": "ec96047a-0566-4914-9228-e484f10a1ab9"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:51:27.643382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-aab5ef51-d270-478c-8b97-982a294a7e62 req-e7de4e42-8be5-4f6d-96ad-b2010134f55c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:27.644888 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-aab5ef51-d270-478c-8b97-982a294a7e62 req-e7de4e42-8be5-4f6d-96ad-b2010134f55c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:27.645966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-aab5ef51-d270-478c-8b97-982a294a7e62 req-e7de4e42-8be5-4f6d-96ad-b2010134f55c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:27.649635 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:51:27.661286 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-aab5ef51-d270-478c-8b97-982a294a7e62 req-e7de4e42-8be5-4f6d-96ad-b2010134f55c service nova] Creating event network-changed:ec96047a-0566-4914-9228-e484f10a1ab9 for instance 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b on n-h1-862964-3 Oct 29 01:51:27.668870 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-aab5ef51-d270-478c-8b97-982a294a7e62 req-e7de4e42-8be5-4f6d-96ad-b2010134f55c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045475 Oct 29 01:51:27.669907 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3597/7410] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:51:27.943795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2cc66c1b-28a3-40e6-872d-7a02ece8f02a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:27.945192 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2cc66c1b-28a3-40e6-872d-7a02ece8f02a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:27.954212 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cc66c1b-28a3-40e6-872d-7a02ece8f02a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:27.955235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cc66c1b-28a3-40e6-872d-7a02ece8f02a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:27.956079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cc66c1b-28a3-40e6-872d-7a02ece8f02a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:27.957744 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cc66c1b-28a3-40e6-872d-7a02ece8f02a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:27.958599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cc66c1b-28a3-40e6-872d-7a02ece8f02a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:27.959247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2cc66c1b-28a3-40e6-872d-7a02ece8f02a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:28.164721 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2cc66c1b-28a3-40e6-872d-7a02ece8f02a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:28.174499 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2cc66c1b-28a3-40e6-872d-7a02ece8f02a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1277 microversion: 2.1 time: 0.235012 Oct 29 01:51:28.177791 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3814/7411] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:27 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:28.923086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-42b8de20-22cb-4b6d-87d8-a916773c2a4a tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] Calling method '.version_select at 0x7f9d97c71790>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:28.972339 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-42b8de20-22cb-4b6d-87d8-a916773c2a4a tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/a6f4772e-e16d-4232-bb39-65f40d4e3c0c" status: 200 len: 351 microversion: 2.1 time: 0.054691 Oct 29 01:51:28.972927 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3598/7412] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 29 01:51:28 2022] GET /compute/v2.1/os-volumes/a6f4772e-e16d-4232-bb39-65f40d4e3c0c => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:51:28.986037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-efe42332-7d1b-400b-8c7e-4c2068d20ea9 tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] Calling method '.version_select at 0x7f9d9fefb280>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:29.073666 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-efe42332-7d1b-400b-8c7e-4c2068d20ea9 tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.091257 Oct 29 01:51:29.074273 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3815/7413] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Oct 29 01:51:28 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:29.089709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4fdf89a0-d120-499d-b4ae-1225e92b8700 tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] Calling method '.version_select at 0x7f9d9fe5f3a0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:29.178839 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4fdf89a0-d120-499d-b4ae-1225e92b8700 tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093640 Oct 29 01:51:29.179412 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3599/7414] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 29 01:51:29 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:51:29.194315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-38a9ee40-522f-46bf-9306-e7878745c3fc tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] Calling method '.version_select at 0x7f9d965af310>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:29.199083 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-29388bc5-e666-4519-833c-8a585565dc20 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:29.200525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-29388bc5-e666-4519-833c-8a585565dc20 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:29.207487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29388bc5-e666-4519-833c-8a585565dc20 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:29.207993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29388bc5-e666-4519-833c-8a585565dc20 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:29.208453 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29388bc5-e666-4519-833c-8a585565dc20 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:29.209195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29388bc5-e666-4519-833c-8a585565dc20 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:29.209807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29388bc5-e666-4519-833c-8a585565dc20 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:29.210242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-29388bc5-e666-4519-833c-8a585565dc20 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:29.286265 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-38a9ee40-522f-46bf-9306-e7878745c3fc tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.095928 Oct 29 01:51:29.287127 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3816/7415] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Oct 29 01:51:29 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:29.300669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cd5305b5-5cc9-457d-a6b8-d7825a76319e tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] Calling method '.version_select at 0x7f9d96798ca0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:29.385490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-29388bc5-e666-4519-833c-8a585565dc20 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:29.393788 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-29388bc5-e666-4519-833c-8a585565dc20 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1277 microversion: 2.1 time: 0.198515 Oct 29 01:51:29.394415 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3600/7416] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:29 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:51:29.418130 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cd5305b5-5cc9-457d-a6b8-d7825a76319e tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.121166 Oct 29 01:51:29.418706 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3817/7417] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Oct 29 01:51:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:51:29.432260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-eaef5f3b-5750-4efe-b320-af836b043d40 tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] Calling method '.version_select at 0x7f9d9febd160>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:29.516019 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-eaef5f3b-5750-4efe-b320-af836b043d40 tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087045 Oct 29 01:51:29.516605 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3601/7418] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Oct 29 01:51:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:51:29.531308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-3481d8fc-7c1b-4e9f-8ebc-ecac5afbeecb tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] Calling method '.version_select at 0x7f9d96600820>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:29.616644 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-3481d8fc-7c1b-4e9f-8ebc-ecac5afbeecb tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089303 Oct 29 01:51:29.617288 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3818/7419] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 29 01:51:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:29.631191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-91da7d24-5e0f-4fbc-aac4-11a89dd26f9e tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] Calling method '.version_select at 0x7f9d97c9c9d0>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:29.717235 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-91da7d24-5e0f-4fbc-aac4-11a89dd26f9e tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.089739 Oct 29 01:51:29.717817 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3602/7420] 10.222.0.26 () {58 vars in 1188 bytes} [Sat Oct 29 01:51:29 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:51:29.731518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-06f8f69a-6ef8-4183-891d-22bfe8c55d42 tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] Calling method '.version_select at 0x7f9d965af160>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:29.817130 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-06f8f69a-6ef8-4183-891d-22bfe8c55d42 tempest-VolumesTestJSON-1114794038 tempest-VolumesTestJSON-1114794038-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089830 Oct 29 01:51:29.817839 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3819/7421] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 29 01:51:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:30.418788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-843721b1-89f2-4374-acae-03fb6617d3cc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:30.419559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-843721b1-89f2-4374-acae-03fb6617d3cc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:30.427314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-843721b1-89f2-4374-acae-03fb6617d3cc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:30.428070 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-843721b1-89f2-4374-acae-03fb6617d3cc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:30.428624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-843721b1-89f2-4374-acae-03fb6617d3cc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:30.429476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-843721b1-89f2-4374-acae-03fb6617d3cc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:30.430049 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-843721b1-89f2-4374-acae-03fb6617d3cc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:30.430590 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-843721b1-89f2-4374-acae-03fb6617d3cc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:30.603522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-843721b1-89f2-4374-acae-03fb6617d3cc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:30.614071 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-843721b1-89f2-4374-acae-03fb6617d3cc tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1277 microversion: 2.1 time: 0.200267 Oct 29 01:51:30.629974 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3603/7422] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:30 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1277 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:31.641756 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e436ffe2-59a7-4fbe-b046-ab942bdf74f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:31.642540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e436ffe2-59a7-4fbe-b046-ab942bdf74f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:31.644819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:51:31.651200 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e436ffe2-59a7-4fbe-b046-ab942bdf74f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:31.651453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e436ffe2-59a7-4fbe-b046-ab942bdf74f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:31.651995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e436ffe2-59a7-4fbe-b046-ab942bdf74f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:31.652954 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e436ffe2-59a7-4fbe-b046-ab942bdf74f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:31.653512 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e436ffe2-59a7-4fbe-b046-ab942bdf74f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:31.654010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e436ffe2-59a7-4fbe-b046-ab942bdf74f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:31.833317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e436ffe2-59a7-4fbe-b046-ab942bdf74f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:31.842357 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e436ffe2-59a7-4fbe-b046-ab942bdf74f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1277 microversion: 2.1 time: 0.205845 Oct 29 01:51:31.842941 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3820/7423] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:31 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:32.865956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e01b5e44-2b10-49cd-8e81-e4cc53bbfa59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:32.866876 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e01b5e44-2b10-49cd-8e81-e4cc53bbfa59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:32.871281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:51:32.872224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=14 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:51:32.872983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:51:32.887441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e01b5e44-2b10-49cd-8e81-e4cc53bbfa59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:32.887441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e01b5e44-2b10-49cd-8e81-e4cc53bbfa59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:32.887441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e01b5e44-2b10-49cd-8e81-e4cc53bbfa59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:32.887441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e01b5e44-2b10-49cd-8e81-e4cc53bbfa59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:32.887441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e01b5e44-2b10-49cd-8e81-e4cc53bbfa59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:32.887441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e01b5e44-2b10-49cd-8e81-e4cc53bbfa59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:33.048967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e01b5e44-2b10-49cd-8e81-e4cc53bbfa59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:33.058683 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e01b5e44-2b10-49cd-8e81-e4cc53bbfa59 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1265 microversion: 2.1 time: 0.196738 Oct 29 01:51:33.059266 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3604/7424] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:32 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:34.085680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cd63af0d-9508-42e0-8bc4-4f41969a8174 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:34.088098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cd63af0d-9508-42e0-8bc4-4f41969a8174 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:34.097945 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:51:34.100148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cd63af0d-9508-42e0-8bc4-4f41969a8174 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:34.101013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cd63af0d-9508-42e0-8bc4-4f41969a8174 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:34.101768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cd63af0d-9508-42e0-8bc4-4f41969a8174 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:34.116784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cd63af0d-9508-42e0-8bc4-4f41969a8174 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:34.118966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cd63af0d-9508-42e0-8bc4-4f41969a8174 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:34.119532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cd63af0d-9508-42e0-8bc4-4f41969a8174 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:34.287386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cd63af0d-9508-42e0-8bc4-4f41969a8174 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:34.296595 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cd63af0d-9508-42e0-8bc4-4f41969a8174 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1265 microversion: 2.1 time: 0.216326 Oct 29 01:51:34.297558 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3821/7425] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:34 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:35.357634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-49595bcd-294d-43e5-b0e3-92ca2fceb8c7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:35.357634 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-49595bcd-294d-43e5-b0e3-92ca2fceb8c7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:35.365267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49595bcd-294d-43e5-b0e3-92ca2fceb8c7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:35.365778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49595bcd-294d-43e5-b0e3-92ca2fceb8c7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:35.366218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49595bcd-294d-43e5-b0e3-92ca2fceb8c7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:35.378509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49595bcd-294d-43e5-b0e3-92ca2fceb8c7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:35.379268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49595bcd-294d-43e5-b0e3-92ca2fceb8c7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:35.379734 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-49595bcd-294d-43e5-b0e3-92ca2fceb8c7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:35.566176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-49595bcd-294d-43e5-b0e3-92ca2fceb8c7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:35.574708 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-49595bcd-294d-43e5-b0e3-92ca2fceb8c7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1265 microversion: 2.1 time: 0.258506 Oct 29 01:51:35.575327 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3605/7426] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:35 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:36.598882 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5aa7b0ba-20a7-4999-9358-def175695c6b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:36.599556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5aa7b0ba-20a7-4999-9358-def175695c6b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:36.606624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5aa7b0ba-20a7-4999-9358-def175695c6b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:36.607111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5aa7b0ba-20a7-4999-9358-def175695c6b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:36.607552 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5aa7b0ba-20a7-4999-9358-def175695c6b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:36.608246 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5aa7b0ba-20a7-4999-9358-def175695c6b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:36.608708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5aa7b0ba-20a7-4999-9358-def175695c6b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:36.609132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5aa7b0ba-20a7-4999-9358-def175695c6b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:36.742348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5aa7b0ba-20a7-4999-9358-def175695c6b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:36.750402 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5aa7b0ba-20a7-4999-9358-def175695c6b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1265 microversion: 2.1 time: 0.155459 Oct 29 01:51:36.750978 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3822/7427] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:36 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:37.774266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6da08d83-c59b-41e9-a950-7147b02dbc9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:37.775010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6da08d83-c59b-41e9-a950-7147b02dbc9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:37.781596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6da08d83-c59b-41e9-a950-7147b02dbc9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:37.782171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6da08d83-c59b-41e9-a950-7147b02dbc9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:37.782700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6da08d83-c59b-41e9-a950-7147b02dbc9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:37.783475 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6da08d83-c59b-41e9-a950-7147b02dbc9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:37.784009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6da08d83-c59b-41e9-a950-7147b02dbc9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:37.784516 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6da08d83-c59b-41e9-a950-7147b02dbc9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:37.932904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6da08d83-c59b-41e9-a950-7147b02dbc9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:37.942252 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6da08d83-c59b-41e9-a950-7147b02dbc9e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1265 microversion: 2.1 time: 0.172108 Oct 29 01:51:37.943496 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3606/7428] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:37 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:38.972476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6a2b2fc8-4623-4ae6-b17c-283029650179 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:38.974723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6a2b2fc8-4623-4ae6-b17c-283029650179 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:38.983206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a2b2fc8-4623-4ae6-b17c-283029650179 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:38.983980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a2b2fc8-4623-4ae6-b17c-283029650179 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:38.984669 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a2b2fc8-4623-4ae6-b17c-283029650179 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:38.985608 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a2b2fc8-4623-4ae6-b17c-283029650179 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:38.986380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a2b2fc8-4623-4ae6-b17c-283029650179 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:38.986987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6a2b2fc8-4623-4ae6-b17c-283029650179 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:39.144361 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6a2b2fc8-4623-4ae6-b17c-283029650179 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:39.153056 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6a2b2fc8-4623-4ae6-b17c-283029650179 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1265 microversion: 2.1 time: 0.184821 Oct 29 01:51:39.153674 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3823/7429] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:38 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:40.176232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-501315e8-221c-4bcd-87d7-0e29b0c6c727 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:40.176986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-501315e8-221c-4bcd-87d7-0e29b0c6c727 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:40.184570 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-501315e8-221c-4bcd-87d7-0e29b0c6c727 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:40.185213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-501315e8-221c-4bcd-87d7-0e29b0c6c727 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:40.185776 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-501315e8-221c-4bcd-87d7-0e29b0c6c727 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:40.186636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-501315e8-221c-4bcd-87d7-0e29b0c6c727 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:40.187173 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-501315e8-221c-4bcd-87d7-0e29b0c6c727 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:40.187684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-501315e8-221c-4bcd-87d7-0e29b0c6c727 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:40.333447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-501315e8-221c-4bcd-87d7-0e29b0c6c727 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:40.343012 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-501315e8-221c-4bcd-87d7-0e29b0c6c727 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1265 microversion: 2.1 time: 0.170751 Oct 29 01:51:40.343599 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3607/7430] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:40 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:41.366174 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-788b3738-ef4a-4436-ae28-fe4092aa4e6f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:41.366781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-788b3738-ef4a-4436-ae28-fe4092aa4e6f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:41.375186 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-788b3738-ef4a-4436-ae28-fe4092aa4e6f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:41.375676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-788b3738-ef4a-4436-ae28-fe4092aa4e6f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:41.376111 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-788b3738-ef4a-4436-ae28-fe4092aa4e6f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:41.376813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-788b3738-ef4a-4436-ae28-fe4092aa4e6f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:41.377322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-788b3738-ef4a-4436-ae28-fe4092aa4e6f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:41.377747 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-788b3738-ef4a-4436-ae28-fe4092aa4e6f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:41.874061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-788b3738-ef4a-4436-ae28-fe4092aa4e6f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:41.883648 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-788b3738-ef4a-4436-ae28-fe4092aa4e6f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1265 microversion: 2.1 time: 0.521269 Oct 29 01:51:41.886065 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3824/7431] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:41 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1265 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:42.908844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-680c8984-96f8-4d55-9a56-a1b4f32929ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:42.909490 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-680c8984-96f8-4d55-9a56-a1b4f32929ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:42.916771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-680c8984-96f8-4d55-9a56-a1b4f32929ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:42.917300 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-680c8984-96f8-4d55-9a56-a1b4f32929ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:42.917746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-680c8984-96f8-4d55-9a56-a1b4f32929ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:42.918456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-680c8984-96f8-4d55-9a56-a1b4f32929ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:42.918929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-680c8984-96f8-4d55-9a56-a1b4f32929ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:42.919410 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-680c8984-96f8-4d55-9a56-a1b4f32929ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:43.122218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-ca787ff3-56aa-4e43-964f-5b36478d9cd7 req-3ff49594-7fe0-45c3-8d3d-0f121db83794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe4dd02-cca8-4d99-ac6a-fde00c1b297b", "name": "network-vif-plugged", "status": "completed", "tag": "ec96047a-0566-4914-9228-e484f10a1ab9"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:51:43.136766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-680c8984-96f8-4d55-9a56-a1b4f32929ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:43.146968 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-680c8984-96f8-4d55-9a56-a1b4f32929ea tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1265 microversion: 2.1 time: 0.242036 Oct 29 01:51:43.149214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ca787ff3-56aa-4e43-964f-5b36478d9cd7 req-3ff49594-7fe0-45c3-8d3d-0f121db83794 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:43.149906 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3608/7432] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:42 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:43.150033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ca787ff3-56aa-4e43-964f-5b36478d9cd7 req-3ff49594-7fe0-45c3-8d3d-0f121db83794 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:43.150033 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ca787ff3-56aa-4e43-964f-5b36478d9cd7 req-3ff49594-7fe0-45c3-8d3d-0f121db83794 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:43.163747 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-ca787ff3-56aa-4e43-964f-5b36478d9cd7 req-3ff49594-7fe0-45c3-8d3d-0f121db83794 service nova] Creating event network-vif-plugged:ec96047a-0566-4914-9228-e484f10a1ab9 for instance 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b on n-h1-862964-3 Oct 29 01:51:43.170601 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-ca787ff3-56aa-4e43-964f-5b36478d9cd7 req-3ff49594-7fe0-45c3-8d3d-0f121db83794 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054501 Oct 29 01:51:43.171330 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3825/7433] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:51:44.170397 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d77b8401-15a7-424a-bd6a-277cb26d16ab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:44.171166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d77b8401-15a7-424a-bd6a-277cb26d16ab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:44.179592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d77b8401-15a7-424a-bd6a-277cb26d16ab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:44.180350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d77b8401-15a7-424a-bd6a-277cb26d16ab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:44.180911 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d77b8401-15a7-424a-bd6a-277cb26d16ab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:44.181749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d77b8401-15a7-424a-bd6a-277cb26d16ab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:44.182314 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d77b8401-15a7-424a-bd6a-277cb26d16ab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:44.182818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d77b8401-15a7-424a-bd6a-277cb26d16ab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:44.326388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d77b8401-15a7-424a-bd6a-277cb26d16ab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:44.335154 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d77b8401-15a7-424a-bd6a-277cb26d16ab tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1265 microversion: 2.1 time: 0.168825 Oct 29 01:51:44.335736 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3609/7434] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:44 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:45.359807 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-26fce34a-99a8-480d-a6e8-fbffd338941e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:45.360518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-26fce34a-99a8-480d-a6e8-fbffd338941e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:45.367832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26fce34a-99a8-480d-a6e8-fbffd338941e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:45.368906 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26fce34a-99a8-480d-a6e8-fbffd338941e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:45.369383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26fce34a-99a8-480d-a6e8-fbffd338941e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:45.370089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26fce34a-99a8-480d-a6e8-fbffd338941e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:45.370542 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26fce34a-99a8-480d-a6e8-fbffd338941e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:45.370968 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-26fce34a-99a8-480d-a6e8-fbffd338941e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:45.559809 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-26fce34a-99a8-480d-a6e8-fbffd338941e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:45.567843 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-26fce34a-99a8-480d-a6e8-fbffd338941e tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1452 microversion: 2.1 time: 0.212875 Oct 29 01:51:45.568417 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3826/7435] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:45 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1452 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:45.591877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fa5c4be2-15d7-4ffc-96d4-97a5f72f896f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:45.592540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fa5c4be2-15d7-4ffc-96d4-97a5f72f896f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:45.599606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa5c4be2-15d7-4ffc-96d4-97a5f72f896f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:45.600147 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa5c4be2-15d7-4ffc-96d4-97a5f72f896f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:45.600606 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa5c4be2-15d7-4ffc-96d4-97a5f72f896f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:45.601362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa5c4be2-15d7-4ffc-96d4-97a5f72f896f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:45.601847 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa5c4be2-15d7-4ffc-96d4-97a5f72f896f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:45.602294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fa5c4be2-15d7-4ffc-96d4-97a5f72f896f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:45.739338 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fa5c4be2-15d7-4ffc-96d4-97a5f72f896f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:45.747699 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fa5c4be2-15d7-4ffc-96d4-97a5f72f896f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1452 microversion: 2.1 time: 0.160456 Oct 29 01:51:45.748284 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3610/7436] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:45 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:46.078442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fc9035ea-33ab-4d05-802b-8ef1af144f4d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:46.078941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fc9035ea-33ab-4d05-802b-8ef1af144f4d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:46.085139 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc9035ea-33ab-4d05-802b-8ef1af144f4d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:46.085661 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc9035ea-33ab-4d05-802b-8ef1af144f4d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:46.086103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc9035ea-33ab-4d05-802b-8ef1af144f4d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:46.086801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc9035ea-33ab-4d05-802b-8ef1af144f4d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:46.087822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc9035ea-33ab-4d05-802b-8ef1af144f4d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:46.088259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fc9035ea-33ab-4d05-802b-8ef1af144f4d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:46.176606 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-fc9035ea-33ab-4d05-802b-8ef1af144f4d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lazy-loading 'services' on Instance uuid 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:51:46.416709 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fc9035ea-33ab-4d05-802b-8ef1af144f4d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "DELETE /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705/os-volume_attachments/d47fb2e5-7452-403b-a500-166701958f00" status: 202 len: 0 microversion: 2.1 time: 0.340594 Oct 29 01:51:46.432006 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3827/7437] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 29 01:51:46 2022] DELETE /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705/os-volume_attachments/d47fb2e5-7452-403b-a500-166701958f00 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:51:47.916743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-48af6d11-00c6-4dd0-8fa3-6eb38f288308 req-3350d450-0853-406f-bb6e-92d215017d9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe4dd02-cca8-4d99-ac6a-fde00c1b297b", "tag": "ec96047a-0566-4914-9228-e484f10a1ab9"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:51:47.927738 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-48af6d11-00c6-4dd0-8fa3-6eb38f288308 req-3350d450-0853-406f-bb6e-92d215017d9a service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:47.931680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-48af6d11-00c6-4dd0-8fa3-6eb38f288308 req-3350d450-0853-406f-bb6e-92d215017d9a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:47.931680 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-48af6d11-00c6-4dd0-8fa3-6eb38f288308 req-3350d450-0853-406f-bb6e-92d215017d9a service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:47.941433 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-48af6d11-00c6-4dd0-8fa3-6eb38f288308 req-3350d450-0853-406f-bb6e-92d215017d9a service nova] Creating event network-changed:ec96047a-0566-4914-9228-e484f10a1ab9 for instance 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b on n-h1-862964-3 Oct 29 01:51:47.947551 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-48af6d11-00c6-4dd0-8fa3-6eb38f288308 req-3350d450-0853-406f-bb6e-92d215017d9a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034281 Oct 29 01:51:47.948587 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3611/7438] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:51:51.898924 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-268897ea-b060-49cf-9881-c89b42b09de9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:51.899534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-268897ea-b060-49cf-9881-c89b42b09de9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:51.906471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-268897ea-b060-49cf-9881-c89b42b09de9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:51.908779 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-268897ea-b060-49cf-9881-c89b42b09de9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:51.909528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-268897ea-b060-49cf-9881-c89b42b09de9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:51.910274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-268897ea-b060-49cf-9881-c89b42b09de9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:51.910712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-268897ea-b060-49cf-9881-c89b42b09de9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:51.911131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-268897ea-b060-49cf-9881-c89b42b09de9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:51.916909 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:51:51.943253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-268897ea-b060-49cf-9881-c89b42b09de9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:51:52.229443 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-268897ea-b060-49cf-9881-c89b42b09de9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "DELETE /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 204 len: 0 microversion: 2.1 time: 0.335275 Oct 29 01:51:52.230063 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3828/7439] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:51:51 2022] DELETE /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:51:52.240123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b27a93ea-f9c3-4f80-b853-624acc08c1e9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:52.240880 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b27a93ea-f9c3-4f80-b853-624acc08c1e9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:52.247791 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b27a93ea-f9c3-4f80-b853-624acc08c1e9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:52.248299 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b27a93ea-f9c3-4f80-b853-624acc08c1e9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:52.248760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b27a93ea-f9c3-4f80-b853-624acc08c1e9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:52.249522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b27a93ea-f9c3-4f80-b853-624acc08c1e9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:52.250339 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b27a93ea-f9c3-4f80-b853-624acc08c1e9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:52.250447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b27a93ea-f9c3-4f80-b853-624acc08c1e9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:52.396074 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b27a93ea-f9c3-4f80-b853-624acc08c1e9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:52.404314 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b27a93ea-f9c3-4f80-b853-624acc08c1e9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1515 microversion: 2.1 time: 0.169573 Oct 29 01:51:52.404992 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3612/7440] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:52 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:53.428714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-40a96f8b-e9de-435f-b9fb-0c6ba8d35012 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:53.429437 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-40a96f8b-e9de-435f-b9fb-0c6ba8d35012 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:53.436060 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40a96f8b-e9de-435f-b9fb-0c6ba8d35012 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:53.436586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40a96f8b-e9de-435f-b9fb-0c6ba8d35012 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:53.437016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40a96f8b-e9de-435f-b9fb-0c6ba8d35012 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:53.437881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40a96f8b-e9de-435f-b9fb-0c6ba8d35012 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:53.438332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40a96f8b-e9de-435f-b9fb-0c6ba8d35012 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:53.438754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-40a96f8b-e9de-435f-b9fb-0c6ba8d35012 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:53.585952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-40a96f8b-e9de-435f-b9fb-0c6ba8d35012 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:53.595364 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-40a96f8b-e9de-435f-b9fb-0c6ba8d35012 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1515 microversion: 2.1 time: 0.170974 Oct 29 01:51:53.596015 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3829/7441] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:53 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:54.619144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3e5e7010-2800-4451-a0d7-2e147452a8f9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:54.621032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3e5e7010-2800-4451-a0d7-2e147452a8f9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:54.628178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e5e7010-2800-4451-a0d7-2e147452a8f9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:54.628702 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e5e7010-2800-4451-a0d7-2e147452a8f9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:54.629205 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e5e7010-2800-4451-a0d7-2e147452a8f9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:54.629846 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e5e7010-2800-4451-a0d7-2e147452a8f9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:54.630499 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e5e7010-2800-4451-a0d7-2e147452a8f9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:54.631111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3e5e7010-2800-4451-a0d7-2e147452a8f9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:54.742832 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3e5e7010-2800-4451-a0d7-2e147452a8f9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:54.751848 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3e5e7010-2800-4451-a0d7-2e147452a8f9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1473 microversion: 2.1 time: 0.137448 Oct 29 01:51:54.762905 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3613/7442] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:54 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1473 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:54.763980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-d3fd2d4d-b8cf-4523-b627-021deb8a196a req-5a1903d9-75ba-4f90-a73c-78174c8acf8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d7f8cf-e7f4-46cb-adeb-8de5c26e5705", "name": "network-vif-deleted", "tag": "8c5af379-5f85-441a-a27b-ff57aefddae8"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:51:54.774953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d3fd2d4d-b8cf-4523-b627-021deb8a196a req-5a1903d9-75ba-4f90-a73c-78174c8acf8d service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:54.775441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d3fd2d4d-b8cf-4523-b627-021deb8a196a req-5a1903d9-75ba-4f90-a73c-78174c8acf8d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:54.775876 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d3fd2d4d-b8cf-4523-b627-021deb8a196a req-5a1903d9-75ba-4f90-a73c-78174c8acf8d service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:54.787333 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-d3fd2d4d-b8cf-4523-b627-021deb8a196a req-5a1903d9-75ba-4f90-a73c-78174c8acf8d service nova] Creating event network-vif-deleted:8c5af379-5f85-441a-a27b-ff57aefddae8 for instance 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 on n-h2-862964-3 Oct 29 01:51:54.793109 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-d3fd2d4d-b8cf-4523-b627-021deb8a196a req-5a1903d9-75ba-4f90-a73c-78174c8acf8d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032746 Oct 29 01:51:54.793839 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3830/7443] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:51:55.775694 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6984b23b-8a92-4941-af82-1e62e72a35b1 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:55.776557 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6984b23b-8a92-4941-af82-1e62e72a35b1 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:55.783592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6984b23b-8a92-4941-af82-1e62e72a35b1 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:55.784081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6984b23b-8a92-4941-af82-1e62e72a35b1 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:55.784529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6984b23b-8a92-4941-af82-1e62e72a35b1 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:55.785269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6984b23b-8a92-4941-af82-1e62e72a35b1 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:55.785743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6984b23b-8a92-4941-af82-1e62e72a35b1 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:55.786182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6984b23b-8a92-4941-af82-1e62e72a35b1 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:55.819109 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6984b23b-8a92-4941-af82-1e62e72a35b1 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:55.819431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6984b23b-8a92-4941-af82-1e62e72a35b1 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:55.819884 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6984b23b-8a92-4941-af82-1e62e72a35b1 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:55.820353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-6984b23b-8a92-4941-af82-1e62e72a35b1 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lazy-loading 'fault' on Instance uuid 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:51:55.869496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6984b23b-8a92-4941-af82-1e62e72a35b1 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:55.877103 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6984b23b-8a92-4941-af82-1e62e72a35b1 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 200 len: 1309 microversion: 2.1 time: 0.105491 Oct 29 01:51:55.877713 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3614/7444] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:55 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:51:56.905717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-36bc7e89-16d2-4460-abe4-42c5bd9e12e2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:56.906422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-36bc7e89-16d2-4460-abe4-42c5bd9e12e2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:56.912689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36bc7e89-16d2-4460-abe4-42c5bd9e12e2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:56.913301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36bc7e89-16d2-4460-abe4-42c5bd9e12e2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:56.913638 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36bc7e89-16d2-4460-abe4-42c5bd9e12e2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:56.914330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36bc7e89-16d2-4460-abe4-42c5bd9e12e2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:56.914785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36bc7e89-16d2-4460-abe4-42c5bd9e12e2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:56.915211 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36bc7e89-16d2-4460-abe4-42c5bd9e12e2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:56.928649 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-36bc7e89-16d2-4460-abe4-42c5bd9e12e2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] HTTP exception thrown: Instance 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 could not be found. Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-36bc7e89-16d2-4460-abe4-42c5bd9e12e2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Request method failure captured: Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 HTTP/1.1 Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIaRXhYnazBRxoQPafx5Y51qxjAORkHIgJGCLxikPvH9PjuAuJWKsw_zEaxXXIM7LErHLNMpkysTK8LPY0F_arphA5S4aTQuxamSLeXgnQF8rDGPHrIj23Ya16JIdA_8x8qZVkQRf03YX4QyPKN1Jr-PuK342CKZJP6ro8yDxzNPPe8 Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: fb7c458477cc4d71a48f4ec5a26cd5fb Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-VolumesSnapshotTestJSON-595634625 Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb7c458477cc4d71a48f4ec5a26cd5fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fb7c458477cc4d71a48f4ec5a26cd5fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb7c458477cc4d71a48f4ec5a26cd5fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fb7c458477cc4d71a48f4ec5a26cd5fb", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-VolumesSnapshotTestJSON-595634625 Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: fb7c458477cc4d71a48f4ec5a26cd5fb Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-595634625 Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-VolumesSnapshotTestJSON-595634625-project Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 287462f4874545a4855566877dc72034 Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-VolumesSnapshotTestJSON-595634625-project Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 could not be found. Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '90d7f8cf-e7f4-46cb-adeb-8de5c26e5705'} Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 could not be found. Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 could not be found. Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:51:56.930317 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:51:56.940245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:51:56.940245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:51:56.940245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:51:56.940245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:51:56.940245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:51:56.940245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 could not be found. Oct 29 01:51:56.940245 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:51:56.940245 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-36bc7e89-16d2-4460-abe4-42c5bd9e12e2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Returning 404 to user: Instance 90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:51:56.940245 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-36bc7e89-16d2-4460-abe4-42c5bd9e12e2 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705" status: 404 len: 111 microversion: 2.1 time: 0.031922 Oct 29 01:51:56.940245 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3831/7445] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:56 2022] GET /compute/v2.1/servers/90d7f8cf-e7f4-46cb-adeb-8de5c26e5705 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:51:58.368711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-677e0530-65ab-4bae-a159-de7ad2cb2ed5 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:58.371065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-677e0530-65ab-4bae-a159-de7ad2cb2ed5 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:58.377213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-677e0530-65ab-4bae-a159-de7ad2cb2ed5 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:58.377906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-677e0530-65ab-4bae-a159-de7ad2cb2ed5 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:58.379574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-677e0530-65ab-4bae-a159-de7ad2cb2ed5 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:58.379574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-677e0530-65ab-4bae-a159-de7ad2cb2ed5 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:58.379574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-677e0530-65ab-4bae-a159-de7ad2cb2ed5 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:58.379948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-677e0530-65ab-4bae-a159-de7ad2cb2ed5 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:58.409957 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-677e0530-65ab-4bae-a159-de7ad2cb2ed5 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:51:58.763967 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-677e0530-65ab-4bae-a159-de7ad2cb2ed5 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 204 len: 0 microversion: 2.1 time: 0.655394 Oct 29 01:51:58.764601 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3615/7446] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:51:58 2022] DELETE /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 0 bytes in 657 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:51:58.772896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-692b8808-9774-4616-a8bc-ae9fb492b57e tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:51:58.776692 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-692b8808-9774-4616-a8bc-ae9fb492b57e tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:51:58.784940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-692b8808-9774-4616-a8bc-ae9fb492b57e tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:58.786170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-692b8808-9774-4616-a8bc-ae9fb492b57e tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:58.786858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-692b8808-9774-4616-a8bc-ae9fb492b57e tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:58.787618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-692b8808-9774-4616-a8bc-ae9fb492b57e tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:51:58.788128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-692b8808-9774-4616-a8bc-ae9fb492b57e tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:51:58.788755 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-692b8808-9774-4616-a8bc-ae9fb492b57e tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:51:59.003833 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-692b8808-9774-4616-a8bc-ae9fb492b57e tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:51:59.012754 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-692b8808-9774-4616-a8bc-ae9fb492b57e tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1733 microversion: 2.1 time: 0.243680 Oct 29 01:51:59.013357 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3832/7447] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:51:58 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1733 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:52:00.038436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-409ef378-cee3-4703-b15e-4a143dc2f729 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:00.039065 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-409ef378-cee3-4703-b15e-4a143dc2f729 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:00.050669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-409ef378-cee3-4703-b15e-4a143dc2f729 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:00.057869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-409ef378-cee3-4703-b15e-4a143dc2f729 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:00.057869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-409ef378-cee3-4703-b15e-4a143dc2f729 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:00.057869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-409ef378-cee3-4703-b15e-4a143dc2f729 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:00.057869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-409ef378-cee3-4703-b15e-4a143dc2f729 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:00.057869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-409ef378-cee3-4703-b15e-4a143dc2f729 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:00.092434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:52:00.453827 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-409ef378-cee3-4703-b15e-4a143dc2f729 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:52:00.465497 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-409ef378-cee3-4703-b15e-4a143dc2f729 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1733 microversion: 2.1 time: 0.431721 Oct 29 01:52:00.467032 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3616/7448] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:00 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1733 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:52:01.113368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-cb519ad6-dc6f-452a-b902-0f0b295e7579 req-5825af1a-88d7-4efc-9f66-5c6d8517e5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c350c1d-73f3-486a-b0db-62b11cb9e94b", "name": "network-vif-deleted", "tag": "e6dfa47d-bb94-49fc-b30b-ddd42ba7e60c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:52:01.129676 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cb519ad6-dc6f-452a-b902-0f0b295e7579 req-5825af1a-88d7-4efc-9f66-5c6d8517e5c5 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:01.130229 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cb519ad6-dc6f-452a-b902-0f0b295e7579 req-5825af1a-88d7-4efc-9f66-5c6d8517e5c5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:01.130994 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-cb519ad6-dc6f-452a-b902-0f0b295e7579 req-5825af1a-88d7-4efc-9f66-5c6d8517e5c5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:01.144366 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-cb519ad6-dc6f-452a-b902-0f0b295e7579 req-5825af1a-88d7-4efc-9f66-5c6d8517e5c5 service nova] Creating event network-vif-deleted:e6dfa47d-bb94-49fc-b30b-ddd42ba7e60c for instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b on n-h1-862964-3 Oct 29 01:52:01.151513 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-cb519ad6-dc6f-452a-b902-0f0b295e7579 req-5825af1a-88d7-4efc-9f66-5c6d8517e5c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041720 Oct 29 01:52:01.152520 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3833/7449] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:52:01.490727 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f29ba052-f62e-457f-8570-be1e735efb94 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:01.496620 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f29ba052-f62e-457f-8570-be1e735efb94 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:01.502586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f29ba052-f62e-457f-8570-be1e735efb94 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:01.503094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f29ba052-f62e-457f-8570-be1e735efb94 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:01.503541 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f29ba052-f62e-457f-8570-be1e735efb94 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:01.504325 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f29ba052-f62e-457f-8570-be1e735efb94 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:01.504823 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f29ba052-f62e-457f-8570-be1e735efb94 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:01.505298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f29ba052-f62e-457f-8570-be1e735efb94 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:01.541816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f29ba052-f62e-457f-8570-be1e735efb94 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:01.542562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f29ba052-f62e-457f-8570-be1e735efb94 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:01.542968 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f29ba052-f62e-457f-8570-be1e735efb94 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:01.543438 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-f29ba052-f62e-457f-8570-be1e735efb94 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lazy-loading 'fault' on Instance uuid 3c350c1d-73f3-486a-b0db-62b11cb9e94b {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:52:01.604332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f29ba052-f62e-457f-8570-be1e735efb94 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a39c840d5324ac19096e7c133e85da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4de4292db14d31bb9496569c083433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:52:01.613999 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f29ba052-f62e-457f-8570-be1e735efb94 tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 200 len: 1387 microversion: 2.1 time: 0.127136 Oct 29 01:52:01.615506 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3617/7450] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:01 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 1387 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:52:02.645086 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d5f62922-6864-42ac-b030-84a5df4ebfdc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:02.646582 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d5f62922-6864-42ac-b030-84a5df4ebfdc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:02.651239 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:52:02.657148 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5f62922-6864-42ac-b030-84a5df4ebfdc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:02.657853 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5f62922-6864-42ac-b030-84a5df4ebfdc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:02.658571 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5f62922-6864-42ac-b030-84a5df4ebfdc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:02.659459 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5f62922-6864-42ac-b030-84a5df4ebfdc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:02.660108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5f62922-6864-42ac-b030-84a5df4ebfdc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:02.660713 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d5f62922-6864-42ac-b030-84a5df4ebfdc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:02.689053 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-d5f62922-6864-42ac-b030-84a5df4ebfdc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] HTTP exception thrown: Instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b could not be found. Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d5f62922-6864-42ac-b030-84a5df4ebfdc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Request method failure captured: Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b HTTP/1.1 Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIXWScUfsM48ppsGt-1waGJVEjJUXGV5hvt6Zu7HOhII8xkFMaMT8zB4nGbF_d9RNjcCEVa0C-TLaiKNyksyiDeIbpQEL_WpmfZc85Eu0z9E0euKrdW1-rhRLMgg4e-LRGF9LuFTnSZHiS0DW0J__iWcminSMPYIfogFde_xasHbbA0 Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 9b4de4292db14d31bb9496569c083433 Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-TestServerBasicOps-1796774184 Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b4de4292db14d31bb9496569c083433"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9b4de4292db14d31bb9496569c083433"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b4de4292db14d31bb9496569c083433"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9b4de4292db14d31bb9496569c083433", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-TestServerBasicOps-1796774184 Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 9b4de4292db14d31bb9496569c083433 Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-TestServerBasicOps-1796774184 Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-TestServerBasicOps-1796774184-project Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 7a39c840d5324ac19096e7c133e85da7 Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-TestServerBasicOps-1796774184-project Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b could not be found. Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '3c350c1d-73f3-486a-b0db-62b11cb9e94b'} Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b could not be found. Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b could not be found. Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:52:02.690792 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:52:02.698525 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:52:02.698525 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:52:02.698525 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:52:02.698525 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:52:02.698525 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:52:02.698525 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b could not be found. Oct 29 01:52:02.698525 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:52:02.698525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d5f62922-6864-42ac-b030-84a5df4ebfdc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Returning 404 to user: Instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:52:02.698525 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d5f62922-6864-42ac-b030-84a5df4ebfdc tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 404 len: 111 microversion: 2.1 time: 0.052140 Oct 29 01:52:02.698525 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3834/7451] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:02 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:52:03.632495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6e12e802-91b3-4b0e-862f-c79b6bdda10f tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:03.633019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6e12e802-91b3-4b0e-862f-c79b6bdda10f tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:03.636799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:52:03.641585 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e12e802-91b3-4b0e-862f-c79b6bdda10f tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:03.644574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e12e802-91b3-4b0e-862f-c79b6bdda10f tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:03.644574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e12e802-91b3-4b0e-862f-c79b6bdda10f tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:03.644574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e12e802-91b3-4b0e-862f-c79b6bdda10f tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:03.644574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e12e802-91b3-4b0e-862f-c79b6bdda10f tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:03.644574 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6e12e802-91b3-4b0e-862f-c79b6bdda10f tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:03.658590 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-6e12e802-91b3-4b0e-862f-c79b6bdda10f tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] HTTP exception thrown: Instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b could not be found. Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6e12e802-91b3-4b0e-862f-c79b6bdda10f tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Request method failure captured: Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b HTTP/1.1 Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIXWScUfsM48ppsGt-1waGJVEjJUXGV5hvt6Zu7HOhII8xkFMaMT8zB4nGbF_d9RNjcCEVa0C-TLaiKNyksyiDeIbpQEL_WpmfZc85Eu0z9E0euKrdW1-rhRLMgg4e-LRGF9LuFTnSZHiS0DW0J__iWcminSMPYIfogFde_xasHbbA0 Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 9b4de4292db14d31bb9496569c083433 Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TestServerBasicOps-1796774184 Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b4de4292db14d31bb9496569c083433"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9b4de4292db14d31bb9496569c083433"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b4de4292db14d31bb9496569c083433"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9b4de4292db14d31bb9496569c083433", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TestServerBasicOps-1796774184 Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 9b4de4292db14d31bb9496569c083433 Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TestServerBasicOps-1796774184 Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TestServerBasicOps-1796774184-project Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 7a39c840d5324ac19096e7c133e85da7 Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TestServerBasicOps-1796774184-project Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b could not be found. Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '3c350c1d-73f3-486a-b0db-62b11cb9e94b'} Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b could not be found. Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:52:03.660262 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:52:03.668414 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b could not be found. Oct 29 01:52:03.668414 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:52:03.668414 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:52:03.668414 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:52:03.668414 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:52:03.668414 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:52:03.668414 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:52:03.668414 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:52:03.668414 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:52:03.668414 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b could not be found. Oct 29 01:52:03.668414 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:52:03.668414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6e12e802-91b3-4b0e-862f-c79b6bdda10f tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Returning 404 to user: Instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:52:03.668414 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6e12e802-91b3-4b0e-862f-c79b6bdda10f tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 404 len: 111 microversion: 2.1 time: 0.033105 Oct 29 01:52:03.668414 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3618/7452] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:52:03 2022] DELETE /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:52:03.671794 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d7493c3e-026c-49f8-9b22-deea4b7902be tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:03.672499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d7493c3e-026c-49f8-9b22-deea4b7902be tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] [instance: 3c350c1d-73f3-486a-b0db-62b11cb9e94b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:03.681389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7493c3e-026c-49f8-9b22-deea4b7902be tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:03.682603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7493c3e-026c-49f8-9b22-deea4b7902be tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:03.683084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7493c3e-026c-49f8-9b22-deea4b7902be tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:03.683931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7493c3e-026c-49f8-9b22-deea4b7902be tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:03.684462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7493c3e-026c-49f8-9b22-deea4b7902be tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:03.684987 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d7493c3e-026c-49f8-9b22-deea4b7902be tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:03.702704 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-d7493c3e-026c-49f8-9b22-deea4b7902be tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] HTTP exception thrown: Instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b could not be found. Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d7493c3e-026c-49f8-9b22-deea4b7902be tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Request method failure captured: Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b HTTP/1.1 Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIXWScUfsM48ppsGt-1waGJVEjJUXGV5hvt6Zu7HOhII8xkFMaMT8zB4nGbF_d9RNjcCEVa0C-TLaiKNyksyiDeIbpQEL_WpmfZc85Eu0z9E0euKrdW1-rhRLMgg4e-LRGF9LuFTnSZHiS0DW0J__iWcminSMPYIfogFde_xasHbbA0 Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 9b4de4292db14d31bb9496569c083433 Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-TestServerBasicOps-1796774184 Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b4de4292db14d31bb9496569c083433"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9b4de4292db14d31bb9496569c083433"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b4de4292db14d31bb9496569c083433"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9b4de4292db14d31bb9496569c083433", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-TestServerBasicOps-1796774184 Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 9b4de4292db14d31bb9496569c083433 Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-TestServerBasicOps-1796774184 Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-TestServerBasicOps-1796774184-project Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 7a39c840d5324ac19096e7c133e85da7 Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-TestServerBasicOps-1796774184-project Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b could not be found. Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '3c350c1d-73f3-486a-b0db-62b11cb9e94b'} Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b could not be found. Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b could not be found. Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:52:03.704579 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:52:03.710565 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:52:03.710565 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:52:03.710565 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:52:03.710565 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:52:03.710565 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:52:03.710565 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b could not be found. Oct 29 01:52:03.710565 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:52:03.710565 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d7493c3e-026c-49f8-9b22-deea4b7902be tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Returning 404 to user: Instance 3c350c1d-73f3-486a-b0db-62b11cb9e94b could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:52:03.710565 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d7493c3e-026c-49f8-9b22-deea4b7902be tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b" status: 404 len: 111 microversion: 2.1 time: 0.039322 Oct 29 01:52:03.710565 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3835/7453] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:03 2022] GET /compute/v2.1/servers/3c350c1d-73f3-486a-b0db-62b11cb9e94b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:52:03.993308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-760dfdb0-4923-446b-89d7-6aff86900a3b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] Calling method '.version_select at 0x7f9d97e79670>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:04.106619 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-760dfdb0-4923-446b-89d7-6aff86900a3b tempest-TestServerBasicOps-1796774184 tempest-TestServerBasicOps-1796774184-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-400162276" status: 202 len: 0 microversion: 2.1 time: 0.127141 Oct 29 01:52:04.107196 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3619/7454] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 29 01:52:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-400162276 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:52:05.421349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-20969de8-b4a1-4264-bcd0-acb78c8c7e2d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1886904955", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "ce11f055-49de-4753-8e4f-bd88746d6fc1"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:52:05.508775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-20969de8-b4a1-4264-bcd0-acb78c8c7e2d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] validate_networks() for [('ce11f055-49de-4753-8e4f-bd88746d6fc1', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:52:06.282256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-20969de8-b4a1-4264-bcd0-acb78c8c7e2d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:52:06.282683 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-20969de8-b4a1-4264-bcd0-acb78c8c7e2d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:52:06.283168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-20969de8-b4a1-4264-bcd0-acb78c8c7e2d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:52:06.283588 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-20969de8-b4a1-4264-bcd0-acb78c8c7e2d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:52:06.284013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-20969de8-b4a1-4264-bcd0-acb78c8c7e2d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:52:06.300439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20969de8-b4a1-4264-bcd0-acb78c8c7e2d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:06.301805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20969de8-b4a1-4264-bcd0-acb78c8c7e2d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:06.302605 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20969de8-b4a1-4264-bcd0-acb78c8c7e2d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:06.307709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20969de8-b4a1-4264-bcd0-acb78c8c7e2d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:06.307709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20969de8-b4a1-4264-bcd0-acb78c8c7e2d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:06.307709 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-20969de8-b4a1-4264-bcd0-acb78c8c7e2d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:06.347913 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-20969de8-b4a1-4264-bcd0-acb78c8c7e2d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Getting quotas for project fb7c458477cc4d71a48f4ec5a26cd5fb. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:52:06.360325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-20969de8-b4a1-4264-bcd0-acb78c8c7e2d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Getting quotas for user 287462f4874545a4855566877dc72034 and project fb7c458477cc4d71a48f4ec5a26cd5fb. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:52:06.377787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-20969de8-b4a1-4264-bcd0-acb78c8c7e2d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:52:06.380462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-20969de8-b4a1-4264-bcd0-acb78c8c7e2d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:52:06.506433 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-20969de8-b4a1-4264-bcd0-acb78c8c7e2d tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.089445 Oct 29 01:52:06.508330 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3836/7455] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:52:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:52:06.526904 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4a256395-ee8c-4ff2-8de5-172899922ea9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:06.527639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4a256395-ee8c-4ff2-8de5-172899922ea9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:06.609081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4a256395-ee8c-4ff2-8de5-172899922ea9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:52:06.621600 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4a256395-ee8c-4ff2-8de5-172899922ea9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e" status: 200 len: 1219 microversion: 2.1 time: 0.104751 Oct 29 01:52:06.624553 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3620/7456] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:06 2022] GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:52:07.648068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5fbc4beb-e132-4ac7-bd1e-05b9864c5503 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:07.648856 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5fbc4beb-e132-4ac7-bd1e-05b9864c5503 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:07.717671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5fbc4beb-e132-4ac7-bd1e-05b9864c5503 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:52:07.725238 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5fbc4beb-e132-4ac7-bd1e-05b9864c5503 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e" status: 200 len: 1219 microversion: 2.1 time: 0.082340 Oct 29 01:52:07.725981 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3837/7457] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:07 2022] GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:52:08.749086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cd1218c7-d207-4c79-be2e-b6f8741b3cec tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:08.749810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cd1218c7-d207-4c79-be2e-b6f8741b3cec tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:08.759097 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd1218c7-d207-4c79-be2e-b6f8741b3cec tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:08.760696 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd1218c7-d207-4c79-be2e-b6f8741b3cec tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:08.761343 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd1218c7-d207-4c79-be2e-b6f8741b3cec tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:08.762069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd1218c7-d207-4c79-be2e-b6f8741b3cec tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:08.762795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd1218c7-d207-4c79-be2e-b6f8741b3cec tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:08.763452 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cd1218c7-d207-4c79-be2e-b6f8741b3cec tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:08.837276 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cd1218c7-d207-4c79-be2e-b6f8741b3cec tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:52:08.845852 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cd1218c7-d207-4c79-be2e-b6f8741b3cec tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e" status: 200 len: 1271 microversion: 2.1 time: 0.101027 Oct 29 01:52:08.846437 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3621/7458] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:08 2022] GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:52:09.873456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e23384dc-346c-4830-85f0-29865ebc178f tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:09.874840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e23384dc-346c-4830-85f0-29865ebc178f tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:09.885822 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e23384dc-346c-4830-85f0-29865ebc178f tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:09.886768 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e23384dc-346c-4830-85f0-29865ebc178f tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:09.888131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e23384dc-346c-4830-85f0-29865ebc178f tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:09.888780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e23384dc-346c-4830-85f0-29865ebc178f tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:09.889981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e23384dc-346c-4830-85f0-29865ebc178f tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:09.890915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e23384dc-346c-4830-85f0-29865ebc178f tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:10.006739 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e23384dc-346c-4830-85f0-29865ebc178f tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:52:10.018965 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e23384dc-346c-4830-85f0-29865ebc178f tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e" status: 200 len: 1277 microversion: 2.1 time: 0.151474 Oct 29 01:52:10.020997 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3838/7459] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:09 2022] GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:52:11.057468 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f6a2e630-01c5-4ed3-bc61-10ec9d3d8cbd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:11.058721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f6a2e630-01c5-4ed3-bc61-10ec9d3d8cbd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:11.073252 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a2e630-01c5-4ed3-bc61-10ec9d3d8cbd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:11.074168 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a2e630-01c5-4ed3-bc61-10ec9d3d8cbd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:11.077181 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a2e630-01c5-4ed3-bc61-10ec9d3d8cbd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:11.078599 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a2e630-01c5-4ed3-bc61-10ec9d3d8cbd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:11.079973 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a2e630-01c5-4ed3-bc61-10ec9d3d8cbd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:11.082039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6a2e630-01c5-4ed3-bc61-10ec9d3d8cbd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:11.380129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f6a2e630-01c5-4ed3-bc61-10ec9d3d8cbd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:52:11.388636 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f6a2e630-01c5-4ed3-bc61-10ec9d3d8cbd tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e" status: 200 len: 1319 microversion: 2.1 time: 0.343560 Oct 29 01:52:11.389526 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3622/7460] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:11 2022] GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:52:12.107425 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4bc68822-5352-413d-a963-2374989f37e5 req-f6997b97-aa47-4a19-a391-5e9212fe78a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efe31484-3b1e-4af4-941e-aff25fbd872e", "tag": "3ac12e7d-8cc8-4e53-b15f-1a0c71682da3"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:52:12.122305 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4bc68822-5352-413d-a963-2374989f37e5 req-f6997b97-aa47-4a19-a391-5e9212fe78a3 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:12.122908 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4bc68822-5352-413d-a963-2374989f37e5 req-f6997b97-aa47-4a19-a391-5e9212fe78a3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:12.123445 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4bc68822-5352-413d-a963-2374989f37e5 req-f6997b97-aa47-4a19-a391-5e9212fe78a3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:12.141457 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4bc68822-5352-413d-a963-2374989f37e5 req-f6997b97-aa47-4a19-a391-5e9212fe78a3 service nova] Creating event network-changed:3ac12e7d-8cc8-4e53-b15f-1a0c71682da3 for instance efe31484-3b1e-4af4-941e-aff25fbd872e on n-h2-862964-3 Oct 29 01:52:12.147618 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4bc68822-5352-413d-a963-2374989f37e5 req-f6997b97-aa47-4a19-a391-5e9212fe78a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048202 Oct 29 01:52:12.150384 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3839/7461] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:52:12.414558 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4a98e52b-b03c-435c-8880-53c4a389975c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:12.416736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4a98e52b-b03c-435c-8880-53c4a389975c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:12.425343 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a98e52b-b03c-435c-8880-53c4a389975c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:12.425877 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a98e52b-b03c-435c-8880-53c4a389975c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:12.426321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a98e52b-b03c-435c-8880-53c4a389975c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:12.427032 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a98e52b-b03c-435c-8880-53c4a389975c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:12.427497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a98e52b-b03c-435c-8880-53c4a389975c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:12.428002 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4a98e52b-b03c-435c-8880-53c4a389975c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:12.660135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4a98e52b-b03c-435c-8880-53c4a389975c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:52:12.677078 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4a98e52b-b03c-435c-8880-53c4a389975c tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e" status: 200 len: 1319 microversion: 2.1 time: 0.263812 Oct 29 01:52:12.689396 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3623/7462] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:12 2022] GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:52:13.722855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-da836a78-5f3f-4555-8612-22ca2efa5f32 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:13.724416 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-da836a78-5f3f-4555-8612-22ca2efa5f32 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:13.742534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da836a78-5f3f-4555-8612-22ca2efa5f32 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:13.743165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da836a78-5f3f-4555-8612-22ca2efa5f32 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:13.743855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da836a78-5f3f-4555-8612-22ca2efa5f32 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:13.744775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da836a78-5f3f-4555-8612-22ca2efa5f32 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:13.745400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da836a78-5f3f-4555-8612-22ca2efa5f32 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:13.745920 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-da836a78-5f3f-4555-8612-22ca2efa5f32 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:13.905970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-da836a78-5f3f-4555-8612-22ca2efa5f32 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:52:13.914294 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-da836a78-5f3f-4555-8612-22ca2efa5f32 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e" status: 200 len: 1319 microversion: 2.1 time: 0.205991 Oct 29 01:52:13.914904 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3840/7463] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:13 2022] GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:52:14.937233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3866aa8e-b019-45ea-87f0-706a703fb300 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:14.937856 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3866aa8e-b019-45ea-87f0-706a703fb300 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:14.944524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3866aa8e-b019-45ea-87f0-706a703fb300 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:14.945812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3866aa8e-b019-45ea-87f0-706a703fb300 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:14.945812 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3866aa8e-b019-45ea-87f0-706a703fb300 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:14.946169 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3866aa8e-b019-45ea-87f0-706a703fb300 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:14.946639 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3866aa8e-b019-45ea-87f0-706a703fb300 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:14.947075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3866aa8e-b019-45ea-87f0-706a703fb300 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:15.093629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3866aa8e-b019-45ea-87f0-706a703fb300 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:52:15.101582 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3866aa8e-b019-45ea-87f0-706a703fb300 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e" status: 200 len: 1319 microversion: 2.1 time: 0.168643 Oct 29 01:52:15.102210 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3624/7464] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:14 2022] GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:52:16.126219 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5450be24-95b8-4803-8b4a-20674194adb7 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:16.128460 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5450be24-95b8-4803-8b4a-20674194adb7 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:16.135439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5450be24-95b8-4803-8b4a-20674194adb7 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:16.135803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5450be24-95b8-4803-8b4a-20674194adb7 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:16.136405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5450be24-95b8-4803-8b4a-20674194adb7 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:16.138465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5450be24-95b8-4803-8b4a-20674194adb7 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:16.138941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5450be24-95b8-4803-8b4a-20674194adb7 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:16.139376 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5450be24-95b8-4803-8b4a-20674194adb7 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:16.315640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5450be24-95b8-4803-8b4a-20674194adb7 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:52:16.327792 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5450be24-95b8-4803-8b4a-20674194adb7 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e" status: 200 len: 1319 microversion: 2.1 time: 0.206306 Oct 29 01:52:16.328925 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3841/7465] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:16 2022] GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:52:17.358800 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-36a90283-45cd-4613-a99c-213f8e6d251b tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:17.358800 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-36a90283-45cd-4613-a99c-213f8e6d251b tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:17.364344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:52:17.367100 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36a90283-45cd-4613-a99c-213f8e6d251b tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:17.367690 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36a90283-45cd-4613-a99c-213f8e6d251b tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:17.368212 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36a90283-45cd-4613-a99c-213f8e6d251b tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:17.368991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36a90283-45cd-4613-a99c-213f8e6d251b tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:17.369553 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36a90283-45cd-4613-a99c-213f8e6d251b tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:17.370151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-36a90283-45cd-4613-a99c-213f8e6d251b tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:17.520783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-36a90283-45cd-4613-a99c-213f8e6d251b tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:52:17.528571 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-36a90283-45cd-4613-a99c-213f8e6d251b tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e" status: 200 len: 1319 microversion: 2.1 time: 0.177733 Oct 29 01:52:17.529195 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3625/7466] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:17 2022] GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:52:18.551493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-31087582-f802-4ae7-a290-2df126bb0349 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:18.552115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-31087582-f802-4ae7-a290-2df126bb0349 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:18.554153 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:52:18.555874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=8 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:52:18.561101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31087582-f802-4ae7-a290-2df126bb0349 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:18.561897 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31087582-f802-4ae7-a290-2df126bb0349 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:18.569304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31087582-f802-4ae7-a290-2df126bb0349 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:18.569304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31087582-f802-4ae7-a290-2df126bb0349 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:18.569304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31087582-f802-4ae7-a290-2df126bb0349 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:18.569304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-31087582-f802-4ae7-a290-2df126bb0349 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:18.705659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-31087582-f802-4ae7-a290-2df126bb0349 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:52:18.713481 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-31087582-f802-4ae7-a290-2df126bb0349 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e" status: 200 len: 1319 microversion: 2.1 time: 0.166027 Oct 29 01:52:18.714062 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3842/7467] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:18 2022] GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:52:18.969683 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-a6ec7ca3-e076-4ed1-a387-dd60d4517a3e req-47b25504-7336-4828-bd85-b8562a5d21f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efe31484-3b1e-4af4-941e-aff25fbd872e", "name": "network-vif-plugged", "status": "completed", "tag": "3ac12e7d-8cc8-4e53-b15f-1a0c71682da3"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:52:18.980310 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a6ec7ca3-e076-4ed1-a387-dd60d4517a3e req-47b25504-7336-4828-bd85-b8562a5d21f0 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:18.981592 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a6ec7ca3-e076-4ed1-a387-dd60d4517a3e req-47b25504-7336-4828-bd85-b8562a5d21f0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:18.982031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-a6ec7ca3-e076-4ed1-a387-dd60d4517a3e req-47b25504-7336-4828-bd85-b8562a5d21f0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:18.993294 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-a6ec7ca3-e076-4ed1-a387-dd60d4517a3e req-47b25504-7336-4828-bd85-b8562a5d21f0 service nova] Creating event network-vif-plugged:3ac12e7d-8cc8-4e53-b15f-1a0c71682da3 for instance efe31484-3b1e-4af4-941e-aff25fbd872e on n-h2-862964-3 Oct 29 01:52:18.998553 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-a6ec7ca3-e076-4ed1-a387-dd60d4517a3e req-47b25504-7336-4828-bd85-b8562a5d21f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033342 Oct 29 01:52:18.999233 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3626/7468] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:52:19.737864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-953fd616-2caf-4113-9274-b86488177e91 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:19.738438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-953fd616-2caf-4113-9274-b86488177e91 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:19.745441 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-953fd616-2caf-4113-9274-b86488177e91 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:19.745929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-953fd616-2caf-4113-9274-b86488177e91 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:19.746992 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-953fd616-2caf-4113-9274-b86488177e91 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:19.747775 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-953fd616-2caf-4113-9274-b86488177e91 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:19.748179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-953fd616-2caf-4113-9274-b86488177e91 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:19.748613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-953fd616-2caf-4113-9274-b86488177e91 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:19.891320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-953fd616-2caf-4113-9274-b86488177e91 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:52:19.899840 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-953fd616-2caf-4113-9274-b86488177e91 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e" status: 200 len: 1319 microversion: 2.1 time: 0.166031 Oct 29 01:52:19.900534 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3843/7469] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:19 2022] GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:52:20.924615 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-66a8ed0f-a12e-498d-a541-da6b711a2852 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:20.925394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-66a8ed0f-a12e-498d-a541-da6b711a2852 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:20.931617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66a8ed0f-a12e-498d-a541-da6b711a2852 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:20.932117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66a8ed0f-a12e-498d-a541-da6b711a2852 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:20.932571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66a8ed0f-a12e-498d-a541-da6b711a2852 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:20.933313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66a8ed0f-a12e-498d-a541-da6b711a2852 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:20.934441 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66a8ed0f-a12e-498d-a541-da6b711a2852 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:20.934894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-66a8ed0f-a12e-498d-a541-da6b711a2852 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:21.070645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-66a8ed0f-a12e-498d-a541-da6b711a2852 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:52:21.079277 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-66a8ed0f-a12e-498d-a541-da6b711a2852 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e" status: 200 len: 1508 microversion: 2.1 time: 0.159759 Oct 29 01:52:21.079862 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3627/7470] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:20 2022] GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:52:21.103052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7eb67fe5-e5c3-489c-b01b-ac5e22c54cbc tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a9dc214-7f75-4f08-8a87-8bb27179a7ed", "device": "/dev/sdb"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:52:21.106216 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7eb67fe5-e5c3-489c-b01b-ac5e22c54cbc tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:21.113242 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7eb67fe5-e5c3-489c-b01b-ac5e22c54cbc tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:21.113731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7eb67fe5-e5c3-489c-b01b-ac5e22c54cbc tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:21.114171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7eb67fe5-e5c3-489c-b01b-ac5e22c54cbc tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:21.114869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7eb67fe5-e5c3-489c-b01b-ac5e22c54cbc tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:21.115394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7eb67fe5-e5c3-489c-b01b-ac5e22c54cbc tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:21.115823 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7eb67fe5-e5c3-489c-b01b-ac5e22c54cbc tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:21.846167 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7eb67fe5-e5c3-489c-b01b-ac5e22c54cbc tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "POST /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.747015 Oct 29 01:52:21.846892 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3844/7471] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 29 01:52:21 2022] POST /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e/os-volume_attachments => generated 194 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:52:45.209089 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d354219c-4939-45cd-87d5-b6f6481b45f0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:45.209701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d354219c-4939-45cd-87d5-b6f6481b45f0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:45.212240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:52:45.212903 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=53 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:52:45.219059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d354219c-4939-45cd-87d5-b6f6481b45f0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:45.219556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d354219c-4939-45cd-87d5-b6f6481b45f0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:45.220007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d354219c-4939-45cd-87d5-b6f6481b45f0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:45.220717 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d354219c-4939-45cd-87d5-b6f6481b45f0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:45.221262 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d354219c-4939-45cd-87d5-b6f6481b45f0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:45.221700 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d354219c-4939-45cd-87d5-b6f6481b45f0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:45.304486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-d354219c-4939-45cd-87d5-b6f6481b45f0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lazy-loading 'services' on Instance uuid efe31484-3b1e-4af4-941e-aff25fbd872e {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:52:45.532513 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d354219c-4939-45cd-87d5-b6f6481b45f0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "DELETE /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e/os-volume_attachments/0a9dc214-7f75-4f08-8a87-8bb27179a7ed" status: 202 len: 0 microversion: 2.1 time: 0.327265 Oct 29 01:52:45.533281 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3628/7472] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 29 01:52:45 2022] DELETE /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e/os-volume_attachments/0a9dc214-7f75-4f08-8a87-8bb27179a7ed => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:52:50.923207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:52:50.923999 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:52:50.928699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aeb70546-1957-4606-a051-a81c5359d4b0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:50.929370 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-aeb70546-1957-4606-a051-a81c5359d4b0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:50.936024 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aeb70546-1957-4606-a051-a81c5359d4b0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:50.936591 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aeb70546-1957-4606-a051-a81c5359d4b0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:50.936958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aeb70546-1957-4606-a051-a81c5359d4b0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:50.940650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aeb70546-1957-4606-a051-a81c5359d4b0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:50.940650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aeb70546-1957-4606-a051-a81c5359d4b0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:50.940650 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aeb70546-1957-4606-a051-a81c5359d4b0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:51.233642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-aeb70546-1957-4606-a051-a81c5359d4b0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:52:51.514436 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aeb70546-1957-4606-a051-a81c5359d4b0 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "DELETE /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e" status: 204 len: 0 microversion: 2.1 time: 0.588917 Oct 29 01:52:51.515188 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3845/7473] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:52:50 2022] DELETE /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:52:51.529870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c4dd1fae-7a49-4548-b48b-e102222c3464 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:51.529870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c4dd1fae-7a49-4548-b48b-e102222c3464 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:51.536014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4dd1fae-7a49-4548-b48b-e102222c3464 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:51.536630 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4dd1fae-7a49-4548-b48b-e102222c3464 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:51.537090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4dd1fae-7a49-4548-b48b-e102222c3464 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:51.537843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4dd1fae-7a49-4548-b48b-e102222c3464 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:51.538342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4dd1fae-7a49-4548-b48b-e102222c3464 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:51.539523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c4dd1fae-7a49-4548-b48b-e102222c3464 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:51.678837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c4dd1fae-7a49-4548-b48b-e102222c3464 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:52:51.686754 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c4dd1fae-7a49-4548-b48b-e102222c3464 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e" status: 200 len: 1514 microversion: 2.1 time: 0.166806 Oct 29 01:52:51.687442 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3629/7474] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:51 2022] GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:52:52.711873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-88fbe69a-1b7f-41b5-b1a5-b23e677da270 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:52.712518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-88fbe69a-1b7f-41b5-b1a5-b23e677da270 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:52.719864 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88fbe69a-1b7f-41b5-b1a5-b23e677da270 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:52.720350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88fbe69a-1b7f-41b5-b1a5-b23e677da270 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:52.720788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88fbe69a-1b7f-41b5-b1a5-b23e677da270 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:52.721515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88fbe69a-1b7f-41b5-b1a5-b23e677da270 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:52.721974 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88fbe69a-1b7f-41b5-b1a5-b23e677da270 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:52.722401 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-88fbe69a-1b7f-41b5-b1a5-b23e677da270 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:52.884843 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-88fbe69a-1b7f-41b5-b1a5-b23e677da270 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:52:52.893385 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-88fbe69a-1b7f-41b5-b1a5-b23e677da270 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e" status: 200 len: 1514 microversion: 2.1 time: 0.186109 Oct 29 01:52:52.893957 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3846/7475] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:52 2022] GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:52:53.917711 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9e44d604-a485-4161-9223-30339fad51a9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:53.918370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9e44d604-a485-4161-9223-30339fad51a9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:53.929896 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e44d604-a485-4161-9223-30339fad51a9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:53.930487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e44d604-a485-4161-9223-30339fad51a9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:53.930948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e44d604-a485-4161-9223-30339fad51a9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:53.931681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e44d604-a485-4161-9223-30339fad51a9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:53.932157 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e44d604-a485-4161-9223-30339fad51a9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:53.932771 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9e44d604-a485-4161-9223-30339fad51a9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:53.998837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9e44d604-a485-4161-9223-30339fad51a9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:52:54.007025 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9e44d604-a485-4161-9223-30339fad51a9 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e" status: 200 len: 1472 microversion: 2.1 time: 0.093267 Oct 29 01:52:54.007618 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3630/7476] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:53 2022] GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e => generated 1472 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:52:54.073079 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-afdc06b6-c058-4795-94dc-b934fb41fc0a req-866d0bde-26b4-40aa-bdf9-0d3f8ae995c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efe31484-3b1e-4af4-941e-aff25fbd872e", "name": "network-vif-deleted", "tag": "3ac12e7d-8cc8-4e53-b15f-1a0c71682da3"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:52:54.084629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-afdc06b6-c058-4795-94dc-b934fb41fc0a req-866d0bde-26b4-40aa-bdf9-0d3f8ae995c2 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:54.085105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-afdc06b6-c058-4795-94dc-b934fb41fc0a req-866d0bde-26b4-40aa-bdf9-0d3f8ae995c2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:54.085559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-afdc06b6-c058-4795-94dc-b934fb41fc0a req-866d0bde-26b4-40aa-bdf9-0d3f8ae995c2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:54.097619 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-afdc06b6-c058-4795-94dc-b934fb41fc0a req-866d0bde-26b4-40aa-bdf9-0d3f8ae995c2 service nova] Creating event network-vif-deleted:3ac12e7d-8cc8-4e53-b15f-1a0c71682da3 for instance efe31484-3b1e-4af4-941e-aff25fbd872e on n-h2-862964-3 Oct 29 01:52:54.102798 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-afdc06b6-c058-4795-94dc-b934fb41fc0a req-866d0bde-26b4-40aa-bdf9-0d3f8ae995c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184925 Oct 29 01:52:54.103569 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3847/7477] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:52:55.032816 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d1b7661-915e-4a66-a2ce-017b03336238 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:55.033464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7d1b7661-915e-4a66-a2ce-017b03336238 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:55.040393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d1b7661-915e-4a66-a2ce-017b03336238 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:55.040947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d1b7661-915e-4a66-a2ce-017b03336238 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:55.041439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d1b7661-915e-4a66-a2ce-017b03336238 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:55.042263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d1b7661-915e-4a66-a2ce-017b03336238 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:55.042731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d1b7661-915e-4a66-a2ce-017b03336238 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:55.043169 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d1b7661-915e-4a66-a2ce-017b03336238 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:55.075752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d1b7661-915e-4a66-a2ce-017b03336238 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:55.076260 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d1b7661-915e-4a66-a2ce-017b03336238 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:55.076811 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d1b7661-915e-4a66-a2ce-017b03336238 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:55.077321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-7d1b7661-915e-4a66-a2ce-017b03336238 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lazy-loading 'fault' on Instance uuid efe31484-3b1e-4af4-941e-aff25fbd872e {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:52:55.125594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7d1b7661-915e-4a66-a2ce-017b03336238 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287462f4874545a4855566877dc72034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7c458477cc4d71a48f4ec5a26cd5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:52:55.132802 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7d1b7661-915e-4a66-a2ce-017b03336238 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e" status: 200 len: 1309 microversion: 2.1 time: 0.104747 Oct 29 01:52:55.133427 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3631/7478] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:55 2022] GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:52:56.157886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fd1cabbd-7c1f-4b24-9430-e9af6f971d56 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:52:56.158620 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fd1cabbd-7c1f-4b24-9430-e9af6f971d56 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] [instance: efe31484-3b1e-4af4-941e-aff25fbd872e] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:52:56.165874 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd1cabbd-7c1f-4b24-9430-e9af6f971d56 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:56.166383 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd1cabbd-7c1f-4b24-9430-e9af6f971d56 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:56.166799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd1cabbd-7c1f-4b24-9430-e9af6f971d56 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:56.167499 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd1cabbd-7c1f-4b24-9430-e9af6f971d56 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:52:56.167952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd1cabbd-7c1f-4b24-9430-e9af6f971d56 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:52:56.168375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd1cabbd-7c1f-4b24-9430-e9af6f971d56 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:52:56.182995 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-fd1cabbd-7c1f-4b24-9430-e9af6f971d56 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] HTTP exception thrown: Instance efe31484-3b1e-4af4-941e-aff25fbd872e could not be found. Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fd1cabbd-7c1f-4b24-9430-e9af6f971d56 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Request method failure captured: Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e HTTP/1.1 Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIaRXhYnazBRxoQPafx5Y51qxjAORkHIgJGCLxikPvH9PjuAuJWKsw_zEaxXXIM7LErHLNMpkysTK8LPY0F_arphA5S4aTQuxamSLeXgnQF8rDGPHrIj23Ya16JIdA_8x8qZVkQRf03YX4QyPKN1Jr-PuK342CKZJP6ro8yDxzNPPe8 Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: fb7c458477cc4d71a48f4ec5a26cd5fb Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-VolumesSnapshotTestJSON-595634625 Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb7c458477cc4d71a48f4ec5a26cd5fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fb7c458477cc4d71a48f4ec5a26cd5fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb7c458477cc4d71a48f4ec5a26cd5fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fb7c458477cc4d71a48f4ec5a26cd5fb", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-VolumesSnapshotTestJSON-595634625 Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: fb7c458477cc4d71a48f4ec5a26cd5fb Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-595634625 Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-VolumesSnapshotTestJSON-595634625-project Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 287462f4874545a4855566877dc72034 Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-VolumesSnapshotTestJSON-595634625-project Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance efe31484-3b1e-4af4-941e-aff25fbd872e could not be found. Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'efe31484-3b1e-4af4-941e-aff25fbd872e'} Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efe31484-3b1e-4af4-941e-aff25fbd872e could not be found. Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efe31484-3b1e-4af4-941e-aff25fbd872e could not be found. Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:52:56.184791 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:52:56.189207 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:52:56.189207 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:52:56.189207 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:52:56.189207 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:52:56.189207 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:52:56.189207 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efe31484-3b1e-4af4-941e-aff25fbd872e could not be found. Oct 29 01:52:56.189207 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:52:56.189207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fd1cabbd-7c1f-4b24-9430-e9af6f971d56 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] Returning 404 to user: Instance efe31484-3b1e-4af4-941e-aff25fbd872e could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:52:56.189207 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fd1cabbd-7c1f-4b24-9430-e9af6f971d56 tempest-VolumesSnapshotTestJSON-595634625 tempest-VolumesSnapshotTestJSON-595634625-project] 10.222.0.26 "GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e" status: 404 len: 111 microversion: 2.1 time: 0.033397 Oct 29 01:52:56.189207 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3848/7479] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:52:56 2022] GET /compute/v2.1/servers/efe31484-3b1e-4af4-941e-aff25fbd872e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:54:16.612535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=10 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:54:16.619394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:54:16.796218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5640d38c-a979-494b-895a-4beca2d6961a tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1724504960", "availability_zone": "foo_zone"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:54:16.801439 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.aggregate [None req-5640d38c-a979-494b-895a-4beca2d6961a tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Generated uuid 5b787958-75f7-4639-be2d-a850e834c9d4 for aggregate {{(pid=121100) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 01:54:16.899706 n-d-862964-3 devstack@n-api.service[121100]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5640d38c-a979-494b-895a-4beca2d6961a tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] [423d0cc3-5deb-410e-819f-5e0a987ca773] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 01:54:17.908222 n-d-862964-3 devstack@n-api.service[121100]: INFO oslo.messaging._drivers.impl_rabbit [None req-5640d38c-a979-494b-895a-4beca2d6961a tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] [423d0cc3-5deb-410e-819f-5e0a987ca773] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 45372. Oct 29 01:54:17.918223 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5640d38c-a979-494b-895a-4beca2d6961a tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 1.305032 Oct 29 01:54:17.918223 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3632/7480] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 29 01:54:16 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:54:17.928960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-197b4d0d-c00d-4fd7-8147-49d74e585566 tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:54:17.938442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:54:17.939995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:54:18.086065 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-197b4d0d-c00d-4fd7-8147-49d74e585566 tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.150213 Oct 29 01:54:18.086065 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3849/7481] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 29 01:54:17 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:54:18.086425 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-143b6cef-26c5-4019-b131-cb0ae108d58b tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:18.091273 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-143b6cef-26c5-4019-b131-cb0ae108d58b tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:18.091778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-143b6cef-26c5-4019-b131-cb0ae108d58b tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:18.092247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-143b6cef-26c5-4019-b131-cb0ae108d58b tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:18.093116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-143b6cef-26c5-4019-b131-cb0ae108d58b tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:18.093726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-143b6cef-26c5-4019-b131-cb0ae108d58b tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:18.094178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-143b6cef-26c5-4019-b131-cb0ae108d58b tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:18.120112 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-143b6cef-26c5-4019-b131-cb0ae108d58b tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.037593 Oct 29 01:54:18.120729 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3633/7482] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Oct 29 01:54:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:54:18.132705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4bab79cd-1ebb-4abe-b020-70b0122b7abd tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:18.141175 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4bab79cd-1ebb-4abe-b020-70b0122b7abd tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.012283 Oct 29 01:54:18.142054 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3850/7483] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 29 01:54:18 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:54:18.153748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cfb7593e-7766-4d91-8280-7b3f579890da tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862964-3"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:54:18.164986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cfb7593e-7766-4d91-8280-7b3f579890da tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:18.165539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cfb7593e-7766-4d91-8280-7b3f579890da tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:18.166003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cfb7593e-7766-4d91-8280-7b3f579890da tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:18.598788 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cfb7593e-7766-4d91-8280-7b3f579890da tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.448778 Oct 29 01:54:18.599449 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3634/7484] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 29 01:54:18 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:54:18.615207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d20e105f-b2d8-4fb4-8cea-a9e1fcab1787 tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:18.625093 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d20e105f-b2d8-4fb4-8cea-a9e1fcab1787 tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.017774 Oct 29 01:54:18.626178 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3851/7485] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:54:18 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:54:18.639192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-02b01b19-4e7f-4057-9624-487c8e833126 tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1171551860", "availability_zone": "foo_zone"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:54:18.798317 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-02b01b19-4e7f-4057-9624-487c8e833126 tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.163544 Oct 29 01:54:18.805355 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3635/7486] 10.222.0.26 () {60 vars in 1173 bytes} [Sat Oct 29 01:54:18 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:54:18.812324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-206c9d8b-e495-4dad-a49c-d56f5ee75caf tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:54:18.923227 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-206c9d8b-e495-4dad-a49c-d56f5ee75caf tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.115978 Oct 29 01:54:18.924761 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3852/7487] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 29 01:54:18 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:54:18.941589 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-048e1450-f5c8-45b7-a741-276cc57bf795 tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:18.956124 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-048e1450-f5c8-45b7-a741-276cc57bf795 tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.022655 Oct 29 01:54:18.957484 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3636/7488] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 29 01:54:18 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:54:18.977339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9d1b1a72-d8ca-4f7b-b267-4a52e6a8f9b6 tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862964-3"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:54:18.990423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d1b1a72-d8ca-4f7b-b267-4a52e6a8f9b6 tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:18.992722 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d1b1a72-d8ca-4f7b-b267-4a52e6a8f9b6 tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:18.994917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9d1b1a72-d8ca-4f7b-b267-4a52e6a8f9b6 tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:19.396780 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9d1b1a72-d8ca-4f7b-b267-4a52e6a8f9b6 tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.427008 Oct 29 01:54:19.397878 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3853/7489] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 29 01:54:18 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:54:19.410141 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0e71d912-69c2-40fc-9d14-e2697626cf55 tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:19.528617 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0e71d912-69c2-40fc-9d14-e2697626cf55 tempest-TestAggregatesBasicOps-1586175193 tempest-TestAggregatesBasicOps-1586175193-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.121446 Oct 29 01:54:19.528617 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3637/7490] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 29 01:54:19 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 01:54:23.539617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-afed741d-bf9d-447e-bb86-6cf5a3d343a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-554901249", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-161758843", "security_groups": [{"name": "tempest-secgroup-smoke-707530340"}], "block_device_mapping_v2": [{"uuid": "b5b88bef-29e7-4070-ba29-2ba386aa16fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d488ed61-ddc0-4d3b-9833-017b49869cf3"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:54:23.983076 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-afed741d-bf9d-447e-bb86-6cf5a3d343a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] validate_networks() for [('d488ed61-ddc0-4d3b-9833-017b49869cf3', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:54:24.430207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-afed741d-bf9d-447e-bb86-6cf5a3d343a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:54:24.430684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-afed741d-bf9d-447e-bb86-6cf5a3d343a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:54:24.431156 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-afed741d-bf9d-447e-bb86-6cf5a3d343a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:54:24.431572 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-afed741d-bf9d-447e-bb86-6cf5a3d343a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:54:24.432015 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-afed741d-bf9d-447e-bb86-6cf5a3d343a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:54:24.443126 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afed741d-bf9d-447e-bb86-6cf5a3d343a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:24.443629 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afed741d-bf9d-447e-bb86-6cf5a3d343a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:24.444078 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afed741d-bf9d-447e-bb86-6cf5a3d343a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:24.444828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afed741d-bf9d-447e-bb86-6cf5a3d343a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:24.445324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afed741d-bf9d-447e-bb86-6cf5a3d343a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:24.445761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-afed741d-bf9d-447e-bb86-6cf5a3d343a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:24.467942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-afed741d-bf9d-447e-bb86-6cf5a3d343a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Getting quotas for project 37416a9397fa4c6dbd0bfe8dee191577. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:54:24.474634 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-afed741d-bf9d-447e-bb86-6cf5a3d343a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Getting quotas for user 8b8f36d10fa340f784581a3cf9a15606 and project 37416a9397fa4c6dbd0bfe8dee191577. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:54:24.548332 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-afed741d-bf9d-447e-bb86-6cf5a3d343a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:54:24.550731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-afed741d-bf9d-447e-bb86-6cf5a3d343a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b5b88bef-29e7-4070-ba29-2ba386aa16fa',volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:54:25.015486 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-afed741d-bf9d-447e-bb86-6cf5a3d343a1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.484791 Oct 29 01:54:25.016743 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3854/7491] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:54:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:54:25.031011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d2b47d9e-b26b-4654-9912-09c826032e75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:25.032524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d2b47d9e-b26b-4654-9912-09c826032e75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:25.363730 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d2b47d9e-b26b-4654-9912-09c826032e75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:25.371764 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d2b47d9e-b26b-4654-9912-09c826032e75 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1093 microversion: 2.1 time: 0.346884 Oct 29 01:54:25.374511 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3638/7492] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:25 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1093 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:54:26.397488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fd1d0f8f-bbbb-4d0a-8c43-280058516e45 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:26.398618 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fd1d0f8f-bbbb-4d0a-8c43-280058516e45 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:26.405612 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd1d0f8f-bbbb-4d0a-8c43-280058516e45 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:26.406241 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd1d0f8f-bbbb-4d0a-8c43-280058516e45 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:26.406922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd1d0f8f-bbbb-4d0a-8c43-280058516e45 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:26.408132 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd1d0f8f-bbbb-4d0a-8c43-280058516e45 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:26.408829 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd1d0f8f-bbbb-4d0a-8c43-280058516e45 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:26.409488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fd1d0f8f-bbbb-4d0a-8c43-280058516e45 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:26.487171 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-fd1d0f8f-bbbb-4d0a-8c43-280058516e45 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:26.500082 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fd1d0f8f-bbbb-4d0a-8c43-280058516e45 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1143 microversion: 2.1 time: 0.108507 Oct 29 01:54:26.500863 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3855/7493] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:26 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1143 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:54:27.523766 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1492d95d-1c65-4b84-b97f-3402c8602ab7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:27.524383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1492d95d-1c65-4b84-b97f-3402c8602ab7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:27.547897 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1492d95d-1c65-4b84-b97f-3402c8602ab7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:27.548408 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1492d95d-1c65-4b84-b97f-3402c8602ab7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:27.549522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1492d95d-1c65-4b84-b97f-3402c8602ab7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:27.550264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1492d95d-1c65-4b84-b97f-3402c8602ab7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:27.557319 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1492d95d-1c65-4b84-b97f-3402c8602ab7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:27.561869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1492d95d-1c65-4b84-b97f-3402c8602ab7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:27.683684 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1492d95d-1c65-4b84-b97f-3402c8602ab7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:27.692677 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1492d95d-1c65-4b84-b97f-3402c8602ab7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1191 microversion: 2.1 time: 0.172920 Oct 29 01:54:27.693624 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3639/7494] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:27 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1191 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:54:28.721786 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a686eb00-d520-48d8-b265-f73393247eed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:28.722420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a686eb00-d520-48d8-b265-f73393247eed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:28.739456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a686eb00-d520-48d8-b265-f73393247eed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:28.739964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a686eb00-d520-48d8-b265-f73393247eed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:28.740431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a686eb00-d520-48d8-b265-f73393247eed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:28.741196 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a686eb00-d520-48d8-b265-f73393247eed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:28.741644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a686eb00-d520-48d8-b265-f73393247eed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:28.742077 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a686eb00-d520-48d8-b265-f73393247eed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:28.841848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a686eb00-d520-48d8-b265-f73393247eed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:28.851771 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a686eb00-d520-48d8-b265-f73393247eed tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1209 microversion: 2.1 time: 0.135649 Oct 29 01:54:28.853904 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3856/7495] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:28 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1209 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:54:29.882617 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-7d156272-e1c8-4b20-a3e4-d320d4487e17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:29.883802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-7d156272-e1c8-4b20-a3e4-d320d4487e17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:29.887705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:54:29.894242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d156272-e1c8-4b20-a3e4-d320d4487e17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:29.895044 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d156272-e1c8-4b20-a3e4-d320d4487e17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:29.895800 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d156272-e1c8-4b20-a3e4-d320d4487e17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:29.897881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d156272-e1c8-4b20-a3e4-d320d4487e17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:29.898759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d156272-e1c8-4b20-a3e4-d320d4487e17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:29.900259 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-7d156272-e1c8-4b20-a3e4-d320d4487e17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:30.187735 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-7d156272-e1c8-4b20-a3e4-d320d4487e17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:30.200793 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-7d156272-e1c8-4b20-a3e4-d320d4487e17 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1276 microversion: 2.1 time: 0.321994 Oct 29 01:54:30.222107 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3640/7496] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:29 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1276 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:54:30.548010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-c41fc044-f7ba-4c2e-bdfc-e732a8bfd34d req-55c19921-a625-4ec6-9315-1b3aa751f5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d153847-7a07-4c05-956c-05b365c81c37", "tag": "7dcf8f03-c531-4e04-aab6-680b834bdc52"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:54:30.572021 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c41fc044-f7ba-4c2e-bdfc-e732a8bfd34d req-55c19921-a625-4ec6-9315-1b3aa751f5a8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:30.572714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c41fc044-f7ba-4c2e-bdfc-e732a8bfd34d req-55c19921-a625-4ec6-9315-1b3aa751f5a8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:30.573742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-c41fc044-f7ba-4c2e-bdfc-e732a8bfd34d req-55c19921-a625-4ec6-9315-1b3aa751f5a8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:30.592272 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-c41fc044-f7ba-4c2e-bdfc-e732a8bfd34d req-55c19921-a625-4ec6-9315-1b3aa751f5a8 service nova] Creating event network-changed:7dcf8f03-c531-4e04-aab6-680b834bdc52 for instance 4d153847-7a07-4c05-956c-05b365c81c37 on n-h2-862964-3 Oct 29 01:54:30.601958 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-c41fc044-f7ba-4c2e-bdfc-e732a8bfd34d req-55c19921-a625-4ec6-9315-1b3aa751f5a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060226 Oct 29 01:54:30.603119 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3857/7497] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:54:31.227927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-fadf6d7b-1332-4628-8aa2-fc98e4a0fe32 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:31.228586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-fadf6d7b-1332-4628-8aa2-fc98e4a0fe32 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:31.236039 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fadf6d7b-1332-4628-8aa2-fc98e4a0fe32 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:31.236881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fadf6d7b-1332-4628-8aa2-fc98e4a0fe32 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:31.238188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fadf6d7b-1332-4628-8aa2-fc98e4a0fe32 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:31.239118 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fadf6d7b-1332-4628-8aa2-fc98e4a0fe32 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:31.239746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fadf6d7b-1332-4628-8aa2-fc98e4a0fe32 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:31.240344 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-fadf6d7b-1332-4628-8aa2-fc98e4a0fe32 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:31.509477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-fadf6d7b-1332-4628-8aa2-fc98e4a0fe32 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:31.519060 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-fadf6d7b-1332-4628-8aa2-fc98e4a0fe32 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1276 microversion: 2.1 time: 0.294915 Oct 29 01:54:31.520020 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3641/7498] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:31 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1276 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:54:32.544784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ebada2e6-5bf6-4045-9e99-0b8935f1447c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:32.545507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ebada2e6-5bf6-4045-9e99-0b8935f1447c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:32.553003 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebada2e6-5bf6-4045-9e99-0b8935f1447c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:32.553526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebada2e6-5bf6-4045-9e99-0b8935f1447c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:32.553962 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebada2e6-5bf6-4045-9e99-0b8935f1447c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:32.554657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebada2e6-5bf6-4045-9e99-0b8935f1447c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:32.555109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebada2e6-5bf6-4045-9e99-0b8935f1447c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:32.555699 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebada2e6-5bf6-4045-9e99-0b8935f1447c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:32.748448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ebada2e6-5bf6-4045-9e99-0b8935f1447c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:32.757255 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ebada2e6-5bf6-4045-9e99-0b8935f1447c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1276 microversion: 2.1 time: 0.217981 Oct 29 01:54:32.758227 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3858/7499] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:32 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1276 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:54:33.779964 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4451f16e-5b4d-4425-aaf5-6057ca28489a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:33.780596 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4451f16e-5b4d-4425-aaf5-6057ca28489a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:33.801143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4451f16e-5b4d-4425-aaf5-6057ca28489a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:33.801681 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4451f16e-5b4d-4425-aaf5-6057ca28489a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:33.802146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4451f16e-5b4d-4425-aaf5-6057ca28489a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:33.802869 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4451f16e-5b4d-4425-aaf5-6057ca28489a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:33.803528 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4451f16e-5b4d-4425-aaf5-6057ca28489a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:33.803979 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4451f16e-5b4d-4425-aaf5-6057ca28489a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:34.092029 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4451f16e-5b4d-4425-aaf5-6057ca28489a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:34.101324 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4451f16e-5b4d-4425-aaf5-6057ca28489a tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1276 microversion: 2.1 time: 0.325077 Oct 29 01:54:34.102190 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3642/7500] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:33 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1276 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:54:35.123955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b988e980-6649-424d-962a-09adcdae0c1f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:35.125172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b988e980-6649-424d-962a-09adcdae0c1f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:35.129143 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:54:35.130256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=6 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:54:35.135896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b988e980-6649-424d-962a-09adcdae0c1f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:35.136614 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b988e980-6649-424d-962a-09adcdae0c1f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:35.137259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b988e980-6649-424d-962a-09adcdae0c1f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:35.138140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b988e980-6649-424d-962a-09adcdae0c1f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:35.138760 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b988e980-6649-424d-962a-09adcdae0c1f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:35.139353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b988e980-6649-424d-962a-09adcdae0c1f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:35.389408 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b988e980-6649-424d-962a-09adcdae0c1f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:35.400372 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b988e980-6649-424d-962a-09adcdae0c1f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1276 microversion: 2.1 time: 0.280217 Oct 29 01:54:35.415643 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3859/7501] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:35 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1276 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:54:36.430143 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-65121996-fc8e-414d-a62c-4e82772fd1cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:36.431471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-65121996-fc8e-414d-a62c-4e82772fd1cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:36.434133 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:54:36.440861 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65121996-fc8e-414d-a62c-4e82772fd1cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:36.441465 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65121996-fc8e-414d-a62c-4e82772fd1cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:36.443144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65121996-fc8e-414d-a62c-4e82772fd1cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:36.443144 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65121996-fc8e-414d-a62c-4e82772fd1cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:36.443661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65121996-fc8e-414d-a62c-4e82772fd1cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:36.444326 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-65121996-fc8e-414d-a62c-4e82772fd1cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:36.612948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-65121996-fc8e-414d-a62c-4e82772fd1cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:36.621279 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-65121996-fc8e-414d-a62c-4e82772fd1cf tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1264 microversion: 2.1 time: 0.196392 Oct 29 01:54:36.622135 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3643/7502] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:36 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1264 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:54:37.646923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-aae4b49d-8b5b-4d41-ac92-6aab6296a59c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:37.647757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-aae4b49d-8b5b-4d41-ac92-6aab6296a59c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:37.654697 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aae4b49d-8b5b-4d41-ac92-6aab6296a59c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:37.655193 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aae4b49d-8b5b-4d41-ac92-6aab6296a59c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:37.655649 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aae4b49d-8b5b-4d41-ac92-6aab6296a59c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:37.656344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aae4b49d-8b5b-4d41-ac92-6aab6296a59c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:37.656808 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aae4b49d-8b5b-4d41-ac92-6aab6296a59c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:37.657268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-aae4b49d-8b5b-4d41-ac92-6aab6296a59c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:37.883438 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-aae4b49d-8b5b-4d41-ac92-6aab6296a59c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:37.894432 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-aae4b49d-8b5b-4d41-ac92-6aab6296a59c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1264 microversion: 2.1 time: 0.251632 Oct 29 01:54:37.895846 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3860/7503] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:37 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1264 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:54:38.919789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a25a27bc-b561-48a3-9b33-a73788fa98e8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:38.920488 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a25a27bc-b561-48a3-9b33-a73788fa98e8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:38.928379 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a25a27bc-b561-48a3-9b33-a73788fa98e8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:38.929064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a25a27bc-b561-48a3-9b33-a73788fa98e8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:38.929787 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a25a27bc-b561-48a3-9b33-a73788fa98e8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:38.930757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a25a27bc-b561-48a3-9b33-a73788fa98e8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:38.931625 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a25a27bc-b561-48a3-9b33-a73788fa98e8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:38.932556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a25a27bc-b561-48a3-9b33-a73788fa98e8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:39.084805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a25a27bc-b561-48a3-9b33-a73788fa98e8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:39.093079 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a25a27bc-b561-48a3-9b33-a73788fa98e8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1264 microversion: 2.1 time: 0.177682 Oct 29 01:54:39.094145 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3644/7504] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:38 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:54:40.118624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1939abbd-50c4-41c9-bdc9-97608aefade8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:40.119330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1939abbd-50c4-41c9-bdc9-97608aefade8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:40.127394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1939abbd-50c4-41c9-bdc9-97608aefade8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:40.128281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1939abbd-50c4-41c9-bdc9-97608aefade8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:40.128988 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1939abbd-50c4-41c9-bdc9-97608aefade8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:40.129814 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1939abbd-50c4-41c9-bdc9-97608aefade8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:40.130355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1939abbd-50c4-41c9-bdc9-97608aefade8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:40.131102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1939abbd-50c4-41c9-bdc9-97608aefade8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:40.650646 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1939abbd-50c4-41c9-bdc9-97608aefade8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:40.659617 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1939abbd-50c4-41c9-bdc9-97608aefade8 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1264 microversion: 2.1 time: 0.545594 Oct 29 01:54:40.660353 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3861/7505] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:40 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1264 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:54:41.684752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1b89140e-a018-427a-b2f9-950abca258af tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:41.686050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1b89140e-a018-427a-b2f9-950abca258af tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:41.697898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b89140e-a018-427a-b2f9-950abca258af tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:41.698662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b89140e-a018-427a-b2f9-950abca258af tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:41.699527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b89140e-a018-427a-b2f9-950abca258af tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:41.701088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b89140e-a018-427a-b2f9-950abca258af tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:41.701760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b89140e-a018-427a-b2f9-950abca258af tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:41.702343 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b89140e-a018-427a-b2f9-950abca258af tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:42.029003 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1b89140e-a018-427a-b2f9-950abca258af tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:42.041691 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1b89140e-a018-427a-b2f9-950abca258af tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1264 microversion: 2.1 time: 0.361377 Oct 29 01:54:42.044087 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3645/7506] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:41 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1264 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:54:43.069201 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d603f28b-8880-427e-a93e-3b885ed3868d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:43.070564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d603f28b-8880-427e-a93e-3b885ed3868d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:43.081108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d603f28b-8880-427e-a93e-3b885ed3868d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:43.081975 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d603f28b-8880-427e-a93e-3b885ed3868d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:43.082640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d603f28b-8880-427e-a93e-3b885ed3868d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:43.083749 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d603f28b-8880-427e-a93e-3b885ed3868d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:43.084155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d603f28b-8880-427e-a93e-3b885ed3868d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:43.084598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d603f28b-8880-427e-a93e-3b885ed3868d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:43.323415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d603f28b-8880-427e-a93e-3b885ed3868d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:43.354736 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d603f28b-8880-427e-a93e-3b885ed3868d tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1264 microversion: 2.1 time: 0.272973 Oct 29 01:54:43.354736 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3862/7507] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:43 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1264 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:54:44.362836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b8c0ddf8-4808-4eb8-98c6-5fae7316458b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:44.364784 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b8c0ddf8-4808-4eb8-98c6-5fae7316458b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:44.372296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8c0ddf8-4808-4eb8-98c6-5fae7316458b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:44.372802 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8c0ddf8-4808-4eb8-98c6-5fae7316458b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:44.373280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8c0ddf8-4808-4eb8-98c6-5fae7316458b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:44.374059 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8c0ddf8-4808-4eb8-98c6-5fae7316458b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:44.374782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8c0ddf8-4808-4eb8-98c6-5fae7316458b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:44.375223 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b8c0ddf8-4808-4eb8-98c6-5fae7316458b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:44.617579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b8c0ddf8-4808-4eb8-98c6-5fae7316458b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:44.629266 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b8c0ddf8-4808-4eb8-98c6-5fae7316458b tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1264 microversion: 2.1 time: 0.271219 Oct 29 01:54:44.635259 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3646/7508] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:44 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1264 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:54:45.652685 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-efa06d53-f8c3-4395-99cd-2dca79f8c6b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:45.653914 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-efa06d53-f8c3-4395-99cd-2dca79f8c6b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:45.665244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efa06d53-f8c3-4395-99cd-2dca79f8c6b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:45.667411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efa06d53-f8c3-4395-99cd-2dca79f8c6b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:45.667873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efa06d53-f8c3-4395-99cd-2dca79f8c6b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:45.668610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efa06d53-f8c3-4395-99cd-2dca79f8c6b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:45.669596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efa06d53-f8c3-4395-99cd-2dca79f8c6b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:45.672855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-efa06d53-f8c3-4395-99cd-2dca79f8c6b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:45.930836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-efa06d53-f8c3-4395-99cd-2dca79f8c6b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:45.958915 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-efa06d53-f8c3-4395-99cd-2dca79f8c6b1 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1264 microversion: 2.1 time: 0.298790 Oct 29 01:54:45.958915 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3863/7509] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:45 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1264 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:54:46.459369 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-20c303d6-0190-4efe-ab03-4242597ddeea req-9652175e-f60b-40af-aeb7-f8bfc2843d35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d153847-7a07-4c05-956c-05b365c81c37", "name": "network-vif-plugged", "status": "completed", "tag": "7dcf8f03-c531-4e04-aab6-680b834bdc52"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:54:46.494622 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-20c303d6-0190-4efe-ab03-4242597ddeea req-9652175e-f60b-40af-aeb7-f8bfc2843d35 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:46.496106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-20c303d6-0190-4efe-ab03-4242597ddeea req-9652175e-f60b-40af-aeb7-f8bfc2843d35 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:46.496743 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-20c303d6-0190-4efe-ab03-4242597ddeea req-9652175e-f60b-40af-aeb7-f8bfc2843d35 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:46.513702 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-20c303d6-0190-4efe-ab03-4242597ddeea req-9652175e-f60b-40af-aeb7-f8bfc2843d35 service nova] Creating event network-vif-plugged:7dcf8f03-c531-4e04-aab6-680b834bdc52 for instance 4d153847-7a07-4c05-956c-05b365c81c37 on n-h2-862964-3 Oct 29 01:54:46.522448 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-20c303d6-0190-4efe-ab03-4242597ddeea req-9652175e-f60b-40af-aeb7-f8bfc2843d35 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068692 Oct 29 01:54:46.525665 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3647/7510] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:54:46.975705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0cc4c086-a326-4792-9c8a-9d1ee77263f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:46.977473 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0cc4c086-a326-4792-9c8a-9d1ee77263f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:46.985289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cc4c086-a326-4792-9c8a-9d1ee77263f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:46.986890 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cc4c086-a326-4792-9c8a-9d1ee77263f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:46.987482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cc4c086-a326-4792-9c8a-9d1ee77263f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:46.988423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cc4c086-a326-4792-9c8a-9d1ee77263f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:46.988895 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cc4c086-a326-4792-9c8a-9d1ee77263f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:46.989358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0cc4c086-a326-4792-9c8a-9d1ee77263f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:47.152964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0cc4c086-a326-4792-9c8a-9d1ee77263f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:47.163828 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0cc4c086-a326-4792-9c8a-9d1ee77263f5 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1264 microversion: 2.1 time: 0.192298 Oct 29 01:54:47.164572 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3864/7511] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:46 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:54:48.188670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-13e76ab6-ab6a-4616-ab70-4f00c8bee648 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:48.189645 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-13e76ab6-ab6a-4616-ab70-4f00c8bee648 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:48.192627 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:54:48.198568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13e76ab6-ab6a-4616-ab70-4f00c8bee648 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:48.199075 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13e76ab6-ab6a-4616-ab70-4f00c8bee648 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:48.199705 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13e76ab6-ab6a-4616-ab70-4f00c8bee648 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:48.200579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13e76ab6-ab6a-4616-ab70-4f00c8bee648 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:48.201056 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13e76ab6-ab6a-4616-ab70-4f00c8bee648 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:48.201855 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-13e76ab6-ab6a-4616-ab70-4f00c8bee648 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:48.204665 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=57 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:54:48.357463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-13e76ab6-ab6a-4616-ab70-4f00c8bee648 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:48.366838 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-13e76ab6-ab6a-4616-ab70-4f00c8bee648 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1264 microversion: 2.1 time: 0.182368 Oct 29 01:54:48.367587 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3648/7512] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:48 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:54:49.511782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-84f585a6-97fa-4dc7-9dd2-a1771bb1fa53 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:49.512462 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-84f585a6-97fa-4dc7-9dd2-a1771bb1fa53 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:49.515660 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:54:49.522259 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84f585a6-97fa-4dc7-9dd2-a1771bb1fa53 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:49.527805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84f585a6-97fa-4dc7-9dd2-a1771bb1fa53 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:49.528364 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84f585a6-97fa-4dc7-9dd2-a1771bb1fa53 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:49.529208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84f585a6-97fa-4dc7-9dd2-a1771bb1fa53 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:49.529688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84f585a6-97fa-4dc7-9dd2-a1771bb1fa53 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:49.530122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-84f585a6-97fa-4dc7-9dd2-a1771bb1fa53 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:49.538272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=63 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:54:49.731393 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-84f585a6-97fa-4dc7-9dd2-a1771bb1fa53 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:49.748177 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-84f585a6-97fa-4dc7-9dd2-a1771bb1fa53 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1451 microversion: 2.1 time: 0.240368 Oct 29 01:54:49.748798 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3865/7513] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:49 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1451 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:54:49.783023 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-943e8969-52a9-4a9b-afb8-b6d14baffef7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:54:49.789781 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-943e8969-52a9-4a9b-afb8-b6d14baffef7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:54:49.815753 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-943e8969-52a9-4a9b-afb8-b6d14baffef7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:49.824171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-943e8969-52a9-4a9b-afb8-b6d14baffef7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:49.824171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-943e8969-52a9-4a9b-afb8-b6d14baffef7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:49.824171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-943e8969-52a9-4a9b-afb8-b6d14baffef7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:49.824171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-943e8969-52a9-4a9b-afb8-b6d14baffef7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:49.824171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-943e8969-52a9-4a9b-afb8-b6d14baffef7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:49.997924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-943e8969-52a9-4a9b-afb8-b6d14baffef7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:54:50.006323 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-943e8969-52a9-4a9b-afb8-b6d14baffef7 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1451 microversion: 2.1 time: 0.228510 Oct 29 01:54:50.006890 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3649/7514] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:54:49 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1451 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:54:52.924404 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-5b6254be-4a2c-4774-912d-6fffdafffebb req-b89e6783-1c42-4d00-a077-0074100e704e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d153847-7a07-4c05-956c-05b365c81c37", "tag": "7dcf8f03-c531-4e04-aab6-680b834bdc52"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:54:52.935526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5b6254be-4a2c-4774-912d-6fffdafffebb req-b89e6783-1c42-4d00-a077-0074100e704e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:54:52.936268 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5b6254be-4a2c-4774-912d-6fffdafffebb req-b89e6783-1c42-4d00-a077-0074100e704e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:54:52.936946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-5b6254be-4a2c-4774-912d-6fffdafffebb req-b89e6783-1c42-4d00-a077-0074100e704e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:54:52.951692 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-5b6254be-4a2c-4774-912d-6fffdafffebb req-b89e6783-1c42-4d00-a077-0074100e704e service nova] Creating event network-changed:7dcf8f03-c531-4e04-aab6-680b834bdc52 for instance 4d153847-7a07-4c05-956c-05b365c81c37 on n-h2-862964-3 Oct 29 01:54:52.958577 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-5b6254be-4a2c-4774-912d-6fffdafffebb req-b89e6783-1c42-4d00-a077-0074100e704e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038757 Oct 29 01:54:52.959240 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3866/7515] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:55:55.705280 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:55:55.706443 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=11 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:55:55.837395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c66d432c-8926-4545-bb71-dec5271bb517 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1230200838", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "c54965c4-2b70-462f-998f-f3ec31635b94"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:55:55.896105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-c66d432c-8926-4545-bb71-dec5271bb517 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] validate_networks() for [('c54965c4-2b70-462f-998f-f3ec31635b94', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:55:56.310052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-c66d432c-8926-4545-bb71-dec5271bb517 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:55:56.310525 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-c66d432c-8926-4545-bb71-dec5271bb517 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:55:56.311048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-c66d432c-8926-4545-bb71-dec5271bb517 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:55:56.311477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-c66d432c-8926-4545-bb71-dec5271bb517 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:55:56.311907 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-c66d432c-8926-4545-bb71-dec5271bb517 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:55:56.321013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c66d432c-8926-4545-bb71-dec5271bb517 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:55:56.321537 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c66d432c-8926-4545-bb71-dec5271bb517 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:55:56.322064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c66d432c-8926-4545-bb71-dec5271bb517 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:55:56.322927 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c66d432c-8926-4545-bb71-dec5271bb517 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:55:56.323405 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c66d432c-8926-4545-bb71-dec5271bb517 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:55:56.323851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c66d432c-8926-4545-bb71-dec5271bb517 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:55:56.341851 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-c66d432c-8926-4545-bb71-dec5271bb517 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Getting quotas for project 03a1e71634244b34b56847d2d218947d. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:55:56.347263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-c66d432c-8926-4545-bb71-dec5271bb517 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Getting quotas for user b174ee92c43245bd80a537ae8f75a72c and project 03a1e71634244b34b56847d2d218947d. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:55:56.360767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c66d432c-8926-4545-bb71-dec5271bb517 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:55:56.363186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c66d432c-8926-4545-bb71-dec5271bb517 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:55:56.471183 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c66d432c-8926-4545-bb71-dec5271bb517 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767962 Oct 29 01:55:56.471851 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3650/7516] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:55:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:55:56.483145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:55:56.484006 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=7 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:55:56.488544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-905d9716-ae3d-493e-87d2-48a2c03fe86b tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:55:56.489279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-905d9716-ae3d-493e-87d2-48a2c03fe86b tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:55:56.554825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-905d9716-ae3d-493e-87d2-48a2c03fe86b tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b174ee92c43245bd80a537ae8f75a72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a1e71634244b34b56847d2d218947d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:55:56.564491 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-905d9716-ae3d-493e-87d2-48a2c03fe86b tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151" status: 200 len: 1214 microversion: 2.1 time: 0.084370 Oct 29 01:55:56.565074 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3867/7517] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:55:56 2022] GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:55:57.591098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f2cf3df0-b3ac-466a-935d-dfde31ee5d13 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:55:57.591098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f2cf3df0-b3ac-466a-935d-dfde31ee5d13 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:55:57.658868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f2cf3df0-b3ac-466a-935d-dfde31ee5d13 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b174ee92c43245bd80a537ae8f75a72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a1e71634244b34b56847d2d218947d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:55:57.667081 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f2cf3df0-b3ac-466a-935d-dfde31ee5d13 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151" status: 200 len: 1214 microversion: 2.1 time: 0.081164 Oct 29 01:55:57.667249 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3651/7518] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:55:57 2022] GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:55:58.693820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-051ca76f-92b9-4f64-a08e-2aef386d4904 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:55:58.693820 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-051ca76f-92b9-4f64-a08e-2aef386d4904 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:55:58.699501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-051ca76f-92b9-4f64-a08e-2aef386d4904 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:55:58.699980 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-051ca76f-92b9-4f64-a08e-2aef386d4904 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:55:58.705045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-051ca76f-92b9-4f64-a08e-2aef386d4904 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:55:58.705045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-051ca76f-92b9-4f64-a08e-2aef386d4904 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:55:58.705045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-051ca76f-92b9-4f64-a08e-2aef386d4904 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:55:58.705045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-051ca76f-92b9-4f64-a08e-2aef386d4904 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:55:58.768931 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-051ca76f-92b9-4f64-a08e-2aef386d4904 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b174ee92c43245bd80a537ae8f75a72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a1e71634244b34b56847d2d218947d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:55:58.777365 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-051ca76f-92b9-4f64-a08e-2aef386d4904 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151" status: 200 len: 1266 microversion: 2.1 time: 0.091434 Oct 29 01:55:58.778041 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3868/7519] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:55:58 2022] GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:55:59.800591 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3af36c01-5816-4953-b1b8-1aff2bd748f1 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:55:59.801250 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3af36c01-5816-4953-b1b8-1aff2bd748f1 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:55:59.808731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3af36c01-5816-4953-b1b8-1aff2bd748f1 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:55:59.809292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3af36c01-5816-4953-b1b8-1aff2bd748f1 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:55:59.809746 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3af36c01-5816-4953-b1b8-1aff2bd748f1 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:55:59.816601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3af36c01-5816-4953-b1b8-1aff2bd748f1 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:55:59.816601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3af36c01-5816-4953-b1b8-1aff2bd748f1 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:55:59.816601 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3af36c01-5816-4953-b1b8-1aff2bd748f1 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:55:59.876817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3af36c01-5816-4953-b1b8-1aff2bd748f1 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b174ee92c43245bd80a537ae8f75a72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a1e71634244b34b56847d2d218947d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:55:59.884620 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3af36c01-5816-4953-b1b8-1aff2bd748f1 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151" status: 200 len: 1272 microversion: 2.1 time: 0.087911 Oct 29 01:55:59.886375 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3652/7520] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:55:59 2022] GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 => generated 1272 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:56:00.908176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d6afb6b1-157a-43d9-b4a9-ec1abdc69791 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:56:00.908795 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d6afb6b1-157a-43d9-b4a9-ec1abdc69791 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:56:00.915916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6afb6b1-157a-43d9-b4a9-ec1abdc69791 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:00.916978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6afb6b1-157a-43d9-b4a9-ec1abdc69791 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:00.917487 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6afb6b1-157a-43d9-b4a9-ec1abdc69791 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:00.918199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6afb6b1-157a-43d9-b4a9-ec1abdc69791 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:00.918662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6afb6b1-157a-43d9-b4a9-ec1abdc69791 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:00.919124 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d6afb6b1-157a-43d9-b4a9-ec1abdc69791 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:01.006128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-44a66b61-996f-4fd0-921e-fca4ae9d2fa7 req-ec2d2bbd-be5d-47bd-bbbf-27ca902d1f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e253f908-c296-4672-9660-87e34c86a151", "tag": "204e4fb8-3b13-4f46-a912-dd007d619906"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:56:01.017838 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-44a66b61-996f-4fd0-921e-fca4ae9d2fa7 req-ec2d2bbd-be5d-47bd-bbbf-27ca902d1f47 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:01.018750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-44a66b61-996f-4fd0-921e-fca4ae9d2fa7 req-ec2d2bbd-be5d-47bd-bbbf-27ca902d1f47 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:01.019500 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-44a66b61-996f-4fd0-921e-fca4ae9d2fa7 req-ec2d2bbd-be5d-47bd-bbbf-27ca902d1f47 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:01.032210 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-44a66b61-996f-4fd0-921e-fca4ae9d2fa7 req-ec2d2bbd-be5d-47bd-bbbf-27ca902d1f47 service nova] Creating event network-changed:204e4fb8-3b13-4f46-a912-dd007d619906 for instance e253f908-c296-4672-9660-87e34c86a151 on n-h1-862964-3 Oct 29 01:56:01.037370 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-44a66b61-996f-4fd0-921e-fca4ae9d2fa7 req-ec2d2bbd-be5d-47bd-bbbf-27ca902d1f47 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035257 Oct 29 01:56:01.037967 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3653/7521] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:56:01.138269 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d6afb6b1-157a-43d9-b4a9-ec1abdc69791 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b174ee92c43245bd80a537ae8f75a72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a1e71634244b34b56847d2d218947d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:56:01.146900 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d6afb6b1-157a-43d9-b4a9-ec1abdc69791 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151" status: 200 len: 1314 microversion: 2.1 time: 0.242945 Oct 29 01:56:01.147488 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3869/7522] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:56:00 2022] GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:56:02.172459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d8aa2467-0a70-4c48-9556-b0197d9961a5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:56:02.173196 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d8aa2467-0a70-4c48-9556-b0197d9961a5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:56:02.180449 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8aa2467-0a70-4c48-9556-b0197d9961a5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:02.180958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8aa2467-0a70-4c48-9556-b0197d9961a5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:02.181414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8aa2467-0a70-4c48-9556-b0197d9961a5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:02.182112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8aa2467-0a70-4c48-9556-b0197d9961a5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:02.183786 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8aa2467-0a70-4c48-9556-b0197d9961a5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:02.184233 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d8aa2467-0a70-4c48-9556-b0197d9961a5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:02.327214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d8aa2467-0a70-4c48-9556-b0197d9961a5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b174ee92c43245bd80a537ae8f75a72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a1e71634244b34b56847d2d218947d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:56:02.335261 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d8aa2467-0a70-4c48-9556-b0197d9961a5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151" status: 200 len: 1314 microversion: 2.1 time: 0.168397 Oct 29 01:56:02.340945 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3654/7523] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:56:02 2022] GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:56:03.358836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d2a0c4c3-baaa-431c-b76f-b553df0fa9d6 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:56:03.359455 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d2a0c4c3-baaa-431c-b76f-b553df0fa9d6 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:56:03.366488 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2a0c4c3-baaa-431c-b76f-b553df0fa9d6 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:03.366977 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2a0c4c3-baaa-431c-b76f-b553df0fa9d6 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:03.367418 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2a0c4c3-baaa-431c-b76f-b553df0fa9d6 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:03.368184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2a0c4c3-baaa-431c-b76f-b553df0fa9d6 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:03.368702 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2a0c4c3-baaa-431c-b76f-b553df0fa9d6 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:03.369131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d2a0c4c3-baaa-431c-b76f-b553df0fa9d6 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:03.502780 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d2a0c4c3-baaa-431c-b76f-b553df0fa9d6 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b174ee92c43245bd80a537ae8f75a72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a1e71634244b34b56847d2d218947d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:56:03.510901 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d2a0c4c3-baaa-431c-b76f-b553df0fa9d6 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151" status: 200 len: 1314 microversion: 2.1 time: 0.156007 Oct 29 01:56:03.511652 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3870/7524] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:56:03 2022] GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:56:04.534200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-27bce1a6-56be-4144-ac3a-8b21b5a32632 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:56:04.534917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-27bce1a6-56be-4144-ac3a-8b21b5a32632 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:56:04.542421 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27bce1a6-56be-4144-ac3a-8b21b5a32632 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:04.542919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27bce1a6-56be-4144-ac3a-8b21b5a32632 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:04.543371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27bce1a6-56be-4144-ac3a-8b21b5a32632 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:04.544093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27bce1a6-56be-4144-ac3a-8b21b5a32632 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:04.544578 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27bce1a6-56be-4144-ac3a-8b21b5a32632 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:04.545013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-27bce1a6-56be-4144-ac3a-8b21b5a32632 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:04.679755 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-27bce1a6-56be-4144-ac3a-8b21b5a32632 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b174ee92c43245bd80a537ae8f75a72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a1e71634244b34b56847d2d218947d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:56:04.688984 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-27bce1a6-56be-4144-ac3a-8b21b5a32632 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151" status: 200 len: 1314 microversion: 2.1 time: 0.158775 Oct 29 01:56:04.689596 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3655/7525] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:56:04 2022] GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:56:05.712693 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-13f62a5d-80ee-4fa9-bfed-bbd2dd55e176 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:56:05.714055 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-13f62a5d-80ee-4fa9-bfed-bbd2dd55e176 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:56:05.721320 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13f62a5d-80ee-4fa9-bfed-bbd2dd55e176 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:05.721813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13f62a5d-80ee-4fa9-bfed-bbd2dd55e176 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:05.722256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13f62a5d-80ee-4fa9-bfed-bbd2dd55e176 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:05.722955 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13f62a5d-80ee-4fa9-bfed-bbd2dd55e176 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:05.723413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13f62a5d-80ee-4fa9-bfed-bbd2dd55e176 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:05.723839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-13f62a5d-80ee-4fa9-bfed-bbd2dd55e176 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:05.856117 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-13f62a5d-80ee-4fa9-bfed-bbd2dd55e176 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b174ee92c43245bd80a537ae8f75a72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a1e71634244b34b56847d2d218947d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:56:05.863955 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-13f62a5d-80ee-4fa9-bfed-bbd2dd55e176 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151" status: 200 len: 1314 microversion: 2.1 time: 0.155232 Oct 29 01:56:05.864537 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3871/7526] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:56:05 2022] GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:56:06.887948 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8e6df5c2-ec23-46dd-8894-6a2c2c7ac5dc tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:56:06.888767 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8e6df5c2-ec23-46dd-8894-6a2c2c7ac5dc tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:56:06.891612 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:56:06.897515 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e6df5c2-ec23-46dd-8894-6a2c2c7ac5dc tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:06.898536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e6df5c2-ec23-46dd-8894-6a2c2c7ac5dc tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:06.898536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e6df5c2-ec23-46dd-8894-6a2c2c7ac5dc tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:06.900031 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e6df5c2-ec23-46dd-8894-6a2c2c7ac5dc tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:06.900477 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e6df5c2-ec23-46dd-8894-6a2c2c7ac5dc tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:06.902069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8e6df5c2-ec23-46dd-8894-6a2c2c7ac5dc tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:07.060200 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8e6df5c2-ec23-46dd-8894-6a2c2c7ac5dc tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b174ee92c43245bd80a537ae8f75a72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a1e71634244b34b56847d2d218947d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:56:07.068346 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8e6df5c2-ec23-46dd-8894-6a2c2c7ac5dc tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151" status: 200 len: 1314 microversion: 2.1 time: 0.185004 Oct 29 01:56:07.068932 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3656/7527] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:56:06 2022] GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:56:08.094141 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ebc8d589-72ec-4f7a-90f4-34957bdb3a1e tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:56:08.094855 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ebc8d589-72ec-4f7a-90f4-34957bdb3a1e tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:56:08.096841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:56:08.102637 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebc8d589-72ec-4f7a-90f4-34957bdb3a1e tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:08.103341 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebc8d589-72ec-4f7a-90f4-34957bdb3a1e tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:08.103782 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebc8d589-72ec-4f7a-90f4-34957bdb3a1e tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:08.105030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebc8d589-72ec-4f7a-90f4-34957bdb3a1e tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:08.105515 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebc8d589-72ec-4f7a-90f4-34957bdb3a1e tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:08.105944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebc8d589-72ec-4f7a-90f4-34957bdb3a1e tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:08.240670 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ebc8d589-72ec-4f7a-90f4-34957bdb3a1e tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b174ee92c43245bd80a537ae8f75a72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a1e71634244b34b56847d2d218947d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:56:08.249597 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ebc8d589-72ec-4f7a-90f4-34957bdb3a1e tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151" status: 200 len: 1314 microversion: 2.1 time: 0.159919 Oct 29 01:56:08.250300 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3872/7528] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:56:08 2022] GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:56:08.340228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:56:08.407941 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-75fc4158-86cf-4ee1-a0d0-2b15d6ea6ca4 req-0494d00c-5139-4708-93f6-fbab424d0b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e253f908-c296-4672-9660-87e34c86a151", "name": "network-vif-plugged", "status": "completed", "tag": "204e4fb8-3b13-4f46-a912-dd007d619906"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:56:08.421524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-75fc4158-86cf-4ee1-a0d0-2b15d6ea6ca4 req-0494d00c-5139-4708-93f6-fbab424d0b33 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:08.421958 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-75fc4158-86cf-4ee1-a0d0-2b15d6ea6ca4 req-0494d00c-5139-4708-93f6-fbab424d0b33 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:08.422402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-75fc4158-86cf-4ee1-a0d0-2b15d6ea6ca4 req-0494d00c-5139-4708-93f6-fbab424d0b33 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:08.434633 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-75fc4158-86cf-4ee1-a0d0-2b15d6ea6ca4 req-0494d00c-5139-4708-93f6-fbab424d0b33 service nova] Creating event network-vif-plugged:204e4fb8-3b13-4f46-a912-dd007d619906 for instance e253f908-c296-4672-9660-87e34c86a151 on n-h1-862964-3 Oct 29 01:56:08.440051 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-75fc4158-86cf-4ee1-a0d0-2b15d6ea6ca4 req-0494d00c-5139-4708-93f6-fbab424d0b33 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105259 Oct 29 01:56:08.440656 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3657/7529] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:56:09.272802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-36406d44-d254-4379-bce9-820cd1d0c5fe tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:56:09.273449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-36406d44-d254-4379-bce9-820cd1d0c5fe tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:56:09.281227 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36406d44-d254-4379-bce9-820cd1d0c5fe tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:09.281724 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36406d44-d254-4379-bce9-820cd1d0c5fe tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:09.282165 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36406d44-d254-4379-bce9-820cd1d0c5fe tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:09.282881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36406d44-d254-4379-bce9-820cd1d0c5fe tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:09.283338 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36406d44-d254-4379-bce9-820cd1d0c5fe tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:09.283803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-36406d44-d254-4379-bce9-820cd1d0c5fe tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:09.419188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-36406d44-d254-4379-bce9-820cd1d0c5fe tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b174ee92c43245bd80a537ae8f75a72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a1e71634244b34b56847d2d218947d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:56:09.427072 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-36406d44-d254-4379-bce9-820cd1d0c5fe tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151" status: 200 len: 1314 microversion: 2.1 time: 0.158283 Oct 29 01:56:09.427713 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3873/7530] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:56:09 2022] GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:56:10.451281 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5ddac975-50b2-4477-915b-029562e07ab0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:56:10.452067 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5ddac975-50b2-4477-915b-029562e07ab0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:56:10.459891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ddac975-50b2-4477-915b-029562e07ab0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:10.460431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ddac975-50b2-4477-915b-029562e07ab0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:10.461038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ddac975-50b2-4477-915b-029562e07ab0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:10.461782 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ddac975-50b2-4477-915b-029562e07ab0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:10.462271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ddac975-50b2-4477-915b-029562e07ab0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:10.462714 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ddac975-50b2-4477-915b-029562e07ab0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:10.600337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5ddac975-50b2-4477-915b-029562e07ab0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b174ee92c43245bd80a537ae8f75a72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a1e71634244b34b56847d2d218947d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:56:10.609199 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5ddac975-50b2-4477-915b-029562e07ab0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151" status: 200 len: 1498 microversion: 2.1 time: 0.162687 Oct 29 01:56:10.609775 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3658/7531] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:56:10 2022] GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:56:14.814502 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-261f0848-e4e0-4ffc-92e9-2b3c20c2dbe5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:56:14.815050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-261f0848-e4e0-4ffc-92e9-2b3c20c2dbe5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:56:14.821477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-261f0848-e4e0-4ffc-92e9-2b3c20c2dbe5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:14.821970 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-261f0848-e4e0-4ffc-92e9-2b3c20c2dbe5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:14.822411 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-261f0848-e4e0-4ffc-92e9-2b3c20c2dbe5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:14.823327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-261f0848-e4e0-4ffc-92e9-2b3c20c2dbe5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:14.823792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-261f0848-e4e0-4ffc-92e9-2b3c20c2dbe5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:14.824226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-261f0848-e4e0-4ffc-92e9-2b3c20c2dbe5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:14.850501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-261f0848-e4e0-4ffc-92e9-2b3c20c2dbe5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:56:15.209561 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-261f0848-e4e0-4ffc-92e9-2b3c20c2dbe5 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151" status: 204 len: 0 microversion: 2.1 time: 0.400952 Oct 29 01:56:15.210267 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3874/7532] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:56:14 2022] DELETE /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:56:15.219494 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ad5b7316-fb5f-4293-a4d5-6f554a2d0410 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:56:15.220127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ad5b7316-fb5f-4293-a4d5-6f554a2d0410 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:56:15.227293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad5b7316-fb5f-4293-a4d5-6f554a2d0410 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:15.227808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad5b7316-fb5f-4293-a4d5-6f554a2d0410 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:15.228268 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad5b7316-fb5f-4293-a4d5-6f554a2d0410 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:15.229518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad5b7316-fb5f-4293-a4d5-6f554a2d0410 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:15.230012 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad5b7316-fb5f-4293-a4d5-6f554a2d0410 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:15.230549 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ad5b7316-fb5f-4293-a4d5-6f554a2d0410 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:15.376677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ad5b7316-fb5f-4293-a4d5-6f554a2d0410 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b174ee92c43245bd80a537ae8f75a72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a1e71634244b34b56847d2d218947d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:56:15.385336 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ad5b7316-fb5f-4293-a4d5-6f554a2d0410 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151" status: 200 len: 1504 microversion: 2.1 time: 0.169760 Oct 29 01:56:15.389227 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3659/7533] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:56:15 2022] GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:56:16.410066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-846eba28-c427-4465-99df-4eb5c103ad4d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:56:16.410777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-846eba28-c427-4465-99df-4eb5c103ad4d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:56:16.417984 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-846eba28-c427-4465-99df-4eb5c103ad4d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:16.418474 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-846eba28-c427-4465-99df-4eb5c103ad4d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:16.418929 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-846eba28-c427-4465-99df-4eb5c103ad4d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:16.419635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-846eba28-c427-4465-99df-4eb5c103ad4d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:16.420103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-846eba28-c427-4465-99df-4eb5c103ad4d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:16.420539 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-846eba28-c427-4465-99df-4eb5c103ad4d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:16.560251 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-846eba28-c427-4465-99df-4eb5c103ad4d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b174ee92c43245bd80a537ae8f75a72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a1e71634244b34b56847d2d218947d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:56:16.569768 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-846eba28-c427-4465-99df-4eb5c103ad4d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151" status: 200 len: 1504 microversion: 2.1 time: 0.163930 Oct 29 01:56:16.570358 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3875/7534] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:56:16 2022] GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:56:17.598311 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3f80e49b-8b44-4a88-83c9-89acf240ef21 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:56:17.598949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3f80e49b-8b44-4a88-83c9-89acf240ef21 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:56:17.606114 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f80e49b-8b44-4a88-83c9-89acf240ef21 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:17.606623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f80e49b-8b44-4a88-83c9-89acf240ef21 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:17.607081 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f80e49b-8b44-4a88-83c9-89acf240ef21 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:17.608011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f80e49b-8b44-4a88-83c9-89acf240ef21 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:17.608492 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f80e49b-8b44-4a88-83c9-89acf240ef21 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:17.608938 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3f80e49b-8b44-4a88-83c9-89acf240ef21 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:17.830700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-6bf14230-56c7-4bfb-be81-8de8bcf7444b req-86be770d-4776-4ac4-833b-d7d5980b9931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e253f908-c296-4672-9660-87e34c86a151", "name": "network-vif-deleted", "tag": "204e4fb8-3b13-4f46-a912-dd007d619906"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:56:17.836106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3f80e49b-8b44-4a88-83c9-89acf240ef21 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b174ee92c43245bd80a537ae8f75a72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a1e71634244b34b56847d2d218947d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:56:17.842802 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6bf14230-56c7-4bfb-be81-8de8bcf7444b req-86be770d-4776-4ac4-833b-d7d5980b9931 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:17.843292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6bf14230-56c7-4bfb-be81-8de8bcf7444b req-86be770d-4776-4ac4-833b-d7d5980b9931 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:17.843731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6bf14230-56c7-4bfb-be81-8de8bcf7444b req-86be770d-4776-4ac4-833b-d7d5980b9931 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:17.845439 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3f80e49b-8b44-4a88-83c9-89acf240ef21 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151" status: 200 len: 1504 microversion: 2.1 time: 0.253170 Oct 29 01:56:17.846439 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3660/7535] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:56:17 2022] GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:56:17.855630 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-6bf14230-56c7-4bfb-be81-8de8bcf7444b req-86be770d-4776-4ac4-833b-d7d5980b9931 service nova] Creating event network-vif-deleted:204e4fb8-3b13-4f46-a912-dd007d619906 for instance e253f908-c296-4672-9660-87e34c86a151 on n-h1-862964-3 Oct 29 01:56:17.860581 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-6bf14230-56c7-4bfb-be81-8de8bcf7444b req-86be770d-4776-4ac4-833b-d7d5980b9931 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033674 Oct 29 01:56:17.861201 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3876/7536] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:56:18.870026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-45fc7021-3d34-439c-9979-b4912e4689f0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:56:18.870799 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-45fc7021-3d34-439c-9979-b4912e4689f0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:56:18.878254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45fc7021-3d34-439c-9979-b4912e4689f0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:18.878789 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45fc7021-3d34-439c-9979-b4912e4689f0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:18.879419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45fc7021-3d34-439c-9979-b4912e4689f0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:18.880201 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45fc7021-3d34-439c-9979-b4912e4689f0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:18.880670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45fc7021-3d34-439c-9979-b4912e4689f0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:18.881116 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45fc7021-3d34-439c-9979-b4912e4689f0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:18.914390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45fc7021-3d34-439c-9979-b4912e4689f0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:18.914898 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45fc7021-3d34-439c-9979-b4912e4689f0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:18.915347 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-45fc7021-3d34-439c-9979-b4912e4689f0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:18.915805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-45fc7021-3d34-439c-9979-b4912e4689f0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lazy-loading 'fault' on Instance uuid e253f908-c296-4672-9660-87e34c86a151 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:56:18.962814 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-45fc7021-3d34-439c-9979-b4912e4689f0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b174ee92c43245bd80a537ae8f75a72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a1e71634244b34b56847d2d218947d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:56:18.971181 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-45fc7021-3d34-439c-9979-b4912e4689f0 tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151" status: 200 len: 1304 microversion: 2.1 time: 0.105695 Oct 29 01:56:18.971784 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3661/7537] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:56:18 2022] GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:56:19.996355 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fe75521b-fc8d-43a4-9f66-1f76a71fa23d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:56:19.997062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-fe75521b-fc8d-43a4-9f66-1f76a71fa23d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] [instance: e253f908-c296-4672-9660-87e34c86a151] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:56:20.003319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe75521b-fc8d-43a4-9f66-1f76a71fa23d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:20.003800 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe75521b-fc8d-43a4-9f66-1f76a71fa23d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:20.004235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe75521b-fc8d-43a4-9f66-1f76a71fa23d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:20.004922 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe75521b-fc8d-43a4-9f66-1f76a71fa23d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:20.005400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe75521b-fc8d-43a4-9f66-1f76a71fa23d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:20.005825 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-fe75521b-fc8d-43a4-9f66-1f76a71fa23d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:20.019683 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-fe75521b-fc8d-43a4-9f66-1f76a71fa23d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] HTTP exception thrown: Instance e253f908-c296-4672-9660-87e34c86a151 could not be found. Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fe75521b-fc8d-43a4-9f66-1f76a71fa23d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Request method failure captured: Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 HTTP/1.1 Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIgp68NzihjhWLWJR6joYHx6IGdJznFqHQlZ1V5HSxdEiNF6KP9KzlciNIDq3sxVJJ6tRcQxLxm6rQ2kWY6y416IHNLdQ1qDm-Gc6jEYI6GMD1_Tt9-Xm5jFUZPXSP08ocqnhBPyGGr5p0QwL6e43XZCrckhDuXtJYs8UOfbK42V_0k Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 03a1e71634244b34b56847d2d218947d Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-VolumesActionsTest-1884646148 Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03a1e71634244b34b56847d2d218947d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/03a1e71634244b34b56847d2d218947d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03a1e71634244b34b56847d2d218947d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_03a1e71634244b34b56847d2d218947d", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-VolumesActionsTest-1884646148 Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 03a1e71634244b34b56847d2d218947d Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-VolumesActionsTest-1884646148 Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-VolumesActionsTest-1884646148-project Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: b174ee92c43245bd80a537ae8f75a72c Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-VolumesActionsTest-1884646148-project Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance e253f908-c296-4672-9660-87e34c86a151 could not be found. Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'e253f908-c296-4672-9660-87e34c86a151'} Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e253f908-c296-4672-9660-87e34c86a151 could not be found. Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e253f908-c296-4672-9660-87e34c86a151 could not be found. Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:56:20.021350 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:56:20.025995 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:56:20.025995 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:56:20.025995 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:56:20.025995 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:56:20.025995 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:56:20.025995 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e253f908-c296-4672-9660-87e34c86a151 could not be found. Oct 29 01:56:20.025995 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:56:20.025995 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-fe75521b-fc8d-43a4-9f66-1f76a71fa23d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] Returning 404 to user: Instance e253f908-c296-4672-9660-87e34c86a151 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:56:20.025995 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-fe75521b-fc8d-43a4-9f66-1f76a71fa23d tempest-VolumesActionsTest-1884646148 tempest-VolumesActionsTest-1884646148-project] 10.222.0.26 "GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151" status: 404 len: 111 microversion: 2.1 time: 0.032163 Oct 29 01:56:20.025995 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3877/7538] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:56:19 2022] GET /compute/v2.1/servers/e253f908-c296-4672-9660-87e34c86a151 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:56:56.712478 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-81c47605-0875-4f99-93ce-4b16173a2a46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:56:56.713050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-81c47605-0875-4f99-93ce-4b16173a2a46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:56:56.717453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-6029b27f-8a5f-48d1-902d-a61baecff40b req-b8bb8e79-6b47-4d25-baf9-6974635995cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d153847-7a07-4c05-956c-05b365c81c37", "tag": "7dcf8f03-c531-4e04-aab6-680b834bdc52"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:56:56.719874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:56:56.721594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=56 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:56:56.725628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81c47605-0875-4f99-93ce-4b16173a2a46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:56.726359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81c47605-0875-4f99-93ce-4b16173a2a46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:56.727092 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81c47605-0875-4f99-93ce-4b16173a2a46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:56.728106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81c47605-0875-4f99-93ce-4b16173a2a46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:56.728788 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81c47605-0875-4f99-93ce-4b16173a2a46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:56.729463 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-81c47605-0875-4f99-93ce-4b16173a2a46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:56.730037 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:56:56.730754 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:56:56.742508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6029b27f-8a5f-48d1-902d-a61baecff40b req-b8bb8e79-6b47-4d25-baf9-6974635995cb service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:56.742997 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6029b27f-8a5f-48d1-902d-a61baecff40b req-b8bb8e79-6b47-4d25-baf9-6974635995cb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:56.744584 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6029b27f-8a5f-48d1-902d-a61baecff40b req-b8bb8e79-6b47-4d25-baf9-6974635995cb service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:56.760050 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-81c47605-0875-4f99-93ce-4b16173a2a46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:56:56.776534 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-6029b27f-8a5f-48d1-902d-a61baecff40b req-b8bb8e79-6b47-4d25-baf9-6974635995cb service nova] Creating event network-changed:7dcf8f03-c531-4e04-aab6-680b834bdc52 for instance 4d153847-7a07-4c05-956c-05b365c81c37 on n-h2-862964-3 Oct 29 01:56:56.786741 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-6029b27f-8a5f-48d1-902d-a61baecff40b req-b8bb8e79-6b47-4d25-baf9-6974635995cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073838 Oct 29 01:56:56.788182 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3878/7539] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:56:57.132419 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-81c47605-0875-4f99-93ce-4b16173a2a46 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 204 len: 0 microversion: 2.1 time: 0.423563 Oct 29 01:56:57.133309 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3662/7540] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:56:56 2022] DELETE /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:56:57.143674 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-896e8de3-2961-40ce-9e19-b2645a7c757f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:56:57.144651 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-896e8de3-2961-40ce-9e19-b2645a7c757f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:56:57.154379 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-896e8de3-2961-40ce-9e19-b2645a7c757f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:57.155140 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-896e8de3-2961-40ce-9e19-b2645a7c757f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:57.155647 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-896e8de3-2961-40ce-9e19-b2645a7c757f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:57.156597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-896e8de3-2961-40ce-9e19-b2645a7c757f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:57.157289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-896e8de3-2961-40ce-9e19-b2645a7c757f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:57.157723 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-896e8de3-2961-40ce-9e19-b2645a7c757f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:57.352367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-896e8de3-2961-40ce-9e19-b2645a7c757f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:56:57.361399 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-896e8de3-2961-40ce-9e19-b2645a7c757f tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1576 microversion: 2.1 time: 0.222219 Oct 29 01:56:57.377714 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3879/7541] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:56:57 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1576 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:56:58.390187 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1b990a87-6dc8-4715-a50b-d5afd99307e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:56:58.391234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1b990a87-6dc8-4715-a50b-d5afd99307e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:56:58.401583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b990a87-6dc8-4715-a50b-d5afd99307e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:58.401583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b990a87-6dc8-4715-a50b-d5afd99307e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:58.401583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b990a87-6dc8-4715-a50b-d5afd99307e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:58.401794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b990a87-6dc8-4715-a50b-d5afd99307e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:58.402243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b990a87-6dc8-4715-a50b-d5afd99307e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:58.403247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1b990a87-6dc8-4715-a50b-d5afd99307e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:58.625342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-1b990a87-6dc8-4715-a50b-d5afd99307e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:56:58.634286 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1b990a87-6dc8-4715-a50b-d5afd99307e6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1457 microversion: 2.1 time: 0.250172 Oct 29 01:56:58.634946 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3663/7542] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:56:58 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1457 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:56:59.661390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-de6432ef-34ee-4e85-935d-2566058dc732 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:56:59.662169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-de6432ef-34ee-4e85-935d-2566058dc732 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:56:59.669577 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de6432ef-34ee-4e85-935d-2566058dc732 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:59.670498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de6432ef-34ee-4e85-935d-2566058dc732 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:59.671147 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de6432ef-34ee-4e85-935d-2566058dc732 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:59.672094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de6432ef-34ee-4e85-935d-2566058dc732 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:59.672769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de6432ef-34ee-4e85-935d-2566058dc732 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:59.673330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-de6432ef-34ee-4e85-935d-2566058dc732 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:59.698466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-6287f27a-726c-4a00-9c47-44a4447b6e7b req-f3078197-2884-4ee7-9284-604bec72e147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d153847-7a07-4c05-956c-05b365c81c37", "name": "network-vif-deleted", "tag": "7dcf8f03-c531-4e04-aab6-680b834bdc52"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:56:59.711245 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6287f27a-726c-4a00-9c47-44a4447b6e7b req-f3078197-2884-4ee7-9284-604bec72e147 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:56:59.712095 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6287f27a-726c-4a00-9c47-44a4447b6e7b req-f3078197-2884-4ee7-9284-604bec72e147 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:56:59.712708 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6287f27a-726c-4a00-9c47-44a4447b6e7b req-f3078197-2884-4ee7-9284-604bec72e147 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:56:59.728298 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-6287f27a-726c-4a00-9c47-44a4447b6e7b req-f3078197-2884-4ee7-9284-604bec72e147 service nova] Creating event network-vif-deleted:7dcf8f03-c531-4e04-aab6-680b834bdc52 for instance 4d153847-7a07-4c05-956c-05b365c81c37 on n-h2-862964-3 Oct 29 01:56:59.734479 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-6287f27a-726c-4a00-9c47-44a4447b6e7b req-f3078197-2884-4ee7-9284-604bec72e147 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040639 Oct 29 01:56:59.735446 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3664/7543] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:56:59.757798 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-de6432ef-34ee-4e85-935d-2566058dc732 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:56:59.767387 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-de6432ef-34ee-4e85-935d-2566058dc732 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1390 microversion: 2.1 time: 0.110810 Oct 29 01:56:59.783856 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3880/7544] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:56:59 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1390 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:00.792932 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2d47735c-3200-4f2b-abc0-e2e473061a90 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:00.794518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2d47735c-3200-4f2b-abc0-e2e473061a90 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:00.810383 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d47735c-3200-4f2b-abc0-e2e473061a90 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:00.811227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d47735c-3200-4f2b-abc0-e2e473061a90 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:00.811887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d47735c-3200-4f2b-abc0-e2e473061a90 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:00.812843 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d47735c-3200-4f2b-abc0-e2e473061a90 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:00.813701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d47735c-3200-4f2b-abc0-e2e473061a90 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:00.814350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2d47735c-3200-4f2b-abc0-e2e473061a90 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:00.897323 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2d47735c-3200-4f2b-abc0-e2e473061a90 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:00.899018 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2d47735c-3200-4f2b-abc0-e2e473061a90 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1224 microversion: 2.1 time: 0.110246 Oct 29 01:57:00.916603 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3665/7545] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:00 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1224 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:01.925603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-08b4df2e-3172-436c-bd08-dd6b8b6701fd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:01.926220 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-08b4df2e-3172-436c-bd08-dd6b8b6701fd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:01.933457 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08b4df2e-3172-436c-bd08-dd6b8b6701fd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:01.933797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08b4df2e-3172-436c-bd08-dd6b8b6701fd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:01.945969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08b4df2e-3172-436c-bd08-dd6b8b6701fd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:01.945969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08b4df2e-3172-436c-bd08-dd6b8b6701fd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:01.945969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08b4df2e-3172-436c-bd08-dd6b8b6701fd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:01.945969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-08b4df2e-3172-436c-bd08-dd6b8b6701fd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:02.013436 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-08b4df2e-3172-436c-bd08-dd6b8b6701fd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:02.023501 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-08b4df2e-3172-436c-bd08-dd6b8b6701fd tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1224 microversion: 2.1 time: 0.102619 Oct 29 01:57:02.024571 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3881/7546] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:01 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:57:03.047977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8b1d11e1-12d8-4ba1-a8e2-9c14fc3cab43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:03.048845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8b1d11e1-12d8-4ba1-a8e2-9c14fc3cab43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:03.056977 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b1d11e1-12d8-4ba1-a8e2-9c14fc3cab43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:03.057729 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b1d11e1-12d8-4ba1-a8e2-9c14fc3cab43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:03.058402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b1d11e1-12d8-4ba1-a8e2-9c14fc3cab43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:03.059367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b1d11e1-12d8-4ba1-a8e2-9c14fc3cab43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:03.059962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b1d11e1-12d8-4ba1-a8e2-9c14fc3cab43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:03.060440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8b1d11e1-12d8-4ba1-a8e2-9c14fc3cab43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:03.146777 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8b1d11e1-12d8-4ba1-a8e2-9c14fc3cab43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:03.155896 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8b1d11e1-12d8-4ba1-a8e2-9c14fc3cab43 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1224 microversion: 2.1 time: 0.112522 Oct 29 01:57:03.157728 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3666/7547] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:03 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1224 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:04.179009 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0c9f94a9-4f32-48f0-a3ad-e1559dd930b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:04.179622 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0c9f94a9-4f32-48f0-a3ad-e1559dd930b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:04.192526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c9f94a9-4f32-48f0-a3ad-e1559dd930b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:04.193030 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c9f94a9-4f32-48f0-a3ad-e1559dd930b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:04.193516 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c9f94a9-4f32-48f0-a3ad-e1559dd930b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:04.194238 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c9f94a9-4f32-48f0-a3ad-e1559dd930b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:04.194700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c9f94a9-4f32-48f0-a3ad-e1559dd930b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:04.195128 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0c9f94a9-4f32-48f0-a3ad-e1559dd930b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:04.280389 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-0c9f94a9-4f32-48f0-a3ad-e1559dd930b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:04.289341 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0c9f94a9-4f32-48f0-a3ad-e1559dd930b0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1224 microversion: 2.1 time: 0.114176 Oct 29 01:57:04.289930 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3882/7548] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:04 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:05.315396 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-ba67f12e-7163-4dbc-b0a7-514066748ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:05.319224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-ba67f12e-7163-4dbc-b0a7-514066748ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:05.348198 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba67f12e-7163-4dbc-b0a7-514066748ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:05.349242 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba67f12e-7163-4dbc-b0a7-514066748ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:05.350390 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba67f12e-7163-4dbc-b0a7-514066748ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:05.352060 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba67f12e-7163-4dbc-b0a7-514066748ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:05.353381 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba67f12e-7163-4dbc-b0a7-514066748ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:05.354454 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba67f12e-7163-4dbc-b0a7-514066748ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:05.392961 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba67f12e-7163-4dbc-b0a7-514066748ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:05.393848 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba67f12e-7163-4dbc-b0a7-514066748ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:05.394464 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-ba67f12e-7163-4dbc-b0a7-514066748ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:05.395094 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-ba67f12e-7163-4dbc-b0a7-514066748ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lazy-loading 'fault' on Instance uuid 4d153847-7a07-4c05-956c-05b365c81c37 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:57:05.458836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-ba67f12e-7163-4dbc-b0a7-514066748ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:05.477545 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-ba67f12e-7163-4dbc-b0a7-514066748ea6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 200 len: 1183 microversion: 2.1 time: 0.158489 Oct 29 01:57:05.477545 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3667/7549] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:05 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 1183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:06.501319 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-064349fc-0b29-4950-8773-e48028e71f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:06.501950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-064349fc-0b29-4950-8773-e48028e71f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 4d153847-7a07-4c05-956c-05b365c81c37] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:06.509115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-064349fc-0b29-4950-8773-e48028e71f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:06.518292 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-064349fc-0b29-4950-8773-e48028e71f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:06.519085 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-064349fc-0b29-4950-8773-e48028e71f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:06.519869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-064349fc-0b29-4950-8773-e48028e71f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:06.520351 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-064349fc-0b29-4950-8773-e48028e71f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:06.520792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-064349fc-0b29-4950-8773-e48028e71f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:06.545121 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-064349fc-0b29-4950-8773-e48028e71f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] HTTP exception thrown: Instance 4d153847-7a07-4c05-956c-05b365c81c37 could not be found. Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-064349fc-0b29-4950-8773-e48028e71f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Request method failure captured: Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 HTTP/1.1 Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXISL1fYm1j7NXik3zsNtroj_Oy-crTrvQAeW5M-FwwtP3LsKgHXpuppTsI04rMuajP4UZsmStYeX1aQyWE5BokToP2AX7pO99qAjgwqGhP0Pb1MuaH07JyrTdqaWdL6Co3a2Gha0Gb4NOVY73erVtuC0neHUxTJ51YCufPzngi0azyM Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37416a9397fa4c6dbd0bfe8dee191577", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-TestVolumeBootPattern-743321222 Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8b8f36d10fa340f784581a3cf9a15606 Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 4d153847-7a07-4c05-956c-05b365c81c37 could not be found. Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '4d153847-7a07-4c05-956c-05b365c81c37'} Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d153847-7a07-4c05-956c-05b365c81c37 could not be found. Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d153847-7a07-4c05-956c-05b365c81c37 could not be found. Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:57:06.546860 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:57:06.551564 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:57:06.551564 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:57:06.551564 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:57:06.551564 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:57:06.551564 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:57:06.551564 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d153847-7a07-4c05-956c-05b365c81c37 could not be found. Oct 29 01:57:06.551564 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:57:06.551564 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-064349fc-0b29-4950-8773-e48028e71f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Returning 404 to user: Instance 4d153847-7a07-4c05-956c-05b365c81c37 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:57:06.551564 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-064349fc-0b29-4950-8773-e48028e71f28 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37" status: 404 len: 111 microversion: 2.1 time: 0.050975 Oct 29 01:57:06.551564 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3883/7550] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:06 2022] GET /compute/v2.1/servers/4d153847-7a07-4c05-956c-05b365c81c37 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:57:15.508137 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8a0dbb37-a739-4cf2-8f21-6f685c005bee tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:15.508808 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-4bcc95c8-fbed-4532-bbef-63803a7b2424 req-a3df1af8-a5fe-4d73-842b-13ea702f9896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe4dd02-cca8-4d99-ac6a-fde00c1b297b", "tag": "ec96047a-0566-4914-9228-e484f10a1ab9"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:57:15.509742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8a0dbb37-a739-4cf2-8f21-6f685c005bee tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:15.513844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:57:15.514556 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:57:15.519203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a0dbb37-a739-4cf2-8f21-6f685c005bee tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:15.519712 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a0dbb37-a739-4cf2-8f21-6f685c005bee tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:15.520623 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4bcc95c8-fbed-4532-bbef-63803a7b2424 req-a3df1af8-a5fe-4d73-842b-13ea702f9896 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:15.521098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a0dbb37-a739-4cf2-8f21-6f685c005bee tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:15.521760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4bcc95c8-fbed-4532-bbef-63803a7b2424 req-a3df1af8-a5fe-4d73-842b-13ea702f9896 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:15.522203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-4bcc95c8-fbed-4532-bbef-63803a7b2424 req-a3df1af8-a5fe-4d73-842b-13ea702f9896 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:15.532119 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a0dbb37-a739-4cf2-8f21-6f685c005bee tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:15.532801 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a0dbb37-a739-4cf2-8f21-6f685c005bee tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:15.533439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8a0dbb37-a739-4cf2-8f21-6f685c005bee tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:15.536606 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-4bcc95c8-fbed-4532-bbef-63803a7b2424 req-a3df1af8-a5fe-4d73-842b-13ea702f9896 service nova] Creating event network-changed:ec96047a-0566-4914-9228-e484f10a1ab9 for instance 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b on n-h1-862964-3 Oct 29 01:57:15.542835 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-4bcc95c8-fbed-4532-bbef-63803a7b2424 req-a3df1af8-a5fe-4d73-842b-13ea702f9896 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037922 Oct 29 01:57:15.544535 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3668/7551] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:57:15.570482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8a0dbb37-a739-4cf2-8f21-6f685c005bee tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:57:15.970936 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8a0dbb37-a739-4cf2-8f21-6f685c005bee tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 204 len: 0 microversion: 2.1 time: 0.466324 Oct 29 01:57:15.972363 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3884/7552] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:57:15 2022] DELETE /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:57:15.982993 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-452da2bd-adb5-433c-82c4-3255862671f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:15.983902 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-452da2bd-adb5-433c-82c4-3255862671f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:15.990529 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-452da2bd-adb5-433c-82c4-3255862671f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:15.991290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-452da2bd-adb5-433c-82c4-3255862671f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:15.992307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-452da2bd-adb5-433c-82c4-3255862671f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:15.993247 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-452da2bd-adb5-433c-82c4-3255862671f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:15.993875 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-452da2bd-adb5-433c-82c4-3255862671f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:15.994469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-452da2bd-adb5-433c-82c4-3255862671f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:16.218207 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-452da2bd-adb5-433c-82c4-3255862671f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:16.230444 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-452da2bd-adb5-433c-82c4-3255862671f6 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1576 microversion: 2.1 time: 0.253382 Oct 29 01:57:16.240681 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3669/7553] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:15 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1576 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:17.255976 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1a872af1-5712-41e6-9330-aefc9403490c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:17.257796 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1a872af1-5712-41e6-9330-aefc9403490c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:17.265380 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a872af1-5712-41e6-9330-aefc9403490c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:17.265965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a872af1-5712-41e6-9330-aefc9403490c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:17.266545 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a872af1-5712-41e6-9330-aefc9403490c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:17.267331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a872af1-5712-41e6-9330-aefc9403490c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:17.268109 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a872af1-5712-41e6-9330-aefc9403490c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:17.268604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1a872af1-5712-41e6-9330-aefc9403490c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:17.468388 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1a872af1-5712-41e6-9330-aefc9403490c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:17.476467 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1a872af1-5712-41e6-9330-aefc9403490c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1458 microversion: 2.1 time: 0.224860 Oct 29 01:57:17.477052 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3885/7554] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:17 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1458 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:17.676837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-2a6cf196-9d01-4bad-9260-e95fce16f2c8 req-40e1de97-09a6-4234-b0fa-2a7bccf1a8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe4dd02-cca8-4d99-ac6a-fde00c1b297b", "name": "network-vif-deleted", "tag": "ec96047a-0566-4914-9228-e484f10a1ab9"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:57:17.689971 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2a6cf196-9d01-4bad-9260-e95fce16f2c8 req-40e1de97-09a6-4234-b0fa-2a7bccf1a8d7 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:17.690471 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2a6cf196-9d01-4bad-9260-e95fce16f2c8 req-40e1de97-09a6-4234-b0fa-2a7bccf1a8d7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:17.694240 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2a6cf196-9d01-4bad-9260-e95fce16f2c8 req-40e1de97-09a6-4234-b0fa-2a7bccf1a8d7 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:17.708953 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-2a6cf196-9d01-4bad-9260-e95fce16f2c8 req-40e1de97-09a6-4234-b0fa-2a7bccf1a8d7 service nova] Creating event network-vif-deleted:ec96047a-0566-4914-9228-e484f10a1ab9 for instance 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b on n-h1-862964-3 Oct 29 01:57:17.714155 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-2a6cf196-9d01-4bad-9260-e95fce16f2c8 req-40e1de97-09a6-4234-b0fa-2a7bccf1a8d7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040967 Oct 29 01:57:17.714835 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3670/7555] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:57:18.501023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f6d9c7eb-008c-4594-aa8d-52447c7edbb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:18.501641 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f6d9c7eb-008c-4594-aa8d-52447c7edbb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:18.517466 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6d9c7eb-008c-4594-aa8d-52447c7edbb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:18.518382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6d9c7eb-008c-4594-aa8d-52447c7edbb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:18.518923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6d9c7eb-008c-4594-aa8d-52447c7edbb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:18.520225 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6d9c7eb-008c-4594-aa8d-52447c7edbb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:18.520996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6d9c7eb-008c-4594-aa8d-52447c7edbb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:18.521659 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f6d9c7eb-008c-4594-aa8d-52447c7edbb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:18.701729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f6d9c7eb-008c-4594-aa8d-52447c7edbb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:18.701729 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f6d9c7eb-008c-4594-aa8d-52447c7edbb0 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1225 microversion: 2.1 time: 0.118626 Oct 29 01:57:18.701729 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3886/7556] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:18 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:19.718131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5822305a-0438-4a53-83a8-b33ddab47358 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:19.728435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5822305a-0438-4a53-83a8-b33ddab47358 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:19.728435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5822305a-0438-4a53-83a8-b33ddab47358 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:19.728435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5822305a-0438-4a53-83a8-b33ddab47358 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:19.728435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5822305a-0438-4a53-83a8-b33ddab47358 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:19.728435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5822305a-0438-4a53-83a8-b33ddab47358 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:19.728435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5822305a-0438-4a53-83a8-b33ddab47358 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:19.729445 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5822305a-0438-4a53-83a8-b33ddab47358 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:19.800322 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5822305a-0438-4a53-83a8-b33ddab47358 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:19.812156 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5822305a-0438-4a53-83a8-b33ddab47358 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1225 microversion: 2.1 time: 0.103163 Oct 29 01:57:19.812811 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3671/7557] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:19 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:20.836195 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81564d13-9962-47df-9302-30a27b278929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:20.837815 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-81564d13-9962-47df-9302-30a27b278929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:20.855281 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81564d13-9962-47df-9302-30a27b278929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:20.856048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81564d13-9962-47df-9302-30a27b278929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:20.856769 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81564d13-9962-47df-9302-30a27b278929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:20.858381 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81564d13-9962-47df-9302-30a27b278929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:20.858896 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81564d13-9962-47df-9302-30a27b278929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:20.859789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81564d13-9962-47df-9302-30a27b278929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:20.929176 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-81564d13-9962-47df-9302-30a27b278929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:20.938071 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-81564d13-9962-47df-9302-30a27b278929 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1225 microversion: 2.1 time: 0.106264 Oct 29 01:57:20.938659 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3887/7558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:20 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:21.962672 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5ba238a8-8478-46c1-a05a-0393ff01252c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:21.963924 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5ba238a8-8478-46c1-a05a-0393ff01252c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:21.972844 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ba238a8-8478-46c1-a05a-0393ff01252c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:21.978900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ba238a8-8478-46c1-a05a-0393ff01252c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:21.978900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ba238a8-8478-46c1-a05a-0393ff01252c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:21.978900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ba238a8-8478-46c1-a05a-0393ff01252c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:21.978900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ba238a8-8478-46c1-a05a-0393ff01252c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:21.978900 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ba238a8-8478-46c1-a05a-0393ff01252c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:22.074037 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5ba238a8-8478-46c1-a05a-0393ff01252c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:22.086568 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5ba238a8-8478-46c1-a05a-0393ff01252c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1225 microversion: 2.1 time: 0.126317 Oct 29 01:57:22.086568 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3672/7559] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:21 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1225 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:23.107471 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ae9b7992-d049-4411-b39f-5be081107f41 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:23.108969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ae9b7992-d049-4411-b39f-5be081107f41 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:23.116465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae9b7992-d049-4411-b39f-5be081107f41 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:23.116964 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae9b7992-d049-4411-b39f-5be081107f41 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:23.117442 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae9b7992-d049-4411-b39f-5be081107f41 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:23.118172 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae9b7992-d049-4411-b39f-5be081107f41 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:23.118635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae9b7992-d049-4411-b39f-5be081107f41 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:23.119102 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae9b7992-d049-4411-b39f-5be081107f41 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:23.158678 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae9b7992-d049-4411-b39f-5be081107f41 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:23.159169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae9b7992-d049-4411-b39f-5be081107f41 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:23.159609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ae9b7992-d049-4411-b39f-5be081107f41 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:23.160061 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-ae9b7992-d049-4411-b39f-5be081107f41 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lazy-loading 'fault' on Instance uuid 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:57:23.210946 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ae9b7992-d049-4411-b39f-5be081107f41 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b8f36d10fa340f784581a3cf9a15606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37416a9397fa4c6dbd0bfe8dee191577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:23.220007 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ae9b7992-d049-4411-b39f-5be081107f41 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 200 len: 1230 microversion: 2.1 time: 0.116429 Oct 29 01:57:23.220624 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3888/7560] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:23 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 1230 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:24.243132 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b6a66083-8f69-47b3-9b02-33eac3e4079c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:24.244497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b6a66083-8f69-47b3-9b02-33eac3e4079c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:24.254446 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6a66083-8f69-47b3-9b02-33eac3e4079c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:24.254939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6a66083-8f69-47b3-9b02-33eac3e4079c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:24.255594 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6a66083-8f69-47b3-9b02-33eac3e4079c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:24.256473 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6a66083-8f69-47b3-9b02-33eac3e4079c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:24.257208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6a66083-8f69-47b3-9b02-33eac3e4079c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:24.257842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b6a66083-8f69-47b3-9b02-33eac3e4079c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:24.274208 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-b6a66083-8f69-47b3-9b02-33eac3e4079c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] HTTP exception thrown: Instance 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b could not be found. Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b6a66083-8f69-47b3-9b02-33eac3e4079c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Request method failure captured: Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b HTTP/1.1 Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXISL1fYm1j7NXik3zsNtroj_Oy-crTrvQAeW5M-FwwtP3LsKgHXpuppTsI04rMuajP4UZsmStYeX1aQyWE5BokToP2AX7pO99qAjgwqGhP0Pb1MuaH07JyrTdqaWdL6Co3a2Gha0Gb4NOVY73erVtuC0neHUxTJ51YCufPzngi0azyM Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37416a9397fa4c6dbd0bfe8dee191577", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TestVolumeBootPattern-743321222 Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 8b8f36d10fa340f784581a3cf9a15606 Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b could not be found. Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '8fe4dd02-cca8-4d99-ac6a-fde00c1b297b'} Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b could not be found. Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b could not be found. Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:57:24.276127 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:57:24.283780 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:57:24.283780 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:57:24.283780 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:57:24.283780 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:57:24.283780 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:57:24.283780 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b could not be found. Oct 29 01:57:24.283780 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:57:24.283780 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b6a66083-8f69-47b3-9b02-33eac3e4079c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Returning 404 to user: Instance 8fe4dd02-cca8-4d99-ac6a-fde00c1b297b could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:57:24.285189 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b6a66083-8f69-47b3-9b02-33eac3e4079c tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b" status: 404 len: 111 microversion: 2.1 time: 0.038450 Oct 29 01:57:24.289286 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3673/7561] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:24 2022] GET /compute/v2.1/servers/8fe4dd02-cca8-4d99-ac6a-fde00c1b297b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:57:24.884108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-741d163a-d735-46ff-a2de-9fdc5bbfb020 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:24.884579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-741d163a-d735-46ff-a2de-9fdc5bbfb020 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:24.894164 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-741d163a-d735-46ff-a2de-9fdc5bbfb020 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:24.894885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-741d163a-d735-46ff-a2de-9fdc5bbfb020 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:24.895522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-741d163a-d735-46ff-a2de-9fdc5bbfb020 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:24.896298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-741d163a-d735-46ff-a2de-9fdc5bbfb020 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:24.896858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-741d163a-d735-46ff-a2de-9fdc5bbfb020 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:24.897405 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-741d163a-d735-46ff-a2de-9fdc5bbfb020 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:24.912533 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-741d163a-d735-46ff-a2de-9fdc5bbfb020 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] HTTP exception thrown: Instance 1ce139ca-0135-40eb-9654-26157715fc1a could not be found. Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-741d163a-d735-46ff-a2de-9fdc5bbfb020 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Request method failure captured: Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: request: DELETE /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a HTTP/1.1 Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXISL1fYm1j7NXik3zsNtroj_Oy-crTrvQAeW5M-FwwtP3LsKgHXpuppTsI04rMuajP4UZsmStYeX1aQyWE5BokToP2AX7pO99qAjgwqGhP0Pb1MuaH07JyrTdqaWdL6Co3a2Gha0Gb4NOVY73erVtuC0neHUxTJ51YCufPzngi0azyM Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37416a9397fa4c6dbd0bfe8dee191577", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-TestVolumeBootPattern-743321222 Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8b8f36d10fa340f784581a3cf9a15606 Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 1ce139ca-0135-40eb-9654-26157715fc1a could not be found. Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '1ce139ca-0135-40eb-9654-26157715fc1a'} Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce139ca-0135-40eb-9654-26157715fc1a could not be found. Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:57:24.917771 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:57:24.922378 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce139ca-0135-40eb-9654-26157715fc1a could not be found. Oct 29 01:57:24.922378 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:57:24.922378 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:57:24.922378 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:57:24.922378 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:57:24.922378 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:57:24.922378 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:57:24.922378 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:57:24.922378 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:57:24.922378 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce139ca-0135-40eb-9654-26157715fc1a could not be found. Oct 29 01:57:24.922378 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:57:24.922378 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-741d163a-d735-46ff-a2de-9fdc5bbfb020 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Returning 404 to user: Instance 1ce139ca-0135-40eb-9654-26157715fc1a could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:57:24.922378 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-741d163a-d735-46ff-a2de-9fdc5bbfb020 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 404 len: 111 microversion: 2.1 time: 0.041450 Oct 29 01:57:24.922378 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3889/7562] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:57:24 2022] DELETE /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:57:24.928967 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6ccd6014-41da-472d-afba-32bc5784e1d3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:24.929917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6ccd6014-41da-472d-afba-32bc5784e1d3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] [instance: 1ce139ca-0135-40eb-9654-26157715fc1a] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:24.936489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ccd6014-41da-472d-afba-32bc5784e1d3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:24.937293 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ccd6014-41da-472d-afba-32bc5784e1d3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:24.937818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ccd6014-41da-472d-afba-32bc5784e1d3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:24.938607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ccd6014-41da-472d-afba-32bc5784e1d3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:24.939153 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ccd6014-41da-472d-afba-32bc5784e1d3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:24.939803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6ccd6014-41da-472d-afba-32bc5784e1d3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:24.960072 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-6ccd6014-41da-472d-afba-32bc5784e1d3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] HTTP exception thrown: Instance 1ce139ca-0135-40eb-9654-26157715fc1a could not be found. Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6ccd6014-41da-472d-afba-32bc5784e1d3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Request method failure captured: Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a HTTP/1.1 Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXISL1fYm1j7NXik3zsNtroj_Oy-crTrvQAeW5M-FwwtP3LsKgHXpuppTsI04rMuajP4UZsmStYeX1aQyWE5BokToP2AX7pO99qAjgwqGhP0Pb1MuaH07JyrTdqaWdL6Co3a2Gha0Gb4NOVY73erVtuC0neHUxTJ51YCufPzngi0azyM Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37416a9397fa4c6dbd0bfe8dee191577"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37416a9397fa4c6dbd0bfe8dee191577", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TestVolumeBootPattern-743321222 Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 37416a9397fa4c6dbd0bfe8dee191577 Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TestVolumeBootPattern-743321222 Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 8b8f36d10fa340f784581a3cf9a15606 Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TestVolumeBootPattern-743321222-project Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 1ce139ca-0135-40eb-9654-26157715fc1a could not be found. Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '1ce139ca-0135-40eb-9654-26157715fc1a'} Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce139ca-0135-40eb-9654-26157715fc1a could not be found. Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce139ca-0135-40eb-9654-26157715fc1a could not be found. Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:57:24.961762 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:57:24.965670 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:57:24.965670 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:57:24.965670 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:57:24.965670 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:57:24.965670 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:57:24.965670 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce139ca-0135-40eb-9654-26157715fc1a could not be found. Oct 29 01:57:24.965670 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:57:24.967306 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6ccd6014-41da-472d-afba-32bc5784e1d3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Returning 404 to user: Instance 1ce139ca-0135-40eb-9654-26157715fc1a could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:57:24.968433 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6ccd6014-41da-472d-afba-32bc5784e1d3 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a" status: 404 len: 111 microversion: 2.1 time: 0.043724 Oct 29 01:57:24.972531 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3674/7563] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:24 2022] GET /compute/v2.1/servers/1ce139ca-0135-40eb-9654-26157715fc1a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:57:29.694179 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e2981121-b063-4b94-b7da-29109bb54433 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] Calling method '.version_select at 0x7f9d965a44c0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:29.703858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:57:29.787175 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e2981121-b063-4b94-b7da-29109bb54433 tempest-TestVolumeBootPattern-743321222 tempest-TestVolumeBootPattern-743321222-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-161758843" status: 202 len: 0 microversion: 2.1 time: 0.097259 Oct 29 01:57:29.787766 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3890/7564] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 29 01:57:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-161758843 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:57:31.012374 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-95bff333-8da4-43de-8ec2-e3522aff356a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Action: 'create', calling method: .version_select at 0x7f9d97c71ca0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1627289416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTioSMbvv18sAGNSG7a0h+WEuPSoPYfFi2mdSrUI+9sKmvC44DYYFp7Y8rnodTruIIVQPGthan6gyhPiBRHlg57di83HpudJ9Ycd0p7RAKmzLF6sVCMhGSoZRgbVLXQxg=="}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:57:31.029348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-95bff333-8da4-43de-8ec2-e3522aff356a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Getting quotas for project a09cae3a0a4945edb5f098b0d6a1b3ce. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:57:31.035841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-95bff333-8da4-43de-8ec2-e3522aff356a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Getting quotas for user 42207547fb0b4117ac4df7284a61c9b4 and project a09cae3a0a4945edb5f098b0d6a1b3ce. Resources: {'key_pairs'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:57:31.177034 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-95bff333-8da4-43de-8ec2-e3522aff356a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.168632 Oct 29 01:57:31.177848 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3675/7565] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 29 01:57:31 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:57:34.141449 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-86293c46-7e35-45dc-a8c4-1662535c73ba tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1830153872", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b741647f-3cbb-4e40-aa25-e8eb922c4e79", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1627289416", "security_groups": [{"name": "tempest-secgroup-smoke-1441395253"}], "networks": [{"uuid": "bae2c4ab-2171-4373-8c8a-055beffc9a2f"}]}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:57:34.266886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.network.neutron [None req-86293c46-7e35-45dc-a8c4-1662535c73ba tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] validate_networks() for [('bae2c4ab-2171-4373-8c8a-055beffc9a2f', None, None, None, None, None)] {{(pid=121099) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:57:34.716525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-86293c46-7e35-45dc-a8c4-1662535c73ba tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:57:34.716942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-86293c46-7e35-45dc-a8c4-1662535c73ba tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:57:34.717556 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-86293c46-7e35-45dc-a8c4-1662535c73ba tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:57:34.718002 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-86293c46-7e35-45dc-a8c4-1662535c73ba tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:57:34.718419 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-86293c46-7e35-45dc-a8c4-1662535c73ba tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:57:34.727867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86293c46-7e35-45dc-a8c4-1662535c73ba tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:34.728358 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86293c46-7e35-45dc-a8c4-1662535c73ba tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:34.728803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86293c46-7e35-45dc-a8c4-1662535c73ba tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:34.729573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86293c46-7e35-45dc-a8c4-1662535c73ba tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:34.730035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86293c46-7e35-45dc-a8c4-1662535c73ba tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:34.730465 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-86293c46-7e35-45dc-a8c4-1662535c73ba tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:34.739150 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:57:34.750016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-86293c46-7e35-45dc-a8c4-1662535c73ba tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Getting quotas for project a09cae3a0a4945edb5f098b0d6a1b3ce. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:57:34.755869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-86293c46-7e35-45dc-a8c4-1662535c73ba tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Getting quotas for user 42207547fb0b4117ac4df7284a61c9b4 and project a09cae3a0a4945edb5f098b0d6a1b3ce. Resources: {'instances', 'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:57:34.820452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-86293c46-7e35-45dc-a8c4-1662535c73ba tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Going to run 1 instances... {{(pid=121099) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:57:34.822663 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-86293c46-7e35-45dc-a8c4-1662535c73ba tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b741647f-3cbb-4e40-aa25-e8eb922c4e79',volume_size=None,volume_type=None)] {{(pid=121099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:57:35.195103 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-86293c46-7e35-45dc-a8c4-1662535c73ba tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.058772 Oct 29 01:57:35.196179 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3891/7566] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:57:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:57:35.205598 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=26 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:57:35.210062 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b0e7c508-d64c-4ccc-9818-b4d069fed472 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:35.218026 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b0e7c508-d64c-4ccc-9818-b4d069fed472 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:35.272476 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b0e7c508-d64c-4ccc-9818-b4d069fed472 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:35.279484 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b0e7c508-d64c-4ccc-9818-b4d069fed472 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1099 microversion: 2.1 time: 0.075588 Oct 29 01:57:35.281670 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3676/7567] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:35 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1099 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:36.309036 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb1177b2-d5ac-4be8-ba77-c0622f093f1e tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:36.309839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bb1177b2-d5ac-4be8-ba77-c0622f093f1e tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:36.377360 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bb1177b2-d5ac-4be8-ba77-c0622f093f1e tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:36.385621 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bb1177b2-d5ac-4be8-ba77-c0622f093f1e tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1099 microversion: 2.1 time: 0.084789 Oct 29 01:57:36.398508 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3892/7568] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:36 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1099 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:37.411527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-69769ec9-bfa3-4fa0-8161-e205a075867a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:37.412166 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-69769ec9-bfa3-4fa0-8161-e205a075867a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:37.505965 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-69769ec9-bfa3-4fa0-8161-e205a075867a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:37.521797 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-69769ec9-bfa3-4fa0-8161-e205a075867a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1099 microversion: 2.1 time: 0.115909 Oct 29 01:57:37.523210 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3677/7569] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:37 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1099 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:38.545023 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5ca04f9c-9f5b-4963-8c63-a64857e418bc tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:38.546290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5ca04f9c-9f5b-4963-8c63-a64857e418bc tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:38.611035 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5ca04f9c-9f5b-4963-8c63-a64857e418bc tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:38.618309 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5ca04f9c-9f5b-4963-8c63-a64857e418bc tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1099 microversion: 2.1 time: 0.077214 Oct 29 01:57:38.618887 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3893/7570] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:38 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1099 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:39.642025 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4493cffe-fbe3-44de-ac88-ab09683a2ab4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:39.643284 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4493cffe-fbe3-44de-ac88-ab09683a2ab4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:39.650584 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4493cffe-fbe3-44de-ac88-ab09683a2ab4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:39.651086 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4493cffe-fbe3-44de-ac88-ab09683a2ab4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:39.651559 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4493cffe-fbe3-44de-ac88-ab09683a2ab4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:39.652682 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4493cffe-fbe3-44de-ac88-ab09683a2ab4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:39.653191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4493cffe-fbe3-44de-ac88-ab09683a2ab4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:39.653649 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4493cffe-fbe3-44de-ac88-ab09683a2ab4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:39.730913 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4493cffe-fbe3-44de-ac88-ab09683a2ab4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:39.739643 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4493cffe-fbe3-44de-ac88-ab09683a2ab4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1149 microversion: 2.1 time: 0.102741 Oct 29 01:57:39.746730 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3678/7571] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:39 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1149 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:40.762971 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-abdb5f66-f00a-43f0-b733-38808a0640f2 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:40.763589 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-abdb5f66-f00a-43f0-b733-38808a0640f2 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:40.770777 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abdb5f66-f00a-43f0-b733-38808a0640f2 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:40.771265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abdb5f66-f00a-43f0-b733-38808a0640f2 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:40.771753 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abdb5f66-f00a-43f0-b733-38808a0640f2 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:40.772456 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abdb5f66-f00a-43f0-b733-38808a0640f2 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:40.772916 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abdb5f66-f00a-43f0-b733-38808a0640f2 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:40.773382 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-abdb5f66-f00a-43f0-b733-38808a0640f2 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:40.836508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-abdb5f66-f00a-43f0-b733-38808a0640f2 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:40.845883 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-abdb5f66-f00a-43f0-b733-38808a0640f2 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1149 microversion: 2.1 time: 0.086796 Oct 29 01:57:40.846453 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3894/7572] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:40 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1149 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:41.869146 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bbb1ff3e-c066-4efd-8b1e-443c4ca6ed15 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:41.873423 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bbb1ff3e-c066-4efd-8b1e-443c4ca6ed15 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:41.892821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbb1ff3e-c066-4efd-8b1e-443c4ca6ed15 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:41.893365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbb1ff3e-c066-4efd-8b1e-443c4ca6ed15 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:41.893824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbb1ff3e-c066-4efd-8b1e-443c4ca6ed15 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:41.894548 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbb1ff3e-c066-4efd-8b1e-443c4ca6ed15 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:41.895186 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbb1ff3e-c066-4efd-8b1e-443c4ca6ed15 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:41.895450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bbb1ff3e-c066-4efd-8b1e-443c4ca6ed15 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:41.974321 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bbb1ff3e-c066-4efd-8b1e-443c4ca6ed15 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:41.982262 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bbb1ff3e-c066-4efd-8b1e-443c4ca6ed15 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1205 microversion: 2.1 time: 0.117036 Oct 29 01:57:41.983545 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3679/7573] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:41 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1205 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:43.006534 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a91b3882-1100-4d10-8bf3-95385f5ce28c tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:43.007264 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a91b3882-1100-4d10-8bf3-95385f5ce28c tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:43.015118 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a91b3882-1100-4d10-8bf3-95385f5ce28c tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:43.015752 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a91b3882-1100-4d10-8bf3-95385f5ce28c tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:43.016453 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a91b3882-1100-4d10-8bf3-95385f5ce28c tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:43.017731 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a91b3882-1100-4d10-8bf3-95385f5ce28c tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:43.018306 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a91b3882-1100-4d10-8bf3-95385f5ce28c tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:43.018849 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a91b3882-1100-4d10-8bf3-95385f5ce28c tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:43.230978 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a91b3882-1100-4d10-8bf3-95385f5ce28c tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:43.240101 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a91b3882-1100-4d10-8bf3-95385f5ce28c tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1283 microversion: 2.1 time: 0.237478 Oct 29 01:57:43.240819 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3895/7574] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:43 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1283 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:43.661192 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-65128135-27b7-4217-bf07-675182af1409 req-b231c47f-36c5-4ab9-a56f-2208b4e31de4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e50b00d-c598-498c-acdf-0e90b0d0c97c", "tag": "dbf53dda-9ca9-4d6e-9306-c753a6002fb5"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:57:43.674391 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-65128135-27b7-4217-bf07-675182af1409 req-b231c47f-36c5-4ab9-a56f-2208b4e31de4 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:43.675019 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-65128135-27b7-4217-bf07-675182af1409 req-b231c47f-36c5-4ab9-a56f-2208b4e31de4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:43.675792 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-65128135-27b7-4217-bf07-675182af1409 req-b231c47f-36c5-4ab9-a56f-2208b4e31de4 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:43.687858 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-65128135-27b7-4217-bf07-675182af1409 req-b231c47f-36c5-4ab9-a56f-2208b4e31de4 service nova] Creating event network-changed:dbf53dda-9ca9-4d6e-9306-c753a6002fb5 for instance 2e50b00d-c598-498c-acdf-0e90b0d0c97c on n-h1-862964-3 Oct 29 01:57:43.693266 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-65128135-27b7-4217-bf07-675182af1409 req-b231c47f-36c5-4ab9-a56f-2208b4e31de4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036186 Oct 29 01:57:43.694018 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3680/7575] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:57:44.264304 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1acd2948-cfe1-4aed-a920-564213de430a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:44.265863 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1acd2948-cfe1-4aed-a920-564213de430a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:44.272881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1acd2948-cfe1-4aed-a920-564213de430a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:44.273414 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1acd2948-cfe1-4aed-a920-564213de430a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:44.273862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1acd2948-cfe1-4aed-a920-564213de430a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:44.274579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1acd2948-cfe1-4aed-a920-564213de430a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:44.275046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1acd2948-cfe1-4aed-a920-564213de430a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:44.275511 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1acd2948-cfe1-4aed-a920-564213de430a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:44.739483 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:57:44.823708 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1acd2948-cfe1-4aed-a920-564213de430a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:44.832930 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1acd2948-cfe1-4aed-a920-564213de430a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1283 microversion: 2.1 time: 0.572532 Oct 29 01:57:44.833677 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3896/7576] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:44 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1283 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:45.857393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2fbb1854-3abe-4751-8f99-4197ad18215b tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:45.858370 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-2fbb1854-3abe-4751-8f99-4197ad18215b tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:45.864656 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fbb1854-3abe-4751-8f99-4197ad18215b tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:45.865235 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fbb1854-3abe-4751-8f99-4197ad18215b tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:45.865759 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fbb1854-3abe-4751-8f99-4197ad18215b tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:45.866524 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fbb1854-3abe-4751-8f99-4197ad18215b tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:45.867064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fbb1854-3abe-4751-8f99-4197ad18215b tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:45.867566 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-2fbb1854-3abe-4751-8f99-4197ad18215b tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:46.012298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-2fbb1854-3abe-4751-8f99-4197ad18215b tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:46.021280 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2fbb1854-3abe-4751-8f99-4197ad18215b tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1283 microversion: 2.1 time: 0.169001 Oct 29 01:57:46.022012 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3681/7577] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:45 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1283 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:47.044497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6dbf4b48-5087-4ba3-ad1e-5471bde159e4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:47.048617 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6dbf4b48-5087-4ba3-ad1e-5471bde159e4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:47.052881 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dbf4b48-5087-4ba3-ad1e-5471bde159e4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:47.053400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dbf4b48-5087-4ba3-ad1e-5471bde159e4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:47.053841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dbf4b48-5087-4ba3-ad1e-5471bde159e4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:47.054535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dbf4b48-5087-4ba3-ad1e-5471bde159e4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:47.054996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dbf4b48-5087-4ba3-ad1e-5471bde159e4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:47.055417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6dbf4b48-5087-4ba3-ad1e-5471bde159e4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:47.202497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6dbf4b48-5087-4ba3-ad1e-5471bde159e4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:47.210832 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6dbf4b48-5087-4ba3-ad1e-5471bde159e4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1283 microversion: 2.1 time: 0.170803 Oct 29 01:57:47.211442 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3897/7578] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:47 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1283 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:48.234230 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-63ef68a3-ec7f-41df-89b2-18333286203a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:48.234866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-63ef68a3-ec7f-41df-89b2-18333286203a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:48.238184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=8 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:57:48.238870 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:57:48.244227 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63ef68a3-ec7f-41df-89b2-18333286203a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:48.245603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63ef68a3-ec7f-41df-89b2-18333286203a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:48.245603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63ef68a3-ec7f-41df-89b2-18333286203a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:48.245891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63ef68a3-ec7f-41df-89b2-18333286203a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:48.246362 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63ef68a3-ec7f-41df-89b2-18333286203a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:48.246804 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-63ef68a3-ec7f-41df-89b2-18333286203a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:48.378255 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-63ef68a3-ec7f-41df-89b2-18333286203a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:48.386173 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-63ef68a3-ec7f-41df-89b2-18333286203a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1271 microversion: 2.1 time: 0.156026 Oct 29 01:57:48.386751 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3682/7579] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:48 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:49.419958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-8e68d007-3fda-4ceb-9a5c-0b00b7010b1a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:49.421224 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-8e68d007-3fda-4ceb-9a5c-0b00b7010b1a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:49.424064 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=10 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:57:49.428859 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e68d007-3fda-4ceb-9a5c-0b00b7010b1a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:49.429387 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e68d007-3fda-4ceb-9a5c-0b00b7010b1a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:49.429832 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e68d007-3fda-4ceb-9a5c-0b00b7010b1a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:49.430536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e68d007-3fda-4ceb-9a5c-0b00b7010b1a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:49.430993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e68d007-3fda-4ceb-9a5c-0b00b7010b1a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:49.431424 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-8e68d007-3fda-4ceb-9a5c-0b00b7010b1a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:49.569648 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-8e68d007-3fda-4ceb-9a5c-0b00b7010b1a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:49.578138 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-8e68d007-3fda-4ceb-9a5c-0b00b7010b1a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1271 microversion: 2.1 time: 0.162245 Oct 29 01:57:49.578707 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3898/7580] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:49 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:50.602317 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bfdf7e2d-6344-4fcf-af5f-39aab3a453f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:50.602944 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bfdf7e2d-6344-4fcf-af5f-39aab3a453f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:50.610414 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfdf7e2d-6344-4fcf-af5f-39aab3a453f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:50.610905 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfdf7e2d-6344-4fcf-af5f-39aab3a453f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:50.611353 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfdf7e2d-6344-4fcf-af5f-39aab3a453f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:50.612054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfdf7e2d-6344-4fcf-af5f-39aab3a453f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:50.612518 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfdf7e2d-6344-4fcf-af5f-39aab3a453f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:50.612954 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bfdf7e2d-6344-4fcf-af5f-39aab3a453f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:50.745216 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bfdf7e2d-6344-4fcf-af5f-39aab3a453f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:50.753965 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bfdf7e2d-6344-4fcf-af5f-39aab3a453f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1271 microversion: 2.1 time: 0.155705 Oct 29 01:57:50.754551 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3683/7581] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:50 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:51.776886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b2ab8e15-4e40-4e8b-804e-f6660ddf64c8 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:51.777575 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b2ab8e15-4e40-4e8b-804e-f6660ddf64c8 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:51.784905 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b2ab8e15-4e40-4e8b-804e-f6660ddf64c8 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:51.785368 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b2ab8e15-4e40-4e8b-804e-f6660ddf64c8 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:51.785816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b2ab8e15-4e40-4e8b-804e-f6660ddf64c8 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:51.786517 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b2ab8e15-4e40-4e8b-804e-f6660ddf64c8 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:51.786982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b2ab8e15-4e40-4e8b-804e-f6660ddf64c8 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:51.787413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-b2ab8e15-4e40-4e8b-804e-f6660ddf64c8 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:51.918948 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b2ab8e15-4e40-4e8b-804e-f6660ddf64c8 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:51.927410 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b2ab8e15-4e40-4e8b-804e-f6660ddf64c8 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1271 microversion: 2.1 time: 0.154474 Oct 29 01:57:51.928429 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3899/7582] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:51 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:52.951256 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e41cc67f-7847-4d3f-8250-b7e579da586f tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:52.952316 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e41cc67f-7847-4d3f-8250-b7e579da586f tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:52.959420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e41cc67f-7847-4d3f-8250-b7e579da586f tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:52.959959 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e41cc67f-7847-4d3f-8250-b7e579da586f tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:52.960415 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e41cc67f-7847-4d3f-8250-b7e579da586f tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:52.961131 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e41cc67f-7847-4d3f-8250-b7e579da586f tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:52.961632 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e41cc67f-7847-4d3f-8250-b7e579da586f tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:52.962076 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e41cc67f-7847-4d3f-8250-b7e579da586f tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:53.098372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e41cc67f-7847-4d3f-8250-b7e579da586f tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:53.106206 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e41cc67f-7847-4d3f-8250-b7e579da586f tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1271 microversion: 2.1 time: 0.158947 Oct 29 01:57:53.106780 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3684/7583] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:52 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:54.129544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e0b8a30a-a9bc-450a-b35a-7568120ab471 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:54.130256 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e0b8a30a-a9bc-450a-b35a-7568120ab471 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:54.137330 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0b8a30a-a9bc-450a-b35a-7568120ab471 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:54.137819 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0b8a30a-a9bc-450a-b35a-7568120ab471 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:54.138262 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0b8a30a-a9bc-450a-b35a-7568120ab471 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:54.138963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0b8a30a-a9bc-450a-b35a-7568120ab471 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:54.140054 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0b8a30a-a9bc-450a-b35a-7568120ab471 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:54.140657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e0b8a30a-a9bc-450a-b35a-7568120ab471 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:54.273714 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e0b8a30a-a9bc-450a-b35a-7568120ab471 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:54.282235 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e0b8a30a-a9bc-450a-b35a-7568120ab471 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1271 microversion: 2.1 time: 0.156675 Oct 29 01:57:54.282808 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3900/7584] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:54 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:55.304719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8a4f4662-3e0a-4f65-907d-6529da7e0871 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:55.305386 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8a4f4662-3e0a-4f65-907d-6529da7e0871 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:55.313170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a4f4662-3e0a-4f65-907d-6529da7e0871 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:55.313673 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a4f4662-3e0a-4f65-907d-6529da7e0871 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:55.314121 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a4f4662-3e0a-4f65-907d-6529da7e0871 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:55.314821 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a4f4662-3e0a-4f65-907d-6529da7e0871 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:55.315287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a4f4662-3e0a-4f65-907d-6529da7e0871 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:55.315733 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8a4f4662-3e0a-4f65-907d-6529da7e0871 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:55.454483 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8a4f4662-3e0a-4f65-907d-6529da7e0871 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:55.462453 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8a4f4662-3e0a-4f65-907d-6529da7e0871 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1271 microversion: 2.1 time: 0.161661 Oct 29 01:57:55.463020 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3685/7585] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:55 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:56.486324 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a3cbd959-49a0-4f65-95d8-494a7b62bf44 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:56.486944 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a3cbd959-49a0-4f65-95d8-494a7b62bf44 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:56.494785 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3cbd959-49a0-4f65-95d8-494a7b62bf44 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:56.495272 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3cbd959-49a0-4f65-95d8-494a7b62bf44 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:56.495716 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3cbd959-49a0-4f65-95d8-494a7b62bf44 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:56.496399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3cbd959-49a0-4f65-95d8-494a7b62bf44 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:56.496858 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3cbd959-49a0-4f65-95d8-494a7b62bf44 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:56.497446 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a3cbd959-49a0-4f65-95d8-494a7b62bf44 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:56.631206 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a3cbd959-49a0-4f65-95d8-494a7b62bf44 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:56.639145 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a3cbd959-49a0-4f65-95d8-494a7b62bf44 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1271 microversion: 2.1 time: 0.156896 Oct 29 01:57:56.640765 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3901/7586] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:56 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:57.662868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-428f0dae-6ecb-4ff1-a88b-e65044b086c4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:57.663491 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-428f0dae-6ecb-4ff1-a88b-e65044b086c4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:57.670356 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-428f0dae-6ecb-4ff1-a88b-e65044b086c4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:57.670845 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-428f0dae-6ecb-4ff1-a88b-e65044b086c4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:57.671290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-428f0dae-6ecb-4ff1-a88b-e65044b086c4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:57.672985 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-428f0dae-6ecb-4ff1-a88b-e65044b086c4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:57.673482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-428f0dae-6ecb-4ff1-a88b-e65044b086c4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:57.673922 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-428f0dae-6ecb-4ff1-a88b-e65044b086c4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:57.808123 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-428f0dae-6ecb-4ff1-a88b-e65044b086c4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:57.816610 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-428f0dae-6ecb-4ff1-a88b-e65044b086c4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1271 microversion: 2.1 time: 0.157715 Oct 29 01:57:57.817206 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3686/7587] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:57 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:58.839514 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-98f1e962-110b-4243-9c5e-462cce27a7b1 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:57:58.840173 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-98f1e962-110b-4243-9c5e-462cce27a7b1 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:57:58.847599 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98f1e962-110b-4243-9c5e-462cce27a7b1 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:58.851893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98f1e962-110b-4243-9c5e-462cce27a7b1 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:58.851893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98f1e962-110b-4243-9c5e-462cce27a7b1 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:58.851893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98f1e962-110b-4243-9c5e-462cce27a7b1 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:58.851893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98f1e962-110b-4243-9c5e-462cce27a7b1 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:58.851893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-98f1e962-110b-4243-9c5e-462cce27a7b1 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:58.983628 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-ef906223-dad8-4452-9fb0-8312bc4f41ea req-20d2a4b1-ffc1-4865-98f1-ea900e496418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e50b00d-c598-498c-acdf-0e90b0d0c97c", "name": "network-vif-plugged", "status": "completed", "tag": "dbf53dda-9ca9-4d6e-9306-c753a6002fb5"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:57:58.988604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-98f1e962-110b-4243-9c5e-462cce27a7b1 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:57:58.996686 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ef906223-dad8-4452-9fb0-8312bc4f41ea req-20d2a4b1-ffc1-4865-98f1-ea900e496418 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:57:58.997604 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ef906223-dad8-4452-9fb0-8312bc4f41ea req-20d2a4b1-ffc1-4865-98f1-ea900e496418 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:57:58.997906 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-98f1e962-110b-4243-9c5e-462cce27a7b1 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1271 microversion: 2.1 time: 0.161839 Oct 29 01:57:58.998005 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ef906223-dad8-4452-9fb0-8312bc4f41ea req-20d2a4b1-ffc1-4865-98f1-ea900e496418 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:57:59.001341 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3902/7588] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:57:58 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1271 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:57:59.010184 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-ef906223-dad8-4452-9fb0-8312bc4f41ea req-20d2a4b1-ffc1-4865-98f1-ea900e496418 service nova] Creating event network-vif-plugged:dbf53dda-9ca9-4d6e-9306-c753a6002fb5 for instance 2e50b00d-c598-498c-acdf-0e90b0d0c97c on n-h1-862964-3 Oct 29 01:57:59.015119 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-ef906223-dad8-4452-9fb0-8312bc4f41ea req-20d2a4b1-ffc1-4865-98f1-ea900e496418 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035373 Oct 29 01:57:59.016811 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3687/7589] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:58:00.020613 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5eb231d5-4757-41d6-9dcb-b519aba2e715 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:58:00.021265 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5eb231d5-4757-41d6-9dcb-b519aba2e715 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:58:00.028084 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5eb231d5-4757-41d6-9dcb-b519aba2e715 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:58:00.028570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5eb231d5-4757-41d6-9dcb-b519aba2e715 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:58:00.029016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5eb231d5-4757-41d6-9dcb-b519aba2e715 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:58:00.029748 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5eb231d5-4757-41d6-9dcb-b519aba2e715 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:58:00.030207 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5eb231d5-4757-41d6-9dcb-b519aba2e715 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:58:00.030640 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5eb231d5-4757-41d6-9dcb-b519aba2e715 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:58:00.176990 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5eb231d5-4757-41d6-9dcb-b519aba2e715 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:58:00.183873 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5eb231d5-4757-41d6-9dcb-b519aba2e715 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1271 microversion: 2.1 time: 0.167918 Oct 29 01:58:00.184457 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3903/7590] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:58:00 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:58:01.209011 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b21d11a6-b181-4910-87c3-df471a937089 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:58:01.209758 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b21d11a6-b181-4910-87c3-df471a937089 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:58:01.216140 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b21d11a6-b181-4910-87c3-df471a937089 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:58:01.216636 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b21d11a6-b181-4910-87c3-df471a937089 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:58:01.217090 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b21d11a6-b181-4910-87c3-df471a937089 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:58:01.217817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b21d11a6-b181-4910-87c3-df471a937089 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:58:01.218286 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b21d11a6-b181-4910-87c3-df471a937089 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:58:01.218726 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b21d11a6-b181-4910-87c3-df471a937089 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:58:01.354929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b21d11a6-b181-4910-87c3-df471a937089 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:58:01.363394 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b21d11a6-b181-4910-87c3-df471a937089 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1460 microversion: 2.1 time: 0.159893 Oct 29 01:58:01.363964 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3688/7591] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:58:01 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1460 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:58:01.385323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cc2d17bc-b4d3-41ec-9f11-23acf4fdd71a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:58:01.385951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cc2d17bc-b4d3-41ec-9f11-23acf4fdd71a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:58:01.393652 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc2d17bc-b4d3-41ec-9f11-23acf4fdd71a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:58:01.394159 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc2d17bc-b4d3-41ec-9f11-23acf4fdd71a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:58:01.394610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc2d17bc-b4d3-41ec-9f11-23acf4fdd71a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:58:01.395326 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc2d17bc-b4d3-41ec-9f11-23acf4fdd71a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:58:01.395787 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc2d17bc-b4d3-41ec-9f11-23acf4fdd71a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:58:01.396218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cc2d17bc-b4d3-41ec-9f11-23acf4fdd71a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:58:01.534467 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cc2d17bc-b4d3-41ec-9f11-23acf4fdd71a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:58:01.542471 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cc2d17bc-b4d3-41ec-9f11-23acf4fdd71a tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1460 microversion: 2.1 time: 0.161123 Oct 29 01:58:01.543045 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3904/7592] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:58:01 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1460 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:58:03.772194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-899ce4e0-5d1a-4084-8f6b-fc01117cf0c8 req-4f0bd49b-2d57-4d80-955e-7a96d80b8253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e50b00d-c598-498c-acdf-0e90b0d0c97c", "tag": "dbf53dda-9ca9-4d6e-9306-c753a6002fb5"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:58:03.782597 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-899ce4e0-5d1a-4084-8f6b-fc01117cf0c8 req-4f0bd49b-2d57-4d80-955e-7a96d80b8253 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:58:03.783013 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-899ce4e0-5d1a-4084-8f6b-fc01117cf0c8 req-4f0bd49b-2d57-4d80-955e-7a96d80b8253 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:58:03.783651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-899ce4e0-5d1a-4084-8f6b-fc01117cf0c8 req-4f0bd49b-2d57-4d80-955e-7a96d80b8253 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:58:03.795704 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-899ce4e0-5d1a-4084-8f6b-fc01117cf0c8 req-4f0bd49b-2d57-4d80-955e-7a96d80b8253 service nova] Creating event network-changed:dbf53dda-9ca9-4d6e-9306-c753a6002fb5 for instance 2e50b00d-c598-498c-acdf-0e90b0d0c97c on n-h1-862964-3 Oct 29 01:58:03.801903 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-899ce4e0-5d1a-4084-8f6b-fc01117cf0c8 req-4f0bd49b-2d57-4d80-955e-7a96d80b8253 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180741 Oct 29 01:58:03.803128 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3689/7593] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:58:05.012422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-8ba467b6-0479-4f11-bec4-bc89586eb37f req-cfee6ec3-70e5-44dc-95d4-242744f763a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e50b00d-c598-498c-acdf-0e90b0d0c97c", "tag": "dbf53dda-9ca9-4d6e-9306-c753a6002fb5"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:58:05.017523 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:58:05.023597 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8ba467b6-0479-4f11-bec4-bc89586eb37f req-cfee6ec3-70e5-44dc-95d4-242744f763a8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:58:05.028105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8ba467b6-0479-4f11-bec4-bc89586eb37f req-cfee6ec3-70e5-44dc-95d4-242744f763a8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:58:05.028105 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-8ba467b6-0479-4f11-bec4-bc89586eb37f req-cfee6ec3-70e5-44dc-95d4-242744f763a8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:58:05.028788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=68 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:58:05.036651 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-8ba467b6-0479-4f11-bec4-bc89586eb37f req-cfee6ec3-70e5-44dc-95d4-242744f763a8 service nova] Creating event network-changed:dbf53dda-9ca9-4d6e-9306-c753a6002fb5 for instance 2e50b00d-c598-498c-acdf-0e90b0d0c97c on n-h1-862964-3 Oct 29 01:58:05.042314 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-8ba467b6-0479-4f11-bec4-bc89586eb37f req-cfee6ec3-70e5-44dc-95d4-242744f763a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114439 Oct 29 01:58:05.045338 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3905/7594] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:58:07.059184 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-6df8116c-a391-4d59-b56c-eeb76fae8951 req-cd8e3df7-946d-4008-a071-4516e1cec644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e50b00d-c598-498c-acdf-0e90b0d0c97c", "tag": "dbf53dda-9ca9-4d6e-9306-c753a6002fb5"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:58:07.069874 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6df8116c-a391-4d59-b56c-eeb76fae8951 req-cd8e3df7-946d-4008-a071-4516e1cec644 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:58:07.070371 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6df8116c-a391-4d59-b56c-eeb76fae8951 req-cd8e3df7-946d-4008-a071-4516e1cec644 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:58:07.072182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-6df8116c-a391-4d59-b56c-eeb76fae8951 req-cd8e3df7-946d-4008-a071-4516e1cec644 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:58:07.083249 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-6df8116c-a391-4d59-b56c-eeb76fae8951 req-cd8e3df7-946d-4008-a071-4516e1cec644 service nova] Creating event network-changed:dbf53dda-9ca9-4d6e-9306-c753a6002fb5 for instance 2e50b00d-c598-498c-acdf-0e90b0d0c97c on n-h1-862964-3 Oct 29 01:58:07.088073 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-6df8116c-a391-4d59-b56c-eeb76fae8951 req-cd8e3df7-946d-4008-a071-4516e1cec644 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034378 Oct 29 01:58:07.088668 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3690/7595] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:59:06.368399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-0816efe6-e54c-4688-a0cb-86d23eb5438e tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:06.369729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0816efe6-e54c-4688-a0cb-86d23eb5438e tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:06.370939 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-2c750dad-60a0-4e62-954b-3fa024c519a4 req-d08974bf-54e2-4a3b-bfd7-f95de63397e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e50b00d-c598-498c-acdf-0e90b0d0c97c", "tag": "dbf53dda-9ca9-4d6e-9306-c753a6002fb5"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:59:06.377131 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0816efe6-e54c-4688-a0cb-86d23eb5438e tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:06.378057 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0816efe6-e54c-4688-a0cb-86d23eb5438e tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:06.378609 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0816efe6-e54c-4688-a0cb-86d23eb5438e tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:06.379642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0816efe6-e54c-4688-a0cb-86d23eb5438e tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:06.380185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0816efe6-e54c-4688-a0cb-86d23eb5438e tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:06.380720 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-0816efe6-e54c-4688-a0cb-86d23eb5438e tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:06.382689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=17 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:59:06.383420 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=62 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:59:06.385956 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2c750dad-60a0-4e62-954b-3fa024c519a4 req-d08974bf-54e2-4a3b-bfd7-f95de63397e2 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:06.388393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2c750dad-60a0-4e62-954b-3fa024c519a4 req-d08974bf-54e2-4a3b-bfd7-f95de63397e2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:06.388393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-2c750dad-60a0-4e62-954b-3fa024c519a4 req-d08974bf-54e2-4a3b-bfd7-f95de63397e2 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:06.404213 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-2c750dad-60a0-4e62-954b-3fa024c519a4 req-d08974bf-54e2-4a3b-bfd7-f95de63397e2 service nova] Creating event network-changed:dbf53dda-9ca9-4d6e-9306-c753a6002fb5 for instance 2e50b00d-c598-498c-acdf-0e90b0d0c97c on n-h1-862964-3 Oct 29 01:59:06.409666 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-2c750dad-60a0-4e62-954b-3fa024c519a4 req-d08974bf-54e2-4a3b-bfd7-f95de63397e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044333 Oct 29 01:59:06.414807 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3691/7596] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:59:06.417359 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-0816efe6-e54c-4688-a0cb-86d23eb5438e tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Going to try to terminate instance {{(pid=121099) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:59:06.804942 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-0816efe6-e54c-4688-a0cb-86d23eb5438e tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 204 len: 0 microversion: 2.1 time: 0.443883 Oct 29 01:59:06.810476 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3906/7597] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:59:06 2022] DELETE /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:59:06.816185 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a4fc43b5-da43-4550-bc99-ca5671063459 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:06.816887 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a4fc43b5-da43-4550-bc99-ca5671063459 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:06.824805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4fc43b5-da43-4550-bc99-ca5671063459 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:06.825692 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4fc43b5-da43-4550-bc99-ca5671063459 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:06.826298 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4fc43b5-da43-4550-bc99-ca5671063459 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:06.827232 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4fc43b5-da43-4550-bc99-ca5671063459 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:06.827891 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4fc43b5-da43-4550-bc99-ca5671063459 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:06.828523 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a4fc43b5-da43-4550-bc99-ca5671063459 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:06.968885 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a4fc43b5-da43-4550-bc99-ca5671063459 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:06.977109 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a4fc43b5-da43-4550-bc99-ca5671063459 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1584 microversion: 2.1 time: 0.165128 Oct 29 01:59:06.977727 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3692/7598] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:06 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1584 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:08.003707 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-70922785-0672-4459-8d6b-406e06eabd03 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:08.004422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-70922785-0672-4459-8d6b-406e06eabd03 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:08.011434 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70922785-0672-4459-8d6b-406e06eabd03 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:08.011915 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70922785-0672-4459-8d6b-406e06eabd03 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:08.012354 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70922785-0672-4459-8d6b-406e06eabd03 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:08.013050 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70922785-0672-4459-8d6b-406e06eabd03 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:08.013592 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70922785-0672-4459-8d6b-406e06eabd03 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:08.016848 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-70922785-0672-4459-8d6b-406e06eabd03 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:08.155270 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-70922785-0672-4459-8d6b-406e06eabd03 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:08.163111 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-70922785-0672-4459-8d6b-406e06eabd03 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1584 microversion: 2.1 time: 0.164171 Oct 29 01:59:08.163686 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3907/7599] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:07 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1584 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:09.104350 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-e7411c3a-bc83-4435-8bf2-fb98ec8fd622 req-1e3e676e-5e44-4dff-a373-eb2118ca8e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e50b00d-c598-498c-acdf-0e90b0d0c97c", "name": "network-vif-deleted", "tag": "dbf53dda-9ca9-4d6e-9306-c753a6002fb5"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:59:09.115375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e7411c3a-bc83-4435-8bf2-fb98ec8fd622 req-1e3e676e-5e44-4dff-a373-eb2118ca8e5c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:09.121066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e7411c3a-bc83-4435-8bf2-fb98ec8fd622 req-1e3e676e-5e44-4dff-a373-eb2118ca8e5c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:09.121066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-e7411c3a-bc83-4435-8bf2-fb98ec8fd622 req-1e3e676e-5e44-4dff-a373-eb2118ca8e5c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:09.128675 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-e7411c3a-bc83-4435-8bf2-fb98ec8fd622 req-1e3e676e-5e44-4dff-a373-eb2118ca8e5c service nova] Creating event network-vif-deleted:dbf53dda-9ca9-4d6e-9306-c753a6002fb5 for instance 2e50b00d-c598-498c-acdf-0e90b0d0c97c on n-h1-862964-3 Oct 29 01:59:09.133529 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-e7411c3a-bc83-4435-8bf2-fb98ec8fd622 req-1e3e676e-5e44-4dff-a373-eb2118ca8e5c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032954 Oct 29 01:59:09.134202 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3693/7600] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:59:09.188108 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-a730ea84-b87b-42b3-a115-e88d8ce0bb28 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:09.188737 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-a730ea84-b87b-42b3-a115-e88d8ce0bb28 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:09.195799 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a730ea84-b87b-42b3-a115-e88d8ce0bb28 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:09.196289 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a730ea84-b87b-42b3-a115-e88d8ce0bb28 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:09.196733 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a730ea84-b87b-42b3-a115-e88d8ce0bb28 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:09.197526 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a730ea84-b87b-42b3-a115-e88d8ce0bb28 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:09.198161 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a730ea84-b87b-42b3-a115-e88d8ce0bb28 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:09.198602 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-a730ea84-b87b-42b3-a115-e88d8ce0bb28 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:09.262490 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-a730ea84-b87b-42b3-a115-e88d8ce0bb28 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:09.271612 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-a730ea84-b87b-42b3-a115-e88d8ce0bb28 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1398 microversion: 2.1 time: 0.088333 Oct 29 01:59:09.272184 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3908/7601] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:09 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1398 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:10.298458 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cca27974-f0d7-4a71-873c-c59b47c4328d tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:10.299182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cca27974-f0d7-4a71-873c-c59b47c4328d tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:10.305486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cca27974-f0d7-4a71-873c-c59b47c4328d tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:10.305983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cca27974-f0d7-4a71-873c-c59b47c4328d tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:10.306436 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cca27974-f0d7-4a71-873c-c59b47c4328d tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:10.307267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cca27974-f0d7-4a71-873c-c59b47c4328d tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:10.307750 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cca27974-f0d7-4a71-873c-c59b47c4328d tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:10.308191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cca27974-f0d7-4a71-873c-c59b47c4328d tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:10.375199 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-cca27974-f0d7-4a71-873c-c59b47c4328d tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:10.383063 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cca27974-f0d7-4a71-873c-c59b47c4328d tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1230 microversion: 2.1 time: 0.090715 Oct 29 01:59:10.383843 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3694/7602] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:10 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1230 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:11.406816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ad5a2367-9b12-4393-b378-fef37a6ae960 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:11.407431 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ad5a2367-9b12-4393-b378-fef37a6ae960 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:11.414554 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad5a2367-9b12-4393-b378-fef37a6ae960 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:11.415042 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad5a2367-9b12-4393-b378-fef37a6ae960 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:11.415481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad5a2367-9b12-4393-b378-fef37a6ae960 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:11.416184 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad5a2367-9b12-4393-b378-fef37a6ae960 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:11.416642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad5a2367-9b12-4393-b378-fef37a6ae960 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:11.417070 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ad5a2367-9b12-4393-b378-fef37a6ae960 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:11.482145 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ad5a2367-9b12-4393-b378-fef37a6ae960 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:11.490604 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ad5a2367-9b12-4393-b378-fef37a6ae960 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1230 microversion: 2.1 time: 0.087936 Oct 29 01:59:11.491260 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3909/7603] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:11 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1230 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:12.521824 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-242f5e66-0fb5-42e4-afd7-e3c755ad26f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:12.522456 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-242f5e66-0fb5-42e4-afd7-e3c755ad26f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:12.529983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-242f5e66-0fb5-42e4-afd7-e3c755ad26f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:12.531006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-242f5e66-0fb5-42e4-afd7-e3c755ad26f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:12.531459 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-242f5e66-0fb5-42e4-afd7-e3c755ad26f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:12.532171 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-242f5e66-0fb5-42e4-afd7-e3c755ad26f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:12.532810 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-242f5e66-0fb5-42e4-afd7-e3c755ad26f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:12.533502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-242f5e66-0fb5-42e4-afd7-e3c755ad26f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:12.596752 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-242f5e66-0fb5-42e4-afd7-e3c755ad26f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:12.604779 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-242f5e66-0fb5-42e4-afd7-e3c755ad26f4 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1230 microversion: 2.1 time: 0.086923 Oct 29 01:59:12.605389 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3695/7604] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:12 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1230 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:13.628166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6375893f-ea45-4e9a-a365-20475a2d0984 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:13.628827 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6375893f-ea45-4e9a-a365-20475a2d0984 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:13.637461 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6375893f-ea45-4e9a-a365-20475a2d0984 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:13.637952 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6375893f-ea45-4e9a-a365-20475a2d0984 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:13.638396 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6375893f-ea45-4e9a-a365-20475a2d0984 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:13.639094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6375893f-ea45-4e9a-a365-20475a2d0984 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:13.640244 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6375893f-ea45-4e9a-a365-20475a2d0984 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:13.640684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6375893f-ea45-4e9a-a365-20475a2d0984 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:13.676757 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6375893f-ea45-4e9a-a365-20475a2d0984 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:13.677644 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6375893f-ea45-4e9a-a365-20475a2d0984 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:13.677759 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6375893f-ea45-4e9a-a365-20475a2d0984 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:13.678144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.objects.instance [None req-6375893f-ea45-4e9a-a365-20475a2d0984 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lazy-loading 'fault' on Instance uuid 2e50b00d-c598-498c-acdf-0e90b0d0c97c {{(pid=121099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:59:13.719454 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6375893f-ea45-4e9a-a365-20475a2d0984 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42207547fb0b4117ac4df7284a61c9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09cae3a0a4945edb5f098b0d6a1b3ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:13.727887 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6375893f-ea45-4e9a-a365-20475a2d0984 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 200 len: 1235 microversion: 2.1 time: 0.103817 Oct 29 01:59:13.728686 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3910/7605] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:13 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 1235 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:14.753498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-14f20aa3-1990-4c32-b14a-269fc036e3ad tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:14.754117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-14f20aa3-1990-4c32-b14a-269fc036e3ad tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] [instance: 2e50b00d-c598-498c-acdf-0e90b0d0c97c] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:14.760996 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-14f20aa3-1990-4c32-b14a-269fc036e3ad tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:14.761522 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-14f20aa3-1990-4c32-b14a-269fc036e3ad tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:14.761966 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-14f20aa3-1990-4c32-b14a-269fc036e3ad tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:14.762662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-14f20aa3-1990-4c32-b14a-269fc036e3ad tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:14.763128 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-14f20aa3-1990-4c32-b14a-269fc036e3ad tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:14.763564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-14f20aa3-1990-4c32-b14a-269fc036e3ad tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:14.776726 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-14f20aa3-1990-4c32-b14a-269fc036e3ad tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] HTTP exception thrown: Instance 2e50b00d-c598-498c-acdf-0e90b0d0c97c could not be found. Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-14f20aa3-1990-4c32-b14a-269fc036e3ad tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Request method failure captured: Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: request: GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c HTTP/1.1 Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIfeeVNSSk1bqtkHLZlnG08AHt-8RlPWjvKX0VK99bcWfWfKOCAPFJmL1sqyYuLIqrPs7Kda4gd6RPNhWEg1-JyG4iZ1HnIyCMJ_YQveU1zhLmPb39OECDLbiRktd1CHKBHtmtQQlMAmH1eDAiowuG486BhDYPARXy1nMLvhKxWTadc Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: a09cae3a0a4945edb5f098b0d6a1b3ce Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-TestVolumeBackupRestore-1236262049 Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a09cae3a0a4945edb5f098b0d6a1b3ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a09cae3a0a4945edb5f098b0d6a1b3ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a09cae3a0a4945edb5f098b0d6a1b3ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a09cae3a0a4945edb5f098b0d6a1b3ce", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-TestVolumeBackupRestore-1236262049 Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: a09cae3a0a4945edb5f098b0d6a1b3ce Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1236262049 Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-TestVolumeBackupRestore-1236262049-project Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 42207547fb0b4117ac4df7284a61c9b4 Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-TestVolumeBackupRestore-1236262049-project Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance 2e50b00d-c598-498c-acdf-0e90b0d0c97c could not be found. Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '2e50b00d-c598-498c-acdf-0e90b0d0c97c'} Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e50b00d-c598-498c-acdf-0e90b0d0c97c could not be found. Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e50b00d-c598-498c-acdf-0e90b0d0c97c could not be found. Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:59:14.778394 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:59:14.784046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:59:14.784046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:59:14.784046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:59:14.784046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:59:14.784046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:59:14.784046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e50b00d-c598-498c-acdf-0e90b0d0c97c could not be found. Oct 29 01:59:14.784046 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:59:14.784046 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-14f20aa3-1990-4c32-b14a-269fc036e3ad tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Returning 404 to user: Instance 2e50b00d-c598-498c-acdf-0e90b0d0c97c could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:59:14.784046 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-14f20aa3-1990-4c32-b14a-269fc036e3ad tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c" status: 404 len: 111 microversion: 2.1 time: 0.030495 Oct 29 01:59:14.784046 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3696/7606] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:14 2022] GET /compute/v2.1/servers/2e50b00d-c598-498c-acdf-0e90b0d0c97c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:59:14.993464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-560fe125-f483-4794-bca1-8895a4ddcbe2 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] Calling method '.version_select at 0x7f9d966bd5e0>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:15.107684 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-560fe125-f483-4794-bca1-8895a4ddcbe2 tempest-TestVolumeBackupRestore-1236262049 tempest-TestVolumeBackupRestore-1236262049-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1627289416" status: 202 len: 0 microversion: 2.1 time: 0.118240 Oct 29 01:59:15.108386 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3911/7607] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 29 01:59:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1627289416 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:59:41.078243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=12 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:59:41.079006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=24 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:59:41.189107 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-0c654321-bbf3-4578-9f6a-1950e1f82acb tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2021499126", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:59:41.346995 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-0c654321-bbf3-4578-9f6a-1950e1f82acb tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] validate_networks() for None {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 01:59:41.639852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-0c654321-bbf3-4578-9f6a-1950e1f82acb tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:59:41.640290 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-0c654321-bbf3-4578-9f6a-1950e1f82acb tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:59:41.640778 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-0c654321-bbf3-4578-9f6a-1950e1f82acb tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:59:41.641238 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-0c654321-bbf3-4578-9f6a-1950e1f82acb tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:59:41.641666 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-0c654321-bbf3-4578-9f6a-1950e1f82acb tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:59:41.650640 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c654321-bbf3-4578-9f6a-1950e1f82acb tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:41.651135 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c654321-bbf3-4578-9f6a-1950e1f82acb tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:41.651587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c654321-bbf3-4578-9f6a-1950e1f82acb tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:41.652333 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c654321-bbf3-4578-9f6a-1950e1f82acb tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:41.652803 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c654321-bbf3-4578-9f6a-1950e1f82acb tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:41.653274 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-0c654321-bbf3-4578-9f6a-1950e1f82acb tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:41.670098 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-0c654321-bbf3-4578-9f6a-1950e1f82acb tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Getting quotas for project 8286393e1b0b453a9acbdbcb0efa7088. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:59:41.675748 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-0c654321-bbf3-4578-9f6a-1950e1f82acb tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Getting quotas for user 1b2e0f003ba64a92b21851fa8d0dae08 and project 8286393e1b0b453a9acbdbcb0efa7088. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:59:41.688586 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0c654321-bbf3-4578-9f6a-1950e1f82acb tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 01:59:41.691006 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-0c654321-bbf3-4578-9f6a-1950e1f82acb tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 01:59:41.813092 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-0c654321-bbf3-4578-9f6a-1950e1f82acb tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740486 Oct 29 01:59:41.813714 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3697/7608] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:59:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:59:41.824501 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:59:41.827413 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:59:41.831180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-b9132d0b-4039-4176-8672-f1b0a068eb00 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:41.831789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-b9132d0b-4039-4176-8672-f1b0a068eb00 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:42.366766 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-b9132d0b-4039-4176-8672-f1b0a068eb00 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2e0f003ba64a92b21851fa8d0dae08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286393e1b0b453a9acbdbcb0efa7088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:42.374362 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-b9132d0b-4039-4176-8672-f1b0a068eb00 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] 10.222.0.26 "GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d" status: 200 len: 1222 microversion: 2.1 time: 0.551260 Oct 29 01:59:42.374896 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3912/7609] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:41 2022] GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d => generated 1222 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:43.398921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6adf0be9-4016-4df9-a603-6057814b16ce tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:43.399555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6adf0be9-4016-4df9-a603-6057814b16ce tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:43.406662 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6adf0be9-4016-4df9-a603-6057814b16ce tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:43.407160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6adf0be9-4016-4df9-a603-6057814b16ce tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:43.407613 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6adf0be9-4016-4df9-a603-6057814b16ce tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:43.408348 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6adf0be9-4016-4df9-a603-6057814b16ce tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:43.408822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6adf0be9-4016-4df9-a603-6057814b16ce tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:43.409365 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6adf0be9-4016-4df9-a603-6057814b16ce tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:43.474469 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6adf0be9-4016-4df9-a603-6057814b16ce tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2e0f003ba64a92b21851fa8d0dae08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286393e1b0b453a9acbdbcb0efa7088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:43.482277 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6adf0be9-4016-4df9-a603-6057814b16ce tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] 10.222.0.26 "GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d" status: 200 len: 1274 microversion: 2.1 time: 0.088305 Oct 29 01:59:43.483477 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3698/7610] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:43 2022] GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:44.507397 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-c5402054-8f48-4297-8533-0e8ed252926f tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:44.508017 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-c5402054-8f48-4297-8533-0e8ed252926f tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:44.521688 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5402054-8f48-4297-8533-0e8ed252926f tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:44.522181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5402054-8f48-4297-8533-0e8ed252926f tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:44.522627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5402054-8f48-4297-8533-0e8ed252926f tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:44.523339 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5402054-8f48-4297-8533-0e8ed252926f tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:44.523803 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5402054-8f48-4297-8533-0e8ed252926f tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:44.524231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-c5402054-8f48-4297-8533-0e8ed252926f tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:44.598472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-c5402054-8f48-4297-8533-0e8ed252926f tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2e0f003ba64a92b21851fa8d0dae08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286393e1b0b453a9acbdbcb0efa7088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:44.606341 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-c5402054-8f48-4297-8533-0e8ed252926f tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] 10.222.0.26 "GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d" status: 200 len: 1280 microversion: 2.1 time: 0.102919 Oct 29 01:59:44.606932 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3913/7611] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:44 2022] GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d => generated 1280 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:45.629539 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-907376a8-7500-4360-ad13-d4b540688d96 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:45.630699 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-907376a8-7500-4360-ad13-d4b540688d96 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:45.637530 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-907376a8-7500-4360-ad13-d4b540688d96 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:45.638034 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-907376a8-7500-4360-ad13-d4b540688d96 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:45.638486 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-907376a8-7500-4360-ad13-d4b540688d96 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:45.639357 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-907376a8-7500-4360-ad13-d4b540688d96 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:45.639842 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-907376a8-7500-4360-ad13-d4b540688d96 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:45.640288 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-907376a8-7500-4360-ad13-d4b540688d96 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:45.848929 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-907376a8-7500-4360-ad13-d4b540688d96 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2e0f003ba64a92b21851fa8d0dae08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286393e1b0b453a9acbdbcb0efa7088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:45.856733 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-907376a8-7500-4360-ad13-d4b540688d96 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] 10.222.0.26 "GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d" status: 200 len: 1322 microversion: 2.1 time: 0.231095 Oct 29 01:59:45.857356 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3699/7612] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:45 2022] GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:45.998942 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-4a55d970-795c-418c-a5f6-59dfdb84bfec req-8f05deee-ad9b-4076-8c8f-50ef3cdb228b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b68c4fc-48ca-4059-847b-1b2715323a7d", "tag": "6f940135-212e-497a-97c9-a763a8bb998c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:59:46.009627 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4a55d970-795c-418c-a5f6-59dfdb84bfec req-8f05deee-ad9b-4076-8c8f-50ef3cdb228b service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:46.010107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4a55d970-795c-418c-a5f6-59dfdb84bfec req-8f05deee-ad9b-4076-8c8f-50ef3cdb228b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:46.010543 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-4a55d970-795c-418c-a5f6-59dfdb84bfec req-8f05deee-ad9b-4076-8c8f-50ef3cdb228b service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:46.022312 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-4a55d970-795c-418c-a5f6-59dfdb84bfec req-8f05deee-ad9b-4076-8c8f-50ef3cdb228b service nova] Creating event network-changed:6f940135-212e-497a-97c9-a763a8bb998c for instance 5b68c4fc-48ca-4059-847b-1b2715323a7d on n-h1-862964-3 Oct 29 01:59:46.028053 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-4a55d970-795c-418c-a5f6-59dfdb84bfec req-8f05deee-ad9b-4076-8c8f-50ef3cdb228b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033079 Oct 29 01:59:46.028660 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3914/7613] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:59:46.880394 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-465bcb33-5d7d-4eed-8db7-762cfced1465 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:46.881015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-465bcb33-5d7d-4eed-8db7-762cfced1465 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:46.887797 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-465bcb33-5d7d-4eed-8db7-762cfced1465 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:46.888294 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-465bcb33-5d7d-4eed-8db7-762cfced1465 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:46.888741 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-465bcb33-5d7d-4eed-8db7-762cfced1465 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:46.890266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-465bcb33-5d7d-4eed-8db7-762cfced1465 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:46.890736 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-465bcb33-5d7d-4eed-8db7-762cfced1465 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:46.891174 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-465bcb33-5d7d-4eed-8db7-762cfced1465 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:47.026527 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-465bcb33-5d7d-4eed-8db7-762cfced1465 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2e0f003ba64a92b21851fa8d0dae08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286393e1b0b453a9acbdbcb0efa7088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:47.034444 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-465bcb33-5d7d-4eed-8db7-762cfced1465 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] 10.222.0.26 "GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d" status: 200 len: 1322 microversion: 2.1 time: 0.157967 Oct 29 01:59:47.035009 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3700/7614] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:46 2022] GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:48.058691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cb67c45b-c8e2-49af-8c5c-08ae5c1c6786 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:48.059386 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cb67c45b-c8e2-49af-8c5c-08ae5c1c6786 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:48.067371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb67c45b-c8e2-49af-8c5c-08ae5c1c6786 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:48.067850 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb67c45b-c8e2-49af-8c5c-08ae5c1c6786 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:48.068285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb67c45b-c8e2-49af-8c5c-08ae5c1c6786 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:48.069005 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb67c45b-c8e2-49af-8c5c-08ae5c1c6786 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:48.069521 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb67c45b-c8e2-49af-8c5c-08ae5c1c6786 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:48.069949 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cb67c45b-c8e2-49af-8c5c-08ae5c1c6786 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:48.201185 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cb67c45b-c8e2-49af-8c5c-08ae5c1c6786 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2e0f003ba64a92b21851fa8d0dae08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286393e1b0b453a9acbdbcb0efa7088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:48.209251 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cb67c45b-c8e2-49af-8c5c-08ae5c1c6786 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] 10.222.0.26 "GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d" status: 200 len: 1322 microversion: 2.1 time: 0.154679 Oct 29 01:59:48.209836 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3915/7615] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:48 2022] GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:49.231863 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-855e8d2e-15f5-4dcd-a4a1-85647e707a74 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:49.232509 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-855e8d2e-15f5-4dcd-a4a1-85647e707a74 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:49.239480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-855e8d2e-15f5-4dcd-a4a1-85647e707a74 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:49.239978 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-855e8d2e-15f5-4dcd-a4a1-85647e707a74 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:49.240440 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-855e8d2e-15f5-4dcd-a4a1-85647e707a74 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:49.241164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-855e8d2e-15f5-4dcd-a4a1-85647e707a74 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:49.241646 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-855e8d2e-15f5-4dcd-a4a1-85647e707a74 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:49.242088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-855e8d2e-15f5-4dcd-a4a1-85647e707a74 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:49.371629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-855e8d2e-15f5-4dcd-a4a1-85647e707a74 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2e0f003ba64a92b21851fa8d0dae08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286393e1b0b453a9acbdbcb0efa7088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:49.379978 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-855e8d2e-15f5-4dcd-a4a1-85647e707a74 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] 10.222.0.26 "GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d" status: 200 len: 1322 microversion: 2.1 time: 0.152154 Oct 29 01:59:49.380550 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3701/7616] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:49 2022] GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:59:50.403562 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-af6ebae0-8ea3-41c7-8af5-8d10008fc426 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:50.404178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-af6ebae0-8ea3-41c7-8af5-8d10008fc426 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:50.411684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af6ebae0-8ea3-41c7-8af5-8d10008fc426 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:50.412167 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af6ebae0-8ea3-41c7-8af5-8d10008fc426 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:50.412604 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af6ebae0-8ea3-41c7-8af5-8d10008fc426 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:50.413331 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af6ebae0-8ea3-41c7-8af5-8d10008fc426 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:50.413789 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af6ebae0-8ea3-41c7-8af5-8d10008fc426 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:50.414218 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-af6ebae0-8ea3-41c7-8af5-8d10008fc426 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:50.550012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-af6ebae0-8ea3-41c7-8af5-8d10008fc426 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2e0f003ba64a92b21851fa8d0dae08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286393e1b0b453a9acbdbcb0efa7088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:50.557779 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-af6ebae0-8ea3-41c7-8af5-8d10008fc426 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] 10.222.0.26 "GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d" status: 200 len: 1322 microversion: 2.1 time: 0.158094 Oct 29 01:59:50.558373 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3916/7617] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:50 2022] GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:51.430267 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-ae78a63e-4a9c-41b8-b3f7-35136e0682b6 req-16270961-72af-44be-9d74-8bd02241a3f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b68c4fc-48ca-4059-847b-1b2715323a7d", "name": "network-vif-plugged", "status": "completed", "tag": "6f940135-212e-497a-97c9-a763a8bb998c"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:59:51.441149 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ae78a63e-4a9c-41b8-b3f7-35136e0682b6 req-16270961-72af-44be-9d74-8bd02241a3f0 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:51.441661 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ae78a63e-4a9c-41b8-b3f7-35136e0682b6 req-16270961-72af-44be-9d74-8bd02241a3f0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:51.442106 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-ae78a63e-4a9c-41b8-b3f7-35136e0682b6 req-16270961-72af-44be-9d74-8bd02241a3f0 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:51.453720 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-ae78a63e-4a9c-41b8-b3f7-35136e0682b6 req-16270961-72af-44be-9d74-8bd02241a3f0 service nova] Creating event network-vif-plugged:6f940135-212e-497a-97c9-a763a8bb998c for instance 5b68c4fc-48ca-4059-847b-1b2715323a7d on n-h1-862964-3 Oct 29 01:59:51.458717 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-ae78a63e-4a9c-41b8-b3f7-35136e0682b6 req-16270961-72af-44be-9d74-8bd02241a3f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032241 Oct 29 01:59:51.459565 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3702/7618] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:59:51.585535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-eb84e346-e940-4ea5-a0e7-55d93720221a tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:51.586182 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-eb84e346-e940-4ea5-a0e7-55d93720221a tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:51.593422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb84e346-e940-4ea5-a0e7-55d93720221a tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:51.593935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb84e346-e940-4ea5-a0e7-55d93720221a tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:51.594566 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb84e346-e940-4ea5-a0e7-55d93720221a tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:51.595541 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb84e346-e940-4ea5-a0e7-55d93720221a tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:51.595735 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb84e346-e940-4ea5-a0e7-55d93720221a tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:51.596170 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-eb84e346-e940-4ea5-a0e7-55d93720221a tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:51.742399 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-eb84e346-e940-4ea5-a0e7-55d93720221a tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2e0f003ba64a92b21851fa8d0dae08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286393e1b0b453a9acbdbcb0efa7088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:51.751412 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-eb84e346-e940-4ea5-a0e7-55d93720221a tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] 10.222.0.26 "GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d" status: 200 len: 1322 microversion: 2.1 time: 0.174414 Oct 29 01:59:51.751989 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3917/7619] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:51 2022] GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:52.771719 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:59:52.772514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:59:52.777579 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4f4d3173-9d97-4d3f-99ff-768f7190795b tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:52.778287 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4f4d3173-9d97-4d3f-99ff-768f7190795b tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:52.785372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f4d3173-9d97-4d3f-99ff-768f7190795b tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:52.785817 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f4d3173-9d97-4d3f-99ff-768f7190795b tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:52.786275 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f4d3173-9d97-4d3f-99ff-768f7190795b tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:52.787505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f4d3173-9d97-4d3f-99ff-768f7190795b tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:52.787983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f4d3173-9d97-4d3f-99ff-768f7190795b tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:52.788432 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4f4d3173-9d97-4d3f-99ff-768f7190795b tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:52.927313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4f4d3173-9d97-4d3f-99ff-768f7190795b tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2e0f003ba64a92b21851fa8d0dae08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286393e1b0b453a9acbdbcb0efa7088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:52.935471 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4f4d3173-9d97-4d3f-99ff-768f7190795b tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] 10.222.0.26 "GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d" status: 200 len: 1322 microversion: 2.1 time: 0.164719 Oct 29 01:59:52.936038 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3703/7620] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:52 2022] GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:53.959831 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2a9f03c4-b3e8-45c5-9f05-7a0939069f17 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:53.960450 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2a9f03c4-b3e8-45c5-9f05-7a0939069f17 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:53.962598 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 01:59:53.969385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2a9f03c4-b3e8-45c5-9f05-7a0939069f17 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:53.977045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2a9f03c4-b3e8-45c5-9f05-7a0939069f17 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:53.977045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2a9f03c4-b3e8-45c5-9f05-7a0939069f17 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:53.977045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2a9f03c4-b3e8-45c5-9f05-7a0939069f17 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:53.977045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2a9f03c4-b3e8-45c5-9f05-7a0939069f17 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:53.977045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2a9f03c4-b3e8-45c5-9f05-7a0939069f17 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:54.105448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2a9f03c4-b3e8-45c5-9f05-7a0939069f17 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2e0f003ba64a92b21851fa8d0dae08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286393e1b0b453a9acbdbcb0efa7088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:54.113299 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2a9f03c4-b3e8-45c5-9f05-7a0939069f17 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] 10.222.0.26 "GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d" status: 200 len: 1471 microversion: 2.1 time: 0.157630 Oct 29 01:59:54.113890 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3918/7621] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:53 2022] GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:54.186466 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a6dbdb8e-1f76-4d9b-9c4f-4f30d6182d29 tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Calling method '.version_select at 0x7f9d9fe69820>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:54.253741 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a6dbdb8e-1f76-4d9b-9c4f-4f30d6182d29 tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/e3286c95e4814a7886069bb151deac56" status: 200 len: 371 microversion: 2.1 time: 0.119230 Oct 29 01:59:54.254335 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3704/7622] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 29 01:59:54 2022] GET /compute/v2.1/os-quota-sets/e3286c95e4814a7886069bb151deac56 => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:59:54.266963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bcccfe74-dec0-48be-99b6-7d99196ca9c3 tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1217626221", "id": 845136270, "os-flavor-access:is_public": "True"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:59:54.330626 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bcccfe74-dec0-48be-99b6-7d99196ca9c3 tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.068045 Oct 29 01:59:54.331233 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3919/7623] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:59:54 2022] POST /compute/v2.1/flavors => generated 435 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:59:54.344194 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "845136270"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:59:54.346502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:54.352419 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:54.352912 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:54.353395 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:54.354093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:54.354561 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:54.355007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:54.441969 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4ece0d6f8dae46238e595d291624e7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3286c95e4814a7886069bb151deac56', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:54.447994 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1217626221 {{(pid=121100) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 01:59:54.455496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:54.455986 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:54.456435 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:54.457188 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:54.457659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:54.458096 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:54.479768 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Getting quotas for project 8286393e1b0b453a9acbdbcb0efa7088. Resources: {'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:59:54.485119 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Getting quotas for user 1b2e0f003ba64a92b21851fa8d0dae08 and project 8286393e1b0b453a9acbdbcb0efa7088. Resources: {'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:59:54.497044 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.compute.api [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] ram quota exceeded for e3286c95e4814a7886069bb151deac56, tried to resize instance. Oct 29 01:59:54.497623 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Request method failure captured: Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: request: POST /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d/action HTTP/1.1 Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 38 Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIkMBYkmWGNyT3xVa8xy8dqIWgkSIqv8pOQe_hS72Rx3MPmMt2rmTo3G6e13tri7RXOJOh8Y9-XHU9jTiuzZg857q8ny877jzYP1WIWB3y9YyyWfmNvz26KQZ1G5FKgCwGXv6vzlvYoigRWn1-zt4tDTp0pNlmylUDvwepgzN1yV-do Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: e3286c95e4814a7886069bb151deac56 Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1543243258 Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,admin,reader Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,admin,reader Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3286c95e4814a7886069bb151deac56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e3286c95e4814a7886069bb151deac56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3286c95e4814a7886069bb151deac56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e3286c95e4814a7886069bb151deac56", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1543243258 Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: e3286c95e4814a7886069bb151deac56 Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1543243258 Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-ServersAdminNegativeTestJSON-1543243258-project-admin Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 4ece0d6f8dae46238e595d291624e7f1 Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1543243258-project-admin Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: {"resize": {"flavorRef": "845136270"}} Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': '5b68c4fc-48ca-4059-847b-1b2715323a7d', 'body': {'resize': {'flavorRef': '845136270'}}} Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:59:54.500218 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-4abf6c36-18f1-4eae-9bbe-79f484d9a82f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d/action" status: 403 len: 118 microversion: 2.1 time: 0.162204 Oct 29 01:59:54.504653 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3705/7624] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:59:54 2022] POST /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d/action => generated 118 bytes in 163 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:59:54.514928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-99cb3dd0-fc8d-43e7-9959-61cc79b36f0c tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:54.587182 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-99cb3dd0-fc8d-43e7-9959-61cc79b36f0c tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/845136270" status: 202 len: 0 microversion: 2.1 time: 0.079469 Oct 29 01:59:54.587812 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3920/7625] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 29 01:59:54 2022] DELETE /compute/v2.1/flavors/845136270 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:59:54.595731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-2e4d227b-3eb8-484a-bb34-b0a12e3ac9db tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:54.615905 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-2e4d227b-3eb8-484a-bb34-b0a12e3ac9db tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023808 Oct 29 01:59:54.616471 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3706/7626] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:59:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:54.636935 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-244aecb4-24a2-41b1-a317-e62684c5bda4 tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Calling method '.version_select at 0x7f9d967dc040>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:54.712969 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-244aecb4-24a2-41b1-a317-e62684c5bda4 tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/e3286c95e4814a7886069bb151deac56" status: 200 len: 371 microversion: 2.1 time: 0.079659 Oct 29 01:59:54.713590 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3921/7627] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 29 01:59:54 2022] GET /compute/v2.1/os-quota-sets/e3286c95e4814a7886069bb151deac56 => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:59:54.725609 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e0da786e-38cb-45e0-865f-5544312a8e80 tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-747152153", "id": 1575265804, "os-flavor-access:is_public": "True"}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:59:54.837854 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e0da786e-38cb-45e0-865f-5544312a8e80 tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.115828 Oct 29 01:59:54.838375 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3707/7628] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 01:59:54 2022] POST /compute/v2.1/flavors => generated 436 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:59:54.850993 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1575265804"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:59:54.853406 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:54.860223 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:54.860717 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:54.861181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:54.861886 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:54.862394 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:54.862940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:54.951870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4ece0d6f8dae46238e595d291624e7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3286c95e4814a7886069bb151deac56', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:54.958452 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-747152153 {{(pid=121099) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 01:59:54.967208 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:54.967806 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:54.968385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:54.969587 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:54.970044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:54.970472 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:54.993950 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Getting quotas for project 8286393e1b0b453a9acbdbcb0efa7088. Resources: {'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 01:59:54.999166 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.quota [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Getting quotas for user 1b2e0f003ba64a92b21851fa8d0dae08 and project 8286393e1b0b453a9acbdbcb0efa7088. Resources: {'cores', 'ram'} {{(pid=121099) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 01:59:55.012118 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.compute.api [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] cores quota exceeded for e3286c95e4814a7886069bb151deac56, tried to resize instance. Oct 29 01:59:55.012666 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Request method failure captured: Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: request: POST /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d/action HTTP/1.1 Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 39 Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIkMBYkmWGNyT3xVa8xy8dqIWgkSIqv8pOQe_hS72Rx3MPmMt2rmTo3G6e13tri7RXOJOh8Y9-XHU9jTiuzZg857q8ny877jzYP1WIWB3y9YyyWfmNvz26KQZ1G5FKgCwGXv6vzlvYoigRWn1-zt4tDTp0pNlmylUDvwepgzN1yV-do Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: e3286c95e4814a7886069bb151deac56 Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1543243258 Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,admin,reader Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,admin,reader Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3286c95e4814a7886069bb151deac56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e3286c95e4814a7886069bb151deac56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3286c95e4814a7886069bb151deac56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e3286c95e4814a7886069bb151deac56", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1543243258 Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: e3286c95e4814a7886069bb151deac56 Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1543243258 Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersAdminNegativeTestJSON-1543243258-project-admin Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 4ece0d6f8dae46238e595d291624e7f1 Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1543243258-project-admin Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: {"resize": {"flavorRef": "1575265804"}} Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '5b68c4fc-48ca-4059-847b-1b2715323a7d', 'body': {'resize': {'flavorRef': '1575265804'}}} Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:59:55.014788 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-f103895d-169c-4658-b484-8e0c64c4f09f tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d/action" status: 403 len: 113 microversion: 2.1 time: 0.169477 Oct 29 01:59:55.019115 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3922/7629] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 01:59:54 2022] POST /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d/action => generated 113 bytes in 171 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:59:55.025243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c8416a93-df57-4146-8998-5213c3400802 tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:55.118688 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c8416a93-df57-4146-8998-5213c3400802 tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1575265804" status: 202 len: 0 microversion: 2.1 time: 0.097122 Oct 29 01:59:55.119277 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3708/7630] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 29 01:59:55 2022] DELETE /compute/v2.1/flavors/1575265804 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:59:55.128210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-4018ae78-0919-4427-92c6-e55be3daf6cd tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:55.148220 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-4018ae78-0919-4427-92c6-e55be3daf6cd tempest-ServersAdminNegativeTestJSON-1543243258 tempest-ServersAdminNegativeTestJSON-1543243258-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024558 Oct 29 01:59:55.148785 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3923/7631] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 29 01:59:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:55.170785 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-cb84d653-a66c-4e64-9f80-0c195b2196bc tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:55.176826 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cb84d653-a66c-4e64-9f80-0c195b2196bc tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:55.179693 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb84d653-a66c-4e64-9f80-0c195b2196bc tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:55.180224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb84d653-a66c-4e64-9f80-0c195b2196bc tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:55.180676 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb84d653-a66c-4e64-9f80-0c195b2196bc tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:55.181413 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb84d653-a66c-4e64-9f80-0c195b2196bc tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:55.181889 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb84d653-a66c-4e64-9f80-0c195b2196bc tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:55.182332 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-cb84d653-a66c-4e64-9f80-0c195b2196bc tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:55.207828 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-cb84d653-a66c-4e64-9f80-0c195b2196bc tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 01:59:55.500758 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-cb84d653-a66c-4e64-9f80-0c195b2196bc tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d" status: 204 len: 0 microversion: 2.1 time: 0.333460 Oct 29 01:59:55.501310 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3709/7632] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 01:59:55 2022] DELETE /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:59:55.509687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-25cf436b-5532-4833-bbd9-725ffacd5c12 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:55.512363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-25cf436b-5532-4833-bbd9-725ffacd5c12 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:55.517067 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25cf436b-5532-4833-bbd9-725ffacd5c12 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:55.517596 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25cf436b-5532-4833-bbd9-725ffacd5c12 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:55.518043 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25cf436b-5532-4833-bbd9-725ffacd5c12 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:55.518750 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25cf436b-5532-4833-bbd9-725ffacd5c12 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:55.519214 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25cf436b-5532-4833-bbd9-725ffacd5c12 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:55.519655 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-25cf436b-5532-4833-bbd9-725ffacd5c12 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:55.654247 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-25cf436b-5532-4833-bbd9-725ffacd5c12 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2e0f003ba64a92b21851fa8d0dae08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286393e1b0b453a9acbdbcb0efa7088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:55.662769 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-25cf436b-5532-4833-bbd9-725ffacd5c12 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] 10.222.0.26 "GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d" status: 200 len: 1477 microversion: 2.1 time: 0.157058 Oct 29 01:59:55.663345 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3924/7633] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:55 2022] GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:59:56.686564 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f6d8bdfb-1195-4e15-8966-1639d7101d93 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:56.687757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f6d8bdfb-1195-4e15-8966-1639d7101d93 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:56.694568 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d8bdfb-1195-4e15-8966-1639d7101d93 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:56.695064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d8bdfb-1195-4e15-8966-1639d7101d93 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:56.695511 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d8bdfb-1195-4e15-8966-1639d7101d93 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:56.696208 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d8bdfb-1195-4e15-8966-1639d7101d93 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:56.696677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d8bdfb-1195-4e15-8966-1639d7101d93 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:56.697112 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f6d8bdfb-1195-4e15-8966-1639d7101d93 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:56.829794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f6d8bdfb-1195-4e15-8966-1639d7101d93 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2e0f003ba64a92b21851fa8d0dae08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286393e1b0b453a9acbdbcb0efa7088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:56.837949 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f6d8bdfb-1195-4e15-8966-1639d7101d93 tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] 10.222.0.26 "GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d" status: 200 len: 1477 microversion: 2.1 time: 0.155688 Oct 29 01:59:56.838566 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3710/7634] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:56 2022] GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d => generated 1477 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:57.597700 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-6d248b88-4270-4a61-9e36-c7e99a7ccb1b req-6ed5ef65-941c-4239-a0be-a306e2bcf60c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b68c4fc-48ca-4059-847b-1b2715323a7d", "name": "network-vif-deleted", "tag": "6f940135-212e-497a-97c9-a763a8bb998c"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:59:57.610686 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6d248b88-4270-4a61-9e36-c7e99a7ccb1b req-6ed5ef65-941c-4239-a0be-a306e2bcf60c service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:57.611175 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6d248b88-4270-4a61-9e36-c7e99a7ccb1b req-6ed5ef65-941c-4239-a0be-a306e2bcf60c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:57.611633 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-6d248b88-4270-4a61-9e36-c7e99a7ccb1b req-6ed5ef65-941c-4239-a0be-a306e2bcf60c service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:57.623525 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-6d248b88-4270-4a61-9e36-c7e99a7ccb1b req-6ed5ef65-941c-4239-a0be-a306e2bcf60c service nova] Creating event network-vif-deleted:6f940135-212e-497a-97c9-a763a8bb998c for instance 5b68c4fc-48ca-4059-847b-1b2715323a7d on n-h1-862964-3 Oct 29 01:59:57.629523 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-6d248b88-4270-4a61-9e36-c7e99a7ccb1b req-6ed5ef65-941c-4239-a0be-a306e2bcf60c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036638 Oct 29 01:59:57.630309 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3925/7635] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 01:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:59:57.862254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-b490efb7-cccb-4865-892c-96c79930970e tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:57.862867 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-b490efb7-cccb-4865-892c-96c79930970e tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:57.869984 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b490efb7-cccb-4865-892c-96c79930970e tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:57.870503 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b490efb7-cccb-4865-892c-96c79930970e tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:57.870952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b490efb7-cccb-4865-892c-96c79930970e tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:57.871651 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b490efb7-cccb-4865-892c-96c79930970e tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:57.872117 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b490efb7-cccb-4865-892c-96c79930970e tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:57.872555 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b490efb7-cccb-4865-892c-96c79930970e tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:57.907603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b490efb7-cccb-4865-892c-96c79930970e tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:57.908018 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b490efb7-cccb-4865-892c-96c79930970e tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:57.908495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-b490efb7-cccb-4865-892c-96c79930970e tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:57.908940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-b490efb7-cccb-4865-892c-96c79930970e tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lazy-loading 'fault' on Instance uuid 5b68c4fc-48ca-4059-847b-1b2715323a7d {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 01:59:57.950312 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-b490efb7-cccb-4865-892c-96c79930970e tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2e0f003ba64a92b21851fa8d0dae08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286393e1b0b453a9acbdbcb0efa7088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:59:57.959415 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-b490efb7-cccb-4865-892c-96c79930970e tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] 10.222.0.26 "GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d" status: 200 len: 1312 microversion: 2.1 time: 0.100913 Oct 29 01:59:57.962766 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3711/7636] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:57 2022] GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:59:58.984951 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-713fa214-d41e-4ab1-a7bc-f2714604a26c tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:59:58.985689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-713fa214-d41e-4ab1-a7bc-f2714604a26c tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] [instance: 5b68c4fc-48ca-4059-847b-1b2715323a7d] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 01:59:58.991986 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-713fa214-d41e-4ab1-a7bc-f2714604a26c tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:58.992476 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-713fa214-d41e-4ab1-a7bc-f2714604a26c tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:58.992923 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-713fa214-d41e-4ab1-a7bc-f2714604a26c tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:58.993636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-713fa214-d41e-4ab1-a7bc-f2714604a26c tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 01:59:58.994101 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-713fa214-d41e-4ab1-a7bc-f2714604a26c tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 01:59:58.994532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-713fa214-d41e-4ab1-a7bc-f2714604a26c tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 01:59:59.011572 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-713fa214-d41e-4ab1-a7bc-f2714604a26c tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] HTTP exception thrown: Instance 5b68c4fc-48ca-4059-847b-1b2715323a7d could not be found. Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-713fa214-d41e-4ab1-a7bc-f2714604a26c tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Request method failure captured: Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d HTTP/1.1 Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIkM7rpXQwiEI3Xb6XLt1Hgqlcna_ZvBboRSo02GlfwZ9W1NM2DLxge1XDLuGi1DcVVwkSbazgslok8Q3_JZV7apV6yhnwWEgVtie7z9ow5nB43fo4LpYMXv7TOr96cU2BqHJQVaWQXXzc_gnNzp2yI79WRlSDV8x3pR2f7aLG2oRDk Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 8286393e1b0b453a9acbdbcb0efa7088 Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-714911058 Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8286393e1b0b453a9acbdbcb0efa7088"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8286393e1b0b453a9acbdbcb0efa7088"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8286393e1b0b453a9acbdbcb0efa7088"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8286393e1b0b453a9acbdbcb0efa7088", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-ServersAdminNegativeTestJSON-714911058 Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 8286393e1b0b453a9acbdbcb0efa7088 Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-714911058 Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-ServersAdminNegativeTestJSON-714911058-project Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 1b2e0f003ba64a92b21851fa8d0dae08 Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-ServersAdminNegativeTestJSON-714911058-project Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance 5b68c4fc-48ca-4059-847b-1b2715323a7d could not be found. Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': '5b68c4fc-48ca-4059-847b-1b2715323a7d'} Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b68c4fc-48ca-4059-847b-1b2715323a7d could not be found. Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b68c4fc-48ca-4059-847b-1b2715323a7d could not be found. Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:59:59.013233 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 01:59:59.018583 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:59:59.018583 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 01:59:59.018583 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 01:59:59.018583 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 01:59:59.018583 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 01:59:59.018583 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 01:59:59.018583 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b68c4fc-48ca-4059-847b-1b2715323a7d could not be found. Oct 29 01:59:59.018583 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 01:59:59.018583 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-713fa214-d41e-4ab1-a7bc-f2714604a26c tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] Returning 404 to user: Instance 5b68c4fc-48ca-4059-847b-1b2715323a7d could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 01:59:59.018583 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-713fa214-d41e-4ab1-a7bc-f2714604a26c tempest-ServersAdminNegativeTestJSON-714911058 tempest-ServersAdminNegativeTestJSON-714911058-project] 10.222.0.26 "GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d" status: 404 len: 111 microversion: 2.1 time: 0.035002 Oct 29 01:59:59.018583 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3926/7637] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 01:59:58 2022] GET /compute/v2.1/servers/5b68c4fc-48ca-4059-847b-1b2715323a7d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:00:07.625340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:00:07.627115 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=3 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:00:07.745058 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-1a9a94ab-bce4-46f6-a497-d45b198bf0a1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-725879166", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "f4d86474-05fa-43e0-8769-5249a525c196"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:00:07.802852 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-1a9a94ab-bce4-46f6-a497-d45b198bf0a1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] validate_networks() for [('f4d86474-05fa-43e0-8769-5249a525c196', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:00:07.958947 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:00:08.205372 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-1a9a94ab-bce4-46f6-a497-d45b198bf0a1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:00:08.207881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-1a9a94ab-bce4-46f6-a497-d45b198bf0a1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:00:08.207881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-1a9a94ab-bce4-46f6-a497-d45b198bf0a1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:00:08.207881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-1a9a94ab-bce4-46f6-a497-d45b198bf0a1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:00:08.207881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-1a9a94ab-bce4-46f6-a497-d45b198bf0a1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:00:08.216731 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a9a94ab-bce4-46f6-a497-d45b198bf0a1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:08.217271 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a9a94ab-bce4-46f6-a497-d45b198bf0a1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:08.217722 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a9a94ab-bce4-46f6-a497-d45b198bf0a1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:08.219120 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a9a94ab-bce4-46f6-a497-d45b198bf0a1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:08.219644 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a9a94ab-bce4-46f6-a497-d45b198bf0a1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:08.220085 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-1a9a94ab-bce4-46f6-a497-d45b198bf0a1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:08.238933 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-1a9a94ab-bce4-46f6-a497-d45b198bf0a1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Getting quotas for project 340e781141e149e89d1fcf2c582951bf. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:00:08.244190 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-1a9a94ab-bce4-46f6-a497-d45b198bf0a1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Getting quotas for user 8a4cf007089b4ab68ae3ca9bb985cf79 and project 340e781141e149e89d1fcf2c582951bf. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:00:08.257565 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1a9a94ab-bce4-46f6-a497-d45b198bf0a1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:00:08.259873 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-1a9a94ab-bce4-46f6-a497-d45b198bf0a1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:00:08.377232 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-1a9a94ab-bce4-46f6-a497-d45b198bf0a1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758220 Oct 29 02:00:08.377891 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3712/7638] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 02:00:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:00:08.388981 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6cf739f2-15f6-41d3-92cc-f13371ae76a4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:08.389619 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6cf739f2-15f6-41d3-92cc-f13371ae76a4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:08.392963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:00:08.393953 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:00:08.450691 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6cf739f2-15f6-41d3-92cc-f13371ae76a4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:08.459635 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6cf739f2-15f6-41d3-92cc-f13371ae76a4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1214 microversion: 2.1 time: 0.074210 Oct 29 02:00:08.460217 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3927/7639] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:08 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:09.485526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-329f0c22-1b32-4e70-a698-d8d05624941c tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:09.486077 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-329f0c22-1b32-4e70-a698-d8d05624941c tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:09.493992 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-329f0c22-1b32-4e70-a698-d8d05624941c tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:09.494495 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-329f0c22-1b32-4e70-a698-d8d05624941c tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:09.494952 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-329f0c22-1b32-4e70-a698-d8d05624941c tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:09.495704 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-329f0c22-1b32-4e70-a698-d8d05624941c tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:09.496176 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-329f0c22-1b32-4e70-a698-d8d05624941c tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:09.496917 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-329f0c22-1b32-4e70-a698-d8d05624941c tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:09.572172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-329f0c22-1b32-4e70-a698-d8d05624941c tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:09.581542 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-329f0c22-1b32-4e70-a698-d8d05624941c tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1218 microversion: 2.1 time: 0.101002 Oct 29 02:00:09.582338 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3713/7640] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:09 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:10.605687 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-400c43ec-f5e1-4507-8e1a-46b64d643a37 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:10.606313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-400c43ec-f5e1-4507-8e1a-46b64d643a37 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:10.608522 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=55 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:00:10.615746 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-400c43ec-f5e1-4507-8e1a-46b64d643a37 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:10.620480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-400c43ec-f5e1-4507-8e1a-46b64d643a37 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:10.620480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-400c43ec-f5e1-4507-8e1a-46b64d643a37 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:10.620480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-400c43ec-f5e1-4507-8e1a-46b64d643a37 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:10.620480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-400c43ec-f5e1-4507-8e1a-46b64d643a37 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:10.620480 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-400c43ec-f5e1-4507-8e1a-46b64d643a37 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:10.692979 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-400c43ec-f5e1-4507-8e1a-46b64d643a37 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:10.701453 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-400c43ec-f5e1-4507-8e1a-46b64d643a37 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1284 microversion: 2.1 time: 0.099616 Oct 29 02:00:10.702045 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3928/7641] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:10 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:11.729540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-e0ab4c69-148e-4686-97cc-1550714bb5c4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:11.730178 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-e0ab4c69-148e-4686-97cc-1550714bb5c4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:11.734505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:00:11.740038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0ab4c69-148e-4686-97cc-1550714bb5c4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:11.742014 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0ab4c69-148e-4686-97cc-1550714bb5c4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:11.742479 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0ab4c69-148e-4686-97cc-1550714bb5c4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:11.743213 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0ab4c69-148e-4686-97cc-1550714bb5c4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:11.743698 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0ab4c69-148e-4686-97cc-1550714bb5c4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:11.744145 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-e0ab4c69-148e-4686-97cc-1550714bb5c4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:11.986234 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-e0ab4c69-148e-4686-97cc-1550714bb5c4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:11.994515 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-e0ab4c69-148e-4686-97cc-1550714bb5c4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1314 microversion: 2.1 time: 0.269017 Oct 29 02:00:11.994930 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3714/7642] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:11 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:12.221738 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-b2544db0-b4c9-4415-bb88-0b529faff250 req-ed3a6f31-030f-41d6-b1d2-eca836660f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb093b5e-f70f-422f-9168-d2eecb506e69", "tag": "dc3c89dc-8253-4c03-bff9-ba2bef361d7f"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:00:12.227415 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:00:12.232532 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b2544db0-b4c9-4415-bb88-0b529faff250 req-ed3a6f31-030f-41d6-b1d2-eca836660f80 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:12.233016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b2544db0-b4c9-4415-bb88-0b529faff250 req-ed3a6f31-030f-41d6-b1d2-eca836660f80 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:12.233477 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-b2544db0-b4c9-4415-bb88-0b529faff250 req-ed3a6f31-030f-41d6-b1d2-eca836660f80 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:12.245518 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-b2544db0-b4c9-4415-bb88-0b529faff250 req-ed3a6f31-030f-41d6-b1d2-eca836660f80 service nova] Creating event network-changed:dc3c89dc-8253-4c03-bff9-ba2bef361d7f for instance bb093b5e-f70f-422f-9168-d2eecb506e69 on n-h1-862964-3 Oct 29 02:00:12.251483 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-b2544db0-b4c9-4415-bb88-0b529faff250 req-ed3a6f31-030f-41d6-b1d2-eca836660f80 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034136 Oct 29 02:00:12.252096 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3929/7643] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 02:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:00:13.018633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-124cca28-6471-4775-a86e-818e1a763f48 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:13.019264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-124cca28-6471-4775-a86e-818e1a763f48 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:13.026304 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-124cca28-6471-4775-a86e-818e1a763f48 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:13.026807 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-124cca28-6471-4775-a86e-818e1a763f48 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:13.027266 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-124cca28-6471-4775-a86e-818e1a763f48 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:13.037254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-124cca28-6471-4775-a86e-818e1a763f48 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:13.037254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-124cca28-6471-4775-a86e-818e1a763f48 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:13.037254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-124cca28-6471-4775-a86e-818e1a763f48 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:13.165749 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-124cca28-6471-4775-a86e-818e1a763f48 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:13.174002 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-124cca28-6471-4775-a86e-818e1a763f48 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1314 microversion: 2.1 time: 0.160164 Oct 29 02:00:13.174567 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3715/7644] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:13 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:14.199458 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-6e4ff76f-15d9-4cd4-8ac3-479628f6db6a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:14.200168 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-6e4ff76f-15d9-4cd4-8ac3-479628f6db6a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:14.207112 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e4ff76f-15d9-4cd4-8ac3-479628f6db6a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:14.207603 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e4ff76f-15d9-4cd4-8ac3-479628f6db6a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:14.208048 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e4ff76f-15d9-4cd4-8ac3-479628f6db6a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:14.208742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e4ff76f-15d9-4cd4-8ac3-479628f6db6a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:14.209233 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e4ff76f-15d9-4cd4-8ac3-479628f6db6a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:14.209958 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-6e4ff76f-15d9-4cd4-8ac3-479628f6db6a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:14.341926 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-6e4ff76f-15d9-4cd4-8ac3-479628f6db6a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:14.350288 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-6e4ff76f-15d9-4cd4-8ac3-479628f6db6a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1314 microversion: 2.1 time: 0.155995 Oct 29 02:00:14.350867 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3930/7645] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:14 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:15.373292 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-5ae3a5af-975f-47fd-b601-27d4cf30105e tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:15.373928 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-5ae3a5af-975f-47fd-b601-27d4cf30105e tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:15.381007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ae3a5af-975f-47fd-b601-27d4cf30105e tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:15.381533 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ae3a5af-975f-47fd-b601-27d4cf30105e tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:15.381989 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ae3a5af-975f-47fd-b601-27d4cf30105e tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:15.382701 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ae3a5af-975f-47fd-b601-27d4cf30105e tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:15.383177 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ae3a5af-975f-47fd-b601-27d4cf30105e tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:15.383624 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-5ae3a5af-975f-47fd-b601-27d4cf30105e tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:15.514129 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-5ae3a5af-975f-47fd-b601-27d4cf30105e tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:15.522042 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-5ae3a5af-975f-47fd-b601-27d4cf30105e tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1314 microversion: 2.1 time: 0.152691 Oct 29 02:00:15.522641 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3716/7646] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:15 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:16.544662 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2ab2251d-10b7-45ae-a44b-07cd7025fc45 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:16.545337 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2ab2251d-10b7-45ae-a44b-07cd7025fc45 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:16.552726 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ab2251d-10b7-45ae-a44b-07cd7025fc45 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:16.553232 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ab2251d-10b7-45ae-a44b-07cd7025fc45 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:16.553680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ab2251d-10b7-45ae-a44b-07cd7025fc45 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:16.554371 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ab2251d-10b7-45ae-a44b-07cd7025fc45 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:16.554828 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ab2251d-10b7-45ae-a44b-07cd7025fc45 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:16.555253 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-2ab2251d-10b7-45ae-a44b-07cd7025fc45 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:16.690937 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2ab2251d-10b7-45ae-a44b-07cd7025fc45 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:16.698851 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2ab2251d-10b7-45ae-a44b-07cd7025fc45 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1314 microversion: 2.1 time: 0.158151 Oct 29 02:00:16.699431 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3931/7647] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:16 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:00:17.722605 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-142978b6-b89a-4776-a155-9aa03d781626 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:17.723429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-142978b6-b89a-4776-a155-9aa03d781626 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:17.730398 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-142978b6-b89a-4776-a155-9aa03d781626 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:17.730892 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-142978b6-b89a-4776-a155-9aa03d781626 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:17.731342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-142978b6-b89a-4776-a155-9aa03d781626 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:17.732047 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-142978b6-b89a-4776-a155-9aa03d781626 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:17.732514 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-142978b6-b89a-4776-a155-9aa03d781626 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:17.732951 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-142978b6-b89a-4776-a155-9aa03d781626 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:17.864607 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-142978b6-b89a-4776-a155-9aa03d781626 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:17.872409 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-142978b6-b89a-4776-a155-9aa03d781626 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1314 microversion: 2.1 time: 0.153698 Oct 29 02:00:17.872977 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3717/7648] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:17 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:18.896340 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-9de3b085-54c8-47b7-bfca-567cf334136b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:18.896947 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-9de3b085-54c8-47b7-bfca-567cf334136b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:18.899774 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:00:18.904658 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9de3b085-54c8-47b7-bfca-567cf334136b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:18.905142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9de3b085-54c8-47b7-bfca-567cf334136b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:18.906363 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9de3b085-54c8-47b7-bfca-567cf334136b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:18.907072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9de3b085-54c8-47b7-bfca-567cf334136b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:18.907536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9de3b085-54c8-47b7-bfca-567cf334136b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:18.907969 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-9de3b085-54c8-47b7-bfca-567cf334136b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:19.042965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-9de3b085-54c8-47b7-bfca-567cf334136b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:19.050694 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-9de3b085-54c8-47b7-bfca-567cf334136b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1314 microversion: 2.1 time: 0.158371 Oct 29 02:00:19.051273 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3932/7649] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:18 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:19.559164 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-5a5f8566-a524-4953-98b9-61831e2f94b4 req-15c03217-87e3-4940-b6d3-2b9575e48d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb093b5e-f70f-422f-9168-d2eecb506e69", "name": "network-vif-plugged", "status": "completed", "tag": "dc3c89dc-8253-4c03-bff9-ba2bef361d7f"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:00:19.565069 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:00:19.565795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell0:SELECT=6 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:00:19.571937 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5a5f8566-a524-4953-98b9-61831e2f94b4 req-15c03217-87e3-4940-b6d3-2b9575e48d17 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:19.572429 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5a5f8566-a524-4953-98b9-61831e2f94b4 req-15c03217-87e3-4940-b6d3-2b9575e48d17 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:19.572919 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-5a5f8566-a524-4953-98b9-61831e2f94b4 req-15c03217-87e3-4940-b6d3-2b9575e48d17 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:19.584915 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-5a5f8566-a524-4953-98b9-61831e2f94b4 req-15c03217-87e3-4940-b6d3-2b9575e48d17 service nova] Creating event network-vif-plugged:dc3c89dc-8253-4c03-bff9-ba2bef361d7f for instance bb093b5e-f70f-422f-9168-d2eecb506e69 on n-h1-862964-3 Oct 29 02:00:19.590311 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-5a5f8566-a524-4953-98b9-61831e2f94b4 req-15c03217-87e3-4940-b6d3-2b9575e48d17 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035408 Oct 29 02:00:19.590917 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3718/7650] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 02:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:00:20.074325 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5f1e3879-b46a-4a98-a7da-feacab6f9706 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:20.074941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5f1e3879-b46a-4a98-a7da-feacab6f9706 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:20.083066 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f1e3879-b46a-4a98-a7da-feacab6f9706 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:20.083550 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f1e3879-b46a-4a98-a7da-feacab6f9706 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:20.084016 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f1e3879-b46a-4a98-a7da-feacab6f9706 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:20.084966 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f1e3879-b46a-4a98-a7da-feacab6f9706 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:20.085433 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f1e3879-b46a-4a98-a7da-feacab6f9706 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:20.085860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5f1e3879-b46a-4a98-a7da-feacab6f9706 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:20.221939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5f1e3879-b46a-4a98-a7da-feacab6f9706 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:20.229716 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5f1e3879-b46a-4a98-a7da-feacab6f9706 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1314 microversion: 2.1 time: 0.159429 Oct 29 02:00:20.230319 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3933/7651] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:20 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:21.253923 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-200352b4-8911-45e5-94db-8d944f5c8fb7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:21.254664 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-200352b4-8911-45e5-94db-8d944f5c8fb7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:21.262400 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-200352b4-8911-45e5-94db-8d944f5c8fb7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:21.263794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-200352b4-8911-45e5-94db-8d944f5c8fb7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:21.263794 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-200352b4-8911-45e5-94db-8d944f5c8fb7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:21.264041 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-200352b4-8911-45e5-94db-8d944f5c8fb7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:21.264513 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-200352b4-8911-45e5-94db-8d944f5c8fb7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:21.265104 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-200352b4-8911-45e5-94db-8d944f5c8fb7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:21.399203 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-200352b4-8911-45e5-94db-8d944f5c8fb7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:21.407629 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-200352b4-8911-45e5-94db-8d944f5c8fb7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1500 microversion: 2.1 time: 0.159398 Oct 29 02:00:21.408206 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3719/7652] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:21 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1500 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:21.430689 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bd6cb12e-360e-4766-a5db-b41e6536666a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:00:21.432928 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bd6cb12e-360e-4766-a5db-b41e6536666a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:21.440094 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd6cb12e-360e-4766-a5db-b41e6536666a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:21.440635 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd6cb12e-360e-4766-a5db-b41e6536666a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:21.441072 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd6cb12e-360e-4766-a5db-b41e6536666a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:21.441792 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd6cb12e-360e-4766-a5db-b41e6536666a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:21.442250 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd6cb12e-360e-4766-a5db-b41e6536666a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:21.442680 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bd6cb12e-360e-4766-a5db-b41e6536666a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:21.474535 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bd6cb12e-360e-4766-a5db-b41e6536666a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:21.480010 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bd6cb12e-360e-4766-a5db-b41e6536666a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Old instance type m1.heat2, new instance type m1.heat {{(pid=121099) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 02:00:21.487178 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-bd6cb12e-360e-4766-a5db-b41e6536666a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Flavor limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:00:21.487595 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-bd6cb12e-360e-4766-a5db-b41e6536666a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Image limits 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:00:21.488062 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-bd6cb12e-360e-4766-a5db-b41e6536666a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Flavor pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:00:21.488464 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-bd6cb12e-360e-4766-a5db-b41e6536666a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Image pref 0:0:0 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:00:21.488870 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.virt.hardware [None req-bd6cb12e-360e-4766-a5db-b41e6536666a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:00:21.653142 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bd6cb12e-360e-4766-a5db-b41e6536666a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "POST /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69/action" status: 202 len: 0 microversion: 2.1 time: 0.226325 Oct 29 02:00:21.653731 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3934/7653] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 29 02:00:21 2022] POST /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:00:21.662795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c1a68acd-093d-428d-8271-e056f696c8b1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:21.663670 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c1a68acd-093d-428d-8271-e056f696c8b1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:21.669760 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1a68acd-093d-428d-8271-e056f696c8b1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:21.670253 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1a68acd-093d-428d-8271-e056f696c8b1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:21.670737 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1a68acd-093d-428d-8271-e056f696c8b1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:21.672042 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1a68acd-093d-428d-8271-e056f696c8b1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:21.672520 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1a68acd-093d-428d-8271-e056f696c8b1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:21.673206 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1a68acd-093d-428d-8271-e056f696c8b1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:21.808337 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c1a68acd-093d-428d-8271-e056f696c8b1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:21.816944 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c1a68acd-093d-428d-8271-e056f696c8b1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1509 microversion: 2.1 time: 0.158323 Oct 29 02:00:21.817569 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3720/7654] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:21 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:22.842374 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-d508b0f5-d3ef-4476-aebc-cddaf24fcc3a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:22.843826 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-d508b0f5-d3ef-4476-aebc-cddaf24fcc3a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:22.850939 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d508b0f5-d3ef-4476-aebc-cddaf24fcc3a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:22.851423 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d508b0f5-d3ef-4476-aebc-cddaf24fcc3a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:22.851857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d508b0f5-d3ef-4476-aebc-cddaf24fcc3a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:22.852559 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d508b0f5-d3ef-4476-aebc-cddaf24fcc3a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:22.853046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d508b0f5-d3ef-4476-aebc-cddaf24fcc3a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:22.853508 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-d508b0f5-d3ef-4476-aebc-cddaf24fcc3a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:22.997428 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-d508b0f5-d3ef-4476-aebc-cddaf24fcc3a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:23.006391 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-d508b0f5-d3ef-4476-aebc-cddaf24fcc3a tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1509 microversion: 2.1 time: 0.168944 Oct 29 02:00:23.008560 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3935/7655] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:22 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:24.028853 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f3b5f094-d06e-4366-b1af-9e4be74f6a67 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:24.029505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f3b5f094-d06e-4366-b1af-9e4be74f6a67 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:24.036839 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3b5f094-d06e-4366-b1af-9e4be74f6a67 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:24.037373 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3b5f094-d06e-4366-b1af-9e4be74f6a67 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:24.037829 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3b5f094-d06e-4366-b1af-9e4be74f6a67 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:24.038536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3b5f094-d06e-4366-b1af-9e4be74f6a67 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:24.039009 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3b5f094-d06e-4366-b1af-9e4be74f6a67 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:24.039450 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f3b5f094-d06e-4366-b1af-9e4be74f6a67 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:24.169434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f3b5f094-d06e-4366-b1af-9e4be74f6a67 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:24.177520 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f3b5f094-d06e-4366-b1af-9e4be74f6a67 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1509 microversion: 2.1 time: 0.152524 Oct 29 02:00:24.178105 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3721/7656] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:24 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:25.201052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-07ce2b64-7101-4543-8609-c75d8e56ab47 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:25.201696 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-07ce2b64-7101-4543-8609-c75d8e56ab47 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:25.209044 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07ce2b64-7101-4543-8609-c75d8e56ab47 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:25.209811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07ce2b64-7101-4543-8609-c75d8e56ab47 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:25.210249 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07ce2b64-7101-4543-8609-c75d8e56ab47 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:25.210941 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07ce2b64-7101-4543-8609-c75d8e56ab47 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:25.211402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07ce2b64-7101-4543-8609-c75d8e56ab47 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:25.211829 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-07ce2b64-7101-4543-8609-c75d8e56ab47 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:25.344417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-07ce2b64-7101-4543-8609-c75d8e56ab47 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:25.352172 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-07ce2b64-7101-4543-8609-c75d8e56ab47 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1509 microversion: 2.1 time: 0.155013 Oct 29 02:00:25.352740 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3936/7657] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:25 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:26.376197 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-defbda56-2367-431c-8d83-18537db92565 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:26.376813 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-defbda56-2367-431c-8d83-18537db92565 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:26.383677 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-defbda56-2367-431c-8d83-18537db92565 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:26.384170 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-defbda56-2367-431c-8d83-18537db92565 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:26.384616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-defbda56-2367-431c-8d83-18537db92565 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:26.385424 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-defbda56-2367-431c-8d83-18537db92565 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:26.386282 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-defbda56-2367-431c-8d83-18537db92565 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:26.387871 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-defbda56-2367-431c-8d83-18537db92565 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:26.780540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-defbda56-2367-431c-8d83-18537db92565 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:26.789073 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-defbda56-2367-431c-8d83-18537db92565 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.417918 Oct 29 02:00:26.789863 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3722/7658] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:26 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:27.813548 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-cda1c1df-a95d-472c-9634-701dd5eb1b5d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:27.814089 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-cda1c1df-a95d-472c-9634-701dd5eb1b5d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:27.821097 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cda1c1df-a95d-472c-9634-701dd5eb1b5d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:27.821610 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cda1c1df-a95d-472c-9634-701dd5eb1b5d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:27.822052 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cda1c1df-a95d-472c-9634-701dd5eb1b5d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:27.822741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cda1c1df-a95d-472c-9634-701dd5eb1b5d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:27.823199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cda1c1df-a95d-472c-9634-701dd5eb1b5d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:27.823624 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-cda1c1df-a95d-472c-9634-701dd5eb1b5d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:27.954448 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-cda1c1df-a95d-472c-9634-701dd5eb1b5d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:27.962524 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-cda1c1df-a95d-472c-9634-701dd5eb1b5d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.153746 Oct 29 02:00:27.963092 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3937/7659] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:27 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:28.986328 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-699a8215-cc3f-4993-88ed-74be23fe7053 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:28.986960 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-699a8215-cc3f-4993-88ed-74be23fe7053 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:28.994036 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-699a8215-cc3f-4993-88ed-74be23fe7053 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:28.994535 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-699a8215-cc3f-4993-88ed-74be23fe7053 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:28.994983 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-699a8215-cc3f-4993-88ed-74be23fe7053 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:28.995716 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-699a8215-cc3f-4993-88ed-74be23fe7053 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:28.996183 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-699a8215-cc3f-4993-88ed-74be23fe7053 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:28.996618 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-699a8215-cc3f-4993-88ed-74be23fe7053 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:29.132052 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-699a8215-cc3f-4993-88ed-74be23fe7053 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:29.139919 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-699a8215-cc3f-4993-88ed-74be23fe7053 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.157501 Oct 29 02:00:29.141124 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3723/7660] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:28 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:30.163315 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ebec2df5-6fbd-4681-a60e-38d68e12920f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:30.163917 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ebec2df5-6fbd-4681-a60e-38d68e12920f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:30.170333 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebec2df5-6fbd-4681-a60e-38d68e12920f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:30.170816 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebec2df5-6fbd-4681-a60e-38d68e12920f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:30.171257 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebec2df5-6fbd-4681-a60e-38d68e12920f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:30.172026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebec2df5-6fbd-4681-a60e-38d68e12920f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:30.172412 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebec2df5-6fbd-4681-a60e-38d68e12920f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:30.172841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ebec2df5-6fbd-4681-a60e-38d68e12920f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:30.304226 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ebec2df5-6fbd-4681-a60e-38d68e12920f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:30.312505 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ebec2df5-6fbd-4681-a60e-38d68e12920f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.152807 Oct 29 02:00:30.313080 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3938/7661] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:30 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:31.336757 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-01154bf9-0544-4d72-a0d0-7cd4ff610430 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:31.337427 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-01154bf9-0544-4d72-a0d0-7cd4ff610430 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:31.344434 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01154bf9-0544-4d72-a0d0-7cd4ff610430 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:31.344934 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01154bf9-0544-4d72-a0d0-7cd4ff610430 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:31.345407 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01154bf9-0544-4d72-a0d0-7cd4ff610430 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:31.346111 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01154bf9-0544-4d72-a0d0-7cd4ff610430 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:31.346587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01154bf9-0544-4d72-a0d0-7cd4ff610430 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:31.347030 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-01154bf9-0544-4d72-a0d0-7cd4ff610430 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:31.477403 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-01154bf9-0544-4d72-a0d0-7cd4ff610430 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:31.486120 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-01154bf9-0544-4d72-a0d0-7cd4ff610430 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.153539 Oct 29 02:00:31.486699 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3724/7662] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:31 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:32.512210 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1e04e1b0-05aa-4e88-a906-33cbe80c5dc1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:32.512872 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1e04e1b0-05aa-4e88-a906-33cbe80c5dc1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:32.520784 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e04e1b0-05aa-4e88-a906-33cbe80c5dc1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:32.521509 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e04e1b0-05aa-4e88-a906-33cbe80c5dc1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:32.521960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e04e1b0-05aa-4e88-a906-33cbe80c5dc1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:32.522671 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e04e1b0-05aa-4e88-a906-33cbe80c5dc1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:32.523142 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e04e1b0-05aa-4e88-a906-33cbe80c5dc1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:32.523579 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1e04e1b0-05aa-4e88-a906-33cbe80c5dc1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:32.659536 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-1e04e1b0-05aa-4e88-a906-33cbe80c5dc1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:32.667369 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1e04e1b0-05aa-4e88-a906-33cbe80c5dc1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.159403 Oct 29 02:00:32.667968 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3939/7663] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:32 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:33.691840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-86a42571-cfca-418c-80c7-b20b9e00f860 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:33.693364 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-86a42571-cfca-418c-80c7-b20b9e00f860 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:33.699942 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86a42571-cfca-418c-80c7-b20b9e00f860 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:33.700739 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86a42571-cfca-418c-80c7-b20b9e00f860 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:33.701393 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86a42571-cfca-418c-80c7-b20b9e00f860 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:33.702401 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86a42571-cfca-418c-80c7-b20b9e00f860 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:33.703172 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86a42571-cfca-418c-80c7-b20b9e00f860 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:33.704269 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-86a42571-cfca-418c-80c7-b20b9e00f860 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:33.848571 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-86a42571-cfca-418c-80c7-b20b9e00f860 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:33.856394 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-86a42571-cfca-418c-80c7-b20b9e00f860 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.169788 Oct 29 02:00:33.869687 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3725/7664] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:33 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:34.880420 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-ff481a3c-03ea-4522-b7bb-44325e7ab643 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:34.881056 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-ff481a3c-03ea-4522-b7bb-44325e7ab643 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:34.887960 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff481a3c-03ea-4522-b7bb-44325e7ab643 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:34.888440 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff481a3c-03ea-4522-b7bb-44325e7ab643 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:34.888877 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff481a3c-03ea-4522-b7bb-44325e7ab643 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:34.889590 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff481a3c-03ea-4522-b7bb-44325e7ab643 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:34.890046 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff481a3c-03ea-4522-b7bb-44325e7ab643 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:34.890497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-ff481a3c-03ea-4522-b7bb-44325e7ab643 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:35.027741 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-ff481a3c-03ea-4522-b7bb-44325e7ab643 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:35.036099 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-ff481a3c-03ea-4522-b7bb-44325e7ab643 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.160190 Oct 29 02:00:35.037877 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3940/7665] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:34 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:36.061064 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-8989c907-cb32-44ca-a344-f5168001d8d1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:36.062264 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-8989c907-cb32-44ca-a344-f5168001d8d1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:36.072629 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8989c907-cb32-44ca-a344-f5168001d8d1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:36.073142 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8989c907-cb32-44ca-a344-f5168001d8d1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:36.073603 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8989c907-cb32-44ca-a344-f5168001d8d1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:36.074318 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8989c907-cb32-44ca-a344-f5168001d8d1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:36.075359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8989c907-cb32-44ca-a344-f5168001d8d1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:36.075359 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-8989c907-cb32-44ca-a344-f5168001d8d1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:36.216935 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-8989c907-cb32-44ca-a344-f5168001d8d1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:36.225674 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-8989c907-cb32-44ca-a344-f5168001d8d1 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.170149 Oct 29 02:00:36.226266 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3726/7666] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:36 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:37.255642 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-530a0988-6899-482c-afce-4ddc43371048 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:37.256443 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-530a0988-6899-482c-afce-4ddc43371048 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:37.264045 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-530a0988-6899-482c-afce-4ddc43371048 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:37.264528 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-530a0988-6899-482c-afce-4ddc43371048 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:37.264965 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-530a0988-6899-482c-afce-4ddc43371048 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:37.265813 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-530a0988-6899-482c-afce-4ddc43371048 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:37.266298 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-530a0988-6899-482c-afce-4ddc43371048 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:37.266862 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-530a0988-6899-482c-afce-4ddc43371048 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:37.403742 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-530a0988-6899-482c-afce-4ddc43371048 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:37.412331 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-530a0988-6899-482c-afce-4ddc43371048 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.160727 Oct 29 02:00:37.412900 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3941/7667] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:37 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:38.436048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-bf661a7c-46e8-4f47-9324-a34c0169791b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:38.436671 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-bf661a7c-46e8-4f47-9324-a34c0169791b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:38.443949 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf661a7c-46e8-4f47-9324-a34c0169791b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:38.444447 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf661a7c-46e8-4f47-9324-a34c0169791b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:38.444899 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf661a7c-46e8-4f47-9324-a34c0169791b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:38.445633 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf661a7c-46e8-4f47-9324-a34c0169791b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:38.446105 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf661a7c-46e8-4f47-9324-a34c0169791b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:38.446545 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-bf661a7c-46e8-4f47-9324-a34c0169791b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:38.449214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=83 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:00:38.578341 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-bf661a7c-46e8-4f47-9324-a34c0169791b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:38.586454 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-bf661a7c-46e8-4f47-9324-a34c0169791b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.154537 Oct 29 02:00:38.587036 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3727/7668] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:38 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:39.610857 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-11b14a4f-cae4-48ed-bc69-da7899a9f37b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:39.611518 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-11b14a4f-cae4-48ed-bc69-da7899a9f37b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:39.618375 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11b14a4f-cae4-48ed-bc69-da7899a9f37b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:39.618888 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11b14a4f-cae4-48ed-bc69-da7899a9f37b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:39.619322 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11b14a4f-cae4-48ed-bc69-da7899a9f37b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:39.620012 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11b14a4f-cae4-48ed-bc69-da7899a9f37b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:39.620468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11b14a4f-cae4-48ed-bc69-da7899a9f37b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:39.620893 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-11b14a4f-cae4-48ed-bc69-da7899a9f37b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:39.751103 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-11b14a4f-cae4-48ed-bc69-da7899a9f37b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:39.758875 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-11b14a4f-cae4-48ed-bc69-da7899a9f37b tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.152767 Oct 29 02:00:39.759449 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3942/7669] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:39 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:40.783962 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-9f939d41-830d-410f-bc20-f1c59d2b5593 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:40.784504 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-9f939d41-830d-410f-bc20-f1c59d2b5593 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:40.791363 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f939d41-830d-410f-bc20-f1c59d2b5593 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:40.791859 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f939d41-830d-410f-bc20-f1c59d2b5593 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:40.792307 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f939d41-830d-410f-bc20-f1c59d2b5593 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:40.793004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f939d41-830d-410f-bc20-f1c59d2b5593 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:40.793505 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f939d41-830d-410f-bc20-f1c59d2b5593 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:40.793940 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-9f939d41-830d-410f-bc20-f1c59d2b5593 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:40.928999 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-9f939d41-830d-410f-bc20-f1c59d2b5593 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:40.936789 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-9f939d41-830d-410f-bc20-f1c59d2b5593 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.157394 Oct 29 02:00:40.937431 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3728/7670] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:40 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:41.960837 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-e93b0c34-74e8-4d2f-b3c9-7513562fa5fe tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:41.961475 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-e93b0c34-74e8-4d2f-b3c9-7513562fa5fe tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:41.968403 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e93b0c34-74e8-4d2f-b3c9-7513562fa5fe tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:41.969525 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e93b0c34-74e8-4d2f-b3c9-7513562fa5fe tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:41.970169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e93b0c34-74e8-4d2f-b3c9-7513562fa5fe tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:41.970869 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e93b0c34-74e8-4d2f-b3c9-7513562fa5fe tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:41.971329 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e93b0c34-74e8-4d2f-b3c9-7513562fa5fe tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:41.971758 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-e93b0c34-74e8-4d2f-b3c9-7513562fa5fe tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:41.974390 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:00:42.104162 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-e93b0c34-74e8-4d2f-b3c9-7513562fa5fe tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:42.112697 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-e93b0c34-74e8-4d2f-b3c9-7513562fa5fe tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.156106 Oct 29 02:00:42.113315 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3943/7671] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:41 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:43.136243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-f825a27a-beaf-446b-8bd5-a077db104ea4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:43.136868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-f825a27a-beaf-446b-8bd5-a077db104ea4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:43.139991 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=30 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:00:43.145720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f825a27a-beaf-446b-8bd5-a077db104ea4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:43.146214 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f825a27a-beaf-446b-8bd5-a077db104ea4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:43.146659 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f825a27a-beaf-446b-8bd5-a077db104ea4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:43.147358 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f825a27a-beaf-446b-8bd5-a077db104ea4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:43.147825 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f825a27a-beaf-446b-8bd5-a077db104ea4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:43.148263 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-f825a27a-beaf-446b-8bd5-a077db104ea4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:43.282916 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-f825a27a-beaf-446b-8bd5-a077db104ea4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:43.290642 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-f825a27a-beaf-446b-8bd5-a077db104ea4 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.158369 Oct 29 02:00:43.291211 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3729/7672] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:43 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:44.313841 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-5aaefe7f-9fa6-423c-b51b-74994de5e4b2 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:44.314507 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-5aaefe7f-9fa6-423c-b51b-74994de5e4b2 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:44.317308 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=34 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:00:44.322144 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5aaefe7f-9fa6-423c-b51b-74994de5e4b2 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:44.322636 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5aaefe7f-9fa6-423c-b51b-74994de5e4b2 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:44.323080 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5aaefe7f-9fa6-423c-b51b-74994de5e4b2 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:44.323811 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5aaefe7f-9fa6-423c-b51b-74994de5e4b2 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:44.324274 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5aaefe7f-9fa6-423c-b51b-74994de5e4b2 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:44.324704 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-5aaefe7f-9fa6-423c-b51b-74994de5e4b2 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:44.455155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-5aaefe7f-9fa6-423c-b51b-74994de5e4b2 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:44.463440 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-5aaefe7f-9fa6-423c-b51b-74994de5e4b2 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.154120 Oct 29 02:00:44.464026 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3944/7673] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:44 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:45.487236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-377d65c4-d0e3-4334-b8e9-4c2f2511ac8f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:45.487906 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-377d65c4-d0e3-4334-b8e9-4c2f2511ac8f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:45.494868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-377d65c4-d0e3-4334-b8e9-4c2f2511ac8f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:45.495368 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-377d65c4-d0e3-4334-b8e9-4c2f2511ac8f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:45.495822 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-377d65c4-d0e3-4334-b8e9-4c2f2511ac8f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:45.496536 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-377d65c4-d0e3-4334-b8e9-4c2f2511ac8f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:45.497010 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-377d65c4-d0e3-4334-b8e9-4c2f2511ac8f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:45.497482 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-377d65c4-d0e3-4334-b8e9-4c2f2511ac8f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:45.627660 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-377d65c4-d0e3-4334-b8e9-4c2f2511ac8f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:45.635487 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-377d65c4-d0e3-4334-b8e9-4c2f2511ac8f tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.152777 Oct 29 02:00:45.636053 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3730/7674] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:45 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:46.659657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-43d97273-03d4-466f-9b22-cda1a5d1315d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:46.660271 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-43d97273-03d4-466f-9b22-cda1a5d1315d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:46.667209 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43d97273-03d4-466f-9b22-cda1a5d1315d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:46.667672 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43d97273-03d4-466f-9b22-cda1a5d1315d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:46.668110 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43d97273-03d4-466f-9b22-cda1a5d1315d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:46.668805 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43d97273-03d4-466f-9b22-cda1a5d1315d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:46.669300 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43d97273-03d4-466f-9b22-cda1a5d1315d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:46.669729 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-43d97273-03d4-466f-9b22-cda1a5d1315d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:46.805240 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-43d97273-03d4-466f-9b22-cda1a5d1315d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:46.813245 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-43d97273-03d4-466f-9b22-cda1a5d1315d tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.157596 Oct 29 02:00:46.813838 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3945/7675] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:46 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:47.836881 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-6d68d2ae-c15d-4906-b7cd-77f5123069e8 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:47.837455 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-6d68d2ae-c15d-4906-b7cd-77f5123069e8 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:47.844402 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d68d2ae-c15d-4906-b7cd-77f5123069e8 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:47.844894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d68d2ae-c15d-4906-b7cd-77f5123069e8 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:47.845382 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d68d2ae-c15d-4906-b7cd-77f5123069e8 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:47.846080 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d68d2ae-c15d-4906-b7cd-77f5123069e8 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:47.846546 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d68d2ae-c15d-4906-b7cd-77f5123069e8 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:47.847004 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-6d68d2ae-c15d-4906-b7cd-77f5123069e8 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:47.977805 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-6d68d2ae-c15d-4906-b7cd-77f5123069e8 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:47.986052 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-6d68d2ae-c15d-4906-b7cd-77f5123069e8 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.153422 Oct 29 02:00:47.986625 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3731/7676] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:47 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:49.009690 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-df82568a-f01c-4688-9090-e5eb78822781 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:49.010323 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-df82568a-f01c-4688-9090-e5eb78822781 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:49.017867 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df82568a-f01c-4688-9090-e5eb78822781 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:49.018344 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df82568a-f01c-4688-9090-e5eb78822781 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:49.018781 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df82568a-f01c-4688-9090-e5eb78822781 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:49.019482 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df82568a-f01c-4688-9090-e5eb78822781 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:49.019940 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df82568a-f01c-4688-9090-e5eb78822781 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:49.020367 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-df82568a-f01c-4688-9090-e5eb78822781 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:49.162013 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-df82568a-f01c-4688-9090-e5eb78822781 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:49.169960 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-df82568a-f01c-4688-9090-e5eb78822781 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.164195 Oct 29 02:00:49.170550 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3946/7677] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:49 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:50.194718 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-d9427524-5fe7-48b9-9417-de5b1095b5d3 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:50.195355 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-d9427524-5fe7-48b9-9417-de5b1095b5d3 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:50.202160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9427524-5fe7-48b9-9417-de5b1095b5d3 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:50.202652 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9427524-5fe7-48b9-9417-de5b1095b5d3 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:50.203099 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9427524-5fe7-48b9-9417-de5b1095b5d3 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:50.204251 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9427524-5fe7-48b9-9417-de5b1095b5d3 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:50.204721 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9427524-5fe7-48b9-9417-de5b1095b5d3 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:50.205182 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-d9427524-5fe7-48b9-9417-de5b1095b5d3 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:50.334236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-d9427524-5fe7-48b9-9417-de5b1095b5d3 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:50.342393 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-d9427524-5fe7-48b9-9417-de5b1095b5d3 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.151614 Oct 29 02:00:50.342970 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3732/7678] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:50 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:51.365873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-81c66b8e-46f5-48a5-8e3e-7f3764c80472 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:51.366497 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-81c66b8e-46f5-48a5-8e3e-7f3764c80472 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:51.373349 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81c66b8e-46f5-48a5-8e3e-7f3764c80472 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:51.373835 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81c66b8e-46f5-48a5-8e3e-7f3764c80472 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:51.374285 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81c66b8e-46f5-48a5-8e3e-7f3764c80472 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:51.375498 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81c66b8e-46f5-48a5-8e3e-7f3764c80472 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:51.376122 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81c66b8e-46f5-48a5-8e3e-7f3764c80472 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:51.376810 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-81c66b8e-46f5-48a5-8e3e-7f3764c80472 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:51.512028 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-81c66b8e-46f5-48a5-8e3e-7f3764c80472 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:51.520799 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-81c66b8e-46f5-48a5-8e3e-7f3764c80472 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.158854 Oct 29 02:00:51.521406 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3947/7679] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:51 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:52.544189 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-97e35532-ad39-4226-8081-8e85a671d0a5 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:52.544818 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-97e35532-ad39-4226-8081-8e85a671d0a5 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:52.551837 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97e35532-ad39-4226-8081-8e85a671d0a5 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:52.552340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97e35532-ad39-4226-8081-8e85a671d0a5 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:52.554783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97e35532-ad39-4226-8081-8e85a671d0a5 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:52.554783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97e35532-ad39-4226-8081-8e85a671d0a5 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:52.554783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97e35532-ad39-4226-8081-8e85a671d0a5 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:52.554783 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-97e35532-ad39-4226-8081-8e85a671d0a5 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:52.699313 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-97e35532-ad39-4226-8081-8e85a671d0a5 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:52.707643 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-97e35532-ad39-4226-8081-8e85a671d0a5 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1514 microversion: 2.1 time: 0.167470 Oct 29 02:00:52.708231 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3733/7680] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:52 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:53.252180 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-ca67651d-99b7-448c-835d-8f02e4827e1d req-591713c1-a347-4e0e-a549-2e890ceca35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb093b5e-f70f-422f-9168-d2eecb506e69", "name": "network-vif-unplugged", "status": "completed", "tag": "dc3c89dc-8253-4c03-bff9-ba2bef361d7f"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:00:53.263169 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ca67651d-99b7-448c-835d-8f02e4827e1d req-591713c1-a347-4e0e-a549-2e890ceca35e service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:53.263657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ca67651d-99b7-448c-835d-8f02e4827e1d req-591713c1-a347-4e0e-a549-2e890ceca35e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:53.264098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-ca67651d-99b7-448c-835d-8f02e4827e1d req-591713c1-a347-4e0e-a549-2e890ceca35e service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:53.276141 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-ca67651d-99b7-448c-835d-8f02e4827e1d req-591713c1-a347-4e0e-a549-2e890ceca35e service nova] Creating event network-vif-unplugged:dc3c89dc-8253-4c03-bff9-ba2bef361d7f for instance bb093b5e-f70f-422f-9168-d2eecb506e69 on n-h2-862964-3 Oct 29 02:00:53.281540 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [req-ca67651d-99b7-448c-835d-8f02e4827e1d req-591713c1-a347-4e0e-a549-2e890ceca35e service nova] Instance bb093b5e-f70f-422f-9168-d2eecb506e69 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121099) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 02:00:53.293120 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-ca67651d-99b7-448c-835d-8f02e4827e1d req-591713c1-a347-4e0e-a549-2e890ceca35e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046231 Oct 29 02:00:53.293775 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3948/7681] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 02:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:00:53.732228 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-c1b24677-c315-4f8c-8852-5c71910546b0 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:53.733531 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-c1b24677-c315-4f8c-8852-5c71910546b0 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:53.744191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1b24677-c315-4f8c-8852-5c71910546b0 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:53.744191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1b24677-c315-4f8c-8852-5c71910546b0 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:53.744191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1b24677-c315-4f8c-8852-5c71910546b0 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:53.744191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1b24677-c315-4f8c-8852-5c71910546b0 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:53.744191 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1b24677-c315-4f8c-8852-5c71910546b0 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:53.744562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-c1b24677-c315-4f8c-8852-5c71910546b0 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:53.967489 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-c1b24677-c315-4f8c-8852-5c71910546b0 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:53.976049 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-c1b24677-c315-4f8c-8852-5c71910546b0 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1513 microversion: 2.1 time: 0.247901 Oct 29 02:00:53.976621 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3734/7682] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:53 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1513 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:55.002385 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-33215230-3b1a-43a0-b4e5-66ee80395a46 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:55.003087 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-33215230-3b1a-43a0-b4e5-66ee80395a46 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:55.009313 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33215230-3b1a-43a0-b4e5-66ee80395a46 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:55.009797 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33215230-3b1a-43a0-b4e5-66ee80395a46 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:55.010235 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33215230-3b1a-43a0-b4e5-66ee80395a46 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:55.010963 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33215230-3b1a-43a0-b4e5-66ee80395a46 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:55.011417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33215230-3b1a-43a0-b4e5-66ee80395a46 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:55.011839 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-33215230-3b1a-43a0-b4e5-66ee80395a46 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:55.148607 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-33215230-3b1a-43a0-b4e5-66ee80395a46 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:55.157528 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-33215230-3b1a-43a0-b4e5-66ee80395a46 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1511 microversion: 2.1 time: 0.160526 Oct 29 02:00:55.158616 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3949/7683] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:54 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:55.308431 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-7d7b4ad8-2e8a-4d80-b605-945de2b302f0 req-dbb671b6-33be-4861-a788-cc6ddc728825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb093b5e-f70f-422f-9168-d2eecb506e69", "tag": "dc3c89dc-8253-4c03-bff9-ba2bef361d7f"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:00:55.318836 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7d7b4ad8-2e8a-4d80-b605-945de2b302f0 req-dbb671b6-33be-4861-a788-cc6ddc728825 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:55.319340 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7d7b4ad8-2e8a-4d80-b605-945de2b302f0 req-dbb671b6-33be-4861-a788-cc6ddc728825 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:55.319795 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7d7b4ad8-2e8a-4d80-b605-945de2b302f0 req-dbb671b6-33be-4861-a788-cc6ddc728825 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:55.331711 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-7d7b4ad8-2e8a-4d80-b605-945de2b302f0 req-dbb671b6-33be-4861-a788-cc6ddc728825 service nova] Creating event network-changed:dc3c89dc-8253-4c03-bff9-ba2bef361d7f for instance bb093b5e-f70f-422f-9168-d2eecb506e69 on n-h2-862964-3 Oct 29 02:00:55.337291 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [req-7d7b4ad8-2e8a-4d80-b605-945de2b302f0 req-dbb671b6-33be-4861-a788-cc6ddc728825 service nova] Instance bb093b5e-f70f-422f-9168-d2eecb506e69 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121100) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 02:00:55.348670 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-7d7b4ad8-2e8a-4d80-b605-945de2b302f0 req-dbb671b6-33be-4861-a788-cc6ddc728825 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044086 Oct 29 02:00:55.349352 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3735/7684] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 02:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:00:56.182417 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-7825bde8-6ee1-46a7-9847-9dd55982c268 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:56.183041 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-7825bde8-6ee1-46a7-9847-9dd55982c268 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:56.190573 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7825bde8-6ee1-46a7-9847-9dd55982c268 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:56.191059 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7825bde8-6ee1-46a7-9847-9dd55982c268 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:56.191496 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7825bde8-6ee1-46a7-9847-9dd55982c268 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:56.192188 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7825bde8-6ee1-46a7-9847-9dd55982c268 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:56.192643 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7825bde8-6ee1-46a7-9847-9dd55982c268 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:56.193068 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-7825bde8-6ee1-46a7-9847-9dd55982c268 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:56.328357 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-7825bde8-6ee1-46a7-9847-9dd55982c268 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:56.336853 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-7825bde8-6ee1-46a7-9847-9dd55982c268 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1511 microversion: 2.1 time: 0.158428 Oct 29 02:00:56.337464 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3950/7685] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:56 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:57.363840 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-99cebd10-4be1-48b8-83cf-069c69b09fa7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:57.364936 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-99cebd10-4be1-48b8-83cf-069c69b09fa7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:57.372388 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99cebd10-4be1-48b8-83cf-069c69b09fa7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:57.372894 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99cebd10-4be1-48b8-83cf-069c69b09fa7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:57.373378 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99cebd10-4be1-48b8-83cf-069c69b09fa7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:57.374093 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99cebd10-4be1-48b8-83cf-069c69b09fa7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:57.374562 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99cebd10-4be1-48b8-83cf-069c69b09fa7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:57.375195 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-99cebd10-4be1-48b8-83cf-069c69b09fa7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:57.551689 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-99cebd10-4be1-48b8-83cf-069c69b09fa7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:57.559482 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-99cebd10-4be1-48b8-83cf-069c69b09fa7 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1511 microversion: 2.1 time: 0.202843 Oct 29 02:00:57.561308 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3736/7686] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:57 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:58.583601 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-83708da5-4b50-4ed7-b2e2-36b0e485f491 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:58.584231 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-83708da5-4b50-4ed7-b2e2-36b0e485f491 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:58.591439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83708da5-4b50-4ed7-b2e2-36b0e485f491 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:58.591925 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83708da5-4b50-4ed7-b2e2-36b0e485f491 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:58.592400 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83708da5-4b50-4ed7-b2e2-36b0e485f491 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:58.593098 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83708da5-4b50-4ed7-b2e2-36b0e485f491 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:58.593586 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83708da5-4b50-4ed7-b2e2-36b0e485f491 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:58.594020 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-83708da5-4b50-4ed7-b2e2-36b0e485f491 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:58.729664 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-83708da5-4b50-4ed7-b2e2-36b0e485f491 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:00:58.737797 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-83708da5-4b50-4ed7-b2e2-36b0e485f491 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1508 microversion: 2.1 time: 0.158837 Oct 29 02:00:58.738380 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3951/7687] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:00:58 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:00:58.761224 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3c8e3b20-47df-4026-be69-df93eeec3f12 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:00:58.761720 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3c8e3b20-47df-4026-be69-df93eeec3f12 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:00:58.769342 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c8e3b20-47df-4026-be69-df93eeec3f12 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:58.769841 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c8e3b20-47df-4026-be69-df93eeec3f12 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:58.770296 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c8e3b20-47df-4026-be69-df93eeec3f12 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:58.771007 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c8e3b20-47df-4026-be69-df93eeec3f12 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:58.771480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c8e3b20-47df-4026-be69-df93eeec3f12 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:58.771921 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3c8e3b20-47df-4026-be69-df93eeec3f12 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:58.797641 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3c8e3b20-47df-4026-be69-df93eeec3f12 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Going to try to terminate instance {{(pid=121100) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:00:58.909435 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.compute.api [None req-3c8e3b20-47df-4026-be69-df93eeec3f12 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Found an unconfirmed migration during delete, id: 16, status: finished Oct 29 02:00:59.771439 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-028ac6c2-87da-40e5-aba8-3e656089259c req-fe9ad332-779e-4bae-ba19-355a0ed726d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb093b5e-f70f-422f-9168-d2eecb506e69", "name": "network-vif-plugged", "status": "completed", "tag": "dc3c89dc-8253-4c03-bff9-ba2bef361d7f"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:00:59.783836 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-028ac6c2-87da-40e5-aba8-3e656089259c req-fe9ad332-779e-4bae-ba19-355a0ed726d3 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:00:59.784261 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-028ac6c2-87da-40e5-aba8-3e656089259c req-fe9ad332-779e-4bae-ba19-355a0ed726d3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:00:59.784703 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-028ac6c2-87da-40e5-aba8-3e656089259c req-fe9ad332-779e-4bae-ba19-355a0ed726d3 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:00:59.797073 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-028ac6c2-87da-40e5-aba8-3e656089259c req-fe9ad332-779e-4bae-ba19-355a0ed726d3 service nova] Creating event network-vif-plugged:dc3c89dc-8253-4c03-bff9-ba2bef361d7f for instance bb093b5e-f70f-422f-9168-d2eecb506e69 on n-h2-862964-3 Oct 29 02:00:59.802761 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [req-028ac6c2-87da-40e5-aba8-3e656089259c req-fe9ad332-779e-4bae-ba19-355a0ed726d3 service nova] Instance bb093b5e-f70f-422f-9168-d2eecb506e69 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-3', 'n-h2-862964-3'} {{(pid=121099) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 02:00:59.814208 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-028ac6c2-87da-40e5-aba8-3e656089259c req-fe9ad332-779e-4bae-ba19-355a0ed726d3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046548 Oct 29 02:00:59.814819 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3952/7688] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 02:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:01:01.392470 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3c8e3b20-47df-4026-be69-df93eeec3f12 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 204 len: 0 microversion: 2.1 time: 2.634944 Oct 29 02:01:01.393077 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3737/7689] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 02:00:58 2022] DELETE /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 0 bytes in 2636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:01:01.402763 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-bb9f3cfd-ddce-4aa3-82ab-5cad61c0f128 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:01:01.403468 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-bb9f3cfd-ddce-4aa3-82ab-5cad61c0f128 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:01:01.410353 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb9f3cfd-ddce-4aa3-82ab-5cad61c0f128 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:01:01.410847 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb9f3cfd-ddce-4aa3-82ab-5cad61c0f128 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:01:01.411290 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb9f3cfd-ddce-4aa3-82ab-5cad61c0f128 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:01:01.411985 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb9f3cfd-ddce-4aa3-82ab-5cad61c0f128 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:01:01.412544 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb9f3cfd-ddce-4aa3-82ab-5cad61c0f128 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:01:01.412982 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-bb9f3cfd-ddce-4aa3-82ab-5cad61c0f128 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:01:01.801632 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-bb9f3cfd-ddce-4aa3-82ab-5cad61c0f128 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:01:01.809759 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-bb9f3cfd-ddce-4aa3-82ab-5cad61c0f128 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1500 microversion: 2.1 time: 0.412143 Oct 29 02:01:01.810344 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3953/7690] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:01:01 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1500 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:01:02.834619 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-a54a2822-50cd-4e63-b5f0-c3d57417d236 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:01:02.835669 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-a54a2822-50cd-4e63-b5f0-c3d57417d236 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:01:02.844254 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a54a2822-50cd-4e63-b5f0-c3d57417d236 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:01:02.845496 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a54a2822-50cd-4e63-b5f0-c3d57417d236 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:01:02.845866 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a54a2822-50cd-4e63-b5f0-c3d57417d236 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:01:02.846583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a54a2822-50cd-4e63-b5f0-c3d57417d236 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:01:02.847054 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a54a2822-50cd-4e63-b5f0-c3d57417d236 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:01:02.847497 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-a54a2822-50cd-4e63-b5f0-c3d57417d236 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:01:03.090061 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-a54a2822-50cd-4e63-b5f0-c3d57417d236 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:01:03.097272 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-a54a2822-50cd-4e63-b5f0-c3d57417d236 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1500 microversion: 2.1 time: 0.266990 Oct 29 02:01:03.109178 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3738/7691] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:01:02 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1500 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:01:03.536155 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-aaa3419a-f11a-4b85-84eb-c528062ce419 req-688df34f-6d6b-4077-aeb1-a0f81fb7df37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb093b5e-f70f-422f-9168-d2eecb506e69", "name": "network-vif-deleted", "tag": "dc3c89dc-8253-4c03-bff9-ba2bef361d7f"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:01:03.548104 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-aaa3419a-f11a-4b85-84eb-c528062ce419 req-688df34f-6d6b-4077-aeb1-a0f81fb7df37 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:01:03.549695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-aaa3419a-f11a-4b85-84eb-c528062ce419 req-688df34f-6d6b-4077-aeb1-a0f81fb7df37 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:01:03.549695 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-aaa3419a-f11a-4b85-84eb-c528062ce419 req-688df34f-6d6b-4077-aeb1-a0f81fb7df37 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:01:03.562203 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-aaa3419a-f11a-4b85-84eb-c528062ce419 req-688df34f-6d6b-4077-aeb1-a0f81fb7df37 service nova] Creating event network-vif-deleted:dc3c89dc-8253-4c03-bff9-ba2bef361d7f for instance bb093b5e-f70f-422f-9168-d2eecb506e69 on n-h2-862964-3 Oct 29 02:01:03.568417 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-aaa3419a-f11a-4b85-84eb-c528062ce419 req-688df34f-6d6b-4077-aeb1-a0f81fb7df37 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044062 Oct 29 02:01:03.569488 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3954/7692] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 02:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:01:04.122088 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-3221d28c-f26c-4fed-bf29-f751154b6213 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:01:04.122713 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-3221d28c-f26c-4fed-bf29-f751154b6213 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:01:04.130498 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3221d28c-f26c-4fed-bf29-f751154b6213 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:01:04.131001 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3221d28c-f26c-4fed-bf29-f751154b6213 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:01:04.131451 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3221d28c-f26c-4fed-bf29-f751154b6213 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:01:04.132151 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3221d28c-f26c-4fed-bf29-f751154b6213 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:01:04.132616 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3221d28c-f26c-4fed-bf29-f751154b6213 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:01:04.133048 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3221d28c-f26c-4fed-bf29-f751154b6213 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:01:04.165209 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3221d28c-f26c-4fed-bf29-f751154b6213 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:01:04.165709 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3221d28c-f26c-4fed-bf29-f751154b6213 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:01:04.166160 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-3221d28c-f26c-4fed-bf29-f751154b6213 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:01:04.166621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.objects.instance [None req-3221d28c-f26c-4fed-bf29-f751154b6213 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lazy-loading 'fault' on Instance uuid bb093b5e-f70f-422f-9168-d2eecb506e69 {{(pid=121100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:01:04.209583 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.policy [None req-3221d28c-f26c-4fed-bf29-f751154b6213 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4cf007089b4ab68ae3ca9bb985cf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e781141e149e89d1fcf2c582951bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121100) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:01:04.219089 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-3221d28c-f26c-4fed-bf29-f751154b6213 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 200 len: 1469 microversion: 2.1 time: 0.099344 Oct 29 02:01:04.219089 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3739/7693] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:01:04 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 1469 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:01:05.242301 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1d693f93-adf2-4077-b6d7-fdaabc178e35 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:01:05.242996 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-1d693f93-adf2-4077-b6d7-fdaabc178e35 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:01:05.249203 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d693f93-adf2-4077-b6d7-fdaabc178e35 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:01:05.249684 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d693f93-adf2-4077-b6d7-fdaabc178e35 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:01:05.250114 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d693f93-adf2-4077-b6d7-fdaabc178e35 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:01:05.250861 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d693f93-adf2-4077-b6d7-fdaabc178e35 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:01:05.251907 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d693f93-adf2-4077-b6d7-fdaabc178e35 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:01:05.252327 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-1d693f93-adf2-4077-b6d7-fdaabc178e35 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:01:05.265652 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-1d693f93-adf2-4077-b6d7-fdaabc178e35 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] HTTP exception thrown: Instance bb093b5e-f70f-422f-9168-d2eecb506e69 could not be found. Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1d693f93-adf2-4077-b6d7-fdaabc178e35 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Request method failure captured: Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 HTTP/1.1 Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIknzDMKDs115tQqAlMkJAkIcGpOQX5c-a-a9M6CyKB6AdtX9OCItbKQJh9uWzaiRLN_Y1lp68l9jQKu7U1amyEvJe9HOMFVOIxejqlGAO3yXOCRMzDW4vJKuy4SiNr-NEsTSvt0UfyB_duUkczrErcid3Y0NF7so095rPirLg_uETI Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 340e781141e149e89d1fcf2c582951bf Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersTestJSON-772852098 Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/340e781141e149e89d1fcf2c582951bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/340e781141e149e89d1fcf2c582951bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/340e781141e149e89d1fcf2c582951bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_340e781141e149e89d1fcf2c582951bf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersTestJSON-772852098 Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 340e781141e149e89d1fcf2c582951bf Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersTestJSON-772852098 Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersTestJSON-772852098-project Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8a4cf007089b4ab68ae3ca9bb985cf79 Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersTestJSON-772852098-project Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance bb093b5e-f70f-422f-9168-d2eecb506e69 could not be found. Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'bb093b5e-f70f-422f-9168-d2eecb506e69'} Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb093b5e-f70f-422f-9168-d2eecb506e69 could not be found. Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb093b5e-f70f-422f-9168-d2eecb506e69 could not be found. Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:01:05.267568 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 02:01:05.272026 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:01:05.272026 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:01:05.272026 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:01:05.272026 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:01:05.272026 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:01:05.272026 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb093b5e-f70f-422f-9168-d2eecb506e69 could not be found. Oct 29 02:01:05.272026 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 02:01:05.272026 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-1d693f93-adf2-4077-b6d7-fdaabc178e35 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Returning 404 to user: Instance bb093b5e-f70f-422f-9168-d2eecb506e69 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:01:05.272026 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-1d693f93-adf2-4077-b6d7-fdaabc178e35 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 404 len: 111 microversion: 2.1 time: 0.031932 Oct 29 02:01:05.272026 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3955/7694] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:01:05 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:01:05.285243 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-951274a1-1dec-45eb-a9cc-993afa62afeb tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:01:05.285747 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-951274a1-1dec-45eb-a9cc-993afa62afeb tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121100) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:01:05.292540 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-951274a1-1dec-45eb-a9cc-993afa62afeb tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:01:05.293038 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-951274a1-1dec-45eb-a9cc-993afa62afeb tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:01:05.293526 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-951274a1-1dec-45eb-a9cc-993afa62afeb tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:01:05.294236 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-951274a1-1dec-45eb-a9cc-993afa62afeb tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:01:05.294710 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-951274a1-1dec-45eb-a9cc-993afa62afeb tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:01:05.295158 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-951274a1-1dec-45eb-a9cc-993afa62afeb tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:01:05.308833 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.wsgi [None req-951274a1-1dec-45eb-a9cc-993afa62afeb tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] HTTP exception thrown: Instance bb093b5e-f70f-422f-9168-d2eecb506e69 could not be found. Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-951274a1-1dec-45eb-a9cc-993afa62afeb tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Request method failure captured: Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: request: DELETE /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 HTTP/1.1 Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: Accept: application/json Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: Accept-Encoding: identity Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: Connection: close Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: Content-Length: 0 Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: Content-Type: application/json Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: Host: 10.222.0.26 Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: Openstack-System-Scope: None Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: User-Agent: python-urllib3/1.26.12 Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-Auth-Token: gAAAAABjXIknzDMKDs115tQqAlMkJAkIcGpOQX5c-a-a9M6CyKB6AdtX9OCItbKQJh9uWzaiRLN_Y1lp68l9jQKu7U1amyEvJe9HOMFVOIxejqlGAO3yXOCRMzDW4vJKuy4SiNr-NEsTSvt0UfyB_duUkczrErcid3Y0NF7so095rPirLg_uETI Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Id: None Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-Domain-Name: None Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-Identity-Status: Confirmed Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-Is-Admin-Project: True Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Id: default Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Domain-Name: Default Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Id: 340e781141e149e89d1fcf2c582951bf Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-Project-Name: tempest-DeleteServersTestJSON-772852098 Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-Role: member,reader Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-Roles: member,reader Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/340e781141e149e89d1fcf2c582951bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/340e781141e149e89d1fcf2c582951bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/340e781141e149e89d1fcf2c582951bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_340e781141e149e89d1fcf2c582951bf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant: tempest-DeleteServersTestJSON-772852098 Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Id: 340e781141e149e89d1fcf2c582951bf Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-Tenant-Name: tempest-DeleteServersTestJSON-772852098 Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-User: tempest-DeleteServersTestJSON-772852098-project Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Id: default Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-User-Domain-Name: Default Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-User-Id: 8a4cf007089b4ab68ae3ca9bb985cf79 Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: X-User-Name: tempest-DeleteServersTestJSON-772852098-project Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: method: > Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: exception: Instance bb093b5e-f70f-422f-9168-d2eecb506e69 could not be found. Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: action_args: {'id': 'bb093b5e-f70f-422f-9168-d2eecb506e69'} Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb093b5e-f70f-422f-9168-d2eecb506e69 could not be found. Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:01:05.310534 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:01:05.315868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb093b5e-f70f-422f-9168-d2eecb506e69 could not be found. Oct 29 02:01:05.315868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 02:01:05.315868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:01:05.315868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 02:01:05.315868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:01:05.315868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:01:05.315868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:01:05.315868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:01:05.315868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:01:05.315868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb093b5e-f70f-422f-9168-d2eecb506e69 could not be found. Oct 29 02:01:05.315868 n-d-862964-3 devstack@n-api.service[121100]: ERROR nova.api.openstack.wsgi Oct 29 02:01:05.315868 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-951274a1-1dec-45eb-a9cc-993afa62afeb tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Returning 404 to user: Instance bb093b5e-f70f-422f-9168-d2eecb506e69 could not be found. {{(pid=121100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:01:05.315868 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-951274a1-1dec-45eb-a9cc-993afa62afeb tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 404 len: 111 microversion: 2.1 time: 0.030763 Oct 29 02:01:05.315868 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3740/7695] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 29 02:01:05 2022] DELETE /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:01:05.321860 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-00313a8e-fa6a-4346-aacf-1dd16169c199 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:01:05.322481 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-00313a8e-fa6a-4346-aacf-1dd16169c199 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] [instance: bb093b5e-f70f-422f-9168-d2eecb506e69] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:01:05.328398 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00313a8e-fa6a-4346-aacf-1dd16169c199 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:01:05.328885 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00313a8e-fa6a-4346-aacf-1dd16169c199 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:01:05.329506 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00313a8e-fa6a-4346-aacf-1dd16169c199 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:01:05.330199 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00313a8e-fa6a-4346-aacf-1dd16169c199 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:01:05.330657 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00313a8e-fa6a-4346-aacf-1dd16169c199 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:01:05.331107 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [None req-00313a8e-fa6a-4346-aacf-1dd16169c199 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:01:05.345097 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.wsgi [None req-00313a8e-fa6a-4346-aacf-1dd16169c199 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] HTTP exception thrown: Instance bb093b5e-f70f-422f-9168-d2eecb506e69 could not be found. Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-00313a8e-fa6a-4346-aacf-1dd16169c199 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Request method failure captured: Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: request: GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 HTTP/1.1 Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: Accept: application/json Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: Accept-Encoding: identity Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: Connection: close Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: Content-Length: 0 Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: Content-Type: application/json Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: Host: 10.222.0.26 Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: Openstack-System-Scope: None Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: User-Agent: python-urllib3/1.26.12 Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-Auth-Token: gAAAAABjXIknzDMKDs115tQqAlMkJAkIcGpOQX5c-a-a9M6CyKB6AdtX9OCItbKQJh9uWzaiRLN_Y1lp68l9jQKu7U1amyEvJe9HOMFVOIxejqlGAO3yXOCRMzDW4vJKuy4SiNr-NEsTSvt0UfyB_duUkczrErcid3Y0NF7so095rPirLg_uETI Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Id: None Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-Domain-Name: None Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-Identity-Status: Confirmed Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-Is-Admin-Project: True Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Id: default Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Domain-Name: Default Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Id: 340e781141e149e89d1fcf2c582951bf Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-Project-Name: tempest-DeleteServersTestJSON-772852098 Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-Role: member,reader Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-Roles: member,reader Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/340e781141e149e89d1fcf2c582951bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/340e781141e149e89d1fcf2c582951bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/340e781141e149e89d1fcf2c582951bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_340e781141e149e89d1fcf2c582951bf", "adminURL": "http://10.222.0.26:8080"}]}] Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant: tempest-DeleteServersTestJSON-772852098 Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Id: 340e781141e149e89d1fcf2c582951bf Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-Tenant-Name: tempest-DeleteServersTestJSON-772852098 Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-User: tempest-DeleteServersTestJSON-772852098-project Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Id: default Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-User-Domain-Name: Default Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-User-Id: 8a4cf007089b4ab68ae3ca9bb985cf79 Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: X-User-Name: tempest-DeleteServersTestJSON-772852098-project Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: method: > Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: exception: Instance bb093b5e-f70f-422f-9168-d2eecb506e69 could not be found. Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: action_args: {'id': 'bb093b5e-f70f-422f-9168-d2eecb506e69'} Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb093b5e-f70f-422f-9168-d2eecb506e69 could not be found. Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb093b5e-f70f-422f-9168-d2eecb506e69 could not be found. Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:01:05.346736 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 02:01:05.350873 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:01:05.350873 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:01:05.350873 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:01:05.350873 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:01:05.350873 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:01:05.350873 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb093b5e-f70f-422f-9168-d2eecb506e69 could not be found. Oct 29 02:01:05.350873 n-d-862964-3 devstack@n-api.service[121099]: ERROR nova.api.openstack.wsgi Oct 29 02:01:05.350873 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-00313a8e-fa6a-4346-aacf-1dd16169c199 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] Returning 404 to user: Instance bb093b5e-f70f-422f-9168-d2eecb506e69 could not be found. {{(pid=121099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:01:05.350873 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-00313a8e-fa6a-4346-aacf-1dd16169c199 tempest-DeleteServersTestJSON-772852098 tempest-DeleteServersTestJSON-772852098-project] 10.222.0.26 "GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69" status: 404 len: 111 microversion: 2.1 time: 0.030140 Oct 29 02:01:05.350873 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3956/7696] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:01:05 2022] GET /compute/v2.1/servers/bb093b5e-f70f-422f-9168-d2eecb506e69 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:01:15.932367 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:01:15.933587 n-d-862964-3 devstack@n-api.service[121100]: DEBUG dbcounter [-] [121100] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:01:16.063976 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [None req-53d80519-82f5-4517-b6e9-766d755689aa tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-305412709", "imageRef": "99205ec5-992b-4d3c-9bcd-04eb4b06191a", "flavorRef": "452", "networks": [{"uuid": "ad4070cc-1fb0-4bba-9648-bd7b7b6b550f"}]}} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:01:16.123308 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.network.neutron [None req-53d80519-82f5-4517-b6e9-766d755689aa tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] validate_networks() for [('ad4070cc-1fb0-4bba-9648-bd7b7b6b550f', None, None, None, None, None)] {{(pid=121100) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:01:16.595621 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-53d80519-82f5-4517-b6e9-766d755689aa tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] Flavor limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:01:16.596066 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-53d80519-82f5-4517-b6e9-766d755689aa tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] Image limits 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:01:16.596560 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-53d80519-82f5-4517-b6e9-766d755689aa tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] Flavor pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:01:16.597015 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-53d80519-82f5-4517-b6e9-766d755689aa tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] Image pref 0:0:0 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:01:16.597480 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.virt.hardware [None req-53d80519-82f5-4517-b6e9-766d755689aa tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:01:16.607507 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-53d80519-82f5-4517-b6e9-766d755689aa tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:01:16.608008 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-53d80519-82f5-4517-b6e9-766d755689aa tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:01:16.608502 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-53d80519-82f5-4517-b6e9-766d755689aa tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:01:16.609375 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-53d80519-82f5-4517-b6e9-766d755689aa tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:01:16.612162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-53d80519-82f5-4517-b6e9-766d755689aa tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:01:16.612162 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [None req-53d80519-82f5-4517-b6e9-766d755689aa tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:01:16.629569 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-53d80519-82f5-4517-b6e9-766d755689aa tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] Getting quotas for project 0e390dbeda6f4f5493cb90f988c058aa. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:01:16.635487 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.quota [None req-53d80519-82f5-4517-b6e9-766d755689aa tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] Getting quotas for user 9121662010f74b13bdab898aece9e991 and project 0e390dbeda6f4f5493cb90f988c058aa. Resources: {'instances', 'cores', 'ram'} {{(pid=121100) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:01:16.649485 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-53d80519-82f5-4517-b6e9-766d755689aa tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] Going to run 1 instances... {{(pid=121100) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:01:16.651963 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.compute.api [None req-53d80519-82f5-4517-b6e9-766d755689aa tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] [instance: 0a54df74-d792-42d5-837a-dcb693c57cee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99205ec5-992b-4d3c-9bcd-04eb4b06191a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:01:16.761140 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [None req-53d80519-82f5-4517-b6e9-766d755689aa tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.834264 Oct 29 02:01:16.762140 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3741/7697] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 29 02:01:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:01:16.774705 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [None req-2afe104e-9545-4fee-8f5d-e654ae4fa433 tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] Calling method '>' {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:01:16.775402 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.compute.api [None req-2afe104e-9545-4fee-8f5d-e654ae4fa433 tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] [instance: 0a54df74-d792-42d5-837a-dcb693c57cee] Fetching instance by UUID {{(pid=121099) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:01:16.781181 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=25 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:01:16.782673 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell1:SELECT=67 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:01:16.843348 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.policy [None req-2afe104e-9545-4fee-8f5d-e654ae4fa433 tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121662010f74b13bdab898aece9e991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e390dbeda6f4f5493cb90f988c058aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121099) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:01:16.855165 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [None req-2afe104e-9545-4fee-8f5d-e654ae4fa433 tempest-ServerDiskConfigTestJSON-149026055 tempest-ServerDiskConfigTestJSON-149026055-project] 10.222.0.26 "GET /compute/v2.1/servers/0a54df74-d792-42d5-837a-dcb693c57cee" status: 200 len: 1217 microversion: 2.1 time: 0.082981 Oct 29 02:01:16.855165 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3957/7698] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 29 02:01:16 2022] GET /compute/v2.1/servers/0a54df74-d792-42d5-837a-dcb693c57cee => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:01:21.239484 n-d-862964-3 devstack@n-api.service[121100]: DEBUG nova.api.openstack.wsgi [req-7b4f5d48-58d8-49db-8b20-19c803d90cd9 req-cf9776f6-df15-4cf3-81e0-fb93f24805a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a54df74-d792-42d5-837a-dcb693c57cee", "tag": "5d27197f-9919-4f14-ad65-6a7a8ff2967b"}]} {{(pid=121100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:01:21.252886 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7b4f5d48-58d8-49db-8b20-19c803d90cd9 req-cf9776f6-df15-4cf3-81e0-fb93f24805a8 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:01:21.253411 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7b4f5d48-58d8-49db-8b20-19c803d90cd9 req-cf9776f6-df15-4cf3-81e0-fb93f24805a8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:01:21.253858 n-d-862964-3 devstack@n-api.service[121100]: DEBUG oslo_concurrency.lockutils [req-7b4f5d48-58d8-49db-8b20-19c803d90cd9 req-cf9776f6-df15-4cf3-81e0-fb93f24805a8 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:01:21.266965 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.compute.server_external_events [req-7b4f5d48-58d8-49db-8b20-19c803d90cd9 req-cf9776f6-df15-4cf3-81e0-fb93f24805a8 service nova] Creating event network-changed:5d27197f-9919-4f14-ad65-6a7a8ff2967b for instance 0a54df74-d792-42d5-837a-dcb693c57cee on n-h2-862964-3 Oct 29 02:01:21.272979 n-d-862964-3 devstack@n-api.service[121100]: INFO nova.api.openstack.requestlog [req-7b4f5d48-58d8-49db-8b20-19c803d90cd9 req-cf9776f6-df15-4cf3-81e0-fb93f24805a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038649 Oct 29 02:01:21.274006 n-d-862964-3 devstack@n-api.service[121100]: [pid: 121100|app: 0|req: 3742/7699] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 02:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:01:27.851493 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_api:SELECT=4 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:01:27.852570 n-d-862964-3 devstack@n-api.service[121099]: DEBUG dbcounter [-] [121099] Writing DB stats nova_cell0:SELECT=2 {{(pid=121099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:01:27.915568 n-d-862964-3 devstack@n-api.service[121099]: DEBUG nova.api.openstack.wsgi [req-d7e2bf3e-b72a-4504-93ca-966ce4be9532 req-dadb1abc-4721-48c0-9b6f-16fcb14400b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a54df74-d792-42d5-837a-dcb693c57cee", "name": "network-vif-plugged", "status": "completed", "tag": "5d27197f-9919-4f14-ad65-6a7a8ff2967b"}]} {{(pid=121099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:01:27.926422 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d7e2bf3e-b72a-4504-93ca-966ce4be9532 req-dadb1abc-4721-48c0-9b6f-16fcb14400b5 service nova] Acquiring lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:01:27.926840 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d7e2bf3e-b72a-4504-93ca-966ce4be9532 req-dadb1abc-4721-48c0-9b6f-16fcb14400b5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:01:27.927279 n-d-862964-3 devstack@n-api.service[121099]: DEBUG oslo_concurrency.lockutils [req-d7e2bf3e-b72a-4504-93ca-966ce4be9532 req-dadb1abc-4721-48c0-9b6f-16fcb14400b5 service nova] Lock "584133c9-70d9-4dbd-88ec-66308eedb7a2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:01:27.938238 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.compute.server_external_events [req-d7e2bf3e-b72a-4504-93ca-966ce4be9532 req-dadb1abc-4721-48c0-9b6f-16fcb14400b5 service nova] Creating event network-vif-plugged:5d27197f-9919-4f14-ad65-6a7a8ff2967b for instance 0a54df74-d792-42d5-837a-dcb693c57cee on n-h2-862964-3 Oct 29 02:01:27.943864 n-d-862964-3 devstack@n-api.service[121099]: INFO nova.api.openstack.requestlog [req-d7e2bf3e-b72a-4504-93ca-966ce4be9532 req-dadb1abc-4721-48c0-9b6f-16fcb14400b5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099670 Oct 29 02:01:27.944471 n-d-862964-3 devstack@n-api.service[121099]: [pid: 121099|app: 0|req: 3958/7700] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 29 02:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0)